-- Logs begin at Mon 2022-06-20 11:05:39 UTC, end at Mon 2022-06-20 13:34:44 UTC. -- Jun 20 11:45:22.230021 n-d-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Jun 20 11:45:22.238943 n-d-master-1 devstack@n-api.service[103811]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 20 11:45:22.240942 n-d-master-1 devstack@n-api.service[103811]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 20 11:45:22 2022] *** Jun 20 11:45:22.240942 n-d-master-1 devstack@n-api.service[103811]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 20 11:45:22.240942 n-d-master-1 devstack@n-api.service[103811]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 20 11:45:22.240942 n-d-master-1 devstack@n-api.service[103811]: nodename: n-d-master-1 Jun 20 11:45:22.240942 n-d-master-1 devstack@n-api.service[103811]: machine: x86_64 Jun 20 11:45:22.240942 n-d-master-1 devstack@n-api.service[103811]: clock source: unix Jun 20 11:45:22.240942 n-d-master-1 devstack@n-api.service[103811]: pcre jit disabled Jun 20 11:45:22.240942 n-d-master-1 devstack@n-api.service[103811]: detected number of CPU cores: 4 Jun 20 11:45:22.240942 n-d-master-1 devstack@n-api.service[103811]: current working directory: / Jun 20 11:45:22.240942 n-d-master-1 devstack@n-api.service[103811]: detected binary path: /usr/bin/uwsgi-core Jun 20 11:45:22.240942 n-d-master-1 devstack@n-api.service[103811]: your processes number limit is 47680 Jun 20 11:45:22.240942 n-d-master-1 devstack@n-api.service[103811]: your memory page size is 4096 bytes Jun 20 11:45:22.240942 n-d-master-1 devstack@n-api.service[103811]: detected max file descriptor number: 2048 Jun 20 11:45:22.240942 n-d-master-1 devstack@n-api.service[103811]: lock engine: pthread robust mutexes Jun 20 11:45:22.241872 n-d-master-1 devstack@n-api.service[103811]: thunder lock: enabled Jun 20 11:45:22.241872 n-d-master-1 devstack@n-api.service[103811]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 20 11:45:22.241872 n-d-master-1 devstack@n-api.service[103811]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 20 11:45:22.284579 n-d-master-1 devstack@n-api.service[103811]: Python main interpreter initialized at 0x55bde1f3f9c0 Jun 20 11:45:22.284579 n-d-master-1 devstack@n-api.service[103811]: python threads support enabled Jun 20 11:45:22.284579 n-d-master-1 devstack@n-api.service[103811]: your server socket listen backlog is limited to 100 connections Jun 20 11:45:22.284579 n-d-master-1 devstack@n-api.service[103811]: your mercy for graceful operations on workers is 90 seconds Jun 20 11:45:22.284983 n-d-master-1 devstack@n-api.service[103811]: mapped 403077 bytes (393 KB) for 2 cores Jun 20 11:45:22.284983 n-d-master-1 devstack@n-api.service[103811]: *** Operational MODE: preforking *** Jun 20 11:45:22.285212 n-d-master-1 devstack@n-api.service[103811]: *** uWSGI is running in multiple interpreter mode *** Jun 20 11:45:22.285212 n-d-master-1 devstack@n-api.service[103811]: spawned uWSGI master process (pid: 103811) Jun 20 11:45:22.285439 n-d-master-1 systemd[1]: Started Devstack devstack@n-api.service. Jun 20 11:45:22.289244 n-d-master-1 devstack@n-api.service[103811]: spawned uWSGI worker 1 (pid: 103812, cores: 1) Jun 20 11:45:22.289244 n-d-master-1 devstack@n-api.service[103811]: spawned uWSGI worker 2 (pid: 103813, cores: 1) Jun 20 11:45:22.289244 n-d-master-1 devstack@n-api.service[103811]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 20 11:45:22.942055 n-d-master-1 devstack@n-api.service[103812]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 20 11:45:22.958079 n-d-master-1 devstack@n-api.service[103813]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 20 11:45:24.061002 n-d-master-1 devstack@n-api.service[103813]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 11:45:24.061002 n-d-master-1 devstack@n-api.service[103813]: from cryptography.utils import int_from_bytes Jun 20 11:45:24.061769 n-d-master-1 devstack@n-api.service[103813]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 11:45:24.061769 n-d-master-1 devstack@n-api.service[103813]: from cryptography.utils import int_from_bytes Jun 20 11:45:24.064535 n-d-master-1 devstack@n-api.service[103812]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 11:45:24.064535 n-d-master-1 devstack@n-api.service[103812]: from cryptography.utils import int_from_bytes Jun 20 11:45:24.064990 n-d-master-1 devstack@n-api.service[103812]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 11:45:24.064990 n-d-master-1 devstack@n-api.service[103812]: from cryptography.utils import int_from_bytes Jun 20 11:45:26.526861 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 11:45:26.527458 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 11:45:26.527545 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 11:45:26.527545 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 11:45:26.527969 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 11:45:26.528050 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 11:45:26.528123 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 11:45:26.528236 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 11:45:26.528329 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 11:45:26.528596 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 11:45:26.528741 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.528903 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.529009 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.529249 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.529391 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.529561 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.529705 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.529882 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.530013 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.530189 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.530356 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.530444 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.530537 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.530762 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.530893 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.531093 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.531186 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.531344 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.531447 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.531642 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.531778 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.531950 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.532052 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.532286 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.532397 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.532612 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.532715 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.532910 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.533013 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.533217 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.533306 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.533514 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.533612 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.533794 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.533877 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.534092 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.534176 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.534394 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.534585 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.534891 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.535846 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.535971 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.536101 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.536185 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.536282 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.536418 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.536588 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.536677 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.536801 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.536881 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.536965 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.537055 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.537141 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.537227 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.537315 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.537392 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.537512 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.537601 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.537688 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.537882 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.538063 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.538269 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.538358 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.538577 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.538671 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.538885 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.538973 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.539194 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.539331 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.539584 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.539677 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.539890 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.540017 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.540192 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.540388 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.540604 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.540737 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.540910 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.541160 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.541286 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.541528 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.541624 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.541844 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.541941 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.542155 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.542251 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.542450 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.542536 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.542756 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.542885 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.543055 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.543144 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.543359 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.543446 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.543654 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.543737 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.543953 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.544039 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.544218 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.544318 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.544520 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.544605 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.544791 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.544880 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.545094 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.545179 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.545413 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.545497 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.545664 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.545758 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.545909 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.546029 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.546218 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.546309 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.546510 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.546601 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.546817 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.546905 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.547118 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.547204 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.547417 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.547500 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.547714 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.547797 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.548012 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.548109 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.548332 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.548420 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.548631 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.548714 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.548929 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.549022 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.549232 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.549315 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.549533 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.549617 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.549844 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.549937 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.550141 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.550224 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.550450 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.550534 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.550748 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.550843 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.551063 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.551148 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.551358 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.551442 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.551682 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.551775 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.551987 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.552094 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.552307 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.552395 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.552621 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.552706 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.552929 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.553018 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.553226 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.553309 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.553527 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.553621 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.553827 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.553910 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.554129 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.554213 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.554431 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.554516 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.554732 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.554814 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.554976 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.555069 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.555270 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.555356 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.555569 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.555654 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.555863 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.556119 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.556234 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.556315 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.556527 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.556648 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.556824 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.556918 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.557115 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.557199 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.557411 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.557493 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.557708 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.557800 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.558004 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.558087 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.558302 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.558384 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.558598 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.558690 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.558895 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.558980 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.559195 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.559278 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.559491 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.559582 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.559786 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.559869 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.560083 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.560166 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.560410 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.560497 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.560709 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.560832 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.561009 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.561094 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.561307 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.561400 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.561604 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.561695 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.561903 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.562011 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.562203 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.562306 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.562500 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.562584 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.562798 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.562883 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.563100 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.563192 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.563396 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.563479 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.563700 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.563783 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.563996 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.564087 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.564317 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.564406 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.564630 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.564715 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.564924 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.565055 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.565226 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.565317 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.565531 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.565615 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.565829 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.565921 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.566127 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.566220 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.566423 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.566506 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.566717 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.566810 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.567011 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.567101 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.567306 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.567398 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.567601 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.567684 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.568251 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.568343 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.568546 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.568646 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.568844 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.568927 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.569144 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.569238 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.569442 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.569533 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.569740 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.569824 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.570041 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.570125 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.570339 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.570431 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.570641 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.570726 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.570955 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:45:26.571040 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.571286 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.571377 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.571619 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.571728 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.571938 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.572027 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.572292 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.572412 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.572610 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.572725 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.572916 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.573021 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.573224 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.573323 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.573543 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.573628 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.573848 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.573947 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.574151 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.574234 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.574459 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.574543 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.574765 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.574856 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.575073 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.575157 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.575388 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.575494 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.575694 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.575786 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.576006 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.576090 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.576337 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.576436 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.576642 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.576738 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.576951 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.577037 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.577254 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.577337 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.577566 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.577659 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.577867 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.577957 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.578190 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.578273 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.578497 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.578591 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.578812 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.578895 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.579127 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.579210 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.579442 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.579528 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.579747 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.579831 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.580051 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.580135 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.580379 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.580482 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.580685 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.580780 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.580992 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.581076 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.581297 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.581418 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.581611 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.581706 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.581916 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.581999 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.582220 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.582305 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.582526 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.582627 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.582826 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.582922 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.583132 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.583217 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.583435 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.583520 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.583741 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.583836 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.584044 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.584175 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.584373 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.584460 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.584684 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.584778 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.584990 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.585073 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.585290 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.585373 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.585593 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.585691 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.585891 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.585982 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.586190 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.586274 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.586487 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.586583 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.586785 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.586875 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.587080 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.587191 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.587498 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.587590 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.587805 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.587901 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.588105 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.588188 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.588455 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.588541 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.588761 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.588845 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.589062 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.589146 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.589368 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.589473 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.589673 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.589764 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.589968 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.590052 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.590273 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.590356 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.590575 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.590666 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.590869 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.590960 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.591174 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.591257 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.591475 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.591558 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.591776 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.591873 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.592086 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.592170 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.592410 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.592508 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.592721 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.592827 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.593017 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.593101 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.593320 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.593443 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.593625 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.593721 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.593931 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.594016 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.594235 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.594318 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.594543 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.594636 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.594851 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.594942 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.595160 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.595245 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.595467 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.595566 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.595776 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.595860 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.596086 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.596169 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.596427 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.596563 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.596732 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.596862 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.597042 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.597171 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.597340 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.597472 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.597645 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.597774 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.597941 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.598079 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.598236 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.598376 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.598524 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.598664 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.598824 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.598963 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.599119 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.599248 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.599419 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.599550 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.599716 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.599853 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.600012 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.600142 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.600322 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.600540 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.600676 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.600819 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.600951 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.601080 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.601209 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.601335 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.601490 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.601618 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.601786 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.601911 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.602085 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.602213 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.602385 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.602520 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.602778 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.602938 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.603077 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.603203 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.603502 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.603650 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.603780 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.603905 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.604032 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.604169 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.604365 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.604490 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.604629 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.604761 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.604891 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.605033 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.605162 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.605291 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.605443 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.605571 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.605756 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.605897 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.606062 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.606192 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.606371 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.606509 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.606675 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.606814 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.606987 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.607143 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.607313 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.607453 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.607584 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.607722 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.607873 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.608014 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.608181 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.608334 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.608507 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.608642 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.608825 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.608954 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.609143 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.609276 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.609458 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.609585 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.609763 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.609890 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.610073 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.610205 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.610412 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.610550 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.610681 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.610818 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.610949 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.611080 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.611228 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.611372 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.611538 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.611672 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.611838 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.611977 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.612147 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.612294 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.612475 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.612601 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.612790 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.612928 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.613090 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.613219 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.613402 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.613485 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.613701 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.613793 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.614009 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.614094 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.614308 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.614400 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.614619 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.614712 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.614928 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.615020 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.615234 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.615319 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.615548 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.615640 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.615852 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.615943 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.616151 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.616288 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.616480 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.616566 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.616779 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.616862 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.617078 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.617168 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.617375 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.617466 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.617676 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.617760 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.617975 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.618058 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.618279 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.618416 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.618692 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.618793 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.619000 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.619084 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.619300 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.619386 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.619598 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.619682 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.619892 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.619986 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.620189 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.620293 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.620511 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.620597 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.620814 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.620910 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.621126 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.621211 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.621429 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.621519 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.621727 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.621819 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.622026 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.622110 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.622329 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.622412 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.622629 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.622755 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.622925 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.623014 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.623219 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.623304 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.623516 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.623610 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.623812 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.623945 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.624111 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.624552 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.624694 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.624859 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.625159 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.625469 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.625555 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.625786 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.625915 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.626091 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.626267 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.626402 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.626604 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.626711 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.626944 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.627037 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.627276 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.627361 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.627608 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.627743 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.627911 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.628003 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.628238 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.628325 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.628560 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.628656 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.628870 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.628962 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.629177 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.629261 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.629497 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.629593 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.629804 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.629888 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.630109 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.630193 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.630414 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.630506 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.630715 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.630837 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.631053 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.631146 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.631329 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.631428 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.631658 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.631895 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.631981 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.632243 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.632559 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.632648 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.632876 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.632969 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.633194 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.633280 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.633510 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.633599 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.633834 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.633924 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.634203 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.634539 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.634795 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.634898 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.635134 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.635226 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.635437 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.635521 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.635739 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.635832 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.636046 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.636144 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.636373 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.636459 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.636674 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.636771 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.636974 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.637060 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.637283 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.637368 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.637585 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.637668 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.637888 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.637972 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.638190 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.638275 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.638497 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.638581 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.638809 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.638894 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.639109 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.639193 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.639415 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.639508 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.639716 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.639801 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.640035 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.640120 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.640369 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.640470 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.640671 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.640756 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.640971 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.641056 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.641270 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.641362 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.641601 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.641729 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.641903 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.641987 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.642208 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.642300 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.642520 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.642606 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.642867 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.642952 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.643169 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.643253 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.643470 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.643561 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.643790 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.643873 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.644092 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.644180 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.644421 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.644521 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.644721 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.644806 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.645030 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.645115 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.645337 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.645420 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.645637 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.645734 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.645947 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.646039 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.646250 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.646335 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.646559 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.646651 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.646861 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.646945 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.647163 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.647247 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.647471 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.647563 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.647767 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.647858 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.648076 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.648169 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.648407 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.648509 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.648711 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.648803 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.649010 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.649094 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.649317 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.649402 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.649646 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.649735 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.649944 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.650251 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.650444 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.650550 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.650767 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.650851 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.651094 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.651178 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.651416 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.651508 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.651712 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.651795 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.652016 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.652100 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.652346 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.652436 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.652648 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.652732 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.652971 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.653069 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.653266 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.653349 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.653566 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.653649 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.653864 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.653989 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.654153 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.654250 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.654451 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.654544 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.654753 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.654847 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.655059 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.655152 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.655367 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.655453 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.655675 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.655766 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.655974 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.656059 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.656304 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.656391 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.656606 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.656692 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.656906 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.656991 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.657205 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.657290 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.657511 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.657597 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.657809 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.657893 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.658108 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.658192 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.658405 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.658490 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.658706 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.658796 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.659001 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.659084 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.659308 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.659393 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.659611 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.659694 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.659909 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.660005 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.660233 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.660319 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.660528 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.660622 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.660829 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.660927 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.661149 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.661232 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.661456 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.661539 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.661818 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.661926 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.662065 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.662150 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.662368 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.662453 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.662683 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.662779 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.662989 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.663073 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.663297 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.663381 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.663598 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.663780 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.663908 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.664000 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.664220 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.664348 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.664540 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.664626 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.664841 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.664924 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.665138 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.665420 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.665520 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.665821 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.665978 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.666118 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.666314 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.666407 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.666638 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.666724 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.666963 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.667048 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.667278 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.667370 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.667591 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.667684 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.667894 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.667978 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.668219 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.668324 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.668529 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.668614 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.668836 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.668920 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.669143 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.669236 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.669449 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.669550 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.669760 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.669862 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.670062 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.670156 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.670368 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.670453 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.670671 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.670755 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.670975 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.671134 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.671281 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.671366 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.671581 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.671665 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.671895 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.672033 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.672211 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.672310 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.672516 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.672603 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.672823 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.672912 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.673124 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.673217 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.673428 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.673514 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.673730 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.673874 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.674030 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.674156 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.674354 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.674494 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.674668 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.674801 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.674975 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.675107 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.675285 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.675424 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.675590 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.675719 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.675897 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.676032 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.676218 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.676358 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.676525 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.676665 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.676938 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.677070 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.677248 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.677387 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.677550 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.677680 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.677854 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.677985 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.678155 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.678367 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.678506 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.678637 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.678778 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.678908 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.679046 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.679177 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.679338 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.679469 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.679638 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.679765 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.679937 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.680075 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.680279 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.680369 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.680582 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.680666 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.680987 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.681326 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.681414 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.681633 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.681758 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.681933 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.682087 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.682340 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.682426 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.682645 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.682731 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.682953 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.683039 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.683271 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.683355 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.683586 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.683669 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.683905 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.683997 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.684239 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.684354 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.684536 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.684677 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.684841 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.684988 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.685162 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.685408 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.685502 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.685729 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.685839 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.686048 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.686141 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.686347 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.686447 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.686663 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.686749 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.686980 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.687073 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.687287 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.687379 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.687603 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.687695 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.687915 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.687999 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.688265 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.688352 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.688597 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.688693 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.688911 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.688998 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.689230 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.689321 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.689533 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.689624 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.689834 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.689927 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.690140 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.690224 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.690441 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.690525 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.690744 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.690830 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.691059 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.691164 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.691359 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.691492 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.691665 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.691807 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.691973 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.692135 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.692304 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.692488 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.692608 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.693109 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.693229 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.693426 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.693547 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.693743 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.693850 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.694054 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.694155 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.694362 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.694486 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.694687 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.694779 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.694994 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.695086 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.695314 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.695408 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.695628 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.695721 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.695938 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.696031 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.696254 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.696354 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.696605 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.696809 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.696894 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.697233 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.697429 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.697526 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.697744 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.697828 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.698071 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.698157 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.698391 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.698489 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.698720 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.698806 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.699044 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.699130 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.699353 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.699439 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.699678 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.699762 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.699989 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.700072 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.700326 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.700414 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.700627 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.700711 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.700934 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.701052 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.701241 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.701335 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.701542 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.701632 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.701845 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.701929 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.702146 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.702271 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.702453 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.702546 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.702753 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.702900 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.703054 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.703138 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.703354 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.703445 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.703671 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.703764 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.703971 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.704056 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.704314 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.704404 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.704623 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.704721 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.704926 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.705011 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.705230 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.705314 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.705533 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.705626 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.705845 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.705936 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.706152 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.706244 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.706465 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.706551 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.706770 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.706861 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.707077 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.707161 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.707384 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.707470 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.707690 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.707781 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.707999 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.708091 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.708333 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.708421 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.708650 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.708734 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.708957 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.709040 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.709262 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.709346 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.709566 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.709651 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.709874 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.709971 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.710183 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.710268 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.710489 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.710580 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.710802 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.710899 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.711113 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.711206 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.711428 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.711513 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.711742 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.711939 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.712099 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.712315 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.712632 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.712903 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.712988 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.713232 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.713325 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.713538 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.713622 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.713849 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.713942 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.714160 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.714245 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.714470 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.714554 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.714781 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.714883 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.715088 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.715180 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.715405 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.715490 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.715720 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.715817 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.716039 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.716130 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.716399 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.716640 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.716743 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.716975 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.717061 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.717296 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.717384 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.717606 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.717707 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.717921 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.718014 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.718239 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.718324 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.718548 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.718711 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.718861 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.718945 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.719174 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.719258 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.719484 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.719569 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.719788 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.719872 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.720096 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.720189 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.720435 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.720524 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.720749 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.720834 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.721059 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.721151 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.721366 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.721452 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.721677 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.721762 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.721987 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.722081 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.722301 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.722392 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.722630 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.722730 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.722949 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.723042 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.723254 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.723346 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.723561 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.723645 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.723874 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.723960 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.724184 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.724408 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.724519 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.724722 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.724865 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.725052 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.725139 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.725375 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.725461 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.725697 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.725795 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.726008 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.726100 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.726320 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.726412 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.726630 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.726755 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.726928 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.727014 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.727227 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.727311 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.727534 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.727620 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.727985 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.728094 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.728321 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.728649 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.728782 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.728959 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.729109 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.729263 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.729580 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.729665 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.729888 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.729973 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.730257 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.730413 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.730586 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.730757 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.730912 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.731070 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.731262 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.731395 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.731552 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.731718 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.731882 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.732031 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.732191 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.732364 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.732526 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.732688 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.732841 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.732991 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.733153 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.733294 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.733463 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.733606 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.733791 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.733915 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.734104 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.734216 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.734412 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.734519 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.734735 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.734821 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.735049 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.735142 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.735400 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.735588 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.735706 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.735938 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.736033 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.736304 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.736407 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.736629 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.736721 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.736932 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.737021 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.737232 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.737329 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.737539 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.737624 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.737841 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.737975 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.738144 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.738280 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.738447 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.738575 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.738743 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.738878 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.739050 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.739179 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.739348 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.739477 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.739648 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.739775 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.739945 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.740083 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.740275 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.740404 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.740579 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.740712 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.740887 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.741026 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.741192 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.741324 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.741519 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.741660 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.741824 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.741954 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.742124 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.742264 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.742429 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.742567 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.742733 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.742820 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.743036 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.743122 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.743368 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.743465 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.743680 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.744100 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.744193 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.744439 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.744525 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.744759 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.744963 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.745070 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.745295 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.745380 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.745617 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.745703 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.745950 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.746037 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.746271 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.746355 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.746573 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.746658 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.746879 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.746964 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.747181 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.747268 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.747503 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.747590 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.747811 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.747902 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.748119 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.748235 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.748454 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.748542 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.748761 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.748845 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.749069 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.749167 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.749377 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.749462 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.749682 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.749769 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.749990 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.750084 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.750294 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.750531 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.750625 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.750867 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.750964 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.751178 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.751263 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.751485 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.751571 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.751794 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.751888 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.752118 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.752246 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.752451 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.752536 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.752760 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.752859 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.753067 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.753152 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.753381 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.753473 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.753690 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.753783 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.753996 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.754081 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.754301 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.754385 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.754607 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.754700 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.754917 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.755001 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.755227 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.755320 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.755537 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.755629 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.755839 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.755924 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.756148 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.756271 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.756569 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.756656 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.756886 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.756978 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.757193 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.757291 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.757494 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.757580 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.757813 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.757945 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.758131 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.758225 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.758443 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.758528 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.758756 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.758850 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.759144 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.759394 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.759799 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.759885 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.760119 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.760249 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.760472 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.760575 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.760787 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.760872 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.761101 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.761184 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.761406 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.761499 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.761708 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.761793 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.762016 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.762102 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.762335 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.762428 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.762645 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.762730 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.762946 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.763031 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.763247 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.763364 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.763554 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.763644 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.763851 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.763945 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.764152 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.764287 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.764477 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.764602 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.764776 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.764929 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.765081 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.765247 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.765379 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.765583 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.765668 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.765925 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.766011 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.766244 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.766327 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.766542 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.766626 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.766840 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.766925 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.767145 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.767237 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.767442 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.767536 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.767740 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.767825 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.768037 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.768122 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.768359 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.768464 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.768661 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.768746 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.768964 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.769055 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.769276 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.769371 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.769585 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.769670 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.769894 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.769979 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.770197 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.770282 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.770499 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.770591 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.770803 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.770898 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.771102 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.771187 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.771406 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.771491 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.771713 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.771797 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.772014 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.772099 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.772337 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.772436 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.772645 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.772731 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.772954 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.773048 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.773256 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.773342 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.773564 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.773686 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.773861 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.773991 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.774165 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.774433 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.774534 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.775038 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.775259 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.775365 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.775608 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.775703 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.775954 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.776048 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.776299 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.776399 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.776614 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.776700 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.776967 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.777071 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.777241 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.777333 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.777544 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.777636 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.777853 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.777940 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.778164 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.778249 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.778470 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.778563 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.778781 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.778867 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.779094 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.779199 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.779401 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.779486 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.779711 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.779807 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.780024 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.780117 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.780355 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.780459 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.780666 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.780750 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.780979 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.781073 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.781305 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.781399 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.781610 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.781700 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.781928 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.782012 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.782253 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.782347 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.782561 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.782645 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.782869 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.782954 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.783170 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.783270 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.783414 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 11:45:26.783499 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.783786 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.784096 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.784433 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.784750 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.785063 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.785376 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.785700 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.786017 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.786344 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.786670 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.786980 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.787305 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.787633 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.787979 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.788447 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.788794 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.789121 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.789480 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.789748 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.790053 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:45:26.790556 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103813) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 11:45:26.860434 n-d-master-1 devstack@n-api.service[103813]: INFO dbcounter [None req-9b766ba3-91e8-42ac-b647-5460229b995e None None] Registered counter for database nova_api Jun 20 11:45:26.937774 n-d-master-1 devstack@n-api.service[103812]: INFO dbcounter [None req-f2007005-62ed-46be-b772-aa528b0683d5 None None] Registered counter for database nova_api Jun 20 11:45:26.959330 n-d-master-1 devstack@n-api.service[103812]: DEBUG oslo_db.sqlalchemy.engines [None req-f2007005-62ed-46be-b772-aa528b0683d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103812) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 11:45:26.966849 n-d-master-1 devstack@n-api.service[103812]: DEBUG dbcounter [-] [103812] Writer thread running {{(pid=103812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 11:45:26.976008 n-d-master-1 devstack@n-api.service[103813]: DEBUG oslo_db.sqlalchemy.engines [None req-9b766ba3-91e8-42ac-b647-5460229b995e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103813) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 11:45:26.983546 n-d-master-1 devstack@n-api.service[103813]: DEBUG dbcounter [-] [103813] Writer thread running {{(pid=103813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 11:45:27.023570 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.context [None req-f2007005-62ed-46be-b772-aa528b0683d5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d5df985c-a080-4240-bcef-1787de3aeb9e(cell1) {{(pid=103812) load_cells /opt/stack/nova/nova/context.py:464}} Jun 20 11:45:27.027660 n-d-master-1 devstack@n-api.service[103812]: DEBUG oslo_concurrency.lockutils [None req-f2007005-62ed-46be-b772-aa528b0683d5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:45:27.029208 n-d-master-1 devstack@n-api.service[103812]: DEBUG oslo_concurrency.lockutils [None req-f2007005-62ed-46be-b772-aa528b0683d5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:45:27.029990 n-d-master-1 devstack@n-api.service[103812]: DEBUG oslo_concurrency.lockutils [None req-f2007005-62ed-46be-b772-aa528b0683d5 None None] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:45:27.031931 n-d-master-1 devstack@n-api.service[103812]: DEBUG oslo_concurrency.lockutils [None req-f2007005-62ed-46be-b772-aa528b0683d5 None None] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:45:27.033939 n-d-master-1 devstack@n-api.service[103812]: INFO dbcounter [None req-f2007005-62ed-46be-b772-aa528b0683d5 None None] Registered counter for database nova_cell0 Jun 20 11:45:27.037946 n-d-master-1 devstack@n-api.service[103812]: INFO dbcounter [None req-f2007005-62ed-46be-b772-aa528b0683d5 None None] Registered counter for database nova_cell1 Jun 20 11:45:27.041632 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.context [None req-9b766ba3-91e8-42ac-b647-5460229b995e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d5df985c-a080-4240-bcef-1787de3aeb9e(cell1) {{(pid=103813) load_cells /opt/stack/nova/nova/context.py:464}} Jun 20 11:45:27.045456 n-d-master-1 devstack@n-api.service[103812]: DEBUG oslo_db.sqlalchemy.engines [None req-f2007005-62ed-46be-b772-aa528b0683d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103812) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 11:45:27.045715 n-d-master-1 devstack@n-api.service[103813]: DEBUG oslo_concurrency.lockutils [None req-9b766ba3-91e8-42ac-b647-5460229b995e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:45:27.046917 n-d-master-1 devstack@n-api.service[103812]: DEBUG oslo_db.sqlalchemy.engines [None req-f2007005-62ed-46be-b772-aa528b0683d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103812) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 11:45:27.047327 n-d-master-1 devstack@n-api.service[103813]: DEBUG oslo_concurrency.lockutils [None req-9b766ba3-91e8-42ac-b647-5460229b995e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:45:27.048155 n-d-master-1 devstack@n-api.service[103813]: DEBUG oslo_concurrency.lockutils [None req-9b766ba3-91e8-42ac-b647-5460229b995e None None] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:45:27.050288 n-d-master-1 devstack@n-api.service[103813]: DEBUG oslo_concurrency.lockutils [None req-9b766ba3-91e8-42ac-b647-5460229b995e None None] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:45:27.052309 n-d-master-1 devstack@n-api.service[103813]: INFO dbcounter [None req-9b766ba3-91e8-42ac-b647-5460229b995e None None] Registered counter for database nova_cell0 Jun 20 11:45:27.053556 n-d-master-1 devstack@n-api.service[103812]: DEBUG dbcounter [-] [103812] Writer thread running {{(pid=103812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 11:45:27.055012 n-d-master-1 devstack@n-api.service[103812]: DEBUG dbcounter [-] [103812] Writer thread running {{(pid=103812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 11:45:27.057207 n-d-master-1 devstack@n-api.service[103813]: INFO dbcounter [None req-9b766ba3-91e8-42ac-b647-5460229b995e None None] Registered counter for database nova_cell1 Jun 20 11:45:27.064751 n-d-master-1 devstack@n-api.service[103813]: DEBUG oslo_db.sqlalchemy.engines [None req-9b766ba3-91e8-42ac-b647-5460229b995e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103813) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 11:45:27.068318 n-d-master-1 devstack@n-api.service[103813]: DEBUG oslo_db.sqlalchemy.engines [None req-9b766ba3-91e8-42ac-b647-5460229b995e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103813) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 11:45:27.072081 n-d-master-1 devstack@n-api.service[103813]: DEBUG dbcounter [-] [103813] Writer thread running {{(pid=103813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 11:45:27.209353 n-d-master-1 devstack@n-api.service[103812]: INFO dbcounter [None req-f2007005-62ed-46be-b772-aa528b0683d5 None None] Registered counter for database nova_cell0 Jun 20 11:45:27.212965 n-d-master-1 devstack@n-api.service[103813]: DEBUG dbcounter [-] [103813] Writer thread running {{(pid=103813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 11:45:27.219164 n-d-master-1 devstack@n-api.service[103812]: DEBUG oslo_db.sqlalchemy.engines [None req-f2007005-62ed-46be-b772-aa528b0683d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103812) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 11:45:27.222510 n-d-master-1 devstack@n-api.service[103813]: INFO dbcounter [None req-9b766ba3-91e8-42ac-b647-5460229b995e None None] Registered counter for database nova_cell0 Jun 20 11:45:27.224299 n-d-master-1 devstack@n-api.service[103812]: DEBUG dbcounter [-] [103812] Writer thread running {{(pid=103812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 11:45:27.233099 n-d-master-1 devstack@n-api.service[103813]: DEBUG oslo_db.sqlalchemy.engines [None req-9b766ba3-91e8-42ac-b647-5460229b995e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103813) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 11:45:27.237348 n-d-master-1 devstack@n-api.service[103813]: DEBUG dbcounter [-] [103813] Writer thread running {{(pid=103813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 11:45:27.559570 n-d-master-1 devstack@n-api.service[103813]: WARNING keystonemiddleware.auth_token [None req-9b766ba3-91e8-42ac-b647-5460229b995e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 11:45:27.564396 n-d-master-1 devstack@n-api.service[103812]: WARNING keystonemiddleware.auth_token [None req-f2007005-62ed-46be-b772-aa528b0683d5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 11:45:27.566982 n-d-master-1 devstack@n-api.service[103813]: WARNING keystonemiddleware.auth_token [None req-9b766ba3-91e8-42ac-b647-5460229b995e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 11:45:27.571874 n-d-master-1 devstack@n-api.service[103812]: WARNING keystonemiddleware.auth_token [None req-f2007005-62ed-46be-b772-aa528b0683d5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 11:45:27.906355 n-d-master-1 devstack@n-api.service[103813]: WARNING keystonemiddleware.auth_token [None req-9b766ba3-91e8-42ac-b647-5460229b995e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 11:45:27.911771 n-d-master-1 devstack@n-api.service[103812]: WARNING keystonemiddleware.auth_token [None req-f2007005-62ed-46be-b772-aa528b0683d5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 11:45:27.912358 n-d-master-1 devstack@n-api.service[103813]: WARNING keystonemiddleware.auth_token [None req-9b766ba3-91e8-42ac-b647-5460229b995e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 11:45:27.917511 n-d-master-1 devstack@n-api.service[103813]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bde1f3f9c0 pid: 103813 (default app) Jun 20 11:45:27.917810 n-d-master-1 devstack@n-api.service[103812]: WARNING keystonemiddleware.auth_token [None req-f2007005-62ed-46be-b772-aa528b0683d5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 11:45:27.919796 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-9b766ba3-91e8-42ac-b647-5460229b995e None None] Calling method '>' {{(pid=103813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:45:27.921048 n-d-master-1 devstack@n-api.service[103813]: INFO nova.api.openstack.requestlog [None req-9b766ba3-91e8-42ac-b647-5460229b995e None None] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002021 Jun 20 11:45:27.921442 n-d-master-1 devstack@n-api.service[103813]: [pid: 103813|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 788 bytes} [Mon Jun 20 11:45:27 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:45:27.923178 n-d-master-1 devstack@n-api.service[103812]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bde1f3f9c0 pid: 103812 (default app) Jun 20 11:46:43.312767 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-9b766ba3-91e8-42ac-b647-5460229b995e None None] Calling method '>' {{(pid=103813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:46:43.314522 n-d-master-1 devstack@n-api.service[103813]: INFO nova.api.openstack.requestlog [None req-9b766ba3-91e8-42ac-b647-5460229b995e None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002165 Jun 20 11:46:43.315234 n-d-master-1 devstack@n-api.service[103813]: [pid: 103813|app: 0|req: 2/2] 10.222.0.27 () {54 vars in 930 bytes} [Mon Jun 20 11:46:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:46:43.329439 n-d-master-1 devstack@n-api.service[103812]: DEBUG dbcounter [-] [103812] Writing DB stats nova_api:SELECT=3 {{(pid=103812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:46:43.330981 n-d-master-1 devstack@n-api.service[103812]: DEBUG dbcounter [-] [103812] Writing DB stats nova_cell0:SELECT=3 {{(pid=103812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:46:43.332337 n-d-master-1 devstack@n-api.service[103812]: DEBUG dbcounter [-] [103812] Writing DB stats nova_cell1:SELECT=3 {{(pid=103812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:46:43.333466 n-d-master-1 devstack@n-api.service[103812]: DEBUG dbcounter [-] [103812] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:46:43.768628 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-e24d1b83-1e74-4440-b62e-fe03cde0f22e admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:46:43.799292 n-d-master-1 devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-e24d1b83-1e74-4440-b62e-fe03cde0f22e admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.476433 Jun 20 11:46:43.800080 n-d-master-1 devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 1/3] 10.222.0.27 () {60 vars in 1291 bytes} [Mon Jun 20 11:46:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:46:45.855761 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-9b766ba3-91e8-42ac-b647-5460229b995e None None] Calling method '>' {{(pid=103813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:46:45.856905 n-d-master-1 devstack@n-api.service[103813]: INFO nova.api.openstack.requestlog [None req-9b766ba3-91e8-42ac-b647-5460229b995e None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001585 Jun 20 11:46:45.857621 n-d-master-1 devstack@n-api.service[103813]: [pid: 103813|app: 0|req: 3/4] 10.222.0.27 () {54 vars in 930 bytes} [Mon Jun 20 11:46:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:46:45.919405 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-fcbb2ca0-2df7-4fb2-a0d6-a4c172088b6d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "swap": 0, "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "c1", "vcpus": 1, "name": "cirros256"}} {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:46:45.939118 n-d-master-1 devstack@n-api.service[103812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:46:45.939118 n-d-master-1 devstack@n-api.service[103812]: warnings.warn(msg) Jun 20 11:46:45.973001 n-d-master-1 devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-fcbb2ca0-2df7-4fb2-a0d6-a4c172088b6d admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.109313 Jun 20 11:46:45.974192 n-d-master-1 devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 2/5] 10.222.0.27 () {64 vars in 1282 bytes} [Mon Jun 20 11:46:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 11:46:45.987950 n-d-master-1 devstack@n-api.service[103813]: DEBUG dbcounter [-] [103813] Writing DB stats nova_api:SELECT=3 {{(pid=103813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:46:45.988936 n-d-master-1 devstack@n-api.service[103813]: DEBUG dbcounter [-] [103813] Writing DB stats nova_cell0:SELECT=3 {{(pid=103813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:46:45.989804 n-d-master-1 devstack@n-api.service[103813]: DEBUG dbcounter [-] [103813] Writing DB stats nova_cell1:SELECT=3 {{(pid=103813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:46:45.990720 n-d-master-1 devstack@n-api.service[103813]: DEBUG dbcounter [-] [103813] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:46:46.202052 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-d0d68d2c-9a5a-458a-b6b5-8bfddf47e80b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:46:46.204752 n-d-master-1 devstack@n-api.service[103813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:46:46.204752 n-d-master-1 devstack@n-api.service[103813]: warnings.warn(msg) Jun 20 11:46:46.274459 n-d-master-1 devstack@n-api.service[103813]: INFO nova.api.openstack.requestlog [None req-d0d68d2c-9a5a-458a-b6b5-8bfddf47e80b admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.292086 Jun 20 11:46:46.275259 n-d-master-1 devstack@n-api.service[103813]: [pid: 103813|app: 0|req: 4/6] 10.222.0.27 () {64 vars in 1335 bytes} [Mon Jun 20 11:46:45 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:46:48.352224 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-fcbb2ca0-2df7-4fb2-a0d6-a4c172088b6d admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:46:48.353275 n-d-master-1 devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-fcbb2ca0-2df7-4fb2-a0d6-a4c172088b6d admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001611 Jun 20 11:46:48.353696 n-d-master-1 devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 3/7] 10.222.0.27 () {54 vars in 930 bytes} [Mon Jun 20 11:46:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:46:48.462792 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-16938138-4cc5-4e2b-b47a-4c524c657bc8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0, "disk": 5, "vcpus": 1, "name": "ds512M"}} {{(pid=103813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:46:48.481371 n-d-master-1 devstack@n-api.service[103813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:46:48.481371 n-d-master-1 devstack@n-api.service[103813]: warnings.warn(msg) Jun 20 11:46:48.501207 n-d-master-1 devstack@n-api.service[103813]: INFO nova.api.openstack.requestlog [None req-16938138-4cc5-4e2b-b47a-4c524c657bc8 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.141563 Jun 20 11:46:48.501771 n-d-master-1 devstack@n-api.service[103813]: [pid: 103813|app: 0|req: 5/8] 10.222.0.27 () {64 vars in 1282 bytes} [Mon Jun 20 11:46:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:46:48.513680 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-de7f6d86-9425-4b62-ba74-f056d1111106 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:46:48.515132 n-d-master-1 devstack@n-api.service[103812]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:46:48.515132 n-d-master-1 devstack@n-api.service[103812]: warnings.warn(msg) Jun 20 11:46:48.550519 n-d-master-1 devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-de7f6d86-9425-4b62-ba74-f056d1111106 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040473 Jun 20 11:46:48.551369 n-d-master-1 devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 4/9] 10.222.0.27 () {64 vars in 1335 bytes} [Mon Jun 20 11:46:48 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:46:50.636496 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-16938138-4cc5-4e2b-b47a-4c524c657bc8 admin admin] Calling method '>' {{(pid=103813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:46:50.637520 n-d-master-1 devstack@n-api.service[103813]: INFO nova.api.openstack.requestlog [None req-16938138-4cc5-4e2b-b47a-4c524c657bc8 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001588 Jun 20 11:46:50.638094 n-d-master-1 devstack@n-api.service[103813]: [pid: 103813|app: 0|req: 6/10] 10.222.0.27 () {54 vars in 930 bytes} [Mon Jun 20 11:46:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:46:50.733853 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-cb91b57b-5e2d-46b4-8682-dd6ba799ae78 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "vcpus": 1, "id": "d2", "ram": 1024, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds1G"}} {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:46:50.762440 n-d-master-1 devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-cb91b57b-5e2d-46b4-8682-dd6ba799ae78 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.117235 Jun 20 11:46:50.763649 n-d-master-1 devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 5/11] 10.222.0.27 () {64 vars in 1282 bytes} [Mon Jun 20 11:46:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 11:46:50.779952 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-a3f9980a-3ba5-4e81-9d0d-a5d083397225 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:46:50.816906 n-d-master-1 devstack@n-api.service[103813]: INFO nova.api.openstack.requestlog [None req-a3f9980a-3ba5-4e81-9d0d-a5d083397225 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043458 Jun 20 11:46:50.819026 n-d-master-1 devstack@n-api.service[103813]: [pid: 103813|app: 0|req: 7/12] 10.222.0.27 () {64 vars in 1335 bytes} [Mon Jun 20 11:46:50 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:46:53.037374 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-cb91b57b-5e2d-46b4-8682-dd6ba799ae78 admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:46:53.038406 n-d-master-1 devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-cb91b57b-5e2d-46b4-8682-dd6ba799ae78 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jun 20 11:46:53.044134 n-d-master-1 devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 6/13] 10.222.0.27 () {54 vars in 930 bytes} [Mon Jun 20 11:46:53 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:46:53.100844 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-27d992d0-92e7-4794-bfa6-849a2b6c8289 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 2, "rxtx_factor": 1.0, "swap": 0, "name": "ds2G", "id": "d3", "disk": 10, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:46:53.132235 n-d-master-1 devstack@n-api.service[103813]: INFO nova.api.openstack.requestlog [None req-27d992d0-92e7-4794-bfa6-849a2b6c8289 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.084262 Jun 20 11:46:53.132235 n-d-master-1 devstack@n-api.service[103813]: [pid: 103813|app: 0|req: 8/14] 10.222.0.27 () {64 vars in 1282 bytes} [Mon Jun 20 11:46:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:46:53.142431 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-907e2b0c-12a2-457f-9ca7-904cc82ae763 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:46:53.180762 n-d-master-1 devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-907e2b0c-12a2-457f-9ca7-904cc82ae763 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039706 Jun 20 11:46:53.193234 n-d-master-1 devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 7/15] 10.222.0.27 () {64 vars in 1335 bytes} [Mon Jun 20 11:46:53 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:46:55.329301 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-27d992d0-92e7-4794-bfa6-849a2b6c8289 admin admin] Calling method '>' {{(pid=103813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:46:55.330313 n-d-master-1 devstack@n-api.service[103813]: INFO nova.api.openstack.requestlog [None req-27d992d0-92e7-4794-bfa6-849a2b6c8289 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Jun 20 11:46:55.330840 n-d-master-1 devstack@n-api.service[103813]: [pid: 103813|app: 0|req: 9/16] 10.222.0.27 () {54 vars in 930 bytes} [Mon Jun 20 11:46:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:46:55.391809 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-a5cede8e-b65e-4189-a6d4-6caad0d648d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "disk": 20, "ram": 4096, "vcpus": 4, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d4", "os-flavor-access:is_public": true}} {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:46:55.412503 n-d-master-1 devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-a5cede8e-b65e-4189-a6d4-6caad0d648d3 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075253 Jun 20 11:46:55.420864 n-d-master-1 devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 8/17] 10.222.0.27 () {64 vars in 1282 bytes} [Mon Jun 20 11:46:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:46:55.425127 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-9238513b-0818-4d36-96e3-7425fc53ae97 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:46:55.451541 n-d-master-1 devstack@n-api.service[103813]: INFO nova.api.openstack.requestlog [None req-9238513b-0818-4d36-96e3-7425fc53ae97 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029754 Jun 20 11:46:55.452148 n-d-master-1 devstack@n-api.service[103813]: [pid: 103813|app: 0|req: 10/18] 10.222.0.27 () {64 vars in 1335 bytes} [Mon Jun 20 11:46:55 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:46:57.520111 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-a5cede8e-b65e-4189-a6d4-6caad0d648d3 admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:46:57.521331 n-d-master-1 devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-a5cede8e-b65e-4189-a6d4-6caad0d648d3 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001721 Jun 20 11:46:57.521988 n-d-master-1 devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 9/19] 10.222.0.27 () {54 vars in 930 bytes} [Mon Jun 20 11:46:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:46:57.601807 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-57a24c9a-c6a1-4f5d-ab6a-f3bf8d422024 admin admin] Calling method '>' {{(pid=103813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:46:57.628379 n-d-master-1 devstack@n-api.service[103813]: INFO nova.api.openstack.requestlog [None req-57a24c9a-c6a1-4f5d-ab6a-f3bf8d422024 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.099816 Jun 20 11:46:57.629360 n-d-master-1 devstack@n-api.service[103813]: [pid: 103813|app: 0|req: 11/20] 10.222.0.27 () {60 vars in 1291 bytes} [Mon Jun 20 11:46:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:46:59.793466 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-a5cede8e-b65e-4189-a6d4-6caad0d648d3 admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:46:59.794530 n-d-master-1 devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-a5cede8e-b65e-4189-a6d4-6caad0d648d3 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Jun 20 11:46:59.794941 n-d-master-1 devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 10/21] 10.222.0.27 () {54 vars in 930 bytes} [Mon Jun 20 11:46:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:46:59.858121 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-ce344ba7-694b-41ce-aca2-618dce97ed38 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "os-flavor-access:is_public": true, "ram": 512, "disk": 1, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:46:59.880782 n-d-master-1 devstack@n-api.service[103813]: INFO nova.api.openstack.requestlog [None req-ce344ba7-694b-41ce-aca2-618dce97ed38 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.079653 Jun 20 11:46:59.895187 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-965d0845-a98b-4976-a291-848c40222282 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:46:59.900314 n-d-master-1 devstack@n-api.service[103813]: [pid: 103813|app: 0|req: 12/22] 10.222.0.27 () {64 vars in 1282 bytes} [Mon Jun 20 11:46:59 2022] POST /compute/v2.1/flavors => generated 402 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:46:59.924572 n-d-master-1 devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-965d0845-a98b-4976-a291-848c40222282 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033393 Jun 20 11:46:59.925437 n-d-master-1 devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 11/23] 10.222.0.27 () {64 vars in 1332 bytes} [Mon Jun 20 11:46:59 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:47:02.062518 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-ce344ba7-694b-41ce-aca2-618dce97ed38 admin admin] Calling method '>' {{(pid=103813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:47:02.064306 n-d-master-1 devstack@n-api.service[103813]: INFO nova.api.openstack.requestlog [None req-ce344ba7-694b-41ce-aca2-618dce97ed38 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002189 Jun 20 11:47:02.075686 n-d-master-1 devstack@n-api.service[103813]: [pid: 103813|app: 0|req: 13/24] 10.222.0.27 () {54 vars in 930 bytes} [Mon Jun 20 11:47:02 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:47:02.133292 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-bbda4695-1549-4185-b777-271cbcc915f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "id": "2", "disk": 20, "rxtx_factor": 1.0, "name": "m1.small", "os-flavor-access:is_public": true}} {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:47:02.155588 n-d-master-1 devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-bbda4695-1549-4185-b777-271cbcc915f6 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.084060 Jun 20 11:47:02.156561 n-d-master-1 devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 12/25] 10.222.0.27 () {64 vars in 1282 bytes} [Mon Jun 20 11:47:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 11:47:02.169330 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-e9861547-e718-477b-86ea-f5ecef0cba6b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:47:02.200118 n-d-master-1 devstack@n-api.service[103813]: INFO nova.api.openstack.requestlog [None req-e9861547-e718-477b-86ea-f5ecef0cba6b admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034566 Jun 20 11:47:02.213425 n-d-master-1 devstack@n-api.service[103813]: [pid: 103813|app: 0|req: 14/26] 10.222.0.27 () {64 vars in 1332 bytes} [Mon Jun 20 11:47:02 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:47:04.374284 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-bbda4695-1549-4185-b777-271cbcc915f6 admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:47:04.375424 n-d-master-1 devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-bbda4695-1549-4185-b777-271cbcc915f6 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001585 Jun 20 11:47:04.376132 n-d-master-1 devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 13/27] 10.222.0.27 () {54 vars in 930 bytes} [Mon Jun 20 11:47:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:47:04.444503 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-e43988ee-8baa-4124-8ec4-0eff1c0fd14b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "m1.medium", "os-flavor-access:is_public": true, "swap": 0, "id": "3", "rxtx_factor": 1.0, "disk": 40, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:47:04.465903 n-d-master-1 devstack@n-api.service[103813]: INFO nova.api.openstack.requestlog [None req-e43988ee-8baa-4124-8ec4-0eff1c0fd14b admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.082083 Jun 20 11:47:04.466586 n-d-master-1 devstack@n-api.service[103813]: [pid: 103813|app: 0|req: 15/28] 10.222.0.27 () {64 vars in 1282 bytes} [Mon Jun 20 11:47:04 2022] POST /compute/v2.1/flavors => generated 406 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:47:04.479963 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-accf989a-4406-48c1-bd60-491ef40adb4a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:47:04.515352 n-d-master-1 devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-accf989a-4406-48c1-bd60-491ef40adb4a admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038867 Jun 20 11:47:04.515589 n-d-master-1 devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 14/29] 10.222.0.27 () {64 vars in 1332 bytes} [Mon Jun 20 11:47:04 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:47:06.872683 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-e43988ee-8baa-4124-8ec4-0eff1c0fd14b admin admin] Calling method '>' {{(pid=103813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:47:06.873806 n-d-master-1 devstack@n-api.service[103813]: INFO nova.api.openstack.requestlog [None req-e43988ee-8baa-4124-8ec4-0eff1c0fd14b admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001652 Jun 20 11:47:06.874246 n-d-master-1 devstack@n-api.service[103813]: [pid: 103813|app: 0|req: 16/30] 10.222.0.27 () {54 vars in 930 bytes} [Mon Jun 20 11:47:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:47:06.933373 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-3045eb78-d467-41c0-a5b4-7aa73ee23e69 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "4", "vcpus": 4, "ram": 8192, "swap": 0, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "os-flavor-access:is_public": true}} {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:47:06.957080 n-d-master-1 devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-3045eb78-d467-41c0-a5b4-7aa73ee23e69 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075113 Jun 20 11:47:06.958148 n-d-master-1 devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 15/31] 10.222.0.27 () {64 vars in 1282 bytes} [Mon Jun 20 11:47:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:47:06.971267 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-eb328a16-8ca9-4576-b566-59fd7d8ac1f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:47:06.998246 n-d-master-1 devstack@n-api.service[103813]: INFO nova.api.openstack.requestlog [None req-eb328a16-8ca9-4576-b566-59fd7d8ac1f3 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031020 Jun 20 11:47:06.999206 n-d-master-1 devstack@n-api.service[103813]: [pid: 103813|app: 0|req: 17/32] 10.222.0.27 () {64 vars in 1332 bytes} [Mon Jun 20 11:47:06 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:47:09.067156 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-3045eb78-d467-41c0-a5b4-7aa73ee23e69 admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:47:09.068526 n-d-master-1 devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-3045eb78-d467-41c0-a5b4-7aa73ee23e69 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002978 Jun 20 11:47:09.069302 n-d-master-1 devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 16/33] 10.222.0.27 () {54 vars in 930 bytes} [Mon Jun 20 11:47:09 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:47:09.132112 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-d2107684-5982-469d-8443-7010c56c1fed admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "name": "m1.xlarge", "disk": 160, "ram": 16384, "vcpus": 8, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:47:09.152085 n-d-master-1 devstack@n-api.service[103813]: INFO nova.api.openstack.requestlog [None req-d2107684-5982-469d-8443-7010c56c1fed admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.076518 Jun 20 11:47:09.152684 n-d-master-1 devstack@n-api.service[103813]: [pid: 103813|app: 0|req: 18/34] 10.222.0.27 () {64 vars in 1282 bytes} [Mon Jun 20 11:47:09 2022] POST /compute/v2.1/flavors => generated 408 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:47:09.165075 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-04a616d5-1bd5-4207-b237-1c1de0433fd3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:47:09.188536 n-d-master-1 devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-04a616d5-1bd5-4207-b237-1c1de0433fd3 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027139 Jun 20 11:47:09.189121 n-d-master-1 devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 17/35] 10.222.0.27 () {64 vars in 1332 bytes} [Mon Jun 20 11:47:09 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:47:38.157558 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-d2107684-5982-469d-8443-7010c56c1fed admin admin] Calling method '>' {{(pid=103813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:47:38.158580 n-d-master-1 devstack@n-api.service[103813]: INFO nova.api.openstack.requestlog [None req-d2107684-5982-469d-8443-7010c56c1fed admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jun 20 11:47:38.158989 n-d-master-1 devstack@n-api.service[103813]: [pid: 103813|app: 0|req: 19/36] 10.222.0.27 () {54 vars in 930 bytes} [Mon Jun 20 11:47:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:47:38.169560 n-d-master-1 devstack@n-api.service[103812]: DEBUG dbcounter [-] [103812] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:47:38.227790 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-01776de4-97ea-4879-9f8a-b6f1c6ea29bc admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:47:38.248572 n-d-master-1 devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-01776de4-97ea-4879-9f8a-b6f1c6ea29bc admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.083564 Jun 20 11:47:38.249116 n-d-master-1 devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 18/37] 10.222.0.27 () {60 vars in 1291 bytes} [Mon Jun 20 11:47:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:47:39.186386 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-d2107684-5982-469d-8443-7010c56c1fed admin admin] Calling method '>' {{(pid=103813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:47:39.187399 n-d-master-1 devstack@n-api.service[103813]: INFO nova.api.openstack.requestlog [None req-d2107684-5982-469d-8443-7010c56c1fed admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jun 20 11:47:39.187804 n-d-master-1 devstack@n-api.service[103813]: [pid: 103813|app: 0|req: 20/38] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Jun 20 11:47:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:47:39.408907 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-7d79d5f3-198e-40dd-9265-fd22b6022a2d admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:47:39.415454 n-d-master-1 devstack@n-api.service[103812]: INFO nova.api.openstack.wsgi [None req-7d79d5f3-198e-40dd-9265-fd22b6022a2d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 20 11:47:39.418815 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-7d79d5f3-198e-40dd-9265-fd22b6022a2d admin admin] Request method failure captured: Jun 20 11:47:39.418815 n-d-master-1 devstack@n-api.service[103812]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 20 11:47:39.418815 n-d-master-1 devstack@n-api.service[103812]: Accept: application/json Jun 20 11:47:39.418815 n-d-master-1 devstack@n-api.service[103812]: Accept-Encoding: gzip, deflate Jun 20 11:47:39.418815 n-d-master-1 devstack@n-api.service[103812]: Connection: keep-alive Jun 20 11:47:39.418815 n-d-master-1 devstack@n-api.service[103812]: Content-Length: 0 Jun 20 11:47:39.418815 n-d-master-1 devstack@n-api.service[103812]: Host: 10.222.0.27 Jun 20 11:47:39.418815 n-d-master-1 devstack@n-api.service[103812]: Openstack-Api-Version: compute 2.90 Jun 20 11:47:39.418815 n-d-master-1 devstack@n-api.service[103812]: Openstack-System-Scope: None Jun 20 11:47:39.418815 n-d-master-1 devstack@n-api.service[103812]: User-Agent: python-novaclient Jun 20 11:47:39.418815 n-d-master-1 devstack@n-api.service[103812]: X-Auth-Token: gAAAAABisF5bYyDefv5MXIJ2jtPx2InMxGhT6d6OdoGKLtQJMwtw1IrEXuvho-_uhey1Bnua3fHT_xdTvKqWWj9DLvoNazm-07Kdotpul5hqIq3xzprYd4ZDwZHrmB644I4NE3K1SyCItCu1x_7FzivmXu1FBSULzRpM-yBSlXZYNKyZCvXLBEc Jun 20 11:47:39.418815 n-d-master-1 devstack@n-api.service[103812]: X-Domain-Id: None Jun 20 11:47:39.418815 n-d-master-1 devstack@n-api.service[103812]: X-Domain-Name: None Jun 20 11:47:39.418815 n-d-master-1 devstack@n-api.service[103812]: X-Identity-Status: Confirmed Jun 20 11:47:39.418815 n-d-master-1 devstack@n-api.service[103812]: X-Is-Admin-Project: True Jun 20 11:47:39.418815 n-d-master-1 devstack@n-api.service[103812]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 11:47:39.418815 n-d-master-1 devstack@n-api.service[103812]: X-Project-Domain-Id: default Jun 20 11:47:39.418815 n-d-master-1 devstack@n-api.service[103812]: X-Project-Domain-Name: Default Jun 20 11:47:39.418815 n-d-master-1 devstack@n-api.service[103812]: X-Project-Id: 4044d4df3d7546b881ed6ef4dde8e5c5 Jun 20 11:47:39.418815 n-d-master-1 devstack@n-api.service[103812]: X-Project-Name: admin Jun 20 11:47:39.418815 n-d-master-1 devstack@n-api.service[103812]: X-Role: reader,member,admin Jun 20 11:47:39.418815 n-d-master-1 devstack@n-api.service[103812]: X-Roles: reader,member,admin Jun 20 11:47:39.420343 n-d-master-1 devstack@n-api.service[103812]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4044d4df3d7546b881ed6ef4dde8e5c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4044d4df3d7546b881ed6ef4dde8e5c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4044d4df3d7546b881ed6ef4dde8e5c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4044d4df3d7546b881ed6ef4dde8e5c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:47:39.420343 n-d-master-1 devstack@n-api.service[103812]: X-Tenant: admin Jun 20 11:47:39.420343 n-d-master-1 devstack@n-api.service[103812]: X-Tenant-Id: 4044d4df3d7546b881ed6ef4dde8e5c5 Jun 20 11:47:39.420343 n-d-master-1 devstack@n-api.service[103812]: X-Tenant-Name: admin Jun 20 11:47:39.420343 n-d-master-1 devstack@n-api.service[103812]: X-User: admin Jun 20 11:47:39.420343 n-d-master-1 devstack@n-api.service[103812]: X-User-Domain-Id: default Jun 20 11:47:39.420343 n-d-master-1 devstack@n-api.service[103812]: X-User-Domain-Name: Default Jun 20 11:47:39.420343 n-d-master-1 devstack@n-api.service[103812]: X-User-Id: 906de9e1c52f4d18a485e89181c5a172 Jun 20 11:47:39.420343 n-d-master-1 devstack@n-api.service[103812]: X-User-Name: admin Jun 20 11:47:39.420343 n-d-master-1 devstack@n-api.service[103812]: method: > Jun 20 11:47:39.420343 n-d-master-1 devstack@n-api.service[103812]: exception: Flavor 42 could not be found. Jun 20 11:47:39.420343 n-d-master-1 devstack@n-api.service[103812]: action_args: {'id': '42'} Jun 20 11:47:39.420343 n-d-master-1 devstack@n-api.service[103812]: {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:47:39.420343 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:47:39.421223 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 11:47:39.421223 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 11:47:39.421223 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 11:47:39.421223 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 11:47:39.421223 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 11:47:39.421223 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 11:47:39.421223 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 11:47:39.421223 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 11:47:39.421223 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 11:47:39.421223 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:47:39.421223 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 11:47:39.421223 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 11:47:39.421223 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 20 11:47:39.421223 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Jun 20 11:47:39.421223 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:47:39.421223 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Jun 20 11:47:39.421223 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:47:39.421223 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:47:39.421223 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:47:39.422359 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:47:39.422359 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:47:39.422359 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:47:39.422359 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:47:39.422359 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 11:47:39.422359 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:47:39.422359 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 20 11:47:39.422359 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Jun 20 11:47:39.422359 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:47:39.422359 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Jun 20 11:47:39.422359 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:47:39.422359 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:47:39.422359 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:47:39.422359 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:47:39.422359 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:47:39.422359 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 20 11:47:39.422359 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Jun 20 11:47:39.422359 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-7d79d5f3-198e-40dd-9265-fd22b6022a2d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:47:39.423483 n-d-master-1 devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-7d79d5f3-198e-40dd-9265-fd22b6022a2d admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.070319 Jun 20 11:47:39.423483 n-d-master-1 devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 19/39] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Jun 20 11:47:39 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 11:47:39.430587 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-c489c695-cd45-4c53-9481-c7c54dcc9443 admin admin] Calling method '>' {{(pid=103813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:47:39.433648 n-d-master-1 devstack@n-api.service[103813]: DEBUG dbcounter [-] [103813] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:47:39.453455 n-d-master-1 devstack@n-api.service[103813]: INFO nova.api.openstack.requestlog [None req-c489c695-cd45-4c53-9481-c7c54dcc9443 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026641 Jun 20 11:47:39.454031 n-d-master-1 devstack@n-api.service[103813]: [pid: 103813|app: 0|req: 21/40] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Jun 20 11:47:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:47:39.466863 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-c4d19553-a994-4bf8-9dbf-b0582ce40594 admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:47:39.498133 n-d-master-1 devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-c4d19553-a994-4bf8-9dbf-b0582ce40594 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.037237 Jun 20 11:47:39.498705 n-d-master-1 devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 20/41] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Jun 20 11:47:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:47:39.508772 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-ddffa578-9ecb-4f98-b62d-f15035d0226a admin admin] Calling method '>' {{(pid=103813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:47:39.515192 n-d-master-1 devstack@n-api.service[103813]: INFO nova.api.openstack.wsgi [None req-ddffa578-9ecb-4f98-b62d-f15035d0226a admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 20 11:47:39.518470 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-ddffa578-9ecb-4f98-b62d-f15035d0226a admin admin] Request method failure captured: Jun 20 11:47:39.518470 n-d-master-1 devstack@n-api.service[103813]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 20 11:47:39.518470 n-d-master-1 devstack@n-api.service[103813]: Accept: application/json Jun 20 11:47:39.518470 n-d-master-1 devstack@n-api.service[103813]: Accept-Encoding: gzip, deflate Jun 20 11:47:39.518470 n-d-master-1 devstack@n-api.service[103813]: Connection: keep-alive Jun 20 11:47:39.518470 n-d-master-1 devstack@n-api.service[103813]: Content-Length: 0 Jun 20 11:47:39.518470 n-d-master-1 devstack@n-api.service[103813]: Host: 10.222.0.27 Jun 20 11:47:39.518470 n-d-master-1 devstack@n-api.service[103813]: Openstack-Api-Version: compute 2.90 Jun 20 11:47:39.518470 n-d-master-1 devstack@n-api.service[103813]: Openstack-System-Scope: None Jun 20 11:47:39.518470 n-d-master-1 devstack@n-api.service[103813]: User-Agent: python-novaclient Jun 20 11:47:39.518470 n-d-master-1 devstack@n-api.service[103813]: X-Auth-Token: gAAAAABisF5bYyDefv5MXIJ2jtPx2InMxGhT6d6OdoGKLtQJMwtw1IrEXuvho-_uhey1Bnua3fHT_xdTvKqWWj9DLvoNazm-07Kdotpul5hqIq3xzprYd4ZDwZHrmB644I4NE3K1SyCItCu1x_7FzivmXu1FBSULzRpM-yBSlXZYNKyZCvXLBEc Jun 20 11:47:39.518470 n-d-master-1 devstack@n-api.service[103813]: X-Domain-Id: None Jun 20 11:47:39.518470 n-d-master-1 devstack@n-api.service[103813]: X-Domain-Name: None Jun 20 11:47:39.518470 n-d-master-1 devstack@n-api.service[103813]: X-Identity-Status: Confirmed Jun 20 11:47:39.518470 n-d-master-1 devstack@n-api.service[103813]: X-Is-Admin-Project: True Jun 20 11:47:39.518470 n-d-master-1 devstack@n-api.service[103813]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 11:47:39.518470 n-d-master-1 devstack@n-api.service[103813]: X-Project-Domain-Id: default Jun 20 11:47:39.518470 n-d-master-1 devstack@n-api.service[103813]: X-Project-Domain-Name: Default Jun 20 11:47:39.518470 n-d-master-1 devstack@n-api.service[103813]: X-Project-Id: 4044d4df3d7546b881ed6ef4dde8e5c5 Jun 20 11:47:39.518470 n-d-master-1 devstack@n-api.service[103813]: X-Project-Name: admin Jun 20 11:47:39.518470 n-d-master-1 devstack@n-api.service[103813]: X-Role: reader,member,admin Jun 20 11:47:39.518470 n-d-master-1 devstack@n-api.service[103813]: X-Roles: reader,member,admin Jun 20 11:47:39.520035 n-d-master-1 devstack@n-api.service[103813]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4044d4df3d7546b881ed6ef4dde8e5c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4044d4df3d7546b881ed6ef4dde8e5c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4044d4df3d7546b881ed6ef4dde8e5c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4044d4df3d7546b881ed6ef4dde8e5c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:47:39.520035 n-d-master-1 devstack@n-api.service[103813]: X-Tenant: admin Jun 20 11:47:39.520035 n-d-master-1 devstack@n-api.service[103813]: X-Tenant-Id: 4044d4df3d7546b881ed6ef4dde8e5c5 Jun 20 11:47:39.520035 n-d-master-1 devstack@n-api.service[103813]: X-Tenant-Name: admin Jun 20 11:47:39.520035 n-d-master-1 devstack@n-api.service[103813]: X-User: admin Jun 20 11:47:39.520035 n-d-master-1 devstack@n-api.service[103813]: X-User-Domain-Id: default Jun 20 11:47:39.520035 n-d-master-1 devstack@n-api.service[103813]: X-User-Domain-Name: Default Jun 20 11:47:39.520035 n-d-master-1 devstack@n-api.service[103813]: X-User-Id: 906de9e1c52f4d18a485e89181c5a172 Jun 20 11:47:39.520035 n-d-master-1 devstack@n-api.service[103813]: X-User-Name: admin Jun 20 11:47:39.520035 n-d-master-1 devstack@n-api.service[103813]: method: > Jun 20 11:47:39.520035 n-d-master-1 devstack@n-api.service[103813]: exception: Flavor 42 could not be found. Jun 20 11:47:39.520035 n-d-master-1 devstack@n-api.service[103813]: action_args: {'id': '42'} Jun 20 11:47:39.520035 n-d-master-1 devstack@n-api.service[103813]: {{(pid=103813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:47:39.520035 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:47:39.520887 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 11:47:39.520887 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 11:47:39.520887 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 11:47:39.520887 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 11:47:39.520887 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 11:47:39.520887 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 11:47:39.520887 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 11:47:39.520887 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 11:47:39.520887 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 11:47:39.520887 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:47:39.520887 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 11:47:39.520887 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 11:47:39.520887 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 20 11:47:39.520887 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi Jun 20 11:47:39.520887 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:47:39.520887 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi Jun 20 11:47:39.520887 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:47:39.520887 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:47:39.520887 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:47:39.521903 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:47:39.521903 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:47:39.521903 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:47:39.521903 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:47:39.521903 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 11:47:39.521903 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:47:39.521903 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 20 11:47:39.521903 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi Jun 20 11:47:39.521903 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:47:39.521903 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi Jun 20 11:47:39.521903 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:47:39.521903 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:47:39.521903 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:47:39.521903 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:47:39.521903 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:47:39.521903 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 20 11:47:39.521903 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi Jun 20 11:47:39.521903 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-ddffa578-9ecb-4f98-b62d-f15035d0226a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:47:39.522866 n-d-master-1 devstack@n-api.service[103813]: INFO nova.api.openstack.requestlog [None req-ddffa578-9ecb-4f98-b62d-f15035d0226a admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014986 Jun 20 11:47:39.522866 n-d-master-1 devstack@n-api.service[103813]: [pid: 103813|app: 0|req: 22/42] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Jun 20 11:47:39 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 11:47:40.337295 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-c4d19553-a994-4bf8-9dbf-b0582ce40594 admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:47:40.338322 n-d-master-1 devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-c4d19553-a994-4bf8-9dbf-b0582ce40594 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jun 20 11:47:40.338737 n-d-master-1 devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 21/43] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Jun 20 11:47:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:47:40.534659 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-7c324412-11aa-42a9-ad54-627c75380f64 admin admin] Calling method '>' {{(pid=103813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:47:40.540731 n-d-master-1 devstack@n-api.service[103813]: INFO nova.api.openstack.wsgi [None req-7c324412-11aa-42a9-ad54-627c75380f64 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 20 11:47:40.542212 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-7c324412-11aa-42a9-ad54-627c75380f64 admin admin] Request method failure captured: Jun 20 11:47:40.542212 n-d-master-1 devstack@n-api.service[103813]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 20 11:47:40.542212 n-d-master-1 devstack@n-api.service[103813]: Accept: application/json Jun 20 11:47:40.542212 n-d-master-1 devstack@n-api.service[103813]: Accept-Encoding: gzip, deflate Jun 20 11:47:40.542212 n-d-master-1 devstack@n-api.service[103813]: Connection: keep-alive Jun 20 11:47:40.542212 n-d-master-1 devstack@n-api.service[103813]: Content-Length: 0 Jun 20 11:47:40.542212 n-d-master-1 devstack@n-api.service[103813]: Host: 10.222.0.27 Jun 20 11:47:40.542212 n-d-master-1 devstack@n-api.service[103813]: Openstack-Api-Version: compute 2.90 Jun 20 11:47:40.542212 n-d-master-1 devstack@n-api.service[103813]: Openstack-System-Scope: None Jun 20 11:47:40.542212 n-d-master-1 devstack@n-api.service[103813]: User-Agent: python-novaclient Jun 20 11:47:40.542212 n-d-master-1 devstack@n-api.service[103813]: X-Auth-Token: gAAAAABisF5cB0v73oKCN450P22ExwT0zGtY5_5N6LNWsjxoZ3ZIwj8JXxAhR1w2-1h0vp_MXbGcIL6KrOPfwghk0_NgMug0kEY61a0P03LtBG6ow5BqD9Fi-s9q6c9vk0x_nC8Mo8C7HJrRQVzjuU46Bwb33cQbdXfrrzTmNjKcAf8JoMqOWAs Jun 20 11:47:40.542212 n-d-master-1 devstack@n-api.service[103813]: X-Domain-Id: None Jun 20 11:47:40.542212 n-d-master-1 devstack@n-api.service[103813]: X-Domain-Name: None Jun 20 11:47:40.542212 n-d-master-1 devstack@n-api.service[103813]: X-Identity-Status: Confirmed Jun 20 11:47:40.542212 n-d-master-1 devstack@n-api.service[103813]: X-Is-Admin-Project: True Jun 20 11:47:40.542212 n-d-master-1 devstack@n-api.service[103813]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 11:47:40.542212 n-d-master-1 devstack@n-api.service[103813]: X-Project-Domain-Id: default Jun 20 11:47:40.542212 n-d-master-1 devstack@n-api.service[103813]: X-Project-Domain-Name: Default Jun 20 11:47:40.542212 n-d-master-1 devstack@n-api.service[103813]: X-Project-Id: 4044d4df3d7546b881ed6ef4dde8e5c5 Jun 20 11:47:40.542212 n-d-master-1 devstack@n-api.service[103813]: X-Project-Name: admin Jun 20 11:47:40.542212 n-d-master-1 devstack@n-api.service[103813]: X-Role: reader,member,admin Jun 20 11:47:40.542212 n-d-master-1 devstack@n-api.service[103813]: X-Roles: reader,member,admin Jun 20 11:47:40.543503 n-d-master-1 devstack@n-api.service[103813]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4044d4df3d7546b881ed6ef4dde8e5c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4044d4df3d7546b881ed6ef4dde8e5c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4044d4df3d7546b881ed6ef4dde8e5c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4044d4df3d7546b881ed6ef4dde8e5c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:47:40.543503 n-d-master-1 devstack@n-api.service[103813]: X-Tenant: admin Jun 20 11:47:40.543503 n-d-master-1 devstack@n-api.service[103813]: X-Tenant-Id: 4044d4df3d7546b881ed6ef4dde8e5c5 Jun 20 11:47:40.543503 n-d-master-1 devstack@n-api.service[103813]: X-Tenant-Name: admin Jun 20 11:47:40.543503 n-d-master-1 devstack@n-api.service[103813]: X-User: admin Jun 20 11:47:40.543503 n-d-master-1 devstack@n-api.service[103813]: X-User-Domain-Id: default Jun 20 11:47:40.543503 n-d-master-1 devstack@n-api.service[103813]: X-User-Domain-Name: Default Jun 20 11:47:40.543503 n-d-master-1 devstack@n-api.service[103813]: X-User-Id: 906de9e1c52f4d18a485e89181c5a172 Jun 20 11:47:40.543503 n-d-master-1 devstack@n-api.service[103813]: X-User-Name: admin Jun 20 11:47:40.543503 n-d-master-1 devstack@n-api.service[103813]: method: > Jun 20 11:47:40.543503 n-d-master-1 devstack@n-api.service[103813]: exception: Flavor 84 could not be found. Jun 20 11:47:40.543503 n-d-master-1 devstack@n-api.service[103813]: action_args: {'id': '84'} Jun 20 11:47:40.543503 n-d-master-1 devstack@n-api.service[103813]: {{(pid=103813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:47:40.543503 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:47:40.544341 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 11:47:40.544341 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 11:47:40.544341 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 11:47:40.544341 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 11:47:40.544341 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 11:47:40.544341 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 11:47:40.544341 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 11:47:40.544341 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 11:47:40.544341 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 11:47:40.544341 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:47:40.544341 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 11:47:40.544341 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 11:47:40.544341 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 20 11:47:40.544341 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi Jun 20 11:47:40.544341 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:47:40.544341 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi Jun 20 11:47:40.544341 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:47:40.544341 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:47:40.544341 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:47:40.545402 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:47:40.545402 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:47:40.545402 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:47:40.545402 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:47:40.545402 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 11:47:40.545402 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:47:40.545402 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 20 11:47:40.545402 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi Jun 20 11:47:40.545402 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:47:40.545402 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi Jun 20 11:47:40.545402 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:47:40.545402 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:47:40.545402 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:47:40.545402 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:47:40.545402 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:47:40.545402 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 20 11:47:40.545402 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi Jun 20 11:47:40.545402 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-7c324412-11aa-42a9-ad54-627c75380f64 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:47:40.546501 n-d-master-1 devstack@n-api.service[103813]: INFO nova.api.openstack.requestlog [None req-7c324412-11aa-42a9-ad54-627c75380f64 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.067880 Jun 20 11:47:40.546501 n-d-master-1 devstack@n-api.service[103813]: [pid: 103813|app: 0|req: 23/44] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Jun 20 11:47:40 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 11:47:40.555140 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-8f44ff6f-911e-4a01-bd58-dc4c657a2047 admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:47:40.569608 n-d-master-1 devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-8f44ff6f-911e-4a01-bd58-dc4c657a2047 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018579 Jun 20 11:47:40.570147 n-d-master-1 devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 22/45] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Jun 20 11:47:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:47:40.581939 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-b6c6d8e9-4d68-4a85-97d6-6c04508371b5 admin admin] Calling method '>' {{(pid=103813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:47:40.598629 n-d-master-1 devstack@n-api.service[103813]: INFO nova.api.openstack.requestlog [None req-b6c6d8e9-4d68-4a85-97d6-6c04508371b5 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022109 Jun 20 11:47:40.599137 n-d-master-1 devstack@n-api.service[103813]: [pid: 103813|app: 0|req: 24/46] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Jun 20 11:47:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:47:40.609131 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-9f30b072-930d-4de1-8d84-05b6f6c33e91 admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:47:40.614676 n-d-master-1 devstack@n-api.service[103812]: INFO nova.api.openstack.wsgi [None req-9f30b072-930d-4de1-8d84-05b6f6c33e91 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 20 11:47:40.616223 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-9f30b072-930d-4de1-8d84-05b6f6c33e91 admin admin] Request method failure captured: Jun 20 11:47:40.616223 n-d-master-1 devstack@n-api.service[103812]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 20 11:47:40.616223 n-d-master-1 devstack@n-api.service[103812]: Accept: application/json Jun 20 11:47:40.616223 n-d-master-1 devstack@n-api.service[103812]: Accept-Encoding: gzip, deflate Jun 20 11:47:40.616223 n-d-master-1 devstack@n-api.service[103812]: Connection: keep-alive Jun 20 11:47:40.616223 n-d-master-1 devstack@n-api.service[103812]: Content-Length: 0 Jun 20 11:47:40.616223 n-d-master-1 devstack@n-api.service[103812]: Host: 10.222.0.27 Jun 20 11:47:40.616223 n-d-master-1 devstack@n-api.service[103812]: Openstack-Api-Version: compute 2.90 Jun 20 11:47:40.616223 n-d-master-1 devstack@n-api.service[103812]: Openstack-System-Scope: None Jun 20 11:47:40.616223 n-d-master-1 devstack@n-api.service[103812]: User-Agent: python-novaclient Jun 20 11:47:40.616223 n-d-master-1 devstack@n-api.service[103812]: X-Auth-Token: gAAAAABisF5cB0v73oKCN450P22ExwT0zGtY5_5N6LNWsjxoZ3ZIwj8JXxAhR1w2-1h0vp_MXbGcIL6KrOPfwghk0_NgMug0kEY61a0P03LtBG6ow5BqD9Fi-s9q6c9vk0x_nC8Mo8C7HJrRQVzjuU46Bwb33cQbdXfrrzTmNjKcAf8JoMqOWAs Jun 20 11:47:40.616223 n-d-master-1 devstack@n-api.service[103812]: X-Domain-Id: None Jun 20 11:47:40.616223 n-d-master-1 devstack@n-api.service[103812]: X-Domain-Name: None Jun 20 11:47:40.616223 n-d-master-1 devstack@n-api.service[103812]: X-Identity-Status: Confirmed Jun 20 11:47:40.616223 n-d-master-1 devstack@n-api.service[103812]: X-Is-Admin-Project: True Jun 20 11:47:40.616223 n-d-master-1 devstack@n-api.service[103812]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 11:47:40.616223 n-d-master-1 devstack@n-api.service[103812]: X-Project-Domain-Id: default Jun 20 11:47:40.616223 n-d-master-1 devstack@n-api.service[103812]: X-Project-Domain-Name: Default Jun 20 11:47:40.616223 n-d-master-1 devstack@n-api.service[103812]: X-Project-Id: 4044d4df3d7546b881ed6ef4dde8e5c5 Jun 20 11:47:40.616223 n-d-master-1 devstack@n-api.service[103812]: X-Project-Name: admin Jun 20 11:47:40.616223 n-d-master-1 devstack@n-api.service[103812]: X-Role: reader,member,admin Jun 20 11:47:40.616223 n-d-master-1 devstack@n-api.service[103812]: X-Roles: reader,member,admin Jun 20 11:47:40.617676 n-d-master-1 devstack@n-api.service[103812]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4044d4df3d7546b881ed6ef4dde8e5c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4044d4df3d7546b881ed6ef4dde8e5c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4044d4df3d7546b881ed6ef4dde8e5c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4044d4df3d7546b881ed6ef4dde8e5c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:47:40.617676 n-d-master-1 devstack@n-api.service[103812]: X-Tenant: admin Jun 20 11:47:40.617676 n-d-master-1 devstack@n-api.service[103812]: X-Tenant-Id: 4044d4df3d7546b881ed6ef4dde8e5c5 Jun 20 11:47:40.617676 n-d-master-1 devstack@n-api.service[103812]: X-Tenant-Name: admin Jun 20 11:47:40.617676 n-d-master-1 devstack@n-api.service[103812]: X-User: admin Jun 20 11:47:40.617676 n-d-master-1 devstack@n-api.service[103812]: X-User-Domain-Id: default Jun 20 11:47:40.617676 n-d-master-1 devstack@n-api.service[103812]: X-User-Domain-Name: Default Jun 20 11:47:40.617676 n-d-master-1 devstack@n-api.service[103812]: X-User-Id: 906de9e1c52f4d18a485e89181c5a172 Jun 20 11:47:40.617676 n-d-master-1 devstack@n-api.service[103812]: X-User-Name: admin Jun 20 11:47:40.617676 n-d-master-1 devstack@n-api.service[103812]: method: > Jun 20 11:47:40.617676 n-d-master-1 devstack@n-api.service[103812]: exception: Flavor 84 could not be found. Jun 20 11:47:40.617676 n-d-master-1 devstack@n-api.service[103812]: action_args: {'id': '84'} Jun 20 11:47:40.617676 n-d-master-1 devstack@n-api.service[103812]: {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:47:40.617676 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:47:40.618540 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 11:47:40.618540 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 11:47:40.618540 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 11:47:40.618540 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 11:47:40.618540 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 11:47:40.618540 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 11:47:40.618540 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 11:47:40.618540 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 11:47:40.618540 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 11:47:40.618540 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:47:40.618540 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 11:47:40.618540 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 11:47:40.618540 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 20 11:47:40.618540 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Jun 20 11:47:40.618540 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:47:40.618540 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Jun 20 11:47:40.618540 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:47:40.618540 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:47:40.618540 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:47:40.619575 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:47:40.619575 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:47:40.619575 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:47:40.619575 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:47:40.619575 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 11:47:40.619575 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:47:40.619575 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 20 11:47:40.619575 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Jun 20 11:47:40.619575 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:47:40.619575 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Jun 20 11:47:40.619575 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:47:40.619575 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:47:40.619575 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:47:40.619575 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:47:40.619575 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:47:40.619575 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 20 11:47:40.619575 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Jun 20 11:47:40.619575 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-9f30b072-930d-4de1-8d84-05b6f6c33e91 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:47:40.620624 n-d-master-1 devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-9f30b072-930d-4de1-8d84-05b6f6c33e91 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012007 Jun 20 11:47:40.620624 n-d-master-1 devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 23/47] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Jun 20 11:47:40 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 11:47:41.435294 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-b6c6d8e9-4d68-4a85-97d6-6c04508371b5 admin admin] Calling method '>' {{(pid=103813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:47:41.436369 n-d-master-1 devstack@n-api.service[103813]: INFO nova.api.openstack.requestlog [None req-b6c6d8e9-4d68-4a85-97d6-6c04508371b5 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jun 20 11:47:41.436737 n-d-master-1 devstack@n-api.service[103813]: [pid: 103813|app: 0|req: 25/48] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Jun 20 11:47:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:47:41.650939 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-075496a8-4c09-44ad-b328-bf416bfad938 admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:47:41.657094 n-d-master-1 devstack@n-api.service[103812]: INFO nova.api.openstack.wsgi [None req-075496a8-4c09-44ad-b328-bf416bfad938 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 20 11:47:41.658594 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-075496a8-4c09-44ad-b328-bf416bfad938 admin admin] Request method failure captured: Jun 20 11:47:41.658594 n-d-master-1 devstack@n-api.service[103812]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 20 11:47:41.658594 n-d-master-1 devstack@n-api.service[103812]: Accept: application/json Jun 20 11:47:41.658594 n-d-master-1 devstack@n-api.service[103812]: Accept-Encoding: gzip, deflate Jun 20 11:47:41.658594 n-d-master-1 devstack@n-api.service[103812]: Connection: keep-alive Jun 20 11:47:41.658594 n-d-master-1 devstack@n-api.service[103812]: Content-Length: 0 Jun 20 11:47:41.658594 n-d-master-1 devstack@n-api.service[103812]: Host: 10.222.0.27 Jun 20 11:47:41.658594 n-d-master-1 devstack@n-api.service[103812]: Openstack-Api-Version: compute 2.90 Jun 20 11:47:41.658594 n-d-master-1 devstack@n-api.service[103812]: Openstack-System-Scope: None Jun 20 11:47:41.658594 n-d-master-1 devstack@n-api.service[103812]: User-Agent: python-novaclient Jun 20 11:47:41.658594 n-d-master-1 devstack@n-api.service[103812]: X-Auth-Token: gAAAAABisF5d2q07P8Yml38tQsNfkiGbK82hYu4-rPzsOxR7QpNYmi1LRFV63W6HL7U3baRmBSG-76vCkICNJ2JEu8e8eZmIjolZ5xeAdZX7hgcDo9Y5ZO2fig8aj-fbC9kBL8LeWlXX4JvzghpexbfzZ8rLVsfbjvcjBTmmukY56w78LwO_wXI Jun 20 11:47:41.658594 n-d-master-1 devstack@n-api.service[103812]: X-Domain-Id: None Jun 20 11:47:41.658594 n-d-master-1 devstack@n-api.service[103812]: X-Domain-Name: None Jun 20 11:47:41.658594 n-d-master-1 devstack@n-api.service[103812]: X-Identity-Status: Confirmed Jun 20 11:47:41.658594 n-d-master-1 devstack@n-api.service[103812]: X-Is-Admin-Project: True Jun 20 11:47:41.658594 n-d-master-1 devstack@n-api.service[103812]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 11:47:41.658594 n-d-master-1 devstack@n-api.service[103812]: X-Project-Domain-Id: default Jun 20 11:47:41.658594 n-d-master-1 devstack@n-api.service[103812]: X-Project-Domain-Name: Default Jun 20 11:47:41.658594 n-d-master-1 devstack@n-api.service[103812]: X-Project-Id: 4044d4df3d7546b881ed6ef4dde8e5c5 Jun 20 11:47:41.658594 n-d-master-1 devstack@n-api.service[103812]: X-Project-Name: admin Jun 20 11:47:41.658594 n-d-master-1 devstack@n-api.service[103812]: X-Role: reader,member,admin Jun 20 11:47:41.658594 n-d-master-1 devstack@n-api.service[103812]: X-Roles: reader,member,admin Jun 20 11:47:41.660096 n-d-master-1 devstack@n-api.service[103812]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4044d4df3d7546b881ed6ef4dde8e5c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4044d4df3d7546b881ed6ef4dde8e5c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4044d4df3d7546b881ed6ef4dde8e5c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4044d4df3d7546b881ed6ef4dde8e5c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:47:41.660096 n-d-master-1 devstack@n-api.service[103812]: X-Tenant: admin Jun 20 11:47:41.660096 n-d-master-1 devstack@n-api.service[103812]: X-Tenant-Id: 4044d4df3d7546b881ed6ef4dde8e5c5 Jun 20 11:47:41.660096 n-d-master-1 devstack@n-api.service[103812]: X-Tenant-Name: admin Jun 20 11:47:41.660096 n-d-master-1 devstack@n-api.service[103812]: X-User: admin Jun 20 11:47:41.660096 n-d-master-1 devstack@n-api.service[103812]: X-User-Domain-Id: default Jun 20 11:47:41.660096 n-d-master-1 devstack@n-api.service[103812]: X-User-Domain-Name: Default Jun 20 11:47:41.660096 n-d-master-1 devstack@n-api.service[103812]: X-User-Id: 906de9e1c52f4d18a485e89181c5a172 Jun 20 11:47:41.660096 n-d-master-1 devstack@n-api.service[103812]: X-User-Name: admin Jun 20 11:47:41.660096 n-d-master-1 devstack@n-api.service[103812]: method: > Jun 20 11:47:41.660096 n-d-master-1 devstack@n-api.service[103812]: exception: Flavor 451 could not be found. Jun 20 11:47:41.660096 n-d-master-1 devstack@n-api.service[103812]: action_args: {'id': '451'} Jun 20 11:47:41.660096 n-d-master-1 devstack@n-api.service[103812]: {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:47:41.660096 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:47:41.660965 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 11:47:41.660965 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 11:47:41.660965 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 11:47:41.660965 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 11:47:41.660965 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 11:47:41.660965 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 11:47:41.660965 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 11:47:41.660965 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 11:47:41.660965 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 11:47:41.660965 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:47:41.660965 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 11:47:41.660965 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 11:47:41.660965 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 20 11:47:41.660965 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Jun 20 11:47:41.660965 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:47:41.660965 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Jun 20 11:47:41.660965 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:47:41.660965 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:47:41.660965 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:47:41.662542 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:47:41.662542 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:47:41.662542 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:47:41.662542 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:47:41.662542 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 11:47:41.662542 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:47:41.662542 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 20 11:47:41.662542 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Jun 20 11:47:41.662542 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:47:41.662542 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Jun 20 11:47:41.662542 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:47:41.662542 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:47:41.662542 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:47:41.662542 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:47:41.662542 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:47:41.662542 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 20 11:47:41.662542 n-d-master-1 devstack@n-api.service[103812]: ERROR nova.api.openstack.wsgi Jun 20 11:47:41.662542 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-075496a8-4c09-44ad-b328-bf416bfad938 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:47:41.663753 n-d-master-1 devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-075496a8-4c09-44ad-b328-bf416bfad938 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.086398 Jun 20 11:47:41.663753 n-d-master-1 devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 24/49] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Jun 20 11:47:41 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 11:47:41.669935 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-d0064c08-8368-40d9-a6d7-b6a309d061a7 admin admin] Calling method '>' {{(pid=103813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:47:41.684092 n-d-master-1 devstack@n-api.service[103813]: INFO nova.api.openstack.requestlog [None req-d0064c08-8368-40d9-a6d7-b6a309d061a7 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017788 Jun 20 11:47:41.684806 n-d-master-1 devstack@n-api.service[103813]: [pid: 103813|app: 0|req: 26/50] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Jun 20 11:47:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:47:41.695047 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-49f1e605-381e-4f54-85e3-ab4ce84afb55 admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:47:41.709302 n-d-master-1 devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-49f1e605-381e-4f54-85e3-ab4ce84afb55 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018439 Jun 20 11:47:41.709840 n-d-master-1 devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 25/51] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Jun 20 11:47:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:47:41.719332 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-1444393a-8b48-40d5-aa3d-181023d5c789 admin admin] Calling method '>' {{(pid=103813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:47:41.724936 n-d-master-1 devstack@n-api.service[103813]: INFO nova.api.openstack.wsgi [None req-1444393a-8b48-40d5-aa3d-181023d5c789 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 20 11:47:41.726437 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-1444393a-8b48-40d5-aa3d-181023d5c789 admin admin] Request method failure captured: Jun 20 11:47:41.726437 n-d-master-1 devstack@n-api.service[103813]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 20 11:47:41.726437 n-d-master-1 devstack@n-api.service[103813]: Accept: application/json Jun 20 11:47:41.726437 n-d-master-1 devstack@n-api.service[103813]: Accept-Encoding: gzip, deflate Jun 20 11:47:41.726437 n-d-master-1 devstack@n-api.service[103813]: Connection: keep-alive Jun 20 11:47:41.726437 n-d-master-1 devstack@n-api.service[103813]: Content-Length: 0 Jun 20 11:47:41.726437 n-d-master-1 devstack@n-api.service[103813]: Host: 10.222.0.27 Jun 20 11:47:41.726437 n-d-master-1 devstack@n-api.service[103813]: Openstack-Api-Version: compute 2.90 Jun 20 11:47:41.726437 n-d-master-1 devstack@n-api.service[103813]: Openstack-System-Scope: None Jun 20 11:47:41.726437 n-d-master-1 devstack@n-api.service[103813]: User-Agent: python-novaclient Jun 20 11:47:41.726437 n-d-master-1 devstack@n-api.service[103813]: X-Auth-Token: gAAAAABisF5d2q07P8Yml38tQsNfkiGbK82hYu4-rPzsOxR7QpNYmi1LRFV63W6HL7U3baRmBSG-76vCkICNJ2JEu8e8eZmIjolZ5xeAdZX7hgcDo9Y5ZO2fig8aj-fbC9kBL8LeWlXX4JvzghpexbfzZ8rLVsfbjvcjBTmmukY56w78LwO_wXI Jun 20 11:47:41.726437 n-d-master-1 devstack@n-api.service[103813]: X-Domain-Id: None Jun 20 11:47:41.726437 n-d-master-1 devstack@n-api.service[103813]: X-Domain-Name: None Jun 20 11:47:41.726437 n-d-master-1 devstack@n-api.service[103813]: X-Identity-Status: Confirmed Jun 20 11:47:41.726437 n-d-master-1 devstack@n-api.service[103813]: X-Is-Admin-Project: True Jun 20 11:47:41.726437 n-d-master-1 devstack@n-api.service[103813]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 11:47:41.726437 n-d-master-1 devstack@n-api.service[103813]: X-Project-Domain-Id: default Jun 20 11:47:41.726437 n-d-master-1 devstack@n-api.service[103813]: X-Project-Domain-Name: Default Jun 20 11:47:41.726437 n-d-master-1 devstack@n-api.service[103813]: X-Project-Id: 4044d4df3d7546b881ed6ef4dde8e5c5 Jun 20 11:47:41.726437 n-d-master-1 devstack@n-api.service[103813]: X-Project-Name: admin Jun 20 11:47:41.726437 n-d-master-1 devstack@n-api.service[103813]: X-Role: reader,member,admin Jun 20 11:47:41.726437 n-d-master-1 devstack@n-api.service[103813]: X-Roles: reader,member,admin Jun 20 11:47:41.727922 n-d-master-1 devstack@n-api.service[103813]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4044d4df3d7546b881ed6ef4dde8e5c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4044d4df3d7546b881ed6ef4dde8e5c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4044d4df3d7546b881ed6ef4dde8e5c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4044d4df3d7546b881ed6ef4dde8e5c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:47:41.727922 n-d-master-1 devstack@n-api.service[103813]: X-Tenant: admin Jun 20 11:47:41.727922 n-d-master-1 devstack@n-api.service[103813]: X-Tenant-Id: 4044d4df3d7546b881ed6ef4dde8e5c5 Jun 20 11:47:41.727922 n-d-master-1 devstack@n-api.service[103813]: X-Tenant-Name: admin Jun 20 11:47:41.727922 n-d-master-1 devstack@n-api.service[103813]: X-User: admin Jun 20 11:47:41.727922 n-d-master-1 devstack@n-api.service[103813]: X-User-Domain-Id: default Jun 20 11:47:41.727922 n-d-master-1 devstack@n-api.service[103813]: X-User-Domain-Name: Default Jun 20 11:47:41.727922 n-d-master-1 devstack@n-api.service[103813]: X-User-Id: 906de9e1c52f4d18a485e89181c5a172 Jun 20 11:47:41.727922 n-d-master-1 devstack@n-api.service[103813]: X-User-Name: admin Jun 20 11:47:41.727922 n-d-master-1 devstack@n-api.service[103813]: method: > Jun 20 11:47:41.727922 n-d-master-1 devstack@n-api.service[103813]: exception: Flavor 451 could not be found. Jun 20 11:47:41.727922 n-d-master-1 devstack@n-api.service[103813]: action_args: {'id': '451'} Jun 20 11:47:41.727922 n-d-master-1 devstack@n-api.service[103813]: {{(pid=103813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:47:41.727922 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:47:41.728830 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 11:47:41.728830 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 11:47:41.728830 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 11:47:41.728830 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 11:47:41.728830 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 11:47:41.728830 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 11:47:41.728830 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 11:47:41.728830 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 11:47:41.728830 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 11:47:41.728830 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:47:41.728830 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 11:47:41.728830 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 11:47:41.728830 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 20 11:47:41.728830 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi Jun 20 11:47:41.728830 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:47:41.728830 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi Jun 20 11:47:41.728830 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:47:41.728830 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:47:41.728830 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:47:41.729873 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:47:41.729873 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:47:41.729873 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:47:41.729873 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:47:41.729873 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 11:47:41.729873 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:47:41.729873 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 20 11:47:41.729873 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi Jun 20 11:47:41.729873 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:47:41.729873 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi Jun 20 11:47:41.729873 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:47:41.729873 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:47:41.729873 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:47:41.729873 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:47:41.729873 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:47:41.729873 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 20 11:47:41.729873 n-d-master-1 devstack@n-api.service[103813]: ERROR nova.api.openstack.wsgi Jun 20 11:47:41.729873 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-1444393a-8b48-40d5-aa3d-181023d5c789 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103813) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:47:41.730873 n-d-master-1 devstack@n-api.service[103813]: INFO nova.api.openstack.requestlog [None req-1444393a-8b48-40d5-aa3d-181023d5c789 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012009 Jun 20 11:47:41.730873 n-d-master-1 devstack@n-api.service[103813]: [pid: 103813|app: 0|req: 27/52] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Jun 20 11:47:41 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 11:47:42.575660 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-49f1e605-381e-4f54-85e3-ab4ce84afb55 admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:47:42.576712 n-d-master-1 devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-49f1e605-381e-4f54-85e3-ab4ce84afb55 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jun 20 11:47:42.577109 n-d-master-1 devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 26/53] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Jun 20 11:47:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:47:42.781334 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-917c6b7a-4777-4d69-b63e-f4bf2189fdf9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:47:42.802534 n-d-master-1 devstack@n-api.service[103813]: INFO nova.api.openstack.requestlog [None req-917c6b7a-4777-4d69-b63e-f4bf2189fdf9 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.086030 Jun 20 11:47:42.803082 n-d-master-1 devstack@n-api.service[103813]: [pid: 103813|app: 0|req: 28/54] 10.222.0.27 () {64 vars in 1235 bytes} [Mon Jun 20 11:47:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:47:43.616478 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-49f1e605-381e-4f54-85e3-ab4ce84afb55 admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:47:43.617517 n-d-master-1 devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-49f1e605-381e-4f54-85e3-ab4ce84afb55 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Jun 20 11:47:43.617912 n-d-master-1 devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 27/55] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Jun 20 11:47:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:47:43.818712 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-848b905f-acb4-4efd-bafc-32fdca2cf206 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:47:43.838791 n-d-master-1 devstack@n-api.service[103813]: INFO nova.api.openstack.requestlog [None req-848b905f-acb4-4efd-bafc-32fdca2cf206 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.084042 Jun 20 11:47:43.839286 n-d-master-1 devstack@n-api.service[103813]: [pid: 103813|app: 0|req: 29/56] 10.222.0.27 () {64 vars in 1235 bytes} [Mon Jun 20 11:47:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:47:44.663108 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-49f1e605-381e-4f54-85e3-ab4ce84afb55 admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:47:44.664123 n-d-master-1 devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-49f1e605-381e-4f54-85e3-ab4ce84afb55 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 20 11:47:44.664576 n-d-master-1 devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 28/57] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Jun 20 11:47:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:47:44.860983 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-aedd8376-ad0e-4f96-83be-55b3d5016193 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:47:44.888623 n-d-master-1 devstack@n-api.service[103813]: INFO nova.api.openstack.requestlog [None req-aedd8376-ad0e-4f96-83be-55b3d5016193 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.087131 Jun 20 11:47:44.888623 n-d-master-1 devstack@n-api.service[103813]: [pid: 103813|app: 0|req: 30/58] 10.222.0.27 () {64 vars in 1235 bytes} [Mon Jun 20 11:47:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:47:45.715213 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-49f1e605-381e-4f54-85e3-ab4ce84afb55 admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:47:45.716301 n-d-master-1 devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-49f1e605-381e-4f54-85e3-ab4ce84afb55 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jun 20 11:47:45.716704 n-d-master-1 devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 29/59] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Jun 20 11:47:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:47:45.919545 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-0f8e5300-6074-4064-9f61-7d2ef36692af admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:47:45.943208 n-d-master-1 devstack@n-api.service[103813]: INFO nova.api.openstack.requestlog [None req-0f8e5300-6074-4064-9f61-7d2ef36692af admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.082378 Jun 20 11:47:45.943800 n-d-master-1 devstack@n-api.service[103813]: [pid: 103813|app: 0|req: 31/60] 10.222.0.27 () {64 vars in 1235 bytes} [Mon Jun 20 11:47:45 2022] POST /compute/v2.1/flavors => generated 409 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:47:46.759139 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-49f1e605-381e-4f54-85e3-ab4ce84afb55 admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:47:46.760145 n-d-master-1 devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-49f1e605-381e-4f54-85e3-ab4ce84afb55 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jun 20 11:47:46.760664 n-d-master-1 devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 30/61] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Jun 20 11:47:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:47:46.956995 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-4d1416dc-b2ec-4af1-b22e-d26f7ef48914 admin admin] Calling method '>' {{(pid=103813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:47:46.976668 n-d-master-1 devstack@n-api.service[103813]: INFO nova.api.openstack.requestlog [None req-4d1416dc-b2ec-4af1-b22e-d26f7ef48914 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.079894 Jun 20 11:47:46.977131 n-d-master-1 devstack@n-api.service[103813]: [pid: 103813|app: 0|req: 32/62] 10.222.0.27 () {60 vars in 1202 bytes} [Mon Jun 20 11:47:46 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:48:34.384880 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-49f1e605-381e-4f54-85e3-ab4ce84afb55 admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:48:34.386171 n-d-master-1 devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-49f1e605-381e-4f54-85e3-ab4ce84afb55 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002778 Jun 20 11:48:34.386727 n-d-master-1 devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 31/63] 10.222.0.27 () {54 vars in 930 bytes} [Mon Jun 20 11:48:34 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:48:34.401959 n-d-master-1 devstack@n-api.service[103813]: DEBUG dbcounter [-] [103813] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:48:34.457653 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-98eede0c-6c3a-46ec-acd0-852cbd58177b admin admin] Calling method '>' {{(pid=103813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:48:34.478312 n-d-master-1 devstack@n-api.service[103813]: INFO nova.api.openstack.requestlog [None req-98eede0c-6c3a-46ec-acd0-852cbd58177b admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.082092 Jun 20 11:48:34.478862 n-d-master-1 devstack@n-api.service[103813]: [pid: 103813|app: 0|req: 33/64] 10.222.0.27 () {60 vars in 1291 bytes} [Mon Jun 20 11:48:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:48:34.501881 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-bfbb278e-1ad0-4ba3-b9c8-97c06c4acdf7 admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:48:34.505392 n-d-master-1 devstack@n-api.service[103812]: DEBUG dbcounter [-] [103812] Writing DB stats nova_api:SELECT=14 {{(pid=103812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:48:34.511027 n-d-master-1 devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-bfbb278e-1ad0-4ba3-b9c8-97c06c4acdf7 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012980 Jun 20 11:48:34.511536 n-d-master-1 devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 32/65] 10.222.0.27 () {60 vars in 1282 bytes} [Mon Jun 20 11:48:34 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:48:34.525666 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-85bf518e-fc68-4cdb-ab27-400129121331 admin admin] Calling method '>' {{(pid=103813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:48:34.533835 n-d-master-1 devstack@n-api.service[103813]: INFO nova.api.openstack.requestlog [None req-85bf518e-fc68-4cdb-ab27-400129121331 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011824 Jun 20 11:48:34.534361 n-d-master-1 devstack@n-api.service[103813]: [pid: 103813|app: 0|req: 34/66] 10.222.0.27 () {60 vars in 1285 bytes} [Mon Jun 20 11:48:34 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:48:34.547019 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-59dc9fe0-6549-498b-b225-0e325e6d45fa admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:48:34.555018 n-d-master-1 devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-59dc9fe0-6549-498b-b225-0e325e6d45fa admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012448 Jun 20 11:48:34.555532 n-d-master-1 devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 33/67] 10.222.0.27 () {60 vars in 1285 bytes} [Mon Jun 20 11:48:34 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:48:34.566824 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-2cadf5ee-77d8-466b-ba44-1fb8ac2a9fcc admin admin] Calling method '>' {{(pid=103813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:48:34.575201 n-d-master-1 devstack@n-api.service[103813]: INFO nova.api.openstack.requestlog [None req-2cadf5ee-77d8-466b-ba44-1fb8ac2a9fcc admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011972 Jun 20 11:48:34.575756 n-d-master-1 devstack@n-api.service[103813]: [pid: 103813|app: 0|req: 35/68] 10.222.0.27 () {60 vars in 1282 bytes} [Mon Jun 20 11:48:34 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:54:24.950977 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-59dc9fe0-6549-498b-b225-0e325e6d45fa admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:54:24.952006 n-d-master-1 devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-59dc9fe0-6549-498b-b225-0e325e6d45fa admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jun 20 11:54:24.952437 n-d-master-1 devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 34/69] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Jun 20 11:54:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:54:25.093723 n-d-master-1 devstack@n-api.service[103813]: DEBUG dbcounter [-] [103813] Writing DB stats nova_api:SELECT=6 {{(pid=103813) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:54:25.217546 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-03eaf9a0-6649-46d7-af61-0c37c8252fa3 admin admin] Calling method '>' {{(pid=103813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:54:25.218716 n-d-master-1 devstack@n-api.service[103813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:54:25.218716 n-d-master-1 devstack@n-api.service[103813]: warnings.warn(msg) Jun 20 11:54:25.219918 n-d-master-1 devstack@n-api.service[103813]: DEBUG oslo_concurrency.lockutils [None req-03eaf9a0-6649-46d7-af61-0c37c8252fa3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:54:25.220394 n-d-master-1 devstack@n-api.service[103813]: DEBUG oslo_concurrency.lockutils [None req-03eaf9a0-6649-46d7-af61-0c37c8252fa3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:54:25.221176 n-d-master-1 devstack@n-api.service[103813]: DEBUG oslo_concurrency.lockutils [None req-03eaf9a0-6649-46d7-af61-0c37c8252fa3 admin admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:54:25.221604 n-d-master-1 devstack@n-api.service[103813]: DEBUG oslo_concurrency.lockutils [None req-03eaf9a0-6649-46d7-af61-0c37c8252fa3 admin admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:54:25.264002 n-d-master-1 devstack@n-api.service[103813]: INFO nova.api.openstack.requestlog [None req-03eaf9a0-6649-46d7-af61-0c37c8252fa3 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.171910 Jun 20 11:54:25.264597 n-d-master-1 devstack@n-api.service[103813]: [pid: 103813|app: 0|req: 36/70] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Jun 20 11:54:25 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:54:26.088237 n-d-master-1 devstack@n-api.service[103812]: DEBUG nova.api.openstack.wsgi [None req-59dc9fe0-6549-498b-b225-0e325e6d45fa admin admin] Calling method '>' {{(pid=103812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:54:26.089282 n-d-master-1 devstack@n-api.service[103812]: INFO nova.api.openstack.requestlog [None req-59dc9fe0-6549-498b-b225-0e325e6d45fa admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jun 20 11:54:26.089681 n-d-master-1 devstack@n-api.service[103812]: [pid: 103812|app: 0|req: 35/71] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Jun 20 11:54:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:54:26.291409 n-d-master-1 devstack@n-api.service[103813]: DEBUG nova.api.openstack.wsgi [None req-2ce29f4a-c148-483d-b52f-1cb27c8085d9 admin admin] Calling method '>' {{(pid=103813) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:54:26.292607 n-d-master-1 devstack@n-api.service[103813]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:54:26.292607 n-d-master-1 devstack@n-api.service[103813]: warnings.warn(msg) Jun 20 11:54:26.293962 n-d-master-1 devstack@n-api.service[103813]: DEBUG oslo_concurrency.lockutils [None req-2ce29f4a-c148-483d-b52f-1cb27c8085d9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:54:26.294432 n-d-master-1 devstack@n-api.service[103813]: DEBUG oslo_concurrency.lockutils [None req-2ce29f4a-c148-483d-b52f-1cb27c8085d9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:54:26.295263 n-d-master-1 devstack@n-api.service[103813]: DEBUG oslo_concurrency.lockutils [None req-2ce29f4a-c148-483d-b52f-1cb27c8085d9 admin admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:54:26.295677 n-d-master-1 devstack@n-api.service[103813]: DEBUG oslo_concurrency.lockutils [None req-2ce29f4a-c148-483d-b52f-1cb27c8085d9 admin admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103813) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:54:26.318973 n-d-master-1 devstack@n-api.service[103813]: INFO nova.api.openstack.requestlog [None req-2ce29f4a-c148-483d-b52f-1cb27c8085d9 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.091977 Jun 20 11:54:26.319525 n-d-master-1 devstack@n-api.service[103813]: [pid: 103813|app: 0|req: 37/72] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Jun 20 11:54:26 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:55:14.864473 n-d-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Jun 20 11:55:14.865069 n-d-master-1 devstack@n-api.service[103811]: Mon Jun 20 11:55:14 2022 - graceful shutdown triggered... Jun 20 11:55:14.865615 n-d-master-1 devstack@n-api.service[103813]: Gracefully killing worker 2 (pid: 103813)... Jun 20 11:55:14.866113 n-d-master-1 devstack@n-api.service[103812]: Gracefully killing worker 1 (pid: 103812)... Jun 20 11:55:15.866323 n-d-master-1 devstack@n-api.service[103811]: worker 1 buried after 1 seconds Jun 20 11:55:15.866323 n-d-master-1 devstack@n-api.service[103811]: worker 2 buried after 1 seconds Jun 20 11:55:15.866323 n-d-master-1 devstack@n-api.service[103811]: goodbye to uWSGI. Jun 20 11:55:15.867853 n-d-master-1 systemd[1]: devstack@n-api.service: Succeeded. Jun 20 11:55:15.868504 n-d-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Jun 20 11:55:15.871359 n-d-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Jun 20 11:55:15.891801 n-d-master-1 devstack@n-api.service[119116]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 20 11:55:15.893866 n-d-master-1 devstack@n-api.service[119116]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 20 11:55:15 2022] *** Jun 20 11:55:15.893866 n-d-master-1 devstack@n-api.service[119116]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 20 11:55:15.893866 n-d-master-1 devstack@n-api.service[119116]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 20 11:55:15.893866 n-d-master-1 devstack@n-api.service[119116]: nodename: n-d-master-1 Jun 20 11:55:15.893866 n-d-master-1 devstack@n-api.service[119116]: machine: x86_64 Jun 20 11:55:15.893866 n-d-master-1 devstack@n-api.service[119116]: clock source: unix Jun 20 11:55:15.893866 n-d-master-1 devstack@n-api.service[119116]: pcre jit disabled Jun 20 11:55:15.893866 n-d-master-1 devstack@n-api.service[119116]: detected number of CPU cores: 4 Jun 20 11:55:15.893866 n-d-master-1 devstack@n-api.service[119116]: current working directory: / Jun 20 11:55:15.893866 n-d-master-1 devstack@n-api.service[119116]: detected binary path: /usr/bin/uwsgi-core Jun 20 11:55:15.893866 n-d-master-1 devstack@n-api.service[119116]: your processes number limit is 47680 Jun 20 11:55:15.893866 n-d-master-1 devstack@n-api.service[119116]: your memory page size is 4096 bytes Jun 20 11:55:15.893866 n-d-master-1 devstack@n-api.service[119116]: detected max file descriptor number: 2048 Jun 20 11:55:15.893866 n-d-master-1 devstack@n-api.service[119116]: lock engine: pthread robust mutexes Jun 20 11:55:15.895385 n-d-master-1 devstack@n-api.service[119116]: thunder lock: enabled Jun 20 11:55:15.895385 n-d-master-1 devstack@n-api.service[119116]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 20 11:55:15.895385 n-d-master-1 devstack@n-api.service[119116]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 20 11:55:15.937932 n-d-master-1 devstack@n-api.service[119116]: Python main interpreter initialized at 0x55a0913fb9c0 Jun 20 11:55:15.937932 n-d-master-1 devstack@n-api.service[119116]: python threads support enabled Jun 20 11:55:15.937932 n-d-master-1 devstack@n-api.service[119116]: your server socket listen backlog is limited to 100 connections Jun 20 11:55:15.937932 n-d-master-1 devstack@n-api.service[119116]: your mercy for graceful operations on workers is 90 seconds Jun 20 11:55:15.938395 n-d-master-1 devstack@n-api.service[119116]: mapped 403077 bytes (393 KB) for 2 cores Jun 20 11:55:15.938395 n-d-master-1 devstack@n-api.service[119116]: *** Operational MODE: preforking *** Jun 20 11:55:15.938664 n-d-master-1 devstack@n-api.service[119116]: *** uWSGI is running in multiple interpreter mode *** Jun 20 11:55:15.938664 n-d-master-1 devstack@n-api.service[119116]: spawned uWSGI master process (pid: 119116) Jun 20 11:55:15.938664 n-d-master-1 devstack@n-api.service[119116]: spawned uWSGI worker 1 (pid: 119127, cores: 1) Jun 20 11:55:15.938664 n-d-master-1 devstack@n-api.service[119116]: spawned uWSGI worker 2 (pid: 119128, cores: 1) Jun 20 11:55:15.938664 n-d-master-1 devstack@n-api.service[119116]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 20 11:55:15.938859 n-d-master-1 systemd[1]: Started Devstack devstack@n-api.service. Jun 20 11:55:16.602743 n-d-master-1 devstack@n-api.service[119128]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 20 11:55:16.612485 n-d-master-1 devstack@n-api.service[119127]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 20 11:55:17.804357 n-d-master-1 devstack@n-api.service[119128]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 11:55:17.804357 n-d-master-1 devstack@n-api.service[119128]: from cryptography.utils import int_from_bytes Jun 20 11:55:17.805015 n-d-master-1 devstack@n-api.service[119128]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 11:55:17.805015 n-d-master-1 devstack@n-api.service[119128]: from cryptography.utils import int_from_bytes Jun 20 11:55:17.817638 n-d-master-1 devstack@n-api.service[119127]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 11:55:17.817638 n-d-master-1 devstack@n-api.service[119127]: from cryptography.utils import int_from_bytes Jun 20 11:55:17.818153 n-d-master-1 devstack@n-api.service[119127]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 11:55:17.818153 n-d-master-1 devstack@n-api.service[119127]: from cryptography.utils import int_from_bytes Jun 20 11:55:20.291505 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 11:55:20.292217 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 11:55:20.292340 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 11:55:20.292685 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 11:55:20.292964 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 11:55:20.293116 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 11:55:20.293517 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.293601 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 11:55:20.293704 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.293849 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 11:55:20.294014 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.294215 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 11:55:20.294329 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.294499 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 11:55:20.294635 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.294876 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.295041 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.295171 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.295283 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.295520 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.295681 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.295817 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.295918 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.296098 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.296331 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.296446 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.296553 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.296763 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.296899 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.297089 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.297237 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.297381 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.297493 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.297674 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.297773 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.297992 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.298093 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.298299 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.298391 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.298625 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.298726 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.298932 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.299035 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.299248 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.299434 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.299551 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.299948 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.300081 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.300343 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.300660 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.300766 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.301080 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.301184 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.301427 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.301536 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.301747 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.301845 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.302064 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.302167 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.302389 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.302498 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.302701 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.302798 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.303009 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.303098 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.303329 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.303427 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.303639 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.303727 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.303970 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.304115 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.304323 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.304461 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.304678 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.304899 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.305125 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.305337 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.305557 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.305790 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.306007 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.306206 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.306206 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.306589 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.306769 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.306950 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.307096 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.307234 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.307234 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.307554 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.307554 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.307840 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.307989 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.308165 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.308362 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.308512 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.308659 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.308799 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.308938 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.309089 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.309231 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.309380 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.309570 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.309714 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.309861 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.310018 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.310170 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.310318 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.310457 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.310596 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.310741 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.310887 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.311033 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.311184 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.311324 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.311481 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.311631 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.311785 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.311924 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.312070 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.312273 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.312434 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.312666 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.312818 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.312960 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.313122 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.313275 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.313443 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.313841 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.314012 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.314248 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.314458 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.314603 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.314756 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.314912 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.315064 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.315205 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.315411 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.315738 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.315974 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.316124 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.316322 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.316468 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.316954 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.317107 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.317257 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.317257 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.317527 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.317665 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.317665 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.317965 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.318105 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.318248 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.318395 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.318534 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.318672 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.318819 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.318966 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.319116 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.319262 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.319400 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.319548 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.319688 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.319849 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.319990 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.320128 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.320286 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.320441 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.320588 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.320734 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.320874 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.321019 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.321169 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.321321 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.321459 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.321605 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.321764 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.321904 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.322042 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.322189 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.322336 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.322474 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.322619 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.322758 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.322895 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.323041 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.323189 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.323333 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.323482 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.323621 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.324030 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.324176 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.324450 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.324657 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.324810 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.324956 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.325111 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.325255 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.325393 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.325531 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.325677 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.325829 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.325986 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.326132 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.326282 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.326420 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.326565 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.326704 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.326905 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.327053 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.327203 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.327343 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.327488 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.327640 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.327790 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.327935 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.328076 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.328232 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.328378 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.328528 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.328676 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.328823 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.328962 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.329107 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.329279 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.329460 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.329609 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.329803 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.329803 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.330087 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.330087 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.330370 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.330524 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.330670 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.330819 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.330958 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.331274 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.331468 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.331612 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.331751 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.331901 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.332040 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.332189 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.332376 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.332525 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.332675 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.332675 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.332954 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.333110 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.333110 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.333396 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.333543 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.333705 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.334119 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.334280 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.334421 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.334570 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.334803 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.334950 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.335090 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.335248 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.335389 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.335527 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.335665 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.335812 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.335974 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.336125 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.336317 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.336469 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.336617 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.336813 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.336964 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.337113 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.337260 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.337400 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.337538 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.337675 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.337823 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.337981 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.338120 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.338265 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.338404 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.338542 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.338688 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.338836 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:55:20.338977 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.339115 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.339261 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.339408 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.339561 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.339708 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.339869 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.340010 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.340155 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.340329 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.340474 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.340619 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.340758 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.340910 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.341057 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.341276 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.341418 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.341564 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.341721 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.341871 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.342011 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.342163 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.342310 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.342448 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.342585 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.342731 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.342880 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.343020 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.343158 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.343310 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.343484 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.343642 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.343782 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.343920 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.344371 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.344532 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.344673 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.344829 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.345039 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.345195 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.345344 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.345490 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.345636 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.345786 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.345926 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.346074 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.346215 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.346362 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.346510 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.346703 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.346860 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.347010 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.347151 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.347291 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.347444 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.347584 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.347744 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.347894 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.348034 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.348172 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.348340 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.348340 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.348340 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.348761 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.348909 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.349058 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.349197 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.349335 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.349482 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.349638 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.349787 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.349935 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.350082 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.350232 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.350385 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.350525 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.350662 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.350815 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.350963 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.351102 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.351254 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.351396 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.351545 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.351691 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.351830 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.351977 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.352124 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.352325 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.352468 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.352607 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.352753 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.352911 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.353059 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.353215 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.353377 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.353523 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.353671 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.353823 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.353972 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.354111 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.354540 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.354696 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.354836 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.354994 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.355222 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.355366 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.355504 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.355662 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.355802 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.355956 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.356095 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.356304 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.356448 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.356587 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.356735 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.356874 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.357018 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.357158 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.357304 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.357452 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.357612 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.357761 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.357900 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.358047 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.358194 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.358334 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.358481 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.358619 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.358758 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.358905 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.359050 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.359199 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.359353 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.359503 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.359650 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.359789 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.359928 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.360085 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.360248 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.360403 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.360550 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.360722 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.360867 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.361018 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.361166 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.361328 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.361474 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.361620 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.361760 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.361907 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.362054 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.362200 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.362493 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.362648 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.362797 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.362946 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.363094 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.363242 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.363401 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.363542 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.363690 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.363690 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.363690 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.364086 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.364472 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.364708 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.364868 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.365023 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.365174 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.365398 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.365557 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.365708 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.365857 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.366005 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.366155 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.366302 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.366441 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.366587 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.366741 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.366887 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.367034 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.367183 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.367322 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.367604 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.367774 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.367917 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.368056 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.368210 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.368371 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.368524 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.368663 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.368812 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.368959 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.369107 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.369245 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.369401 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.369559 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.369710 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.369849 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.369995 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.370142 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.370294 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.370434 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.370581 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.370581 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.370855 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.371007 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.371154 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.371294 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.371445 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.371586 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.371727 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.371874 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.372034 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.372181 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.372361 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.372361 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.372628 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.372780 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.372928 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.372928 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.373202 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.373362 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.373512 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.373665 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.373805 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.373944 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.374082 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.374230 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.374579 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.374824 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.374977 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.375128 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.375268 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.375431 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.375665 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.375810 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.375956 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.376105 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.376286 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.376443 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.376598 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.376739 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.376886 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.377039 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.377190 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.377337 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.377485 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.377634 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.377775 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.377996 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.378236 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.378379 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.378536 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.378677 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.378824 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.378824 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.379097 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.379244 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.379391 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.379547 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.379547 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.379830 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.379994 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.380150 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.380343 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.380490 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.380635 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.380788 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.380934 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.381091 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.381247 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.381392 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.381558 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.381704 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.381863 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.382018 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.382164 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.382315 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.382461 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.382612 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.382771 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.382918 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.383064 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.383209 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.383366 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.383522 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.383675 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.383821 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.383975 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.384129 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.384329 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.384475 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.384848 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.385075 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.385227 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.385372 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.385516 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.385677 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.385917 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.386077 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.386223 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.386368 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.386511 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.386670 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.386823 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.386975 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.387129 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.387282 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.387436 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.387618 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.387813 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.388013 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.388172 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.388372 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.388497 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.388603 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.388689 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.388778 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.388869 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.388958 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.389039 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.389133 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.389217 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.389304 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.389385 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.389471 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.389561 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.389655 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.389738 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.389818 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.389897 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.389994 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.390084 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.390162 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.390231 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.390307 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.390433 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.390523 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.390775 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.390924 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.391123 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.391260 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.391424 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.391533 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.391754 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.391904 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.392039 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.392150 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.392435 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.392567 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.392678 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.392780 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.393035 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.393184 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.393352 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.393515 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.393761 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.393941 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.394101 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.394498 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.394659 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.395027 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.395286 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.395440 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.395588 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.395741 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.395916 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.396270 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.396440 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.396597 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.396751 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.396897 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.397043 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.397202 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.397347 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.397506 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.397653 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.397815 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.397979 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.398125 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.398277 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.398435 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.398610 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.398770 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.398926 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.398926 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.399218 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.399375 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.399520 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.399693 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.399847 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.400007 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.400152 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.400331 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.400477 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.400623 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.400778 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.400925 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.401076 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.401221 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.401429 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.401618 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.401770 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.401915 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.402070 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.402224 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.402370 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.402523 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.402669 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.402669 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.402955 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.403114 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.403289 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.403448 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.403602 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.403747 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.403902 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.404056 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.404259 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.404413 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.404571 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.404718 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.405069 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.405223 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.405459 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.405638 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.405795 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.405941 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.406087 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.406327 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.406484 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.406639 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.406785 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.406931 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.407085 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.407233 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.407390 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.407544 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.407718 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.407872 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.408018 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.408163 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.408330 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.408488 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.408642 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.408787 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.408934 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.409085 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.409331 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.409562 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.409718 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.409876 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.410024 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.410171 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.410368 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.410521 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.410667 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.410812 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.410966 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.411112 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.411273 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.411427 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.411573 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.411740 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.411895 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.412048 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.412240 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.412395 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.412552 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.412699 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.412844 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.412997 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.413144 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.413297 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.413452 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.413597 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.413759 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.413921 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.414074 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.414219 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.414365 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.414510 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.414661 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.414821 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.415189 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.415351 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.415590 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.415742 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.415889 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.416056 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.416543 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.416718 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.416875 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.417021 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.417175 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.417347 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.417517 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.417677 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.417828 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.417979 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.418135 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.418280 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.418478 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.418640 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.418640 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.418974 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.418974 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.419316 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.419472 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.419628 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.419785 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.419940 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.419940 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.420343 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.420343 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.420657 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.420657 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.420963 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.421118 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.421274 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.421274 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.421551 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.421697 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.421851 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.422007 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.422161 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.422315 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.422471 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.422617 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.422778 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.422934 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.423087 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.423246 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.423392 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.423392 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.423695 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.423695 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.423989 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.424142 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.424323 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.424492 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.424647 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.424925 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.425296 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.425479 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.425758 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.425923 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.426078 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.426233 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.426379 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.426533 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.426686 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.426686 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.427067 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.427222 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.427369 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.427523 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.427673 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.427831 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.427831 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.428118 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.428317 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.428477 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.428634 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.428794 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.428950 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.429109 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.429263 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.429409 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.429563 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.429725 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.429872 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.430019 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.430165 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.430309 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.430463 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.430623 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.430777 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.430922 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.431080 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.431234 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.431388 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.431534 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.431534 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.431822 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.431976 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.432131 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.432131 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.432442 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.432597 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.432751 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.432921 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.433082 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.433236 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.433383 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.433540 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.433687 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.433833 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.434058 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.434213 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.434360 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.434505 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.434650 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.434803 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.434975 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.435129 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.435479 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.435632 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.435803 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.436026 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.436191 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.436374 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.436520 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.436665 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.436809 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.436970 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.437117 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.437273 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.437439 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.437593 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.437739 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.437897 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.438049 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.438195 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.438348 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.438502 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.438662 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.438816 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.438963 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.439107 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.439269 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.439416 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.439569 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.439723 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.439877 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.440022 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.440168 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.440338 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.440701 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.440908 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.441087 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.441295 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.441467 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.441971 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.442140 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.442286 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.442431 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.442583 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.442745 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.442892 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.443048 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.443194 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.443348 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.443494 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.443638 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.443795 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.443949 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.444095 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.444286 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.444439 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.444439 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.444738 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.444885 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.445030 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.445183 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.445335 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.445694 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.445852 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.446036 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.446266 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.446416 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.446561 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.446705 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.446860 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.447015 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.447176 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.447337 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.447494 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.447648 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.448007 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.448162 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.448363 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.448519 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.448665 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.448824 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.448972 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.449125 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.449279 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.449432 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.449578 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.449731 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.449887 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.450044 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.450044 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.450344 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.450491 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.450649 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.450794 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.450954 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.451110 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.451257 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.451257 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.451558 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.451704 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.451859 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.452012 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.452171 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.452358 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.452522 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.452672 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.452825 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.452972 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.453125 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.453286 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.453439 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.453597 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.453742 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.453895 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.454049 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.454218 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.454375 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.454521 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.454666 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.454943 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.455097 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.455254 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.455400 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.455716 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.455868 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.456162 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.456503 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.456688 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.456837 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.456982 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.457127 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.457368 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.457529 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.457688 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.457835 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.457980 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.458136 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.458291 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.458447 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.458604 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.458759 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.458905 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.459059 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.459219 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.459365 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.459511 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.459662 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.459815 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.459975 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.459975 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.460479 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.460637 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.460637 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.460936 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.461098 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.461253 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.461407 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.461554 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.461707 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.461864 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.462018 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.462174 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.462319 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.462472 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.462619 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.462777 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.462941 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.463088 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.463233 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.463381 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.463539 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.463695 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.463850 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.463995 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.464140 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.464348 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.464504 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.464660 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.464829 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.465056 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.465210 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.465356 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.465510 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.465802 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.465966 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.466126 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.466275 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.466421 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.466575 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.466729 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.466886 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.467053 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.467216 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.467372 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.467530 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.467685 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.467806 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.467895 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.467978 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.468069 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.468164 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.468287 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.468372 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.468454 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.468551 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.468670 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.468755 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.468838 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.468919 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.469009 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.469092 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.469189 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.469272 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.469362 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.469451 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.469534 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.469616 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.469727 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.469825 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.469904 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.469983 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.470068 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.470149 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.470240 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.470323 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.470412 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.470494 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.470576 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.470666 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.470749 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.470837 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.470928 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.471012 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.471101 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.471196 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.471279 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.471368 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.471457 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.471548 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.471671 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.471906 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.472045 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.472160 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.472282 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.472375 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.472466 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.472558 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.472649 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.472739 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.472739 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.472913 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.473027 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.473109 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.473190 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.473278 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.473360 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.473440 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.473534 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.473624 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.473770 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.473950 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.474111 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.474260 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.474422 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.474570 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.474717 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.474862 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.475018 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.475253 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.475413 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.475568 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.475857 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.476023 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.476177 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.476365 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.476365 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.476659 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.476814 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.476968 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.477123 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.477291 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.477439 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.477583 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.477735 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.477882 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.478041 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.478197 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.478344 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.478490 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.478490 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.478774 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.478927 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.479087 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.479253 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.479400 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.479554 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.479717 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.479872 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.480181 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.480371 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.480521 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.480691 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.480838 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.480993 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.481148 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.481302 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.481460 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.481614 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.481759 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.481914 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.482065 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.482219 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.482373 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.482373 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.482741 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.482890 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.483045 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.483220 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.483392 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.483392 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.483680 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.483827 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.483972 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.484117 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.484282 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.484431 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.484589 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.484745 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.484904 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.485056 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.485228 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.485456 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.485607 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.485755 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.486031 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.486191 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.486347 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.486508 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.486664 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.486819 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.486965 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.486965 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.487306 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.487575 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.487726 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.487873 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.488019 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.488165 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.488358 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.488505 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.488651 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.488798 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.488951 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.489105 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.489275 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.489422 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.489568 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.489724 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.489871 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.490031 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.490177 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.490322 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.490476 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.490625 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.490778 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.490934 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.491091 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.491237 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.491393 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.491539 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.491685 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.491838 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.491996 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.492142 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.492351 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.492539 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.492692 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.492869 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.493021 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.493159 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.493282 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.493520 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.493672 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.493841 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.494000 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.494104 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.494205 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.494448 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.494605 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.494771 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.494926 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.495044 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.495291 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.495428 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.495618 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.495742 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.495959 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.496097 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.496317 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.496477 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.496606 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.496701 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.496934 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.497141 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.497314 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.497480 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.497635 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.497803 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.497964 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.498137 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.498298 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.498461 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.498606 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.498774 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.498925 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.499081 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.499235 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.499404 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.499550 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.499703 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.499855 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.500001 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.500160 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.500365 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.500524 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.500678 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.500831 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.500984 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.501137 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.501294 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.501488 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.501648 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.501804 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.501964 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.502124 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.502277 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.502430 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.502576 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.502735 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.503010 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.503208 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.503868 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.504186 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.504518 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.504675 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.504840 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.504988 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.505132 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.505286 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.505443 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.505598 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.505763 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.505910 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.506063 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.506415 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.506584 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.506740 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.506902 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.507055 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.507209 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.507365 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.507518 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.507664 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.507820 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.507977 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.508123 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.508314 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.508476 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.508648 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.508805 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.508958 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.509104 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.509252 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.509403 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.509558 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.509712 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.509866 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.510018 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.510177 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.510322 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.510492 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.510639 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.510793 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.510951 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.511107 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.511253 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.511416 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.511570 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.511717 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.511862 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.512016 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.512016 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.512355 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.512484 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.512581 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.512668 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.512792 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.513009 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.513103 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.513185 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.513478 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.513620 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.513787 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.513939 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.514075 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.514177 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.514409 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.514545 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.514732 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.514890 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.515021 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.515132 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.515359 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.515562 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.515677 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.515776 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.515976 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.516130 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.516296 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.516442 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.516633 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.516783 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.516950 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.517157 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.517330 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.517491 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.517648 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.517796 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.517942 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.518126 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.518280 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.518447 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.518750 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.518907 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.519053 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.519253 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.519406 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.519588 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.519747 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.519894 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.520040 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.520241 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.520399 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.520564 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.520723 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.520869 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.521014 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.521179 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.521337 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.521491 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.521647 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.521803 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.521958 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.522106 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.522259 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.522412 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.522584 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.522736 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.522881 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.523035 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.523222 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.523378 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.523577 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.523752 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.523900 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.524044 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.524222 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.524400 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.524561 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.524720 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.524964 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.525138 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.525293 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.525440 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.525617 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.525768 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.525923 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.526089 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.526237 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.526581 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.526750 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.526918 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.526918 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.527212 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.527360 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.527504 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.527658 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.527805 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.527961 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.528120 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.528295 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.528457 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.528611 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.528772 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.528930 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.529085 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.529085 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.529364 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.529508 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.529654 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.529808 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.529954 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.530100 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.530255 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.530400 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.530556 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.530713 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.530869 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.531023 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.531169 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.531327 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.531487 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.531636 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.531796 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.531951 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.532098 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.532273 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.532441 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.532605 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.532752 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.532899 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.533045 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.533197 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.533352 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.533498 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.533643 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.533788 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.533934 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.534091 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.534403 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.534554 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.534554 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.534852 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.535026 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.535272 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.535423 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.535578 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.535733 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.535882 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.536038 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.536194 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.536384 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.536736 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.536893 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.537052 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.537213 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.537360 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.537514 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.537669 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.538427 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.538598 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.538769 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.538917 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.539063 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.539211 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.539372 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.539531 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.539687 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.539833 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.539978 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.540141 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.540325 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.540481 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.540641 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.540796 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.540942 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.541087 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.541234 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.541234 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.541577 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.541732 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.541886 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.542032 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.542176 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.542336 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.542483 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.542640 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.542786 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.542931 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.543076 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.543305 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.543455 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.543621 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.543775 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.543921 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.544067 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.544246 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.544412 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.544568 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.544721 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.544868 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.545032 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.545188 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.545433 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.545603 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.545749 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.545895 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.546054 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.546200 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.546345 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.546345 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.546631 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.546987 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.547146 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.547302 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.547457 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.547604 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.547768 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.547924 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.548078 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.548078 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.548421 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.548578 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.548725 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.548880 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.549026 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.549181 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.549327 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.549481 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.549647 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.549955 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.550122 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.550278 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.550432 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.550586 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.550743 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.550898 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.551044 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.551191 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.551335 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.551335 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.551619 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.551777 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 11:55:20.551932 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.551932 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.551932 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.551932 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.552599 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.552599 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.552883 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.553026 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.553265 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.553581 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.553913 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.554242 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.554595 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.554913 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.555267 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.555603 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.555923 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.556264 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.556577 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:55:20.556858 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 11:55:20.613286 n-d-master-1 devstack@n-api.service[119128]: INFO dbcounter [None req-66eed94c-575b-49cd-8a5a-49689e734ac8 None None] Registered counter for database nova_api Jun 20 11:55:20.620877 n-d-master-1 devstack@n-api.service[119127]: INFO dbcounter [None req-f61683bd-9b9b-48d3-8d62-46160eace445 None None] Registered counter for database nova_api Jun 20 11:55:20.634331 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_db.sqlalchemy.engines [None req-66eed94c-575b-49cd-8a5a-49689e734ac8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 11:55:20.641403 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writer thread running {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 11:55:20.641622 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_db.sqlalchemy.engines [None req-f61683bd-9b9b-48d3-8d62-46160eace445 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119127) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 11:55:20.649238 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writer thread running {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 11:55:20.699022 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.context [None req-66eed94c-575b-49cd-8a5a-49689e734ac8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d5df985c-a080-4240-bcef-1787de3aeb9e(cell1) {{(pid=119128) load_cells /opt/stack/nova/nova/context.py:464}} Jun 20 11:55:20.703497 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-66eed94c-575b-49cd-8a5a-49689e734ac8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:55:20.705312 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-66eed94c-575b-49cd-8a5a-49689e734ac8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:55:20.706324 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-66eed94c-575b-49cd-8a5a-49689e734ac8 None None] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:55:20.708487 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-66eed94c-575b-49cd-8a5a-49689e734ac8 None None] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:55:20.708644 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.context [None req-f61683bd-9b9b-48d3-8d62-46160eace445 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d5df985c-a080-4240-bcef-1787de3aeb9e(cell1) {{(pid=119127) load_cells /opt/stack/nova/nova/context.py:464}} Jun 20 11:55:20.710544 n-d-master-1 devstack@n-api.service[119128]: INFO dbcounter [None req-66eed94c-575b-49cd-8a5a-49689e734ac8 None None] Registered counter for database nova_cell0 Jun 20 11:55:20.712856 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f61683bd-9b9b-48d3-8d62-46160eace445 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:55:20.714405 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f61683bd-9b9b-48d3-8d62-46160eace445 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:55:20.714636 n-d-master-1 devstack@n-api.service[119128]: INFO dbcounter [None req-66eed94c-575b-49cd-8a5a-49689e734ac8 None None] Registered counter for database nova_cell1 Jun 20 11:55:20.715205 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f61683bd-9b9b-48d3-8d62-46160eace445 None None] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:55:20.717349 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f61683bd-9b9b-48d3-8d62-46160eace445 None None] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:55:20.719372 n-d-master-1 devstack@n-api.service[119127]: INFO dbcounter [None req-f61683bd-9b9b-48d3-8d62-46160eace445 None None] Registered counter for database nova_cell0 Jun 20 11:55:20.722313 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_db.sqlalchemy.engines [None req-66eed94c-575b-49cd-8a5a-49689e734ac8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 11:55:20.724766 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_db.sqlalchemy.engines [None req-66eed94c-575b-49cd-8a5a-49689e734ac8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 11:55:20.724908 n-d-master-1 devstack@n-api.service[119127]: INFO dbcounter [None req-f61683bd-9b9b-48d3-8d62-46160eace445 None None] Registered counter for database nova_cell1 Jun 20 11:55:20.730891 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writer thread running {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 11:55:20.732123 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_db.sqlalchemy.engines [None req-f61683bd-9b9b-48d3-8d62-46160eace445 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119127) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 11:55:20.733569 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writer thread running {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 11:55:20.737680 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_db.sqlalchemy.engines [None req-f61683bd-9b9b-48d3-8d62-46160eace445 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119127) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 11:55:20.743228 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writer thread running {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 11:55:20.748883 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writer thread running {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 11:55:20.894750 n-d-master-1 devstack@n-api.service[119127]: INFO dbcounter [None req-f61683bd-9b9b-48d3-8d62-46160eace445 None None] Registered counter for database nova_cell0 Jun 20 11:55:20.900248 n-d-master-1 devstack@n-api.service[119128]: INFO dbcounter [None req-66eed94c-575b-49cd-8a5a-49689e734ac8 None None] Registered counter for database nova_cell0 Jun 20 11:55:20.902146 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_db.sqlalchemy.engines [None req-f61683bd-9b9b-48d3-8d62-46160eace445 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119127) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 11:55:20.906851 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writer thread running {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 11:55:20.907295 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_db.sqlalchemy.engines [None req-66eed94c-575b-49cd-8a5a-49689e734ac8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 11:55:20.912165 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writer thread running {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 11:55:21.233755 n-d-master-1 devstack@n-api.service[119127]: WARNING keystonemiddleware.auth_token [None req-f61683bd-9b9b-48d3-8d62-46160eace445 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 11:55:21.241154 n-d-master-1 devstack@n-api.service[119127]: WARNING keystonemiddleware.auth_token [None req-f61683bd-9b9b-48d3-8d62-46160eace445 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 11:55:21.265226 n-d-master-1 devstack@n-api.service[119128]: WARNING keystonemiddleware.auth_token [None req-66eed94c-575b-49cd-8a5a-49689e734ac8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 11:55:21.272750 n-d-master-1 devstack@n-api.service[119128]: WARNING keystonemiddleware.auth_token [None req-66eed94c-575b-49cd-8a5a-49689e734ac8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 11:55:21.588280 n-d-master-1 devstack@n-api.service[119127]: WARNING keystonemiddleware.auth_token [None req-f61683bd-9b9b-48d3-8d62-46160eace445 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 11:55:21.594331 n-d-master-1 devstack@n-api.service[119127]: WARNING keystonemiddleware.auth_token [None req-f61683bd-9b9b-48d3-8d62-46160eace445 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 11:55:21.599723 n-d-master-1 devstack@n-api.service[119127]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a0913fb9c0 pid: 119127 (default app) Jun 20 11:55:21.625808 n-d-master-1 devstack@n-api.service[119128]: WARNING keystonemiddleware.auth_token [None req-66eed94c-575b-49cd-8a5a-49689e734ac8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 11:55:21.632010 n-d-master-1 devstack@n-api.service[119128]: WARNING keystonemiddleware.auth_token [None req-66eed94c-575b-49cd-8a5a-49689e734ac8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 11:55:21.637352 n-d-master-1 devstack@n-api.service[119128]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a0913fb9c0 pid: 119128 (default app) Jun 20 11:56:07.314950 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:56:07.316539 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:56:07.317702 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:56:07.318637 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:56:07.437687 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:56:07.439882 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:56:07.440834 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:56:07.442315 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:56:08.532596 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-09fad4a5-3aa2-427f-b3f1-93c09d28be36 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Calling method '.version_select at 0x7f6082105790>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:08.534797 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:08.534797 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:08.541203 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-09fad4a5-3aa2-427f-b3f1-93c09d28be36 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d5df985c-a080-4240-bcef-1787de3aeb9e(cell1) {{(pid=119127) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jun 20 11:56:08.542297 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-09fad4a5-3aa2-427f-b3f1-93c09d28be36 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:08.542930 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-09fad4a5-3aa2-427f-b3f1-93c09d28be36 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:08.573221 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-09fad4a5-3aa2-427f-b3f1-93c09d28be36 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:08.573934 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-09fad4a5-3aa2-427f-b3f1-93c09d28be36 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:08.588280 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-09fad4a5-3aa2-427f-b3f1-93c09d28be36 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:08.588962 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-09fad4a5-3aa2-427f-b3f1-93c09d28be36 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:08.595682 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-09fad4a5-3aa2-427f-b3f1-93c09d28be36 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.290810 Jun 20 11:56:08.596855 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1/1] 10.222.0.27 () {58 vars in 1166 bytes} [Mon Jun 20 11:56:07 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:08.639776 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f049c508-dc68-463f-9cb9-a92bcb9d5e86 tempest-FlavorsV255TestJSON-1791338581 tempest-FlavorsV255TestJSON-1791338581-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1454441939", "id": 478505842, "os-flavor-access:is_public": "True"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:08.658829 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:08.658829 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:08.693029 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f049c508-dc68-463f-9cb9-a92bcb9d5e86 tempest-FlavorsV255TestJSON-1791338581 tempest-FlavorsV255TestJSON-1791338581-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 1.265702 Jun 20 11:56:08.694120 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1/2] 10.222.0.27 () {62 vars in 1187 bytes} [Mon Jun 20 11:56:07 2022] POST /compute/v2.1/flavors => generated 446 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:56:08.763372 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6cbca021-408a-42f8-b729-2b729d8ec3bf tempest-AggregatesAdminTestV241-712732138 tempest-AggregatesAdminTestV241-712732138-project-admin] Calling method '.version_select at 0x7f608201a790>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:08.765534 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:08.765534 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:08.767135 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6cbca021-408a-42f8-b729-2b729d8ec3bf tempest-AggregatesAdminTestV241-712732138 tempest-AggregatesAdminTestV241-712732138-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:08.767579 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6cbca021-408a-42f8-b729-2b729d8ec3bf tempest-AggregatesAdminTestV241-712732138 tempest-AggregatesAdminTestV241-712732138-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:08.786814 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6cbca021-408a-42f8-b729-2b729d8ec3bf tempest-AggregatesAdminTestV241-712732138 tempest-AggregatesAdminTestV241-712732138-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:08.786814 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6cbca021-408a-42f8-b729-2b729d8ec3bf tempest-AggregatesAdminTestV241-712732138 tempest-AggregatesAdminTestV241-712732138-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:08.797366 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6cbca021-408a-42f8-b729-2b729d8ec3bf tempest-AggregatesAdminTestV241-712732138 tempest-AggregatesAdminTestV241-712732138-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:08.797806 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6cbca021-408a-42f8-b729-2b729d8ec3bf tempest-AggregatesAdminTestV241-712732138 tempest-AggregatesAdminTestV241-712732138-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:08.803693 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7f2aeecf-84f9-4c19-b500-ea60e8faa9be tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:08.804806 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6cbca021-408a-42f8-b729-2b729d8ec3bf tempest-AggregatesAdminTestV241-712732138 tempest-AggregatesAdminTestV241-712732138-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.206696 Jun 20 11:56:08.804969 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:08.804969 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:08.805373 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2/3] 10.222.0.27 () {60 vars in 1207 bytes} [Mon Jun 20 11:56:08 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:56:08.806242 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f2aeecf-84f9-4c19-b500-ea60e8faa9be tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:08.806680 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f2aeecf-84f9-4c19-b500-ea60e8faa9be tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:08.807466 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f2aeecf-84f9-4c19-b500-ea60e8faa9be tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:08.807892 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f2aeecf-84f9-4c19-b500-ea60e8faa9be tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:08.857518 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7f2aeecf-84f9-4c19-b500-ea60e8faa9be tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.161814 Jun 20 11:56:08.858404 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1175 bytes} [Mon Jun 20 11:56:08 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:08.983145 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5e5e8bed-89a1-4dff-b0e5-c46d80cdb399 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-465984343", "id": 727214186, "os-flavor-access:is_public": "True"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:09.001254 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:09.001254 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:09.013748 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8cb1a92f-95aa-4416-aee0-4bda0325446f tempest-AZAdminNegativeTestJSON-369701413 tempest-AZAdminNegativeTestJSON-369701413-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:09.014936 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:09.014936 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:09.016044 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8cb1a92f-95aa-4416-aee0-4bda0325446f tempest-AZAdminNegativeTestJSON-369701413 tempest-AZAdminNegativeTestJSON-369701413-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'f104bc543cf84b5c8739b7bd536456db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40cbdc853ec4c469e62ca6ee4e06f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:09.019406 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8cb1a92f-95aa-4416-aee0-4bda0325446f tempest-AZAdminNegativeTestJSON-369701413 tempest-AZAdminNegativeTestJSON-369701413-project] Request method failure captured: Jun 20 11:56:09.019406 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Jun 20 11:56:09.019406 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:56:09.019406 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:56:09.019406 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:56:09.019406 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 11:56:09.019406 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:56:09.019406 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:56:09.019406 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:56:09.019406 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:09.019406 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGBWLAdnBUbf0fGXbZ43BkM6gCeiub9es3Iww7fs1l1_13We6WwHX0-5c0lmy8oHjAgW6AUeWZKBwMQRt07z1bIhpAnQxDFPW3NgsXHGqVeRFJA-JtmzbRft7EuXYLQd1SN0Gd89gWg-1R3epn25KTDfTgwt6mwnGRREanXLspvvsUk Jun 20 11:56:09.019406 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:56:09.019406 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:56:09.019406 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:56:09.019406 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:56:09.019406 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:56:09.019406 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:56:09.019406 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: b40cbdc853ec4c469e62ca6ee4e06f17 Jun 20 11:56:09.019406 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-AZAdminNegativeTestJSON-369701413 Jun 20 11:56:09.019406 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 11:56:09.019406 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 11:56:09.020761 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b40cbdc853ec4c469e62ca6ee4e06f17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b40cbdc853ec4c469e62ca6ee4e06f17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b40cbdc853ec4c469e62ca6ee4e06f17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b40cbdc853ec4c469e62ca6ee4e06f17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:09.020761 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-AZAdminNegativeTestJSON-369701413 Jun 20 11:56:09.020761 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: b40cbdc853ec4c469e62ca6ee4e06f17 Jun 20 11:56:09.020761 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-369701413 Jun 20 11:56:09.020761 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-AZAdminNegativeTestJSON-369701413-project Jun 20 11:56:09.020761 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:56:09.020761 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:56:09.020761 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: f104bc543cf84b5c8739b7bd536456db Jun 20 11:56:09.020761 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-AZAdminNegativeTestJSON-369701413-project Jun 20 11:56:09.020761 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 11:56:09.020761 n-d-master-1 devstack@n-api.service[119128]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jun 20 11:56:09.020761 n-d-master-1 devstack@n-api.service[119128]: action_args: {} Jun 20 11:56:09.021367 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:09.021367 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:09.021367 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:09.021367 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:09.021367 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:09.021367 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:09.021367 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:09.021367 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:09.021367 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Jun 20 11:56:09.021367 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Jun 20 11:56:09.021367 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 20 11:56:09.021367 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 20 11:56:09.021367 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 20 11:56:09.021367 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 20 11:56:09.021367 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 11:56:09.021367 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 11:56:09.021367 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 11:56:09.021367 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 11:56:09.021367 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 20 11:56:09.022285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 20 11:56:09.022285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 20 11:56:09.022285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 20 11:56:09.022285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 20 11:56:09.022285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 20 11:56:09.022285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jun 20 11:56:09.022285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:09.022285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:09.022285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:09.022285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:09.022285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:09.022285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:09.022285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 20 11:56:09.022285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 20 11:56:09.022285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jun 20 11:56:09.022285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:09.022285 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8cb1a92f-95aa-4416-aee0-4bda0325446f tempest-AZAdminNegativeTestJSON-369701413 tempest-AZAdminNegativeTestJSON-369701413-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:09.023107 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8cb1a92f-95aa-4416-aee0-4bda0325446f tempest-AZAdminNegativeTestJSON-369701413 tempest-AZAdminNegativeTestJSON-369701413-project] 10.222.0.27 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.161769 Jun 20 11:56:09.023107 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3/5] 10.222.0.27 () {58 vars in 1184 bytes} [Mon Jun 20 11:56:08 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 163 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:56:09.026127 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-66eb436f-d7c4-4f34-bde6-a0f8e266f78b tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-708707118", "name": "tempest-test_aggregate-1947419939"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:09.046955 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:09.046955 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:09.047500 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5e5e8bed-89a1-4dff-b0e5-c46d80cdb399 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.240952 Jun 20 11:56:09.048486 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3/6] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:56:08 2022] POST /compute/v2.1/flavors => generated 426 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:09.049132 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.aggregate [None req-66eb436f-d7c4-4f34-bde6-a0f8e266f78b tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Generated uuid b3b3195e-0648-4745-83c7-81b757d80699 for aggregate {{(pid=119128) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 20 11:56:09.049775 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5e5e8bed-89a1-4dff-b0e5-c46d80cdb399 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:09.050881 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5e5e8bed-89a1-4dff-b0e5-c46d80cdb399 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001230 Jun 20 11:56:09.057268 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 4/7] 10.222.0.27 () {56 vars in 885 bytes} [Mon Jun 20 11:56:09 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jun 20 11:56:09.141038 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-66eb436f-d7c4-4f34-bde6-a0f8e266f78b tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.117311 Jun 20 11:56:09.141952 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 4/8] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Jun 20 11:56:09 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:09.148485 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8d3b9449-b14b-412c-bba3-037279566e48 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:09.149610 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:09.149610 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:09.176915 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8d3b9449-b14b-412c-bba3-037279566e48 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/727214186" status: 202 len: 0 microversion: 2.1 time: 0.033513 Jun 20 11:56:09.177673 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 5/9] 10.222.0.27 () {58 vars in 1157 bytes} [Mon Jun 20 11:56:09 2022] DELETE /compute/v2.1/flavors/727214186 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:56:09.182091 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-25ceae23-879a-46cb-82ee-cbae20fcc714 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:09.182846 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:09.182846 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:09.196070 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-25ceae23-879a-46cb-82ee-cbae20fcc714 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 301 microversion: 2.1 time: 0.017344 Jun 20 11:56:09.196668 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 6/10] 10.222.0.27 () {58 vars in 1142 bytes} [Mon Jun 20 11:56:09 2022] GET /compute/v2.1/os-aggregates => generated 301 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:09.201467 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-55a630bf-083e-4bf9-94f5-453696b1f4dd tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:09.233882 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-55a630bf-083e-4bf9-94f5-453696b1f4dd tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.035975 Jun 20 11:56:09.234455 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 7/11] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 11:56:09 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:09.239347 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d79ca579-fbb0-4b34-8f56-07f9e288f7dd tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:09.240865 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:09.240865 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:09.255754 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d79ca579-fbb0-4b34-8f56-07f9e288f7dd tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:09.256120 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d79ca579-fbb0-4b34-8f56-07f9e288f7dd tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:09.446276 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6d8e1d75-337d-4a08-aceb-ea9f44438410 tempest-FlavorsV255TestJSON-360791789 tempest-FlavorsV255TestJSON-360791789-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:09.475091 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6d8e1d75-337d-4a08-aceb-ea9f44438410 tempest-FlavorsV255TestJSON-360791789 tempest-FlavorsV255TestJSON-360791789-project] 10.222.0.27 "GET /compute/v2.1/flavors/478505842" status: 200 len: 446 microversion: 2.55 time: 0.422397 Jun 20 11:56:09.482123 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 5/12] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Jun 20 11:56:09 2022] GET /compute/v2.1/flavors/478505842 => generated 446 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:56:09.482123 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6ee9e5bd-ad72-4d00-8fb0-d98ad3221f46 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1353268856", "id": 938657062, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:09.499289 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6ee9e5bd-ad72-4d00-8fb0-d98ad3221f46 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.022158 Jun 20 11:56:09.500126 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 6/13] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:56:09 2022] POST /compute/v2.1/flavors => generated 414 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:09.511159 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a804ab2d-9f01-434d-8be7-af5b2bfad9cb tempest-FlavorsV255TestJSON-1791338581 tempest-FlavorsV255TestJSON-1791338581-project-admin] Action: 'update', calling method: .version_select at 0x7f60824c8d30>, body: {"flavor": {"description": "new"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:09.522624 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:09.522624 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:09.559597 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a804ab2d-9f01-434d-8be7-af5b2bfad9cb tempest-FlavorsV255TestJSON-1791338581 tempest-FlavorsV255TestJSON-1791338581-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/478505842" status: 200 len: 447 microversion: 2.55 time: 0.053940 Jun 20 11:56:09.560330 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 7/14] 10.222.0.27 () {62 vars in 1215 bytes} [Mon Jun 20 11:56:09 2022] PUT /compute/v2.1/flavors/478505842 => generated 447 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:56:09.571360 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7d95f7d2-ba12-48e5-b3be-b44da2809836 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:09.607260 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7d95f7d2-ba12-48e5-b3be-b44da2809836 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5810 microversion: 2.1 time: 0.045113 Jun 20 11:56:09.607908 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 8/15] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 11:56:09 2022] GET /compute/v2.1/flavors/detail => generated 5810 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:09.612949 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d8602e3e-9824-4d19-a4d6-416702d0e863 tempest-FlavorsV255TestJSON-360791789 tempest-FlavorsV255TestJSON-360791789-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:09.644652 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d8602e3e-9824-4d19-a4d6-416702d0e863 tempest-FlavorsV255TestJSON-360791789 tempest-FlavorsV255TestJSON-360791789-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6147 microversion: 2.55 time: 0.035423 Jun 20 11:56:09.645638 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 9/16] 10.222.0.27 () {60 vars in 1186 bytes} [Mon Jun 20 11:56:09 2022] GET /compute/v2.1/flavors/detail => generated 6147 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:56:10.056887 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bf1b9c10-7f76-44de-8c02-a8458bab0c8e tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1526393235", "id": 731016404, "os-flavor-access:is_public": "False"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:10.062116 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d79ca579-fbb0-4b34-8f56-07f9e288f7dd tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.1 time: 0.826472 Jun 20 11:56:10.064435 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 8/17] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Jun 20 11:56:09 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:10.071443 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-694618e9-dea1-4d28-8857-9a1e6ed10081 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:10.072289 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:10.072289 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:10.094614 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bf1b9c10-7f76-44de-8c02-a8458bab0c8e tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.447308 Jun 20 11:56:10.101629 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 10/18] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:56:09 2022] POST /compute/v2.1/flavors => generated 436 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:10.108316 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-694618e9-dea1-4d28-8857-9a1e6ed10081 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/938657062" status: 202 len: 0 microversion: 2.1 time: 0.042113 Jun 20 11:56:10.109331 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 9/19] 10.222.0.27 () {58 vars in 1157 bytes} [Mon Jun 20 11:56:10 2022] DELETE /compute/v2.1/flavors/938657062 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:56:10.112814 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1157c646-e9cb-41c4-8f1d-b445aa6a4f88 tempest-FlavorsV255TestJSON-360791789 tempest-FlavorsV255TestJSON-360791789-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:10.117558 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6f4027f5-598e-4d7e-abda-4f779ce9b57a tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "88dd4280f81742cca79931de52257fa3"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:10.123153 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:10.123153 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:10.163561 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1157c646-e9cb-41c4-8f1d-b445aa6a4f88 tempest-FlavorsV255TestJSON-360791789 tempest-FlavorsV255TestJSON-360791789-project] 10.222.0.27 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.55 time: 0.058573 Jun 20 11:56:10.164566 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 11/20] 10.222.0.27 () {60 vars in 1165 bytes} [Mon Jun 20 11:56:10 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:56:10.171330 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-35bfb874-6054-4c6d-9f46-7c273de93a51 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:10.207896 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-35bfb874-6054-4c6d-9f46-7c273de93a51 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.041304 Jun 20 11:56:10.209556 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 12/21] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 11:56:10 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:10.215269 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0ce56e8e-01cd-4c3f-b6ec-00845f085d21 tempest-FlavorsV255TestJSON-1791338581 tempest-FlavorsV255TestJSON-1791338581-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:10.217117 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:10.217117 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:10.257805 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0ce56e8e-01cd-4c3f-b6ec-00845f085d21 tempest-FlavorsV255TestJSON-1791338581 tempest-FlavorsV255TestJSON-1791338581-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/478505842" status: 202 len: 0 microversion: 2.55 time: 0.046240 Jun 20 11:56:10.258772 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 13/22] 10.222.0.27 () {60 vars in 1198 bytes} [Mon Jun 20 11:56:10 2022] DELETE /compute/v2.1/flavors/478505842 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:56:10.276075 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-290ff2bd-125b-43b0-a6c7-d03a72178cef tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1310084477", "id": 1446130534, "os-flavor-access:is_public": "True"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:10.310614 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-290ff2bd-125b-43b0-a6c7-d03a72178cef tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.050009 Jun 20 11:56:10.317324 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 14/23] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:56:10 2022] POST /compute/v2.1/flavors => generated 429 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:10.552574 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6f4027f5-598e-4d7e-abda-4f779ce9b57a tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/731016404/action" status: 200 len: 96 microversion: 2.1 time: 0.441728 Jun 20 11:56:10.557347 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 10/24] 10.222.0.27 () {60 vars in 1196 bytes} [Mon Jun 20 11:56:10 2022] POST /compute/v2.1/flavors/731016404/action => generated 96 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 11:56:10.562803 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9e32c97f-4e38-414c-8a5d-7bb0558eabd2 tempest-FlavorsV255TestJSON-1791338581 tempest-FlavorsV255TestJSON-1791338581-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:10.586922 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9e32c97f-4e38-414c-8a5d-7bb0558eabd2 tempest-FlavorsV255TestJSON-1791338581 tempest-FlavorsV255TestJSON-1791338581-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5725 microversion: 2.55 time: 0.030627 Jun 20 11:56:10.601136 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 11/25] 10.222.0.27 () {60 vars in 1186 bytes} [Mon Jun 20 11:56:10 2022] GET /compute/v2.1/flavors/detail => generated 5725 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:56:10.608063 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e35e9212-ea31-42f4-b2ee-85baeb9558cc tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:10.629336 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e35e9212-ea31-42f4-b2ee-85baeb9558cc tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1446130534" status: 202 len: 0 microversion: 2.1 time: 0.026461 Jun 20 11:56:10.630238 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 12/26] 10.222.0.27 () {58 vars in 1160 bytes} [Mon Jun 20 11:56:10 2022] DELETE /compute/v2.1/flavors/1446130534 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:56:10.635024 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2432c15a-ccb4-4103-b50e-74bf9f954243 tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "88dd4280f81742cca79931de52257fa3"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:10.719571 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-920894a9-f896-4486-8149-ef95d6c42eb5 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1570546327", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "availability_zone": "tempest-test_az-708707118"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:10.734214 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-920894a9-f896-4486-8149-ef95d6c42eb5 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:10.734960 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-920894a9-f896-4486-8149-ef95d6c42eb5 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:10.735983 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-920894a9-f896-4486-8149-ef95d6c42eb5 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:10.736627 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-920894a9-f896-4486-8149-ef95d6c42eb5 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:11.309333 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-2432c15a-ccb4-4103-b50e-74bf9f954243 tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] HTTP exception thrown: Flavor access already exists for flavor 18 and project 88dd4280f81742cca79931de52257fa3 combination. Jun 20 11:56:11.326404 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2432c15a-ccb4-4103-b50e-74bf9f954243 tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] Request method failure captured: Jun 20 11:56:11.326404 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/flavors/731016404/action HTTP/1.1 Jun 20 11:56:11.326404 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:56:11.326404 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:56:11.326404 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:56:11.326404 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 67 Jun 20 11:56:11.326404 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:56:11.326404 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:56:11.326404 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:56:11.326404 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:11.326404 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGBYuKXlb6R71cKHPxywlEbTDXaXbObYdmJPcf434SH3VW3FlJ8sGNyZSApgcpWr-4nlZyC9RIzTso6MhBZNgfnCjfOAsxWPqNCM9iyP4IuMfsGcj0HQS3uX4EJ1xK_f7Ax4GDdMpEkIvyqbvPQP8vbZhAkUWt_KpNFdWJNtzIEHiSI Jun 20 11:56:11.326404 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:56:11.326404 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:56:11.326404 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:56:11.326404 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:56:11.326404 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:56:11.326404 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:56:11.326404 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 6d9aabb1385f406f915671520fdddc9c Jun 20 11:56:11.326404 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1102082032 Jun 20 11:56:11.326404 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member,admin Jun 20 11:56:11.326404 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member,admin Jun 20 11:56:11.327705 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d9aabb1385f406f915671520fdddc9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d9aabb1385f406f915671520fdddc9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6d9aabb1385f406f915671520fdddc9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6d9aabb1385f406f915671520fdddc9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:11.327705 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1102082032 Jun 20 11:56:11.327705 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 6d9aabb1385f406f915671520fdddc9c Jun 20 11:56:11.327705 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1102082032 Jun 20 11:56:11.327705 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin Jun 20 11:56:11.327705 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:56:11.327705 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:56:11.327705 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 5a375a9716c746ac9dd6b498e11b0071 Jun 20 11:56:11.327705 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin Jun 20 11:56:11.327705 n-d-master-1 devstack@n-api.service[119128]: Jun 20 11:56:11.327705 n-d-master-1 devstack@n-api.service[119128]: {"addTenantAccess": {"tenant": "88dd4280f81742cca79931de52257fa3"}} Jun 20 11:56:11.327705 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 11:56:11.328484 n-d-master-1 devstack@n-api.service[119128]: exception: Flavor access already exists for flavor 18 and project 88dd4280f81742cca79931de52257fa3 combination. Jun 20 11:56:11.328484 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '731016404', 'body': {'addTenantAccess': {'tenant': '88dd4280f81742cca79931de52257fa3'}}} Jun 20 11:56:11.328484 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:11.328484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:11.328484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 11:56:11.328484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 20 11:56:11.328484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 11:56:11.328484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 20 11:56:11.328484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 11:56:11.328484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 20 11:56:11.328484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 11:56:11.328484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 20 11:56:11.328484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 11:56:11.328484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 11:56:11.328484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 11:56:11.328484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result.read() Jun 20 11:56:11.328484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 11:56:11.328484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 20 11:56:11.329604 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 11:56:11.329604 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 20 11:56:11.329604 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 11:56:11.329604 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 20 11:56:11.329604 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 11:56:11.329604 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 20 11:56:11.329604 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '18-88dd4280f81742cca79931de52257fa3' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jun 20 11:56:11.329604 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:11.329604 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jun 20 11:56:11.329604 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:11.329604 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:11.329604 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Jun 20 11:56:11.329604 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi project.save(context.session) Jun 20 11:56:11.329604 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jun 20 11:56:11.329604 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi session.flush() Jun 20 11:56:11.329604 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 20 11:56:11.329604 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._flush(objects) Jun 20 11:56:11.329604 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 20 11:56:11.329604 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jun 20 11:56:11.330788 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 20 11:56:11.330788 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi compat.raise_( Jun 20 11:56:11.330788 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 11:56:11.330788 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception Jun 20 11:56:11.330788 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 20 11:56:11.330788 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi flush_context.execute() Jun 20 11:56:11.330788 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 20 11:56:11.330788 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi rec.execute(self) Jun 20 11:56:11.330788 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 20 11:56:11.330788 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jun 20 11:56:11.330788 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 20 11:56:11.330788 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jun 20 11:56:11.330788 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 20 11:56:11.330788 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jun 20 11:56:11.330788 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 20 11:56:11.330788 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jun 20 11:56:11.330788 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 20 11:56:11.330788 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jun 20 11:56:11.331847 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 20 11:56:11.331847 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jun 20 11:56:11.331847 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 20 11:56:11.331847 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jun 20 11:56:11.331847 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 20 11:56:11.331847 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 20 11:56:11.331847 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 11:56:11.331847 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception Jun 20 11:56:11.331847 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 11:56:11.331847 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 20 11:56:11.331847 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 11:56:11.331847 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 20 11:56:11.331847 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 11:56:11.331847 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 20 11:56:11.331847 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 11:56:11.331847 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 20 11:56:11.331847 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 11:56:11.331847 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 11:56:11.332872 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 11:56:11.332872 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result.read() Jun 20 11:56:11.332872 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 11:56:11.332872 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 20 11:56:11.332872 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 11:56:11.332872 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 20 11:56:11.332872 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 11:56:11.332872 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 20 11:56:11.332872 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 11:56:11.332872 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 20 11:56:11.332872 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '18-88dd4280f81742cca79931de52257fa3' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jun 20 11:56:11.332872 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Jun 20 11:56:11.332872 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 6, 20, 11, 56, 11, 303219), 'updated_at': None, 'flavor_id': 18, 'project_id': '88dd4280f81742cca79931de52257fa3'}] Jun 20 11:56:11.332872 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 20 11:56:11.332872 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:11.332872 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:11.332872 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:11.333846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:11.333846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Jun 20 11:56:11.333846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Jun 20 11:56:11.333846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 20 11:56:11.333846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 20 11:56:11.333846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Jun 20 11:56:11.333846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Jun 20 11:56:11.333846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Jun 20 11:56:11.333846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Jun 20 11:56:11.333846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Jun 20 11:56:11.333846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Jun 20 11:56:11.333846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 20 11:56:11.333846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 20 11:56:11.333846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Jun 20 11:56:11.333846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Jun 20 11:56:11.333846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 18 and project 88dd4280f81742cca79931de52257fa3 combination. Jun 20 11:56:11.333846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:11.333846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:11.333846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:11.335027 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:11.335027 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:11.335027 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:11.335027 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:11.335027 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:11.335027 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:11.335027 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:11.335027 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:56:11.335027 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:56:11.335027 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Jun 20 11:56:11.335027 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Jun 20 11:56:11.335027 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 18 and project 88dd4280f81742cca79931de52257fa3 combination. Jun 20 11:56:11.335027 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:11.335027 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:11.335027 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:11.335027 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:11.335027 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:11.335027 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:11.335027 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:56:11.335027 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:56:11.338113 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 18 and project 88dd4280f81742cca79931de52257fa3 combination. Jun 20 11:56:11.338113 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:11.338113 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2432c15a-ccb4-4103-b50e-74bf9f954243 tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] Returning 409 to user: Flavor access already exists for flavor 18 and project 88dd4280f81742cca79931de52257fa3 combination. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:11.338113 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2432c15a-ccb4-4103-b50e-74bf9f954243 tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/731016404/action" status: 409 len: 152 microversion: 2.1 time: 0.696814 Jun 20 11:56:11.338113 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 13/27] 10.222.0.27 () {60 vars in 1196 bytes} [Mon Jun 20 11:56:10 2022] POST /compute/v2.1/flavors/731016404/action => generated 152 bytes in 702 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 20 11:56:11.339091 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-79137c32-387a-41ad-b154-7e012509bad8 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:11.358737 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-79137c32-387a-41ad-b154-7e012509bad8 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024532 Jun 20 11:56:11.359418 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 14/28] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 11:56:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:11.364680 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-75475a0b-8f0d-4f55-b942-d1c60c613467 tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "88dd4280f81742cca79931de52257fa3"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:11.365941 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:11.365941 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:11.377416 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-920894a9-f896-4486-8149-ef95d6c42eb5 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] validate_networks() for None {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:56:11.744951 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-920894a9-f896-4486-8149-ef95d6c42eb5 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:56:11.746319 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-920894a9-f896-4486-8149-ef95d6c42eb5 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:56:11.747092 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-920894a9-f896-4486-8149-ef95d6c42eb5 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:56:11.747697 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-920894a9-f896-4486-8149-ef95d6c42eb5 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:56:11.748399 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-920894a9-f896-4486-8149-ef95d6c42eb5 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:56:11.767046 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-920894a9-f896-4486-8149-ef95d6c42eb5 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:11.767930 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-920894a9-f896-4486-8149-ef95d6c42eb5 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:11.768881 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-920894a9-f896-4486-8149-ef95d6c42eb5 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:11.769580 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-920894a9-f896-4486-8149-ef95d6c42eb5 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:11.804162 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-920894a9-f896-4486-8149-ef95d6c42eb5 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Getting quotas for project c671077727e44ef8ba72fe3ffdfa15eb. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:56:11.816525 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-920894a9-f896-4486-8149-ef95d6c42eb5 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Getting quotas for user 93cf53cbece54a978bdab523d015313d and project c671077727e44ef8ba72fe3ffdfa15eb. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:56:11.835376 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-920894a9-f896-4486-8149-ef95d6c42eb5 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:56:11.838827 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-920894a9-f896-4486-8149-ef95d6c42eb5 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] [instance: 69a2418e-ab69-4e7b-a243-365951169370] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:56:11.845858 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-75475a0b-8f0d-4f55-b942-d1c60c613467 tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/731016404/action" status: 200 len: 21 microversion: 2.1 time: 0.485103 Jun 20 11:56:11.848420 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 15/29] 10.222.0.27 () {60 vars in 1196 bytes} [Mon Jun 20 11:56:11 2022] POST /compute/v2.1/flavors/731016404/action => generated 21 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 11:56:11.864287 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f95f1c85-f711-4364-a462-4f6aa639cb99 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1042609707", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:11.866045 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:11.866045 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:11.894746 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f95f1c85-f711-4364-a462-4f6aa639cb99 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.042033 Jun 20 11:56:11.903231 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 16/30] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:56:11 2022] POST /compute/v2.1/flavors => generated 507 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:11.913769 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9e4b8fbe-2723-4c4e-a8c3-b02c695cdb18 tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:11.928835 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-920894a9-f896-4486-8149-ef95d6c42eb5 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.608717 Jun 20 11:56:11.929766 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 15/31] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:56:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 11:56:11.945017 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9abab8be-fa0b-4a8d-aaa0-4927bb6aae21 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:11.945967 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:11.945967 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:11.959644 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9e4b8fbe-2723-4c4e-a8c3-b02c695cdb18 tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/731016404" status: 202 len: 0 microversion: 2.1 time: 0.055152 Jun 20 11:56:11.960266 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 17/32] 10.222.0.27 () {58 vars in 1157 bytes} [Mon Jun 20 11:56:11 2022] DELETE /compute/v2.1/flavors/731016404 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:56:11.969920 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5f2e5600-a1d0-41a7-813f-f99cd304ed1f tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:11.973719 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5f2e5600-a1d0-41a7-813f-f99cd304ed1f tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] [instance: 69a2418e-ab69-4e7b-a243-365951169370] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:11.988343 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9abab8be-fa0b-4a8d-aaa0-4927bb6aae21 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/4af8f93b-db12-4cec-af91-d3473e3b6bf8" status: 202 len: 0 microversion: 2.1 time: 0.056736 Jun 20 11:56:11.989429 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 16/33] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 11:56:11 2022] DELETE /compute/v2.1/flavors/4af8f93b-db12-4cec-af91-d3473e3b6bf8 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:56:12.000992 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a898fe9f-6669-4f4a-b563-bf235774478d tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:12.041408 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a898fe9f-6669-4f4a-b563-bf235774478d tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050223 Jun 20 11:56:12.042022 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 17/34] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 11:56:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:12.059622 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8a09d9f4-db1e-41ce-bd93-29db2a742a67 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:12.096872 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8a09d9f4-db1e-41ce-bd93-29db2a742a67 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050456 Jun 20 11:56:12.098385 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 18/35] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 11:56:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:12.104259 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bbdeab39-a2ed-4eba-9956-d56fe990db1c tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-456148279", "id": 1655741363, "os-flavor-access:is_public": "True"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:12.106128 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:12.106128 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:12.129032 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bbdeab39-a2ed-4eba-9956-d56fe990db1c tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.028470 Jun 20 11:56:12.136035 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 19/36] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:56:12 2022] POST /compute/v2.1/flavors => generated 437 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:12.142004 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b29d09c8-1437-497a-a18a-e057abd3a7e9 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1386155420", "id": "6254fd9c-145b-4ff0-bda7-655c37275fc9", "os-flavor-access:is_public": "True"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:12.168078 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b29d09c8-1437-497a-a18a-e057abd3a7e9 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.030699 Jun 20 11:56:12.169286 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 20/37] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:56:12 2022] POST /compute/v2.1/flavors => generated 507 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:12.176682 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bbee86d0-ab8f-463f-aae9-14e19a9f2825 tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:12.177592 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:12.177592 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:12.192281 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-bbee86d0-ab8f-463f-aae9-14e19a9f2825 tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] HTTP exception thrown: Access list not available for public flavors. Jun 20 11:56:12.194519 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bbee86d0-ab8f-463f-aae9-14e19a9f2825 tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] Request method failure captured: Jun 20 11:56:12.194519 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/flavors/1655741363/os-flavor-access HTTP/1.1 Jun 20 11:56:12.194519 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:56:12.194519 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:56:12.194519 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:56:12.194519 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 11:56:12.194519 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:56:12.194519 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:56:12.194519 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:56:12.194519 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:12.194519 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGBYuKXlb6R71cKHPxywlEbTDXaXbObYdmJPcf434SH3VW3FlJ8sGNyZSApgcpWr-4nlZyC9RIzTso6MhBZNgfnCjfOAsxWPqNCM9iyP4IuMfsGcj0HQS3uX4EJ1xK_f7Ax4GDdMpEkIvyqbvPQP8vbZhAkUWt_KpNFdWJNtzIEHiSI Jun 20 11:56:12.194519 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:56:12.194519 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:56:12.194519 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:56:12.194519 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:56:12.194519 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:56:12.194519 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:56:12.194519 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 6d9aabb1385f406f915671520fdddc9c Jun 20 11:56:12.194519 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1102082032 Jun 20 11:56:12.194519 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member,admin Jun 20 11:56:12.194519 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member,admin Jun 20 11:56:12.195713 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d9aabb1385f406f915671520fdddc9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d9aabb1385f406f915671520fdddc9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6d9aabb1385f406f915671520fdddc9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6d9aabb1385f406f915671520fdddc9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:12.195713 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1102082032 Jun 20 11:56:12.195713 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 6d9aabb1385f406f915671520fdddc9c Jun 20 11:56:12.195713 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1102082032 Jun 20 11:56:12.195713 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin Jun 20 11:56:12.195713 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:56:12.195713 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:56:12.195713 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 5a375a9716c746ac9dd6b498e11b0071 Jun 20 11:56:12.195713 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin Jun 20 11:56:12.195713 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 11:56:12.195713 n-d-master-1 devstack@n-api.service[119127]: exception: Access list not available for public flavors. Jun 20 11:56:12.195713 n-d-master-1 devstack@n-api.service[119127]: action_args: {'flavor_id': '1655741363'} Jun 20 11:56:12.196467 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:12.196467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:12.196467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:12.196467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:12.196467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:12.196467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:12.196467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:12.196467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:12.196467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Jun 20 11:56:12.196467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 20 11:56:12.196467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Jun 20 11:56:12.196467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:12.196467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:12.196467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:12.196467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:12.196467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:12.196467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:12.196467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:56:12.196467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:56:12.196467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Jun 20 11:56:12.196467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:12.197885 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bbee86d0-ab8f-463f-aae9-14e19a9f2825 tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:12.197885 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bbee86d0-ab8f-463f-aae9-14e19a9f2825 tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/1655741363/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.025729 Jun 20 11:56:12.197885 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 21/38] 10.222.0.27 () {58 vars in 1208 bytes} [Mon Jun 20 11:56:12 2022] GET /compute/v2.1/flavors/1655741363/os-flavor-access => generated 91 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 11:56:12.202791 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-add7982b-ed92-4abc-8c4e-0586ca1569b6 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:12.224359 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-add7982b-ed92-4abc-8c4e-0586ca1569b6 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/6254fd9c-145b-4ff0-bda7-655c37275fc9" status: 202 len: 0 microversion: 2.1 time: 0.024182 Jun 20 11:56:12.225123 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 22/39] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 11:56:12 2022] DELETE /compute/v2.1/flavors/6254fd9c-145b-4ff0-bda7-655c37275fc9 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:56:12.231984 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bd2a11ec-35c4-4e1a-8f21-2997c68a993d tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:12.246978 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=9,nova_api:UPDATE=1,nova_api:DELETE=9 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:56:12.252321 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bd2a11ec-35c4-4e1a-8f21-2997c68a993d tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1655741363" status: 202 len: 0 microversion: 2.1 time: 0.024934 Jun 20 11:56:12.254350 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 23/40] 10.222.0.27 () {58 vars in 1160 bytes} [Mon Jun 20 11:56:12 2022] DELETE /compute/v2.1/flavors/1655741363 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:56:12.260364 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ba109f78-5bc4-4104-8a71-8efd9c2c99b5 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:12.281173 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ba109f78-5bc4-4104-8a71-8efd9c2c99b5 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025703 Jun 20 11:56:12.281951 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 24/41] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 11:56:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:12.293742 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c576dec3-f473-4567-b098-5a8d327dbf74 tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:12.315551 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c576dec3-f473-4567-b098-5a8d327dbf74 tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032294 Jun 20 11:56:12.316533 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 25/42] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 11:56:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:12.321137 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bce12c27-3527-46bb-a06c-eb65539cf84b tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2126823869", "id": 1023692470, "os-flavor-access:is_public": "True"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:12.340564 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bce12c27-3527-46bb-a06c-eb65539cf84b tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.022580 Jun 20 11:56:12.341173 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 26/43] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:56:12 2022] POST /compute/v2.1/flavors => generated 414 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:12.346334 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-732357cb-b7a3-48f7-b97c-b004b6bd5704 tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1327011081", "id": 1349570142, "os-flavor-access:is_public": "False"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:12.364363 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-732357cb-b7a3-48f7-b97c-b004b6bd5704 tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.021957 Jun 20 11:56:12.371257 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 27/44] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:56:12 2022] POST /compute/v2.1/flavors => generated 439 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:12.376794 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6207c262-2a53-4a02-9e1a-ee0c7c1d2970 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:12.383788 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6207c262-2a53-4a02-9e1a-ee0c7c1d2970 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/1023692470" status: 200 len: 414 microversion: 2.1 time: 0.011536 Jun 20 11:56:12.389823 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 28/45] 10.222.0.27 () {58 vars in 1157 bytes} [Mon Jun 20 11:56:12 2022] GET /compute/v2.1/flavors/1023692470 => generated 414 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:12.668747 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-972975d5-2b89-4a7c-be51-0194c796a392 tempest-FlavorsAccessNegativeTestJSON-717764665 tempest-FlavorsAccessNegativeTestJSON-717764665-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "88dd4280f81742cca79931de52257fa3"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:12.673620 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:12.673620 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:12.675166 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-972975d5-2b89-4a7c-be51-0194c796a392 tempest-FlavorsAccessNegativeTestJSON-717764665 tempest-FlavorsAccessNegativeTestJSON-717764665-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '931e5e6af8974cff90547d255546e419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88dd4280f81742cca79931de52257fa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:12.679225 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-972975d5-2b89-4a7c-be51-0194c796a392 tempest-FlavorsAccessNegativeTestJSON-717764665 tempest-FlavorsAccessNegativeTestJSON-717764665-project] Request method failure captured: Jun 20 11:56:12.679225 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/flavors/1349570142/action HTTP/1.1 Jun 20 11:56:12.679225 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:56:12.679225 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:56:12.679225 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:56:12.679225 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 67 Jun 20 11:56:12.679225 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:56:12.679225 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:56:12.679225 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:56:12.679225 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:12.679225 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGBWQ3SUrl5keQtoylXeV6K6FtSj-KOU1jsmn2GQzDXO1kbCSXSh-iWa3mHM-gRFenY2EShtpfOABZeuFz_EItukxYA1HuOwLgHLaPNUgPmXtoPLz6zObisu9w62jyjDJaWErqo_Z38gf3ykmojpjSZFkjI9aZ7eTJ7uKDYDdEp_OrM Jun 20 11:56:12.679225 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:56:12.679225 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:56:12.679225 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:56:12.679225 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:56:12.679225 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:56:12.679225 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:56:12.679225 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 88dd4280f81742cca79931de52257fa3 Jun 20 11:56:12.679225 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-717764665 Jun 20 11:56:12.679225 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 11:56:12.679225 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 11:56:12.680850 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/88dd4280f81742cca79931de52257fa3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/88dd4280f81742cca79931de52257fa3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/88dd4280f81742cca79931de52257fa3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_88dd4280f81742cca79931de52257fa3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:12.680850 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-717764665 Jun 20 11:56:12.680850 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 88dd4280f81742cca79931de52257fa3 Jun 20 11:56:12.680850 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-717764665 Jun 20 11:56:12.680850 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-FlavorsAccessNegativeTestJSON-717764665-project Jun 20 11:56:12.680850 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:56:12.680850 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:56:12.680850 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 931e5e6af8974cff90547d255546e419 Jun 20 11:56:12.680850 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-717764665-project Jun 20 11:56:12.680850 n-d-master-1 devstack@n-api.service[119127]: Jun 20 11:56:12.680850 n-d-master-1 devstack@n-api.service[119127]: {"addTenantAccess": {"tenant": "88dd4280f81742cca79931de52257fa3"}} Jun 20 11:56:12.680850 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 11:56:12.681572 n-d-master-1 devstack@n-api.service[119127]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jun 20 11:56:12.681572 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '1349570142', 'body': {'addTenantAccess': {'tenant': '88dd4280f81742cca79931de52257fa3'}}} Jun 20 11:56:12.681572 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:12.681572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:12.681572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:12.681572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:12.681572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:12.681572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:12.681572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:12.681572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:12.681572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:56:12.681572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:56:12.681572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Jun 20 11:56:12.681572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Jun 20 11:56:12.681572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 20 11:56:12.681572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 20 11:56:12.681572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 20 11:56:12.681572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 20 11:56:12.681572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 11:56:12.682654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 11:56:12.682654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 11:56:12.682654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 11:56:12.682654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 20 11:56:12.682654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 20 11:56:12.682654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 20 11:56:12.682654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 20 11:56:12.682654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 20 11:56:12.682654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 20 11:56:12.682654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jun 20 11:56:12.682654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:12.682654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:12.682654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:12.682654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:12.682654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:12.682654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:12.682654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 20 11:56:12.682654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 20 11:56:12.682654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jun 20 11:56:12.682654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:12.685902 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-972975d5-2b89-4a7c-be51-0194c796a392 tempest-FlavorsAccessNegativeTestJSON-717764665 tempest-FlavorsAccessNegativeTestJSON-717764665-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:12.687235 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-972975d5-2b89-4a7c-be51-0194c796a392 tempest-FlavorsAccessNegativeTestJSON-717764665 tempest-FlavorsAccessNegativeTestJSON-717764665-project] 10.222.0.27 "POST /compute/v2.1/flavors/1349570142/action" status: 403 len: 130 microversion: 2.1 time: 0.301630 Jun 20 11:56:12.688380 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 29/46] 10.222.0.27 () {60 vars in 1199 bytes} [Mon Jun 20 11:56:12 2022] POST /compute/v2.1/flavors/1349570142/action => generated 130 bytes in 303 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:56:12.697468 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5f2e5600-a1d0-41a7-813f-f99cd304ed1f tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93cf53cbece54a978bdab523d015313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671077727e44ef8ba72fe3ffdfa15eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:12.712194 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5f2e5600-a1d0-41a7-813f-f99cd304ed1f tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] 10.222.0.27 "GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370" status: 200 len: 1242 microversion: 2.1 time: 0.750671 Jun 20 11:56:12.712946 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 18/47] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:11 2022] GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370 => generated 1242 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:12.730073 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bc3e65d0-a9a2-4796-a032-f48187e3044f tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:12.731005 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:12.731005 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:12.752507 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bc3e65d0-a9a2-4796-a032-f48187e3044f tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1349570142" status: 202 len: 0 microversion: 2.1 time: 0.028425 Jun 20 11:56:12.756367 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 19/48] 10.222.0.27 () {58 vars in 1160 bytes} [Mon Jun 20 11:56:12 2022] DELETE /compute/v2.1/flavors/1349570142 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:56:12.764641 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-201cd3d8-0311-4024-9fea-d1f1330becc4 tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:12.805369 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-201cd3d8-0311-4024-9fea-d1f1330becc4 tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.047396 Jun 20 11:56:12.806588 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 20/49] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 11:56:12 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:12.824057 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7b9326ea-8220-42bb-8821-db9b2dddac1c tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1256022674", "id": 1716412829, "os-flavor-access:is_public": "False"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:12.827757 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:12.827757 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:12.848339 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=8,nova_api:DELETE=16 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:56:12.854464 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7b9326ea-8220-42bb-8821-db9b2dddac1c tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.034510 Jun 20 11:56:12.856276 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 21/50] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:56:12 2022] POST /compute/v2.1/flavors => generated 439 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 11:56:12.867231 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f0ebcaf3-b0a8-49ff-90d0-70ce68c9e6d7 tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "88dd4280f81742cca79931de52257fa3"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:12.868783 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:12.868783 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:13.186460 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a5a7af01-2847-4d02-a137-26513c9e59ba tempest-FlavorsAdminTestJSON-946673456 tempest-FlavorsAdminTestJSON-946673456-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:13.210441 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a5a7af01-2847-4d02-a137-26513c9e59ba tempest-FlavorsAdminTestJSON-946673456 tempest-FlavorsAdminTestJSON-946673456-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.520445 Jun 20 11:56:13.222006 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 30/51] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 11:56:12 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:13.229328 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b06e7309-2862-494f-8278-fb284d9275b4 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:13.254574 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b06e7309-2862-494f-8278-fb284d9275b4 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1023692470" status: 202 len: 0 microversion: 2.1 time: 0.029413 Jun 20 11:56:13.260060 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 31/52] 10.222.0.27 () {58 vars in 1160 bytes} [Mon Jun 20 11:56:13 2022] DELETE /compute/v2.1/flavors/1023692470 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:56:13.266593 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f6811a36-1606-4664-b343-aca4da84c446 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:13.297583 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f6811a36-1606-4664-b343-aca4da84c446 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036117 Jun 20 11:56:13.298562 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 32/53] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 11:56:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:13.314513 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-779455f9-4ec1-49de-b101-22da665f4a9f tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1876206738", "id": 1175689049, "os-flavor-access:is_public": "False"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:13.339736 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-779455f9-4ec1-49de-b101-22da665f4a9f tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.028962 Jun 20 11:56:13.340975 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 33/54] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:56:13 2022] POST /compute/v2.1/flavors => generated 430 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 11:56:13.367194 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-03eec2f7-c895-438c-8c37-7a21cbd0de49 tempest-FlavorsAdminTestJSON-946673456 tempest-FlavorsAdminTestJSON-946673456-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "1175689049"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:13.380037 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-03eec2f7-c895-438c-8c37-7a21cbd0de49 tempest-FlavorsAdminTestJSON-946673456 tempest-FlavorsAdminTestJSON-946673456-project] HTTP exception thrown: Flavor 1175689049 could not be found. Jun 20 11:56:13.383493 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-03eec2f7-c895-438c-8c37-7a21cbd0de49 tempest-FlavorsAdminTestJSON-946673456 tempest-FlavorsAdminTestJSON-946673456-project] Request method failure captured: Jun 20 11:56:13.383493 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 20 11:56:13.383493 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:56:13.383493 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:56:13.383493 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:56:13.383493 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 107 Jun 20 11:56:13.383493 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:56:13.383493 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:56:13.383493 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:56:13.383493 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:13.383493 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGBWx8veNo157g4D_IKaqdcqpNgAVXlLxxj1pEMBQMGf6YN18NNJ_rNhmFvRzH67mRnv2PFkRqOeoVKAF2dEuaVSQlp8rRpmIm3TeUFDybg8mUXUMM3GriVH8a-3ZBE2ey4bBr0Ww7OVY1F6QHL6s8tAV1hI32QG1GpNcA2pV0wGKSI Jun 20 11:56:13.383493 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:56:13.383493 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:56:13.383493 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:56:13.383493 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:56:13.383493 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:56:13.383493 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:56:13.383493 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 6709e48bff864f758347cd4b7f741c4f Jun 20 11:56:13.383493 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-FlavorsAdminTestJSON-946673456 Jun 20 11:56:13.383493 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 11:56:13.383493 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 11:56:13.384978 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6709e48bff864f758347cd4b7f741c4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6709e48bff864f758347cd4b7f741c4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6709e48bff864f758347cd4b7f741c4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6709e48bff864f758347cd4b7f741c4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:13.384978 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-FlavorsAdminTestJSON-946673456 Jun 20 11:56:13.384978 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 6709e48bff864f758347cd4b7f741c4f Jun 20 11:56:13.384978 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-946673456 Jun 20 11:56:13.384978 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-FlavorsAdminTestJSON-946673456-project Jun 20 11:56:13.384978 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:56:13.384978 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:56:13.384978 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: b0770d5bcb8c459ea2d08559d835581a Jun 20 11:56:13.384978 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-FlavorsAdminTestJSON-946673456-project Jun 20 11:56:13.384978 n-d-master-1 devstack@n-api.service[119127]: Jun 20 11:56:13.384978 n-d-master-1 devstack@n-api.service[119127]: {"server": {"name": "test", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "1175689049"}} Jun 20 11:56:13.384978 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 11:56:13.384978 n-d-master-1 devstack@n-api.service[119127]: exception: Flavor 1175689049 could not be found. Jun 20 11:56:13.385768 n-d-master-1 devstack@n-api.service[119127]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'f16836cc-4e18-4bd0-b261-3865adf8cb83', 'flavorRef': '1175689049'}}} Jun 20 11:56:13.385768 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:13.385768 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:13.385768 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jun 20 11:56:13.385768 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jun 20 11:56:13.385768 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 11:56:13.385768 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 11:56:13.385768 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 11:56:13.385768 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 11:56:13.385768 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 11:56:13.385768 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 11:56:13.385768 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 11:56:13.385768 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:13.385768 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 11:56:13.385768 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 11:56:13.385768 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1175689049 could not be found. Jun 20 11:56:13.385768 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:13.385768 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:13.385768 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:13.385768 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:13.386966 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:13.386966 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:13.386966 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:13.386966 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:13.386966 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:13.386966 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:13.386966 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:56:13.386966 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:56:13.386966 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:56:13.386966 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:56:13.386966 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:56:13.386966 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:56:13.386966 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 20 11:56:13.386966 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jun 20 11:56:13.386966 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jun 20 11:56:13.386966 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1175689049 could not be found. Jun 20 11:56:13.386966 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:13.386966 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:13.386966 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:13.386966 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:13.386966 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:13.388330 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:13.388330 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:56:13.388330 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:56:13.388330 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1175689049 could not be found. Jun 20 11:56:13.388330 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:13.388330 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-03eec2f7-c895-438c-8c37-7a21cbd0de49 tempest-FlavorsAdminTestJSON-946673456 tempest-FlavorsAdminTestJSON-946673456-project] Returning 400 to user: Flavor 1175689049 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:13.388330 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-03eec2f7-c895-438c-8c37-7a21cbd0de49 tempest-FlavorsAdminTestJSON-946673456 tempest-FlavorsAdminTestJSON-946673456-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.036619 Jun 20 11:56:13.388330 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 34/55] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:56:13 2022] POST /compute/v2.1/servers => generated 81 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jun 20 11:56:13.394695 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-51b5b7d7-b0ab-4545-bf4f-617ad324a487 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:13.415891 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-51b5b7d7-b0ab-4545-bf4f-617ad324a487 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1175689049" status: 202 len: 0 microversion: 2.1 time: 0.024748 Jun 20 11:56:13.417370 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 35/56] 10.222.0.27 () {58 vars in 1160 bytes} [Mon Jun 20 11:56:13 2022] DELETE /compute/v2.1/flavors/1175689049 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:56:13.426224 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3cdfe753-a135-430d-92fb-73aa52d72a0e tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:13.450963 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3cdfe753-a135-430d-92fb-73aa52d72a0e tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028727 Jun 20 11:56:13.464382 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 36/57] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 11:56:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:13.471985 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-db6b6603-5328-4187-aca5-ad713f858ba4 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-736112175", "id": 268489782, "os-flavor-access:is_public": "False"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:13.476867 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f0ebcaf3-b0a8-49ff-90d0-70ce68c9e6d7 tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1716412829/action" status: 200 len: 97 microversion: 2.1 time: 0.614887 Jun 20 11:56:13.482525 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 22/58] 10.222.0.27 () {60 vars in 1199 bytes} [Mon Jun 20 11:56:12 2022] POST /compute/v2.1/flavors/1716412829/action => generated 97 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 20 11:56:13.488362 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8f8e6e9c-afde-4a27-a079-1d5ca9b3ab4f tempest-FlavorsAccessNegativeTestJSON-717764665 tempest-FlavorsAccessNegativeTestJSON-717764665-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "88dd4280f81742cca79931de52257fa3"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:13.490022 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:13.490022 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:13.491077 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8f8e6e9c-afde-4a27-a079-1d5ca9b3ab4f tempest-FlavorsAccessNegativeTestJSON-717764665 tempest-FlavorsAccessNegativeTestJSON-717764665-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '931e5e6af8974cff90547d255546e419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88dd4280f81742cca79931de52257fa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:13.493099 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8f8e6e9c-afde-4a27-a079-1d5ca9b3ab4f tempest-FlavorsAccessNegativeTestJSON-717764665 tempest-FlavorsAccessNegativeTestJSON-717764665-project] Request method failure captured: Jun 20 11:56:13.493099 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/flavors/1716412829/action HTTP/1.1 Jun 20 11:56:13.493099 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:56:13.493099 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:56:13.493099 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:56:13.493099 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 70 Jun 20 11:56:13.493099 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:56:13.493099 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:56:13.493099 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:56:13.493099 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:13.493099 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGBWQ3SUrl5keQtoylXeV6K6FtSj-KOU1jsmn2GQzDXO1kbCSXSh-iWa3mHM-gRFenY2EShtpfOABZeuFz_EItukxYA1HuOwLgHLaPNUgPmXtoPLz6zObisu9w62jyjDJaWErqo_Z38gf3ykmojpjSZFkjI9aZ7eTJ7uKDYDdEp_OrM Jun 20 11:56:13.493099 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:56:13.493099 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:56:13.493099 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:56:13.493099 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:56:13.493099 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:56:13.493099 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:56:13.493099 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 88dd4280f81742cca79931de52257fa3 Jun 20 11:56:13.493099 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-717764665 Jun 20 11:56:13.493099 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 11:56:13.493099 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 11:56:13.494459 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/88dd4280f81742cca79931de52257fa3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/88dd4280f81742cca79931de52257fa3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/88dd4280f81742cca79931de52257fa3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_88dd4280f81742cca79931de52257fa3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:13.494459 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-717764665 Jun 20 11:56:13.494459 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 88dd4280f81742cca79931de52257fa3 Jun 20 11:56:13.494459 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-717764665 Jun 20 11:56:13.494459 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-FlavorsAccessNegativeTestJSON-717764665-project Jun 20 11:56:13.494459 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:56:13.494459 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:56:13.494459 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 931e5e6af8974cff90547d255546e419 Jun 20 11:56:13.494459 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-717764665-project Jun 20 11:56:13.494459 n-d-master-1 devstack@n-api.service[119128]: Jun 20 11:56:13.494459 n-d-master-1 devstack@n-api.service[119128]: {"removeTenantAccess": {"tenant": "88dd4280f81742cca79931de52257fa3"}} Jun 20 11:56:13.494459 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 11:56:13.495117 n-d-master-1 devstack@n-api.service[119128]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jun 20 11:56:13.495117 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '1716412829', 'body': {'removeTenantAccess': {'tenant': '88dd4280f81742cca79931de52257fa3'}}} Jun 20 11:56:13.495117 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:13.495117 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:13.495117 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:13.495117 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:13.495117 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:13.495117 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:13.495117 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:13.495117 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:13.495117 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:56:13.495117 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:56:13.495117 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Jun 20 11:56:13.495117 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi context.can( Jun 20 11:56:13.495117 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 20 11:56:13.495117 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 20 11:56:13.495117 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 20 11:56:13.495117 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 20 11:56:13.495117 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 11:56:13.495117 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 11:56:13.496310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 11:56:13.496310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 11:56:13.496310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 20 11:56:13.496310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 20 11:56:13.496310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 20 11:56:13.496310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 20 11:56:13.496310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 20 11:56:13.496310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 20 11:56:13.496310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jun 20 11:56:13.496310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:13.496310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:13.496310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:13.496310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:13.496310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:13.496310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:13.496310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 20 11:56:13.496310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 20 11:56:13.496310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jun 20 11:56:13.496310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:13.498148 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8f8e6e9c-afde-4a27-a079-1d5ca9b3ab4f tempest-FlavorsAccessNegativeTestJSON-717764665 tempest-FlavorsAccessNegativeTestJSON-717764665-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:13.498985 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-db6b6603-5328-4187-aca5-ad713f858ba4 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.031510 Jun 20 11:56:13.499122 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8f8e6e9c-afde-4a27-a079-1d5ca9b3ab4f tempest-FlavorsAccessNegativeTestJSON-717764665 tempest-FlavorsAccessNegativeTestJSON-717764665-project] 10.222.0.27 "POST /compute/v2.1/flavors/1716412829/action" status: 403 len: 133 microversion: 2.1 time: 0.015439 Jun 20 11:56:13.499589 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 37/59] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:56:13 2022] POST /compute/v2.1/flavors => generated 411 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:13.503089 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 23/60] 10.222.0.27 () {60 vars in 1199 bytes} [Mon Jun 20 11:56:13 2022] POST /compute/v2.1/flavors/1716412829/action => generated 133 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:56:13.509015 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c923f9b1-fd26-4afc-8ef3-2a90115b47ca tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "88dd4280f81742cca79931de52257fa3"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:13.510530 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:13.510530 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:13.517279 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ed63bba9-2d76-42eb-ae42-356e72cc1270 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-135741918", "id": 628665710, "os-flavor-access:is_public": "True"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:13.538135 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ed63bba9-2d76-42eb-ae42-356e72cc1270 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.031337 Jun 20 11:56:13.539112 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 24/61] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:56:13 2022] POST /compute/v2.1/flavors => generated 410 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:13.549506 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7c5acf9f-bc6c-4bd6-b751-73175387aea1 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:13.567203 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7c5acf9f-bc6c-4bd6-b751-73175387aea1 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 843 microversion: 2.1 time: 0.021397 Jun 20 11:56:13.568264 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 25/62] 10.222.0.27 () {58 vars in 1168 bytes} [Mon Jun 20 11:56:13 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 843 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:13.580068 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e1c99e1f-6289-4686-96df-187c08505ad6 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:13.591315 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e1c99e1f-6289-4686-96df-187c08505ad6 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 843 microversion: 2.1 time: 0.015494 Jun 20 11:56:13.592675 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 26/63] 10.222.0.27 () {58 vars in 1176 bytes} [Mon Jun 20 11:56:13 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 843 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:13.607050 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4de236cc-46b1-41e7-aeaa-bb8ae1a8c10c tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:13.620106 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4de236cc-46b1-41e7-aeaa-bb8ae1a8c10c tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 843 microversion: 2.1 time: 0.018804 Jun 20 11:56:13.621812 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 27/64] 10.222.0.27 () {58 vars in 1170 bytes} [Mon Jun 20 11:56:13 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 843 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:13.633271 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-da40796f-b948-4dd3-8550-06f15402c929 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:13.644655 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-da40796f-b948-4dd3-8550-06f15402c929 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 843 microversion: 2.1 time: 0.015114 Jun 20 11:56:13.645894 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 28/65] 10.222.0.27 () {58 vars in 1168 bytes} [Mon Jun 20 11:56:13 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 843 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:13.656908 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-691c893e-0cfa-473f-99e9-2357bc90fba0 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:13.682873 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-691c893e-0cfa-473f-99e9-2357bc90fba0 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5391 microversion: 2.1 time: 0.029738 Jun 20 11:56:13.683835 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 29/66] 10.222.0.27 () {58 vars in 1168 bytes} [Mon Jun 20 11:56:13 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5391 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:56:13.701878 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4e2c4190-1a0f-43a1-b29c-c0ac30807a02 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:13.735328 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4e2c4190-1a0f-43a1-b29c-c0ac30807a02 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5391 microversion: 2.1 time: 0.039003 Jun 20 11:56:13.735916 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 30/67] 10.222.0.27 () {58 vars in 1174 bytes} [Mon Jun 20 11:56:13 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5391 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:56:13.740876 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f953c856-04d0-4161-baf4-19aa6e986596 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:13.741599 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f953c856-04d0-4161-baf4-19aa6e986596 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] [instance: 69a2418e-ab69-4e7b-a243-365951169370] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:13.748456 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f953c856-04d0-4161-baf4-19aa6e986596 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:13.748898 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f953c856-04d0-4161-baf4-19aa6e986596 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:13.749826 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f953c856-04d0-4161-baf4-19aa6e986596 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:13.750256 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f953c856-04d0-4161-baf4-19aa6e986596 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:13.894131 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f953c856-04d0-4161-baf4-19aa6e986596 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93cf53cbece54a978bdab523d015313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671077727e44ef8ba72fe3ffdfa15eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:13.906038 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f953c856-04d0-4161-baf4-19aa6e986596 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] 10.222.0.27 "GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370" status: 200 len: 1290 microversion: 2.1 time: 0.168597 Jun 20 11:56:13.906615 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 31/68] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:13 2022] GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370 => generated 1290 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:13.912630 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7e5ac943-0e05-43a9-8669-ec2a4833c66f tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:13.932358 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7e5ac943-0e05-43a9-8669-ec2a4833c66f tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5391 microversion: 2.1 time: 0.024405 Jun 20 11:56:13.933053 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 32/69] 10.222.0.27 () {58 vars in 1172 bytes} [Mon Jun 20 11:56:13 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5391 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:13.952472 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d2eee570-a160-4acc-975f-c01dfb32b62b tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:13.975446 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d2eee570-a160-4acc-975f-c01dfb32b62b tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5391 microversion: 2.1 time: 0.027169 Jun 20 11:56:13.976222 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 33/70] 10.222.0.27 () {58 vars in 1168 bytes} [Mon Jun 20 11:56:13 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5391 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:13.991759 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-257a59c5-0fd7-492d-a765-d5494773ccd4 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:13.992718 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:13.992718 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:14.019228 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-257a59c5-0fd7-492d-a765-d5494773ccd4 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/628665710" status: 202 len: 0 microversion: 2.1 time: 0.031700 Jun 20 11:56:14.020251 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 34/71] 10.222.0.27 () {58 vars in 1157 bytes} [Mon Jun 20 11:56:13 2022] DELETE /compute/v2.1/flavors/628665710 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 11:56:14.030439 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-59490d42-c249-4805-ad60-5832da1b676c tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:14.052088 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-59490d42-c249-4805-ad60-5832da1b676c tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027749 Jun 20 11:56:14.052931 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 35/72] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 11:56:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:14.068126 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c506b717-efb3-4433-8134-aa34679865a1 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:14.090884 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c506b717-efb3-4433-8134-aa34679865a1 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/268489782" status: 202 len: 0 microversion: 2.1 time: 0.026757 Jun 20 11:56:14.095286 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 36/73] 10.222.0.27 () {58 vars in 1157 bytes} [Mon Jun 20 11:56:14 2022] DELETE /compute/v2.1/flavors/268489782 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 11:56:14.100878 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9124b590-ebd8-45d8-869e-32db54b80ac6 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:14.120483 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9124b590-ebd8-45d8-869e-32db54b80ac6 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023584 Jun 20 11:56:14.132232 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 37/74] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 11:56:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:14.137430 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d44bfd52-685f-4737-b2ab-2ffd8a46bff4 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-277077941", "id": 483625036, "os-flavor-access:is_public": "False"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:14.139269 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:14.139269 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:14.178677 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d44bfd52-685f-4737-b2ab-2ffd8a46bff4 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.045164 Jun 20 11:56:14.184715 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 38/75] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:56:14 2022] POST /compute/v2.1/flavors => generated 411 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:14.190208 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2fe4d9e8-b897-40f6-9ffb-56c694a6610b tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:14.211012 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2fe4d9e8-b897-40f6-9ffb-56c694a6610b tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024972 Jun 20 11:56:14.213186 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 39/76] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 11:56:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:14.227617 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ec9c609c-d5f1-4676-ae92-e10100027cdf tempest-FlavorsAdminTestJSON-946673456 tempest-FlavorsAdminTestJSON-946673456-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:14.252056 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c923f9b1-fd26-4afc-8ef3-2a90115b47ca tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1716412829/action" status: 200 len: 21 microversion: 2.1 time: 0.745842 Jun 20 11:56:14.253496 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 38/77] 10.222.0.27 () {60 vars in 1199 bytes} [Mon Jun 20 11:56:13 2022] POST /compute/v2.1/flavors/1716412829/action => generated 21 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 11:56:14.257751 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ec9c609c-d5f1-4676-ae92-e10100027cdf tempest-FlavorsAdminTestJSON-946673456 tempest-FlavorsAdminTestJSON-946673456-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034008 Jun 20 11:56:14.263077 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e8a27a3f-a8b8-4318-a195-9b021e8200d0 tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:14.268098 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 40/78] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 11:56:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:14.274032 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-52e921ed-0563-4b0c-a00f-92eb28a0030d tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:14.299344 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-52e921ed-0563-4b0c-a00f-92eb28a0030d tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/483625036" status: 202 len: 0 microversion: 2.1 time: 0.028378 Jun 20 11:56:14.305245 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 41/79] 10.222.0.27 () {58 vars in 1157 bytes} [Mon Jun 20 11:56:14 2022] DELETE /compute/v2.1/flavors/483625036 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:56:14.315331 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0517eb93-63c5-4cce-adaa-def4d8b890c3 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:14.327231 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e8a27a3f-a8b8-4318-a195-9b021e8200d0 tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1716412829" status: 202 len: 0 microversion: 2.1 time: 0.068059 Jun 20 11:56:14.328486 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 39/80] 10.222.0.27 () {58 vars in 1160 bytes} [Mon Jun 20 11:56:14 2022] DELETE /compute/v2.1/flavors/1716412829 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:56:14.337801 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bf9e67ba-4199-4953-9354-672865b99ca6 tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:14.364760 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0517eb93-63c5-4cce-adaa-def4d8b890c3 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052057 Jun 20 11:56:14.376776 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 42/81] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 11:56:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:14.383045 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3da0f560-0f90-46c4-a997-f2fcd5b8908c tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-82039089", "id": 1722732734, "os-flavor-access:is_public": "True"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:14.387613 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bf9e67ba-4199-4953-9354-672865b99ca6 tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054231 Jun 20 11:56:14.390254 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 40/82] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 11:56:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:14.406605 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2f2aa4ac-f8e7-4767-b3ed-9631def56ceb tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-924944314", "id": 1619322446, "os-flavor-access:is_public": "False"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:14.434070 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3da0f560-0f90-46c4-a997-f2fcd5b8908c tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.055871 Jun 20 11:56:14.446238 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 43/83] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:56:14 2022] POST /compute/v2.1/flavors => generated 412 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:14.451864 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f270785c-2a48-41d0-932e-cb56b0f3146b tempest-FlavorsAdminTestJSON-946673456 tempest-FlavorsAdminTestJSON-946673456-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:14.476914 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2f2aa4ac-f8e7-4767-b3ed-9631def56ceb tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.065564 Jun 20 11:56:14.478315 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 41/84] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:56:14 2022] POST /compute/v2.1/flavors => generated 438 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 11:56:14.492518 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bc5dbe0f-8d76-4587-bd28-85ad212df017 tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9682e967cfcd4d19bfe69db614e1e577"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:14.504252 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f270785c-2a48-41d0-932e-cb56b0f3146b tempest-FlavorsAdminTestJSON-946673456 tempest-FlavorsAdminTestJSON-946673456-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5393 microversion: 2.1 time: 0.056133 Jun 20 11:56:14.504891 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 44/85] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 11:56:14 2022] GET /compute/v2.1/flavors/detail => generated 5393 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:14.546343 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c2a94ed4-8b47-4d63-8ea3-b7a454a55806 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:14.581547 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c2a94ed4-8b47-4d63-8ea3-b7a454a55806 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1722732734" status: 202 len: 0 microversion: 2.1 time: 0.042987 Jun 20 11:56:14.582263 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 45/86] 10.222.0.27 () {58 vars in 1160 bytes} [Mon Jun 20 11:56:14 2022] DELETE /compute/v2.1/flavors/1722732734 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:56:14.590805 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3ca0db57-0385-48a9-9ec5-780985ef4661 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:14.615259 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3ca0db57-0385-48a9-9ec5-780985ef4661 tempest-FlavorsAdminTestJSON-474824920 tempest-FlavorsAdminTestJSON-474824920-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027974 Jun 20 11:56:14.616119 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 46/87] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 11:56:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:15.178019 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-bc5dbe0f-8d76-4587-bd28-85ad212df017 tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] HTTP exception thrown: Flavor access not found for 31 / 9682e967cfcd4d19bfe69db614e1e577 combination. Jun 20 11:56:15.181164 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bc5dbe0f-8d76-4587-bd28-85ad212df017 tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] Request method failure captured: Jun 20 11:56:15.181164 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/flavors/1619322446/action HTTP/1.1 Jun 20 11:56:15.181164 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:56:15.181164 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:56:15.181164 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:56:15.181164 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 70 Jun 20 11:56:15.181164 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:56:15.181164 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:56:15.181164 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:56:15.181164 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:15.181164 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGBYuKXlb6R71cKHPxywlEbTDXaXbObYdmJPcf434SH3VW3FlJ8sGNyZSApgcpWr-4nlZyC9RIzTso6MhBZNgfnCjfOAsxWPqNCM9iyP4IuMfsGcj0HQS3uX4EJ1xK_f7Ax4GDdMpEkIvyqbvPQP8vbZhAkUWt_KpNFdWJNtzIEHiSI Jun 20 11:56:15.181164 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:56:15.181164 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:56:15.181164 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:56:15.181164 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:56:15.181164 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:56:15.181164 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:56:15.181164 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 6d9aabb1385f406f915671520fdddc9c Jun 20 11:56:15.181164 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1102082032 Jun 20 11:56:15.181164 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member,admin Jun 20 11:56:15.181164 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member,admin Jun 20 11:56:15.182532 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d9aabb1385f406f915671520fdddc9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d9aabb1385f406f915671520fdddc9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6d9aabb1385f406f915671520fdddc9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6d9aabb1385f406f915671520fdddc9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:15.182532 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1102082032 Jun 20 11:56:15.182532 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 6d9aabb1385f406f915671520fdddc9c Jun 20 11:56:15.182532 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1102082032 Jun 20 11:56:15.182532 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin Jun 20 11:56:15.182532 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:56:15.182532 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:56:15.182532 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 5a375a9716c746ac9dd6b498e11b0071 Jun 20 11:56:15.182532 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin Jun 20 11:56:15.182532 n-d-master-1 devstack@n-api.service[119127]: Jun 20 11:56:15.182532 n-d-master-1 devstack@n-api.service[119127]: {"removeTenantAccess": {"tenant": "9682e967cfcd4d19bfe69db614e1e577"}} Jun 20 11:56:15.182532 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 11:56:15.183285 n-d-master-1 devstack@n-api.service[119127]: exception: Flavor access not found for 31 / 9682e967cfcd4d19bfe69db614e1e577 combination. Jun 20 11:56:15.183285 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '1619322446', 'body': {'removeTenantAccess': {'tenant': '9682e967cfcd4d19bfe69db614e1e577'}}} Jun 20 11:56:15.183285 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:15.183285 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:15.183285 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Jun 20 11:56:15.183285 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Jun 20 11:56:15.183285 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 20 11:56:15.183285 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 20 11:56:15.183285 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Jun 20 11:56:15.183285 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Jun 20 11:56:15.183285 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Jun 20 11:56:15.183285 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Jun 20 11:56:15.183285 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Jun 20 11:56:15.183285 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Jun 20 11:56:15.183285 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 20 11:56:15.183285 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 20 11:56:15.183285 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Jun 20 11:56:15.183285 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Jun 20 11:56:15.184445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 31 / 9682e967cfcd4d19bfe69db614e1e577 combination. Jun 20 11:56:15.184445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:15.184445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:15.184445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:15.184445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:15.184445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:15.184445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:15.184445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:15.184445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:15.184445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:15.184445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:15.184445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:56:15.184445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:56:15.184445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Jun 20 11:56:15.184445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:56:15.184445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 31 / 9682e967cfcd4d19bfe69db614e1e577 combination. Jun 20 11:56:15.184445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:15.184445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:15.184445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:15.184445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:15.185651 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:15.185651 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:15.185651 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:56:15.185651 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:56:15.185651 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 31 / 9682e967cfcd4d19bfe69db614e1e577 combination. Jun 20 11:56:15.185651 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:15.186094 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bc5dbe0f-8d76-4587-bd28-85ad212df017 tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] Returning 404 to user: Flavor access not found for 31 / 9682e967cfcd4d19bfe69db614e1e577 combination. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:15.187168 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bc5dbe0f-8d76-4587-bd28-85ad212df017 tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1619322446/action" status: 404 len: 124 microversion: 2.1 time: 0.702224 Jun 20 11:56:15.187956 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 42/88] 10.222.0.27 () {60 vars in 1199 bytes} [Mon Jun 20 11:56:14 2022] POST /compute/v2.1/flavors/1619322446/action => generated 124 bytes in 704 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 11:56:15.197283 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7f5e6534-713b-4476-a8fd-4d6ccf0fc0be tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:15.198281 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7f5e6534-713b-4476-a8fd-4d6ccf0fc0be tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] [instance: 69a2418e-ab69-4e7b-a243-365951169370] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:15.213171 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7f5e6534-713b-4476-a8fd-4d6ccf0fc0be tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:15.214054 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7f5e6534-713b-4476-a8fd-4d6ccf0fc0be tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:15.214571 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c670e70c-0fe2-4a43-8c6e-5311fa5fabb9 tempest-QuotaClassesAdminTestJSON-202617290 tempest-QuotaClassesAdminTestJSON-202617290-project-admin] Calling method '.version_select at 0x7f6080351310>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:15.215083 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7f5e6534-713b-4476-a8fd-4d6ccf0fc0be tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:15.215413 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:15.215413 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:15.215666 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7f5e6534-713b-4476-a8fd-4d6ccf0fc0be tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:15.248540 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c670e70c-0fe2-4a43-8c6e-5311fa5fabb9 tempest-QuotaClassesAdminTestJSON-202617290 tempest-QuotaClassesAdminTestJSON-202617290-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.463641 Jun 20 11:56:15.249145 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 47/89] 10.222.0.27 () {58 vars in 1184 bytes} [Mon Jun 20 11:56:14 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:15.266593 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-13bae854-25f7-4e89-a59e-939031bcc50e tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:15.301668 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-13bae854-25f7-4e89-a59e-939031bcc50e tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1619322446" status: 202 len: 0 microversion: 2.1 time: 0.048297 Jun 20 11:56:15.302605 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 48/90] 10.222.0.27 () {58 vars in 1160 bytes} [Mon Jun 20 11:56:15 2022] DELETE /compute/v2.1/flavors/1619322446 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:56:15.312925 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9ccab427-69ce-4296-95b2-efec498768a1 tempest-QuotaClassesAdminTestJSON-202617290 tempest-QuotaClassesAdminTestJSON-202617290-project-admin] Action: 'update', calling method: .version_select at 0x7f60803510d0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:15.316709 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:15.316709 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:15.443165 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7f5e6534-713b-4476-a8fd-4d6ccf0fc0be tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93cf53cbece54a978bdab523d015313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671077727e44ef8ba72fe3ffdfa15eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:15.460617 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7f5e6534-713b-4476-a8fd-4d6ccf0fc0be tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] 10.222.0.27 "GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370" status: 200 len: 1296 microversion: 2.1 time: 0.267046 Jun 20 11:56:15.466903 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6,nova_api:DELETE=15,nova_api:UPDATE=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:56:15.471580 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 43/91] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:15 2022] GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370 => generated 1296 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:15.477521 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-594ab626-a804-4e5f-afc7-90b850831dcf tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:15.501119 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-594ab626-a804-4e5f-afc7-90b850831dcf tempest-FlavorsAccessNegativeTestJSON-1102082032 tempest-FlavorsAccessNegativeTestJSON-1102082032-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028049 Jun 20 11:56:15.502276 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 44/92] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 11:56:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:16.034733 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9ccab427-69ce-4296-95b2-efec498768a1 tempest-QuotaClassesAdminTestJSON-202617290 tempest-QuotaClassesAdminTestJSON-202617290-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.730260 Jun 20 11:56:16.035598 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 49/93] 10.222.0.27 () {60 vars in 1205 bytes} [Mon Jun 20 11:56:15 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:16.049892 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1a693e55-de79-4c7c-93eb-9533f37937cc tempest-QuotaClassesAdminTestJSON-202617290 tempest-QuotaClassesAdminTestJSON-202617290-project-admin] Calling method '.version_select at 0x7f60802aa8b0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:16.065355 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1a693e55-de79-4c7c-93eb-9533f37937cc tempest-QuotaClassesAdminTestJSON-202617290 tempest-QuotaClassesAdminTestJSON-202617290-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.021036 Jun 20 11:56:16.072988 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 50/94] 10.222.0.27 () {58 vars in 1184 bytes} [Mon Jun 20 11:56:16 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:16.079639 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d0288345-ec93-48cc-8601-d82a85411b10 tempest-QuotaClassesAdminTestJSON-202617290 tempest-QuotaClassesAdminTestJSON-202617290-project-admin] Action: 'update', calling method: .version_select at 0x7f60802f9550>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:16.310679 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d0288345-ec93-48cc-8601-d82a85411b10 tempest-QuotaClassesAdminTestJSON-202617290 tempest-QuotaClassesAdminTestJSON-202617290-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.235713 Jun 20 11:56:16.318680 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 51/95] 10.222.0.27 () {60 vars in 1205 bytes} [Mon Jun 20 11:56:16 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:16.481584 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-aac7b454-262a-4af7-897d-88d6b4cdb09d tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:16.482490 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-aac7b454-262a-4af7-897d-88d6b4cdb09d tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] [instance: 69a2418e-ab69-4e7b-a243-365951169370] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:16.501712 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aac7b454-262a-4af7-897d-88d6b4cdb09d tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:16.502676 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aac7b454-262a-4af7-897d-88d6b4cdb09d tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:16.510524 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aac7b454-262a-4af7-897d-88d6b4cdb09d tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:16.512854 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aac7b454-262a-4af7-897d-88d6b4cdb09d tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:16.584224 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-61b8e223-7ea4-4ef0-96fb-a8c4a0d9e814 tempest-FlavorsV261TestJSON-532556618 tempest-FlavorsV261TestJSON-532556618-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1076954757", "id": 937868475, "os-flavor-access:is_public": "True"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:16.599948 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:16.599948 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:16.641741 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-61b8e223-7ea4-4ef0-96fb-a8c4a0d9e814 tempest-FlavorsV261TestJSON-532556618 tempest-FlavorsV261TestJSON-532556618-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.860237 Jun 20 11:56:16.661119 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 45/96] 10.222.0.27 () {62 vars in 1187 bytes} [Mon Jun 20 11:56:15 2022] POST /compute/v2.1/flavors => generated 465 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:56:16.889002 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-aac7b454-262a-4af7-897d-88d6b4cdb09d tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93cf53cbece54a978bdab523d015313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671077727e44ef8ba72fe3ffdfa15eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:16.901562 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-aac7b454-262a-4af7-897d-88d6b4cdb09d tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] 10.222.0.27 "GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370" status: 200 len: 1338 microversion: 2.1 time: 0.424642 Jun 20 11:56:16.913654 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 52/97] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:16 2022] GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370 => generated 1338 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:17.423647 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-11896903-7cb1-4159-ab23-bd5690f9d626 tempest-FlavorsV261TestJSON-750398157 tempest-FlavorsV261TestJSON-750398157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:17.434630 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-11896903-7cb1-4159-ab23-bd5690f9d626 tempest-FlavorsV261TestJSON-750398157 tempest-FlavorsV261TestJSON-750398157-project] 10.222.0.27 "GET /compute/v2.1/flavors/937868475" status: 200 len: 465 microversion: 2.61 time: 0.771927 Jun 20 11:56:17.442733 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 46/98] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Jun 20 11:56:16 2022] GET /compute/v2.1/flavors/937868475 => generated 465 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:56:17.453928 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-549f2358-8e92-4133-8a05-f34a7328872a tempest-FlavorsV261TestJSON-532556618 tempest-FlavorsV261TestJSON-532556618-project-admin] Action: 'update', calling method: .version_select at 0x7f60824c1d30>, body: {"flavor": {"description": "new"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:17.475428 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:17.475428 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:17.546575 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-549f2358-8e92-4133-8a05-f34a7328872a tempest-FlavorsV261TestJSON-532556618 tempest-FlavorsV261TestJSON-532556618-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/937868475" status: 200 len: 466 microversion: 2.61 time: 0.097825 Jun 20 11:56:17.549588 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 53/99] 10.222.0.27 () {62 vars in 1215 bytes} [Mon Jun 20 11:56:17 2022] PUT /compute/v2.1/flavors/937868475 => generated 466 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:56:17.571487 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-385d4024-374d-44fb-a116-53bd357bc861 tempest-FlavorsV261TestJSON-750398157 tempest-FlavorsV261TestJSON-750398157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:17.637701 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-385d4024-374d-44fb-a116-53bd357bc861 tempest-FlavorsV261TestJSON-750398157 tempest-FlavorsV261TestJSON-750398157-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6247 microversion: 2.61 time: 0.079879 Jun 20 11:56:17.657681 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 47/100] 10.222.0.27 () {60 vars in 1186 bytes} [Mon Jun 20 11:56:17 2022] GET /compute/v2.1/flavors/detail => generated 6247 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:56:17.665705 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ecf56cb2-9697-47c7-8742-a918fa6216fa tempest-FlavorsV261TestJSON-750398157 tempest-FlavorsV261TestJSON-750398157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:17.732106 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ecf56cb2-9697-47c7-8742-a918fa6216fa tempest-FlavorsV261TestJSON-750398157 tempest-FlavorsV261TestJSON-750398157-project] 10.222.0.27 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.61 time: 0.065592 Jun 20 11:56:17.734066 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 54/101] 10.222.0.27 () {60 vars in 1165 bytes} [Mon Jun 20 11:56:17 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:56:17.760277 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-729c0e97-5da2-4916-9f5e-30cd2b470ee8 tempest-FlavorsV261TestJSON-532556618 tempest-FlavorsV261TestJSON-532556618-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:17.767931 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:17.767931 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:17.815149 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-729c0e97-5da2-4916-9f5e-30cd2b470ee8 tempest-FlavorsV261TestJSON-532556618 tempest-FlavorsV261TestJSON-532556618-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/937868475" status: 202 len: 0 microversion: 2.61 time: 0.064835 Jun 20 11:56:17.820718 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 48/102] 10.222.0.27 () {60 vars in 1198 bytes} [Mon Jun 20 11:56:17 2022] DELETE /compute/v2.1/flavors/937868475 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:56:17.825771 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a6d8da53-4814-4b0e-9017-caa0ba9ad06e tempest-FlavorsV261TestJSON-532556618 tempest-FlavorsV261TestJSON-532556618-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:17.873519 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a6d8da53-4814-4b0e-9017-caa0ba9ad06e tempest-FlavorsV261TestJSON-532556618 tempest-FlavorsV261TestJSON-532556618-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.052202 Jun 20 11:56:17.877649 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 55/103] 10.222.0.27 () {60 vars in 1186 bytes} [Mon Jun 20 11:56:17 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:56:17.923113 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b4ab396d-1ec1-4ddb-be33-3b12c7368003 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:17.924328 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b4ab396d-1ec1-4ddb-be33-3b12c7368003 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] [instance: 69a2418e-ab69-4e7b-a243-365951169370] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:17.944282 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b4ab396d-1ec1-4ddb-be33-3b12c7368003 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:17.945943 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b4ab396d-1ec1-4ddb-be33-3b12c7368003 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:17.948761 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b4ab396d-1ec1-4ddb-be33-3b12c7368003 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:17.949981 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b4ab396d-1ec1-4ddb-be33-3b12c7368003 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:18.650348 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b4ab396d-1ec1-4ddb-be33-3b12c7368003 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93cf53cbece54a978bdab523d015313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671077727e44ef8ba72fe3ffdfa15eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:18.669566 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b4ab396d-1ec1-4ddb-be33-3b12c7368003 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] 10.222.0.27 "GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370" status: 200 len: 1338 microversion: 2.1 time: 0.751239 Jun 20 11:56:18.685897 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 49/104] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:17 2022] GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370 => generated 1338 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:18.823390 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:56:19.071521 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-287754e7-4ab4-4a99-a824-5869de98d787 tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Calling method '.version_select at 0x7f60802818b0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:19.075759 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:19.075759 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:19.089692 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-287754e7-4ab4-4a99-a824-5869de98d787 tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d5df985c-a080-4240-bcef-1787de3aeb9e(cell1) {{(pid=119128) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jun 20 11:56:19.092956 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-287754e7-4ab4-4a99-a824-5869de98d787 tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:19.093611 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-287754e7-4ab4-4a99-a824-5869de98d787 tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:19.154830 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-287754e7-4ab4-4a99-a824-5869de98d787 tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:19.155296 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-287754e7-4ab4-4a99-a824-5869de98d787 tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:19.181266 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-287754e7-4ab4-4a99-a824-5869de98d787 tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:19.181894 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-287754e7-4ab4-4a99-a824-5869de98d787 tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:19.192727 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-287754e7-4ab4-4a99-a824-5869de98d787 tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.494914 Jun 20 11:56:19.193528 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 56/105] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 11:56:18 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:19.223708 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fb3077f8-4008-49dc-9ed2-70e1d7dff8a9 tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Calling method '.version_select at 0x7f60815ff310>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:19.226996 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:19.226996 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:19.229783 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fb3077f8-4008-49dc-9ed2-70e1d7dff8a9 tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:19.234145 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fb3077f8-4008-49dc-9ed2-70e1d7dff8a9 tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:19.296764 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fb3077f8-4008-49dc-9ed2-70e1d7dff8a9 tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:19.299476 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fb3077f8-4008-49dc-9ed2-70e1d7dff8a9 tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:19.345456 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fb3077f8-4008-49dc-9ed2-70e1d7dff8a9 tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:19.356540 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fb3077f8-4008-49dc-9ed2-70e1d7dff8a9 tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:19.405401 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fb3077f8-4008-49dc-9ed2-70e1d7dff8a9 tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.202356 Jun 20 11:56:19.419603 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 50/106] 10.222.0.27 () {58 vars in 1166 bytes} [Mon Jun 20 11:56:19 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:19.435229 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a6c4e414-4e8e-4c7a-a81f-28120c6d220e tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Calling method '.version_select at 0x7f60802f9040>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:19.437311 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:19.437311 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:19.439961 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6c4e414-4e8e-4c7a-a81f-28120c6d220e tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:19.441142 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6c4e414-4e8e-4c7a-a81f-28120c6d220e tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:19.498460 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6c4e414-4e8e-4c7a-a81f-28120c6d220e tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:19.507053 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6c4e414-4e8e-4c7a-a81f-28120c6d220e tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:19.544384 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=10,nova_api:UPDATE=22 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:56:19.559805 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6c4e414-4e8e-4c7a-a81f-28120c6d220e tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:19.563915 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6c4e414-4e8e-4c7a-a81f-28120c6d220e tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:19.620893 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a6c4e414-4e8e-4c7a-a81f-28120c6d220e tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.199584 Jun 20 11:56:19.622279 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 57/107] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 11:56:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:19.637203 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-48137c18-9722-4177-acc5-f1765c31c82f tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Calling method '.version_select at 0x7f6080cbc310>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:19.638256 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:19.638256 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:19.639927 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-48137c18-9722-4177-acc5-f1765c31c82f tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:19.640551 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-48137c18-9722-4177-acc5-f1765c31c82f tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:19.693014 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-782655c4-38c1-4f7b-b699-c4630983a3d2 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:19.694067 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-782655c4-38c1-4f7b-b699-c4630983a3d2 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] [instance: 69a2418e-ab69-4e7b-a243-365951169370] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:19.721929 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-782655c4-38c1-4f7b-b699-c4630983a3d2 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:19.725816 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-782655c4-38c1-4f7b-b699-c4630983a3d2 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:19.733951 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-782655c4-38c1-4f7b-b699-c4630983a3d2 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:19.735039 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-48137c18-9722-4177-acc5-f1765c31c82f tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:19.739031 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-782655c4-38c1-4f7b-b699-c4630983a3d2 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:19.742102 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-48137c18-9722-4177-acc5-f1765c31c82f tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:19.770547 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-48137c18-9722-4177-acc5-f1765c31c82f tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.137544 Jun 20 11:56:19.775028 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 51/108] 10.222.0.27 () {58 vars in 1151 bytes} [Mon Jun 20 11:56:19 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:19.812557 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-91928cce-80cb-40fb-811a-90508dea2ca6 tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Calling method '.version_select at 0x7f6080cbc700>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:19.817877 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:19.817877 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:19.822376 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91928cce-80cb-40fb-811a-90508dea2ca6 tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:19.834230 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91928cce-80cb-40fb-811a-90508dea2ca6 tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:19.911692 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-91928cce-80cb-40fb-811a-90508dea2ca6 tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.125247 Jun 20 11:56:19.918192 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 52/109] 10.222.0.27 () {58 vars in 1178 bytes} [Mon Jun 20 11:56:19 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 11:56:19.937463 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-710a5093-7358-444a-b49c-e4ee7561acd2 tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Calling method '.version_select at 0x7f60815ff1f0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:19.939444 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:19.939444 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:19.954244 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-710a5093-7358-444a-b49c-e4ee7561acd2 tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:19.958493 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-710a5093-7358-444a-b49c-e4ee7561acd2 tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:19.981621 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:DELETE=17,nova_api:SELECT=77,nova_api:INSERT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:56:19.993819 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-710a5093-7358-444a-b49c-e4ee7561acd2 tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:19.994827 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-710a5093-7358-444a-b49c-e4ee7561acd2 tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:20.016289 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-710a5093-7358-444a-b49c-e4ee7561acd2 tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:20.018271 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-710a5093-7358-444a-b49c-e4ee7561acd2 tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:20.033818 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-710a5093-7358-444a-b49c-e4ee7561acd2 tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.104342 Jun 20 11:56:20.040462 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 53/110] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 11:56:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:20.048718 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-24239d9c-2479-482e-b600-0d03f24fb4fd tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Calling method '.version_select at 0x7f6080c80ca0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:20.050791 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:20.050791 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:20.052640 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-24239d9c-2479-482e-b600-0d03f24fb4fd tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:20.054344 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-24239d9c-2479-482e-b600-0d03f24fb4fd tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:20.109272 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-24239d9c-2479-482e-b600-0d03f24fb4fd tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:20.110051 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-24239d9c-2479-482e-b600-0d03f24fb4fd tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:20.138033 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-24239d9c-2479-482e-b600-0d03f24fb4fd tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.093964 Jun 20 11:56:20.146777 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 54/111] 10.222.0.27 () {58 vars in 1151 bytes} [Mon Jun 20 11:56:20 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:20.156566 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9a2a4318-6619-43f8-857c-6dd7ac4b82ec tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Calling method '.version_select at 0x7f6080c80310>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:20.161243 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:20.161243 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:20.162959 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a2a4318-6619-43f8-857c-6dd7ac4b82ec tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:20.163510 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a2a4318-6619-43f8-857c-6dd7ac4b82ec tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:20.187974 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a2a4318-6619-43f8-857c-6dd7ac4b82ec tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:20.189278 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a2a4318-6619-43f8-857c-6dd7ac4b82ec tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:20.205697 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9a2a4318-6619-43f8-857c-6dd7ac4b82ec tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.055200 Jun 20 11:56:20.218277 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 55/112] 10.222.0.27 () {58 vars in 1151 bytes} [Mon Jun 20 11:56:20 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 11:56:20.264864 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-262ddd64-f7f1-45c4-9c40-ceab601265ed tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Calling method '.version_select at 0x7f6080c80e50>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:20.271008 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:20.271008 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:20.278505 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-262ddd64-f7f1-45c4-9c40-ceab601265ed tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:20.284238 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-262ddd64-f7f1-45c4-9c40-ceab601265ed tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:20.325953 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-262ddd64-f7f1-45c4-9c40-ceab601265ed tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:20.327075 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-262ddd64-f7f1-45c4-9c40-ceab601265ed tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:20.359626 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-262ddd64-f7f1-45c4-9c40-ceab601265ed tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:20.359626 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-262ddd64-f7f1-45c4-9c40-ceab601265ed tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:20.385965 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-262ddd64-f7f1-45c4-9c40-ceab601265ed tempest-HypervisorAdminTestJSON-1656927411 tempest-HypervisorAdminTestJSON-1656927411-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=119127) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 20 11:56:20.386592 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-61245ee4-225f-4fb2-99cf-abafd392870e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:20.386947 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-61245ee4-225f-4fb2-99cf-abafd392870e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:20.387728 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-61245ee4-225f-4fb2-99cf-abafd392870e None None] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:20.388156 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-61245ee4-225f-4fb2-99cf-abafd392870e None None] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:20.419718 n-d-master-1 devstack@n-api.service[119127]: INFO nova.compute.rpcapi [None req-61245ee4-225f-4fb2-99cf-abafd392870e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 20 11:56:20.420865 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-61245ee4-225f-4fb2-99cf-abafd392870e None None] Releasing lock "compute-rpcapi-router" {{(pid=119127) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 20 11:56:20.587658 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-782655c4-38c1-4f7b-b699-c4630983a3d2 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93cf53cbece54a978bdab523d015313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671077727e44ef8ba72fe3ffdfa15eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:20.599203 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-782655c4-38c1-4f7b-b699-c4630983a3d2 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] 10.222.0.27 "GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370" status: 200 len: 1338 microversion: 2.1 time: 0.911523 Jun 20 11:56:20.615390 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 58/113] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:19 2022] GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370 => generated 1338 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:56:20.627791 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-61245ee4-225f-4fb2-99cf-abafd392870e None None] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.404200 Jun 20 11:56:20.628493 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 56/114] 10.222.0.27 () {58 vars in 1172 bytes} [Mon Jun 20 11:56:20 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:20.736305 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-e50b63de-5edc-4d5f-b153-d50d2940ab15 req-6b6037da-8b03-42ab-89ac-c61c04ffd3ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69a2418e-ab69-4e7b-a243-365951169370", "tag": "ad514aee-5d3c-42ae-986c-2e6beda339f2"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:20.767354 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e50b63de-5edc-4d5f-b153-d50d2940ab15 req-6b6037da-8b03-42ab-89ac-c61c04ffd3ed service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:20.769928 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e50b63de-5edc-4d5f-b153-d50d2940ab15 req-6b6037da-8b03-42ab-89ac-c61c04ffd3ed service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:20.822770 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-e50b63de-5edc-4d5f-b153-d50d2940ab15 req-6b6037da-8b03-42ab-89ac-c61c04ffd3ed service nova] Creating event network-changed:ad514aee-5d3c-42ae-986c-2e6beda339f2 for instance 69a2418e-ab69-4e7b-a243-365951169370 on n-h1-master-1 Jun 20 11:56:20.823323 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e50b63de-5edc-4d5f-b153-d50d2940ab15 req-6b6037da-8b03-42ab-89ac-c61c04ffd3ed service nova] Acquired lock "compute-rpcapi-router" {{(pid=119128) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 20 11:56:20.826703 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b50d3c8c-7807-49e1-bd26-657a897ebcac None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:20.827202 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b50d3c8c-7807-49e1-bd26-657a897ebcac None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:20.834933 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b50d3c8c-7807-49e1-bd26-657a897ebcac None None] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:20.837565 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b50d3c8c-7807-49e1-bd26-657a897ebcac None None] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:20.879059 n-d-master-1 devstack@n-api.service[119128]: INFO nova.compute.rpcapi [None req-b50d3c8c-7807-49e1-bd26-657a897ebcac None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 20 11:56:20.880395 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b50d3c8c-7807-49e1-bd26-657a897ebcac None None] Releasing lock "compute-rpcapi-router" {{(pid=119128) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 20 11:56:20.937309 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b50d3c8c-7807-49e1-bd26-657a897ebcac None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.320215 Jun 20 11:56:20.938018 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 59/115] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:21.623062 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6cfe695a-909e-4d3f-89f3-35f6c9d9d6d0 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:21.623787 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6cfe695a-909e-4d3f-89f3-35f6c9d9d6d0 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] [instance: 69a2418e-ab69-4e7b-a243-365951169370] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:21.657457 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6cfe695a-909e-4d3f-89f3-35f6c9d9d6d0 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:21.658390 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6cfe695a-909e-4d3f-89f3-35f6c9d9d6d0 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:21.664493 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6cfe695a-909e-4d3f-89f3-35f6c9d9d6d0 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:21.666032 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6cfe695a-909e-4d3f-89f3-35f6c9d9d6d0 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:21.824980 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:56:22.066023 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6cfe695a-909e-4d3f-89f3-35f6c9d9d6d0 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93cf53cbece54a978bdab523d015313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671077727e44ef8ba72fe3ffdfa15eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:22.074257 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6cfe695a-909e-4d3f-89f3-35f6c9d9d6d0 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] 10.222.0.27 "GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370" status: 200 len: 1338 microversion: 2.1 time: 0.456091 Jun 20 11:56:22.079008 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 57/116] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:21 2022] GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370 => generated 1338 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:23.099057 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-577ddcc7-c289-46e6-8b43-5ca92e9ac761 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:23.102512 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-577ddcc7-c289-46e6-8b43-5ca92e9ac761 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] [instance: 69a2418e-ab69-4e7b-a243-365951169370] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:23.122699 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-577ddcc7-c289-46e6-8b43-5ca92e9ac761 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:23.122970 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-577ddcc7-c289-46e6-8b43-5ca92e9ac761 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:23.123757 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-577ddcc7-c289-46e6-8b43-5ca92e9ac761 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:23.124191 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-577ddcc7-c289-46e6-8b43-5ca92e9ac761 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:23.512104 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-577ddcc7-c289-46e6-8b43-5ca92e9ac761 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93cf53cbece54a978bdab523d015313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671077727e44ef8ba72fe3ffdfa15eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:23.527898 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-577ddcc7-c289-46e6-8b43-5ca92e9ac761 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] 10.222.0.27 "GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370" status: 200 len: 1338 microversion: 2.1 time: 0.428654 Jun 20 11:56:23.531614 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 60/117] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:23 2022] GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370 => generated 1338 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:24.551819 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-27943641-c2c5-4024-95fc-d46f4d507d84 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:24.553641 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-27943641-c2c5-4024-95fc-d46f4d507d84 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] [instance: 69a2418e-ab69-4e7b-a243-365951169370] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:24.571963 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-27943641-c2c5-4024-95fc-d46f4d507d84 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:24.572731 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-27943641-c2c5-4024-95fc-d46f4d507d84 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:24.573726 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-27943641-c2c5-4024-95fc-d46f4d507d84 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:24.574356 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-27943641-c2c5-4024-95fc-d46f4d507d84 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:24.809990 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-27943641-c2c5-4024-95fc-d46f4d507d84 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93cf53cbece54a978bdab523d015313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671077727e44ef8ba72fe3ffdfa15eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:24.822649 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-27943641-c2c5-4024-95fc-d46f4d507d84 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] 10.222.0.27 "GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370" status: 200 len: 1338 microversion: 2.1 time: 0.277302 Jun 20 11:56:24.824095 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 58/118] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:24 2022] GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370 => generated 1338 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:25.839904 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-33d77bee-3b2a-4d48-9f47-f513f90b73b6 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:25.840624 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-33d77bee-3b2a-4d48-9f47-f513f90b73b6 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] [instance: 69a2418e-ab69-4e7b-a243-365951169370] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:25.847768 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-33d77bee-3b2a-4d48-9f47-f513f90b73b6 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:25.848395 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-33d77bee-3b2a-4d48-9f47-f513f90b73b6 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:25.849172 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-33d77bee-3b2a-4d48-9f47-f513f90b73b6 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:25.849925 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-33d77bee-3b2a-4d48-9f47-f513f90b73b6 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:25.991400 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-33d77bee-3b2a-4d48-9f47-f513f90b73b6 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93cf53cbece54a978bdab523d015313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671077727e44ef8ba72fe3ffdfa15eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:26.003225 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-33d77bee-3b2a-4d48-9f47-f513f90b73b6 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] 10.222.0.27 "GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370" status: 200 len: 1338 microversion: 2.1 time: 0.167269 Jun 20 11:56:26.004001 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 59/119] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:25 2022] GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370 => generated 1338 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:56:26.177073 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e9a8290f-744a-4792-858e-2e36a31a05d9 tempest-FlavorsAccessTestJSON-215567345 tempest-FlavorsAccessTestJSON-215567345-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-352633806", "id": 163329083, "os-flavor-access:is_public": "False"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:26.177073 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:26.177073 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:26.197093 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e9a8290f-744a-4792-858e-2e36a31a05d9 tempest-FlavorsAccessTestJSON-215567345 tempest-FlavorsAccessTestJSON-215567345-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.428615 Jun 20 11:56:26.197784 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 61/120] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:56:25 2022] POST /compute/v2.1/flavors => generated 427 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:26.209494 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fb2e9c3d-8568-40fd-9505-c13bfbfd7e52 tempest-FlavorsAccessTestJSON-215567345 tempest-FlavorsAccessTestJSON-215567345-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "039af89bf1b14fceb6361019090fa691"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:26.210855 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:26.210855 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:26.671797 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fb2e9c3d-8568-40fd-9505-c13bfbfd7e52 tempest-FlavorsAccessTestJSON-215567345 tempest-FlavorsAccessTestJSON-215567345-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/163329083/action" status: 200 len: 96 microversion: 2.1 time: 0.465864 Jun 20 11:56:26.672801 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 60/121] 10.222.0.27 () {60 vars in 1196 bytes} [Mon Jun 20 11:56:26 2022] POST /compute/v2.1/flavors/163329083/action => generated 96 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 11:56:26.683323 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=46,nova_cell0:UPDATE=12 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:56:27.041967 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-da2bc202-bebb-4db6-af19-7c742a363fa8 tempest-FlavorsAccessTestJSON-247983461 tempest-FlavorsAccessTestJSON-247983461-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:27.063127 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-da2bc202-bebb-4db6-af19-7c742a363fa8 tempest-FlavorsAccessTestJSON-247983461 tempest-FlavorsAccessTestJSON-247983461-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 0.384560 Jun 20 11:56:27.063903 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 62/122] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 11:56:26 2022] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:27.069282 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a8eb9e5c-e9c8-4f9d-b4cd-9d95ccab31cf tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:27.069889 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a8eb9e5c-e9c8-4f9d-b4cd-9d95ccab31cf tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] [instance: 69a2418e-ab69-4e7b-a243-365951169370] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:27.077324 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a8eb9e5c-e9c8-4f9d-b4cd-9d95ccab31cf tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:27.077842 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a8eb9e5c-e9c8-4f9d-b4cd-9d95ccab31cf tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:27.078854 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a8eb9e5c-e9c8-4f9d-b4cd-9d95ccab31cf tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:27.079493 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a8eb9e5c-e9c8-4f9d-b4cd-9d95ccab31cf tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:27.223022 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a8eb9e5c-e9c8-4f9d-b4cd-9d95ccab31cf tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93cf53cbece54a978bdab523d015313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671077727e44ef8ba72fe3ffdfa15eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:27.230426 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a8eb9e5c-e9c8-4f9d-b4cd-9d95ccab31cf tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] 10.222.0.27 "GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370" status: 200 len: 1338 microversion: 2.1 time: 0.165318 Jun 20 11:56:27.231315 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 63/123] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:27 2022] GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370 => generated 1338 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:27.236050 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2e264ec9-d6e9-488c-8c42-a42dd6f34d39 tempest-FlavorsAccessTestJSON-215567345 tempest-FlavorsAccessTestJSON-215567345-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "039af89bf1b14fceb6361019090fa691"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:27.237493 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:27.237493 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:27.341792 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-81139dc8-808c-4248-881d-d3d568574d89 tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] Calling method '.version_select at 0x7f6080c2ec10>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:27.566672 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2e264ec9-d6e9-488c-8c42-a42dd6f34d39 tempest-FlavorsAccessTestJSON-215567345 tempest-FlavorsAccessTestJSON-215567345-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/163329083/action" status: 200 len: 21 microversion: 2.1 time: 0.334191 Jun 20 11:56:27.567579 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 64/124] 10.222.0.27 () {60 vars in 1196 bytes} [Mon Jun 20 11:56:27 2022] POST /compute/v2.1/flavors/163329083/action => generated 21 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 11:56:27.703658 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-81139dc8-808c-4248-881d-d3d568574d89 tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/4bdbd48aa5df42418f750ae35bc2eb21" status: 200 len: 371 microversion: 2.1 time: 0.722146 Jun 20 11:56:27.704441 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 61/125] 10.222.0.27 () {58 vars in 1241 bytes} [Mon Jun 20 11:56:26 2022] GET /compute/v2.1/os-quota-sets/4bdbd48aa5df42418f750ae35bc2eb21 => generated 371 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:27.744071 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2912dfd4-6959-4817-b818-13396624d693 tempest-HypervisorAdminNegativeTestJSON-1212411986 tempest-HypervisorAdminNegativeTestJSON-1212411986-project] Calling method '.version_select at 0x7f608024ddc0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:27.745095 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:27.745095 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:27.746300 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2912dfd4-6959-4817-b818-13396624d693 tempest-HypervisorAdminNegativeTestJSON-1212411986 tempest-HypervisorAdminNegativeTestJSON-1212411986-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'c1b53eb5c58145dda70d6426b983fe53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b165b245e85147de8ae15946d4e52f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:27.749226 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2912dfd4-6959-4817-b818-13396624d693 tempest-HypervisorAdminNegativeTestJSON-1212411986 tempest-HypervisorAdminNegativeTestJSON-1212411986-project] Request method failure captured: Jun 20 11:56:27.749226 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Jun 20 11:56:27.749226 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:56:27.749226 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:56:27.749226 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:56:27.749226 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 11:56:27.749226 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:56:27.749226 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:56:27.749226 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:56:27.749226 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:27.749226 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGBpLaoaBfu9vLUC-HGHDErIbscsmFeWY7id3OqbavB3g2XHeuEPsxHKo4L4Kx1xcgZ1sgUf6evh_prrtPlfvmXE1lrfevzVtmlTVs0vMH5EQYMQQwQpG2ApmvV-Ruwg6Y9ci3PiP6vkS5bUkIGe6rNgVeZ3yxt-5wJT1jYiBdPeYxw Jun 20 11:56:27.749226 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:56:27.749226 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:56:27.749226 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:56:27.749226 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:56:27.749226 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:56:27.749226 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:56:27.749226 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: b165b245e85147de8ae15946d4e52f6a Jun 20 11:56:27.749226 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1212411986 Jun 20 11:56:27.749226 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 11:56:27.749226 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 11:56:27.750784 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b165b245e85147de8ae15946d4e52f6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b165b245e85147de8ae15946d4e52f6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b165b245e85147de8ae15946d4e52f6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b165b245e85147de8ae15946d4e52f6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:27.750784 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1212411986 Jun 20 11:56:27.750784 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: b165b245e85147de8ae15946d4e52f6a Jun 20 11:56:27.750784 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1212411986 Jun 20 11:56:27.750784 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-HypervisorAdminNegativeTestJSON-1212411986-project Jun 20 11:56:27.750784 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:56:27.750784 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:56:27.750784 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: c1b53eb5c58145dda70d6426b983fe53 Jun 20 11:56:27.750784 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1212411986-project Jun 20 11:56:27.750784 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 11:56:27.750784 n-d-master-1 devstack@n-api.service[119128]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jun 20 11:56:27.750784 n-d-master-1 devstack@n-api.service[119128]: action_args: {} Jun 20 11:56:27.750784 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:27.751662 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:27.751662 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:27.751662 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:27.751662 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:27.751662 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:27.751662 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 11:56:27.751662 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 11:56:27.751662 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:27.751662 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:27.751662 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Jun 20 11:56:27.751662 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._detail(req) Jun 20 11:56:27.751662 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Jun 20 11:56:27.751662 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Jun 20 11:56:27.751662 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 20 11:56:27.751662 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 20 11:56:27.751662 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 20 11:56:27.751662 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 20 11:56:27.751662 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 11:56:27.751662 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 11:56:27.753027 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 11:56:27.753027 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 11:56:27.753027 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 20 11:56:27.753027 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 20 11:56:27.753027 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 20 11:56:27.753027 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 20 11:56:27.753027 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 20 11:56:27.753027 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 20 11:56:27.753027 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jun 20 11:56:27.753027 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:27.753027 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:27.753027 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:27.753027 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:27.753027 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:27.753027 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:27.753027 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 20 11:56:27.753027 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 20 11:56:27.753027 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jun 20 11:56:27.753027 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:27.754204 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2912dfd4-6959-4817-b818-13396624d693 tempest-HypervisorAdminNegativeTestJSON-1212411986 tempest-HypervisorAdminNegativeTestJSON-1212411986-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:27.754204 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2912dfd4-6959-4817-b818-13396624d693 tempest-HypervisorAdminNegativeTestJSON-1212411986 tempest-HypervisorAdminNegativeTestJSON-1212411986-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.183737 Jun 20 11:56:27.754204 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 65/126] 10.222.0.27 () {58 vars in 1166 bytes} [Mon Jun 20 11:56:27 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 185 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:56:27.757549 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e40f4ae5-48c1-4575-8420-2b6a694bc766 tempest-FlavorsAccessTestJSON-247983461 tempest-FlavorsAccessTestJSON-247983461-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:27.779039 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e40f4ae5-48c1-4575-8420-2b6a694bc766 tempest-FlavorsAccessTestJSON-247983461 tempest-FlavorsAccessTestJSON-247983461-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024822 Jun 20 11:56:27.779806 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 66/127] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 11:56:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:27.794785 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d671d83f-8b49-42f4-bf09-1228999f22c9 tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] Action: 'update', calling method: .version_select at 0x7f608029a310>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:27.858294 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fb61de7a-3120-4375-8bc1-bb7143937500 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] Calling method '.version_select at 0x7f6080c2e820>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:27.859897 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:27.859897 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:27.861449 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fb61de7a-3120-4375-8bc1-bb7143937500 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:27.862037 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fb61de7a-3120-4375-8bc1-bb7143937500 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:27.863742 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fb61de7a-3120-4375-8bc1-bb7143937500 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:27.864450 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fb61de7a-3120-4375-8bc1-bb7143937500 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:27.899203 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fb61de7a-3120-4375-8bc1-bb7143937500 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 397 microversion: 2.1 time: 0.193518 Jun 20 11:56:27.899788 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 62/128] 10.222.0.27 () {58 vars in 1127 bytes} [Mon Jun 20 11:56:27 2022] GET /compute/v2.1/os-hosts => generated 397 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:27.903113 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d671d83f-8b49-42f4-bf09-1228999f22c9 tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:27.903849 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d671d83f-8b49-42f4-bf09-1228999f22c9 tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:27.904503 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-be74459e-00c8-4e21-a874-7e93fdf5c7e4 tempest-HypervisorAdminNegativeTestJSON-1212411986 tempest-HypervisorAdminNegativeTestJSON-1212411986-project] Calling method '.version_select at 0x7f6080bf75e0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:27.904603 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d671d83f-8b49-42f4-bf09-1228999f22c9 tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:27.904783 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d671d83f-8b49-42f4-bf09-1228999f22c9 tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:27.905069 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:27.905069 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:27.906127 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-be74459e-00c8-4e21-a874-7e93fdf5c7e4 tempest-HypervisorAdminNegativeTestJSON-1212411986 tempest-HypervisorAdminNegativeTestJSON-1212411986-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'c1b53eb5c58145dda70d6426b983fe53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b165b245e85147de8ae15946d4e52f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:27.908361 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-be74459e-00c8-4e21-a874-7e93fdf5c7e4 tempest-HypervisorAdminNegativeTestJSON-1212411986 tempest-HypervisorAdminNegativeTestJSON-1212411986-project] Request method failure captured: Jun 20 11:56:27.908361 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Jun 20 11:56:27.908361 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:56:27.908361 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:56:27.908361 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:56:27.908361 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 11:56:27.908361 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:56:27.908361 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:56:27.908361 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:56:27.908361 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:27.908361 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGBpLaoaBfu9vLUC-HGHDErIbscsmFeWY7id3OqbavB3g2XHeuEPsxHKo4L4Kx1xcgZ1sgUf6evh_prrtPlfvmXE1lrfevzVtmlTVs0vMH5EQYMQQwQpG2ApmvV-Ruwg6Y9ci3PiP6vkS5bUkIGe6rNgVeZ3yxt-5wJT1jYiBdPeYxw Jun 20 11:56:27.908361 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:56:27.908361 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:56:27.908361 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:56:27.908361 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:56:27.908361 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:56:27.908361 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:56:27.908361 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: b165b245e85147de8ae15946d4e52f6a Jun 20 11:56:27.908361 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1212411986 Jun 20 11:56:27.908361 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 11:56:27.908361 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 11:56:27.909458 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b165b245e85147de8ae15946d4e52f6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b165b245e85147de8ae15946d4e52f6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b165b245e85147de8ae15946d4e52f6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b165b245e85147de8ae15946d4e52f6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:27.909458 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1212411986 Jun 20 11:56:27.909458 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: b165b245e85147de8ae15946d4e52f6a Jun 20 11:56:27.909458 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1212411986 Jun 20 11:56:27.909458 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-HypervisorAdminNegativeTestJSON-1212411986-project Jun 20 11:56:27.909458 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:56:27.909458 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:56:27.909458 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: c1b53eb5c58145dda70d6426b983fe53 Jun 20 11:56:27.909458 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1212411986-project Jun 20 11:56:27.909458 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 11:56:27.909458 n-d-master-1 devstack@n-api.service[119127]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jun 20 11:56:27.909458 n-d-master-1 devstack@n-api.service[119127]: action_args: {} Jun 20 11:56:27.909458 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:27.910158 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:27.910158 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:27.910158 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:27.910158 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:27.910158 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:27.910158 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 11:56:27.910158 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 11:56:27.910158 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:27.910158 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:27.910158 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Jun 20 11:56:27.910158 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._index(req) Jun 20 11:56:27.910158 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Jun 20 11:56:27.910158 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Jun 20 11:56:27.910158 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 20 11:56:27.910158 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 20 11:56:27.910158 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 20 11:56:27.910158 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 20 11:56:27.910158 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 11:56:27.910158 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 11:56:27.911096 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 11:56:27.911096 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 11:56:27.911096 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 20 11:56:27.911096 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 20 11:56:27.911096 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 20 11:56:27.911096 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 20 11:56:27.911096 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 20 11:56:27.911096 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 20 11:56:27.911096 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jun 20 11:56:27.911096 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:27.911096 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:27.911096 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:27.911096 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:27.911096 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:27.911096 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:27.911096 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 20 11:56:27.911096 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 20 11:56:27.911096 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jun 20 11:56:27.911096 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:27.912046 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-be74459e-00c8-4e21-a874-7e93fdf5c7e4 tempest-HypervisorAdminNegativeTestJSON-1212411986 tempest-HypervisorAdminNegativeTestJSON-1212411986-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:27.912046 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-be74459e-00c8-4e21-a874-7e93fdf5c7e4 tempest-HypervisorAdminNegativeTestJSON-1212411986 tempest-HypervisorAdminNegativeTestJSON-1212411986-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.008807 Jun 20 11:56:27.912046 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 63/129] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 11:56:27 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:56:27.915523 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-761d3960-6808-4750-bd84-f0f05dd04302 tempest-FlavorsAccessTestJSON-215567345 tempest-FlavorsAccessTestJSON-215567345-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:27.916451 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:27.916451 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:27.933827 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-761d3960-6808-4750-bd84-f0f05dd04302 tempest-FlavorsAccessTestJSON-215567345 tempest-FlavorsAccessTestJSON-215567345-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/163329083" status: 202 len: 0 microversion: 2.1 time: 0.022629 Jun 20 11:56:27.934778 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 64/130] 10.222.0.27 () {58 vars in 1157 bytes} [Mon Jun 20 11:56:27 2022] DELETE /compute/v2.1/flavors/163329083 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:56:27.974240 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d671d83f-8b49-42f4-bf09-1228999f22c9 tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/4bdbd48aa5df42418f750ae35bc2eb21" status: 200 len: 328 microversion: 2.1 time: 0.183425 Jun 20 11:56:27.982636 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 67/131] 10.222.0.27 () {60 vars in 1261 bytes} [Mon Jun 20 11:56:27 2022] PUT /compute/v2.1/os-quota-sets/4bdbd48aa5df42418f750ae35bc2eb21 => generated 328 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:27.982636 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5bd68e0b-24bd-4ed5-b10a-11974faeab27 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] Calling method '.version_select at 0x7f608029aca0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:27.982636 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:27.982636 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:27.982636 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5bd68e0b-24bd-4ed5-b10a-11974faeab27 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:27.982636 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5bd68e0b-24bd-4ed5-b10a-11974faeab27 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:27.983158 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5bd68e0b-24bd-4ed5-b10a-11974faeab27 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:27.983607 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5bd68e0b-24bd-4ed5-b10a-11974faeab27 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:27.996328 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5e461833-0dc9-4606-8fdc-91a72eb48f35 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-820149112", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:28.010645 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5bd68e0b-24bd-4ed5-b10a-11974faeab27 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 397 microversion: 2.1 time: 0.034576 Jun 20 11:56:28.011373 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 68/132] 10.222.0.27 () {58 vars in 1138 bytes} [Mon Jun 20 11:56:27 2022] GET /compute/v2.1/os-hosts?zone= => generated 397 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:28.017072 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-77bef5d6-39d0-4614-beeb-97efabf5256d tempest-HypervisorAdminNegativeTestJSON-1212411986 tempest-HypervisorAdminNegativeTestJSON-1212411986-project] Calling method '.version_select at 0x7f6080351310>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:28.018560 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:28.018560 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:28.020030 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-77bef5d6-39d0-4614-beeb-97efabf5256d tempest-HypervisorAdminNegativeTestJSON-1212411986 tempest-HypervisorAdminNegativeTestJSON-1212411986-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'c1b53eb5c58145dda70d6426b983fe53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b165b245e85147de8ae15946d4e52f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:28.021719 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-77bef5d6-39d0-4614-beeb-97efabf5256d tempest-HypervisorAdminNegativeTestJSON-1212411986 tempest-HypervisorAdminNegativeTestJSON-1212411986-project] Request method failure captured: Jun 20 11:56:28.021719 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Jun 20 11:56:28.021719 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:56:28.021719 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:56:28.021719 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:56:28.021719 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 11:56:28.021719 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:56:28.021719 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:56:28.021719 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:56:28.021719 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:28.021719 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGBpLaoaBfu9vLUC-HGHDErIbscsmFeWY7id3OqbavB3g2XHeuEPsxHKo4L4Kx1xcgZ1sgUf6evh_prrtPlfvmXE1lrfevzVtmlTVs0vMH5EQYMQQwQpG2ApmvV-Ruwg6Y9ci3PiP6vkS5bUkIGe6rNgVeZ3yxt-5wJT1jYiBdPeYxw Jun 20 11:56:28.021719 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:56:28.021719 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:56:28.021719 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:56:28.021719 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:56:28.021719 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:56:28.021719 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:56:28.021719 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: b165b245e85147de8ae15946d4e52f6a Jun 20 11:56:28.021719 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1212411986 Jun 20 11:56:28.021719 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 11:56:28.021719 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 11:56:28.022987 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b165b245e85147de8ae15946d4e52f6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b165b245e85147de8ae15946d4e52f6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b165b245e85147de8ae15946d4e52f6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b165b245e85147de8ae15946d4e52f6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:28.022987 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1212411986 Jun 20 11:56:28.022987 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: b165b245e85147de8ae15946d4e52f6a Jun 20 11:56:28.022987 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1212411986 Jun 20 11:56:28.022987 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-HypervisorAdminNegativeTestJSON-1212411986-project Jun 20 11:56:28.022987 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:56:28.022987 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:56:28.022987 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: c1b53eb5c58145dda70d6426b983fe53 Jun 20 11:56:28.022987 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1212411986-project Jun 20 11:56:28.022987 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 11:56:28.022987 n-d-master-1 devstack@n-api.service[119128]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jun 20 11:56:28.022987 n-d-master-1 devstack@n-api.service[119128]: action_args: {} Jun 20 11:56:28.022987 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:28.023782 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:28.023782 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:28.023782 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:28.023782 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:28.023782 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:28.023782 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 11:56:28.023782 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 11:56:28.023782 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:28.023782 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:28.023782 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Jun 20 11:56:28.023782 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Jun 20 11:56:28.023782 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 20 11:56:28.023782 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 20 11:56:28.023782 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 20 11:56:28.023782 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 20 11:56:28.023782 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 11:56:28.023782 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 11:56:28.023782 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 11:56:28.023782 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 11:56:28.025058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 20 11:56:28.025058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 20 11:56:28.025058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 20 11:56:28.025058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 20 11:56:28.025058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 20 11:56:28.025058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 20 11:56:28.025058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jun 20 11:56:28.025058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:28.025058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:28.025058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:28.025058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:28.025058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:28.025058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:28.025058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 20 11:56:28.025058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 20 11:56:28.025058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jun 20 11:56:28.025058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:28.026108 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-77bef5d6-39d0-4614-beeb-97efabf5256d tempest-HypervisorAdminNegativeTestJSON-1212411986 tempest-HypervisorAdminNegativeTestJSON-1212411986-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:28.026108 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-77bef5d6-39d0-4614-beeb-97efabf5256d tempest-HypervisorAdminNegativeTestJSON-1212411986 tempest-HypervisorAdminNegativeTestJSON-1212411986-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.012318 Jun 20 11:56:28.026504 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 69/133] 10.222.0.27 () {58 vars in 1178 bytes} [Mon Jun 20 11:56:28 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:56:28.030746 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-15ea775c-0978-4953-979e-8892d932f0ab tempest-FlavorsAccessTestJSON-215567345 tempest-FlavorsAccessTestJSON-215567345-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:28.050930 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-15ea775c-0978-4953-979e-8892d932f0ab tempest-FlavorsAccessTestJSON-215567345 tempest-FlavorsAccessTestJSON-215567345-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023391 Jun 20 11:56:28.051596 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 70/134] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 11:56:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:28.056454 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5a22408b-db7f-4706-a7ba-cfaec84d6c75 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] Calling method '.version_select at 0x7f608024d670>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:28.057795 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:28.057795 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:28.058921 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a22408b-db7f-4706-a7ba-cfaec84d6c75 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:28.059512 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a22408b-db7f-4706-a7ba-cfaec84d6c75 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:28.060663 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a22408b-db7f-4706-a7ba-cfaec84d6c75 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:28.061230 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a22408b-db7f-4706-a7ba-cfaec84d6c75 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:28.068096 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-5e461833-0dc9-4606-8fdc-91a72eb48f35 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] validate_networks() for None {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:56:28.085286 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5a22408b-db7f-4706-a7ba-cfaec84d6c75 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.032473 Jun 20 11:56:28.086108 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 71/135] 10.222.0.27 () {58 vars in 1144 bytes} [Mon Jun 20 11:56:28 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 11:56:28.194278 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f946ff7e-01b4-49ca-9206-187bacab7411 tempest-HypervisorAdminNegativeTestJSON-1841606867 tempest-HypervisorAdminNegativeTestJSON-1841606867-project-admin] Calling method '.version_select at 0x7f6081f3e820>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:28.196296 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:28.196296 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:28.197609 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f946ff7e-01b4-49ca-9206-187bacab7411 tempest-HypervisorAdminNegativeTestJSON-1841606867 tempest-HypervisorAdminNegativeTestJSON-1841606867-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:28.198110 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f946ff7e-01b4-49ca-9206-187bacab7411 tempest-HypervisorAdminNegativeTestJSON-1841606867 tempest-HypervisorAdminNegativeTestJSON-1841606867-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:28.212133 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f946ff7e-01b4-49ca-9206-187bacab7411 tempest-HypervisorAdminNegativeTestJSON-1841606867 tempest-HypervisorAdminNegativeTestJSON-1841606867-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:28.212716 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f946ff7e-01b4-49ca-9206-187bacab7411 tempest-HypervisorAdminNegativeTestJSON-1841606867 tempest-HypervisorAdminNegativeTestJSON-1841606867-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:28.223814 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f946ff7e-01b4-49ca-9206-187bacab7411 tempest-HypervisorAdminNegativeTestJSON-1841606867 tempest-HypervisorAdminNegativeTestJSON-1841606867-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:28.224521 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f946ff7e-01b4-49ca-9206-187bacab7411 tempest-HypervisorAdminNegativeTestJSON-1841606867 tempest-HypervisorAdminNegativeTestJSON-1841606867-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:28.230187 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f946ff7e-01b4-49ca-9206-187bacab7411 tempest-HypervisorAdminNegativeTestJSON-1841606867 tempest-HypervisorAdminNegativeTestJSON-1841606867-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.143130 Jun 20 11:56:28.230741 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 72/136] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 11:56:28 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:28.235124 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9a951f5d-fc02-47cc-aa52-f6f96cee3f54 tempest-FlavorsAccessTestJSON-215567345 tempest-FlavorsAccessTestJSON-215567345-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-606879391", "id": 1742559827, "os-flavor-access:is_public": "False"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:28.236715 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:28.236715 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:28.252624 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9a951f5d-fc02-47cc-aa52-f6f96cee3f54 tempest-FlavorsAccessTestJSON-215567345 tempest-FlavorsAccessTestJSON-215567345-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.020813 Jun 20 11:56:28.253217 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 73/137] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:56:28 2022] POST /compute/v2.1/flavors => generated 430 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:28.266420 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-5e461833-0dc9-4606-8fdc-91a72eb48f35 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:56:28.266848 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-5e461833-0dc9-4606-8fdc-91a72eb48f35 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:56:28.267315 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-5e461833-0dc9-4606-8fdc-91a72eb48f35 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:56:28.267720 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-5e461833-0dc9-4606-8fdc-91a72eb48f35 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:56:28.268128 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-5e461833-0dc9-4606-8fdc-91a72eb48f35 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:56:28.276859 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5e461833-0dc9-4606-8fdc-91a72eb48f35 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:28.277307 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5e461833-0dc9-4606-8fdc-91a72eb48f35 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:28.278096 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5e461833-0dc9-4606-8fdc-91a72eb48f35 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:28.278532 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5e461833-0dc9-4606-8fdc-91a72eb48f35 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:28.295222 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-5e461833-0dc9-4606-8fdc-91a72eb48f35 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Getting quotas for project c4bfbc9c01ee408fbfe777ae4ad19fbf. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:56:28.300221 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-5e461833-0dc9-4606-8fdc-91a72eb48f35 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Getting quotas for user 3b1f420e75854a9f81f27ab6b1e718b2 and project c4bfbc9c01ee408fbfe777ae4ad19fbf. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:56:28.305531 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a46e35da-4532-4b3b-bb22-5797197ad23c tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1316210166", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:28.312248 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5e461833-0dc9-4606-8fdc-91a72eb48f35 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:56:28.314664 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5e461833-0dc9-4606-8fdc-91a72eb48f35 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f75be1cf-4d20-4ea9-bcbb-b407892a39ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:56:28.364886 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5e461833-0dc9-4606-8fdc-91a72eb48f35 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.428998 Jun 20 11:56:28.371794 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 65/138] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:56:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 11:56:28.377560 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c690daf8-ab1f-450d-a92e-6bb5e3c9faca tempest-HypervisorAdminNegativeTestJSON-1212411986 tempest-HypervisorAdminNegativeTestJSON-1212411986-project] Calling method '.version_select at 0x7f6080c66700>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:28.378671 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:28.378671 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:28.380250 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c690daf8-ab1f-450d-a92e-6bb5e3c9faca tempest-HypervisorAdminNegativeTestJSON-1212411986 tempest-HypervisorAdminNegativeTestJSON-1212411986-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'c1b53eb5c58145dda70d6426b983fe53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b165b245e85147de8ae15946d4e52f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:28.382294 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c690daf8-ab1f-450d-a92e-6bb5e3c9faca tempest-HypervisorAdminNegativeTestJSON-1212411986 tempest-HypervisorAdminNegativeTestJSON-1212411986-project] Request method failure captured: Jun 20 11:56:28.382294 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Jun 20 11:56:28.382294 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:56:28.382294 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:56:28.382294 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:56:28.382294 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 11:56:28.382294 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:56:28.382294 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:56:28.382294 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:56:28.382294 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:28.382294 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGBpLaoaBfu9vLUC-HGHDErIbscsmFeWY7id3OqbavB3g2XHeuEPsxHKo4L4Kx1xcgZ1sgUf6evh_prrtPlfvmXE1lrfevzVtmlTVs0vMH5EQYMQQwQpG2ApmvV-Ruwg6Y9ci3PiP6vkS5bUkIGe6rNgVeZ3yxt-5wJT1jYiBdPeYxw Jun 20 11:56:28.382294 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:56:28.382294 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:56:28.382294 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:56:28.382294 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:56:28.382294 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:56:28.382294 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:56:28.382294 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: b165b245e85147de8ae15946d4e52f6a Jun 20 11:56:28.382294 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1212411986 Jun 20 11:56:28.382294 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 11:56:28.382294 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 11:56:28.383401 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b165b245e85147de8ae15946d4e52f6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b165b245e85147de8ae15946d4e52f6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b165b245e85147de8ae15946d4e52f6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b165b245e85147de8ae15946d4e52f6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:28.383401 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1212411986 Jun 20 11:56:28.383401 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: b165b245e85147de8ae15946d4e52f6a Jun 20 11:56:28.383401 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1212411986 Jun 20 11:56:28.383401 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-HypervisorAdminNegativeTestJSON-1212411986-project Jun 20 11:56:28.383401 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:56:28.383401 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:56:28.383401 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: c1b53eb5c58145dda70d6426b983fe53 Jun 20 11:56:28.383401 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1212411986-project Jun 20 11:56:28.383401 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 11:56:28.383401 n-d-master-1 devstack@n-api.service[119127]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jun 20 11:56:28.383401 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '1'} Jun 20 11:56:28.383401 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:28.384150 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:28.384150 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:28.384150 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:28.384150 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:28.384150 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:28.384150 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 11:56:28.384150 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 11:56:28.384150 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:28.384150 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:28.384150 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Jun 20 11:56:28.384150 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Jun 20 11:56:28.384150 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 20 11:56:28.384150 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 20 11:56:28.384150 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 20 11:56:28.384150 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 20 11:56:28.384150 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 11:56:28.384150 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 11:56:28.384150 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 11:56:28.384150 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 11:56:28.385234 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 20 11:56:28.385234 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 20 11:56:28.385234 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 20 11:56:28.385234 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 20 11:56:28.385234 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 20 11:56:28.385234 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 20 11:56:28.385234 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jun 20 11:56:28.385234 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:28.385234 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:28.385234 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:28.385234 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:28.385234 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:28.385234 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:28.385234 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 20 11:56:28.385234 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 20 11:56:28.385234 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jun 20 11:56:28.385234 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:28.387044 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c690daf8-ab1f-450d-a92e-6bb5e3c9faca tempest-HypervisorAdminNegativeTestJSON-1212411986 tempest-HypervisorAdminNegativeTestJSON-1212411986-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:28.387893 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c690daf8-ab1f-450d-a92e-6bb5e3c9faca tempest-HypervisorAdminNegativeTestJSON-1212411986 tempest-HypervisorAdminNegativeTestJSON-1212411986-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.015011 Jun 20 11:56:28.392867 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 66/139] 10.222.0.27 () {58 vars in 1172 bytes} [Mon Jun 20 11:56:28 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:56:28.395104 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e583d023-4966-4c58-b0a7-cb8055511116 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:28.395693 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e583d023-4966-4c58-b0a7-cb8055511116 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] [instance: 69a2418e-ab69-4e7b-a243-365951169370] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:28.404269 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e583d023-4966-4c58-b0a7-cb8055511116 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:28.404749 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e583d023-4966-4c58-b0a7-cb8055511116 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:28.405091 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-a46e35da-4532-4b3b-bb22-5797197ad23c tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] validate_networks() for None {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:56:28.405535 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e583d023-4966-4c58-b0a7-cb8055511116 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:28.405977 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e583d023-4966-4c58-b0a7-cb8055511116 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:28.544635 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e583d023-4966-4c58-b0a7-cb8055511116 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93cf53cbece54a978bdab523d015313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671077727e44ef8ba72fe3ffdfa15eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:28.552953 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e583d023-4966-4c58-b0a7-cb8055511116 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] 10.222.0.27 "GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370" status: 200 len: 1338 microversion: 2.1 time: 0.163084 Jun 20 11:56:28.553536 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 67/140] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:28 2022] GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370 => generated 1338 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:28.567940 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9566032e-2500-4a08-8d29-e4c493ee7b7c tempest-FlavorsAccessTestJSON-215567345 tempest-FlavorsAccessTestJSON-215567345-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:28.568737 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:28.568737 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:28.581209 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9566032e-2500-4a08-8d29-e4c493ee7b7c tempest-FlavorsAccessTestJSON-215567345 tempest-FlavorsAccessTestJSON-215567345-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/1742559827/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.017096 Jun 20 11:56:28.581996 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 68/141] 10.222.0.27 () {58 vars in 1208 bytes} [Mon Jun 20 11:56:28 2022] GET /compute/v2.1/flavors/1742559827/os-flavor-access => generated 21 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 11:56:28.590851 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d1b30ed8-e2d4-41cf-98a4-84c7add98d66 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:28.591690 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d1b30ed8-e2d4-41cf-98a4-84c7add98d66 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f75be1cf-4d20-4ea9-bcbb-b407892a39ee] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:28.642389 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-a46e35da-4532-4b3b-bb22-5797197ad23c tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:56:28.642919 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-a46e35da-4532-4b3b-bb22-5797197ad23c tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:56:28.643634 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-a46e35da-4532-4b3b-bb22-5797197ad23c tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:56:28.644048 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-a46e35da-4532-4b3b-bb22-5797197ad23c tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:56:28.644597 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-a46e35da-4532-4b3b-bb22-5797197ad23c tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:56:28.656288 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d1b30ed8-e2d4-41cf-98a4-84c7add98d66 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:28.658702 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a46e35da-4532-4b3b-bb22-5797197ad23c tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:28.660023 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a46e35da-4532-4b3b-bb22-5797197ad23c tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:28.661289 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a46e35da-4532-4b3b-bb22-5797197ad23c tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:28.661803 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a46e35da-4532-4b3b-bb22-5797197ad23c tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:28.669045 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d1b30ed8-e2d4-41cf-98a4-84c7add98d66 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee" status: 200 len: 1218 microversion: 2.1 time: 0.081654 Jun 20 11:56:28.669709 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 69/142] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:28 2022] GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:28.674708 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-43e675d6-acf0-41a0-a749-d0e7ff7020ba tempest-HypervisorAdminNegativeTestJSON-1841606867 tempest-HypervisorAdminNegativeTestJSON-1841606867-project-admin] Calling method '.version_select at 0x7f6080bf7670>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:28.676692 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:28.676692 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:28.677655 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-43e675d6-acf0-41a0-a749-d0e7ff7020ba tempest-HypervisorAdminNegativeTestJSON-1841606867 tempest-HypervisorAdminNegativeTestJSON-1841606867-project-admin] HTTP exception thrown: Hypervisor with ID 'a494e213-2b72-46fd-bb3d-c5e8e0202522' could not be found. Jun 20 11:56:28.687549 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-43e675d6-acf0-41a0-a749-d0e7ff7020ba tempest-HypervisorAdminNegativeTestJSON-1841606867 tempest-HypervisorAdminNegativeTestJSON-1841606867-project-admin] Request method failure captured: Jun 20 11:56:28.687549 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/os-hypervisors/a494e213-2b72-46fd-bb3d-c5e8e0202522/uptime HTTP/1.1 Jun 20 11:56:28.687549 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:56:28.687549 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:56:28.687549 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:56:28.687549 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 11:56:28.687549 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:56:28.687549 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:56:28.687549 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:56:28.687549 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:28.687549 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGBrPGshFEO_B701GCA4z4zqqNKtYpnE2pjV7F3p4hBwJ17grdOH1wiZSPJUxTVAkHd6yxWO8CrtPwZ3xPwcP-be-GOMRuYAEmp210Z7FI4Lg7ZvAS-yugkZhbx4Jt1-rpzuVvxoxm7YpOkqAX2mj4ZdAenN-8UXYltQnAnVWCCGjF8 Jun 20 11:56:28.687549 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:56:28.687549 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:56:28.687549 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:56:28.687549 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:56:28.687549 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:56:28.687549 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:56:28.687549 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 9453ce9d5ba64dd394e3fb0b5f6ed53d Jun 20 11:56:28.687549 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1841606867 Jun 20 11:56:28.687549 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member,admin Jun 20 11:56:28.687549 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member,admin Jun 20 11:56:28.689033 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9453ce9d5ba64dd394e3fb0b5f6ed53d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9453ce9d5ba64dd394e3fb0b5f6ed53d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9453ce9d5ba64dd394e3fb0b5f6ed53d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9453ce9d5ba64dd394e3fb0b5f6ed53d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:28.689033 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1841606867 Jun 20 11:56:28.689033 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 9453ce9d5ba64dd394e3fb0b5f6ed53d Jun 20 11:56:28.689033 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1841606867 Jun 20 11:56:28.689033 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-HypervisorAdminNegativeTestJSON-1841606867-project-admin Jun 20 11:56:28.689033 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:56:28.689033 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:56:28.689033 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: b2b69d7742e344779971fa32462ead86 Jun 20 11:56:28.689033 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1841606867-project-admin Jun 20 11:56:28.689033 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 11:56:28.689033 n-d-master-1 devstack@n-api.service[119127]: exception: Hypervisor with ID 'a494e213-2b72-46fd-bb3d-c5e8e0202522' could not be found. Jun 20 11:56:28.689033 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'a494e213-2b72-46fd-bb3d-c5e8e0202522'} Jun 20 11:56:28.690132 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:28.690132 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:28.690132 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jun 20 11:56:28.690132 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jun 20 11:56:28.690132 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'a494e213-2b72-46fd-bb3d-c5e8e0202522' Jun 20 11:56:28.690132 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:28.690132 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:28.690132 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:28.690132 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:28.690132 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jun 20 11:56:28.690132 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jun 20 11:56:28.690132 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jun 20 11:56:28.690132 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jun 20 11:56:28.690132 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jun 20 11:56:28.690132 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:28.690132 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:28.690132 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:28.690132 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:28.690132 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jun 20 11:56:28.690132 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jun 20 11:56:28.690132 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jun 20 11:56:28.690132 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jun 20 11:56:28.691710 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jun 20 11:56:28.691710 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:28.691710 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:28.691710 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:28.691710 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:28.691710 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:28.691710 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:28.691710 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:28.691710 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:28.691710 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 11:56:28.691710 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 11:56:28.691710 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:28.691710 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:28.691710 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Jun 20 11:56:28.691710 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jun 20 11:56:28.691710 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jun 20 11:56:28.691710 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 20 11:56:28.691710 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'a494e213-2b72-46fd-bb3d-c5e8e0202522' could not be found. Jun 20 11:56:28.691710 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:28.691710 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:28.691710 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:28.693154 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:28.693154 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:28.693154 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:28.693154 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:56:28.693154 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:56:28.693154 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'a494e213-2b72-46fd-bb3d-c5e8e0202522' could not be found. Jun 20 11:56:28.693154 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:28.693154 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-43e675d6-acf0-41a0-a749-d0e7ff7020ba tempest-HypervisorAdminNegativeTestJSON-1841606867 tempest-HypervisorAdminNegativeTestJSON-1841606867-project-admin] Returning 404 to user: Hypervisor with ID 'a494e213-2b72-46fd-bb3d-c5e8e0202522' could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:28.693154 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-43e675d6-acf0-41a0-a749-d0e7ff7020ba tempest-HypervisorAdminNegativeTestJSON-1841606867 tempest-HypervisorAdminNegativeTestJSON-1841606867-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/a494e213-2b72-46fd-bb3d-c5e8e0202522/uptime" status: 404 len: 123 microversion: 2.1 time: 0.018908 Jun 20 11:56:28.693154 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 70/143] 10.222.0.27 () {58 vars in 1277 bytes} [Mon Jun 20 11:56:28 2022] GET /compute/v2.1/os-hypervisors/a494e213-2b72-46fd-bb3d-c5e8e0202522/uptime => generated 123 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:56:28.694013 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-a46e35da-4532-4b3b-bb22-5797197ad23c tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Getting quotas for project 4bdbd48aa5df42418f750ae35bc2eb21. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:56:28.697458 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1e76f40e-b237-4d4d-bcde-d9685ce626ac tempest-FlavorsAccessTestJSON-215567345 tempest-FlavorsAccessTestJSON-215567345-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:28.698199 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:28.698199 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:28.700587 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-a46e35da-4532-4b3b-bb22-5797197ad23c tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Getting quotas for user f49c2eb9caa94cc789f862904b5dde77 and project 4bdbd48aa5df42418f750ae35bc2eb21. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:56:28.714238 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.utils [None req-a46e35da-4532-4b3b-bb22-5797197ad23c tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] cores quota exceeded for 4bdbd48aa5df42418f750ae35bc2eb21, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119128) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jun 20 11:56:28.715071 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-a46e35da-4532-4b3b-bb22-5797197ad23c tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jun 20 11:56:28.720894 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1e76f40e-b237-4d4d-bcde-d9685ce626ac tempest-FlavorsAccessTestJSON-215567345 tempest-FlavorsAccessTestJSON-215567345-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1742559827" status: 202 len: 0 microversion: 2.1 time: 0.028666 Jun 20 11:56:28.721309 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a46e35da-4532-4b3b-bb22-5797197ad23c tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Request method failure captured: Jun 20 11:56:28.721309 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 20 11:56:28.721309 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:56:28.721309 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:56:28.721309 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:56:28.721309 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 145 Jun 20 11:56:28.721309 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:56:28.721309 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:56:28.721309 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:56:28.721309 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:28.721309 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGBpe-8mnXK4f4X9vkKFiN4Hg99YWHBVG9HIFL09ZEFNX4o-SXWwhnneePBj7JzAesKoH81EHjeXxWhQz2zyq4-bxM5Nxu5fbkx_RVbLd5dcwAxxewHXko9pOQg_UlgeBBUAvLOEL0abtvCF1AW9XAMIMbc3kHaS7Wx79MfrpZTwFmU Jun 20 11:56:28.721309 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:56:28.721309 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:56:28.721309 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:56:28.721309 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:56:28.721309 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:56:28.721309 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:56:28.721309 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 4bdbd48aa5df42418f750ae35bc2eb21 Jun 20 11:56:28.721309 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-QuotasAdminNegativeTest-2081924257 Jun 20 11:56:28.721309 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 11:56:28.721309 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 11:56:28.722813 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4bdbd48aa5df42418f750ae35bc2eb21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4bdbd48aa5df42418f750ae35bc2eb21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4bdbd48aa5df42418f750ae35bc2eb21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4bdbd48aa5df42418f750ae35bc2eb21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:28.722813 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-QuotasAdminNegativeTest-2081924257 Jun 20 11:56:28.722813 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 4bdbd48aa5df42418f750ae35bc2eb21 Jun 20 11:56:28.722813 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2081924257 Jun 20 11:56:28.722813 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-QuotasAdminNegativeTest-2081924257-project Jun 20 11:56:28.722813 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:56:28.722813 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:56:28.722813 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: f49c2eb9caa94cc789f862904b5dde77 Jun 20 11:56:28.722813 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-QuotasAdminNegativeTest-2081924257-project Jun 20 11:56:28.722813 n-d-master-1 devstack@n-api.service[119128]: Jun 20 11:56:28.722813 n-d-master-1 devstack@n-api.service[119128]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1316210166", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452"}} Jun 20 11:56:28.722813 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 11:56:28.723437 n-d-master-1 devstack@n-api.service[119128]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jun 20 11:56:28.723437 n-d-master-1 devstack@n-api.service[119128]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1316210166', 'imageRef': 'f16836cc-4e18-4bd0-b261-3865adf8cb83', 'flavorRef': '452'}}} Jun 20 11:56:28.723437 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:28.723437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:28.723437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jun 20 11:56:28.723437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jun 20 11:56:28.723437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 11:56:28.723437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 11:56:28.723437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jun 20 11:56:28.723437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc Jun 20 11:56:28.723437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jun 20 11:56:28.723437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jun 20 11:56:28.723437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 11:56:28.723437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 11:56:28.723437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jun 20 11:56:28.723437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jun 20 11:56:28.723437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jun 20 11:56:28.723437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jun 20 11:56:28.724380 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jun 20 11:56:28.724380 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jun 20 11:56:28.724380 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jun 20 11:56:28.724380 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:28.724380 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:28.724380 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:28.724380 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:28.724380 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 20 11:56:28.724380 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 20 11:56:28.724380 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 20 11:56:28.724380 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 20 11:56:28.724380 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jun 20 11:56:28.724380 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jun 20 11:56:28.724380 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jun 20 11:56:28.724380 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jun 20 11:56:28.724380 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jun 20 11:56:28.724380 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jun 20 11:56:28.724380 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jun 20 11:56:28.724380 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:28.724380 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:28.724380 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:28.725498 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:28.725498 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:28.725498 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:28.725498 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:28.725498 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:28.725498 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:28.725498 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:28.725498 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:56:28.725498 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:56:28.725498 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:56:28.725498 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:56:28.725498 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:56:28.725498 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:56:28.725498 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 20 11:56:28.725498 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jun 20 11:56:28.725498 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 20 11:56:28.725498 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jun 20 11:56:28.725498 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:28.725498 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:28.725498 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:28.725498 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:28.726554 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:28.726554 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:28.726554 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:56:28.726554 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:56:28.726554 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jun 20 11:56:28.726554 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:28.726864 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 71/144] 10.222.0.27 () {58 vars in 1160 bytes} [Mon Jun 20 11:56:28 2022] DELETE /compute/v2.1/flavors/1742559827 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:56:28.726932 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a46e35da-4532-4b3b-bb22-5797197ad23c tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:28.726932 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a46e35da-4532-4b3b-bb22-5797197ad23c tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.468493 Jun 20 11:56:28.726932 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 74/145] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:56:28 2022] POST /compute/v2.1/servers => generated 111 bytes in 473 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:56:28.728170 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-241662a2-94f8-459b-a303-cadfd3e89559 tempest-HypervisorAdminNegativeTestJSON-1841606867 tempest-HypervisorAdminNegativeTestJSON-1841606867-project-admin] Calling method '.version_select at 0x7f6080cd70d0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:28.728976 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:28.728976 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:28.730352 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-241662a2-94f8-459b-a303-cadfd3e89559 tempest-HypervisorAdminNegativeTestJSON-1841606867 tempest-HypervisorAdminNegativeTestJSON-1841606867-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:28.731095 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-241662a2-94f8-459b-a303-cadfd3e89559 tempest-HypervisorAdminNegativeTestJSON-1841606867 tempest-HypervisorAdminNegativeTestJSON-1841606867-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:28.731375 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-af1e885b-8949-4e25-897c-53c4179093e4 tempest-FlavorsAccessTestJSON-215567345 tempest-FlavorsAccessTestJSON-215567345-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:28.745628 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-241662a2-94f8-459b-a303-cadfd3e89559 tempest-HypervisorAdminNegativeTestJSON-1841606867 tempest-HypervisorAdminNegativeTestJSON-1841606867-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:28.746084 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-241662a2-94f8-459b-a303-cadfd3e89559 tempest-HypervisorAdminNegativeTestJSON-1841606867 tempest-HypervisorAdminNegativeTestJSON-1841606867-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:28.752691 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-af1e885b-8949-4e25-897c-53c4179093e4 tempest-FlavorsAccessTestJSON-215567345 tempest-FlavorsAccessTestJSON-215567345-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024633 Jun 20 11:56:28.763664 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 75/146] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 11:56:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:28.763891 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-241662a2-94f8-459b-a303-cadfd3e89559 tempest-HypervisorAdminNegativeTestJSON-1841606867 tempest-HypervisorAdminNegativeTestJSON-1841606867-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:28.763979 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f258e3bc-7a2e-4899-a739-e21151223303 tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] Action: 'update', calling method: .version_select at 0x7f608008eee0>, body: {"quota_set": {"cores": 20}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:28.764049 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-241662a2-94f8-459b-a303-cadfd3e89559 tempest-HypervisorAdminNegativeTestJSON-1841606867 tempest-HypervisorAdminNegativeTestJSON-1841606867-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:28.775167 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-241662a2-94f8-459b-a303-cadfd3e89559 tempest-HypervisorAdminNegativeTestJSON-1841606867 tempest-HypervisorAdminNegativeTestJSON-1841606867-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.051921 Jun 20 11:56:28.776275 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 72/147] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 11:56:28 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:28.785849 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fd9a953e-fe8c-44b6-b04c-03756d4a172c tempest-HypervisorAdminNegativeTestJSON-1212411986 tempest-HypervisorAdminNegativeTestJSON-1212411986-project] Calling method '.version_select at 0x7f6080d23e50>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:28.786639 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:28.786639 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:28.787710 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fd9a953e-fe8c-44b6-b04c-03756d4a172c tempest-HypervisorAdminNegativeTestJSON-1212411986 tempest-HypervisorAdminNegativeTestJSON-1212411986-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'c1b53eb5c58145dda70d6426b983fe53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b165b245e85147de8ae15946d4e52f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:28.789364 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fd9a953e-fe8c-44b6-b04c-03756d4a172c tempest-HypervisorAdminNegativeTestJSON-1212411986 tempest-HypervisorAdminNegativeTestJSON-1212411986-project] Request method failure captured: Jun 20 11:56:28.789364 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Jun 20 11:56:28.789364 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:56:28.789364 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:56:28.789364 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:56:28.789364 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 11:56:28.789364 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:56:28.789364 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:56:28.789364 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:56:28.789364 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:28.789364 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGBpLaoaBfu9vLUC-HGHDErIbscsmFeWY7id3OqbavB3g2XHeuEPsxHKo4L4Kx1xcgZ1sgUf6evh_prrtPlfvmXE1lrfevzVtmlTVs0vMH5EQYMQQwQpG2ApmvV-Ruwg6Y9ci3PiP6vkS5bUkIGe6rNgVeZ3yxt-5wJT1jYiBdPeYxw Jun 20 11:56:28.789364 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:56:28.789364 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:56:28.789364 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:56:28.789364 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:56:28.789364 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:56:28.789364 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:56:28.789364 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: b165b245e85147de8ae15946d4e52f6a Jun 20 11:56:28.789364 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1212411986 Jun 20 11:56:28.789364 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 11:56:28.789364 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 11:56:28.790578 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b165b245e85147de8ae15946d4e52f6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b165b245e85147de8ae15946d4e52f6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b165b245e85147de8ae15946d4e52f6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b165b245e85147de8ae15946d4e52f6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:28.790578 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1212411986 Jun 20 11:56:28.790578 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: b165b245e85147de8ae15946d4e52f6a Jun 20 11:56:28.790578 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1212411986 Jun 20 11:56:28.790578 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-HypervisorAdminNegativeTestJSON-1212411986-project Jun 20 11:56:28.790578 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:56:28.790578 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:56:28.790578 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: c1b53eb5c58145dda70d6426b983fe53 Jun 20 11:56:28.790578 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1212411986-project Jun 20 11:56:28.790578 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 11:56:28.790578 n-d-master-1 devstack@n-api.service[119127]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jun 20 11:56:28.790578 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '1'} Jun 20 11:56:28.790578 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:28.792673 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:28.792673 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:28.792673 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:28.792673 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:28.792673 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:28.792673 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 11:56:28.792673 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 11:56:28.792673 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:28.792673 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:28.792673 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jun 20 11:56:28.792673 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jun 20 11:56:28.792673 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Jun 20 11:56:28.792673 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Jun 20 11:56:28.792673 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 20 11:56:28.792673 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 20 11:56:28.792673 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 20 11:56:28.792673 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 20 11:56:28.792673 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 11:56:28.792673 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 11:56:28.793716 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 11:56:28.793716 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 11:56:28.793716 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 20 11:56:28.793716 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 20 11:56:28.793716 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 20 11:56:28.793716 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 20 11:56:28.793716 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 20 11:56:28.793716 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 20 11:56:28.793716 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jun 20 11:56:28.793716 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:28.793716 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:28.793716 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:28.793716 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:28.793716 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:28.793716 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:28.793716 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 20 11:56:28.793716 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 20 11:56:28.793716 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jun 20 11:56:28.793716 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:28.794653 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fd9a953e-fe8c-44b6-b04c-03756d4a172c tempest-HypervisorAdminNegativeTestJSON-1212411986 tempest-HypervisorAdminNegativeTestJSON-1212411986-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:28.794653 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fd9a953e-fe8c-44b6-b04c-03756d4a172c tempest-HypervisorAdminNegativeTestJSON-1212411986 tempest-HypervisorAdminNegativeTestJSON-1212411986-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.008889 Jun 20 11:56:28.794653 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 73/148] 10.222.0.27 () {58 vars in 1151 bytes} [Mon Jun 20 11:56:28 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jun 20 11:56:28.800615 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e10b47e5-a7fa-491c-ad64-10beb5d3730c tempest-HypervisorAdminNegativeTestJSON-1841606867 tempest-HypervisorAdminNegativeTestJSON-1841606867-project-admin] Calling method '.version_select at 0x7f60803cf550>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:28.802205 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-e10b47e5-a7fa-491c-ad64-10beb5d3730c tempest-HypervisorAdminNegativeTestJSON-1841606867 tempest-HypervisorAdminNegativeTestJSON-1841606867-project-admin] HTTP exception thrown: Hypervisor with ID '0ff205e5-23ed-4bb9-98bb-5138073c442f' could not be found. Jun 20 11:56:28.803845 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e10b47e5-a7fa-491c-ad64-10beb5d3730c tempest-HypervisorAdminNegativeTestJSON-1841606867 tempest-HypervisorAdminNegativeTestJSON-1841606867-project-admin] Request method failure captured: Jun 20 11:56:28.803845 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/os-hypervisors/0ff205e5-23ed-4bb9-98bb-5138073c442f HTTP/1.1 Jun 20 11:56:28.803845 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:56:28.803845 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:56:28.803845 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:56:28.803845 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 11:56:28.803845 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:56:28.803845 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:56:28.803845 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:56:28.803845 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:28.803845 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGBrPGshFEO_B701GCA4z4zqqNKtYpnE2pjV7F3p4hBwJ17grdOH1wiZSPJUxTVAkHd6yxWO8CrtPwZ3xPwcP-be-GOMRuYAEmp210Z7FI4Lg7ZvAS-yugkZhbx4Jt1-rpzuVvxoxm7YpOkqAX2mj4ZdAenN-8UXYltQnAnVWCCGjF8 Jun 20 11:56:28.803845 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:56:28.803845 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:56:28.803845 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:56:28.803845 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:56:28.803845 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:56:28.803845 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:56:28.803845 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 9453ce9d5ba64dd394e3fb0b5f6ed53d Jun 20 11:56:28.803845 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1841606867 Jun 20 11:56:28.803845 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member,admin Jun 20 11:56:28.803845 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member,admin Jun 20 11:56:28.805278 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9453ce9d5ba64dd394e3fb0b5f6ed53d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9453ce9d5ba64dd394e3fb0b5f6ed53d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9453ce9d5ba64dd394e3fb0b5f6ed53d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9453ce9d5ba64dd394e3fb0b5f6ed53d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:28.805278 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1841606867 Jun 20 11:56:28.805278 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 9453ce9d5ba64dd394e3fb0b5f6ed53d Jun 20 11:56:28.805278 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1841606867 Jun 20 11:56:28.805278 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-HypervisorAdminNegativeTestJSON-1841606867-project-admin Jun 20 11:56:28.805278 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:56:28.805278 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:56:28.805278 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: b2b69d7742e344779971fa32462ead86 Jun 20 11:56:28.805278 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1841606867-project-admin Jun 20 11:56:28.805278 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 11:56:28.805278 n-d-master-1 devstack@n-api.service[119127]: exception: Hypervisor with ID '0ff205e5-23ed-4bb9-98bb-5138073c442f' could not be found. Jun 20 11:56:28.805278 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '0ff205e5-23ed-4bb9-98bb-5138073c442f'} Jun 20 11:56:28.806006 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:28.806006 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:28.806006 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jun 20 11:56:28.806006 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jun 20 11:56:28.806006 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '0ff205e5-23ed-4bb9-98bb-5138073c442f' Jun 20 11:56:28.806006 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:28.806006 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:28.806006 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:28.806006 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:28.806006 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jun 20 11:56:28.806006 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jun 20 11:56:28.806006 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jun 20 11:56:28.806006 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jun 20 11:56:28.806006 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jun 20 11:56:28.806006 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:28.806006 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:28.806006 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:28.806006 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:28.806006 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jun 20 11:56:28.806006 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jun 20 11:56:28.806006 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jun 20 11:56:28.806006 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jun 20 11:56:28.807112 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jun 20 11:56:28.807112 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:28.807112 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:28.807112 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:28.807112 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:28.807112 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:28.807112 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:28.807112 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:28.807112 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:28.807112 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 11:56:28.807112 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 11:56:28.807112 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:28.807112 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:28.807112 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jun 20 11:56:28.807112 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jun 20 11:56:28.807112 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Jun 20 11:56:28.807112 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jun 20 11:56:28.807112 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jun 20 11:56:28.807112 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 20 11:56:28.807112 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '0ff205e5-23ed-4bb9-98bb-5138073c442f' could not be found. Jun 20 11:56:28.809946 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:28.809946 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:28.809946 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:28.809946 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:28.809946 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:28.809946 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:28.809946 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:56:28.809946 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:56:28.809946 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '0ff205e5-23ed-4bb9-98bb-5138073c442f' could not be found. Jun 20 11:56:28.809946 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:28.809946 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e10b47e5-a7fa-491c-ad64-10beb5d3730c tempest-HypervisorAdminNegativeTestJSON-1841606867 tempest-HypervisorAdminNegativeTestJSON-1841606867-project-admin] Returning 404 to user: Hypervisor with ID '0ff205e5-23ed-4bb9-98bb-5138073c442f' could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:28.809946 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e10b47e5-a7fa-491c-ad64-10beb5d3730c tempest-HypervisorAdminNegativeTestJSON-1841606867 tempest-HypervisorAdminNegativeTestJSON-1841606867-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/0ff205e5-23ed-4bb9-98bb-5138073c442f" status: 404 len: 123 microversion: 2.1 time: 0.008171 Jun 20 11:56:28.809946 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 74/149] 10.222.0.27 () {58 vars in 1256 bytes} [Mon Jun 20 11:56:28 2022] GET /compute/v2.1/os-hypervisors/0ff205e5-23ed-4bb9-98bb-5138073c442f => generated 123 bytes in 9 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:56:28.858508 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f258e3bc-7a2e-4899-a739-e21151223303 tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:28.859280 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f258e3bc-7a2e-4899-a739-e21151223303 tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:28.861048 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f258e3bc-7a2e-4899-a739-e21151223303 tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:28.861708 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f258e3bc-7a2e-4899-a739-e21151223303 tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:28.935502 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f258e3bc-7a2e-4899-a739-e21151223303 tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/4bdbd48aa5df42418f750ae35bc2eb21" status: 200 len: 329 microversion: 2.1 time: 0.180891 Jun 20 11:56:28.951557 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 76/150] 10.222.0.27 () {60 vars in 1261 bytes} [Mon Jun 20 11:56:28 2022] PUT /compute/v2.1/os-quota-sets/4bdbd48aa5df42418f750ae35bc2eb21 => generated 329 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:28.955635 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8dd06bda-948c-406c-a400-e8d359f50b4a tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] Calling method '.version_select at 0x7f6080cbc700>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:29.291562 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8dd06bda-948c-406c-a400-e8d359f50b4a tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/4bdbd48aa5df42418f750ae35bc2eb21" status: 200 len: 371 microversion: 2.1 time: 0.346711 Jun 20 11:56:29.297754 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 75/151] 10.222.0.27 () {58 vars in 1241 bytes} [Mon Jun 20 11:56:28 2022] GET /compute/v2.1/os-quota-sets/4bdbd48aa5df42418f750ae35bc2eb21 => generated 371 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:29.305130 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8e535a26-6b7c-4b23-a9f4-68d506a6e0d9 tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] Action: 'update', calling method: .version_select at 0x7f60800a3ee0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:29.411634 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e535a26-6b7c-4b23-a9f4-68d506a6e0d9 tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:29.412183 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e535a26-6b7c-4b23-a9f4-68d506a6e0d9 tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:29.413110 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e535a26-6b7c-4b23-a9f4-68d506a6e0d9 tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:29.413698 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e535a26-6b7c-4b23-a9f4-68d506a6e0d9 tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:29.466052 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8e535a26-6b7c-4b23-a9f4-68d506a6e0d9 tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/4bdbd48aa5df42418f750ae35bc2eb21" status: 200 len: 328 microversion: 2.1 time: 0.166027 Jun 20 11:56:29.476601 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 77/152] 10.222.0.27 () {60 vars in 1261 bytes} [Mon Jun 20 11:56:29 2022] PUT /compute/v2.1/os-quota-sets/4bdbd48aa5df42418f750ae35bc2eb21 => generated 328 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:29.570520 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b53cc94f-b6cb-48ec-a9cd-113e8bfcd507 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:29.571944 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b53cc94f-b6cb-48ec-a9cd-113e8bfcd507 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] [instance: 69a2418e-ab69-4e7b-a243-365951169370] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:29.584443 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b53cc94f-b6cb-48ec-a9cd-113e8bfcd507 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:29.584902 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b53cc94f-b6cb-48ec-a9cd-113e8bfcd507 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:29.585693 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b53cc94f-b6cb-48ec-a9cd-113e8bfcd507 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:29.586122 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b53cc94f-b6cb-48ec-a9cd-113e8bfcd507 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:29.589051 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-64323ec2-d0f1-425f-b697-8b546fb86675 tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1214897776", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:29.596903 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:56:29.606328 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:56:29.643817 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-64323ec2-d0f1-425f-b697-8b546fb86675 tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] validate_networks() for None {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:56:29.846198 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b53cc94f-b6cb-48ec-a9cd-113e8bfcd507 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93cf53cbece54a978bdab523d015313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671077727e44ef8ba72fe3ffdfa15eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:29.859559 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b53cc94f-b6cb-48ec-a9cd-113e8bfcd507 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] 10.222.0.27 "GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370" status: 200 len: 1338 microversion: 2.1 time: 0.292767 Jun 20 11:56:29.866436 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 76/153] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:29 2022] GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370 => generated 1338 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:29.871327 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-64323ec2-d0f1-425f-b697-8b546fb86675 tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:56:29.871852 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-64323ec2-d0f1-425f-b697-8b546fb86675 tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:56:29.872450 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-64323ec2-d0f1-425f-b697-8b546fb86675 tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:56:29.872959 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-64323ec2-d0f1-425f-b697-8b546fb86675 tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:56:29.873464 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-64323ec2-d0f1-425f-b697-8b546fb86675 tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:56:29.895470 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9a4c3ef3-73fa-4b7c-b6bc-aea7a419155b tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:29.896373 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9a4c3ef3-73fa-4b7c-b6bc-aea7a419155b tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f75be1cf-4d20-4ea9-bcbb-b407892a39ee] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:29.900290 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64323ec2-d0f1-425f-b697-8b546fb86675 tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:29.900996 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64323ec2-d0f1-425f-b697-8b546fb86675 tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:29.902006 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64323ec2-d0f1-425f-b697-8b546fb86675 tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:29.904067 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64323ec2-d0f1-425f-b697-8b546fb86675 tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:29.911728 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a4c3ef3-73fa-4b7c-b6bc-aea7a419155b tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:29.914063 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a4c3ef3-73fa-4b7c-b6bc-aea7a419155b tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:29.915740 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a4c3ef3-73fa-4b7c-b6bc-aea7a419155b tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:29.917584 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a4c3ef3-73fa-4b7c-b6bc-aea7a419155b tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:29.955129 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-64323ec2-d0f1-425f-b697-8b546fb86675 tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Getting quotas for project 4bdbd48aa5df42418f750ae35bc2eb21. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:56:29.977329 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-64323ec2-d0f1-425f-b697-8b546fb86675 tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Getting quotas for user f49c2eb9caa94cc789f862904b5dde77 and project 4bdbd48aa5df42418f750ae35bc2eb21. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:56:30.008039 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.utils [None req-64323ec2-d0f1-425f-b697-8b546fb86675 tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] instances quota exceeded for 4bdbd48aa5df42418f750ae35bc2eb21, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119128) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jun 20 11:56:30.010068 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-64323ec2-d0f1-425f-b697-8b546fb86675 tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jun 20 11:56:30.014199 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-64323ec2-d0f1-425f-b697-8b546fb86675 tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Request method failure captured: Jun 20 11:56:30.014199 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 20 11:56:30.014199 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:56:30.014199 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:56:30.014199 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:56:30.014199 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 145 Jun 20 11:56:30.014199 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:56:30.014199 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:56:30.014199 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:56:30.014199 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:30.014199 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGBpe-8mnXK4f4X9vkKFiN4Hg99YWHBVG9HIFL09ZEFNX4o-SXWwhnneePBj7JzAesKoH81EHjeXxWhQz2zyq4-bxM5Nxu5fbkx_RVbLd5dcwAxxewHXko9pOQg_UlgeBBUAvLOEL0abtvCF1AW9XAMIMbc3kHaS7Wx79MfrpZTwFmU Jun 20 11:56:30.014199 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:56:30.014199 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:56:30.014199 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:56:30.014199 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:56:30.014199 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:56:30.014199 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:56:30.014199 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 4bdbd48aa5df42418f750ae35bc2eb21 Jun 20 11:56:30.014199 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-QuotasAdminNegativeTest-2081924257 Jun 20 11:56:30.014199 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 11:56:30.014199 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 11:56:30.015278 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4bdbd48aa5df42418f750ae35bc2eb21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4bdbd48aa5df42418f750ae35bc2eb21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4bdbd48aa5df42418f750ae35bc2eb21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4bdbd48aa5df42418f750ae35bc2eb21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:30.015278 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-QuotasAdminNegativeTest-2081924257 Jun 20 11:56:30.015278 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 4bdbd48aa5df42418f750ae35bc2eb21 Jun 20 11:56:30.015278 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2081924257 Jun 20 11:56:30.015278 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-QuotasAdminNegativeTest-2081924257-project Jun 20 11:56:30.015278 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:56:30.015278 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:56:30.015278 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: f49c2eb9caa94cc789f862904b5dde77 Jun 20 11:56:30.015278 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-QuotasAdminNegativeTest-2081924257-project Jun 20 11:56:30.015278 n-d-master-1 devstack@n-api.service[119128]: Jun 20 11:56:30.015278 n-d-master-1 devstack@n-api.service[119128]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1214897776", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452"}} Jun 20 11:56:30.015278 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 11:56:30.016262 n-d-master-1 devstack@n-api.service[119128]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jun 20 11:56:30.016262 n-d-master-1 devstack@n-api.service[119128]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1214897776', 'imageRef': 'f16836cc-4e18-4bd0-b261-3865adf8cb83', 'flavorRef': '452'}}} Jun 20 11:56:30.016262 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:30.016262 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:30.016262 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jun 20 11:56:30.016262 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jun 20 11:56:30.016262 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 11:56:30.016262 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 11:56:30.016262 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jun 20 11:56:30.016262 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc Jun 20 11:56:30.016262 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jun 20 11:56:30.016262 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jun 20 11:56:30.016262 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 11:56:30.016262 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 11:56:30.016262 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jun 20 11:56:30.016262 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jun 20 11:56:30.016262 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jun 20 11:56:30.016262 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jun 20 11:56:30.017271 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jun 20 11:56:30.017271 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jun 20 11:56:30.017271 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Jun 20 11:56:30.017271 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:30.017271 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:30.017271 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:30.017271 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:30.017271 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 20 11:56:30.017271 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 20 11:56:30.017271 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 20 11:56:30.017271 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 20 11:56:30.017271 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jun 20 11:56:30.017271 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jun 20 11:56:30.017271 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jun 20 11:56:30.017271 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jun 20 11:56:30.017271 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jun 20 11:56:30.017271 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jun 20 11:56:30.017271 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jun 20 11:56:30.017271 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:30.017271 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:30.017271 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:30.018396 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:30.018396 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:30.018396 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:30.018396 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:30.018396 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:30.018396 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:30.018396 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:30.018396 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:56:30.018396 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:56:30.018396 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:56:30.018396 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:56:30.018396 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:56:30.018396 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:56:30.018396 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 20 11:56:30.018396 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jun 20 11:56:30.018396 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 20 11:56:30.018396 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jun 20 11:56:30.018396 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:30.018396 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:30.018396 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:30.018396 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:30.019574 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:30.019574 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:30.019574 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:56:30.019574 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:56:30.019574 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jun 20 11:56:30.019574 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:30.028163 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-64323ec2-d0f1-425f-b697-8b546fb86675 tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:30.029218 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-64323ec2-d0f1-425f-b697-8b546fb86675 tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.444911 Jun 20 11:56:30.030936 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 78/154] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:56:29 2022] POST /compute/v2.1/servers => generated 119 bytes in 448 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:56:30.045121 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1a0e3df9-d830-45ff-a77b-9064c2fbc993 tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] Action: 'update', calling method: .version_select at 0x7f60800a3280>, body: {"quota_set": {"instances": 10}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:30.066721 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9a4c3ef3-73fa-4b7c-b6bc-aea7a419155b tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:30.079196 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9a4c3ef3-73fa-4b7c-b6bc-aea7a419155b tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee" status: 200 len: 1278 microversion: 2.1 time: 0.211403 Jun 20 11:56:30.091825 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 77/155] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:29 2022] GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee => generated 1278 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:30.709773 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a0e3df9-d830-45ff-a77b-9064c2fbc993 tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:30.710365 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a0e3df9-d830-45ff-a77b-9064c2fbc993 tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:30.711022 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a0e3df9-d830-45ff-a77b-9064c2fbc993 tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:30.713065 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a0e3df9-d830-45ff-a77b-9064c2fbc993 tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:30.881461 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6da1e5f1-69a3-4075-8ec2-ddee7f704436 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:30.882088 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6da1e5f1-69a3-4075-8ec2-ddee7f704436 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] [instance: 69a2418e-ab69-4e7b-a243-365951169370] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:30.892845 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6da1e5f1-69a3-4075-8ec2-ddee7f704436 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:30.895995 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6da1e5f1-69a3-4075-8ec2-ddee7f704436 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:30.899293 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6da1e5f1-69a3-4075-8ec2-ddee7f704436 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:30.902468 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1a0e3df9-d830-45ff-a77b-9064c2fbc993 tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/4bdbd48aa5df42418f750ae35bc2eb21" status: 200 len: 329 microversion: 2.1 time: 0.867431 Jun 20 11:56:30.903178 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 79/156] 10.222.0.27 () {60 vars in 1261 bytes} [Mon Jun 20 11:56:30 2022] PUT /compute/v2.1/os-quota-sets/4bdbd48aa5df42418f750ae35bc2eb21 => generated 329 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:30.903306 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6da1e5f1-69a3-4075-8ec2-ddee7f704436 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:30.917193 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-478e1f81-6d4f-440e-afd8-6f83ea5db5a2 tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] Calling method '.version_select at 0x7f60800a3820>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:31.240626 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-478e1f81-6d4f-440e-afd8-6f83ea5db5a2 tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/4bdbd48aa5df42418f750ae35bc2eb21" status: 200 len: 371 microversion: 2.1 time: 0.327488 Jun 20 11:56:31.250050 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 80/157] 10.222.0.27 () {58 vars in 1241 bytes} [Mon Jun 20 11:56:30 2022] GET /compute/v2.1/os-quota-sets/4bdbd48aa5df42418f750ae35bc2eb21 => generated 371 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:31.258893 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5199457c-ecef-4d8c-9616-16673e9f0f41 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:31.259276 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5199457c-ecef-4d8c-9616-16673e9f0f41 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f75be1cf-4d20-4ea9-bcbb-b407892a39ee] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:31.268188 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5199457c-ecef-4d8c-9616-16673e9f0f41 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:31.268706 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5199457c-ecef-4d8c-9616-16673e9f0f41 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:31.269847 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5199457c-ecef-4d8c-9616-16673e9f0f41 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:31.270493 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5199457c-ecef-4d8c-9616-16673e9f0f41 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:31.355633 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5199457c-ecef-4d8c-9616-16673e9f0f41 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:31.356775 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6da1e5f1-69a3-4075-8ec2-ddee7f704436 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93cf53cbece54a978bdab523d015313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671077727e44ef8ba72fe3ffdfa15eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:31.369281 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5199457c-ecef-4d8c-9616-16673e9f0f41 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee" status: 200 len: 1276 microversion: 2.1 time: 0.117238 Jun 20 11:56:31.372496 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 81/158] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:31 2022] GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee => generated 1276 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:31.379862 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b0095f2a-f334-4dcd-9c9a-45beb3c69427 tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] Action: 'update', calling method: .version_select at 0x7f608029a670>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:31.380720 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6da1e5f1-69a3-4075-8ec2-ddee7f704436 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] 10.222.0.27 "GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370" status: 200 len: 1338 microversion: 2.1 time: 0.500481 Jun 20 11:56:31.382904 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 78/159] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:30 2022] GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370 => generated 1338 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:56:31.787059 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b0095f2a-f334-4dcd-9c9a-45beb3c69427 tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:31.788252 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b0095f2a-f334-4dcd-9c9a-45beb3c69427 tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:31.789421 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b0095f2a-f334-4dcd-9c9a-45beb3c69427 tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:31.790111 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b0095f2a-f334-4dcd-9c9a-45beb3c69427 tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:31.895676 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b0095f2a-f334-4dcd-9c9a-45beb3c69427 tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/4bdbd48aa5df42418f750ae35bc2eb21" status: 200 len: 325 microversion: 2.1 time: 0.518897 Jun 20 11:56:31.911307 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 82/160] 10.222.0.27 () {60 vars in 1261 bytes} [Mon Jun 20 11:56:31 2022] PUT /compute/v2.1/os-quota-sets/4bdbd48aa5df42418f750ae35bc2eb21 => generated 325 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:32.110404 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0c033612-b2fa-4c84-98f2-6c56b96b38ef tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1262470162", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:32.208282 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-0c033612-b2fa-4c84-98f2-6c56b96b38ef tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] validate_networks() for None {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:56:32.393124 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2f565c6b-4643-4e16-8bf3-c1772616e704 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:32.394570 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2f565c6b-4643-4e16-8bf3-c1772616e704 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f75be1cf-4d20-4ea9-bcbb-b407892a39ee] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:32.412329 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2f565c6b-4643-4e16-8bf3-c1772616e704 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:32.419680 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2f565c6b-4643-4e16-8bf3-c1772616e704 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:32.422808 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2f565c6b-4643-4e16-8bf3-c1772616e704 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:32.424374 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2f565c6b-4643-4e16-8bf3-c1772616e704 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:32.532240 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-0c033612-b2fa-4c84-98f2-6c56b96b38ef tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:56:32.533396 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-0c033612-b2fa-4c84-98f2-6c56b96b38ef tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:56:32.534021 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-0c033612-b2fa-4c84-98f2-6c56b96b38ef tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:56:32.534437 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-0c033612-b2fa-4c84-98f2-6c56b96b38ef tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:56:32.535007 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-0c033612-b2fa-4c84-98f2-6c56b96b38ef tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:56:32.546074 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0c033612-b2fa-4c84-98f2-6c56b96b38ef tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:32.546817 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0c033612-b2fa-4c84-98f2-6c56b96b38ef tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:32.548228 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0c033612-b2fa-4c84-98f2-6c56b96b38ef tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:32.548864 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0c033612-b2fa-4c84-98f2-6c56b96b38ef tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:32.582638 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-0c033612-b2fa-4c84-98f2-6c56b96b38ef tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Getting quotas for project 4bdbd48aa5df42418f750ae35bc2eb21. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:56:32.589927 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-0c033612-b2fa-4c84-98f2-6c56b96b38ef tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Getting quotas for user f49c2eb9caa94cc789f862904b5dde77 and project 4bdbd48aa5df42418f750ae35bc2eb21. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:56:32.612856 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.utils [None req-0c033612-b2fa-4c84-98f2-6c56b96b38ef tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] ram quota exceeded for 4bdbd48aa5df42418f750ae35bc2eb21, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119127) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jun 20 11:56:32.614483 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-0c033612-b2fa-4c84-98f2-6c56b96b38ef tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jun 20 11:56:32.619501 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2f565c6b-4643-4e16-8bf3-c1772616e704 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:32.631117 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2f565c6b-4643-4e16-8bf3-c1772616e704 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee" status: 200 len: 1318 microversion: 2.1 time: 0.245621 Jun 20 11:56:32.632192 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 83/161] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:32 2022] GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:32.635412 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0c033612-b2fa-4c84-98f2-6c56b96b38ef tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Request method failure captured: Jun 20 11:56:32.635412 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 20 11:56:32.635412 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:56:32.635412 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:56:32.635412 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:56:32.635412 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 145 Jun 20 11:56:32.635412 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:56:32.635412 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:56:32.635412 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:56:32.635412 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:32.635412 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGBpe-8mnXK4f4X9vkKFiN4Hg99YWHBVG9HIFL09ZEFNX4o-SXWwhnneePBj7JzAesKoH81EHjeXxWhQz2zyq4-bxM5Nxu5fbkx_RVbLd5dcwAxxewHXko9pOQg_UlgeBBUAvLOEL0abtvCF1AW9XAMIMbc3kHaS7Wx79MfrpZTwFmU Jun 20 11:56:32.635412 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:56:32.635412 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:56:32.635412 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:56:32.635412 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:56:32.635412 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:56:32.635412 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:56:32.635412 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 4bdbd48aa5df42418f750ae35bc2eb21 Jun 20 11:56:32.635412 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-QuotasAdminNegativeTest-2081924257 Jun 20 11:56:32.635412 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 11:56:32.635412 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 11:56:32.636865 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4bdbd48aa5df42418f750ae35bc2eb21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4bdbd48aa5df42418f750ae35bc2eb21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4bdbd48aa5df42418f750ae35bc2eb21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4bdbd48aa5df42418f750ae35bc2eb21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:32.636865 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-QuotasAdminNegativeTest-2081924257 Jun 20 11:56:32.636865 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 4bdbd48aa5df42418f750ae35bc2eb21 Jun 20 11:56:32.636865 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2081924257 Jun 20 11:56:32.636865 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-QuotasAdminNegativeTest-2081924257-project Jun 20 11:56:32.636865 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:56:32.636865 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:56:32.636865 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: f49c2eb9caa94cc789f862904b5dde77 Jun 20 11:56:32.636865 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-QuotasAdminNegativeTest-2081924257-project Jun 20 11:56:32.636865 n-d-master-1 devstack@n-api.service[119127]: Jun 20 11:56:32.636865 n-d-master-1 devstack@n-api.service[119127]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1262470162", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452"}} Jun 20 11:56:32.636865 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 11:56:32.637529 n-d-master-1 devstack@n-api.service[119127]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jun 20 11:56:32.637529 n-d-master-1 devstack@n-api.service[119127]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1262470162', 'imageRef': 'f16836cc-4e18-4bd0-b261-3865adf8cb83', 'flavorRef': '452'}}} Jun 20 11:56:32.637529 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:32.637529 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:32.637529 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jun 20 11:56:32.637529 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jun 20 11:56:32.637529 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 11:56:32.637529 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 11:56:32.637529 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jun 20 11:56:32.637529 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc Jun 20 11:56:32.637529 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jun 20 11:56:32.637529 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jun 20 11:56:32.637529 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 11:56:32.637529 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 11:56:32.637529 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jun 20 11:56:32.637529 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jun 20 11:56:32.637529 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jun 20 11:56:32.637529 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jun 20 11:56:32.638515 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jun 20 11:56:32.638515 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jun 20 11:56:32.638515 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jun 20 11:56:32.638515 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:32.638515 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:32.638515 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:32.638515 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:32.638515 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 20 11:56:32.638515 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 20 11:56:32.638515 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 20 11:56:32.638515 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 20 11:56:32.638515 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jun 20 11:56:32.638515 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jun 20 11:56:32.638515 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jun 20 11:56:32.638515 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jun 20 11:56:32.638515 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jun 20 11:56:32.638515 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jun 20 11:56:32.638515 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jun 20 11:56:32.638515 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:32.638515 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:32.638515 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:32.642208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:32.642208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:32.642208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:32.642208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:32.642208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:32.642208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:32.642208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:32.642208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:56:32.642208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:56:32.642208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:56:32.642208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:56:32.642208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:56:32.642208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:56:32.642208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 20 11:56:32.642208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jun 20 11:56:32.642208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 20 11:56:32.642208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jun 20 11:56:32.642208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:32.642208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:32.642208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:32.642208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:32.644193 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:32.644193 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:32.644193 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:56:32.644193 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:56:32.644193 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jun 20 11:56:32.644193 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:32.644193 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0c033612-b2fa-4c84-98f2-6c56b96b38ef tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:32.644193 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0c033612-b2fa-4c84-98f2-6c56b96b38ef tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.532301 Jun 20 11:56:32.644193 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 79/162] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:56:32 2022] POST /compute/v2.1/servers => generated 110 bytes in 534 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:56:32.648337 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c60c7277-b271-431c-9b56-facc2c85ea43 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:32.649006 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c60c7277-b271-431c-9b56-facc2c85ea43 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] [instance: 69a2418e-ab69-4e7b-a243-365951169370] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:32.659929 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c60c7277-b271-431c-9b56-facc2c85ea43 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:32.659929 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c60c7277-b271-431c-9b56-facc2c85ea43 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:32.659929 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c60c7277-b271-431c-9b56-facc2c85ea43 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:32.659929 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c60c7277-b271-431c-9b56-facc2c85ea43 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:32.826338 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c60c7277-b271-431c-9b56-facc2c85ea43 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93cf53cbece54a978bdab523d015313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671077727e44ef8ba72fe3ffdfa15eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:32.835999 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c60c7277-b271-431c-9b56-facc2c85ea43 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] 10.222.0.27 "GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370" status: 200 len: 1338 microversion: 2.1 time: 0.202217 Jun 20 11:56:32.840926 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-dc662526-c62a-4f10-b86b-a9cba38f4032 req-f525aef0-990a-4ebb-abbf-32903ac5dbb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69a2418e-ab69-4e7b-a243-365951169370", "name": "network-vif-plugged", "status": "completed", "tag": "ad514aee-5d3c-42ae-986c-2e6beda339f2"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:32.845460 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 84/163] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:32 2022] GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370 => generated 1338 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:32.850313 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-23ed6bc7-b11a-4a45-86e6-9b04903f89cf tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] Action: 'update', calling method: .version_select at 0x7f608003c550>, body: {"quota_set": {"ram": 51200}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:32.858243 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-dc662526-c62a-4f10-b86b-a9cba38f4032 req-f525aef0-990a-4ebb-abbf-32903ac5dbb1 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:32.858702 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-dc662526-c62a-4f10-b86b-a9cba38f4032 req-f525aef0-990a-4ebb-abbf-32903ac5dbb1 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:32.887343 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-dc662526-c62a-4f10-b86b-a9cba38f4032 req-f525aef0-990a-4ebb-abbf-32903ac5dbb1 service nova] Creating event network-vif-plugged:ad514aee-5d3c-42ae-986c-2e6beda339f2 for instance 69a2418e-ab69-4e7b-a243-365951169370 on n-h1-master-1 Jun 20 11:56:32.893940 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-dc662526-c62a-4f10-b86b-a9cba38f4032 req-f525aef0-990a-4ebb-abbf-32903ac5dbb1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.246228 Jun 20 11:56:32.894842 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 80/164] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:33.174799 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23ed6bc7-b11a-4a45-86e6-9b04903f89cf tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:33.175628 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23ed6bc7-b11a-4a45-86e6-9b04903f89cf tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:33.177223 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23ed6bc7-b11a-4a45-86e6-9b04903f89cf tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:33.178370 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23ed6bc7-b11a-4a45-86e6-9b04903f89cf tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:33.255956 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-23ed6bc7-b11a-4a45-86e6-9b04903f89cf tempest-QuotasAdminNegativeTest-1844599805 tempest-QuotasAdminNegativeTest-1844599805-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/4bdbd48aa5df42418f750ae35bc2eb21" status: 200 len: 329 microversion: 2.1 time: 0.409271 Jun 20 11:56:33.263762 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 85/165] 10.222.0.27 () {60 vars in 1261 bytes} [Mon Jun 20 11:56:32 2022] PUT /compute/v2.1/os-quota-sets/4bdbd48aa5df42418f750ae35bc2eb21 => generated 329 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:33.270801 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9dc857f9-3f11-4104-995b-96111aeb5a75 tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Action: 'update', calling method: .version_select at 0x7f608028daf0>, body: {"quota_set": {"ram": 0}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:33.274383 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9dc857f9-3f11-4104-995b-96111aeb5a75 tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'f49c2eb9caa94cc789f862904b5dde77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbd48aa5df42418f750ae35bc2eb21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:33.276463 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9dc857f9-3f11-4104-995b-96111aeb5a75 tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Request method failure captured: Jun 20 11:56:33.276463 n-d-master-1 devstack@n-api.service[119127]: request: PUT /compute/v2.1/os-quota-sets/4bdbd48aa5df42418f750ae35bc2eb21 HTTP/1.1 Jun 20 11:56:33.276463 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:56:33.276463 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:56:33.276463 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:56:33.276463 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 25 Jun 20 11:56:33.276463 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:56:33.276463 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:56:33.276463 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:56:33.276463 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:33.276463 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGBpe-8mnXK4f4X9vkKFiN4Hg99YWHBVG9HIFL09ZEFNX4o-SXWwhnneePBj7JzAesKoH81EHjeXxWhQz2zyq4-bxM5Nxu5fbkx_RVbLd5dcwAxxewHXko9pOQg_UlgeBBUAvLOEL0abtvCF1AW9XAMIMbc3kHaS7Wx79MfrpZTwFmU Jun 20 11:56:33.276463 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:56:33.276463 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:56:33.276463 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:56:33.276463 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:56:33.276463 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:56:33.276463 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:56:33.276463 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 4bdbd48aa5df42418f750ae35bc2eb21 Jun 20 11:56:33.276463 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-QuotasAdminNegativeTest-2081924257 Jun 20 11:56:33.276463 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 11:56:33.276463 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 11:56:33.277647 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4bdbd48aa5df42418f750ae35bc2eb21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4bdbd48aa5df42418f750ae35bc2eb21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4bdbd48aa5df42418f750ae35bc2eb21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4bdbd48aa5df42418f750ae35bc2eb21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:33.277647 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-QuotasAdminNegativeTest-2081924257 Jun 20 11:56:33.277647 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 4bdbd48aa5df42418f750ae35bc2eb21 Jun 20 11:56:33.277647 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2081924257 Jun 20 11:56:33.277647 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-QuotasAdminNegativeTest-2081924257-project Jun 20 11:56:33.277647 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:56:33.277647 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:56:33.277647 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: f49c2eb9caa94cc789f862904b5dde77 Jun 20 11:56:33.277647 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-QuotasAdminNegativeTest-2081924257-project Jun 20 11:56:33.277647 n-d-master-1 devstack@n-api.service[119127]: Jun 20 11:56:33.277647 n-d-master-1 devstack@n-api.service[119127]: {"quota_set": {"ram": 0}} Jun 20 11:56:33.277647 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 11:56:33.277647 n-d-master-1 devstack@n-api.service[119127]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jun 20 11:56:33.277647 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '4bdbd48aa5df42418f750ae35bc2eb21', 'body': {'quota_set': {'ram': 0}}} Jun 20 11:56:33.278460 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:33.278460 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:33.278460 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:33.278460 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:33.278460 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:33.278460 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:33.278460 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 11:56:33.278460 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 11:56:33.278460 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:33.278460 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:33.278460 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:56:33.278460 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:56:33.278460 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Jun 20 11:56:33.278460 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Jun 20 11:56:33.278460 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 20 11:56:33.278460 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:56:33.278460 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 20 11:56:33.278460 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:56:33.278460 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Jun 20 11:56:33.279410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Jun 20 11:56:33.279410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 20 11:56:33.279410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 20 11:56:33.279410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 20 11:56:33.279410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 20 11:56:33.279410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 11:56:33.279410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 11:56:33.279410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 11:56:33.279410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 11:56:33.279410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 20 11:56:33.279410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 20 11:56:33.279410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 20 11:56:33.279410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 20 11:56:33.279410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 20 11:56:33.279410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 20 11:56:33.279410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jun 20 11:56:33.279410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:33.279410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:33.279410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:33.279410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:33.282314 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:33.282314 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:33.282314 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 20 11:56:33.282314 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 20 11:56:33.282314 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jun 20 11:56:33.282314 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:33.284626 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9dc857f9-3f11-4104-995b-96111aeb5a75 tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:33.286736 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9dc857f9-3f11-4104-995b-96111aeb5a75 tempest-QuotasAdminNegativeTest-2081924257 tempest-QuotasAdminNegativeTest-2081924257-project] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/4bdbd48aa5df42418f750ae35bc2eb21" status: 403 len: 116 microversion: 2.1 time: 0.022034 Jun 20 11:56:33.287969 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 81/166] 10.222.0.27 () {60 vars in 1261 bytes} [Mon Jun 20 11:56:33 2022] PUT /compute/v2.1/os-quota-sets/4bdbd48aa5df42418f750ae35bc2eb21 => generated 116 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:56:33.648584 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-382e2ff2-c85d-4edc-ac78-7befde8943da tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:33.649487 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-382e2ff2-c85d-4edc-ac78-7befde8943da tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f75be1cf-4d20-4ea9-bcbb-b407892a39ee] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:33.656121 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-382e2ff2-c85d-4edc-ac78-7befde8943da tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:33.656947 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-382e2ff2-c85d-4edc-ac78-7befde8943da tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:33.657716 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-382e2ff2-c85d-4edc-ac78-7befde8943da tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:33.658147 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-382e2ff2-c85d-4edc-ac78-7befde8943da tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:33.682830 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:56:33.853063 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2347d738-9bbe-4d2d-bdb5-8298d53b6324 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:33.853814 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2347d738-9bbe-4d2d-bdb5-8298d53b6324 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] [instance: 69a2418e-ab69-4e7b-a243-365951169370] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:33.857955 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:56:33.873548 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2347d738-9bbe-4d2d-bdb5-8298d53b6324 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:33.874365 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2347d738-9bbe-4d2d-bdb5-8298d53b6324 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:33.876192 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2347d738-9bbe-4d2d-bdb5-8298d53b6324 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:33.876946 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2347d738-9bbe-4d2d-bdb5-8298d53b6324 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:34.068682 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2347d738-9bbe-4d2d-bdb5-8298d53b6324 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93cf53cbece54a978bdab523d015313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671077727e44ef8ba72fe3ffdfa15eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:34.073737 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-382e2ff2-c85d-4edc-ac78-7befde8943da tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:34.084170 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-382e2ff2-c85d-4edc-ac78-7befde8943da tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee" status: 200 len: 1318 microversion: 2.1 time: 0.439292 Jun 20 11:56:34.087857 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2347d738-9bbe-4d2d-bdb5-8298d53b6324 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] 10.222.0.27 "GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370" status: 200 len: 1338 microversion: 2.1 time: 0.239034 Jun 20 11:56:34.088786 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 82/167] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:33 2022] GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370 => generated 1338 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:56:34.100638 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 86/168] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:33 2022] GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee => generated 1318 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:56:34.406889 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-85af13e9-e53c-4e1f-b131-6b8401df4cea tempest-InstanceUsageAuditLogTestJSON-745549356 tempest-InstanceUsageAuditLogTestJSON-745549356-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:34.407834 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:34.407834 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:34.432554 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-85af13e9-e53c-4e1f-b131-6b8401df4cea tempest-InstanceUsageAuditLogTestJSON-745549356 tempest-InstanceUsageAuditLogTestJSON-745549356-project-admin] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log/2022-06-20 11:56:34" status: 200 len: 318 microversion: 2.1 time: 0.281858 Jun 20 11:56:34.433512 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 87/169] 10.222.0.27 () {58 vars in 1250 bytes} [Mon Jun 20 11:56:34 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-06-20%2011%3A56%3A34 => generated 318 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:34.447827 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a9eb0aa2-d649-44b6-baa8-1d9ba4ec3629 tempest-InstanceUsageAuditLogTestJSON-745549356 tempest-InstanceUsageAuditLogTestJSON-745549356-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:34.449445 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:34.449445 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:34.482953 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a9eb0aa2-d649-44b6-baa8-1d9ba4ec3629 tempest-InstanceUsageAuditLogTestJSON-745549356 tempest-InstanceUsageAuditLogTestJSON-745549356-project-admin] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.039925 Jun 20 11:56:34.483995 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 83/170] 10.222.0.27 () {58 vars in 1184 bytes} [Mon Jun 20 11:56:34 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:35.111682 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-57f3b141-18ed-4942-aa16-b1c1be39803a tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:35.113656 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ad947815-e391-432f-bff3-f060a7d96e83 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:35.115279 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ad947815-e391-432f-bff3-f060a7d96e83 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] [instance: 69a2418e-ab69-4e7b-a243-365951169370] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:35.119295 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-57f3b141-18ed-4942-aa16-b1c1be39803a tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f75be1cf-4d20-4ea9-bcbb-b407892a39ee] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:35.129694 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ad947815-e391-432f-bff3-f060a7d96e83 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:35.131769 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57f3b141-18ed-4942-aa16-b1c1be39803a tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:35.132445 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ad947815-e391-432f-bff3-f060a7d96e83 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:35.133371 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ad947815-e391-432f-bff3-f060a7d96e83 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:35.133952 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57f3b141-18ed-4942-aa16-b1c1be39803a tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:35.134879 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57f3b141-18ed-4942-aa16-b1c1be39803a tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:35.135483 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ad947815-e391-432f-bff3-f060a7d96e83 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:35.136075 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57f3b141-18ed-4942-aa16-b1c1be39803a tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:35.388459 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-57f3b141-18ed-4942-aa16-b1c1be39803a tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:35.401180 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-57f3b141-18ed-4942-aa16-b1c1be39803a tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee" status: 200 len: 1318 microversion: 2.1 time: 0.296930 Jun 20 11:56:35.405342 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 84/171] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:35 2022] GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee => generated 1318 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:35.455784 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ad947815-e391-432f-bff3-f060a7d96e83 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93cf53cbece54a978bdab523d015313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671077727e44ef8ba72fe3ffdfa15eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:35.463608 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ad947815-e391-432f-bff3-f060a7d96e83 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] 10.222.0.27 "GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370" status: 200 len: 1486 microversion: 2.1 time: 0.360555 Jun 20 11:56:35.478838 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 88/172] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:35 2022] GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370 => generated 1486 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:35.489063 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7c99e86a-c0ae-491a-a1b4-3f282689b7a7 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:35.489515 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7c99e86a-c0ae-491a-a1b4-3f282689b7a7 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] [instance: 69a2418e-ab69-4e7b-a243-365951169370] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:35.495544 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c99e86a-c0ae-491a-a1b4-3f282689b7a7 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:35.495985 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c99e86a-c0ae-491a-a1b4-3f282689b7a7 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:35.497347 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c99e86a-c0ae-491a-a1b4-3f282689b7a7 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:35.498000 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c99e86a-c0ae-491a-a1b4-3f282689b7a7 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:35.896443 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7c99e86a-c0ae-491a-a1b4-3f282689b7a7 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370" status: 200 len: 1637 microversion: 2.1 time: 0.411808 Jun 20 11:56:35.900545 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 85/173] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:35 2022] GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370 => generated 1637 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:35.912653 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3c7242b8-0180-4dfb-a0ca-6872110ed3c6 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:35.913142 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3c7242b8-0180-4dfb-a0ca-6872110ed3c6 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] [instance: 69a2418e-ab69-4e7b-a243-365951169370] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:35.920121 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3c7242b8-0180-4dfb-a0ca-6872110ed3c6 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:35.920589 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3c7242b8-0180-4dfb-a0ca-6872110ed3c6 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:35.921538 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3c7242b8-0180-4dfb-a0ca-6872110ed3c6 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:35.922427 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3c7242b8-0180-4dfb-a0ca-6872110ed3c6 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:35.955047 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3c7242b8-0180-4dfb-a0ca-6872110ed3c6 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] [instance: 69a2418e-ab69-4e7b-a243-365951169370] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 11:56:36.111015 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3c7242b8-0180-4dfb-a0ca-6872110ed3c6 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] 10.222.0.27 "DELETE /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370" status: 204 len: 0 microversion: 2.1 time: 0.201223 Jun 20 11:56:36.120391 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a3418825-8bf1-4176-a48b-30e08341548b tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:36.121175 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a3418825-8bf1-4176-a48b-30e08341548b tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] [instance: 69a2418e-ab69-4e7b-a243-365951169370] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:36.127074 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 89/174] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 11:56:35 2022] DELETE /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:56:36.129557 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a3418825-8bf1-4176-a48b-30e08341548b tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:36.130373 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a3418825-8bf1-4176-a48b-30e08341548b tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:36.131370 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a3418825-8bf1-4176-a48b-30e08341548b tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:36.132227 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a3418825-8bf1-4176-a48b-30e08341548b tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:36.369493 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a3418825-8bf1-4176-a48b-30e08341548b tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93cf53cbece54a978bdab523d015313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671077727e44ef8ba72fe3ffdfa15eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:36.378049 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a3418825-8bf1-4176-a48b-30e08341548b tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] 10.222.0.27 "GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370" status: 200 len: 1492 microversion: 2.1 time: 0.261795 Jun 20 11:56:36.379275 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 86/175] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:36 2022] GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370 => generated 1492 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:36.572444 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-22b4b699-2664-482c-b0ee-af505db10daf tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:36.572444 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-22b4b699-2664-482c-b0ee-af505db10daf tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f75be1cf-4d20-4ea9-bcbb-b407892a39ee] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:36.572444 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22b4b699-2664-482c-b0ee-af505db10daf tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:36.572444 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22b4b699-2664-482c-b0ee-af505db10daf tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:36.573872 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22b4b699-2664-482c-b0ee-af505db10daf tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:36.573872 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22b4b699-2664-482c-b0ee-af505db10daf tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:36.596703 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-22b4b699-2664-482c-b0ee-af505db10daf tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:36.611014 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-22b4b699-2664-482c-b0ee-af505db10daf tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee" status: 200 len: 1318 microversion: 2.1 time: 0.191425 Jun 20 11:56:36.620605 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 90/176] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:36 2022] GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:37.397025 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-af2f3b11-8770-4748-bdb7-8a2023b33b78 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:37.397737 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-af2f3b11-8770-4748-bdb7-8a2023b33b78 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] [instance: 69a2418e-ab69-4e7b-a243-365951169370] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:37.404044 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-af2f3b11-8770-4748-bdb7-8a2023b33b78 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:37.404512 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-af2f3b11-8770-4748-bdb7-8a2023b33b78 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:37.405276 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-af2f3b11-8770-4748-bdb7-8a2023b33b78 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:37.405700 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-af2f3b11-8770-4748-bdb7-8a2023b33b78 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:37.549911 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-af2f3b11-8770-4748-bdb7-8a2023b33b78 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93cf53cbece54a978bdab523d015313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671077727e44ef8ba72fe3ffdfa15eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:37.557371 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-af2f3b11-8770-4748-bdb7-8a2023b33b78 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] 10.222.0.27 "GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370" status: 200 len: 1492 microversion: 2.1 time: 0.164854 Jun 20 11:56:37.557945 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 87/177] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:37 2022] GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370 => generated 1492 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:37.636852 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-928d581b-b2ea-45cc-9609-955a33028e72 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:37.637499 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-928d581b-b2ea-45cc-9609-955a33028e72 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f75be1cf-4d20-4ea9-bcbb-b407892a39ee] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:37.645707 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-928d581b-b2ea-45cc-9609-955a33028e72 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:37.646295 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-928d581b-b2ea-45cc-9609-955a33028e72 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:37.647923 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-928d581b-b2ea-45cc-9609-955a33028e72 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:37.648902 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-928d581b-b2ea-45cc-9609-955a33028e72 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:37.990499 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-928d581b-b2ea-45cc-9609-955a33028e72 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:38.002667 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-928d581b-b2ea-45cc-9609-955a33028e72 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee" status: 200 len: 1318 microversion: 2.1 time: 0.377935 Jun 20 11:56:38.003968 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 91/178] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:37 2022] GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee => generated 1318 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:38.244275 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-95a1c4f1-651e-4641-bdfd-6059daf4122f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1727378881", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:38.369364 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-95a1c4f1-651e-4641-bdfd-6059daf4122f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] validate_networks() for None {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:56:38.396262 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0116b5b9-6a4f-4b9c-ae0b-7f90d9c6ddf3 tempest-SecurityGroupsTestAdminJSON-1384445310 tempest-SecurityGroupsTestAdminJSON-1384445310-project] Action: 'create', calling method: .version_select at 0x7f608004b430>, body: {"security_group": {"name": "tempest-securitygroup-725969827", "description": "tempest-description-1111841075"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:38.625575 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-95a1c4f1-651e-4641-bdfd-6059daf4122f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:56:38.626106 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-95a1c4f1-651e-4641-bdfd-6059daf4122f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:56:38.626940 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-95a1c4f1-651e-4641-bdfd-6059daf4122f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:56:38.627339 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-95a1c4f1-651e-4641-bdfd-6059daf4122f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:56:38.627747 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-95a1c4f1-651e-4641-bdfd-6059daf4122f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:56:38.637680 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-95a1c4f1-651e-4641-bdfd-6059daf4122f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:38.638122 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-95a1c4f1-651e-4641-bdfd-6059daf4122f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:38.638903 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-95a1c4f1-651e-4641-bdfd-6059daf4122f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:38.639339 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-95a1c4f1-651e-4641-bdfd-6059daf4122f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:38.648322 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=13 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:56:38.661157 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-95a1c4f1-651e-4641-bdfd-6059daf4122f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Getting quotas for project a6150795e7424cca91c71531840d88be. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:56:38.667011 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-95a1c4f1-651e-4641-bdfd-6059daf4122f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Getting quotas for user 1297c1b206f845bcaf936313fd7eed9b and project a6150795e7424cca91c71531840d88be. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:56:38.679972 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-95a1c4f1-651e-4641-bdfd-6059daf4122f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:56:38.682481 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-95a1c4f1-651e-4641-bdfd-6059daf4122f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: c5afa776-6f61-4b7a-b586-c5047b5fbe5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:56:38.730149 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-95a1c4f1-651e-4641-bdfd-6059daf4122f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.830405 Jun 20 11:56:38.731161 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 88/179] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:56:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 11:56:38.740554 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-3be0ec4e-75c1-4f34-89f2-706114a098ee req-f56c9a9e-b9f0-43d5-a00d-db7b7641d597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69a2418e-ab69-4e7b-a243-365951169370", "name": "network-vif-deleted", "tag": "ad514aee-5d3c-42ae-986c-2e6beda339f2"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:38.750699 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-3be0ec4e-75c1-4f34-89f2-706114a098ee req-f56c9a9e-b9f0-43d5-a00d-db7b7641d597 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:38.751175 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-3be0ec4e-75c1-4f34-89f2-706114a098ee req-f56c9a9e-b9f0-43d5-a00d-db7b7641d597 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:38.764020 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-3be0ec4e-75c1-4f34-89f2-706114a098ee req-f56c9a9e-b9f0-43d5-a00d-db7b7641d597 service nova] Creating event network-vif-deleted:ad514aee-5d3c-42ae-986c-2e6beda339f2 for instance 69a2418e-ab69-4e7b-a243-365951169370 on n-h1-master-1 Jun 20 11:56:38.770242 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-3be0ec4e-75c1-4f34-89f2-706114a098ee req-f56c9a9e-b9f0-43d5-a00d-db7b7641d597 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037781 Jun 20 11:56:38.771197 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 89/180] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:38.811035 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a98013f6-d2e2-43e4-bec7-22858fe92eec tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:38.811746 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a98013f6-d2e2-43e4-bec7-22858fe92eec tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] [instance: 69a2418e-ab69-4e7b-a243-365951169370] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:38.828613 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a98013f6-d2e2-43e4-bec7-22858fe92eec tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:38.829071 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a98013f6-d2e2-43e4-bec7-22858fe92eec tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:38.830180 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a98013f6-d2e2-43e4-bec7-22858fe92eec tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:38.830791 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a98013f6-d2e2-43e4-bec7-22858fe92eec tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:38.867937 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a98013f6-d2e2-43e4-bec7-22858fe92eec tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:38.868946 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a98013f6-d2e2-43e4-bec7-22858fe92eec tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:38.869636 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-a98013f6-d2e2-43e4-bec7-22858fe92eec tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lazy-loading 'fault' on Instance uuid 69a2418e-ab69-4e7b-a243-365951169370 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:56:38.964321 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a98013f6-d2e2-43e4-bec7-22858fe92eec tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93cf53cbece54a978bdab523d015313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671077727e44ef8ba72fe3ffdfa15eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:38.974642 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a98013f6-d2e2-43e4-bec7-22858fe92eec tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] 10.222.0.27 "GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370" status: 200 len: 1328 microversion: 2.1 time: 0.201862 Jun 20 11:56:38.976613 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 90/181] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:38 2022] GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370 => generated 1328 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:38.990969 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-19168dd5-9466-452c-8404-3ece1d686bbe tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:38.991588 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-19168dd5-9466-452c-8404-3ece1d686bbe tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: c5afa776-6f61-4b7a-b586-c5047b5fbe5e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:39.041276 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0116b5b9-6a4f-4b9c-ae0b-7f90d9c6ddf3 tempest-SecurityGroupsTestAdminJSON-1384445310 tempest-SecurityGroupsTestAdminJSON-1384445310-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.852995 Jun 20 11:56:39.054277 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 92/182] 10.222.0.27 () {60 vars in 1179 bytes} [Mon Jun 20 11:56:38 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:39.064421 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-05e50598-5f0d-402c-82f6-4eb8268a4e13 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:39.065816 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-05e50598-5f0d-402c-82f6-4eb8268a4e13 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f75be1cf-4d20-4ea9-bcbb-b407892a39ee] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:39.075044 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05e50598-5f0d-402c-82f6-4eb8268a4e13 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:39.075795 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05e50598-5f0d-402c-82f6-4eb8268a4e13 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:39.076859 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05e50598-5f0d-402c-82f6-4eb8268a4e13 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:39.079605 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05e50598-5f0d-402c-82f6-4eb8268a4e13 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:39.085291 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-19168dd5-9466-452c-8404-3ece1d686bbe tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:39.095783 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-19168dd5-9466-452c-8404-3ece1d686bbe tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/c5afa776-6f61-4b7a-b586-c5047b5fbe5e" status: 200 len: 1217 microversion: 2.1 time: 0.117641 Jun 20 11:56:39.098193 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 91/183] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:38 2022] GET /compute/v2.1/servers/c5afa776-6f61-4b7a-b586-c5047b5fbe5e => generated 1217 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:39.110008 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-82e38438-6cfd-427b-8b3f-820c6b3f497d tempest-SecurityGroupsTestAdminJSON-1384445310 tempest-SecurityGroupsTestAdminJSON-1384445310-project] Action: 'create', calling method: .version_select at 0x7f6080c80ca0>, body: {"security_group": {"name": "tempest-securitygroup-615677360", "description": "tempest-description-1713190941"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:39.513190 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-05e50598-5f0d-402c-82f6-4eb8268a4e13 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:39.526254 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-05e50598-5f0d-402c-82f6-4eb8268a4e13 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee" status: 200 len: 1318 microversion: 2.1 time: 0.476073 Jun 20 11:56:39.527756 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 93/184] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:39 2022] GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee => generated 1318 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:39.578542 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-82e38438-6cfd-427b-8b3f-820c6b3f497d tempest-SecurityGroupsTestAdminJSON-1384445310 tempest-SecurityGroupsTestAdminJSON-1384445310-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.478812 Jun 20 11:56:39.585071 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 92/185] 10.222.0.27 () {60 vars in 1179 bytes} [Mon Jun 20 11:56:39 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:39.662720 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-74426601-7b88-409b-bb53-b6ad69ad7ddb tempest-SecurityGroupsTestAdminJSON-639651349 tempest-SecurityGroupsTestAdminJSON-639651349-project-admin] Action: 'create', calling method: .version_select at 0x7f6073f44160>, body: {"security_group": {"name": "tempest-securitygroup-405283364", "description": "tempest-description-1765820830"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:39.992444 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-be2e5de5-3e60-4af6-bf0e-a0627e11be9b tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:39.993072 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-be2e5de5-3e60-4af6-bf0e-a0627e11be9b tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] [instance: 69a2418e-ab69-4e7b-a243-365951169370] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:40.013517 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-be2e5de5-3e60-4af6-bf0e-a0627e11be9b tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:40.013878 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-be2e5de5-3e60-4af6-bf0e-a0627e11be9b tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:40.014853 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-be2e5de5-3e60-4af6-bf0e-a0627e11be9b tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:40.015503 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-be2e5de5-3e60-4af6-bf0e-a0627e11be9b tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:40.031981 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-be2e5de5-3e60-4af6-bf0e-a0627e11be9b tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] HTTP exception thrown: Instance 69a2418e-ab69-4e7b-a243-365951169370 could not be found. Jun 20 11:56:40.035158 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-be2e5de5-3e60-4af6-bf0e-a0627e11be9b tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Request method failure captured: Jun 20 11:56:40.035158 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370 HTTP/1.1 Jun 20 11:56:40.035158 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:56:40.035158 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:56:40.035158 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:56:40.035158 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 11:56:40.035158 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:56:40.035158 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:56:40.035158 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:56:40.035158 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:40.035158 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGBVlNA1dQYh3tJPd2oEZb_DLj2c5lYzrHOLqgIZzf-nAfxST3TnT6kQfIbYPOCYMi_QcZh5bKYPhxLocp6V81eXEKr4y3jjlkkozMKg2iKSGpSrlL-Tt5DDAGCnXXp9l-3ExJohKjnqW2yJo75lgQbdasTVwgEOC-NAFRjfZ_PxmJ0 Jun 20 11:56:40.035158 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:56:40.035158 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:56:40.035158 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:56:40.035158 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:56:40.035158 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:56:40.035158 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:56:40.035158 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: c671077727e44ef8ba72fe3ffdfa15eb Jun 20 11:56:40.035158 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-AggregatesAdminTestJSON-1880636502 Jun 20 11:56:40.035158 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 11:56:40.035158 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 11:56:40.036583 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c671077727e44ef8ba72fe3ffdfa15eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c671077727e44ef8ba72fe3ffdfa15eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c671077727e44ef8ba72fe3ffdfa15eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c671077727e44ef8ba72fe3ffdfa15eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:40.036583 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-AggregatesAdminTestJSON-1880636502 Jun 20 11:56:40.036583 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: c671077727e44ef8ba72fe3ffdfa15eb Jun 20 11:56:40.036583 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1880636502 Jun 20 11:56:40.036583 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-AggregatesAdminTestJSON-1880636502-project Jun 20 11:56:40.036583 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:56:40.036583 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:56:40.036583 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 93cf53cbece54a978bdab523d015313d Jun 20 11:56:40.036583 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-AggregatesAdminTestJSON-1880636502-project Jun 20 11:56:40.036583 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 11:56:40.036583 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 69a2418e-ab69-4e7b-a243-365951169370 could not be found. Jun 20 11:56:40.036583 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '69a2418e-ab69-4e7b-a243-365951169370'} Jun 20 11:56:40.037248 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:40.037248 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:40.037248 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:56:40.037248 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:56:40.037248 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:56:40.037248 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:56:40.037248 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:56:40.037248 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:56:40.037248 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:56:40.037248 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:56:40.037248 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69a2418e-ab69-4e7b-a243-365951169370 could not be found. Jun 20 11:56:40.037248 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:40.037248 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:40.037248 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:40.037248 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:40.037248 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:40.037248 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:40.037248 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:40.037248 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:40.037248 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:40.038772 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:40.038772 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:56:40.038772 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:56:40.038772 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:56:40.038772 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:56:40.038772 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:56:40.038772 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:56:40.038772 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69a2418e-ab69-4e7b-a243-365951169370 could not be found. Jun 20 11:56:40.038772 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:40.038772 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:40.038772 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:40.038772 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:40.038772 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:40.038772 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:40.038772 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:56:40.038772 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:56:40.038772 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69a2418e-ab69-4e7b-a243-365951169370 could not be found. Jun 20 11:56:40.038772 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:40.040797 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-be2e5de5-3e60-4af6-bf0e-a0627e11be9b tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Returning 404 to user: Instance 69a2418e-ab69-4e7b-a243-365951169370 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:40.052847 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-be2e5de5-3e60-4af6-bf0e-a0627e11be9b tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] 10.222.0.27 "GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370" status: 404 len: 111 microversion: 2.1 time: 0.064063 Jun 20 11:56:40.054438 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 93/186] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:39 2022] GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:56:40.065989 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fd03a8fb-4f91-4cc2-b203-a6a393110039 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:40.067691 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:40.067691 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:40.116921 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fd03a8fb-4f91-4cc2-b203-a6a393110039 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:40.117785 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fd03a8fb-4f91-4cc2-b203-a6a393110039 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:40.611695 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-74426601-7b88-409b-bb53-b6ad69ad7ddb tempest-SecurityGroupsTestAdminJSON-639651349 tempest-SecurityGroupsTestAdminJSON-639651349-project-admin] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.025111 Jun 20 11:56:40.613358 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 94/187] 10.222.0.27 () {60 vars in 1179 bytes} [Mon Jun 20 11:56:39 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:40.620269 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fbbec7ca-3173-4548-99c2-d00b0484eb88 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:40.623136 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fbbec7ca-3173-4548-99c2-d00b0484eb88 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: c5afa776-6f61-4b7a-b586-c5047b5fbe5e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:40.645453 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fbbec7ca-3173-4548-99c2-d00b0484eb88 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:40.646224 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fbbec7ca-3173-4548-99c2-d00b0484eb88 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:40.647716 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fbbec7ca-3173-4548-99c2-d00b0484eb88 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:40.648517 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fbbec7ca-3173-4548-99c2-d00b0484eb88 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:40.704179 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fd03a8fb-4f91-4cc2-b203-a6a393110039 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.1 time: 0.642812 Jun 20 11:56:40.704858 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 94/188] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Jun 20 11:56:40 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 11:56:40.779513 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fbbec7ca-3173-4548-99c2-d00b0484eb88 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:40.790163 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fbbec7ca-3173-4548-99c2-d00b0484eb88 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/c5afa776-6f61-4b7a-b586-c5047b5fbe5e" status: 200 len: 1296 microversion: 2.1 time: 0.175362 Jun 20 11:56:40.799550 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 95/189] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:40 2022] GET /compute/v2.1/servers/c5afa776-6f61-4b7a-b586-c5047b5fbe5e => generated 1296 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:40.805288 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-59928ce1-3c0f-4d16-85eb-593b0e912917 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:40.808966 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-59928ce1-3c0f-4d16-85eb-593b0e912917 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f75be1cf-4d20-4ea9-bcbb-b407892a39ee] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:40.820671 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-667390b4-1131-419b-89f7-4a956b666d6c req-2eb753ae-7c2b-4373-874b-97eac528834b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f75be1cf-4d20-4ea9-bcbb-b407892a39ee", "tag": "c3bed4a9-e3ea-430b-925d-8d2500a2726f"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:40.824673 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-59928ce1-3c0f-4d16-85eb-593b0e912917 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:40.825581 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-59928ce1-3c0f-4d16-85eb-593b0e912917 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:40.826284 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-59928ce1-3c0f-4d16-85eb-593b0e912917 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:40.828549 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-59928ce1-3c0f-4d16-85eb-593b0e912917 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:40.835041 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-667390b4-1131-419b-89f7-4a956b666d6c req-2eb753ae-7c2b-4373-874b-97eac528834b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:40.835600 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-667390b4-1131-419b-89f7-4a956b666d6c req-2eb753ae-7c2b-4373-874b-97eac528834b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:40.853548 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-667390b4-1131-419b-89f7-4a956b666d6c req-2eb753ae-7c2b-4373-874b-97eac528834b service nova] Creating event network-changed:c3bed4a9-e3ea-430b-925d-8d2500a2726f for instance f75be1cf-4d20-4ea9-bcbb-b407892a39ee on n-h2-master-1 Jun 20 11:56:40.859579 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-667390b4-1131-419b-89f7-4a956b666d6c req-2eb753ae-7c2b-4373-874b-97eac528834b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151158 Jun 20 11:56:40.861006 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 95/190] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:40.867221 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3042ee10-c978-4241-84e7-a5a7f79a2dfe tempest-SecurityGroupsTestAdminJSON-639651349 tempest-SecurityGroupsTestAdminJSON-639651349-project-admin] Action: 'create', calling method: .version_select at 0x7f60801b01f0>, body: {"security_group": {"name": "tempest-securitygroup-1215371014", "description": "tempest-description-1113428766"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:41.163571 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-59928ce1-3c0f-4d16-85eb-593b0e912917 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:41.179703 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-59928ce1-3c0f-4d16-85eb-593b0e912917 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee" status: 200 len: 1318 microversion: 2.1 time: 0.378940 Jun 20 11:56:41.180751 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 96/191] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:40 2022] GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee => generated 1318 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:41.189589 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-03df56da-6052-4177-b51a-228540bce55a tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:41.191232 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:41.191232 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:41.225370 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-03df56da-6052-4177-b51a-228540bce55a tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.043191 Jun 20 11:56:41.226432 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 97/192] 10.222.0.27 () {58 vars in 1151 bytes} [Mon Jun 20 11:56:41 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 20 11:56:41.256387 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-679235ad-e1e6-450e-8f22-58a41533cca5 tempest-AggregatesAdminTestV241-712732138 tempest-AggregatesAdminTestV241-712732138-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-526309633"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:41.257721 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:41.257721 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:41.258852 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.aggregate [None req-679235ad-e1e6-450e-8f22-58a41533cca5 tempest-AggregatesAdminTestV241-712732138 tempest-AggregatesAdminTestV241-712732138-project-admin] Generated uuid 81387a6f-0e6d-4a76-a9e7-5d5d96b465ba for aggregate {{(pid=119128) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 20 11:56:41.259340 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3042ee10-c978-4241-84e7-a5a7f79a2dfe tempest-SecurityGroupsTestAdminJSON-639651349 tempest-SecurityGroupsTestAdminJSON-639651349-project-admin] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.396749 Jun 20 11:56:41.259926 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 96/193] 10.222.0.27 () {60 vars in 1179 bytes} [Mon Jun 20 11:56:40 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:41.271827 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-35611d8d-ab3f-4e29-93e0-924433face30 tempest-SecurityGroupsTestAdminJSON-639651349 tempest-SecurityGroupsTestAdminJSON-639651349-project-admin] Calling method '.version_select at 0x7f60802a4b80>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:41.293392 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-679235ad-e1e6-450e-8f22-58a41533cca5 tempest-AggregatesAdminTestV241-712732138 tempest-AggregatesAdminTestV241-712732138-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.047060 Jun 20 11:56:41.294537 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 98/194] 10.222.0.27 () {62 vars in 1204 bytes} [Mon Jun 20 11:56:41 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:56:41.307429 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ba58907e-a808-466c-9cdc-8c6fdde15747 tempest-AggregatesAdminTestV241-712732138 tempest-AggregatesAdminTestV241-712732138-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-342102565"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:41.637925 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:41.637925 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:41.642145 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:56:41.684733 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ba58907e-a808-466c-9cdc-8c6fdde15747 tempest-AggregatesAdminTestV241-712732138 tempest-AggregatesAdminTestV241-712732138-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-aggregates/2" status: 200 len: 298 microversion: 2.41 time: 0.383015 Jun 20 11:56:41.692646 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 99/195] 10.222.0.27 () {62 vars in 1209 bytes} [Mon Jun 20 11:56:41 2022] PUT /compute/v2.1/os-aggregates/2 => generated 298 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 11:56:41.698372 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-55061e8f-edea-4034-99a8-104ed9a64107 tempest-AggregatesAdminTestV241-712732138 tempest-AggregatesAdminTestV241-712732138-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:41.699442 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:41.699442 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:41.708537 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-55061e8f-edea-4034-99a8-104ed9a64107 tempest-AggregatesAdminTestV241-712732138 tempest-AggregatesAdminTestV241-712732138-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 298 microversion: 2.41 time: 0.014171 Jun 20 11:56:41.715815 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 100/196] 10.222.0.27 () {60 vars in 1189 bytes} [Mon Jun 20 11:56:41 2022] GET /compute/v2.1/os-aggregates/2 => generated 298 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:56:41.729149 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-05ac5beb-0ea9-46d0-86e2-6a3ca670551e tempest-AggregatesAdminTestV241-712732138 tempest-AggregatesAdminTestV241-712732138-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:41.731190 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:41.731190 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:41.741912 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05ac5beb-0ea9-46d0-86e2-6a3ca670551e tempest-AggregatesAdminTestV241-712732138 tempest-AggregatesAdminTestV241-712732138-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:41.742839 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05ac5beb-0ea9-46d0-86e2-6a3ca670551e tempest-AggregatesAdminTestV241-712732138 tempest-AggregatesAdminTestV241-712732138-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:41.890614 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-05ac5beb-0ea9-46d0-86e2-6a3ca670551e tempest-AggregatesAdminTestV241-712732138 tempest-AggregatesAdminTestV241-712732138-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 313 microversion: 2.41 time: 0.172916 Jun 20 11:56:41.891499 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 101/197] 10.222.0.27 () {62 vars in 1231 bytes} [Mon Jun 20 11:56:41 2022] POST /compute/v2.1/os-aggregates/2/action => generated 313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:56:41.897095 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-585b0e23-f472-4d5e-b684-7bc799f23a3c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:41.898018 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-585b0e23-f472-4d5e-b684-7bc799f23a3c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: c5afa776-6f61-4b7a-b586-c5047b5fbe5e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:41.905681 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-585b0e23-f472-4d5e-b684-7bc799f23a3c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:41.906344 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-585b0e23-f472-4d5e-b684-7bc799f23a3c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:41.907453 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-585b0e23-f472-4d5e-b684-7bc799f23a3c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:41.908025 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-585b0e23-f472-4d5e-b684-7bc799f23a3c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:42.048589 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-585b0e23-f472-4d5e-b684-7bc799f23a3c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:42.063862 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-585b0e23-f472-4d5e-b684-7bc799f23a3c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/c5afa776-6f61-4b7a-b586-c5047b5fbe5e" status: 200 len: 1275 microversion: 2.1 time: 0.170836 Jun 20 11:56:42.064890 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 102/198] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:41 2022] GET /compute/v2.1/servers/c5afa776-6f61-4b7a-b586-c5047b5fbe5e => generated 1275 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:42.070651 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-297c4ab5-177f-49a7-a4c2-522fcbbb9ccf tempest-AggregatesAdminTestV241-712732138 tempest-AggregatesAdminTestV241-712732138-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:42.072116 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:42.072116 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:42.082175 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-297c4ab5-177f-49a7-a4c2-522fcbbb9ccf tempest-AggregatesAdminTestV241-712732138 tempest-AggregatesAdminTestV241-712732138-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:42.086958 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-297c4ab5-177f-49a7-a4c2-522fcbbb9ccf tempest-AggregatesAdminTestV241-712732138 tempest-AggregatesAdminTestV241-712732138-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:42.260933 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-297c4ab5-177f-49a7-a4c2-522fcbbb9ccf tempest-AggregatesAdminTestV241-712732138 tempest-AggregatesAdminTestV241-712732138-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 298 microversion: 2.41 time: 0.193521 Jun 20 11:56:42.262001 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 103/199] 10.222.0.27 () {62 vars in 1231 bytes} [Mon Jun 20 11:56:42 2022] POST /compute/v2.1/os-aggregates/2/action => generated 298 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:56:42.269094 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dcb502b1-63b7-4f8f-b995-802e7441d03e tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:42.270272 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-dcb502b1-63b7-4f8f-b995-802e7441d03e tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f75be1cf-4d20-4ea9-bcbb-b407892a39ee] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:42.283494 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dcb502b1-63b7-4f8f-b995-802e7441d03e tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:42.284179 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dcb502b1-63b7-4f8f-b995-802e7441d03e tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:42.285201 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dcb502b1-63b7-4f8f-b995-802e7441d03e tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:42.285785 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dcb502b1-63b7-4f8f-b995-802e7441d03e tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:42.683162 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-dcb502b1-63b7-4f8f-b995-802e7441d03e tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:42.698921 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dcb502b1-63b7-4f8f-b995-802e7441d03e tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee" status: 200 len: 1318 microversion: 2.1 time: 0.429443 Jun 20 11:56:42.700288 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 104/200] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:42 2022] GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee => generated 1318 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:42.713755 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1f05cfd8-3a83-4221-be2b-73ee7d8a22e3 tempest-AggregatesAdminTestV241-712732138 tempest-AggregatesAdminTestV241-712732138-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:42.715137 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:42.715137 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:42.761508 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1f05cfd8-3a83-4221-be2b-73ee7d8a22e3 tempest-AggregatesAdminTestV241-712732138 tempest-AggregatesAdminTestV241-712732138-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.41 time: 0.059920 Jun 20 11:56:42.762453 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 105/201] 10.222.0.27 () {60 vars in 1192 bytes} [Mon Jun 20 11:56:42 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:42.779686 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fe578903-132e-48c4-bd1c-a5c8230698e1 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] Calling method '.version_select at 0x7f60825f95e0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:42.781586 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:42.781586 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:42.783206 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe578903-132e-48c4-bd1c-a5c8230698e1 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:42.783993 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe578903-132e-48c4-bd1c-a5c8230698e1 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:42.785051 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe578903-132e-48c4-bd1c-a5c8230698e1 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:42.786147 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe578903-132e-48c4-bd1c-a5c8230698e1 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:42.821335 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fe578903-132e-48c4-bd1c-a5c8230698e1 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.046328 Jun 20 11:56:42.827663 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 106/202] 10.222.0.27 () {58 vars in 1127 bytes} [Mon Jun 20 11:56:42 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:42.833462 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cc540eff-7ced-43d0-bfd4-4a1815328219 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] Calling method '.version_select at 0x7f6073fd8670>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:42.834980 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:42.834980 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:42.836449 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cc540eff-7ced-43d0-bfd4-4a1815328219 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:42.837231 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cc540eff-7ced-43d0-bfd4-4a1815328219 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:42.838361 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cc540eff-7ced-43d0-bfd4-4a1815328219 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:42.838951 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cc540eff-7ced-43d0-bfd4-4a1815328219 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:42.874192 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cc540eff-7ced-43d0-bfd4-4a1815328219 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.044816 Jun 20 11:56:42.882627 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 107/203] 10.222.0.27 () {58 vars in 1154 bytes} [Mon Jun 20 11:56:42 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:42.897328 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5889f6c5-733e-4293-a8ee-f46b765186c7 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] Calling method '.version_select at 0x7f60801c58b0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:42.901516 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:42.901516 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:42.903202 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5889f6c5-733e-4293-a8ee-f46b765186c7 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:42.906563 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5889f6c5-733e-4293-a8ee-f46b765186c7 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:42.907788 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5889f6c5-733e-4293-a8ee-f46b765186c7 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:42.910031 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5889f6c5-733e-4293-a8ee-f46b765186c7 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:42.941667 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5889f6c5-733e-4293-a8ee-f46b765186c7 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.057661 Jun 20 11:56:42.947204 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 108/204] 10.222.0.27 () {58 vars in 1127 bytes} [Mon Jun 20 11:56:42 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:42.950002 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6bae61de-af8f-4ba4-a121-ec6a0a22ee9a tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1159337899"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:42.951919 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:42.951919 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:42.953433 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.aggregate [None req-6bae61de-af8f-4ba4-a121-ec6a0a22ee9a tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Generated uuid 78fe9bb0-f68b-49c3-a8eb-8447f248497a for aggregate {{(pid=119128) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 20 11:56:42.998339 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6bae61de-af8f-4ba4-a121-ec6a0a22ee9a tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.053616 Jun 20 11:56:43.001403 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 109/205] 10.222.0.27 () {60 vars in 1163 bytes} [Mon Jun 20 11:56:42 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:43.011904 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8a00413a-d296-4e2c-8924-ea37dfeaf8aa tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] Calling method '.version_select at 0x7f6073f444c0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:43.012784 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:43.012784 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:43.020829 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8a00413a-d296-4e2c-8924-ea37dfeaf8aa tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:43.021207 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8a00413a-d296-4e2c-8924-ea37dfeaf8aa tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:43.037260 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8a00413a-d296-4e2c-8924-ea37dfeaf8aa tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:43.037800 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8a00413a-d296-4e2c-8924-ea37dfeaf8aa tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:43.075304 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8a00413a-d296-4e2c-8924-ea37dfeaf8aa tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-h1-master-1" status: 200 len: 467 microversion: 2.1 time: 0.072362 Jun 20 11:56:43.080121 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 110/206] 10.222.0.27 () {58 vars in 1169 bytes} [Mon Jun 20 11:56:43 2022] GET /compute/v2.1/os-hosts/n-h1-master-1 => generated 467 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:43.082011 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-35611d8d-ab3f-4e29-93e0-924433face30 tempest-SecurityGroupsTestAdminJSON-639651349 tempest-SecurityGroupsTestAdminJSON-639651349-project-admin] 10.222.0.27 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 7004 microversion: 2.1 time: 1.814049 Jun 20 11:56:43.083203 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 97/207] 10.222.0.27 () {58 vars in 1190 bytes} [Mon Jun 20 11:56:41 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 7004 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:43.088654 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f7dc5edc-f849-4d74-b3c5-1b393a7ab355 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:43.091189 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f644ee37-94e0-42a8-aca7-763afb338d43 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:43.091573 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f7dc5edc-f849-4d74-b3c5-1b393a7ab355 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: c5afa776-6f61-4b7a-b586-c5047b5fbe5e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:43.098417 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:43.098417 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:43.106054 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f7dc5edc-f849-4d74-b3c5-1b393a7ab355 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:43.106571 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f7dc5edc-f849-4d74-b3c5-1b393a7ab355 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:43.107376 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f7dc5edc-f849-4d74-b3c5-1b393a7ab355 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:43.107817 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f7dc5edc-f849-4d74-b3c5-1b393a7ab355 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:43.113132 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f644ee37-94e0-42a8-aca7-763afb338d43 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:43.119124 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f644ee37-94e0-42a8-aca7-763afb338d43 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:43.283484 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f644ee37-94e0-42a8-aca7-763afb338d43 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.206005 Jun 20 11:56:43.289376 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 111/208] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Jun 20 11:56:43 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:43.295025 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-32021547-dd23-4ff5-9b92-59ca2083fa55 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] Calling method '.version_select at 0x7f6073f449d0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:43.295732 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:43.295732 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:43.319753 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-32021547-dd23-4ff5-9b92-59ca2083fa55 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:43.322652 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-32021547-dd23-4ff5-9b92-59ca2083fa55 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:43.341567 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f7dc5edc-f849-4d74-b3c5-1b393a7ab355 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:43.350447 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-32021547-dd23-4ff5-9b92-59ca2083fa55 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:43.351408 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-32021547-dd23-4ff5-9b92-59ca2083fa55 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:43.352876 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f7dc5edc-f849-4d74-b3c5-1b393a7ab355 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/c5afa776-6f61-4b7a-b586-c5047b5fbe5e" status: 200 len: 1317 microversion: 2.1 time: 0.268269 Jun 20 11:56:43.353628 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 98/209] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:43 2022] GET /compute/v2.1/servers/c5afa776-6f61-4b7a-b586-c5047b5fbe5e => generated 1317 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:43.361029 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bedc29b4-a42d-4089-921c-00a34bc51a22 tempest-SecurityGroupsTestAdminJSON-1384445310 tempest-SecurityGroupsTestAdminJSON-1384445310-project] Calling method '.version_select at 0x7f60801b0ca0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:43.371934 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-32021547-dd23-4ff5-9b92-59ca2083fa55 tempest-HostsAdminTestJSON-377785920 tempest-HostsAdminTestJSON-377785920-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-h2-master-1" status: 200 len: 467 microversion: 2.1 time: 0.086210 Jun 20 11:56:43.379131 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 112/210] 10.222.0.27 () {58 vars in 1169 bytes} [Mon Jun 20 11:56:43 2022] GET /compute/v2.1/os-hosts/n-h2-master-1 => generated 467 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:43.394830 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f2181652-4f64-4047-85ab-a7515b9f0530 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:43.398700 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:43.398700 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:43.417124 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f2181652-4f64-4047-85ab-a7515b9f0530 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:43.417590 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f2181652-4f64-4047-85ab-a7515b9f0530 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:43.460763 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-f2181652-4f64-4047-85ab-a7515b9f0530 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] HTTP exception thrown: Aggregate 3 already has host n-h1-master-1. Jun 20 11:56:43.467080 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f2181652-4f64-4047-85ab-a7515b9f0530 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Request method failure captured: Jun 20 11:56:43.467080 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/os-aggregates/3/action HTTP/1.1 Jun 20 11:56:43.467080 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:56:43.467080 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:56:43.467080 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:56:43.467080 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 39 Jun 20 11:56:43.467080 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:56:43.467080 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:56:43.467080 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:56:43.467080 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:43.467080 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGBYXn_pnmOl9_-aQXBxZ5Rj3u2wmmQBKrGhim4f18zdlY2TbQSRN57i5YsPfJpl83sJX0v-bqJwWp_aPuS3VR9bHHmHEfmkKpQy0g7jHi1goEFcsNh_Lh1wT6m3MsnYCqYX-krSLR0kGB7AZLVGO_BPzeI-TFqx-uvj8A73xge5HhY Jun 20 11:56:43.467080 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:56:43.467080 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:56:43.467080 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:56:43.467080 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:56:43.467080 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:56:43.467080 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:56:43.467080 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: bba587cbb9ed4336909c69950606a7b5 Jun 20 11:56:43.467080 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1183794404 Jun 20 11:56:43.467080 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member,admin Jun 20 11:56:43.467080 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member,admin Jun 20 11:56:43.469025 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bba587cbb9ed4336909c69950606a7b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bba587cbb9ed4336909c69950606a7b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bba587cbb9ed4336909c69950606a7b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bba587cbb9ed4336909c69950606a7b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:43.469025 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1183794404 Jun 20 11:56:43.469025 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: bba587cbb9ed4336909c69950606a7b5 Jun 20 11:56:43.469025 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1183794404 Jun 20 11:56:43.469025 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin Jun 20 11:56:43.469025 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:56:43.469025 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:56:43.469025 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 11fbf454924c4e11a5aecc649712be85 Jun 20 11:56:43.469025 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin Jun 20 11:56:43.469025 n-d-master-1 devstack@n-api.service[119128]: Jun 20 11:56:43.469025 n-d-master-1 devstack@n-api.service[119128]: {"add_host": {"host": "n-h1-master-1"}} Jun 20 11:56:43.469025 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 11:56:43.469025 n-d-master-1 devstack@n-api.service[119128]: exception: Aggregate 3 already has host n-h1-master-1. Jun 20 11:56:43.469894 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '3', 'body': {'add_host': {'host': 'n-h1-master-1'}}} Jun 20 11:56:43.469894 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:43.469894 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:43.469894 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 11:56:43.469894 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 20 11:56:43.469894 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 11:56:43.469894 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 20 11:56:43.469894 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 11:56:43.469894 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 20 11:56:43.469894 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 11:56:43.469894 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 20 11:56:43.469894 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 11:56:43.469894 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 11:56:43.469894 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 11:56:43.469894 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result.read() Jun 20 11:56:43.469894 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 11:56:43.469894 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 20 11:56:43.469894 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 11:56:43.469894 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 20 11:56:43.470915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 11:56:43.470915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 20 11:56:43.470915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 11:56:43.470915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 20 11:56:43.470915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-master-1-3' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jun 20 11:56:43.470915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:43.470915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jun 20 11:56:43.470915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:43.470915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:43.470915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Jun 20 11:56:43.470915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Jun 20 11:56:43.470915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jun 20 11:56:43.470915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi session.flush() Jun 20 11:56:43.470915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 20 11:56:43.470915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._flush(objects) Jun 20 11:56:43.470915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 20 11:56:43.470915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jun 20 11:56:43.470915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 20 11:56:43.470915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi compat.raise_( Jun 20 11:56:43.472047 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 11:56:43.472047 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception Jun 20 11:56:43.472047 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 20 11:56:43.472047 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi flush_context.execute() Jun 20 11:56:43.472047 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 20 11:56:43.472047 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi rec.execute(self) Jun 20 11:56:43.472047 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 20 11:56:43.472047 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jun 20 11:56:43.472047 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 20 11:56:43.472047 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jun 20 11:56:43.472047 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 20 11:56:43.472047 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jun 20 11:56:43.472047 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 20 11:56:43.472047 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jun 20 11:56:43.472047 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 20 11:56:43.472047 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jun 20 11:56:43.472047 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 20 11:56:43.472047 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jun 20 11:56:43.476066 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 20 11:56:43.476066 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jun 20 11:56:43.476066 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 20 11:56:43.476066 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 20 11:56:43.476066 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 11:56:43.476066 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception Jun 20 11:56:43.476066 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 11:56:43.476066 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 20 11:56:43.476066 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 11:56:43.476066 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 20 11:56:43.476066 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 11:56:43.476066 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 20 11:56:43.476066 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 11:56:43.476066 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 20 11:56:43.476066 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 11:56:43.476066 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 11:56:43.476066 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 11:56:43.476066 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result.read() Jun 20 11:56:43.478100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 11:56:43.478100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 20 11:56:43.478100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 11:56:43.478100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 20 11:56:43.478100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 11:56:43.478100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 20 11:56:43.478100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 11:56:43.478100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 20 11:56:43.478100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-master-1-3' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jun 20 11:56:43.478100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Jun 20 11:56:43.478100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 6, 20, 11, 56, 43, 444738), 'updated_at': None, 'host': 'n-h1-master-1', 'aggregate_id': 3}] Jun 20 11:56:43.478100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 20 11:56:43.478100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:43.478100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:43.478100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:43.478100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:43.478100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jun 20 11:56:43.481343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jun 20 11:56:43.481343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 20 11:56:43.481343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 20 11:56:43.481343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 11:56:43.481343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 11:56:43.481343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 11:56:43.481343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 11:56:43.481343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 20 11:56:43.481343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 20 11:56:43.481343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6513, in add_host_to_aggregate Jun 20 11:56:43.481343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Jun 20 11:56:43.481343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 20 11:56:43.481343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 20 11:56:43.481343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Jun 20 11:56:43.481343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Jun 20 11:56:43.481343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Jun 20 11:56:43.481343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Jun 20 11:56:43.481343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 3 already has host n-h1-master-1. Jun 20 11:56:43.481343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:43.481343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:43.486338 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:43.486338 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:43.486338 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:43.486338 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:43.486338 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:43.486338 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:43.486338 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:43.486338 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:43.486338 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:56:43.486338 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:56:43.486338 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Jun 20 11:56:43.486338 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jun 20 11:56:43.486338 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 3 already has host n-h1-master-1. Jun 20 11:56:43.486338 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:43.486338 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:43.486338 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:43.486338 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:43.486338 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:43.486338 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:43.486338 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:56:43.486338 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:56:43.491164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 3 already has host n-h1-master-1. Jun 20 11:56:43.491164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:43.491164 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f2181652-4f64-4047-85ab-a7515b9f0530 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Returning 409 to user: Aggregate 3 already has host n-h1-master-1. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:43.491164 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f2181652-4f64-4047-85ab-a7515b9f0530 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/3/action" status: 409 len: 95 microversion: 2.1 time: 0.093451 Jun 20 11:56:43.491164 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 113/211] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Jun 20 11:56:43 2022] POST /compute/v2.1/os-aggregates/3/action => generated 95 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Jun 20 11:56:43.491164 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-822bf00e-0f07-4c30-baee-3f421359988d tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:43.493485 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:43.493485 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:43.505147 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-822bf00e-0f07-4c30-baee-3f421359988d tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:43.505791 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-822bf00e-0f07-4c30-baee-3f421359988d tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:43.519209 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:56:43.718505 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-822bf00e-0f07-4c30-baee-3f421359988d tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.241341 Jun 20 11:56:43.721173 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 114/212] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Jun 20 11:56:43 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:43.739708 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a43013a9-976c-4dcc-8857-420de5add2b9 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:43.743101 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a43013a9-976c-4dcc-8857-420de5add2b9 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f75be1cf-4d20-4ea9-bcbb-b407892a39ee] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:43.761714 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a43013a9-976c-4dcc-8857-420de5add2b9 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:43.763075 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a43013a9-976c-4dcc-8857-420de5add2b9 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:43.765611 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a43013a9-976c-4dcc-8857-420de5add2b9 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:43.769687 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a43013a9-976c-4dcc-8857-420de5add2b9 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:43.833766 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bedc29b4-a42d-4089-921c-00a34bc51a22 tempest-SecurityGroupsTestAdminJSON-1384445310 tempest-SecurityGroupsTestAdminJSON-1384445310-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.478462 Jun 20 11:56:43.835163 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 99/213] 10.222.0.27 () {58 vars in 1190 bytes} [Mon Jun 20 11:56:43 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:43.840195 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-93510b7e-75ed-4d78-a00d-23ae3e525725 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:43.841384 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:43.841384 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:43.878756 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-93510b7e-75ed-4d78-a00d-23ae3e525725 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.040797 Jun 20 11:56:43.879950 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 100/214] 10.222.0.27 () {58 vars in 1151 bytes} [Mon Jun 20 11:56:43 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 20 11:56:43.891301 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-576c1b8d-13fa-4945-be37-f17a9cca8258 tempest-SecurityGroupsTestAdminJSON-639651349 tempest-SecurityGroupsTestAdminJSON-639651349-project-admin] Calling method '.version_select at 0x7f60802a4e50>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:44.283282 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a43013a9-976c-4dcc-8857-420de5add2b9 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:44.293997 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a43013a9-976c-4dcc-8857-420de5add2b9 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee" status: 200 len: 1318 microversion: 2.1 time: 0.564621 Jun 20 11:56:44.306242 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 115/215] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:43 2022] GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee => generated 1318 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:44.317742 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ccb2b0b1-96fa-4c87-ab6a-bb84abaffc79 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1001361281"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:44.319975 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:44.319975 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:44.321367 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.aggregate [None req-ccb2b0b1-96fa-4c87-ab6a-bb84abaffc79 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Generated uuid eaa2b5ed-e1ae-4bad-9fef-294a1c56ef90 for aggregate {{(pid=119128) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 20 11:56:44.351893 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ccb2b0b1-96fa-4c87-ab6a-bb84abaffc79 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.044133 Jun 20 11:56:44.353317 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 116/216] 10.222.0.27 () {60 vars in 1163 bytes} [Mon Jun 20 11:56:44 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:44.372636 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8fbb320a-b3e4-4d90-9d3a-1006ba27ae9a tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1529845158"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:44.374740 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:44.374740 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:44.376338 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.aggregate [None req-8fbb320a-b3e4-4d90-9d3a-1006ba27ae9a tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Generated uuid 342854fd-3168-4c58-985d-d7fc4399b73a for aggregate {{(pid=119128) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 20 11:56:44.416691 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8fbb320a-b3e4-4d90-9d3a-1006ba27ae9a tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.060687 Jun 20 11:56:44.418089 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 117/217] 10.222.0.27 () {60 vars in 1163 bytes} [Mon Jun 20 11:56:44 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:44.450028 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=66 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:56:44.806656 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8491439b-cc7d-4a1e-b8ac-0c18b23dde04 tempest-AggregatesAdminNegativeTestJSON-961533158 tempest-AggregatesAdminNegativeTestJSON-961533158-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:44.807952 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:44.807952 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:44.808854 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8491439b-cc7d-4a1e-b8ac-0c18b23dde04 tempest-AggregatesAdminNegativeTestJSON-961533158 tempest-AggregatesAdminNegativeTestJSON-961533158-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'f5fcced710cc407dab76987139f966da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da93853b5ab44cb3b3167db2c9d4ad4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:44.811027 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8491439b-cc7d-4a1e-b8ac-0c18b23dde04 tempest-AggregatesAdminNegativeTestJSON-961533158 tempest-AggregatesAdminNegativeTestJSON-961533158-project] Request method failure captured: Jun 20 11:56:44.811027 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Jun 20 11:56:44.811027 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:56:44.811027 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:56:44.811027 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:56:44.811027 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 39 Jun 20 11:56:44.811027 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:56:44.811027 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:56:44.811027 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:56:44.811027 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:44.811027 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGBV760t8IGpkViCBI51z0zQvPBOAJjEFImYPXxAffcNHxSrIw-SvdptdPiLYn3mziIKBZLqonNkQMusxjpMegIaoWtm4JOAYbDu_SuX_74hOBiQc3veOCnA15mpTNhCdQAHo5KtQyQK8wSzCLUgpO9QqaU7vyBTAzJLtC-TtYs98GY Jun 20 11:56:44.811027 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:56:44.811027 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:56:44.811027 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:56:44.811027 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:56:44.811027 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:56:44.811027 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:56:44.811027 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: da93853b5ab44cb3b3167db2c9d4ad4d Jun 20 11:56:44.811027 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-961533158 Jun 20 11:56:44.811027 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 11:56:44.811027 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 11:56:44.812475 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da93853b5ab44cb3b3167db2c9d4ad4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da93853b5ab44cb3b3167db2c9d4ad4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da93853b5ab44cb3b3167db2c9d4ad4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da93853b5ab44cb3b3167db2c9d4ad4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:44.812475 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-961533158 Jun 20 11:56:44.812475 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: da93853b5ab44cb3b3167db2c9d4ad4d Jun 20 11:56:44.812475 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-961533158 Jun 20 11:56:44.812475 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-AggregatesAdminNegativeTestJSON-961533158-project Jun 20 11:56:44.812475 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:56:44.812475 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:56:44.812475 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: f5fcced710cc407dab76987139f966da Jun 20 11:56:44.812475 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-961533158-project Jun 20 11:56:44.812475 n-d-master-1 devstack@n-api.service[119128]: Jun 20 11:56:44.812475 n-d-master-1 devstack@n-api.service[119128]: {"add_host": {"host": "n-h1-master-1"}} Jun 20 11:56:44.812475 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 11:56:44.812475 n-d-master-1 devstack@n-api.service[119128]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jun 20 11:56:44.813219 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '4', 'body': {'add_host': {'host': 'n-h1-master-1'}}} Jun 20 11:56:44.813219 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:44.813219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:44.813219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:44.813219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:44.813219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:44.813219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:44.813219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:44.813219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:44.813219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:56:44.813219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:56:44.813219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Jun 20 11:56:44.813219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Jun 20 11:56:44.813219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 20 11:56:44.813219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 20 11:56:44.813219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 20 11:56:44.813219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 20 11:56:44.813219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 11:56:44.813219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 11:56:44.814259 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 11:56:44.814259 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 11:56:44.814259 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 20 11:56:44.814259 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 20 11:56:44.814259 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 20 11:56:44.814259 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 20 11:56:44.814259 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 20 11:56:44.814259 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 20 11:56:44.814259 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jun 20 11:56:44.814259 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:44.814259 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:44.814259 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:44.814259 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:44.814259 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:44.814259 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:44.814259 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 20 11:56:44.814259 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 20 11:56:44.814259 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jun 20 11:56:44.814259 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:44.815742 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8491439b-cc7d-4a1e-b8ac-0c18b23dde04 tempest-AggregatesAdminNegativeTestJSON-961533158 tempest-AggregatesAdminNegativeTestJSON-961533158-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:44.815742 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8491439b-cc7d-4a1e-b8ac-0c18b23dde04 tempest-AggregatesAdminNegativeTestJSON-961533158 tempest-AggregatesAdminNegativeTestJSON-961533158-project] 10.222.0.27 "POST /compute/v2.1/os-aggregates/4/action" status: 403 len: 118 microversion: 2.1 time: 0.395063 Jun 20 11:56:44.815742 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 118/218] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Jun 20 11:56:44 2022] POST /compute/v2.1/os-aggregates/4/action => generated 118 bytes in 396 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:56:44.832611 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fddc58e1-ace6-4674-b6fa-722a64dd9201 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:44.833695 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fddc58e1-ace6-4674-b6fa-722a64dd9201 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: c5afa776-6f61-4b7a-b586-c5047b5fbe5e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:44.852608 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fddc58e1-ace6-4674-b6fa-722a64dd9201 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:44.853362 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fddc58e1-ace6-4674-b6fa-722a64dd9201 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:44.854358 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fddc58e1-ace6-4674-b6fa-722a64dd9201 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:44.854828 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fddc58e1-ace6-4674-b6fa-722a64dd9201 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:45.212526 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-576c1b8d-13fa-4945-be37-f17a9cca8258 tempest-SecurityGroupsTestAdminJSON-639651349 tempest-SecurityGroupsTestAdminJSON-639651349-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/19a76805-6104-48c2-adc8-21561291c0a3" status: 202 len: 0 microversion: 2.1 time: 1.325976 Jun 20 11:56:45.213187 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 101/219] 10.222.0.27 () {58 vars in 1271 bytes} [Mon Jun 20 11:56:43 2022] DELETE /compute/v2.1/os-security-groups/19a76805-6104-48c2-adc8-21561291c0a3 => generated 0 bytes in 1327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:56:45.224949 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3a7e4e06-0859-40d8-bace-635f56c03615 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:45.226652 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:45.226652 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:45.254067 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a7e4e06-0859-40d8-bace-635f56c03615 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:45.254529 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a7e4e06-0859-40d8-bace-635f56c03615 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:45.297404 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fddc58e1-ace6-4674-b6fa-722a64dd9201 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:45.334440 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fddc58e1-ace6-4674-b6fa-722a64dd9201 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/c5afa776-6f61-4b7a-b586-c5047b5fbe5e" status: 200 len: 1317 microversion: 2.1 time: 0.504382 Jun 20 11:56:45.337428 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 119/220] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:44 2022] GET /compute/v2.1/servers/c5afa776-6f61-4b7a-b586-c5047b5fbe5e => generated 1317 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:45.356500 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-b21c5b3a-9566-4ce9-b38a-777476df0ca7 req-38873d2d-353d-4995-94ff-b7e3741b48c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5afa776-6f61-4b7a-b586-c5047b5fbe5e", "tag": "76925e12-773d-4c10-a31b-fe42c389e3f4"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:45.375684 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-b21c5b3a-9566-4ce9-b38a-777476df0ca7 req-38873d2d-353d-4995-94ff-b7e3741b48c5 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:45.377863 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-b21c5b3a-9566-4ce9-b38a-777476df0ca7 req-38873d2d-353d-4995-94ff-b7e3741b48c5 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:45.394471 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-b21c5b3a-9566-4ce9-b38a-777476df0ca7 req-38873d2d-353d-4995-94ff-b7e3741b48c5 service nova] Creating event network-changed:76925e12-773d-4c10-a31b-fe42c389e3f4 for instance c5afa776-6f61-4b7a-b586-c5047b5fbe5e on n-h1-master-1 Jun 20 11:56:45.411190 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-b21c5b3a-9566-4ce9-b38a-777476df0ca7 req-38873d2d-353d-4995-94ff-b7e3741b48c5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069787 Jun 20 11:56:45.412838 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 120/221] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:45.425789 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0792c806-e7cf-40a2-97a3-31c7301395a5 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:45.426639 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:45.426639 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:45.458194 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:56:45.482150 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0792c806-e7cf-40a2-97a3-31c7301395a5 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.066910 Jun 20 11:56:45.486579 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 121/222] 10.222.0.27 () {58 vars in 1151 bytes} [Mon Jun 20 11:56:45 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 20 11:56:45.496316 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cad032a6-0764-4715-8236-e9d235570538 tempest-SecurityGroupsTestAdminJSON-639651349 tempest-SecurityGroupsTestAdminJSON-639651349-project-admin] Calling method '.version_select at 0x7f60801bd0d0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:45.525255 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3a7e4e06-0859-40d8-bace-635f56c03615 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 242 microversion: 2.1 time: 0.310741 Jun 20 11:56:45.526751 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 102/223] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Jun 20 11:56:45 2022] POST /compute/v2.1/os-aggregates/5/action => generated 242 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:45.534518 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1d4f0e6c-b20e-4d8b-aadf-4195e216ba76 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:45.535394 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1d4f0e6c-b20e-4d8b-aadf-4195e216ba76 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f75be1cf-4d20-4ea9-bcbb-b407892a39ee] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:45.552997 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1d4f0e6c-b20e-4d8b-aadf-4195e216ba76 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:45.554709 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1d4f0e6c-b20e-4d8b-aadf-4195e216ba76 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:45.556801 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1d4f0e6c-b20e-4d8b-aadf-4195e216ba76 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:45.557240 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1d4f0e6c-b20e-4d8b-aadf-4195e216ba76 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:45.926964 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cad032a6-0764-4715-8236-e9d235570538 tempest-SecurityGroupsTestAdminJSON-639651349 tempest-SecurityGroupsTestAdminJSON-639651349-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/0c194aac-0f8f-4db3-978c-695cf498d5b8" status: 202 len: 0 microversion: 2.1 time: 0.438649 Jun 20 11:56:45.928118 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 122/224] 10.222.0.27 () {58 vars in 1271 bytes} [Mon Jun 20 11:56:45 2022] DELETE /compute/v2.1/os-security-groups/0c194aac-0f8f-4db3-978c-695cf498d5b8 => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:56:45.932970 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-312d3e88-27b9-4387-a670-1c886c6c4ede tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-226735398"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:45.934565 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:45.934565 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:45.936652 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.aggregate [None req-312d3e88-27b9-4387-a670-1c886c6c4ede tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Generated uuid 2ef8a92a-a343-4b1d-9985-01881453dd38 for aggregate {{(pid=119128) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 20 11:56:45.984933 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-312d3e88-27b9-4387-a670-1c886c6c4ede tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.054058 Jun 20 11:56:45.986791 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 123/225] 10.222.0.27 () {60 vars in 1163 bytes} [Mon Jun 20 11:56:45 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:45.993307 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a9aee5ec-736f-4f06-88c0-02281d78f69e tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:45.994485 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:45.994485 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:46.010751 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a9aee5ec-736f-4f06-88c0-02281d78f69e tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/5" status: 200 len: 242 microversion: 2.1 time: 0.022214 Jun 20 11:56:46.011628 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 124/226] 10.222.0.27 () {58 vars in 1148 bytes} [Mon Jun 20 11:56:45 2022] GET /compute/v2.1/os-aggregates/5 => generated 242 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:46.026926 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ab510575-8bc7-4911-ae5f-e52aab71c716 tempest-SecurityGroupsTestAdminJSON-1384445310 tempest-SecurityGroupsTestAdminJSON-1384445310-project] Calling method '.version_select at 0x7f608003c9d0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:46.033649 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1d4f0e6c-b20e-4d8b-aadf-4195e216ba76 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:46.045579 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1d4f0e6c-b20e-4d8b-aadf-4195e216ba76 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee" status: 200 len: 1318 microversion: 2.1 time: 0.516856 Jun 20 11:56:46.046219 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 103/227] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:45 2022] GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee => generated 1318 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:46.059914 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-55da9277-1167-4020-b888-57bdee024aa2 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-2106395929"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:46.069269 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:46.069269 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:46.087003 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-55da9277-1167-4020-b888-57bdee024aa2 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:46.087468 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-55da9277-1167-4020-b888-57bdee024aa2 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:46.096279 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-55da9277-1167-4020-b888-57bdee024aa2 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:46.097002 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-55da9277-1167-4020-b888-57bdee024aa2 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:46.108889 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-55da9277-1167-4020-b888-57bdee024aa2 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-2106395929 could not be found. Jun 20 11:56:46.112565 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-55da9277-1167-4020-b888-57bdee024aa2 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Request method failure captured: Jun 20 11:56:46.112565 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/os-aggregates/6/action HTTP/1.1 Jun 20 11:56:46.112565 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:56:46.112565 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:56:46.112565 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:56:46.112565 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 58 Jun 20 11:56:46.112565 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:56:46.112565 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:56:46.112565 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:56:46.112565 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:46.112565 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGBYXn_pnmOl9_-aQXBxZ5Rj3u2wmmQBKrGhim4f18zdlY2TbQSRN57i5YsPfJpl83sJX0v-bqJwWp_aPuS3VR9bHHmHEfmkKpQy0g7jHi1goEFcsNh_Lh1wT6m3MsnYCqYX-krSLR0kGB7AZLVGO_BPzeI-TFqx-uvj8A73xge5HhY Jun 20 11:56:46.112565 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:56:46.112565 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:56:46.112565 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:56:46.112565 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:56:46.112565 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:56:46.112565 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:56:46.112565 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: bba587cbb9ed4336909c69950606a7b5 Jun 20 11:56:46.112565 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1183794404 Jun 20 11:56:46.112565 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member,admin Jun 20 11:56:46.112565 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member,admin Jun 20 11:56:46.113925 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bba587cbb9ed4336909c69950606a7b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bba587cbb9ed4336909c69950606a7b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bba587cbb9ed4336909c69950606a7b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bba587cbb9ed4336909c69950606a7b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:46.113925 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1183794404 Jun 20 11:56:46.113925 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: bba587cbb9ed4336909c69950606a7b5 Jun 20 11:56:46.113925 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1183794404 Jun 20 11:56:46.113925 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin Jun 20 11:56:46.113925 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:56:46.113925 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:56:46.113925 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 11fbf454924c4e11a5aecc649712be85 Jun 20 11:56:46.113925 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin Jun 20 11:56:46.113925 n-d-master-1 devstack@n-api.service[119127]: Jun 20 11:56:46.113925 n-d-master-1 devstack@n-api.service[119127]: {"add_host": {"host": "tempest-nonexist_host-2106395929"}} Jun 20 11:56:46.113925 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 11:56:46.113925 n-d-master-1 devstack@n-api.service[119127]: exception: Compute host tempest-nonexist_host-2106395929 could not be found. Jun 20 11:56:46.114742 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '6', 'body': {'add_host': {'host': 'tempest-nonexist_host-2106395929'}}} Jun 20 11:56:46.114742 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:46.114742 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:46.114742 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jun 20 11:56:46.114742 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jun 20 11:56:46.114742 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 11:56:46.114742 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 11:56:46.114742 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 20 11:56:46.114742 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 20 11:56:46.114742 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 20 11:56:46.114742 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 20 11:56:46.114742 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 20 11:56:46.114742 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 20 11:56:46.114742 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-2106395929' is not mapped to any cell Jun 20 11:56:46.114742 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:46.114742 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:46.114742 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:46.114742 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:46.114742 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jun 20 11:56:46.115754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jun 20 11:56:46.115754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jun 20 11:56:46.115754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jun 20 11:56:46.115754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jun 20 11:56:46.115754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:46.115754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:46.115754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:46.115754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:46.115754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jun 20 11:56:46.115754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jun 20 11:56:46.115754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 20 11:56:46.115754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 20 11:56:46.115754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 11:56:46.115754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 11:56:46.115754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 11:56:46.115754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 11:56:46.115754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 20 11:56:46.115754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 20 11:56:46.115754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6493, in add_host_to_aggregate Jun 20 11:56:46.115754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Jun 20 11:56:46.116943 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jun 20 11:56:46.116943 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jun 20 11:56:46.116943 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-2106395929 could not be found. Jun 20 11:56:46.116943 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:46.116943 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:46.116943 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:46.116943 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:46.116943 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:46.116943 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:46.116943 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:46.116943 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:46.116943 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:46.116943 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:46.116943 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:56:46.116943 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:56:46.116943 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Jun 20 11:56:46.116943 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:56:46.116943 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-2106395929 could not be found. Jun 20 11:56:46.116943 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:46.116943 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:46.116943 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:46.118160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:46.118160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:46.118160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:46.118160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:56:46.118160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:56:46.118160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-2106395929 could not be found. Jun 20 11:56:46.118160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:46.120487 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-55da9277-1167-4020-b888-57bdee024aa2 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-2106395929 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:46.121361 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-55da9277-1167-4020-b888-57bdee024aa2 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/6/action" status: 404 len: 111 microversion: 2.1 time: 0.068485 Jun 20 11:56:46.122123 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 104/228] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Jun 20 11:56:46 2022] POST /compute/v2.1/os-aggregates/6/action => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:56:46.127365 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8bcb3525-df1f-47d7-b85b-a142005381d4 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:46.128890 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:46.128890 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:46.145074 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bcb3525-df1f-47d7-b85b-a142005381d4 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:46.145775 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bcb3525-df1f-47d7-b85b-a142005381d4 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:46.287958 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8bcb3525-df1f-47d7-b85b-a142005381d4 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 227 microversion: 2.1 time: 0.164497 Jun 20 11:56:46.288967 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 105/229] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Jun 20 11:56:46 2022] POST /compute/v2.1/os-aggregates/5/action => generated 227 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:46.311533 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7511b003-4239-4322-8cb1-0f4e2d616a75 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:46.315615 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:46.315615 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:46.354913 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7511b003-4239-4322-8cb1-0f4e2d616a75 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.064626 Jun 20 11:56:46.363762 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 106/230] 10.222.0.27 () {58 vars in 1151 bytes} [Mon Jun 20 11:56:46 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 20 11:56:46.375220 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f9893038-b557-4f94-bcf9-e805eb9ed2d7 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:46.379317 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:46.379317 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:46.420702 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f9893038-b557-4f94-bcf9-e805eb9ed2d7 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.055110 Jun 20 11:56:46.425988 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 107/231] 10.222.0.27 () {58 vars in 1151 bytes} [Mon Jun 20 11:56:46 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 20 11:56:46.433724 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0f01cf24-7b67-458f-b9a2-9fc1b331baf5 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:46.434985 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0f01cf24-7b67-458f-b9a2-9fc1b331baf5 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: c5afa776-6f61-4b7a-b586-c5047b5fbe5e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:46.451294 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f01cf24-7b67-458f-b9a2-9fc1b331baf5 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:46.452066 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f01cf24-7b67-458f-b9a2-9fc1b331baf5 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:46.453473 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f01cf24-7b67-458f-b9a2-9fc1b331baf5 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:46.454590 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f01cf24-7b67-458f-b9a2-9fc1b331baf5 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:46.653476 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ab510575-8bc7-4911-ae5f-e52aab71c716 tempest-SecurityGroupsTestAdminJSON-1384445310 tempest-SecurityGroupsTestAdminJSON-1384445310-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/5b2174f0-8f4f-4fbc-a609-1e308e73daef" status: 202 len: 0 microversion: 2.1 time: 0.639743 Jun 20 11:56:46.654123 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 125/232] 10.222.0.27 () {58 vars in 1271 bytes} [Mon Jun 20 11:56:46 2022] DELETE /compute/v2.1/os-security-groups/5b2174f0-8f4f-4fbc-a609-1e308e73daef => generated 0 bytes in 641 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:56:46.661575 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bce2292f-c7ff-43d4-bffd-2fa49bd01eac tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:46.674067 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bce2292f-c7ff-43d4-bffd-2fa49bd01eac tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Request method failure captured: Jun 20 11:56:46.674067 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jun 20 11:56:46.674067 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:56:46.674067 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:56:46.674067 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:56:46.674067 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 283 Jun 20 11:56:46.674067 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:56:46.674067 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:56:46.674067 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:56:46.674067 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:46.674067 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGBYXn_pnmOl9_-aQXBxZ5Rj3u2wmmQBKrGhim4f18zdlY2TbQSRN57i5YsPfJpl83sJX0v-bqJwWp_aPuS3VR9bHHmHEfmkKpQy0g7jHi1goEFcsNh_Lh1wT6m3MsnYCqYX-krSLR0kGB7AZLVGO_BPzeI-TFqx-uvj8A73xge5HhY Jun 20 11:56:46.674067 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:56:46.674067 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:56:46.674067 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:56:46.674067 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:56:46.674067 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:56:46.674067 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:56:46.674067 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: bba587cbb9ed4336909c69950606a7b5 Jun 20 11:56:46.674067 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1183794404 Jun 20 11:56:46.674067 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member,admin Jun 20 11:56:46.674067 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member,admin Jun 20 11:56:46.675529 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bba587cbb9ed4336909c69950606a7b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bba587cbb9ed4336909c69950606a7b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bba587cbb9ed4336909c69950606a7b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bba587cbb9ed4336909c69950606a7b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:46.675529 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1183794404 Jun 20 11:56:46.675529 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: bba587cbb9ed4336909c69950606a7b5 Jun 20 11:56:46.675529 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1183794404 Jun 20 11:56:46.675529 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin Jun 20 11:56:46.675529 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:56:46.675529 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:56:46.675529 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 11fbf454924c4e11a5aecc649712be85 Jun 20 11:56:46.675529 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin Jun 20 11:56:46.675529 n-d-master-1 devstack@n-api.service[119128]: Jun 20 11:56:46.675529 n-d-master-1 devstack@n-api.service[119128]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jun 20 11:56:46.676298 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 11:56:46.676298 n-d-master-1 devstack@n-api.service[119128]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 20 11:56:46.676298 n-d-master-1 devstack@n-api.service[119128]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jun 20 11:56:46.676298 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:46.676298 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:46.676298 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 11:56:46.676298 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 11:56:46.676298 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 11:56:46.676298 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise error Jun 20 11:56:46.676298 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 20 11:56:46.676298 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:46.677059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Jun 20 11:56:46.677059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 20 11:56:46.677059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:46.677059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jun 20 11:56:46.677059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 20 11:56:46.677059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:46.677059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:46.677059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:46.677059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:46.677059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:46.677059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:46.677059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:46.677059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:46.677059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:46.677059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:46.677059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:56:46.677059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:56:46.677059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 11:56:46.677059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 11:56:46.678336 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 11:56:46.678336 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 11:56:46.678336 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 11:56:46.678336 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 11:56:46.678336 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 20 11:56:46.678336 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:46.678336 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:46.678336 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:46.678336 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:46.678336 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:46.678336 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:46.678336 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 11:56:46.678336 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 11:56:46.679508 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 20 11:56:46.679508 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:46.680282 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bce2292f-c7ff-43d4-bffd-2fa49bd01eac tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:46.681159 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bce2292f-c7ff-43d4-bffd-2fa49bd01eac tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.026101 Jun 20 11:56:46.681764 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 126/233] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Jun 20 11:56:46 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 11:56:46.689985 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c1f5dc33-1e8f-4967-9df1-c8741ed5a40f tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1341360961"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:46.699095 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:46.699095 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:46.701517 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.aggregate [None req-c1f5dc33-1e8f-4967-9df1-c8741ed5a40f tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Generated uuid 888fcf02-ba7f-4190-ac44-36737cf04b98 for aggregate {{(pid=119128) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 20 11:56:46.750669 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c1f5dc33-1e8f-4967-9df1-c8741ed5a40f tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.067439 Jun 20 11:56:46.757405 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 127/234] 10.222.0.27 () {60 vars in 1163 bytes} [Mon Jun 20 11:56:46 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:46.763095 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4a02b14e-432d-494b-bcab-8b9c7091baca tempest-SecurityGroupsTestAdminJSON-1384445310 tempest-SecurityGroupsTestAdminJSON-1384445310-project] Calling method '.version_select at 0x7f608003cdc0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:46.928738 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0f01cf24-7b67-458f-b9a2-9fc1b331baf5 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:46.942355 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0f01cf24-7b67-458f-b9a2-9fc1b331baf5 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/c5afa776-6f61-4b7a-b586-c5047b5fbe5e" status: 200 len: 1317 microversion: 2.1 time: 0.511746 Jun 20 11:56:46.957397 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 108/235] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:46 2022] GET /compute/v2.1/servers/c5afa776-6f61-4b7a-b586-c5047b5fbe5e => generated 1317 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:46.972383 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a0d92b55-eb78-4043-a53f-fd2b7991caba tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:47.002642 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a0d92b55-eb78-4043-a53f-fd2b7991caba tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Request method failure captured: Jun 20 11:56:47.002642 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jun 20 11:56:47.002642 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:56:47.002642 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:56:47.002642 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:56:47.002642 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 27 Jun 20 11:56:47.002642 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:56:47.002642 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:56:47.002642 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:56:47.002642 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:47.002642 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGBYXn_pnmOl9_-aQXBxZ5Rj3u2wmmQBKrGhim4f18zdlY2TbQSRN57i5YsPfJpl83sJX0v-bqJwWp_aPuS3VR9bHHmHEfmkKpQy0g7jHi1goEFcsNh_Lh1wT6m3MsnYCqYX-krSLR0kGB7AZLVGO_BPzeI-TFqx-uvj8A73xge5HhY Jun 20 11:56:47.002642 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:56:47.002642 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:56:47.002642 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:56:47.002642 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:56:47.002642 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:56:47.002642 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:56:47.002642 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: bba587cbb9ed4336909c69950606a7b5 Jun 20 11:56:47.002642 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1183794404 Jun 20 11:56:47.002642 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member,admin Jun 20 11:56:47.002642 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member,admin Jun 20 11:56:47.004141 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bba587cbb9ed4336909c69950606a7b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bba587cbb9ed4336909c69950606a7b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bba587cbb9ed4336909c69950606a7b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bba587cbb9ed4336909c69950606a7b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:47.004141 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1183794404 Jun 20 11:56:47.004141 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: bba587cbb9ed4336909c69950606a7b5 Jun 20 11:56:47.004141 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1183794404 Jun 20 11:56:47.004141 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin Jun 20 11:56:47.004141 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:56:47.004141 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:56:47.004141 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 11fbf454924c4e11a5aecc649712be85 Jun 20 11:56:47.004141 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin Jun 20 11:56:47.004141 n-d-master-1 devstack@n-api.service[119127]: Jun 20 11:56:47.004141 n-d-master-1 devstack@n-api.service[119127]: {"aggregate": {"name": ""}} Jun 20 11:56:47.004141 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 11:56:47.004141 n-d-master-1 devstack@n-api.service[119127]: exception: Invalid input for field/attribute name. Value: . '' is too short Jun 20 11:56:47.005074 n-d-master-1 devstack@n-api.service[119127]: action_args: {'body': {'aggregate': {'name': ''}}} Jun 20 11:56:47.005074 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:47.005074 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:47.005074 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 11:56:47.005074 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 11:56:47.005074 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 11:56:47.005074 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise error Jun 20 11:56:47.005074 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jun 20 11:56:47.005074 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:47.005074 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Jun 20 11:56:47.005074 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 20 11:56:47.005074 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:47.005074 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jun 20 11:56:47.005074 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi '' Jun 20 11:56:47.005074 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:47.005074 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:47.005074 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:47.005074 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:47.005074 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:47.005074 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:47.005074 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:47.005074 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:47.005074 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:47.006699 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:47.006699 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:56:47.006699 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:56:47.006699 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 11:56:47.006699 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 11:56:47.006699 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 11:56:47.006699 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 11:56:47.006699 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 11:56:47.006699 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 11:56:47.006699 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jun 20 11:56:47.006699 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:47.006699 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:47.006699 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:47.006699 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:47.006699 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:47.006699 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:47.006699 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 11:56:47.006699 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 11:56:47.006699 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jun 20 11:56:47.006699 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:47.015322 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a0d92b55-eb78-4043-a53f-fd2b7991caba tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:47.016527 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a0d92b55-eb78-4043-a53f-fd2b7991caba tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.057677 Jun 20 11:56:47.024476 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 109/236] 10.222.0.27 () {60 vars in 1163 bytes} [Mon Jun 20 11:56:46 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 11:56:47.032012 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bdcefc48-9840-4be8-ad25-89afac82ace8 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:47.036465 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:47.036465 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:47.053199 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bdcefc48-9840-4be8-ad25-89afac82ace8 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:47.054303 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bdcefc48-9840-4be8-ad25-89afac82ace8 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:47.126827 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:56:47.324770 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bdcefc48-9840-4be8-ad25-89afac82ace8 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 242 microversion: 2.1 time: 0.298287 Jun 20 11:56:47.326012 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 110/237] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Jun 20 11:56:47 2022] POST /compute/v2.1/os-aggregates/7/action => generated 242 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:47.353938 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fa191cc8-0ae9-4051-a425-ae5eb057ca0a tempest-AggregatesAdminNegativeTestJSON-961533158 tempest-AggregatesAdminNegativeTestJSON-961533158-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-464397029"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:47.355861 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:47.355861 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:47.357016 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fa191cc8-0ae9-4051-a425-ae5eb057ca0a tempest-AggregatesAdminNegativeTestJSON-961533158 tempest-AggregatesAdminNegativeTestJSON-961533158-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'f5fcced710cc407dab76987139f966da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da93853b5ab44cb3b3167db2c9d4ad4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:47.359412 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fa191cc8-0ae9-4051-a425-ae5eb057ca0a tempest-AggregatesAdminNegativeTestJSON-961533158 tempest-AggregatesAdminNegativeTestJSON-961533158-project] Request method failure captured: Jun 20 11:56:47.359412 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jun 20 11:56:47.359412 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:56:47.359412 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:56:47.359412 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:56:47.359412 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 59 Jun 20 11:56:47.359412 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:56:47.359412 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:56:47.359412 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:56:47.359412 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:47.359412 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGBV760t8IGpkViCBI51z0zQvPBOAJjEFImYPXxAffcNHxSrIw-SvdptdPiLYn3mziIKBZLqonNkQMusxjpMegIaoWtm4JOAYbDu_SuX_74hOBiQc3veOCnA15mpTNhCdQAHo5KtQyQK8wSzCLUgpO9QqaU7vyBTAzJLtC-TtYs98GY Jun 20 11:56:47.359412 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:56:47.359412 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:56:47.359412 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:56:47.359412 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:56:47.359412 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:56:47.359412 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:56:47.359412 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: da93853b5ab44cb3b3167db2c9d4ad4d Jun 20 11:56:47.359412 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-961533158 Jun 20 11:56:47.359412 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 11:56:47.359412 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 11:56:47.361118 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da93853b5ab44cb3b3167db2c9d4ad4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da93853b5ab44cb3b3167db2c9d4ad4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da93853b5ab44cb3b3167db2c9d4ad4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da93853b5ab44cb3b3167db2c9d4ad4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:47.361118 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-961533158 Jun 20 11:56:47.361118 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: da93853b5ab44cb3b3167db2c9d4ad4d Jun 20 11:56:47.361118 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-961533158 Jun 20 11:56:47.361118 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-AggregatesAdminNegativeTestJSON-961533158-project Jun 20 11:56:47.361118 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:56:47.361118 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:56:47.361118 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: f5fcced710cc407dab76987139f966da Jun 20 11:56:47.361118 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-961533158-project Jun 20 11:56:47.361118 n-d-master-1 devstack@n-api.service[119127]: Jun 20 11:56:47.361118 n-d-master-1 devstack@n-api.service[119127]: {"aggregate": {"name": "tempest-test_aggregate-464397029"}} Jun 20 11:56:47.361118 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 11:56:47.361118 n-d-master-1 devstack@n-api.service[119127]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jun 20 11:56:47.362037 n-d-master-1 devstack@n-api.service[119127]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-464397029'}}} Jun 20 11:56:47.362037 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:47.362037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:47.362037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:47.362037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:47.362037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:47.362037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:47.362037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:47.362037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:47.362037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:56:47.362037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:56:47.362037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:56:47.362037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:56:47.362037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Jun 20 11:56:47.362037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Jun 20 11:56:47.362037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 20 11:56:47.362037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 20 11:56:47.362037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 20 11:56:47.362037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 20 11:56:47.363259 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 11:56:47.363259 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 11:56:47.363259 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 11:56:47.363259 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 11:56:47.363259 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 20 11:56:47.363259 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 20 11:56:47.363259 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 20 11:56:47.363259 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 20 11:56:47.363259 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 20 11:56:47.363259 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 20 11:56:47.363259 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jun 20 11:56:47.363259 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:47.363259 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:47.363259 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:47.363259 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:47.363259 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:47.363259 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:47.363259 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 20 11:56:47.363259 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 20 11:56:47.363259 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jun 20 11:56:47.364691 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:47.364691 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fa191cc8-0ae9-4051-a425-ae5eb057ca0a tempest-AggregatesAdminNegativeTestJSON-961533158 tempest-AggregatesAdminNegativeTestJSON-961533158-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:47.364691 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fa191cc8-0ae9-4051-a425-ae5eb057ca0a tempest-AggregatesAdminNegativeTestJSON-961533158 tempest-AggregatesAdminNegativeTestJSON-961533158-project] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.032712 Jun 20 11:56:47.377590 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 111/238] 10.222.0.27 () {60 vars in 1163 bytes} [Mon Jun 20 11:56:47 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:56:47.384303 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-56fc3fe5-ebd2-445f-9c75-71535e430777 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:47.387574 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-56fc3fe5-ebd2-445f-9c75-71535e430777 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f75be1cf-4d20-4ea9-bcbb-b407892a39ee] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:47.398250 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-56fc3fe5-ebd2-445f-9c75-71535e430777 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:47.398964 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-56fc3fe5-ebd2-445f-9c75-71535e430777 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:47.400028 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-56fc3fe5-ebd2-445f-9c75-71535e430777 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:47.400591 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-56fc3fe5-ebd2-445f-9c75-71535e430777 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:47.514536 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4a02b14e-432d-494b-bcab-8b9c7091baca tempest-SecurityGroupsTestAdminJSON-1384445310 tempest-SecurityGroupsTestAdminJSON-1384445310-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/615d2356-b7fd-46a6-bb8e-7c26064eec23" status: 202 len: 0 microversion: 2.1 time: 0.755928 Jun 20 11:56:47.525109 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 128/239] 10.222.0.27 () {58 vars in 1271 bytes} [Mon Jun 20 11:56:46 2022] DELETE /compute/v2.1/os-security-groups/615d2356-b7fd-46a6-bb8e-7c26064eec23 => generated 0 bytes in 767 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:56:47.530879 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-09daa93b-dfff-47a2-a705-9f01c83f7e5a tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:47.531927 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:47.531927 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:47.542295 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-09daa93b-dfff-47a2-a705-9f01c83f7e5a tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.015715 Jun 20 11:56:47.546291 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 129/240] 10.222.0.27 () {58 vars in 1142 bytes} [Mon Jun 20 11:56:47 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:47.558162 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-35420d3b-7427-4bfd-8332-25bb38cdbc2f tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-187152821"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:47.559701 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:47.559701 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:47.561228 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.aggregate [None req-35420d3b-7427-4bfd-8332-25bb38cdbc2f tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Generated uuid ec53f905-7a55-4623-bc12-16dcc71eb40c for aggregate {{(pid=119128) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 20 11:56:47.595110 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-35420d3b-7427-4bfd-8332-25bb38cdbc2f tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.047452 Jun 20 11:56:47.599446 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 130/241] 10.222.0.27 () {60 vars in 1163 bytes} [Mon Jun 20 11:56:47 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:47.627628 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bd488054-224f-4193-b530-a436681ea6d2 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:47.629874 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:47.629874 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:47.664566 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bd488054-224f-4193-b530-a436681ea6d2 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:47.665489 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bd488054-224f-4193-b530-a436681ea6d2 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:47.844260 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-56fc3fe5-ebd2-445f-9c75-71535e430777 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:47.857531 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bd488054-224f-4193-b530-a436681ea6d2 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 227 microversion: 2.1 time: 0.253729 Jun 20 11:56:47.859965 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-56fc3fe5-ebd2-445f-9c75-71535e430777 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee" status: 200 len: 1318 microversion: 2.1 time: 0.480933 Jun 20 11:56:47.862262 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 112/242] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:47 2022] GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee => generated 1318 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:47.867640 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 131/243] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Jun 20 11:56:47 2022] POST /compute/v2.1/os-aggregates/7/action => generated 227 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:47.872598 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-360fccaf-e804-49eb-ac69-15635ad65315 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:47.873613 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:47.873613 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:47.876401 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-27cf0cf2-3ded-4b73-afce-3a9c16e1be02 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-187152821"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:47.877864 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:47.877864 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:47.880991 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.aggregate [None req-27cf0cf2-3ded-4b73-afce-3a9c16e1be02 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Generated uuid 5afeef13-f601-4da6-9b1a-d278becf44aa for aggregate {{(pid=119127) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 20 11:56:47.893043 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=5,nova_api:DELETE=8 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:56:47.906200 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-360fccaf-e804-49eb-ac69-15635ad65315 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.036912 Jun 20 11:56:47.914727 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-27cf0cf2-3ded-4b73-afce-3a9c16e1be02 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-187152821 already exists. Jun 20 11:56:47.915794 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 132/244] 10.222.0.27 () {58 vars in 1151 bytes} [Mon Jun 20 11:56:47 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 20 11:56:47.919527 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-27cf0cf2-3ded-4b73-afce-3a9c16e1be02 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Request method failure captured: Jun 20 11:56:47.919527 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jun 20 11:56:47.919527 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:56:47.919527 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:56:47.919527 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:56:47.919527 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 59 Jun 20 11:56:47.919527 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:56:47.919527 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:56:47.919527 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:56:47.919527 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:47.919527 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGBYXn_pnmOl9_-aQXBxZ5Rj3u2wmmQBKrGhim4f18zdlY2TbQSRN57i5YsPfJpl83sJX0v-bqJwWp_aPuS3VR9bHHmHEfmkKpQy0g7jHi1goEFcsNh_Lh1wT6m3MsnYCqYX-krSLR0kGB7AZLVGO_BPzeI-TFqx-uvj8A73xge5HhY Jun 20 11:56:47.919527 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:56:47.919527 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:56:47.919527 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:56:47.919527 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:56:47.919527 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:56:47.919527 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:56:47.919527 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: bba587cbb9ed4336909c69950606a7b5 Jun 20 11:56:47.919527 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1183794404 Jun 20 11:56:47.919527 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member,admin Jun 20 11:56:47.919527 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member,admin Jun 20 11:56:47.921249 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bba587cbb9ed4336909c69950606a7b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bba587cbb9ed4336909c69950606a7b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bba587cbb9ed4336909c69950606a7b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bba587cbb9ed4336909c69950606a7b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:47.921249 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1183794404 Jun 20 11:56:47.921249 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: bba587cbb9ed4336909c69950606a7b5 Jun 20 11:56:47.921249 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1183794404 Jun 20 11:56:47.921249 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin Jun 20 11:56:47.921249 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:56:47.921249 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:56:47.921249 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 11fbf454924c4e11a5aecc649712be85 Jun 20 11:56:47.921249 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin Jun 20 11:56:47.921249 n-d-master-1 devstack@n-api.service[119127]: Jun 20 11:56:47.921249 n-d-master-1 devstack@n-api.service[119127]: {"aggregate": {"name": "tempest-test_aggregate-187152821"}} Jun 20 11:56:47.921249 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 11:56:47.921249 n-d-master-1 devstack@n-api.service[119127]: exception: Aggregate tempest-test_aggregate-187152821 already exists. Jun 20 11:56:47.922139 n-d-master-1 devstack@n-api.service[119127]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-187152821'}}} Jun 20 11:56:47.922139 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:47.922139 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:47.922139 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Jun 20 11:56:47.922139 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Jun 20 11:56:47.922139 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 20 11:56:47.922139 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 20 11:56:47.922139 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 11:56:47.922139 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 11:56:47.922139 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 11:56:47.922139 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 11:56:47.922139 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 20 11:56:47.922139 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 20 11:56:47.922139 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6330, in create_aggregate Jun 20 11:56:47.922139 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi aggregate.create() Jun 20 11:56:47.922139 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 20 11:56:47.922139 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 20 11:56:47.922139 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Jun 20 11:56:47.922139 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Jun 20 11:56:47.923519 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 20 11:56:47.923519 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 20 11:56:47.923519 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Jun 20 11:56:47.923519 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Jun 20 11:56:47.923519 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-187152821 already exists. Jun 20 11:56:47.923519 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:47.923519 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:47.923519 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:47.923519 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:47.923519 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:47.923519 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:47.923519 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:47.923519 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:47.923519 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:47.923519 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:47.923519 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:56:47.923519 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:56:47.923519 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:56:47.923519 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:56:47.923519 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Jun 20 11:56:47.924795 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jun 20 11:56:47.924795 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-187152821 already exists. Jun 20 11:56:47.924795 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:47.924795 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:47.924795 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:47.924795 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:47.924795 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:47.924795 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:47.924795 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:56:47.924795 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:56:47.924795 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-187152821 already exists. Jun 20 11:56:47.924795 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:47.924795 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-27cf0cf2-3ded-4b73-afce-3a9c16e1be02 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-187152821 already exists. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:47.924795 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-27cf0cf2-3ded-4b73-afce-3a9c16e1be02 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.060388 Jun 20 11:56:47.930866 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 113/245] 10.222.0.27 () {60 vars in 1163 bytes} [Mon Jun 20 11:56:47 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 68 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 20 11:56:47.935262 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e5a140bd-32e5-4f36-aeeb-003466d9e4a5 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-400636509"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:47.940094 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:47.940094 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:47.942046 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.aggregate [None req-e5a140bd-32e5-4f36-aeeb-003466d9e4a5 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Generated uuid 771ae9bb-c5e4-44f8-bba9-bf5b74592a91 for aggregate {{(pid=119128) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 20 11:56:47.955779 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a2ac1035-2f0d-4c6f-9fc8-e5d5b8230811 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:47.959999 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:47.959999 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:48.009332 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a2ac1035-2f0d-4c6f-9fc8-e5d5b8230811 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.076093 Jun 20 11:56:48.011034 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 114/246] 10.222.0.27 () {58 vars in 1151 bytes} [Mon Jun 20 11:56:47 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 20 11:56:48.036412 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bfd7345b-ef8a-4dab-8861-27419fc35fb6 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:48.037243 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bfd7345b-ef8a-4dab-8861-27419fc35fb6 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: c5afa776-6f61-4b7a-b586-c5047b5fbe5e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:48.047739 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e5a140bd-32e5-4f36-aeeb-003466d9e4a5 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.129235 Jun 20 11:56:48.050521 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 133/247] 10.222.0.27 () {60 vars in 1163 bytes} [Mon Jun 20 11:56:47 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:48.061125 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8c62e491-2db1-46ae-bbbe-4fa435e8cf57 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-946503693"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:48.062949 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:48.062949 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:48.065965 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.aggregate [None req-8c62e491-2db1-46ae-bbbe-4fa435e8cf57 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Generated uuid 3c2f9fd5-e89b-42aa-9046-2ea0c544e48d for aggregate {{(pid=119128) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 20 11:56:48.067557 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bfd7345b-ef8a-4dab-8861-27419fc35fb6 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:48.068031 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bfd7345b-ef8a-4dab-8861-27419fc35fb6 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:48.080560 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bfd7345b-ef8a-4dab-8861-27419fc35fb6 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:48.081529 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bfd7345b-ef8a-4dab-8861-27419fc35fb6 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:48.094545 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8c62e491-2db1-46ae-bbbe-4fa435e8cf57 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.042708 Jun 20 11:56:48.101586 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 134/248] 10.222.0.27 () {60 vars in 1163 bytes} [Mon Jun 20 11:56:48 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:48.107233 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b3884ecf-1077-429e-93a0-a4bb7acbc332 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:48.110211 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:48.110211 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:48.123696 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b3884ecf-1077-429e-93a0-a4bb7acbc332 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:48.124977 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b3884ecf-1077-429e-93a0-a4bb7acbc332 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:48.370710 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b3884ecf-1077-429e-93a0-a4bb7acbc332 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 241 microversion: 2.1 time: 0.267761 Jun 20 11:56:48.371414 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 135/249] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Jun 20 11:56:48 2022] POST /compute/v2.1/os-aggregates/9/action => generated 241 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:48.377003 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6b63a70e-fbaa-4c80-afe3-56293c6aa82a tempest-AggregatesAdminNegativeTestJSON-961533158 tempest-AggregatesAdminNegativeTestJSON-961533158-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:48.378004 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:48.378004 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:48.381073 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6b63a70e-fbaa-4c80-afe3-56293c6aa82a tempest-AggregatesAdminNegativeTestJSON-961533158 tempest-AggregatesAdminNegativeTestJSON-961533158-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'f5fcced710cc407dab76987139f966da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da93853b5ab44cb3b3167db2c9d4ad4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:48.391050 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6b63a70e-fbaa-4c80-afe3-56293c6aa82a tempest-AggregatesAdminNegativeTestJSON-961533158 tempest-AggregatesAdminNegativeTestJSON-961533158-project] Request method failure captured: Jun 20 11:56:48.391050 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/os-aggregates/10 HTTP/1.1 Jun 20 11:56:48.391050 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:56:48.391050 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:56:48.391050 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:56:48.391050 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 11:56:48.391050 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:56:48.391050 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:56:48.391050 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:56:48.391050 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:48.391050 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGBV760t8IGpkViCBI51z0zQvPBOAJjEFImYPXxAffcNHxSrIw-SvdptdPiLYn3mziIKBZLqonNkQMusxjpMegIaoWtm4JOAYbDu_SuX_74hOBiQc3veOCnA15mpTNhCdQAHo5KtQyQK8wSzCLUgpO9QqaU7vyBTAzJLtC-TtYs98GY Jun 20 11:56:48.391050 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:56:48.391050 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:56:48.391050 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:56:48.391050 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:56:48.391050 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:56:48.391050 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:56:48.391050 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: da93853b5ab44cb3b3167db2c9d4ad4d Jun 20 11:56:48.391050 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-961533158 Jun 20 11:56:48.391050 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 11:56:48.391050 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 11:56:48.392868 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da93853b5ab44cb3b3167db2c9d4ad4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da93853b5ab44cb3b3167db2c9d4ad4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da93853b5ab44cb3b3167db2c9d4ad4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da93853b5ab44cb3b3167db2c9d4ad4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:48.392868 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-961533158 Jun 20 11:56:48.392868 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: da93853b5ab44cb3b3167db2c9d4ad4d Jun 20 11:56:48.392868 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-961533158 Jun 20 11:56:48.392868 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-AggregatesAdminNegativeTestJSON-961533158-project Jun 20 11:56:48.392868 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:56:48.392868 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:56:48.392868 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: f5fcced710cc407dab76987139f966da Jun 20 11:56:48.392868 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-961533158-project Jun 20 11:56:48.392868 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 11:56:48.392868 n-d-master-1 devstack@n-api.service[119128]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jun 20 11:56:48.392868 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '10'} Jun 20 11:56:48.393846 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:48.393846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:48.393846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:48.393846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:48.393846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:48.393846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:48.393846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:48.393846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:48.393846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Jun 20 11:56:48.393846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Jun 20 11:56:48.393846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 20 11:56:48.393846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 20 11:56:48.393846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 20 11:56:48.393846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 20 11:56:48.393846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 11:56:48.393846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 11:56:48.393846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 11:56:48.393846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 11:56:48.393846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 20 11:56:48.396567 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 20 11:56:48.396567 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 20 11:56:48.396567 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 20 11:56:48.396567 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 20 11:56:48.396567 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 20 11:56:48.396567 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jun 20 11:56:48.396567 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:48.396567 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:48.396567 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:48.396567 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:48.396567 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:48.396567 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:48.396567 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 20 11:56:48.396567 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 20 11:56:48.396567 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jun 20 11:56:48.396567 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:48.396567 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6b63a70e-fbaa-4c80-afe3-56293c6aa82a tempest-AggregatesAdminNegativeTestJSON-961533158 tempest-AggregatesAdminNegativeTestJSON-961533158-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:48.398816 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6b63a70e-fbaa-4c80-afe3-56293c6aa82a tempest-AggregatesAdminNegativeTestJSON-961533158 tempest-AggregatesAdminNegativeTestJSON-961533158-project] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/10" status: 403 len: 116 microversion: 2.1 time: 0.023280 Jun 20 11:56:48.398816 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 136/250] 10.222.0.27 () {58 vars in 1154 bytes} [Mon Jun 20 11:56:48 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 116 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:56:48.413742 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-377f5161-0b04-4c5c-87da-b82fca3b3b2e tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:48.421713 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:48.421713 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:48.442051 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-377f5161-0b04-4c5c-87da-b82fca3b3b2e tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:48.443355 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-377f5161-0b04-4c5c-87da-b82fca3b3b2e tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:48.610026 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-377f5161-0b04-4c5c-87da-b82fca3b3b2e tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.206023 Jun 20 11:56:48.615749 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 137/251] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Jun 20 11:56:48 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:48.621758 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-942e672e-364c-479d-8eed-a4903344ce41 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:48.626003 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:48.626003 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:48.665537 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-942e672e-364c-479d-8eed-a4903344ce41 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.051609 Jun 20 11:56:48.667007 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bfd7345b-ef8a-4dab-8861-27419fc35fb6 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:48.671527 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 138/252] 10.222.0.27 () {58 vars in 1154 bytes} [Mon Jun 20 11:56:48 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 20 11:56:48.678648 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e3500095-0e3e-4121-a162-0ef4f241e9dd tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:48.686335 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bfd7345b-ef8a-4dab-8861-27419fc35fb6 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/c5afa776-6f61-4b7a-b586-c5047b5fbe5e" status: 200 len: 1317 microversion: 2.1 time: 0.671706 Jun 20 11:56:48.687405 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 115/253] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:48 2022] GET /compute/v2.1/servers/c5afa776-6f61-4b7a-b586-c5047b5fbe5e => generated 1317 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:48.689211 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:48.689211 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:48.709142 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0117adf4-12b8-4a97-be1d-b1e4a8f432e5 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:48.710788 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:48.710788 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:48.731268 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-0117adf4-12b8-4a97-be1d-b1e4a8f432e5 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jun 20 11:56:48.734989 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0117adf4-12b8-4a97-be1d-b1e4a8f432e5 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Request method failure captured: Jun 20 11:56:48.734989 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jun 20 11:56:48.734989 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:56:48.734989 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:56:48.734989 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:56:48.734989 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 11:56:48.734989 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:56:48.734989 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:56:48.734989 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:56:48.734989 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:48.734989 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGBYXn_pnmOl9_-aQXBxZ5Rj3u2wmmQBKrGhim4f18zdlY2TbQSRN57i5YsPfJpl83sJX0v-bqJwWp_aPuS3VR9bHHmHEfmkKpQy0g7jHi1goEFcsNh_Lh1wT6m3MsnYCqYX-krSLR0kGB7AZLVGO_BPzeI-TFqx-uvj8A73xge5HhY Jun 20 11:56:48.734989 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:56:48.734989 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:56:48.734989 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:56:48.734989 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:56:48.734989 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:56:48.734989 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:56:48.734989 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: bba587cbb9ed4336909c69950606a7b5 Jun 20 11:56:48.734989 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1183794404 Jun 20 11:56:48.734989 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member,admin Jun 20 11:56:48.734989 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member,admin Jun 20 11:56:48.736330 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bba587cbb9ed4336909c69950606a7b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bba587cbb9ed4336909c69950606a7b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bba587cbb9ed4336909c69950606a7b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bba587cbb9ed4336909c69950606a7b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:48.736330 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1183794404 Jun 20 11:56:48.736330 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: bba587cbb9ed4336909c69950606a7b5 Jun 20 11:56:48.736330 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1183794404 Jun 20 11:56:48.736330 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin Jun 20 11:56:48.736330 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:56:48.736330 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:56:48.736330 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 11fbf454924c4e11a5aecc649712be85 Jun 20 11:56:48.736330 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin Jun 20 11:56:48.736330 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 11:56:48.736330 n-d-master-1 devstack@n-api.service[119127]: exception: Aggregate -1 could not be found. Jun 20 11:56:48.736330 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '-1'} Jun 20 11:56:48.737102 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:48.737102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:48.737102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jun 20 11:56:48.737102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jun 20 11:56:48.737102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 20 11:56:48.737102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 20 11:56:48.737102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 11:56:48.737102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 11:56:48.737102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 11:56:48.737102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 11:56:48.737102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 20 11:56:48.737102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 20 11:56:48.737102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jun 20 11:56:48.737102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jun 20 11:56:48.737102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 11:56:48.737102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 11:56:48.737102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 20 11:56:48.737102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 20 11:56:48.737102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 20 11:56:48.738319 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 20 11:56:48.738319 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 20 11:56:48.738319 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 20 11:56:48.738319 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jun 20 11:56:48.738319 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:48.738319 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:48.738319 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:48.738319 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:48.738319 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:48.738319 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:48.738319 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:48.738319 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:48.738319 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:48.738319 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:48.738319 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jun 20 11:56:48.738319 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:56:48.738319 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jun 20 11:56:48.738319 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:48.738319 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:48.738319 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:48.738319 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:48.739660 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:48.739660 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:48.739660 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:56:48.739660 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:56:48.739660 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jun 20 11:56:48.739660 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:48.741515 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0117adf4-12b8-4a97-be1d-b1e4a8f432e5 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:48.743134 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0117adf4-12b8-4a97-be1d-b1e4a8f432e5 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.053630 Jun 20 11:56:48.746302 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 116/254] 10.222.0.27 () {58 vars in 1154 bytes} [Mon Jun 20 11:56:48 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 11:56:48.761655 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a5da6294-0197-4ae8-8bf5-39172d83a068 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1155172982"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:48.764520 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e3500095-0e3e-4121-a162-0ef4f241e9dd tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.091426 Jun 20 11:56:48.767498 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:48.767498 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:48.768561 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.aggregate [None req-a5da6294-0197-4ae8-8bf5-39172d83a068 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Generated uuid 2ebfa7ea-5c63-4faf-9950-08094909ada9 for aggregate {{(pid=119127) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 20 11:56:48.774524 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 139/255] 10.222.0.27 () {58 vars in 1151 bytes} [Mon Jun 20 11:56:48 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 20 11:56:48.781902 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e6559cd1-201b-4ea9-90c1-f86a987647ff tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-301644511"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:48.796378 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:48.796378 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:48.807914 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a5da6294-0197-4ae8-8bf5-39172d83a068 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.055476 Jun 20 11:56:48.808723 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.aggregate [None req-e6559cd1-201b-4ea9-90c1-f86a987647ff tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Generated uuid 708cdddb-cbf3-4b7f-8afc-199586fd01ff for aggregate {{(pid=119128) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 20 11:56:48.814876 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 117/256] 10.222.0.27 () {60 vars in 1163 bytes} [Mon Jun 20 11:56:48 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:48.823471 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b6f297b2-f251-4dd3-b430-e27c570126d2 tempest-AggregatesAdminNegativeTestJSON-961533158 tempest-AggregatesAdminNegativeTestJSON-961533158-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:48.830282 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:48.830282 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:48.834383 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b6f297b2-f251-4dd3-b430-e27c570126d2 tempest-AggregatesAdminNegativeTestJSON-961533158 tempest-AggregatesAdminNegativeTestJSON-961533158-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'f5fcced710cc407dab76987139f966da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da93853b5ab44cb3b3167db2c9d4ad4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:48.837333 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b6f297b2-f251-4dd3-b430-e27c570126d2 tempest-AggregatesAdminNegativeTestJSON-961533158 tempest-AggregatesAdminNegativeTestJSON-961533158-project] Request method failure captured: Jun 20 11:56:48.837333 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/os-aggregates/11 HTTP/1.1 Jun 20 11:56:48.837333 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:56:48.837333 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:56:48.837333 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:56:48.837333 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 11:56:48.837333 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:56:48.837333 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:56:48.837333 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:56:48.837333 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:48.837333 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGBV760t8IGpkViCBI51z0zQvPBOAJjEFImYPXxAffcNHxSrIw-SvdptdPiLYn3mziIKBZLqonNkQMusxjpMegIaoWtm4JOAYbDu_SuX_74hOBiQc3veOCnA15mpTNhCdQAHo5KtQyQK8wSzCLUgpO9QqaU7vyBTAzJLtC-TtYs98GY Jun 20 11:56:48.837333 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:56:48.837333 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:56:48.837333 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:56:48.837333 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:56:48.837333 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:56:48.837333 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:56:48.837333 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: da93853b5ab44cb3b3167db2c9d4ad4d Jun 20 11:56:48.837333 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-961533158 Jun 20 11:56:48.837333 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 11:56:48.837333 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 11:56:48.838768 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da93853b5ab44cb3b3167db2c9d4ad4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da93853b5ab44cb3b3167db2c9d4ad4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da93853b5ab44cb3b3167db2c9d4ad4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da93853b5ab44cb3b3167db2c9d4ad4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:48.838768 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-961533158 Jun 20 11:56:48.838768 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: da93853b5ab44cb3b3167db2c9d4ad4d Jun 20 11:56:48.838768 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-961533158 Jun 20 11:56:48.838768 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-AggregatesAdminNegativeTestJSON-961533158-project Jun 20 11:56:48.838768 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:56:48.838768 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:56:48.838768 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: f5fcced710cc407dab76987139f966da Jun 20 11:56:48.838768 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-961533158-project Jun 20 11:56:48.838768 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 11:56:48.838768 n-d-master-1 devstack@n-api.service[119127]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jun 20 11:56:48.838768 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '11'} Jun 20 11:56:48.839582 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:48.839582 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:48.839582 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:48.839582 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:48.839582 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:48.839582 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:48.839582 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:48.839582 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:48.839582 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Jun 20 11:56:48.839582 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Jun 20 11:56:48.839582 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 20 11:56:48.839582 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 20 11:56:48.839582 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 20 11:56:48.839582 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 20 11:56:48.839582 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 11:56:48.839582 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 11:56:48.839582 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 11:56:48.839582 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 11:56:48.839582 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 20 11:56:48.845192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 20 11:56:48.845192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 20 11:56:48.845192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 20 11:56:48.845192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 20 11:56:48.845192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 20 11:56:48.845192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jun 20 11:56:48.845192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:48.845192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:48.845192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:48.845192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:48.845192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:48.845192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:48.845192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 20 11:56:48.845192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 20 11:56:48.845192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jun 20 11:56:48.845192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:48.845192 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b6f297b2-f251-4dd3-b430-e27c570126d2 tempest-AggregatesAdminNegativeTestJSON-961533158 tempest-AggregatesAdminNegativeTestJSON-961533158-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:48.847179 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b6f297b2-f251-4dd3-b430-e27c570126d2 tempest-AggregatesAdminNegativeTestJSON-961533158 tempest-AggregatesAdminNegativeTestJSON-961533158-project] 10.222.0.27 "GET /compute/v2.1/os-aggregates/11" status: 403 len: 114 microversion: 2.1 time: 0.020607 Jun 20 11:56:48.847179 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 118/257] 10.222.0.27 () {58 vars in 1151 bytes} [Mon Jun 20 11:56:48 2022] GET /compute/v2.1/os-aggregates/11 => generated 114 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:56:48.850849 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-daf97474-5ae8-45a8-96d3-379897410926 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:48.851724 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:48.851724 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:48.865791 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e6559cd1-201b-4ea9-90c1-f86a987647ff tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.088067 Jun 20 11:56:48.872543 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 140/258] 10.222.0.27 () {60 vars in 1163 bytes} [Mon Jun 20 11:56:48 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 11:56:48.882727 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3896d0a1-d20c-4acb-864a-ef43799a9e37 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:48.887802 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:48.887802 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:48.915072 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-daf97474-5ae8-45a8-96d3-379897410926 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.068384 Jun 20 11:56:48.916256 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 119/259] 10.222.0.27 () {58 vars in 1154 bytes} [Mon Jun 20 11:56:48 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 20 11:56:48.947289 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0a6687e6-0e46-44cf-b982-8e88c4831bd5 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:48.949180 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3896d0a1-d20c-4acb-864a-ef43799a9e37 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.071517 Jun 20 11:56:48.950283 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0a6687e6-0e46-44cf-b982-8e88c4831bd5 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f75be1cf-4d20-4ea9-bcbb-b407892a39ee] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:48.954586 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 141/260] 10.222.0.27 () {58 vars in 1154 bytes} [Mon Jun 20 11:56:48 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 20 11:56:48.972935 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-36db6a9c-b82f-4640-97a9-b7bcd6848ddf tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:48.973357 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a6687e6-0e46-44cf-b982-8e88c4831bd5 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:48.974514 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:48.974514 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:48.975404 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a6687e6-0e46-44cf-b982-8e88c4831bd5 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:48.976707 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a6687e6-0e46-44cf-b982-8e88c4831bd5 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:48.978556 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a6687e6-0e46-44cf-b982-8e88c4831bd5 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:48.994916 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-36db6a9c-b82f-4640-97a9-b7bcd6848ddf tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jun 20 11:56:49.000565 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-36db6a9c-b82f-4640-97a9-b7bcd6848ddf tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Request method failure captured: Jun 20 11:56:49.000565 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jun 20 11:56:49.000565 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:56:49.000565 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:56:49.000565 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:56:49.000565 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 11:56:49.000565 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:56:49.000565 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:56:49.000565 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:56:49.000565 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:49.000565 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGBYXn_pnmOl9_-aQXBxZ5Rj3u2wmmQBKrGhim4f18zdlY2TbQSRN57i5YsPfJpl83sJX0v-bqJwWp_aPuS3VR9bHHmHEfmkKpQy0g7jHi1goEFcsNh_Lh1wT6m3MsnYCqYX-krSLR0kGB7AZLVGO_BPzeI-TFqx-uvj8A73xge5HhY Jun 20 11:56:49.000565 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:56:49.000565 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:56:49.000565 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:56:49.000565 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:56:49.000565 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:56:49.000565 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:56:49.000565 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: bba587cbb9ed4336909c69950606a7b5 Jun 20 11:56:49.000565 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1183794404 Jun 20 11:56:49.000565 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member,admin Jun 20 11:56:49.000565 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member,admin Jun 20 11:56:49.001938 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bba587cbb9ed4336909c69950606a7b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bba587cbb9ed4336909c69950606a7b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bba587cbb9ed4336909c69950606a7b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bba587cbb9ed4336909c69950606a7b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:49.001938 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1183794404 Jun 20 11:56:49.001938 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: bba587cbb9ed4336909c69950606a7b5 Jun 20 11:56:49.001938 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1183794404 Jun 20 11:56:49.001938 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin Jun 20 11:56:49.001938 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:56:49.001938 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:56:49.001938 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 11fbf454924c4e11a5aecc649712be85 Jun 20 11:56:49.001938 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin Jun 20 11:56:49.001938 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 11:56:49.001938 n-d-master-1 devstack@n-api.service[119128]: exception: Aggregate -1 could not be found. Jun 20 11:56:49.001938 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '-1'} Jun 20 11:56:49.002861 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:49.002861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:49.002861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jun 20 11:56:49.002861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jun 20 11:56:49.002861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jun 20 11:56:49.002861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jun 20 11:56:49.002861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 11:56:49.002861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 11:56:49.002861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 20 11:56:49.002861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 20 11:56:49.002861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 20 11:56:49.002861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 20 11:56:49.002861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 20 11:56:49.002861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 20 11:56:49.002861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jun 20 11:56:49.002861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:49.002861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:49.002861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:49.002861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:49.002861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:49.004115 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:49.004115 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:49.004115 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:49.004115 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:49.004115 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:49.004115 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jun 20 11:56:49.004115 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:56:49.004115 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jun 20 11:56:49.004115 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:49.004115 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:49.004115 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:49.004115 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:49.004115 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:49.004115 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:49.004115 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:56:49.004115 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:56:49.004115 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jun 20 11:56:49.004115 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:49.007776 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-36db6a9c-b82f-4640-97a9-b7bcd6848ddf tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:49.010372 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-36db6a9c-b82f-4640-97a9-b7bcd6848ddf tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.052005 Jun 20 11:56:49.014049 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 142/261] 10.222.0.27 () {58 vars in 1151 bytes} [Mon Jun 20 11:56:48 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 11:56:49.030234 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bd7498df-c48f-4e81-a4e7-fbebf8a60bda tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:49.052916 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-bd7498df-c48f-4e81-a4e7-fbebf8a60bda tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Jun 20 11:56:49.055579 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bd7498df-c48f-4e81-a4e7-fbebf8a60bda tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Request method failure captured: Jun 20 11:56:49.055579 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Jun 20 11:56:49.055579 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:56:49.055579 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:56:49.055579 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:56:49.055579 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 11:56:49.055579 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:56:49.055579 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:56:49.055579 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:56:49.055579 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:49.055579 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGBXc0K3vs28G_NgOwgkZLnIEN1YAq4v3BuECT5tJ_YN2efe6XfJMoTsQsYvxYxm88V7GZI-vDXNDhvfEOSd28JNlUQ2mN9IRW2xJ6mpYPnhSYAjBqkdRPmDZm4_8qLhrC5GXqkTgMT3Btb8ew0Y7f7OIWwtxHYWf2kZbzBCpf3e8_8 Jun 20 11:56:49.055579 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:56:49.055579 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:56:49.055579 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:56:49.055579 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:56:49.055579 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:56:49.055579 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:56:49.055579 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 485420ac3171457cba258654de2c8ad3 Jun 20 11:56:49.055579 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-AggregatesAdminTestJSON-1556022503 Jun 20 11:56:49.055579 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member,admin Jun 20 11:56:49.055579 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member,admin Jun 20 11:56:49.057202 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/485420ac3171457cba258654de2c8ad3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/485420ac3171457cba258654de2c8ad3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/485420ac3171457cba258654de2c8ad3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_485420ac3171457cba258654de2c8ad3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:49.057202 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-AggregatesAdminTestJSON-1556022503 Jun 20 11:56:49.057202 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 485420ac3171457cba258654de2c8ad3 Jun 20 11:56:49.057202 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1556022503 Jun 20 11:56:49.057202 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-AggregatesAdminTestJSON-1556022503-project-admin Jun 20 11:56:49.057202 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:56:49.057202 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:56:49.057202 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: dbdd9ff22dd546b689a8fa21691b5ddf Jun 20 11:56:49.057202 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-AggregatesAdminTestJSON-1556022503-project-admin Jun 20 11:56:49.057202 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 11:56:49.057202 n-d-master-1 devstack@n-api.service[119128]: exception: Aggregate 12 could not be found. Jun 20 11:56:49.057202 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '12'} Jun 20 11:56:49.057202 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:49.058042 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:49.058042 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jun 20 11:56:49.058042 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jun 20 11:56:49.058042 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jun 20 11:56:49.058042 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jun 20 11:56:49.058042 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 11:56:49.058042 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 11:56:49.058042 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 20 11:56:49.058042 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 20 11:56:49.058042 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 20 11:56:49.058042 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 20 11:56:49.058042 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 20 11:56:49.058042 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 20 11:56:49.058042 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Jun 20 11:56:49.058042 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:49.058042 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:49.058042 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:49.058042 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:49.058042 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:49.059170 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:49.059170 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:49.059170 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:49.059170 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:49.059170 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:49.059170 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jun 20 11:56:49.059170 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:56:49.059170 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Jun 20 11:56:49.059170 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:49.059170 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:49.059170 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:49.059170 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:49.059170 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:49.059170 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:49.059170 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:56:49.059170 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:56:49.059170 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Jun 20 11:56:49.059170 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:49.062663 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bd7498df-c48f-4e81-a4e7-fbebf8a60bda tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:49.066646 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bd7498df-c48f-4e81-a4e7-fbebf8a60bda tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.047987 Jun 20 11:56:49.071382 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 143/262] 10.222.0.27 () {58 vars in 1151 bytes} [Mon Jun 20 11:56:49 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 11:56:49.080878 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ee53f2ca-db4d-4ac6-a0be-32bdbe6f64be tempest-AggregatesAdminNegativeTestJSON-961533158 tempest-AggregatesAdminNegativeTestJSON-961533158-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:49.084295 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:49.084295 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:49.085822 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ee53f2ca-db4d-4ac6-a0be-32bdbe6f64be tempest-AggregatesAdminNegativeTestJSON-961533158 tempest-AggregatesAdminNegativeTestJSON-961533158-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'f5fcced710cc407dab76987139f966da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da93853b5ab44cb3b3167db2c9d4ad4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:49.087843 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ee53f2ca-db4d-4ac6-a0be-32bdbe6f64be tempest-AggregatesAdminNegativeTestJSON-961533158 tempest-AggregatesAdminNegativeTestJSON-961533158-project] Request method failure captured: Jun 20 11:56:49.087843 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Jun 20 11:56:49.087843 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:56:49.087843 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:56:49.087843 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:56:49.087843 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 11:56:49.087843 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:56:49.087843 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:56:49.087843 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:56:49.087843 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:49.087843 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGBV760t8IGpkViCBI51z0zQvPBOAJjEFImYPXxAffcNHxSrIw-SvdptdPiLYn3mziIKBZLqonNkQMusxjpMegIaoWtm4JOAYbDu_SuX_74hOBiQc3veOCnA15mpTNhCdQAHo5KtQyQK8wSzCLUgpO9QqaU7vyBTAzJLtC-TtYs98GY Jun 20 11:56:49.087843 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:56:49.087843 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:56:49.087843 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:56:49.087843 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:56:49.087843 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:56:49.087843 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:56:49.087843 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: da93853b5ab44cb3b3167db2c9d4ad4d Jun 20 11:56:49.087843 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-961533158 Jun 20 11:56:49.087843 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 11:56:49.087843 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 11:56:49.089296 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da93853b5ab44cb3b3167db2c9d4ad4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da93853b5ab44cb3b3167db2c9d4ad4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da93853b5ab44cb3b3167db2c9d4ad4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da93853b5ab44cb3b3167db2c9d4ad4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:49.089296 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-961533158 Jun 20 11:56:49.089296 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: da93853b5ab44cb3b3167db2c9d4ad4d Jun 20 11:56:49.089296 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-961533158 Jun 20 11:56:49.089296 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-AggregatesAdminNegativeTestJSON-961533158-project Jun 20 11:56:49.089296 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:56:49.089296 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:56:49.089296 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: f5fcced710cc407dab76987139f966da Jun 20 11:56:49.089296 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-961533158-project Jun 20 11:56:49.089296 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 11:56:49.089296 n-d-master-1 devstack@n-api.service[119128]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jun 20 11:56:49.089296 n-d-master-1 devstack@n-api.service[119128]: action_args: {} Jun 20 11:56:49.090063 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:49.090063 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:49.090063 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:49.090063 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:49.090063 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:49.090063 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:49.090063 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:49.090063 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:49.090063 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Jun 20 11:56:49.090063 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Jun 20 11:56:49.090063 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 20 11:56:49.090063 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 20 11:56:49.090063 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 20 11:56:49.090063 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 20 11:56:49.090063 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 11:56:49.090063 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 11:56:49.090063 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 11:56:49.090063 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 11:56:49.090063 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 20 11:56:49.091234 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 20 11:56:49.091234 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 20 11:56:49.091234 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 20 11:56:49.091234 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 20 11:56:49.091234 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 20 11:56:49.091234 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jun 20 11:56:49.091234 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:49.091234 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:49.091234 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:49.091234 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:49.091234 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:49.091234 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:49.091234 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 20 11:56:49.091234 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 20 11:56:49.091234 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jun 20 11:56:49.091234 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:49.092929 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=30 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:56:49.094422 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ee53f2ca-db4d-4ac6-a0be-32bdbe6f64be tempest-AggregatesAdminNegativeTestJSON-961533158 tempest-AggregatesAdminNegativeTestJSON-961533158-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:49.095379 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ee53f2ca-db4d-4ac6-a0be-32bdbe6f64be tempest-AggregatesAdminNegativeTestJSON-961533158 tempest-AggregatesAdminNegativeTestJSON-961533158-project] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.022698 Jun 20 11:56:49.103777 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 144/263] 10.222.0.27 () {58 vars in 1142 bytes} [Mon Jun 20 11:56:49 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:56:49.108662 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-89a0bd27-90e0-4af8-94b2-be4dde91f3cf tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:49.109829 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:49.109829 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:49.126430 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-89a0bd27-90e0-4af8-94b2-be4dde91f3cf tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Jun 20 11:56:49.128537 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-89a0bd27-90e0-4af8-94b2-be4dde91f3cf tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Request method failure captured: Jun 20 11:56:49.128537 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Jun 20 11:56:49.128537 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:56:49.128537 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:56:49.128537 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:56:49.128537 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 11:56:49.128537 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:56:49.128537 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:56:49.128537 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:56:49.128537 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:49.128537 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGBXc0K3vs28G_NgOwgkZLnIEN1YAq4v3BuECT5tJ_YN2efe6XfJMoTsQsYvxYxm88V7GZI-vDXNDhvfEOSd28JNlUQ2mN9IRW2xJ6mpYPnhSYAjBqkdRPmDZm4_8qLhrC5GXqkTgMT3Btb8ew0Y7f7OIWwtxHYWf2kZbzBCpf3e8_8 Jun 20 11:56:49.128537 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:56:49.128537 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:56:49.128537 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:56:49.128537 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:56:49.128537 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:56:49.128537 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:56:49.128537 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 485420ac3171457cba258654de2c8ad3 Jun 20 11:56:49.128537 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-AggregatesAdminTestJSON-1556022503 Jun 20 11:56:49.128537 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member,admin Jun 20 11:56:49.128537 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member,admin Jun 20 11:56:49.129983 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/485420ac3171457cba258654de2c8ad3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/485420ac3171457cba258654de2c8ad3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/485420ac3171457cba258654de2c8ad3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_485420ac3171457cba258654de2c8ad3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:49.129983 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-AggregatesAdminTestJSON-1556022503 Jun 20 11:56:49.129983 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 485420ac3171457cba258654de2c8ad3 Jun 20 11:56:49.129983 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1556022503 Jun 20 11:56:49.129983 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-AggregatesAdminTestJSON-1556022503-project-admin Jun 20 11:56:49.129983 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:56:49.129983 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:56:49.129983 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: dbdd9ff22dd546b689a8fa21691b5ddf Jun 20 11:56:49.129983 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-AggregatesAdminTestJSON-1556022503-project-admin Jun 20 11:56:49.129983 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 11:56:49.129983 n-d-master-1 devstack@n-api.service[119128]: exception: Aggregate 12 could not be found. Jun 20 11:56:49.129983 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '12'} Jun 20 11:56:49.129983 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:49.130849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:49.130849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jun 20 11:56:49.130849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jun 20 11:56:49.130849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 20 11:56:49.130849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 20 11:56:49.130849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 11:56:49.130849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 11:56:49.130849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 11:56:49.130849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 11:56:49.130849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 20 11:56:49.130849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 20 11:56:49.130849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jun 20 11:56:49.130849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jun 20 11:56:49.130849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 11:56:49.130849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 11:56:49.130849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 20 11:56:49.130849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 20 11:56:49.130849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 20 11:56:49.130849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 20 11:56:49.132117 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 20 11:56:49.132117 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 20 11:56:49.132117 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Jun 20 11:56:49.132117 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:49.132117 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:49.132117 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:49.132117 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:49.132117 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:49.132117 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:49.132117 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:49.132117 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:49.132117 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:49.132117 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:49.132117 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jun 20 11:56:49.132117 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:56:49.132117 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Jun 20 11:56:49.132117 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:49.132117 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:49.132117 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:49.132117 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:49.132117 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:49.133393 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:49.133393 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:56:49.133393 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:56:49.133393 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Jun 20 11:56:49.133393 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:49.134984 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-89a0bd27-90e0-4af8-94b2-be4dde91f3cf tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:49.137720 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-89a0bd27-90e0-4af8-94b2-be4dde91f3cf tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.032896 Jun 20 11:56:49.140584 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 145/264] 10.222.0.27 () {58 vars in 1154 bytes} [Mon Jun 20 11:56:49 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 11:56:49.159546 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d45db424-20e4-4586-9657-b0643b4be7f8 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1057298752"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:49.168340 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:49.168340 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:49.172480 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.aggregate [None req-d45db424-20e4-4586-9657-b0643b4be7f8 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Generated uuid 37d93fb3-ca68-43e3-8f9c-b799ba43dc1b for aggregate {{(pid=119128) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 20 11:56:49.219634 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d45db424-20e4-4586-9657-b0643b4be7f8 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.073346 Jun 20 11:56:49.221559 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 146/265] 10.222.0.27 () {60 vars in 1163 bytes} [Mon Jun 20 11:56:49 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:49.243437 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-02f84988-c601-4fed-85bb-c12ec8d2170c tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-956572199", "name": "tempest-test_aggregate-952740870"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:49.246094 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:49.246094 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:49.249405 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.aggregate [None req-02f84988-c601-4fed-85bb-c12ec8d2170c tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Generated uuid b05b40b1-537a-47ad-9018-c77cbf84d6d5 for aggregate {{(pid=119128) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 20 11:56:49.329846 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-02f84988-c601-4fed-85bb-c12ec8d2170c tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.106812 Jun 20 11:56:49.332179 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 147/266] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Jun 20 11:56:49 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:49.343156 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b491c198-5ba3-4883-916d-f53bbc2a4dfe tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:49.345098 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:49.345098 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:49.361472 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b491c198-5ba3-4883-916d-f53bbc2a4dfe tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:49.362282 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b491c198-5ba3-4883-916d-f53bbc2a4dfe tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:49.378302 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=10,nova_api:DELETE=10 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:56:49.577147 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b491c198-5ba3-4883-916d-f53bbc2a4dfe tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 243 microversion: 2.1 time: 0.239781 Jun 20 11:56:49.578453 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 148/267] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Jun 20 11:56:49 2022] POST /compute/v2.1/os-aggregates/13/action => generated 243 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:49.584848 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d6d7206a-49f2-4c80-9f9b-bfb9b9e33803 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:49.585987 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:49.585987 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:49.619124 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0a6687e6-0e46-44cf-b982-8e88c4831bd5 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:49.626752 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d6d7206a-49f2-4c80-9f9b-bfb9b9e33803 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.046706 Jun 20 11:56:49.630141 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 149/268] 10.222.0.27 () {58 vars in 1154 bytes} [Mon Jun 20 11:56:49 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 20 11:56:49.639015 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0a6687e6-0e46-44cf-b982-8e88c4831bd5 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee" status: 200 len: 1318 microversion: 2.1 time: 0.719152 Jun 20 11:56:49.639881 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 120/269] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:48 2022] GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee => generated 1318 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:49.650182 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-db6e0e3b-ac00-4904-844b-87bb80de82a0 req-d59cc7ba-a4f1-446d-acb1-6849fc927cae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f75be1cf-4d20-4ea9-bcbb-b407892a39ee", "name": "network-vif-plugged", "status": "completed", "tag": "c3bed4a9-e3ea-430b-925d-8d2500a2726f"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:49.656119 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-20290dd7-3e5a-4f11-a209-1abcec0bdd3c tempest-AggregatesAdminNegativeTestJSON-961533158 tempest-AggregatesAdminNegativeTestJSON-961533158-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:49.667295 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:49.667295 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:49.674104 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-db6e0e3b-ac00-4904-844b-87bb80de82a0 req-d59cc7ba-a4f1-446d-acb1-6849fc927cae service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:49.675728 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-20290dd7-3e5a-4f11-a209-1abcec0bdd3c tempest-AggregatesAdminNegativeTestJSON-961533158 tempest-AggregatesAdminNegativeTestJSON-961533158-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'f5fcced710cc407dab76987139f966da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da93853b5ab44cb3b3167db2c9d4ad4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:49.677571 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-20290dd7-3e5a-4f11-a209-1abcec0bdd3c tempest-AggregatesAdminNegativeTestJSON-961533158 tempest-AggregatesAdminNegativeTestJSON-961533158-project] Request method failure captured: Jun 20 11:56:49.677571 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Jun 20 11:56:49.677571 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:56:49.677571 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:56:49.677571 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:56:49.677571 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 42 Jun 20 11:56:49.677571 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:56:49.677571 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:56:49.677571 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:56:49.677571 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:49.677571 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGBV760t8IGpkViCBI51z0zQvPBOAJjEFImYPXxAffcNHxSrIw-SvdptdPiLYn3mziIKBZLqonNkQMusxjpMegIaoWtm4JOAYbDu_SuX_74hOBiQc3veOCnA15mpTNhCdQAHo5KtQyQK8wSzCLUgpO9QqaU7vyBTAzJLtC-TtYs98GY Jun 20 11:56:49.677571 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:56:49.677571 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:56:49.677571 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:56:49.677571 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:56:49.677571 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:56:49.677571 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:56:49.677571 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: da93853b5ab44cb3b3167db2c9d4ad4d Jun 20 11:56:49.677571 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-961533158 Jun 20 11:56:49.677571 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 11:56:49.677571 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 11:56:49.679666 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da93853b5ab44cb3b3167db2c9d4ad4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da93853b5ab44cb3b3167db2c9d4ad4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da93853b5ab44cb3b3167db2c9d4ad4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da93853b5ab44cb3b3167db2c9d4ad4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:49.679666 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-961533158 Jun 20 11:56:49.679666 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: da93853b5ab44cb3b3167db2c9d4ad4d Jun 20 11:56:49.679666 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-961533158 Jun 20 11:56:49.679666 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-AggregatesAdminNegativeTestJSON-961533158-project Jun 20 11:56:49.679666 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:56:49.679666 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:56:49.679666 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: f5fcced710cc407dab76987139f966da Jun 20 11:56:49.679666 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-961533158-project Jun 20 11:56:49.679666 n-d-master-1 devstack@n-api.service[119127]: Jun 20 11:56:49.679666 n-d-master-1 devstack@n-api.service[119127]: {"remove_host": {"host": "n-h1-master-1"}} Jun 20 11:56:49.679666 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 11:56:49.679666 n-d-master-1 devstack@n-api.service[119127]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jun 20 11:56:49.681075 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'n-h1-master-1'}}} Jun 20 11:56:49.681075 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:49.681075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:49.681075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:49.681075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:49.681075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:49.681075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:49.681075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:49.681075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:49.681075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:56:49.681075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:56:49.681075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Jun 20 11:56:49.681075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Jun 20 11:56:49.681075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 20 11:56:49.681075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 20 11:56:49.681075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 20 11:56:49.681075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 20 11:56:49.681075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 11:56:49.681075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 11:56:49.682434 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 11:56:49.682434 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 11:56:49.682434 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 20 11:56:49.682434 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 20 11:56:49.682434 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 20 11:56:49.682434 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 20 11:56:49.682434 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 20 11:56:49.682434 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 20 11:56:49.682434 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jun 20 11:56:49.682434 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:49.682434 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:49.682434 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:49.682434 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:49.682434 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:49.682434 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:49.682434 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 20 11:56:49.682434 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 20 11:56:49.682434 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jun 20 11:56:49.682434 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:49.684618 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-20290dd7-3e5a-4f11-a209-1abcec0bdd3c tempest-AggregatesAdminNegativeTestJSON-961533158 tempest-AggregatesAdminNegativeTestJSON-961533158-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:49.684618 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-20290dd7-3e5a-4f11-a209-1abcec0bdd3c tempest-AggregatesAdminNegativeTestJSON-961533158 tempest-AggregatesAdminNegativeTestJSON-961533158-project] 10.222.0.27 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.027881 Jun 20 11:56:49.684618 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 121/270] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Jun 20 11:56:49 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:56:49.685812 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-db6e0e3b-ac00-4904-844b-87bb80de82a0 req-d59cc7ba-a4f1-446d-acb1-6849fc927cae service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:49.697668 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-420e4e05-cb76-4b1c-87f3-cd69283912fb tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:49.698959 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:49.698959 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:49.723581 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-db6e0e3b-ac00-4904-844b-87bb80de82a0 req-d59cc7ba-a4f1-446d-acb1-6849fc927cae service nova] Creating event network-vif-plugged:c3bed4a9-e3ea-430b-925d-8d2500a2726f for instance f75be1cf-4d20-4ea9-bcbb-b407892a39ee on n-h2-master-1 Jun 20 11:56:49.726717 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-420e4e05-cb76-4b1c-87f3-cd69283912fb tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Jun 20 11:56:49.730876 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-420e4e05-cb76-4b1c-87f3-cd69283912fb tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Request method failure captured: Jun 20 11:56:49.730876 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Jun 20 11:56:49.730876 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:56:49.730876 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:56:49.730876 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:56:49.730876 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 11:56:49.730876 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:56:49.730876 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:56:49.730876 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:56:49.730876 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:49.730876 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGBXc0K3vs28G_NgOwgkZLnIEN1YAq4v3BuECT5tJ_YN2efe6XfJMoTsQsYvxYxm88V7GZI-vDXNDhvfEOSd28JNlUQ2mN9IRW2xJ6mpYPnhSYAjBqkdRPmDZm4_8qLhrC5GXqkTgMT3Btb8ew0Y7f7OIWwtxHYWf2kZbzBCpf3e8_8 Jun 20 11:56:49.730876 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:56:49.730876 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:56:49.730876 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:56:49.730876 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:56:49.730876 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:56:49.730876 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:56:49.730876 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 485420ac3171457cba258654de2c8ad3 Jun 20 11:56:49.730876 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-AggregatesAdminTestJSON-1556022503 Jun 20 11:56:49.730876 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member,admin Jun 20 11:56:49.730876 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member,admin Jun 20 11:56:49.732025 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/485420ac3171457cba258654de2c8ad3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/485420ac3171457cba258654de2c8ad3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/485420ac3171457cba258654de2c8ad3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_485420ac3171457cba258654de2c8ad3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:49.732025 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-AggregatesAdminTestJSON-1556022503 Jun 20 11:56:49.732025 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 485420ac3171457cba258654de2c8ad3 Jun 20 11:56:49.732025 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1556022503 Jun 20 11:56:49.732025 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-AggregatesAdminTestJSON-1556022503-project-admin Jun 20 11:56:49.732025 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:56:49.732025 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:56:49.732025 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: dbdd9ff22dd546b689a8fa21691b5ddf Jun 20 11:56:49.732025 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-AggregatesAdminTestJSON-1556022503-project-admin Jun 20 11:56:49.732025 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 11:56:49.732025 n-d-master-1 devstack@n-api.service[119127]: exception: Aggregate 14 could not be found. Jun 20 11:56:49.732025 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '14'} Jun 20 11:56:49.732025 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:49.732754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:49.732754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jun 20 11:56:49.732754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jun 20 11:56:49.732754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jun 20 11:56:49.732754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jun 20 11:56:49.732754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 11:56:49.732754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 11:56:49.732754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 20 11:56:49.732754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 20 11:56:49.732754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 20 11:56:49.732754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 20 11:56:49.732754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 20 11:56:49.732754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 20 11:56:49.732754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Jun 20 11:56:49.732754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:49.732754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:49.732754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:49.732754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:49.732754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:49.733867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:49.733867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:49.733867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:49.733867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:49.733867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:49.733867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jun 20 11:56:49.733867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:56:49.733867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Jun 20 11:56:49.733867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:49.733867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:49.733867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:49.733867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:49.733867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:49.733867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:49.733867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:56:49.733867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:56:49.733867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Jun 20 11:56:49.733867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:49.737579 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-420e4e05-cb76-4b1c-87f3-cd69283912fb tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:49.738661 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-420e4e05-cb76-4b1c-87f3-cd69283912fb tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.058135 Jun 20 11:56:49.739987 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 122/271] 10.222.0.27 () {58 vars in 1151 bytes} [Mon Jun 20 11:56:49 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 11:56:49.744909 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-db6e0e3b-ac00-4904-844b-87bb80de82a0 req-d59cc7ba-a4f1-446d-acb1-6849fc927cae service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113323 Jun 20 11:56:49.751651 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 150/272] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:49.751836 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b9b04f54-baea-4719-9065-6cd93548c886 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:49.758541 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-23454aed-fee9-4312-b45b-b981e844b5e6 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:49.759339 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-23454aed-fee9-4312-b45b-b981e844b5e6 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: c5afa776-6f61-4b7a-b586-c5047b5fbe5e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:49.770001 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b9b04f54-baea-4719-9065-6cd93548c886 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:49.770783 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b9b04f54-baea-4719-9065-6cd93548c886 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:49.779947 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23454aed-fee9-4312-b45b-b981e844b5e6 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:49.780477 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23454aed-fee9-4312-b45b-b981e844b5e6 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:49.781448 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23454aed-fee9-4312-b45b-b981e844b5e6 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:49.781935 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23454aed-fee9-4312-b45b-b981e844b5e6 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:50.039015 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b9b04f54-baea-4719-9065-6cd93548c886 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 228 microversion: 2.1 time: 0.293589 Jun 20 11:56:50.040543 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 123/273] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Jun 20 11:56:49 2022] POST /compute/v2.1/os-aggregates/13/action => generated 228 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:50.055629 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a22193f1-d33c-4f78-80d4-73e186f6fa11 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:50.056736 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:50.056736 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:50.072129 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-a22193f1-d33c-4f78-80d4-73e186f6fa11 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Jun 20 11:56:50.074208 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a22193f1-d33c-4f78-80d4-73e186f6fa11 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Request method failure captured: Jun 20 11:56:50.074208 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Jun 20 11:56:50.074208 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:56:50.074208 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:56:50.074208 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:56:50.074208 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 11:56:50.074208 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:56:50.074208 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:56:50.074208 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:56:50.074208 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:50.074208 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGBXc0K3vs28G_NgOwgkZLnIEN1YAq4v3BuECT5tJ_YN2efe6XfJMoTsQsYvxYxm88V7GZI-vDXNDhvfEOSd28JNlUQ2mN9IRW2xJ6mpYPnhSYAjBqkdRPmDZm4_8qLhrC5GXqkTgMT3Btb8ew0Y7f7OIWwtxHYWf2kZbzBCpf3e8_8 Jun 20 11:56:50.074208 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:56:50.074208 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:56:50.074208 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:56:50.074208 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:56:50.074208 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:56:50.074208 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:56:50.074208 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 485420ac3171457cba258654de2c8ad3 Jun 20 11:56:50.074208 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-AggregatesAdminTestJSON-1556022503 Jun 20 11:56:50.074208 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member,admin Jun 20 11:56:50.074208 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member,admin Jun 20 11:56:50.075351 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/485420ac3171457cba258654de2c8ad3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/485420ac3171457cba258654de2c8ad3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/485420ac3171457cba258654de2c8ad3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_485420ac3171457cba258654de2c8ad3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:50.075351 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-AggregatesAdminTestJSON-1556022503 Jun 20 11:56:50.075351 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 485420ac3171457cba258654de2c8ad3 Jun 20 11:56:50.075351 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1556022503 Jun 20 11:56:50.075351 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-AggregatesAdminTestJSON-1556022503-project-admin Jun 20 11:56:50.075351 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:56:50.075351 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:56:50.075351 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: dbdd9ff22dd546b689a8fa21691b5ddf Jun 20 11:56:50.075351 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-AggregatesAdminTestJSON-1556022503-project-admin Jun 20 11:56:50.075351 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 11:56:50.075351 n-d-master-1 devstack@n-api.service[119127]: exception: Aggregate 14 could not be found. Jun 20 11:56:50.075351 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '14'} Jun 20 11:56:50.075351 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:50.076072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:50.076072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jun 20 11:56:50.076072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jun 20 11:56:50.076072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 20 11:56:50.076072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 20 11:56:50.076072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 11:56:50.076072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 11:56:50.076072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 11:56:50.076072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 11:56:50.076072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 20 11:56:50.076072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 20 11:56:50.076072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jun 20 11:56:50.076072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jun 20 11:56:50.076072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 11:56:50.076072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 11:56:50.076072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 20 11:56:50.076072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 20 11:56:50.076072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 20 11:56:50.076072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 20 11:56:50.077127 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 20 11:56:50.077127 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 20 11:56:50.077127 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Jun 20 11:56:50.077127 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:50.077127 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:50.077127 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:50.077127 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:50.077127 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:50.077127 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:50.077127 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:50.077127 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:50.077127 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:50.077127 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:50.077127 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jun 20 11:56:50.077127 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:56:50.077127 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Jun 20 11:56:50.077127 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:50.077127 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:50.077127 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:50.077127 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:50.077127 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:50.078540 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:50.078540 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:56:50.078540 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:56:50.078540 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Jun 20 11:56:50.078540 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:50.080933 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a22193f1-d33c-4f78-80d4-73e186f6fa11 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:50.082196 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a22193f1-d33c-4f78-80d4-73e186f6fa11 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.033350 Jun 20 11:56:50.088551 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 124/274] 10.222.0.27 () {58 vars in 1154 bytes} [Mon Jun 20 11:56:50 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 11:56:50.094680 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6c834694-0687-4838-adb1-9d5072b5cf3a tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:50.133117 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6c834694-0687-4838-adb1-9d5072b5cf3a tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.041342 Jun 20 11:56:50.140615 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 125/275] 10.222.0.27 () {58 vars in 1154 bytes} [Mon Jun 20 11:56:50 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 20 11:56:50.149154 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-eb8eb9af-fb73-40ce-a7a4-62d00b256496 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1117271983"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:50.153638 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:50.153638 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:50.156818 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.aggregate [None req-eb8eb9af-fb73-40ce-a7a4-62d00b256496 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Generated uuid 6ca9b6c6-99f2-43d0-8876-783c5aeed5a4 for aggregate {{(pid=119127) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 20 11:56:50.164062 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-23454aed-fee9-4312-b45b-b981e844b5e6 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:50.178019 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-23454aed-fee9-4312-b45b-b981e844b5e6 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/c5afa776-6f61-4b7a-b586-c5047b5fbe5e" status: 200 len: 1317 microversion: 2.1 time: 0.424927 Jun 20 11:56:50.181053 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 151/276] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:49 2022] GET /compute/v2.1/servers/c5afa776-6f61-4b7a-b586-c5047b5fbe5e => generated 1317 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:50.186280 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ff7ee393-3c1b-45aa-b2f8-dc5dead284e6 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-705979540"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:50.188737 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:50.188737 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:50.190614 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.aggregate [None req-ff7ee393-3c1b-45aa-b2f8-dc5dead284e6 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Generated uuid da17f716-9c94-48dc-a5e2-fc85b8d75901 for aggregate {{(pid=119128) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 20 11:56:50.206407 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-eb8eb9af-fb73-40ce-a7a4-62d00b256496 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.064244 Jun 20 11:56:50.208992 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 126/277] 10.222.0.27 () {60 vars in 1163 bytes} [Mon Jun 20 11:56:50 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:50.221612 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ff7ee393-3c1b-45aa-b2f8-dc5dead284e6 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.039152 Jun 20 11:56:50.222828 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 152/278] 10.222.0.27 () {60 vars in 1163 bytes} [Mon Jun 20 11:56:50 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:50.227136 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8c7340ec-589b-4ab9-b14e-5ee1d4a57e18 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:50.228321 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:50.228321 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:50.234569 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4dd2928b-02e3-4bf5-9755-98a493e64924 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:50.237096 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:50.237096 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:50.251850 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8c7340ec-589b-4ab9-b14e-5ee1d4a57e18 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 228 microversion: 2.1 time: 0.035556 Jun 20 11:56:50.256703 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 127/279] 10.222.0.27 () {58 vars in 1151 bytes} [Mon Jun 20 11:56:50 2022] GET /compute/v2.1/os-aggregates/15 => generated 228 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:50.257377 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4dd2928b-02e3-4bf5-9755-98a493e64924 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:50.258123 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4dd2928b-02e3-4bf5-9755-98a493e64924 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:50.264882 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=29 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:56:50.269582 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1c6fa784-5941-4d4c-bc38-30f5721d9a6c tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:50.270069 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4dd2928b-02e3-4bf5-9755-98a493e64924 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:50.270664 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4dd2928b-02e3-4bf5-9755-98a493e64924 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:50.271392 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:50.271392 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:50.283090 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.compute.aggregates [None req-4dd2928b-02e3-4bf5-9755-98a493e64924 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Failed to remove host nonexist_host from aggregate 16. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jun 20 11:56:50.284765 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-4dd2928b-02e3-4bf5-9755-98a493e64924 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 16 Jun 20 11:56:50.287424 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4dd2928b-02e3-4bf5-9755-98a493e64924 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Request method failure captured: Jun 20 11:56:50.287424 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/os-aggregates/16/action HTTP/1.1 Jun 20 11:56:50.287424 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:56:50.287424 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:56:50.287424 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:56:50.287424 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 42 Jun 20 11:56:50.287424 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:56:50.287424 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:56:50.287424 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:56:50.287424 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:50.287424 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGBYXn_pnmOl9_-aQXBxZ5Rj3u2wmmQBKrGhim4f18zdlY2TbQSRN57i5YsPfJpl83sJX0v-bqJwWp_aPuS3VR9bHHmHEfmkKpQy0g7jHi1goEFcsNh_Lh1wT6m3MsnYCqYX-krSLR0kGB7AZLVGO_BPzeI-TFqx-uvj8A73xge5HhY Jun 20 11:56:50.287424 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:56:50.287424 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:56:50.287424 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:56:50.287424 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:56:50.287424 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:56:50.287424 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:56:50.287424 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: bba587cbb9ed4336909c69950606a7b5 Jun 20 11:56:50.287424 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1183794404 Jun 20 11:56:50.287424 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member,admin Jun 20 11:56:50.287424 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member,admin Jun 20 11:56:50.289159 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bba587cbb9ed4336909c69950606a7b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bba587cbb9ed4336909c69950606a7b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bba587cbb9ed4336909c69950606a7b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bba587cbb9ed4336909c69950606a7b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:50.289159 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1183794404 Jun 20 11:56:50.289159 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: bba587cbb9ed4336909c69950606a7b5 Jun 20 11:56:50.289159 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1183794404 Jun 20 11:56:50.289159 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin Jun 20 11:56:50.289159 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:56:50.289159 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:56:50.289159 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 11fbf454924c4e11a5aecc649712be85 Jun 20 11:56:50.289159 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin Jun 20 11:56:50.289159 n-d-master-1 devstack@n-api.service[119128]: Jun 20 11:56:50.289159 n-d-master-1 devstack@n-api.service[119128]: {"remove_host": {"host": "nonexist_host"}} Jun 20 11:56:50.289159 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 11:56:50.289159 n-d-master-1 devstack@n-api.service[119128]: exception: Cannot remove host nonexist_host in aggregate 16 Jun 20 11:56:50.290064 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '16', 'body': {'remove_host': {'host': 'nonexist_host'}}} Jun 20 11:56:50.290064 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:50.290064 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:50.290064 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jun 20 11:56:50.290064 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jun 20 11:56:50.290064 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 11:56:50.290064 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 11:56:50.290064 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 20 11:56:50.290064 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 20 11:56:50.290064 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 20 11:56:50.290064 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 20 11:56:50.290064 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 20 11:56:50.290064 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 20 11:56:50.290064 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Jun 20 11:56:50.290064 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:50.290064 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:50.290064 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:50.290064 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:50.290064 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jun 20 11:56:50.290064 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jun 20 11:56:50.291433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jun 20 11:56:50.291433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jun 20 11:56:50.291433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jun 20 11:56:50.291433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:50.291433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:50.291433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:50.291433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:50.291433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Jun 20 11:56:50.291433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Jun 20 11:56:50.291433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 20 11:56:50.291433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 20 11:56:50.291433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 11:56:50.291433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 11:56:50.291433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 11:56:50.291433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 11:56:50.291433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 20 11:56:50.291433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 20 11:56:50.291433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6555, in remove_host_from_aggregate Jun 20 11:56:50.291433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Jun 20 11:56:50.291433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jun 20 11:56:50.292734 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jun 20 11:56:50.292734 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jun 20 11:56:50.292734 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:50.292734 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:50.292734 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:50.292734 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:50.292734 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:50.292734 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:50.292734 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:50.292734 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:50.292734 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:50.292734 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:50.292734 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:56:50.292734 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:56:50.292734 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Jun 20 11:56:50.292734 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 20 11:56:50.292734 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 16 Jun 20 11:56:50.292734 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:50.292734 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:50.292734 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:50.292734 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:50.294594 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:50.294594 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:50.294594 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:56:50.294594 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:56:50.294594 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 16 Jun 20 11:56:50.294594 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:50.297505 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4dd2928b-02e3-4bf5-9755-98a493e64924 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 16 {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:50.299295 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4dd2928b-02e3-4bf5-9755-98a493e64924 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/16/action" status: 404 len: 94 microversion: 2.1 time: 0.070029 Jun 20 11:56:50.303841 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 153/280] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Jun 20 11:56:50 2022] POST /compute/v2.1/os-aggregates/16/action => generated 94 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 11:56:50.310990 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3813710a-bb31-41e8-b501-cf69422be909 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:50.312277 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:50.312277 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:50.335744 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1c6fa784-5941-4d4c-bc38-30f5721d9a6c tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 266 microversion: 2.1 time: 0.073403 Jun 20 11:56:50.338148 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 128/281] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Jun 20 11:56:50 2022] POST /compute/v2.1/os-aggregates/15/action => generated 266 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:50.346596 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3813710a-bb31-41e8-b501-cf69422be909 tempest-AggregatesAdminNegativeTestJSON-1183794404 tempest-AggregatesAdminNegativeTestJSON-1183794404-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.041193 Jun 20 11:56:50.352093 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 154/282] 10.222.0.27 () {58 vars in 1154 bytes} [Mon Jun 20 11:56:50 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 20 11:56:50.364177 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-150d7c9a-6592-4ab5-bb26-306d566b1c6e tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:50.366797 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:50.366797 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:50.381377 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-150d7c9a-6592-4ab5-bb26-306d566b1c6e tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 242 microversion: 2.1 time: 0.027551 Jun 20 11:56:50.381964 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 129/283] 10.222.0.27 () {58 vars in 1151 bytes} [Mon Jun 20 11:56:50 2022] GET /compute/v2.1/os-aggregates/15 => generated 242 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:50.392976 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9dabc7c0-7595-4059-945b-a42f241279c0 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:50.393916 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:50.393916 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:50.417411 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9dabc7c0-7595-4059-945b-a42f241279c0 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.028834 Jun 20 11:56:50.418626 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 155/284] 10.222.0.27 () {58 vars in 1154 bytes} [Mon Jun 20 11:56:50 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jun 20 11:56:50.428024 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2a29c366-bcdd-4819-89ab-851d0460a57b tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2111636755", "availability_zone": "tempest-test_az-54932535"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:50.451075 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:50.451075 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:50.452778 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.aggregate [None req-2a29c366-bcdd-4819-89ab-851d0460a57b tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Generated uuid 7a41e26a-fbd0-4c8d-af95-c2aa0fd9204d for aggregate {{(pid=119127) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 20 11:56:50.509382 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2a29c366-bcdd-4819-89ab-851d0460a57b tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.084811 Jun 20 11:56:50.511410 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 130/285] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Jun 20 11:56:50 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:50.522895 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-da046800-219e-42b8-9970-96f503c98cf9 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2111636755_new", "availability_zone": "tempest-test_az-54932535_new"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:50.525704 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:50.525704 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:50.572136 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-da046800-219e-42b8-9970-96f503c98cf9 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:50.573382 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-da046800-219e-42b8-9970-96f503c98cf9 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:50.633192 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-da046800-219e-42b8-9970-96f503c98cf9 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 333 microversion: 2.1 time: 0.114779 Jun 20 11:56:50.641698 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 156/286] 10.222.0.27 () {60 vars in 1172 bytes} [Mon Jun 20 11:56:50 2022] PUT /compute/v2.1/os-aggregates/17 => generated 333 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:50.646215 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f40d3884-224f-4f30-a330-c1f7c07365cb tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:50.646965 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:50.646965 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:50.666588 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d792cdf5-049b-45d1-b6f1-e82b8c1b9b7e tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:50.667930 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d792cdf5-049b-45d1-b6f1-e82b8c1b9b7e tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f75be1cf-4d20-4ea9-bcbb-b407892a39ee] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:50.670170 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f40d3884-224f-4f30-a330-c1f7c07365cb tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 336 microversion: 2.1 time: 0.027675 Jun 20 11:56:50.674277 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 131/287] 10.222.0.27 () {58 vars in 1142 bytes} [Mon Jun 20 11:56:50 2022] GET /compute/v2.1/os-aggregates => generated 336 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:50.686744 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-eedbd335-089a-4d50-a798-b3bd96b47d30 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:50.691046 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:50.691046 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:50.697416 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d792cdf5-049b-45d1-b6f1-e82b8c1b9b7e tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:50.697972 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d792cdf5-049b-45d1-b6f1-e82b8c1b9b7e tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:50.703042 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d792cdf5-049b-45d1-b6f1-e82b8c1b9b7e tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:50.703684 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d792cdf5-049b-45d1-b6f1-e82b8c1b9b7e tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:50.746798 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-eedbd335-089a-4d50-a798-b3bd96b47d30 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.064777 Jun 20 11:56:50.749474 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 132/288] 10.222.0.27 () {58 vars in 1154 bytes} [Mon Jun 20 11:56:50 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 20 11:56:50.766417 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-183b584c-4812-4c4d-bc65-5d2515c3b3a7 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-931550619"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:50.771135 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:50.771135 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:50.780414 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.aggregate [None req-183b584c-4812-4c4d-bc65-5d2515c3b3a7 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Generated uuid 3df7e4e9-d6c5-4315-9044-d067dd4085f9 for aggregate {{(pid=119127) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 20 11:56:50.843791 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-183b584c-4812-4c4d-bc65-5d2515c3b3a7 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.087109 Jun 20 11:56:50.854404 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 133/289] 10.222.0.27 () {60 vars in 1163 bytes} [Mon Jun 20 11:56:50 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:50.865101 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f86344c0-afa2-4ebb-b9fb-ab986d4ddd54 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:50.868299 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:50.868299 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:50.885172 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f86344c0-afa2-4ebb-b9fb-ab986d4ddd54 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.026220 Jun 20 11:56:50.894401 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 134/290] 10.222.0.27 () {58 vars in 1142 bytes} [Mon Jun 20 11:56:50 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:50.899612 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-06d0dd84-a9ff-442d-a1e9-17cf9e813cc3 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:50.903060 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:50.903060 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:50.908562 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d792cdf5-049b-45d1-b6f1-e82b8c1b9b7e tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:50.919511 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d792cdf5-049b-45d1-b6f1-e82b8c1b9b7e tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee" status: 200 len: 1318 microversion: 2.1 time: 0.264897 Jun 20 11:56:50.920822 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 157/291] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:50 2022] GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:56:50.957020 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-06d0dd84-a9ff-442d-a1e9-17cf9e813cc3 tempest-AggregatesAdminTestJSON-1556022503 tempest-AggregatesAdminTestJSON-1556022503-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.061119 Jun 20 11:56:50.962508 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 135/292] 10.222.0.27 () {58 vars in 1154 bytes} [Mon Jun 20 11:56:50 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 20 11:56:50.968057 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-707ba64a-3c70-4241-9eb9-0cfdabc7ff0e tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:50.969046 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-707ba64a-3c70-4241-9eb9-0cfdabc7ff0e tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] [instance: 69a2418e-ab69-4e7b-a243-365951169370] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:50.977822 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-707ba64a-3c70-4241-9eb9-0cfdabc7ff0e tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:50.978541 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-707ba64a-3c70-4241-9eb9-0cfdabc7ff0e tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:50.979540 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-707ba64a-3c70-4241-9eb9-0cfdabc7ff0e tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:50.980155 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-707ba64a-3c70-4241-9eb9-0cfdabc7ff0e tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:51.000927 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-707ba64a-3c70-4241-9eb9-0cfdabc7ff0e tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] HTTP exception thrown: Instance 69a2418e-ab69-4e7b-a243-365951169370 could not be found. Jun 20 11:56:51.003997 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-707ba64a-3c70-4241-9eb9-0cfdabc7ff0e tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Request method failure captured: Jun 20 11:56:51.003997 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370 HTTP/1.1 Jun 20 11:56:51.003997 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:56:51.003997 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:56:51.003997 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:56:51.003997 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 11:56:51.003997 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:56:51.003997 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:56:51.003997 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:56:51.003997 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:51.003997 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGBVlNA1dQYh3tJPd2oEZb_DLj2c5lYzrHOLqgIZzf-nAfxST3TnT6kQfIbYPOCYMi_QcZh5bKYPhxLocp6V81eXEKr4y3jjlkkozMKg2iKSGpSrlL-Tt5DDAGCnXXp9l-3ExJohKjnqW2yJo75lgQbdasTVwgEOC-NAFRjfZ_PxmJ0 Jun 20 11:56:51.003997 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:56:51.003997 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:56:51.003997 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:56:51.003997 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:56:51.003997 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:56:51.003997 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:56:51.003997 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: c671077727e44ef8ba72fe3ffdfa15eb Jun 20 11:56:51.003997 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-AggregatesAdminTestJSON-1880636502 Jun 20 11:56:51.003997 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 11:56:51.003997 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 11:56:51.005764 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c671077727e44ef8ba72fe3ffdfa15eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c671077727e44ef8ba72fe3ffdfa15eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c671077727e44ef8ba72fe3ffdfa15eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c671077727e44ef8ba72fe3ffdfa15eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:51.005764 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-AggregatesAdminTestJSON-1880636502 Jun 20 11:56:51.005764 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: c671077727e44ef8ba72fe3ffdfa15eb Jun 20 11:56:51.005764 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1880636502 Jun 20 11:56:51.005764 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-AggregatesAdminTestJSON-1880636502-project Jun 20 11:56:51.005764 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:56:51.005764 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:56:51.005764 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 93cf53cbece54a978bdab523d015313d Jun 20 11:56:51.005764 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-AggregatesAdminTestJSON-1880636502-project Jun 20 11:56:51.005764 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 11:56:51.005764 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 69a2418e-ab69-4e7b-a243-365951169370 could not be found. Jun 20 11:56:51.005764 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '69a2418e-ab69-4e7b-a243-365951169370'} Jun 20 11:56:51.006559 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:51.006559 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:51.006559 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:56:51.006559 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:56:51.006559 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:56:51.006559 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:56:51.006559 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:56:51.006559 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:56:51.006559 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:56:51.006559 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:56:51.006559 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69a2418e-ab69-4e7b-a243-365951169370 could not be found. Jun 20 11:56:51.006559 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:51.006559 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:51.006559 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:51.006559 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:51.006559 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:51.006559 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:51.006559 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:51.006559 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:51.006559 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:51.007953 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:51.007953 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 11:56:51.007953 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 11:56:51.007953 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 11:56:51.007953 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 11:56:51.007953 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:56:51.007953 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:56:51.007953 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:56:51.007953 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:56:51.007953 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69a2418e-ab69-4e7b-a243-365951169370 could not be found. Jun 20 11:56:51.007953 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:51.007953 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:51.007953 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:51.007953 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:51.007953 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:51.007953 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:51.007953 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:56:51.007953 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:56:51.007953 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69a2418e-ab69-4e7b-a243-365951169370 could not be found. Jun 20 11:56:51.007953 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:51.011167 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-707ba64a-3c70-4241-9eb9-0cfdabc7ff0e tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Returning 404 to user: Instance 69a2418e-ab69-4e7b-a243-365951169370 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:51.012964 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-707ba64a-3c70-4241-9eb9-0cfdabc7ff0e tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] 10.222.0.27 "DELETE /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370" status: 404 len: 111 microversion: 2.1 time: 0.049333 Jun 20 11:56:51.014325 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 158/293] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 11:56:50 2022] DELETE /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:56:51.024886 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0b231aaa-219d-49d6-ab7c-63c2191f5954 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:51.024886 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0b231aaa-219d-49d6-ab7c-63c2191f5954 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] [instance: 69a2418e-ab69-4e7b-a243-365951169370] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:51.035682 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0b231aaa-219d-49d6-ab7c-63c2191f5954 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:51.036396 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0b231aaa-219d-49d6-ab7c-63c2191f5954 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:51.037187 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0b231aaa-219d-49d6-ab7c-63c2191f5954 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:51.037764 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0b231aaa-219d-49d6-ab7c-63c2191f5954 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:51.054604 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-0b231aaa-219d-49d6-ab7c-63c2191f5954 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] HTTP exception thrown: Instance 69a2418e-ab69-4e7b-a243-365951169370 could not be found. Jun 20 11:56:51.056678 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0b231aaa-219d-49d6-ab7c-63c2191f5954 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Request method failure captured: Jun 20 11:56:51.056678 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370 HTTP/1.1 Jun 20 11:56:51.056678 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:56:51.056678 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:56:51.056678 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:56:51.056678 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 11:56:51.056678 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:56:51.056678 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:56:51.056678 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:56:51.056678 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:51.056678 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGBVlNA1dQYh3tJPd2oEZb_DLj2c5lYzrHOLqgIZzf-nAfxST3TnT6kQfIbYPOCYMi_QcZh5bKYPhxLocp6V81eXEKr4y3jjlkkozMKg2iKSGpSrlL-Tt5DDAGCnXXp9l-3ExJohKjnqW2yJo75lgQbdasTVwgEOC-NAFRjfZ_PxmJ0 Jun 20 11:56:51.056678 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:56:51.056678 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:56:51.056678 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:56:51.056678 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:56:51.056678 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:56:51.056678 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:56:51.056678 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: c671077727e44ef8ba72fe3ffdfa15eb Jun 20 11:56:51.056678 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-AggregatesAdminTestJSON-1880636502 Jun 20 11:56:51.056678 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 11:56:51.056678 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 11:56:51.058179 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c671077727e44ef8ba72fe3ffdfa15eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c671077727e44ef8ba72fe3ffdfa15eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c671077727e44ef8ba72fe3ffdfa15eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c671077727e44ef8ba72fe3ffdfa15eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:51.058179 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-AggregatesAdminTestJSON-1880636502 Jun 20 11:56:51.058179 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: c671077727e44ef8ba72fe3ffdfa15eb Jun 20 11:56:51.058179 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1880636502 Jun 20 11:56:51.058179 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-AggregatesAdminTestJSON-1880636502-project Jun 20 11:56:51.058179 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:56:51.058179 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:56:51.058179 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 93cf53cbece54a978bdab523d015313d Jun 20 11:56:51.058179 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-AggregatesAdminTestJSON-1880636502-project Jun 20 11:56:51.058179 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 11:56:51.058179 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 69a2418e-ab69-4e7b-a243-365951169370 could not be found. Jun 20 11:56:51.058179 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '69a2418e-ab69-4e7b-a243-365951169370'} Jun 20 11:56:51.058824 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:51.058824 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:51.058824 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:56:51.058824 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:56:51.058824 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:56:51.058824 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:56:51.058824 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:56:51.058824 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:56:51.058824 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:56:51.058824 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:56:51.058824 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69a2418e-ab69-4e7b-a243-365951169370 could not be found. Jun 20 11:56:51.058824 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:51.058824 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:51.058824 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:51.058824 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:51.058824 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:51.058824 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:51.058824 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:51.058824 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:51.058824 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:51.060654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:51.060654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:56:51.060654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:56:51.060654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:56:51.060654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:56:51.060654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:56:51.060654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:56:51.060654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69a2418e-ab69-4e7b-a243-365951169370 could not be found. Jun 20 11:56:51.060654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:51.060654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:51.060654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:51.060654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:51.060654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:51.060654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:51.060654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:56:51.060654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:56:51.060654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69a2418e-ab69-4e7b-a243-365951169370 could not be found. Jun 20 11:56:51.060654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:51.062645 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0b231aaa-219d-49d6-ab7c-63c2191f5954 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] Returning 404 to user: Instance 69a2418e-ab69-4e7b-a243-365951169370 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:51.062645 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0b231aaa-219d-49d6-ab7c-63c2191f5954 tempest-AggregatesAdminTestJSON-1880636502 tempest-AggregatesAdminTestJSON-1880636502-project] 10.222.0.27 "GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370" status: 404 len: 111 microversion: 2.1 time: 0.039971 Jun 20 11:56:51.062645 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 136/294] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:51 2022] GET /compute/v2.1/servers/69a2418e-ab69-4e7b-a243-365951169370 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:56:51.200617 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-739a892c-f6a9-4d9e-93c8-0fa8edaed780 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:51.201598 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-739a892c-f6a9-4d9e-93c8-0fa8edaed780 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: c5afa776-6f61-4b7a-b586-c5047b5fbe5e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:51.210380 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-739a892c-f6a9-4d9e-93c8-0fa8edaed780 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:51.211886 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-739a892c-f6a9-4d9e-93c8-0fa8edaed780 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:51.213039 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-739a892c-f6a9-4d9e-93c8-0fa8edaed780 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:51.213570 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-739a892c-f6a9-4d9e-93c8-0fa8edaed780 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:51.394704 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-739a892c-f6a9-4d9e-93c8-0fa8edaed780 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:51.403254 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-739a892c-f6a9-4d9e-93c8-0fa8edaed780 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/c5afa776-6f61-4b7a-b586-c5047b5fbe5e" status: 200 len: 1317 microversion: 2.1 time: 0.208328 Jun 20 11:56:51.404513 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 159/295] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:51 2022] GET /compute/v2.1/servers/c5afa776-6f61-4b7a-b586-c5047b5fbe5e => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:51.940465 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-64bb1781-73ac-40b5-acf3-366113719d96 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:51.941208 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-64bb1781-73ac-40b5-acf3-366113719d96 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f75be1cf-4d20-4ea9-bcbb-b407892a39ee] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:51.960358 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-64bb1781-73ac-40b5-acf3-366113719d96 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:51.960873 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-64bb1781-73ac-40b5-acf3-366113719d96 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:51.961684 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-64bb1781-73ac-40b5-acf3-366113719d96 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:51.968152 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-64bb1781-73ac-40b5-acf3-366113719d96 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:52.432123 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-33def894-38d4-4f17-9235-7fa04d1e097f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:52.433079 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-33def894-38d4-4f17-9235-7fa04d1e097f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: c5afa776-6f61-4b7a-b586-c5047b5fbe5e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:52.449881 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-33def894-38d4-4f17-9235-7fa04d1e097f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:52.451081 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-33def894-38d4-4f17-9235-7fa04d1e097f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:52.453800 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-33def894-38d4-4f17-9235-7fa04d1e097f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:52.454432 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-33def894-38d4-4f17-9235-7fa04d1e097f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:52.576940 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-64bb1781-73ac-40b5-acf3-366113719d96 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:52.591671 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-64bb1781-73ac-40b5-acf3-366113719d96 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee" status: 200 len: 1318 microversion: 2.1 time: 0.654528 Jun 20 11:56:52.601860 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 137/296] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:51 2022] GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee => generated 1318 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:52.899260 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-33def894-38d4-4f17-9235-7fa04d1e097f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:52.912998 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-33def894-38d4-4f17-9235-7fa04d1e097f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/c5afa776-6f61-4b7a-b586-c5047b5fbe5e" status: 200 len: 1317 microversion: 2.1 time: 0.484738 Jun 20 11:56:52.928340 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 160/297] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:52 2022] GET /compute/v2.1/servers/c5afa776-6f61-4b7a-b586-c5047b5fbe5e => generated 1317 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:56:53.131561 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e1ced1fb-2097-43ca-be18-d107481279d7 tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] Calling method '.version_select at 0x7f60801b0f70>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:53.133152 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:53.133152 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:53.134532 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1ced1fb-2097-43ca-be18-d107481279d7 tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:53.135200 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1ced1fb-2097-43ca-be18-d107481279d7 tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:53.141199 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1ced1fb-2097-43ca-be18-d107481279d7 tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:53.141714 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1ced1fb-2097-43ca-be18-d107481279d7 tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:53.186762 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e1ced1fb-2097-43ca-be18-d107481279d7 tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.549122 Jun 20 11:56:53.188061 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 138/298] 10.222.0.27 () {58 vars in 1127 bytes} [Mon Jun 20 11:56:52 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:53.353974 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-c929e8ad-b48f-4739-8829-35eb49db7c5e req-14f11a05-c7bf-4083-8000-5859b57d8019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5afa776-6f61-4b7a-b586-c5047b5fbe5e", "name": "network-vif-plugged", "status": "completed", "tag": "76925e12-773d-4c10-a31b-fe42c389e3f4"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:53.364620 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-c929e8ad-b48f-4739-8829-35eb49db7c5e req-14f11a05-c7bf-4083-8000-5859b57d8019 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:53.365373 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-c929e8ad-b48f-4739-8829-35eb49db7c5e req-14f11a05-c7bf-4083-8000-5859b57d8019 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:53.379114 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-c929e8ad-b48f-4739-8829-35eb49db7c5e req-14f11a05-c7bf-4083-8000-5859b57d8019 service nova] Creating event network-vif-plugged:76925e12-773d-4c10-a31b-fe42c389e3f4 for instance c5afa776-6f61-4b7a-b586-c5047b5fbe5e on n-h1-master-1 Jun 20 11:56:53.385611 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-c929e8ad-b48f-4739-8829-35eb49db7c5e req-14f11a05-c7bf-4083-8000-5859b57d8019 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036191 Jun 20 11:56:53.386799 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 139/299] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:53.611502 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-63dd20cd-4a2c-4c93-97a8-31c4c4027712 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:53.612441 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-63dd20cd-4a2c-4c93-97a8-31c4c4027712 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f75be1cf-4d20-4ea9-bcbb-b407892a39ee] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:53.625851 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63dd20cd-4a2c-4c93-97a8-31c4c4027712 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:53.626327 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63dd20cd-4a2c-4c93-97a8-31c4c4027712 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:53.627150 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63dd20cd-4a2c-4c93-97a8-31c4c4027712 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:53.632008 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63dd20cd-4a2c-4c93-97a8-31c4c4027712 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:53.984191 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-37f0007c-728c-4d01-b0cc-b0797818ed22 tempest-HostsAdminNegativeTestJSON-1987358230 tempest-HostsAdminNegativeTestJSON-1987358230-project] Calling method '.version_select at 0x7f6073f58700>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:54.002414 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:54.002414 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:54.010212 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-37f0007c-728c-4d01-b0cc-b0797818ed22 tempest-HostsAdminNegativeTestJSON-1987358230 tempest-HostsAdminNegativeTestJSON-1987358230-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '7d5c1a7d5b2a476699aa189f1e9b0780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452a3243c7924984812e6603f1efc531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:54.018340 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-37f0007c-728c-4d01-b0cc-b0797818ed22 tempest-HostsAdminNegativeTestJSON-1987358230 tempest-HostsAdminNegativeTestJSON-1987358230-project] Request method failure captured: Jun 20 11:56:54.018340 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Jun 20 11:56:54.018340 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:56:54.018340 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:56:54.018340 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:56:54.018340 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 11:56:54.018340 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:56:54.018340 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:56:54.018340 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:56:54.018340 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:54.018340 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGCBDDdORbpJEq1tPzSdPSRH88YM94TTF_8c2N2nAiFYtHRspLoeKgecfuwlPE0_0nXuW4HIvksQPYBySnWAh4wOrAdOCfh1JReVMn1mCk4uGR8oZDqcxWiu-Uz_Aov77c0JAzw6qi5c944zAPOUbo1cSZv24glSXJ66yRCi1Has6rc Jun 20 11:56:54.018340 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:56:54.018340 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:56:54.018340 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:56:54.018340 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:56:54.018340 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:56:54.018340 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:56:54.018340 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 452a3243c7924984812e6603f1efc531 Jun 20 11:56:54.018340 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1987358230 Jun 20 11:56:54.018340 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 11:56:54.018340 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 11:56:54.019712 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/452a3243c7924984812e6603f1efc531"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/452a3243c7924984812e6603f1efc531"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/452a3243c7924984812e6603f1efc531"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_452a3243c7924984812e6603f1efc531"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:54.019712 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1987358230 Jun 20 11:56:54.019712 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 452a3243c7924984812e6603f1efc531 Jun 20 11:56:54.019712 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1987358230 Jun 20 11:56:54.019712 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-HostsAdminNegativeTestJSON-1987358230-project Jun 20 11:56:54.019712 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:56:54.019712 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:56:54.019712 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 7d5c1a7d5b2a476699aa189f1e9b0780 Jun 20 11:56:54.019712 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1987358230-project Jun 20 11:56:54.019712 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 11:56:54.019712 n-d-master-1 devstack@n-api.service[119128]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jun 20 11:56:54.019712 n-d-master-1 devstack@n-api.service[119128]: action_args: {} Jun 20 11:56:54.019712 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:54.020630 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:54.020630 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:54.020630 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:54.020630 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:54.020630 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:54.020630 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 11:56:54.020630 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 11:56:54.020630 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 20 11:56:54.020630 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:56:54.020630 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:54.020630 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:54.020630 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Jun 20 11:56:54.020630 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Jun 20 11:56:54.020630 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 20 11:56:54.020630 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 20 11:56:54.020630 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 20 11:56:54.020630 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 20 11:56:54.020630 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 11:56:54.020630 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 11:56:54.022269 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 11:56:54.022269 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 11:56:54.022269 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 20 11:56:54.022269 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 20 11:56:54.022269 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 20 11:56:54.022269 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 20 11:56:54.022269 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 20 11:56:54.022269 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 20 11:56:54.022269 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jun 20 11:56:54.022269 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.022269 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:54.022269 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.022269 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:54.022269 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:54.022269 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:54.022269 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 20 11:56:54.022269 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 20 11:56:54.022269 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jun 20 11:56:54.022269 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.027178 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-37f0007c-728c-4d01-b0cc-b0797818ed22 tempest-HostsAdminNegativeTestJSON-1987358230 tempest-HostsAdminNegativeTestJSON-1987358230-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:54.028421 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-37f0007c-728c-4d01-b0cc-b0797818ed22 tempest-HostsAdminNegativeTestJSON-1987358230 tempest-HostsAdminNegativeTestJSON-1987358230-project] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.831865 Jun 20 11:56:54.042817 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 161/300] 10.222.0.27 () {58 vars in 1127 bytes} [Mon Jun 20 11:56:53 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 846 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:56:54.054337 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3fcfda1c-028e-48e0-9968-b40f4ecb00ca tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:54.056062 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3fcfda1c-028e-48e0-9968-b40f4ecb00ca tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: c5afa776-6f61-4b7a-b586-c5047b5fbe5e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:54.076525 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3fcfda1c-028e-48e0-9968-b40f4ecb00ca tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:54.077667 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3fcfda1c-028e-48e0-9968-b40f4ecb00ca tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:54.085404 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3fcfda1c-028e-48e0-9968-b40f4ecb00ca tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:54.085955 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3fcfda1c-028e-48e0-9968-b40f4ecb00ca tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:54.393612 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-63dd20cd-4a2c-4c93-97a8-31c4c4027712 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:54.408354 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-63dd20cd-4a2c-4c93-97a8-31c4c4027712 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee" status: 200 len: 1468 microversion: 2.1 time: 0.802081 Jun 20 11:56:54.432450 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 140/301] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:53 2022] GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee => generated 1468 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:54.452020 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d7c60aff-8af1-4a76-9c04-b33bc1eafc20 tempest-HostsAdminNegativeTestJSON-1987358230 tempest-HostsAdminNegativeTestJSON-1987358230-project] Calling method '.version_select at 0x7f6080251a60>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:54.458170 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:54.458170 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:56:54.460585 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d7c60aff-8af1-4a76-9c04-b33bc1eafc20 tempest-HostsAdminNegativeTestJSON-1987358230 tempest-HostsAdminNegativeTestJSON-1987358230-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '7d5c1a7d5b2a476699aa189f1e9b0780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452a3243c7924984812e6603f1efc531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:54.462897 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d7c60aff-8af1-4a76-9c04-b33bc1eafc20 tempest-HostsAdminNegativeTestJSON-1987358230 tempest-HostsAdminNegativeTestJSON-1987358230-project] Request method failure captured: Jun 20 11:56:54.462897 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/os-hosts/n-d-master-1/reboot HTTP/1.1 Jun 20 11:56:54.462897 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:56:54.462897 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:56:54.462897 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:56:54.462897 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 11:56:54.462897 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:56:54.462897 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:56:54.462897 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:56:54.462897 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:54.462897 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGCBDDdORbpJEq1tPzSdPSRH88YM94TTF_8c2N2nAiFYtHRspLoeKgecfuwlPE0_0nXuW4HIvksQPYBySnWAh4wOrAdOCfh1JReVMn1mCk4uGR8oZDqcxWiu-Uz_Aov77c0JAzw6qi5c944zAPOUbo1cSZv24glSXJ66yRCi1Has6rc Jun 20 11:56:54.462897 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:56:54.462897 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:56:54.462897 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:56:54.462897 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:56:54.462897 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:56:54.462897 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:56:54.462897 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 452a3243c7924984812e6603f1efc531 Jun 20 11:56:54.462897 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1987358230 Jun 20 11:56:54.462897 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 11:56:54.462897 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 11:56:54.464362 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/452a3243c7924984812e6603f1efc531"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/452a3243c7924984812e6603f1efc531"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/452a3243c7924984812e6603f1efc531"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_452a3243c7924984812e6603f1efc531"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:54.464362 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1987358230 Jun 20 11:56:54.464362 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 452a3243c7924984812e6603f1efc531 Jun 20 11:56:54.464362 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1987358230 Jun 20 11:56:54.464362 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-HostsAdminNegativeTestJSON-1987358230-project Jun 20 11:56:54.464362 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:56:54.464362 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:56:54.464362 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 7d5c1a7d5b2a476699aa189f1e9b0780 Jun 20 11:56:54.464362 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1987358230-project Jun 20 11:56:54.464362 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 11:56:54.464362 n-d-master-1 devstack@n-api.service[119127]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jun 20 11:56:54.464362 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'n-d-master-1'} Jun 20 11:56:54.464362 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:54.465208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:54.465208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:54.465208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:54.465208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:54.465208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:54.465208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 11:56:54.465208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 11:56:54.465208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:54.465208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:54.465208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Jun 20 11:56:54.465208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Jun 20 11:56:54.465208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 20 11:56:54.465208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 20 11:56:54.465208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 20 11:56:54.465208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 20 11:56:54.465208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 11:56:54.465208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 11:56:54.465208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 11:56:54.465208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 11:56:54.466346 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 20 11:56:54.466346 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 20 11:56:54.466346 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 20 11:56:54.466346 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 20 11:56:54.466346 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 20 11:56:54.466346 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 20 11:56:54.466346 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jun 20 11:56:54.466346 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.466346 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:54.466346 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.466346 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:54.466346 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:54.466346 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:54.466346 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 20 11:56:54.466346 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 20 11:56:54.466346 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jun 20 11:56:54.466346 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.470094 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d7c60aff-8af1-4a76-9c04-b33bc1eafc20 tempest-HostsAdminNegativeTestJSON-1987358230 tempest-HostsAdminNegativeTestJSON-1987358230-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:54.471252 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d7c60aff-8af1-4a76-9c04-b33bc1eafc20 tempest-HostsAdminNegativeTestJSON-1987358230 tempest-HostsAdminNegativeTestJSON-1987358230-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.036271 Jun 20 11:56:54.473275 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 141/302] 10.222.0.27 () {58 vars in 1187 bytes} [Mon Jun 20 11:56:54 2022] GET /compute/v2.1/os-hosts/n-d-master-1/reboot => generated 111 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:56:54.521452 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3fcfda1c-028e-48e0-9968-b40f4ecb00ca tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:54.530924 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3fcfda1c-028e-48e0-9968-b40f4ecb00ca tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/c5afa776-6f61-4b7a-b586-c5047b5fbe5e" status: 200 len: 1317 microversion: 2.1 time: 0.486490 Jun 20 11:56:54.533674 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 162/303] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:54 2022] GET /compute/v2.1/servers/c5afa776-6f61-4b7a-b586-c5047b5fbe5e => generated 1317 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:54.554250 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fdbb774d-893e-4170-899f-c4136afba815 tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] Calling method '.version_select at 0x7f6073f58a60>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:54.555422 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:54.555422 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:54.568195 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-fdbb774d-893e-4170-899f-c4136afba815 tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jun 20 11:56:54.570483 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fdbb774d-893e-4170-899f-c4136afba815 tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] Request method failure captured: Jun 20 11:56:54.570483 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Jun 20 11:56:54.570483 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:56:54.570483 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:56:54.570483 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:56:54.570483 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 11:56:54.570483 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:56:54.570483 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:56:54.570483 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:56:54.570483 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:54.570483 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGCE5ZssgZXLuwzSoNY9EHv8SPpHAkp6OxjNLSqrZx2MXG0ylZHw5eHd734apEDAmqSO-gqaq_18NTzHZiCVnflEiGV62ftsREq3HMabaMTWAgb_65Yj2lBIDTjsDy6RnxLA9wWoqDHrTO-dSWzzUYwcJkt6K-bdwUkcyHy5Z7W8x20 Jun 20 11:56:54.570483 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:56:54.570483 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:56:54.570483 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:56:54.570483 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:56:54.570483 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:56:54.570483 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:56:54.570483 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: f29391b461bd48d8a441d1b57658b0d9 Jun 20 11:56:54.570483 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1838036286 Jun 20 11:56:54.570483 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member,admin Jun 20 11:56:54.570483 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member,admin Jun 20 11:56:54.571668 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f29391b461bd48d8a441d1b57658b0d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f29391b461bd48d8a441d1b57658b0d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f29391b461bd48d8a441d1b57658b0d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f29391b461bd48d8a441d1b57658b0d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:54.571668 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1838036286 Jun 20 11:56:54.571668 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: f29391b461bd48d8a441d1b57658b0d9 Jun 20 11:56:54.571668 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1838036286 Jun 20 11:56:54.571668 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-HostsAdminNegativeTestJSON-1838036286-project-admin Jun 20 11:56:54.571668 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:56:54.571668 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:56:54.571668 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: a6f90638465f42e3a79992a31827de3d Jun 20 11:56:54.571668 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1838036286-project-admin Jun 20 11:56:54.571668 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 11:56:54.571668 n-d-master-1 devstack@n-api.service[119128]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jun 20 11:56:54.571668 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'nonexistent_hostname'} Jun 20 11:56:54.571668 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:54.572409 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:54.572409 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jun 20 11:56:54.572409 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jun 20 11:56:54.572409 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 20 11:56:54.572409 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 20 11:56:54.572409 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 11:56:54.572409 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 11:56:54.572409 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 11:56:54.572409 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 11:56:54.572409 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 20 11:56:54.572409 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 20 11:56:54.572409 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jun 20 11:56:54.572409 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jun 20 11:56:54.572409 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 11:56:54.572409 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 11:56:54.572409 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 20 11:56:54.572409 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 20 11:56:54.572409 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 20 11:56:54.572409 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 20 11:56:54.573406 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 20 11:56:54.573406 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 20 11:56:54.573406 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 20 11:56:54.573406 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.573406 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:54.573406 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.573406 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:54.573406 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:54.573406 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:54.573406 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:54.573406 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:54.573406 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 11:56:54.573406 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 11:56:54.573406 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:54.573406 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:54.573406 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Jun 20 11:56:54.573406 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Jun 20 11:56:54.573406 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jun 20 11:56:54.573406 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:56:54.574393 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 20 11:56:54.574393 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.574393 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:54.574393 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.574393 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:54.574393 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:54.574393 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:54.574393 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:56:54.574393 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:56:54.574393 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jun 20 11:56:54.574393 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.574393 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fdbb774d-893e-4170-899f-c4136afba815 tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:54.574393 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fdbb774d-893e-4170-899f-c4136afba815 tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.030177 Jun 20 11:56:54.574393 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 163/304] 10.222.0.27 () {58 vars in 1211 bytes} [Mon Jun 20 11:56:54 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 11:56:54.583628 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0154e967-630e-4199-af90-b94a9945fa54 tempest-HostsAdminNegativeTestJSON-1987358230 tempest-HostsAdminNegativeTestJSON-1987358230-project] Calling method '.version_select at 0x7f6073f44670>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:54.584494 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:54.584494 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:54.585661 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0154e967-630e-4199-af90-b94a9945fa54 tempest-HostsAdminNegativeTestJSON-1987358230 tempest-HostsAdminNegativeTestJSON-1987358230-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '7d5c1a7d5b2a476699aa189f1e9b0780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452a3243c7924984812e6603f1efc531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:54.587236 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0154e967-630e-4199-af90-b94a9945fa54 tempest-HostsAdminNegativeTestJSON-1987358230 tempest-HostsAdminNegativeTestJSON-1987358230-project] Request method failure captured: Jun 20 11:56:54.587236 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Jun 20 11:56:54.587236 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:56:54.587236 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:56:54.587236 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:56:54.587236 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 11:56:54.587236 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:56:54.587236 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:56:54.587236 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:56:54.587236 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:54.587236 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGCBDDdORbpJEq1tPzSdPSRH88YM94TTF_8c2N2nAiFYtHRspLoeKgecfuwlPE0_0nXuW4HIvksQPYBySnWAh4wOrAdOCfh1JReVMn1mCk4uGR8oZDqcxWiu-Uz_Aov77c0JAzw6qi5c944zAPOUbo1cSZv24glSXJ66yRCi1Has6rc Jun 20 11:56:54.587236 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:56:54.587236 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:56:54.587236 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:56:54.587236 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:56:54.587236 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:56:54.587236 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:56:54.587236 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 452a3243c7924984812e6603f1efc531 Jun 20 11:56:54.587236 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1987358230 Jun 20 11:56:54.587236 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 11:56:54.587236 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 11:56:54.588487 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/452a3243c7924984812e6603f1efc531"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/452a3243c7924984812e6603f1efc531"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/452a3243c7924984812e6603f1efc531"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_452a3243c7924984812e6603f1efc531"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:54.588487 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1987358230 Jun 20 11:56:54.588487 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 452a3243c7924984812e6603f1efc531 Jun 20 11:56:54.588487 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1987358230 Jun 20 11:56:54.588487 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-HostsAdminNegativeTestJSON-1987358230-project Jun 20 11:56:54.588487 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:56:54.588487 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:56:54.588487 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 7d5c1a7d5b2a476699aa189f1e9b0780 Jun 20 11:56:54.588487 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1987358230-project Jun 20 11:56:54.588487 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 11:56:54.588487 n-d-master-1 devstack@n-api.service[119128]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jun 20 11:56:54.588487 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'n-d-master-1'} Jun 20 11:56:54.588487 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:54.589285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:54.589285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:54.589285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:54.589285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:54.589285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:54.589285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 11:56:54.589285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 11:56:54.589285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:54.589285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:54.589285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Jun 20 11:56:54.589285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Jun 20 11:56:54.589285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 20 11:56:54.589285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 20 11:56:54.589285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 20 11:56:54.589285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 20 11:56:54.589285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 11:56:54.589285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 11:56:54.589285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 11:56:54.589285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 11:56:54.591968 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 20 11:56:54.591968 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 20 11:56:54.591968 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 20 11:56:54.591968 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 20 11:56:54.591968 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 20 11:56:54.591968 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 20 11:56:54.591968 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jun 20 11:56:54.591968 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.591968 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:54.591968 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.591968 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:54.591968 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:54.591968 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:54.591968 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 20 11:56:54.591968 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 20 11:56:54.591968 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jun 20 11:56:54.591968 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.594898 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0154e967-630e-4199-af90-b94a9945fa54 tempest-HostsAdminNegativeTestJSON-1987358230 tempest-HostsAdminNegativeTestJSON-1987358230-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:54.594898 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0154e967-630e-4199-af90-b94a9945fa54 tempest-HostsAdminNegativeTestJSON-1987358230 tempest-HostsAdminNegativeTestJSON-1987358230-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-master-1" status: 403 len: 109 microversion: 2.1 time: 0.010629 Jun 20 11:56:54.598291 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 164/305] 10.222.0.27 () {58 vars in 1166 bytes} [Mon Jun 20 11:56:54 2022] GET /compute/v2.1/os-hosts/n-d-master-1 => generated 109 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jun 20 11:56:54.604284 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f9cdc84e-9096-4d96-92d5-cc4e4f9e2ed0 tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] Calling method '.version_select at 0x7f608004b1f0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:54.613044 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-f9cdc84e-9096-4d96-92d5-cc4e4f9e2ed0 tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jun 20 11:56:54.616052 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f9cdc84e-9096-4d96-92d5-cc4e4f9e2ed0 tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] Request method failure captured: Jun 20 11:56:54.616052 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jun 20 11:56:54.616052 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:56:54.616052 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:56:54.616052 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:56:54.616052 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 11:56:54.616052 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:56:54.616052 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:56:54.616052 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:56:54.616052 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:54.616052 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGCE5ZssgZXLuwzSoNY9EHv8SPpHAkp6OxjNLSqrZx2MXG0ylZHw5eHd734apEDAmqSO-gqaq_18NTzHZiCVnflEiGV62ftsREq3HMabaMTWAgb_65Yj2lBIDTjsDy6RnxLA9wWoqDHrTO-dSWzzUYwcJkt6K-bdwUkcyHy5Z7W8x20 Jun 20 11:56:54.616052 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:56:54.616052 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:56:54.616052 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:56:54.616052 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:56:54.616052 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:56:54.616052 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:56:54.616052 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: f29391b461bd48d8a441d1b57658b0d9 Jun 20 11:56:54.616052 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1838036286 Jun 20 11:56:54.616052 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member,admin Jun 20 11:56:54.616052 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member,admin Jun 20 11:56:54.617406 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f29391b461bd48d8a441d1b57658b0d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f29391b461bd48d8a441d1b57658b0d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f29391b461bd48d8a441d1b57658b0d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f29391b461bd48d8a441d1b57658b0d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:54.617406 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1838036286 Jun 20 11:56:54.617406 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: f29391b461bd48d8a441d1b57658b0d9 Jun 20 11:56:54.617406 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1838036286 Jun 20 11:56:54.617406 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-HostsAdminNegativeTestJSON-1838036286-project-admin Jun 20 11:56:54.617406 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:56:54.617406 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:56:54.617406 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: a6f90638465f42e3a79992a31827de3d Jun 20 11:56:54.617406 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1838036286-project-admin Jun 20 11:56:54.617406 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 11:56:54.617406 n-d-master-1 devstack@n-api.service[119128]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jun 20 11:56:54.617406 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'nonexistent_hostname'} Jun 20 11:56:54.617406 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:54.618124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:54.618124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Jun 20 11:56:54.618124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jun 20 11:56:54.618124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 11:56:54.618124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 11:56:54.618124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 20 11:56:54.618124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 20 11:56:54.618124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 20 11:56:54.618124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 20 11:56:54.618124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 20 11:56:54.618124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 20 11:56:54.618124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 20 11:56:54.618124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.618124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:54.618124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.618124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:54.618124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:54.618124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:54.618124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:54.619125 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:54.619125 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 11:56:54.619125 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 11:56:54.619125 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:54.619125 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:54.619125 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Jun 20 11:56:54.619125 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:56:54.619125 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 20 11:56:54.619125 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.619125 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:54.619125 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.619125 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:54.619125 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:54.619125 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:54.619125 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:56:54.619125 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:56:54.619125 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jun 20 11:56:54.619125 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.622429 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f9cdc84e-9096-4d96-92d5-cc4e4f9e2ed0 tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:54.625722 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f9cdc84e-9096-4d96-92d5-cc4e4f9e2ed0 tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.024999 Jun 20 11:56:54.629760 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 165/306] 10.222.0.27 () {58 vars in 1190 bytes} [Mon Jun 20 11:56:54 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 11:56:54.647050 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ee2ffc76-1541-4b1b-b51f-14cb09581938 tempest-HostsAdminNegativeTestJSON-1987358230 tempest-HostsAdminNegativeTestJSON-1987358230-project] Calling method '.version_select at 0x7f60801bd4c0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:54.648319 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:54.648319 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:54.649672 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ee2ffc76-1541-4b1b-b51f-14cb09581938 tempest-HostsAdminNegativeTestJSON-1987358230 tempest-HostsAdminNegativeTestJSON-1987358230-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '7d5c1a7d5b2a476699aa189f1e9b0780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452a3243c7924984812e6603f1efc531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:54.651933 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ee2ffc76-1541-4b1b-b51f-14cb09581938 tempest-HostsAdminNegativeTestJSON-1987358230 tempest-HostsAdminNegativeTestJSON-1987358230-project] Request method failure captured: Jun 20 11:56:54.651933 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/os-hosts/n-d-master-1/shutdown HTTP/1.1 Jun 20 11:56:54.651933 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:56:54.651933 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:56:54.651933 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:56:54.651933 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 11:56:54.651933 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:56:54.651933 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:56:54.651933 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:56:54.651933 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:54.651933 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGCBDDdORbpJEq1tPzSdPSRH88YM94TTF_8c2N2nAiFYtHRspLoeKgecfuwlPE0_0nXuW4HIvksQPYBySnWAh4wOrAdOCfh1JReVMn1mCk4uGR8oZDqcxWiu-Uz_Aov77c0JAzw6qi5c944zAPOUbo1cSZv24glSXJ66yRCi1Has6rc Jun 20 11:56:54.651933 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:56:54.651933 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:56:54.651933 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:56:54.651933 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:56:54.651933 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:56:54.651933 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:56:54.651933 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 452a3243c7924984812e6603f1efc531 Jun 20 11:56:54.651933 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1987358230 Jun 20 11:56:54.651933 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 11:56:54.651933 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 11:56:54.653398 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/452a3243c7924984812e6603f1efc531"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/452a3243c7924984812e6603f1efc531"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/452a3243c7924984812e6603f1efc531"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_452a3243c7924984812e6603f1efc531"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:54.653398 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1987358230 Jun 20 11:56:54.653398 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 452a3243c7924984812e6603f1efc531 Jun 20 11:56:54.653398 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1987358230 Jun 20 11:56:54.653398 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-HostsAdminNegativeTestJSON-1987358230-project Jun 20 11:56:54.653398 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:56:54.653398 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:56:54.653398 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 7d5c1a7d5b2a476699aa189f1e9b0780 Jun 20 11:56:54.653398 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1987358230-project Jun 20 11:56:54.653398 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 11:56:54.653398 n-d-master-1 devstack@n-api.service[119128]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jun 20 11:56:54.653398 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'n-d-master-1'} Jun 20 11:56:54.653398 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:54.654123 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:54.654123 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:54.654123 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:54.654123 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:54.654123 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:54.654123 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 11:56:54.654123 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 11:56:54.654123 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:54.654123 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:54.654123 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Jun 20 11:56:54.654123 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Jun 20 11:56:54.654123 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 20 11:56:54.654123 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 20 11:56:54.654123 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 20 11:56:54.654123 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 20 11:56:54.654123 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 11:56:54.654123 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 11:56:54.654123 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 11:56:54.654123 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 11:56:54.655321 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 20 11:56:54.655321 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 20 11:56:54.655321 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 20 11:56:54.655321 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 20 11:56:54.655321 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 20 11:56:54.655321 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 20 11:56:54.655321 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jun 20 11:56:54.655321 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.655321 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:54.655321 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.655321 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:54.655321 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:54.655321 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:54.655321 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 20 11:56:54.655321 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 20 11:56:54.655321 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jun 20 11:56:54.655321 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.658027 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ee2ffc76-1541-4b1b-b51f-14cb09581938 tempest-HostsAdminNegativeTestJSON-1987358230 tempest-HostsAdminNegativeTestJSON-1987358230-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:54.659136 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ee2ffc76-1541-4b1b-b51f-14cb09581938 tempest-HostsAdminNegativeTestJSON-1987358230 tempest-HostsAdminNegativeTestJSON-1987358230-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.018462 Jun 20 11:56:54.659929 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 166/307] 10.222.0.27 () {58 vars in 1193 bytes} [Mon Jun 20 11:56:54 2022] GET /compute/v2.1/os-hosts/n-d-master-1/shutdown => generated 113 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:56:54.680753 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a4c40e92-51eb-4309-8e4e-55486dc48d1b tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] Calling method '.version_select at 0x7f6073f584c0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:54.716409 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-a4c40e92-51eb-4309-8e4e-55486dc48d1b tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jun 20 11:56:54.720349 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a4c40e92-51eb-4309-8e4e-55486dc48d1b tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] Request method failure captured: Jun 20 11:56:54.720349 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Jun 20 11:56:54.720349 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:56:54.720349 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:56:54.720349 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:56:54.720349 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 11:56:54.720349 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:56:54.720349 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:56:54.720349 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:56:54.720349 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:54.720349 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGCE5ZssgZXLuwzSoNY9EHv8SPpHAkp6OxjNLSqrZx2MXG0ylZHw5eHd734apEDAmqSO-gqaq_18NTzHZiCVnflEiGV62ftsREq3HMabaMTWAgb_65Yj2lBIDTjsDy6RnxLA9wWoqDHrTO-dSWzzUYwcJkt6K-bdwUkcyHy5Z7W8x20 Jun 20 11:56:54.720349 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:56:54.720349 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:56:54.720349 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:56:54.720349 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:56:54.720349 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:56:54.720349 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:56:54.720349 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: f29391b461bd48d8a441d1b57658b0d9 Jun 20 11:56:54.720349 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1838036286 Jun 20 11:56:54.720349 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member,admin Jun 20 11:56:54.720349 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member,admin Jun 20 11:56:54.721845 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f29391b461bd48d8a441d1b57658b0d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f29391b461bd48d8a441d1b57658b0d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f29391b461bd48d8a441d1b57658b0d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f29391b461bd48d8a441d1b57658b0d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:54.721845 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1838036286 Jun 20 11:56:54.721845 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: f29391b461bd48d8a441d1b57658b0d9 Jun 20 11:56:54.721845 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1838036286 Jun 20 11:56:54.721845 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-HostsAdminNegativeTestJSON-1838036286-project-admin Jun 20 11:56:54.721845 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:56:54.721845 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:56:54.721845 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: a6f90638465f42e3a79992a31827de3d Jun 20 11:56:54.721845 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1838036286-project-admin Jun 20 11:56:54.721845 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 11:56:54.721845 n-d-master-1 devstack@n-api.service[119128]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jun 20 11:56:54.721845 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'nonexistent_hostname'} Jun 20 11:56:54.721845 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:54.722852 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:54.722852 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jun 20 11:56:54.722852 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jun 20 11:56:54.722852 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 20 11:56:54.722852 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 20 11:56:54.722852 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 11:56:54.722852 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 11:56:54.722852 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 11:56:54.722852 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 11:56:54.722852 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 20 11:56:54.722852 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 20 11:56:54.722852 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jun 20 11:56:54.722852 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jun 20 11:56:54.722852 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 11:56:54.722852 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 11:56:54.722852 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 20 11:56:54.722852 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 20 11:56:54.722852 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 20 11:56:54.722852 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 20 11:56:54.724090 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 20 11:56:54.724090 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 20 11:56:54.724090 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 20 11:56:54.724090 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.724090 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:54.724090 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.724090 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:54.724090 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:54.724090 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:54.724090 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:54.724090 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:54.724090 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 11:56:54.724090 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 11:56:54.724090 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:54.724090 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:54.724090 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Jun 20 11:56:54.724090 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Jun 20 11:56:54.724090 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jun 20 11:56:54.724090 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:56:54.725421 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 20 11:56:54.725421 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.725421 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:54.725421 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.725421 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:54.725421 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:54.725421 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:54.725421 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:56:54.725421 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:56:54.725421 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jun 20 11:56:54.725421 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.729354 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a4c40e92-51eb-4309-8e4e-55486dc48d1b tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:54.730725 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a4c40e92-51eb-4309-8e4e-55486dc48d1b tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.065392 Jun 20 11:56:54.734390 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 167/308] 10.222.0.27 () {58 vars in 1217 bytes} [Mon Jun 20 11:56:54 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 11:56:54.750837 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-538cf35c-f562-4b53-83d1-e348f4887fa7 tempest-HostsAdminNegativeTestJSON-1987358230 tempest-HostsAdminNegativeTestJSON-1987358230-project] Calling method '.version_select at 0x7f60801bdb80>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:54.751853 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:54.751853 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:54.753465 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-538cf35c-f562-4b53-83d1-e348f4887fa7 tempest-HostsAdminNegativeTestJSON-1987358230 tempest-HostsAdminNegativeTestJSON-1987358230-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '7d5c1a7d5b2a476699aa189f1e9b0780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452a3243c7924984812e6603f1efc531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:54.755197 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-538cf35c-f562-4b53-83d1-e348f4887fa7 tempest-HostsAdminNegativeTestJSON-1987358230 tempest-HostsAdminNegativeTestJSON-1987358230-project] Request method failure captured: Jun 20 11:56:54.755197 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/os-hosts/n-d-master-1/startup HTTP/1.1 Jun 20 11:56:54.755197 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:56:54.755197 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:56:54.755197 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:56:54.755197 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 11:56:54.755197 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:56:54.755197 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:56:54.755197 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:56:54.755197 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:54.755197 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGCBDDdORbpJEq1tPzSdPSRH88YM94TTF_8c2N2nAiFYtHRspLoeKgecfuwlPE0_0nXuW4HIvksQPYBySnWAh4wOrAdOCfh1JReVMn1mCk4uGR8oZDqcxWiu-Uz_Aov77c0JAzw6qi5c944zAPOUbo1cSZv24glSXJ66yRCi1Has6rc Jun 20 11:56:54.755197 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:56:54.755197 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:56:54.755197 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:56:54.755197 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:56:54.755197 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:56:54.755197 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:56:54.755197 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 452a3243c7924984812e6603f1efc531 Jun 20 11:56:54.755197 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1987358230 Jun 20 11:56:54.755197 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 11:56:54.755197 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 11:56:54.756841 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/452a3243c7924984812e6603f1efc531"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/452a3243c7924984812e6603f1efc531"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/452a3243c7924984812e6603f1efc531"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_452a3243c7924984812e6603f1efc531"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:54.756841 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1987358230 Jun 20 11:56:54.756841 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 452a3243c7924984812e6603f1efc531 Jun 20 11:56:54.756841 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1987358230 Jun 20 11:56:54.756841 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-HostsAdminNegativeTestJSON-1987358230-project Jun 20 11:56:54.756841 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:56:54.756841 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:56:54.756841 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 7d5c1a7d5b2a476699aa189f1e9b0780 Jun 20 11:56:54.756841 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1987358230-project Jun 20 11:56:54.756841 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 11:56:54.756841 n-d-master-1 devstack@n-api.service[119128]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jun 20 11:56:54.756841 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'n-d-master-1'} Jun 20 11:56:54.756841 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:54.757719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:54.757719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:54.757719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:54.757719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:54.757719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:54.757719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 11:56:54.757719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 11:56:54.757719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:54.757719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:54.757719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Jun 20 11:56:54.757719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Jun 20 11:56:54.757719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 20 11:56:54.757719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 20 11:56:54.757719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 20 11:56:54.757719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 20 11:56:54.757719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 11:56:54.757719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 11:56:54.757719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 11:56:54.757719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 11:56:54.759175 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 20 11:56:54.759175 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 20 11:56:54.759175 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 20 11:56:54.759175 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 20 11:56:54.759175 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 20 11:56:54.759175 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 20 11:56:54.759175 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jun 20 11:56:54.759175 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.759175 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:54.759175 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.759175 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:54.759175 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:54.759175 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:54.759175 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 20 11:56:54.759175 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 20 11:56:54.759175 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jun 20 11:56:54.759175 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.760366 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-538cf35c-f562-4b53-83d1-e348f4887fa7 tempest-HostsAdminNegativeTestJSON-1987358230 tempest-HostsAdminNegativeTestJSON-1987358230-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:54.760782 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-538cf35c-f562-4b53-83d1-e348f4887fa7 tempest-HostsAdminNegativeTestJSON-1987358230 tempest-HostsAdminNegativeTestJSON-1987358230-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.020036 Jun 20 11:56:54.761974 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 168/309] 10.222.0.27 () {58 vars in 1190 bytes} [Mon Jun 20 11:56:54 2022] GET /compute/v2.1/os-hosts/n-d-master-1/startup => generated 110 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:56:54.772404 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e7e6910b-f398-4ba9-b29d-466130b90222 tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] Calling method '.version_select at 0x7f6073f449d0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:54.795151 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-e7e6910b-f398-4ba9-b29d-466130b90222 tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jun 20 11:56:54.803151 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e7e6910b-f398-4ba9-b29d-466130b90222 tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] Request method failure captured: Jun 20 11:56:54.803151 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Jun 20 11:56:54.803151 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:56:54.803151 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:56:54.803151 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:56:54.803151 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 11:56:54.803151 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:56:54.803151 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:56:54.803151 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:56:54.803151 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:54.803151 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGCE5ZssgZXLuwzSoNY9EHv8SPpHAkp6OxjNLSqrZx2MXG0ylZHw5eHd734apEDAmqSO-gqaq_18NTzHZiCVnflEiGV62ftsREq3HMabaMTWAgb_65Yj2lBIDTjsDy6RnxLA9wWoqDHrTO-dSWzzUYwcJkt6K-bdwUkcyHy5Z7W8x20 Jun 20 11:56:54.803151 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:56:54.803151 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:56:54.803151 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:56:54.803151 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:56:54.803151 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:56:54.803151 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:56:54.803151 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: f29391b461bd48d8a441d1b57658b0d9 Jun 20 11:56:54.803151 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1838036286 Jun 20 11:56:54.803151 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member,admin Jun 20 11:56:54.803151 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member,admin Jun 20 11:56:54.804404 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f29391b461bd48d8a441d1b57658b0d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f29391b461bd48d8a441d1b57658b0d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f29391b461bd48d8a441d1b57658b0d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f29391b461bd48d8a441d1b57658b0d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:54.804404 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1838036286 Jun 20 11:56:54.804404 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: f29391b461bd48d8a441d1b57658b0d9 Jun 20 11:56:54.804404 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1838036286 Jun 20 11:56:54.804404 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-HostsAdminNegativeTestJSON-1838036286-project-admin Jun 20 11:56:54.804404 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:56:54.804404 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:56:54.804404 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: a6f90638465f42e3a79992a31827de3d Jun 20 11:56:54.804404 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1838036286-project-admin Jun 20 11:56:54.804404 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 11:56:54.804404 n-d-master-1 devstack@n-api.service[119128]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jun 20 11:56:54.804404 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'nonexistent_hostname'} Jun 20 11:56:54.804404 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:54.805109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:54.805109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jun 20 11:56:54.805109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jun 20 11:56:54.805109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 20 11:56:54.805109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 20 11:56:54.805109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 11:56:54.805109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 11:56:54.805109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 11:56:54.805109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 11:56:54.805109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 20 11:56:54.805109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 20 11:56:54.805109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jun 20 11:56:54.805109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jun 20 11:56:54.805109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 11:56:54.805109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 11:56:54.805109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 20 11:56:54.805109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 20 11:56:54.805109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 20 11:56:54.805109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 20 11:56:54.806150 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 20 11:56:54.806150 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 20 11:56:54.806150 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 20 11:56:54.806150 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.806150 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:54.806150 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.806150 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:54.806150 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:54.806150 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:54.806150 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:54.806150 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:54.806150 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 11:56:54.806150 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 11:56:54.806150 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:54.806150 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:54.806150 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Jun 20 11:56:54.806150 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Jun 20 11:56:54.806150 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jun 20 11:56:54.806150 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:56:54.807164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 20 11:56:54.807164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.807164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:54.807164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.807164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:54.807164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:54.807164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:54.807164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:56:54.807164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:56:54.807164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jun 20 11:56:54.807164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.807164 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e7e6910b-f398-4ba9-b29d-466130b90222 tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:54.807164 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e7e6910b-f398-4ba9-b29d-466130b90222 tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.036810 Jun 20 11:56:54.811828 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 169/310] 10.222.0.27 () {58 vars in 1214 bytes} [Mon Jun 20 11:56:54 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 20 11:56:54.822769 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b2d4b4cc-2d4d-430f-b35b-fd79dfc54f9b tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] Action: 'update', calling method: .version_select at 0x7f608004b3a0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:54.831289 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b2d4b4cc-2d4d-430f-b35b-fd79dfc54f9b tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] Request method failure captured: Jun 20 11:56:54.831289 n-d-master-1 devstack@n-api.service[119128]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Jun 20 11:56:54.831289 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:56:54.831289 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:56:54.831289 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:56:54.831289 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 51 Jun 20 11:56:54.831289 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:56:54.831289 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:56:54.831289 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:56:54.831289 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:54.831289 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGCE5ZssgZXLuwzSoNY9EHv8SPpHAkp6OxjNLSqrZx2MXG0ylZHw5eHd734apEDAmqSO-gqaq_18NTzHZiCVnflEiGV62ftsREq3HMabaMTWAgb_65Yj2lBIDTjsDy6RnxLA9wWoqDHrTO-dSWzzUYwcJkt6K-bdwUkcyHy5Z7W8x20 Jun 20 11:56:54.831289 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:56:54.831289 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:56:54.831289 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:56:54.831289 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:56:54.831289 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:56:54.831289 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:56:54.831289 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: f29391b461bd48d8a441d1b57658b0d9 Jun 20 11:56:54.831289 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1838036286 Jun 20 11:56:54.831289 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member,admin Jun 20 11:56:54.831289 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member,admin Jun 20 11:56:54.832655 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f29391b461bd48d8a441d1b57658b0d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f29391b461bd48d8a441d1b57658b0d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f29391b461bd48d8a441d1b57658b0d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f29391b461bd48d8a441d1b57658b0d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:54.832655 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1838036286 Jun 20 11:56:54.832655 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: f29391b461bd48d8a441d1b57658b0d9 Jun 20 11:56:54.832655 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1838036286 Jun 20 11:56:54.832655 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-HostsAdminNegativeTestJSON-1838036286-project-admin Jun 20 11:56:54.832655 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:56:54.832655 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:56:54.832655 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: a6f90638465f42e3a79992a31827de3d Jun 20 11:56:54.832655 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1838036286-project-admin Jun 20 11:56:54.832655 n-d-master-1 devstack@n-api.service[119128]: Jun 20 11:56:54.832655 n-d-master-1 devstack@n-api.service[119128]: {"status": "enable", "maintenance_mode": "invalid"} Jun 20 11:56:54.832655 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 11:56:54.832655 n-d-master-1 devstack@n-api.service[119128]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 20 11:56:54.833408 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Jun 20 11:56:54.833408 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:54.833408 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:54.833408 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 11:56:54.833408 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 11:56:54.833408 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 11:56:54.833408 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise error Jun 20 11:56:54.833408 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 20 11:56:54.833408 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.833408 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Jun 20 11:56:54.833408 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jun 20 11:56:54.833408 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'disable', Jun 20 11:56:54.833408 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'Enable', Jun 20 11:56:54.833408 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'Disable', Jun 20 11:56:54.833408 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'ENABLE', Jun 20 11:56:54.833408 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jun 20 11:56:54.833408 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jun 20 11:56:54.833408 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.833408 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi On instance: Jun 20 11:56:54.833408 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'invalid' Jun 20 11:56:54.833408 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.833408 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:54.833408 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.833408 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:54.833408 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:54.834743 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:54.834743 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:54.834743 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:54.834743 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 11:56:54.834743 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 11:56:54.834743 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:54.834743 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:54.834743 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 11:56:54.834743 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 11:56:54.834743 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 11:56:54.834743 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 11:56:54.834743 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 11:56:54.834743 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 11:56:54.834743 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 20 11:56:54.834743 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.834743 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:54.834743 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.834743 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:54.834743 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:54.835783 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:54.835783 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 11:56:54.835783 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 11:56:54.835783 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 20 11:56:54.835783 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.835783 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b2d4b4cc-2d4d-430f-b35b-fd79dfc54f9b tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:54.839973 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b2d4b4cc-2d4d-430f-b35b-fd79dfc54f9b tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 199 microversion: 2.1 time: 0.024979 Jun 20 11:56:54.841579 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 170/311] 10.222.0.27 () {60 vars in 1186 bytes} [Mon Jun 20 11:56:54 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 199 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 11:56:54.851883 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2a3927c3-e36e-42f8-8ca6-f76b133d5286 tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] Action: 'update', calling method: .version_select at 0x7f6073f58ee0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:54.864936 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2a3927c3-e36e-42f8-8ca6-f76b133d5286 tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] Request method failure captured: Jun 20 11:56:54.864936 n-d-master-1 devstack@n-api.service[119128]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Jun 20 11:56:54.864936 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:56:54.864936 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:56:54.864936 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:56:54.864936 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 51 Jun 20 11:56:54.864936 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:56:54.864936 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:56:54.864936 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:56:54.864936 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:54.864936 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGCE5ZssgZXLuwzSoNY9EHv8SPpHAkp6OxjNLSqrZx2MXG0ylZHw5eHd734apEDAmqSO-gqaq_18NTzHZiCVnflEiGV62ftsREq3HMabaMTWAgb_65Yj2lBIDTjsDy6RnxLA9wWoqDHrTO-dSWzzUYwcJkt6K-bdwUkcyHy5Z7W8x20 Jun 20 11:56:54.864936 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:56:54.864936 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:56:54.864936 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:56:54.864936 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:56:54.864936 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:56:54.864936 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:56:54.864936 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: f29391b461bd48d8a441d1b57658b0d9 Jun 20 11:56:54.864936 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1838036286 Jun 20 11:56:54.864936 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member,admin Jun 20 11:56:54.864936 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member,admin Jun 20 11:56:54.866179 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f29391b461bd48d8a441d1b57658b0d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f29391b461bd48d8a441d1b57658b0d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f29391b461bd48d8a441d1b57658b0d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f29391b461bd48d8a441d1b57658b0d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:54.866179 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1838036286 Jun 20 11:56:54.866179 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: f29391b461bd48d8a441d1b57658b0d9 Jun 20 11:56:54.866179 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1838036286 Jun 20 11:56:54.866179 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-HostsAdminNegativeTestJSON-1838036286-project-admin Jun 20 11:56:54.866179 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:56:54.866179 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:56:54.866179 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: a6f90638465f42e3a79992a31827de3d Jun 20 11:56:54.866179 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1838036286-project-admin Jun 20 11:56:54.866179 n-d-master-1 devstack@n-api.service[119128]: Jun 20 11:56:54.866179 n-d-master-1 devstack@n-api.service[119128]: {"status": "invalid", "maintenance_mode": "enable"} Jun 20 11:56:54.866179 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 11:56:54.866179 n-d-master-1 devstack@n-api.service[119128]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 20 11:56:54.866984 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Jun 20 11:56:54.866984 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:54.866984 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:54.866984 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 11:56:54.866984 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 11:56:54.866984 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 11:56:54.866984 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise error Jun 20 11:56:54.866984 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 20 11:56:54.866984 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.866984 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Jun 20 11:56:54.866984 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jun 20 11:56:54.866984 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'disable', Jun 20 11:56:54.866984 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'Enable', Jun 20 11:56:54.866984 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'Disable', Jun 20 11:56:54.866984 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'ENABLE', Jun 20 11:56:54.866984 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jun 20 11:56:54.866984 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jun 20 11:56:54.866984 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.866984 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi On instance: Jun 20 11:56:54.866984 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'invalid' Jun 20 11:56:54.866984 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.866984 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:54.866984 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.866984 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:54.866984 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:54.868306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:54.868306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:54.868306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:54.868306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 11:56:54.868306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 11:56:54.868306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:54.868306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:54.868306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 11:56:54.868306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 11:56:54.868306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 11:56:54.868306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 11:56:54.868306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 11:56:54.868306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 11:56:54.868306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 20 11:56:54.868306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.868306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:54.868306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.868306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:54.868306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:54.871732 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:54.871732 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 11:56:54.871732 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 11:56:54.871732 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 20 11:56:54.871732 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.871732 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2a3927c3-e36e-42f8-8ca6-f76b133d5286 tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:54.871732 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2a3927c3-e36e-42f8-8ca6-f76b133d5286 tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 189 microversion: 2.1 time: 0.019422 Jun 20 11:56:54.871732 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 171/312] 10.222.0.27 () {60 vars in 1186 bytes} [Mon Jun 20 11:56:54 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 189 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 20 11:56:54.883755 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bac64237-c5dd-45c2-a108-228c4a160a7c tempest-HostsAdminNegativeTestJSON-1987358230 tempest-HostsAdminNegativeTestJSON-1987358230-project] Action: 'update', calling method: .version_select at 0x7f60801bddc0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:54.907438 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:56:54.907438 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:56:54.911374 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-bac64237-c5dd-45c2-a108-228c4a160a7c tempest-HostsAdminNegativeTestJSON-1987358230 tempest-HostsAdminNegativeTestJSON-1987358230-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '7d5c1a7d5b2a476699aa189f1e9b0780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452a3243c7924984812e6603f1efc531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:54.915357 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bac64237-c5dd-45c2-a108-228c4a160a7c tempest-HostsAdminNegativeTestJSON-1987358230 tempest-HostsAdminNegativeTestJSON-1987358230-project] Request method failure captured: Jun 20 11:56:54.915357 n-d-master-1 devstack@n-api.service[119128]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Jun 20 11:56:54.915357 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:56:54.915357 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:56:54.915357 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:56:54.915357 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 50 Jun 20 11:56:54.915357 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:56:54.915357 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:56:54.915357 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:56:54.915357 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:54.915357 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGCBDDdORbpJEq1tPzSdPSRH88YM94TTF_8c2N2nAiFYtHRspLoeKgecfuwlPE0_0nXuW4HIvksQPYBySnWAh4wOrAdOCfh1JReVMn1mCk4uGR8oZDqcxWiu-Uz_Aov77c0JAzw6qi5c944zAPOUbo1cSZv24glSXJ66yRCi1Has6rc Jun 20 11:56:54.915357 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:56:54.915357 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:56:54.915357 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:56:54.915357 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:56:54.915357 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:56:54.915357 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:56:54.915357 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 452a3243c7924984812e6603f1efc531 Jun 20 11:56:54.915357 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1987358230 Jun 20 11:56:54.915357 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 11:56:54.915357 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 11:56:54.916785 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/452a3243c7924984812e6603f1efc531"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/452a3243c7924984812e6603f1efc531"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/452a3243c7924984812e6603f1efc531"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_452a3243c7924984812e6603f1efc531"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:54.916785 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1987358230 Jun 20 11:56:54.916785 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 452a3243c7924984812e6603f1efc531 Jun 20 11:56:54.916785 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1987358230 Jun 20 11:56:54.916785 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-HostsAdminNegativeTestJSON-1987358230-project Jun 20 11:56:54.916785 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:56:54.916785 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:56:54.916785 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 7d5c1a7d5b2a476699aa189f1e9b0780 Jun 20 11:56:54.916785 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1987358230-project Jun 20 11:56:54.916785 n-d-master-1 devstack@n-api.service[119128]: Jun 20 11:56:54.916785 n-d-master-1 devstack@n-api.service[119128]: {"status": "enable", "maintenance_mode": "enable"} Jun 20 11:56:54.916785 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 11:56:54.916785 n-d-master-1 devstack@n-api.service[119128]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jun 20 11:56:54.916785 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jun 20 11:56:54.917593 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:54.917593 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:54.917593 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:54.917593 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:54.917593 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:54.917593 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:54.917593 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 11:56:54.917593 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 11:56:54.917593 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:54.917593 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:54.917593 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:56:54.917593 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:56:54.917593 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Jun 20 11:56:54.917593 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Jun 20 11:56:54.917593 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 20 11:56:54.917593 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 20 11:56:54.917593 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 20 11:56:54.917593 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 20 11:56:54.917593 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 11:56:54.917593 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 11:56:54.919177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 11:56:54.919177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 11:56:54.919177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 20 11:56:54.919177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 20 11:56:54.919177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 20 11:56:54.919177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 20 11:56:54.919177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 20 11:56:54.919177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 20 11:56:54.919177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jun 20 11:56:54.919177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.919177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:54.919177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.919177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:54.919177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:54.919177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:54.919177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 20 11:56:54.919177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 20 11:56:54.919177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jun 20 11:56:54.919177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.920509 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bac64237-c5dd-45c2-a108-228c4a160a7c tempest-HostsAdminNegativeTestJSON-1987358230 tempest-HostsAdminNegativeTestJSON-1987358230-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:54.922702 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bac64237-c5dd-45c2-a108-228c4a160a7c tempest-HostsAdminNegativeTestJSON-1987358230 tempest-HostsAdminNegativeTestJSON-1987358230-project] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 403 len: 111 microversion: 2.1 time: 0.042670 Jun 20 11:56:54.931743 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 172/313] 10.222.0.27 () {60 vars in 1186 bytes} [Mon Jun 20 11:56:54 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 111 bytes in 58 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:56:54.950811 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-752c4fdc-f495-4431-b73b-83f134cfa4e4 tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] Action: 'update', calling method: .version_select at 0x7f6073f58f70>, body: {"status": null, "maintenance_mode": null} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:54.963052 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-752c4fdc-f495-4431-b73b-83f134cfa4e4 tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] Request method failure captured: Jun 20 11:56:54.963052 n-d-master-1 devstack@n-api.service[119128]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Jun 20 11:56:54.963052 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:56:54.963052 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:56:54.963052 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:56:54.963052 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 42 Jun 20 11:56:54.963052 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:56:54.963052 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:56:54.963052 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:56:54.963052 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:54.963052 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGCE5ZssgZXLuwzSoNY9EHv8SPpHAkp6OxjNLSqrZx2MXG0ylZHw5eHd734apEDAmqSO-gqaq_18NTzHZiCVnflEiGV62ftsREq3HMabaMTWAgb_65Yj2lBIDTjsDy6RnxLA9wWoqDHrTO-dSWzzUYwcJkt6K-bdwUkcyHy5Z7W8x20 Jun 20 11:56:54.963052 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:56:54.963052 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:56:54.963052 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:56:54.963052 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:56:54.963052 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:56:54.963052 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:56:54.963052 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: f29391b461bd48d8a441d1b57658b0d9 Jun 20 11:56:54.963052 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1838036286 Jun 20 11:56:54.963052 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member,admin Jun 20 11:56:54.963052 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member,admin Jun 20 11:56:54.964679 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f29391b461bd48d8a441d1b57658b0d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f29391b461bd48d8a441d1b57658b0d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f29391b461bd48d8a441d1b57658b0d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f29391b461bd48d8a441d1b57658b0d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:54.964679 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1838036286 Jun 20 11:56:54.964679 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: f29391b461bd48d8a441d1b57658b0d9 Jun 20 11:56:54.964679 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1838036286 Jun 20 11:56:54.964679 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-HostsAdminNegativeTestJSON-1838036286-project-admin Jun 20 11:56:54.964679 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:56:54.964679 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:56:54.964679 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: a6f90638465f42e3a79992a31827de3d Jun 20 11:56:54.964679 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1838036286-project-admin Jun 20 11:56:54.964679 n-d-master-1 devstack@n-api.service[119128]: Jun 20 11:56:54.964679 n-d-master-1 devstack@n-api.service[119128]: {"status": null, "maintenance_mode": null} Jun 20 11:56:54.964679 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 11:56:54.964679 n-d-master-1 devstack@n-api.service[119128]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jun 20 11:56:54.964679 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'n-d-master-1', 'body': {'status': None, 'maintenance_mode': None}} Jun 20 11:56:54.965652 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:54.965652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:54.965652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 11:56:54.965652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 11:56:54.965652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 11:56:54.965652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise error Jun 20 11:56:54.965652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Jun 20 11:56:54.965652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.965652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Jun 20 11:56:54.965652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jun 20 11:56:54.965652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'disable', Jun 20 11:56:54.965652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'Enable', Jun 20 11:56:54.965652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'Disable', Jun 20 11:56:54.965652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'ENABLE', Jun 20 11:56:54.965652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jun 20 11:56:54.965652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jun 20 11:56:54.965652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.965652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi On instance: Jun 20 11:56:54.965652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi None Jun 20 11:56:54.965652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.965652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:54.965652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.965652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:54.965652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:54.965652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:54.967232 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:54.967232 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:54.967232 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 11:56:54.967232 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 11:56:54.967232 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:54.967232 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:54.967232 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 11:56:54.967232 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 11:56:54.967232 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 11:56:54.967232 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 11:56:54.967232 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 11:56:54.967232 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 11:56:54.967232 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jun 20 11:56:54.967232 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.967232 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:54.967232 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.967232 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:54.967232 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:54.967232 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:54.969075 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 11:56:54.969075 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 11:56:54.969075 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jun 20 11:56:54.969075 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:54.970308 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-752c4fdc-f495-4431-b73b-83f134cfa4e4 tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:54.971407 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-752c4fdc-f495-4431-b73b-83f134cfa4e4 tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 127 microversion: 2.1 time: 0.031637 Jun 20 11:56:54.973301 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 173/314] 10.222.0.27 () {60 vars in 1186 bytes} [Mon Jun 20 11:56:54 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 127 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 11:56:54.982026 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-01a2e14b-1a3e-48ce-baef-b3dd199be184 tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] Action: 'update', calling method: .version_select at 0x7f6073e90790>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:54.992297 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.hosts [None req-01a2e14b-1a3e-48ce-baef-b3dd199be184 tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] Enabling host nonexistent_hostname. Jun 20 11:56:55.010756 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-01a2e14b-1a3e-48ce-baef-b3dd199be184 tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jun 20 11:56:55.015603 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-01a2e14b-1a3e-48ce-baef-b3dd199be184 tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] Request method failure captured: Jun 20 11:56:55.015603 n-d-master-1 devstack@n-api.service[119128]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jun 20 11:56:55.015603 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:56:55.015603 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:56:55.015603 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:56:55.015603 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 50 Jun 20 11:56:55.015603 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:56:55.015603 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:56:55.015603 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:56:55.015603 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:55.015603 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGCE5ZssgZXLuwzSoNY9EHv8SPpHAkp6OxjNLSqrZx2MXG0ylZHw5eHd734apEDAmqSO-gqaq_18NTzHZiCVnflEiGV62ftsREq3HMabaMTWAgb_65Yj2lBIDTjsDy6RnxLA9wWoqDHrTO-dSWzzUYwcJkt6K-bdwUkcyHy5Z7W8x20 Jun 20 11:56:55.015603 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:56:55.015603 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:56:55.015603 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:56:55.015603 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:56:55.015603 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:56:55.015603 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:56:55.015603 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: f29391b461bd48d8a441d1b57658b0d9 Jun 20 11:56:55.015603 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1838036286 Jun 20 11:56:55.015603 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member,admin Jun 20 11:56:55.015603 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member,admin Jun 20 11:56:55.016971 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f29391b461bd48d8a441d1b57658b0d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f29391b461bd48d8a441d1b57658b0d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f29391b461bd48d8a441d1b57658b0d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f29391b461bd48d8a441d1b57658b0d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:55.016971 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1838036286 Jun 20 11:56:55.016971 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: f29391b461bd48d8a441d1b57658b0d9 Jun 20 11:56:55.016971 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1838036286 Jun 20 11:56:55.016971 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-HostsAdminNegativeTestJSON-1838036286-project-admin Jun 20 11:56:55.016971 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:56:55.016971 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:56:55.016971 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: a6f90638465f42e3a79992a31827de3d Jun 20 11:56:55.016971 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1838036286-project-admin Jun 20 11:56:55.016971 n-d-master-1 devstack@n-api.service[119128]: Jun 20 11:56:55.016971 n-d-master-1 devstack@n-api.service[119128]: {"status": "enable", "maintenance_mode": "enable"} Jun 20 11:56:55.016971 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 11:56:55.016971 n-d-master-1 devstack@n-api.service[119128]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jun 20 11:56:55.016971 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jun 20 11:56:55.017732 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:55.017732 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:55.017732 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Jun 20 11:56:55.017732 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Jun 20 11:56:55.017732 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 20 11:56:55.017732 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 20 11:56:55.017732 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 11:56:55.017732 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 11:56:55.017732 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 11:56:55.017732 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 11:56:55.017732 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 20 11:56:55.017732 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 20 11:56:55.017732 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jun 20 11:56:55.017732 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jun 20 11:56:55.017732 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 11:56:55.017732 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 11:56:55.017732 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 20 11:56:55.017732 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 20 11:56:55.018678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 20 11:56:55.018678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 20 11:56:55.018678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 20 11:56:55.018678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 20 11:56:55.018678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 20 11:56:55.018678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:55.018678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:55.018678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:55.018678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:55.018678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:55.018678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:55.018678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:55.018678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:55.018678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 11:56:55.018678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 11:56:55.018678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:55.018678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:55.018678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:56:55.018678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:56:55.018678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Jun 20 11:56:55.019727 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Jun 20 11:56:55.019727 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Jun 20 11:56:55.019727 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:56:55.019727 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 20 11:56:55.019727 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:55.019727 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:55.019727 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:55.019727 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:55.019727 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:55.019727 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:55.019727 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:56:55.019727 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:56:55.019727 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jun 20 11:56:55.019727 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:56:55.022066 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-01a2e14b-1a3e-48ce-baef-b3dd199be184 tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:55.023259 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-01a2e14b-1a3e-48ce-baef-b3dd199be184 tempest-HostsAdminNegativeTestJSON-1838036286 tempest-HostsAdminNegativeTestJSON-1838036286-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.045253 Jun 20 11:56:55.024389 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 174/315] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Jun 20 11:56:54 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 11:56:55.102321 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3218d2b8-28d5-4551-9845-c87c7a4b10c6 tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1373211942", "block_migration": true, "disk_over_commit": false}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:55.103526 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3218d2b8-28d5-4551-9845-c87c7a4b10c6 tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] [instance: f75be1cf-4d20-4ea9-bcbb-b407892a39ee] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:55.119611 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3218d2b8-28d5-4551-9845-c87c7a4b10c6 tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:55.124081 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3218d2b8-28d5-4551-9845-c87c7a4b10c6 tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:55.125048 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3218d2b8-28d5-4551-9845-c87c7a4b10c6 tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:55.127042 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3218d2b8-28d5-4551-9845-c87c7a4b10c6 tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:55.550073 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8b1244ff-42e6-49bb-bba6-130f1695375b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:55.550691 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8b1244ff-42e6-49bb-bba6-130f1695375b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: c5afa776-6f61-4b7a-b586-c5047b5fbe5e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:55.557744 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8b1244ff-42e6-49bb-bba6-130f1695375b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:55.564385 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8b1244ff-42e6-49bb-bba6-130f1695375b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:55.565990 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8b1244ff-42e6-49bb-bba6-130f1695375b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:55.573462 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8b1244ff-42e6-49bb-bba6-130f1695375b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:55.883973 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8b1244ff-42e6-49bb-bba6-130f1695375b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:55.894961 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8b1244ff-42e6-49bb-bba6-130f1695375b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/c5afa776-6f61-4b7a-b586-c5047b5fbe5e" status: 200 len: 1467 microversion: 2.1 time: 0.348898 Jun 20 11:56:55.899453 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 175/316] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:55 2022] GET /compute/v2.1/servers/c5afa776-6f61-4b7a-b586-c5047b5fbe5e => generated 1467 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:56.516486 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-3218d2b8-28d5-4551-9845-c87c7a4b10c6 tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] Lazy-loading 'flavor' on Instance uuid f75be1cf-4d20-4ea9-bcbb-b407892a39ee {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:56:56.530117 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-adf218b8-3dae-4bbf-88d8-13c8f80c5f1c tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:56.530958 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-adf218b8-3dae-4bbf-88d8-13c8f80c5f1c tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] [instance: c5afa776-6f61-4b7a-b586-c5047b5fbe5e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:56.545833 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-adf218b8-3dae-4bbf-88d8-13c8f80c5f1c tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:56.546371 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-adf218b8-3dae-4bbf-88d8-13c8f80c5f1c tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:56.551729 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-adf218b8-3dae-4bbf-88d8-13c8f80c5f1c tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:56.552377 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-adf218b8-3dae-4bbf-88d8-13c8f80c5f1c tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:56.631159 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3218d2b8-28d5-4551-9845-c87c7a4b10c6 tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] [instance: f75be1cf-4d20-4ea9-bcbb-b407892a39ee] Going to try to live migrate instance to tempest-host-1373211942 {{(pid=119127) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 20 11:56:56.645437 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-3218d2b8-28d5-4551-9845-c87c7a4b10c6 tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] HTTP exception thrown: Compute host tempest-host-1373211942 could not be found. Jun 20 11:56:56.657229 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3218d2b8-28d5-4551-9845-c87c7a4b10c6 tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] Request method failure captured: Jun 20 11:56:56.657229 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee/action HTTP/1.1 Jun 20 11:56:56.657229 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:56:56.657229 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:56:56.657229 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:56:56.657229 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 107 Jun 20 11:56:56.657229 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:56:56.657229 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:56:56.657229 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:56:56.657229 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:56:56.657229 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGBrrZ1TFAScTXF3z5Dj7ZbyHXQlkg887_nTvZgmtAChNV1RyfhS_ca7kZrIhOloXluxjmkPVXYzDEGkoCFxUVcJKBRvWVHs84n2Q1bYj15-qzKYc5ke-2kb3egAqLdVAlSyF_Tc_wz0VSeEDdScCwxS-vqY7_1jRlxioeu4sN0Mg7c Jun 20 11:56:56.657229 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:56:56.657229 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:56:56.657229 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:56:56.657229 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:56:56.657229 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:56:56.657229 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:56:56.657229 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 915d0319929440e485fc5f40fdeb7dc9 Jun 20 11:56:56.657229 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-LiveMigrationNegativeTest-1842497938 Jun 20 11:56:56.657229 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member,admin Jun 20 11:56:56.657229 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member,admin Jun 20 11:56:56.658430 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/915d0319929440e485fc5f40fdeb7dc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/915d0319929440e485fc5f40fdeb7dc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/915d0319929440e485fc5f40fdeb7dc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_915d0319929440e485fc5f40fdeb7dc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:56:56.658430 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-LiveMigrationNegativeTest-1842497938 Jun 20 11:56:56.658430 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 915d0319929440e485fc5f40fdeb7dc9 Jun 20 11:56:56.658430 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1842497938 Jun 20 11:56:56.658430 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-LiveMigrationNegativeTest-1842497938-project-admin Jun 20 11:56:56.658430 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:56:56.658430 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:56:56.658430 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 0ae66fe055d34584bc1ae3dbefc1f76d Jun 20 11:56:56.658430 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-LiveMigrationNegativeTest-1842497938-project-admin Jun 20 11:56:56.658430 n-d-master-1 devstack@n-api.service[119127]: Jun 20 11:56:56.658430 n-d-master-1 devstack@n-api.service[119127]: {"os-migrateLive": {"host": "tempest-host-1373211942", "block_migration": true, "disk_over_commit": false}} Jun 20 11:56:56.658430 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 11:56:56.659175 n-d-master-1 devstack@n-api.service[119127]: exception: Compute host tempest-host-1373211942 could not be found. Jun 20 11:56:56.659175 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'f75be1cf-4d20-4ea9-bcbb-b407892a39ee', 'body': {'os-migrateLive': {'host': 'tempest-host-1373211942', 'block_migration': True, 'disk_over_commit': False}}} Jun 20 11:56:56.659175 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:56:56.659175 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:56.659175 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jun 20 11:56:56.659175 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jun 20 11:56:56.659175 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 20 11:56:56.659175 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 11:56:56.659175 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 20 11:56:56.659175 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 20 11:56:56.659175 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 20 11:56:56.659175 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 11:56:56.659175 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 20 11:56:56.659175 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 20 11:56:56.659175 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jun 20 11:56:56.659175 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 11:56:56.659175 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jun 20 11:56:56.659175 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 11:56:56.659175 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 11:56:56.660234 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 11:56:56.660234 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 20 11:56:56.660234 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 11:56:56.660234 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate Jun 20 11:56:56.660234 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Jun 20 11:56:56.660234 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 11:56:56.660234 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 11:56:56.660234 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Jun 20 11:56:56.660234 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Jun 20 11:56:56.660234 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Jun 20 11:56:56.660234 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:56.660234 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Jun 20 11:56:56.660234 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Jun 20 11:56:56.660234 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Jun 20 11:56:56.660234 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Jun 20 11:56:56.660234 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Jun 20 11:56:56.660234 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Jun 20 11:56:56.660234 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1373211942 could not be found. Jun 20 11:56:56.660234 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:56.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:56.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:56.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:56.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:56.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:56.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:56:56.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:56:56.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:56:56.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:56:56.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:56:56.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:56:56.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:56:56.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:56:56.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:56:56.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:56:56.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 20 11:56:56.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Jun 20 11:56:56.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 20 11:56:56.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1373211942 could not be found. Jun 20 11:56:56.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:56.662558 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:56:56.662558 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:56.662558 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:56:56.662558 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:56:56.662558 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:56:56.662558 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:56:56.662558 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:56:56.662558 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1373211942 could not be found. Jun 20 11:56:56.662558 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:56:56.667522 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3218d2b8-28d5-4551-9845-c87c7a4b10c6 tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] Returning 400 to user: Compute host tempest-host-1373211942 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:56:56.670749 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3218d2b8-28d5-4551-9845-c87c7a4b10c6 tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee/action" status: 400 len: 100 microversion: 2.1 time: 2.194442 Jun 20 11:56:56.673319 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 142/317] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Jun 20 11:56:54 2022] POST /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee/action => generated 100 bytes in 2199 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 11:56:56.687437 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-723c2c86-1363-47c7-bfff-f54b9180e5e7 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:56.688774 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-723c2c86-1363-47c7-bfff-f54b9180e5e7 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f75be1cf-4d20-4ea9-bcbb-b407892a39ee] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:56.711719 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-723c2c86-1363-47c7-bfff-f54b9180e5e7 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:56.714610 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-723c2c86-1363-47c7-bfff-f54b9180e5e7 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:56.715741 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-723c2c86-1363-47c7-bfff-f54b9180e5e7 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:56.717223 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-723c2c86-1363-47c7-bfff-f54b9180e5e7 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:57.122133 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-723c2c86-1363-47c7-bfff-f54b9180e5e7 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:57.135512 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-723c2c86-1363-47c7-bfff-f54b9180e5e7 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee" status: 200 len: 1468 microversion: 2.1 time: 0.457611 Jun 20 11:56:57.136322 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-adf218b8-3dae-4bbf-88d8-13c8f80c5f1c tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c5afa776-6f61-4b7a-b586-c5047b5fbe5e" status: 200 len: 1618 microversion: 2.1 time: 1.220747 Jun 20 11:56:57.137534 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 143/318] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:56 2022] GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee => generated 1468 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:57.148548 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 176/319] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:55 2022] GET /compute/v2.1/servers/c5afa776-6f61-4b7a-b586-c5047b5fbe5e => generated 1618 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:56:57.158758 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-99f5e7f9-b557-4781-a1ec-329adc035761 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Action: 'create', calling method: .version_select at 0x7f60800b1820>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-278056435", "policies": ["affinity"]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:57.182002 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=11,nova_api:INSERT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:56:57.191731 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-99f5e7f9-b557-4781-a1ec-329adc035761 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Getting quotas for project a6150795e7424cca91c71531840d88be. Resources: {'server_groups'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:56:57.200320 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-99f5e7f9-b557-4781-a1ec-329adc035761 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Getting quotas for user 1297c1b206f845bcaf936313fd7eed9b and project a6150795e7424cca91c71531840d88be. Resources: {'server_groups'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:56:57.284267 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-99f5e7f9-b557-4781-a1ec-329adc035761 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Getting quotas for project a6150795e7424cca91c71531840d88be. Resources: {'server_groups'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:56:57.296513 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-99f5e7f9-b557-4781-a1ec-329adc035761 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Getting quotas for user 1297c1b206f845bcaf936313fd7eed9b and project a6150795e7424cca91c71531840d88be. Resources: {'server_groups'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:56:57.329833 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-99f5e7f9-b557-4781-a1ec-329adc035761 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.180061 Jun 20 11:56:57.332373 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 144/320] 10.222.0.27 () {60 vars in 1173 bytes} [Mon Jun 20 11:56:57 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:56:57.637887 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f1a872ec-29e8-4e62-9369-d79ac957f105 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1824179048", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:57.758919 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-f1a872ec-29e8-4e62-9369-d79ac957f105 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] validate_networks() for None {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:56:57.829164 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-77a57018-e4f5-4422-8d16-e9ea4ddfb7d2 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-54778078", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "77cab7ed-5f36-44be-8700-82f38c90fe27"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:57.935667 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-77a57018-e4f5-4422-8d16-e9ea4ddfb7d2 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] validate_networks() for None {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:56:58.428162 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-f1a872ec-29e8-4e62-9369-d79ac957f105 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:56:58.428928 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-f1a872ec-29e8-4e62-9369-d79ac957f105 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:56:58.429498 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-f1a872ec-29e8-4e62-9369-d79ac957f105 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:56:58.429995 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-f1a872ec-29e8-4e62-9369-d79ac957f105 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:56:58.430500 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-f1a872ec-29e8-4e62-9369-d79ac957f105 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:56:58.466831 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f1a872ec-29e8-4e62-9369-d79ac957f105 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:58.467337 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f1a872ec-29e8-4e62-9369-d79ac957f105 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:58.468467 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f1a872ec-29e8-4e62-9369-d79ac957f105 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:58.475547 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f1a872ec-29e8-4e62-9369-d79ac957f105 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:58.518827 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-f1a872ec-29e8-4e62-9369-d79ac957f105 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Getting quotas for project c4bfbc9c01ee408fbfe777ae4ad19fbf. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:56:58.524293 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-f1a872ec-29e8-4e62-9369-d79ac957f105 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Getting quotas for user 3b1f420e75854a9f81f27ab6b1e718b2 and project c4bfbc9c01ee408fbfe777ae4ad19fbf. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:56:58.555682 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f1a872ec-29e8-4e62-9369-d79ac957f105 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:56:58.564923 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f1a872ec-29e8-4e62-9369-d79ac957f105 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f9361b90-1c71-4bf4-b694-483cab19b1b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:56:58.638368 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-77a57018-e4f5-4422-8d16-e9ea4ddfb7d2 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:56:58.639308 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-77a57018-e4f5-4422-8d16-e9ea4ddfb7d2 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:56:58.640415 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-77a57018-e4f5-4422-8d16-e9ea4ddfb7d2 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:56:58.641158 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-77a57018-e4f5-4422-8d16-e9ea4ddfb7d2 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:56:58.641909 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-77a57018-e4f5-4422-8d16-e9ea4ddfb7d2 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:56:58.682801 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-77a57018-e4f5-4422-8d16-e9ea4ddfb7d2 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:58.683636 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-77a57018-e4f5-4422-8d16-e9ea4ddfb7d2 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:58.684683 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-77a57018-e4f5-4422-8d16-e9ea4ddfb7d2 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:56:58.685375 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-77a57018-e4f5-4422-8d16-e9ea4ddfb7d2 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:56:58.690805 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f1a872ec-29e8-4e62-9369-d79ac957f105 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.056095 Jun 20 11:56:58.695377 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 177/321] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:56:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 11:56:58.710653 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-77a57018-e4f5-4422-8d16-e9ea4ddfb7d2 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Getting quotas for project a6150795e7424cca91c71531840d88be. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:56:58.744805 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-77a57018-e4f5-4422-8d16-e9ea4ddfb7d2 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Getting quotas for user 1297c1b206f845bcaf936313fd7eed9b and project a6150795e7424cca91c71531840d88be. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:56:58.786588 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-77a57018-e4f5-4422-8d16-e9ea4ddfb7d2 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Going to run 2 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:56:58.793587 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-77a57018-e4f5-4422-8d16-e9ea4ddfb7d2 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 5156dcdb-2590-41b9-8b02-3f04c5c4acf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:56:58.879712 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-77a57018-e4f5-4422-8d16-e9ea4ddfb7d2 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119127) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jun 20 11:56:58.930312 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-77a57018-e4f5-4422-8d16-e9ea4ddfb7d2 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Getting quotas for project a6150795e7424cca91c71531840d88be. Resources: {'server_group_members'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:56:58.950070 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-77a57018-e4f5-4422-8d16-e9ea4ddfb7d2 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Getting quotas for user 1297c1b206f845bcaf936313fd7eed9b and project a6150795e7424cca91c71531840d88be. Resources: {'server_group_members'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:56:59.046848 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-77a57018-e4f5-4422-8d16-e9ea4ddfb7d2 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Getting quotas for project a6150795e7424cca91c71531840d88be. Resources: {'server_group_members'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:56:59.054276 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-77a57018-e4f5-4422-8d16-e9ea4ddfb7d2 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Getting quotas for user 1297c1b206f845bcaf936313fd7eed9b and project a6150795e7424cca91c71531840d88be. Resources: {'server_group_members'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:56:59.076162 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-77a57018-e4f5-4422-8d16-e9ea4ddfb7d2 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 097ee17d-f450-475a-8f33-fe596f6d98a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=5156dcdb-2590-41b9-8b02-3f04c5c4acf7,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:56:59.197098 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-77a57018-e4f5-4422-8d16-e9ea4ddfb7d2 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Getting quotas for project a6150795e7424cca91c71531840d88be. Resources: {'server_group_members'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:56:59.200341 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-323eb305-8192-4787-9307-c633a5273121 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1459874095", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:56:59.209339 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-77a57018-e4f5-4422-8d16-e9ea4ddfb7d2 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Getting quotas for user 1297c1b206f845bcaf936313fd7eed9b and project a6150795e7424cca91c71531840d88be. Resources: {'server_group_members'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:56:59.309132 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-77a57018-e4f5-4422-8d16-e9ea4ddfb7d2 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Getting quotas for project a6150795e7424cca91c71531840d88be. Resources: {'server_group_members'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:56:59.325729 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-323eb305-8192-4787-9307-c633a5273121 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] validate_networks() for None {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:56:59.336422 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-77a57018-e4f5-4422-8d16-e9ea4ddfb7d2 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Getting quotas for user 1297c1b206f845bcaf936313fd7eed9b and project a6150795e7424cca91c71531840d88be. Resources: {'server_group_members'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:56:59.406803 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-77a57018-e4f5-4422-8d16-e9ea4ddfb7d2 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.585708 Jun 20 11:56:59.407613 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 145/322] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:56:57 2022] POST /compute/v2.1/servers => generated 32 bytes in 1587 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jun 20 11:56:59.413235 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fe56bce5-b169-47ab-afc5-4f88f75c0d91 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:56:59.414185 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fe56bce5-b169-47ab-afc5-4f88f75c0d91 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f9361b90-1c71-4bf4-b694-483cab19b1b8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:56:59.981742 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fe56bce5-b169-47ab-afc5-4f88f75c0d91 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:56:59.995000 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fe56bce5-b169-47ab-afc5-4f88f75c0d91 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8" status: 200 len: 1219 microversion: 2.1 time: 0.583319 Jun 20 11:56:59.995613 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 146/323] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:56:59 2022] GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8 => generated 1219 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:00.331452 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-323eb305-8192-4787-9307-c633a5273121 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:57:00.332159 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-323eb305-8192-4787-9307-c633a5273121 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:57:00.332625 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-323eb305-8192-4787-9307-c633a5273121 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:57:00.333324 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-323eb305-8192-4787-9307-c633a5273121 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:57:00.333878 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-323eb305-8192-4787-9307-c633a5273121 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:57:00.351534 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-323eb305-8192-4787-9307-c633a5273121 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:00.354546 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-323eb305-8192-4787-9307-c633a5273121 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:00.358599 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-323eb305-8192-4787-9307-c633a5273121 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:00.359253 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-323eb305-8192-4787-9307-c633a5273121 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:00.395109 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-323eb305-8192-4787-9307-c633a5273121 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Getting quotas for project d9fc528349c34afbace41593b93d169a. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:57:00.405866 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-323eb305-8192-4787-9307-c633a5273121 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Getting quotas for user f069018a1fc24a9fbaac9b58ee7b07fa and project d9fc528349c34afbace41593b93d169a. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:57:00.411352 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=87,nova_api:DELETE=6,nova_api:UPDATE=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:57:00.452518 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-323eb305-8192-4787-9307-c633a5273121 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:57:00.461651 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-323eb305-8192-4787-9307-c633a5273121 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 8a71d955-cfc0-44b7-ae7b-e899afa8698a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:57:00.609756 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-323eb305-8192-4787-9307-c633a5273121 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.913078 Jun 20 11:57:00.628890 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 178/324] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:56:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 11:57:00.636012 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-253d96d4-fda2-45f6-8c41-a18660ae130d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:00.644941 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-253d96d4-fda2-45f6-8c41-a18660ae130d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:00.646144 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-253d96d4-fda2-45f6-8c41-a18660ae130d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Searching by: {'deleted': False, 'project_id': 'a6150795e7424cca91c71531840d88be'} {{(pid=119128) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 11:57:00.693901 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1494f7d1-b0a9-410d-a2b4-031540afcece tempest-AZAdminV2TestJSON-1130358835 tempest-AZAdminV2TestJSON-1130358835-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:00.703975 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1494f7d1-b0a9-410d-a2b4-031540afcece tempest-AZAdminV2TestJSON-1130358835 tempest-AZAdminV2TestJSON-1130358835-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:00.706530 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1494f7d1-b0a9-410d-a2b4-031540afcece tempest-AZAdminV2TestJSON-1130358835 tempest-AZAdminV2TestJSON-1130358835-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:00.707784 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1494f7d1-b0a9-410d-a2b4-031540afcece tempest-AZAdminV2TestJSON-1130358835 tempest-AZAdminV2TestJSON-1130358835-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:00.708544 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1494f7d1-b0a9-410d-a2b4-031540afcece tempest-AZAdminV2TestJSON-1130358835 tempest-AZAdminV2TestJSON-1130358835-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:00.717089 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-253d96d4-fda2-45f6-8c41-a18660ae130d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:00.719816 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-253d96d4-fda2-45f6-8c41-a18660ae130d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:00.726089 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-253d96d4-fda2-45f6-8c41-a18660ae130d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:00.729888 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-253d96d4-fda2-45f6-8c41-a18660ae130d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:00.736159 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:57:00.753820 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1494f7d1-b0a9-410d-a2b4-031540afcece tempest-AZAdminV2TestJSON-1130358835 tempest-AZAdminV2TestJSON-1130358835-project-admin] 10.222.0.27 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.750218 Jun 20 11:57:00.755112 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 147/325] 10.222.0.27 () {58 vars in 1163 bytes} [Mon Jun 20 11:57:00 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 11:57:00.769677 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c2be24a5-3634-42e1-a4a1-0f122763eefc tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:00.771547 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c2be24a5-3634-42e1-a4a1-0f122763eefc tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 8a71d955-cfc0-44b7-ae7b-e899afa8698a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:00.956888 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.multi_cell_list [None req-253d96d4-fda2-45f6-8c41-a18660ae130d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=119128) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 11:57:01.017704 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c2be24a5-3634-42e1-a4a1-0f122763eefc tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f069018a1fc24a9fbaac9b58ee7b07fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fc528349c34afbace41593b93d169a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:01.026508 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c2be24a5-3634-42e1-a4a1-0f122763eefc tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "GET /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a" status: 200 len: 1222 microversion: 2.1 time: 0.270148 Jun 20 11:57:01.028798 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 148/326] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:00 2022] GET /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a => generated 1222 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:01.053959 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-05764f3f-2ead-4344-939d-cd424f99bba5 tempest-AZAdminV2TestJSON-1130358835 tempest-AZAdminV2TestJSON-1130358835-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:01.057937 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:57:01.057937 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:57:01.061794 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-05764f3f-2ead-4344-939d-cd424f99bba5 tempest-AZAdminV2TestJSON-1130358835 tempest-AZAdminV2TestJSON-1130358835-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:01.069629 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-05764f3f-2ead-4344-939d-cd424f99bba5 tempest-AZAdminV2TestJSON-1130358835 tempest-AZAdminV2TestJSON-1130358835-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:01.072265 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-05764f3f-2ead-4344-939d-cd424f99bba5 tempest-AZAdminV2TestJSON-1130358835 tempest-AZAdminV2TestJSON-1130358835-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:01.074637 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-05764f3f-2ead-4344-939d-cd424f99bba5 tempest-AZAdminV2TestJSON-1130358835 tempest-AZAdminV2TestJSON-1130358835-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:01.155405 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-05764f3f-2ead-4344-939d-cd424f99bba5 tempest-AZAdminV2TestJSON-1130358835 tempest-AZAdminV2TestJSON-1130358835-project-admin] 10.222.0.27 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.124653 Jun 20 11:57:01.156583 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 149/327] 10.222.0.27 () {58 vars in 1184 bytes} [Mon Jun 20 11:57:01 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:57:01.171803 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-93e4a615-8ca0-47c4-ae17-b3d1cc30c47c tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:01.172681 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-93e4a615-8ca0-47c4-ae17-b3d1cc30c47c tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f9361b90-1c71-4bf4-b694-483cab19b1b8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:01.187748 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93e4a615-8ca0-47c4-ae17-b3d1cc30c47c tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:01.188449 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93e4a615-8ca0-47c4-ae17-b3d1cc30c47c tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:01.189476 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93e4a615-8ca0-47c4-ae17-b3d1cc30c47c tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:01.190402 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93e4a615-8ca0-47c4-ae17-b3d1cc30c47c tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:01.210230 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-253d96d4-fda2-45f6-8c41-a18660ae130d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1000 microversion: 2.1 time: 0.579342 Jun 20 11:57:01.212228 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 179/328] 10.222.0.27 () {58 vars in 1124 bytes} [Mon Jun 20 11:57:00 2022] GET /compute/v2.1/servers => generated 1000 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:01.347369 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-93e4a615-8ca0-47c4-ae17-b3d1cc30c47c tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:01.355731 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-93e4a615-8ca0-47c4-ae17-b3d1cc30c47c tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8" status: 200 len: 1289 microversion: 2.1 time: 0.197964 Jun 20 11:57:01.359114 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 150/329] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:01 2022] GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8 => generated 1289 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:01.372836 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c44e6d34-09c2-473e-ad3b-542da0fa84bd tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:01.373692 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c44e6d34-09c2-473e-ad3b-542da0fa84bd tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 097ee17d-f450-475a-8f33-fe596f6d98a0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:01.389692 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c44e6d34-09c2-473e-ad3b-542da0fa84bd tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:01.390391 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c44e6d34-09c2-473e-ad3b-542da0fa84bd tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:01.391316 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c44e6d34-09c2-473e-ad3b-542da0fa84bd tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:01.391889 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c44e6d34-09c2-473e-ad3b-542da0fa84bd tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:01.542307 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4e21fe44-66d7-40c9-aec0-4cfd11e43aea tempest-FlavorsExtraSpecsTestJSON-933649690 tempest-FlavorsExtraSpecsTestJSON-933649690-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-72115355", "ram": 512, "vcpus": 1, "disk": 10, "id": 1619903214, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:01.544681 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:57:01.544681 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:57:01.584698 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4e21fe44-66d7-40c9-aec0-4cfd11e43aea tempest-FlavorsExtraSpecsTestJSON-933649690 tempest-FlavorsExtraSpecsTestJSON-933649690-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.370784 Jun 20 11:57:01.585311 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 180/330] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:57:01 2022] POST /compute/v2.1/flavors => generated 414 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:57:01.599344 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-340398fa-e158-4e5d-9d99-9173a44c1bca tempest-FlavorsExtraSpecsTestJSON-933649690 tempest-FlavorsExtraSpecsTestJSON-933649690-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:01.602160 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:57:01.602160 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:57:01.678698 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c44e6d34-09c2-473e-ad3b-542da0fa84bd tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:01.687165 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c44e6d34-09c2-473e-ad3b-542da0fa84bd tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0" status: 200 len: 1221 microversion: 2.1 time: 0.326758 Jun 20 11:57:01.687736 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 151/331] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:01 2022] GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0 => generated 1221 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:01.725415 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-340398fa-e158-4e5d-9d99-9173a44c1bca tempest-FlavorsExtraSpecsTestJSON-933649690 tempest-FlavorsExtraSpecsTestJSON-933649690-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1619903214/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.130405 Jun 20 11:57:01.729698 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 181/332] 10.222.0.27 () {60 vars in 1223 bytes} [Mon Jun 20 11:57:01 2022] POST /compute/v2.1/flavors/1619903214/os-extra_specs => generated 66 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 20 11:57:02.048709 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0c5918b8-4efa-47b4-945b-6e5769388020 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:02.049375 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0c5918b8-4efa-47b4-945b-6e5769388020 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 8a71d955-cfc0-44b7-ae7b-e899afa8698a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:02.064893 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c5918b8-4efa-47b4-945b-6e5769388020 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:02.066807 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c5918b8-4efa-47b4-945b-6e5769388020 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:02.071505 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c5918b8-4efa-47b4-945b-6e5769388020 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:02.072033 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c5918b8-4efa-47b4-945b-6e5769388020 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:02.295287 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0c5918b8-4efa-47b4-945b-6e5769388020 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f069018a1fc24a9fbaac9b58ee7b07fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fc528349c34afbace41593b93d169a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:02.303779 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:57:02.306113 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0c5918b8-4efa-47b4-945b-6e5769388020 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "GET /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a" status: 200 len: 1218 microversion: 2.1 time: 0.265158 Jun 20 11:57:02.317210 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 182/333] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:02 2022] GET /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a => generated 1218 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:02.373229 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-56525d99-001d-4681-858e-c2116f8e2984 tempest-FlavorsExtraSpecsTestJSON-1900562795 tempest-FlavorsExtraSpecsTestJSON-1900562795-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:02.379074 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2d59ab7a-1ac8-4983-a41e-4ce908c70026 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:02.379776 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2d59ab7a-1ac8-4983-a41e-4ce908c70026 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f9361b90-1c71-4bf4-b694-483cab19b1b8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:02.401543 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2d59ab7a-1ac8-4983-a41e-4ce908c70026 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:02.401991 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2d59ab7a-1ac8-4983-a41e-4ce908c70026 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:02.402764 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2d59ab7a-1ac8-4983-a41e-4ce908c70026 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:02.403196 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2d59ab7a-1ac8-4983-a41e-4ce908c70026 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:02.408614 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-56525d99-001d-4681-858e-c2116f8e2984 tempest-FlavorsExtraSpecsTestJSON-1900562795 tempest-FlavorsExtraSpecsTestJSON-1900562795-project] 10.222.0.27 "GET /compute/v2.1/flavors/1619903214/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.670003 Jun 20 11:57:02.410233 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 152/334] 10.222.0.27 () {58 vars in 1202 bytes} [Mon Jun 20 11:57:01 2022] GET /compute/v2.1/flavors/1619903214/os-extra_specs => generated 66 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 11:57:02.449865 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f452b06f-4df7-407c-a706-056e265a5e5e tempest-FlavorsExtraSpecsTestJSON-933649690 tempest-FlavorsExtraSpecsTestJSON-933649690-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:02.455363 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:57:02.455363 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:57:02.554777 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f452b06f-4df7-407c-a706-056e265a5e5e tempest-FlavorsExtraSpecsTestJSON-933649690 tempest-FlavorsExtraSpecsTestJSON-933649690-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1619903214/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.136089 Jun 20 11:57:02.557302 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 153/335] 10.222.0.27 () {60 vars in 1223 bytes} [Mon Jun 20 11:57:02 2022] POST /compute/v2.1/flavors/1619903214/os-extra_specs => generated 66 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 11:57:02.573545 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-65aff74a-a1f8-4595-9170-37bbfc5da79c tempest-FlavorsExtraSpecsTestJSON-1900562795 tempest-FlavorsExtraSpecsTestJSON-1900562795-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:02.601997 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-65aff74a-a1f8-4595-9170-37bbfc5da79c tempest-FlavorsExtraSpecsTestJSON-1900562795 tempest-FlavorsExtraSpecsTestJSON-1900562795-project] 10.222.0.27 "GET /compute/v2.1/flavors/1619903214/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.039478 Jun 20 11:57:02.603667 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 154/336] 10.222.0.27 () {58 vars in 1244 bytes} [Mon Jun 20 11:57:02 2022] GET /compute/v2.1/flavors/1619903214/os-extra_specs/hw:numa_nodes => generated 22 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 11:57:02.612378 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2d59ab7a-1ac8-4983-a41e-4ce908c70026 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:02.618667 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-990e38f4-362f-4fa9-8ec8-f9f6799bbb5f tempest-FlavorsExtraSpecsTestJSON-933649690 tempest-FlavorsExtraSpecsTestJSON-933649690-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:02.623548 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2d59ab7a-1ac8-4983-a41e-4ce908c70026 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8" status: 200 len: 1277 microversion: 2.1 time: 0.252026 Jun 20 11:57:02.630049 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 183/337] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:02 2022] GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8 => generated 1277 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:02.688822 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-990e38f4-362f-4fa9-8ec8-f9f6799bbb5f tempest-FlavorsExtraSpecsTestJSON-933649690 tempest-FlavorsExtraSpecsTestJSON-933649690-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1619903214/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.078726 Jun 20 11:57:02.691918 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 155/338] 10.222.0.27 () {60 vars in 1223 bytes} [Mon Jun 20 11:57:02 2022] POST /compute/v2.1/flavors/1619903214/os-extra_specs => generated 66 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 11:57:02.699798 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-48d62663-142a-4efe-93ed-78753a473116 tempest-FlavorsExtraSpecsTestJSON-933649690 tempest-FlavorsExtraSpecsTestJSON-933649690-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:02.725645 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-568663bd-7be7-47e1-8845-2aa2a9988267 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:02.727725 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-48d62663-142a-4efe-93ed-78753a473116 tempest-FlavorsExtraSpecsTestJSON-933649690 tempest-FlavorsExtraSpecsTestJSON-933649690-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/1619903214/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.031562 Jun 20 11:57:02.728349 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 184/339] 10.222.0.27 () {58 vars in 1202 bytes} [Mon Jun 20 11:57:02 2022] GET /compute/v2.1/flavors/1619903214/os-extra_specs => generated 66 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 11:57:02.732948 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-568663bd-7be7-47e1-8845-2aa2a9988267 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 097ee17d-f450-475a-8f33-fe596f6d98a0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:02.743837 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-601ec1dc-50c0-4426-bbb5-f734da599aa9 tempest-FlavorsExtraSpecsTestJSON-933649690 tempest-FlavorsExtraSpecsTestJSON-933649690-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:02.752068 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:57:02.752068 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:57:02.754096 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-568663bd-7be7-47e1-8845-2aa2a9988267 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:02.754779 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-568663bd-7be7-47e1-8845-2aa2a9988267 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:02.759582 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-568663bd-7be7-47e1-8845-2aa2a9988267 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:02.774517 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-568663bd-7be7-47e1-8845-2aa2a9988267 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:02.880700 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-601ec1dc-50c0-4426-bbb5-f734da599aa9 tempest-FlavorsExtraSpecsTestJSON-933649690 tempest-FlavorsExtraSpecsTestJSON-933649690-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/1619903214/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.141095 Jun 20 11:57:02.881817 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 185/340] 10.222.0.27 () {60 vars in 1264 bytes} [Mon Jun 20 11:57:02 2022] PUT /compute/v2.1/flavors/1619903214/os-extra_specs/hw:numa_nodes => generated 22 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 11:57:02.894403 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5f664b6a-7b27-498c-9fb1-09d3a4b4935f tempest-FlavorsExtraSpecsTestJSON-933649690 tempest-FlavorsExtraSpecsTestJSON-933649690-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:02.916884 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5f664b6a-7b27-498c-9fb1-09d3a4b4935f tempest-FlavorsExtraSpecsTestJSON-933649690 tempest-FlavorsExtraSpecsTestJSON-933649690-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/1619903214/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.027219 Jun 20 11:57:02.917519 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 186/341] 10.222.0.27 () {58 vars in 1202 bytes} [Mon Jun 20 11:57:02 2022] GET /compute/v2.1/flavors/1619903214/os-extra_specs => generated 66 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 11:57:02.932639 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-39394ee4-e325-4c4a-92e5-ce8546c6b1f4 tempest-FlavorsExtraSpecsTestJSON-933649690 tempest-FlavorsExtraSpecsTestJSON-933649690-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:02.933432 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:57:02.933432 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:57:03.016990 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-39394ee4-e325-4c4a-92e5-ce8546c6b1f4 tempest-FlavorsExtraSpecsTestJSON-933649690 tempest-FlavorsExtraSpecsTestJSON-933649690-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1619903214/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.091062 Jun 20 11:57:03.021080 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 187/342] 10.222.0.27 () {58 vars in 1247 bytes} [Mon Jun 20 11:57:02 2022] DELETE /compute/v2.1/flavors/1619903214/os-extra_specs/hw:numa_nodes => generated 0 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 20 11:57:03.038125 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-84abe89e-a024-463c-b975-c9cb061f6402 tempest-FlavorsExtraSpecsTestJSON-933649690 tempest-FlavorsExtraSpecsTestJSON-933649690-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:03.094329 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-568663bd-7be7-47e1-8845-2aa2a9988267 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:03.104523 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-568663bd-7be7-47e1-8845-2aa2a9988267 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0" status: 200 len: 1269 microversion: 2.1 time: 0.398971 Jun 20 11:57:03.105675 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 156/343] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:02 2022] GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0 => generated 1269 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:03.135368 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-84abe89e-a024-463c-b975-c9cb061f6402 tempest-FlavorsExtraSpecsTestJSON-933649690 tempest-FlavorsExtraSpecsTestJSON-933649690-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1619903214/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.109442 Jun 20 11:57:03.137112 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 188/344] 10.222.0.27 () {58 vars in 1247 bytes} [Mon Jun 20 11:57:03 2022] DELETE /compute/v2.1/flavors/1619903214/os-extra_specs/hw:cpu_policy => generated 0 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 20 11:57:03.147751 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d42bddc9-7ad7-4a75-9155-fb0f5981368f tempest-FlavorsExtraSpecsTestJSON-933649690 tempest-FlavorsExtraSpecsTestJSON-933649690-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:03.164009 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d42bddc9-7ad7-4a75-9155-fb0f5981368f tempest-FlavorsExtraSpecsTestJSON-933649690 tempest-FlavorsExtraSpecsTestJSON-933649690-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/1619903214/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.019711 Jun 20 11:57:03.166110 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 157/345] 10.222.0.27 () {58 vars in 1202 bytes} [Mon Jun 20 11:57:03 2022] GET /compute/v2.1/flavors/1619903214/os-extra_specs => generated 19 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 11:57:03.175397 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ac15bbc4-014d-49c8-a2a3-6788020e4cd4 tempest-FlavorsExtraSpecsTestJSON-933649690 tempest-FlavorsExtraSpecsTestJSON-933649690-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:03.176551 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:57:03.176551 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:57:03.217236 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ac15bbc4-014d-49c8-a2a3-6788020e4cd4 tempest-FlavorsExtraSpecsTestJSON-933649690 tempest-FlavorsExtraSpecsTestJSON-933649690-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1619903214" status: 202 len: 0 microversion: 2.1 time: 0.045583 Jun 20 11:57:03.218504 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 189/346] 10.222.0.27 () {58 vars in 1160 bytes} [Mon Jun 20 11:57:03 2022] DELETE /compute/v2.1/flavors/1619903214 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:57:03.228417 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7470ba2e-630d-47de-915e-a1b173c9b512 tempest-FlavorsExtraSpecsTestJSON-933649690 tempest-FlavorsExtraSpecsTestJSON-933649690-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:03.313060 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7470ba2e-630d-47de-915e-a1b173c9b512 tempest-FlavorsExtraSpecsTestJSON-933649690 tempest-FlavorsExtraSpecsTestJSON-933649690-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.087042 Jun 20 11:57:03.318112 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 158/347] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 11:57:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:03.334426 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d290bd55-a1e0-4da0-863c-a17dffcf1a72 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:03.335048 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d290bd55-a1e0-4da0-863c-a17dffcf1a72 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 8a71d955-cfc0-44b7-ae7b-e899afa8698a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:03.347482 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d290bd55-a1e0-4da0-863c-a17dffcf1a72 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:03.349706 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d290bd55-a1e0-4da0-863c-a17dffcf1a72 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:03.350732 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d290bd55-a1e0-4da0-863c-a17dffcf1a72 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:03.352489 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d290bd55-a1e0-4da0-863c-a17dffcf1a72 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:03.650124 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d290bd55-a1e0-4da0-863c-a17dffcf1a72 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f069018a1fc24a9fbaac9b58ee7b07fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fc528349c34afbace41593b93d169a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:03.650738 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-02d58d74-4c8d-4927-8e3f-94a261d4f59b tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:03.651157 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-02d58d74-4c8d-4927-8e3f-94a261d4f59b tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f9361b90-1c71-4bf4-b694-483cab19b1b8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:03.673609 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02d58d74-4c8d-4927-8e3f-94a261d4f59b tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:03.674086 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02d58d74-4c8d-4927-8e3f-94a261d4f59b tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:03.674211 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d290bd55-a1e0-4da0-863c-a17dffcf1a72 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "GET /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a" status: 200 len: 1292 microversion: 2.1 time: 0.348125 Jun 20 11:57:03.683528 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02d58d74-4c8d-4927-8e3f-94a261d4f59b tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:03.683528 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02d58d74-4c8d-4927-8e3f-94a261d4f59b tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:03.683759 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 190/348] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:03 2022] GET /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a => generated 1292 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:04.454291 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-37999293-065e-4547-a7f8-acfcc0c430bd tempest-InstanceUsageAuditLogNegativeTestJSON-843889562 tempest-InstanceUsageAuditLogNegativeTestJSON-843889562-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:04.455060 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:57:04.455060 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:57:04.456279 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-37999293-065e-4547-a7f8-acfcc0c430bd tempest-InstanceUsageAuditLogNegativeTestJSON-843889562 tempest-InstanceUsageAuditLogNegativeTestJSON-843889562-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Jun 20 11:57:04.466250 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-37999293-065e-4547-a7f8-acfcc0c430bd tempest-InstanceUsageAuditLogNegativeTestJSON-843889562 tempest-InstanceUsageAuditLogNegativeTestJSON-843889562-project-admin] Request method failure captured: Jun 20 11:57:04.466250 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Jun 20 11:57:04.466250 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:57:04.466250 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:57:04.466250 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:57:04.466250 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 11:57:04.466250 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:57:04.466250 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:57:04.466250 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:57:04.466250 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:57:04.466250 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGCP5l6UK2N8iE48ZHc9EongyFnaWeraf7Cd4BFJG9aa5WfESq69IVAWkcgdMDsqTut9vNFIqfuUc8XHnt5kDp6MyXnOXah-gjNnb2om7zX0Xu97oIjHCBrg_h7_zn4nfHpg6sCneDxyVQe9iGQUAR8kC5FsoM7KDh-x9E2cpprgCPE Jun 20 11:57:04.466250 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:57:04.466250 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:57:04.466250 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:57:04.466250 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:57:04.466250 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:57:04.466250 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:57:04.466250 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 739a293694a6436e978af08fbb28b0f6 Jun 20 11:57:04.466250 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-843889562 Jun 20 11:57:04.466250 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member,admin Jun 20 11:57:04.466250 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member,admin Jun 20 11:57:04.468516 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/739a293694a6436e978af08fbb28b0f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/739a293694a6436e978af08fbb28b0f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/739a293694a6436e978af08fbb28b0f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_739a293694a6436e978af08fbb28b0f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:57:04.468516 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-843889562 Jun 20 11:57:04.468516 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 739a293694a6436e978af08fbb28b0f6 Jun 20 11:57:04.468516 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-843889562 Jun 20 11:57:04.468516 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-843889562-project-admin Jun 20 11:57:04.468516 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:57:04.468516 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:57:04.468516 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 4532e66ccb7842ea95931a0e43ef60f2 Jun 20 11:57:04.468516 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-843889562-project-admin Jun 20 11:57:04.468516 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 11:57:04.468516 n-d-master-1 devstack@n-api.service[119128]: exception: Invalid timestamp for date invalid_time Jun 20 11:57:04.468516 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'invalid_time'} Jun 20 11:57:04.469366 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:57:04.469366 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:04.469366 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Jun 20 11:57:04.469366 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Jun 20 11:57:04.469366 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Jun 20 11:57:04.469366 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Jun 20 11:57:04.469366 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Jun 20 11:57:04.469366 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Jun 20 11:57:04.469366 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Jun 20 11:57:04.469366 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:04.469366 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:57:04.469366 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:04.469366 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:04.469366 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:57:04.469366 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:57:04.469366 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:57:04.469366 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:57:04.469366 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:57:04.469366 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:57:04.469366 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Jun 20 11:57:04.470805 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Jun 20 11:57:04.470805 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Jun 20 11:57:04.470805 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:04.470805 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:57:04.470805 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:04.470805 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:04.470805 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:57:04.470805 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:57:04.470805 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:57:04.470805 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:57:04.470805 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Jun 20 11:57:04.470805 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:04.470805 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-37999293-065e-4547-a7f8-acfcc0c430bd tempest-InstanceUsageAuditLogNegativeTestJSON-843889562 tempest-InstanceUsageAuditLogNegativeTestJSON-843889562-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:57:04.470805 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-37999293-065e-4547-a7f8-acfcc0c430bd tempest-InstanceUsageAuditLogNegativeTestJSON-843889562 tempest-InstanceUsageAuditLogNegativeTestJSON-843889562-project-admin] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.659485 Jun 20 11:57:04.471617 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 191/349] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jun 20 11:57:03 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 661 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 20 11:57:04.473724 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-02d58d74-4c8d-4927-8e3f-94a261d4f59b tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:04.482411 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-02d58d74-4c8d-4927-8e3f-94a261d4f59b tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8" status: 200 len: 1277 microversion: 2.1 time: 0.836336 Jun 20 11:57:04.482988 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 159/350] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:03 2022] GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8 => generated 1277 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:57:04.499744 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1ab5ee88-8866-414f-a335-d1cdf786c21d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:04.506321 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1ab5ee88-8866-414f-a335-d1cdf786c21d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 097ee17d-f450-475a-8f33-fe596f6d98a0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:04.526099 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1ab5ee88-8866-414f-a335-d1cdf786c21d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:04.530127 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1ab5ee88-8866-414f-a335-d1cdf786c21d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:04.532285 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1ab5ee88-8866-414f-a335-d1cdf786c21d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:04.532761 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1ab5ee88-8866-414f-a335-d1cdf786c21d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:04.686083 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-23ecc02d-c99a-4388-b5f8-397ae0690466 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-763338388", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "7c57fb93-e580-4d64-8790-597bcac7a666"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:04.822500 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-23ecc02d-c99a-4388-b5f8-397ae0690466 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] validate_networks() for [('7c57fb93-e580-4d64-8790-597bcac7a666', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:57:05.256769 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1ab5ee88-8866-414f-a335-d1cdf786c21d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:05.285756 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1ab5ee88-8866-414f-a335-d1cdf786c21d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0" status: 200 len: 1275 microversion: 2.1 time: 0.797587 Jun 20 11:57:05.286667 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 160/351] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:04 2022] GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0 => generated 1275 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:05.767185 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-370e5bff-2560-40ff-8727-4edcb2f447b8 tempest-InstanceUsageAuditLogNegativeTestJSON-677780340 tempest-InstanceUsageAuditLogNegativeTestJSON-677780340-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:05.768327 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:57:05.768327 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:57:05.769979 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-370e5bff-2560-40ff-8727-4edcb2f447b8 tempest-InstanceUsageAuditLogNegativeTestJSON-677780340 tempest-InstanceUsageAuditLogNegativeTestJSON-677780340-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '795462ce4fa049d7ac42fe63261ae4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762585f86c8144d48d89f160882fb3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:05.775645 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-370e5bff-2560-40ff-8727-4edcb2f447b8 tempest-InstanceUsageAuditLogNegativeTestJSON-677780340 tempest-InstanceUsageAuditLogNegativeTestJSON-677780340-project] Request method failure captured: Jun 20 11:57:05.775645 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Jun 20 11:57:05.775645 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:57:05.775645 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:57:05.775645 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:57:05.775645 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 11:57:05.775645 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:57:05.775645 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:57:05.775645 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:57:05.775645 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:57:05.775645 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGCNU21MLozNsTGVEqlZ0fYysvpI7EgydWInDYKrOMlA4GTCsA6G4s_WCwlNRGKX7L0gedCQQLUxMTjQyj6_QnDAGePYOwVh63BNzBCU6j5D7U5sovi7qEtJpjkzGwEASWYPajtcl51eQvOSW1Eh7hRbsNHb0lKL8NZrbRMOe5OtOoc Jun 20 11:57:05.775645 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:57:05.775645 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:57:05.775645 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:57:05.775645 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:57:05.775645 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:57:05.775645 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:57:05.775645 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 762585f86c8144d48d89f160882fb3c4 Jun 20 11:57:05.775645 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-677780340 Jun 20 11:57:05.775645 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 11:57:05.775645 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 11:57:05.777700 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/762585f86c8144d48d89f160882fb3c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/762585f86c8144d48d89f160882fb3c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/762585f86c8144d48d89f160882fb3c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_762585f86c8144d48d89f160882fb3c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:57:05.777700 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-677780340 Jun 20 11:57:05.777700 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 762585f86c8144d48d89f160882fb3c4 Jun 20 11:57:05.777700 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-677780340 Jun 20 11:57:05.777700 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-677780340-project Jun 20 11:57:05.777700 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:57:05.777700 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:57:05.777700 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 795462ce4fa049d7ac42fe63261ae4e2 Jun 20 11:57:05.777700 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-677780340-project Jun 20 11:57:05.777700 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 11:57:05.777700 n-d-master-1 devstack@n-api.service[119127]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jun 20 11:57:05.778704 n-d-master-1 devstack@n-api.service[119127]: action_args: {} Jun 20 11:57:05.778704 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:57:05.778704 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:05.778704 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:57:05.778704 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:57:05.778704 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:57:05.778704 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:57:05.778704 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:57:05.778704 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:57:05.778704 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Jun 20 11:57:05.778704 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Jun 20 11:57:05.778704 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 20 11:57:05.778704 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 20 11:57:05.778704 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 20 11:57:05.778704 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 20 11:57:05.778704 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 11:57:05.778704 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 11:57:05.778704 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 11:57:05.778704 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 11:57:05.778704 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 20 11:57:05.780174 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 20 11:57:05.780174 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 20 11:57:05.780174 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 20 11:57:05.780174 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 20 11:57:05.780174 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 20 11:57:05.780174 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jun 20 11:57:05.780174 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:57:05.780174 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:57:05.780174 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:57:05.780174 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:05.780174 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:57:05.780174 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:57:05.780174 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 20 11:57:05.780174 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 20 11:57:05.780174 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jun 20 11:57:05.780174 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:57:05.782524 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-370e5bff-2560-40ff-8727-4edcb2f447b8 tempest-InstanceUsageAuditLogNegativeTestJSON-677780340 tempest-InstanceUsageAuditLogNegativeTestJSON-677780340-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:57:05.783638 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-370e5bff-2560-40ff-8727-4edcb2f447b8 tempest-InstanceUsageAuditLogNegativeTestJSON-677780340 tempest-InstanceUsageAuditLogNegativeTestJSON-677780340-project] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.489922 Jun 20 11:57:05.784362 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 161/352] 10.222.0.27 () {58 vars in 1184 bytes} [Mon Jun 20 11:57:05 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 491 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:57:05.794002 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4df31f76-cacf-4400-8097-3cdd60a4870e tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:05.796099 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4df31f76-cacf-4400-8097-3cdd60a4870e tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 8a71d955-cfc0-44b7-ae7b-e899afa8698a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:05.819041 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4df31f76-cacf-4400-8097-3cdd60a4870e tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:05.819753 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4df31f76-cacf-4400-8097-3cdd60a4870e tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:05.820714 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4df31f76-cacf-4400-8097-3cdd60a4870e tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:05.821283 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4df31f76-cacf-4400-8097-3cdd60a4870e tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:05.958993 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4df31f76-cacf-4400-8097-3cdd60a4870e tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f069018a1fc24a9fbaac9b58ee7b07fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fc528349c34afbace41593b93d169a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:05.975255 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4df31f76-cacf-4400-8097-3cdd60a4870e tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "GET /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a" status: 200 len: 1280 microversion: 2.1 time: 0.188080 Jun 20 11:57:05.976487 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 162/353] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:05 2022] GET /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a => generated 1280 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:05.984660 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f3f02890-ef52-4f90-a628-d55f74ef7417 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:05.985500 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f3f02890-ef52-4f90-a628-d55f74ef7417 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f9361b90-1c71-4bf4-b694-483cab19b1b8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:06.004491 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f3f02890-ef52-4f90-a628-d55f74ef7417 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:06.005838 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f3f02890-ef52-4f90-a628-d55f74ef7417 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:06.023398 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f3f02890-ef52-4f90-a628-d55f74ef7417 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:06.029250 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f3f02890-ef52-4f90-a628-d55f74ef7417 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:06.085247 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:57:06.489540 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f3f02890-ef52-4f90-a628-d55f74ef7417 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:06.498870 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f3f02890-ef52-4f90-a628-d55f74ef7417 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8" status: 200 len: 1319 microversion: 2.1 time: 0.521079 Jun 20 11:57:06.510859 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 163/354] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:05 2022] GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8 => generated 1319 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:06.521431 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ae080499-6a20-4841-950b-a4cc37ab7aa8 tempest-InstanceUsageAuditLogNegativeTestJSON-677780340 tempest-InstanceUsageAuditLogNegativeTestJSON-677780340-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:06.524775 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:57:06.524775 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:57:06.529605 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ae080499-6a20-4841-950b-a4cc37ab7aa8 tempest-InstanceUsageAuditLogNegativeTestJSON-677780340 tempest-InstanceUsageAuditLogNegativeTestJSON-677780340-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '795462ce4fa049d7ac42fe63261ae4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762585f86c8144d48d89f160882fb3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:06.542546 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ae080499-6a20-4841-950b-a4cc37ab7aa8 tempest-InstanceUsageAuditLogNegativeTestJSON-677780340 tempest-InstanceUsageAuditLogNegativeTestJSON-677780340-project] Request method failure captured: Jun 20 11:57:06.542546 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-06-20%2011:57:05 HTTP/1.1 Jun 20 11:57:06.542546 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:57:06.542546 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:57:06.542546 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:57:06.542546 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 11:57:06.542546 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:57:06.542546 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:57:06.542546 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:57:06.542546 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:57:06.542546 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGCNU21MLozNsTGVEqlZ0fYysvpI7EgydWInDYKrOMlA4GTCsA6G4s_WCwlNRGKX7L0gedCQQLUxMTjQyj6_QnDAGePYOwVh63BNzBCU6j5D7U5sovi7qEtJpjkzGwEASWYPajtcl51eQvOSW1Eh7hRbsNHb0lKL8NZrbRMOe5OtOoc Jun 20 11:57:06.542546 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:57:06.542546 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:57:06.542546 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:57:06.542546 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:57:06.542546 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:57:06.542546 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:57:06.542546 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 762585f86c8144d48d89f160882fb3c4 Jun 20 11:57:06.542546 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-677780340 Jun 20 11:57:06.542546 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 11:57:06.542546 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 11:57:06.544029 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/762585f86c8144d48d89f160882fb3c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/762585f86c8144d48d89f160882fb3c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/762585f86c8144d48d89f160882fb3c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_762585f86c8144d48d89f160882fb3c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:57:06.544029 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-677780340 Jun 20 11:57:06.544029 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 762585f86c8144d48d89f160882fb3c4 Jun 20 11:57:06.544029 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-677780340 Jun 20 11:57:06.544029 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-677780340-project Jun 20 11:57:06.544029 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:57:06.544029 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:57:06.544029 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 795462ce4fa049d7ac42fe63261ae4e2 Jun 20 11:57:06.544029 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-677780340-project Jun 20 11:57:06.544029 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 11:57:06.544029 n-d-master-1 devstack@n-api.service[119127]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jun 20 11:57:06.544799 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '2022-06-20 11:57:05'} Jun 20 11:57:06.544799 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:57:06.544799 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:06.544799 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:57:06.544799 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:57:06.544799 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:57:06.544799 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:57:06.544799 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:57:06.544799 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:57:06.544799 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Jun 20 11:57:06.544799 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Jun 20 11:57:06.544799 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 20 11:57:06.544799 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 20 11:57:06.544799 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 20 11:57:06.544799 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 20 11:57:06.544799 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 11:57:06.544799 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 11:57:06.544799 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 11:57:06.544799 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 11:57:06.544799 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 20 11:57:06.546743 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 20 11:57:06.546743 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 20 11:57:06.546743 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 20 11:57:06.546743 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 20 11:57:06.546743 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 20 11:57:06.546743 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jun 20 11:57:06.546743 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:57:06.546743 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:57:06.546743 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:57:06.546743 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:06.546743 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:57:06.546743 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:57:06.546743 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 20 11:57:06.546743 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 20 11:57:06.546743 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jun 20 11:57:06.546743 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:57:06.546743 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ae080499-6a20-4841-950b-a4cc37ab7aa8 tempest-InstanceUsageAuditLogNegativeTestJSON-677780340 tempest-InstanceUsageAuditLogNegativeTestJSON-677780340-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:57:06.548717 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ae080499-6a20-4841-950b-a4cc37ab7aa8 tempest-InstanceUsageAuditLogNegativeTestJSON-677780340 tempest-InstanceUsageAuditLogNegativeTestJSON-677780340-project] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log/2022-06-20 11:57:05" status: 403 len: 128 microversion: 2.1 time: 0.034702 Jun 20 11:57:06.554126 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 164/355] 10.222.0.27 () {58 vars in 1250 bytes} [Mon Jun 20 11:57:06 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-06-20%2011%3A57%3A05 => generated 128 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:57:06.601908 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4d6054ad-ec5e-4196-9738-0477888e1eb7 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:06.605386 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4d6054ad-ec5e-4196-9738-0477888e1eb7 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 097ee17d-f450-475a-8f33-fe596f6d98a0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:06.641305 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d6054ad-ec5e-4196-9738-0477888e1eb7 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:06.641838 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d6054ad-ec5e-4196-9738-0477888e1eb7 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:06.642764 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d6054ad-ec5e-4196-9738-0477888e1eb7 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:06.649691 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d6054ad-ec5e-4196-9738-0477888e1eb7 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:06.903422 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4d6054ad-ec5e-4196-9738-0477888e1eb7 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:06.918553 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4d6054ad-ec5e-4196-9738-0477888e1eb7 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0" status: 200 len: 1275 microversion: 2.1 time: 0.356276 Jun 20 11:57:06.932015 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 165/356] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:06 2022] GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0 => generated 1275 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:06.996220 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fbe118e4-bbcc-41a8-a3f3-10908b7ac5f2 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:06.997450 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fbe118e4-bbcc-41a8-a3f3-10908b7ac5f2 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 8a71d955-cfc0-44b7-ae7b-e899afa8698a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:07.013780 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fbe118e4-bbcc-41a8-a3f3-10908b7ac5f2 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:07.014558 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fbe118e4-bbcc-41a8-a3f3-10908b7ac5f2 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:07.015532 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fbe118e4-bbcc-41a8-a3f3-10908b7ac5f2 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:07.016102 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fbe118e4-bbcc-41a8-a3f3-10908b7ac5f2 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:07.501124 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fbe118e4-bbcc-41a8-a3f3-10908b7ac5f2 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f069018a1fc24a9fbaac9b58ee7b07fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fc528349c34afbace41593b93d169a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:07.513111 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fbe118e4-bbcc-41a8-a3f3-10908b7ac5f2 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "GET /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a" status: 200 len: 1322 microversion: 2.1 time: 0.522101 Jun 20 11:57:07.523914 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 166/357] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:06 2022] GET /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a => generated 1322 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:07.530849 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e0f00a7b-0149-4e62-a327-89d7ac2130e2 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:07.533180 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e0f00a7b-0149-4e62-a327-89d7ac2130e2 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f9361b90-1c71-4bf4-b694-483cab19b1b8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:07.560394 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e0f00a7b-0149-4e62-a327-89d7ac2130e2 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:07.560926 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e0f00a7b-0149-4e62-a327-89d7ac2130e2 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:07.564772 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e0f00a7b-0149-4e62-a327-89d7ac2130e2 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:07.566092 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e0f00a7b-0149-4e62-a327-89d7ac2130e2 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:08.120962 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-23ecc02d-c99a-4388-b5f8-397ae0690466 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:57:08.121459 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-23ecc02d-c99a-4388-b5f8-397ae0690466 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:57:08.122734 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-23ecc02d-c99a-4388-b5f8-397ae0690466 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:57:08.123709 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-23ecc02d-c99a-4388-b5f8-397ae0690466 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:57:08.124298 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-23ecc02d-c99a-4388-b5f8-397ae0690466 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:57:08.152570 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23ecc02d-c99a-4388-b5f8-397ae0690466 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:08.153702 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23ecc02d-c99a-4388-b5f8-397ae0690466 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:08.154728 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23ecc02d-c99a-4388-b5f8-397ae0690466 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:08.157338 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23ecc02d-c99a-4388-b5f8-397ae0690466 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:08.173137 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e0f00a7b-0149-4e62-a327-89d7ac2130e2 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:08.184584 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e0f00a7b-0149-4e62-a327-89d7ac2130e2 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8" status: 200 len: 1319 microversion: 2.1 time: 0.656947 Jun 20 11:57:08.185827 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 167/358] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:07 2022] GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8 => generated 1319 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:08.198449 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f09c93db-b7f4-44bc-889c-b0a772e760e6 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:08.199374 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f09c93db-b7f4-44bc-889c-b0a772e760e6 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 097ee17d-f450-475a-8f33-fe596f6d98a0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:08.213221 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-23ecc02d-c99a-4388-b5f8-397ae0690466 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Getting quotas for project 7fdba36a70464a8e816944a7f29e47cf. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:57:08.213632 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f09c93db-b7f4-44bc-889c-b0a772e760e6 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:08.214265 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f09c93db-b7f4-44bc-889c-b0a772e760e6 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:08.215514 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f09c93db-b7f4-44bc-889c-b0a772e760e6 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:08.218332 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f09c93db-b7f4-44bc-889c-b0a772e760e6 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:08.231322 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-23ecc02d-c99a-4388-b5f8-397ae0690466 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Getting quotas for user b429a092ac04479eb8644bc82972234e and project 7fdba36a70464a8e816944a7f29e47cf. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:57:08.259272 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-23ecc02d-c99a-4388-b5f8-397ae0690466 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:57:08.262511 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-23ecc02d-c99a-4388-b5f8-397ae0690466 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:57:08.372712 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f09c93db-b7f4-44bc-889c-b0a772e760e6 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:08.388951 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f09c93db-b7f4-44bc-889c-b0a772e760e6 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0" status: 200 len: 1275 microversion: 2.1 time: 0.200470 Jun 20 11:57:08.392919 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-23ecc02d-c99a-4388-b5f8-397ae0690466 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.920826 Jun 20 11:57:08.395195 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 192/359] 10.222.0.27 () {62 vars in 1187 bytes} [Mon Jun 20 11:57:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 3925 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 20 11:57:08.400399 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 168/360] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:08 2022] GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0 => generated 1275 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:08.431065 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-21ad4969-c150-4b0d-a874-51578a140e36 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:08.431713 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-21ad4969-c150-4b0d-a874-51578a140e36 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:08.531837 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-89ca8c21-1f7f-47bd-8918-3c61530fe8c6 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:08.533223 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-89ca8c21-1f7f-47bd-8918-3c61530fe8c6 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 8a71d955-cfc0-44b7-ae7b-e899afa8698a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:08.546375 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-89ca8c21-1f7f-47bd-8918-3c61530fe8c6 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:08.547298 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-89ca8c21-1f7f-47bd-8918-3c61530fe8c6 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:08.548595 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-89ca8c21-1f7f-47bd-8918-3c61530fe8c6 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:08.550440 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-89ca8c21-1f7f-47bd-8918-3c61530fe8c6 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:08.677012 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-21ad4969-c150-4b0d-a874-51578a140e36 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:08.694720 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-21ad4969-c150-4b0d-a874-51578a140e36 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:08.698277 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-21ad4969-c150-4b0d-a874-51578a140e36 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:08.703355 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-21ad4969-c150-4b0d-a874-51578a140e36 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f" status: 200 len: 1261 microversion: 2.25 time: 0.289500 Jun 20 11:57:08.706394 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 193/361] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:57:08 2022] GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f => generated 1261 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 11:57:09.211957 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7f4a02a2-1809-4f7b-b511-fdc83e12bf49 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:09.215202 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7f4a02a2-1809-4f7b-b511-fdc83e12bf49 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f9361b90-1c71-4bf4-b694-483cab19b1b8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:09.266356 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f4a02a2-1809-4f7b-b511-fdc83e12bf49 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:09.270168 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f4a02a2-1809-4f7b-b511-fdc83e12bf49 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:09.273260 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f4a02a2-1809-4f7b-b511-fdc83e12bf49 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:09.277766 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f4a02a2-1809-4f7b-b511-fdc83e12bf49 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:09.689434 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-89ca8c21-1f7f-47bd-8918-3c61530fe8c6 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f069018a1fc24a9fbaac9b58ee7b07fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fc528349c34afbace41593b93d169a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:09.706214 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-89ca8c21-1f7f-47bd-8918-3c61530fe8c6 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "GET /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a" status: 200 len: 1322 microversion: 2.1 time: 1.178853 Jun 20 11:57:09.720231 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 169/362] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:08 2022] GET /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a => generated 1322 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:09.727919 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0e979d1b-3685-4a53-9a6a-51fc762b8ebc tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:09.728609 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0e979d1b-3685-4a53-9a6a-51fc762b8ebc tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 097ee17d-f450-475a-8f33-fe596f6d98a0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:09.766090 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0e979d1b-3685-4a53-9a6a-51fc762b8ebc tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:09.766541 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0e979d1b-3685-4a53-9a6a-51fc762b8ebc tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:09.768715 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0e979d1b-3685-4a53-9a6a-51fc762b8ebc tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:09.769158 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0e979d1b-3685-4a53-9a6a-51fc762b8ebc tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:09.903182 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7f4a02a2-1809-4f7b-b511-fdc83e12bf49 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:09.918240 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7f4a02a2-1809-4f7b-b511-fdc83e12bf49 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8" status: 200 len: 1319 microversion: 2.1 time: 0.717545 Jun 20 11:57:09.919175 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 194/363] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:09 2022] GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8 => generated 1319 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:09.937577 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e500f820-326c-47a2-9ee0-f7b604ea9ed5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:09.941463 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e500f820-326c-47a2-9ee0-f7b604ea9ed5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:09.984363 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e500f820-326c-47a2-9ee0-f7b604ea9ed5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:09.985023 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e500f820-326c-47a2-9ee0-f7b604ea9ed5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:09.986302 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e500f820-326c-47a2-9ee0-f7b604ea9ed5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:09.986744 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e500f820-326c-47a2-9ee0-f7b604ea9ed5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:10.172945 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e500f820-326c-47a2-9ee0-f7b604ea9ed5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:10.183602 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e500f820-326c-47a2-9ee0-f7b604ea9ed5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:10.184952 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e500f820-326c-47a2-9ee0-f7b604ea9ed5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:10.186100 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e500f820-326c-47a2-9ee0-f7b604ea9ed5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f" status: 200 len: 1313 microversion: 2.25 time: 0.263056 Jun 20 11:57:10.199362 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 195/364] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:57:09 2022] GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f => generated 1313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:57:10.729609 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9b3c7f14-cfa5-4f91-8486-c6913ea87e36 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:10.730282 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9b3c7f14-cfa5-4f91-8486-c6913ea87e36 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 8a71d955-cfc0-44b7-ae7b-e899afa8698a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:10.746315 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9b3c7f14-cfa5-4f91-8486-c6913ea87e36 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:10.746806 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9b3c7f14-cfa5-4f91-8486-c6913ea87e36 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:10.749477 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9b3c7f14-cfa5-4f91-8486-c6913ea87e36 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:10.749786 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9b3c7f14-cfa5-4f91-8486-c6913ea87e36 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:11.024049 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=34 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:57:11.108619 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=11 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:57:11.199314 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9b3c7f14-cfa5-4f91-8486-c6913ea87e36 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f069018a1fc24a9fbaac9b58ee7b07fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fc528349c34afbace41593b93d169a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:11.208323 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9b3c7f14-cfa5-4f91-8486-c6913ea87e36 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "GET /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a" status: 200 len: 1322 microversion: 2.1 time: 0.483000 Jun 20 11:57:11.208905 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 196/365] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:10 2022] GET /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a => generated 1322 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:57:11.224607 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-65ffd7e4-5f14-439a-99ce-3a297bd99dee tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:11.225234 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-65ffd7e4-5f14-439a-99ce-3a297bd99dee tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f9361b90-1c71-4bf4-b694-483cab19b1b8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:11.245261 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65ffd7e4-5f14-439a-99ce-3a297bd99dee tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:11.252497 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65ffd7e4-5f14-439a-99ce-3a297bd99dee tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:11.255305 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65ffd7e4-5f14-439a-99ce-3a297bd99dee tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:11.255946 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65ffd7e4-5f14-439a-99ce-3a297bd99dee tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:11.640112 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0e979d1b-3685-4a53-9a6a-51fc762b8ebc tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:11.651960 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0e979d1b-3685-4a53-9a6a-51fc762b8ebc tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0" status: 200 len: 1317 microversion: 2.1 time: 1.942696 Jun 20 11:57:11.665437 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 170/366] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:09 2022] GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0 => generated 1317 bytes in 1956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:11.672933 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0e5cb7f2-6d82-4ce3-8d7a-8e235e903679 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:11.676529 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0e5cb7f2-6d82-4ce3-8d7a-8e235e903679 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:11.691140 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0e5cb7f2-6d82-4ce3-8d7a-8e235e903679 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:11.691886 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0e5cb7f2-6d82-4ce3-8d7a-8e235e903679 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:11.693428 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0e5cb7f2-6d82-4ce3-8d7a-8e235e903679 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:11.694072 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0e5cb7f2-6d82-4ce3-8d7a-8e235e903679 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:11.947550 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0e5cb7f2-6d82-4ce3-8d7a-8e235e903679 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:11.973940 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0e5cb7f2-6d82-4ce3-8d7a-8e235e903679 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:11.989231 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0e5cb7f2-6d82-4ce3-8d7a-8e235e903679 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:12.000694 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0e5cb7f2-6d82-4ce3-8d7a-8e235e903679 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f" status: 200 len: 1319 microversion: 2.25 time: 0.329237 Jun 20 11:57:12.014710 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 171/367] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:57:11 2022] GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f => generated 1319 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:57:12.608099 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-65ffd7e4-5f14-439a-99ce-3a297bd99dee tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:12.618121 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-65ffd7e4-5f14-439a-99ce-3a297bd99dee tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8" status: 200 len: 1319 microversion: 2.1 time: 1.408055 Jun 20 11:57:12.624708 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 197/368] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:11 2022] GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8 => generated 1319 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:12.648532 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-8059876f-952c-497b-94e7-c8d68d5b5c8f req-a21ddff5-2914-4614-9f3e-b70b3b0311fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a71d955-cfc0-44b7-ae7b-e899afa8698a", "tag": "531fca0e-e0ad-490e-a381-e0aae8963315"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:12.665156 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cc8f3c15-6148-4a79-ac2b-760a9ae817b6 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1750763364", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:12.685226 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-8059876f-952c-497b-94e7-c8d68d5b5c8f req-a21ddff5-2914-4614-9f3e-b70b3b0311fe service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:12.689044 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-8059876f-952c-497b-94e7-c8d68d5b5c8f req-a21ddff5-2914-4614-9f3e-b70b3b0311fe service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:12.754063 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-8059876f-952c-497b-94e7-c8d68d5b5c8f req-a21ddff5-2914-4614-9f3e-b70b3b0311fe service nova] Creating event network-changed:531fca0e-e0ad-490e-a381-e0aae8963315 for instance 8a71d955-cfc0-44b7-ae7b-e899afa8698a on n-h1-master-1 Jun 20 11:57:12.771850 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-cc8f3c15-6148-4a79-ac2b-760a9ae817b6 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] validate_networks() for None {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:57:12.777971 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-8059876f-952c-497b-94e7-c8d68d5b5c8f req-a21ddff5-2914-4614-9f3e-b70b3b0311fe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147514 Jun 20 11:57:12.778586 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 198/369] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:57:12.797745 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-cef2584d-4afb-4d47-bffe-207c30e6b5e0 req-4b268b78-40d0-4fba-a17c-f94a1d73a2d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9361b90-1c71-4bf4-b694-483cab19b1b8", "tag": "bed1d701-63b1-4626-9a02-786ef021ecb7"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:12.812823 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=9,nova_api:SAVEPOINT=5,nova_api:RELEASE=5,nova_api:UPDATE=1,nova_api:DELETE=5 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:57:12.828474 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-cef2584d-4afb-4d47-bffe-207c30e6b5e0 req-4b268b78-40d0-4fba-a17c-f94a1d73a2d8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:12.831484 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-cef2584d-4afb-4d47-bffe-207c30e6b5e0 req-4b268b78-40d0-4fba-a17c-f94a1d73a2d8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:12.880751 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-cef2584d-4afb-4d47-bffe-207c30e6b5e0 req-4b268b78-40d0-4fba-a17c-f94a1d73a2d8 service nova] Creating event network-changed:bed1d701-63b1-4626-9a02-786ef021ecb7 for instance f9361b90-1c71-4bf4-b694-483cab19b1b8 on n-h2-master-1 Jun 20 11:57:12.894367 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-cef2584d-4afb-4d47-bffe-207c30e6b5e0 req-4b268b78-40d0-4fba-a17c-f94a1d73a2d8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107455 Jun 20 11:57:12.896159 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 199/370] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:57:12.913491 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-efa23fe8-ed9f-4b02-8e60-0f744fa9ba43 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:12.914206 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-efa23fe8-ed9f-4b02-8e60-0f744fa9ba43 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 8a71d955-cfc0-44b7-ae7b-e899afa8698a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:12.934874 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-efa23fe8-ed9f-4b02-8e60-0f744fa9ba43 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:12.935350 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-efa23fe8-ed9f-4b02-8e60-0f744fa9ba43 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:12.938951 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-efa23fe8-ed9f-4b02-8e60-0f744fa9ba43 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:12.940786 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-efa23fe8-ed9f-4b02-8e60-0f744fa9ba43 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:13.514283 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-efa23fe8-ed9f-4b02-8e60-0f744fa9ba43 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f069018a1fc24a9fbaac9b58ee7b07fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fc528349c34afbace41593b93d169a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:13.532826 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-efa23fe8-ed9f-4b02-8e60-0f744fa9ba43 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "GET /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a" status: 200 len: 1322 microversion: 2.1 time: 0.634586 Jun 20 11:57:13.535453 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 200/371] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:12 2022] GET /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a => generated 1322 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:13.553291 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-46beb3c9-c5a9-4d78-aa1c-0926aa34c59b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:13.556535 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-46beb3c9-c5a9-4d78-aa1c-0926aa34c59b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 097ee17d-f450-475a-8f33-fe596f6d98a0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:13.583725 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-46beb3c9-c5a9-4d78-aa1c-0926aa34c59b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:13.586957 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-46beb3c9-c5a9-4d78-aa1c-0926aa34c59b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:13.588285 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-46beb3c9-c5a9-4d78-aa1c-0926aa34c59b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:13.588851 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-46beb3c9-c5a9-4d78-aa1c-0926aa34c59b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:13.788381 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-cc8f3c15-6148-4a79-ac2b-760a9ae817b6 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:57:13.789370 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-cc8f3c15-6148-4a79-ac2b-760a9ae817b6 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:57:13.790154 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-cc8f3c15-6148-4a79-ac2b-760a9ae817b6 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:57:13.793989 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-cc8f3c15-6148-4a79-ac2b-760a9ae817b6 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:57:13.812038 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-cc8f3c15-6148-4a79-ac2b-760a9ae817b6 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:57:13.863354 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cc8f3c15-6148-4a79-ac2b-760a9ae817b6 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:13.865131 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cc8f3c15-6148-4a79-ac2b-760a9ae817b6 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:13.874812 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cc8f3c15-6148-4a79-ac2b-760a9ae817b6 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:13.877995 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cc8f3c15-6148-4a79-ac2b-760a9ae817b6 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:13.911289 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-cc8f3c15-6148-4a79-ac2b-760a9ae817b6 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Getting quotas for project 8964bee8790c43ccb896f404015dcdd6. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:57:13.917948 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-cc8f3c15-6148-4a79-ac2b-760a9ae817b6 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Getting quotas for user 374ef56db0ba42a1a3b0ac12aa172b56 and project 8964bee8790c43ccb896f404015dcdd6. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:57:13.936576 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cc8f3c15-6148-4a79-ac2b-760a9ae817b6 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:57:13.939063 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cc8f3c15-6148-4a79-ac2b-760a9ae817b6 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: b7973338-9aa7-497a-8036-d7a2a0f750a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:57:14.008625 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cc8f3c15-6148-4a79-ac2b-760a9ae817b6 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.991424 Jun 20 11:57:14.011425 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 172/372] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:57:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1995 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 11:57:14.019799 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7a8fba60-c545-4cde-b4ab-f6ed015ac5e8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:14.020759 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7a8fba60-c545-4cde-b4ab-f6ed015ac5e8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:14.028953 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7a8fba60-c545-4cde-b4ab-f6ed015ac5e8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:14.030090 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7a8fba60-c545-4cde-b4ab-f6ed015ac5e8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:14.032767 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7a8fba60-c545-4cde-b4ab-f6ed015ac5e8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:14.033274 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7a8fba60-c545-4cde-b4ab-f6ed015ac5e8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:14.095042 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-46beb3c9-c5a9-4d78-aa1c-0926aa34c59b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:14.105200 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-46beb3c9-c5a9-4d78-aa1c-0926aa34c59b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0" status: 200 len: 1317 microversion: 2.1 time: 0.566265 Jun 20 11:57:14.116416 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 201/373] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:13 2022] GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0 => generated 1317 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:14.568118 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3644912c-bbd6-440d-a781-9e26bc19f69d tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033 tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1086475607", "ram": 512, "vcpus": 1, "disk": 10, "id": 189264557, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:14.579286 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:57:14.579286 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:57:14.620943 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3644912c-bbd6-440d-a781-9e26bc19f69d tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033 tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.502548 Jun 20 11:57:14.622409 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 202/374] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:57:14 2022] POST /compute/v2.1/flavors => generated 413 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:57:14.633166 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-59851830-7ecb-4b51-a177-83895263ee62 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:14.635025 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-59851830-7ecb-4b51-a177-83895263ee62 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f9361b90-1c71-4bf4-b694-483cab19b1b8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:14.648307 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-59851830-7ecb-4b51-a177-83895263ee62 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:14.649070 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-59851830-7ecb-4b51-a177-83895263ee62 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:14.651711 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-59851830-7ecb-4b51-a177-83895263ee62 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:14.652663 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-59851830-7ecb-4b51-a177-83895263ee62 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:14.925107 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7a8fba60-c545-4cde-b4ab-f6ed015ac5e8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:14.944904 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7a8fba60-c545-4cde-b4ab-f6ed015ac5e8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:14.947071 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7a8fba60-c545-4cde-b4ab-f6ed015ac5e8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:14.949511 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7a8fba60-c545-4cde-b4ab-f6ed015ac5e8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f" status: 200 len: 1361 microversion: 2.25 time: 0.936385 Jun 20 11:57:14.961983 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 173/375] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:57:14 2022] GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f => generated 1361 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:57:14.969157 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d112d044-252b-4fbe-8f1a-d9dfda708c58 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:14.969952 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d112d044-252b-4fbe-8f1a-d9dfda708c58 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: b7973338-9aa7-497a-8036-d7a2a0f750a4] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:14.978836 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d112d044-252b-4fbe-8f1a-d9dfda708c58 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:14.979487 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d112d044-252b-4fbe-8f1a-d9dfda708c58 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:14.980302 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d112d044-252b-4fbe-8f1a-d9dfda708c58 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:14.980926 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d112d044-252b-4fbe-8f1a-d9dfda708c58 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:15.113465 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d112d044-252b-4fbe-8f1a-d9dfda708c58 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374ef56db0ba42a1a3b0ac12aa172b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8964bee8790c43ccb896f404015dcdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:15.145690 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d112d044-252b-4fbe-8f1a-d9dfda708c58 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] 10.222.0.27 "GET /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4" status: 200 len: 1216 microversion: 2.1 time: 0.182106 Jun 20 11:57:15.151298 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 174/376] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:14 2022] GET /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4 => generated 1216 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:15.157238 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-52368dc3-7c00-4ee1-bff0-5ff5a7886afd tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:15.169441 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-52368dc3-7c00-4ee1-bff0-5ff5a7886afd tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 8a71d955-cfc0-44b7-ae7b-e899afa8698a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:15.189596 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52368dc3-7c00-4ee1-bff0-5ff5a7886afd tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:15.190844 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52368dc3-7c00-4ee1-bff0-5ff5a7886afd tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:15.192048 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52368dc3-7c00-4ee1-bff0-5ff5a7886afd tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:15.192665 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52368dc3-7c00-4ee1-bff0-5ff5a7886afd tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:15.402161 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-59851830-7ecb-4b51-a177-83895263ee62 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:15.412750 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-59851830-7ecb-4b51-a177-83895263ee62 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8" status: 200 len: 1319 microversion: 2.1 time: 0.788886 Jun 20 11:57:15.420277 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 203/377] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:14 2022] GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8 => generated 1319 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:15.524041 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-52368dc3-7c00-4ee1-bff0-5ff5a7886afd tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f069018a1fc24a9fbaac9b58ee7b07fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fc528349c34afbace41593b93d169a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:15.540589 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-52368dc3-7c00-4ee1-bff0-5ff5a7886afd tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "GET /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a" status: 200 len: 1322 microversion: 2.1 time: 0.385630 Jun 20 11:57:15.543837 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 175/378] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:15 2022] GET /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a => generated 1322 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:15.557745 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-0cc6d1b7-d977-4c05-a728-f9cfb15a1661 req-949fc173-0882-4652-a0fb-e0307bf9a5fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5156dcdb-2590-41b9-8b02-3f04c5c4acf7", "tag": "75217176-413a-4759-ac3b-e85684959c38"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:15.589764 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-0cc6d1b7-d977-4c05-a728-f9cfb15a1661 req-949fc173-0882-4652-a0fb-e0307bf9a5fc service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:15.593239 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-0cc6d1b7-d977-4c05-a728-f9cfb15a1661 req-949fc173-0882-4652-a0fb-e0307bf9a5fc service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:15.651012 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-0cc6d1b7-d977-4c05-a728-f9cfb15a1661 req-949fc173-0882-4652-a0fb-e0307bf9a5fc service nova] Creating event network-changed:75217176-413a-4759-ac3b-e85684959c38 for instance 5156dcdb-2590-41b9-8b02-3f04c5c4acf7 on n-h2-master-1 Jun 20 11:57:15.660599 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-0cc6d1b7-d977-4c05-a728-f9cfb15a1661 req-949fc173-0882-4652-a0fb-e0307bf9a5fc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113698 Jun 20 11:57:15.661570 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 176/379] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:57:15.675457 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5b0c146c-b21d-4ee7-a876-78db3c8556e0 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:15.676641 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5b0c146c-b21d-4ee7-a876-78db3c8556e0 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 097ee17d-f450-475a-8f33-fe596f6d98a0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:15.687185 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b0c146c-b21d-4ee7-a876-78db3c8556e0 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:15.688344 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b0c146c-b21d-4ee7-a876-78db3c8556e0 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:15.690330 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b0c146c-b21d-4ee7-a876-78db3c8556e0 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:15.691602 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b0c146c-b21d-4ee7-a876-78db3c8556e0 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:15.757887 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-64ac69f3-564c-478e-85ec-9e1de6d41058 tempest-FlavorsExtraSpecsNegativeTestJSON-631935225 tempest-FlavorsExtraSpecsNegativeTestJSON-631935225-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:15.774499 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-64ac69f3-564c-478e-85ec-9e1de6d41058 tempest-FlavorsExtraSpecsNegativeTestJSON-631935225 tempest-FlavorsExtraSpecsNegativeTestJSON-631935225-project] HTTP exception thrown: Flavor 189264557 has no extra specs with key hw:cpu_thread_policy. Jun 20 11:57:15.786942 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-64ac69f3-564c-478e-85ec-9e1de6d41058 tempest-FlavorsExtraSpecsNegativeTestJSON-631935225 tempest-FlavorsExtraSpecsNegativeTestJSON-631935225-project] Request method failure captured: Jun 20 11:57:15.786942 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/flavors/189264557/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jun 20 11:57:15.786942 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:57:15.786942 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:57:15.786942 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:57:15.786942 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 11:57:15.786942 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:57:15.786942 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:57:15.786942 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:57:15.786942 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:57:15.786942 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGCXUzfSS0IEQuxXlL7mYK9MOHIFKPVA8WR4dA4sqfAbFz1hC8fpxQ9KKXB2CdmTyXuBDnX4Gwd7jrcsRmag7hvlBnv-aDGmIAbLsH9DBXrWXBPQUycrupDyLOGiL6-7MWgjyWuJNsANsYF8mEqi5sDMTfLn8fW79HgN9cjZ1c-ZLq8 Jun 20 11:57:15.786942 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:57:15.786942 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:57:15.786942 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:57:15.786942 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:57:15.786942 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:57:15.786942 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:57:15.786942 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 6799828d9cce4b25a7fe288e3aa2a288 Jun 20 11:57:15.786942 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-631935225 Jun 20 11:57:15.786942 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 11:57:15.786942 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 11:57:15.789494 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6799828d9cce4b25a7fe288e3aa2a288"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6799828d9cce4b25a7fe288e3aa2a288"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6799828d9cce4b25a7fe288e3aa2a288"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6799828d9cce4b25a7fe288e3aa2a288"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:57:15.789494 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-631935225 Jun 20 11:57:15.789494 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 6799828d9cce4b25a7fe288e3aa2a288 Jun 20 11:57:15.789494 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-631935225 Jun 20 11:57:15.789494 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-631935225-project Jun 20 11:57:15.789494 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:57:15.789494 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:57:15.789494 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: bc61aadfde684f1e9b17384f4eb37a1c Jun 20 11:57:15.789494 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-631935225-project Jun 20 11:57:15.789494 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 11:57:15.789494 n-d-master-1 devstack@n-api.service[119128]: exception: Flavor 189264557 has no extra specs with key hw:cpu_thread_policy. Jun 20 11:57:15.791639 n-d-master-1 devstack@n-api.service[119128]: action_args: {'flavor_id': '189264557', 'id': 'hw:cpu_thread_policy'} Jun 20 11:57:15.791639 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:57:15.791639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:15.791639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Jun 20 11:57:15.791639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Jun 20 11:57:15.791639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jun 20 11:57:15.791639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:15.791639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:57:15.791639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:15.791639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:15.791639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:57:15.791639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:57:15.791639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:57:15.791639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:57:15.791639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:57:15.791639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:57:15.791639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Jun 20 11:57:15.791639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 20 11:57:15.791639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 189264557 has no extra specs with key hw:cpu_thread_policy. Jun 20 11:57:15.791639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:15.791639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:57:15.791639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:15.796144 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:15.796144 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:57:15.796144 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:57:15.796144 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:57:15.796144 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:57:15.796144 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 189264557 has no extra specs with key hw:cpu_thread_policy. Jun 20 11:57:15.796144 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:15.796144 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-64ac69f3-564c-478e-85ec-9e1de6d41058 tempest-FlavorsExtraSpecsNegativeTestJSON-631935225 tempest-FlavorsExtraSpecsNegativeTestJSON-631935225-project] Returning 404 to user: Flavor 189264557 has no extra specs with key hw:cpu_thread_policy. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:57:15.796144 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-64ac69f3-564c-478e-85ec-9e1de6d41058 tempest-FlavorsExtraSpecsNegativeTestJSON-631935225 tempest-FlavorsExtraSpecsNegativeTestJSON-631935225-project] 10.222.0.27 "GET /compute/v2.1/flavors/189264557/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.366840 Jun 20 11:57:15.799804 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 204/380] 10.222.0.27 () {58 vars in 1262 bytes} [Mon Jun 20 11:57:15 2022] GET /compute/v2.1/flavors/189264557/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 378 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:57:15.807221 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7cc3ab88-543b-4561-a671-3c8b42f15e46 tempest-FlavorsExtraSpecsNegativeTestJSON-631935225 tempest-FlavorsExtraSpecsNegativeTestJSON-631935225-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:15.807221 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:57:15.807221 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:57:15.811890 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7cc3ab88-543b-4561-a671-3c8b42f15e46 tempest-FlavorsExtraSpecsNegativeTestJSON-631935225 tempest-FlavorsExtraSpecsNegativeTestJSON-631935225-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'bc61aadfde684f1e9b17384f4eb37a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6799828d9cce4b25a7fe288e3aa2a288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:15.828291 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7cc3ab88-543b-4561-a671-3c8b42f15e46 tempest-FlavorsExtraSpecsNegativeTestJSON-631935225 tempest-FlavorsExtraSpecsNegativeTestJSON-631935225-project] Request method failure captured: Jun 20 11:57:15.828291 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/flavors/189264557/os-extra_specs HTTP/1.1 Jun 20 11:57:15.828291 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:57:15.828291 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:57:15.828291 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:57:15.828291 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 66 Jun 20 11:57:15.828291 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:57:15.828291 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:57:15.828291 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:57:15.828291 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:57:15.828291 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGCXUzfSS0IEQuxXlL7mYK9MOHIFKPVA8WR4dA4sqfAbFz1hC8fpxQ9KKXB2CdmTyXuBDnX4Gwd7jrcsRmag7hvlBnv-aDGmIAbLsH9DBXrWXBPQUycrupDyLOGiL6-7MWgjyWuJNsANsYF8mEqi5sDMTfLn8fW79HgN9cjZ1c-ZLq8 Jun 20 11:57:15.828291 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:57:15.828291 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:57:15.828291 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:57:15.828291 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:57:15.828291 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:57:15.828291 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:57:15.828291 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 6799828d9cce4b25a7fe288e3aa2a288 Jun 20 11:57:15.828291 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-631935225 Jun 20 11:57:15.828291 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 11:57:15.828291 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 11:57:15.829732 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6799828d9cce4b25a7fe288e3aa2a288"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6799828d9cce4b25a7fe288e3aa2a288"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6799828d9cce4b25a7fe288e3aa2a288"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6799828d9cce4b25a7fe288e3aa2a288"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:57:15.829732 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-631935225 Jun 20 11:57:15.829732 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 6799828d9cce4b25a7fe288e3aa2a288 Jun 20 11:57:15.829732 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-631935225 Jun 20 11:57:15.829732 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-631935225-project Jun 20 11:57:15.829732 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:57:15.829732 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:57:15.829732 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: bc61aadfde684f1e9b17384f4eb37a1c Jun 20 11:57:15.829732 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-631935225-project Jun 20 11:57:15.829732 n-d-master-1 devstack@n-api.service[119128]: Jun 20 11:57:15.829732 n-d-master-1 devstack@n-api.service[119128]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Jun 20 11:57:15.829732 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 11:57:15.830550 n-d-master-1 devstack@n-api.service[119128]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jun 20 11:57:15.830550 n-d-master-1 devstack@n-api.service[119128]: action_args: {'flavor_id': '189264557', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Jun 20 11:57:15.830550 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:57:15.830550 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:15.830550 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:57:15.830550 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:57:15.830550 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:57:15.830550 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:57:15.830550 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:57:15.830550 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:57:15.830550 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:57:15.830550 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:57:15.830550 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Jun 20 11:57:15.830550 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Jun 20 11:57:15.830550 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 20 11:57:15.830550 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 20 11:57:15.830550 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 20 11:57:15.830550 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 20 11:57:15.830550 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 11:57:15.833578 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 11:57:15.833578 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 11:57:15.833578 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 11:57:15.833578 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 20 11:57:15.833578 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 20 11:57:15.833578 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 20 11:57:15.833578 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 20 11:57:15.833578 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 20 11:57:15.833578 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 20 11:57:15.833578 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jun 20 11:57:15.833578 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:15.833578 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:57:15.833578 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:15.833578 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:15.833578 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:57:15.833578 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:57:15.833578 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 20 11:57:15.833578 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 20 11:57:15.833578 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jun 20 11:57:15.833578 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:15.836761 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7cc3ab88-543b-4561-a671-3c8b42f15e46 tempest-FlavorsExtraSpecsNegativeTestJSON-631935225 tempest-FlavorsExtraSpecsNegativeTestJSON-631935225-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:57:15.836761 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7cc3ab88-543b-4561-a671-3c8b42f15e46 tempest-FlavorsExtraSpecsNegativeTestJSON-631935225 tempest-FlavorsExtraSpecsNegativeTestJSON-631935225-project] 10.222.0.27 "POST /compute/v2.1/flavors/189264557/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.028849 Jun 20 11:57:15.836761 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 205/381] 10.222.0.27 () {60 vars in 1220 bytes} [Mon Jun 20 11:57:15 2022] POST /compute/v2.1/flavors/189264557/os-extra_specs => generated 124 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:57:15.846911 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c1bc64fb-6a8c-4e96-826e-4ef570bdd1de tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033 tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:15.942545 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c1bc64fb-6a8c-4e96-826e-4ef570bdd1de tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033 tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/189264557/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.100388 Jun 20 11:57:15.949443 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 206/382] 10.222.0.27 () {60 vars in 1220 bytes} [Mon Jun 20 11:57:15 2022] POST /compute/v2.1/flavors/189264557/os-extra_specs => generated 66 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 11:57:15.956605 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1337f93c-f448-4b6a-ada8-e3bed6979589 tempest-FlavorsExtraSpecsNegativeTestJSON-631935225 tempest-FlavorsExtraSpecsNegativeTestJSON-631935225-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:15.969961 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:57:15.969961 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:57:15.973808 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1337f93c-f448-4b6a-ada8-e3bed6979589 tempest-FlavorsExtraSpecsNegativeTestJSON-631935225 tempest-FlavorsExtraSpecsNegativeTestJSON-631935225-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'bc61aadfde684f1e9b17384f4eb37a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6799828d9cce4b25a7fe288e3aa2a288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:15.987224 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1337f93c-f448-4b6a-ada8-e3bed6979589 tempest-FlavorsExtraSpecsNegativeTestJSON-631935225 tempest-FlavorsExtraSpecsNegativeTestJSON-631935225-project] Request method failure captured: Jun 20 11:57:15.987224 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/flavors/189264557/os-extra_specs/hw:numa_nodes HTTP/1.1 Jun 20 11:57:15.987224 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:57:15.987224 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:57:15.987224 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:57:15.987224 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 11:57:15.987224 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:57:15.987224 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:57:15.987224 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:57:15.987224 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:57:15.987224 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGCXUzfSS0IEQuxXlL7mYK9MOHIFKPVA8WR4dA4sqfAbFz1hC8fpxQ9KKXB2CdmTyXuBDnX4Gwd7jrcsRmag7hvlBnv-aDGmIAbLsH9DBXrWXBPQUycrupDyLOGiL6-7MWgjyWuJNsANsYF8mEqi5sDMTfLn8fW79HgN9cjZ1c-ZLq8 Jun 20 11:57:15.987224 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:57:15.987224 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:57:15.987224 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:57:15.987224 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:57:15.987224 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:57:15.987224 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:57:15.987224 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 6799828d9cce4b25a7fe288e3aa2a288 Jun 20 11:57:15.987224 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-631935225 Jun 20 11:57:15.987224 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 11:57:15.987224 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 11:57:15.988851 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6799828d9cce4b25a7fe288e3aa2a288"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6799828d9cce4b25a7fe288e3aa2a288"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6799828d9cce4b25a7fe288e3aa2a288"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6799828d9cce4b25a7fe288e3aa2a288"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:57:15.988851 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-631935225 Jun 20 11:57:15.988851 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 6799828d9cce4b25a7fe288e3aa2a288 Jun 20 11:57:15.988851 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-631935225 Jun 20 11:57:15.988851 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-631935225-project Jun 20 11:57:15.988851 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:57:15.988851 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:57:15.988851 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: bc61aadfde684f1e9b17384f4eb37a1c Jun 20 11:57:15.988851 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-631935225-project Jun 20 11:57:15.988851 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 11:57:15.988851 n-d-master-1 devstack@n-api.service[119128]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jun 20 11:57:15.989618 n-d-master-1 devstack@n-api.service[119128]: action_args: {'flavor_id': '189264557', 'id': 'hw:numa_nodes'} Jun 20 11:57:15.989618 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:57:15.989618 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:15.989618 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:57:15.989618 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:57:15.989618 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:57:15.989618 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:57:15.989618 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:57:15.989618 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:57:15.989618 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Jun 20 11:57:15.989618 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Jun 20 11:57:15.989618 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 20 11:57:15.989618 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 20 11:57:15.989618 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 20 11:57:15.989618 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 20 11:57:15.989618 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 11:57:15.989618 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 11:57:15.989618 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 11:57:15.989618 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 11:57:15.989618 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 20 11:57:15.991427 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 20 11:57:15.991427 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 20 11:57:15.991427 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 20 11:57:15.991427 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 20 11:57:15.991427 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 20 11:57:15.991427 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jun 20 11:57:15.991427 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:15.991427 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:57:15.991427 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:15.991427 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:15.991427 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:57:15.991427 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:57:15.991427 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 20 11:57:15.991427 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 20 11:57:15.991427 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jun 20 11:57:15.991427 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:15.991427 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1337f93c-f448-4b6a-ada8-e3bed6979589 tempest-FlavorsExtraSpecsNegativeTestJSON-631935225 tempest-FlavorsExtraSpecsNegativeTestJSON-631935225-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:57:15.992805 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1337f93c-f448-4b6a-ada8-e3bed6979589 tempest-FlavorsExtraSpecsNegativeTestJSON-631935225 tempest-FlavorsExtraSpecsNegativeTestJSON-631935225-project] 10.222.0.27 "DELETE /compute/v2.1/flavors/189264557/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.038447 Jun 20 11:57:15.992805 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 207/383] 10.222.0.27 () {58 vars in 1244 bytes} [Mon Jun 20 11:57:15 2022] DELETE /compute/v2.1/flavors/189264557/os-extra_specs/hw:numa_nodes => generated 124 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:57:16.000288 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8d236302-3fab-42b4-beb4-8c6ef3383e1b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:16.000902 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8d236302-3fab-42b4-beb4-8c6ef3383e1b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:16.048630 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8d236302-3fab-42b4-beb4-8c6ef3383e1b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:16.049360 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8d236302-3fab-42b4-beb4-8c6ef3383e1b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:16.056497 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8d236302-3fab-42b4-beb4-8c6ef3383e1b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:16.057042 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8d236302-3fab-42b4-beb4-8c6ef3383e1b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:16.259632 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5b0c146c-b21d-4ee7-a876-78db3c8556e0 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:16.272142 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5b0c146c-b21d-4ee7-a876-78db3c8556e0 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0" status: 200 len: 1317 microversion: 2.1 time: 0.608480 Jun 20 11:57:16.277861 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 177/384] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:15 2022] GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0 => generated 1317 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:16.300606 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-205d89f2-9242-495c-ad26-06b258b0f7c0 tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033 tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:16.302026 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:57:16.302026 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:57:16.323496 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=86,nova_api:SAVEPOINT=6,nova_api:RELEASE=5,nova_api:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:57:16.333867 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-205d89f2-9242-495c-ad26-06b258b0f7c0 tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033 tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/189264557/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.044665 Jun 20 11:57:16.334708 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 178/385] 10.222.0.27 () {60 vars in 1220 bytes} [Mon Jun 20 11:57:16 2022] POST /compute/v2.1/flavors/189264557/os-extra_specs => generated 66 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 11:57:16.340286 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f986d631-23d3-4bf8-b4d0-7a6071066cec tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:16.340932 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f986d631-23d3-4bf8-b4d0-7a6071066cec tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: b7973338-9aa7-497a-8036-d7a2a0f750a4] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:16.347690 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f986d631-23d3-4bf8-b4d0-7a6071066cec tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:16.348257 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f986d631-23d3-4bf8-b4d0-7a6071066cec tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:16.349546 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f986d631-23d3-4bf8-b4d0-7a6071066cec tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:16.350170 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f986d631-23d3-4bf8-b4d0-7a6071066cec tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:16.456680 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f986d631-23d3-4bf8-b4d0-7a6071066cec tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374ef56db0ba42a1a3b0ac12aa172b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8964bee8790c43ccb896f404015dcdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:16.468386 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f986d631-23d3-4bf8-b4d0-7a6071066cec tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] 10.222.0.27 "GET /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4" status: 200 len: 1278 microversion: 2.1 time: 0.132148 Jun 20 11:57:16.469746 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 179/386] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:16 2022] GET /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4 => generated 1278 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:16.474794 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d914d60a-6a20-4a2d-a33f-184a63667976 tempest-FlavorsExtraSpecsNegativeTestJSON-631935225 tempest-FlavorsExtraSpecsNegativeTestJSON-631935225-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:16.476589 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:57:16.476589 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:57:16.477759 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d914d60a-6a20-4a2d-a33f-184a63667976 tempest-FlavorsExtraSpecsNegativeTestJSON-631935225 tempest-FlavorsExtraSpecsNegativeTestJSON-631935225-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'bc61aadfde684f1e9b17384f4eb37a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6799828d9cce4b25a7fe288e3aa2a288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:16.479796 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d914d60a-6a20-4a2d-a33f-184a63667976 tempest-FlavorsExtraSpecsNegativeTestJSON-631935225 tempest-FlavorsExtraSpecsNegativeTestJSON-631935225-project] Request method failure captured: Jun 20 11:57:16.479796 n-d-master-1 devstack@n-api.service[119127]: request: PUT /compute/v2.1/flavors/189264557/os-extra_specs/hw:numa_nodes HTTP/1.1 Jun 20 11:57:16.479796 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:57:16.479796 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:57:16.479796 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:57:16.479796 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 22 Jun 20 11:57:16.479796 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:57:16.479796 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:57:16.479796 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:57:16.479796 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:57:16.479796 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGCXUzfSS0IEQuxXlL7mYK9MOHIFKPVA8WR4dA4sqfAbFz1hC8fpxQ9KKXB2CdmTyXuBDnX4Gwd7jrcsRmag7hvlBnv-aDGmIAbLsH9DBXrWXBPQUycrupDyLOGiL6-7MWgjyWuJNsANsYF8mEqi5sDMTfLn8fW79HgN9cjZ1c-ZLq8 Jun 20 11:57:16.479796 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:57:16.479796 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:57:16.479796 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:57:16.479796 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:57:16.479796 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:57:16.479796 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:57:16.479796 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 6799828d9cce4b25a7fe288e3aa2a288 Jun 20 11:57:16.479796 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-631935225 Jun 20 11:57:16.479796 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 11:57:16.479796 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 11:57:16.481269 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6799828d9cce4b25a7fe288e3aa2a288"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6799828d9cce4b25a7fe288e3aa2a288"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6799828d9cce4b25a7fe288e3aa2a288"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6799828d9cce4b25a7fe288e3aa2a288"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:57:16.481269 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-631935225 Jun 20 11:57:16.481269 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 6799828d9cce4b25a7fe288e3aa2a288 Jun 20 11:57:16.481269 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-631935225 Jun 20 11:57:16.481269 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-631935225-project Jun 20 11:57:16.481269 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:57:16.481269 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:57:16.481269 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: bc61aadfde684f1e9b17384f4eb37a1c Jun 20 11:57:16.481269 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-631935225-project Jun 20 11:57:16.481269 n-d-master-1 devstack@n-api.service[119127]: Jun 20 11:57:16.481269 n-d-master-1 devstack@n-api.service[119127]: {"hw:numa_nodes": "1"} Jun 20 11:57:16.481269 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 11:57:16.481269 n-d-master-1 devstack@n-api.service[119127]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jun 20 11:57:16.482216 n-d-master-1 devstack@n-api.service[119127]: action_args: {'flavor_id': '189264557', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Jun 20 11:57:16.482216 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:57:16.482216 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:16.482216 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:57:16.482216 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:57:16.482216 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:57:16.482216 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:57:16.482216 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:57:16.482216 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:57:16.482216 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:57:16.482216 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:57:16.482216 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Jun 20 11:57:16.482216 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Jun 20 11:57:16.482216 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 20 11:57:16.482216 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 20 11:57:16.482216 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 20 11:57:16.482216 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 20 11:57:16.482216 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 11:57:16.482216 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 11:57:16.483836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 11:57:16.483836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 11:57:16.483836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 20 11:57:16.483836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 20 11:57:16.483836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 20 11:57:16.483836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 20 11:57:16.483836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 20 11:57:16.483836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 20 11:57:16.483836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jun 20 11:57:16.483836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:57:16.483836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:57:16.483836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:57:16.483836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:16.483836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:57:16.483836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:57:16.483836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 20 11:57:16.483836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 20 11:57:16.483836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jun 20 11:57:16.483836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:57:16.485838 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d914d60a-6a20-4a2d-a33f-184a63667976 tempest-FlavorsExtraSpecsNegativeTestJSON-631935225 tempest-FlavorsExtraSpecsNegativeTestJSON-631935225-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:57:16.486707 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d914d60a-6a20-4a2d-a33f-184a63667976 tempest-FlavorsExtraSpecsNegativeTestJSON-631935225 tempest-FlavorsExtraSpecsNegativeTestJSON-631935225-project] 10.222.0.27 "PUT /compute/v2.1/flavors/189264557/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.015733 Jun 20 11:57:16.487291 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 180/387] 10.222.0.27 () {60 vars in 1261 bytes} [Mon Jun 20 11:57:16 2022] PUT /compute/v2.1/flavors/189264557/os-extra_specs/hw:numa_nodes => generated 124 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:57:16.494891 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9a9fd840-5850-4d6e-80ce-2219890f9165 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:16.495786 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9a9fd840-5850-4d6e-80ce-2219890f9165 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f9361b90-1c71-4bf4-b694-483cab19b1b8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:16.506647 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a9fd840-5850-4d6e-80ce-2219890f9165 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:16.507368 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a9fd840-5850-4d6e-80ce-2219890f9165 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:16.508862 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a9fd840-5850-4d6e-80ce-2219890f9165 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:16.509300 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a9fd840-5850-4d6e-80ce-2219890f9165 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:16.690111 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8d236302-3fab-42b4-beb4-8c6ef3383e1b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:16.701633 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8d236302-3fab-42b4-beb4-8c6ef3383e1b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:16.703890 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8d236302-3fab-42b4-beb4-8c6ef3383e1b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:16.705330 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8d236302-3fab-42b4-beb4-8c6ef3383e1b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f" status: 200 len: 1361 microversion: 2.25 time: 0.711844 Jun 20 11:57:16.706439 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 208/388] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:57:15 2022] GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f => generated 1361 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:57:16.711254 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8539ad19-2325-4c71-897d-a630a146d4de tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033 tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:16.711993 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:57:16.711993 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:57:16.719897 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9a9fd840-5850-4d6e-80ce-2219890f9165 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:16.723647 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-8539ad19-2325-4c71-897d-a630a146d4de tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033 tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033-project-admin] HTTP exception thrown: Flavor 189264557 has no extra specs with key hw:cpu_thread_policy. Jun 20 11:57:16.731121 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8539ad19-2325-4c71-897d-a630a146d4de tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033 tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033-project-admin] Request method failure captured: Jun 20 11:57:16.731121 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/flavors/189264557/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jun 20 11:57:16.731121 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:57:16.731121 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:57:16.731121 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:57:16.731121 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 11:57:16.731121 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:57:16.731121 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:57:16.731121 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:57:16.731121 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:57:16.731121 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGCZWdVqkVFB4getNeDgmq1dGEbbxCi10lWUX7HqHqyedIrtgyrtKkv-T7mRjtcle10ggp1JoO0lJ1SOiUwZ4eRX2voL1mVpIBUWHJxJiv1IMXu4z9xk8-jXPiW2U5g0V30MgzLuYkF9dlZu44-MQz1LKvaSh1zjQa50ku8pxyq5C8M Jun 20 11:57:16.731121 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:57:16.731121 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:57:16.731121 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:57:16.731121 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:57:16.731121 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:57:16.731121 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:57:16.731121 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: df9178cfbf8e481c8ab2c7ad01bed4be Jun 20 11:57:16.731121 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033 Jun 20 11:57:16.731121 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member,admin Jun 20 11:57:16.731121 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member,admin Jun 20 11:57:16.732417 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/df9178cfbf8e481c8ab2c7ad01bed4be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/df9178cfbf8e481c8ab2c7ad01bed4be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/df9178cfbf8e481c8ab2c7ad01bed4be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_df9178cfbf8e481c8ab2c7ad01bed4be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:57:16.732417 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033 Jun 20 11:57:16.732417 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: df9178cfbf8e481c8ab2c7ad01bed4be Jun 20 11:57:16.732417 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033 Jun 20 11:57:16.732417 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033-project-admin Jun 20 11:57:16.732417 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:57:16.732417 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:57:16.732417 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 56693a1022ee4368bb3fae78f8747b67 Jun 20 11:57:16.732417 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033-project-admin Jun 20 11:57:16.732417 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 11:57:16.732417 n-d-master-1 devstack@n-api.service[119128]: exception: Flavor 189264557 has no extra specs with key hw:cpu_thread_policy. Jun 20 11:57:16.733155 n-d-master-1 devstack@n-api.service[119128]: action_args: {'flavor_id': '189264557', 'id': 'hw:cpu_thread_policy'} Jun 20 11:57:16.733155 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:57:16.733155 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:16.733155 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Jun 20 11:57:16.733155 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Jun 20 11:57:16.733155 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jun 20 11:57:16.733155 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:16.733155 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:57:16.733155 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:16.733155 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:16.733155 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:57:16.733155 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:57:16.733155 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:57:16.733155 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:57:16.733155 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:57:16.733155 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:57:16.733155 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Jun 20 11:57:16.733155 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 20 11:57:16.733155 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 189264557 has no extra specs with key hw:cpu_thread_policy. Jun 20 11:57:16.733155 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:16.733155 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:57:16.733155 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:16.734445 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:16.734445 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:57:16.734445 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:57:16.734445 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:57:16.734445 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:57:16.734445 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 189264557 has no extra specs with key hw:cpu_thread_policy. Jun 20 11:57:16.734445 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:16.737133 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8539ad19-2325-4c71-897d-a630a146d4de tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033 tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033-project-admin] Returning 404 to user: Flavor 189264557 has no extra specs with key hw:cpu_thread_policy. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:57:16.738235 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8539ad19-2325-4c71-897d-a630a146d4de tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033 tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/189264557/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.030579 Jun 20 11:57:16.743077 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 209/389] 10.222.0.27 () {58 vars in 1265 bytes} [Mon Jun 20 11:57:16 2022] DELETE /compute/v2.1/flavors/189264557/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:57:16.745519 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9a9fd840-5850-4d6e-80ce-2219890f9165 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8" status: 200 len: 1319 microversion: 2.1 time: 0.256163 Jun 20 11:57:16.758049 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 181/390] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:16 2022] GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8 => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:16.768016 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5ae16f42-3b30-4462-bf4d-6bbf1a7dd449 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:16.768739 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5ae16f42-3b30-4462-bf4d-6bbf1a7dd449 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 8a71d955-cfc0-44b7-ae7b-e899afa8698a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:16.772124 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cce5aaae-693e-4a95-984d-06311994f47b tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033 tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:16.773950 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:57:16.773950 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:57:16.775122 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-cce5aaae-693e-4a95-984d-06311994f47b tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033 tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033-project-admin] HTTP exception thrown: Request body and URI mismatch Jun 20 11:57:16.779404 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cce5aaae-693e-4a95-984d-06311994f47b tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033 tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033-project-admin] Request method failure captured: Jun 20 11:57:16.779404 n-d-master-1 devstack@n-api.service[119127]: request: PUT /compute/v2.1/flavors/189264557/os-extra_specs/hw:numa_nodes HTTP/1.1 Jun 20 11:57:16.779404 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:57:16.779404 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:57:16.779404 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:57:16.779404 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 27 Jun 20 11:57:16.779404 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:57:16.779404 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:57:16.779404 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:57:16.779404 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:57:16.779404 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGCZWdVqkVFB4getNeDgmq1dGEbbxCi10lWUX7HqHqyedIrtgyrtKkv-T7mRjtcle10ggp1JoO0lJ1SOiUwZ4eRX2voL1mVpIBUWHJxJiv1IMXu4z9xk8-jXPiW2U5g0V30MgzLuYkF9dlZu44-MQz1LKvaSh1zjQa50ku8pxyq5C8M Jun 20 11:57:16.779404 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:57:16.779404 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:57:16.779404 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:57:16.779404 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:57:16.779404 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:57:16.779404 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:57:16.779404 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: df9178cfbf8e481c8ab2c7ad01bed4be Jun 20 11:57:16.779404 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033 Jun 20 11:57:16.779404 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member,admin Jun 20 11:57:16.779404 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member,admin Jun 20 11:57:16.780758 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/df9178cfbf8e481c8ab2c7ad01bed4be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/df9178cfbf8e481c8ab2c7ad01bed4be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/df9178cfbf8e481c8ab2c7ad01bed4be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_df9178cfbf8e481c8ab2c7ad01bed4be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:57:16.780758 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033 Jun 20 11:57:16.780758 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: df9178cfbf8e481c8ab2c7ad01bed4be Jun 20 11:57:16.780758 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033 Jun 20 11:57:16.780758 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033-project-admin Jun 20 11:57:16.780758 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:57:16.780758 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:57:16.780758 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 56693a1022ee4368bb3fae78f8747b67 Jun 20 11:57:16.780758 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033-project-admin Jun 20 11:57:16.780758 n-d-master-1 devstack@n-api.service[119127]: Jun 20 11:57:16.780758 n-d-master-1 devstack@n-api.service[119127]: {"hw:cpu_policy": "shared"} Jun 20 11:57:16.780758 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 11:57:16.780758 n-d-master-1 devstack@n-api.service[119127]: exception: Request body and URI mismatch Jun 20 11:57:16.781546 n-d-master-1 devstack@n-api.service[119127]: action_args: {'flavor_id': '189264557', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Jun 20 11:57:16.781546 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:57:16.781546 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:16.781546 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:57:16.781546 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:57:16.781546 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:57:16.781546 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:57:16.781546 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:57:16.781546 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:57:16.781546 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:57:16.781546 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:57:16.781546 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Jun 20 11:57:16.781546 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Jun 20 11:57:16.781546 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Jun 20 11:57:16.781546 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:57:16.781546 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:57:16.781546 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:57:16.781546 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:16.781546 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:57:16.781546 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:57:16.782619 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:57:16.782619 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:57:16.782619 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Jun 20 11:57:16.782619 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:57:16.782619 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cce5aaae-693e-4a95-984d-06311994f47b tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033 tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:57:16.782619 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cce5aaae-693e-4a95-984d-06311994f47b tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033 tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/189264557/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.019871 Jun 20 11:57:16.782619 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 182/391] 10.222.0.27 () {60 vars in 1261 bytes} [Mon Jun 20 11:57:16 2022] PUT /compute/v2.1/flavors/189264557/os-extra_specs/hw:numa_nodes => generated 73 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 20 11:57:16.785425 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5ae16f42-3b30-4462-bf4d-6bbf1a7dd449 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:16.790112 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5ae16f42-3b30-4462-bf4d-6bbf1a7dd449 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:16.791258 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5ae16f42-3b30-4462-bf4d-6bbf1a7dd449 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:16.791891 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5ae16f42-3b30-4462-bf4d-6bbf1a7dd449 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:16.798734 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c479f6cf-5c8e-4bc1-881e-e9953c783e12 tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033 tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:16.804066 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c479f6cf-5c8e-4bc1-881e-e9953c783e12 tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033 tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033-project-admin] Request method failure captured: Jun 20 11:57:16.804066 n-d-master-1 devstack@n-api.service[119127]: request: PUT /compute/v2.1/flavors/189264557/os-extra_specs/hw:numa_nodes HTTP/1.1 Jun 20 11:57:16.804066 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:57:16.804066 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:57:16.804066 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:57:16.804066 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 49 Jun 20 11:57:16.804066 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:57:16.804066 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:57:16.804066 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:57:16.804066 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:57:16.804066 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGCZWdVqkVFB4getNeDgmq1dGEbbxCi10lWUX7HqHqyedIrtgyrtKkv-T7mRjtcle10ggp1JoO0lJ1SOiUwZ4eRX2voL1mVpIBUWHJxJiv1IMXu4z9xk8-jXPiW2U5g0V30MgzLuYkF9dlZu44-MQz1LKvaSh1zjQa50ku8pxyq5C8M Jun 20 11:57:16.804066 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:57:16.804066 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:57:16.804066 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:57:16.804066 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:57:16.804066 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:57:16.804066 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:57:16.804066 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: df9178cfbf8e481c8ab2c7ad01bed4be Jun 20 11:57:16.804066 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033 Jun 20 11:57:16.804066 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member,admin Jun 20 11:57:16.804066 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member,admin Jun 20 11:57:16.805929 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/df9178cfbf8e481c8ab2c7ad01bed4be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/df9178cfbf8e481c8ab2c7ad01bed4be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/df9178cfbf8e481c8ab2c7ad01bed4be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_df9178cfbf8e481c8ab2c7ad01bed4be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:57:16.805929 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033 Jun 20 11:57:16.805929 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: df9178cfbf8e481c8ab2c7ad01bed4be Jun 20 11:57:16.805929 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033 Jun 20 11:57:16.805929 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033-project-admin Jun 20 11:57:16.805929 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:57:16.805929 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:57:16.805929 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 56693a1022ee4368bb3fae78f8747b67 Jun 20 11:57:16.805929 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033-project-admin Jun 20 11:57:16.805929 n-d-master-1 devstack@n-api.service[119127]: Jun 20 11:57:16.805929 n-d-master-1 devstack@n-api.service[119127]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Jun 20 11:57:16.805929 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 11:57:16.806766 n-d-master-1 devstack@n-api.service[119127]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jun 20 11:57:16.806766 n-d-master-1 devstack@n-api.service[119127]: action_args: {'flavor_id': '189264557', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Jun 20 11:57:16.806766 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:57:16.806766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:16.806766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 11:57:16.806766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 11:57:16.806766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 11:57:16.806766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise error Jun 20 11:57:16.806766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jun 20 11:57:16.806766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:57:16.806766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Jun 20 11:57:16.806766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 20 11:57:16.806766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Jun 20 11:57:16.806766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Jun 20 11:57:16.806766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 20 11:57:16.806766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi 'type': ['string', Jun 20 11:57:16.806766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi 'number']}}, Jun 20 11:57:16.806766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 20 11:57:16.806766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:57:16.806766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi On instance: Jun 20 11:57:16.806766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Jun 20 11:57:16.806766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:57:16.808337 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:57:16.808337 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:57:16.808337 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:16.808337 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:57:16.808337 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:57:16.808337 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:57:16.808337 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:57:16.808337 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:57:16.808337 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:57:16.808337 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 11:57:16.808337 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 11:57:16.808337 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 11:57:16.808337 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 11:57:16.808337 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 11:57:16.808337 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 11:57:16.808337 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jun 20 11:57:16.808337 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:57:16.808337 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:57:16.808337 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:57:16.808337 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:16.810289 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:57:16.810289 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:57:16.810289 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 11:57:16.810289 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 11:57:16.810289 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jun 20 11:57:16.810289 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:57:16.819806 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c479f6cf-5c8e-4bc1-881e-e9953c783e12 tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033 tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:57:16.822049 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c479f6cf-5c8e-4bc1-881e-e9953c783e12 tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033 tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/189264557/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.035149 Jun 20 11:57:16.822858 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 183/392] 10.222.0.27 () {60 vars in 1261 bytes} [Mon Jun 20 11:57:16 2022] PUT /compute/v2.1/flavors/189264557/os-extra_specs/hw:numa_nodes => generated 117 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 11:57:16.835763 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-342154da-dc35-4589-88c2-ed08c68cc711 tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033 tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:16.841913 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:57:16.841913 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:57:16.879782 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-342154da-dc35-4589-88c2-ed08c68cc711 tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033 tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/189264557" status: 202 len: 0 microversion: 2.1 time: 0.050757 Jun 20 11:57:16.880838 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 184/393] 10.222.0.27 () {58 vars in 1157 bytes} [Mon Jun 20 11:57:16 2022] DELETE /compute/v2.1/flavors/189264557 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 11:57:16.890524 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-633ae50f-c7d7-4646-9ab6-f7f8f3e6f320 tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033 tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:16.913253 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-633ae50f-c7d7-4646-9ab6-f7f8f3e6f320 tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033 tempest-FlavorsExtraSpecsNegativeTestJSON-1136786033-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028044 Jun 20 11:57:16.914789 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 185/394] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 11:57:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:57:17.221094 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-518409d4-bb81-46e8-9b94-a5e8fb363778 req-344de64c-5e43-4be0-a5a2-eb3a9bebbe2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddbdd7f1-6b17-4f7a-9793-873b18c7a92f", "tag": "be0d0765-87a0-4732-987c-66193517041e"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:17.240532 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-518409d4-bb81-46e8-9b94-a5e8fb363778 req-344de64c-5e43-4be0-a5a2-eb3a9bebbe2d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:17.243462 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-518409d4-bb81-46e8-9b94-a5e8fb363778 req-344de64c-5e43-4be0-a5a2-eb3a9bebbe2d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:17.279240 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-518409d4-bb81-46e8-9b94-a5e8fb363778 req-344de64c-5e43-4be0-a5a2-eb3a9bebbe2d service nova] Creating event network-changed:be0d0765-87a0-4732-987c-66193517041e for instance ddbdd7f1-6b17-4f7a-9793-873b18c7a92f on n-h1-master-1 Jun 20 11:57:17.294266 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-518409d4-bb81-46e8-9b94-a5e8fb363778 req-344de64c-5e43-4be0-a5a2-eb3a9bebbe2d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077347 Jun 20 11:57:17.297658 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 186/395] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:57:17.308591 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e84580fb-dbe6-4051-ad87-db89cb213761 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:17.313330 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e84580fb-dbe6-4051-ad87-db89cb213761 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 097ee17d-f450-475a-8f33-fe596f6d98a0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:17.324016 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e84580fb-dbe6-4051-ad87-db89cb213761 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:17.324784 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e84580fb-dbe6-4051-ad87-db89cb213761 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:17.325638 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e84580fb-dbe6-4051-ad87-db89cb213761 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:17.326083 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e84580fb-dbe6-4051-ad87-db89cb213761 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:17.512620 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5ae16f42-3b30-4462-bf4d-6bbf1a7dd449 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f069018a1fc24a9fbaac9b58ee7b07fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fc528349c34afbace41593b93d169a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:17.531113 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5ae16f42-3b30-4462-bf4d-6bbf1a7dd449 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "GET /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a" status: 200 len: 1322 microversion: 2.1 time: 0.776799 Jun 20 11:57:17.531862 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 210/396] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:16 2022] GET /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a => generated 1322 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:17.539771 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-70144297-b4cb-4a56-a90c-afb08ed4e5a2 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:17.540585 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-70144297-b4cb-4a56-a90c-afb08ed4e5a2 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: b7973338-9aa7-497a-8036-d7a2a0f750a4] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:17.556121 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-70144297-b4cb-4a56-a90c-afb08ed4e5a2 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:17.556823 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-70144297-b4cb-4a56-a90c-afb08ed4e5a2 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:17.557753 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-70144297-b4cb-4a56-a90c-afb08ed4e5a2 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:17.559111 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-70144297-b4cb-4a56-a90c-afb08ed4e5a2 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:17.683991 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-70144297-b4cb-4a56-a90c-afb08ed4e5a2 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374ef56db0ba42a1a3b0ac12aa172b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8964bee8790c43ccb896f404015dcdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:17.695106 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-70144297-b4cb-4a56-a90c-afb08ed4e5a2 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] 10.222.0.27 "GET /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4" status: 200 len: 1278 microversion: 2.1 time: 0.160445 Jun 20 11:57:17.696563 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 211/397] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:17 2022] GET /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4 => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:17.711809 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-18a30d19-dd5c-4758-889c-23a4f2840fc2 req-e7a8a0d5-c707-4286-a92c-05a5a12763b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "097ee17d-f450-475a-8f33-fe596f6d98a0", "tag": "b542790e-8718-43ca-9777-dbb16ec436a1"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:17.720918 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-18a30d19-dd5c-4758-889c-23a4f2840fc2 req-e7a8a0d5-c707-4286-a92c-05a5a12763b4 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:17.721724 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-18a30d19-dd5c-4758-889c-23a4f2840fc2 req-e7a8a0d5-c707-4286-a92c-05a5a12763b4 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:17.736608 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-18a30d19-dd5c-4758-889c-23a4f2840fc2 req-e7a8a0d5-c707-4286-a92c-05a5a12763b4 service nova] Creating event network-changed:b542790e-8718-43ca-9777-dbb16ec436a1 for instance 097ee17d-f450-475a-8f33-fe596f6d98a0 on n-h2-master-1 Jun 20 11:57:17.743879 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-18a30d19-dd5c-4758-889c-23a4f2840fc2 req-e7a8a0d5-c707-4286-a92c-05a5a12763b4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036627 Jun 20 11:57:17.745197 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 212/398] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 11:57:17.751739 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-859f2e0e-214e-4a4e-9e2c-e785a7352043 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:17.752796 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-859f2e0e-214e-4a4e-9e2c-e785a7352043 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:17.761656 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-859f2e0e-214e-4a4e-9e2c-e785a7352043 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:17.762594 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-859f2e0e-214e-4a4e-9e2c-e785a7352043 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:17.763735 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-859f2e0e-214e-4a4e-9e2c-e785a7352043 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:17.764514 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-859f2e0e-214e-4a4e-9e2c-e785a7352043 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:18.128343 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e84580fb-dbe6-4051-ad87-db89cb213761 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:18.145180 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e84580fb-dbe6-4051-ad87-db89cb213761 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0" status: 200 len: 1317 microversion: 2.1 time: 0.844013 Jun 20 11:57:18.146378 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 187/399] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:17 2022] GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0 => generated 1317 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:18.151717 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b3b76f3c-7f28-40c0-9f91-c7fec3ef3ee9 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:18.152355 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b3b76f3c-7f28-40c0-9f91-c7fec3ef3ee9 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f9361b90-1c71-4bf4-b694-483cab19b1b8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:18.168402 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3b76f3c-7f28-40c0-9f91-c7fec3ef3ee9 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:18.170128 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3b76f3c-7f28-40c0-9f91-c7fec3ef3ee9 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:18.174289 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3b76f3c-7f28-40c0-9f91-c7fec3ef3ee9 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:18.175304 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3b76f3c-7f28-40c0-9f91-c7fec3ef3ee9 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:18.189261 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=9 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:57:18.443603 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-859f2e0e-214e-4a4e-9e2c-e785a7352043 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:18.460784 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-859f2e0e-214e-4a4e-9e2c-e785a7352043 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:18.466139 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-859f2e0e-214e-4a4e-9e2c-e785a7352043 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:18.472343 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-859f2e0e-214e-4a4e-9e2c-e785a7352043 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f" status: 200 len: 1361 microversion: 2.25 time: 0.722350 Jun 20 11:57:18.475917 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 213/400] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:57:17 2022] GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f => generated 1361 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:57:18.548944 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4b6fe0ce-9a97-4102-9cad-36757307727c tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:18.549832 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4b6fe0ce-9a97-4102-9cad-36757307727c tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 8a71d955-cfc0-44b7-ae7b-e899afa8698a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:18.563485 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4b6fe0ce-9a97-4102-9cad-36757307727c tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:18.567935 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4b6fe0ce-9a97-4102-9cad-36757307727c tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:18.569341 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4b6fe0ce-9a97-4102-9cad-36757307727c tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:18.570091 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4b6fe0ce-9a97-4102-9cad-36757307727c tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:18.685353 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=20 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:57:18.908491 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b3b76f3c-7f28-40c0-9f91-c7fec3ef3ee9 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:18.922362 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b3b76f3c-7f28-40c0-9f91-c7fec3ef3ee9 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8" status: 200 len: 1319 microversion: 2.1 time: 0.774732 Jun 20 11:57:18.923697 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 188/401] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:18 2022] GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8 => generated 1319 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:18.936620 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f691e248-0bc6-4636-a921-272c2829f45d tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:18.937909 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f691e248-0bc6-4636-a921-272c2829f45d tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: b7973338-9aa7-497a-8036-d7a2a0f750a4] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:18.957816 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f691e248-0bc6-4636-a921-272c2829f45d tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:18.959364 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f691e248-0bc6-4636-a921-272c2829f45d tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:18.960397 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f691e248-0bc6-4636-a921-272c2829f45d tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:18.961559 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f691e248-0bc6-4636-a921-272c2829f45d tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:18.993195 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:57:19.213876 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4b6fe0ce-9a97-4102-9cad-36757307727c tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f069018a1fc24a9fbaac9b58ee7b07fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fc528349c34afbace41593b93d169a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:19.256774 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4b6fe0ce-9a97-4102-9cad-36757307727c tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "GET /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a" status: 200 len: 1322 microversion: 2.1 time: 0.712176 Jun 20 11:57:19.273859 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 214/402] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:18 2022] GET /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a => generated 1322 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:57:19.281228 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-96eb2332-e001-4599-bff3-117a41ba8153 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:19.284610 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-96eb2332-e001-4599-bff3-117a41ba8153 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 097ee17d-f450-475a-8f33-fe596f6d98a0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:19.292572 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-96eb2332-e001-4599-bff3-117a41ba8153 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:19.294392 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-96eb2332-e001-4599-bff3-117a41ba8153 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:19.297483 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-96eb2332-e001-4599-bff3-117a41ba8153 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:19.298410 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-96eb2332-e001-4599-bff3-117a41ba8153 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:19.437588 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f691e248-0bc6-4636-a921-272c2829f45d tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374ef56db0ba42a1a3b0ac12aa172b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8964bee8790c43ccb896f404015dcdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:19.451913 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f691e248-0bc6-4636-a921-272c2829f45d tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] 10.222.0.27 "GET /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4" status: 200 len: 1320 microversion: 2.1 time: 0.525826 Jun 20 11:57:19.465025 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 189/403] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:18 2022] GET /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4 => generated 1320 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:19.496150 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c3671451-9ee5-46f5-ae19-916106aa00d4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:19.497503 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c3671451-9ee5-46f5-ae19-916106aa00d4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:19.526320 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c3671451-9ee5-46f5-ae19-916106aa00d4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:19.527454 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c3671451-9ee5-46f5-ae19-916106aa00d4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:19.528908 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c3671451-9ee5-46f5-ae19-916106aa00d4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:19.531450 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c3671451-9ee5-46f5-ae19-916106aa00d4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:19.954833 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-96eb2332-e001-4599-bff3-117a41ba8153 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:19.964895 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-96eb2332-e001-4599-bff3-117a41ba8153 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0" status: 200 len: 1317 microversion: 2.1 time: 0.689496 Jun 20 11:57:19.967536 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 215/404] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:19 2022] GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0 => generated 1317 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:19.971919 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c3671451-9ee5-46f5-ae19-916106aa00d4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:19.981084 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-aeb13d14-b9e6-41d2-a51c-5da8439a1b1a tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:19.985630 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c3671451-9ee5-46f5-ae19-916106aa00d4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:19.987330 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-aeb13d14-b9e6-41d2-a51c-5da8439a1b1a tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f9361b90-1c71-4bf4-b694-483cab19b1b8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:19.989220 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c3671451-9ee5-46f5-ae19-916106aa00d4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:19.993316 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c3671451-9ee5-46f5-ae19-916106aa00d4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f" status: 200 len: 1361 microversion: 2.25 time: 0.503215 Jun 20 11:57:19.997057 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 190/405] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:57:19 2022] GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f => generated 1361 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:57:20.014399 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aeb13d14-b9e6-41d2-a51c-5da8439a1b1a tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:20.015143 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aeb13d14-b9e6-41d2-a51c-5da8439a1b1a tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:20.015993 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aeb13d14-b9e6-41d2-a51c-5da8439a1b1a tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:20.016591 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aeb13d14-b9e6-41d2-a51c-5da8439a1b1a tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:20.024152 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:57:20.278154 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0d109270-b104-4898-a076-0ae6e6fc8b7c tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:20.279055 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0d109270-b104-4898-a076-0ae6e6fc8b7c tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 8a71d955-cfc0-44b7-ae7b-e899afa8698a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:20.300706 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0d109270-b104-4898-a076-0ae6e6fc8b7c tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:20.304818 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0d109270-b104-4898-a076-0ae6e6fc8b7c tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:20.305943 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0d109270-b104-4898-a076-0ae6e6fc8b7c tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:20.309015 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0d109270-b104-4898-a076-0ae6e6fc8b7c tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:20.457936 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-aeb13d14-b9e6-41d2-a51c-5da8439a1b1a tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:20.471812 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-aeb13d14-b9e6-41d2-a51c-5da8439a1b1a tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8" status: 200 len: 1319 microversion: 2.1 time: 0.499918 Jun 20 11:57:20.473727 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 216/406] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:19 2022] GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8 => generated 1319 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:20.489301 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-3baa28cf-0ed9-4744-861f-16ea37628aa9 req-32e31578-3086-4729-9bb2-ed0c94277a9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7973338-9aa7-497a-8036-d7a2a0f750a4", "tag": "78be856f-abe5-4eae-9efd-e00f6fe411b0"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:20.522355 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-3baa28cf-0ed9-4744-861f-16ea37628aa9 req-32e31578-3086-4729-9bb2-ed0c94277a9b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:20.523289 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-3baa28cf-0ed9-4744-861f-16ea37628aa9 req-32e31578-3086-4729-9bb2-ed0c94277a9b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:20.560372 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-3baa28cf-0ed9-4744-861f-16ea37628aa9 req-32e31578-3086-4729-9bb2-ed0c94277a9b service nova] Creating event network-changed:78be856f-abe5-4eae-9efd-e00f6fe411b0 for instance b7973338-9aa7-497a-8036-d7a2a0f750a4 on n-h1-master-1 Jun 20 11:57:20.574297 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-3baa28cf-0ed9-4744-861f-16ea37628aa9 req-32e31578-3086-4729-9bb2-ed0c94277a9b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097294 Jun 20 11:57:20.576056 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 217/407] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:57:20.584612 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-13b45f2a-e690-494e-acc0-e4c90505bc93 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:20.586062 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-13b45f2a-e690-494e-acc0-e4c90505bc93 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: b7973338-9aa7-497a-8036-d7a2a0f750a4] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:20.593891 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13b45f2a-e690-494e-acc0-e4c90505bc93 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:20.594646 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13b45f2a-e690-494e-acc0-e4c90505bc93 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:20.596523 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13b45f2a-e690-494e-acc0-e4c90505bc93 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:20.598273 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13b45f2a-e690-494e-acc0-e4c90505bc93 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:20.886550 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0d109270-b104-4898-a076-0ae6e6fc8b7c tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f069018a1fc24a9fbaac9b58ee7b07fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fc528349c34afbace41593b93d169a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:20.901114 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0d109270-b104-4898-a076-0ae6e6fc8b7c tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "GET /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a" status: 200 len: 1322 microversion: 2.1 time: 0.629286 Jun 20 11:57:20.901856 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 191/408] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:20 2022] GET /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a => generated 1322 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:20.986574 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c19eb5c6-f09b-4877-8a15-5e776f0a2194 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:20.988062 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c19eb5c6-f09b-4877-8a15-5e776f0a2194 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 097ee17d-f450-475a-8f33-fe596f6d98a0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:21.007981 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c19eb5c6-f09b-4877-8a15-5e776f0a2194 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:21.008749 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c19eb5c6-f09b-4877-8a15-5e776f0a2194 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:21.009982 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c19eb5c6-f09b-4877-8a15-5e776f0a2194 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:21.010740 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c19eb5c6-f09b-4877-8a15-5e776f0a2194 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:21.394714 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-13b45f2a-e690-494e-acc0-e4c90505bc93 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374ef56db0ba42a1a3b0ac12aa172b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8964bee8790c43ccb896f404015dcdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:21.409037 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-13b45f2a-e690-494e-acc0-e4c90505bc93 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] 10.222.0.27 "GET /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4" status: 200 len: 1320 microversion: 2.1 time: 0.829017 Jun 20 11:57:21.411210 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 218/409] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:20 2022] GET /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4 => generated 1320 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:21.422765 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e6d145cd-a697-424b-9e79-d5386ea52cbc tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:21.423388 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e6d145cd-a697-424b-9e79-d5386ea52cbc tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:21.439912 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e6d145cd-a697-424b-9e79-d5386ea52cbc tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:21.441775 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e6d145cd-a697-424b-9e79-d5386ea52cbc tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:21.445155 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e6d145cd-a697-424b-9e79-d5386ea52cbc tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:21.448432 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e6d145cd-a697-424b-9e79-d5386ea52cbc tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:21.670355 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c19eb5c6-f09b-4877-8a15-5e776f0a2194 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:21.689337 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c19eb5c6-f09b-4877-8a15-5e776f0a2194 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0" status: 200 len: 1317 microversion: 2.1 time: 0.708710 Jun 20 11:57:21.690878 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 192/410] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:20 2022] GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0 => generated 1317 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:21.707051 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-7245be25-390e-469e-8393-55aba98bf55e req-588b2797-cb44-4687-a0c6-2eedd301689b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a71d955-cfc0-44b7-ae7b-e899afa8698a", "name": "network-vif-plugged", "status": "completed", "tag": "531fca0e-e0ad-490e-a381-e0aae8963315"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:21.725688 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-7245be25-390e-469e-8393-55aba98bf55e req-588b2797-cb44-4687-a0c6-2eedd301689b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:21.726492 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-7245be25-390e-469e-8393-55aba98bf55e req-588b2797-cb44-4687-a0c6-2eedd301689b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:21.755141 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-7245be25-390e-469e-8393-55aba98bf55e req-588b2797-cb44-4687-a0c6-2eedd301689b service nova] Creating event network-vif-plugged:531fca0e-e0ad-490e-a381-e0aae8963315 for instance 8a71d955-cfc0-44b7-ae7b-e899afa8698a on n-h1-master-1 Jun 20 11:57:21.769509 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-7245be25-390e-469e-8393-55aba98bf55e req-588b2797-cb44-4687-a0c6-2eedd301689b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077297 Jun 20 11:57:21.776497 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 193/411] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:57:21.783082 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b418b086-5d2c-4bba-a276-f9c6bb0f269f tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:21.790496 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b418b086-5d2c-4bba-a276-f9c6bb0f269f tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f9361b90-1c71-4bf4-b694-483cab19b1b8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:21.808330 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b418b086-5d2c-4bba-a276-f9c6bb0f269f tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:21.808886 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b418b086-5d2c-4bba-a276-f9c6bb0f269f tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:21.809779 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b418b086-5d2c-4bba-a276-f9c6bb0f269f tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:21.810344 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b418b086-5d2c-4bba-a276-f9c6bb0f269f tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:22.336073 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e6d145cd-a697-424b-9e79-d5386ea52cbc tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:22.347225 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e6d145cd-a697-424b-9e79-d5386ea52cbc tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:22.348762 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b418b086-5d2c-4bba-a276-f9c6bb0f269f tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:22.350529 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e6d145cd-a697-424b-9e79-d5386ea52cbc tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:22.353493 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e6d145cd-a697-424b-9e79-d5386ea52cbc tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f" status: 200 len: 1361 microversion: 2.25 time: 0.941079 Jun 20 11:57:22.356177 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 219/412] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:57:21 2022] GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f => generated 1361 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:57:22.358688 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b418b086-5d2c-4bba-a276-f9c6bb0f269f tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8" status: 200 len: 1319 microversion: 2.1 time: 0.580415 Jun 20 11:57:22.365936 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 194/413] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:21 2022] GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8 => generated 1319 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:22.367901 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-44aa99bb-333b-4c56-a5ae-8e09d318bd5b tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:22.368704 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-44aa99bb-333b-4c56-a5ae-8e09d318bd5b tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 8a71d955-cfc0-44b7-ae7b-e899afa8698a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:22.384917 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-44aa99bb-333b-4c56-a5ae-8e09d318bd5b tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:22.385597 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-44aa99bb-333b-4c56-a5ae-8e09d318bd5b tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:22.388716 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-44aa99bb-333b-4c56-a5ae-8e09d318bd5b tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:22.389436 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-44aa99bb-333b-4c56-a5ae-8e09d318bd5b tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:22.427042 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6add4fab-2592-48f2-8e7f-89f7f7bd9fc0 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:22.427757 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6add4fab-2592-48f2-8e7f-89f7f7bd9fc0 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: b7973338-9aa7-497a-8036-d7a2a0f750a4] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:22.434692 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6add4fab-2592-48f2-8e7f-89f7f7bd9fc0 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:22.437557 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6add4fab-2592-48f2-8e7f-89f7f7bd9fc0 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:22.439287 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6add4fab-2592-48f2-8e7f-89f7f7bd9fc0 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:22.441090 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6add4fab-2592-48f2-8e7f-89f7f7bd9fc0 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:22.679174 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6add4fab-2592-48f2-8e7f-89f7f7bd9fc0 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374ef56db0ba42a1a3b0ac12aa172b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8964bee8790c43ccb896f404015dcdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:22.691800 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6add4fab-2592-48f2-8e7f-89f7f7bd9fc0 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] 10.222.0.27 "GET /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4" status: 200 len: 1320 microversion: 2.1 time: 0.268725 Jun 20 11:57:22.695002 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 195/414] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:22 2022] GET /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4 => generated 1320 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:57:22.717485 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f8189c2e-9704-412e-8870-c00ff87711f2 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:22.718366 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f8189c2e-9704-412e-8870-c00ff87711f2 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 097ee17d-f450-475a-8f33-fe596f6d98a0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:22.725234 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f8189c2e-9704-412e-8870-c00ff87711f2 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:22.726571 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f8189c2e-9704-412e-8870-c00ff87711f2 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:22.727937 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f8189c2e-9704-412e-8870-c00ff87711f2 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:22.728712 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f8189c2e-9704-412e-8870-c00ff87711f2 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:22.913830 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-44aa99bb-333b-4c56-a5ae-8e09d318bd5b tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f069018a1fc24a9fbaac9b58ee7b07fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fc528349c34afbace41593b93d169a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:22.933937 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-44aa99bb-333b-4c56-a5ae-8e09d318bd5b tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "GET /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a" status: 200 len: 1322 microversion: 2.1 time: 0.570179 Jun 20 11:57:22.935392 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 220/415] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:22 2022] GET /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a => generated 1322 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:22.955090 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f8189c2e-9704-412e-8870-c00ff87711f2 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:22.965579 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f8189c2e-9704-412e-8870-c00ff87711f2 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0" status: 200 len: 1317 microversion: 2.1 time: 0.254152 Jun 20 11:57:22.966402 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 196/416] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:22 2022] GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0 => generated 1317 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:23.375543 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-98d1965c-7d4f-431b-8301-7a78077ac305 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:23.376346 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-98d1965c-7d4f-431b-8301-7a78077ac305 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f9361b90-1c71-4bf4-b694-483cab19b1b8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:23.381013 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-832546a3-5e3a-454d-81ad-5f056a74199d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:23.381013 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-832546a3-5e3a-454d-81ad-5f056a74199d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:23.395282 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-98d1965c-7d4f-431b-8301-7a78077ac305 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:23.395735 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-98d1965c-7d4f-431b-8301-7a78077ac305 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:23.396537 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-98d1965c-7d4f-431b-8301-7a78077ac305 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:23.396985 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-98d1965c-7d4f-431b-8301-7a78077ac305 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:23.401676 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-832546a3-5e3a-454d-81ad-5f056a74199d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:23.403046 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-832546a3-5e3a-454d-81ad-5f056a74199d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:23.404368 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-832546a3-5e3a-454d-81ad-5f056a74199d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:23.404903 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-832546a3-5e3a-454d-81ad-5f056a74199d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:23.690727 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-98d1965c-7d4f-431b-8301-7a78077ac305 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:23.711918 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-98d1965c-7d4f-431b-8301-7a78077ac305 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8" status: 200 len: 1319 microversion: 2.1 time: 0.340257 Jun 20 11:57:23.712483 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 197/417] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:23 2022] GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8 => generated 1319 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:23.739177 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e1532fb3-6f7f-41e9-84a8-c5bb946c458e tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:23.739807 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e1532fb3-6f7f-41e9-84a8-c5bb946c458e tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: b7973338-9aa7-497a-8036-d7a2a0f750a4] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:23.765231 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1532fb3-6f7f-41e9-84a8-c5bb946c458e tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:23.771512 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1532fb3-6f7f-41e9-84a8-c5bb946c458e tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:23.772704 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1532fb3-6f7f-41e9-84a8-c5bb946c458e tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:23.778725 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1532fb3-6f7f-41e9-84a8-c5bb946c458e tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:23.912492 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:57:23.929783 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:57:24.359865 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e1532fb3-6f7f-41e9-84a8-c5bb946c458e tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374ef56db0ba42a1a3b0ac12aa172b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8964bee8790c43ccb896f404015dcdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:24.372660 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e1532fb3-6f7f-41e9-84a8-c5bb946c458e tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] 10.222.0.27 "GET /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4" status: 200 len: 1320 microversion: 2.1 time: 0.658930 Jun 20 11:57:24.390636 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 198/418] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:23 2022] GET /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4 => generated 1320 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:24.397884 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-b66b34fc-06b7-49d6-af0e-d23fdd022050 req-5e781e52-df09-46c5-b5a1-dc67e20904ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9361b90-1c71-4bf4-b694-483cab19b1b8", "name": "network-vif-plugged", "status": "completed", "tag": "bed1d701-63b1-4626-9a02-786ef021ecb7"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:24.423772 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b66b34fc-06b7-49d6-af0e-d23fdd022050 req-5e781e52-df09-46c5-b5a1-dc67e20904ea service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:24.424550 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b66b34fc-06b7-49d6-af0e-d23fdd022050 req-5e781e52-df09-46c5-b5a1-dc67e20904ea service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:24.454698 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-b66b34fc-06b7-49d6-af0e-d23fdd022050 req-5e781e52-df09-46c5-b5a1-dc67e20904ea service nova] Creating event network-vif-plugged:bed1d701-63b1-4626-9a02-786ef021ecb7 for instance f9361b90-1c71-4bf4-b694-483cab19b1b8 on n-h2-master-1 Jun 20 11:57:24.462028 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-b66b34fc-06b7-49d6-af0e-d23fdd022050 req-5e781e52-df09-46c5-b5a1-dc67e20904ea service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069238 Jun 20 11:57:24.463100 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 199/419] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:57:24.471413 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cd38cd02-8592-4f7d-933c-5add01478975 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:24.472111 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cd38cd02-8592-4f7d-933c-5add01478975 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 8a71d955-cfc0-44b7-ae7b-e899afa8698a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:24.473407 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-832546a3-5e3a-454d-81ad-5f056a74199d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:24.480406 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cd38cd02-8592-4f7d-933c-5add01478975 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:24.480774 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cd38cd02-8592-4f7d-933c-5add01478975 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:24.481733 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cd38cd02-8592-4f7d-933c-5add01478975 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:24.481876 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-832546a3-5e3a-454d-81ad-5f056a74199d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:24.482159 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cd38cd02-8592-4f7d-933c-5add01478975 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:24.486101 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-832546a3-5e3a-454d-81ad-5f056a74199d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:24.487270 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-832546a3-5e3a-454d-81ad-5f056a74199d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f" status: 200 len: 1361 microversion: 2.25 time: 1.118315 Jun 20 11:57:24.487826 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 221/420] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:57:23 2022] GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f => generated 1361 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:57:24.523119 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-903be60e-a3d4-419f-9bb8-660774b19e34 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:24.523796 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-903be60e-a3d4-419f-9bb8-660774b19e34 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 097ee17d-f450-475a-8f33-fe596f6d98a0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:24.554326 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-903be60e-a3d4-419f-9bb8-660774b19e34 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:24.554782 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-903be60e-a3d4-419f-9bb8-660774b19e34 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:24.555803 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-903be60e-a3d4-419f-9bb8-660774b19e34 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:24.556268 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-903be60e-a3d4-419f-9bb8-660774b19e34 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:25.171327 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-903be60e-a3d4-419f-9bb8-660774b19e34 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:25.186852 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-903be60e-a3d4-419f-9bb8-660774b19e34 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0" status: 200 len: 1317 microversion: 2.1 time: 0.676757 Jun 20 11:57:25.199928 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 222/421] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:24 2022] GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0 => generated 1317 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:25.503410 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fcf4b44e-bc24-4360-8e59-b5b0467bdab1 tempest-ServicesAdminNegativeTestJSON-414455182 tempest-ServicesAdminNegativeTestJSON-414455182-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:25.505452 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:57:25.505452 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:57:25.507125 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fcf4b44e-bc24-4360-8e59-b5b0467bdab1 tempest-ServicesAdminNegativeTestJSON-414455182 tempest-ServicesAdminNegativeTestJSON-414455182-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:25.510160 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fcf4b44e-bc24-4360-8e59-b5b0467bdab1 tempest-ServicesAdminNegativeTestJSON-414455182 tempest-ServicesAdminNegativeTestJSON-414455182-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:25.511564 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fcf4b44e-bc24-4360-8e59-b5b0467bdab1 tempest-ServicesAdminNegativeTestJSON-414455182 tempest-ServicesAdminNegativeTestJSON-414455182-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:25.513851 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fcf4b44e-bc24-4360-8e59-b5b0467bdab1 tempest-ServicesAdminNegativeTestJSON-414455182 tempest-ServicesAdminNegativeTestJSON-414455182-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:25.609316 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fcf4b44e-bc24-4360-8e59-b5b0467bdab1 tempest-ServicesAdminNegativeTestJSON-414455182 tempest-ServicesAdminNegativeTestJSON-414455182-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.407934 Jun 20 11:57:25.613912 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 223/422] 10.222.0.27 () {58 vars in 1136 bytes} [Mon Jun 20 11:57:25 2022] GET /compute/v2.1/os-services => generated 944 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:57:25.626462 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-398f3f8a-c759-4cb7-bf51-3519b3b7e6b2 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:25.627576 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-398f3f8a-c759-4cb7-bf51-3519b3b7e6b2 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f9361b90-1c71-4bf4-b694-483cab19b1b8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:25.643941 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-398f3f8a-c759-4cb7-bf51-3519b3b7e6b2 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:25.645990 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-398f3f8a-c759-4cb7-bf51-3519b3b7e6b2 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:25.649032 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-398f3f8a-c759-4cb7-bf51-3519b3b7e6b2 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:25.649626 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-398f3f8a-c759-4cb7-bf51-3519b3b7e6b2 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:25.890583 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cd38cd02-8592-4f7d-933c-5add01478975 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f069018a1fc24a9fbaac9b58ee7b07fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fc528349c34afbace41593b93d169a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:25.909108 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cd38cd02-8592-4f7d-933c-5add01478975 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "GET /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a" status: 200 len: 1471 microversion: 2.1 time: 1.444777 Jun 20 11:57:25.929005 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 200/423] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:24 2022] GET /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a => generated 1471 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:25.947086 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6480e100-870a-41eb-8086-691eac0f66e3 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:25.948154 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6480e100-870a-41eb-8086-691eac0f66e3 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: b7973338-9aa7-497a-8036-d7a2a0f750a4] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:25.959160 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6480e100-870a-41eb-8086-691eac0f66e3 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:25.959786 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6480e100-870a-41eb-8086-691eac0f66e3 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:25.982137 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6480e100-870a-41eb-8086-691eac0f66e3 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:25.984108 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6480e100-870a-41eb-8086-691eac0f66e3 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:26.155746 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-398f3f8a-c759-4cb7-bf51-3519b3b7e6b2 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:26.171558 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-398f3f8a-c759-4cb7-bf51-3519b3b7e6b2 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8" status: 200 len: 1319 microversion: 2.1 time: 0.555652 Jun 20 11:57:26.174563 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 224/424] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:25 2022] GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8 => generated 1319 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:26.195157 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c4a6750b-35fa-4b1d-a129-53f8919a3280 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:26.203887 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c4a6750b-35fa-4b1d-a129-53f8919a3280 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:26.210035 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4a6750b-35fa-4b1d-a129-53f8919a3280 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:26.210690 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4a6750b-35fa-4b1d-a129-53f8919a3280 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:26.211611 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4a6750b-35fa-4b1d-a129-53f8919a3280 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:26.212193 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4a6750b-35fa-4b1d-a129-53f8919a3280 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:26.738804 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c4a6750b-35fa-4b1d-a129-53f8919a3280 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:26.753759 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c4a6750b-35fa-4b1d-a129-53f8919a3280 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:26.755267 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c4a6750b-35fa-4b1d-a129-53f8919a3280 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:26.760459 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c4a6750b-35fa-4b1d-a129-53f8919a3280 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f" status: 200 len: 1361 microversion: 2.25 time: 0.583435 Jun 20 11:57:26.761073 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 225/425] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:57:26 2022] GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f => generated 1361 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:57:26.775584 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0c7230ce-5b5f-44a1-8c34-a3daefc9231d tempest-ServicesAdminNegativeTestJSON-414455182 tempest-ServicesAdminNegativeTestJSON-414455182-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:26.784148 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:57:26.784148 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:57:26.787670 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c7230ce-5b5f-44a1-8c34-a3daefc9231d tempest-ServicesAdminNegativeTestJSON-414455182 tempest-ServicesAdminNegativeTestJSON-414455182-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:26.787670 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c7230ce-5b5f-44a1-8c34-a3daefc9231d tempest-ServicesAdminNegativeTestJSON-414455182 tempest-ServicesAdminNegativeTestJSON-414455182-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:26.787670 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c7230ce-5b5f-44a1-8c34-a3daefc9231d tempest-ServicesAdminNegativeTestJSON-414455182 tempest-ServicesAdminNegativeTestJSON-414455182-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:26.788377 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c7230ce-5b5f-44a1-8c34-a3daefc9231d tempest-ServicesAdminNegativeTestJSON-414455182 tempest-ServicesAdminNegativeTestJSON-414455182-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:26.842992 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0c7230ce-5b5f-44a1-8c34-a3daefc9231d tempest-ServicesAdminNegativeTestJSON-414455182 tempest-ServicesAdminNegativeTestJSON-414455182-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.074198 Jun 20 11:57:26.844843 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 226/426] 10.222.0.27 () {58 vars in 1169 bytes} [Mon Jun 20 11:57:26 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:57:27.123886 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6480e100-870a-41eb-8086-691eac0f66e3 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374ef56db0ba42a1a3b0ac12aa172b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8964bee8790c43ccb896f404015dcdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:27.143617 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6480e100-870a-41eb-8086-691eac0f66e3 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] 10.222.0.27 "GET /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4" status: 200 len: 1320 microversion: 2.1 time: 1.213136 Jun 20 11:57:27.149347 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 201/427] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:25 2022] GET /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4 => generated 1320 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:27.163297 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3ee3e0b4-0ff4-46c3-be52-967d9498d4cb tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:27.164374 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3ee3e0b4-0ff4-46c3-be52-967d9498d4cb tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 097ee17d-f450-475a-8f33-fe596f6d98a0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:27.171933 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8f4577f8-30c3-4ac9-8580-ca07641aee0b tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:27.172701 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8f4577f8-30c3-4ac9-8580-ca07641aee0b tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] [instance: a9283101-ed91-486a-86c7-8d81e90e12a2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:27.177744 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3ee3e0b4-0ff4-46c3-be52-967d9498d4cb tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:27.179669 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3ee3e0b4-0ff4-46c3-be52-967d9498d4cb tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:27.181197 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-8f4577f8-30c3-4ac9-8580-ca07641aee0b tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] HTTP exception thrown: Instance a9283101-ed91-486a-86c7-8d81e90e12a2 could not be found. Jun 20 11:57:27.181908 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3ee3e0b4-0ff4-46c3-be52-967d9498d4cb tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:27.182737 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3ee3e0b4-0ff4-46c3-be52-967d9498d4cb tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:27.190405 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8f4577f8-30c3-4ac9-8580-ca07641aee0b tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] Request method failure captured: Jun 20 11:57:27.190405 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/servers/a9283101-ed91-486a-86c7-8d81e90e12a2/action HTTP/1.1 Jun 20 11:57:27.190405 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:57:27.190405 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:57:27.190405 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:57:27.190405 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 15 Jun 20 11:57:27.190405 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:57:27.190405 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:57:27.190405 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:57:27.190405 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:57:27.190405 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGCJJkRNMEJUBgA8fv6dzFDrq3IG4hKusSKzTOefPK-bmqE5a_msAcQpazfsw42KsZ6WOxgCXvPxwWTgiiswBtQMNFGSjMDU5dPRY9XEG5ZMuaRDRO9sPc8fcTFfqDEYxhEdmNX_sp9B2Hyh6vY4pvekEImJagYoEXkaI9wWDhGy2H0 Jun 20 11:57:27.190405 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:57:27.190405 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:57:27.190405 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:57:27.190405 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:57:27.190405 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:57:27.190405 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:57:27.190405 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: ed905c1a009342268372f3dc99ceaa36 Jun 20 11:57:27.190405 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-55105741 Jun 20 11:57:27.190405 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member,admin Jun 20 11:57:27.190405 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member,admin Jun 20 11:57:27.192384 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed905c1a009342268372f3dc99ceaa36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed905c1a009342268372f3dc99ceaa36"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ed905c1a009342268372f3dc99ceaa36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ed905c1a009342268372f3dc99ceaa36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:57:27.192384 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersAdminNegativeTestJSON-55105741 Jun 20 11:57:27.192384 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: ed905c1a009342268372f3dc99ceaa36 Jun 20 11:57:27.192384 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-55105741 Jun 20 11:57:27.192384 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersAdminNegativeTestJSON-55105741-project-admin Jun 20 11:57:27.192384 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:57:27.192384 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:57:27.192384 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: d86aa1945a054dc7bc66d680614f146c Jun 20 11:57:27.192384 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersAdminNegativeTestJSON-55105741-project-admin Jun 20 11:57:27.192384 n-d-master-1 devstack@n-api.service[119128]: Jun 20 11:57:27.192384 n-d-master-1 devstack@n-api.service[119128]: {"migrate": {}} Jun 20 11:57:27.192384 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 11:57:27.192384 n-d-master-1 devstack@n-api.service[119128]: exception: Instance a9283101-ed91-486a-86c7-8d81e90e12a2 could not be found. Jun 20 11:57:27.193287 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'a9283101-ed91-486a-86c7-8d81e90e12a2', 'body': {'migrate': {}}} Jun 20 11:57:27.193287 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:57:27.193287 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:27.193287 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:57:27.193287 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:57:27.193287 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:57:27.193287 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:57:27.193287 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 20 11:57:27.193287 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 20 11:57:27.193287 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9283101-ed91-486a-86c7-8d81e90e12a2 could not be found. Jun 20 11:57:27.193287 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:27.193287 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:57:27.193287 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:27.193287 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:27.193287 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:57:27.193287 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:57:27.193287 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:57:27.193287 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:57:27.193287 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:57:27.193287 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:57:27.194748 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:57:27.194748 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:57:27.194748 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Jun 20 11:57:27.194748 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Jun 20 11:57:27.194748 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:57:27.194748 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:57:27.194748 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9283101-ed91-486a-86c7-8d81e90e12a2 could not be found. Jun 20 11:57:27.194748 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:27.194748 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:57:27.194748 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:27.194748 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:27.194748 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:57:27.194748 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:57:27.194748 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:57:27.194748 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:57:27.194748 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9283101-ed91-486a-86c7-8d81e90e12a2 could not be found. Jun 20 11:57:27.194748 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:27.208592 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8f4577f8-30c3-4ac9-8580-ca07641aee0b tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] Returning 404 to user: Instance a9283101-ed91-486a-86c7-8d81e90e12a2 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:57:27.210008 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8f4577f8-30c3-4ac9-8580-ca07641aee0b tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/a9283101-ed91-486a-86c7-8d81e90e12a2/action" status: 404 len: 111 microversion: 2.1 time: 0.356890 Jun 20 11:57:27.211154 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 227/428] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 11:57:26 2022] POST /compute/v2.1/servers/a9283101-ed91-486a-86c7-8d81e90e12a2/action => generated 111 bytes in 366 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:57:27.219079 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9c19434d-a5dc-4548-b8cf-79e6db4aad62 tempest-ServicesAdminNegativeTestJSON-414455182 tempest-ServicesAdminNegativeTestJSON-414455182-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:27.222053 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:57:27.222053 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:57:27.229801 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c19434d-a5dc-4548-b8cf-79e6db4aad62 tempest-ServicesAdminNegativeTestJSON-414455182 tempest-ServicesAdminNegativeTestJSON-414455182-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:27.230780 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c19434d-a5dc-4548-b8cf-79e6db4aad62 tempest-ServicesAdminNegativeTestJSON-414455182 tempest-ServicesAdminNegativeTestJSON-414455182-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:27.231890 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c19434d-a5dc-4548-b8cf-79e6db4aad62 tempest-ServicesAdminNegativeTestJSON-414455182 tempest-ServicesAdminNegativeTestJSON-414455182-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:27.239451 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c19434d-a5dc-4548-b8cf-79e6db4aad62 tempest-ServicesAdminNegativeTestJSON-414455182 tempest-ServicesAdminNegativeTestJSON-414455182-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:27.306194 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9c19434d-a5dc-4548-b8cf-79e6db4aad62 tempest-ServicesAdminNegativeTestJSON-414455182 tempest-ServicesAdminNegativeTestJSON-414455182-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.093510 Jun 20 11:57:27.311379 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 228/429] 10.222.0.27 () {58 vars in 1136 bytes} [Mon Jun 20 11:57:27 2022] GET /compute/v2.1/os-services => generated 944 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:57:27.327089 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1518c49b-0af4-4950-88f0-6567bb091021 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:27.334996 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1518c49b-0af4-4950-88f0-6567bb091021 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f9361b90-1c71-4bf4-b694-483cab19b1b8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:27.355801 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1518c49b-0af4-4950-88f0-6567bb091021 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:27.360389 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1518c49b-0af4-4950-88f0-6567bb091021 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:27.363166 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1518c49b-0af4-4950-88f0-6567bb091021 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:27.363894 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1518c49b-0af4-4950-88f0-6567bb091021 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:27.885253 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1518c49b-0af4-4950-88f0-6567bb091021 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:27.886994 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3ee3e0b4-0ff4-46c3-be52-967d9498d4cb tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:27.895856 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3ee3e0b4-0ff4-46c3-be52-967d9498d4cb tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0" status: 200 len: 1317 microversion: 2.1 time: 0.745118 Jun 20 11:57:27.897089 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 202/430] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:27 2022] GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0 => generated 1317 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:27.911950 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-44134490-3ea1-4e1d-b109-f323b15cd0d1 tempest-ServicesAdminNegativeTestJSON-414455182 tempest-ServicesAdminNegativeTestJSON-414455182-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:27.915743 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:57:27.915743 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:57:27.917651 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-44134490-3ea1-4e1d-b109-f323b15cd0d1 tempest-ServicesAdminNegativeTestJSON-414455182 tempest-ServicesAdminNegativeTestJSON-414455182-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:27.920704 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1518c49b-0af4-4950-88f0-6567bb091021 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8" status: 200 len: 1469 microversion: 2.1 time: 0.597327 Jun 20 11:57:27.924373 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-44134490-3ea1-4e1d-b109-f323b15cd0d1 tempest-ServicesAdminNegativeTestJSON-414455182 tempest-ServicesAdminNegativeTestJSON-414455182-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:27.925815 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-44134490-3ea1-4e1d-b109-f323b15cd0d1 tempest-ServicesAdminNegativeTestJSON-414455182 tempest-ServicesAdminNegativeTestJSON-414455182-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:27.928555 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-44134490-3ea1-4e1d-b109-f323b15cd0d1 tempest-ServicesAdminNegativeTestJSON-414455182 tempest-ServicesAdminNegativeTestJSON-414455182-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:27.935581 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 229/431] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:27 2022] GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8 => generated 1469 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:27.957472 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e70df87a-45ef-4fa2-b4a1-8940050ecf9f tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1690723530", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:27.968354 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-44134490-3ea1-4e1d-b109-f323b15cd0d1 tempest-ServicesAdminNegativeTestJSON-414455182 tempest-ServicesAdminNegativeTestJSON-414455182-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.069714 Jun 20 11:57:27.969748 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 203/432] 10.222.0.27 () {58 vars in 1193 bytes} [Mon Jun 20 11:57:27 2022] GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx => generated 16 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 11:57:27.975051 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-2772c7f6-33ee-43e6-b680-dbce35ee9b88 req-2e6c890c-aa1d-4b5d-bb69-ff7c281b5de2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5156dcdb-2590-41b9-8b02-3f04c5c4acf7", "name": "network-vif-plugged", "status": "completed", "tag": "75217176-413a-4759-ac3b-e85684959c38"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:28.004541 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-2772c7f6-33ee-43e6-b680-dbce35ee9b88 req-2e6c890c-aa1d-4b5d-bb69-ff7c281b5de2 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:28.005144 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-2772c7f6-33ee-43e6-b680-dbce35ee9b88 req-2e6c890c-aa1d-4b5d-bb69-ff7c281b5de2 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:28.027040 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-2772c7f6-33ee-43e6-b680-dbce35ee9b88 req-2e6c890c-aa1d-4b5d-bb69-ff7c281b5de2 service nova] Creating event network-vif-plugged:75217176-413a-4759-ac3b-e85684959c38 for instance 5156dcdb-2590-41b9-8b02-3f04c5c4acf7 on n-h2-master-1 Jun 20 11:57:28.038237 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-2772c7f6-33ee-43e6-b680-dbce35ee9b88 req-2e6c890c-aa1d-4b5d-bb69-ff7c281b5de2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066872 Jun 20 11:57:28.041951 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 204/433] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:57:28.063919 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1ddb16fa-cc51-4740-a668-7b0a98841303 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:28.069080 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1ddb16fa-cc51-4740-a668-7b0a98841303 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:28.083865 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-e70df87a-45ef-4fa2-b4a1-8940050ecf9f tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] validate_networks() for None {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:57:28.095736 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1ddb16fa-cc51-4740-a668-7b0a98841303 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:28.096184 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1ddb16fa-cc51-4740-a668-7b0a98841303 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:28.115939 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1ddb16fa-cc51-4740-a668-7b0a98841303 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:28.117051 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1ddb16fa-cc51-4740-a668-7b0a98841303 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:28.592031 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-e70df87a-45ef-4fa2-b4a1-8940050ecf9f tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:57:28.592860 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-e70df87a-45ef-4fa2-b4a1-8940050ecf9f tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:57:28.593491 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-e70df87a-45ef-4fa2-b4a1-8940050ecf9f tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:57:28.594633 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-e70df87a-45ef-4fa2-b4a1-8940050ecf9f tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:57:28.595224 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-e70df87a-45ef-4fa2-b4a1-8940050ecf9f tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:57:28.608499 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e70df87a-45ef-4fa2-b4a1-8940050ecf9f tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:28.609253 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e70df87a-45ef-4fa2-b4a1-8940050ecf9f tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:28.610456 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e70df87a-45ef-4fa2-b4a1-8940050ecf9f tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:28.611353 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e70df87a-45ef-4fa2-b4a1-8940050ecf9f tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:28.662008 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-e70df87a-45ef-4fa2-b4a1-8940050ecf9f tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Getting quotas for project d9fc528349c34afbace41593b93d169a. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:57:28.670072 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-e70df87a-45ef-4fa2-b4a1-8940050ecf9f tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Getting quotas for user f069018a1fc24a9fbaac9b58ee7b07fa and project d9fc528349c34afbace41593b93d169a. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:57:28.695176 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e70df87a-45ef-4fa2-b4a1-8940050ecf9f tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:57:28.697990 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e70df87a-45ef-4fa2-b4a1-8940050ecf9f tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 1cab587f-a3f7-4c56-8645-3ff752168244] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:57:28.783179 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e70df87a-45ef-4fa2-b4a1-8940050ecf9f tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.845894 Jun 20 11:57:28.784833 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 230/434] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:57:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 11:57:28.790588 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-62afddd1-15c6-418a-8c0b-44612fa936ab tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:28.791515 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-62afddd1-15c6-418a-8c0b-44612fa936ab tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] [instance: f9361b90-1c71-4bf4-b694-483cab19b1b8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:28.801610 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-62afddd1-15c6-418a-8c0b-44612fa936ab tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:28.802367 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-62afddd1-15c6-418a-8c0b-44612fa936ab tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:28.803640 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-62afddd1-15c6-418a-8c0b-44612fa936ab tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:28.804282 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-62afddd1-15c6-418a-8c0b-44612fa936ab tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:28.886849 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-62afddd1-15c6-418a-8c0b-44612fa936ab tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] Lazy-loading 'flavor' on Instance uuid f9361b90-1c71-4bf4-b694-483cab19b1b8 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:57:28.970795 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1ddb16fa-cc51-4740-a668-7b0a98841303 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:28.994213 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1ddb16fa-cc51-4740-a668-7b0a98841303 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:29.003957 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1ddb16fa-cc51-4740-a668-7b0a98841303 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:29.007050 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1ddb16fa-cc51-4740-a668-7b0a98841303 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f" status: 200 len: 1361 microversion: 2.25 time: 0.957615 Jun 20 11:57:29.009328 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 205/435] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:57:28 2022] GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f => generated 1361 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:57:29.023717 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-86c18576-349f-4b0b-af11-779151797c47 tempest-ServicesAdminNegativeTestJSON-414455182 tempest-ServicesAdminNegativeTestJSON-414455182-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:29.030623 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:57:29.030623 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:57:29.033569 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86c18576-349f-4b0b-af11-779151797c47 tempest-ServicesAdminNegativeTestJSON-414455182 tempest-ServicesAdminNegativeTestJSON-414455182-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:29.033923 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86c18576-349f-4b0b-af11-779151797c47 tempest-ServicesAdminNegativeTestJSON-414455182 tempest-ServicesAdminNegativeTestJSON-414455182-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:29.034692 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86c18576-349f-4b0b-af11-779151797c47 tempest-ServicesAdminNegativeTestJSON-414455182 tempest-ServicesAdminNegativeTestJSON-414455182-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:29.035124 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86c18576-349f-4b0b-af11-779151797c47 tempest-ServicesAdminNegativeTestJSON-414455182 tempest-ServicesAdminNegativeTestJSON-414455182-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:29.105421 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-86c18576-349f-4b0b-af11-779151797c47 tempest-ServicesAdminNegativeTestJSON-414455182 tempest-ServicesAdminNegativeTestJSON-414455182-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.093440 Jun 20 11:57:29.106446 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 206/436] 10.222.0.27 () {58 vars in 1136 bytes} [Mon Jun 20 11:57:29 2022] GET /compute/v2.1/os-services => generated 944 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:57:29.113026 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-62afddd1-15c6-418a-8c0b-44612fa936ab tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8/action" status: 202 len: 0 microversion: 2.1 time: 0.324381 Jun 20 11:57:29.114145 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-45e7dfa0-6be5-4ad2-8f90-e52b02deb11d tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:29.114263 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 231/437] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 11:57:28 2022] POST /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:57:29.115650 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-45e7dfa0-6be5-4ad2-8f90-e52b02deb11d tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: b7973338-9aa7-497a-8036-d7a2a0f750a4] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:29.127933 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-964ef0b6-87c8-42f9-9d05-b5fba8b54ad5 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:29.130899 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-964ef0b6-87c8-42f9-9d05-b5fba8b54ad5 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 1cab587f-a3f7-4c56-8645-3ff752168244] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:29.141195 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-45e7dfa0-6be5-4ad2-8f90-e52b02deb11d tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:29.143205 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-45e7dfa0-6be5-4ad2-8f90-e52b02deb11d tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:29.145183 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-45e7dfa0-6be5-4ad2-8f90-e52b02deb11d tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:29.147636 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-45e7dfa0-6be5-4ad2-8f90-e52b02deb11d tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:29.268563 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-964ef0b6-87c8-42f9-9d05-b5fba8b54ad5 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f069018a1fc24a9fbaac9b58ee7b07fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fc528349c34afbace41593b93d169a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:29.277584 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-964ef0b6-87c8-42f9-9d05-b5fba8b54ad5 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244" status: 200 len: 1222 microversion: 2.1 time: 0.161666 Jun 20 11:57:29.278726 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 232/438] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:29 2022] GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244 => generated 1222 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:29.286114 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-30b15674-7aef-4c94-a9d0-7383a85fc724 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:29.287409 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-30b15674-7aef-4c94-a9d0-7383a85fc724 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 097ee17d-f450-475a-8f33-fe596f6d98a0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:29.299007 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-30b15674-7aef-4c94-a9d0-7383a85fc724 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:29.299758 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-30b15674-7aef-4c94-a9d0-7383a85fc724 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:29.300930 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-30b15674-7aef-4c94-a9d0-7383a85fc724 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:29.301515 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-30b15674-7aef-4c94-a9d0-7383a85fc724 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:29.462856 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-45e7dfa0-6be5-4ad2-8f90-e52b02deb11d tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374ef56db0ba42a1a3b0ac12aa172b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8964bee8790c43ccb896f404015dcdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:29.477254 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-45e7dfa0-6be5-4ad2-8f90-e52b02deb11d tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] 10.222.0.27 "GET /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4" status: 200 len: 1320 microversion: 2.1 time: 0.368786 Jun 20 11:57:29.480273 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 207/439] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:29 2022] GET /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4 => generated 1320 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:29.481315 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-30b15674-7aef-4c94-a9d0-7383a85fc724 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:29.490134 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-16c13240-5c76-45c8-a92a-9c5ea777c2e5 tempest-ServicesAdminNegativeTestJSON-414455182 tempest-ServicesAdminNegativeTestJSON-414455182-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:29.492241 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:57:29.492241 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:57:29.492834 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-30b15674-7aef-4c94-a9d0-7383a85fc724 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0" status: 200 len: 1317 microversion: 2.1 time: 0.210541 Jun 20 11:57:29.494394 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-16c13240-5c76-45c8-a92a-9c5ea777c2e5 tempest-ServicesAdminNegativeTestJSON-414455182 tempest-ServicesAdminNegativeTestJSON-414455182-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:29.494686 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 233/440] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:29 2022] GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0 => generated 1317 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:29.496247 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-16c13240-5c76-45c8-a92a-9c5ea777c2e5 tempest-ServicesAdminNegativeTestJSON-414455182 tempest-ServicesAdminNegativeTestJSON-414455182-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:29.497078 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-16c13240-5c76-45c8-a92a-9c5ea777c2e5 tempest-ServicesAdminNegativeTestJSON-414455182 tempest-ServicesAdminNegativeTestJSON-414455182-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:29.497514 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-16c13240-5c76-45c8-a92a-9c5ea777c2e5 tempest-ServicesAdminNegativeTestJSON-414455182 tempest-ServicesAdminNegativeTestJSON-414455182-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:29.515496 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-93cddd4e-be84-4319-98de-c3c0d0ce8ed1 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:29.530180 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-93cddd4e-be84-4319-98de-c3c0d0ce8ed1 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f9361b90-1c71-4bf4-b694-483cab19b1b8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:29.533962 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-16c13240-5c76-45c8-a92a-9c5ea777c2e5 tempest-ServicesAdminNegativeTestJSON-414455182 tempest-ServicesAdminNegativeTestJSON-414455182-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.1 time: 0.052474 Jun 20 11:57:29.534987 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 208/441] 10.222.0.27 () {58 vars in 1197 bytes} [Mon Jun 20 11:57:29 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 11:57:29.545738 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:57:29.561325 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-93cddd4e-be84-4319-98de-c3c0d0ce8ed1 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:29.561979 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-93cddd4e-be84-4319-98de-c3c0d0ce8ed1 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:29.567500 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-93cddd4e-be84-4319-98de-c3c0d0ce8ed1 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:29.568311 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-93cddd4e-be84-4319-98de-c3c0d0ce8ed1 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:30.143170 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-158ddb03-7cdf-4604-a16c-60684b5aec28 tempest-ServicesAdminNegativeTestJSON-1769284924 tempest-ServicesAdminNegativeTestJSON-1769284924-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:30.146071 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:57:30.146071 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:57:30.147650 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-158ddb03-7cdf-4604-a16c-60684b5aec28 tempest-ServicesAdminNegativeTestJSON-1769284924 tempest-ServicesAdminNegativeTestJSON-1769284924-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '60a4dc55f36240fa9e234570a5680935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb9a8dec346d4961822ca1b17cc34d24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:30.151542 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-158ddb03-7cdf-4604-a16c-60684b5aec28 tempest-ServicesAdminNegativeTestJSON-1769284924 tempest-ServicesAdminNegativeTestJSON-1769284924-project] Request method failure captured: Jun 20 11:57:30.151542 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/os-services HTTP/1.1 Jun 20 11:57:30.151542 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:57:30.151542 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:57:30.151542 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:57:30.151542 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 11:57:30.151542 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:57:30.151542 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:57:30.151542 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:57:30.151542 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:57:30.151542 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGCik4U8IxfLiK1DMalP8CVnt3X5p0iPD0fqc4ix8PeeZsN0_1kKAZ65X-seRXmsA7puXmrE_31iZGEAy0oykEY9I5fxHRqOZdmdSOUfzMjXjU0mKoAh5-jT2AjWGRuGsoDJU_CA2O7WWdjrApc7AHzzZOpyW8MESqMXxirMIe1rCFs Jun 20 11:57:30.151542 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:57:30.151542 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:57:30.151542 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:57:30.151542 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:57:30.151542 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:57:30.151542 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:57:30.151542 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: bb9a8dec346d4961822ca1b17cc34d24 Jun 20 11:57:30.151542 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1769284924 Jun 20 11:57:30.151542 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 11:57:30.151542 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 11:57:30.153191 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb9a8dec346d4961822ca1b17cc34d24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb9a8dec346d4961822ca1b17cc34d24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bb9a8dec346d4961822ca1b17cc34d24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bb9a8dec346d4961822ca1b17cc34d24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:57:30.153191 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1769284924 Jun 20 11:57:30.153191 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: bb9a8dec346d4961822ca1b17cc34d24 Jun 20 11:57:30.153191 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1769284924 Jun 20 11:57:30.153191 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServicesAdminNegativeTestJSON-1769284924-project Jun 20 11:57:30.153191 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:57:30.153191 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:57:30.153191 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 60a4dc55f36240fa9e234570a5680935 Jun 20 11:57:30.153191 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1769284924-project Jun 20 11:57:30.153191 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 11:57:30.153191 n-d-master-1 devstack@n-api.service[119127]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 20 11:57:30.153191 n-d-master-1 devstack@n-api.service[119127]: action_args: {} Jun 20 11:57:30.154095 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:57:30.154095 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:30.154095 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:57:30.154095 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:57:30.154095 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:57:30.154095 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:57:30.154095 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 20 11:57:30.154095 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:57:30.154095 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 20 11:57:30.154095 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:57:30.154095 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:57:30.154095 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:57:30.154095 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jun 20 11:57:30.154095 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jun 20 11:57:30.154095 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 20 11:57:30.154095 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 20 11:57:30.154095 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 20 11:57:30.154095 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 20 11:57:30.154095 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 11:57:30.155431 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 11:57:30.155431 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 11:57:30.155431 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 11:57:30.155431 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 20 11:57:30.155431 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 20 11:57:30.155431 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 20 11:57:30.155431 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 20 11:57:30.155431 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 20 11:57:30.155431 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 20 11:57:30.155431 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 20 11:57:30.155431 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:57:30.155431 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:57:30.155431 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:57:30.155431 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:30.155431 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:57:30.155431 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:57:30.155431 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 20 11:57:30.155431 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 20 11:57:30.155431 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 20 11:57:30.155431 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:57:30.157777 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-158ddb03-7cdf-4604-a16c-60684b5aec28 tempest-ServicesAdminNegativeTestJSON-1769284924 tempest-ServicesAdminNegativeTestJSON-1769284924-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:57:30.160581 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-158ddb03-7cdf-4604-a16c-60684b5aec28 tempest-ServicesAdminNegativeTestJSON-1769284924 tempest-ServicesAdminNegativeTestJSON-1769284924-project] 10.222.0.27 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.616143 Jun 20 11:57:30.165318 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 209/442] 10.222.0.27 () {58 vars in 1136 bytes} [Mon Jun 20 11:57:29 2022] GET /compute/v2.1/os-services => generated 112 bytes in 623 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:57:30.172703 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4db63cb2-dd35-4006-93c3-e11bc046531f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:30.178710 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4db63cb2-dd35-4006-93c3-e11bc046531f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:30.200843 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4db63cb2-dd35-4006-93c3-e11bc046531f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:30.204463 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4db63cb2-dd35-4006-93c3-e11bc046531f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:30.206757 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4db63cb2-dd35-4006-93c3-e11bc046531f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:30.208876 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4db63cb2-dd35-4006-93c3-e11bc046531f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:30.637082 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4db63cb2-dd35-4006-93c3-e11bc046531f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:30.641105 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:57:30.648428 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4db63cb2-dd35-4006-93c3-e11bc046531f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:30.653351 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4db63cb2-dd35-4006-93c3-e11bc046531f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:30.659833 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4db63cb2-dd35-4006-93c3-e11bc046531f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f" status: 200 len: 1361 microversion: 2.25 time: 0.491829 Jun 20 11:57:30.662495 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 210/443] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:57:30 2022] GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f => generated 1361 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:57:30.678257 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-c1612b8c-255a-470c-bf4a-02d4c4fda51f req-3004a714-7a3c-4ab8-94c7-d94cfbad6608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddbdd7f1-6b17-4f7a-9793-873b18c7a92f", "name": "network-vif-plugged", "status": "completed", "tag": "be0d0765-87a0-4732-987c-66193517041e"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:30.714813 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-c1612b8c-255a-470c-bf4a-02d4c4fda51f req-3004a714-7a3c-4ab8-94c7-d94cfbad6608 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:30.715528 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-c1612b8c-255a-470c-bf4a-02d4c4fda51f req-3004a714-7a3c-4ab8-94c7-d94cfbad6608 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:30.743617 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-c1612b8c-255a-470c-bf4a-02d4c4fda51f req-3004a714-7a3c-4ab8-94c7-d94cfbad6608 service nova] Creating event network-vif-plugged:be0d0765-87a0-4732-987c-66193517041e for instance ddbdd7f1-6b17-4f7a-9793-873b18c7a92f on n-h1-master-1 Jun 20 11:57:30.749626 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-c1612b8c-255a-470c-bf4a-02d4c4fda51f req-3004a714-7a3c-4ab8-94c7-d94cfbad6608 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085301 Jun 20 11:57:30.750930 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 211/444] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:57:30.756740 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f41df537-a7e9-4493-a622-555450fef66c tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:30.757717 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f41df537-a7e9-4493-a622-555450fef66c tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 1cab587f-a3f7-4c56-8645-3ff752168244] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:30.765328 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f41df537-a7e9-4493-a622-555450fef66c tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:30.766038 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f41df537-a7e9-4493-a622-555450fef66c tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:30.766984 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f41df537-a7e9-4493-a622-555450fef66c tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:30.767659 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f41df537-a7e9-4493-a622-555450fef66c tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:30.879763 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f41df537-a7e9-4493-a622-555450fef66c tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f069018a1fc24a9fbaac9b58ee7b07fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fc528349c34afbace41593b93d169a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:30.893694 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f41df537-a7e9-4493-a622-555450fef66c tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244" status: 200 len: 1218 microversion: 2.1 time: 0.141139 Jun 20 11:57:30.906059 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 212/445] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:30 2022] GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244 => generated 1218 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:30.912354 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e51149c2-5e44-441f-8a46-2589b64e7851 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:30.913319 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e51149c2-5e44-441f-8a46-2589b64e7851 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: b7973338-9aa7-497a-8036-d7a2a0f750a4] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:30.920799 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e51149c2-5e44-441f-8a46-2589b64e7851 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:30.921508 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e51149c2-5e44-441f-8a46-2589b64e7851 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:30.922530 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e51149c2-5e44-441f-8a46-2589b64e7851 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:30.923213 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e51149c2-5e44-441f-8a46-2589b64e7851 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:30.978058 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-93cddd4e-be84-4319-98de-c3c0d0ce8ed1 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:30.990338 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-93cddd4e-be84-4319-98de-c3c0d0ce8ed1 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8" status: 200 len: 1477 microversion: 2.1 time: 1.492677 Jun 20 11:57:30.993423 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 234/446] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:29 2022] GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8 => generated 1477 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:31.019602 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e9e9e129-1414-4941-b373-2303b610f0c9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:31.021949 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e9e9e129-1414-4941-b373-2303b610f0c9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 097ee17d-f450-475a-8f33-fe596f6d98a0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:31.044011 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e9e9e129-1414-4941-b373-2303b610f0c9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:31.046579 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e9e9e129-1414-4941-b373-2303b610f0c9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:31.050785 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e9e9e129-1414-4941-b373-2303b610f0c9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:31.053033 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e9e9e129-1414-4941-b373-2303b610f0c9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:31.216682 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e51149c2-5e44-441f-8a46-2589b64e7851 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374ef56db0ba42a1a3b0ac12aa172b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8964bee8790c43ccb896f404015dcdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:31.229124 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e51149c2-5e44-441f-8a46-2589b64e7851 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] 10.222.0.27 "GET /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4" status: 200 len: 1320 microversion: 2.1 time: 0.320509 Jun 20 11:57:31.230026 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 213/447] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:30 2022] GET /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4 => generated 1320 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:31.655249 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e9e9e129-1414-4941-b373-2303b610f0c9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:31.681741 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0c8e1773-b3bb-4f5a-9d6d-798ba6b8ec4e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:31.682360 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0c8e1773-b3bb-4f5a-9d6d-798ba6b8ec4e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:31.696149 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e9e9e129-1414-4941-b373-2303b610f0c9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0" status: 200 len: 1317 microversion: 2.1 time: 0.699768 Jun 20 11:57:31.696746 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0c8e1773-b3bb-4f5a-9d6d-798ba6b8ec4e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:31.697234 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0c8e1773-b3bb-4f5a-9d6d-798ba6b8ec4e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:31.699013 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0c8e1773-b3bb-4f5a-9d6d-798ba6b8ec4e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:31.701433 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0c8e1773-b3bb-4f5a-9d6d-798ba6b8ec4e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:31.702104 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 235/448] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:30 2022] GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0 => generated 1317 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:31.925343 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f7b705be-f3f2-4e3e-a46e-d28d0ef3f0b6 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:31.929356 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f7b705be-f3f2-4e3e-a46e-d28d0ef3f0b6 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 1cab587f-a3f7-4c56-8645-3ff752168244] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:31.967938 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7b705be-f3f2-4e3e-a46e-d28d0ef3f0b6 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:31.969004 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7b705be-f3f2-4e3e-a46e-d28d0ef3f0b6 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:31.970455 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7b705be-f3f2-4e3e-a46e-d28d0ef3f0b6 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:31.971229 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7b705be-f3f2-4e3e-a46e-d28d0ef3f0b6 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:32.024814 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:57:32.181597 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f7b705be-f3f2-4e3e-a46e-d28d0ef3f0b6 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f069018a1fc24a9fbaac9b58ee7b07fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fc528349c34afbace41593b93d169a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:32.191623 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f7b705be-f3f2-4e3e-a46e-d28d0ef3f0b6 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244" status: 200 len: 1280 microversion: 2.1 time: 0.281396 Jun 20 11:57:32.197496 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 236/449] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:31 2022] GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244 => generated 1280 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:57:32.222820 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4afba2b5-5b07-4461-a2bb-4eda4be04b9e tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:32.224263 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4afba2b5-5b07-4461-a2bb-4eda4be04b9e tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f9361b90-1c71-4bf4-b694-483cab19b1b8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:32.240973 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4afba2b5-5b07-4461-a2bb-4eda4be04b9e tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:32.241954 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4afba2b5-5b07-4461-a2bb-4eda4be04b9e tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:32.243323 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4afba2b5-5b07-4461-a2bb-4eda4be04b9e tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:32.244044 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4afba2b5-5b07-4461-a2bb-4eda4be04b9e tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:32.650740 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0c8e1773-b3bb-4f5a-9d6d-798ba6b8ec4e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:32.663260 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0c8e1773-b3bb-4f5a-9d6d-798ba6b8ec4e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:32.664847 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0c8e1773-b3bb-4f5a-9d6d-798ba6b8ec4e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:32.666011 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0c8e1773-b3bb-4f5a-9d6d-798ba6b8ec4e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f" status: 200 len: 1361 microversion: 2.25 time: 0.989471 Jun 20 11:57:32.674264 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 214/450] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:57:31 2022] GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f => generated 1361 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:57:32.679737 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9cbe6fea-667f-4bcb-91e0-fd1c854f4225 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:32.687102 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9cbe6fea-667f-4bcb-91e0-fd1c854f4225 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: b7973338-9aa7-497a-8036-d7a2a0f750a4] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:32.707005 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9cbe6fea-667f-4bcb-91e0-fd1c854f4225 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:32.709996 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9cbe6fea-667f-4bcb-91e0-fd1c854f4225 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:32.712459 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9cbe6fea-667f-4bcb-91e0-fd1c854f4225 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:32.713087 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9cbe6fea-667f-4bcb-91e0-fd1c854f4225 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:32.842232 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4afba2b5-5b07-4461-a2bb-4eda4be04b9e tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:32.855583 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4afba2b5-5b07-4461-a2bb-4eda4be04b9e tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8" status: 200 len: 1460 microversion: 2.1 time: 0.655437 Jun 20 11:57:32.856387 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 237/451] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:32 2022] GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8 => generated 1460 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:32.870882 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cbd0e81d-0f13-4614-99f1-b2b5b6fb929b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:32.871723 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cbd0e81d-0f13-4614-99f1-b2b5b6fb929b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 097ee17d-f450-475a-8f33-fe596f6d98a0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:32.889896 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cbd0e81d-0f13-4614-99f1-b2b5b6fb929b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:32.890626 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cbd0e81d-0f13-4614-99f1-b2b5b6fb929b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:32.892592 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cbd0e81d-0f13-4614-99f1-b2b5b6fb929b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:32.894748 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cbd0e81d-0f13-4614-99f1-b2b5b6fb929b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:33.340685 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9cbe6fea-667f-4bcb-91e0-fd1c854f4225 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374ef56db0ba42a1a3b0ac12aa172b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8964bee8790c43ccb896f404015dcdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:33.355337 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9cbe6fea-667f-4bcb-91e0-fd1c854f4225 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] 10.222.0.27 "GET /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4" status: 200 len: 1320 microversion: 2.1 time: 0.679441 Jun 20 11:57:33.356217 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 215/452] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:32 2022] GET /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4 => generated 1320 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:33.364507 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7b849e88-a589-413a-8790-10b58922f699 tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:33.365586 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7b849e88-a589-413a-8790-10b58922f699 tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] [instance: f9361b90-1c71-4bf4-b694-483cab19b1b8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:33.379197 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7b849e88-a589-413a-8790-10b58922f699 tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:33.380117 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7b849e88-a589-413a-8790-10b58922f699 tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:33.381904 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7b849e88-a589-413a-8790-10b58922f699 tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:33.382523 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7b849e88-a589-413a-8790-10b58922f699 tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:33.671423 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-cbd0e81d-0f13-4614-99f1-b2b5b6fb929b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:33.681453 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cbd0e81d-0f13-4614-99f1-b2b5b6fb929b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0" status: 200 len: 1317 microversion: 2.1 time: 0.815894 Jun 20 11:57:33.682090 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 238/453] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:32 2022] GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0 => generated 1317 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:33.706978 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-1f019207-9f0f-49cc-b1dd-4c7eaf8b567f req-652ead16-e9b1-4b62-8a18-8cbb568504bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "097ee17d-f450-475a-8f33-fe596f6d98a0", "name": "network-vif-plugged", "status": "completed", "tag": "b542790e-8718-43ca-9777-dbb16ec436a1"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:33.730884 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-1f019207-9f0f-49cc-b1dd-4c7eaf8b567f req-652ead16-e9b1-4b62-8a18-8cbb568504bd service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:33.731321 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-1f019207-9f0f-49cc-b1dd-4c7eaf8b567f req-652ead16-e9b1-4b62-8a18-8cbb568504bd service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:33.782713 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-1f019207-9f0f-49cc-b1dd-4c7eaf8b567f req-652ead16-e9b1-4b62-8a18-8cbb568504bd service nova] Creating event network-vif-plugged:b542790e-8718-43ca-9777-dbb16ec436a1 for instance 097ee17d-f450-475a-8f33-fe596f6d98a0 on n-h2-master-1 Jun 20 11:57:33.808997 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-1f019207-9f0f-49cc-b1dd-4c7eaf8b567f req-652ead16-e9b1-4b62-8a18-8cbb568504bd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115710 Jun 20 11:57:33.817836 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 239/454] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:57:33.845075 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7747ad22-969b-4a49-9df5-81c631e45392 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:33.846281 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7747ad22-969b-4a49-9df5-81c631e45392 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 1cab587f-a3f7-4c56-8645-3ff752168244] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:33.880706 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7747ad22-969b-4a49-9df5-81c631e45392 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:33.900025 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7747ad22-969b-4a49-9df5-81c631e45392 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:33.901129 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7747ad22-969b-4a49-9df5-81c631e45392 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:33.908059 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7747ad22-969b-4a49-9df5-81c631e45392 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:34.574024 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7b849e88-a589-413a-8790-10b58922f699 tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8" status: 200 len: 1611 microversion: 2.1 time: 1.216293 Jun 20 11:57:34.577793 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 216/455] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:33 2022] GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8 => generated 1611 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:34.594763 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a8f16b86-dc3f-48fa-a08b-1db08ac192d8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:34.595732 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a8f16b86-dc3f-48fa-a08b-1db08ac192d8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:34.610804 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a8f16b86-dc3f-48fa-a08b-1db08ac192d8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:34.614409 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a8f16b86-dc3f-48fa-a08b-1db08ac192d8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:34.615373 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a8f16b86-dc3f-48fa-a08b-1db08ac192d8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:34.615938 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a8f16b86-dc3f-48fa-a08b-1db08ac192d8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:34.965641 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a8f16b86-dc3f-48fa-a08b-1db08ac192d8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:34.986721 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a8f16b86-dc3f-48fa-a08b-1db08ac192d8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:34.990913 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a8f16b86-dc3f-48fa-a08b-1db08ac192d8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:34.995473 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a8f16b86-dc3f-48fa-a08b-1db08ac192d8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f" status: 200 len: 1557 microversion: 2.25 time: 0.415432 Jun 20 11:57:34.998585 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 217/456] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:57:34 2022] GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f => generated 1557 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:57:35.017927 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a51dd41a-1658-4e8d-9ff2-0e6bd51591d8 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:35.019623 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a51dd41a-1658-4e8d-9ff2-0e6bd51591d8 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: b7973338-9aa7-497a-8036-d7a2a0f750a4] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:35.041042 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a51dd41a-1658-4e8d-9ff2-0e6bd51591d8 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:35.041867 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a51dd41a-1658-4e8d-9ff2-0e6bd51591d8 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:35.043255 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a51dd41a-1658-4e8d-9ff2-0e6bd51591d8 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:35.043937 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a51dd41a-1658-4e8d-9ff2-0e6bd51591d8 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:35.108679 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7747ad22-969b-4a49-9df5-81c631e45392 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f069018a1fc24a9fbaac9b58ee7b07fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fc528349c34afbace41593b93d169a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:35.125586 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7747ad22-969b-4a49-9df5-81c631e45392 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244" status: 200 len: 1322 microversion: 2.1 time: 1.297166 Jun 20 11:57:35.135568 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 240/457] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:33 2022] GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244 => generated 1322 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:35.140722 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f9323425-0bc6-4ab9-8786-53499bf77fb8 tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:35.150377 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:57:35.150377 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:57:35.153124 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f9323425-0bc6-4ab9-8786-53499bf77fb8 tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:35.154860 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f9323425-0bc6-4ab9-8786-53499bf77fb8 tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:35.157222 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f9323425-0bc6-4ab9-8786-53499bf77fb8 tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:35.160792 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f9323425-0bc6-4ab9-8786-53499bf77fb8 tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:35.216093 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f9323425-0bc6-4ab9-8786-53499bf77fb8 tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.079289 Jun 20 11:57:35.219676 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 241/458] 10.222.0.27 () {58 vars in 1175 bytes} [Mon Jun 20 11:57:35 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:57:35.229177 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f88a9568-dc3b-4719-a88a-715afa8196b1 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:35.233666 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f88a9568-dc3b-4719-a88a-715afa8196b1 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 097ee17d-f450-475a-8f33-fe596f6d98a0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:35.246269 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f88a9568-dc3b-4719-a88a-715afa8196b1 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:35.246789 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f88a9568-dc3b-4719-a88a-715afa8196b1 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:35.248004 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f88a9568-dc3b-4719-a88a-715afa8196b1 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:35.248490 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f88a9568-dc3b-4719-a88a-715afa8196b1 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:35.528444 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a51dd41a-1658-4e8d-9ff2-0e6bd51591d8 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374ef56db0ba42a1a3b0ac12aa172b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8964bee8790c43ccb896f404015dcdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:35.538027 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a51dd41a-1658-4e8d-9ff2-0e6bd51591d8 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] 10.222.0.27 "GET /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4" status: 200 len: 1320 microversion: 2.1 time: 0.537508 Jun 20 11:57:35.540372 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 218/459] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:34 2022] GET /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4 => generated 1320 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:35.992768 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f88a9568-dc3b-4719-a88a-715afa8196b1 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:36.025627 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f88a9568-dc3b-4719-a88a-715afa8196b1 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0" status: 200 len: 1317 microversion: 2.1 time: 0.804479 Jun 20 11:57:36.030046 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 242/460] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:35 2022] GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0 => generated 1317 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:36.052467 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-95b31321-bf21-4d8a-be2f-4db536d15f50 tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:36.056346 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-95b31321-bf21-4d8a-be2f-4db536d15f50 tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] [instance: f9361b90-1c71-4bf4-b694-483cab19b1b8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:36.094087 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95b31321-bf21-4d8a-be2f-4db536d15f50 tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:36.096920 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95b31321-bf21-4d8a-be2f-4db536d15f50 tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:36.098672 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95b31321-bf21-4d8a-be2f-4db536d15f50 tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:36.100026 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95b31321-bf21-4d8a-be2f-4db536d15f50 tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:36.394073 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-95b31321-bf21-4d8a-be2f-4db536d15f50 tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] Lazy-loading 'flavor' on Instance uuid f9361b90-1c71-4bf4-b694-483cab19b1b8 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:57:36.428173 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-95b31321-bf21-4d8a-be2f-4db536d15f50 tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance f9361b90-1c71-4bf4-b694-483cab19b1b8 while it is in vm_state suspended Jun 20 11:57:36.433043 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-95b31321-bf21-4d8a-be2f-4db536d15f50 tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] Request method failure captured: Jun 20 11:57:36.433043 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8/action HTTP/1.1 Jun 20 11:57:36.433043 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:57:36.433043 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:57:36.433043 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:57:36.433043 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 97 Jun 20 11:57:36.433043 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:57:36.433043 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:57:36.433043 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:57:36.433043 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:57:36.433043 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGBrrZ1TFAScTXF3z5Dj7ZbyHXQlkg887_nTvZgmtAChNV1RyfhS_ca7kZrIhOloXluxjmkPVXYzDEGkoCFxUVcJKBRvWVHs84n2Q1bYj15-qzKYc5ke-2kb3egAqLdVAlSyF_Tc_wz0VSeEDdScCwxS-vqY7_1jRlxioeu4sN0Mg7c Jun 20 11:57:36.433043 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:57:36.433043 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:57:36.433043 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:57:36.433043 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:57:36.433043 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:57:36.433043 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:57:36.433043 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 915d0319929440e485fc5f40fdeb7dc9 Jun 20 11:57:36.433043 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-LiveMigrationNegativeTest-1842497938 Jun 20 11:57:36.433043 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member,admin Jun 20 11:57:36.433043 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member,admin Jun 20 11:57:36.434435 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/915d0319929440e485fc5f40fdeb7dc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/915d0319929440e485fc5f40fdeb7dc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/915d0319929440e485fc5f40fdeb7dc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_915d0319929440e485fc5f40fdeb7dc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:57:36.434435 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-LiveMigrationNegativeTest-1842497938 Jun 20 11:57:36.434435 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 915d0319929440e485fc5f40fdeb7dc9 Jun 20 11:57:36.434435 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1842497938 Jun 20 11:57:36.434435 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-LiveMigrationNegativeTest-1842497938-project-admin Jun 20 11:57:36.434435 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:57:36.434435 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:57:36.434435 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 0ae66fe055d34584bc1ae3dbefc1f76d Jun 20 11:57:36.434435 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-LiveMigrationNegativeTest-1842497938-project-admin Jun 20 11:57:36.434435 n-d-master-1 devstack@n-api.service[119128]: Jun 20 11:57:36.434435 n-d-master-1 devstack@n-api.service[119128]: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": true, "disk_over_commit": false}} Jun 20 11:57:36.434435 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 11:57:36.435323 n-d-master-1 devstack@n-api.service[119128]: exception: Cannot 'os-migrateLive' instance f9361b90-1c71-4bf4-b694-483cab19b1b8 while it is in vm_state suspended Jun 20 11:57:36.435323 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'f9361b90-1c71-4bf4-b694-483cab19b1b8', 'body': {'os-migrateLive': {'host': 'n-h1-master-1', 'block_migration': True, 'disk_over_commit': False}}} Jun 20 11:57:36.435323 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:57:36.435323 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:36.435323 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jun 20 11:57:36.435323 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jun 20 11:57:36.435323 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 20 11:57:36.435323 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 11:57:36.435323 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 20 11:57:36.435323 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 20 11:57:36.435323 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 20 11:57:36.435323 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 11:57:36.435323 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 20 11:57:36.435323 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 20 11:57:36.435323 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jun 20 11:57:36.435323 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 11:57:36.435323 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jun 20 11:57:36.435323 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 11:57:36.436518 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 11:57:36.436518 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 11:57:36.436518 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 20 11:57:36.436518 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 20 11:57:36.436518 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f9361b90-1c71-4bf4-b694-483cab19b1b8 in vm_state suspended. Cannot live_migrate while the instance is in this state. Jun 20 11:57:36.436518 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:36.436518 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:57:36.436518 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:36.436518 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:36.436518 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:57:36.436518 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:57:36.436518 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:57:36.436518 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:57:36.436518 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:57:36.436518 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:57:36.436518 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:57:36.436518 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:57:36.436518 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:57:36.436518 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:57:36.436518 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:57:36.437686 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:57:36.437686 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 20 11:57:36.437686 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Jun 20 11:57:36.437686 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 20 11:57:36.437686 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 20 11:57:36.437686 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 20 11:57:36.437686 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance f9361b90-1c71-4bf4-b694-483cab19b1b8 while it is in vm_state suspended Jun 20 11:57:36.437686 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:36.437686 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:57:36.437686 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:36.437686 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:36.437686 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:57:36.437686 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:57:36.437686 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:57:36.437686 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:57:36.437686 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance f9361b90-1c71-4bf4-b694-483cab19b1b8 while it is in vm_state suspended Jun 20 11:57:36.437686 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:36.438752 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-95b31321-bf21-4d8a-be2f-4db536d15f50 tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance f9361b90-1c71-4bf4-b694-483cab19b1b8 while it is in vm_state suspended {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:57:36.438752 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-95b31321-bf21-4d8a-be2f-4db536d15f50 tempest-LiveMigrationNegativeTest-1842497938 tempest-LiveMigrationNegativeTest-1842497938-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8/action" status: 409 len: 155 microversion: 2.1 time: 0.404850 Jun 20 11:57:36.452497 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 243/461] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 11:57:36 2022] POST /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8/action => generated 155 bytes in 420 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 20 11:57:36.470581 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-0a7962f1-2a00-4813-9760-c32b7da6cf68 req-68fcbb8e-1333-49ba-91b8-dad3315e5605 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cab587f-a3f7-4c56-8645-3ff752168244", "tag": "4c34624e-8618-4536-b887-d13e05a1b590"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:36.482968 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-0a7962f1-2a00-4813-9760-c32b7da6cf68 req-68fcbb8e-1333-49ba-91b8-dad3315e5605 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:36.483421 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-0a7962f1-2a00-4813-9760-c32b7da6cf68 req-68fcbb8e-1333-49ba-91b8-dad3315e5605 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:36.500455 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e86ce660-5c4c-47ed-8c9d-5d5f6f855786 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:36.501122 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e86ce660-5c4c-47ed-8c9d-5d5f6f855786 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:36.521148 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e86ce660-5c4c-47ed-8c9d-5d5f6f855786 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:36.521603 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e86ce660-5c4c-47ed-8c9d-5d5f6f855786 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:36.523115 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e86ce660-5c4c-47ed-8c9d-5d5f6f855786 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:36.523579 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e86ce660-5c4c-47ed-8c9d-5d5f6f855786 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:36.537216 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-0a7962f1-2a00-4813-9760-c32b7da6cf68 req-68fcbb8e-1333-49ba-91b8-dad3315e5605 service nova] Creating event network-changed:4c34624e-8618-4536-b887-d13e05a1b590 for instance 1cab587f-a3f7-4c56-8645-3ff752168244 on n-h2-master-1 Jun 20 11:57:36.556739 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-0a7962f1-2a00-4813-9760-c32b7da6cf68 req-68fcbb8e-1333-49ba-91b8-dad3315e5605 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102259 Jun 20 11:57:36.565960 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 244/462] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:57:36.582127 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-07e86698-4268-43f6-b1db-3b31a11c3de9 req-cd8a7604-c274-4edd-af83-4f5b7c8cb7b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7973338-9aa7-497a-8036-d7a2a0f750a4", "name": "network-vif-plugged", "status": "completed", "tag": "78be856f-abe5-4eae-9efd-e00f6fe411b0"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:36.611484 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-07e86698-4268-43f6-b1db-3b31a11c3de9 req-cd8a7604-c274-4edd-af83-4f5b7c8cb7b0 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:36.613692 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-07e86698-4268-43f6-b1db-3b31a11c3de9 req-cd8a7604-c274-4edd-af83-4f5b7c8cb7b0 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:36.654492 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-07e86698-4268-43f6-b1db-3b31a11c3de9 req-cd8a7604-c274-4edd-af83-4f5b7c8cb7b0 service nova] Creating event network-vif-plugged:78be856f-abe5-4eae-9efd-e00f6fe411b0 for instance b7973338-9aa7-497a-8036-d7a2a0f750a4 on n-h1-master-1 Jun 20 11:57:36.670264 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-07e86698-4268-43f6-b1db-3b31a11c3de9 req-cd8a7604-c274-4edd-af83-4f5b7c8cb7b0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102723 Jun 20 11:57:36.684252 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 245/463] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:57:36.703104 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-224c68e9-6c4f-4dd8-b9eb-fca645462181 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:36.707347 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-224c68e9-6c4f-4dd8-b9eb-fca645462181 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 1cab587f-a3f7-4c56-8645-3ff752168244] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:36.721669 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-224c68e9-6c4f-4dd8-b9eb-fca645462181 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:36.725822 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-224c68e9-6c4f-4dd8-b9eb-fca645462181 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:36.745215 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-224c68e9-6c4f-4dd8-b9eb-fca645462181 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:36.751504 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-224c68e9-6c4f-4dd8-b9eb-fca645462181 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:36.918732 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-e86ce660-5c4c-47ed-8c9d-5d5f6f855786 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lazy-loading 'services' on Instance uuid ddbdd7f1-6b17-4f7a-9793-873b18c7a92f {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:57:37.037200 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e86ce660-5c4c-47ed-8c9d-5d5f6f855786 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f" status: 200 len: 2049 microversion: 2.25 time: 1.494832 Jun 20 11:57:37.054293 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 219/464] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:57:35 2022] GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f => generated 2049 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:57:37.074765 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b452d8b8-1dc9-4598-9046-1b9a2418f68f tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:37.075268 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b452d8b8-1dc9-4598-9046-1b9a2418f68f tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f9361b90-1c71-4bf4-b694-483cab19b1b8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:37.085129 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b452d8b8-1dc9-4598-9046-1b9a2418f68f tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:37.086147 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b452d8b8-1dc9-4598-9046-1b9a2418f68f tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:37.087129 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b452d8b8-1dc9-4598-9046-1b9a2418f68f tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:37.088128 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b452d8b8-1dc9-4598-9046-1b9a2418f68f tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:37.156019 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b452d8b8-1dc9-4598-9046-1b9a2418f68f tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f9361b90-1c71-4bf4-b694-483cab19b1b8] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 11:57:37.410561 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b452d8b8-1dc9-4598-9046-1b9a2418f68f tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8" status: 204 len: 0 microversion: 2.1 time: 0.353707 Jun 20 11:57:37.411526 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 220/465] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 11:57:37 2022] DELETE /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:57:37.419093 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-24d94547-4f9d-4193-a23f-cd3f778c4092 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:37.426800 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-24d94547-4f9d-4193-a23f-cd3f778c4092 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: b7973338-9aa7-497a-8036-d7a2a0f750a4] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:37.454758 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-24d94547-4f9d-4193-a23f-cd3f778c4092 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:37.457225 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-24d94547-4f9d-4193-a23f-cd3f778c4092 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:37.458567 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-24d94547-4f9d-4193-a23f-cd3f778c4092 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:37.459077 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-24d94547-4f9d-4193-a23f-cd3f778c4092 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:37.602854 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-224c68e9-6c4f-4dd8-b9eb-fca645462181 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f069018a1fc24a9fbaac9b58ee7b07fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fc528349c34afbace41593b93d169a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:37.612812 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-224c68e9-6c4f-4dd8-b9eb-fca645462181 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244" status: 200 len: 1322 microversion: 2.1 time: 0.922398 Jun 20 11:57:37.613406 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 246/466] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:36 2022] GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244 => generated 1322 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:37.645905 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1d74fbe1-23b9-42f8-9016-94925c8eff6a tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:37.645905 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1d74fbe1-23b9-42f8-9016-94925c8eff6a tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 097ee17d-f450-475a-8f33-fe596f6d98a0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:37.677578 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d74fbe1-23b9-42f8-9016-94925c8eff6a tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:37.678546 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d74fbe1-23b9-42f8-9016-94925c8eff6a tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:37.679315 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d74fbe1-23b9-42f8-9016-94925c8eff6a tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:37.679784 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d74fbe1-23b9-42f8-9016-94925c8eff6a tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:37.841835 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-24d94547-4f9d-4193-a23f-cd3f778c4092 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374ef56db0ba42a1a3b0ac12aa172b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8964bee8790c43ccb896f404015dcdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:37.851858 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-24d94547-4f9d-4193-a23f-cd3f778c4092 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] 10.222.0.27 "GET /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4" status: 200 len: 1320 microversion: 2.1 time: 0.438394 Jun 20 11:57:37.852405 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 221/467] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:37 2022] GET /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4 => generated 1320 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:37.867824 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cca515dc-1a0c-4e20-97c6-352b42148af8 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:37.871461 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cca515dc-1a0c-4e20-97c6-352b42148af8 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:37.879565 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:RELEASE=1,nova_api:SELECT=95,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:57:37.888892 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cca515dc-1a0c-4e20-97c6-352b42148af8 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:37.890978 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cca515dc-1a0c-4e20-97c6-352b42148af8 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:37.894963 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cca515dc-1a0c-4e20-97c6-352b42148af8 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:37.895479 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cca515dc-1a0c-4e20-97c6-352b42148af8 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:38.151345 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-cca515dc-1a0c-4e20-97c6-352b42148af8 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lazy-loading 'services' on Instance uuid ddbdd7f1-6b17-4f7a-9793-873b18c7a92f {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:57:38.172231 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cca515dc-1a0c-4e20-97c6-352b42148af8 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f" status: 200 len: 2049 microversion: 2.25 time: 0.314564 Jun 20 11:57:38.185279 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 222/468] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:57:37 2022] GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f => generated 2049 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:57:38.191430 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c8c8cb28-5480-439b-853f-8b191e7dadea tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:38.192333 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c8c8cb28-5480-439b-853f-8b191e7dadea tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f9361b90-1c71-4bf4-b694-483cab19b1b8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:38.199740 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c8c8cb28-5480-439b-853f-8b191e7dadea tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:38.200764 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c8c8cb28-5480-439b-853f-8b191e7dadea tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:38.201690 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c8c8cb28-5480-439b-853f-8b191e7dadea tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:38.202289 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c8c8cb28-5480-439b-853f-8b191e7dadea tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:38.449576 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1d74fbe1-23b9-42f8-9016-94925c8eff6a tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:38.458220 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1d74fbe1-23b9-42f8-9016-94925c8eff6a tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0" status: 200 len: 1467 microversion: 2.1 time: 0.826087 Jun 20 11:57:38.463098 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 247/469] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:37 2022] GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0 => generated 1467 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:38.483436 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6df6c4ac-309f-49d3-a32f-7b9f27f84183 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:38.486438 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:57:38.486438 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:57:38.494524 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6df6c4ac-309f-49d3-a32f-7b9f27f84183 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:38.503866 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6df6c4ac-309f-49d3-a32f-7b9f27f84183 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:38.508735 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6df6c4ac-309f-49d3-a32f-7b9f27f84183 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:38.509542 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6df6c4ac-309f-49d3-a32f-7b9f27f84183 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:38.522841 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c8c8cb28-5480-439b-853f-8b191e7dadea tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:38.534102 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c8c8cb28-5480-439b-853f-8b191e7dadea tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8" status: 200 len: 1466 microversion: 2.1 time: 0.347281 Jun 20 11:57:38.534688 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 223/470] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:38 2022] GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8 => generated 1466 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:38.549587 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e2a1eb9e-5fe9-45d9-8833-73f043d52900 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:38.554669 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e2a1eb9e-5fe9-45d9-8833-73f043d52900 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 5156dcdb-2590-41b9-8b02-3f04c5c4acf7] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:38.574581 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2a1eb9e-5fe9-45d9-8833-73f043d52900 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:38.576612 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2a1eb9e-5fe9-45d9-8833-73f043d52900 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:38.577831 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2a1eb9e-5fe9-45d9-8833-73f043d52900 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:38.579580 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2a1eb9e-5fe9-45d9-8833-73f043d52900 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:38.593773 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6df6c4ac-309f-49d3-a32f-7b9f27f84183 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.125018 Jun 20 11:57:38.594880 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 248/471] 10.222.0.27 () {60 vars in 1216 bytes} [Mon Jun 20 11:57:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:57:38.605788 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-34de7f5b-4350-462a-996e-2d8f25a1a55a tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": "auto"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:38.607189 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-34de7f5b-4350-462a-996e-2d8f25a1a55a tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:38.617428 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-34de7f5b-4350-462a-996e-2d8f25a1a55a tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:38.620497 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-34de7f5b-4350-462a-996e-2d8f25a1a55a tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:38.621651 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-34de7f5b-4350-462a-996e-2d8f25a1a55a tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:38.622298 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-34de7f5b-4350-462a-996e-2d8f25a1a55a tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:38.675310 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-34de7f5b-4350-462a-996e-2d8f25a1a55a tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lazy-loading 'flavor' on Instance uuid ddbdd7f1-6b17-4f7a-9793-873b18c7a92f {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:57:38.689689 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-34de7f5b-4350-462a-996e-2d8f25a1a55a tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Going to try to live migrate instance to n-h2-master-1 {{(pid=119128) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 20 11:57:38.802751 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e2a1eb9e-5fe9-45d9-8833-73f043d52900 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:38.818755 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e2a1eb9e-5fe9-45d9-8833-73f043d52900 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/5156dcdb-2590-41b9-8b02-3f04c5c4acf7" status: 200 len: 1466 microversion: 2.1 time: 0.281562 Jun 20 11:57:38.820142 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 224/472] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:38 2022] GET /compute/v2.1/servers/5156dcdb-2590-41b9-8b02-3f04c5c4acf7 => generated 1466 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:38.827143 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e5cbe2c0-403c-4a18-a1cc-9d1a41f9a6f1 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:38.828037 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e5cbe2c0-403c-4a18-a1cc-9d1a41f9a6f1 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 1cab587f-a3f7-4c56-8645-3ff752168244] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:38.836955 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e5cbe2c0-403c-4a18-a1cc-9d1a41f9a6f1 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:38.838153 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e5cbe2c0-403c-4a18-a1cc-9d1a41f9a6f1 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:38.839810 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e5cbe2c0-403c-4a18-a1cc-9d1a41f9a6f1 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:38.842915 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e5cbe2c0-403c-4a18-a1cc-9d1a41f9a6f1 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:39.046198 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e5cbe2c0-403c-4a18-a1cc-9d1a41f9a6f1 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f069018a1fc24a9fbaac9b58ee7b07fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fc528349c34afbace41593b93d169a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:39.052379 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:57:39.061868 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e5cbe2c0-403c-4a18-a1cc-9d1a41f9a6f1 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244" status: 200 len: 1322 microversion: 2.1 time: 0.239931 Jun 20 11:57:39.062854 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 225/473] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:38 2022] GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:39.081503 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c3a75506-b9c2-45f6-8e78-de7e5d03bbf7 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:39.088628 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c3a75506-b9c2-45f6-8e78-de7e5d03bbf7 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:39.090673 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c3a75506-b9c2-45f6-8e78-de7e5d03bbf7 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Searching by: {'reservation_id': 'r-b48tdnuo', 'deleted': False, 'project_id': 'a6150795e7424cca91c71531840d88be'} {{(pid=119127) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 11:57:39.101124 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c3a75506-b9c2-45f6-8e78-de7e5d03bbf7 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:39.101985 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c3a75506-b9c2-45f6-8e78-de7e5d03bbf7 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:39.103602 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c3a75506-b9c2-45f6-8e78-de7e5d03bbf7 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:39.104779 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c3a75506-b9c2-45f6-8e78-de7e5d03bbf7 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:39.277405 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=8 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:57:39.331605 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.multi_cell_list [None req-c3a75506-b9c2-45f6-8e78-de7e5d03bbf7 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119127) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 11:57:39.642835 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c3a75506-b9c2-45f6-8e78-de7e5d03bbf7 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:39.658917 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c3a75506-b9c2-45f6-8e78-de7e5d03bbf7 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:39.659379 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c3a75506-b9c2-45f6-8e78-de7e5d03bbf7 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:39.947480 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c3a75506-b9c2-45f6-8e78-de7e5d03bbf7 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?reservation_id=r-b48tdnuo" status: 200 len: 2926 microversion: 2.1 time: 0.883176 Jun 20 11:57:39.960851 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 226/474] 10.222.0.27 () {58 vars in 1196 bytes} [Mon Jun 20 11:57:39 2022] GET /compute/v2.1/servers/detail?reservation_id=r-b48tdnuo => generated 2926 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:39.966062 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a861aaa5-cac6-4b9a-8e0b-15bbf2cb4a60 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:39.966882 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a861aaa5-cac6-4b9a-8e0b-15bbf2cb4a60 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: b7973338-9aa7-497a-8036-d7a2a0f750a4] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:39.988609 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a861aaa5-cac6-4b9a-8e0b-15bbf2cb4a60 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:39.990481 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a861aaa5-cac6-4b9a-8e0b-15bbf2cb4a60 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:39.990749 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a861aaa5-cac6-4b9a-8e0b-15bbf2cb4a60 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:39.991425 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a861aaa5-cac6-4b9a-8e0b-15bbf2cb4a60 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:40.236845 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a861aaa5-cac6-4b9a-8e0b-15bbf2cb4a60 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374ef56db0ba42a1a3b0ac12aa172b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8964bee8790c43ccb896f404015dcdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:40.256332 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a861aaa5-cac6-4b9a-8e0b-15bbf2cb4a60 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] 10.222.0.27 "GET /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4" status: 200 len: 1470 microversion: 2.1 time: 0.294154 Jun 20 11:57:40.269442 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 227/475] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:39 2022] GET /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4 => generated 1470 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:40.279313 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4f456920-26bd-4135-86d3-c1fc0654f4f0 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:40.280661 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4f456920-26bd-4135-86d3-c1fc0654f4f0 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f9361b90-1c71-4bf4-b694-483cab19b1b8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:40.288550 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4f456920-26bd-4135-86d3-c1fc0654f4f0 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:40.289004 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4f456920-26bd-4135-86d3-c1fc0654f4f0 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:40.289781 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4f456920-26bd-4135-86d3-c1fc0654f4f0 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:40.290210 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4f456920-26bd-4135-86d3-c1fc0654f4f0 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:40.492506 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4f456920-26bd-4135-86d3-c1fc0654f4f0 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:40.502753 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4f456920-26bd-4135-86d3-c1fc0654f4f0 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8" status: 200 len: 1466 microversion: 2.1 time: 0.231662 Jun 20 11:57:40.512537 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 228/476] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:40 2022] GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8 => generated 1466 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:40.823319 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fc9dfd90-50f0-4290-833b-1ae0ff32baa5 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:40.833183 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fc9dfd90-50f0-4290-833b-1ae0ff32baa5 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.319078 Jun 20 11:57:40.840255 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 229/477] 10.222.0.27 () {58 vars in 1136 bytes} [Mon Jun 20 11:57:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:57:40.845727 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f199b262-c172-470a-b281-eb4b96169ff9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:40.862662 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.compute.server_groups [None req-f199b262-c172-470a-b281-eb4b96169ff9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Querying cell d5df985c-a080-4240-bcef-1787de3aeb9e(cell1) for 2 instances {{(pid=119127) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jun 20 11:57:40.863601 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f199b262-c172-470a-b281-eb4b96169ff9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:40.864158 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f199b262-c172-470a-b281-eb4b96169ff9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:40.914182 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f199b262-c172-470a-b281-eb4b96169ff9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/77cab7ed-5f36-44be-8700-82f38c90fe27" status: 200 len: 265 microversion: 2.1 time: 0.072474 Jun 20 11:57:40.915463 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 230/478] 10.222.0.27 () {58 vars in 1262 bytes} [Mon Jun 20 11:57:40 2022] GET /compute/v2.1/os-server-groups/77cab7ed-5f36-44be-8700-82f38c90fe27 => generated 265 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:57:40.933982 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0507b1e8-c8da-4c76-bcec-82a8b510d82f tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:40.936465 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0507b1e8-c8da-4c76-bcec-82a8b510d82f tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 1cab587f-a3f7-4c56-8645-3ff752168244] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:40.961884 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0507b1e8-c8da-4c76-bcec-82a8b510d82f tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:40.962556 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0507b1e8-c8da-4c76-bcec-82a8b510d82f tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:40.963419 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0507b1e8-c8da-4c76-bcec-82a8b510d82f tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:40.970686 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0507b1e8-c8da-4c76-bcec-82a8b510d82f tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:41.247898 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0507b1e8-c8da-4c76-bcec-82a8b510d82f tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f069018a1fc24a9fbaac9b58ee7b07fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fc528349c34afbace41593b93d169a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:41.280139 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0507b1e8-c8da-4c76-bcec-82a8b510d82f tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244" status: 200 len: 1322 microversion: 2.1 time: 0.356643 Jun 20 11:57:41.286906 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 231/479] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:40 2022] GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244 => generated 1322 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:41.643389 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c50c5e57-41be-49d5-ba05-11ff0d4cf15f tempest-DeleteServersAdminTestJSON-1168729359 tempest-DeleteServersAdminTestJSON-1168729359-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:41.645686 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c50c5e57-41be-49d5-ba05-11ff0d4cf15f tempest-DeleteServersAdminTestJSON-1168729359 tempest-DeleteServersAdminTestJSON-1168729359-project-admin] [instance: b7973338-9aa7-497a-8036-d7a2a0f750a4] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:41.658634 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c50c5e57-41be-49d5-ba05-11ff0d4cf15f tempest-DeleteServersAdminTestJSON-1168729359 tempest-DeleteServersAdminTestJSON-1168729359-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:41.659498 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c50c5e57-41be-49d5-ba05-11ff0d4cf15f tempest-DeleteServersAdminTestJSON-1168729359 tempest-DeleteServersAdminTestJSON-1168729359-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:41.662383 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c50c5e57-41be-49d5-ba05-11ff0d4cf15f tempest-DeleteServersAdminTestJSON-1168729359 tempest-DeleteServersAdminTestJSON-1168729359-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:41.663105 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c50c5e57-41be-49d5-ba05-11ff0d4cf15f tempest-DeleteServersAdminTestJSON-1168729359 tempest-DeleteServersAdminTestJSON-1168729359-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:41.760623 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c50c5e57-41be-49d5-ba05-11ff0d4cf15f tempest-DeleteServersAdminTestJSON-1168729359 tempest-DeleteServersAdminTestJSON-1168729359-project-admin] [instance: b7973338-9aa7-497a-8036-d7a2a0f750a4] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 11:57:42.034784 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c50c5e57-41be-49d5-ba05-11ff0d4cf15f tempest-DeleteServersAdminTestJSON-1168729359 tempest-DeleteServersAdminTestJSON-1168729359-project-admin] 10.222.0.27 "DELETE /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4" status: 204 len: 0 microversion: 2.1 time: 0.745042 Jun 20 11:57:42.035668 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 232/480] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 11:57:41 2022] DELETE /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4 => generated 0 bytes in 748 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:57:42.145234 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5ea8694d-565a-4721-9e6e-b6ef9c43fe97 tempest-ServersWithSpecificFlavorTestJSON-1780513578 tempest-ServersWithSpecificFlavorTestJSON-1780513578-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-887693474", "id": 982151523, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:42.147324 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:57:42.147324 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:57:42.251168 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5ea8694d-565a-4721-9e6e-b6ef9c43fe97 tempest-ServersWithSpecificFlavorTestJSON-1780513578 tempest-ServersWithSpecificFlavorTestJSON-1780513578-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.213853 Jun 20 11:57:42.252221 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 233/481] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:57:42 2022] POST /compute/v2.1/flavors => generated 421 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:57:42.264314 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c7f0f806-c05a-4893-945f-b0e8de0d064a tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:42.265832 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c7f0f806-c05a-4893-945f-b0e8de0d064a tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] [instance: 097ee17d-f450-475a-8f33-fe596f6d98a0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:42.273878 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c7f0f806-c05a-4893-945f-b0e8de0d064a tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:42.274777 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c7f0f806-c05a-4893-945f-b0e8de0d064a tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:42.275934 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c7f0f806-c05a-4893-945f-b0e8de0d064a tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:42.276602 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c7f0f806-c05a-4893-945f-b0e8de0d064a tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:42.919022 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c7f0f806-c05a-4893-945f-b0e8de0d064a tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0" status: 200 len: 1618 microversion: 2.1 time: 0.664830 Jun 20 11:57:42.920081 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 234/482] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:42 2022] GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0 => generated 1618 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:42.936291 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-70945a8d-97ea-4bd3-84af-10ed02f4a9e1 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:42.936868 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-70945a8d-97ea-4bd3-84af-10ed02f4a9e1 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f9361b90-1c71-4bf4-b694-483cab19b1b8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:42.955997 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-70945a8d-97ea-4bd3-84af-10ed02f4a9e1 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:42.956483 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-70945a8d-97ea-4bd3-84af-10ed02f4a9e1 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:42.957298 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-70945a8d-97ea-4bd3-84af-10ed02f4a9e1 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:42.957800 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-70945a8d-97ea-4bd3-84af-10ed02f4a9e1 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:43.834900 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-70945a8d-97ea-4bd3-84af-10ed02f4a9e1 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:43.855533 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-70945a8d-97ea-4bd3-84af-10ed02f4a9e1 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8" status: 200 len: 1466 microversion: 2.1 time: 0.919143 Jun 20 11:57:43.863804 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 235/483] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:42 2022] GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8 => generated 1466 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:43.889817 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-959b1c63-58a0-4183-9f7c-254cdabfee95 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:43.890330 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-959b1c63-58a0-4183-9f7c-254cdabfee95 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: b7973338-9aa7-497a-8036-d7a2a0f750a4] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:43.914051 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-959b1c63-58a0-4183-9f7c-254cdabfee95 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:43.914515 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-959b1c63-58a0-4183-9f7c-254cdabfee95 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:43.915438 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-959b1c63-58a0-4183-9f7c-254cdabfee95 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:43.916594 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-959b1c63-58a0-4183-9f7c-254cdabfee95 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:45.026566 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-959b1c63-58a0-4183-9f7c-254cdabfee95 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374ef56db0ba42a1a3b0ac12aa172b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8964bee8790c43ccb896f404015dcdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:45.038716 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-959b1c63-58a0-4183-9f7c-254cdabfee95 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] 10.222.0.27 "GET /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4" status: 200 len: 1476 microversion: 2.1 time: 1.173639 Jun 20 11:57:45.051117 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 236/484] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:43 2022] GET /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4 => generated 1476 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:45.057356 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a2c6bc3d-bc06-4a5d-bd58-2b9d6f17463b tempest-ServersWithSpecificFlavorTestJSON-1780513578 tempest-ServersWithSpecificFlavorTestJSON-1780513578-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:45.073983 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a2c6bc3d-bc06-4a5d-bd58-2b9d6f17463b tempest-ServersWithSpecificFlavorTestJSON-1780513578 tempest-ServersWithSpecificFlavorTestJSON-1780513578-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.021323 Jun 20 11:57:45.077366 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 237/485] 10.222.0.27 () {58 vars in 1181 bytes} [Mon Jun 20 11:57:45 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 11:57:45.091768 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-99e8db7b-77cc-4094-9a4b-4b8dce6d3fd8 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:45.092870 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-99e8db7b-77cc-4094-9a4b-4b8dce6d3fd8 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 1cab587f-a3f7-4c56-8645-3ff752168244] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:45.114077 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-99e8db7b-77cc-4094-9a4b-4b8dce6d3fd8 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:45.115300 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-99e8db7b-77cc-4094-9a4b-4b8dce6d3fd8 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:45.116545 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-99e8db7b-77cc-4094-9a4b-4b8dce6d3fd8 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:45.121088 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-99e8db7b-77cc-4094-9a4b-4b8dce6d3fd8 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:45.700754 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-99e8db7b-77cc-4094-9a4b-4b8dce6d3fd8 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f069018a1fc24a9fbaac9b58ee7b07fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fc528349c34afbace41593b93d169a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:45.725878 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-99e8db7b-77cc-4094-9a4b-4b8dce6d3fd8 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244" status: 200 len: 1322 microversion: 2.1 time: 0.647009 Jun 20 11:57:45.726500 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 238/486] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:45 2022] GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244 => generated 1322 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:45.736268 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-91db3f9f-72c2-4ca1-a838-c07242a7fc75 tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:45.736870 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-91db3f9f-72c2-4ca1-a838-c07242a7fc75 tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] [instance: 5156dcdb-2590-41b9-8b02-3f04c5c4acf7] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:45.762599 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91db3f9f-72c2-4ca1-a838-c07242a7fc75 tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:45.763080 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91db3f9f-72c2-4ca1-a838-c07242a7fc75 tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:45.763917 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91db3f9f-72c2-4ca1-a838-c07242a7fc75 tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:45.764388 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91db3f9f-72c2-4ca1-a838-c07242a7fc75 tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:46.484606 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-34de7f5b-4350-462a-996e-2d8f25a1a55a tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f/action" status: 202 len: 0 microversion: 2.25 time: 7.882434 Jun 20 11:57:46.487082 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 249/487] 10.222.0.27 () {62 vars in 1318 bytes} [Mon Jun 20 11:57:38 2022] POST /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f/action => generated 0 bytes in 7886 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 20 11:57:46.494662 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-08dc9eda-929c-479d-a7cf-1eb4149f3f84 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:46.498685 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-08dc9eda-929c-479d-a7cf-1eb4149f3f84 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f9361b90-1c71-4bf4-b694-483cab19b1b8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:46.523894 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-08dc9eda-929c-479d-a7cf-1eb4149f3f84 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:46.525036 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-08dc9eda-929c-479d-a7cf-1eb4149f3f84 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:46.527143 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-08dc9eda-929c-479d-a7cf-1eb4149f3f84 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:46.529634 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-08dc9eda-929c-479d-a7cf-1eb4149f3f84 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:46.569025 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-08dc9eda-929c-479d-a7cf-1eb4149f3f84 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] HTTP exception thrown: Instance f9361b90-1c71-4bf4-b694-483cab19b1b8 could not be found. Jun 20 11:57:46.572985 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-08dc9eda-929c-479d-a7cf-1eb4149f3f84 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Request method failure captured: Jun 20 11:57:46.572985 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8 HTTP/1.1 Jun 20 11:57:46.572985 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:57:46.572985 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:57:46.572985 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:57:46.572985 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 11:57:46.572985 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:57:46.572985 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:57:46.572985 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:57:46.572985 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:57:46.572985 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGBqVQBWTHbybYvaXBM2JYGVR5je0i_sq6z4yKfDCbeDnggYO_bsx2mgrGR6ZtOtDqQrC-55q793HMOaoIckCLwoJnCtDjgDbhB3MSLYFAUVrmy2QpsfznKnJh5JiYRasYD_6mxS_sBMgGApmvfskvqut97O1iE_j5CGjrwlsTFxAoI Jun 20 11:57:46.572985 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:57:46.572985 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:57:46.572985 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:57:46.572985 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:57:46.572985 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:57:46.572985 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:57:46.572985 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: c4bfbc9c01ee408fbfe777ae4ad19fbf Jun 20 11:57:46.572985 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-LiveMigrationNegativeTest-54019274 Jun 20 11:57:46.572985 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 11:57:46.572985 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 11:57:46.574332 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c4bfbc9c01ee408fbfe777ae4ad19fbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c4bfbc9c01ee408fbfe777ae4ad19fbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c4bfbc9c01ee408fbfe777ae4ad19fbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c4bfbc9c01ee408fbfe777ae4ad19fbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:57:46.574332 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-LiveMigrationNegativeTest-54019274 Jun 20 11:57:46.574332 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: c4bfbc9c01ee408fbfe777ae4ad19fbf Jun 20 11:57:46.574332 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-54019274 Jun 20 11:57:46.574332 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-LiveMigrationNegativeTest-54019274-project Jun 20 11:57:46.574332 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:57:46.574332 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:57:46.574332 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 3b1f420e75854a9f81f27ab6b1e718b2 Jun 20 11:57:46.574332 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-LiveMigrationNegativeTest-54019274-project Jun 20 11:57:46.574332 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 11:57:46.574332 n-d-master-1 devstack@n-api.service[119128]: exception: Instance f9361b90-1c71-4bf4-b694-483cab19b1b8 could not be found. Jun 20 11:57:46.574332 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'f9361b90-1c71-4bf4-b694-483cab19b1b8'} Jun 20 11:57:46.575039 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:57:46.575039 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:46.575039 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:57:46.575039 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:57:46.575039 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:57:46.575039 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:57:46.575039 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:57:46.575039 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:57:46.575039 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:57:46.575039 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:57:46.575039 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9361b90-1c71-4bf4-b694-483cab19b1b8 could not be found. Jun 20 11:57:46.575039 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:46.575039 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:57:46.575039 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:46.575039 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:46.575039 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:57:46.575039 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:57:46.575039 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:57:46.575039 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:57:46.575039 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:57:46.576395 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:57:46.576395 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:57:46.576395 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:57:46.576395 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:57:46.576395 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:57:46.576395 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:57:46.576395 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:57:46.576395 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9361b90-1c71-4bf4-b694-483cab19b1b8 could not be found. Jun 20 11:57:46.576395 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:46.576395 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:57:46.576395 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:46.576395 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:46.576395 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:57:46.576395 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:57:46.576395 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:57:46.576395 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:57:46.576395 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9361b90-1c71-4bf4-b694-483cab19b1b8 could not be found. Jun 20 11:57:46.576395 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:46.586349 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-08dc9eda-929c-479d-a7cf-1eb4149f3f84 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Returning 404 to user: Instance f9361b90-1c71-4bf4-b694-483cab19b1b8 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:57:46.587635 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-08dc9eda-929c-479d-a7cf-1eb4149f3f84 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8" status: 404 len: 111 microversion: 2.1 time: 0.099357 Jun 20 11:57:46.588815 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 250/488] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:46 2022] GET /compute/v2.1/servers/f9361b90-1c71-4bf4-b694-483cab19b1b8 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:57:46.606520 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6e0c032d-6752-42b4-b384-136cbf28b7e3 tempest-ServersWithSpecificFlavorTestJSON-1780513578 tempest-ServersWithSpecificFlavorTestJSON-1780513578-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1947470973", "id": 1311349000, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:46.610200 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:57:46.610200 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:57:46.643355 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6e0c032d-6752-42b4-b384-136cbf28b7e3 tempest-ServersWithSpecificFlavorTestJSON-1780513578 tempest-ServersWithSpecificFlavorTestJSON-1780513578-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.053067 Jun 20 11:57:46.649493 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 251/489] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:57:46 2022] POST /compute/v2.1/flavors => generated 425 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:57:46.650443 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-91db3f9f-72c2-4ca1-a838-c07242a7fc75 tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/5156dcdb-2590-41b9-8b02-3f04c5c4acf7" status: 200 len: 1617 microversion: 2.1 time: 0.922069 Jun 20 11:57:46.663296 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 239/490] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:45 2022] GET /compute/v2.1/servers/5156dcdb-2590-41b9-8b02-3f04c5c4acf7 => generated 1617 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:46.666454 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-2ac66df9-0164-4dd9-ae15-3e99752e3592 req-1cb558d2-2050-4970-9628-95fc650870a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9361b90-1c71-4bf4-b694-483cab19b1b8", "name": "network-vif-deleted", "tag": "bed1d701-63b1-4626-9a02-786ef021ecb7"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:46.668097 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-33810f13-884c-4dc2-8d58-a0b9ae342f72 req-c69bc9a4-9414-490b-90c2-243361d59a72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7973338-9aa7-497a-8036-d7a2a0f750a4", "name": "network-vif-deleted", "tag": "78be856f-abe5-4eae-9efd-e00f6fe411b0"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:46.678535 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-2ac66df9-0164-4dd9-ae15-3e99752e3592 req-1cb558d2-2050-4970-9628-95fc650870a2 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:46.679610 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-2ac66df9-0164-4dd9-ae15-3e99752e3592 req-1cb558d2-2050-4970-9628-95fc650870a2 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:46.690929 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-33810f13-884c-4dc2-8d58-a0b9ae342f72 req-c69bc9a4-9414-490b-90c2-243361d59a72 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:46.696848 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-33810f13-884c-4dc2-8d58-a0b9ae342f72 req-c69bc9a4-9414-490b-90c2-243361d59a72 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:46.703095 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-2ac66df9-0164-4dd9-ae15-3e99752e3592 req-1cb558d2-2050-4970-9628-95fc650870a2 service nova] Creating event network-vif-deleted:bed1d701-63b1-4626-9a02-786ef021ecb7 for instance f9361b90-1c71-4bf4-b694-483cab19b1b8 on n-h2-master-1 Jun 20 11:57:46.717384 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-2ac66df9-0164-4dd9-ae15-3e99752e3592 req-1cb558d2-2050-4970-9628-95fc650870a2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066261 Jun 20 11:57:46.721535 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 252/491] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:57:46.728568 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-33810f13-884c-4dc2-8d58-a0b9ae342f72 req-c69bc9a4-9414-490b-90c2-243361d59a72 service nova] Creating event network-vif-deleted:78be856f-abe5-4eae-9efd-e00f6fe411b0 for instance b7973338-9aa7-497a-8036-d7a2a0f750a4 on n-h1-master-1 Jun 20 11:57:46.734402 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-924e74e5-854a-47eb-af5a-8142cb37a9b9 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:46.736027 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-924e74e5-854a-47eb-af5a-8142cb37a9b9 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: b7973338-9aa7-497a-8036-d7a2a0f750a4] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:46.738042 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-33810f13-884c-4dc2-8d58-a0b9ae342f72 req-c69bc9a4-9414-490b-90c2-243361d59a72 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083318 Jun 20 11:57:46.741112 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 240/492] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:57:46.757215 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-924e74e5-854a-47eb-af5a-8142cb37a9b9 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:46.757770 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-924e74e5-854a-47eb-af5a-8142cb37a9b9 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:46.757917 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fea3344b-cdf5-45ff-91c1-e095f3930cc8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:46.758795 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fea3344b-cdf5-45ff-91c1-e095f3930cc8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:46.759454 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-924e74e5-854a-47eb-af5a-8142cb37a9b9 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:46.761448 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-924e74e5-854a-47eb-af5a-8142cb37a9b9 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:46.775171 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fea3344b-cdf5-45ff-91c1-e095f3930cc8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:46.777110 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fea3344b-cdf5-45ff-91c1-e095f3930cc8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:46.778753 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fea3344b-cdf5-45ff-91c1-e095f3930cc8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:46.780794 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fea3344b-cdf5-45ff-91c1-e095f3930cc8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:46.868181 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-924e74e5-854a-47eb-af5a-8142cb37a9b9 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:46.868943 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-924e74e5-854a-47eb-af5a-8142cb37a9b9 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:46.869550 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-924e74e5-854a-47eb-af5a-8142cb37a9b9 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lazy-loading 'fault' on Instance uuid b7973338-9aa7-497a-8036-d7a2a0f750a4 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:57:46.999862 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-924e74e5-854a-47eb-af5a-8142cb37a9b9 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374ef56db0ba42a1a3b0ac12aa172b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8964bee8790c43ccb896f404015dcdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:47.030507 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-924e74e5-854a-47eb-af5a-8142cb37a9b9 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] 10.222.0.27 "GET /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4" status: 200 len: 1310 microversion: 2.1 time: 0.307270 Jun 20 11:57:47.031625 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 253/493] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:46 2022] GET /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4 => generated 1310 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:47.039222 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-277b7f86-2587-4e59-9ddf-c63334bd41a8 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:47.040110 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-277b7f86-2587-4e59-9ddf-c63334bd41a8 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f75be1cf-4d20-4ea9-bcbb-b407892a39ee] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:47.049384 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-277b7f86-2587-4e59-9ddf-c63334bd41a8 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:47.050570 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-277b7f86-2587-4e59-9ddf-c63334bd41a8 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:47.052752 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-277b7f86-2587-4e59-9ddf-c63334bd41a8 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:47.054048 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-277b7f86-2587-4e59-9ddf-c63334bd41a8 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:47.096570 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-277b7f86-2587-4e59-9ddf-c63334bd41a8 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f75be1cf-4d20-4ea9-bcbb-b407892a39ee] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 11:57:47.147650 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fea3344b-cdf5-45ff-91c1-e095f3930cc8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:47.159124 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fea3344b-cdf5-45ff-91c1-e095f3930cc8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:47.160677 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fea3344b-cdf5-45ff-91c1-e095f3930cc8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:47.161869 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fea3344b-cdf5-45ff-91c1-e095f3930cc8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f" status: 200 len: 1567 microversion: 2.25 time: 0.419031 Jun 20 11:57:47.177032 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 241/494] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:57:46 2022] GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f => generated 1567 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:57:47.180705 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:57:47.194285 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b6c679c6-4d15-4ff7-b202-27e660c9b245 tempest-ServersWithSpecificFlavorTestJSON-1780513578 tempest-ServersWithSpecificFlavorTestJSON-1780513578-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:47.203685 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b6c679c6-4d15-4ff7-b202-27e660c9b245 tempest-ServersWithSpecificFlavorTestJSON-1780513578 tempest-ServersWithSpecificFlavorTestJSON-1780513578-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.014570 Jun 20 11:57:47.204295 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 242/495] 10.222.0.27 () {58 vars in 1181 bytes} [Mon Jun 20 11:57:47 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 11:57:47.224060 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ba9c4809-267a-4e20-bc7b-f652095ba0bf tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Action: 'create', calling method: .version_select at 0x7f6073bc21f0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1908191184", "policies": ["anti-affinity"]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:47.233138 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-277b7f86-2587-4e59-9ddf-c63334bd41a8 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee" status: 204 len: 0 microversion: 2.1 time: 0.198652 Jun 20 11:57:47.239066 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 254/496] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 11:57:47 2022] DELETE /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:57:47.251588 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-66815499-5217-4247-a56b-89c7e910e70c tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:47.253089 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-66815499-5217-4247-a56b-89c7e910e70c tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 1cab587f-a3f7-4c56-8645-3ff752168244] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:47.262222 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-66815499-5217-4247-a56b-89c7e910e70c tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:47.262709 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-ba9c4809-267a-4e20-bc7b-f652095ba0bf tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Getting quotas for project a6150795e7424cca91c71531840d88be. Resources: {'server_groups'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:57:47.263819 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-66815499-5217-4247-a56b-89c7e910e70c tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:47.265479 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-66815499-5217-4247-a56b-89c7e910e70c tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:47.266471 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-66815499-5217-4247-a56b-89c7e910e70c tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:47.268278 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-ba9c4809-267a-4e20-bc7b-f652095ba0bf tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Getting quotas for user 1297c1b206f845bcaf936313fd7eed9b and project a6150795e7424cca91c71531840d88be. Resources: {'server_groups'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:57:47.360961 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-ba9c4809-267a-4e20-bc7b-f652095ba0bf tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Getting quotas for project a6150795e7424cca91c71531840d88be. Resources: {'server_groups'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:57:47.371297 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-ba9c4809-267a-4e20-bc7b-f652095ba0bf tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Getting quotas for user 1297c1b206f845bcaf936313fd7eed9b and project a6150795e7424cca91c71531840d88be. Resources: {'server_groups'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:57:47.404445 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ba9c4809-267a-4e20-bc7b-f652095ba0bf tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.183758 Jun 20 11:57:47.406057 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 243/497] 10.222.0.27 () {60 vars in 1173 bytes} [Mon Jun 20 11:57:47 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:57:47.411708 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d698123e-53e8-479e-8ef1-3f5c05304f18 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Action: 'create', calling method: .version_select at 0x7f6073fb7dc0>, body: {"keypair": {"name": "tempest-keypair-830207600", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5R+niTuqvms+CGFHuNbxUoAQntsIkAzjjuhS6ygwhBDjX1Yu0Ag8yThKS2gLenBf7B2CAUrnU0eiHsezEHXJhjgmrputXwbAYrrWTrHbwrmYVI9x1EoHF9AuT83ewJYQ=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:47.459148 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-d698123e-53e8-479e-8ef1-3f5c05304f18 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Getting quotas for project d8790cc26204435aaf4071847ee00288. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:57:47.482569 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-d698123e-53e8-479e-8ef1-3f5c05304f18 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Getting quotas for user f5f49b57013f4675a70bac9b13e0a229 and project d8790cc26204435aaf4071847ee00288. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:57:47.564781 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d698123e-53e8-479e-8ef1-3f5c05304f18 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.157142 Jun 20 11:57:47.565858 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 244/498] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 11:57:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:57:47.574417 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-75621add-e9e8-473d-9df2-9aadf52f1ba4 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:47.577349 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-75621add-e9e8-473d-9df2-9aadf52f1ba4 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f75be1cf-4d20-4ea9-bcbb-b407892a39ee] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:47.591222 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-75621add-e9e8-473d-9df2-9aadf52f1ba4 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:47.591862 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-75621add-e9e8-473d-9df2-9aadf52f1ba4 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:47.594306 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-75621add-e9e8-473d-9df2-9aadf52f1ba4 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:47.594811 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-75621add-e9e8-473d-9df2-9aadf52f1ba4 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:47.641414 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-66815499-5217-4247-a56b-89c7e910e70c tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f069018a1fc24a9fbaac9b58ee7b07fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fc528349c34afbace41593b93d169a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:47.653856 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-66815499-5217-4247-a56b-89c7e910e70c tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244" status: 200 len: 1322 microversion: 2.1 time: 0.410716 Jun 20 11:57:47.654511 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 255/499] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:47 2022] GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244 => generated 1322 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:47.678442 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f0f2d3ac-ac88-466f-bcf7-f0ddbc62d385 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1141639844", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "bfbb54d0-ba33-4556-8511-9ce0bdc7ca52"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:47.780722 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-f0f2d3ac-ac88-466f-bcf7-f0ddbc62d385 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] validate_networks() for None {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:57:47.947209 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-75621add-e9e8-473d-9df2-9aadf52f1ba4 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:47.961312 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-75621add-e9e8-473d-9df2-9aadf52f1ba4 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee" status: 200 len: 1474 microversion: 2.1 time: 0.393984 Jun 20 11:57:47.962519 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 245/500] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:47 2022] GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee => generated 1474 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:47.971450 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-23595a43-0b19-4f65-a4ec-e2bc39e34fce req-2bf07159-63df-463c-ad39-b15a6b2a40c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cab587f-a3f7-4c56-8645-3ff752168244", "name": "network-vif-plugged", "status": "completed", "tag": "4c34624e-8618-4536-b887-d13e05a1b590"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:47.982287 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-23595a43-0b19-4f65-a4ec-e2bc39e34fce req-2bf07159-63df-463c-ad39-b15a6b2a40c8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:47.983173 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-23595a43-0b19-4f65-a4ec-e2bc39e34fce req-2bf07159-63df-463c-ad39-b15a6b2a40c8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:47.997808 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-23595a43-0b19-4f65-a4ec-e2bc39e34fce req-2bf07159-63df-463c-ad39-b15a6b2a40c8 service nova] Creating event network-vif-plugged:4c34624e-8618-4536-b887-d13e05a1b590 for instance 1cab587f-a3f7-4c56-8645-3ff752168244 on n-h2-master-1 Jun 20 11:57:48.013007 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-23595a43-0b19-4f65-a4ec-e2bc39e34fce req-2bf07159-63df-463c-ad39-b15a6b2a40c8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048800 Jun 20 11:57:48.014348 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 246/501] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:57:48.050711 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-13bcb278-0996-4779-97f1-e24a474cfaed tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:48.051928 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-13bcb278-0996-4779-97f1-e24a474cfaed tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: b7973338-9aa7-497a-8036-d7a2a0f750a4] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:48.060359 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-13bcb278-0996-4779-97f1-e24a474cfaed tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:48.061212 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-13bcb278-0996-4779-97f1-e24a474cfaed tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:48.062263 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-13bcb278-0996-4779-97f1-e24a474cfaed tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:48.062891 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-13bcb278-0996-4779-97f1-e24a474cfaed tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:48.085225 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-13bcb278-0996-4779-97f1-e24a474cfaed tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] HTTP exception thrown: Instance b7973338-9aa7-497a-8036-d7a2a0f750a4 could not be found. Jun 20 11:57:48.086940 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-13bcb278-0996-4779-97f1-e24a474cfaed tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Request method failure captured: Jun 20 11:57:48.086940 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4 HTTP/1.1 Jun 20 11:57:48.086940 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:57:48.086940 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:57:48.086940 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:57:48.086940 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 11:57:48.086940 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:57:48.086940 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:57:48.086940 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:57:48.086940 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:57:48.086940 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGCVZrbjAouTpF4CO5xNLPnI1lpqfAfo09SiD_IKfTBaB5ORp-KnTjFxG4AdKZcvqp22ZbNZzcEGjV6YjB90nql2h9MiyhOcafW36k4Hpj4mrGqAs7HvsL06wbmVtKSgulBi1Xiu77Tz08vfjjK85sqDvhgnIQUSWsn1zwxX7PaWDrc Jun 20 11:57:48.086940 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:57:48.086940 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:57:48.086940 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:57:48.086940 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:57:48.086940 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:57:48.086940 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:57:48.086940 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 8964bee8790c43ccb896f404015dcdd6 Jun 20 11:57:48.086940 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1169340897 Jun 20 11:57:48.086940 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 11:57:48.086940 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 11:57:48.088365 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8964bee8790c43ccb896f404015dcdd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8964bee8790c43ccb896f404015dcdd6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8964bee8790c43ccb896f404015dcdd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8964bee8790c43ccb896f404015dcdd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:57:48.088365 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-DeleteServersAdminTestJSON-1169340897 Jun 20 11:57:48.088365 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 8964bee8790c43ccb896f404015dcdd6 Jun 20 11:57:48.088365 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1169340897 Jun 20 11:57:48.088365 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-DeleteServersAdminTestJSON-1169340897-project Jun 20 11:57:48.088365 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:57:48.088365 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:57:48.088365 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 374ef56db0ba42a1a3b0ac12aa172b56 Jun 20 11:57:48.088365 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-DeleteServersAdminTestJSON-1169340897-project Jun 20 11:57:48.088365 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 11:57:48.088365 n-d-master-1 devstack@n-api.service[119127]: exception: Instance b7973338-9aa7-497a-8036-d7a2a0f750a4 could not be found. Jun 20 11:57:48.088365 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'b7973338-9aa7-497a-8036-d7a2a0f750a4'} Jun 20 11:57:48.089093 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:57:48.089093 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:48.089093 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:57:48.089093 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:57:48.089093 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:57:48.089093 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:57:48.089093 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:57:48.089093 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:57:48.089093 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:57:48.089093 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:57:48.089093 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7973338-9aa7-497a-8036-d7a2a0f750a4 could not be found. Jun 20 11:57:48.089093 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:57:48.089093 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:57:48.089093 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:57:48.089093 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:48.089093 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:57:48.089093 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:57:48.089093 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:57:48.089093 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:57:48.089093 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:57:48.090214 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:57:48.090214 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:57:48.090214 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:57:48.090214 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:57:48.090214 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:57:48.090214 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:57:48.090214 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:57:48.090214 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7973338-9aa7-497a-8036-d7a2a0f750a4 could not be found. Jun 20 11:57:48.090214 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:57:48.090214 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:57:48.090214 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:57:48.090214 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:48.090214 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:57:48.090214 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:57:48.090214 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:57:48.090214 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:57:48.090214 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7973338-9aa7-497a-8036-d7a2a0f750a4 could not be found. Jun 20 11:57:48.090214 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:57:48.097260 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-13bcb278-0996-4779-97f1-e24a474cfaed tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Returning 404 to user: Instance b7973338-9aa7-497a-8036-d7a2a0f750a4 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:57:48.097260 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-13bcb278-0996-4779-97f1-e24a474cfaed tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] 10.222.0.27 "GET /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4" status: 404 len: 111 microversion: 2.1 time: 0.043392 Jun 20 11:57:48.097260 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 247/502] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:48 2022] GET /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:57:48.196189 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c79c8e98-739d-4683-b814-9a9df1ed1ff6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:48.208451 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c79c8e98-739d-4683-b814-9a9df1ed1ff6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:48.221081 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c79c8e98-739d-4683-b814-9a9df1ed1ff6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:48.224454 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c79c8e98-739d-4683-b814-9a9df1ed1ff6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:48.227344 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c79c8e98-739d-4683-b814-9a9df1ed1ff6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:48.227885 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c79c8e98-739d-4683-b814-9a9df1ed1ff6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:48.259693 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:57:48.427862 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c79c8e98-739d-4683-b814-9a9df1ed1ff6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:48.444122 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c79c8e98-739d-4683-b814-9a9df1ed1ff6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:48.445700 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c79c8e98-739d-4683-b814-9a9df1ed1ff6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:48.446957 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c79c8e98-739d-4683-b814-9a9df1ed1ff6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f" status: 200 len: 1567 microversion: 2.25 time: 0.254959 Jun 20 11:57:48.448500 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 248/503] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:57:48 2022] GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f => generated 1567 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:57:48.461924 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-acd3d2ce-b5a3-45a2-a165-798395c3b398 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-321848316", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:48.469377 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:57:48.555418 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=12 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:57:48.579101 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-acd3d2ce-b5a3-45a2-a165-798395c3b398 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] validate_networks() for None {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:57:49.022766 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-f0f2d3ac-ac88-466f-bcf7-f0ddbc62d385 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:57:49.024372 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-f0f2d3ac-ac88-466f-bcf7-f0ddbc62d385 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:57:49.025405 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-f0f2d3ac-ac88-466f-bcf7-f0ddbc62d385 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:57:49.026003 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-f0f2d3ac-ac88-466f-bcf7-f0ddbc62d385 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:57:49.026587 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-f0f2d3ac-ac88-466f-bcf7-f0ddbc62d385 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:57:49.092731 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f0f2d3ac-ac88-466f-bcf7-f0ddbc62d385 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:49.094339 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f0f2d3ac-ac88-466f-bcf7-f0ddbc62d385 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:49.097848 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f0f2d3ac-ac88-466f-bcf7-f0ddbc62d385 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:49.100016 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f0f2d3ac-ac88-466f-bcf7-f0ddbc62d385 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:49.150876 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-f0f2d3ac-ac88-466f-bcf7-f0ddbc62d385 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Getting quotas for project a6150795e7424cca91c71531840d88be. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:57:49.164916 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=8 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:57:49.172045 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-f0f2d3ac-ac88-466f-bcf7-f0ddbc62d385 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Getting quotas for user 1297c1b206f845bcaf936313fd7eed9b and project a6150795e7424cca91c71531840d88be. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:57:49.212002 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f0f2d3ac-ac88-466f-bcf7-f0ddbc62d385 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Going to run 2 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:57:49.214551 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f0f2d3ac-ac88-466f-bcf7-f0ddbc62d385 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: a20958a4-d7af-4e1b-bb62-823c89c60073] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:57:49.313615 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-acd3d2ce-b5a3-45a2-a165-798395c3b398 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:57:49.314879 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-acd3d2ce-b5a3-45a2-a165-798395c3b398 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:57:49.315443 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-acd3d2ce-b5a3-45a2-a165-798395c3b398 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:57:49.315897 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-acd3d2ce-b5a3-45a2-a165-798395c3b398 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:57:49.316388 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-acd3d2ce-b5a3-45a2-a165-798395c3b398 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:57:49.324171 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-f0f2d3ac-ac88-466f-bcf7-f0ddbc62d385 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119128) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jun 20 11:57:49.333693 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-acd3d2ce-b5a3-45a2-a165-798395c3b398 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:49.336747 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-acd3d2ce-b5a3-45a2-a165-798395c3b398 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:49.339047 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-acd3d2ce-b5a3-45a2-a165-798395c3b398 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:49.340742 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-acd3d2ce-b5a3-45a2-a165-798395c3b398 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:49.366963 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-f0f2d3ac-ac88-466f-bcf7-f0ddbc62d385 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Getting quotas for project a6150795e7424cca91c71531840d88be. Resources: {'server_group_members'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:57:49.373114 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-f0f2d3ac-ac88-466f-bcf7-f0ddbc62d385 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Getting quotas for user 1297c1b206f845bcaf936313fd7eed9b and project a6150795e7424cca91c71531840d88be. Resources: {'server_group_members'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:57:49.394671 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-acd3d2ce-b5a3-45a2-a165-798395c3b398 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Getting quotas for project 8964bee8790c43ccb896f404015dcdd6. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:57:49.412458 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-acd3d2ce-b5a3-45a2-a165-798395c3b398 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Getting quotas for user 374ef56db0ba42a1a3b0ac12aa172b56 and project 8964bee8790c43ccb896f404015dcdd6. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:57:49.450601 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-f0f2d3ac-ac88-466f-bcf7-f0ddbc62d385 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Getting quotas for project a6150795e7424cca91c71531840d88be. Resources: {'server_group_members'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:57:49.451655 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-acd3d2ce-b5a3-45a2-a165-798395c3b398 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:57:49.463024 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-acd3d2ce-b5a3-45a2-a165-798395c3b398 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: ba20d661-74fb-4922-b931-67f76a29e1b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:57:49.479912 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-f0f2d3ac-ac88-466f-bcf7-f0ddbc62d385 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Getting quotas for user 1297c1b206f845bcaf936313fd7eed9b and project a6150795e7424cca91c71531840d88be. Resources: {'server_group_members'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:57:49.484106 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:57:49.514390 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f0f2d3ac-ac88-466f-bcf7-f0ddbc62d385 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 1a618cf4-fd96-4675-a17c-899544a65dcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=a20958a4-d7af-4e1b-bb62-823c89c60073,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:57:49.529751 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-acd3d2ce-b5a3-45a2-a165-798395c3b398 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.079895 Jun 20 11:57:49.530419 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 249/504] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:57:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1081 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 11:57:49.534964 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3bd4410d-6cb1-4026-8617-cc0662488c5e tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:49.535564 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3bd4410d-6cb1-4026-8617-cc0662488c5e tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 1cab587f-a3f7-4c56-8645-3ff752168244] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:49.561013 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3bd4410d-6cb1-4026-8617-cc0662488c5e tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:49.561751 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3bd4410d-6cb1-4026-8617-cc0662488c5e tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:49.562694 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3bd4410d-6cb1-4026-8617-cc0662488c5e tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:49.563285 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3bd4410d-6cb1-4026-8617-cc0662488c5e tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:49.651927 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-f0f2d3ac-ac88-466f-bcf7-f0ddbc62d385 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Getting quotas for project a6150795e7424cca91c71531840d88be. Resources: {'server_group_members'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:57:49.661962 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-f0f2d3ac-ac88-466f-bcf7-f0ddbc62d385 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Getting quotas for user 1297c1b206f845bcaf936313fd7eed9b and project a6150795e7424cca91c71531840d88be. Resources: {'server_group_members'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:57:49.768492 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-f0f2d3ac-ac88-466f-bcf7-f0ddbc62d385 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Getting quotas for project a6150795e7424cca91c71531840d88be. Resources: {'server_group_members'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:57:49.787764 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-f0f2d3ac-ac88-466f-bcf7-f0ddbc62d385 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Getting quotas for user 1297c1b206f845bcaf936313fd7eed9b and project a6150795e7424cca91c71531840d88be. Resources: {'server_group_members'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:57:49.859253 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3bd4410d-6cb1-4026-8617-cc0662488c5e tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f069018a1fc24a9fbaac9b58ee7b07fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fc528349c34afbace41593b93d169a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:49.872444 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3bd4410d-6cb1-4026-8617-cc0662488c5e tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244" status: 200 len: 1322 microversion: 2.1 time: 0.340872 Jun 20 11:57:49.874841 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 250/505] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:49 2022] GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244 => generated 1322 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:49.885294 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-50db56f3-0e54-4098-8693-50261571ab21 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:49.893649 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-50db56f3-0e54-4098-8693-50261571ab21 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f75be1cf-4d20-4ea9-bcbb-b407892a39ee] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:49.901247 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f0f2d3ac-ac88-466f-bcf7-f0ddbc62d385 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.225897 Jun 20 11:57:49.905819 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 256/506] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:57:47 2022] POST /compute/v2.1/servers => generated 32 bytes in 2234 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jun 20 11:57:49.920482 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-50db56f3-0e54-4098-8693-50261571ab21 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:49.922489 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-50db56f3-0e54-4098-8693-50261571ab21 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:49.923257 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a2a30445-7ca2-4fde-9f35-9ff406d85be6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:49.924553 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-50db56f3-0e54-4098-8693-50261571ab21 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:49.926041 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-50db56f3-0e54-4098-8693-50261571ab21 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:49.926311 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a2a30445-7ca2-4fde-9f35-9ff406d85be6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:49.971413 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a2a30445-7ca2-4fde-9f35-9ff406d85be6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:49.975014 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a2a30445-7ca2-4fde-9f35-9ff406d85be6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:49.979509 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a2a30445-7ca2-4fde-9f35-9ff406d85be6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:49.980977 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a2a30445-7ca2-4fde-9f35-9ff406d85be6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:50.252678 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a2a30445-7ca2-4fde-9f35-9ff406d85be6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:50.267379 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a2a30445-7ca2-4fde-9f35-9ff406d85be6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:50.273606 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a2a30445-7ca2-4fde-9f35-9ff406d85be6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:50.275453 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a2a30445-7ca2-4fde-9f35-9ff406d85be6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f" status: 200 len: 1567 microversion: 2.25 time: 0.368259 Jun 20 11:57:50.279397 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 257/507] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:57:49 2022] GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f => generated 1567 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:57:50.288118 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-aeece947-7845-4b76-a99e-d34c9eb5549a tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:50.288925 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-aeece947-7845-4b76-a99e-d34c9eb5549a tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: ba20d661-74fb-4922-b931-67f76a29e1b8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:50.468054 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-aeece947-7845-4b76-a99e-d34c9eb5549a tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374ef56db0ba42a1a3b0ac12aa172b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8964bee8790c43ccb896f404015dcdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:50.480707 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-aeece947-7845-4b76-a99e-d34c9eb5549a tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] 10.222.0.27 "GET /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8" status: 200 len: 1219 microversion: 2.1 time: 0.199717 Jun 20 11:57:50.481341 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 258/508] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:50 2022] GET /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8 => generated 1219 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:50.491125 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-03b7179d-1fe7-4766-983f-73c244ca0965 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:50.499514 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-03b7179d-1fe7-4766-983f-73c244ca0965 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:50.513959 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-03b7179d-1fe7-4766-983f-73c244ca0965 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Searching by: {'deleted': False, 'project_id': 'a6150795e7424cca91c71531840d88be'} {{(pid=119128) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 11:57:50.572932 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-03b7179d-1fe7-4766-983f-73c244ca0965 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:50.573523 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-03b7179d-1fe7-4766-983f-73c244ca0965 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:50.576764 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-03b7179d-1fe7-4766-983f-73c244ca0965 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:50.584367 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-03b7179d-1fe7-4766-983f-73c244ca0965 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:50.653373 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.multi_cell_list [None req-03b7179d-1fe7-4766-983f-73c244ca0965 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=119128) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 11:57:50.723281 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-03b7179d-1fe7-4766-983f-73c244ca0965 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1662 microversion: 2.1 time: 0.236769 Jun 20 11:57:50.728457 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 259/509] 10.222.0.27 () {58 vars in 1124 bytes} [Mon Jun 20 11:57:50 2022] GET /compute/v2.1/servers => generated 1662 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:50.748600 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ed900bd2-a669-495c-b6d5-fd69601e2d9f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:50.749723 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ed900bd2-a669-495c-b6d5-fd69601e2d9f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 1a618cf4-fd96-4675-a17c-899544a65dcf] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:50.932301 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-50db56f3-0e54-4098-8693-50261571ab21 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:50.951965 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-50db56f3-0e54-4098-8693-50261571ab21 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee" status: 200 len: 1474 microversion: 2.1 time: 1.066227 Jun 20 11:57:50.952897 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 251/510] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:49 2022] GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee => generated 1474 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:50.958265 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-db45ab8d-87ee-4361-9b40-570a309c5151 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:50.971018 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-db45ab8d-87ee-4361-9b40-570a309c5151 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 1cab587f-a3f7-4c56-8645-3ff752168244] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:50.993631 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-db45ab8d-87ee-4361-9b40-570a309c5151 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:50.994613 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-db45ab8d-87ee-4361-9b40-570a309c5151 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:50.997594 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-db45ab8d-87ee-4361-9b40-570a309c5151 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:51.000881 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-db45ab8d-87ee-4361-9b40-570a309c5151 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:51.222657 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ed900bd2-a669-495c-b6d5-fd69601e2d9f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:51.231879 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ed900bd2-a669-495c-b6d5-fd69601e2d9f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/1a618cf4-fd96-4675-a17c-899544a65dcf" status: 200 len: 1219 microversion: 2.1 time: 0.496023 Jun 20 11:57:51.235351 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 260/511] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:50 2022] GET /compute/v2.1/servers/1a618cf4-fd96-4675-a17c-899544a65dcf => generated 1219 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:51.301344 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-45423251-3614-4c20-a6bc-3c17137315f9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:51.302504 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-45423251-3614-4c20-a6bc-3c17137315f9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:51.320010 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-45423251-3614-4c20-a6bc-3c17137315f9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:51.320527 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-45423251-3614-4c20-a6bc-3c17137315f9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:51.321623 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-45423251-3614-4c20-a6bc-3c17137315f9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:51.322238 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-45423251-3614-4c20-a6bc-3c17137315f9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:52.001951 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-45423251-3614-4c20-a6bc-3c17137315f9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:52.032300 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-45423251-3614-4c20-a6bc-3c17137315f9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:52.034014 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-45423251-3614-4c20-a6bc-3c17137315f9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:52.044698 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-45423251-3614-4c20-a6bc-3c17137315f9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f" status: 200 len: 1567 microversion: 2.25 time: 0.748875 Jun 20 11:57:52.045929 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 261/512] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:57:51 2022] GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f => generated 1567 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:57:52.051804 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0a9dc299-7710-40dd-89d7-c544a0007737 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:52.052933 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0a9dc299-7710-40dd-89d7-c544a0007737 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: ba20d661-74fb-4922-b931-67f76a29e1b8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:52.063395 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a9dc299-7710-40dd-89d7-c544a0007737 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:52.064578 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a9dc299-7710-40dd-89d7-c544a0007737 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:52.066236 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a9dc299-7710-40dd-89d7-c544a0007737 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:52.066949 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a9dc299-7710-40dd-89d7-c544a0007737 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:52.215659 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-db45ab8d-87ee-4361-9b40-570a309c5151 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f069018a1fc24a9fbaac9b58ee7b07fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fc528349c34afbace41593b93d169a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:52.237659 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-db45ab8d-87ee-4361-9b40-570a309c5151 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244" status: 200 len: 1322 microversion: 2.1 time: 1.283094 Jun 20 11:57:52.239005 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 252/513] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:50 2022] GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244 => generated 1322 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:52.254704 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dc0dcc6c-6358-47c2-a260-d7fea57e37c3 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:52.256575 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dc0dcc6c-6358-47c2-a260-d7fea57e37c3 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f75be1cf-4d20-4ea9-bcbb-b407892a39ee] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:52.305424 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc0dcc6c-6358-47c2-a260-d7fea57e37c3 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:52.308112 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc0dcc6c-6358-47c2-a260-d7fea57e37c3 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:52.311077 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc0dcc6c-6358-47c2-a260-d7fea57e37c3 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:52.315330 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc0dcc6c-6358-47c2-a260-d7fea57e37c3 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:52.331326 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0a9dc299-7710-40dd-89d7-c544a0007737 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374ef56db0ba42a1a3b0ac12aa172b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8964bee8790c43ccb896f404015dcdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:52.343748 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0a9dc299-7710-40dd-89d7-c544a0007737 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] 10.222.0.27 "GET /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8" status: 200 len: 1277 microversion: 2.1 time: 0.296528 Jun 20 11:57:52.344363 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 262/514] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:52 2022] GET /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8 => generated 1277 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:52.367993 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9b37aea1-c921-443f-ad75-84586c145fdd tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:52.368927 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9b37aea1-c921-443f-ad75-84586c145fdd tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 1a618cf4-fd96-4675-a17c-899544a65dcf] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:52.396158 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9b37aea1-c921-443f-ad75-84586c145fdd tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:52.396801 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9b37aea1-c921-443f-ad75-84586c145fdd tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:52.398335 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9b37aea1-c921-443f-ad75-84586c145fdd tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:52.398791 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9b37aea1-c921-443f-ad75-84586c145fdd tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:52.561451 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9b37aea1-c921-443f-ad75-84586c145fdd tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:52.573331 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9b37aea1-c921-443f-ad75-84586c145fdd tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/1a618cf4-fd96-4675-a17c-899544a65dcf" status: 200 len: 1271 microversion: 2.1 time: 0.215649 Jun 20 11:57:52.587334 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 263/515] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:52 2022] GET /compute/v2.1/servers/1a618cf4-fd96-4675-a17c-899544a65dcf => generated 1271 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:53.062961 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-72fcbce0-f36a-42f7-a060-81230f058b0d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:53.063563 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-72fcbce0-f36a-42f7-a060-81230f058b0d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:53.078375 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-72fcbce0-f36a-42f7-a060-81230f058b0d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:53.079055 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-72fcbce0-f36a-42f7-a060-81230f058b0d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:53.079846 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-72fcbce0-f36a-42f7-a060-81230f058b0d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:53.080323 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-72fcbce0-f36a-42f7-a060-81230f058b0d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:53.555374 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dc0dcc6c-6358-47c2-a260-d7fea57e37c3 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1f420e75854a9f81f27ab6b1e718b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bfbc9c01ee408fbfe777ae4ad19fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:53.570589 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dc0dcc6c-6358-47c2-a260-d7fea57e37c3 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee" status: 200 len: 1474 microversion: 2.1 time: 1.327220 Jun 20 11:57:53.571251 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 253/516] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:52 2022] GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee => generated 1474 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:53.576252 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c677fe94-d64a-432a-aa14-c452a4ee6fdc tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:53.581130 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c677fe94-d64a-432a-aa14-c452a4ee6fdc tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 1cab587f-a3f7-4c56-8645-3ff752168244] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:53.595295 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c677fe94-d64a-432a-aa14-c452a4ee6fdc tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:53.596542 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c677fe94-d64a-432a-aa14-c452a4ee6fdc tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:53.597443 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c677fe94-d64a-432a-aa14-c452a4ee6fdc tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:53.598698 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c677fe94-d64a-432a-aa14-c452a4ee6fdc tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:54.238673 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c677fe94-d64a-432a-aa14-c452a4ee6fdc tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f069018a1fc24a9fbaac9b58ee7b07fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fc528349c34afbace41593b93d169a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:54.250762 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c677fe94-d64a-432a-aa14-c452a4ee6fdc tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244" status: 200 len: 1472 microversion: 2.1 time: 0.678191 Jun 20 11:57:54.251368 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 254/517] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:53 2022] GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244 => generated 1472 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:54.259545 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8d993598-60b6-402b-8397-2a65de0351b1 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:54.265084 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8d993598-60b6-402b-8397-2a65de0351b1 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: ba20d661-74fb-4922-b931-67f76a29e1b8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:54.273074 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8d993598-60b6-402b-8397-2a65de0351b1 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:54.273948 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8d993598-60b6-402b-8397-2a65de0351b1 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:54.274954 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8d993598-60b6-402b-8397-2a65de0351b1 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:54.275632 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8d993598-60b6-402b-8397-2a65de0351b1 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:54.575844 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-72fcbce0-f36a-42f7-a060-81230f058b0d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:54.589024 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-72fcbce0-f36a-42f7-a060-81230f058b0d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:54.594338 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-72fcbce0-f36a-42f7-a060-81230f058b0d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:54.595589 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-72fcbce0-f36a-42f7-a060-81230f058b0d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f" status: 200 len: 1567 microversion: 2.25 time: 1.536587 Jun 20 11:57:54.596169 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 264/518] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:57:53 2022] GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f => generated 1567 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 11:57:54.625666 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-de70250c-0a41-4c99-bcb4-a28796ab6077 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:54.627913 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-de70250c-0a41-4c99-bcb4-a28796ab6077 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 1a618cf4-fd96-4675-a17c-899544a65dcf] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:54.661778 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-de70250c-0a41-4c99-bcb4-a28796ab6077 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:54.662242 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-de70250c-0a41-4c99-bcb4-a28796ab6077 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:54.663035 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-de70250c-0a41-4c99-bcb4-a28796ab6077 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:54.671718 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-de70250c-0a41-4c99-bcb4-a28796ab6077 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:55.110678 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-de70250c-0a41-4c99-bcb4-a28796ab6077 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:55.122374 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-de70250c-0a41-4c99-bcb4-a28796ab6077 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/1a618cf4-fd96-4675-a17c-899544a65dcf" status: 200 len: 1277 microversion: 2.1 time: 0.510942 Jun 20 11:57:55.123603 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 265/519] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:54 2022] GET /compute/v2.1/servers/1a618cf4-fd96-4675-a17c-899544a65dcf => generated 1277 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:55.132938 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-44414aa8-66bc-4be5-8986-b9fa2aac71fd req-bbd9f7f1-a85e-438a-87d0-8faf9466c444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f75be1cf-4d20-4ea9-bcbb-b407892a39ee", "name": "network-vif-deleted", "tag": "c3bed4a9-e3ea-430b-925d-8d2500a2726f"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:55.155550 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-44414aa8-66bc-4be5-8986-b9fa2aac71fd req-bbd9f7f1-a85e-438a-87d0-8faf9466c444 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:55.156006 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-44414aa8-66bc-4be5-8986-b9fa2aac71fd req-bbd9f7f1-a85e-438a-87d0-8faf9466c444 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:55.223553 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-44414aa8-66bc-4be5-8986-b9fa2aac71fd req-bbd9f7f1-a85e-438a-87d0-8faf9466c444 service nova] Creating event network-vif-deleted:c3bed4a9-e3ea-430b-925d-8d2500a2726f for instance f75be1cf-4d20-4ea9-bcbb-b407892a39ee on n-h2-master-1 Jun 20 11:57:55.242545 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-44414aa8-66bc-4be5-8986-b9fa2aac71fd req-bbd9f7f1-a85e-438a-87d0-8faf9466c444 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109306 Jun 20 11:57:55.246021 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 266/520] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:57:55.269168 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8c1f5966-eacb-41b6-b6ac-a74c48a77b05 tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:55.272685 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8c1f5966-eacb-41b6-b6ac-a74c48a77b05 tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] [instance: 1cab587f-a3f7-4c56-8645-3ff752168244] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:55.296581 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8c1f5966-eacb-41b6-b6ac-a74c48a77b05 tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:55.299777 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8c1f5966-eacb-41b6-b6ac-a74c48a77b05 tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:55.300938 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8c1f5966-eacb-41b6-b6ac-a74c48a77b05 tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:55.303161 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8c1f5966-eacb-41b6-b6ac-a74c48a77b05 tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:55.422637 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-8c1f5966-eacb-41b6-b6ac-a74c48a77b05 tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] Lazy-loading 'flavor' on Instance uuid 1cab587f-a3f7-4c56-8645-3ff752168244 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:57:55.587474 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8c1f5966-eacb-41b6-b6ac-a74c48a77b05 tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244/action" status: 202 len: 0 microversion: 2.1 time: 0.337423 Jun 20 11:57:55.594470 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 267/521] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 11:57:55 2022] POST /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:57:55.610098 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1c37b711-94ad-4eb5-8c20-2b281d2ee855 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:55.617560 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1c37b711-94ad-4eb5-8c20-2b281d2ee855 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] [instance: f75be1cf-4d20-4ea9-bcbb-b407892a39ee] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:55.636624 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1c37b711-94ad-4eb5-8c20-2b281d2ee855 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:55.637600 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1c37b711-94ad-4eb5-8c20-2b281d2ee855 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:55.638355 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1c37b711-94ad-4eb5-8c20-2b281d2ee855 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:55.643357 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1c37b711-94ad-4eb5-8c20-2b281d2ee855 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:55.680635 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-1c37b711-94ad-4eb5-8c20-2b281d2ee855 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] HTTP exception thrown: Instance f75be1cf-4d20-4ea9-bcbb-b407892a39ee could not be found. Jun 20 11:57:55.688553 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1c37b711-94ad-4eb5-8c20-2b281d2ee855 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Request method failure captured: Jun 20 11:57:55.688553 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee HTTP/1.1 Jun 20 11:57:55.688553 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:57:55.688553 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:57:55.688553 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:57:55.688553 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 11:57:55.688553 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:57:55.688553 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:57:55.688553 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:57:55.688553 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:57:55.688553 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGBqVQBWTHbybYvaXBM2JYGVR5je0i_sq6z4yKfDCbeDnggYO_bsx2mgrGR6ZtOtDqQrC-55q793HMOaoIckCLwoJnCtDjgDbhB3MSLYFAUVrmy2QpsfznKnJh5JiYRasYD_6mxS_sBMgGApmvfskvqut97O1iE_j5CGjrwlsTFxAoI Jun 20 11:57:55.688553 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:57:55.688553 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:57:55.688553 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:57:55.688553 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:57:55.688553 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:57:55.688553 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:57:55.688553 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: c4bfbc9c01ee408fbfe777ae4ad19fbf Jun 20 11:57:55.688553 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-LiveMigrationNegativeTest-54019274 Jun 20 11:57:55.688553 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 11:57:55.688553 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 11:57:55.690238 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c4bfbc9c01ee408fbfe777ae4ad19fbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c4bfbc9c01ee408fbfe777ae4ad19fbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c4bfbc9c01ee408fbfe777ae4ad19fbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c4bfbc9c01ee408fbfe777ae4ad19fbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:57:55.690238 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-LiveMigrationNegativeTest-54019274 Jun 20 11:57:55.690238 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: c4bfbc9c01ee408fbfe777ae4ad19fbf Jun 20 11:57:55.690238 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-54019274 Jun 20 11:57:55.690238 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-LiveMigrationNegativeTest-54019274-project Jun 20 11:57:55.690238 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:57:55.690238 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:57:55.690238 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 3b1f420e75854a9f81f27ab6b1e718b2 Jun 20 11:57:55.690238 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-LiveMigrationNegativeTest-54019274-project Jun 20 11:57:55.690238 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 11:57:55.690238 n-d-master-1 devstack@n-api.service[119128]: exception: Instance f75be1cf-4d20-4ea9-bcbb-b407892a39ee could not be found. Jun 20 11:57:55.690238 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'f75be1cf-4d20-4ea9-bcbb-b407892a39ee'} Jun 20 11:57:55.690927 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:57:55.690927 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:55.690927 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:57:55.690927 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:57:55.690927 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:57:55.690927 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:57:55.690927 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:57:55.690927 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:57:55.690927 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:57:55.690927 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:57:55.690927 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f75be1cf-4d20-4ea9-bcbb-b407892a39ee could not be found. Jun 20 11:57:55.690927 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:55.690927 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:57:55.690927 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:55.690927 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:55.690927 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:57:55.690927 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:57:55.690927 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:57:55.690927 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:57:55.690927 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:57:55.692030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:57:55.692030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:57:55.692030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:57:55.692030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:57:55.692030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:57:55.692030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:57:55.692030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:57:55.692030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f75be1cf-4d20-4ea9-bcbb-b407892a39ee could not be found. Jun 20 11:57:55.692030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:55.692030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:57:55.692030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:55.692030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:55.692030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:57:55.692030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:57:55.692030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:57:55.692030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:57:55.692030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f75be1cf-4d20-4ea9-bcbb-b407892a39ee could not be found. Jun 20 11:57:55.692030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:55.703638 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1c37b711-94ad-4eb5-8c20-2b281d2ee855 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] Returning 404 to user: Instance f75be1cf-4d20-4ea9-bcbb-b407892a39ee could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:57:55.704917 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1c37b711-94ad-4eb5-8c20-2b281d2ee855 tempest-LiveMigrationNegativeTest-54019274 tempest-LiveMigrationNegativeTest-54019274-project] 10.222.0.27 "GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee" status: 404 len: 111 microversion: 2.1 time: 0.105903 Jun 20 11:57:55.706365 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 268/522] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:55 2022] GET /compute/v2.1/servers/f75be1cf-4d20-4ea9-bcbb-b407892a39ee => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:57:55.883779 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1d309bc9-6bc2-442d-880d-144df72b8b42 tempest-FloatingIPsNegativeTestJSON-312927953 tempest-FloatingIPsNegativeTestJSON-312927953-project] Calling method '.version_select at 0x7f6073b083a0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:55.928131 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8d993598-60b6-402b-8397-2a65de0351b1 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374ef56db0ba42a1a3b0ac12aa172b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8964bee8790c43ccb896f404015dcdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:55.954084 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8d993598-60b6-402b-8397-2a65de0351b1 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] 10.222.0.27 "GET /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8" status: 200 len: 1319 microversion: 2.1 time: 1.698150 Jun 20 11:57:55.958941 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 255/523] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:54 2022] GET /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8 => generated 1319 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:55.977452 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9e794ab4-b66b-4a81-9d0e-ad7d9484c584 tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:55.977452 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9e794ab4-b66b-4a81-9d0e-ad7d9484c584 tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] [instance: 1cab587f-a3f7-4c56-8645-3ff752168244] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:55.998986 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9e794ab4-b66b-4a81-9d0e-ad7d9484c584 tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:56.009967 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9e794ab4-b66b-4a81-9d0e-ad7d9484c584 tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:56.018120 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9e794ab4-b66b-4a81-9d0e-ad7d9484c584 tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:56.018595 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9e794ab4-b66b-4a81-9d0e-ad7d9484c584 tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:56.098487 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1d309bc9-6bc2-442d-880d-144df72b8b42 tempest-FloatingIPsNegativeTestJSON-312927953 tempest-FloatingIPsNegativeTestJSON-312927953-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.390800 Jun 20 11:57:56.105576 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 269/524] 10.222.0.27 () {58 vars in 1148 bytes} [Mon Jun 20 11:57:55 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 11:57:56.122101 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a39c241c-649f-470b-8743-72877f655d9e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:56.122985 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a39c241c-649f-470b-8743-72877f655d9e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:56.137118 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a39c241c-649f-470b-8743-72877f655d9e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:56.137887 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a39c241c-649f-470b-8743-72877f655d9e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:56.138831 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a39c241c-649f-470b-8743-72877f655d9e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:56.139276 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a39c241c-649f-470b-8743-72877f655d9e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:57.352974 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a39c241c-649f-470b-8743-72877f655d9e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:57.362048 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a39c241c-649f-470b-8743-72877f655d9e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:57.368109 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a39c241c-649f-470b-8743-72877f655d9e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:57.369353 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a39c241c-649f-470b-8743-72877f655d9e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f" status: 200 len: 1567 microversion: 2.25 time: 1.269097 Jun 20 11:57:57.386819 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 270/525] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:57:56 2022] GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f => generated 1567 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:57:57.392159 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-21e513d3-2f13-4176-bdb9-8a0edd4d99d4 tempest-FloatingIPsNegativeTestJSON-312927953 tempest-FloatingIPsNegativeTestJSON-312927953-project] Action: 'create', calling method: .version_select at 0x7f6073b5ca60>, body: {"pool": "non_exist_pool"} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:57.505523 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-21e513d3-2f13-4176-bdb9-8a0edd4d99d4 tempest-FloatingIPsNegativeTestJSON-312927953 tempest-FloatingIPsNegativeTestJSON-312927953-project] HTTP exception thrown: Floating IP pool not found. Jun 20 11:57:57.508798 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-21e513d3-2f13-4176-bdb9-8a0edd4d99d4 tempest-FloatingIPsNegativeTestJSON-312927953 tempest-FloatingIPsNegativeTestJSON-312927953-project] Request method failure captured: Jun 20 11:57:57.508798 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Jun 20 11:57:57.508798 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:57:57.508798 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:57:57.508798 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:57:57.508798 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 26 Jun 20 11:57:57.508798 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:57:57.508798 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:57:57.508798 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:57:57.508798 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:57:57.508798 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGDDgaoF1D5STF1DpPXIcL781a7jfi1wLBZT9lyx_hiJCQ5u5n0JaiP9aIgZ94B21FsHvbrj5wgCqPvBS8fUiMTcnfeDrx8ZSHICRGUE5og_wORmGRzKS4Wk3sveT2yeWJolzAtYdLtaBvpZYxKjZ8O5RKBMlbcR1Lw63Oh2aN2X-zk Jun 20 11:57:57.508798 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:57:57.508798 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:57:57.508798 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:57:57.508798 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:57:57.508798 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:57:57.508798 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:57:57.508798 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: e73fffb87ff64b9d9cfcc1601119b02c Jun 20 11:57:57.508798 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-312927953 Jun 20 11:57:57.508798 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 11:57:57.508798 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 11:57:57.510371 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e73fffb87ff64b9d9cfcc1601119b02c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e73fffb87ff64b9d9cfcc1601119b02c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e73fffb87ff64b9d9cfcc1601119b02c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e73fffb87ff64b9d9cfcc1601119b02c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:57:57.510371 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-312927953 Jun 20 11:57:57.510371 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: e73fffb87ff64b9d9cfcc1601119b02c Jun 20 11:57:57.510371 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-312927953 Jun 20 11:57:57.510371 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-FloatingIPsNegativeTestJSON-312927953-project Jun 20 11:57:57.510371 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:57:57.510371 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:57:57.510371 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 90c3dd4a040640f496515057010b7b03 Jun 20 11:57:57.510371 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-312927953-project Jun 20 11:57:57.510371 n-d-master-1 devstack@n-api.service[119128]: Jun 20 11:57:57.510371 n-d-master-1 devstack@n-api.service[119128]: {"pool": "non_exist_pool"} Jun 20 11:57:57.510371 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 11:57:57.510371 n-d-master-1 devstack@n-api.service[119128]: exception: Floating IP pool not found. Jun 20 11:57:57.510371 n-d-master-1 devstack@n-api.service[119128]: action_args: {'body': {'pool': 'non_exist_pool'}} Jun 20 11:57:57.510371 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:57:57.511438 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:57.511438 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Jun 20 11:57:57.511438 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Jun 20 11:57:57.511438 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Jun 20 11:57:57.511438 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Jun 20 11:57:57.511438 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Jun 20 11:57:57.511438 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Jun 20 11:57:57.511438 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Jun 20 11:57:57.511438 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:57.511438 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:57:57.511438 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:57.511438 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:57.511438 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:57:57.511438 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:57:57.511438 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:57:57.511438 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:57:57.511438 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 11:57:57.511438 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 11:57:57.511438 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:57:57.511438 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:57:57.513390 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Jun 20 11:57:57.513390 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:57:57.513390 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Jun 20 11:57:57.513390 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:57.513390 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:57:57.513390 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:57.513390 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:57.513390 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:57:57.513390 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:57:57.513390 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:57:57.513390 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:57:57.513390 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Jun 20 11:57:57.513390 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:57.515334 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-21e513d3-2f13-4176-bdb9-8a0edd4d99d4 tempest-FloatingIPsNegativeTestJSON-312927953 tempest-FloatingIPsNegativeTestJSON-312927953-project] Returning 404 to user: Floating IP pool not found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:57:57.516222 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-21e513d3-2f13-4176-bdb9-8a0edd4d99d4 tempest-FloatingIPsNegativeTestJSON-312927953 tempest-FloatingIPsNegativeTestJSON-312927953-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.128259 Jun 20 11:57:57.521217 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 271/526] 10.222.0.27 () {60 vars in 1169 bytes} [Mon Jun 20 11:57:57 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 11:57:57.526159 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9fca0ec7-3674-4e38-ac17-08431b0706c7 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:57.526963 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9fca0ec7-3674-4e38-ac17-08431b0706c7 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 1a618cf4-fd96-4675-a17c-899544a65dcf] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:57.556163 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9fca0ec7-3674-4e38-ac17-08431b0706c7 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:57.560139 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9fca0ec7-3674-4e38-ac17-08431b0706c7 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:57.561353 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9fca0ec7-3674-4e38-ac17-08431b0706c7 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:57.561968 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9fca0ec7-3674-4e38-ac17-08431b0706c7 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:57.971659 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9e794ab4-b66b-4a81-9d0e-ad7d9484c584 tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244" status: 200 len: 1631 microversion: 2.1 time: 2.010917 Jun 20 11:57:57.981292 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 256/527] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:55 2022] GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244 => generated 1631 bytes in 2018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:57.991842 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-41e6b68a-fed1-48f0-a808-8a8603833540 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:58.000891 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-41e6b68a-fed1-48f0-a808-8a8603833540 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: ba20d661-74fb-4922-b931-67f76a29e1b8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:58.015958 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-41e6b68a-fed1-48f0-a808-8a8603833540 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:58.022023 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-41e6b68a-fed1-48f0-a808-8a8603833540 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:58.023164 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-41e6b68a-fed1-48f0-a808-8a8603833540 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:58.023811 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-41e6b68a-fed1-48f0-a808-8a8603833540 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:58.571395 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-41e6b68a-fed1-48f0-a808-8a8603833540 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374ef56db0ba42a1a3b0ac12aa172b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8964bee8790c43ccb896f404015dcdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:58.582432 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-41e6b68a-fed1-48f0-a808-8a8603833540 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] 10.222.0.27 "GET /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8" status: 200 len: 1319 microversion: 2.1 time: 0.603225 Jun 20 11:57:58.593895 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 257/528] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:57 2022] GET /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8 => generated 1319 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:58.606055 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0dea9872-1596-49a9-a838-5d83532b1bec tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-736618348", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "1311349000", "adminPass": "***", "networks": [{"uuid": "9e362e4a-dd44-4b55-9c5f-38f56974a875"}], "security_groups": [{"name": "tempest-securitygroup--590114889"}], "key_name": "tempest-keypair-830207600", "user_data": "}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:58.739682 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9fca0ec7-3674-4e38-ac17-08431b0706c7 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:58.758935 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9fca0ec7-3674-4e38-ac17-08431b0706c7 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/1a618cf4-fd96-4675-a17c-899544a65dcf" status: 200 len: 1319 microversion: 2.1 time: 1.233338 Jun 20 11:57:58.769312 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 272/529] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:57 2022] GET /compute/v2.1/servers/1a618cf4-fd96-4675-a17c-899544a65dcf => generated 1319 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:57:58.797283 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fb47a84d-efa5-4f34-abce-f51414316bd9 tempest-FloatingIPsNegativeTestJSON-312927953 tempest-FloatingIPsNegativeTestJSON-312927953-project] Calling method '.version_select at 0x7f6073bc8c10>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:58.897520 n-d-master-1 devstack@n-api.service[119128]: DEBUG neutronclient.v2_0.client [None req-fb47a84d-efa5-4f34-abce-f51414316bd9 tempest-FloatingIPsNegativeTestJSON-312927953 tempest-FloatingIPsNegativeTestJSON-312927953-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 9217bd97-49d5-4f9c-af66-a1cf13f978d0 could not be found", "detail": ""}} {{(pid=119128) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 20 11:57:58.903082 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-fb47a84d-efa5-4f34-abce-f51414316bd9 tempest-FloatingIPsNegativeTestJSON-312927953 tempest-FloatingIPsNegativeTestJSON-312927953-project] HTTP exception thrown: Floating IP not found for ID 9217bd97-49d5-4f9c-af66-a1cf13f978d0 Jun 20 11:57:58.921723 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fb47a84d-efa5-4f34-abce-f51414316bd9 tempest-FloatingIPsNegativeTestJSON-312927953 tempest-FloatingIPsNegativeTestJSON-312927953-project] Request method failure captured: Jun 20 11:57:58.921723 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/os-floating-ips/9217bd97-49d5-4f9c-af66-a1cf13f978d0 HTTP/1.1 Jun 20 11:57:58.921723 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:57:58.921723 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:57:58.921723 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:57:58.921723 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 11:57:58.921723 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:57:58.921723 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:57:58.921723 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:57:58.921723 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:57:58.921723 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGDDgaoF1D5STF1DpPXIcL781a7jfi1wLBZT9lyx_hiJCQ5u5n0JaiP9aIgZ94B21FsHvbrj5wgCqPvBS8fUiMTcnfeDrx8ZSHICRGUE5og_wORmGRzKS4Wk3sveT2yeWJolzAtYdLtaBvpZYxKjZ8O5RKBMlbcR1Lw63Oh2aN2X-zk Jun 20 11:57:58.921723 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:57:58.921723 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:57:58.921723 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:57:58.921723 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:57:58.921723 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:57:58.921723 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:57:58.921723 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: e73fffb87ff64b9d9cfcc1601119b02c Jun 20 11:57:58.921723 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-312927953 Jun 20 11:57:58.921723 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 11:57:58.921723 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 11:57:58.923046 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e73fffb87ff64b9d9cfcc1601119b02c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e73fffb87ff64b9d9cfcc1601119b02c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e73fffb87ff64b9d9cfcc1601119b02c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e73fffb87ff64b9d9cfcc1601119b02c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:57:58.923046 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-312927953 Jun 20 11:57:58.923046 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: e73fffb87ff64b9d9cfcc1601119b02c Jun 20 11:57:58.923046 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-312927953 Jun 20 11:57:58.923046 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-FloatingIPsNegativeTestJSON-312927953-project Jun 20 11:57:58.923046 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:57:58.923046 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:57:58.923046 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 90c3dd4a040640f496515057010b7b03 Jun 20 11:57:58.923046 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-312927953-project Jun 20 11:57:58.923046 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 11:57:58.923046 n-d-master-1 devstack@n-api.service[119128]: exception: Floating IP not found for ID 9217bd97-49d5-4f9c-af66-a1cf13f978d0 Jun 20 11:57:58.923046 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '9217bd97-49d5-4f9c-af66-a1cf13f978d0'} Jun 20 11:57:58.923046 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:57:58.923771 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:58.923771 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jun 20 11:57:58.923771 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jun 20 11:57:58.923771 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 11:57:58.923771 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 11:57:58.923771 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jun 20 11:57:58.923771 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jun 20 11:57:58.923771 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 11:57:58.923771 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 11:57:58.923771 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 20 11:57:58.923771 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 20 11:57:58.923771 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 11:57:58.923771 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 11:57:58.923771 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 20 11:57:58.923771 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 20 11:57:58.923771 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 11:57:58.923771 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 11:57:58.923771 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 20 11:57:58.923771 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 20 11:57:58.926516 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 11:57:58.926516 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 11:57:58.926516 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 20 11:57:58.926516 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 20 11:57:58.926516 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 20 11:57:58.926516 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 20 11:57:58.926516 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 9217bd97-49d5-4f9c-af66-a1cf13f978d0 could not be found Jun 20 11:57:58.926516 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e50d7cb7-1523-40db-9bad-411ae5a3338e'] Jun 20 11:57:58.926516 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:58.926516 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:57:58.926516 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:58.926516 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:58.926516 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jun 20 11:57:58.926516 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jun 20 11:57:58.926516 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jun 20 11:57:58.926516 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jun 20 11:57:58.926516 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 9217bd97-49d5-4f9c-af66-a1cf13f978d0. Jun 20 11:57:58.926516 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:58.926516 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:57:58.926516 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:58.928567 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:58.928567 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:57:58.928567 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:57:58.928567 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:57:58.928567 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:57:58.928567 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 11:57:58.928567 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 11:57:58.928567 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:57:58.928567 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:57:58.928567 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jun 20 11:57:58.928567 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 20 11:57:58.928567 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 9217bd97-49d5-4f9c-af66-a1cf13f978d0 Jun 20 11:57:58.928567 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:58.928567 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:57:58.928567 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:58.928567 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:57:58.928567 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:57:58.928567 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:57:58.928567 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:57:58.928567 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:57:58.931389 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 9217bd97-49d5-4f9c-af66-a1cf13f978d0 Jun 20 11:57:58.931389 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:57:58.931389 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fb47a84d-efa5-4f34-abce-f51414316bd9 tempest-FloatingIPsNegativeTestJSON-312927953 tempest-FloatingIPsNegativeTestJSON-312927953-project] Returning 404 to user: Floating IP not found for ID 9217bd97-49d5-4f9c-af66-a1cf13f978d0 {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:57:58.931389 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fb47a84d-efa5-4f34-abce-f51414316bd9 tempest-FloatingIPsNegativeTestJSON-312927953 tempest-FloatingIPsNegativeTestJSON-312927953-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/9217bd97-49d5-4f9c-af66-a1cf13f978d0" status: 404 len: 111 microversion: 2.1 time: 0.149109 Jun 20 11:57:58.937249 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 273/530] 10.222.0.27 () {58 vars in 1262 bytes} [Mon Jun 20 11:57:58 2022] DELETE /compute/v2.1/os-floating-ips/9217bd97-49d5-4f9c-af66-a1cf13f978d0 => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:57:58.953412 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-be62763e-a49f-4f8b-a04d-7994fbd521cc req-0a6baa4f-d569-4ba9-98ee-55af0f9e9bc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddbdd7f1-6b17-4f7a-9793-873b18c7a92f", "name": "network-vif-unplugged", "status": "completed", "tag": "be0d0765-87a0-4732-987c-66193517041e"}, {"name": "network-changed", "server_uuid": "ddbdd7f1-6b17-4f7a-9793-873b18c7a92f", "tag": "be0d0765-87a0-4732-987c-66193517041e"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:57:58.991999 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-be62763e-a49f-4f8b-a04d-7994fbd521cc req-0a6baa4f-d569-4ba9-98ee-55af0f9e9bc9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:58.992437 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-be62763e-a49f-4f8b-a04d-7994fbd521cc req-0a6baa4f-d569-4ba9-98ee-55af0f9e9bc9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:59.042096 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-be62763e-a49f-4f8b-a04d-7994fbd521cc req-0a6baa4f-d569-4ba9-98ee-55af0f9e9bc9 service nova] Creating event network-vif-unplugged:be0d0765-87a0-4732-987c-66193517041e for instance ddbdd7f1-6b17-4f7a-9793-873b18c7a92f on n-h1-master-1 Jun 20 11:57:59.042733 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-be62763e-a49f-4f8b-a04d-7994fbd521cc req-0a6baa4f-d569-4ba9-98ee-55af0f9e9bc9 service nova] Creating event network-changed:be0d0765-87a0-4732-987c-66193517041e for instance ddbdd7f1-6b17-4f7a-9793-873b18c7a92f on n-h1-master-1 Jun 20 11:57:59.079389 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-be62763e-a49f-4f8b-a04d-7994fbd521cc req-0a6baa4f-d569-4ba9-98ee-55af0f9e9bc9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.133010 Jun 20 11:57:59.080002 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 274/531] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:57:59.112816 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ce860452-20bc-48d4-acd1-f6d3a18e5c4a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:59.125016 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ce860452-20bc-48d4-acd1-f6d3a18e5c4a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:59.134614 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce860452-20bc-48d4-acd1-f6d3a18e5c4a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:59.135270 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce860452-20bc-48d4-acd1-f6d3a18e5c4a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:59.136309 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce860452-20bc-48d4-acd1-f6d3a18e5c4a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:59.136895 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce860452-20bc-48d4-acd1-f6d3a18e5c4a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:59.245148 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-0dea9872-1596-49a9-a838-5d83532b1bec tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] validate_networks() for [('9e362e4a-dd44-4b55-9c5f-38f56974a875', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:57:59.369386 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:57:59.435153 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=20 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:57:59.491963 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ce860452-20bc-48d4-acd1-f6d3a18e5c4a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:59.504150 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ce860452-20bc-48d4-acd1-f6d3a18e5c4a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:59.506058 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ce860452-20bc-48d4-acd1-f6d3a18e5c4a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:57:59.507466 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ce860452-20bc-48d4-acd1-f6d3a18e5c4a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f" status: 200 len: 1567 microversion: 2.25 time: 0.419289 Jun 20 11:57:59.508337 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 275/532] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:57:59 2022] GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f => generated 1567 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:57:59.513884 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d63efb53-9237-44df-b6e8-2b65ed162e08 tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:57:59.514662 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d63efb53-9237-44df-b6e8-2b65ed162e08 tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] [instance: 1cab587f-a3f7-4c56-8645-3ff752168244] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:57:59.522531 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d63efb53-9237-44df-b6e8-2b65ed162e08 tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:59.523498 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d63efb53-9237-44df-b6e8-2b65ed162e08 tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:57:59.524652 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d63efb53-9237-44df-b6e8-2b65ed162e08 tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:57:59.525443 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d63efb53-9237-44df-b6e8-2b65ed162e08 tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:00.157815 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d63efb53-9237-44df-b6e8-2b65ed162e08 tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244" status: 200 len: 1614 microversion: 2.1 time: 0.648101 Jun 20 11:58:00.168188 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 276/533] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:57:59 2022] GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244 => generated 1614 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:00.175123 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f8606259-455e-455e-bb74-770ab3d827dd tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:00.176455 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f8606259-455e-455e-bb74-770ab3d827dd tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: ba20d661-74fb-4922-b931-67f76a29e1b8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:00.183822 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8606259-455e-455e-bb74-770ab3d827dd tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:00.184694 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8606259-455e-455e-bb74-770ab3d827dd tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:00.185599 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8606259-455e-455e-bb74-770ab3d827dd tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:00.186563 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8606259-455e-455e-bb74-770ab3d827dd tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:00.192366 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:58:00.614393 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=4 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:58:00.972114 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f8606259-455e-455e-bb74-770ab3d827dd tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374ef56db0ba42a1a3b0ac12aa172b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8964bee8790c43ccb896f404015dcdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:00.985257 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f8606259-455e-455e-bb74-770ab3d827dd tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] 10.222.0.27 "GET /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8" status: 200 len: 1319 microversion: 2.1 time: 0.815200 Jun 20 11:58:00.986045 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 277/534] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:00 2022] GET /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8 => generated 1319 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:01.003042 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-ad0cf6a2-887a-48e5-b6bd-0f368440f4dc req-79156ada-e7a4-412b-a994-38ff07561e8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba20d661-74fb-4922-b931-67f76a29e1b8", "tag": "5f78b71e-9034-48d7-9a62-92ffa6500f59"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:01.014783 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-ad0cf6a2-887a-48e5-b6bd-0f368440f4dc req-79156ada-e7a4-412b-a994-38ff07561e8a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:01.029517 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-ad0cf6a2-887a-48e5-b6bd-0f368440f4dc req-79156ada-e7a4-412b-a994-38ff07561e8a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:01.051667 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-ad0cf6a2-887a-48e5-b6bd-0f368440f4dc req-79156ada-e7a4-412b-a994-38ff07561e8a service nova] Creating event network-changed:5f78b71e-9034-48d7-9a62-92ffa6500f59 for instance ba20d661-74fb-4922-b931-67f76a29e1b8 on n-h1-master-1 Jun 20 11:58:01.058890 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-ad0cf6a2-887a-48e5-b6bd-0f368440f4dc req-79156ada-e7a4-412b-a994-38ff07561e8a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070334 Jun 20 11:58:01.060675 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 278/535] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:58:01.066613 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-094471c8-2df9-41fb-a241-e8ed336ae0b5 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:01.077275 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-094471c8-2df9-41fb-a241-e8ed336ae0b5 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 1a618cf4-fd96-4675-a17c-899544a65dcf] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:01.094551 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-094471c8-2df9-41fb-a241-e8ed336ae0b5 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:01.095267 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-094471c8-2df9-41fb-a241-e8ed336ae0b5 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:01.096232 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-094471c8-2df9-41fb-a241-e8ed336ae0b5 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:01.096852 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-094471c8-2df9-41fb-a241-e8ed336ae0b5 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:01.227950 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=26 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:58:01.417949 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-0dea9872-1596-49a9-a838-5d83532b1bec tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:58:01.418691 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-0dea9872-1596-49a9-a838-5d83532b1bec tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:58:01.419412 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-0dea9872-1596-49a9-a838-5d83532b1bec tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:58:01.419884 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-0dea9872-1596-49a9-a838-5d83532b1bec tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:58:01.420444 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-0dea9872-1596-49a9-a838-5d83532b1bec tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:58:01.471856 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0dea9872-1596-49a9-a838-5d83532b1bec tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:01.473095 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0dea9872-1596-49a9-a838-5d83532b1bec tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:01.474410 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0dea9872-1596-49a9-a838-5d83532b1bec tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:01.475057 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0dea9872-1596-49a9-a838-5d83532b1bec tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:01.515818 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-0dea9872-1596-49a9-a838-5d83532b1bec tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Getting quotas for project d8790cc26204435aaf4071847ee00288. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:58:01.525396 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-0dea9872-1596-49a9-a838-5d83532b1bec tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Getting quotas for user f5f49b57013f4675a70bac9b13e0a229 and project d8790cc26204435aaf4071847ee00288. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:58:01.546848 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0dea9872-1596-49a9-a838-5d83532b1bec tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:58:01.547961 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-094471c8-2df9-41fb-a241-e8ed336ae0b5 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:01.549576 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0dea9872-1596-49a9-a838-5d83532b1bec tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: adee1d54-6e18-4a4e-96ac-48a6fc56345d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:58:01.559350 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-094471c8-2df9-41fb-a241-e8ed336ae0b5 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/1a618cf4-fd96-4675-a17c-899544a65dcf" status: 200 len: 1319 microversion: 2.1 time: 0.496012 Jun 20 11:58:01.560527 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 279/536] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:01 2022] GET /compute/v2.1/servers/1a618cf4-fd96-4675-a17c-899544a65dcf => generated 1319 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:01.576193 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fd22fd71-06df-4433-9755-379b584870f0 tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:01.585755 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fd22fd71-06df-4433-9755-379b584870f0 tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] [instance: 1cab587f-a3f7-4c56-8645-3ff752168244] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:01.595127 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fd22fd71-06df-4433-9755-379b584870f0 tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:01.599259 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fd22fd71-06df-4433-9755-379b584870f0 tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:01.600332 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fd22fd71-06df-4433-9755-379b584870f0 tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:01.602779 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fd22fd71-06df-4433-9755-379b584870f0 tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:01.635541 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0dea9872-1596-49a9-a838-5d83532b1bec tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.038077 Jun 20 11:58:01.636801 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 258/537] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:57:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 3042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 11:58:01.647259 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7807fa8d-8ab2-4b98-b43c-7d8bce0f7764 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:01.650198 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7807fa8d-8ab2-4b98-b43c-7d8bce0f7764 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:01.659468 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7807fa8d-8ab2-4b98-b43c-7d8bce0f7764 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:01.661434 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7807fa8d-8ab2-4b98-b43c-7d8bce0f7764 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:01.662606 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7807fa8d-8ab2-4b98-b43c-7d8bce0f7764 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:01.663217 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7807fa8d-8ab2-4b98-b43c-7d8bce0f7764 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:01.881168 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-fd22fd71-06df-4433-9755-379b584870f0 tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] HTTP exception thrown: Cannot 'migrate' instance 1cab587f-a3f7-4c56-8645-3ff752168244 while it is in vm_state suspended Jun 20 11:58:01.884531 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fd22fd71-06df-4433-9755-379b584870f0 tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] Request method failure captured: Jun 20 11:58:01.884531 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244/action HTTP/1.1 Jun 20 11:58:01.884531 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:58:01.884531 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:58:01.884531 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:58:01.884531 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 15 Jun 20 11:58:01.884531 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:58:01.884531 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:58:01.884531 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:58:01.884531 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:58:01.884531 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGCJJkRNMEJUBgA8fv6dzFDrq3IG4hKusSKzTOefPK-bmqE5a_msAcQpazfsw42KsZ6WOxgCXvPxwWTgiiswBtQMNFGSjMDU5dPRY9XEG5ZMuaRDRO9sPc8fcTFfqDEYxhEdmNX_sp9B2Hyh6vY4pvekEImJagYoEXkaI9wWDhGy2H0 Jun 20 11:58:01.884531 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:58:01.884531 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:58:01.884531 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:58:01.884531 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:58:01.884531 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:58:01.884531 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:58:01.884531 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: ed905c1a009342268372f3dc99ceaa36 Jun 20 11:58:01.884531 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-55105741 Jun 20 11:58:01.884531 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member,admin Jun 20 11:58:01.884531 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member,admin Jun 20 11:58:01.886171 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed905c1a009342268372f3dc99ceaa36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed905c1a009342268372f3dc99ceaa36"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ed905c1a009342268372f3dc99ceaa36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ed905c1a009342268372f3dc99ceaa36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:58:01.886171 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersAdminNegativeTestJSON-55105741 Jun 20 11:58:01.886171 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: ed905c1a009342268372f3dc99ceaa36 Jun 20 11:58:01.886171 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-55105741 Jun 20 11:58:01.886171 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersAdminNegativeTestJSON-55105741-project-admin Jun 20 11:58:01.886171 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:58:01.886171 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:58:01.886171 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: d86aa1945a054dc7bc66d680614f146c Jun 20 11:58:01.886171 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersAdminNegativeTestJSON-55105741-project-admin Jun 20 11:58:01.886171 n-d-master-1 devstack@n-api.service[119128]: Jun 20 11:58:01.886171 n-d-master-1 devstack@n-api.service[119128]: {"migrate": {}} Jun 20 11:58:01.886171 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 11:58:01.886171 n-d-master-1 devstack@n-api.service[119128]: exception: Cannot 'migrate' instance 1cab587f-a3f7-4c56-8645-3ff752168244 while it is in vm_state suspended Jun 20 11:58:01.887485 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '1cab587f-a3f7-4c56-8645-3ff752168244', 'body': {'migrate': {}}} Jun 20 11:58:01.887485 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:58:01.887485 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:01.887485 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Jun 20 11:58:01.887485 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Jun 20 11:58:01.887485 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 20 11:58:01.887485 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 11:58:01.887485 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 20 11:58:01.887485 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 20 11:58:01.887485 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 20 11:58:01.887485 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 11:58:01.887485 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 20 11:58:01.887485 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 20 11:58:01.887485 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 11:58:01.887485 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 11:58:01.887485 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 20 11:58:01.887485 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 20 11:58:01.887485 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1cab587f-a3f7-4c56-8645-3ff752168244 in vm_state suspended. Cannot resize while the instance is in this state. Jun 20 11:58:01.887485 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:58:01.888873 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:58:01.888873 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:58:01.888873 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:01.888873 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:58:01.888873 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:58:01.888873 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:58:01.888873 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:58:01.888873 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:58:01.888873 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:58:01.888873 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:58:01.888873 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:58:01.888873 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Jun 20 11:58:01.888873 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 20 11:58:01.888873 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 20 11:58:01.888873 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 20 11:58:01.888873 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 1cab587f-a3f7-4c56-8645-3ff752168244 while it is in vm_state suspended Jun 20 11:58:01.888873 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:58:01.888873 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:58:01.888873 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:58:01.888873 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:01.890275 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:58:01.890275 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:58:01.890275 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:58:01.890275 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:58:01.890275 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 1cab587f-a3f7-4c56-8645-3ff752168244 while it is in vm_state suspended Jun 20 11:58:01.890275 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:58:01.893765 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fd22fd71-06df-4433-9755-379b584870f0 tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] Returning 409 to user: Cannot 'migrate' instance 1cab587f-a3f7-4c56-8645-3ff752168244 while it is in vm_state suspended {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:58:01.894629 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fd22fd71-06df-4433-9755-379b584870f0 tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244/action" status: 409 len: 148 microversion: 2.1 time: 0.332992 Jun 20 11:58:01.895395 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 280/538] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 11:58:01 2022] POST /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244/action => generated 148 bytes in 334 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 20 11:58:01.899780 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-e77f5808-43fe-4bfc-93e9-74d84f4adb3c req-320ab058-a465-4a1a-b44a-76fdee07cc5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a618cf4-fd96-4675-a17c-899544a65dcf", "tag": "909ad315-4767-4718-9c17-767afc417cdf"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:01.914643 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e77f5808-43fe-4bfc-93e9-74d84f4adb3c req-320ab058-a465-4a1a-b44a-76fdee07cc5d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:01.915078 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e77f5808-43fe-4bfc-93e9-74d84f4adb3c req-320ab058-a465-4a1a-b44a-76fdee07cc5d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:01.929282 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-e77f5808-43fe-4bfc-93e9-74d84f4adb3c req-320ab058-a465-4a1a-b44a-76fdee07cc5d service nova] Creating event network-changed:909ad315-4767-4718-9c17-767afc417cdf for instance 1a618cf4-fd96-4675-a17c-899544a65dcf on n-h2-master-1 Jun 20 11:58:01.936396 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-e77f5808-43fe-4bfc-93e9-74d84f4adb3c req-320ab058-a465-4a1a-b44a-76fdee07cc5d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039929 Jun 20 11:58:01.937919 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 281/539] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:58:01.953477 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0c5ed2b9-00cb-4dab-928d-5cd181a08700 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:01.954425 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0c5ed2b9-00cb-4dab-928d-5cd181a08700 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: adee1d54-6e18-4a4e-96ac-48a6fc56345d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:02.157490 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0c5ed2b9-00cb-4dab-928d-5cd181a08700 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f49b57013f4675a70bac9b13e0a229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8790cc26204435aaf4071847ee00288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:02.165739 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0c5ed2b9-00cb-4dab-928d-5cd181a08700 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "GET /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d" status: 200 len: 1263 microversion: 2.1 time: 0.225824 Jun 20 11:58:02.175954 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 282/540] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:01 2022] GET /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d => generated 1263 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:02.192617 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a8d49a40-5a82-4c8a-9725-eac8f24ac456 tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:02.195431 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a8d49a40-5a82-4c8a-9725-eac8f24ac456 tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] Request method failure captured: Jun 20 11:58:02.195431 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a/action HTTP/1.1 Jun 20 11:58:02.195431 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:58:02.195431 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:58:02.195431 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:58:02.195431 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 39 Jun 20 11:58:02.195431 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:58:02.195431 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:58:02.195431 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:58:02.195431 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:58:02.195431 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGCJJkRNMEJUBgA8fv6dzFDrq3IG4hKusSKzTOefPK-bmqE5a_msAcQpazfsw42KsZ6WOxgCXvPxwWTgiiswBtQMNFGSjMDU5dPRY9XEG5ZMuaRDRO9sPc8fcTFfqDEYxhEdmNX_sp9B2Hyh6vY4pvekEImJagYoEXkaI9wWDhGy2H0 Jun 20 11:58:02.195431 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:58:02.195431 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:58:02.195431 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:58:02.195431 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:58:02.195431 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:58:02.195431 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:58:02.195431 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: ed905c1a009342268372f3dc99ceaa36 Jun 20 11:58:02.195431 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-55105741 Jun 20 11:58:02.195431 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member,admin Jun 20 11:58:02.195431 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member,admin Jun 20 11:58:02.196756 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed905c1a009342268372f3dc99ceaa36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed905c1a009342268372f3dc99ceaa36"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ed905c1a009342268372f3dc99ceaa36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ed905c1a009342268372f3dc99ceaa36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:58:02.196756 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersAdminNegativeTestJSON-55105741 Jun 20 11:58:02.196756 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: ed905c1a009342268372f3dc99ceaa36 Jun 20 11:58:02.196756 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-55105741 Jun 20 11:58:02.196756 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersAdminNegativeTestJSON-55105741-project-admin Jun 20 11:58:02.196756 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:58:02.196756 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:58:02.196756 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: d86aa1945a054dc7bc66d680614f146c Jun 20 11:58:02.196756 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersAdminNegativeTestJSON-55105741-project-admin Jun 20 11:58:02.196756 n-d-master-1 devstack@n-api.service[119128]: Jun 20 11:58:02.196756 n-d-master-1 devstack@n-api.service[119128]: {"os-resetState": {"state": "invalid"}} Jun 20 11:58:02.196756 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 11:58:02.198034 n-d-master-1 devstack@n-api.service[119128]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jun 20 11:58:02.198034 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '8a71d955-cfc0-44b7-ae7b-e899afa8698a', 'body': {'os-resetState': {'state': 'invalid'}}} Jun 20 11:58:02.198034 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:58:02.198034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:02.198034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 11:58:02.198034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 11:58:02.198034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 11:58:02.198034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise error Jun 20 11:58:02.198034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Jun 20 11:58:02.198034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:58:02.198034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Jun 20 11:58:02.198034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jun 20 11:58:02.198034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:58:02.198034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jun 20 11:58:02.198034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'invalid' Jun 20 11:58:02.198034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:58:02.198034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:58:02.198034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:58:02.198034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:02.198034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:58:02.198034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:58:02.198034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:58:02.199342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:58:02.199342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:58:02.199342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:58:02.199342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 11:58:02.199342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 11:58:02.199342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 11:58:02.199342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 11:58:02.199342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 11:58:02.199342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 11:58:02.199342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jun 20 11:58:02.199342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:58:02.199342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:58:02.199342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:58:02.199342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:02.199342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:58:02.199342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:58:02.199342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 11:58:02.199342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 11:58:02.199342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jun 20 11:58:02.200832 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:58:02.228547 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a8d49a40-5a82-4c8a-9725-eac8f24ac456 tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:58:02.231142 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a8d49a40-5a82-4c8a-9725-eac8f24ac456 tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a/action" status: 400 len: 144 microversion: 2.1 time: 0.053536 Jun 20 11:58:02.234107 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 283/541] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 11:58:02 2022] POST /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a/action => generated 144 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 11:58:02.246505 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a9b96ce5-3f04-4b7a-ba63-0652ab0f9bab tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:02.248828 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a9b96ce5-3f04-4b7a-ba63-0652ab0f9bab tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: ba20d661-74fb-4922-b931-67f76a29e1b8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:02.250788 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7807fa8d-8ab2-4b98-b43c-7d8bce0f7764 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:02.265102 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a9b96ce5-3f04-4b7a-ba63-0652ab0f9bab tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:02.266506 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a9b96ce5-3f04-4b7a-ba63-0652ab0f9bab tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:02.267349 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7807fa8d-8ab2-4b98-b43c-7d8bce0f7764 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:02.272007 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7807fa8d-8ab2-4b98-b43c-7d8bce0f7764 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:02.272759 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a9b96ce5-3f04-4b7a-ba63-0652ab0f9bab tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:02.273436 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a9b96ce5-3f04-4b7a-ba63-0652ab0f9bab tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:02.280988 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7807fa8d-8ab2-4b98-b43c-7d8bce0f7764 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f" status: 200 len: 1567 microversion: 2.25 time: 0.636949 Jun 20 11:58:02.283705 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 259/542] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:58:01 2022] GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f => generated 1567 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:58:02.290707 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bd8e40ad-6ed4-456b-804e-aa0d2ecc8865 tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:02.295163 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bd8e40ad-6ed4-456b-804e-aa0d2ecc8865 tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] Request method failure captured: Jun 20 11:58:02.295163 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a/action HTTP/1.1 Jun 20 11:58:02.295163 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:58:02.295163 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:58:02.295163 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:58:02.295163 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 31 Jun 20 11:58:02.295163 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:58:02.295163 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:58:02.295163 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:58:02.295163 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:58:02.295163 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGCJJkRNMEJUBgA8fv6dzFDrq3IG4hKusSKzTOefPK-bmqE5a_msAcQpazfsw42KsZ6WOxgCXvPxwWTgiiswBtQMNFGSjMDU5dPRY9XEG5ZMuaRDRO9sPc8fcTFfqDEYxhEdmNX_sp9B2Hyh6vY4pvekEImJagYoEXkaI9wWDhGy2H0 Jun 20 11:58:02.295163 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:58:02.295163 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:58:02.295163 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:58:02.295163 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:58:02.295163 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:58:02.295163 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:58:02.295163 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: ed905c1a009342268372f3dc99ceaa36 Jun 20 11:58:02.295163 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-55105741 Jun 20 11:58:02.295163 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member,admin Jun 20 11:58:02.295163 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member,admin Jun 20 11:58:02.296711 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed905c1a009342268372f3dc99ceaa36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed905c1a009342268372f3dc99ceaa36"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ed905c1a009342268372f3dc99ceaa36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ed905c1a009342268372f3dc99ceaa36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:58:02.296711 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersAdminNegativeTestJSON-55105741 Jun 20 11:58:02.296711 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: ed905c1a009342268372f3dc99ceaa36 Jun 20 11:58:02.296711 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-55105741 Jun 20 11:58:02.296711 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersAdminNegativeTestJSON-55105741-project-admin Jun 20 11:58:02.296711 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:58:02.296711 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:58:02.296711 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: d86aa1945a054dc7bc66d680614f146c Jun 20 11:58:02.296711 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersAdminNegativeTestJSON-55105741-project-admin Jun 20 11:58:02.296711 n-d-master-1 devstack@n-api.service[119127]: Jun 20 11:58:02.296711 n-d-master-1 devstack@n-api.service[119127]: {"os-resetState": {"state": 1}} Jun 20 11:58:02.296711 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 11:58:02.296711 n-d-master-1 devstack@n-api.service[119127]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jun 20 11:58:02.297531 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '8a71d955-cfc0-44b7-ae7b-e899afa8698a', 'body': {'os-resetState': {'state': 1}}} Jun 20 11:58:02.297531 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:58:02.297531 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:02.297531 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 11:58:02.297531 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 11:58:02.297531 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 11:58:02.297531 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise error Jun 20 11:58:02.297531 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Jun 20 11:58:02.297531 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:02.297531 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Jun 20 11:58:02.297531 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jun 20 11:58:02.297531 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:02.297531 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jun 20 11:58:02.297531 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi 1 Jun 20 11:58:02.297531 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:02.297531 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:58:02.297531 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:02.297531 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:02.297531 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:58:02.297531 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:58:02.297531 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:58:02.297531 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:58:02.298794 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:58:02.298794 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:58:02.298794 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 11:58:02.298794 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 11:58:02.298794 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 11:58:02.298794 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 11:58:02.298794 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 11:58:02.298794 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 11:58:02.298794 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jun 20 11:58:02.298794 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:02.298794 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:58:02.298794 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:02.298794 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:02.298794 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:58:02.298794 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:58:02.298794 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 11:58:02.298794 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 11:58:02.298794 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jun 20 11:58:02.298794 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:02.299877 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bd8e40ad-6ed4-456b-804e-aa0d2ecc8865 tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:58:02.299877 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bd8e40ad-6ed4-456b-804e-aa0d2ecc8865 tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a/action" status: 400 len: 120 microversion: 2.1 time: 0.012408 Jun 20 11:58:02.299877 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 260/543] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 11:58:02 2022] POST /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a/action => generated 120 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 11:58:02.320063 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-08087e1b-25e0-4710-9bb3-c5be7f2a495d tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:02.324181 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-08087e1b-25e0-4710-9bb3-c5be7f2a495d tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] Failed to fetch instance by id 999 {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 20 11:58:02.325944 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-08087e1b-25e0-4710-9bb3-c5be7f2a495d tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] HTTP exception thrown: Instance 999 could not be found. Jun 20 11:58:02.333229 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-08087e1b-25e0-4710-9bb3-c5be7f2a495d tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] Request method failure captured: Jun 20 11:58:02.333229 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Jun 20 11:58:02.333229 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:58:02.333229 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:58:02.333229 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:58:02.333229 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 37 Jun 20 11:58:02.333229 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:58:02.333229 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:58:02.333229 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:58:02.333229 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:58:02.333229 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGCJJkRNMEJUBgA8fv6dzFDrq3IG4hKusSKzTOefPK-bmqE5a_msAcQpazfsw42KsZ6WOxgCXvPxwWTgiiswBtQMNFGSjMDU5dPRY9XEG5ZMuaRDRO9sPc8fcTFfqDEYxhEdmNX_sp9B2Hyh6vY4pvekEImJagYoEXkaI9wWDhGy2H0 Jun 20 11:58:02.333229 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:58:02.333229 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:58:02.333229 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:58:02.333229 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:58:02.333229 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:58:02.333229 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:58:02.333229 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: ed905c1a009342268372f3dc99ceaa36 Jun 20 11:58:02.333229 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-55105741 Jun 20 11:58:02.333229 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member,admin Jun 20 11:58:02.333229 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member,admin Jun 20 11:58:02.334858 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed905c1a009342268372f3dc99ceaa36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed905c1a009342268372f3dc99ceaa36"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ed905c1a009342268372f3dc99ceaa36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ed905c1a009342268372f3dc99ceaa36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:58:02.334858 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersAdminNegativeTestJSON-55105741 Jun 20 11:58:02.334858 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: ed905c1a009342268372f3dc99ceaa36 Jun 20 11:58:02.334858 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-55105741 Jun 20 11:58:02.334858 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersAdminNegativeTestJSON-55105741-project-admin Jun 20 11:58:02.334858 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:58:02.334858 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:58:02.334858 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: d86aa1945a054dc7bc66d680614f146c Jun 20 11:58:02.334858 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersAdminNegativeTestJSON-55105741-project-admin Jun 20 11:58:02.334858 n-d-master-1 devstack@n-api.service[119127]: Jun 20 11:58:02.334858 n-d-master-1 devstack@n-api.service[119127]: {"os-resetState": {"state": "error"}} Jun 20 11:58:02.334858 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 11:58:02.334858 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 999 could not be found. Jun 20 11:58:02.335772 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Jun 20 11:58:02.335772 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:58:02.335772 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:02.335772 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:58:02.335772 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:58:02.335772 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 20 11:58:02.335772 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 20 11:58:02.335772 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jun 20 11:58:02.335772 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:02.335772 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:58:02.335772 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:02.335772 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:02.335772 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:58:02.335772 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:58:02.335772 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:58:02.335772 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:58:02.335772 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:58:02.335772 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:58:02.335772 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:58:02.335772 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:58:02.335772 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Jun 20 11:58:02.337200 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 20 11:58:02.337200 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:58:02.337200 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:58:02.337200 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jun 20 11:58:02.337200 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:02.337200 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:58:02.337200 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:02.337200 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:02.337200 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:58:02.337200 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:58:02.337200 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:58:02.337200 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:58:02.337200 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jun 20 11:58:02.337200 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:02.337200 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-08087e1b-25e0-4710-9bb3-c5be7f2a495d tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:58:02.337200 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-08087e1b-25e0-4710-9bb3-c5be7f2a495d tempest-ServersAdminNegativeTestJSON-55105741 tempest-ServersAdminNegativeTestJSON-55105741-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.025408 Jun 20 11:58:02.338212 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 261/544] 10.222.0.27 () {60 vars in 1178 bytes} [Mon Jun 20 11:58:02 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 11:58:02.347138 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4b20cebd-5d12-444f-b31d-0e3a6e69f0d5 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:02.347760 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4b20cebd-5d12-444f-b31d-0e3a6e69f0d5 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 1cab587f-a3f7-4c56-8645-3ff752168244] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:02.371256 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4b20cebd-5d12-444f-b31d-0e3a6e69f0d5 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:02.375801 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4b20cebd-5d12-444f-b31d-0e3a6e69f0d5 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:02.376847 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4b20cebd-5d12-444f-b31d-0e3a6e69f0d5 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:02.377294 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4b20cebd-5d12-444f-b31d-0e3a6e69f0d5 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:02.439305 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4b20cebd-5d12-444f-b31d-0e3a6e69f0d5 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 1cab587f-a3f7-4c56-8645-3ff752168244] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 11:58:02.670941 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4b20cebd-5d12-444f-b31d-0e3a6e69f0d5 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244" status: 204 len: 0 microversion: 2.1 time: 0.328902 Jun 20 11:58:02.676087 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 262/545] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 11:58:02 2022] DELETE /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:58:02.682587 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-62002c6f-2e51-49a2-8d4c-16b410fdc123 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:02.683622 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-62002c6f-2e51-49a2-8d4c-16b410fdc123 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 1a618cf4-fd96-4675-a17c-899544a65dcf] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:02.694403 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-62002c6f-2e51-49a2-8d4c-16b410fdc123 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:02.695185 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-62002c6f-2e51-49a2-8d4c-16b410fdc123 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:02.696245 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-62002c6f-2e51-49a2-8d4c-16b410fdc123 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:02.696907 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-62002c6f-2e51-49a2-8d4c-16b410fdc123 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:03.070061 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a9b96ce5-3f04-4b7a-ba63-0652ab0f9bab tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374ef56db0ba42a1a3b0ac12aa172b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8964bee8790c43ccb896f404015dcdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:03.082455 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a9b96ce5-3f04-4b7a-ba63-0652ab0f9bab tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] 10.222.0.27 "GET /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8" status: 200 len: 1319 microversion: 2.1 time: 0.846593 Jun 20 11:58:03.084392 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 284/546] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:02 2022] GET /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8 => generated 1319 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:03.090490 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-33dd102f-737b-47e5-8229-ece4633c4f30 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:03.091256 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-33dd102f-737b-47e5-8229-ece4633c4f30 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 1cab587f-a3f7-4c56-8645-3ff752168244] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:03.101851 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-33dd102f-737b-47e5-8229-ece4633c4f30 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:03.102305 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-33dd102f-737b-47e5-8229-ece4633c4f30 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:03.103356 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-33dd102f-737b-47e5-8229-ece4633c4f30 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:03.104009 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-33dd102f-737b-47e5-8229-ece4633c4f30 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:03.214879 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-62002c6f-2e51-49a2-8d4c-16b410fdc123 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:03.236001 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-62002c6f-2e51-49a2-8d4c-16b410fdc123 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/1a618cf4-fd96-4675-a17c-899544a65dcf" status: 200 len: 1319 microversion: 2.1 time: 0.558256 Jun 20 11:58:03.239656 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 263/547] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:02 2022] GET /compute/v2.1/servers/1a618cf4-fd96-4675-a17c-899544a65dcf => generated 1319 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:03.247866 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-006e87e7-66c5-41ba-8641-5cb344a49cae req-172ed7d9-276c-4b79-b205-cdfeb887e080 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a20958a4-d7af-4e1b-bb62-823c89c60073", "tag": "c3c36f49-931c-4f7b-b496-69341db3256c"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:03.285468 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-006e87e7-66c5-41ba-8641-5cb344a49cae req-172ed7d9-276c-4b79-b205-cdfeb887e080 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:03.285918 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-006e87e7-66c5-41ba-8641-5cb344a49cae req-172ed7d9-276c-4b79-b205-cdfeb887e080 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:03.327857 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-006e87e7-66c5-41ba-8641-5cb344a49cae req-172ed7d9-276c-4b79-b205-cdfeb887e080 service nova] Creating event network-changed:c3c36f49-931c-4f7b-b496-69341db3256c for instance a20958a4-d7af-4e1b-bb62-823c89c60073 on n-h1-master-1 Jun 20 11:58:03.333145 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-006e87e7-66c5-41ba-8641-5cb344a49cae req-172ed7d9-276c-4b79-b205-cdfeb887e080 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091289 Jun 20 11:58:03.334038 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 264/548] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:58:03.339631 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-73a4e070-a4eb-41bd-abdf-68635701052e tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:03.340608 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-73a4e070-a4eb-41bd-abdf-68635701052e tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: adee1d54-6e18-4a4e-96ac-48a6fc56345d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:03.349764 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-73a4e070-a4eb-41bd-abdf-68635701052e tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:03.350222 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-73a4e070-a4eb-41bd-abdf-68635701052e tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:03.351009 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-73a4e070-a4eb-41bd-abdf-68635701052e tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:03.351451 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-73a4e070-a4eb-41bd-abdf-68635701052e tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:03.689606 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-33dd102f-737b-47e5-8229-ece4633c4f30 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f069018a1fc24a9fbaac9b58ee7b07fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fc528349c34afbace41593b93d169a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:03.697601 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-33dd102f-737b-47e5-8229-ece4633c4f30 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244" status: 200 len: 1469 microversion: 2.1 time: 0.612092 Jun 20 11:58:03.701579 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 285/549] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:03 2022] GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244 => generated 1469 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:03.716150 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bddb473f-f3eb-48b1-a3f7-e729488aa884 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:03.716852 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bddb473f-f3eb-48b1-a3f7-e729488aa884 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:03.730799 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bddb473f-f3eb-48b1-a3f7-e729488aa884 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:03.731407 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bddb473f-f3eb-48b1-a3f7-e729488aa884 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:03.732563 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bddb473f-f3eb-48b1-a3f7-e729488aa884 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:03.733158 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bddb473f-f3eb-48b1-a3f7-e729488aa884 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:03.929162 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-73a4e070-a4eb-41bd-abdf-68635701052e tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f49b57013f4675a70bac9b13e0a229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8790cc26204435aaf4071847ee00288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:03.938337 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-73a4e070-a4eb-41bd-abdf-68635701052e tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "GET /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d" status: 200 len: 1315 microversion: 2.1 time: 0.603065 Jun 20 11:58:03.961768 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 265/550] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:03 2022] GET /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d => generated 1315 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:04.179511 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e380fecc-7d9e-47db-8700-b5297ed297d5 tempest-QuotasAdminTestV257-1602459792 tempest-QuotasAdminTestV257-1602459792-project-admin] Action: 'update', calling method: .version_select at 0x7f6073f25ca0>, body: {"quota_set": {"ram": "5120"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:04.281820 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e380fecc-7d9e-47db-8700-b5297ed297d5 tempest-QuotasAdminTestV257-1602459792 tempest-QuotasAdminTestV257-1602459792-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:04.282606 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e380fecc-7d9e-47db-8700-b5297ed297d5 tempest-QuotasAdminTestV257-1602459792 tempest-QuotasAdminTestV257-1602459792-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:04.283756 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e380fecc-7d9e-47db-8700-b5297ed297d5 tempest-QuotasAdminTestV257-1602459792 tempest-QuotasAdminTestV257-1602459792-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:04.284336 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e380fecc-7d9e-47db-8700-b5297ed297d5 tempest-QuotasAdminTestV257-1602459792 tempest-QuotasAdminTestV257-1602459792-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:04.361045 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e380fecc-7d9e-47db-8700-b5297ed297d5 tempest-QuotasAdminTestV257-1602459792 tempest-QuotasAdminTestV257-1602459792-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/4190fcf16ed2499ebe70f4118cd85799" status: 200 len: 148 microversion: 2.57 time: 0.397908 Jun 20 11:58:04.364620 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 266/551] 10.222.0.27 () {62 vars in 1302 bytes} [Mon Jun 20 11:58:03 2022] PUT /compute/v2.1/os-quota-sets/4190fcf16ed2499ebe70f4118cd85799 => generated 148 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:58:04.374284 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5007b57d-dc54-485c-9cc6-a5859153e8fc tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:04.375132 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5007b57d-dc54-485c-9cc6-a5859153e8fc tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: ba20d661-74fb-4922-b931-67f76a29e1b8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:04.382087 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5007b57d-dc54-485c-9cc6-a5859153e8fc tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:04.382760 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5007b57d-dc54-485c-9cc6-a5859153e8fc tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:04.383714 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5007b57d-dc54-485c-9cc6-a5859153e8fc tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:04.384272 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5007b57d-dc54-485c-9cc6-a5859153e8fc tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:04.451041 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-bddb473f-f3eb-48b1-a3f7-e729488aa884 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:04.460764 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-bddb473f-f3eb-48b1-a3f7-e729488aa884 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:04.463124 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-bddb473f-f3eb-48b1-a3f7-e729488aa884 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:04.464620 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bddb473f-f3eb-48b1-a3f7-e729488aa884 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f" status: 200 len: 1567 microversion: 2.25 time: 0.761995 Jun 20 11:58:04.466578 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 286/552] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:58:03 2022] GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f => generated 1567 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:58:04.472100 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-36a504c2-15d8-4cbe-a69f-e96aa4acfb7c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:04.473572 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-36a504c2-15d8-4cbe-a69f-e96aa4acfb7c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 1a618cf4-fd96-4675-a17c-899544a65dcf] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:04.482035 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-36a504c2-15d8-4cbe-a69f-e96aa4acfb7c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:04.482745 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-36a504c2-15d8-4cbe-a69f-e96aa4acfb7c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:04.483846 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-36a504c2-15d8-4cbe-a69f-e96aa4acfb7c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:04.484649 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-36a504c2-15d8-4cbe-a69f-e96aa4acfb7c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:04.732646 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5007b57d-dc54-485c-9cc6-a5859153e8fc tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374ef56db0ba42a1a3b0ac12aa172b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8964bee8790c43ccb896f404015dcdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:04.746448 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5007b57d-dc54-485c-9cc6-a5859153e8fc tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] 10.222.0.27 "GET /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8" status: 200 len: 1319 microversion: 2.1 time: 0.380259 Jun 20 11:58:04.759080 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 267/553] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:04 2022] GET /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8 => generated 1319 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:04.764776 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3d70a46b-97cf-40c0-a1dd-dd048d0d5d4c tempest-QuotasAdminTestV257-1602459792 tempest-QuotasAdminTestV257-1602459792-project-admin] Calling method '.version_select at 0x7f6073ca4040>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:04.892790 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3d70a46b-97cf-40c0-a1dd-dd048d0d5d4c tempest-QuotasAdminTestV257-1602459792 tempest-QuotasAdminTestV257-1602459792-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:04.893634 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3d70a46b-97cf-40c0-a1dd-dd048d0d5d4c tempest-QuotasAdminTestV257-1602459792 tempest-QuotasAdminTestV257-1602459792-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:04.894603 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3d70a46b-97cf-40c0-a1dd-dd048d0d5d4c tempest-QuotasAdminTestV257-1602459792 tempest-QuotasAdminTestV257-1602459792-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:04.895618 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3d70a46b-97cf-40c0-a1dd-dd048d0d5d4c tempest-QuotasAdminTestV257-1602459792 tempest-QuotasAdminTestV257-1602459792-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:04.908853 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-36a504c2-15d8-4cbe-a69f-e96aa4acfb7c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:04.916098 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:58:04.919159 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-36a504c2-15d8-4cbe-a69f-e96aa4acfb7c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/1a618cf4-fd96-4675-a17c-899544a65dcf" status: 200 len: 1319 microversion: 2.1 time: 0.450890 Jun 20 11:58:04.930094 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 287/554] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:04 2022] GET /compute/v2.1/servers/1a618cf4-fd96-4675-a17c-899544a65dcf => generated 1319 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:04.939117 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-edffa565-d96c-4d59-9215-fd06184a71ba tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:04.940660 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-edffa565-d96c-4d59-9215-fd06184a71ba tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 1cab587f-a3f7-4c56-8645-3ff752168244] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:04.945361 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3d70a46b-97cf-40c0-a1dd-dd048d0d5d4c tempest-QuotasAdminTestV257-1602459792 tempest-QuotasAdminTestV257-1602459792-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/4190fcf16ed2499ebe70f4118cd85799/detail" status: 200 len: 463 microversion: 2.57 time: 0.186432 Jun 20 11:58:04.947117 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 268/555] 10.222.0.27 () {60 vars in 1303 bytes} [Mon Jun 20 11:58:04 2022] GET /compute/v2.1/os-quota-sets/4190fcf16ed2499ebe70f4118cd85799/detail => generated 463 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:58:04.964540 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-edffa565-d96c-4d59-9215-fd06184a71ba tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:04.965590 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-eb9e9a45-ea31-4e85-8497-6d55616c1321 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:04.966295 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-edffa565-d96c-4d59-9215-fd06184a71ba tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:04.967297 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-edffa565-d96c-4d59-9215-fd06184a71ba tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:04.967606 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-eb9e9a45-ea31-4e85-8497-6d55616c1321 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: adee1d54-6e18-4a4e-96ac-48a6fc56345d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:04.967750 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-edffa565-d96c-4d59-9215-fd06184a71ba tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:04.976935 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb9e9a45-ea31-4e85-8497-6d55616c1321 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:04.977673 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb9e9a45-ea31-4e85-8497-6d55616c1321 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:04.978622 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb9e9a45-ea31-4e85-8497-6d55616c1321 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:04.979208 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb9e9a45-ea31-4e85-8497-6d55616c1321 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:05.212589 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-eb9e9a45-ea31-4e85-8497-6d55616c1321 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f49b57013f4675a70bac9b13e0a229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8790cc26204435aaf4071847ee00288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:05.224708 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-eb9e9a45-ea31-4e85-8497-6d55616c1321 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "GET /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d" status: 200 len: 1321 microversion: 2.1 time: 0.267649 Jun 20 11:58:05.227304 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 269/556] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:04 2022] GET /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d => generated 1321 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:05.270479 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f370ef7b-e22b-4215-b679-2fb75a4253c4 tempest-QuotasAdminTestV257-1602459792 tempest-QuotasAdminTestV257-1602459792-project-admin] Action: 'update', calling method: .version_select at 0x7f6073b97430>, body: {"quota_set": {"ram": "2048"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:05.304929 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-edffa565-d96c-4d59-9215-fd06184a71ba tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f069018a1fc24a9fbaac9b58ee7b07fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fc528349c34afbace41593b93d169a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:05.314778 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-edffa565-d96c-4d59-9215-fd06184a71ba tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244" status: 200 len: 1469 microversion: 2.1 time: 0.382692 Jun 20 11:58:05.318432 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 288/557] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:04 2022] GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244 => generated 1469 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:05.347545 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f370ef7b-e22b-4215-b679-2fb75a4253c4 tempest-QuotasAdminTestV257-1602459792 tempest-QuotasAdminTestV257-1602459792-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:05.348086 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f370ef7b-e22b-4215-b679-2fb75a4253c4 tempest-QuotasAdminTestV257-1602459792 tempest-QuotasAdminTestV257-1602459792-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:05.349211 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f370ef7b-e22b-4215-b679-2fb75a4253c4 tempest-QuotasAdminTestV257-1602459792 tempest-QuotasAdminTestV257-1602459792-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:05.349862 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f370ef7b-e22b-4215-b679-2fb75a4253c4 tempest-QuotasAdminTestV257-1602459792 tempest-QuotasAdminTestV257-1602459792-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:05.390829 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f370ef7b-e22b-4215-b679-2fb75a4253c4 tempest-QuotasAdminTestV257-1602459792 tempest-QuotasAdminTestV257-1602459792-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:05.391411 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f370ef7b-e22b-4215-b679-2fb75a4253c4 tempest-QuotasAdminTestV257-1602459792 tempest-QuotasAdminTestV257-1602459792-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:05.392374 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f370ef7b-e22b-4215-b679-2fb75a4253c4 tempest-QuotasAdminTestV257-1602459792 tempest-QuotasAdminTestV257-1602459792-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:05.393018 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f370ef7b-e22b-4215-b679-2fb75a4253c4 tempest-QuotasAdminTestV257-1602459792 tempest-QuotasAdminTestV257-1602459792-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:05.414591 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:58:05.471801 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f370ef7b-e22b-4215-b679-2fb75a4253c4 tempest-QuotasAdminTestV257-1602459792 tempest-QuotasAdminTestV257-1602459792-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/4190fcf16ed2499ebe70f4118cd85799?user_id=cb5d687ffe5c4303a4bc196244087914" status: 200 len: 148 microversion: 2.57 time: 0.205118 Jun 20 11:58:05.477502 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 270/558] 10.222.0.27 () {62 vars in 1383 bytes} [Mon Jun 20 11:58:05 2022] PUT /compute/v2.1/os-quota-sets/4190fcf16ed2499ebe70f4118cd85799?user_id=cb5d687ffe5c4303a4bc196244087914 => generated 148 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:58:05.482571 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9f4a7ebc-996b-4106-b222-daff33889d14 tempest-QuotasAdminTestV257-1602459792 tempest-QuotasAdminTestV257-1602459792-project-admin] Calling method '.version_select at 0x7f6073b78790>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:05.484343 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-890cc734-bfc5-47a9-80d3-d6ac8b2bc006 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:05.484996 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-890cc734-bfc5-47a9-80d3-d6ac8b2bc006 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:05.492500 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-890cc734-bfc5-47a9-80d3-d6ac8b2bc006 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:05.493013 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-890cc734-bfc5-47a9-80d3-d6ac8b2bc006 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:05.493994 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-890cc734-bfc5-47a9-80d3-d6ac8b2bc006 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:05.494579 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-890cc734-bfc5-47a9-80d3-d6ac8b2bc006 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:05.582226 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9f4a7ebc-996b-4106-b222-daff33889d14 tempest-QuotasAdminTestV257-1602459792 tempest-QuotasAdminTestV257-1602459792-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/4190fcf16ed2499ebe70f4118cd85799?user_id=cb5d687ffe5c4303a4bc196244087914" status: 200 len: 190 microversion: 2.57 time: 0.103430 Jun 20 11:58:05.583157 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 289/559] 10.222.0.27 () {60 vars in 1363 bytes} [Mon Jun 20 11:58:05 2022] GET /compute/v2.1/os-quota-sets/4190fcf16ed2499ebe70f4118cd85799?user_id=cb5d687ffe5c4303a4bc196244087914 => generated 190 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:58:05.763447 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c47970fa-b41d-4f60-b49a-0871163d4aba tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:05.764070 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c47970fa-b41d-4f60-b49a-0871163d4aba tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: ba20d661-74fb-4922-b931-67f76a29e1b8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:05.767215 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:58:05.791111 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c47970fa-b41d-4f60-b49a-0871163d4aba tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:05.791606 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c47970fa-b41d-4f60-b49a-0871163d4aba tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:05.796695 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c47970fa-b41d-4f60-b49a-0871163d4aba tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:05.803408 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c47970fa-b41d-4f60-b49a-0871163d4aba tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:05.988404 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-890cc734-bfc5-47a9-80d3-d6ac8b2bc006 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:06.002083 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-890cc734-bfc5-47a9-80d3-d6ac8b2bc006 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:06.012652 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-890cc734-bfc5-47a9-80d3-d6ac8b2bc006 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:06.016096 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-890cc734-bfc5-47a9-80d3-d6ac8b2bc006 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f" status: 200 len: 1567 microversion: 2.25 time: 0.535968 Jun 20 11:58:06.029997 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 271/560] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:58:05 2022] GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f => generated 1567 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 11:58:06.037825 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-423305d9-9715-4ff4-a1fe-185912180c94 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:06.038844 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-423305d9-9715-4ff4-a1fe-185912180c94 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 1a618cf4-fd96-4675-a17c-899544a65dcf] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:06.046481 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-423305d9-9715-4ff4-a1fe-185912180c94 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:06.047294 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-423305d9-9715-4ff4-a1fe-185912180c94 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:06.049541 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-423305d9-9715-4ff4-a1fe-185912180c94 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:06.050174 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-423305d9-9715-4ff4-a1fe-185912180c94 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:06.285700 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c47970fa-b41d-4f60-b49a-0871163d4aba tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374ef56db0ba42a1a3b0ac12aa172b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8964bee8790c43ccb896f404015dcdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:06.297209 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c47970fa-b41d-4f60-b49a-0871163d4aba tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] 10.222.0.27 "GET /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8" status: 200 len: 1319 microversion: 2.1 time: 0.537569 Jun 20 11:58:06.309580 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 290/561] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:05 2022] GET /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8 => generated 1319 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:06.315111 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e3c5efb2-c402-468a-9094-501275614962 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:06.315962 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e3c5efb2-c402-468a-9094-501275614962 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: adee1d54-6e18-4a4e-96ac-48a6fc56345d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:06.323091 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e3c5efb2-c402-468a-9094-501275614962 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:06.323803 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e3c5efb2-c402-468a-9094-501275614962 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:06.325077 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e3c5efb2-c402-468a-9094-501275614962 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:06.325689 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e3c5efb2-c402-468a-9094-501275614962 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:06.366242 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-423305d9-9715-4ff4-a1fe-185912180c94 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:06.384517 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-423305d9-9715-4ff4-a1fe-185912180c94 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/1a618cf4-fd96-4675-a17c-899544a65dcf" status: 200 len: 1319 microversion: 2.1 time: 0.352939 Jun 20 11:58:06.385368 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 272/562] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:06 2022] GET /compute/v2.1/servers/1a618cf4-fd96-4675-a17c-899544a65dcf => generated 1319 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:06.393895 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-60e9c5b0-ec49-44ea-a16c-56002d1ab2ec tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:06.394517 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-60e9c5b0-ec49-44ea-a16c-56002d1ab2ec tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 1cab587f-a3f7-4c56-8645-3ff752168244] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:06.444736 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-60e9c5b0-ec49-44ea-a16c-56002d1ab2ec tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:06.445482 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-60e9c5b0-ec49-44ea-a16c-56002d1ab2ec tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:06.446420 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-60e9c5b0-ec49-44ea-a16c-56002d1ab2ec tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:06.448659 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-60e9c5b0-ec49-44ea-a16c-56002d1ab2ec tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:06.803686 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e3c5efb2-c402-468a-9094-501275614962 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f49b57013f4675a70bac9b13e0a229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8790cc26204435aaf4071847ee00288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:06.814230 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e3c5efb2-c402-468a-9094-501275614962 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "GET /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d" status: 200 len: 1388 microversion: 2.1 time: 0.501681 Jun 20 11:58:06.814830 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 291/563] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:06 2022] GET /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d => generated 1388 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:07.000410 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-1bb355ae-ff27-49af-bdde-b2930f4b7132 req-76b4cbe8-565e-49a7-99e5-36ff782845ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba20d661-74fb-4922-b931-67f76a29e1b8", "name": "network-vif-plugged", "status": "completed", "tag": "5f78b71e-9034-48d7-9a62-92ffa6500f59"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:07.013788 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-1bb355ae-ff27-49af-bdde-b2930f4b7132 req-76b4cbe8-565e-49a7-99e5-36ff782845ec service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:07.019397 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-1bb355ae-ff27-49af-bdde-b2930f4b7132 req-76b4cbe8-565e-49a7-99e5-36ff782845ec service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:07.033178 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-1bb355ae-ff27-49af-bdde-b2930f4b7132 req-76b4cbe8-565e-49a7-99e5-36ff782845ec service nova] Creating event network-vif-plugged:5f78b71e-9034-48d7-9a62-92ffa6500f59 for instance ba20d661-74fb-4922-b931-67f76a29e1b8 on n-h1-master-1 Jun 20 11:58:07.050285 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-1bb355ae-ff27-49af-bdde-b2930f4b7132 req-76b4cbe8-565e-49a7-99e5-36ff782845ec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053929 Jun 20 11:58:07.054017 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-60e9c5b0-ec49-44ea-a16c-56002d1ab2ec tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f069018a1fc24a9fbaac9b58ee7b07fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fc528349c34afbace41593b93d169a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:07.060593 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 292/564] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 11:58:07.066972 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ea3b7e2d-7b54-42dd-a841-4be3684b3ecb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:07.067884 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ea3b7e2d-7b54-42dd-a841-4be3684b3ecb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:07.074613 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-60e9c5b0-ec49-44ea-a16c-56002d1ab2ec tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244" status: 200 len: 1469 microversion: 2.1 time: 0.686386 Jun 20 11:58:07.080749 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ea3b7e2d-7b54-42dd-a841-4be3684b3ecb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:07.088978 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ea3b7e2d-7b54-42dd-a841-4be3684b3ecb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:07.089516 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 273/565] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:06 2022] GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244 => generated 1469 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:07.090506 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ea3b7e2d-7b54-42dd-a841-4be3684b3ecb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:07.090961 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ea3b7e2d-7b54-42dd-a841-4be3684b3ecb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:07.321659 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8e5b9424-72ca-46b3-8189-6d2045579429 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:07.323934 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8e5b9424-72ca-46b3-8189-6d2045579429 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: ba20d661-74fb-4922-b931-67f76a29e1b8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:07.352118 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8e5b9424-72ca-46b3-8189-6d2045579429 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:07.352736 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8e5b9424-72ca-46b3-8189-6d2045579429 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:07.354206 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8e5b9424-72ca-46b3-8189-6d2045579429 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:07.355708 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8e5b9424-72ca-46b3-8189-6d2045579429 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:07.955987 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8e5b9424-72ca-46b3-8189-6d2045579429 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374ef56db0ba42a1a3b0ac12aa172b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8964bee8790c43ccb896f404015dcdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:07.972822 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8e5b9424-72ca-46b3-8189-6d2045579429 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] 10.222.0.27 "GET /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8" status: 200 len: 1319 microversion: 2.1 time: 0.660081 Jun 20 11:58:07.977059 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 274/566] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:07 2022] GET /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8 => generated 1319 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:07.984165 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9b502103-5f8c-485d-aaa6-8bebb4872582 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:07.985054 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9b502103-5f8c-485d-aaa6-8bebb4872582 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 1a618cf4-fd96-4675-a17c-899544a65dcf] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:07.994717 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b502103-5f8c-485d-aaa6-8bebb4872582 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:07.995564 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b502103-5f8c-485d-aaa6-8bebb4872582 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:07.996633 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b502103-5f8c-485d-aaa6-8bebb4872582 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:07.997402 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b502103-5f8c-485d-aaa6-8bebb4872582 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:08.151239 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ea3b7e2d-7b54-42dd-a841-4be3684b3ecb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:08.162648 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ea3b7e2d-7b54-42dd-a841-4be3684b3ecb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:08.164342 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ea3b7e2d-7b54-42dd-a841-4be3684b3ecb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:08.166007 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ea3b7e2d-7b54-42dd-a841-4be3684b3ecb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f" status: 200 len: 1567 microversion: 2.25 time: 1.103744 Jun 20 11:58:08.170763 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 293/567] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:58:07 2022] GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f => generated 1567 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:58:08.175168 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-18f1544f-a4a3-49fa-85b5-0203151c2ff8 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:08.176027 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-18f1544f-a4a3-49fa-85b5-0203151c2ff8 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: adee1d54-6e18-4a4e-96ac-48a6fc56345d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:08.184076 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-18f1544f-a4a3-49fa-85b5-0203151c2ff8 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:08.184076 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-18f1544f-a4a3-49fa-85b5-0203151c2ff8 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:08.185417 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-18f1544f-a4a3-49fa-85b5-0203151c2ff8 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:08.186067 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-18f1544f-a4a3-49fa-85b5-0203151c2ff8 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:08.734467 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-18f1544f-a4a3-49fa-85b5-0203151c2ff8 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f49b57013f4675a70bac9b13e0a229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8790cc26204435aaf4071847ee00288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:08.772104 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9b502103-5f8c-485d-aaa6-8bebb4872582 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:08.776679 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-18f1544f-a4a3-49fa-85b5-0203151c2ff8 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "GET /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d" status: 200 len: 1388 microversion: 2.1 time: 0.601130 Jun 20 11:58:08.779954 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 294/568] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:08 2022] GET /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d => generated 1388 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:08.791440 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9b502103-5f8c-485d-aaa6-8bebb4872582 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/1a618cf4-fd96-4675-a17c-899544a65dcf" status: 200 len: 1319 microversion: 2.1 time: 0.812360 Jun 20 11:58:08.805840 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 275/569] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:07 2022] GET /compute/v2.1/servers/1a618cf4-fd96-4675-a17c-899544a65dcf => generated 1319 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:08.807478 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-fa08e35a-2a00-4b3c-9727-23a31bed137c req-8f7df946-f211-4a99-a352-ff9c5555d1b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddbdd7f1-6b17-4f7a-9793-873b18c7a92f", "name": "network-vif-unplugged", "status": "completed", "tag": "be0d0765-87a0-4732-987c-66193517041e"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:08.832547 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-fa08e35a-2a00-4b3c-9727-23a31bed137c req-8f7df946-f211-4a99-a352-ff9c5555d1b6 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:08.834397 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-fa08e35a-2a00-4b3c-9727-23a31bed137c req-8f7df946-f211-4a99-a352-ff9c5555d1b6 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:08.848729 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2ac296f6-ab96-4e92-a534-b6764d16c3ca tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:08.872444 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2ac296f6-ab96-4e92-a534-b6764d16c3ca tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 1cab587f-a3f7-4c56-8645-3ff752168244] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:08.877153 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-fa08e35a-2a00-4b3c-9727-23a31bed137c req-8f7df946-f211-4a99-a352-ff9c5555d1b6 service nova] Creating event network-vif-unplugged:be0d0765-87a0-4732-987c-66193517041e for instance ddbdd7f1-6b17-4f7a-9793-873b18c7a92f on n-h1-master-1 Jun 20 11:58:08.892795 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2ac296f6-ab96-4e92-a534-b6764d16c3ca tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:08.893641 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2ac296f6-ab96-4e92-a534-b6764d16c3ca tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:08.895160 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2ac296f6-ab96-4e92-a534-b6764d16c3ca tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:08.896132 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2ac296f6-ab96-4e92-a534-b6764d16c3ca tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:08.918355 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-fa08e35a-2a00-4b3c-9727-23a31bed137c req-8f7df946-f211-4a99-a352-ff9c5555d1b6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.132274 Jun 20 11:58:08.921142 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 295/570] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:58:08.934845 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-2f845ef1-b0d8-4ef7-a227-c72b4592dcbe req-0a9c0521-ad50-46e6-81ef-c76f57afcaf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adee1d54-6e18-4a4e-96ac-48a6fc56345d", "tag": "194f5e91-83a7-4654-843b-cd734d1661fd"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:08.964182 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-2f845ef1-b0d8-4ef7-a227-c72b4592dcbe req-0a9c0521-ad50-46e6-81ef-c76f57afcaf0 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:08.965398 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-2f845ef1-b0d8-4ef7-a227-c72b4592dcbe req-0a9c0521-ad50-46e6-81ef-c76f57afcaf0 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:09.013147 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-2f845ef1-b0d8-4ef7-a227-c72b4592dcbe req-0a9c0521-ad50-46e6-81ef-c76f57afcaf0 service nova] Creating event network-changed:194f5e91-83a7-4654-843b-cd734d1661fd for instance adee1d54-6e18-4a4e-96ac-48a6fc56345d on n-h1-master-1 Jun 20 11:58:09.018898 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-2f845ef1-b0d8-4ef7-a227-c72b4592dcbe req-0a9c0521-ad50-46e6-81ef-c76f57afcaf0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094020 Jun 20 11:58:09.020329 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 296/571] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:58:09.027041 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e6e0cf4c-aa15-4645-b6f4-2f691a16ea96 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:09.028875 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e6e0cf4c-aa15-4645-b6f4-2f691a16ea96 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: ba20d661-74fb-4922-b931-67f76a29e1b8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:09.037944 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e6e0cf4c-aa15-4645-b6f4-2f691a16ea96 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:09.038639 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e6e0cf4c-aa15-4645-b6f4-2f691a16ea96 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:09.041420 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e6e0cf4c-aa15-4645-b6f4-2f691a16ea96 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:09.045679 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e6e0cf4c-aa15-4645-b6f4-2f691a16ea96 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:09.341833 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e6e0cf4c-aa15-4645-b6f4-2f691a16ea96 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374ef56db0ba42a1a3b0ac12aa172b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8964bee8790c43ccb896f404015dcdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:09.356712 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e6e0cf4c-aa15-4645-b6f4-2f691a16ea96 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] 10.222.0.27 "GET /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8" status: 200 len: 1319 microversion: 2.1 time: 0.333352 Jun 20 11:58:09.357478 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 297/572] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:09 2022] GET /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8 => generated 1319 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:09.366547 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8be56a90-9a72-4eb3-ae01-6a6bff264045 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:09.367788 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8be56a90-9a72-4eb3-ae01-6a6bff264045 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:09.377166 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8be56a90-9a72-4eb3-ae01-6a6bff264045 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:09.377974 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8be56a90-9a72-4eb3-ae01-6a6bff264045 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:09.378594 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8be56a90-9a72-4eb3-ae01-6a6bff264045 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:09.379291 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8be56a90-9a72-4eb3-ae01-6a6bff264045 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:09.690815 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8be56a90-9a72-4eb3-ae01-6a6bff264045 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:09.700383 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8be56a90-9a72-4eb3-ae01-6a6bff264045 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:09.701987 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8be56a90-9a72-4eb3-ae01-6a6bff264045 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:09.703068 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8be56a90-9a72-4eb3-ae01-6a6bff264045 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f" status: 200 len: 1567 microversion: 2.25 time: 0.344401 Jun 20 11:58:09.703630 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 298/573] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:58:09 2022] GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f => generated 1567 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:58:09.794275 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1fcb7243-7bcf-4ec2-9e59-689e61238093 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:09.795117 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1fcb7243-7bcf-4ec2-9e59-689e61238093 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: adee1d54-6e18-4a4e-96ac-48a6fc56345d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:09.802053 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1fcb7243-7bcf-4ec2-9e59-689e61238093 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:09.802737 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1fcb7243-7bcf-4ec2-9e59-689e61238093 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:09.803670 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1fcb7243-7bcf-4ec2-9e59-689e61238093 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:09.804483 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1fcb7243-7bcf-4ec2-9e59-689e61238093 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:10.028700 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1fcb7243-7bcf-4ec2-9e59-689e61238093 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f49b57013f4675a70bac9b13e0a229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8790cc26204435aaf4071847ee00288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:10.037571 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1fcb7243-7bcf-4ec2-9e59-689e61238093 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "GET /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d" status: 200 len: 1388 microversion: 2.1 time: 0.247591 Jun 20 11:58:10.047875 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 299/574] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:09 2022] GET /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d => generated 1388 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:10.053347 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5506f295-ba16-4535-b8f6-f45ab88f21da tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:10.054169 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5506f295-ba16-4535-b8f6-f45ab88f21da tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 1a618cf4-fd96-4675-a17c-899544a65dcf] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:10.061423 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5506f295-ba16-4535-b8f6-f45ab88f21da tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:10.062247 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5506f295-ba16-4535-b8f6-f45ab88f21da tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:10.063396 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5506f295-ba16-4535-b8f6-f45ab88f21da tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:10.064499 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5506f295-ba16-4535-b8f6-f45ab88f21da tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:10.094190 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2ac296f6-ab96-4e92-a534-b6764d16c3ca tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f069018a1fc24a9fbaac9b58ee7b07fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fc528349c34afbace41593b93d169a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:10.109209 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2ac296f6-ab96-4e92-a534-b6764d16c3ca tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244" status: 200 len: 1469 microversion: 2.1 time: 1.283085 Jun 20 11:58:10.123056 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 276/575] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:08 2022] GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244 => generated 1469 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:10.126615 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:58:10.380988 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-58fd38f4-1217-406e-b72a-b171351be864 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:10.382079 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-58fd38f4-1217-406e-b72a-b171351be864 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: ba20d661-74fb-4922-b931-67f76a29e1b8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:10.400826 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-58fd38f4-1217-406e-b72a-b171351be864 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:10.404931 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-58fd38f4-1217-406e-b72a-b171351be864 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:10.406107 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-58fd38f4-1217-406e-b72a-b171351be864 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:10.407684 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-58fd38f4-1217-406e-b72a-b171351be864 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:10.547949 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5506f295-ba16-4535-b8f6-f45ab88f21da tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:10.556974 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5506f295-ba16-4535-b8f6-f45ab88f21da tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/1a618cf4-fd96-4675-a17c-899544a65dcf" status: 200 len: 1319 microversion: 2.1 time: 0.507615 Jun 20 11:58:10.571115 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 300/576] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:10 2022] GET /compute/v2.1/servers/1a618cf4-fd96-4675-a17c-899544a65dcf => generated 1319 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:10.728377 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c8ab9889-7e80-4add-956a-286aad67f9f4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:10.729926 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c8ab9889-7e80-4add-956a-286aad67f9f4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:10.748551 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c8ab9889-7e80-4add-956a-286aad67f9f4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:10.750587 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c8ab9889-7e80-4add-956a-286aad67f9f4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:10.754603 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c8ab9889-7e80-4add-956a-286aad67f9f4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:10.758386 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c8ab9889-7e80-4add-956a-286aad67f9f4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:11.106530 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c8ab9889-7e80-4add-956a-286aad67f9f4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:11.131814 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c8ab9889-7e80-4add-956a-286aad67f9f4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:11.134356 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c8ab9889-7e80-4add-956a-286aad67f9f4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:11.142693 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c8ab9889-7e80-4add-956a-286aad67f9f4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f" status: 200 len: 1567 microversion: 2.25 time: 0.423691 Jun 20 11:58:11.146308 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 301/577] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:58:10 2022] GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f => generated 1567 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:58:11.163483 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1bf0e9a1-38cc-49e0-b4cc-aa879ebc6cdd tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:11.165666 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1bf0e9a1-38cc-49e0-b4cc-aa879ebc6cdd tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: adee1d54-6e18-4a4e-96ac-48a6fc56345d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:11.168539 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-58fd38f4-1217-406e-b72a-b171351be864 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374ef56db0ba42a1a3b0ac12aa172b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8964bee8790c43ccb896f404015dcdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:11.177212 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-58fd38f4-1217-406e-b72a-b171351be864 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] 10.222.0.27 "GET /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8" status: 200 len: 1468 microversion: 2.1 time: 0.807249 Jun 20 11:58:11.185080 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 277/578] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:10 2022] GET /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8 => generated 1468 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:11.195684 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-46b99484-50ac-4c2f-a71f-7f0c147dd8bd req-8f2268eb-a32b-45c5-95ad-4075caca1dd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a20958a4-d7af-4e1b-bb62-823c89c60073", "name": "network-vif-plugged", "status": "completed", "tag": "c3c36f49-931c-4f7b-b496-69341db3256c"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:11.201025 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1bf0e9a1-38cc-49e0-b4cc-aa879ebc6cdd tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:11.201629 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1bf0e9a1-38cc-49e0-b4cc-aa879ebc6cdd tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:11.202719 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1bf0e9a1-38cc-49e0-b4cc-aa879ebc6cdd tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:11.204822 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1bf0e9a1-38cc-49e0-b4cc-aa879ebc6cdd tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:11.214899 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-46b99484-50ac-4c2f-a71f-7f0c147dd8bd req-8f2268eb-a32b-45c5-95ad-4075caca1dd8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:11.215372 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-46b99484-50ac-4c2f-a71f-7f0c147dd8bd req-8f2268eb-a32b-45c5-95ad-4075caca1dd8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:11.238540 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-46b99484-50ac-4c2f-a71f-7f0c147dd8bd req-8f2268eb-a32b-45c5-95ad-4075caca1dd8 service nova] Creating event network-vif-plugged:c3c36f49-931c-4f7b-b496-69341db3256c for instance a20958a4-d7af-4e1b-bb62-823c89c60073 on n-h1-master-1 Jun 20 11:58:11.256607 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-46b99484-50ac-4c2f-a71f-7f0c147dd8bd req-8f2268eb-a32b-45c5-95ad-4075caca1dd8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069770 Jun 20 11:58:11.257671 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 278/579] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:58:11.269668 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-29d59255-ca74-4bf4-92b0-83ebc5eae873 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:11.270581 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-29d59255-ca74-4bf4-92b0-83ebc5eae873 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 1cab587f-a3f7-4c56-8645-3ff752168244] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:11.292037 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-29d59255-ca74-4bf4-92b0-83ebc5eae873 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:11.292532 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-29d59255-ca74-4bf4-92b0-83ebc5eae873 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:11.294080 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-29d59255-ca74-4bf4-92b0-83ebc5eae873 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:11.294609 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-29d59255-ca74-4bf4-92b0-83ebc5eae873 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:11.352258 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-29d59255-ca74-4bf4-92b0-83ebc5eae873 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:11.353130 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-29d59255-ca74-4bf4-92b0-83ebc5eae873 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:11.354681 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-29d59255-ca74-4bf4-92b0-83ebc5eae873 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lazy-loading 'fault' on Instance uuid 1cab587f-a3f7-4c56-8645-3ff752168244 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:58:11.439905 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-29d59255-ca74-4bf4-92b0-83ebc5eae873 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f069018a1fc24a9fbaac9b58ee7b07fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fc528349c34afbace41593b93d169a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:11.451090 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-29d59255-ca74-4bf4-92b0-83ebc5eae873 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244" status: 200 len: 1312 microversion: 2.1 time: 0.191803 Jun 20 11:58:11.456672 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1bf0e9a1-38cc-49e0-b4cc-aa879ebc6cdd tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f49b57013f4675a70bac9b13e0a229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8790cc26204435aaf4071847ee00288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:11.456877 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 279/580] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:11 2022] GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244 => generated 1312 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:11.469590 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-ca398c23-f763-4795-a568-8136dac06a3e req-74bf5217-65b2-4a7d-8cd6-3f64b4ab61be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cab587f-a3f7-4c56-8645-3ff752168244", "name": "network-vif-deleted", "tag": "4c34624e-8618-4536-b887-d13e05a1b590"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:11.473487 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1bf0e9a1-38cc-49e0-b4cc-aa879ebc6cdd tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "GET /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d" status: 200 len: 1388 microversion: 2.1 time: 0.324779 Jun 20 11:58:11.490284 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 302/581] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:11 2022] GET /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d => generated 1388 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:11.490284 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-56a178e0-4c37-4eed-b85a-ee776b08e1e3 tempest-DeleteServersAdminTestJSON-1168729359 tempest-DeleteServersAdminTestJSON-1168729359-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:11.490284 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-56a178e0-4c37-4eed-b85a-ee776b08e1e3 tempest-DeleteServersAdminTestJSON-1168729359 tempest-DeleteServersAdminTestJSON-1168729359-project-admin] [instance: ba20d661-74fb-4922-b931-67f76a29e1b8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:11.501823 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ca398c23-f763-4795-a568-8136dac06a3e req-74bf5217-65b2-4a7d-8cd6-3f64b4ab61be service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:11.502657 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ca398c23-f763-4795-a568-8136dac06a3e req-74bf5217-65b2-4a7d-8cd6-3f64b4ab61be service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:11.505118 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-56a178e0-4c37-4eed-b85a-ee776b08e1e3 tempest-DeleteServersAdminTestJSON-1168729359 tempest-DeleteServersAdminTestJSON-1168729359-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:11.505579 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-56a178e0-4c37-4eed-b85a-ee776b08e1e3 tempest-DeleteServersAdminTestJSON-1168729359 tempest-DeleteServersAdminTestJSON-1168729359-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:11.506381 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-56a178e0-4c37-4eed-b85a-ee776b08e1e3 tempest-DeleteServersAdminTestJSON-1168729359 tempest-DeleteServersAdminTestJSON-1168729359-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:11.506826 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-56a178e0-4c37-4eed-b85a-ee776b08e1e3 tempest-DeleteServersAdminTestJSON-1168729359 tempest-DeleteServersAdminTestJSON-1168729359-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:11.533240 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-ca398c23-f763-4795-a568-8136dac06a3e req-74bf5217-65b2-4a7d-8cd6-3f64b4ab61be service nova] Creating event network-vif-deleted:4c34624e-8618-4536-b887-d13e05a1b590 for instance 1cab587f-a3f7-4c56-8645-3ff752168244 on n-h2-master-1 Jun 20 11:58:11.551633 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-ca398c23-f763-4795-a568-8136dac06a3e req-74bf5217-65b2-4a7d-8cd6-3f64b4ab61be service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092537 Jun 20 11:58:11.553212 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 280/582] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:58:11.582210 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7e2a67d2-b4e9-49f1-8d00-58fcbbfa6ed1 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:11.583285 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7e2a67d2-b4e9-49f1-8d00-58fcbbfa6ed1 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 1a618cf4-fd96-4675-a17c-899544a65dcf] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:11.597354 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7e2a67d2-b4e9-49f1-8d00-58fcbbfa6ed1 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:11.603972 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7e2a67d2-b4e9-49f1-8d00-58fcbbfa6ed1 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:11.605269 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7e2a67d2-b4e9-49f1-8d00-58fcbbfa6ed1 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:11.606756 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7e2a67d2-b4e9-49f1-8d00-58fcbbfa6ed1 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:11.723457 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-56a178e0-4c37-4eed-b85a-ee776b08e1e3 tempest-DeleteServersAdminTestJSON-1168729359 tempest-DeleteServersAdminTestJSON-1168729359-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8/action" status: 202 len: 0 microversion: 2.1 time: 0.239692 Jun 20 11:58:11.729647 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 303/583] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 11:58:11 2022] POST /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:58:11.739364 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ddddece7-e6e8-4f7d-b083-661665cbb77c tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:11.741256 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ddddece7-e6e8-4f7d-b083-661665cbb77c tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: ba20d661-74fb-4922-b931-67f76a29e1b8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:11.751439 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ddddece7-e6e8-4f7d-b083-661665cbb77c tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:11.752625 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ddddece7-e6e8-4f7d-b083-661665cbb77c tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:11.753868 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ddddece7-e6e8-4f7d-b083-661665cbb77c tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:11.754574 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ddddece7-e6e8-4f7d-b083-661665cbb77c tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:11.822751 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ddddece7-e6e8-4f7d-b083-661665cbb77c tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:11.824371 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ddddece7-e6e8-4f7d-b083-661665cbb77c tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:11.825444 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-ddddece7-e6e8-4f7d-b083-661665cbb77c tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lazy-loading 'fault' on Instance uuid ba20d661-74fb-4922-b931-67f76a29e1b8 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:58:12.193186 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7e2a67d2-b4e9-49f1-8d00-58fcbbfa6ed1 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:12.212166 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7e2a67d2-b4e9-49f1-8d00-58fcbbfa6ed1 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/1a618cf4-fd96-4675-a17c-899544a65dcf" status: 200 len: 1319 microversion: 2.1 time: 0.636683 Jun 20 11:58:12.222290 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 281/584] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:11 2022] GET /compute/v2.1/servers/1a618cf4-fd96-4675-a17c-899544a65dcf => generated 1319 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:58:12.227697 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1bfb0001-6766-42c9-924c-bb7f68da4c35 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:12.228489 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1bfb0001-6766-42c9-924c-bb7f68da4c35 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:12.230186 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ddddece7-e6e8-4f7d-b083-661665cbb77c tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374ef56db0ba42a1a3b0ac12aa172b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8964bee8790c43ccb896f404015dcdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:12.243216 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1bfb0001-6766-42c9-924c-bb7f68da4c35 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:12.243842 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1bfb0001-6766-42c9-924c-bb7f68da4c35 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:12.244900 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ddddece7-e6e8-4f7d-b083-661665cbb77c tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] 10.222.0.27 "GET /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8" status: 200 len: 1451 microversion: 2.1 time: 0.512262 Jun 20 11:58:12.245168 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1bfb0001-6766-42c9-924c-bb7f68da4c35 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:12.245828 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 304/585] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:11 2022] GET /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8 => generated 1451 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:12.245945 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1bfb0001-6766-42c9-924c-bb7f68da4c35 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:12.272124 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-70eb0cff-279b-4679-9a80-a48089b00b05 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:12.273085 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-70eb0cff-279b-4679-9a80-a48089b00b05 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: ba20d661-74fb-4922-b931-67f76a29e1b8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:12.284044 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-70eb0cff-279b-4679-9a80-a48089b00b05 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:12.284865 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-70eb0cff-279b-4679-9a80-a48089b00b05 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:12.286064 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-70eb0cff-279b-4679-9a80-a48089b00b05 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:12.286732 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-70eb0cff-279b-4679-9a80-a48089b00b05 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:12.351704 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-70eb0cff-279b-4679-9a80-a48089b00b05 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: ba20d661-74fb-4922-b931-67f76a29e1b8] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 11:58:12.610622 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-70eb0cff-279b-4679-9a80-a48089b00b05 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8" status: 204 len: 0 microversion: 2.1 time: 0.343110 Jun 20 11:58:12.613992 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 305/586] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 11:58:12 2022] DELETE /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:58:12.631045 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f438a7d2-708a-4819-b5df-8b5fcc3cad23 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:12.637713 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f438a7d2-708a-4819-b5df-8b5fcc3cad23 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 1cab587f-a3f7-4c56-8645-3ff752168244] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:12.644851 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1bfb0001-6766-42c9-924c-bb7f68da4c35 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:12.654754 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f438a7d2-708a-4819-b5df-8b5fcc3cad23 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:12.655850 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f438a7d2-708a-4819-b5df-8b5fcc3cad23 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:12.658100 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f438a7d2-708a-4819-b5df-8b5fcc3cad23 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:12.663146 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f438a7d2-708a-4819-b5df-8b5fcc3cad23 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:12.666986 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1bfb0001-6766-42c9-924c-bb7f68da4c35 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:12.671767 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1bfb0001-6766-42c9-924c-bb7f68da4c35 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:12.675064 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1bfb0001-6766-42c9-924c-bb7f68da4c35 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f" status: 200 len: 1557 microversion: 2.25 time: 0.450232 Jun 20 11:58:12.691944 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 282/587] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:58:12 2022] GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f => generated 1557 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:58:12.699596 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-15743aad-578d-4baa-a084-870b08a4e047 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:12.700184 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-f438a7d2-708a-4819-b5df-8b5fcc3cad23 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] HTTP exception thrown: Instance 1cab587f-a3f7-4c56-8645-3ff752168244 could not be found. Jun 20 11:58:12.700951 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-15743aad-578d-4baa-a084-870b08a4e047 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: adee1d54-6e18-4a4e-96ac-48a6fc56345d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:12.704734 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f438a7d2-708a-4819-b5df-8b5fcc3cad23 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Request method failure captured: Jun 20 11:58:12.704734 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244 HTTP/1.1 Jun 20 11:58:12.704734 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:58:12.704734 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:58:12.704734 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:58:12.704734 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 11:58:12.704734 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:58:12.704734 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:58:12.704734 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:58:12.704734 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:58:12.704734 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGCGmyh2iGkfAQvFQ4eBFmhytLocCCiZbM5rUrzZhiBxBc5JoomjW_AnImZMqx31H1aBVJNxyK50vgLWzh88FUoH6rRXgexzlmqClcyL42RAGQfC65_GqM0FeaaFaPFoF9OY7qCeMH82HYud503Z6NKoeuRFxvN8c4J3eFvPTxENcsE Jun 20 11:58:12.704734 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:58:12.704734 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:58:12.704734 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:58:12.704734 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:58:12.704734 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:58:12.704734 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:58:12.704734 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: d9fc528349c34afbace41593b93d169a Jun 20 11:58:12.704734 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-389644078 Jun 20 11:58:12.704734 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 11:58:12.704734 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 11:58:12.706274 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d9fc528349c34afbace41593b93d169a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d9fc528349c34afbace41593b93d169a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d9fc528349c34afbace41593b93d169a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d9fc528349c34afbace41593b93d169a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:58:12.706274 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersAdminNegativeTestJSON-389644078 Jun 20 11:58:12.706274 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: d9fc528349c34afbace41593b93d169a Jun 20 11:58:12.706274 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-389644078 Jun 20 11:58:12.706274 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersAdminNegativeTestJSON-389644078-project Jun 20 11:58:12.706274 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:58:12.706274 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:58:12.706274 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: f069018a1fc24a9fbaac9b58ee7b07fa Jun 20 11:58:12.706274 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersAdminNegativeTestJSON-389644078-project Jun 20 11:58:12.706274 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 11:58:12.706274 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 1cab587f-a3f7-4c56-8645-3ff752168244 could not be found. Jun 20 11:58:12.706274 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '1cab587f-a3f7-4c56-8645-3ff752168244'} Jun 20 11:58:12.707194 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:58:12.707194 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:12.707194 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:58:12.707194 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:58:12.707194 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:58:12.707194 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:58:12.707194 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:58:12.707194 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:58:12.707194 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:58:12.707194 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:58:12.707194 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cab587f-a3f7-4c56-8645-3ff752168244 could not be found. Jun 20 11:58:12.707194 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:58:12.707194 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:58:12.707194 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:58:12.707194 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:12.707194 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:58:12.707194 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:58:12.707194 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:58:12.707194 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:58:12.707194 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:58:12.708717 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:58:12.708717 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:58:12.708717 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:58:12.708717 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:58:12.708717 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:58:12.708717 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:58:12.708717 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:58:12.708717 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cab587f-a3f7-4c56-8645-3ff752168244 could not be found. Jun 20 11:58:12.708717 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:58:12.708717 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:58:12.708717 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:58:12.708717 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:12.708717 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:58:12.708717 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:58:12.708717 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:58:12.708717 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:58:12.708717 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cab587f-a3f7-4c56-8645-3ff752168244 could not be found. Jun 20 11:58:12.708717 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:58:12.709899 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f438a7d2-708a-4819-b5df-8b5fcc3cad23 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Returning 404 to user: Instance 1cab587f-a3f7-4c56-8645-3ff752168244 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:58:12.709899 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f438a7d2-708a-4819-b5df-8b5fcc3cad23 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244" status: 404 len: 111 microversion: 2.1 time: 0.092977 Jun 20 11:58:12.715020 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 306/588] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:12 2022] GET /compute/v2.1/servers/1cab587f-a3f7-4c56-8645-3ff752168244 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:58:12.724563 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-15743aad-578d-4baa-a084-870b08a4e047 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:12.725085 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-15743aad-578d-4baa-a084-870b08a4e047 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:12.725906 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-15743aad-578d-4baa-a084-870b08a4e047 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:12.726370 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-15743aad-578d-4baa-a084-870b08a4e047 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:12.726557 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8798c54e-7037-4cb3-9df6-f1527731d441 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:12.728420 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8798c54e-7037-4cb3-9df6-f1527731d441 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: ba20d661-74fb-4922-b931-67f76a29e1b8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:12.742234 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8798c54e-7037-4cb3-9df6-f1527731d441 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:12.743004 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8798c54e-7037-4cb3-9df6-f1527731d441 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:12.743832 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8798c54e-7037-4cb3-9df6-f1527731d441 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:12.744532 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8798c54e-7037-4cb3-9df6-f1527731d441 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:12.804335 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8798c54e-7037-4cb3-9df6-f1527731d441 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:12.805176 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8798c54e-7037-4cb3-9df6-f1527731d441 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:12.805793 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-8798c54e-7037-4cb3-9df6-f1527731d441 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lazy-loading 'fault' on Instance uuid ba20d661-74fb-4922-b931-67f76a29e1b8 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:58:12.977092 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-15743aad-578d-4baa-a084-870b08a4e047 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f49b57013f4675a70bac9b13e0a229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8790cc26204435aaf4071847ee00288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:12.981259 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8798c54e-7037-4cb3-9df6-f1527731d441 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374ef56db0ba42a1a3b0ac12aa172b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8964bee8790c43ccb896f404015dcdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:12.988124 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-15743aad-578d-4baa-a084-870b08a4e047 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "GET /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d" status: 200 len: 1388 microversion: 2.1 time: 0.293308 Jun 20 11:58:12.989569 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 283/589] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:12 2022] GET /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d => generated 1388 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:12.993221 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8798c54e-7037-4cb3-9df6-f1527731d441 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] 10.222.0.27 "GET /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8" status: 200 len: 1457 microversion: 2.1 time: 0.270964 Jun 20 11:58:12.995639 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0cb25cf0-7893-4ba3-99e1-872961875e96 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Calling method '.version_select at 0x7f6073bc2820>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:12.996970 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 307/590] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:12 2022] GET /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8 => generated 1457 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:12.999192 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0cb25cf0-7893-4ba3-99e1-872961875e96 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:12.999938 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0cb25cf0-7893-4ba3-99e1-872961875e96 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:13.001833 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-721006c2-37b9-4fbf-b31b-ab95b639f7d0 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:13.002345 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-721006c2-37b9-4fbf-b31b-ab95b639f7d0 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 8a71d955-cfc0-44b7-ae7b-e899afa8698a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:13.022943 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-721006c2-37b9-4fbf-b31b-ab95b639f7d0 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:13.023416 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-721006c2-37b9-4fbf-b31b-ab95b639f7d0 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:13.024238 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0cb25cf0-7893-4ba3-99e1-872961875e96 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 680 microversion: 2.25 time: 0.032922 Jun 20 11:58:13.025562 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 284/591] 10.222.0.27 () {60 vars in 1183 bytes} [Mon Jun 20 11:58:12 2022] GET /compute/v2.1/os-migrations => generated 680 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:58:13.027280 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-721006c2-37b9-4fbf-b31b-ab95b639f7d0 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:13.027938 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-721006c2-37b9-4fbf-b31b-ab95b639f7d0 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:13.038193 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4d757578-018b-4baa-bb6d-f8e30122cda9 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:13.038817 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4d757578-018b-4baa-bb6d-f8e30122cda9 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:13.046881 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d757578-018b-4baa-bb6d-f8e30122cda9 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:13.047322 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d757578-018b-4baa-bb6d-f8e30122cda9 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:13.048334 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d757578-018b-4baa-bb6d-f8e30122cda9 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:13.048920 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d757578-018b-4baa-bb6d-f8e30122cda9 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:13.078029 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-721006c2-37b9-4fbf-b31b-ab95b639f7d0 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 8a71d955-cfc0-44b7-ae7b-e899afa8698a] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 11:58:13.239915 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-4d757578-018b-4baa-bb6d-f8e30122cda9 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lazy-loading 'services' on Instance uuid ddbdd7f1-6b17-4f7a-9793-873b18c7a92f {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:58:13.256811 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4d757578-018b-4baa-bb6d-f8e30122cda9 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f" status: 200 len: 2049 microversion: 2.25 time: 0.222310 Jun 20 11:58:13.257598 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 285/592] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:58:13 2022] GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f => generated 2049 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:58:13.281715 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-119f1bf0-0199-4d1f-a6d8-779e127589b9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:13.289938 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-119f1bf0-0199-4d1f-a6d8-779e127589b9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 1a618cf4-fd96-4675-a17c-899544a65dcf] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:13.297406 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-721006c2-37b9-4fbf-b31b-ab95b639f7d0 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a" status: 204 len: 0 microversion: 2.1 time: 0.298853 Jun 20 11:58:13.298556 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 308/593] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 11:58:12 2022] DELETE /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:58:13.306738 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-c7209182-507e-40c5-8c9e-e7c2d28f054b req-8c3ebee0-a037-4a60-ab8d-52e8e719bceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a618cf4-fd96-4675-a17c-899544a65dcf", "name": "network-vif-plugged", "status": "completed", "tag": "909ad315-4767-4718-9c17-767afc417cdf"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:13.315081 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-119f1bf0-0199-4d1f-a6d8-779e127589b9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:13.315378 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-c7209182-507e-40c5-8c9e-e7c2d28f054b req-8c3ebee0-a037-4a60-ab8d-52e8e719bceb service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:13.315955 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-119f1bf0-0199-4d1f-a6d8-779e127589b9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:13.316284 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-c7209182-507e-40c5-8c9e-e7c2d28f054b req-8c3ebee0-a037-4a60-ab8d-52e8e719bceb service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:13.317664 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-119f1bf0-0199-4d1f-a6d8-779e127589b9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:13.318338 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-119f1bf0-0199-4d1f-a6d8-779e127589b9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:13.332072 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-c7209182-507e-40c5-8c9e-e7c2d28f054b req-8c3ebee0-a037-4a60-ab8d-52e8e719bceb service nova] Creating event network-vif-plugged:909ad315-4767-4718-9c17-767afc417cdf for instance 1a618cf4-fd96-4675-a17c-899544a65dcf on n-h2-master-1 Jun 20 11:58:13.338399 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-c7209182-507e-40c5-8c9e-e7c2d28f054b req-8c3ebee0-a037-4a60-ab8d-52e8e719bceb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037975 Jun 20 11:58:13.339478 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 309/594] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:58:13.366204 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-155497b0-df78-4783-a081-6c00683b8a38 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:13.367440 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-155497b0-df78-4783-a081-6c00683b8a38 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 8a71d955-cfc0-44b7-ae7b-e899afa8698a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:13.379608 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-155497b0-df78-4783-a081-6c00683b8a38 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:13.380371 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-155497b0-df78-4783-a081-6c00683b8a38 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:13.381874 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-155497b0-df78-4783-a081-6c00683b8a38 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:13.382990 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-155497b0-df78-4783-a081-6c00683b8a38 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:13.609829 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-119f1bf0-0199-4d1f-a6d8-779e127589b9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:13.619138 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-119f1bf0-0199-4d1f-a6d8-779e127589b9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/1a618cf4-fd96-4675-a17c-899544a65dcf" status: 200 len: 1319 microversion: 2.1 time: 0.360132 Jun 20 11:58:13.619731 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 286/595] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:13 2022] GET /compute/v2.1/servers/1a618cf4-fd96-4675-a17c-899544a65dcf => generated 1319 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:13.634552 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9ad2453c-191f-44d1-b960-5d4d8a6eaa0c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1740437367", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "7c57fb93-e580-4d64-8790-597bcac7a666"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:13.682594 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-155497b0-df78-4783-a081-6c00683b8a38 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f069018a1fc24a9fbaac9b58ee7b07fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fc528349c34afbace41593b93d169a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:13.693437 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-155497b0-df78-4783-a081-6c00683b8a38 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "GET /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a" status: 200 len: 1477 microversion: 2.1 time: 0.350071 Jun 20 11:58:13.694037 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 310/596] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:13 2022] GET /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a => generated 1477 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:13.709666 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-9ad2453c-191f-44d1-b960-5d4d8a6eaa0c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] validate_networks() for [('7c57fb93-e580-4d64-8790-597bcac7a666', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:58:14.016052 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5d6b3ebe-9140-46e0-9fff-993e58da40da tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:14.017379 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5d6b3ebe-9140-46e0-9fff-993e58da40da tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: adee1d54-6e18-4a4e-96ac-48a6fc56345d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:14.024871 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5d6b3ebe-9140-46e0-9fff-993e58da40da tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:14.026090 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5d6b3ebe-9140-46e0-9fff-993e58da40da tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:14.027080 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5d6b3ebe-9140-46e0-9fff-993e58da40da tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:14.027808 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5d6b3ebe-9140-46e0-9fff-993e58da40da tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:14.195679 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5d6b3ebe-9140-46e0-9fff-993e58da40da tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f49b57013f4675a70bac9b13e0a229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8790cc26204435aaf4071847ee00288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:14.207186 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5d6b3ebe-9140-46e0-9fff-993e58da40da tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "GET /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d" status: 200 len: 1388 microversion: 2.1 time: 0.203961 Jun 20 11:58:14.208501 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 311/597] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:14 2022] GET /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d => generated 1388 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:14.220862 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b5a94f0c-a440-4976-ac5f-d8fa60988e66 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:14.221670 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b5a94f0c-a440-4976-ac5f-d8fa60988e66 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: ba20d661-74fb-4922-b931-67f76a29e1b8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:14.229595 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b5a94f0c-a440-4976-ac5f-d8fa60988e66 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:14.230465 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b5a94f0c-a440-4976-ac5f-d8fa60988e66 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:14.231798 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b5a94f0c-a440-4976-ac5f-d8fa60988e66 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:14.233387 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b5a94f0c-a440-4976-ac5f-d8fa60988e66 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:14.246788 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-9ad2453c-191f-44d1-b960-5d4d8a6eaa0c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:58:14.247342 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-9ad2453c-191f-44d1-b960-5d4d8a6eaa0c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:58:14.247817 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-9ad2453c-191f-44d1-b960-5d4d8a6eaa0c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:58:14.248308 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-9ad2453c-191f-44d1-b960-5d4d8a6eaa0c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:58:14.248780 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-9ad2453c-191f-44d1-b960-5d4d8a6eaa0c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:58:14.258726 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ad2453c-191f-44d1-b960-5d4d8a6eaa0c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:14.259248 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ad2453c-191f-44d1-b960-5d4d8a6eaa0c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:14.260103 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ad2453c-191f-44d1-b960-5d4d8a6eaa0c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:14.260617 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ad2453c-191f-44d1-b960-5d4d8a6eaa0c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:14.267805 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:58:14.274354 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b5a94f0c-a440-4976-ac5f-d8fa60988e66 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:14.274922 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b5a94f0c-a440-4976-ac5f-d8fa60988e66 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:14.275438 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-b5a94f0c-a440-4976-ac5f-d8fa60988e66 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lazy-loading 'fault' on Instance uuid ba20d661-74fb-4922-b931-67f76a29e1b8 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:58:14.281717 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-9ad2453c-191f-44d1-b960-5d4d8a6eaa0c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Getting quotas for project 7fdba36a70464a8e816944a7f29e47cf. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:58:14.287495 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-9ad2453c-191f-44d1-b960-5d4d8a6eaa0c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Getting quotas for user b429a092ac04479eb8644bc82972234e and project 7fdba36a70464a8e816944a7f29e47cf. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:58:14.300558 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9ad2453c-191f-44d1-b960-5d4d8a6eaa0c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:58:14.306234 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9ad2453c-191f-44d1-b960-5d4d8a6eaa0c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 29575605-7785-45df-becf-359b0da6db4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:58:14.371810 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9ad2453c-191f-44d1-b960-5d4d8a6eaa0c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.741789 Jun 20 11:58:14.372729 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 287/598] 10.222.0.27 () {62 vars in 1187 bytes} [Mon Jun 20 11:58:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 20 11:58:14.388011 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6d63aa72-1fde-4d24-b9f3-5f9b0bb5c97a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:14.392152 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6d63aa72-1fde-4d24-b9f3-5f9b0bb5c97a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 29575605-7785-45df-becf-359b0da6db4e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:14.425521 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b5a94f0c-a440-4976-ac5f-d8fa60988e66 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374ef56db0ba42a1a3b0ac12aa172b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8964bee8790c43ccb896f404015dcdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:14.428746 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:58:14.436983 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b5a94f0c-a440-4976-ac5f-d8fa60988e66 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] 10.222.0.27 "GET /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8" status: 200 len: 1457 microversion: 2.1 time: 0.226560 Jun 20 11:58:14.438299 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 312/599] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:14 2022] GET /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8 => generated 1457 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:14.503759 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6d63aa72-1fde-4d24-b9f3-5f9b0bb5c97a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:14.513088 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6d63aa72-1fde-4d24-b9f3-5f9b0bb5c97a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:14.515861 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6d63aa72-1fde-4d24-b9f3-5f9b0bb5c97a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:14.517593 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6d63aa72-1fde-4d24-b9f3-5f9b0bb5c97a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e" status: 200 len: 1262 microversion: 2.25 time: 0.138952 Jun 20 11:58:14.518977 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 288/600] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:58:14 2022] GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e => generated 1262 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:58:14.635835 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-64b02ec2-7d46-4ab0-b1c4-57bb879deedf tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:14.637260 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-64b02ec2-7d46-4ab0-b1c4-57bb879deedf tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 1a618cf4-fd96-4675-a17c-899544a65dcf] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:14.645751 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64b02ec2-7d46-4ab0-b1c4-57bb879deedf tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:14.647641 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64b02ec2-7d46-4ab0-b1c4-57bb879deedf tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:14.649024 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64b02ec2-7d46-4ab0-b1c4-57bb879deedf tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:14.649938 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64b02ec2-7d46-4ab0-b1c4-57bb879deedf tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:14.714051 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a530333a-03d1-46bf-a04b-afef2707f511 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:14.715079 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a530333a-03d1-46bf-a04b-afef2707f511 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 8a71d955-cfc0-44b7-ae7b-e899afa8698a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:14.725643 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a530333a-03d1-46bf-a04b-afef2707f511 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:14.726352 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a530333a-03d1-46bf-a04b-afef2707f511 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:14.728035 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a530333a-03d1-46bf-a04b-afef2707f511 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:14.729012 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a530333a-03d1-46bf-a04b-afef2707f511 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:14.916789 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-64b02ec2-7d46-4ab0-b1c4-57bb879deedf tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:14.921087 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a530333a-03d1-46bf-a04b-afef2707f511 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f069018a1fc24a9fbaac9b58ee7b07fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fc528349c34afbace41593b93d169a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:14.927960 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-64b02ec2-7d46-4ab0-b1c4-57bb879deedf tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/1a618cf4-fd96-4675-a17c-899544a65dcf" status: 200 len: 1319 microversion: 2.1 time: 0.295803 Jun 20 11:58:14.930269 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 313/601] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:14 2022] GET /compute/v2.1/servers/1a618cf4-fd96-4675-a17c-899544a65dcf => generated 1319 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:58:14.934948 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a530333a-03d1-46bf-a04b-afef2707f511 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "GET /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a" status: 200 len: 1477 microversion: 2.1 time: 0.228028 Jun 20 11:58:14.947467 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 289/602] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:14 2022] GET /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a => generated 1477 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:15.237154 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f844a91c-8e91-4671-af69-192a274428c2 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:15.237154 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f844a91c-8e91-4671-af69-192a274428c2 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: adee1d54-6e18-4a4e-96ac-48a6fc56345d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:15.237154 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f844a91c-8e91-4671-af69-192a274428c2 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:15.237154 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f844a91c-8e91-4671-af69-192a274428c2 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:15.237894 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f844a91c-8e91-4671-af69-192a274428c2 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:15.238149 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f844a91c-8e91-4671-af69-192a274428c2 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:15.455220 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b618ee0d-3316-4dbe-859f-7a72dc85a4c0 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:15.456556 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b618ee0d-3316-4dbe-859f-7a72dc85a4c0 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: ba20d661-74fb-4922-b931-67f76a29e1b8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:15.476143 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b618ee0d-3316-4dbe-859f-7a72dc85a4c0 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:15.477281 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b618ee0d-3316-4dbe-859f-7a72dc85a4c0 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:15.479661 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b618ee0d-3316-4dbe-859f-7a72dc85a4c0 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:15.483598 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b618ee0d-3316-4dbe-859f-7a72dc85a4c0 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:15.578007 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:58:15.618118 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b618ee0d-3316-4dbe-859f-7a72dc85a4c0 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:15.619238 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b618ee0d-3316-4dbe-859f-7a72dc85a4c0 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:15.620909 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-b618ee0d-3316-4dbe-859f-7a72dc85a4c0 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lazy-loading 'fault' on Instance uuid ba20d661-74fb-4922-b931-67f76a29e1b8 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:58:16.024153 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b618ee0d-3316-4dbe-859f-7a72dc85a4c0 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374ef56db0ba42a1a3b0ac12aa172b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8964bee8790c43ccb896f404015dcdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:16.032402 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b618ee0d-3316-4dbe-859f-7a72dc85a4c0 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] 10.222.0.27 "GET /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8" status: 200 len: 1457 microversion: 2.1 time: 0.580856 Jun 20 11:58:16.042745 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 290/603] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:15 2022] GET /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8 => generated 1457 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:16.079418 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f844a91c-8e91-4671-af69-192a274428c2 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f49b57013f4675a70bac9b13e0a229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8790cc26204435aaf4071847ee00288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:16.087370 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f844a91c-8e91-4671-af69-192a274428c2 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "GET /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d" status: 200 len: 1388 microversion: 2.1 time: 0.863890 Jun 20 11:58:16.100761 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 314/604] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:15 2022] GET /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d => generated 1388 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:16.109235 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f81c81c6-17ad-47b7-bd38-510cc5a25334 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:16.113985 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f81c81c6-17ad-47b7-bd38-510cc5a25334 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 29575605-7785-45df-becf-359b0da6db4e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:16.127309 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f81c81c6-17ad-47b7-bd38-510cc5a25334 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:16.128082 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f81c81c6-17ad-47b7-bd38-510cc5a25334 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:16.129075 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f81c81c6-17ad-47b7-bd38-510cc5a25334 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:16.132747 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f81c81c6-17ad-47b7-bd38-510cc5a25334 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:16.252540 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-125b2759-b3b1-49c6-ba02-81d262088fa3 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-185305312", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:16.329170 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-125b2759-b3b1-49c6-ba02-81d262088fa3 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] validate_networks() for None {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:58:16.388160 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f81c81c6-17ad-47b7-bd38-510cc5a25334 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:16.401602 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f81c81c6-17ad-47b7-bd38-510cc5a25334 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:16.405392 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f81c81c6-17ad-47b7-bd38-510cc5a25334 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:16.406944 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f81c81c6-17ad-47b7-bd38-510cc5a25334 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e" status: 200 len: 1322 microversion: 2.25 time: 0.304836 Jun 20 11:58:16.408003 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 315/605] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:58:16 2022] GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e => generated 1322 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:58:16.492412 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-92d21b15-b111-4db6-b861-a6314b069b1c tempest-QuotasAdminTestV236-1558451738 tempest-QuotasAdminTestV236-1558451738-project-admin] Action: 'update', calling method: .version_select at 0x7f6073a4c8b0>, body: {"quota_set": {"ram": "5120"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:16.579278 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-92d21b15-b111-4db6-b861-a6314b069b1c tempest-QuotasAdminTestV236-1558451738 tempest-QuotasAdminTestV236-1558451738-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:16.580106 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-92d21b15-b111-4db6-b861-a6314b069b1c tempest-QuotasAdminTestV236-1558451738 tempest-QuotasAdminTestV236-1558451738-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:16.581216 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-92d21b15-b111-4db6-b861-a6314b069b1c tempest-QuotasAdminTestV236-1558451738 tempest-QuotasAdminTestV236-1558451738-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:16.581859 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-92d21b15-b111-4db6-b861-a6314b069b1c tempest-QuotasAdminTestV236-1558451738 tempest-QuotasAdminTestV236-1558451738-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:16.657145 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-92d21b15-b111-4db6-b861-a6314b069b1c tempest-QuotasAdminTestV236-1558451738 tempest-QuotasAdminTestV236-1558451738-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/edd2594c48fa430f90c0a7fe886832b0" status: 200 len: 240 microversion: 2.36 time: 0.247184 Jun 20 11:58:16.666379 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 316/606] 10.222.0.27 () {62 vars in 1302 bytes} [Mon Jun 20 11:58:16 2022] PUT /compute/v2.1/os-quota-sets/edd2594c48fa430f90c0a7fe886832b0 => generated 240 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:58:16.678493 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4507d6b4-0601-4fe5-9b52-f642a62270d0 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:16.679694 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4507d6b4-0601-4fe5-9b52-f642a62270d0 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 1a618cf4-fd96-4675-a17c-899544a65dcf] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:16.693527 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4507d6b4-0601-4fe5-9b52-f642a62270d0 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:16.694174 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4507d6b4-0601-4fe5-9b52-f642a62270d0 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:16.695102 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4507d6b4-0601-4fe5-9b52-f642a62270d0 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:16.696302 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4507d6b4-0601-4fe5-9b52-f642a62270d0 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:16.892848 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-125b2759-b3b1-49c6-ba02-81d262088fa3 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:58:16.893422 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-125b2759-b3b1-49c6-ba02-81d262088fa3 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:58:16.893800 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-125b2759-b3b1-49c6-ba02-81d262088fa3 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:58:16.894211 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-125b2759-b3b1-49c6-ba02-81d262088fa3 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:58:16.894622 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-125b2759-b3b1-49c6-ba02-81d262088fa3 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:58:16.908128 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-125b2759-b3b1-49c6-ba02-81d262088fa3 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:16.909007 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-125b2759-b3b1-49c6-ba02-81d262088fa3 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:16.910063 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-125b2759-b3b1-49c6-ba02-81d262088fa3 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:16.910912 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-125b2759-b3b1-49c6-ba02-81d262088fa3 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:16.939346 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-125b2759-b3b1-49c6-ba02-81d262088fa3 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Getting quotas for project 3842c54af1c84c5ead0c5cf6530df872. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:58:16.951693 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-125b2759-b3b1-49c6-ba02-81d262088fa3 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Getting quotas for user 04f4477b25804205a497458b38d66883 and project 3842c54af1c84c5ead0c5cf6530df872. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:58:16.965839 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-125b2759-b3b1-49c6-ba02-81d262088fa3 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:58:16.968813 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-125b2759-b3b1-49c6-ba02-81d262088fa3 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] [instance: a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:58:17.030901 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-125b2759-b3b1-49c6-ba02-81d262088fa3 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.985837 Jun 20 11:58:17.031613 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 291/607] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:58:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 11:58:17.041809 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5b7c14ff-e3c7-40ce-82d9-42073a616e6b tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:17.044257 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5b7c14ff-e3c7-40ce-82d9-42073a616e6b tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 8a71d955-cfc0-44b7-ae7b-e899afa8698a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:17.057910 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b7c14ff-e3c7-40ce-82d9-42073a616e6b tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:17.058909 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b7c14ff-e3c7-40ce-82d9-42073a616e6b tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:17.060592 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b7c14ff-e3c7-40ce-82d9-42073a616e6b tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:17.061247 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b7c14ff-e3c7-40ce-82d9-42073a616e6b tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:17.242301 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5b7c14ff-e3c7-40ce-82d9-42073a616e6b tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f069018a1fc24a9fbaac9b58ee7b07fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fc528349c34afbace41593b93d169a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:17.251626 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5b7c14ff-e3c7-40ce-82d9-42073a616e6b tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "GET /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a" status: 200 len: 1477 microversion: 2.1 time: 0.218958 Jun 20 11:58:17.253298 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 292/608] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:17 2022] GET /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a => generated 1477 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:17.258719 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cd8e8e49-1cde-480c-aad1-e6941fb33c5a tempest-QuotasAdminTestV236-1558451738 tempest-QuotasAdminTestV236-1558451738-project-admin] Calling method '.version_select at 0x7f6073b9a3a0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:17.344524 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cd8e8e49-1cde-480c-aad1-e6941fb33c5a tempest-QuotasAdminTestV236-1558451738 tempest-QuotasAdminTestV236-1558451738-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:17.345242 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cd8e8e49-1cde-480c-aad1-e6941fb33c5a tempest-QuotasAdminTestV236-1558451738 tempest-QuotasAdminTestV236-1558451738-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:17.346575 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cd8e8e49-1cde-480c-aad1-e6941fb33c5a tempest-QuotasAdminTestV236-1558451738 tempest-QuotasAdminTestV236-1558451738-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:17.347260 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cd8e8e49-1cde-480c-aad1-e6941fb33c5a tempest-QuotasAdminTestV236-1558451738 tempest-QuotasAdminTestV236-1558451738-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:17.373798 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cd8e8e49-1cde-480c-aad1-e6941fb33c5a tempest-QuotasAdminTestV236-1558451738 tempest-QuotasAdminTestV236-1558451738-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/edd2594c48fa430f90c0a7fe886832b0/detail" status: 200 len: 672 microversion: 2.36 time: 0.119424 Jun 20 11:58:17.375435 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 293/609] 10.222.0.27 () {60 vars in 1303 bytes} [Mon Jun 20 11:58:17 2022] GET /compute/v2.1/os-quota-sets/edd2594c48fa430f90c0a7fe886832b0/detail => generated 672 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:58:17.380395 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-a690109c-4a62-442b-a513-6adc6b2ff27c req-86568834-2b61-405b-81d1-b89026d7dcfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba20d661-74fb-4922-b931-67f76a29e1b8", "name": "network-vif-deleted", "tag": "5f78b71e-9034-48d7-9a62-92ffa6500f59"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:17.407763 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-a690109c-4a62-442b-a513-6adc6b2ff27c req-86568834-2b61-405b-81d1-b89026d7dcfd service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:17.408349 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-a690109c-4a62-442b-a513-6adc6b2ff27c req-86568834-2b61-405b-81d1-b89026d7dcfd service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:17.422140 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-a690109c-4a62-442b-a513-6adc6b2ff27c req-86568834-2b61-405b-81d1-b89026d7dcfd service nova] Creating event network-vif-deleted:5f78b71e-9034-48d7-9a62-92ffa6500f59 for instance ba20d661-74fb-4922-b931-67f76a29e1b8 on n-h1-master-1 Jun 20 11:58:17.428472 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-a690109c-4a62-442b-a513-6adc6b2ff27c req-86568834-2b61-405b-81d1-b89026d7dcfd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051366 Jun 20 11:58:17.431301 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4507d6b4-0601-4fe5-9b52-f642a62270d0 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:17.434079 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 294/610] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:58:17.441519 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-54e939be-0464-4a06-b461-02da67692d35 req-b6930e0a-2e4d-4f98-aac0-37ce265bba79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adee1d54-6e18-4a4e-96ac-48a6fc56345d", "name": "network-vif-plugged", "status": "completed", "tag": "194f5e91-83a7-4654-843b-cd734d1661fd"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:17.447103 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4507d6b4-0601-4fe5-9b52-f642a62270d0 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/1a618cf4-fd96-4675-a17c-899544a65dcf" status: 200 len: 1469 microversion: 2.1 time: 0.778352 Jun 20 11:58:17.452637 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-54e939be-0464-4a06-b461-02da67692d35 req-b6930e0a-2e4d-4f98-aac0-37ce265bba79 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:17.453368 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-54e939be-0464-4a06-b461-02da67692d35 req-b6930e0a-2e4d-4f98-aac0-37ce265bba79 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:17.459860 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 317/611] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:16 2022] GET /compute/v2.1/servers/1a618cf4-fd96-4675-a17c-899544a65dcf => generated 1469 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:17.464860 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3e18251e-2d7b-4a20-a35b-bfd4de562839 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:17.465554 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3e18251e-2d7b-4a20-a35b-bfd4de562839 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] [instance: a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:17.469411 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-54e939be-0464-4a06-b461-02da67692d35 req-b6930e0a-2e4d-4f98-aac0-37ce265bba79 service nova] Creating event network-vif-plugged:194f5e91-83a7-4654-843b-cd734d1661fd for instance adee1d54-6e18-4a4e-96ac-48a6fc56345d on n-h1-master-1 Jun 20 11:58:17.476735 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-54e939be-0464-4a06-b461-02da67692d35 req-b6930e0a-2e4d-4f98-aac0-37ce265bba79 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040335 Jun 20 11:58:17.479397 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 295/612] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:58:17.488067 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ac6c272c-019c-4b4b-84ed-9e254953a114 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:17.497319 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ac6c272c-019c-4b4b-84ed-9e254953a114 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: ba20d661-74fb-4922-b931-67f76a29e1b8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:17.508349 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:58:17.516857 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac6c272c-019c-4b4b-84ed-9e254953a114 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:17.520191 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac6c272c-019c-4b4b-84ed-9e254953a114 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:17.521154 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac6c272c-019c-4b4b-84ed-9e254953a114 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:17.521496 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac6c272c-019c-4b4b-84ed-9e254953a114 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:17.547461 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-ac6c272c-019c-4b4b-84ed-9e254953a114 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] HTTP exception thrown: Instance ba20d661-74fb-4922-b931-67f76a29e1b8 could not be found. Jun 20 11:58:17.548843 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ac6c272c-019c-4b4b-84ed-9e254953a114 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Request method failure captured: Jun 20 11:58:17.548843 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8 HTTP/1.1 Jun 20 11:58:17.548843 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:58:17.548843 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:58:17.548843 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:58:17.548843 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 11:58:17.548843 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:58:17.548843 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:58:17.548843 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:58:17.548843 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:58:17.548843 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGCVZrbjAouTpF4CO5xNLPnI1lpqfAfo09SiD_IKfTBaB5ORp-KnTjFxG4AdKZcvqp22ZbNZzcEGjV6YjB90nql2h9MiyhOcafW36k4Hpj4mrGqAs7HvsL06wbmVtKSgulBi1Xiu77Tz08vfjjK85sqDvhgnIQUSWsn1zwxX7PaWDrc Jun 20 11:58:17.548843 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:58:17.548843 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:58:17.548843 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:58:17.548843 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:58:17.548843 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:58:17.548843 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:58:17.548843 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 8964bee8790c43ccb896f404015dcdd6 Jun 20 11:58:17.548843 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1169340897 Jun 20 11:58:17.548843 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 11:58:17.548843 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 11:58:17.550130 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8964bee8790c43ccb896f404015dcdd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8964bee8790c43ccb896f404015dcdd6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8964bee8790c43ccb896f404015dcdd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8964bee8790c43ccb896f404015dcdd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:58:17.550130 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-DeleteServersAdminTestJSON-1169340897 Jun 20 11:58:17.550130 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 8964bee8790c43ccb896f404015dcdd6 Jun 20 11:58:17.550130 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1169340897 Jun 20 11:58:17.550130 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-DeleteServersAdminTestJSON-1169340897-project Jun 20 11:58:17.550130 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:58:17.550130 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:58:17.550130 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 374ef56db0ba42a1a3b0ac12aa172b56 Jun 20 11:58:17.550130 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-DeleteServersAdminTestJSON-1169340897-project Jun 20 11:58:17.550130 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 11:58:17.550130 n-d-master-1 devstack@n-api.service[119127]: exception: Instance ba20d661-74fb-4922-b931-67f76a29e1b8 could not be found. Jun 20 11:58:17.550130 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'ba20d661-74fb-4922-b931-67f76a29e1b8'} Jun 20 11:58:17.550877 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:58:17.550877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:17.550877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:58:17.550877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:58:17.550877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:58:17.550877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:58:17.550877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:58:17.550877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:58:17.550877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:58:17.550877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:58:17.550877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba20d661-74fb-4922-b931-67f76a29e1b8 could not be found. Jun 20 11:58:17.550877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:17.550877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:58:17.550877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:17.550877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:17.550877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:58:17.550877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:58:17.550877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:58:17.550877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:58:17.550877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:58:17.552031 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:58:17.552031 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:58:17.552031 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:58:17.552031 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:58:17.552031 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:58:17.552031 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:58:17.552031 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:58:17.552031 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba20d661-74fb-4922-b931-67f76a29e1b8 could not be found. Jun 20 11:58:17.552031 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:17.552031 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:58:17.552031 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:17.552031 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:17.552031 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:58:17.552031 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:58:17.552031 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:58:17.552031 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:58:17.552031 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba20d661-74fb-4922-b931-67f76a29e1b8 could not be found. Jun 20 11:58:17.552031 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:17.553705 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ac6c272c-019c-4b4b-84ed-9e254953a114 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Returning 404 to user: Instance ba20d661-74fb-4922-b931-67f76a29e1b8 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:58:17.553705 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ac6c272c-019c-4b4b-84ed-9e254953a114 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] 10.222.0.27 "GET /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8" status: 404 len: 111 microversion: 2.1 time: 0.068075 Jun 20 11:58:17.556346 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 296/613] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:17 2022] GET /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:58:17.564698 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a6c40578-1399-42fc-a051-2cc40d62890d tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:17.565811 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a6c40578-1399-42fc-a051-2cc40d62890d tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: adee1d54-6e18-4a4e-96ac-48a6fc56345d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:17.573785 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a6c40578-1399-42fc-a051-2cc40d62890d tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:17.583673 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a6c40578-1399-42fc-a051-2cc40d62890d tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:17.588604 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a6c40578-1399-42fc-a051-2cc40d62890d tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:17.589075 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a6c40578-1399-42fc-a051-2cc40d62890d tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:17.686496 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3e18251e-2d7b-4a20-a35b-bfd4de562839 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f4477b25804205a497458b38d66883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3842c54af1c84c5ead0c5cf6530df872', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:17.695571 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3e18251e-2d7b-4a20-a35b-bfd4de562839 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/servers/a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0" status: 200 len: 1216 microversion: 2.1 time: 0.234506 Jun 20 11:58:17.696511 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 318/614] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:17 2022] GET /compute/v2.1/servers/a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0 => generated 1216 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:17.701561 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5fc9215b-11c8-4497-8cc0-9e6f9ada0305 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:17.702162 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5fc9215b-11c8-4497-8cc0-9e6f9ada0305 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 29575605-7785-45df-becf-359b0da6db4e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:17.709246 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5fc9215b-11c8-4497-8cc0-9e6f9ada0305 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:17.710491 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5fc9215b-11c8-4497-8cc0-9e6f9ada0305 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:17.711924 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5fc9215b-11c8-4497-8cc0-9e6f9ada0305 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:17.712407 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5fc9215b-11c8-4497-8cc0-9e6f9ada0305 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:17.870031 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a6c40578-1399-42fc-a051-2cc40d62890d tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f49b57013f4675a70bac9b13e0a229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8790cc26204435aaf4071847ee00288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:17.876173 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5fc9215b-11c8-4497-8cc0-9e6f9ada0305 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:17.890530 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5fc9215b-11c8-4497-8cc0-9e6f9ada0305 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:17.892066 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5fc9215b-11c8-4497-8cc0-9e6f9ada0305 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:17.895086 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5fc9215b-11c8-4497-8cc0-9e6f9ada0305 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e" status: 200 len: 1320 microversion: 2.25 time: 0.197340 Jun 20 11:58:17.897375 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a6c40578-1399-42fc-a051-2cc40d62890d tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "GET /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d" status: 200 len: 1388 microversion: 2.1 time: 0.338549 Jun 20 11:58:17.897873 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 319/615] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:58:17 2022] GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e => generated 1320 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:58:17.901313 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 297/616] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:17 2022] GET /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d => generated 1388 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:17.914658 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c2200ac1-425c-4315-8f45-4de3f6a6965d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:17.915561 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c2200ac1-425c-4315-8f45-4de3f6a6965d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: a20958a4-d7af-4e1b-bb62-823c89c60073] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:17.917206 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6df1383f-f390-41eb-95ad-63f823ffd7f7 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:17.919468 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6df1383f-f390-41eb-95ad-63f823ffd7f7 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: ba20d661-74fb-4922-b931-67f76a29e1b8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:17.931012 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c2200ac1-425c-4315-8f45-4de3f6a6965d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:17.931522 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c2200ac1-425c-4315-8f45-4de3f6a6965d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:17.932364 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c2200ac1-425c-4315-8f45-4de3f6a6965d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:17.932971 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c2200ac1-425c-4315-8f45-4de3f6a6965d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:17.934783 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6df1383f-f390-41eb-95ad-63f823ffd7f7 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:17.939121 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6df1383f-f390-41eb-95ad-63f823ffd7f7 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:17.940897 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6df1383f-f390-41eb-95ad-63f823ffd7f7 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:17.943402 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6df1383f-f390-41eb-95ad-63f823ffd7f7 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:17.983024 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-6df1383f-f390-41eb-95ad-63f823ffd7f7 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] HTTP exception thrown: Instance ba20d661-74fb-4922-b931-67f76a29e1b8 could not be found. Jun 20 11:58:17.987282 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6df1383f-f390-41eb-95ad-63f823ffd7f7 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Request method failure captured: Jun 20 11:58:17.987282 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8 HTTP/1.1 Jun 20 11:58:17.987282 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:58:17.987282 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:58:17.987282 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:58:17.987282 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 11:58:17.987282 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:58:17.987282 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:58:17.987282 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:58:17.987282 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:58:17.987282 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGCVZrbjAouTpF4CO5xNLPnI1lpqfAfo09SiD_IKfTBaB5ORp-KnTjFxG4AdKZcvqp22ZbNZzcEGjV6YjB90nql2h9MiyhOcafW36k4Hpj4mrGqAs7HvsL06wbmVtKSgulBi1Xiu77Tz08vfjjK85sqDvhgnIQUSWsn1zwxX7PaWDrc Jun 20 11:58:17.987282 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:58:17.987282 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:58:17.987282 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:58:17.987282 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:58:17.987282 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:58:17.987282 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:58:17.987282 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 8964bee8790c43ccb896f404015dcdd6 Jun 20 11:58:17.987282 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1169340897 Jun 20 11:58:17.987282 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 11:58:17.987282 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 11:58:17.988900 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8964bee8790c43ccb896f404015dcdd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8964bee8790c43ccb896f404015dcdd6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8964bee8790c43ccb896f404015dcdd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8964bee8790c43ccb896f404015dcdd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:58:17.988900 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-DeleteServersAdminTestJSON-1169340897 Jun 20 11:58:17.988900 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 8964bee8790c43ccb896f404015dcdd6 Jun 20 11:58:17.988900 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1169340897 Jun 20 11:58:17.988900 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-DeleteServersAdminTestJSON-1169340897-project Jun 20 11:58:17.988900 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:58:17.988900 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:58:17.988900 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 374ef56db0ba42a1a3b0ac12aa172b56 Jun 20 11:58:17.988900 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-DeleteServersAdminTestJSON-1169340897-project Jun 20 11:58:17.988900 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 11:58:17.988900 n-d-master-1 devstack@n-api.service[119127]: exception: Instance ba20d661-74fb-4922-b931-67f76a29e1b8 could not be found. Jun 20 11:58:17.988900 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'ba20d661-74fb-4922-b931-67f76a29e1b8'} Jun 20 11:58:17.989764 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:58:17.989764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:17.989764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:58:17.989764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:58:17.989764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:58:17.989764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:58:17.989764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:58:17.989764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:58:17.989764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:58:17.989764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:58:17.989764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba20d661-74fb-4922-b931-67f76a29e1b8 could not be found. Jun 20 11:58:17.989764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:17.989764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:58:17.989764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:17.989764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:17.989764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:58:17.989764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:58:17.989764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:58:17.989764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:58:17.989764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:58:17.991313 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:58:17.991313 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 11:58:17.991313 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 11:58:17.991313 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 11:58:17.991313 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 11:58:17.991313 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:58:17.991313 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:58:17.991313 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:58:17.991313 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:58:17.991313 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba20d661-74fb-4922-b931-67f76a29e1b8 could not be found. Jun 20 11:58:17.991313 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:17.991313 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:58:17.991313 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:17.991313 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:17.991313 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:58:17.991313 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:58:17.991313 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:58:17.991313 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:58:17.991313 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba20d661-74fb-4922-b931-67f76a29e1b8 could not be found. Jun 20 11:58:17.991313 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:17.996058 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6df1383f-f390-41eb-95ad-63f823ffd7f7 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Returning 404 to user: Instance ba20d661-74fb-4922-b931-67f76a29e1b8 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:58:17.997833 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6df1383f-f390-41eb-95ad-63f823ffd7f7 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8" status: 404 len: 111 microversion: 2.1 time: 0.093894 Jun 20 11:58:18.000975 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 298/617] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 11:58:17 2022] DELETE /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:58:18.015421 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5f31ec38-b372-4e03-9ed4-672ad2b62ba4 tempest-QuotasAdminTestV236-1558451738 tempest-QuotasAdminTestV236-1558451738-project-admin] Action: 'update', calling method: .version_select at 0x7f6073b00160>, body: {"quota_set": {"ram": "2048"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:18.118578 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f31ec38-b372-4e03-9ed4-672ad2b62ba4 tempest-QuotasAdminTestV236-1558451738 tempest-QuotasAdminTestV236-1558451738-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:18.119505 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f31ec38-b372-4e03-9ed4-672ad2b62ba4 tempest-QuotasAdminTestV236-1558451738 tempest-QuotasAdminTestV236-1558451738-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:18.120566 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f31ec38-b372-4e03-9ed4-672ad2b62ba4 tempest-QuotasAdminTestV236-1558451738 tempest-QuotasAdminTestV236-1558451738-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:18.121258 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f31ec38-b372-4e03-9ed4-672ad2b62ba4 tempest-QuotasAdminTestV236-1558451738 tempest-QuotasAdminTestV236-1558451738-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:18.181648 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f31ec38-b372-4e03-9ed4-672ad2b62ba4 tempest-QuotasAdminTestV236-1558451738 tempest-QuotasAdminTestV236-1558451738-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:18.182435 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f31ec38-b372-4e03-9ed4-672ad2b62ba4 tempest-QuotasAdminTestV236-1558451738 tempest-QuotasAdminTestV236-1558451738-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:18.183662 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f31ec38-b372-4e03-9ed4-672ad2b62ba4 tempest-QuotasAdminTestV236-1558451738 tempest-QuotasAdminTestV236-1558451738-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:18.185036 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f31ec38-b372-4e03-9ed4-672ad2b62ba4 tempest-QuotasAdminTestV236-1558451738 tempest-QuotasAdminTestV236-1558451738-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:18.289683 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c2200ac1-425c-4315-8f45-4de3f6a6965d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:18.302278 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5f31ec38-b372-4e03-9ed4-672ad2b62ba4 tempest-QuotasAdminTestV236-1558451738 tempest-QuotasAdminTestV236-1558451738-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/edd2594c48fa430f90c0a7fe886832b0?user_id=65639f0e11f3402e8c3ad53d652dc799" status: 200 len: 240 microversion: 2.36 time: 0.296578 Jun 20 11:58:18.303598 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 299/618] 10.222.0.27 () {62 vars in 1383 bytes} [Mon Jun 20 11:58:18 2022] PUT /compute/v2.1/os-quota-sets/edd2594c48fa430f90c0a7fe886832b0?user_id=65639f0e11f3402e8c3ad53d652dc799 => generated 240 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:58:18.306100 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c2200ac1-425c-4315-8f45-4de3f6a6965d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/a20958a4-d7af-4e1b-bb62-823c89c60073" status: 200 len: 1469 microversion: 2.1 time: 0.407458 Jun 20 11:58:18.306699 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 320/619] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:17 2022] GET /compute/v2.1/servers/a20958a4-d7af-4e1b-bb62-823c89c60073 => generated 1469 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:18.317544 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8142bcec-f370-4c71-84bc-32e94be3fe57 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:18.317701 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8142bcec-f370-4c71-84bc-32e94be3fe57 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: ba20d661-74fb-4922-b931-67f76a29e1b8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:18.322605 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-6591f776-974a-4d13-9382-80add37ccffb req-ace2f657-67ad-43ae-bb69-0ae48eb9d34f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a71d955-cfc0-44b7-ae7b-e899afa8698a", "name": "network-vif-deleted", "tag": "531fca0e-e0ad-490e-a381-e0aae8963315"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:18.335408 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-6591f776-974a-4d13-9382-80add37ccffb req-ace2f657-67ad-43ae-bb69-0ae48eb9d34f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:18.335854 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-6591f776-974a-4d13-9382-80add37ccffb req-ace2f657-67ad-43ae-bb69-0ae48eb9d34f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:18.337750 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8142bcec-f370-4c71-84bc-32e94be3fe57 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:18.338273 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8142bcec-f370-4c71-84bc-32e94be3fe57 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:18.339244 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8142bcec-f370-4c71-84bc-32e94be3fe57 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:18.342757 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8142bcec-f370-4c71-84bc-32e94be3fe57 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:18.362964 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-6591f776-974a-4d13-9382-80add37ccffb req-ace2f657-67ad-43ae-bb69-0ae48eb9d34f service nova] Creating event network-vif-deleted:531fca0e-e0ad-490e-a381-e0aae8963315 for instance 8a71d955-cfc0-44b7-ae7b-e899afa8698a on n-h1-master-1 Jun 20 11:58:18.363501 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-8142bcec-f370-4c71-84bc-32e94be3fe57 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] HTTP exception thrown: Instance ba20d661-74fb-4922-b931-67f76a29e1b8 could not be found. Jun 20 11:58:18.376142 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8142bcec-f370-4c71-84bc-32e94be3fe57 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Request method failure captured: Jun 20 11:58:18.376142 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8 HTTP/1.1 Jun 20 11:58:18.376142 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:58:18.376142 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:58:18.376142 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:58:18.376142 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 11:58:18.376142 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:58:18.376142 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:58:18.376142 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:58:18.376142 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:58:18.376142 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGCVZrbjAouTpF4CO5xNLPnI1lpqfAfo09SiD_IKfTBaB5ORp-KnTjFxG4AdKZcvqp22ZbNZzcEGjV6YjB90nql2h9MiyhOcafW36k4Hpj4mrGqAs7HvsL06wbmVtKSgulBi1Xiu77Tz08vfjjK85sqDvhgnIQUSWsn1zwxX7PaWDrc Jun 20 11:58:18.376142 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:58:18.376142 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:58:18.376142 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:58:18.376142 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:58:18.376142 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:58:18.376142 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:58:18.376142 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 8964bee8790c43ccb896f404015dcdd6 Jun 20 11:58:18.376142 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1169340897 Jun 20 11:58:18.376142 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 11:58:18.376142 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 11:58:18.377829 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8964bee8790c43ccb896f404015dcdd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8964bee8790c43ccb896f404015dcdd6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8964bee8790c43ccb896f404015dcdd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8964bee8790c43ccb896f404015dcdd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:58:18.377829 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-DeleteServersAdminTestJSON-1169340897 Jun 20 11:58:18.377829 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 8964bee8790c43ccb896f404015dcdd6 Jun 20 11:58:18.377829 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1169340897 Jun 20 11:58:18.377829 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-DeleteServersAdminTestJSON-1169340897-project Jun 20 11:58:18.377829 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:58:18.377829 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:58:18.377829 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 374ef56db0ba42a1a3b0ac12aa172b56 Jun 20 11:58:18.377829 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-DeleteServersAdminTestJSON-1169340897-project Jun 20 11:58:18.377829 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 11:58:18.377829 n-d-master-1 devstack@n-api.service[119127]: exception: Instance ba20d661-74fb-4922-b931-67f76a29e1b8 could not be found. Jun 20 11:58:18.377829 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'ba20d661-74fb-4922-b931-67f76a29e1b8'} Jun 20 11:58:18.378688 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:58:18.378688 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:18.378688 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:58:18.378688 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:58:18.378688 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:58:18.378688 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:58:18.378688 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:58:18.378688 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:58:18.378688 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:58:18.378688 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:58:18.378688 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba20d661-74fb-4922-b931-67f76a29e1b8 could not be found. Jun 20 11:58:18.378688 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:18.378688 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:58:18.378688 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:18.378688 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:18.378688 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:58:18.378688 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:58:18.378688 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:58:18.378688 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:58:18.378688 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:58:18.379911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:58:18.379911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:58:18.379911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:58:18.379911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:58:18.379911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:58:18.379911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:58:18.379911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:58:18.379911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba20d661-74fb-4922-b931-67f76a29e1b8 could not be found. Jun 20 11:58:18.379911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:18.379911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:58:18.379911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:18.379911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:18.379911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:58:18.379911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:58:18.379911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:58:18.379911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:58:18.379911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba20d661-74fb-4922-b931-67f76a29e1b8 could not be found. Jun 20 11:58:18.379911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:18.380965 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8142bcec-f370-4c71-84bc-32e94be3fe57 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Returning 404 to user: Instance ba20d661-74fb-4922-b931-67f76a29e1b8 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:58:18.380965 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8142bcec-f370-4c71-84bc-32e94be3fe57 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] 10.222.0.27 "GET /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8" status: 404 len: 111 microversion: 2.1 time: 0.073001 Jun 20 11:58:18.380965 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 300/620] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:18 2022] GET /compute/v2.1/servers/ba20d661-74fb-4922-b931-67f76a29e1b8 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:58:18.382138 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-6591f776-974a-4d13-9382-80add37ccffb req-ace2f657-67ad-43ae-bb69-0ae48eb9d34f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062930 Jun 20 11:58:18.383963 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9ee9975f-6f3f-4f39-ab48-02653adbac14 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:18.384609 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9ee9975f-6f3f-4f39-ab48-02653adbac14 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 8a71d955-cfc0-44b7-ae7b-e899afa8698a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:18.385282 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 321/621] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:58:18.391954 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0545945b-7ef7-431c-9900-c7dcfb088976 tempest-QuotasAdminTestV236-1558451738 tempest-QuotasAdminTestV236-1558451738-project-admin] Calling method '.version_select at 0x7f6073d31d30>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:18.405291 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ee9975f-6f3f-4f39-ab48-02653adbac14 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:18.405765 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ee9975f-6f3f-4f39-ab48-02653adbac14 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:18.406553 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ee9975f-6f3f-4f39-ab48-02653adbac14 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:18.406991 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ee9975f-6f3f-4f39-ab48-02653adbac14 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:18.479244 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ee9975f-6f3f-4f39-ab48-02653adbac14 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:18.479852 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ee9975f-6f3f-4f39-ab48-02653adbac14 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:18.480793 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-9ee9975f-6f3f-4f39-ab48-02653adbac14 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lazy-loading 'fault' on Instance uuid 8a71d955-cfc0-44b7-ae7b-e899afa8698a {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:58:18.527669 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:58:18.542228 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0545945b-7ef7-431c-9900-c7dcfb088976 tempest-QuotasAdminTestV236-1558451738 tempest-QuotasAdminTestV236-1558451738-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/edd2594c48fa430f90c0a7fe886832b0?user_id=65639f0e11f3402e8c3ad53d652dc799" status: 200 len: 282 microversion: 2.36 time: 0.155447 Jun 20 11:58:18.542772 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9ee9975f-6f3f-4f39-ab48-02653adbac14 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f069018a1fc24a9fbaac9b58ee7b07fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fc528349c34afbace41593b93d169a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:18.552659 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 322/622] 10.222.0.27 () {60 vars in 1363 bytes} [Mon Jun 20 11:58:18 2022] GET /compute/v2.1/os-quota-sets/edd2594c48fa430f90c0a7fe886832b0?user_id=65639f0e11f3402e8c3ad53d652dc799 => generated 282 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:58:18.554033 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9ee9975f-6f3f-4f39-ab48-02653adbac14 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "GET /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a" status: 200 len: 1312 microversion: 2.1 time: 0.173582 Jun 20 11:58:18.556486 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 301/623] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:18 2022] GET /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a => generated 1312 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:18.561631 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-27ac0a13-c64a-4403-b399-40ab4eac8e9f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:18.567484 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-03589327-df50-43af-89d9-e3f78cf75337 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:18.567989 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-03589327-df50-43af-89d9-e3f78cf75337 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: b7973338-9aa7-497a-8036-d7a2a0f750a4] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:18.574626 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-27ac0a13-c64a-4403-b399-40ab4eac8e9f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:18.576970 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-27ac0a13-c64a-4403-b399-40ab4eac8e9f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Searching by: {'reservation_id': 'r-6c6fc08w', 'deleted': False, 'project_id': 'a6150795e7424cca91c71531840d88be'} {{(pid=119128) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 11:58:18.582261 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-03589327-df50-43af-89d9-e3f78cf75337 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:18.582741 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-03589327-df50-43af-89d9-e3f78cf75337 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:18.587284 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-03589327-df50-43af-89d9-e3f78cf75337 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:18.587973 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-03589327-df50-43af-89d9-e3f78cf75337 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:18.595462 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-27ac0a13-c64a-4403-b399-40ab4eac8e9f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:18.599511 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-27ac0a13-c64a-4403-b399-40ab4eac8e9f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:18.605463 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-27ac0a13-c64a-4403-b399-40ab4eac8e9f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:18.606262 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-27ac0a13-c64a-4403-b399-40ab4eac8e9f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:18.635960 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-03589327-df50-43af-89d9-e3f78cf75337 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] HTTP exception thrown: Instance b7973338-9aa7-497a-8036-d7a2a0f750a4 could not be found. Jun 20 11:58:18.640754 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-03589327-df50-43af-89d9-e3f78cf75337 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Request method failure captured: Jun 20 11:58:18.640754 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4 HTTP/1.1 Jun 20 11:58:18.640754 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:58:18.640754 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:58:18.640754 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:58:18.640754 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 11:58:18.640754 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:58:18.640754 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:58:18.640754 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:58:18.640754 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:58:18.640754 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGCVZrbjAouTpF4CO5xNLPnI1lpqfAfo09SiD_IKfTBaB5ORp-KnTjFxG4AdKZcvqp22ZbNZzcEGjV6YjB90nql2h9MiyhOcafW36k4Hpj4mrGqAs7HvsL06wbmVtKSgulBi1Xiu77Tz08vfjjK85sqDvhgnIQUSWsn1zwxX7PaWDrc Jun 20 11:58:18.640754 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:58:18.640754 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:58:18.640754 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:58:18.640754 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:58:18.640754 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:58:18.640754 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:58:18.640754 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 8964bee8790c43ccb896f404015dcdd6 Jun 20 11:58:18.640754 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1169340897 Jun 20 11:58:18.640754 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 11:58:18.640754 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 11:58:18.642334 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8964bee8790c43ccb896f404015dcdd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8964bee8790c43ccb896f404015dcdd6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8964bee8790c43ccb896f404015dcdd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8964bee8790c43ccb896f404015dcdd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:58:18.642334 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-DeleteServersAdminTestJSON-1169340897 Jun 20 11:58:18.642334 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 8964bee8790c43ccb896f404015dcdd6 Jun 20 11:58:18.642334 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1169340897 Jun 20 11:58:18.642334 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-DeleteServersAdminTestJSON-1169340897-project Jun 20 11:58:18.642334 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:58:18.642334 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:58:18.642334 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 374ef56db0ba42a1a3b0ac12aa172b56 Jun 20 11:58:18.642334 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-DeleteServersAdminTestJSON-1169340897-project Jun 20 11:58:18.642334 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 11:58:18.642334 n-d-master-1 devstack@n-api.service[119127]: exception: Instance b7973338-9aa7-497a-8036-d7a2a0f750a4 could not be found. Jun 20 11:58:18.642334 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'b7973338-9aa7-497a-8036-d7a2a0f750a4'} Jun 20 11:58:18.643166 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:58:18.643166 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:18.643166 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:58:18.643166 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:58:18.643166 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:58:18.643166 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:58:18.643166 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:58:18.643166 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:58:18.643166 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:58:18.643166 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:58:18.643166 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7973338-9aa7-497a-8036-d7a2a0f750a4 could not be found. Jun 20 11:58:18.643166 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:18.643166 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:58:18.643166 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:18.643166 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:18.643166 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:58:18.643166 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:58:18.643166 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:58:18.643166 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:58:18.643166 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:58:18.644819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:58:18.644819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 11:58:18.644819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 11:58:18.644819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 11:58:18.644819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 11:58:18.644819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:58:18.644819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:58:18.644819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:58:18.644819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:58:18.644819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7973338-9aa7-497a-8036-d7a2a0f750a4 could not be found. Jun 20 11:58:18.644819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:18.644819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:58:18.644819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:18.644819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:18.644819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:58:18.644819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:58:18.644819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:58:18.644819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:58:18.644819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7973338-9aa7-497a-8036-d7a2a0f750a4 could not be found. Jun 20 11:58:18.644819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:18.646257 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-03589327-df50-43af-89d9-e3f78cf75337 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Returning 404 to user: Instance b7973338-9aa7-497a-8036-d7a2a0f750a4 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:58:18.646257 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-03589327-df50-43af-89d9-e3f78cf75337 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4" status: 404 len: 111 microversion: 2.1 time: 0.086766 Jun 20 11:58:18.648923 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 302/624] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 11:58:18 2022] DELETE /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:58:18.662779 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6fb0783a-b3ab-467f-9973-459152577d51 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:18.663400 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6fb0783a-b3ab-467f-9973-459152577d51 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] [instance: b7973338-9aa7-497a-8036-d7a2a0f750a4] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:18.672329 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6fb0783a-b3ab-467f-9973-459152577d51 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:18.672789 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6fb0783a-b3ab-467f-9973-459152577d51 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:18.673582 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6fb0783a-b3ab-467f-9973-459152577d51 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:18.674075 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6fb0783a-b3ab-467f-9973-459152577d51 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:18.701364 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-6fb0783a-b3ab-467f-9973-459152577d51 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] HTTP exception thrown: Instance b7973338-9aa7-497a-8036-d7a2a0f750a4 could not be found. Jun 20 11:58:18.703078 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6fb0783a-b3ab-467f-9973-459152577d51 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Request method failure captured: Jun 20 11:58:18.703078 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4 HTTP/1.1 Jun 20 11:58:18.703078 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:58:18.703078 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:58:18.703078 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:58:18.703078 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 11:58:18.703078 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:58:18.703078 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:58:18.703078 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:58:18.703078 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:58:18.703078 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGCVZrbjAouTpF4CO5xNLPnI1lpqfAfo09SiD_IKfTBaB5ORp-KnTjFxG4AdKZcvqp22ZbNZzcEGjV6YjB90nql2h9MiyhOcafW36k4Hpj4mrGqAs7HvsL06wbmVtKSgulBi1Xiu77Tz08vfjjK85sqDvhgnIQUSWsn1zwxX7PaWDrc Jun 20 11:58:18.703078 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:58:18.703078 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:58:18.703078 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:58:18.703078 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:58:18.703078 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:58:18.703078 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:58:18.703078 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 8964bee8790c43ccb896f404015dcdd6 Jun 20 11:58:18.703078 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1169340897 Jun 20 11:58:18.703078 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 11:58:18.703078 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 11:58:18.704950 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8964bee8790c43ccb896f404015dcdd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8964bee8790c43ccb896f404015dcdd6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8964bee8790c43ccb896f404015dcdd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8964bee8790c43ccb896f404015dcdd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:58:18.704950 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-DeleteServersAdminTestJSON-1169340897 Jun 20 11:58:18.704950 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 8964bee8790c43ccb896f404015dcdd6 Jun 20 11:58:18.704950 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1169340897 Jun 20 11:58:18.704950 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-DeleteServersAdminTestJSON-1169340897-project Jun 20 11:58:18.704950 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:58:18.704950 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:58:18.704950 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 374ef56db0ba42a1a3b0ac12aa172b56 Jun 20 11:58:18.704950 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-DeleteServersAdminTestJSON-1169340897-project Jun 20 11:58:18.704950 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 11:58:18.704950 n-d-master-1 devstack@n-api.service[119127]: exception: Instance b7973338-9aa7-497a-8036-d7a2a0f750a4 could not be found. Jun 20 11:58:18.704950 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'b7973338-9aa7-497a-8036-d7a2a0f750a4'} Jun 20 11:58:18.705846 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:58:18.705846 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:18.705846 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:58:18.705846 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:58:18.705846 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:58:18.705846 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:58:18.705846 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:58:18.705846 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:58:18.705846 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:58:18.705846 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:58:18.705846 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7973338-9aa7-497a-8036-d7a2a0f750a4 could not be found. Jun 20 11:58:18.705846 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:18.705846 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:58:18.705846 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:18.705846 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:18.705846 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:58:18.705846 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:58:18.705846 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:58:18.705846 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:58:18.705846 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:58:18.707248 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:58:18.707248 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:58:18.707248 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:58:18.707248 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:58:18.707248 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:58:18.707248 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:58:18.707248 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:58:18.707248 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7973338-9aa7-497a-8036-d7a2a0f750a4 could not be found. Jun 20 11:58:18.707248 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:18.707248 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:58:18.707248 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:18.707248 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:18.707248 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:58:18.707248 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:58:18.707248 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:58:18.707248 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:58:18.707248 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7973338-9aa7-497a-8036-d7a2a0f750a4 could not be found. Jun 20 11:58:18.707248 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:18.708761 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6fb0783a-b3ab-467f-9973-459152577d51 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] Returning 404 to user: Instance b7973338-9aa7-497a-8036-d7a2a0f750a4 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:58:18.708761 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6fb0783a-b3ab-467f-9973-459152577d51 tempest-DeleteServersAdminTestJSON-1169340897 tempest-DeleteServersAdminTestJSON-1169340897-project] 10.222.0.27 "GET /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4" status: 404 len: 111 microversion: 2.1 time: 0.049074 Jun 20 11:58:18.711061 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 303/625] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:18 2022] GET /compute/v2.1/servers/b7973338-9aa7-497a-8036-d7a2a0f750a4 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:58:18.720255 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0fd75811-13b1-449f-9109-b52e24fc6ad6 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:18.740136 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0fd75811-13b1-449f-9109-b52e24fc6ad6 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] [instance: a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:18.759615 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0fd75811-13b1-449f-9109-b52e24fc6ad6 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:18.760364 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0fd75811-13b1-449f-9109-b52e24fc6ad6 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:18.763237 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0fd75811-13b1-449f-9109-b52e24fc6ad6 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:18.775114 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0fd75811-13b1-449f-9109-b52e24fc6ad6 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:18.853668 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.multi_cell_list [None req-27ac0a13-c64a-4403-b399-40ab4eac8e9f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119128) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 11:58:19.087826 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-27ac0a13-c64a-4403-b399-40ab4eac8e9f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:19.098745 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-27ac0a13-c64a-4403-b399-40ab4eac8e9f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:19.099187 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-27ac0a13-c64a-4403-b399-40ab4eac8e9f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:19.276775 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0fd75811-13b1-449f-9109-b52e24fc6ad6 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f4477b25804205a497458b38d66883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3842c54af1c84c5ead0c5cf6530df872', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:19.314567 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0fd75811-13b1-449f-9109-b52e24fc6ad6 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/servers/a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0" status: 200 len: 1268 microversion: 2.1 time: 0.599908 Jun 20 11:58:19.316835 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 304/626] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:18 2022] GET /compute/v2.1/servers/a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0 => generated 1268 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:19.336751 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a4bf20db-4d92-411b-90c7-4d00f35d09bc tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:19.340854 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a4bf20db-4d92-411b-90c7-4d00f35d09bc tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 29575605-7785-45df-becf-359b0da6db4e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:19.370002 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a4bf20db-4d92-411b-90c7-4d00f35d09bc tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:19.374008 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a4bf20db-4d92-411b-90c7-4d00f35d09bc tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:19.381593 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a4bf20db-4d92-411b-90c7-4d00f35d09bc tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:19.382083 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a4bf20db-4d92-411b-90c7-4d00f35d09bc tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:19.745180 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-27ac0a13-c64a-4403-b399-40ab4eac8e9f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?reservation_id=r-6c6fc08w" status: 200 len: 2931 microversion: 2.1 time: 1.188615 Jun 20 11:58:19.745902 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 323/627] 10.222.0.27 () {58 vars in 1196 bytes} [Mon Jun 20 11:58:18 2022] GET /compute/v2.1/servers/detail?reservation_id=r-6c6fc08w => generated 2931 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:19.751670 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-248543bd-d760-498a-ae09-ab91b9f51d1a tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:19.752771 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-248543bd-d760-498a-ae09-ab91b9f51d1a tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: adee1d54-6e18-4a4e-96ac-48a6fc56345d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:19.771827 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-248543bd-d760-498a-ae09-ab91b9f51d1a tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:19.772549 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-248543bd-d760-498a-ae09-ab91b9f51d1a tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:19.773415 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-248543bd-d760-498a-ae09-ab91b9f51d1a tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:19.773915 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-248543bd-d760-498a-ae09-ab91b9f51d1a tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:19.866126 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a4bf20db-4d92-411b-90c7-4d00f35d09bc tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:19.891899 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a4bf20db-4d92-411b-90c7-4d00f35d09bc tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:19.897656 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a4bf20db-4d92-411b-90c7-4d00f35d09bc tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:19.901253 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a4bf20db-4d92-411b-90c7-4d00f35d09bc tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e" status: 200 len: 1362 microversion: 2.25 time: 0.582492 Jun 20 11:58:19.902389 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 305/628] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:58:19 2022] GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e => generated 1362 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:58:19.912959 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ac1ae7ed-0be4-4ccd-8710-6376af74bdf1 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:19.915439 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ac1ae7ed-0be4-4ccd-8710-6376af74bdf1 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] [instance: 8a71d955-cfc0-44b7-ae7b-e899afa8698a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:19.929779 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac1ae7ed-0be4-4ccd-8710-6376af74bdf1 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:19.930234 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac1ae7ed-0be4-4ccd-8710-6376af74bdf1 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:19.931026 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac1ae7ed-0be4-4ccd-8710-6376af74bdf1 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:19.931464 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac1ae7ed-0be4-4ccd-8710-6376af74bdf1 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:19.956049 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-ac1ae7ed-0be4-4ccd-8710-6376af74bdf1 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] HTTP exception thrown: Instance 8a71d955-cfc0-44b7-ae7b-e899afa8698a could not be found. Jun 20 11:58:19.958579 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ac1ae7ed-0be4-4ccd-8710-6376af74bdf1 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Request method failure captured: Jun 20 11:58:19.958579 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a HTTP/1.1 Jun 20 11:58:19.958579 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:58:19.958579 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:58:19.958579 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:58:19.958579 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 11:58:19.958579 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:58:19.958579 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:58:19.958579 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:58:19.958579 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:58:19.958579 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGCGmyh2iGkfAQvFQ4eBFmhytLocCCiZbM5rUrzZhiBxBc5JoomjW_AnImZMqx31H1aBVJNxyK50vgLWzh88FUoH6rRXgexzlmqClcyL42RAGQfC65_GqM0FeaaFaPFoF9OY7qCeMH82HYud503Z6NKoeuRFxvN8c4J3eFvPTxENcsE Jun 20 11:58:19.958579 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:58:19.958579 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:58:19.958579 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:58:19.958579 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:58:19.958579 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:58:19.958579 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:58:19.958579 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: d9fc528349c34afbace41593b93d169a Jun 20 11:58:19.958579 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-389644078 Jun 20 11:58:19.958579 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 11:58:19.958579 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 11:58:19.959937 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d9fc528349c34afbace41593b93d169a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d9fc528349c34afbace41593b93d169a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d9fc528349c34afbace41593b93d169a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d9fc528349c34afbace41593b93d169a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:58:19.959937 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersAdminNegativeTestJSON-389644078 Jun 20 11:58:19.959937 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: d9fc528349c34afbace41593b93d169a Jun 20 11:58:19.959937 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-389644078 Jun 20 11:58:19.959937 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersAdminNegativeTestJSON-389644078-project Jun 20 11:58:19.959937 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:58:19.959937 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:58:19.959937 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: f069018a1fc24a9fbaac9b58ee7b07fa Jun 20 11:58:19.959937 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersAdminNegativeTestJSON-389644078-project Jun 20 11:58:19.959937 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 11:58:19.959937 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 8a71d955-cfc0-44b7-ae7b-e899afa8698a could not be found. Jun 20 11:58:19.959937 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '8a71d955-cfc0-44b7-ae7b-e899afa8698a'} Jun 20 11:58:19.960705 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:58:19.960705 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:19.960705 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:58:19.960705 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:58:19.960705 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:58:19.960705 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:58:19.960705 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:58:19.960705 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:58:19.960705 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:58:19.960705 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:58:19.960705 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a71d955-cfc0-44b7-ae7b-e899afa8698a could not be found. Jun 20 11:58:19.960705 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:19.960705 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:58:19.960705 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:19.960705 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:19.960705 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:58:19.960705 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:58:19.960705 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:58:19.960705 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:58:19.960705 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:58:19.961839 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:58:19.961839 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:58:19.961839 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:58:19.961839 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:58:19.961839 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:58:19.961839 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:58:19.961839 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:58:19.961839 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a71d955-cfc0-44b7-ae7b-e899afa8698a could not be found. Jun 20 11:58:19.961839 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:19.961839 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:58:19.961839 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:19.961839 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:19.961839 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:58:19.961839 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:58:19.961839 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:58:19.961839 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:58:19.961839 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a71d955-cfc0-44b7-ae7b-e899afa8698a could not be found. Jun 20 11:58:19.961839 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:19.962870 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ac1ae7ed-0be4-4ccd-8710-6376af74bdf1 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] Returning 404 to user: Instance 8a71d955-cfc0-44b7-ae7b-e899afa8698a could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:58:19.962870 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ac1ae7ed-0be4-4ccd-8710-6376af74bdf1 tempest-ServersAdminNegativeTestJSON-389644078 tempest-ServersAdminNegativeTestJSON-389644078-project] 10.222.0.27 "GET /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a" status: 404 len: 111 microversion: 2.1 time: 0.056443 Jun 20 11:58:19.962870 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 306/629] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:19 2022] GET /compute/v2.1/servers/8a71d955-cfc0-44b7-ae7b-e899afa8698a => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:58:19.971309 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dc52c57d-ee20-4499-88a9-589aa16bdc2c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:20.021000 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.compute.server_groups [None req-dc52c57d-ee20-4499-88a9-589aa16bdc2c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Querying cell d5df985c-a080-4240-bcef-1787de3aeb9e(cell1) for 2 instances {{(pid=119127) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jun 20 11:58:20.022116 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc52c57d-ee20-4499-88a9-589aa16bdc2c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:20.022576 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc52c57d-ee20-4499-88a9-589aa16bdc2c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:20.052982 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dc52c57d-ee20-4499-88a9-589aa16bdc2c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/bfbb54d0-ba33-4556-8511-9ce0bdc7ca52" status: 200 len: 271 microversion: 2.1 time: 0.090762 Jun 20 11:58:20.054066 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 307/630] 10.222.0.27 () {58 vars in 1262 bytes} [Mon Jun 20 11:58:19 2022] GET /compute/v2.1/os-server-groups/bfbb54d0-ba33-4556-8511-9ce0bdc7ca52 => generated 271 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:58:20.066513 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1676587a-d574-499c-9dca-a8be34dd0ab7 tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:20.069221 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1676587a-d574-499c-9dca-a8be34dd0ab7 tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] [instance: 1a618cf4-fd96-4675-a17c-899544a65dcf] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:20.076926 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1676587a-d574-499c-9dca-a8be34dd0ab7 tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:20.077830 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1676587a-d574-499c-9dca-a8be34dd0ab7 tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:20.079013 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1676587a-d574-499c-9dca-a8be34dd0ab7 tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:20.080103 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1676587a-d574-499c-9dca-a8be34dd0ab7 tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:20.440829 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-248543bd-d760-498a-ae09-ab91b9f51d1a tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f49b57013f4675a70bac9b13e0a229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8790cc26204435aaf4071847ee00288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:20.458019 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-248543bd-d760-498a-ae09-ab91b9f51d1a tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "GET /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d" status: 200 len: 1586 microversion: 2.1 time: 0.708744 Jun 20 11:58:20.473258 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 324/631] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:19 2022] GET /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d => generated 1586 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:20.478853 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-225d0710-e16e-4864-9740-fff0b717575b tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:20.479698 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-225d0710-e16e-4864-9740-fff0b717575b tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] [instance: a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:20.493858 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-225d0710-e16e-4864-9740-fff0b717575b tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:20.494312 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-225d0710-e16e-4864-9740-fff0b717575b tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:20.495244 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-225d0710-e16e-4864-9740-fff0b717575b tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:20.495912 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-225d0710-e16e-4864-9740-fff0b717575b tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:20.585357 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1676587a-d574-499c-9dca-a8be34dd0ab7 tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/1a618cf4-fd96-4675-a17c-899544a65dcf" status: 200 len: 1620 microversion: 2.1 time: 0.523860 Jun 20 11:58:20.586863 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 308/632] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:20 2022] GET /compute/v2.1/servers/1a618cf4-fd96-4675-a17c-899544a65dcf => generated 1620 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:20.594408 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-40f3ac1e-c520-4771-a9d4-594a93d00e01 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:20.598255 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-40f3ac1e-c520-4771-a9d4-594a93d00e01 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: adee1d54-6e18-4a4e-96ac-48a6fc56345d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:20.621979 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-40f3ac1e-c520-4771-a9d4-594a93d00e01 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:20.622126 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-40f3ac1e-c520-4771-a9d4-594a93d00e01 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:20.622944 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-40f3ac1e-c520-4771-a9d4-594a93d00e01 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:20.623340 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-40f3ac1e-c520-4771-a9d4-594a93d00e01 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:20.662524 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-225d0710-e16e-4864-9740-fff0b717575b tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f4477b25804205a497458b38d66883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3842c54af1c84c5ead0c5cf6530df872', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:20.679970 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-225d0710-e16e-4864-9740-fff0b717575b tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/servers/a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0" status: 200 len: 1274 microversion: 2.1 time: 0.205330 Jun 20 11:58:20.680917 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 325/633] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:20 2022] GET /compute/v2.1/servers/a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0 => generated 1274 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:20.691138 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a66ff786-f107-471a-aad8-978aac324fa2 tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:20.691825 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a66ff786-f107-471a-aad8-978aac324fa2 tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] [instance: a20958a4-d7af-4e1b-bb62-823c89c60073] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:20.716759 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a66ff786-f107-471a-aad8-978aac324fa2 tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:20.717562 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a66ff786-f107-471a-aad8-978aac324fa2 tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:20.723649 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a66ff786-f107-471a-aad8-978aac324fa2 tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:20.724384 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a66ff786-f107-471a-aad8-978aac324fa2 tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:20.788779 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-40f3ac1e-c520-4771-a9d4-594a93d00e01 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "GET /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.200521 Jun 20 11:58:20.789920 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 309/634] 10.222.0.27 () {58 vars in 1274 bytes} [Mon Jun 20 11:58:20 2022] GET /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d/os-interface => generated 284 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:58:20.921415 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-95804a71-a596-4467-821b-45f2a7e0cb20 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:20.922625 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-95804a71-a596-4467-821b-45f2a7e0cb20 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 29575605-7785-45df-becf-359b0da6db4e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:20.937520 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-95804a71-a596-4467-821b-45f2a7e0cb20 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:20.941666 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-95804a71-a596-4467-821b-45f2a7e0cb20 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:20.942832 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-95804a71-a596-4467-821b-45f2a7e0cb20 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:20.943991 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-95804a71-a596-4467-821b-45f2a7e0cb20 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:21.236162 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a66ff786-f107-471a-aad8-978aac324fa2 tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a20958a4-d7af-4e1b-bb62-823c89c60073" status: 200 len: 1620 microversion: 2.1 time: 0.553499 Jun 20 11:58:21.240229 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 326/635] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:20 2022] GET /compute/v2.1/servers/a20958a4-d7af-4e1b-bb62-823c89c60073 => generated 1620 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:21.451766 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5961c2dd-b105-4a7f-9dc7-388907092ee4 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1167802347", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "c5afa776-6f61-4b7a-b586-c5047b5fbe5e"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:21.574993 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-5961c2dd-b105-4a7f-9dc7-388907092ee4 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] validate_networks() for None {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:58:22.146483 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-95804a71-a596-4467-821b-45f2a7e0cb20 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:22.161703 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-95804a71-a596-4467-821b-45f2a7e0cb20 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:22.163988 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-95804a71-a596-4467-821b-45f2a7e0cb20 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:22.165479 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-95804a71-a596-4467-821b-45f2a7e0cb20 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e" status: 200 len: 1362 microversion: 2.25 time: 1.249225 Jun 20 11:58:22.166968 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 310/636] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:58:20 2022] GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e => generated 1362 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 11:58:22.182267 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f2547686-8ccd-4e7f-899f-b15bea89263f tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:22.183171 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f2547686-8ccd-4e7f-899f-b15bea89263f tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] [instance: a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:22.196569 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f2547686-8ccd-4e7f-899f-b15bea89263f tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:22.197279 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f2547686-8ccd-4e7f-899f-b15bea89263f tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:22.198261 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f2547686-8ccd-4e7f-899f-b15bea89263f tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:22.199645 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f2547686-8ccd-4e7f-899f-b15bea89263f tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:22.398372 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-5961c2dd-b105-4a7f-9dc7-388907092ee4 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:58:22.400400 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-5961c2dd-b105-4a7f-9dc7-388907092ee4 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:58:22.401184 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-5961c2dd-b105-4a7f-9dc7-388907092ee4 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:58:22.404496 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-5961c2dd-b105-4a7f-9dc7-388907092ee4 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:58:22.405400 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-5961c2dd-b105-4a7f-9dc7-388907092ee4 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:58:22.421221 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5961c2dd-b105-4a7f-9dc7-388907092ee4 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:22.421847 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5961c2dd-b105-4a7f-9dc7-388907092ee4 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:22.422898 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5961c2dd-b105-4a7f-9dc7-388907092ee4 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:22.423604 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5961c2dd-b105-4a7f-9dc7-388907092ee4 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:22.448509 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f2547686-8ccd-4e7f-899f-b15bea89263f tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f4477b25804205a497458b38d66883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3842c54af1c84c5ead0c5cf6530df872', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:22.451362 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-5961c2dd-b105-4a7f-9dc7-388907092ee4 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Getting quotas for project a6150795e7424cca91c71531840d88be. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:58:22.457365 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-5961c2dd-b105-4a7f-9dc7-388907092ee4 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Getting quotas for user 1297c1b206f845bcaf936313fd7eed9b and project a6150795e7424cca91c71531840d88be. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:58:22.471193 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f2547686-8ccd-4e7f-899f-b15bea89263f tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/servers/a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0" status: 200 len: 1274 microversion: 2.1 time: 0.298689 Jun 20 11:58:22.473913 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 311/637] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:22 2022] GET /compute/v2.1/servers/a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0 => generated 1274 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:22.475118 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5961c2dd-b105-4a7f-9dc7-388907092ee4 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:58:22.479474 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5961c2dd-b105-4a7f-9dc7-388907092ee4 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 66d1074f-478d-4676-ab01-4dc1d4561a42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:58:22.483451 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-7890bce8-7290-411c-b56e-b05356ca0ded req-1634203e-69ac-490e-8b23-e8d4d664f6de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29575605-7785-45df-becf-359b0da6db4e", "tag": "e0f1c5e6-79d0-4e55-a956-27d25ee10457"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:22.504739 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-7890bce8-7290-411c-b56e-b05356ca0ded req-1634203e-69ac-490e-8b23-e8d4d664f6de service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:22.505850 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-7890bce8-7290-411c-b56e-b05356ca0ded req-1634203e-69ac-490e-8b23-e8d4d664f6de service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:22.525932 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:58:22.549077 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-7890bce8-7290-411c-b56e-b05356ca0ded req-1634203e-69ac-490e-8b23-e8d4d664f6de service nova] Creating event network-changed:e0f1c5e6-79d0-4e55-a956-27d25ee10457 for instance 29575605-7785-45df-becf-359b0da6db4e on n-h2-master-1 Jun 20 11:58:22.556249 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-7890bce8-7290-411c-b56e-b05356ca0ded req-1634203e-69ac-490e-8b23-e8d4d664f6de service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078966 Jun 20 11:58:22.558265 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 312/638] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:58:22.574709 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5961c2dd-b105-4a7f-9dc7-388907092ee4 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.129118 Jun 20 11:58:22.579667 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 327/639] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:58:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1134 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 11:58:22.593594 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f3e3c82c-3eb2-4483-912a-ebb705290041 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:22.596127 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f3e3c82c-3eb2-4483-912a-ebb705290041 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 66d1074f-478d-4676-ab01-4dc1d4561a42] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:22.841787 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f3e3c82c-3eb2-4483-912a-ebb705290041 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:22.849399 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f3e3c82c-3eb2-4483-912a-ebb705290041 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42" status: 200 len: 1217 microversion: 2.1 time: 0.263311 Jun 20 11:58:22.856552 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 313/640] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:22 2022] GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42 => generated 1217 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:23.193492 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5fd4ca4b-f414-4cec-bb30-0d9aa9ba46f5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:23.194096 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5fd4ca4b-f414-4cec-bb30-0d9aa9ba46f5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 29575605-7785-45df-becf-359b0da6db4e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:23.217230 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5fd4ca4b-f414-4cec-bb30-0d9aa9ba46f5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:23.217230 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5fd4ca4b-f414-4cec-bb30-0d9aa9ba46f5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:23.217230 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5fd4ca4b-f414-4cec-bb30-0d9aa9ba46f5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:23.217230 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5fd4ca4b-f414-4cec-bb30-0d9aa9ba46f5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:23.491361 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c14b9d6f-ba2f-45f8-a65f-cfce2cba1b8a tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:23.493110 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c14b9d6f-ba2f-45f8-a65f-cfce2cba1b8a tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] [instance: a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:23.525185 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c14b9d6f-ba2f-45f8-a65f-cfce2cba1b8a tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:23.527339 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c14b9d6f-ba2f-45f8-a65f-cfce2cba1b8a tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:23.529492 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c14b9d6f-ba2f-45f8-a65f-cfce2cba1b8a tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:23.531573 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c14b9d6f-ba2f-45f8-a65f-cfce2cba1b8a tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:23.642607 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5fd4ca4b-f414-4cec-bb30-0d9aa9ba46f5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:23.660218 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5fd4ca4b-f414-4cec-bb30-0d9aa9ba46f5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:23.661886 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5fd4ca4b-f414-4cec-bb30-0d9aa9ba46f5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:23.666395 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5fd4ca4b-f414-4cec-bb30-0d9aa9ba46f5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e" status: 200 len: 1362 microversion: 2.25 time: 0.479593 Jun 20 11:58:23.668692 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 328/641] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:58:23 2022] GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e => generated 1362 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:58:23.884595 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ee1fefa6-59f5-4375-af59-52adddf368eb tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:23.887152 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ee1fefa6-59f5-4375-af59-52adddf368eb tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 66d1074f-478d-4676-ab01-4dc1d4561a42] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:23.906000 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ee1fefa6-59f5-4375-af59-52adddf368eb tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:23.910994 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ee1fefa6-59f5-4375-af59-52adddf368eb tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:23.915237 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ee1fefa6-59f5-4375-af59-52adddf368eb tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:23.915237 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ee1fefa6-59f5-4375-af59-52adddf368eb tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:24.196074 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ee1fefa6-59f5-4375-af59-52adddf368eb tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:24.229966 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ee1fefa6-59f5-4375-af59-52adddf368eb tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42" status: 200 len: 1269 microversion: 2.1 time: 0.351777 Jun 20 11:58:24.237979 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 329/642] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:23 2022] GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42 => generated 1269 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:24.454568 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c14b9d6f-ba2f-45f8-a65f-cfce2cba1b8a tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f4477b25804205a497458b38d66883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3842c54af1c84c5ead0c5cf6530df872', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:24.467505 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c14b9d6f-ba2f-45f8-a65f-cfce2cba1b8a tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/servers/a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0" status: 200 len: 1316 microversion: 2.1 time: 0.977141 Jun 20 11:58:24.468186 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 314/643] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:23 2022] GET /compute/v2.1/servers/a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0 => generated 1316 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:58:24.688358 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5af61860-8936-4dd3-99db-037908324719 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:24.689344 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5af61860-8936-4dd3-99db-037908324719 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 29575605-7785-45df-becf-359b0da6db4e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:24.707468 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5af61860-8936-4dd3-99db-037908324719 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:24.708599 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5af61860-8936-4dd3-99db-037908324719 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:24.709908 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5af61860-8936-4dd3-99db-037908324719 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:24.711606 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5af61860-8936-4dd3-99db-037908324719 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:24.789178 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-ce9bfe03-7e84-4b45-a197-9c776550864f req-5737a860-5127-4208-8508-cf71e970b8de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0", "tag": "736a1975-6c4b-4f19-83da-ab507fc213c8"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:24.812089 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ce9bfe03-7e84-4b45-a197-9c776550864f req-5737a860-5127-4208-8508-cf71e970b8de service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:24.812649 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ce9bfe03-7e84-4b45-a197-9c776550864f req-5737a860-5127-4208-8508-cf71e970b8de service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:24.856479 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-ce9bfe03-7e84-4b45-a197-9c776550864f req-5737a860-5127-4208-8508-cf71e970b8de service nova] Creating event network-changed:736a1975-6c4b-4f19-83da-ab507fc213c8 for instance a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0 on n-h1-master-1 Jun 20 11:58:24.873190 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-ce9bfe03-7e84-4b45-a197-9c776550864f req-5737a860-5127-4208-8508-cf71e970b8de service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087606 Jun 20 11:58:24.883084 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 315/644] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 11:58:24.890509 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f53390d5-4e51-46f7-9524-3f7753bcfb2a tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:24.906517 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f53390d5-4e51-46f7-9524-3f7753bcfb2a tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: adee1d54-6e18-4a4e-96ac-48a6fc56345d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:24.925328 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f53390d5-4e51-46f7-9524-3f7753bcfb2a tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:24.925785 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f53390d5-4e51-46f7-9524-3f7753bcfb2a tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:24.926569 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f53390d5-4e51-46f7-9524-3f7753bcfb2a tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:24.927011 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f53390d5-4e51-46f7-9524-3f7753bcfb2a tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:25.319178 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f53390d5-4e51-46f7-9524-3f7753bcfb2a tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f49b57013f4675a70bac9b13e0a229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8790cc26204435aaf4071847ee00288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:25.329290 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f53390d5-4e51-46f7-9524-3f7753bcfb2a tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "GET /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d" status: 200 len: 1586 microversion: 2.1 time: 0.443321 Jun 20 11:58:25.334610 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 316/645] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:24 2022] GET /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d => generated 1586 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:25.344685 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-3e73f133-b1ab-45fa-a0b0-e733dcb0ebab req-57f9642f-56f2-47a1-ba04-cba66dc1c6a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adee1d54-6e18-4a4e-96ac-48a6fc56345d", "tag": "194f5e91-83a7-4654-843b-cd734d1661fd"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:25.363705 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-3e73f133-b1ab-45fa-a0b0-e733dcb0ebab req-57f9642f-56f2-47a1-ba04-cba66dc1c6a8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:25.371014 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-3e73f133-b1ab-45fa-a0b0-e733dcb0ebab req-57f9642f-56f2-47a1-ba04-cba66dc1c6a8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:25.401022 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-3e73f133-b1ab-45fa-a0b0-e733dcb0ebab req-57f9642f-56f2-47a1-ba04-cba66dc1c6a8 service nova] Creating event network-changed:194f5e91-83a7-4654-843b-cd734d1661fd for instance adee1d54-6e18-4a4e-96ac-48a6fc56345d on n-h1-master-1 Jun 20 11:58:25.410894 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-3e73f133-b1ab-45fa-a0b0-e733dcb0ebab req-57f9642f-56f2-47a1-ba04-cba66dc1c6a8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074604 Jun 20 11:58:25.413776 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 317/646] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:58:25.429024 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4691bf17-cf6f-4028-b30e-54dcfa353dff tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:25.430087 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4691bf17-cf6f-4028-b30e-54dcfa353dff tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 66d1074f-478d-4676-ab01-4dc1d4561a42] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:25.452659 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4691bf17-cf6f-4028-b30e-54dcfa353dff tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:25.456863 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4691bf17-cf6f-4028-b30e-54dcfa353dff tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:25.458818 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4691bf17-cf6f-4028-b30e-54dcfa353dff tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:25.460758 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4691bf17-cf6f-4028-b30e-54dcfa353dff tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:25.613282 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4691bf17-cf6f-4028-b30e-54dcfa353dff tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:25.630750 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4691bf17-cf6f-4028-b30e-54dcfa353dff tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42" status: 200 len: 1269 microversion: 2.1 time: 0.213892 Jun 20 11:58:25.637994 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 318/647] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:25 2022] GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42 => generated 1269 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:25.652748 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b94df78c-7b20-4f54-aacd-08bbf9176f7f tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:25.654059 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b94df78c-7b20-4f54-aacd-08bbf9176f7f tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] [instance: a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:25.665425 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b94df78c-7b20-4f54-aacd-08bbf9176f7f tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:25.666566 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b94df78c-7b20-4f54-aacd-08bbf9176f7f tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:25.668246 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b94df78c-7b20-4f54-aacd-08bbf9176f7f tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:25.669332 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b94df78c-7b20-4f54-aacd-08bbf9176f7f tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:25.930173 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b94df78c-7b20-4f54-aacd-08bbf9176f7f tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f4477b25804205a497458b38d66883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3842c54af1c84c5ead0c5cf6530df872', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:25.957810 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b94df78c-7b20-4f54-aacd-08bbf9176f7f tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/servers/a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0" status: 200 len: 1316 microversion: 2.1 time: 0.315848 Jun 20 11:58:25.961121 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 319/648] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:25 2022] GET /compute/v2.1/servers/a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0 => generated 1316 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:26.173528 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5af61860-8936-4dd3-99db-037908324719 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:26.182313 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5af61860-8936-4dd3-99db-037908324719 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:26.183907 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5af61860-8936-4dd3-99db-037908324719 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:26.185078 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5af61860-8936-4dd3-99db-037908324719 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e" status: 200 len: 1362 microversion: 2.25 time: 1.502028 Jun 20 11:58:26.205169 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 330/649] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:58:24 2022] GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e => generated 1362 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:58:26.637243 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-93754af7-0f31-495d-8e55-9c98ae41bf2c tempest-ServicesAdminTestJSON-813831123 tempest-ServicesAdminTestJSON-813831123-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:26.639592 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:58:26.639592 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:58:26.641608 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93754af7-0f31-495d-8e55-9c98ae41bf2c tempest-ServicesAdminTestJSON-813831123 tempest-ServicesAdminTestJSON-813831123-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:26.643609 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93754af7-0f31-495d-8e55-9c98ae41bf2c tempest-ServicesAdminTestJSON-813831123 tempest-ServicesAdminTestJSON-813831123-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:26.644933 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93754af7-0f31-495d-8e55-9c98ae41bf2c tempest-ServicesAdminTestJSON-813831123 tempest-ServicesAdminTestJSON-813831123-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:26.646363 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93754af7-0f31-495d-8e55-9c98ae41bf2c tempest-ServicesAdminTestJSON-813831123 tempest-ServicesAdminTestJSON-813831123-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:26.650758 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2da572c6-9c5e-4b69-b5ca-33414701d52a tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:26.651377 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2da572c6-9c5e-4b69-b5ca-33414701d52a tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 66d1074f-478d-4676-ab01-4dc1d4561a42] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:26.672094 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2da572c6-9c5e-4b69-b5ca-33414701d52a tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:26.672767 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2da572c6-9c5e-4b69-b5ca-33414701d52a tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:26.673982 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2da572c6-9c5e-4b69-b5ca-33414701d52a tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:26.674737 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2da572c6-9c5e-4b69-b5ca-33414701d52a tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:26.718851 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-93754af7-0f31-495d-8e55-9c98ae41bf2c tempest-ServicesAdminTestJSON-813831123 tempest-ServicesAdminTestJSON-813831123-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.429115 Jun 20 11:58:26.728501 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 320/650] 10.222.0.27 () {58 vars in 1136 bytes} [Mon Jun 20 11:58:26 2022] GET /compute/v2.1/os-services => generated 944 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:58:26.738983 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-074ca190-44f0-4113-a1af-97371f780a72 tempest-ServicesAdminTestJSON-813831123 tempest-ServicesAdminTestJSON-813831123-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:26.751272 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:58:26.751272 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:58:26.753323 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-074ca190-44f0-4113-a1af-97371f780a72 tempest-ServicesAdminTestJSON-813831123 tempest-ServicesAdminTestJSON-813831123-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:26.753978 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-074ca190-44f0-4113-a1af-97371f780a72 tempest-ServicesAdminTestJSON-813831123 tempest-ServicesAdminTestJSON-813831123-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:26.756246 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-074ca190-44f0-4113-a1af-97371f780a72 tempest-ServicesAdminTestJSON-813831123 tempest-ServicesAdminTestJSON-813831123-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:26.758138 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-074ca190-44f0-4113-a1af-97371f780a72 tempest-ServicesAdminTestJSON-813831123 tempest-ServicesAdminTestJSON-813831123-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:26.822025 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-074ca190-44f0-4113-a1af-97371f780a72 tempest-ServicesAdminTestJSON-813831123 tempest-ServicesAdminTestJSON-813831123-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=n-d-master-1" status: 200 len: 578 microversion: 2.1 time: 0.089297 Jun 20 11:58:26.832847 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 321/651] 10.222.0.27 () {58 vars in 1171 bytes} [Mon Jun 20 11:58:26 2022] GET /compute/v2.1/os-services?host=n-d-master-1 => generated 578 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:58:26.840972 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8104e64e-a6b3-4c97-b100-595dabd87a9b tempest-ServicesAdminTestJSON-813831123 tempest-ServicesAdminTestJSON-813831123-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:26.842335 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:58:26.842335 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:58:26.845086 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8104e64e-a6b3-4c97-b100-595dabd87a9b tempest-ServicesAdminTestJSON-813831123 tempest-ServicesAdminTestJSON-813831123-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:26.851797 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8104e64e-a6b3-4c97-b100-595dabd87a9b tempest-ServicesAdminTestJSON-813831123 tempest-ServicesAdminTestJSON-813831123-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:26.854279 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8104e64e-a6b3-4c97-b100-595dabd87a9b tempest-ServicesAdminTestJSON-813831123 tempest-ServicesAdminTestJSON-813831123-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:26.854758 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8104e64e-a6b3-4c97-b100-595dabd87a9b tempest-ServicesAdminTestJSON-813831123 tempest-ServicesAdminTestJSON-813831123-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:26.965756 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8104e64e-a6b3-4c97-b100-595dabd87a9b tempest-ServicesAdminTestJSON-813831123 tempest-ServicesAdminTestJSON-813831123-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.131678 Jun 20 11:58:26.966459 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 322/652] 10.222.0.27 () {58 vars in 1175 bytes} [Mon Jun 20 11:58:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:58:27.065585 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2da572c6-9c5e-4b69-b5ca-33414701d52a tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:27.105873 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2da572c6-9c5e-4b69-b5ca-33414701d52a tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42" status: 200 len: 1269 microversion: 2.1 time: 0.460575 Jun 20 11:58:27.106965 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 331/653] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:26 2022] GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42 => generated 1269 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:58:27.129101 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a32a1bad-66e8-4a1e-8da2-1675fc519cc9 tempest-ServicesAdminTestJSON-813831123 tempest-ServicesAdminTestJSON-813831123-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:27.137113 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:58:27.137113 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:58:27.143788 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a32a1bad-66e8-4a1e-8da2-1675fc519cc9 tempest-ServicesAdminTestJSON-813831123 tempest-ServicesAdminTestJSON-813831123-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:27.156188 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a32a1bad-66e8-4a1e-8da2-1675fc519cc9 tempest-ServicesAdminTestJSON-813831123 tempest-ServicesAdminTestJSON-813831123-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:27.158067 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a32a1bad-66e8-4a1e-8da2-1675fc519cc9 tempest-ServicesAdminTestJSON-813831123 tempest-ServicesAdminTestJSON-813831123-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:27.160484 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a32a1bad-66e8-4a1e-8da2-1675fc519cc9 tempest-ServicesAdminTestJSON-813831123 tempest-ServicesAdminTestJSON-813831123-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:27.239206 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a32a1bad-66e8-4a1e-8da2-1675fc519cc9 tempest-ServicesAdminTestJSON-813831123 tempest-ServicesAdminTestJSON-813831123-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.130991 Jun 20 11:58:27.246245 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 332/654] 10.222.0.27 () {58 vars in 1136 bytes} [Mon Jun 20 11:58:27 2022] GET /compute/v2.1/os-services => generated 944 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:58:27.268147 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7ca424a5-b1b7-47e1-a387-a0d5dc42759f tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:27.268818 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7ca424a5-b1b7-47e1-a387-a0d5dc42759f tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] [instance: a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:27.292059 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ca424a5-b1b7-47e1-a387-a0d5dc42759f tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:27.292583 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ca424a5-b1b7-47e1-a387-a0d5dc42759f tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:27.298873 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ca424a5-b1b7-47e1-a387-a0d5dc42759f tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:27.299461 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ca424a5-b1b7-47e1-a387-a0d5dc42759f tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:27.363979 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:58:27.549342 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6209b395-ff73-40ab-af42-64617d916a5c tempest-HypervisorAdminUnderV252Test-735445904 tempest-HypervisorAdminUnderV252Test-735445904-project-admin] Calling method '.version_select at 0x7f6073d97700>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:27.550297 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:58:27.550297 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:58:27.552948 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6209b395-ff73-40ab-af42-64617d916a5c tempest-HypervisorAdminUnderV252Test-735445904 tempest-HypervisorAdminUnderV252Test-735445904-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:27.553625 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6209b395-ff73-40ab-af42-64617d916a5c tempest-HypervisorAdminUnderV252Test-735445904 tempest-HypervisorAdminUnderV252Test-735445904-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:27.617935 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6209b395-ff73-40ab-af42-64617d916a5c tempest-HypervisorAdminUnderV252Test-735445904 tempest-HypervisorAdminUnderV252Test-735445904-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:27.619042 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6209b395-ff73-40ab-af42-64617d916a5c tempest-HypervisorAdminUnderV252Test-735445904 tempest-HypervisorAdminUnderV252Test-735445904-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:27.660981 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6209b395-ff73-40ab-af42-64617d916a5c tempest-HypervisorAdminUnderV252Test-735445904 tempest-HypervisorAdminUnderV252Test-735445904-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:27.661658 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6209b395-ff73-40ab-af42-64617d916a5c tempest-HypervisorAdminUnderV252Test-735445904 tempest-HypervisorAdminUnderV252Test-735445904-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:27.671102 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6209b395-ff73-40ab-af42-64617d916a5c tempest-HypervisorAdminUnderV252Test-735445904 tempest-HypervisorAdminUnderV252Test-735445904-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.682013 Jun 20 11:58:27.676486 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 323/655] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 11:58:26 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:58:27.693401 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6cd7ea83-4e28-47b7-abb1-81576895f12a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:27.695974 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6cd7ea83-4e28-47b7-abb1-81576895f12a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 29575605-7785-45df-becf-359b0da6db4e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:27.712745 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6cd7ea83-4e28-47b7-abb1-81576895f12a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:27.716523 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6cd7ea83-4e28-47b7-abb1-81576895f12a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:27.717581 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6cd7ea83-4e28-47b7-abb1-81576895f12a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:27.718185 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6cd7ea83-4e28-47b7-abb1-81576895f12a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:28.076434 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6cd7ea83-4e28-47b7-abb1-81576895f12a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:28.090044 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6cd7ea83-4e28-47b7-abb1-81576895f12a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:28.091581 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6cd7ea83-4e28-47b7-abb1-81576895f12a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:28.096475 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6cd7ea83-4e28-47b7-abb1-81576895f12a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e" status: 200 len: 1362 microversion: 2.25 time: 0.418631 Jun 20 11:58:28.103066 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 324/656] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:58:27 2022] GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e => generated 1362 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:58:28.109927 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6a31ee3f-8409-4a23-b1b3-32e057d0e132 tempest-HypervisorAdminUnderV252Test-735445904 tempest-HypervisorAdminUnderV252Test-735445904-project-admin] Calling method '.version_select at 0x7f6073cb24c0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:28.119166 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:58:28.119166 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:58:28.125144 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6a31ee3f-8409-4a23-b1b3-32e057d0e132 tempest-HypervisorAdminUnderV252Test-735445904 tempest-HypervisorAdminUnderV252Test-735445904-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:28.125861 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6a31ee3f-8409-4a23-b1b3-32e057d0e132 tempest-HypervisorAdminUnderV252Test-735445904 tempest-HypervisorAdminUnderV252Test-735445904-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:28.167632 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6a31ee3f-8409-4a23-b1b3-32e057d0e132 tempest-HypervisorAdminUnderV252Test-735445904 tempest-HypervisorAdminUnderV252Test-735445904-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:28.168240 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6a31ee3f-8409-4a23-b1b3-32e057d0e132 tempest-HypervisorAdminUnderV252Test-735445904 tempest-HypervisorAdminUnderV252Test-735445904-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:28.259565 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6a31ee3f-8409-4a23-b1b3-32e057d0e132 tempest-HypervisorAdminUnderV252Test-735445904 tempest-HypervisorAdminUnderV252Test-735445904-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:28.260142 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6a31ee3f-8409-4a23-b1b3-32e057d0e132 tempest-HypervisorAdminUnderV252Test-735445904 tempest-HypervisorAdminUnderV252Test-735445904-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:28.272932 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6a31ee3f-8409-4a23-b1b3-32e057d0e132 tempest-HypervisorAdminUnderV252Test-735445904 tempest-HypervisorAdminUnderV252Test-735445904-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/n-h1-master-1/servers" status: 200 len: 433 microversion: 2.1 time: 0.168290 Jun 20 11:58:28.273876 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 325/657] 10.222.0.27 () {58 vars in 1211 bytes} [Mon Jun 20 11:58:28 2022] GET /compute/v2.1/os-hypervisors/n-h1-master-1/servers => generated 433 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:58:28.278730 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d4cad786-4a91-4af1-b859-3dc4860106d9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:28.279347 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d4cad786-4a91-4af1-b859-3dc4860106d9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 66d1074f-478d-4676-ab01-4dc1d4561a42] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:28.294946 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d4cad786-4a91-4af1-b859-3dc4860106d9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:28.295403 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d4cad786-4a91-4af1-b859-3dc4860106d9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:28.296229 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d4cad786-4a91-4af1-b859-3dc4860106d9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:28.296669 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d4cad786-4a91-4af1-b859-3dc4860106d9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:28.326080 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7ca424a5-b1b7-47e1-a387-a0d5dc42759f tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f4477b25804205a497458b38d66883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3842c54af1c84c5ead0c5cf6530df872', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:28.344962 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7ca424a5-b1b7-47e1-a387-a0d5dc42759f tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/servers/a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0" status: 200 len: 1316 microversion: 2.1 time: 1.103573 Jun 20 11:58:28.346658 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 333/658] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:27 2022] GET /compute/v2.1/servers/a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0 => generated 1316 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:28.353488 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-40dababf-27f1-4274-8f1a-aa4c041996c7 tempest-HypervisorAdminUnderV252Test-735445904 tempest-HypervisorAdminUnderV252Test-735445904-project-admin] Calling method '.version_select at 0x7f60738a6550>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:28.355439 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:58:28.355439 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:58:28.357475 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-40dababf-27f1-4274-8f1a-aa4c041996c7 tempest-HypervisorAdminUnderV252Test-735445904 tempest-HypervisorAdminUnderV252Test-735445904-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:28.358134 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-40dababf-27f1-4274-8f1a-aa4c041996c7 tempest-HypervisorAdminUnderV252Test-735445904 tempest-HypervisorAdminUnderV252Test-735445904-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:28.379171 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-40dababf-27f1-4274-8f1a-aa4c041996c7 tempest-HypervisorAdminUnderV252Test-735445904 tempest-HypervisorAdminUnderV252Test-735445904-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:28.380632 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-40dababf-27f1-4274-8f1a-aa4c041996c7 tempest-HypervisorAdminUnderV252Test-735445904 tempest-HypervisorAdminUnderV252Test-735445904-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:28.404587 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-40dababf-27f1-4274-8f1a-aa4c041996c7 tempest-HypervisorAdminUnderV252Test-735445904 tempest-HypervisorAdminUnderV252Test-735445904-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:28.405141 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-40dababf-27f1-4274-8f1a-aa4c041996c7 tempest-HypervisorAdminUnderV252Test-735445904 tempest-HypervisorAdminUnderV252Test-735445904-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:28.424241 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-40dababf-27f1-4274-8f1a-aa4c041996c7 tempest-HypervisorAdminUnderV252Test-735445904 tempest-HypervisorAdminUnderV252Test-735445904-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.076017 Jun 20 11:58:28.428409 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 334/659] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 11:58:28 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:58:28.449932 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-686c6ee1-2d65-400a-994a-8ea25b90b6a3 tempest-HypervisorAdminUnderV252Test-735445904 tempest-HypervisorAdminUnderV252Test-735445904-project-admin] Calling method '.version_select at 0x7f60738bc9d0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:28.451454 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:58:28.451454 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:58:28.459933 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-686c6ee1-2d65-400a-994a-8ea25b90b6a3 tempest-HypervisorAdminUnderV252Test-735445904 tempest-HypervisorAdminUnderV252Test-735445904-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:28.460575 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-686c6ee1-2d65-400a-994a-8ea25b90b6a3 tempest-HypervisorAdminUnderV252Test-735445904 tempest-HypervisorAdminUnderV252Test-735445904-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:28.521414 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-686c6ee1-2d65-400a-994a-8ea25b90b6a3 tempest-HypervisorAdminUnderV252Test-735445904 tempest-HypervisorAdminUnderV252Test-735445904-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:28.522238 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-686c6ee1-2d65-400a-994a-8ea25b90b6a3 tempest-HypervisorAdminUnderV252Test-735445904 tempest-HypervisorAdminUnderV252Test-735445904-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:28.548592 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-686c6ee1-2d65-400a-994a-8ea25b90b6a3 tempest-HypervisorAdminUnderV252Test-735445904 tempest-HypervisorAdminUnderV252Test-735445904-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/n-h1-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.116336 Jun 20 11:58:28.549769 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 335/660] 10.222.0.27 () {58 vars in 1208 bytes} [Mon Jun 20 11:58:28 2022] GET /compute/v2.1/os-hypervisors/n-h1-master-1/search => generated 104 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:58:28.774726 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d4cad786-4a91-4af1-b859-3dc4860106d9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:28.790685 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d4cad786-4a91-4af1-b859-3dc4860106d9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42" status: 200 len: 1317 microversion: 2.1 time: 0.511255 Jun 20 11:58:28.800236 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 326/661] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:28 2022] GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42 => generated 1317 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:29.137715 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-638d5ae0-3090-4d29-b4ed-569273d1cac5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:29.138723 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-638d5ae0-3090-4d29-b4ed-569273d1cac5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 29575605-7785-45df-becf-359b0da6db4e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:29.163345 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-638d5ae0-3090-4d29-b4ed-569273d1cac5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:29.170137 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-638d5ae0-3090-4d29-b4ed-569273d1cac5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:29.173118 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-638d5ae0-3090-4d29-b4ed-569273d1cac5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:29.178594 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-638d5ae0-3090-4d29-b4ed-569273d1cac5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:29.366678 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a4cd3bd8-7d3a-4a89-b6d6-396449763ba2 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:29.367161 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a4cd3bd8-7d3a-4a89-b6d6-396449763ba2 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] [instance: a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:29.380407 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a4cd3bd8-7d3a-4a89-b6d6-396449763ba2 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:29.380856 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a4cd3bd8-7d3a-4a89-b6d6-396449763ba2 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:29.381659 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a4cd3bd8-7d3a-4a89-b6d6-396449763ba2 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:29.384682 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a4cd3bd8-7d3a-4a89-b6d6-396449763ba2 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:29.892405 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-638d5ae0-3090-4d29-b4ed-569273d1cac5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:29.909487 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-638d5ae0-3090-4d29-b4ed-569273d1cac5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:29.911007 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-638d5ae0-3090-4d29-b4ed-569273d1cac5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:29.912143 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-638d5ae0-3090-4d29-b4ed-569273d1cac5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e" status: 200 len: 1362 microversion: 2.25 time: 0.789185 Jun 20 11:58:29.923400 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 336/662] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:58:29 2022] GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e => generated 1362 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:58:30.159664 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1210315c-2212-458c-bb3b-a5de7ab82c94 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1864078424", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:30.235470 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-1210315c-2212-458c-bb3b-a5de7ab82c94 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] validate_networks() for None {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:58:30.274299 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a4cd3bd8-7d3a-4a89-b6d6-396449763ba2 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f4477b25804205a497458b38d66883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3842c54af1c84c5ead0c5cf6530df872', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:30.283076 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a4cd3bd8-7d3a-4a89-b6d6-396449763ba2 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/servers/a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0" status: 200 len: 1316 microversion: 2.1 time: 0.924499 Jun 20 11:58:30.283681 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 327/663] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:29 2022] GET /compute/v2.1/servers/a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0 => generated 1316 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:30.300312 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8ef62e84-d37a-48a4-ba3a-d507e5dadf00 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:30.301195 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8ef62e84-d37a-48a4-ba3a-d507e5dadf00 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 66d1074f-478d-4676-ab01-4dc1d4561a42] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:30.304584 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:58:30.310988 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8ef62e84-d37a-48a4-ba3a-d507e5dadf00 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:30.311549 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8ef62e84-d37a-48a4-ba3a-d507e5dadf00 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:30.312496 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8ef62e84-d37a-48a4-ba3a-d507e5dadf00 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:30.313665 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8ef62e84-d37a-48a4-ba3a-d507e5dadf00 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:30.704531 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8ef62e84-d37a-48a4-ba3a-d507e5dadf00 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:30.719585 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8ef62e84-d37a-48a4-ba3a-d507e5dadf00 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42" status: 200 len: 1317 microversion: 2.1 time: 0.434192 Jun 20 11:58:30.721472 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 328/664] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:30 2022] GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42 => generated 1317 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:30.799344 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-005eb129-f8e4-49d1-96e1-3fd9c4297bd7 req-fde150ab-33b4-4774-a218-7fb6cb3bf1c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66d1074f-478d-4676-ab01-4dc1d4561a42", "tag": "72a638fb-8a29-4a15-ac3c-30318a976b7a"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:30.823179 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-005eb129-f8e4-49d1-96e1-3fd9c4297bd7 req-fde150ab-33b4-4774-a218-7fb6cb3bf1c9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:30.825463 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-005eb129-f8e4-49d1-96e1-3fd9c4297bd7 req-fde150ab-33b4-4774-a218-7fb6cb3bf1c9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:30.845098 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-005eb129-f8e4-49d1-96e1-3fd9c4297bd7 req-fde150ab-33b4-4774-a218-7fb6cb3bf1c9 service nova] Creating event network-changed:72a638fb-8a29-4a15-ac3c-30318a976b7a for instance 66d1074f-478d-4676-ab01-4dc1d4561a42 on n-h2-master-1 Jun 20 11:58:30.851602 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-005eb129-f8e4-49d1-96e1-3fd9c4297bd7 req-fde150ab-33b4-4774-a218-7fb6cb3bf1c9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059353 Jun 20 11:58:30.852756 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 329/665] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:58:30.931291 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5424435c-2b32-4cda-a41c-e329ad9d045c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:30.932235 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5424435c-2b32-4cda-a41c-e329ad9d045c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 29575605-7785-45df-becf-359b0da6db4e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:30.942466 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5424435c-2b32-4cda-a41c-e329ad9d045c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:30.942922 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5424435c-2b32-4cda-a41c-e329ad9d045c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:30.943713 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5424435c-2b32-4cda-a41c-e329ad9d045c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:30.944159 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5424435c-2b32-4cda-a41c-e329ad9d045c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:30.997932 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-1210315c-2212-458c-bb3b-a5de7ab82c94 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:58:30.999052 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-1210315c-2212-458c-bb3b-a5de7ab82c94 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:58:30.999666 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-1210315c-2212-458c-bb3b-a5de7ab82c94 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:58:31.000276 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-1210315c-2212-458c-bb3b-a5de7ab82c94 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:58:31.001421 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-1210315c-2212-458c-bb3b-a5de7ab82c94 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:58:31.020794 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1210315c-2212-458c-bb3b-a5de7ab82c94 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:31.021547 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1210315c-2212-458c-bb3b-a5de7ab82c94 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:31.022546 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1210315c-2212-458c-bb3b-a5de7ab82c94 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:31.023261 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1210315c-2212-458c-bb3b-a5de7ab82c94 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:31.076725 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-1210315c-2212-458c-bb3b-a5de7ab82c94 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Getting quotas for project 15149d3df8e846cc993a30a0e0f75b3e. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:58:31.101151 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-1210315c-2212-458c-bb3b-a5de7ab82c94 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Getting quotas for user c7f3607d4bf04f74a49b74ff74875dd0 and project 15149d3df8e846cc993a30a0e0f75b3e. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:58:31.120658 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1210315c-2212-458c-bb3b-a5de7ab82c94 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:58:31.123458 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1210315c-2212-458c-bb3b-a5de7ab82c94 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] [instance: da760340-ab64-4d7c-a4c9-3bcd606858c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:58:31.176817 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1210315c-2212-458c-bb3b-a5de7ab82c94 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.251589 Jun 20 11:58:31.183749 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 337/666] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:58:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 11:58:31.189917 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4890f7b3-5101-4cd0-be8a-eb9544f267e6 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:31.191019 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4890f7b3-5101-4cd0-be8a-eb9544f267e6 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] [instance: da760340-ab64-4d7c-a4c9-3bcd606858c5] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:31.262532 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5424435c-2b32-4cda-a41c-e329ad9d045c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:31.278298 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5424435c-2b32-4cda-a41c-e329ad9d045c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:31.283518 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5424435c-2b32-4cda-a41c-e329ad9d045c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:31.285609 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5424435c-2b32-4cda-a41c-e329ad9d045c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e" status: 200 len: 1362 microversion: 2.25 time: 0.358913 Jun 20 11:58:31.305005 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 330/667] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:58:30 2022] GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e => generated 1362 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 11:58:31.328238 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-74c3bfde-d36c-4886-9ee5-0986a54115f3 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:31.330819 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-74c3bfde-d36c-4886-9ee5-0986a54115f3 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] [instance: a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:31.340110 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-74c3bfde-d36c-4886-9ee5-0986a54115f3 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:31.342690 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-74c3bfde-d36c-4886-9ee5-0986a54115f3 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:31.344317 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-74c3bfde-d36c-4886-9ee5-0986a54115f3 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:31.345394 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-74c3bfde-d36c-4886-9ee5-0986a54115f3 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:31.401146 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4890f7b3-5101-4cd0-be8a-eb9544f267e6 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3607d4bf04f74a49b74ff74875dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15149d3df8e846cc993a30a0e0f75b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:31.420124 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4890f7b3-5101-4cd0-be8a-eb9544f267e6 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] 10.222.0.27 "GET /compute/v2.1/servers/da760340-ab64-4d7c-a4c9-3bcd606858c5" status: 200 len: 1223 microversion: 2.1 time: 0.234714 Jun 20 11:58:31.421083 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 338/668] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:31 2022] GET /compute/v2.1/servers/da760340-ab64-4d7c-a4c9-3bcd606858c5 => generated 1223 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:31.740772 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-52a74776-bee3-4722-a64e-5bd2aedaded8 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:31.741519 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-52a74776-bee3-4722-a64e-5bd2aedaded8 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 66d1074f-478d-4676-ab01-4dc1d4561a42] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:31.749587 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-52a74776-bee3-4722-a64e-5bd2aedaded8 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:31.750035 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-52a74776-bee3-4722-a64e-5bd2aedaded8 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:31.750805 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-52a74776-bee3-4722-a64e-5bd2aedaded8 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:31.751238 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-52a74776-bee3-4722-a64e-5bd2aedaded8 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:31.994309 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-74c3bfde-d36c-4886-9ee5-0986a54115f3 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f4477b25804205a497458b38d66883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3842c54af1c84c5ead0c5cf6530df872', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:32.031843 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-74c3bfde-d36c-4886-9ee5-0986a54115f3 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/servers/a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0" status: 200 len: 1316 microversion: 2.1 time: 0.719985 Jun 20 11:58:32.032435 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 331/669] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:31 2022] GET /compute/v2.1/servers/a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0 => generated 1316 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:32.266214 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-52a74776-bee3-4722-a64e-5bd2aedaded8 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:32.281680 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-52a74776-bee3-4722-a64e-5bd2aedaded8 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42" status: 200 len: 1317 microversion: 2.1 time: 0.544390 Jun 20 11:58:32.284076 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 339/670] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:31 2022] GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42 => generated 1317 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:32.310384 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-81095668-d307-424d-aeb0-7117fe2b74fb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:32.310997 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-81095668-d307-424d-aeb0-7117fe2b74fb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 29575605-7785-45df-becf-359b0da6db4e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:32.359152 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-81095668-d307-424d-aeb0-7117fe2b74fb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:32.359599 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-81095668-d307-424d-aeb0-7117fe2b74fb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:32.363867 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-81095668-d307-424d-aeb0-7117fe2b74fb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:32.364183 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-81095668-d307-424d-aeb0-7117fe2b74fb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:32.453376 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1f5d4067-66b6-4914-9283-75f00cadf915 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:32.455751 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1f5d4067-66b6-4914-9283-75f00cadf915 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] [instance: da760340-ab64-4d7c-a4c9-3bcd606858c5] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:32.475262 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f5d4067-66b6-4914-9283-75f00cadf915 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:32.476442 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f5d4067-66b6-4914-9283-75f00cadf915 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:32.477641 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f5d4067-66b6-4914-9283-75f00cadf915 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:32.483553 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f5d4067-66b6-4914-9283-75f00cadf915 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:32.628831 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1f5d4067-66b6-4914-9283-75f00cadf915 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3607d4bf04f74a49b74ff74875dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15149d3df8e846cc993a30a0e0f75b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:32.644837 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1f5d4067-66b6-4914-9283-75f00cadf915 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] 10.222.0.27 "GET /compute/v2.1/servers/da760340-ab64-4d7c-a4c9-3bcd606858c5" status: 200 len: 1275 microversion: 2.1 time: 0.203129 Jun 20 11:58:32.656001 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 340/671] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:32 2022] GET /compute/v2.1/servers/da760340-ab64-4d7c-a4c9-3bcd606858c5 => generated 1275 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:58:32.684413 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-81095668-d307-424d-aeb0-7117fe2b74fb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:32.700380 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-81095668-d307-424d-aeb0-7117fe2b74fb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:32.701998 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-81095668-d307-424d-aeb0-7117fe2b74fb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:32.705791 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-81095668-d307-424d-aeb0-7117fe2b74fb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e" status: 200 len: 1362 microversion: 2.25 time: 0.400255 Jun 20 11:58:32.710831 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 332/672] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:58:32 2022] GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e => generated 1362 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:58:33.061199 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-713b4a6d-7a69-4fcf-adbe-82225e7ee2fa tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:33.062448 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-713b4a6d-7a69-4fcf-adbe-82225e7ee2fa tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] [instance: a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:33.082931 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-713b4a6d-7a69-4fcf-adbe-82225e7ee2fa tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:33.083496 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-713b4a6d-7a69-4fcf-adbe-82225e7ee2fa tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:33.085545 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-713b4a6d-7a69-4fcf-adbe-82225e7ee2fa tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:33.086153 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-713b4a6d-7a69-4fcf-adbe-82225e7ee2fa tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:33.226798 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-f3ecee97-df39-4c8f-b48c-e5b439a4c7e3 req-184dcaf6-1374-48c6-87a2-1ca64b1f6f45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0", "name": "network-vif-plugged", "status": "completed", "tag": "736a1975-6c4b-4f19-83da-ab507fc213c8"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:33.233348 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=58 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:58:33.252844 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-f3ecee97-df39-4c8f-b48c-e5b439a4c7e3 req-184dcaf6-1374-48c6-87a2-1ca64b1f6f45 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:33.255149 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-f3ecee97-df39-4c8f-b48c-e5b439a4c7e3 req-184dcaf6-1374-48c6-87a2-1ca64b1f6f45 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:33.286140 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-f3ecee97-df39-4c8f-b48c-e5b439a4c7e3 req-184dcaf6-1374-48c6-87a2-1ca64b1f6f45 service nova] Creating event network-vif-plugged:736a1975-6c4b-4f19-83da-ab507fc213c8 for instance a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0 on n-h1-master-1 Jun 20 11:58:33.306850 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-f3ecee97-df39-4c8f-b48c-e5b439a4c7e3 req-184dcaf6-1374-48c6-87a2-1ca64b1f6f45 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080816 Jun 20 11:58:33.307352 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 333/673] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 11:58:33.332283 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-80bdf78d-c0fd-4449-a70d-3878b62a71dc tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:33.332941 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-80bdf78d-c0fd-4449-a70d-3878b62a71dc tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 66d1074f-478d-4676-ab01-4dc1d4561a42] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:33.356726 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-80bdf78d-c0fd-4449-a70d-3878b62a71dc tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:33.357177 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-80bdf78d-c0fd-4449-a70d-3878b62a71dc tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:33.357996 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-80bdf78d-c0fd-4449-a70d-3878b62a71dc tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:33.358428 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-80bdf78d-c0fd-4449-a70d-3878b62a71dc tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:33.648973 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-80bdf78d-c0fd-4449-a70d-3878b62a71dc tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:33.671263 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:58:33.678159 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-80bdf78d-c0fd-4449-a70d-3878b62a71dc tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42" status: 200 len: 1317 microversion: 2.1 time: 0.369370 Jun 20 11:58:33.705616 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 334/674] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:33 2022] GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42 => generated 1317 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:33.714981 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-340edc8b-392a-48a7-8727-946edb9d9c97 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:33.715643 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-340edc8b-392a-48a7-8727-946edb9d9c97 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] [instance: da760340-ab64-4d7c-a4c9-3bcd606858c5] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:33.754205 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-340edc8b-392a-48a7-8727-946edb9d9c97 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:33.754564 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-340edc8b-392a-48a7-8727-946edb9d9c97 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:33.755353 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-340edc8b-392a-48a7-8727-946edb9d9c97 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:33.755784 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-340edc8b-392a-48a7-8727-946edb9d9c97 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:33.908551 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-340edc8b-392a-48a7-8727-946edb9d9c97 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3607d4bf04f74a49b74ff74875dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15149d3df8e846cc993a30a0e0f75b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:33.917445 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-340edc8b-392a-48a7-8727-946edb9d9c97 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] 10.222.0.27 "GET /compute/v2.1/servers/da760340-ab64-4d7c-a4c9-3bcd606858c5" status: 200 len: 1281 microversion: 2.1 time: 0.210354 Jun 20 11:58:33.918668 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 335/675] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:33 2022] GET /compute/v2.1/servers/da760340-ab64-4d7c-a4c9-3bcd606858c5 => generated 1281 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:33.924351 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d8a98684-d068-48ea-b96c-0132c6c6c6ca tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:33.925813 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d8a98684-d068-48ea-b96c-0132c6c6c6ca tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 29575605-7785-45df-becf-359b0da6db4e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:33.938847 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d8a98684-d068-48ea-b96c-0132c6c6c6ca tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:33.939596 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d8a98684-d068-48ea-b96c-0132c6c6c6ca tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:33.940610 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d8a98684-d068-48ea-b96c-0132c6c6c6ca tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:33.941199 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d8a98684-d068-48ea-b96c-0132c6c6c6ca tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:34.200699 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d8a98684-d068-48ea-b96c-0132c6c6c6ca tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:34.215905 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d8a98684-d068-48ea-b96c-0132c6c6c6ca tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:34.221327 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d8a98684-d068-48ea-b96c-0132c6c6c6ca tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:34.223548 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d8a98684-d068-48ea-b96c-0132c6c6c6ca tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e" status: 200 len: 1362 microversion: 2.25 time: 0.303567 Jun 20 11:58:34.224756 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 336/676] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:58:33 2022] GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e => generated 1362 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:58:34.312345 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-713b4a6d-7a69-4fcf-adbe-82225e7ee2fa tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f4477b25804205a497458b38d66883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3842c54af1c84c5ead0c5cf6530df872', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:34.328090 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-713b4a6d-7a69-4fcf-adbe-82225e7ee2fa tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/servers/a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0" status: 200 len: 1316 microversion: 2.1 time: 1.274552 Jun 20 11:58:34.330831 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 341/677] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:33 2022] GET /compute/v2.1/servers/a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0 => generated 1316 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:58:34.705499 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-188bfb06-67dc-48b7-8b1e-c3078af1aa82 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:34.706730 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-188bfb06-67dc-48b7-8b1e-c3078af1aa82 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 66d1074f-478d-4676-ab01-4dc1d4561a42] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:34.720849 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-188bfb06-67dc-48b7-8b1e-c3078af1aa82 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:34.725918 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-188bfb06-67dc-48b7-8b1e-c3078af1aa82 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:34.727780 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-188bfb06-67dc-48b7-8b1e-c3078af1aa82 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:34.739165 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-188bfb06-67dc-48b7-8b1e-c3078af1aa82 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:34.935488 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e091f32c-84eb-4051-b224-2e329efbe351 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:34.936381 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e091f32c-84eb-4051-b224-2e329efbe351 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] [instance: da760340-ab64-4d7c-a4c9-3bcd606858c5] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:34.943920 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e091f32c-84eb-4051-b224-2e329efbe351 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:34.944804 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e091f32c-84eb-4051-b224-2e329efbe351 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:34.945937 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e091f32c-84eb-4051-b224-2e329efbe351 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:34.946764 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e091f32c-84eb-4051-b224-2e329efbe351 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:35.116606 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e091f32c-84eb-4051-b224-2e329efbe351 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3607d4bf04f74a49b74ff74875dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15149d3df8e846cc993a30a0e0f75b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:35.126349 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e091f32c-84eb-4051-b224-2e329efbe351 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] 10.222.0.27 "GET /compute/v2.1/servers/da760340-ab64-4d7c-a4c9-3bcd606858c5" status: 200 len: 1281 microversion: 2.1 time: 0.195256 Jun 20 11:58:35.131980 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 342/678] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:34 2022] GET /compute/v2.1/servers/da760340-ab64-4d7c-a4c9-3bcd606858c5 => generated 1281 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:58:35.246586 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-041b9e32-f7bc-4993-9e07-8c2d395d1b87 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:35.247455 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-041b9e32-f7bc-4993-9e07-8c2d395d1b87 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 29575605-7785-45df-becf-359b0da6db4e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:35.258499 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-041b9e32-f7bc-4993-9e07-8c2d395d1b87 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:35.266436 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-041b9e32-f7bc-4993-9e07-8c2d395d1b87 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:35.267598 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-041b9e32-f7bc-4993-9e07-8c2d395d1b87 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:35.268240 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-041b9e32-f7bc-4993-9e07-8c2d395d1b87 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:35.750920 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-041b9e32-f7bc-4993-9e07-8c2d395d1b87 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:35.774966 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-041b9e32-f7bc-4993-9e07-8c2d395d1b87 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:35.781291 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-041b9e32-f7bc-4993-9e07-8c2d395d1b87 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:35.784602 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-041b9e32-f7bc-4993-9e07-8c2d395d1b87 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e" status: 200 len: 1362 microversion: 2.25 time: 0.544683 Jun 20 11:58:35.787886 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 343/679] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:58:35 2022] GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e => generated 1362 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:58:35.798661 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-9835eff2-06f5-444d-b084-ddffabfffa75 req-8f07a23b-c4e8-468e-a467-d39cf85239c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29575605-7785-45df-becf-359b0da6db4e", "name": "network-vif-plugged", "status": "completed", "tag": "e0f1c5e6-79d0-4e55-a956-27d25ee10457"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:35.827768 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9835eff2-06f5-444d-b084-ddffabfffa75 req-8f07a23b-c4e8-468e-a467-d39cf85239c7 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:35.828268 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-188bfb06-67dc-48b7-8b1e-c3078af1aa82 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:35.847218 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-188bfb06-67dc-48b7-8b1e-c3078af1aa82 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42" status: 200 len: 1317 microversion: 2.1 time: 1.147089 Jun 20 11:58:35.848912 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 337/680] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:34 2022] GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42 => generated 1317 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:35.852955 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9835eff2-06f5-444d-b084-ddffabfffa75 req-8f07a23b-c4e8-468e-a467-d39cf85239c7 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:35.862266 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-04e8d69d-402e-4477-9c11-27a29df3f5e5 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:35.863617 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-04e8d69d-402e-4477-9c11-27a29df3f5e5 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] [instance: a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:35.888317 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-9835eff2-06f5-444d-b084-ddffabfffa75 req-8f07a23b-c4e8-468e-a467-d39cf85239c7 service nova] Creating event network-vif-plugged:e0f1c5e6-79d0-4e55-a956-27d25ee10457 for instance 29575605-7785-45df-becf-359b0da6db4e on n-h2-master-1 Jun 20 11:58:35.893218 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-04e8d69d-402e-4477-9c11-27a29df3f5e5 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:35.894145 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-04e8d69d-402e-4477-9c11-27a29df3f5e5 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:35.897005 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-04e8d69d-402e-4477-9c11-27a29df3f5e5 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:35.898613 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-04e8d69d-402e-4477-9c11-27a29df3f5e5 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:35.903084 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-9835eff2-06f5-444d-b084-ddffabfffa75 req-8f07a23b-c4e8-468e-a467-d39cf85239c7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108895 Jun 20 11:58:35.906430 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 344/681] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:58:36.451802 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-04e8d69d-402e-4477-9c11-27a29df3f5e5 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f4477b25804205a497458b38d66883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3842c54af1c84c5ead0c5cf6530df872', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:36.465250 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-04e8d69d-402e-4477-9c11-27a29df3f5e5 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/servers/a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0" status: 200 len: 1464 microversion: 2.1 time: 0.614077 Jun 20 11:58:36.465763 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 338/682] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:35 2022] GET /compute/v2.1/servers/a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0 => generated 1464 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:36.491732 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3e65e8ac-f49e-4440-80fb-d0b3e72e4f4e tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:36.492372 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3e65e8ac-f49e-4440-80fb-d0b3e72e4f4e tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] [instance: da760340-ab64-4d7c-a4c9-3bcd606858c5] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:36.513178 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e65e8ac-f49e-4440-80fb-d0b3e72e4f4e tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:36.516060 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e65e8ac-f49e-4440-80fb-d0b3e72e4f4e tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:36.517771 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e65e8ac-f49e-4440-80fb-d0b3e72e4f4e tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:36.521426 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e65e8ac-f49e-4440-80fb-d0b3e72e4f4e tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:36.641770 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-338268b2-f9cd-4bec-8189-ad4450520597 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Action: 'update', calling method: .version_select at 0x7f607384c5e0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:36.643667 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:58:36.643667 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:58:36.644938 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-338268b2-f9cd-4bec-8189-ad4450520597 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:36.646834 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-338268b2-f9cd-4bec-8189-ad4450520597 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:36.656912 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-338268b2-f9cd-4bec-8189-ad4450520597 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:36.657708 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-338268b2-f9cd-4bec-8189-ad4450520597 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:36.666869 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-338268b2-f9cd-4bec-8189-ad4450520597 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] HTTP exception thrown: Service 382880e4-da35-478f-8228-baba3b7ac5ed could not be found. Jun 20 11:58:36.669543 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-338268b2-f9cd-4bec-8189-ad4450520597 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Request method failure captured: Jun 20 11:58:36.669543 n-d-master-1 devstack@n-api.service[119128]: request: PUT /compute/v2.1/os-services/382880e4-da35-478f-8228-baba3b7ac5ed HTTP/1.1 Jun 20 11:58:36.669543 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:58:36.669543 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:58:36.669543 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:58:36.669543 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 56 Jun 20 11:58:36.669543 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:58:36.669543 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:58:36.669543 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:58:36.669543 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:58:36.669543 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGDrXWnM0Rof0cmZ_bBny9e_9yfomswF7isjJhVjPdCe2xshdUtxcDZjevB9IvUZxtgCsj6sXfAKFXESOtreRrGz-ZlYENOls3-Z2rEPcQXTlancCSaQ_Im8fAuKagkmZSJwIkyMQwFQxNiMRc5WGK0rbLwcdmjDJ3wRKySz-oPEgDA Jun 20 11:58:36.669543 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:58:36.669543 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:58:36.669543 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:58:36.669543 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:58:36.669543 n-d-master-1 devstack@n-api.service[119128]: X-Openstack-Nova-Api-Version: 2.53 Jun 20 11:58:36.669543 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:58:36.669543 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:58:36.669543 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 4056040e3cc045118e1ee508583bd535 Jun 20 11:58:36.669543 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1453410473 Jun 20 11:58:36.669543 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member,admin Jun 20 11:58:36.669543 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member,admin Jun 20 11:58:36.671114 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4056040e3cc045118e1ee508583bd535"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4056040e3cc045118e1ee508583bd535"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4056040e3cc045118e1ee508583bd535"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4056040e3cc045118e1ee508583bd535"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:58:36.671114 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1453410473 Jun 20 11:58:36.671114 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 4056040e3cc045118e1ee508583bd535 Jun 20 11:58:36.671114 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1453410473 Jun 20 11:58:36.671114 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin Jun 20 11:58:36.671114 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:58:36.671114 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:58:36.671114 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 81344de13723473cad926b3cf2acb3e1 Jun 20 11:58:36.671114 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin Jun 20 11:58:36.671114 n-d-master-1 devstack@n-api.service[119128]: Jun 20 11:58:36.671114 n-d-master-1 devstack@n-api.service[119128]: {"status": "disabled", "disabled_reason": "maintenance"} Jun 20 11:58:36.671114 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 11:58:36.671114 n-d-master-1 devstack@n-api.service[119128]: exception: Service 382880e4-da35-478f-8228-baba3b7ac5ed could not be found. Jun 20 11:58:36.671962 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '382880e4-da35-478f-8228-baba3b7ac5ed', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Jun 20 11:58:36.671962 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:58:36.671962 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:36.671962 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jun 20 11:58:36.671962 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jun 20 11:58:36.671962 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jun 20 11:58:36.671962 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jun 20 11:58:36.671962 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jun 20 11:58:36.671962 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:58:36.671962 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:58:36.671962 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:58:36.671962 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:36.671962 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jun 20 11:58:36.671962 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jun 20 11:58:36.671962 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jun 20 11:58:36.671962 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jun 20 11:58:36.671962 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 382880e4-da35-478f-8228-baba3b7ac5ed could not be found. Jun 20 11:58:36.671962 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:58:36.671962 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:58:36.671962 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:58:36.671962 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:36.673378 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:58:36.673378 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:58:36.673378 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:58:36.673378 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:58:36.673378 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 11:58:36.673378 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 11:58:36.673378 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:58:36.673378 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:58:36.673378 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:58:36.673378 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:58:36.673378 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jun 20 11:58:36.673378 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:58:36.673378 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 382880e4-da35-478f-8228-baba3b7ac5ed could not be found. Jun 20 11:58:36.673378 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:58:36.673378 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:58:36.673378 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:58:36.673378 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:36.673378 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:58:36.673378 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:58:36.673378 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:58:36.674630 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:58:36.674630 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 382880e4-da35-478f-8228-baba3b7ac5ed could not be found. Jun 20 11:58:36.674630 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:58:36.677020 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-338268b2-f9cd-4bec-8189-ad4450520597 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Returning 404 to user: Service 382880e4-da35-478f-8228-baba3b7ac5ed could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:58:36.678133 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-338268b2-f9cd-4bec-8189-ad4450520597 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-services/382880e4-da35-478f-8228-baba3b7ac5ed" status: 404 len: 110 microversion: 2.53 time: 0.767309 Jun 20 11:58:36.679314 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 345/683] 10.222.0.27 () {62 vars in 1308 bytes} [Mon Jun 20 11:58:35 2022] PUT /compute/v2.1/os-services/382880e4-da35-478f-8228-baba3b7ac5ed => generated 110 bytes in 770 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 11:58:36.689454 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2e6de724-8b64-47a2-9ffb-5161bcb098df tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-510168271", "metadata": {"image_type": "test"}}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:36.691038 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2e6de724-8b64-47a2-9ffb-5161bcb098df tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] [instance: a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:36.699750 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2e6de724-8b64-47a2-9ffb-5161bcb098df tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:36.700396 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2e6de724-8b64-47a2-9ffb-5161bcb098df tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:36.702690 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2e6de724-8b64-47a2-9ffb-5161bcb098df tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:36.703864 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2e6de724-8b64-47a2-9ffb-5161bcb098df tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:36.774086 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-2e6de724-8b64-47a2-9ffb-5161bcb098df tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Getting quotas for project 3842c54af1c84c5ead0c5cf6530df872. Resources: dict_keys(['metadata_items']) {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:58:36.785539 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-2e6de724-8b64-47a2-9ffb-5161bcb098df tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Getting quotas for user 04f4477b25804205a497458b38d66883 and project 3842c54af1c84c5ead0c5cf6530df872. Resources: dict_keys(['metadata_items']) {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:58:36.819055 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3e65e8ac-f49e-4440-80fb-d0b3e72e4f4e tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3607d4bf04f74a49b74ff74875dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15149d3df8e846cc993a30a0e0f75b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:36.827427 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3e65e8ac-f49e-4440-80fb-d0b3e72e4f4e tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] 10.222.0.27 "GET /compute/v2.1/servers/da760340-ab64-4d7c-a4c9-3bcd606858c5" status: 200 len: 1323 microversion: 2.1 time: 0.342485 Jun 20 11:58:36.828051 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 339/684] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:36 2022] GET /compute/v2.1/servers/da760340-ab64-4d7c-a4c9-3bcd606858c5 => generated 1323 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:36.887446 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=28 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:58:37.018821 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-232995f0-67d7-46e3-b924-7a0925c419d0 tempest-HypervisorAdminV228Test-2002095343 tempest-HypervisorAdminV228Test-2002095343-project-admin] Calling method '.version_select at 0x7f6073a909d0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:37.019838 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:58:37.019838 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:58:37.021595 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-232995f0-67d7-46e3-b924-7a0925c419d0 tempest-HypervisorAdminV228Test-2002095343 tempest-HypervisorAdminV228Test-2002095343-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:37.022391 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-232995f0-67d7-46e3-b924-7a0925c419d0 tempest-HypervisorAdminV228Test-2002095343 tempest-HypervisorAdminV228Test-2002095343-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:37.041449 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-232995f0-67d7-46e3-b924-7a0925c419d0 tempest-HypervisorAdminV228Test-2002095343 tempest-HypervisorAdminV228Test-2002095343-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:37.042044 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-232995f0-67d7-46e3-b924-7a0925c419d0 tempest-HypervisorAdminV228Test-2002095343 tempest-HypervisorAdminV228Test-2002095343-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:37.055097 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-232995f0-67d7-46e3-b924-7a0925c419d0 tempest-HypervisorAdminV228Test-2002095343 tempest-HypervisorAdminV228Test-2002095343-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:37.056092 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-232995f0-67d7-46e3-b924-7a0925c419d0 tempest-HypervisorAdminV228Test-2002095343 tempest-HypervisorAdminV228Test-2002095343-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:37.062936 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-232995f0-67d7-46e3-b924-7a0925c419d0 tempest-HypervisorAdminV228Test-2002095343 tempest-HypervisorAdminV228Test-2002095343-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.233438 Jun 20 11:58:37.064148 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 340/685] 10.222.0.27 () {60 vars in 1186 bytes} [Mon Jun 20 11:58:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:58:37.068613 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-741a40c5-78ec-41a3-babf-73f22d3b8689 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Action: 'update', calling method: .version_select at 0x7f6073b6b4c0>, body: {"status": "disabled"} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:37.070612 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:58:37.070612 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:58:37.072406 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-741a40c5-78ec-41a3-babf-73f22d3b8689 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:37.073032 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-741a40c5-78ec-41a3-babf-73f22d3b8689 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:37.082176 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-741a40c5-78ec-41a3-babf-73f22d3b8689 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:37.082871 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-741a40c5-78ec-41a3-babf-73f22d3b8689 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:37.090490 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-741a40c5-78ec-41a3-babf-73f22d3b8689 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] HTTP exception thrown: Service 382880e4-da35-478f-8228-baba3b7ac5ed could not be found. Jun 20 11:58:37.092982 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-741a40c5-78ec-41a3-babf-73f22d3b8689 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Request method failure captured: Jun 20 11:58:37.092982 n-d-master-1 devstack@n-api.service[119127]: request: PUT /compute/v2.1/os-services/382880e4-da35-478f-8228-baba3b7ac5ed HTTP/1.1 Jun 20 11:58:37.092982 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:58:37.092982 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:58:37.092982 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:58:37.092982 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 22 Jun 20 11:58:37.092982 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:58:37.092982 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:58:37.092982 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:58:37.092982 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:58:37.092982 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGDrXWnM0Rof0cmZ_bBny9e_9yfomswF7isjJhVjPdCe2xshdUtxcDZjevB9IvUZxtgCsj6sXfAKFXESOtreRrGz-ZlYENOls3-Z2rEPcQXTlancCSaQ_Im8fAuKagkmZSJwIkyMQwFQxNiMRc5WGK0rbLwcdmjDJ3wRKySz-oPEgDA Jun 20 11:58:37.092982 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:58:37.092982 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:58:37.092982 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:58:37.092982 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:58:37.092982 n-d-master-1 devstack@n-api.service[119127]: X-Openstack-Nova-Api-Version: 2.53 Jun 20 11:58:37.092982 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:58:37.092982 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:58:37.092982 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 4056040e3cc045118e1ee508583bd535 Jun 20 11:58:37.092982 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1453410473 Jun 20 11:58:37.092982 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member,admin Jun 20 11:58:37.092982 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member,admin Jun 20 11:58:37.094783 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4056040e3cc045118e1ee508583bd535"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4056040e3cc045118e1ee508583bd535"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4056040e3cc045118e1ee508583bd535"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4056040e3cc045118e1ee508583bd535"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:58:37.094783 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1453410473 Jun 20 11:58:37.094783 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 4056040e3cc045118e1ee508583bd535 Jun 20 11:58:37.094783 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1453410473 Jun 20 11:58:37.094783 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin Jun 20 11:58:37.094783 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:58:37.094783 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:58:37.094783 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 81344de13723473cad926b3cf2acb3e1 Jun 20 11:58:37.094783 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin Jun 20 11:58:37.094783 n-d-master-1 devstack@n-api.service[119127]: Jun 20 11:58:37.094783 n-d-master-1 devstack@n-api.service[119127]: {"status": "disabled"} Jun 20 11:58:37.094783 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 11:58:37.094783 n-d-master-1 devstack@n-api.service[119127]: exception: Service 382880e4-da35-478f-8228-baba3b7ac5ed could not be found. Jun 20 11:58:37.094783 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '382880e4-da35-478f-8228-baba3b7ac5ed', 'body': {'status': 'disabled'}} Jun 20 11:58:37.095656 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:58:37.095656 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:37.095656 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jun 20 11:58:37.095656 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jun 20 11:58:37.095656 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jun 20 11:58:37.095656 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jun 20 11:58:37.095656 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jun 20 11:58:37.095656 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:37.095656 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:58:37.095656 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:37.095656 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:37.095656 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jun 20 11:58:37.095656 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jun 20 11:58:37.095656 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jun 20 11:58:37.095656 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jun 20 11:58:37.095656 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 382880e4-da35-478f-8228-baba3b7ac5ed could not be found. Jun 20 11:58:37.095656 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:37.095656 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:58:37.095656 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:37.095656 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:37.095656 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:58:37.097148 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:58:37.097148 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:58:37.097148 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:58:37.097148 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 11:58:37.097148 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 11:58:37.097148 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:58:37.097148 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:58:37.097148 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:58:37.097148 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:58:37.097148 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jun 20 11:58:37.097148 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:58:37.097148 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 382880e4-da35-478f-8228-baba3b7ac5ed could not be found. Jun 20 11:58:37.097148 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:37.097148 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:58:37.097148 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:37.097148 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:37.097148 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:58:37.097148 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:58:37.097148 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:58:37.097148 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:58:37.098508 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 382880e4-da35-478f-8228-baba3b7ac5ed could not be found. Jun 20 11:58:37.098508 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:58:37.099875 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-741a40c5-78ec-41a3-babf-73f22d3b8689 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Returning 404 to user: Service 382880e4-da35-478f-8228-baba3b7ac5ed could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:58:37.100917 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-741a40c5-78ec-41a3-babf-73f22d3b8689 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-services/382880e4-da35-478f-8228-baba3b7ac5ed" status: 404 len: 110 microversion: 2.53 time: 0.035834 Jun 20 11:58:37.102042 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 341/686] 10.222.0.27 () {62 vars in 1308 bytes} [Mon Jun 20 11:58:37 2022] PUT /compute/v2.1/os-services/382880e4-da35-478f-8228-baba3b7ac5ed => generated 110 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 11:58:37.107629 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-de9d495b-d756-4c58-840c-5118dfa61e55 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:37.108600 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-de9d495b-d756-4c58-840c-5118dfa61e55 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 29575605-7785-45df-becf-359b0da6db4e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:37.116003 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-de9d495b-d756-4c58-840c-5118dfa61e55 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:37.116581 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-de9d495b-d756-4c58-840c-5118dfa61e55 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:37.117471 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-de9d495b-d756-4c58-840c-5118dfa61e55 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:37.118068 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-de9d495b-d756-4c58-840c-5118dfa61e55 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:37.393072 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2e6de724-8b64-47a2-9ffb-5161bcb098df tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "POST /compute/v2.1/servers/a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0/action" status: 202 len: 0 microversion: 2.1 time: 0.710942 Jun 20 11:58:37.394206 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 346/687] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 11:58:36 2022] POST /compute/v2.1/servers/a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0/action => generated 0 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 20 11:58:37.421040 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5dfe2f86-8874-453a-a846-4fbba6d986f6 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:37.424875 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5dfe2f86-8874-453a-a846-4fbba6d986f6 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 66d1074f-478d-4676-ab01-4dc1d4561a42] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:37.443909 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5dfe2f86-8874-453a-a846-4fbba6d986f6 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:37.444716 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5dfe2f86-8874-453a-a846-4fbba6d986f6 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:37.445715 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5dfe2f86-8874-453a-a846-4fbba6d986f6 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:37.446158 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5dfe2f86-8874-453a-a846-4fbba6d986f6 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:37.684625 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5dfe2f86-8874-453a-a846-4fbba6d986f6 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:37.693606 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5dfe2f86-8874-453a-a846-4fbba6d986f6 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42" status: 200 len: 1317 microversion: 2.1 time: 0.297710 Jun 20 11:58:37.694623 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 347/688] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:37 2022] GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42 => generated 1317 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:37.699933 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-28f859eb-1fda-4765-9bbc-36fb7070e5d5 tempest-HypervisorAdminV228Test-2002095343 tempest-HypervisorAdminV228Test-2002095343-project-admin] Calling method '.version_select at 0x7f60739ac670>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:37.701253 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:58:37.701253 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:58:37.702915 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-28f859eb-1fda-4765-9bbc-36fb7070e5d5 tempest-HypervisorAdminV228Test-2002095343 tempest-HypervisorAdminV228Test-2002095343-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:37.703508 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-28f859eb-1fda-4765-9bbc-36fb7070e5d5 tempest-HypervisorAdminV228Test-2002095343 tempest-HypervisorAdminV228Test-2002095343-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:37.723866 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-28f859eb-1fda-4765-9bbc-36fb7070e5d5 tempest-HypervisorAdminV228Test-2002095343 tempest-HypervisorAdminV228Test-2002095343-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:37.724605 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-28f859eb-1fda-4765-9bbc-36fb7070e5d5 tempest-HypervisorAdminV228Test-2002095343 tempest-HypervisorAdminV228Test-2002095343-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:37.732896 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-28f859eb-1fda-4765-9bbc-36fb7070e5d5 tempest-HypervisorAdminV228Test-2002095343 tempest-HypervisorAdminV228Test-2002095343-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.036752 Jun 20 11:58:37.734327 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 348/689] 10.222.0.27 () {60 vars in 1192 bytes} [Mon Jun 20 11:58:37 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:58:37.740426 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6ccd30b3-fb8b-4acb-aa55-3bfe19325417 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Action: 'update', calling method: .version_select at 0x7f60738a69d0>, body: {"status": "enabled"} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:37.744564 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:58:37.744564 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:58:37.746635 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ccd30b3-fb8b-4acb-aa55-3bfe19325417 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:37.747387 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ccd30b3-fb8b-4acb-aa55-3bfe19325417 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:37.754703 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ccd30b3-fb8b-4acb-aa55-3bfe19325417 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:37.766858 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ccd30b3-fb8b-4acb-aa55-3bfe19325417 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:37.782443 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-6ccd30b3-fb8b-4acb-aa55-3bfe19325417 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] HTTP exception thrown: Service 382880e4-da35-478f-8228-baba3b7ac5ed could not be found. Jun 20 11:58:37.788029 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6ccd30b3-fb8b-4acb-aa55-3bfe19325417 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Request method failure captured: Jun 20 11:58:37.788029 n-d-master-1 devstack@n-api.service[119128]: request: PUT /compute/v2.1/os-services/382880e4-da35-478f-8228-baba3b7ac5ed HTTP/1.1 Jun 20 11:58:37.788029 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:58:37.788029 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:58:37.788029 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:58:37.788029 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 21 Jun 20 11:58:37.788029 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:58:37.788029 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:58:37.788029 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:58:37.788029 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:58:37.788029 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGDrXWnM0Rof0cmZ_bBny9e_9yfomswF7isjJhVjPdCe2xshdUtxcDZjevB9IvUZxtgCsj6sXfAKFXESOtreRrGz-ZlYENOls3-Z2rEPcQXTlancCSaQ_Im8fAuKagkmZSJwIkyMQwFQxNiMRc5WGK0rbLwcdmjDJ3wRKySz-oPEgDA Jun 20 11:58:37.788029 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:58:37.788029 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:58:37.788029 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:58:37.788029 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:58:37.788029 n-d-master-1 devstack@n-api.service[119128]: X-Openstack-Nova-Api-Version: 2.53 Jun 20 11:58:37.788029 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:58:37.788029 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:58:37.788029 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 4056040e3cc045118e1ee508583bd535 Jun 20 11:58:37.788029 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1453410473 Jun 20 11:58:37.788029 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member,admin Jun 20 11:58:37.788029 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member,admin Jun 20 11:58:37.789574 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4056040e3cc045118e1ee508583bd535"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4056040e3cc045118e1ee508583bd535"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4056040e3cc045118e1ee508583bd535"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4056040e3cc045118e1ee508583bd535"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:58:37.789574 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1453410473 Jun 20 11:58:37.789574 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 4056040e3cc045118e1ee508583bd535 Jun 20 11:58:37.789574 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1453410473 Jun 20 11:58:37.789574 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin Jun 20 11:58:37.789574 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:58:37.789574 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:58:37.789574 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 81344de13723473cad926b3cf2acb3e1 Jun 20 11:58:37.789574 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin Jun 20 11:58:37.789574 n-d-master-1 devstack@n-api.service[119128]: Jun 20 11:58:37.789574 n-d-master-1 devstack@n-api.service[119128]: {"status": "enabled"} Jun 20 11:58:37.789574 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 11:58:37.789574 n-d-master-1 devstack@n-api.service[119128]: exception: Service 382880e4-da35-478f-8228-baba3b7ac5ed could not be found. Jun 20 11:58:37.789574 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '382880e4-da35-478f-8228-baba3b7ac5ed', 'body': {'status': 'enabled'}} Jun 20 11:58:37.790398 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:58:37.790398 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:37.790398 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jun 20 11:58:37.790398 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jun 20 11:58:37.790398 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jun 20 11:58:37.790398 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jun 20 11:58:37.790398 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jun 20 11:58:37.790398 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:58:37.790398 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:58:37.790398 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:58:37.790398 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:37.790398 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jun 20 11:58:37.790398 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jun 20 11:58:37.790398 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jun 20 11:58:37.790398 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jun 20 11:58:37.790398 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 382880e4-da35-478f-8228-baba3b7ac5ed could not be found. Jun 20 11:58:37.790398 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:58:37.790398 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:58:37.790398 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:58:37.790398 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:37.790398 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:58:37.791680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:58:37.791680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:58:37.791680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:58:37.791680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 11:58:37.791680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 11:58:37.791680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:58:37.791680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:58:37.791680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:58:37.791680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:58:37.791680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jun 20 11:58:37.791680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:58:37.791680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 382880e4-da35-478f-8228-baba3b7ac5ed could not be found. Jun 20 11:58:37.791680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:58:37.791680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:58:37.791680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:58:37.791680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:37.791680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:58:37.791680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:58:37.791680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:58:37.791680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:58:37.793265 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 382880e4-da35-478f-8228-baba3b7ac5ed could not be found. Jun 20 11:58:37.793265 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:58:37.795756 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6ccd30b3-fb8b-4acb-aa55-3bfe19325417 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Returning 404 to user: Service 382880e4-da35-478f-8228-baba3b7ac5ed could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:58:37.798033 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6ccd30b3-fb8b-4acb-aa55-3bfe19325417 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-services/382880e4-da35-478f-8228-baba3b7ac5ed" status: 404 len: 110 microversion: 2.53 time: 0.062487 Jun 20 11:58:37.803633 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 349/690] 10.222.0.27 () {62 vars in 1308 bytes} [Mon Jun 20 11:58:37 2022] PUT /compute/v2.1/os-services/382880e4-da35-478f-8228-baba3b7ac5ed => generated 110 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 11:58:37.816453 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cd30c739-083d-4b7b-a80e-ff153cb7ce55 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '.version_select at 0x7f6073a22b80>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:37.898520 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cd30c739-083d-4b7b-a80e-ff153cb7ce55 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/images/dc3eda0e-770b-433b-861a-25a8d5c351a7" status: 200 len: 1421 microversion: 2.1 time: 0.093177 Jun 20 11:58:37.907728 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 350/691] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 11:58:37 2022] GET /compute/v2.1/images/dc3eda0e-770b-433b-861a-25a8d5c351a7 => generated 1421 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:37.917213 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-b687fd23-c53f-4baa-80cf-f6271cced91d req-af3c8b14-7a93-4b31-9afc-e51343f448ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da760340-ab64-4d7c-a4c9-3bcd606858c5", "tag": "5f3971de-6416-4e5b-9307-3da2ee368027"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:37.933758 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-b687fd23-c53f-4baa-80cf-f6271cced91d req-af3c8b14-7a93-4b31-9afc-e51343f448ce service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:37.934483 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-b687fd23-c53f-4baa-80cf-f6271cced91d req-af3c8b14-7a93-4b31-9afc-e51343f448ce service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:37.977200 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-b687fd23-c53f-4baa-80cf-f6271cced91d req-af3c8b14-7a93-4b31-9afc-e51343f448ce service nova] Creating event network-changed:5f3971de-6416-4e5b-9307-3da2ee368027 for instance da760340-ab64-4d7c-a4c9-3bcd606858c5 on n-h1-master-1 Jun 20 11:58:37.983301 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-b687fd23-c53f-4baa-80cf-f6271cced91d req-af3c8b14-7a93-4b31-9afc-e51343f448ce service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073763 Jun 20 11:58:37.984260 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 351/692] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:58:37.990155 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cc884d10-72e6-4930-a4c7-b121abb1c4c2 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:37.991702 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:58:37.991702 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:58:37.993318 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cc884d10-72e6-4930-a4c7-b121abb1c4c2 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:37.994029 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cc884d10-72e6-4930-a4c7-b121abb1c4c2 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:37.995119 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cc884d10-72e6-4930-a4c7-b121abb1c4c2 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:37.996155 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cc884d10-72e6-4930-a4c7-b121abb1c4c2 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:38.042301 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-de9d495b-d756-4c58-840c-5118dfa61e55 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:38.057310 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-de9d495b-d756-4c58-840c-5118dfa61e55 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:38.063752 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-de9d495b-d756-4c58-840c-5118dfa61e55 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:38.067806 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-de9d495b-d756-4c58-840c-5118dfa61e55 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e" status: 200 len: 1362 microversion: 2.25 time: 0.963406 Jun 20 11:58:38.070031 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 342/693] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:58:37 2022] GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e => generated 1362 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:58:38.083988 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2aa119a1-bd03-4f0c-8eee-e54580f325f3 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:38.084814 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2aa119a1-bd03-4f0c-8eee-e54580f325f3 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] [instance: da760340-ab64-4d7c-a4c9-3bcd606858c5] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:38.102804 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2aa119a1-bd03-4f0c-8eee-e54580f325f3 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:38.103828 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2aa119a1-bd03-4f0c-8eee-e54580f325f3 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:38.105109 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2aa119a1-bd03-4f0c-8eee-e54580f325f3 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:38.110583 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2aa119a1-bd03-4f0c-8eee-e54580f325f3 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:38.259480 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:58:38.270855 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cc884d10-72e6-4930-a4c7-b121abb1c4c2 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.285178 Jun 20 11:58:38.272058 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 352/694] 10.222.0.27 () {60 vars in 1177 bytes} [Mon Jun 20 11:58:37 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:58:38.286228 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9487551f-c2d8-4f6d-adbe-5a1a77210dbe tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:38.288033 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:58:38.288033 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:58:38.290027 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9487551f-c2d8-4f6d-adbe-5a1a77210dbe tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:38.290955 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9487551f-c2d8-4f6d-adbe-5a1a77210dbe tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:38.292185 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9487551f-c2d8-4f6d-adbe-5a1a77210dbe tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:38.292879 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9487551f-c2d8-4f6d-adbe-5a1a77210dbe tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:38.326302 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9487551f-c2d8-4f6d-adbe-5a1a77210dbe tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.044967 Jun 20 11:58:38.327183 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 353/695] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Jun 20 11:58:38 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:58:38.342603 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f51c9283-ee87-4269-8a1c-5b264a7bdd64 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:38.345214 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:58:38.345214 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:58:38.346771 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f51c9283-ee87-4269-8a1c-5b264a7bdd64 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:38.347575 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f51c9283-ee87-4269-8a1c-5b264a7bdd64 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:38.348836 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f51c9283-ee87-4269-8a1c-5b264a7bdd64 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:38.349456 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f51c9283-ee87-4269-8a1c-5b264a7bdd64 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:38.414367 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f51c9283-ee87-4269-8a1c-5b264a7bdd64 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.075694 Jun 20 11:58:38.415393 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 354/696] 10.222.0.27 () {60 vars in 1177 bytes} [Mon Jun 20 11:58:38 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:58:38.434474 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-38c3b736-c784-4bc6-86e2-6b6b00082f02 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:38.437651 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:58:38.437651 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:58:38.441402 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-38c3b736-c784-4bc6-86e2-6b6b00082f02 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:38.442363 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-38c3b736-c784-4bc6-86e2-6b6b00082f02 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:38.444072 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-38c3b736-c784-4bc6-86e2-6b6b00082f02 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:38.445779 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-38c3b736-c784-4bc6-86e2-6b6b00082f02 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:38.485625 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-38c3b736-c784-4bc6-86e2-6b6b00082f02 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.060831 Jun 20 11:58:38.486299 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2aa119a1-bd03-4f0c-8eee-e54580f325f3 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3607d4bf04f74a49b74ff74875dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15149d3df8e846cc993a30a0e0f75b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:38.487855 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 355/697] 10.222.0.27 () {60 vars in 1234 bytes} [Mon Jun 20 11:58:38 2022] GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx => generated 16 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:38.501306 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2aa119a1-bd03-4f0c-8eee-e54580f325f3 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] 10.222.0.27 "GET /compute/v2.1/servers/da760340-ab64-4d7c-a4c9-3bcd606858c5" status: 200 len: 1323 microversion: 2.1 time: 0.430033 Jun 20 11:58:38.501966 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-85dd0eb2-49a7-444a-a6aa-09a53f2813c2 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:38.504173 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:58:38.504173 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:58:38.505771 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-85dd0eb2-49a7-444a-a6aa-09a53f2813c2 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:38.506226 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-85dd0eb2-49a7-444a-a6aa-09a53f2813c2 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:38.507220 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-85dd0eb2-49a7-444a-a6aa-09a53f2813c2 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:38.507655 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-85dd0eb2-49a7-444a-a6aa-09a53f2813c2 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:38.507786 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 343/698] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:38 2022] GET /compute/v2.1/servers/da760340-ab64-4d7c-a4c9-3bcd606858c5 => generated 1323 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:38.542303 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-85dd0eb2-49a7-444a-a6aa-09a53f2813c2 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.047712 Jun 20 11:58:38.543554 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 356/699] 10.222.0.27 () {60 vars in 1177 bytes} [Mon Jun 20 11:58:38 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 11:58:38.560466 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b95583b5-4d14-4549-8844-d441165dd396 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:38.562122 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:58:38.562122 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:58:38.564120 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b95583b5-4d14-4549-8844-d441165dd396 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:38.564850 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b95583b5-4d14-4549-8844-d441165dd396 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:38.565898 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b95583b5-4d14-4549-8844-d441165dd396 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:38.566515 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b95583b5-4d14-4549-8844-d441165dd396 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:38.592231 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b95583b5-4d14-4549-8844-d441165dd396 tempest-ServicesAdminNegativeV253TestJSON-1453410473 tempest-ServicesAdminNegativeV253TestJSON-1453410473-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.040940 Jun 20 11:58:38.592835 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 344/700] 10.222.0.27 () {60 vars in 1238 bytes} [Mon Jun 20 11:58:38 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:58:38.712958 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9ba4279f-ffa8-49d4-b08a-2659b76c2982 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:38.713614 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9ba4279f-ffa8-49d4-b08a-2659b76c2982 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 66d1074f-478d-4676-ab01-4dc1d4561a42] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:38.727474 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ba4279f-ffa8-49d4-b08a-2659b76c2982 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:38.727888 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ba4279f-ffa8-49d4-b08a-2659b76c2982 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:38.728683 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ba4279f-ffa8-49d4-b08a-2659b76c2982 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:38.729109 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ba4279f-ffa8-49d4-b08a-2659b76c2982 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:38.918188 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f58e3081-c1ee-4a32-bf66-1cbed8193b96 tempest-ServicesAdminNegativeV253TestJSON-1915602723 tempest-ServicesAdminNegativeV253TestJSON-1915602723-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:38.919394 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:58:38.919394 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 11:58:38.923560 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f58e3081-c1ee-4a32-bf66-1cbed8193b96 tempest-ServicesAdminNegativeV253TestJSON-1915602723 tempest-ServicesAdminNegativeV253TestJSON-1915602723-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '281e40ad99a24e3f9c88a10c5ce9219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1f287859d7147b7b91e9e35d63acaba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:38.925431 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f58e3081-c1ee-4a32-bf66-1cbed8193b96 tempest-ServicesAdminNegativeV253TestJSON-1915602723 tempest-ServicesAdminNegativeV253TestJSON-1915602723-project] Request method failure captured: Jun 20 11:58:38.925431 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/os-services HTTP/1.1 Jun 20 11:58:38.925431 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:58:38.925431 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:58:38.925431 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:58:38.925431 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 11:58:38.925431 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:58:38.925431 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:58:38.925431 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:58:38.925431 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:58:38.925431 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGDqdphnYCx2ho6H7vchr1MPjfTEgw3TC8hR5UfXSobyivfWFnecICe4fgFM0P37Xs-tNZnFMyKmA_N3m7YZtT1m1VU7TlOE1WqzsRedqXhk2q8AwxZW3-zkEt-w9K6brciApYlFWWOaHLL9elQf92o3e66sKyvu3Df9C-NhrAE8WOY Jun 20 11:58:38.925431 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:58:38.925431 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:58:38.925431 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:58:38.925431 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:58:38.925431 n-d-master-1 devstack@n-api.service[119128]: X-Openstack-Nova-Api-Version: 2.53 Jun 20 11:58:38.925431 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:58:38.925431 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:58:38.925431 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: f1f287859d7147b7b91e9e35d63acaba Jun 20 11:58:38.925431 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1915602723 Jun 20 11:58:38.925431 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 11:58:38.925431 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 11:58:38.927049 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f1f287859d7147b7b91e9e35d63acaba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f1f287859d7147b7b91e9e35d63acaba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f1f287859d7147b7b91e9e35d63acaba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f1f287859d7147b7b91e9e35d63acaba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:58:38.927049 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1915602723 Jun 20 11:58:38.927049 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: f1f287859d7147b7b91e9e35d63acaba Jun 20 11:58:38.927049 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1915602723 Jun 20 11:58:38.927049 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1915602723-project Jun 20 11:58:38.927049 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:58:38.927049 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:58:38.927049 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 281e40ad99a24e3f9c88a10c5ce9219b Jun 20 11:58:38.927049 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1915602723-project Jun 20 11:58:38.927049 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 11:58:38.927049 n-d-master-1 devstack@n-api.service[119128]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 20 11:58:38.927049 n-d-master-1 devstack@n-api.service[119128]: action_args: {} Jun 20 11:58:38.927959 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:58:38.927959 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:38.927959 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:58:38.927959 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:58:38.927959 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:58:38.927959 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:58:38.927959 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 20 11:58:38.927959 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:58:38.927959 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 20 11:58:38.927959 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:58:38.927959 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:58:38.927959 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:58:38.927959 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jun 20 11:58:38.927959 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jun 20 11:58:38.927959 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 20 11:58:38.927959 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 20 11:58:38.927959 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 20 11:58:38.927959 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 20 11:58:38.927959 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 11:58:38.929694 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 11:58:38.929694 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 11:58:38.929694 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 11:58:38.929694 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 20 11:58:38.929694 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 20 11:58:38.929694 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 20 11:58:38.929694 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 20 11:58:38.929694 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 20 11:58:38.929694 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 20 11:58:38.929694 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 20 11:58:38.929694 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:58:38.929694 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:58:38.929694 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:58:38.929694 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:38.929694 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:58:38.929694 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:58:38.929694 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 20 11:58:38.929694 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 20 11:58:38.929694 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 20 11:58:38.929694 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:58:38.931117 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f58e3081-c1ee-4a32-bf66-1cbed8193b96 tempest-ServicesAdminNegativeV253TestJSON-1915602723 tempest-ServicesAdminNegativeV253TestJSON-1915602723-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:58:38.931117 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f58e3081-c1ee-4a32-bf66-1cbed8193b96 tempest-ServicesAdminNegativeV253TestJSON-1915602723 tempest-ServicesAdminNegativeV253TestJSON-1915602723-project] 10.222.0.27 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.326213 Jun 20 11:58:38.936480 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 357/701] 10.222.0.27 () {60 vars in 1177 bytes} [Mon Jun 20 11:58:38 2022] GET /compute/v2.1/os-services => generated 112 bytes in 336 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Jun 20 11:58:38.948801 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5f42a2ca-5887-431f-9513-4ea418ac000e tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '.version_select at 0x7f60739ac4c0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:39.025961 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5f42a2ca-5887-431f-9513-4ea418ac000e tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/images/dc3eda0e-770b-433b-861a-25a8d5c351a7" status: 200 len: 1421 microversion: 2.1 time: 0.088257 Jun 20 11:58:39.026909 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 358/702] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 11:58:38 2022] GET /compute/v2.1/images/dc3eda0e-770b-433b-861a-25a8d5c351a7 => generated 1421 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:39.076524 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9ba4279f-ffa8-49d4-b08a-2659b76c2982 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:39.097218 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8c4543bc-a653-42dc-a925-c963463b04d3 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:39.098395 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9ba4279f-ffa8-49d4-b08a-2659b76c2982 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42" status: 200 len: 1317 microversion: 2.1 time: 0.391003 Jun 20 11:58:39.099018 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 345/703] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:38 2022] GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42 => generated 1317 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:39.099457 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8c4543bc-a653-42dc-a925-c963463b04d3 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 29575605-7785-45df-becf-359b0da6db4e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:39.108768 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8c4543bc-a653-42dc-a925-c963463b04d3 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:39.109221 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8c4543bc-a653-42dc-a925-c963463b04d3 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:39.109998 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8c4543bc-a653-42dc-a925-c963463b04d3 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:39.110909 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8c4543bc-a653-42dc-a925-c963463b04d3 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:39.135952 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:58:39.283909 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8c4543bc-a653-42dc-a925-c963463b04d3 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:39.299463 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8c4543bc-a653-42dc-a925-c963463b04d3 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:39.302631 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8c4543bc-a653-42dc-a925-c963463b04d3 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:39.304269 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8c4543bc-a653-42dc-a925-c963463b04d3 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e" status: 200 len: 1362 microversion: 2.25 time: 0.218277 Jun 20 11:58:39.305993 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 359/704] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:58:39 2022] GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:58:39.525378 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c2821a12-c835-4259-acbc-81f37055e779 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:39.526510 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c2821a12-c835-4259-acbc-81f37055e779 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] [instance: da760340-ab64-4d7c-a4c9-3bcd606858c5] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:39.533636 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c2821a12-c835-4259-acbc-81f37055e779 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:39.534243 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c2821a12-c835-4259-acbc-81f37055e779 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:39.535078 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c2821a12-c835-4259-acbc-81f37055e779 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:39.535509 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c2821a12-c835-4259-acbc-81f37055e779 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:39.797330 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c2821a12-c835-4259-acbc-81f37055e779 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3607d4bf04f74a49b74ff74875dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15149d3df8e846cc993a30a0e0f75b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:39.808915 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c2821a12-c835-4259-acbc-81f37055e779 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] 10.222.0.27 "GET /compute/v2.1/servers/da760340-ab64-4d7c-a4c9-3bcd606858c5" status: 200 len: 1323 microversion: 2.1 time: 0.288764 Jun 20 11:58:39.809665 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 346/705] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:39 2022] GET /compute/v2.1/servers/da760340-ab64-4d7c-a4c9-3bcd606858c5 => generated 1323 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:40.045914 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8064ad0b-2c8d-49dc-9fc6-1bdff7421930 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '.version_select at 0x7f607399e820>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:40.117405 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-09836e9f-9272-4ae5-afbe-8785d63ad4f9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:40.118440 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8064ad0b-2c8d-49dc-9fc6-1bdff7421930 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/images/dc3eda0e-770b-433b-861a-25a8d5c351a7" status: 200 len: 1421 microversion: 2.1 time: 0.081980 Jun 20 11:58:40.120016 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-09836e9f-9272-4ae5-afbe-8785d63ad4f9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 66d1074f-478d-4676-ab01-4dc1d4561a42] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:40.144376 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 360/706] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 11:58:40 2022] GET /compute/v2.1/images/dc3eda0e-770b-433b-861a-25a8d5c351a7 => generated 1421 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:40.150439 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-09836e9f-9272-4ae5-afbe-8785d63ad4f9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:40.153669 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-09836e9f-9272-4ae5-afbe-8785d63ad4f9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:40.155077 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-09836e9f-9272-4ae5-afbe-8785d63ad4f9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:40.156694 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-09836e9f-9272-4ae5-afbe-8785d63ad4f9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:40.325068 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d6496ab6-bae5-4a73-98f0-52e36eef2c55 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:40.325697 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d6496ab6-bae5-4a73-98f0-52e36eef2c55 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 29575605-7785-45df-becf-359b0da6db4e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:40.340594 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6496ab6-bae5-4a73-98f0-52e36eef2c55 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:40.341782 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6496ab6-bae5-4a73-98f0-52e36eef2c55 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:40.345238 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6496ab6-bae5-4a73-98f0-52e36eef2c55 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:40.348113 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6496ab6-bae5-4a73-98f0-52e36eef2c55 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:40.845607 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-09836e9f-9272-4ae5-afbe-8785d63ad4f9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:40.848670 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d6496ab6-bae5-4a73-98f0-52e36eef2c55 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:40.874271 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-09836e9f-9272-4ae5-afbe-8785d63ad4f9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42" status: 200 len: 1317 microversion: 2.1 time: 0.760018 Jun 20 11:58:40.876437 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 347/707] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:40 2022] GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42 => generated 1317 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:40.887961 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d6496ab6-bae5-4a73-98f0-52e36eef2c55 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:40.888747 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b9c293ee-c229-4fc7-b151-bfe46f7df68a tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:40.889533 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b9c293ee-c229-4fc7-b151-bfe46f7df68a tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] [instance: da760340-ab64-4d7c-a4c9-3bcd606858c5] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:40.890636 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d6496ab6-bae5-4a73-98f0-52e36eef2c55 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:40.901650 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d6496ab6-bae5-4a73-98f0-52e36eef2c55 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e" status: 200 len: 1559 microversion: 2.25 time: 0.581431 Jun 20 11:58:40.908441 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 361/708] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:58:40 2022] GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e => generated 1559 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:58:40.910259 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b9c293ee-c229-4fc7-b151-bfe46f7df68a tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:40.910709 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b9c293ee-c229-4fc7-b151-bfe46f7df68a tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:40.911484 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b9c293ee-c229-4fc7-b151-bfe46f7df68a tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:40.911912 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b9c293ee-c229-4fc7-b151-bfe46f7df68a tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:40.921749 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-393b9102-a9fd-4410-9061-1600cae5ca34 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:40.922683 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-393b9102-a9fd-4410-9061-1600cae5ca34 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] [instance: 29575605-7785-45df-becf-359b0da6db4e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:40.945064 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-393b9102-a9fd-4410-9061-1600cae5ca34 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:40.966053 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-393b9102-a9fd-4410-9061-1600cae5ca34 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:40.967528 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-393b9102-a9fd-4410-9061-1600cae5ca34 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:40.970775 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-393b9102-a9fd-4410-9061-1600cae5ca34 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:41.289883 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b9c293ee-c229-4fc7-b151-bfe46f7df68a tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3607d4bf04f74a49b74ff74875dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15149d3df8e846cc993a30a0e0f75b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:41.334830 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b9c293ee-c229-4fc7-b151-bfe46f7df68a tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] 10.222.0.27 "GET /compute/v2.1/servers/da760340-ab64-4d7c-a4c9-3bcd606858c5" status: 200 len: 1323 microversion: 2.1 time: 0.448798 Jun 20 11:58:41.347727 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 348/709] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:40 2022] GET /compute/v2.1/servers/da760340-ab64-4d7c-a4c9-3bcd606858c5 => generated 1323 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:41.358024 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-393b9102-a9fd-4410-9061-1600cae5ca34 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lazy-loading 'services' on Instance uuid 29575605-7785-45df-becf-359b0da6db4e {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:58:41.359702 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ff47db45-d29f-49cb-bbdf-69e319a0b146 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '.version_select at 0x7f6073a8e700>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:41.435079 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ff47db45-d29f-49cb-bbdf-69e319a0b146 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/images/dc3eda0e-770b-433b-861a-25a8d5c351a7" status: 200 len: 1421 microversion: 2.1 time: 0.085479 Jun 20 11:58:41.443780 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 349/710] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 11:58:41 2022] GET /compute/v2.1/images/dc3eda0e-770b-433b-861a-25a8d5c351a7 => generated 1421 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:41.505081 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=30 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:58:41.584375 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-393b9102-a9fd-4410-9061-1600cae5ca34 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e" status: 200 len: 2052 microversion: 2.25 time: 0.666016 Jun 20 11:58:41.586357 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 362/711] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:58:40 2022] GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e => generated 2052 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 11:58:41.610559 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2877841c-75b3-4ee1-8a93-7c73ef2466fd tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:41.613865 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2877841c-75b3-4ee1-8a93-7c73ef2466fd tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] [instance: 29575605-7785-45df-becf-359b0da6db4e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:41.636559 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2877841c-75b3-4ee1-8a93-7c73ef2466fd tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:41.637431 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2877841c-75b3-4ee1-8a93-7c73ef2466fd tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:41.638287 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2877841c-75b3-4ee1-8a93-7c73ef2466fd tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:41.648016 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2877841c-75b3-4ee1-8a93-7c73ef2466fd tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:41.906238 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3b399c20-4161-49ad-9445-5c152895fef3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:41.911330 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3b399c20-4161-49ad-9445-5c152895fef3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 66d1074f-478d-4676-ab01-4dc1d4561a42] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:41.959317 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b399c20-4161-49ad-9445-5c152895fef3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:41.964425 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b399c20-4161-49ad-9445-5c152895fef3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:41.969529 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b399c20-4161-49ad-9445-5c152895fef3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:41.972926 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b399c20-4161-49ad-9445-5c152895fef3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:42.249919 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-2877841c-75b3-4ee1-8a93-7c73ef2466fd tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lazy-loading 'services' on Instance uuid 29575605-7785-45df-becf-359b0da6db4e {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:58:42.296504 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2877841c-75b3-4ee1-8a93-7c73ef2466fd tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e" status: 200 len: 2052 microversion: 2.25 time: 0.689297 Jun 20 11:58:42.299164 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 350/712] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:58:41 2022] GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e => generated 2052 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:58:42.309837 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-3eaf62d9-cf64-43dd-b3d2-6ce657ffef2e req-de6e179e-e6e6-42f3-93aa-2dbf285c5a28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66d1074f-478d-4676-ab01-4dc1d4561a42", "name": "network-vif-plugged", "status": "completed", "tag": "72a638fb-8a29-4a15-ac3c-30318a976b7a"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:42.327731 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-3eaf62d9-cf64-43dd-b3d2-6ce657ffef2e req-de6e179e-e6e6-42f3-93aa-2dbf285c5a28 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:42.333748 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-3eaf62d9-cf64-43dd-b3d2-6ce657ffef2e req-de6e179e-e6e6-42f3-93aa-2dbf285c5a28 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:42.361934 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-3eaf62d9-cf64-43dd-b3d2-6ce657ffef2e req-de6e179e-e6e6-42f3-93aa-2dbf285c5a28 service nova] Creating event network-vif-plugged:72a638fb-8a29-4a15-ac3c-30318a976b7a for instance 66d1074f-478d-4676-ab01-4dc1d4561a42 on n-h2-master-1 Jun 20 11:58:42.368419 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-3eaf62d9-cf64-43dd-b3d2-6ce657ffef2e req-de6e179e-e6e6-42f3-93aa-2dbf285c5a28 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067812 Jun 20 11:58:42.369332 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 351/713] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:58:42.377085 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f2f84137-82e9-4e08-9478-3791c3304432 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:42.378789 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:58:42.378789 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 11:58:42.380401 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f2f84137-82e9-4e08-9478-3791c3304432 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:42.381168 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f2f84137-82e9-4e08-9478-3791c3304432 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:42.382209 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f2f84137-82e9-4e08-9478-3791c3304432 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:42.382890 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f2f84137-82e9-4e08-9478-3791c3304432 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:42.414977 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f2f84137-82e9-4e08-9478-3791c3304432 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.044036 Jun 20 11:58:42.421382 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 352/714] 10.222.0.27 () {60 vars in 1216 bytes} [Mon Jun 20 11:58:42 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:58:42.437466 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ea444129-0da9-4009-9092-64b98d7d41cc tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:42.439286 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ea444129-0da9-4009-9092-64b98d7d41cc tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] [instance: da760340-ab64-4d7c-a4c9-3bcd606858c5] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:42.447352 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea444129-0da9-4009-9092-64b98d7d41cc tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:42.448322 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea444129-0da9-4009-9092-64b98d7d41cc tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:42.449349 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea444129-0da9-4009-9092-64b98d7d41cc tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:42.450021 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea444129-0da9-4009-9092-64b98d7d41cc tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:42.643133 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3b399c20-4161-49ad-9445-5c152895fef3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:42.658145 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3b399c20-4161-49ad-9445-5c152895fef3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42" status: 200 len: 1317 microversion: 2.1 time: 0.763886 Jun 20 11:58:42.661073 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 363/715] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:41 2022] GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42 => generated 1317 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:42.673978 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9cf75278-11cc-4d7f-aa6f-e4c6cb83de95 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:42.676312 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9cf75278-11cc-4d7f-aa6f-e4c6cb83de95 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] [instance: 29575605-7785-45df-becf-359b0da6db4e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:42.693099 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9cf75278-11cc-4d7f-aa6f-e4c6cb83de95 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:42.696549 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9cf75278-11cc-4d7f-aa6f-e4c6cb83de95 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:42.699802 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9cf75278-11cc-4d7f-aa6f-e4c6cb83de95 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:42.701579 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9cf75278-11cc-4d7f-aa6f-e4c6cb83de95 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:42.964818 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9cf75278-11cc-4d7f-aa6f-e4c6cb83de95 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e/action" status: 202 len: 0 microversion: 2.25 time: 0.300731 Jun 20 11:58:42.970308 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 364/716] 10.222.0.27 () {62 vars in 1318 bytes} [Mon Jun 20 11:58:42 2022] POST /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:58:42.997053 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d13e08a6-f9f0-4c38-a69d-7868dfced54c tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '.version_select at 0x7f60738bcdc0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:43.040978 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ea444129-0da9-4009-9092-64b98d7d41cc tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3607d4bf04f74a49b74ff74875dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15149d3df8e846cc993a30a0e0f75b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:43.060410 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ea444129-0da9-4009-9092-64b98d7d41cc tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] 10.222.0.27 "GET /compute/v2.1/servers/da760340-ab64-4d7c-a4c9-3bcd606858c5" status: 200 len: 1323 microversion: 2.1 time: 0.636823 Jun 20 11:58:43.061011 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 353/717] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:42 2022] GET /compute/v2.1/servers/da760340-ab64-4d7c-a4c9-3bcd606858c5 => generated 1323 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:43.087967 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2dde992a-d56d-4fab-bfcf-36f2e73f186c tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:43.088726 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2dde992a-d56d-4fab-bfcf-36f2e73f186c tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] [instance: 29575605-7785-45df-becf-359b0da6db4e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:43.101368 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d13e08a6-f9f0-4c38-a69d-7868dfced54c tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/images/dc3eda0e-770b-433b-861a-25a8d5c351a7" status: 200 len: 1421 microversion: 2.1 time: 0.127291 Jun 20 11:58:43.102741 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 365/718] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 11:58:42 2022] GET /compute/v2.1/images/dc3eda0e-770b-433b-861a-25a8d5c351a7 => generated 1421 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:43.114595 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2dde992a-d56d-4fab-bfcf-36f2e73f186c tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:43.123112 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2dde992a-d56d-4fab-bfcf-36f2e73f186c tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:43.124687 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2dde992a-d56d-4fab-bfcf-36f2e73f186c tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:43.130913 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2dde992a-d56d-4fab-bfcf-36f2e73f186c tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:43.475502 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:58:43.498870 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-2dde992a-d56d-4fab-bfcf-36f2e73f186c tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lazy-loading 'services' on Instance uuid 29575605-7785-45df-becf-359b0da6db4e {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:58:43.522215 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2dde992a-d56d-4fab-bfcf-36f2e73f186c tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e" status: 200 len: 2057 microversion: 2.25 time: 0.456238 Jun 20 11:58:43.523524 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 354/719] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:58:43 2022] GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e => generated 2057 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:58:43.678801 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7d28712b-3a56-42f1-ab4b-fc1ddcaa9fef tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:43.680483 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7d28712b-3a56-42f1-ab4b-fc1ddcaa9fef tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 66d1074f-478d-4676-ab01-4dc1d4561a42] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:43.692170 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7d28712b-3a56-42f1-ab4b-fc1ddcaa9fef tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:43.692895 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7d28712b-3a56-42f1-ab4b-fc1ddcaa9fef tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:43.693825 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7d28712b-3a56-42f1-ab4b-fc1ddcaa9fef tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:43.694454 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7d28712b-3a56-42f1-ab4b-fc1ddcaa9fef tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:44.183015 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cb6533b4-3c48-41b5-8086-739e3845b2a3 tempest-KeyPairsV210TestJSON-1608037084 tempest-KeyPairsV210TestJSON-1608037084-project-admin] Action: 'create', calling method: .version_select at 0x7f6073eb61f0>, body: {"keypair": {"name": "tempest-keypair-1680239403", "type": "ssh", "user_id": "9003a552dbc74a849208275c2efd04d6", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKg+3ekjqviYw6GJPeUIxnrPZnokbBYqIFp9Jf8cZuGlvEYr36y/bAE3Z7GrLOoXvWXFWjA7hAF6ROL32/AkPP4TdSpHkxb+Jwt2Su0PvvY8arN+ND7y842bis2ZGtbFuQ=="}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:44.215743 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7d28712b-3a56-42f1-ab4b-fc1ddcaa9fef tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:44.254427 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7d28712b-3a56-42f1-ab4b-fc1ddcaa9fef tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42" status: 200 len: 1317 microversion: 2.1 time: 0.574413 Jun 20 11:58:44.255481 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 355/720] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:43 2022] GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42 => generated 1317 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:58:44.284934 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0ab2aa8c-0806-4ff4-a279-1448aea78296 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:44.285120 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-cb6533b4-3c48-41b5-8086-739e3845b2a3 tempest-KeyPairsV210TestJSON-1608037084 tempest-KeyPairsV210TestJSON-1608037084-project-admin] Getting quotas for project 146dd3bfd1924d129a9fc0739c178ffa. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:58:44.287303 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0ab2aa8c-0806-4ff4-a279-1448aea78296 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] [instance: da760340-ab64-4d7c-a4c9-3bcd606858c5] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:44.291585 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-cb6533b4-3c48-41b5-8086-739e3845b2a3 tempest-KeyPairsV210TestJSON-1608037084 tempest-KeyPairsV210TestJSON-1608037084-project-admin] Getting quotas for user a63754cd53b24656a5db98ac0a7b9921 and project 146dd3bfd1924d129a9fc0739c178ffa. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:58:44.305007 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0ab2aa8c-0806-4ff4-a279-1448aea78296 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:44.307564 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0ab2aa8c-0806-4ff4-a279-1448aea78296 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:44.308581 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0ab2aa8c-0806-4ff4-a279-1448aea78296 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:44.311364 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0ab2aa8c-0806-4ff4-a279-1448aea78296 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:44.351514 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cb6533b4-3c48-41b5-8086-739e3845b2a3 tempest-KeyPairsV210TestJSON-1608037084 tempest-KeyPairsV210TestJSON-1608037084-project-admin] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.696637 Jun 20 11:58:44.352514 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 366/721] 10.222.0.27 () {62 vars in 1199 bytes} [Mon Jun 20 11:58:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 702 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 20 11:58:44.376252 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-53ceb9d6-03b9-4026-abf0-ef18a12b9397 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '.version_select at 0x7f60738bcf70>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:44.508972 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-53ceb9d6-03b9-4026-abf0-ef18a12b9397 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/images/dc3eda0e-770b-433b-861a-25a8d5c351a7" status: 200 len: 1421 microversion: 2.1 time: 0.151898 Jun 20 11:58:44.511152 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 367/722] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 11:58:44 2022] GET /compute/v2.1/images/dc3eda0e-770b-433b-861a-25a8d5c351a7 => generated 1421 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:44.516601 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0a0d477f-e06c-4d84-81c2-516f5a206b09 tempest-KeyPairsV210TestJSON-1608037084 tempest-KeyPairsV210TestJSON-1608037084-project-admin] Action: 'create', calling method: .version_select at 0x7f60738a65e0>, body: {"keypair": {"name": "tempest-keypair-1469281828", "type": "ssh", "user_id": "9003a552dbc74a849208275c2efd04d6", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEL/6Th/0gGRkPNULmme9J19ELmnOt8tTL0udGpc4ahoxuubPiGmB0s29qbRRgqkOjQ6CSIOX3oZP3gQPT9Q4LuvOQlEJiRM6qorVd+V5E3Jp9C1mRNJESisQMJ/d77yg=="}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:44.544854 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-0a0d477f-e06c-4d84-81c2-516f5a206b09 tempest-KeyPairsV210TestJSON-1608037084 tempest-KeyPairsV210TestJSON-1608037084-project-admin] Getting quotas for project 146dd3bfd1924d129a9fc0739c178ffa. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:58:44.578713 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-0a0d477f-e06c-4d84-81c2-516f5a206b09 tempest-KeyPairsV210TestJSON-1608037084 tempest-KeyPairsV210TestJSON-1608037084-project-admin] Getting quotas for user a63754cd53b24656a5db98ac0a7b9921 and project 146dd3bfd1924d129a9fc0739c178ffa. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:58:44.640890 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0a0d477f-e06c-4d84-81c2-516f5a206b09 tempest-KeyPairsV210TestJSON-1608037084 tempest-KeyPairsV210TestJSON-1608037084-project-admin] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.128202 Jun 20 11:58:44.642759 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 368/723] 10.222.0.27 () {62 vars in 1199 bytes} [Mon Jun 20 11:58:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 131 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 20 11:58:44.652527 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f88c8ed8-733b-4bc8-8070-f243be375dda tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:44.654351 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f88c8ed8-733b-4bc8-8070-f243be375dda tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] [instance: 29575605-7785-45df-becf-359b0da6db4e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:44.665708 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f88c8ed8-733b-4bc8-8070-f243be375dda tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:44.685609 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f88c8ed8-733b-4bc8-8070-f243be375dda tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:44.687957 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f88c8ed8-733b-4bc8-8070-f243be375dda tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:44.695065 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f88c8ed8-733b-4bc8-8070-f243be375dda tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:44.855029 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0ab2aa8c-0806-4ff4-a279-1448aea78296 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3607d4bf04f74a49b74ff74875dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15149d3df8e846cc993a30a0e0f75b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:44.865903 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0ab2aa8c-0806-4ff4-a279-1448aea78296 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] 10.222.0.27 "GET /compute/v2.1/servers/da760340-ab64-4d7c-a4c9-3bcd606858c5" status: 200 len: 1323 microversion: 2.1 time: 0.602842 Jun 20 11:58:44.866500 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 356/724] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:44 2022] GET /compute/v2.1/servers/da760340-ab64-4d7c-a4c9-3bcd606858c5 => generated 1323 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:44.893457 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b5613cba-02f1-43ae-9cad-b7f5c8368a0a tempest-KeyPairsV210TestJSON-1608037084 tempest-KeyPairsV210TestJSON-1608037084-project-admin] Calling method '.version_select at 0x7f6073af1550>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:44.915773 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b5613cba-02f1-43ae-9cad-b7f5c8368a0a tempest-KeyPairsV210TestJSON-1608037084 tempest-KeyPairsV210TestJSON-1608037084-project-admin] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-1680239403?user_id=9003a552dbc74a849208275c2efd04d6" status: 200 len: 512 microversion: 2.10 time: 0.042547 Jun 20 11:58:44.916377 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 357/725] 10.222.0.27 () {60 vars in 1339 bytes} [Mon Jun 20 11:58:44 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1680239403?user_id=9003a552dbc74a849208275c2efd04d6 => generated 512 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:58:44.934935 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4095fafb-a767-4b6b-bd01-e3f5f03d2c3d tempest-KeyPairsV210TestJSON-1608037084 tempest-KeyPairsV210TestJSON-1608037084-project-admin] Action: 'create', calling method: .version_select at 0x7f6073b17790>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1817752798", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIY8vqsZ4/mcsJtgYWOkSsf9wCF8U9u+Gn16SA+Rhtrx3n97ZNDBE7RATXzSfOeBIUTjRKgu70//Tz5iK1SBnpC2mpf3/QAGzRJ5jk/lj2czkXbL3FcW7xyFObwMHg+43Q=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:44.966811 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-4095fafb-a767-4b6b-bd01-e3f5f03d2c3d tempest-KeyPairsV210TestJSON-1608037084 tempest-KeyPairsV210TestJSON-1608037084-project-admin] Getting quotas for project 146dd3bfd1924d129a9fc0739c178ffa. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:58:44.972906 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-4095fafb-a767-4b6b-bd01-e3f5f03d2c3d tempest-KeyPairsV210TestJSON-1608037084 tempest-KeyPairsV210TestJSON-1608037084-project-admin] Getting quotas for user a63754cd53b24656a5db98ac0a7b9921 and project 146dd3bfd1924d129a9fc0739c178ffa. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:58:45.032767 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4095fafb-a767-4b6b-bd01-e3f5f03d2c3d tempest-KeyPairsV210TestJSON-1608037084 tempest-KeyPairsV210TestJSON-1608037084-project-admin] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.106914 Jun 20 11:58:45.033944 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 358/726] 10.222.0.27 () {62 vars in 1199 bytes} [Mon Jun 20 11:58:44 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 109 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 20 11:58:45.044518 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3f14078f-bf8e-4954-867e-69adca2e74fc tempest-KeyPairsV210TestJSON-1608037084 tempest-KeyPairsV210TestJSON-1608037084-project-admin] Calling method '.version_select at 0x7f6073a8ec10>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:45.047629 n-d-master-1 devstack@n-api.service[119127]: WARNING oslo_db.sqlalchemy.utils [None req-3f14078f-bf8e-4954-867e-69adca2e74fc tempest-KeyPairsV210TestJSON-1608037084 tempest-KeyPairsV210TestJSON-1608037084-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Jun 20 11:58:45.070491 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3f14078f-bf8e-4954-867e-69adca2e74fc tempest-KeyPairsV210TestJSON-1608037084 tempest-KeyPairsV210TestJSON-1608037084-project-admin] 10.222.0.27 "GET /compute/v2.1/os-keypairs?user_id=9003a552dbc74a849208275c2efd04d6" status: 200 len: 726 microversion: 2.10 time: 0.030795 Jun 20 11:58:45.080625 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 359/727] 10.222.0.27 () {60 vars in 1258 bytes} [Mon Jun 20 11:58:45 2022] GET /compute/v2.1/os-keypairs?user_id=9003a552dbc74a849208275c2efd04d6 => generated 726 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:58:45.093340 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2a5d2cbb-d656-4fbf-b646-e49d83585f23 tempest-KeyPairsV210TestJSON-1608037084 tempest-KeyPairsV210TestJSON-1608037084-project-admin] Calling method '.version_select at 0x7f6073a8e940>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:45.126778 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2a5d2cbb-d656-4fbf-b646-e49d83585f23 tempest-KeyPairsV210TestJSON-1608037084 tempest-KeyPairsV210TestJSON-1608037084-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1817752798" status: 204 len: 0 microversion: 2.10 time: 0.043416 Jun 20 11:58:45.129485 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 360/728] 10.222.0.27 () {60 vars in 1324 bytes} [Mon Jun 20 11:58:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1817752798 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 11:58:45.142565 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f427b507-ac3a-4d64-89cf-c4059c655bb0 tempest-KeyPairsV210TestJSON-1608037084 tempest-KeyPairsV210TestJSON-1608037084-project-admin] Calling method '.version_select at 0x7f6073a8e1f0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:45.196891 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f427b507-ac3a-4d64-89cf-c4059c655bb0 tempest-KeyPairsV210TestJSON-1608037084 tempest-KeyPairsV210TestJSON-1608037084-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1469281828?user_id=9003a552dbc74a849208275c2efd04d6" status: 204 len: 0 microversion: 2.10 time: 0.062449 Jun 20 11:58:45.198386 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 361/729] 10.222.0.27 () {60 vars in 1342 bytes} [Mon Jun 20 11:58:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1469281828?user_id=9003a552dbc74a849208275c2efd04d6 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 11:58:45.209251 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cab0830f-a9d9-4d41-af4e-1cdbaa875bfb tempest-KeyPairsV210TestJSON-1608037084 tempest-KeyPairsV210TestJSON-1608037084-project-admin] Calling method '.version_select at 0x7f6073a4b160>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:45.257082 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cab0830f-a9d9-4d41-af4e-1cdbaa875bfb tempest-KeyPairsV210TestJSON-1608037084 tempest-KeyPairsV210TestJSON-1608037084-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1680239403?user_id=9003a552dbc74a849208275c2efd04d6" status: 204 len: 0 microversion: 2.10 time: 0.053730 Jun 20 11:58:45.258290 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 362/730] 10.222.0.27 () {60 vars in 1342 bytes} [Mon Jun 20 11:58:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1680239403?user_id=9003a552dbc74a849208275c2efd04d6 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 11:58:45.276001 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-509ca229-8900-4de2-8988-241fe7db96df tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:45.277506 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-509ca229-8900-4de2-8988-241fe7db96df tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 66d1074f-478d-4676-ab01-4dc1d4561a42] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:45.288343 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-509ca229-8900-4de2-8988-241fe7db96df tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:45.289143 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-509ca229-8900-4de2-8988-241fe7db96df tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:45.291389 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-509ca229-8900-4de2-8988-241fe7db96df tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:45.293326 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-509ca229-8900-4de2-8988-241fe7db96df tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:45.864081 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-f88c8ed8-733b-4bc8-8070-f243be375dda tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lazy-loading 'services' on Instance uuid 29575605-7785-45df-becf-359b0da6db4e {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:58:45.923138 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f88c8ed8-733b-4bc8-8070-f243be375dda tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e" status: 200 len: 2037 microversion: 2.25 time: 1.277342 Jun 20 11:58:45.924984 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 369/731] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:58:44 2022] GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e => generated 2037 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:58:45.959985 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-509cf6d6-0781-48cc-bfe4-9d964fd10ada tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '.version_select at 0x7f60738bca60>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:46.034144 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-509cf6d6-0781-48cc-bfe4-9d964fd10ada tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/images/dc3eda0e-770b-433b-861a-25a8d5c351a7" status: 200 len: 1421 microversion: 2.1 time: 0.106157 Jun 20 11:58:46.035003 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 370/732] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 11:58:45 2022] GET /compute/v2.1/images/dc3eda0e-770b-433b-861a-25a8d5c351a7 => generated 1421 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:46.043177 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-88e00371-2452-416e-afb5-916b3be56e06 req-f7c43785-410b-4ec1-850b-15f2d39e94b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0", "name": "network-vif-plugged", "status": "completed", "tag": "736a1975-6c4b-4f19-83da-ab507fc213c8"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:46.052718 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-88e00371-2452-416e-afb5-916b3be56e06 req-f7c43785-410b-4ec1-850b-15f2d39e94b7 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:46.053448 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-88e00371-2452-416e-afb5-916b3be56e06 req-f7c43785-410b-4ec1-850b-15f2d39e94b7 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:46.075753 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-88e00371-2452-416e-afb5-916b3be56e06 req-f7c43785-410b-4ec1-850b-15f2d39e94b7 service nova] Creating event network-vif-plugged:736a1975-6c4b-4f19-83da-ab507fc213c8 for instance a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0 on n-h1-master-1 Jun 20 11:58:46.078986 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-509ca229-8900-4de2-8988-241fe7db96df tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:46.082144 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-88e00371-2452-416e-afb5-916b3be56e06 req-f7c43785-410b-4ec1-850b-15f2d39e94b7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044229 Jun 20 11:58:46.083729 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 371/733] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:58:46.090602 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fb0e26f0-3292-4fea-8f21-37bc0cc37e63 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:46.091602 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fb0e26f0-3292-4fea-8f21-37bc0cc37e63 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] [instance: da760340-ab64-4d7c-a4c9-3bcd606858c5] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:46.093071 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-509ca229-8900-4de2-8988-241fe7db96df tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42" status: 200 len: 1467 microversion: 2.1 time: 0.821413 Jun 20 11:58:46.093674 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 363/734] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:45 2022] GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42 => generated 1467 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:46.109939 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dad01989-b1cc-4f85-9f8e-7a59c8518e59 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": "auto"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:46.111401 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dad01989-b1cc-4f85-9f8e-7a59c8518e59 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] [instance: 29575605-7785-45df-becf-359b0da6db4e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:46.126570 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dad01989-b1cc-4f85-9f8e-7a59c8518e59 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:46.127022 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dad01989-b1cc-4f85-9f8e-7a59c8518e59 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:46.127972 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dad01989-b1cc-4f85-9f8e-7a59c8518e59 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:46.128160 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fb0e26f0-3292-4fea-8f21-37bc0cc37e63 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:46.128666 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fb0e26f0-3292-4fea-8f21-37bc0cc37e63 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:46.128941 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dad01989-b1cc-4f85-9f8e-7a59c8518e59 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:46.131403 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fb0e26f0-3292-4fea-8f21-37bc0cc37e63 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:46.132097 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fb0e26f0-3292-4fea-8f21-37bc0cc37e63 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:46.232477 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-dad01989-b1cc-4f85-9f8e-7a59c8518e59 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lazy-loading 'flavor' on Instance uuid 29575605-7785-45df-becf-359b0da6db4e {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:58:46.247968 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dad01989-b1cc-4f85-9f8e-7a59c8518e59 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] [instance: 29575605-7785-45df-becf-359b0da6db4e] Going to try to live migrate instance to n-h1-master-1 {{(pid=119127) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 20 11:58:46.556882 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fb0e26f0-3292-4fea-8f21-37bc0cc37e63 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3607d4bf04f74a49b74ff74875dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15149d3df8e846cc993a30a0e0f75b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:46.568118 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fb0e26f0-3292-4fea-8f21-37bc0cc37e63 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] 10.222.0.27 "GET /compute/v2.1/servers/da760340-ab64-4d7c-a4c9-3bcd606858c5" status: 200 len: 1323 microversion: 2.1 time: 0.482741 Jun 20 11:58:46.578851 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 372/735] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:46 2022] GET /compute/v2.1/servers/da760340-ab64-4d7c-a4c9-3bcd606858c5 => generated 1323 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:46.584144 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ca28053c-6790-48cd-8bc3-33677072cfdf tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:46.585120 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ca28053c-6790-48cd-8bc3-33677072cfdf tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] [instance: 66d1074f-478d-4676-ab01-4dc1d4561a42] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:46.599872 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ca28053c-6790-48cd-8bc3-33677072cfdf tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:46.600996 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ca28053c-6790-48cd-8bc3-33677072cfdf tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:46.602460 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ca28053c-6790-48cd-8bc3-33677072cfdf tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:46.603098 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ca28053c-6790-48cd-8bc3-33677072cfdf tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:46.910379 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ca28053c-6790-48cd-8bc3-33677072cfdf tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42" status: 200 len: 1618 microversion: 2.1 time: 0.330055 Jun 20 11:58:46.912677 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 373/736] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:46 2022] GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42 => generated 1618 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:47.062426 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0963e7b6-a01f-4f85-8681-a7f05d2d637d tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '.version_select at 0x7f6073b13940>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:48.521852 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=24 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:58:50.407835 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dad01989-b1cc-4f85-9f8e-7a59c8518e59 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e/action" status: 202 len: 0 microversion: 2.25 time: 4.312830 Jun 20 11:58:50.408987 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 364/737] 10.222.0.27 () {62 vars in 1318 bytes} [Mon Jun 20 11:58:46 2022] POST /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e/action => generated 0 bytes in 4315 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:58:50.418777 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-edfd9e37-cf19-4d9d-bc6e-15b94f0bb207 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-903359544", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["c5afa776-6f61-4b7a-b586-c5047b5fbe5e"]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:52.096338 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0963e7b6-a01f-4f85-8681-a7f05d2d637d tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/images/dc3eda0e-770b-433b-861a-25a8d5c351a7" status: 200 len: 1421 microversion: 2.1 time: 5.051160 Jun 20 11:58:52.096910 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 374/738] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 11:58:47 2022] GET /compute/v2.1/images/dc3eda0e-770b-433b-861a-25a8d5c351a7 => generated 1421 bytes in 5053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:52.121729 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-044e2abe-557f-4e19-9573-a7e3becfd29f tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:52.127231 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-edfd9e37-cf19-4d9d-bc6e-15b94f0bb207 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] validate_networks() for None {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:58:52.128539 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-044e2abe-557f-4e19-9573-a7e3becfd29f tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] [instance: da760340-ab64-4d7c-a4c9-3bcd606858c5] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:52.175946 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-044e2abe-557f-4e19-9573-a7e3becfd29f tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:52.180439 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-044e2abe-557f-4e19-9573-a7e3becfd29f tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:52.181517 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-044e2abe-557f-4e19-9573-a7e3becfd29f tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:52.189967 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-044e2abe-557f-4e19-9573-a7e3becfd29f tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:52.389111 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:58:52.886061 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-edfd9e37-cf19-4d9d-bc6e-15b94f0bb207 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:58:52.886490 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-edfd9e37-cf19-4d9d-bc6e-15b94f0bb207 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:58:52.887011 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-edfd9e37-cf19-4d9d-bc6e-15b94f0bb207 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:58:52.887351 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-edfd9e37-cf19-4d9d-bc6e-15b94f0bb207 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:58:52.887761 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-edfd9e37-cf19-4d9d-bc6e-15b94f0bb207 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:58:52.932465 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-edfd9e37-cf19-4d9d-bc6e-15b94f0bb207 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:52.935519 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-edfd9e37-cf19-4d9d-bc6e-15b94f0bb207 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:52.936437 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-edfd9e37-cf19-4d9d-bc6e-15b94f0bb207 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:52.942219 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-edfd9e37-cf19-4d9d-bc6e-15b94f0bb207 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:53.078251 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-edfd9e37-cf19-4d9d-bc6e-15b94f0bb207 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Getting quotas for project a6150795e7424cca91c71531840d88be. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:58:53.101882 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:58:53.106848 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-edfd9e37-cf19-4d9d-bc6e-15b94f0bb207 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Getting quotas for user 1297c1b206f845bcaf936313fd7eed9b and project a6150795e7424cca91c71531840d88be. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:58:53.184144 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-044e2abe-557f-4e19-9573-a7e3becfd29f tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3607d4bf04f74a49b74ff74875dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15149d3df8e846cc993a30a0e0f75b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:53.209495 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-edfd9e37-cf19-4d9d-bc6e-15b94f0bb207 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:58:53.223280 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-044e2abe-557f-4e19-9573-a7e3becfd29f tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] 10.222.0.27 "GET /compute/v2.1/servers/da760340-ab64-4d7c-a4c9-3bcd606858c5" status: 200 len: 1323 microversion: 2.1 time: 1.122636 Jun 20 11:58:53.224605 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-edfd9e37-cf19-4d9d-bc6e-15b94f0bb207 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: df847276-3f6d-4fbf-bd7c-defd0d1e633c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:58:53.235837 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 375/739] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:52 2022] GET /compute/v2.1/servers/da760340-ab64-4d7c-a4c9-3bcd606858c5 => generated 1323 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:53.263415 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-a51c63cc-53d4-47d9-ba70-c121b041be10 req-e392de10-fa4b-4752-8e1d-b0e2a0b92ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da760340-ab64-4d7c-a4c9-3bcd606858c5", "name": "network-vif-plugged", "status": "completed", "tag": "5f3971de-6416-4e5b-9307-3da2ee368027"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:53.308735 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-a51c63cc-53d4-47d9-ba70-c121b041be10 req-e392de10-fa4b-4752-8e1d-b0e2a0b92ce2 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:53.311412 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-a51c63cc-53d4-47d9-ba70-c121b041be10 req-e392de10-fa4b-4752-8e1d-b0e2a0b92ce2 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:53.339610 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-a51c63cc-53d4-47d9-ba70-c121b041be10 req-e392de10-fa4b-4752-8e1d-b0e2a0b92ce2 service nova] Creating event network-vif-plugged:5f3971de-6416-4e5b-9307-3da2ee368027 for instance da760340-ab64-4d7c-a4c9-3bcd606858c5 on n-h1-master-1 Jun 20 11:58:53.358541 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-a51c63cc-53d4-47d9-ba70-c121b041be10 req-e392de10-fa4b-4752-8e1d-b0e2a0b92ce2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115950 Jun 20 11:58:53.374846 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 376/740] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:58:53.407243 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9093504c-7ce1-471c-8580-1ed9caa5d62e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:53.417906 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9093504c-7ce1-471c-8580-1ed9caa5d62e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 29575605-7785-45df-becf-359b0da6db4e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:53.443550 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9093504c-7ce1-471c-8580-1ed9caa5d62e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:53.453537 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9093504c-7ce1-471c-8580-1ed9caa5d62e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:53.459399 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9093504c-7ce1-471c-8580-1ed9caa5d62e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:53.461501 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9093504c-7ce1-471c-8580-1ed9caa5d62e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:53.515584 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-edfd9e37-cf19-4d9d-bc6e-15b94f0bb207 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.105273 Jun 20 11:58:53.529571 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 365/741] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:58:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 3120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 11:58:53.534765 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-91b278ff-68d1-4f7c-aa9e-3f0c22038df0 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '.version_select at 0x7f6073ebe160>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:53.686818 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-91b278ff-68d1-4f7c-aa9e-3f0c22038df0 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/images/dc3eda0e-770b-433b-861a-25a8d5c351a7" status: 200 len: 1421 microversion: 2.1 time: 0.153359 Jun 20 11:58:53.694394 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 366/742] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 11:58:53 2022] GET /compute/v2.1/images/dc3eda0e-770b-433b-861a-25a8d5c351a7 => generated 1421 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:53.713616 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cbdf8b25-95ec-4a26-a9b3-4e0ccb7e60d4 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:53.720254 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cbdf8b25-95ec-4a26-a9b3-4e0ccb7e60d4 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: df847276-3f6d-4fbf-bd7c-defd0d1e633c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:54.026681 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cbdf8b25-95ec-4a26-a9b3-4e0ccb7e60d4 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:54.034315 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cbdf8b25-95ec-4a26-a9b3-4e0ccb7e60d4 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/df847276-3f6d-4fbf-bd7c-defd0d1e633c" status: 200 len: 1216 microversion: 2.1 time: 0.337074 Jun 20 11:58:54.052816 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 367/743] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:53 2022] GET /compute/v2.1/servers/df847276-3f6d-4fbf-bd7c-defd0d1e633c => generated 1216 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:54.248665 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cd1e4d85-6336-4e16-911c-f4ce7bef0649 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:54.249340 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cd1e4d85-6336-4e16-911c-f4ce7bef0649 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] [instance: da760340-ab64-4d7c-a4c9-3bcd606858c5] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:54.261447 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cd1e4d85-6336-4e16-911c-f4ce7bef0649 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:54.266383 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cd1e4d85-6336-4e16-911c-f4ce7bef0649 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:54.266383 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cd1e4d85-6336-4e16-911c-f4ce7bef0649 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:54.266383 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cd1e4d85-6336-4e16-911c-f4ce7bef0649 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:54.610113 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=8 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:58:54.650842 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9093504c-7ce1-471c-8580-1ed9caa5d62e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:54.671238 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9093504c-7ce1-471c-8580-1ed9caa5d62e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:54.683657 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9093504c-7ce1-471c-8580-1ed9caa5d62e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:54.688975 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9093504c-7ce1-471c-8580-1ed9caa5d62e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e" status: 200 len: 1569 microversion: 2.25 time: 1.308987 Jun 20 11:58:54.701251 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 377/744] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:58:53 2022] GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e => generated 1569 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:58:54.727177 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9af4d1fa-d240-4945-be4c-9f7e13e6bf6c tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '.version_select at 0x7f6073c81940>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:54.864715 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9af4d1fa-d240-4945-be4c-9f7e13e6bf6c tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/images/dc3eda0e-770b-433b-861a-25a8d5c351a7" status: 200 len: 1421 microversion: 2.1 time: 0.154732 Jun 20 11:58:54.866007 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 378/745] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 11:58:54 2022] GET /compute/v2.1/images/dc3eda0e-770b-433b-861a-25a8d5c351a7 => generated 1421 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:55.051222 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9e115505-e8e5-4b71-a631-96bdf4282484 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:55.051917 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9e115505-e8e5-4b71-a631-96bdf4282484 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: df847276-3f6d-4fbf-bd7c-defd0d1e633c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:55.086175 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9e115505-e8e5-4b71-a631-96bdf4282484 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:55.091356 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9e115505-e8e5-4b71-a631-96bdf4282484 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:55.095770 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9e115505-e8e5-4b71-a631-96bdf4282484 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:55.100106 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9e115505-e8e5-4b71-a631-96bdf4282484 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:55.104011 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cd1e4d85-6336-4e16-911c-f4ce7bef0649 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3607d4bf04f74a49b74ff74875dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15149d3df8e846cc993a30a0e0f75b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:55.122091 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cd1e4d85-6336-4e16-911c-f4ce7bef0649 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] 10.222.0.27 "GET /compute/v2.1/servers/da760340-ab64-4d7c-a4c9-3bcd606858c5" status: 200 len: 1323 microversion: 2.1 time: 0.871937 Jun 20 11:58:55.126330 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 368/746] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:54 2022] GET /compute/v2.1/servers/da760340-ab64-4d7c-a4c9-3bcd606858c5 => generated 1323 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:58:55.552500 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9e115505-e8e5-4b71-a631-96bdf4282484 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:55.581633 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9e115505-e8e5-4b71-a631-96bdf4282484 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/df847276-3f6d-4fbf-bd7c-defd0d1e633c" status: 200 len: 1220 microversion: 2.1 time: 0.534437 Jun 20 11:58:55.591829 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 379/747] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:55 2022] GET /compute/v2.1/servers/df847276-3f6d-4fbf-bd7c-defd0d1e633c => generated 1220 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:58:55.747784 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b02c4dfc-d671-4cc3-885c-0b80fdcf39b4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:55.748644 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b02c4dfc-d671-4cc3-885c-0b80fdcf39b4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 29575605-7785-45df-becf-359b0da6db4e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:55.772107 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b02c4dfc-d671-4cc3-885c-0b80fdcf39b4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:55.772991 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b02c4dfc-d671-4cc3-885c-0b80fdcf39b4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:55.779583 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b02c4dfc-d671-4cc3-885c-0b80fdcf39b4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:55.780792 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b02c4dfc-d671-4cc3-885c-0b80fdcf39b4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:55.977237 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-372baea9-3443-4d50-b50e-21fb9da8e307 tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] Calling method '.version_select at 0x7f6073a8e820>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:56.221352 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-372baea9-3443-4d50-b50e-21fb9da8e307 tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/37fc65a620de415d873d453c3b2f5d0c" status: 200 len: 371 microversion: 2.1 time: 0.885241 Jun 20 11:58:56.229364 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 369/748] 10.222.0.27 () {58 vars in 1241 bytes} [Mon Jun 20 11:58:55 2022] GET /compute/v2.1/os-quota-sets/37fc65a620de415d873d453c3b2f5d0c => generated 371 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:58:56.272247 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-309d6ea4-5547-4234-b62b-414e76a0aea4 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '.version_select at 0x7f6073b17040>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:56.437647 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-309d6ea4-5547-4234-b62b-414e76a0aea4 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/images/dc3eda0e-770b-433b-861a-25a8d5c351a7" status: 200 len: 1421 microversion: 2.1 time: 0.196893 Jun 20 11:58:56.440869 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 370/749] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 11:58:56 2022] GET /compute/v2.1/images/dc3eda0e-770b-433b-861a-25a8d5c351a7 => generated 1421 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:56.466736 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f1d683ef-32c1-4c94-8c58-c698e056f2dc tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:56.471117 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b02c4dfc-d671-4cc3-885c-0b80fdcf39b4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:56.476319 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f1d683ef-32c1-4c94-8c58-c698e056f2dc tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] [instance: da760340-ab64-4d7c-a4c9-3bcd606858c5] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:56.486718 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b02c4dfc-d671-4cc3-885c-0b80fdcf39b4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:56.496649 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b02c4dfc-d671-4cc3-885c-0b80fdcf39b4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:56.509199 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b02c4dfc-d671-4cc3-885c-0b80fdcf39b4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e" status: 200 len: 1569 microversion: 2.25 time: 0.791646 Jun 20 11:58:56.518356 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 380/750] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:58:55 2022] GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e => generated 1569 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:58:56.526690 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-10f3aafc-960a-48a7-ad87-97e2b372bbd2 tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] Action: 'update', calling method: .version_select at 0x7f6073c311f0>, body: {"quota_set": {"ram": "5120"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:56.531118 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f1d683ef-32c1-4c94-8c58-c698e056f2dc tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:56.544722 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f1d683ef-32c1-4c94-8c58-c698e056f2dc tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:56.548452 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f1d683ef-32c1-4c94-8c58-c698e056f2dc tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:56.548954 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f1d683ef-32c1-4c94-8c58-c698e056f2dc tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:56.735883 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-10f3aafc-960a-48a7-ad87-97e2b372bbd2 tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:56.736453 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-10f3aafc-960a-48a7-ad87-97e2b372bbd2 tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:56.737165 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-10f3aafc-960a-48a7-ad87-97e2b372bbd2 tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:56.737607 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-10f3aafc-960a-48a7-ad87-97e2b372bbd2 tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:56.919766 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-10f3aafc-960a-48a7-ad87-97e2b372bbd2 tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/37fc65a620de415d873d453c3b2f5d0c" status: 200 len: 328 microversion: 2.1 time: 0.398153 Jun 20 11:58:56.921462 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 381/751] 10.222.0.27 () {60 vars in 1261 bytes} [Mon Jun 20 11:58:56 2022] PUT /compute/v2.1/os-quota-sets/37fc65a620de415d873d453c3b2f5d0c => generated 328 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:58:56.935749 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5730540c-64c0-445d-928f-c881e24bea0d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:56.937578 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5730540c-64c0-445d-928f-c881e24bea0d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: df847276-3f6d-4fbf-bd7c-defd0d1e633c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:56.962523 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5730540c-64c0-445d-928f-c881e24bea0d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:56.962523 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5730540c-64c0-445d-928f-c881e24bea0d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:56.962523 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5730540c-64c0-445d-928f-c881e24bea0d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:56.964626 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5730540c-64c0-445d-928f-c881e24bea0d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:57.198112 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5730540c-64c0-445d-928f-c881e24bea0d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:57.231720 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5730540c-64c0-445d-928f-c881e24bea0d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/df847276-3f6d-4fbf-bd7c-defd0d1e633c" status: 200 len: 1274 microversion: 2.1 time: 0.306798 Jun 20 11:58:57.232643 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 382/752] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:56 2022] GET /compute/v2.1/servers/df847276-3f6d-4fbf-bd7c-defd0d1e633c => generated 1274 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:57.244748 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cb76c876-34b8-4113-b8cd-1d6ddad1c80d tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:57.276180 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cb76c876-34b8-4113-b8cd-1d6ddad1c80d tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-quota-sets/37fc65a620de415d873d453c3b2f5d0c" status: 202 len: 0 microversion: 2.1 time: 0.042411 Jun 20 11:58:57.280367 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 383/753] 10.222.0.27 () {58 vars in 1244 bytes} [Mon Jun 20 11:58:57 2022] DELETE /compute/v2.1/os-quota-sets/37fc65a620de415d873d453c3b2f5d0c => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:58:57.287748 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-6b8bd2da-81d1-4e31-ac79-30c8c0bcaa26 req-4e661709-d788-40b0-85bb-1dbc63d5976c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29575605-7785-45df-becf-359b0da6db4e", "name": "network-vif-unplugged", "status": "completed", "tag": "e0f1c5e6-79d0-4e55-a956-27d25ee10457"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:57.308026 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-6b8bd2da-81d1-4e31-ac79-30c8c0bcaa26 req-4e661709-d788-40b0-85bb-1dbc63d5976c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:57.316706 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-6b8bd2da-81d1-4e31-ac79-30c8c0bcaa26 req-4e661709-d788-40b0-85bb-1dbc63d5976c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:57.355651 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-6b8bd2da-81d1-4e31-ac79-30c8c0bcaa26 req-4e661709-d788-40b0-85bb-1dbc63d5976c service nova] Creating event network-vif-unplugged:e0f1c5e6-79d0-4e55-a956-27d25ee10457 for instance 29575605-7785-45df-becf-359b0da6db4e on n-h2-master-1 Jun 20 11:58:57.382372 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-6b8bd2da-81d1-4e31-ac79-30c8c0bcaa26 req-4e661709-d788-40b0-85bb-1dbc63d5976c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098828 Jun 20 11:58:57.386664 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 384/754] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:58:57.405679 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-37fec8d2-4d1b-4714-8834-2e629e7d10c0 tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] Calling method '.version_select at 0x7f607399ec10>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:57.582500 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-37fec8d2-4d1b-4714-8834-2e629e7d10c0 tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/37fc65a620de415d873d453c3b2f5d0c" status: 200 len: 371 microversion: 2.1 time: 0.194160 Jun 20 11:58:57.591602 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 385/755] 10.222.0.27 () {58 vars in 1241 bytes} [Mon Jun 20 11:58:57 2022] GET /compute/v2.1/os-quota-sets/37fc65a620de415d873d453c3b2f5d0c => generated 371 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:58:57.623738 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3b1f0f44-f5b4-4274-a2ad-df3162a8e6dd tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '.version_select at 0x7f60738bc550>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:57.666924 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f1d683ef-32c1-4c94-8c58-c698e056f2dc tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3607d4bf04f74a49b74ff74875dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15149d3df8e846cc993a30a0e0f75b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:57.675962 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f1d683ef-32c1-4c94-8c58-c698e056f2dc tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] 10.222.0.27 "GET /compute/v2.1/servers/da760340-ab64-4d7c-a4c9-3bcd606858c5" status: 200 len: 1473 microversion: 2.1 time: 1.233426 Jun 20 11:58:57.685532 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 371/756] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:56 2022] GET /compute/v2.1/servers/da760340-ab64-4d7c-a4c9-3bcd606858c5 => generated 1473 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:57.718768 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e8558a09-230d-4b17-b156-9600ffa1f4e2 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:57.726781 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e8558a09-230d-4b17-b156-9600ffa1f4e2 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 29575605-7785-45df-becf-359b0da6db4e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:57.746627 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e8558a09-230d-4b17-b156-9600ffa1f4e2 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:57.751580 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e8558a09-230d-4b17-b156-9600ffa1f4e2 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:57.753264 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e8558a09-230d-4b17-b156-9600ffa1f4e2 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:57.753573 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3b1f0f44-f5b4-4274-a2ad-df3162a8e6dd tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/images/dc3eda0e-770b-433b-861a-25a8d5c351a7" status: 200 len: 1421 microversion: 2.1 time: 0.140790 Jun 20 11:58:57.758102 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 386/757] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 11:58:57 2022] GET /compute/v2.1/images/dc3eda0e-770b-433b-861a-25a8d5c351a7 => generated 1421 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:57.759661 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e8558a09-230d-4b17-b156-9600ffa1f4e2 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:57.772633 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3b408ab8-a637-450f-80ef-f02e459937e7 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:57.779626 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3b408ab8-a637-450f-80ef-f02e459937e7 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] [instance: da760340-ab64-4d7c-a4c9-3bcd606858c5] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:57.809918 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b408ab8-a637-450f-80ef-f02e459937e7 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:57.825769 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b408ab8-a637-450f-80ef-f02e459937e7 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:57.832177 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b408ab8-a637-450f-80ef-f02e459937e7 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:57.833066 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b408ab8-a637-450f-80ef-f02e459937e7 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:57.973235 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3b408ab8-a637-450f-80ef-f02e459937e7 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'c7f3607d4bf04f74a49b74ff74875dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15149d3df8e846cc993a30a0e0f75b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:57.977797 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3b408ab8-a637-450f-80ef-f02e459937e7 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Request method failure captured: Jun 20 11:58:57.977797 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/da760340-ab64-4d7c-a4c9-3bcd606858c5/diagnostics HTTP/1.1 Jun 20 11:58:57.977797 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:58:57.977797 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:58:57.977797 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:58:57.977797 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 11:58:57.977797 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:58:57.977797 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:58:57.977797 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:58:57.977797 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:58:57.977797 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGDkabDMDLkcukIQ-vjqtpbsVA8c49rOsncHyS55mkD0TpyGaErIxI2PjaWDwjplrwq1JVAbJ2UqQePqB046gChKOFYqrJcqfjC2D1GlRCllAmVxhh-iq8AbBknBtbx-jsAjDzvq9bKBt_5rFua6YF5ThREutMb4GdaVQtnHtRmTuQ8 Jun 20 11:58:57.977797 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:58:57.977797 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:58:57.977797 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:58:57.977797 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:58:57.977797 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:58:57.977797 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:58:57.977797 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 15149d3df8e846cc993a30a0e0f75b3e Jun 20 11:58:57.977797 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1660360679 Jun 20 11:58:57.977797 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 11:58:57.977797 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 11:58:57.979392 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/15149d3df8e846cc993a30a0e0f75b3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/15149d3df8e846cc993a30a0e0f75b3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/15149d3df8e846cc993a30a0e0f75b3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_15149d3df8e846cc993a30a0e0f75b3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:58:57.979392 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1660360679 Jun 20 11:58:57.979392 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 15149d3df8e846cc993a30a0e0f75b3e Jun 20 11:58:57.979392 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1660360679 Jun 20 11:58:57.979392 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServerDiagnosticsNegativeTest-1660360679-project Jun 20 11:58:57.979392 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:58:57.979392 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:58:57.979392 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: c7f3607d4bf04f74a49b74ff74875dd0 Jun 20 11:58:57.979392 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1660360679-project Jun 20 11:58:57.979392 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 11:58:57.979392 n-d-master-1 devstack@n-api.service[119128]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jun 20 11:58:57.980172 n-d-master-1 devstack@n-api.service[119128]: action_args: {'server_id': 'da760340-ab64-4d7c-a4c9-3bcd606858c5'} Jun 20 11:58:57.980172 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:58:57.980172 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:57.980172 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:58:57.980172 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:58:57.980172 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:58:57.980172 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:58:57.980172 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:58:57.980172 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:58:57.980172 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Jun 20 11:58:57.980172 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Jun 20 11:58:57.980172 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 20 11:58:57.980172 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 20 11:58:57.980172 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 20 11:58:57.980172 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 20 11:58:57.980172 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 11:58:57.980172 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 11:58:57.980172 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 11:58:57.980172 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 11:58:57.980172 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 20 11:58:57.981488 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 20 11:58:57.981488 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 20 11:58:57.981488 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 20 11:58:57.981488 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 20 11:58:57.981488 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 20 11:58:57.981488 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jun 20 11:58:57.981488 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:58:57.981488 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:58:57.981488 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:58:57.981488 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:58:57.981488 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:58:57.981488 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:58:57.981488 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 20 11:58:57.981488 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 20 11:58:57.981488 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jun 20 11:58:57.981488 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:58:57.997646 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3b408ab8-a637-450f-80ef-f02e459937e7 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:58:57.998703 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3b408ab8-a637-450f-80ef-f02e459937e7 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] 10.222.0.27 "GET /compute/v2.1/servers/da760340-ab64-4d7c-a4c9-3bcd606858c5/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.239410 Jun 20 11:58:58.015212 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 387/758] 10.222.0.27 () {58 vars in 1271 bytes} [Mon Jun 20 11:58:57 2022] GET /compute/v2.1/servers/da760340-ab64-4d7c-a4c9-3bcd606858c5/diagnostics => generated 117 bytes in 257 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:58:58.048732 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b3773da5-c531-4672-ba62-832ca740803a tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:58.053044 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b3773da5-c531-4672-ba62-832ca740803a tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] [instance: da760340-ab64-4d7c-a4c9-3bcd606858c5] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:58.072030 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b3773da5-c531-4672-ba62-832ca740803a tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:58.075832 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b3773da5-c531-4672-ba62-832ca740803a tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:58.077144 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b3773da5-c531-4672-ba62-832ca740803a tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:58.079013 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b3773da5-c531-4672-ba62-832ca740803a tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:58.135069 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:58:58.196306 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b3773da5-c531-4672-ba62-832ca740803a tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] [instance: da760340-ab64-4d7c-a4c9-3bcd606858c5] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 11:58:58.402264 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:58:58.450997 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b3773da5-c531-4672-ba62-832ca740803a tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] 10.222.0.27 "DELETE /compute/v2.1/servers/da760340-ab64-4d7c-a4c9-3bcd606858c5" status: 204 len: 0 microversion: 2.1 time: 0.417444 Jun 20 11:58:58.452077 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 388/759] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 11:58:58 2022] DELETE /compute/v2.1/servers/da760340-ab64-4d7c-a4c9-3bcd606858c5 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:58:58.459004 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e05dccad-20c9-4e5f-bb5b-94c44a4f9db3 tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] Calling method '.version_select at 0x7f608003c3a0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:58.715443 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e05dccad-20c9-4e5f-bb5b-94c44a4f9db3 tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/f765c853e7b44b03911752ee960a172c/defaults" status: 200 len: 371 microversion: 2.1 time: 0.261921 Jun 20 11:58:58.716472 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 389/760] 10.222.0.27 () {58 vars in 1268 bytes} [Mon Jun 20 11:58:58 2022] GET /compute/v2.1/os-quota-sets/f765c853e7b44b03911752ee960a172c/defaults => generated 371 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:58:58.741114 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-754f2fa8-563f-453e-b07a-43acf5556e68 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:58.745750 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-754f2fa8-563f-453e-b07a-43acf5556e68 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: df847276-3f6d-4fbf-bd7c-defd0d1e633c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:58.757981 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-754f2fa8-563f-453e-b07a-43acf5556e68 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:58.767310 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-754f2fa8-563f-453e-b07a-43acf5556e68 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:58.768452 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-754f2fa8-563f-453e-b07a-43acf5556e68 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:58.770648 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-754f2fa8-563f-453e-b07a-43acf5556e68 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:58.925568 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-754f2fa8-563f-453e-b07a-43acf5556e68 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:58.959721 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-754f2fa8-563f-453e-b07a-43acf5556e68 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/df847276-3f6d-4fbf-bd7c-defd0d1e633c" status: 200 len: 1274 microversion: 2.1 time: 0.223807 Jun 20 11:58:58.960913 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 390/761] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:58 2022] GET /compute/v2.1/servers/df847276-3f6d-4fbf-bd7c-defd0d1e633c => generated 1274 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:58.982616 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-30ce49b3-b889-43cb-a6a4-2ce60427dae9 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:58.984538 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-30ce49b3-b889-43cb-a6a4-2ce60427dae9 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] [instance: da760340-ab64-4d7c-a4c9-3bcd606858c5] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:58:59.005624 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-30ce49b3-b889-43cb-a6a4-2ce60427dae9 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:59.005624 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-30ce49b3-b889-43cb-a6a4-2ce60427dae9 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:59.005624 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-30ce49b3-b889-43cb-a6a4-2ce60427dae9 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:59.008798 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-30ce49b3-b889-43cb-a6a4-2ce60427dae9 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:59.346575 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-30ce49b3-b889-43cb-a6a4-2ce60427dae9 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3607d4bf04f74a49b74ff74875dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15149d3df8e846cc993a30a0e0f75b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:59.354926 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-30ce49b3-b889-43cb-a6a4-2ce60427dae9 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] 10.222.0.27 "GET /compute/v2.1/servers/da760340-ab64-4d7c-a4c9-3bcd606858c5" status: 200 len: 1479 microversion: 2.1 time: 0.392647 Jun 20 11:58:59.359829 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 391/762] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:58:58 2022] GET /compute/v2.1/servers/da760340-ab64-4d7c-a4c9-3bcd606858c5 => generated 1479 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:59.388857 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-622fe736-aa37-4f75-8891-f79b61abde3c tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '.version_select at 0x7f6073d31700>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:58:59.491544 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-622fe736-aa37-4f75-8891-f79b61abde3c tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/images/dc3eda0e-770b-433b-861a-25a8d5c351a7" status: 200 len: 1421 microversion: 2.1 time: 0.129689 Jun 20 11:58:59.492466 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 392/763] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 11:58:59 2022] GET /compute/v2.1/images/dc3eda0e-770b-433b-861a-25a8d5c351a7 => generated 1421 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:58:59.501851 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b17867b1-c89b-4caa-9f5f-51bf42e75e8d tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] Action: 'update', calling method: .version_select at 0x7f6073b43160>, body: {"quota_set": {"ram": "5120"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:59.806130 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e8558a09-230d-4b17-b156-9600ffa1f4e2 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:59.835239 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e8558a09-230d-4b17-b156-9600ffa1f4e2 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:59.840126 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e8558a09-230d-4b17-b156-9600ffa1f4e2 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:58:59.842712 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e8558a09-230d-4b17-b156-9600ffa1f4e2 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e" status: 200 len: 1569 microversion: 2.25 time: 2.152833 Jun 20 11:58:59.848190 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b17867b1-c89b-4caa-9f5f-51bf42e75e8d tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:59.848536 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 372/764] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:58:57 2022] GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e => generated 1569 bytes in 2160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:58:59.850869 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b17867b1-c89b-4caa-9f5f-51bf42e75e8d tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:59.853167 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b17867b1-c89b-4caa-9f5f-51bf42e75e8d tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:59.853918 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b17867b1-c89b-4caa-9f5f-51bf42e75e8d tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:59.863158 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-ce7460d7-f5b8-412e-9189-96b82aea2bb2 req-52b9246d-e60e-40a6-9f4e-82c5fbdadcf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29575605-7785-45df-becf-359b0da6db4e", "tag": "e0f1c5e6-79d0-4e55-a956-27d25ee10457"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:58:59.895486 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ce7460d7-f5b8-412e-9189-96b82aea2bb2 req-52b9246d-e60e-40a6-9f4e-82c5fbdadcf2 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:58:59.899474 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ce7460d7-f5b8-412e-9189-96b82aea2bb2 req-52b9246d-e60e-40a6-9f4e-82c5fbdadcf2 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:58:59.932360 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-ce7460d7-f5b8-412e-9189-96b82aea2bb2 req-52b9246d-e60e-40a6-9f4e-82c5fbdadcf2 service nova] Creating event network-changed:e0f1c5e6-79d0-4e55-a956-27d25ee10457 for instance 29575605-7785-45df-becf-359b0da6db4e on n-h2-master-1 Jun 20 11:58:59.941874 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-ce7460d7-f5b8-412e-9189-96b82aea2bb2 req-52b9246d-e60e-40a6-9f4e-82c5fbdadcf2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091837 Jun 20 11:58:59.962197 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 373/765] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:59:00.003911 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7522d3ee-7812-495e-b5d8-c869876e160a tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:00.004934 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7522d3ee-7812-495e-b5d8-c869876e160a tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: adee1d54-6e18-4a4e-96ac-48a6fc56345d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:00.042024 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7522d3ee-7812-495e-b5d8-c869876e160a tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:00.063839 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7522d3ee-7812-495e-b5d8-c869876e160a tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:00.064077 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b17867b1-c89b-4caa-9f5f-51bf42e75e8d tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/b421659d926c4d87b9d97306402ac30a" status: 200 len: 328 microversion: 2.1 time: 0.570170 Jun 20 11:59:00.085098 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7522d3ee-7812-495e-b5d8-c869876e160a tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:00.085553 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7522d3ee-7812-495e-b5d8-c869876e160a tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:00.093387 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 393/766] 10.222.0.27 () {60 vars in 1261 bytes} [Mon Jun 20 11:58:59 2022] PUT /compute/v2.1/os-quota-sets/b421659d926c4d87b9d97306402ac30a => generated 328 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:59:00.107217 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-de53e888-649f-4d84-85aa-f35fb414e9ec tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:00.116298 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-de53e888-649f-4d84-85aa-f35fb414e9ec tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: df847276-3f6d-4fbf-bd7c-defd0d1e633c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:00.144453 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-de53e888-649f-4d84-85aa-f35fb414e9ec tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:00.146055 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-de53e888-649f-4d84-85aa-f35fb414e9ec tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:00.148849 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-de53e888-649f-4d84-85aa-f35fb414e9ec tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:00.152907 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-de53e888-649f-4d84-85aa-f35fb414e9ec tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:00.270631 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7522d3ee-7812-495e-b5d8-c869876e160a tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: adee1d54-6e18-4a4e-96ac-48a6fc56345d] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 11:59:00.511052 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7522d3ee-7812-495e-b5d8-c869876e160a tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "DELETE /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d" status: 204 len: 0 microversion: 2.1 time: 0.543539 Jun 20 11:59:00.518829 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 374/767] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 11:58:59 2022] DELETE /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d => generated 0 bytes in 546 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:59:00.548006 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-15a02cb5-3437-492c-80dc-5e2ee9e4cc6d tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] Calling method '.version_select at 0x7f6073fb79d0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:00.806221 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-15a02cb5-3437-492c-80dc-5e2ee9e4cc6d tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:00.808130 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-15a02cb5-3437-492c-80dc-5e2ee9e4cc6d tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:00.810822 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-15a02cb5-3437-492c-80dc-5e2ee9e4cc6d tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:00.811708 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-15a02cb5-3437-492c-80dc-5e2ee9e4cc6d tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:00.864496 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-15a02cb5-3437-492c-80dc-5e2ee9e4cc6d tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/b421659d926c4d87b9d97306402ac30a/detail" status: 200 len: 916 microversion: 2.1 time: 0.350041 Jun 20 11:59:00.874813 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 375/768] 10.222.0.27 () {58 vars in 1262 bytes} [Mon Jun 20 11:59:00 2022] GET /compute/v2.1/os-quota-sets/b421659d926c4d87b9d97306402ac30a/detail => generated 916 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:59:00.880809 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-82b1f11b-0907-4540-a755-ac91dfc2620c tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:00.882051 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-82b1f11b-0907-4540-a755-ac91dfc2620c tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] [instance: da760340-ab64-4d7c-a4c9-3bcd606858c5] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:00.902553 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-82b1f11b-0907-4540-a755-ac91dfc2620c tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:00.904764 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-82b1f11b-0907-4540-a755-ac91dfc2620c tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:00.906932 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-82b1f11b-0907-4540-a755-ac91dfc2620c tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:00.908691 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-82b1f11b-0907-4540-a755-ac91dfc2620c tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:01.411811 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-de53e888-649f-4d84-85aa-f35fb414e9ec tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:01.422690 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-de53e888-649f-4d84-85aa-f35fb414e9ec tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/df847276-3f6d-4fbf-bd7c-defd0d1e633c" status: 200 len: 1316 microversion: 2.1 time: 1.327738 Jun 20 11:59:01.429296 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 394/769] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:00 2022] GET /compute/v2.1/servers/df847276-3f6d-4fbf-bd7c-defd0d1e633c => generated 1316 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:01.444120 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9fb75025-9113-4a56-805b-c91bd5b9721d tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '.version_select at 0x7f6073a22940>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:02.118254 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-82b1f11b-0907-4540-a755-ac91dfc2620c tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3607d4bf04f74a49b74ff74875dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15149d3df8e846cc993a30a0e0f75b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:02.130493 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-82b1f11b-0907-4540-a755-ac91dfc2620c tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] 10.222.0.27 "GET /compute/v2.1/servers/da760340-ab64-4d7c-a4c9-3bcd606858c5" status: 200 len: 1479 microversion: 2.1 time: 1.254056 Jun 20 11:59:02.145334 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 376/770] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:00 2022] GET /compute/v2.1/servers/da760340-ab64-4d7c-a4c9-3bcd606858c5 => generated 1479 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:02.159456 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9b3143d7-d6f8-4cef-88c6-38d33f3a3946 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1702909293", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "982151523", "adminPass": "***", "networks": [{"uuid": "9e362e4a-dd44-4b55-9c5f-38f56974a875"}], "security_groups": [{"name": "tempest-securitygroup--590114889"}], "key_name": "tempest-keypair-830207600", "user_data": "}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:59:09.879258 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=4 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:59:10.038313 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=18 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:59:10.121005 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:59:10.794392 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=16 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:59:10.831001 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=4 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:59:11.199270 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9fb75025-9113-4a56-805b-c91bd5b9721d tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/images/dc3eda0e-770b-433b-861a-25a8d5c351a7" status: 200 len: 1430 microversion: 2.1 time: 9.768425 Jun 20 11:59:11.206723 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 395/771] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 11:59:01 2022] GET /compute/v2.1/images/dc3eda0e-770b-433b-861a-25a8d5c351a7 => generated 1430 bytes in 9771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:11.214604 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-339a416b-1882-48d4-8a96-41b548582a09 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:11.218913 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-339a416b-1882-48d4-8a96-41b548582a09 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 29575605-7785-45df-becf-359b0da6db4e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:11.245020 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-339a416b-1882-48d4-8a96-41b548582a09 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:11.245517 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-339a416b-1882-48d4-8a96-41b548582a09 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:11.246357 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-339a416b-1882-48d4-8a96-41b548582a09 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:11.246795 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-339a416b-1882-48d4-8a96-41b548582a09 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:11.330623 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-9b3143d7-d6f8-4cef-88c6-38d33f3a3946 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] validate_networks() for [('9e362e4a-dd44-4b55-9c5f-38f56974a875', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:59:11.952791 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-339a416b-1882-48d4-8a96-41b548582a09 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:11.965707 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-339a416b-1882-48d4-8a96-41b548582a09 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:11.967609 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-339a416b-1882-48d4-8a96-41b548582a09 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:11.973506 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-339a416b-1882-48d4-8a96-41b548582a09 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e" status: 200 len: 1569 microversion: 2.25 time: 0.771204 Jun 20 11:59:11.974532 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 396/772] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:59:11 2022] GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e => generated 1569 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:59:11.988729 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ea59c133-c040-4148-b278-650d1e30726b tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] Action: 'update', calling method: .version_select at 0x7f6073b5e8b0>, body: {"quota_set": {"ram": "2048"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:59:12.124848 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:59:12.143774 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-9b3143d7-d6f8-4cef-88c6-38d33f3a3946 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:59:12.144244 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-9b3143d7-d6f8-4cef-88c6-38d33f3a3946 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:59:12.144944 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-9b3143d7-d6f8-4cef-88c6-38d33f3a3946 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:59:12.145579 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-9b3143d7-d6f8-4cef-88c6-38d33f3a3946 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:59:12.146152 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-9b3143d7-d6f8-4cef-88c6-38d33f3a3946 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:59:12.166531 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b3143d7-d6f8-4cef-88c6-38d33f3a3946 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:12.169004 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b3143d7-d6f8-4cef-88c6-38d33f3a3946 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:12.174566 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b3143d7-d6f8-4cef-88c6-38d33f3a3946 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:12.184053 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b3143d7-d6f8-4cef-88c6-38d33f3a3946 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:12.242764 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-9b3143d7-d6f8-4cef-88c6-38d33f3a3946 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Getting quotas for project d8790cc26204435aaf4071847ee00288. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:59:12.260730 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-9b3143d7-d6f8-4cef-88c6-38d33f3a3946 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Getting quotas for user f5f49b57013f4675a70bac9b13e0a229 and project d8790cc26204435aaf4071847ee00288. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:59:12.295017 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9b3143d7-d6f8-4cef-88c6-38d33f3a3946 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:59:12.298056 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9b3143d7-d6f8-4cef-88c6-38d33f3a3946 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: 042df052-0ba8-4734-803c-c168858021f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:59:12.418567 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ea59c133-c040-4148-b278-650d1e30726b tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:12.419549 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ea59c133-c040-4148-b278-650d1e30726b tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:12.420688 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ea59c133-c040-4148-b278-650d1e30726b tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:12.421147 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ea59c133-c040-4148-b278-650d1e30726b tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:12.433428 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9b3143d7-d6f8-4cef-88c6-38d33f3a3946 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 10.285380 Jun 20 11:59:12.434103 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 377/773] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:59:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 10288 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 11:59:12.453761 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-35e3e28e-1cde-4314-bb10-f0e9e257b30c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:12.454377 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-35e3e28e-1cde-4314-bb10-f0e9e257b30c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: df847276-3f6d-4fbf-bd7c-defd0d1e633c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:12.471312 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-35e3e28e-1cde-4314-bb10-f0e9e257b30c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:12.487616 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-35e3e28e-1cde-4314-bb10-f0e9e257b30c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:12.488776 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-35e3e28e-1cde-4314-bb10-f0e9e257b30c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:12.489234 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-35e3e28e-1cde-4314-bb10-f0e9e257b30c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:12.539868 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ea59c133-c040-4148-b278-650d1e30726b tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:12.540657 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ea59c133-c040-4148-b278-650d1e30726b tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:12.551746 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ea59c133-c040-4148-b278-650d1e30726b tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:12.552545 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ea59c133-c040-4148-b278-650d1e30726b tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:12.822120 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ea59c133-c040-4148-b278-650d1e30726b tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/b421659d926c4d87b9d97306402ac30a?user_id=427f70e49dbb4208bc3354a0bb705746" status: 200 len: 328 microversion: 2.1 time: 0.840403 Jun 20 11:59:12.831866 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 397/774] 10.222.0.27 () {60 vars in 1342 bytes} [Mon Jun 20 11:59:11 2022] PUT /compute/v2.1/os-quota-sets/b421659d926c4d87b9d97306402ac30a?user_id=427f70e49dbb4208bc3354a0bb705746 => generated 328 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:59:12.858580 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ca1dc35e-5ccb-45e2-8be9-9866ca13e175 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:12.859207 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ca1dc35e-5ccb-45e2-8be9-9866ca13e175 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] [instance: da760340-ab64-4d7c-a4c9-3bcd606858c5] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:12.892161 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ca1dc35e-5ccb-45e2-8be9-9866ca13e175 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:12.893234 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ca1dc35e-5ccb-45e2-8be9-9866ca13e175 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:12.894048 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ca1dc35e-5ccb-45e2-8be9-9866ca13e175 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:12.894487 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ca1dc35e-5ccb-45e2-8be9-9866ca13e175 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:12.943242 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-ca1dc35e-5ccb-45e2-8be9-9866ca13e175 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] HTTP exception thrown: Instance da760340-ab64-4d7c-a4c9-3bcd606858c5 could not be found. Jun 20 11:59:12.945553 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ca1dc35e-5ccb-45e2-8be9-9866ca13e175 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Request method failure captured: Jun 20 11:59:12.945553 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/da760340-ab64-4d7c-a4c9-3bcd606858c5 HTTP/1.1 Jun 20 11:59:12.945553 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 11:59:12.945553 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 11:59:12.945553 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 11:59:12.945553 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 11:59:12.945553 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 11:59:12.945553 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 11:59:12.945553 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 11:59:12.945553 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 11:59:12.945553 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGDkabDMDLkcukIQ-vjqtpbsVA8c49rOsncHyS55mkD0TpyGaErIxI2PjaWDwjplrwq1JVAbJ2UqQePqB046gChKOFYqrJcqfjC2D1GlRCllAmVxhh-iq8AbBknBtbx-jsAjDzvq9bKBt_5rFua6YF5ThREutMb4GdaVQtnHtRmTuQ8 Jun 20 11:59:12.945553 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 11:59:12.945553 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 11:59:12.945553 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 11:59:12.945553 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 11:59:12.945553 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 11:59:12.945553 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 11:59:12.945553 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 15149d3df8e846cc993a30a0e0f75b3e Jun 20 11:59:12.945553 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1660360679 Jun 20 11:59:12.945553 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 11:59:12.945553 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 11:59:12.947005 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/15149d3df8e846cc993a30a0e0f75b3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/15149d3df8e846cc993a30a0e0f75b3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/15149d3df8e846cc993a30a0e0f75b3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_15149d3df8e846cc993a30a0e0f75b3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:59:12.947005 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1660360679 Jun 20 11:59:12.947005 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 15149d3df8e846cc993a30a0e0f75b3e Jun 20 11:59:12.947005 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1660360679 Jun 20 11:59:12.947005 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServerDiagnosticsNegativeTest-1660360679-project Jun 20 11:59:12.947005 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 11:59:12.947005 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 11:59:12.947005 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: c7f3607d4bf04f74a49b74ff74875dd0 Jun 20 11:59:12.947005 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1660360679-project Jun 20 11:59:12.947005 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 11:59:12.947005 n-d-master-1 devstack@n-api.service[119128]: exception: Instance da760340-ab64-4d7c-a4c9-3bcd606858c5 could not be found. Jun 20 11:59:12.947005 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'da760340-ab64-4d7c-a4c9-3bcd606858c5'} Jun 20 11:59:12.947803 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:59:12.947803 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:59:12.947803 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:59:12.947803 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:59:12.947803 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:59:12.947803 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:59:12.947803 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:59:12.947803 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:59:12.947803 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:59:12.947803 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:59:12.947803 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da760340-ab64-4d7c-a4c9-3bcd606858c5 could not be found. Jun 20 11:59:12.947803 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:59:12.947803 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:59:12.947803 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:59:12.947803 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:59:12.947803 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:59:12.947803 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:59:12.947803 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:59:12.947803 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:59:12.947803 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:59:12.949073 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:59:12.949073 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:59:12.949073 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:59:12.949073 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:59:12.949073 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:59:12.949073 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:59:12.949073 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:59:12.949073 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da760340-ab64-4d7c-a4c9-3bcd606858c5 could not be found. Jun 20 11:59:12.949073 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:59:12.949073 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:59:12.949073 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:59:12.949073 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:59:12.949073 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:59:12.949073 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:59:12.949073 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:59:12.949073 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:59:12.949073 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da760340-ab64-4d7c-a4c9-3bcd606858c5 could not be found. Jun 20 11:59:12.949073 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 11:59:12.958066 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-35e3e28e-1cde-4314-bb10-f0e9e257b30c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:12.970787 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ca1dc35e-5ccb-45e2-8be9-9866ca13e175 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] Returning 404 to user: Instance da760340-ab64-4d7c-a4c9-3bcd606858c5 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:59:12.971660 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ca1dc35e-5ccb-45e2-8be9-9866ca13e175 tempest-ServerDiagnosticsNegativeTest-1660360679 tempest-ServerDiagnosticsNegativeTest-1660360679-project] 10.222.0.27 "GET /compute/v2.1/servers/da760340-ab64-4d7c-a4c9-3bcd606858c5" status: 404 len: 111 microversion: 2.1 time: 0.138536 Jun 20 11:59:12.987465 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-35e3e28e-1cde-4314-bb10-f0e9e257b30c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/df847276-3f6d-4fbf-bd7c-defd0d1e633c" status: 200 len: 1316 microversion: 2.1 time: 0.539427 Jun 20 11:59:13.002098 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 398/775] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:12 2022] GET /compute/v2.1/servers/da760340-ab64-4d7c-a4c9-3bcd606858c5 => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:59:13.004152 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 378/776] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:12 2022] GET /compute/v2.1/servers/df847276-3f6d-4fbf-bd7c-defd0d1e633c => generated 1316 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:13.020617 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-58693de1-6f31-46aa-890b-42124b88a3dd req-b72dc369-7070-483d-9a1a-eca395b0c3c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df847276-3f6d-4fbf-bd7c-defd0d1e633c", "tag": "cc9f210a-49d7-439a-8602-57e97b5de3d0"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:59:13.028514 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-398d8323-8a92-4bff-92c2-6d493d4e9646 req-33c7b034-7cfc-4145-a484-04dab6ff3ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29575605-7785-45df-becf-359b0da6db4e", "name": "network-vif-unplugged", "status": "completed", "tag": "e0f1c5e6-79d0-4e55-a956-27d25ee10457"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:59:13.066833 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-58693de1-6f31-46aa-890b-42124b88a3dd req-b72dc369-7070-483d-9a1a-eca395b0c3c1 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:13.070373 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-398d8323-8a92-4bff-92c2-6d493d4e9646 req-33c7b034-7cfc-4145-a484-04dab6ff3ae8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:13.070886 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-398d8323-8a92-4bff-92c2-6d493d4e9646 req-33c7b034-7cfc-4145-a484-04dab6ff3ae8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:13.072832 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-58693de1-6f31-46aa-890b-42124b88a3dd req-b72dc369-7070-483d-9a1a-eca395b0c3c1 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:13.150331 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-58693de1-6f31-46aa-890b-42124b88a3dd req-b72dc369-7070-483d-9a1a-eca395b0c3c1 service nova] Creating event network-changed:cc9f210a-49d7-439a-8602-57e97b5de3d0 for instance df847276-3f6d-4fbf-bd7c-defd0d1e633c on n-h2-master-1 Jun 20 11:59:13.158509 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-398d8323-8a92-4bff-92c2-6d493d4e9646 req-33c7b034-7cfc-4145-a484-04dab6ff3ae8 service nova] Creating event network-vif-unplugged:e0f1c5e6-79d0-4e55-a956-27d25ee10457 for instance 29575605-7785-45df-becf-359b0da6db4e on n-h1-master-1 Jun 20 11:59:13.173065 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-58693de1-6f31-46aa-890b-42124b88a3dd req-b72dc369-7070-483d-9a1a-eca395b0c3c1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166630 Jun 20 11:59:13.174285 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-398d8323-8a92-4bff-92c2-6d493d4e9646 req-33c7b034-7cfc-4145-a484-04dab6ff3ae8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.168782 Jun 20 11:59:13.175392 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 399/777] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:59:13.183693 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 379/778] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:59:13.202447 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-05d5b6f7-b8c6-4ea9-9cac-d3fcdb03b987 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '.version_select at 0x7f6073b13820>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:13.212280 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d092d932-8a2b-49c5-abda-88c756c893cb tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:13.227049 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d092d932-8a2b-49c5-abda-88c756c893cb tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: 042df052-0ba8-4734-803c-c168858021f3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:13.304947 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-05d5b6f7-b8c6-4ea9-9cac-d3fcdb03b987 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/images/dc3eda0e-770b-433b-861a-25a8d5c351a7" status: 200 len: 1430 microversion: 2.1 time: 0.121068 Jun 20 11:59:13.306018 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 400/779] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 11:59:13 2022] GET /compute/v2.1/images/dc3eda0e-770b-433b-861a-25a8d5c351a7 => generated 1430 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:13.332357 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0b57658d-40e6-438b-afad-ada1679a5cb2 tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] Calling method '.version_select at 0x7f6073c81e50>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:13.606807 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0b57658d-40e6-438b-afad-ada1679a5cb2 tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/b421659d926c4d87b9d97306402ac30a?user_id=427f70e49dbb4208bc3354a0bb705746" status: 200 len: 370 microversion: 2.1 time: 0.295625 Jun 20 11:59:13.612963 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 401/780] 10.222.0.27 () {58 vars in 1322 bytes} [Mon Jun 20 11:59:13 2022] GET /compute/v2.1/os-quota-sets/b421659d926c4d87b9d97306402ac30a?user_id=427f70e49dbb4208bc3354a0bb705746 => generated 370 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:59:13.657802 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-353daea7-5dca-4c74-a46a-d4472699f036 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:13.665984 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-353daea7-5dca-4c74-a46a-d4472699f036 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 29575605-7785-45df-becf-359b0da6db4e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:13.703642 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-353daea7-5dca-4c74-a46a-d4472699f036 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:13.704128 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-353daea7-5dca-4c74-a46a-d4472699f036 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:13.705007 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-353daea7-5dca-4c74-a46a-d4472699f036 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:13.714094 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-353daea7-5dca-4c74-a46a-d4472699f036 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:13.957101 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d092d932-8a2b-49c5-abda-88c756c893cb tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f49b57013f4675a70bac9b13e0a229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8790cc26204435aaf4071847ee00288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:13.968522 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d092d932-8a2b-49c5-abda-88c756c893cb tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "GET /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3" status: 200 len: 1262 microversion: 2.1 time: 0.779669 Jun 20 11:59:13.994663 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 380/781] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:13 2022] GET /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3 => generated 1262 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:14.017232 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-04b64956-af97-44e0-b2bd-8c302417cdf1 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:14.023139 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-04b64956-af97-44e0-b2bd-8c302417cdf1 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] [instance: a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:14.054012 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-04b64956-af97-44e0-b2bd-8c302417cdf1 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:14.054742 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-04b64956-af97-44e0-b2bd-8c302417cdf1 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:14.056472 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-04b64956-af97-44e0-b2bd-8c302417cdf1 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:14.061023 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-04b64956-af97-44e0-b2bd-8c302417cdf1 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:14.251152 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-353daea7-5dca-4c74-a46a-d4472699f036 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:14.267202 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-353daea7-5dca-4c74-a46a-d4472699f036 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:14.269523 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-353daea7-5dca-4c74-a46a-d4472699f036 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:14.274359 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-353daea7-5dca-4c74-a46a-d4472699f036 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e" status: 200 len: 1544 microversion: 2.25 time: 0.654130 Jun 20 11:59:14.276658 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 402/782] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:59:13 2022] GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e => generated 1544 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:59:14.294736 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c4fd1cc5-8a0d-4be3-a539-355f78a9c952 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:14.295364 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c4fd1cc5-8a0d-4be3-a539-355f78a9c952 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: df847276-3f6d-4fbf-bd7c-defd0d1e633c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:14.316803 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4fd1cc5-8a0d-4be3-a539-355f78a9c952 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:14.317279 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4fd1cc5-8a0d-4be3-a539-355f78a9c952 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:14.319287 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4fd1cc5-8a0d-4be3-a539-355f78a9c952 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:14.321792 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4fd1cc5-8a0d-4be3-a539-355f78a9c952 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:14.612694 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-04b64956-af97-44e0-b2bd-8c302417cdf1 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f4477b25804205a497458b38d66883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3842c54af1c84c5ead0c5cf6530df872', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:14.641465 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-04b64956-af97-44e0-b2bd-8c302417cdf1 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/servers/a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0" status: 200 len: 1464 microversion: 2.1 time: 0.645288 Jun 20 11:59:14.653070 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 381/783] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:13 2022] GET /compute/v2.1/servers/a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0 => generated 1464 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:14.658365 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fd4645fd-58c6-4699-8fac-64408975242b tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Calling method '.version_select at 0x7f6073e9e940>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:14.661169 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fd4645fd-58c6-4699-8fac-64408975242b tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:14.661822 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fd4645fd-58c6-4699-8fac-64408975242b tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:14.671898 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fd4645fd-58c6-4699-8fac-64408975242b tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 856 microversion: 2.25 time: 0.017152 Jun 20 11:59:14.673144 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 382/784] 10.222.0.27 () {60 vars in 1183 bytes} [Mon Jun 20 11:59:14 2022] GET /compute/v2.1/os-migrations => generated 856 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:59:14.678330 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9788df20-fec2-4e90-b8ea-63a9dc9002b2 tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] Calling method '.version_select at 0x7f6073edcdc0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:14.699389 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c4fd1cc5-8a0d-4be3-a539-355f78a9c952 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:14.710029 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c4fd1cc5-8a0d-4be3-a539-355f78a9c952 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/df847276-3f6d-4fbf-bd7c-defd0d1e633c" status: 200 len: 1316 microversion: 2.1 time: 0.431383 Jun 20 11:59:14.711156 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 403/785] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:14 2022] GET /compute/v2.1/servers/df847276-3f6d-4fbf-bd7c-defd0d1e633c => generated 1316 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:14.717315 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a592afb5-e5d4-484a-88cd-7c963e92d361 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '.version_select at 0x7f6073b13e50>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:14.786320 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a592afb5-e5d4-484a-88cd-7c963e92d361 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/images/f16836cc-4e18-4bd0-b261-3865adf8cb83" status: 200 len: 784 microversion: 2.1 time: 0.073664 Jun 20 11:59:14.788941 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 404/786] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 11:59:14 2022] GET /compute/v2.1/images/f16836cc-4e18-4bd0-b261-3865adf8cb83 => generated 784 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:59:14.800400 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-792c900b-97a9-476f-ae11-0ce7fa51be57 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:14.817363 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-792c900b-97a9-476f-ae11-0ce7fa51be57 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] [instance: 29575605-7785-45df-becf-359b0da6db4e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:14.833527 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-792c900b-97a9-476f-ae11-0ce7fa51be57 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:14.848439 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-792c900b-97a9-476f-ae11-0ce7fa51be57 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:14.850186 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-792c900b-97a9-476f-ae11-0ce7fa51be57 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:14.853122 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-792c900b-97a9-476f-ae11-0ce7fa51be57 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:15.010612 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9788df20-fec2-4e90-b8ea-63a9dc9002b2 tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/f765c853e7b44b03911752ee960a172c/defaults" status: 200 len: 371 microversion: 2.1 time: 0.334058 Jun 20 11:59:15.015176 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 383/787] 10.222.0.27 () {58 vars in 1268 bytes} [Mon Jun 20 11:59:14 2022] GET /compute/v2.1/os-quota-sets/f765c853e7b44b03911752ee960a172c/defaults => generated 371 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:59:15.021703 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2a80a7ae-fe98-4037-8e7e-8eacaefb941c tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:15.045033 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2a80a7ae-fe98-4037-8e7e-8eacaefb941c tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028395 Jun 20 11:59:15.057347 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 384/788] 10.222.0.27 () {58 vars in 1136 bytes} [Mon Jun 20 11:59:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:59:15.070292 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-85d6ec01-0151-4587-9d57-a418949778d9 req-95c4faaf-337c-41ed-9a23-3a5d2b4b03bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df847276-3f6d-4fbf-bd7c-defd0d1e633c", "name": "network-vif-plugged", "status": "completed", "tag": "cc9f210a-49d7-439a-8602-57e97b5de3d0"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:59:15.082750 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-85d6ec01-0151-4587-9d57-a418949778d9 req-95c4faaf-337c-41ed-9a23-3a5d2b4b03bd service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:15.085566 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-85d6ec01-0151-4587-9d57-a418949778d9 req-95c4faaf-337c-41ed-9a23-3a5d2b4b03bd service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:15.111254 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-85d6ec01-0151-4587-9d57-a418949778d9 req-95c4faaf-337c-41ed-9a23-3a5d2b4b03bd service nova] Creating event network-vif-plugged:cc9f210a-49d7-439a-8602-57e97b5de3d0 for instance df847276-3f6d-4fbf-bd7c-defd0d1e633c on n-h2-master-1 Jun 20 11:59:15.134205 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-85d6ec01-0151-4587-9d57-a418949778d9 req-95c4faaf-337c-41ed-9a23-3a5d2b4b03bd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074804 Jun 20 11:59:15.135849 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 385/789] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:59:15.147847 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f4c3d035-bf9a-4f5a-8e08-685e9ad18e8a tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:15.163270 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f4c3d035-bf9a-4f5a-8e08-685e9ad18e8a tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: 042df052-0ba8-4734-803c-c168858021f3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:15.175964 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f4c3d035-bf9a-4f5a-8e08-685e9ad18e8a tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:15.176527 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f4c3d035-bf9a-4f5a-8e08-685e9ad18e8a tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:15.177537 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f4c3d035-bf9a-4f5a-8e08-685e9ad18e8a tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:15.185180 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f4c3d035-bf9a-4f5a-8e08-685e9ad18e8a tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:15.374967 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f4c3d035-bf9a-4f5a-8e08-685e9ad18e8a tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f49b57013f4675a70bac9b13e0a229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8790cc26204435aaf4071847ee00288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:15.391321 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f4c3d035-bf9a-4f5a-8e08-685e9ad18e8a tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "GET /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3" status: 200 len: 1320 microversion: 2.1 time: 0.253521 Jun 20 11:59:15.401274 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 386/790] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:15 2022] GET /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3 => generated 1320 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:15.413297 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bf2ac837-530e-4afb-ba4e-77045d5d444e tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] Action: 'update', calling method: .version_select at 0x7f6073ab6c10>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:59:15.605489 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf2ac837-530e-4afb-ba4e-77045d5d444e tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:15.605949 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf2ac837-530e-4afb-ba4e-77045d5d444e tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:15.606817 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf2ac837-530e-4afb-ba4e-77045d5d444e tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:15.607251 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf2ac837-530e-4afb-ba4e-77045d5d444e tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:15.900193 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=13,nova_api:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:59:15.967398 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-792c900b-97a9-476f-ae11-0ce7fa51be57 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lazy-loading 'services' on Instance uuid 29575605-7785-45df-becf-359b0da6db4e {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:59:16.016713 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-792c900b-97a9-476f-ae11-0ce7fa51be57 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e" status: 200 len: 2037 microversion: 2.25 time: 1.224576 Jun 20 11:59:16.026089 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 405/791] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:59:14 2022] GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e => generated 2037 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:59:16.059457 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bcbcca41-4be6-4618-97d4-94196963dcef tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '.version_select at 0x7f6073b134c0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:16.163693 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bf2ac837-530e-4afb-ba4e-77045d5d444e tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/f765c853e7b44b03911752ee960a172c" status: 200 len: 329 microversion: 2.1 time: 0.770070 Jun 20 11:59:16.164749 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 387/792] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Jun 20 11:59:15 2022] PUT /compute/v2.1/os-quota-sets/f765c853e7b44b03911752ee960a172c => generated 329 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:59:16.173330 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-39f7f481-64dd-4496-a145-43a221e62f30 req-6431858e-be0e-4981-b369-f9a05fa40722 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da760340-ab64-4d7c-a4c9-3bcd606858c5", "name": "network-vif-deleted", "tag": "5f3971de-6416-4e5b-9307-3da2ee368027"}, {"server_uuid": "adee1d54-6e18-4a4e-96ac-48a6fc56345d", "name": "network-vif-deleted", "tag": "194f5e91-83a7-4654-843b-cd734d1661fd"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:59:16.198614 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-39f7f481-64dd-4496-a145-43a221e62f30 req-6431858e-be0e-4981-b369-f9a05fa40722 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:16.199250 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-39f7f481-64dd-4496-a145-43a221e62f30 req-6431858e-be0e-4981-b369-f9a05fa40722 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:16.227556 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-39f7f481-64dd-4496-a145-43a221e62f30 req-6431858e-be0e-4981-b369-f9a05fa40722 service nova] Creating event network-vif-deleted:5f3971de-6416-4e5b-9307-3da2ee368027 for instance da760340-ab64-4d7c-a4c9-3bcd606858c5 on n-h1-master-1 Jun 20 11:59:16.228564 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-39f7f481-64dd-4496-a145-43a221e62f30 req-6431858e-be0e-4981-b369-f9a05fa40722 service nova] Creating event network-vif-deleted:194f5e91-83a7-4654-843b-cd734d1661fd for instance adee1d54-6e18-4a4e-96ac-48a6fc56345d on n-h1-master-1 Jun 20 11:59:16.244842 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-39f7f481-64dd-4496-a145-43a221e62f30 req-6431858e-be0e-4981-b369-f9a05fa40722 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.078491 Jun 20 11:59:16.246919 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 388/793] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:59:16.259586 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dc49b9a1-7cf9-4277-97d3-63ffd545b110 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:16.260393 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dc49b9a1-7cf9-4277-97d3-63ffd545b110 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: df847276-3f6d-4fbf-bd7c-defd0d1e633c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:16.269417 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc49b9a1-7cf9-4277-97d3-63ffd545b110 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:16.271308 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc49b9a1-7cf9-4277-97d3-63ffd545b110 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:16.274159 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc49b9a1-7cf9-4277-97d3-63ffd545b110 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:16.274733 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc49b9a1-7cf9-4277-97d3-63ffd545b110 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:16.997260 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dc49b9a1-7cf9-4277-97d3-63ffd545b110 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:17.007002 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dc49b9a1-7cf9-4277-97d3-63ffd545b110 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/df847276-3f6d-4fbf-bd7c-defd0d1e633c" status: 200 len: 1316 microversion: 2.1 time: 0.757718 Jun 20 11:59:17.019856 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 389/794] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:16 2022] GET /compute/v2.1/servers/df847276-3f6d-4fbf-bd7c-defd0d1e633c => generated 1316 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:17.025400 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-84778b34-761d-4c71-b7ea-484dd0b1c961 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Action: 'create', calling method: .version_select at 0x7f6073d97e50>, body: {"keypair": {"name": "tempest-keypair-2096760270", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImQ6VN0BgfRwNjJDF0PjtQ0cQ9tLgbCZl3QJFndfeo5KMNk+du22PwusxV+m+2do9GbKdfis9EsNYuxAnPcXSsO+hsrW1J69DPwEkWd5Q7KMXMFfeS+krl4geBBKP9hiA=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:59:17.083332 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-84778b34-761d-4c71-b7ea-484dd0b1c961 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Getting quotas for project 7fdba36a70464a8e816944a7f29e47cf. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:59:17.094273 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-84778b34-761d-4c71-b7ea-484dd0b1c961 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Getting quotas for user b429a092ac04479eb8644bc82972234e and project 7fdba36a70464a8e816944a7f29e47cf. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:59:17.162726 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-84778b34-761d-4c71-b7ea-484dd0b1c961 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.141119 Jun 20 11:59:17.167089 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 390/795] 10.222.0.27 () {62 vars in 1199 bytes} [Mon Jun 20 11:59:17 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 146 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 20 11:59:17.177276 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-11b2de1c-0b64-4d00-8f9f-7a21a920e73b tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] Action: 'update', calling method: .version_select at 0x7f6073ab6e50>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:59:17.323997 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11b2de1c-0b64-4d00-8f9f-7a21a920e73b tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:17.330654 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11b2de1c-0b64-4d00-8f9f-7a21a920e73b tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:17.332030 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11b2de1c-0b64-4d00-8f9f-7a21a920e73b tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:17.332862 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11b2de1c-0b64-4d00-8f9f-7a21a920e73b tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:17.678890 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bcbcca41-4be6-4618-97d4-94196963dcef tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "DELETE /compute/v2.1/images/dc3eda0e-770b-433b-861a-25a8d5c351a7" status: 204 len: 0 microversion: 2.1 time: 1.651270 Jun 20 11:59:17.681094 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 406/796] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:16 2022] DELETE /compute/v2.1/images/dc3eda0e-770b-433b-861a-25a8d5c351a7 => generated 0 bytes in 1653 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:59:17.686528 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2ae0eda7-1fcb-495f-86d2-d58a3fce6ef1 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:17.687815 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2ae0eda7-1fcb-495f-86d2-d58a3fce6ef1 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: 042df052-0ba8-4734-803c-c168858021f3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:17.716168 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2ae0eda7-1fcb-495f-86d2-d58a3fce6ef1 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:17.735037 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2ae0eda7-1fcb-495f-86d2-d58a3fce6ef1 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:17.738738 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2ae0eda7-1fcb-495f-86d2-d58a3fce6ef1 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:17.743422 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2ae0eda7-1fcb-495f-86d2-d58a3fce6ef1 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:18.191561 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:INSERT=22,nova_api:SELECT=64,nova_api:UPDATE=14 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:59:18.196453 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-11b2de1c-0b64-4d00-8f9f-7a21a920e73b tempest-QuotasAdminTestJSON-579937431 tempest-QuotasAdminTestJSON-579937431-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/f765c853e7b44b03911752ee960a172c" status: 200 len: 329 microversion: 2.1 time: 1.028447 Jun 20 11:59:18.199344 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 391/797] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Jun 20 11:59:17 2022] PUT /compute/v2.1/os-quota-sets/f765c853e7b44b03911752ee960a172c => generated 329 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:59:18.210361 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-22294b61-6e68-402c-a45f-30986ef02053 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '.version_select at 0x7f6073ebe4c0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:18.282398 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-22294b61-6e68-402c-a45f-30986ef02053 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] HTTP exception thrown: Image not found. Jun 20 11:59:18.324320 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-22294b61-6e68-402c-a45f-30986ef02053 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Request method failure captured: Jun 20 11:59:18.324320 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/images/dc3eda0e-770b-433b-861a-25a8d5c351a7 HTTP/1.1 Jun 20 11:59:18.324320 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:59:18.324320 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:59:18.324320 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:59:18.324320 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 11:59:18.324320 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:59:18.324320 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:59:18.324320 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:59:18.324320 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:59:18.324320 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGDXcoKLNnHk5Vd41xldZubTKAqVDvS1k_2LbhmvUD-6WypmR1ISt9eElY5yAacPbdpKNt2MkSTDbx6BooHUcU0GDvHVyyc3t-jzMKy0stovmf5GQMf0x9V3pGqV-V25xV1nyzNlRm1q-22x0oehPhdxFTyFC5pZoQrxEE9Wsq1Bl9Y Jun 20 11:59:18.324320 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:59:18.324320 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:59:18.324320 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:59:18.324320 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:59:18.324320 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:59:18.324320 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:59:18.324320 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 3842c54af1c84c5ead0c5cf6530df872 Jun 20 11:59:18.324320 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ImagesOneServerTestJSON-498983894 Jun 20 11:59:18.324320 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 11:59:18.324320 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 11:59:18.325786 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3842c54af1c84c5ead0c5cf6530df872"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3842c54af1c84c5ead0c5cf6530df872"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3842c54af1c84c5ead0c5cf6530df872"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3842c54af1c84c5ead0c5cf6530df872"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:59:18.325786 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ImagesOneServerTestJSON-498983894 Jun 20 11:59:18.325786 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 3842c54af1c84c5ead0c5cf6530df872 Jun 20 11:59:18.325786 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-498983894 Jun 20 11:59:18.325786 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ImagesOneServerTestJSON-498983894-project Jun 20 11:59:18.325786 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:59:18.325786 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:59:18.325786 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 04f4477b25804205a497458b38d66883 Jun 20 11:59:18.325786 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ImagesOneServerTestJSON-498983894-project Jun 20 11:59:18.325786 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 11:59:18.325786 n-d-master-1 devstack@n-api.service[119127]: exception: Image not found. Jun 20 11:59:18.325786 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'dc3eda0e-770b-433b-861a-25a8d5c351a7'} Jun 20 11:59:18.325786 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:59:18.325786 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:59:18.326697 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 20 11:59:18.326697 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 20 11:59:18.326697 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 20 11:59:18.326697 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 20 11:59:18.326697 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 20 11:59:18.326697 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 20 11:59:18.326697 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 20 11:59:18.326697 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 20 11:59:18.326697 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 20 11:59:18.326697 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 20 11:59:18.326697 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 20 11:59:18.326697 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 20 11:59:18.326697 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 20 11:59:18.326697 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 20 11:59:18.326697 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 20 11:59:18.326697 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 20 11:59:18.326697 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID dc3eda0e-770b-433b-861a-25a8d5c351a7 Jun 20 11:59:18.326697 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:59:18.328022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:59:18.328022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:59:18.328022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:59:18.328022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jun 20 11:59:18.328022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jun 20 11:59:18.328022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 20 11:59:18.328022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 20 11:59:18.328022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 20 11:59:18.328022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 20 11:59:18.328022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 20 11:59:18.328022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 20 11:59:18.328022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 20 11:59:18.328022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 20 11:59:18.328022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 20 11:59:18.328022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 20 11:59:18.328022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 20 11:59:18.328022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 20 11:59:18.328022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 20 11:59:18.328022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 20 11:59:18.329399 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 20 11:59:18.329399 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 20 11:59:18.329399 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 20 11:59:18.329399 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 20 11:59:18.329399 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 20 11:59:18.329399 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 20 11:59:18.329399 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 20 11:59:18.329399 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 20 11:59:18.329399 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image dc3eda0e-770b-433b-861a-25a8d5c351a7 could not be found. Jun 20 11:59:18.329399 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:59:18.329399 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:59:18.329399 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:59:18.329399 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:59:18.329399 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:59:18.329399 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:59:18.329399 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:59:18.329399 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:59:18.329399 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 11:59:18.329399 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 11:59:18.330766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:59:18.330766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:59:18.330766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jun 20 11:59:18.330766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 20 11:59:18.330766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 20 11:59:18.330766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:59:18.330766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:59:18.330766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:59:18.330766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:59:18.330766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:59:18.330766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:59:18.330766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:59:18.330766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:59:18.330766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 20 11:59:18.330766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:59:18.330766 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-22294b61-6e68-402c-a45f-30986ef02053 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Returning 404 to user: Image not found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:59:18.330766 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-22294b61-6e68-402c-a45f-30986ef02053 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/images/dc3eda0e-770b-433b-861a-25a8d5c351a7" status: 404 len: 62 microversion: 2.1 time: 0.124984 Jun 20 11:59:18.331936 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 392/798] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 11:59:18 2022] GET /compute/v2.1/images/dc3eda0e-770b-433b-861a-25a8d5c351a7 => generated 62 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 11:59:18.332021 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-974733e8-ec79-4620-8fd1-d4538dc118ac tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:18.336230 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-974733e8-ec79-4620-8fd1-d4538dc118ac tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: df847276-3f6d-4fbf-bd7c-defd0d1e633c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:18.352311 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-974733e8-ec79-4620-8fd1-d4538dc118ac tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:18.354511 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-974733e8-ec79-4620-8fd1-d4538dc118ac tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:18.357172 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-974733e8-ec79-4620-8fd1-d4538dc118ac tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:18.358346 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-974733e8-ec79-4620-8fd1-d4538dc118ac tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:18.749610 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-974733e8-ec79-4620-8fd1-d4538dc118ac tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:18.760947 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-974733e8-ec79-4620-8fd1-d4538dc118ac tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/df847276-3f6d-4fbf-bd7c-defd0d1e633c" status: 200 len: 1465 microversion: 2.1 time: 0.431311 Jun 20 11:59:18.763385 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 393/799] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:18 2022] GET /compute/v2.1/servers/df847276-3f6d-4fbf-bd7c-defd0d1e633c => generated 1465 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:18.780590 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b731c1c4-e387-4bb2-b062-012ccde45bea tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-2107078571"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:59:18.785214 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b731c1c4-e387-4bb2-b062-012ccde45bea tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] [instance: a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:18.787160 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2ae0eda7-1fcb-495f-86d2-d58a3fce6ef1 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f49b57013f4675a70bac9b13e0a229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8790cc26204435aaf4071847ee00288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:18.802745 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2ae0eda7-1fcb-495f-86d2-d58a3fce6ef1 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "GET /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3" status: 200 len: 1387 microversion: 2.1 time: 1.120309 Jun 20 11:59:18.804119 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b731c1c4-e387-4bb2-b062-012ccde45bea tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:18.804879 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b731c1c4-e387-4bb2-b062-012ccde45bea tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:18.805947 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b731c1c4-e387-4bb2-b062-012ccde45bea tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:18.808855 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b731c1c4-e387-4bb2-b062-012ccde45bea tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:18.813805 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 407/800] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:17 2022] GET /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3 => generated 1387 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:18.824509 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-113e76c4-f7e1-4c8b-99cf-3b78ae14dbcd req-9b467aaa-0a6f-4dc4-b0c2-c3542f358bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0", "name": "network-vif-unplugged", "status": "completed", "tag": "736a1975-6c4b-4f19-83da-ab507fc213c8"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:59:18.849998 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-113e76c4-f7e1-4c8b-99cf-3b78ae14dbcd req-9b467aaa-0a6f-4dc4-b0c2-c3542f358bc7 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:18.851412 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-113e76c4-f7e1-4c8b-99cf-3b78ae14dbcd req-9b467aaa-0a6f-4dc4-b0c2-c3542f358bc7 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:18.904984 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-113e76c4-f7e1-4c8b-99cf-3b78ae14dbcd req-9b467aaa-0a6f-4dc4-b0c2-c3542f358bc7 service nova] Creating event network-vif-unplugged:736a1975-6c4b-4f19-83da-ab507fc213c8 for instance a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0 on n-h1-master-1 Jun 20 11:59:18.927807 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-113e76c4-f7e1-4c8b-99cf-3b78ae14dbcd req-9b467aaa-0a6f-4dc4-b0c2-c3542f358bc7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112557 Jun 20 11:59:18.933047 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 408/801] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:59:18.953445 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-12f8dc07-41de-4404-b331-07b86a06f278 tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:18.959532 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-12f8dc07-41de-4404-b331-07b86a06f278 tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] [instance: df847276-3f6d-4fbf-bd7c-defd0d1e633c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:18.978804 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-12f8dc07-41de-4404-b331-07b86a06f278 tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:18.982524 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-12f8dc07-41de-4404-b331-07b86a06f278 tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:18.985759 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-12f8dc07-41de-4404-b331-07b86a06f278 tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:18.986369 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-12f8dc07-41de-4404-b331-07b86a06f278 tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:19.573317 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b731c1c4-e387-4bb2-b062-012ccde45bea tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "POST /compute/v2.1/servers/a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0/action" status: 202 len: 0 microversion: 2.1 time: 0.805597 Jun 20 11:59:19.574260 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 394/802] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 11:59:18 2022] POST /compute/v2.1/servers/a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0/action => generated 0 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 20 11:59:19.600752 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d42d4e85-cea7-4b8b-9dad-56c21b447c2b tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '.version_select at 0x7f6073be9310>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:19.712543 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d42d4e85-cea7-4b8b-9dad-56c21b447c2b tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/images/3600a08c-de7d-4769-906e-f9294057cb1a" status: 200 len: 1427 microversion: 2.1 time: 0.131589 Jun 20 11:59:19.724873 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 395/803] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 11:59:19 2022] GET /compute/v2.1/images/3600a08c-de7d-4769-906e-f9294057cb1a => generated 1427 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:19.809757 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-12f8dc07-41de-4404-b331-07b86a06f278 tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/df847276-3f6d-4fbf-bd7c-defd0d1e633c" status: 200 len: 1616 microversion: 2.1 time: 0.875133 Jun 20 11:59:19.815486 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 409/804] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:18 2022] GET /compute/v2.1/servers/df847276-3f6d-4fbf-bd7c-defd0d1e633c => generated 1616 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:19.834288 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d12d86e3-3932-4f69-bfc2-7bee073bc868 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:19.835346 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d12d86e3-3932-4f69-bfc2-7bee073bc868 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: 042df052-0ba8-4734-803c-c168858021f3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:19.856853 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d12d86e3-3932-4f69-bfc2-7bee073bc868 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:19.857778 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d12d86e3-3932-4f69-bfc2-7bee073bc868 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:19.858947 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d12d86e3-3932-4f69-bfc2-7bee073bc868 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:19.860871 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d12d86e3-3932-4f69-bfc2-7bee073bc868 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:20.138024 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d657cae5-a611-449c-8baf-d984a46e18e1 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2123548123", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "c5afa776-6f61-4b7a-b586-c5047b5fbe5e"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:59:20.249996 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-d657cae5-a611-449c-8baf-d984a46e18e1 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] validate_networks() for None {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:59:20.456563 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d12d86e3-3932-4f69-bfc2-7bee073bc868 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f49b57013f4675a70bac9b13e0a229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8790cc26204435aaf4071847ee00288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:20.481997 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d12d86e3-3932-4f69-bfc2-7bee073bc868 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "GET /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3" status: 200 len: 1387 microversion: 2.1 time: 0.656004 Jun 20 11:59:20.499590 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 396/805] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:19 2022] GET /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3 => generated 1387 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:20.986636 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-d657cae5-a611-449c-8baf-d984a46e18e1 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:59:20.987116 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-d657cae5-a611-449c-8baf-d984a46e18e1 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:59:20.987613 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-d657cae5-a611-449c-8baf-d984a46e18e1 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:59:20.988971 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-d657cae5-a611-449c-8baf-d984a46e18e1 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:59:20.989630 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-d657cae5-a611-449c-8baf-d984a46e18e1 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:59:21.012018 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d657cae5-a611-449c-8baf-d984a46e18e1 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:21.013536 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d657cae5-a611-449c-8baf-d984a46e18e1 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:21.016864 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d657cae5-a611-449c-8baf-d984a46e18e1 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:21.017564 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d657cae5-a611-449c-8baf-d984a46e18e1 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:21.065868 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-d657cae5-a611-449c-8baf-d984a46e18e1 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Getting quotas for project a6150795e7424cca91c71531840d88be. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:59:21.074936 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-d657cae5-a611-449c-8baf-d984a46e18e1 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Getting quotas for user 1297c1b206f845bcaf936313fd7eed9b and project a6150795e7424cca91c71531840d88be. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:59:21.105225 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d657cae5-a611-449c-8baf-d984a46e18e1 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:59:21.107621 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d657cae5-a611-449c-8baf-d984a46e18e1 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 72126702-46a5-4d4c-a6ae-430f43d8fdfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:59:21.203556 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d657cae5-a611-449c-8baf-d984a46e18e1 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.071536 Jun 20 11:59:21.204951 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 410/806] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:59:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 11:59:21.211187 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b2e1cfcb-6556-4ae1-9969-a61d7fc98835 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '.version_select at 0x7f6073901820>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:21.272918 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b2e1cfcb-6556-4ae1-9969-a61d7fc98835 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/images/3600a08c-de7d-4769-906e-f9294057cb1a" status: 200 len: 1427 microversion: 2.1 time: 0.066687 Jun 20 11:59:21.273814 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 411/807] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 11:59:21 2022] GET /compute/v2.1/images/3600a08c-de7d-4769-906e-f9294057cb1a => generated 1427 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:21.280115 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e593c7e3-126e-4f07-839e-7e0ec4e16791 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:21.280985 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e593c7e3-126e-4f07-839e-7e0ec4e16791 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 72126702-46a5-4d4c-a6ae-430f43d8fdfb] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:21.427872 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-62b1780b-505d-4fc9-856f-c8240572a64b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Action: 'create', calling method: .version_select at 0x7f6073be9430>, body: {"keypair": {"name": "tempest-keypair-1101819572", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9UYVSuaJtVxGQcnubZQZlY7/YkaT4SbwdWnqye9qiO0PO7QvNzu7qv9Gkv2jdWOJAiCM5txOrSgjG2cqGGfuaDURrWdVPcFqKZ2wiFF0ZcqBpoQ9WWXZ0F1pPH0/UeNg=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:59:21.476105 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e593c7e3-126e-4f07-839e-7e0ec4e16791 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:21.485367 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e593c7e3-126e-4f07-839e-7e0ec4e16791 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/72126702-46a5-4d4c-a6ae-430f43d8fdfb" status: 200 len: 1217 microversion: 2.1 time: 0.209940 Jun 20 11:59:21.486647 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 412/808] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:21 2022] GET /compute/v2.1/servers/72126702-46a5-4d4c-a6ae-430f43d8fdfb => generated 1217 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:21.490988 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-62b1780b-505d-4fc9-856f-c8240572a64b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Getting quotas for project ada715b6fd664c06b9ffcdff7f4ecb12. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:59:21.507480 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8f80b7b7-5ae7-401c-ac86-a8f067d8a4bf tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:21.507912 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-62b1780b-505d-4fc9-856f-c8240572a64b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Getting quotas for user 0f0ad0b87eae43f6b7f6ee8fc60cac9d and project ada715b6fd664c06b9ffcdff7f4ecb12. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:59:21.508787 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8f80b7b7-5ae7-401c-ac86-a8f067d8a4bf tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: 042df052-0ba8-4734-803c-c168858021f3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:21.520127 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8f80b7b7-5ae7-401c-ac86-a8f067d8a4bf tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:21.520868 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8f80b7b7-5ae7-401c-ac86-a8f067d8a4bf tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:21.521841 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8f80b7b7-5ae7-401c-ac86-a8f067d8a4bf tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:21.522454 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8f80b7b7-5ae7-401c-ac86-a8f067d8a4bf tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:21.557298 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-62b1780b-505d-4fc9-856f-c8240572a64b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.862298 Jun 20 11:59:21.558412 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 397/809] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 11:59:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 11:59:22.142653 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cf681c6a-4f87-4432-8299-2e81a571f976 tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] Action: 'create', calling method: .version_select at 0x7f6073b2bf70>, body: {"keypair": {"name": "tempest-keypair-1660063325", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMu6MUMIVa350Pl6GFIfZSE16gB1IU9hYC16YsegXnrqqgcJU+XpxEDIcnd2N57NrRiHTeA60aKAOu72gldn9TXzPYJAgQUW3MP+dAWtafrhcRSRSC4VWnHJvvnt/r9F0w=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:59:22.166512 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-cf681c6a-4f87-4432-8299-2e81a571f976 tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] Getting quotas for project 93b17c975ba54109949d2b6b622e324b. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:59:22.194801 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-cf681c6a-4f87-4432-8299-2e81a571f976 tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] Getting quotas for user 5d3fbfa21de74c8194f6faa86d36779a and project 93b17c975ba54109949d2b6b622e324b. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:59:22.250053 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cf681c6a-4f87-4432-8299-2e81a571f976 tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.412249 Jun 20 11:59:22.255162 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 398/810] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 11:59:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 11:59:22.264702 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f33c3e51-cbba-4282-aebd-aca80e8ced6a tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] Calling method '.version_select at 0x7f6073edcdc0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:22.296055 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f33c3e51-cbba-4282-aebd-aca80e8ced6a tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-1660063325" status: 200 len: 497 microversion: 2.1 time: 0.038217 Jun 20 11:59:22.298011 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 399/811] 10.222.0.27 () {58 vars in 1217 bytes} [Mon Jun 20 11:59:22 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1660063325 => generated 497 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:59:22.320825 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b3cc4cad-4547-481e-b21a-e222e8b89003 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '.version_select at 0x7f60801b00d0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:22.348230 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8f80b7b7-5ae7-401c-ac86-a8f067d8a4bf tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f49b57013f4675a70bac9b13e0a229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8790cc26204435aaf4071847ee00288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:22.360714 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8f80b7b7-5ae7-401c-ac86-a8f067d8a4bf tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "GET /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3" status: 200 len: 1387 microversion: 2.1 time: 0.861150 Jun 20 11:59:22.364263 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 413/812] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:21 2022] GET /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3 => generated 1387 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:22.381519 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3926a13c-45a6-4729-bad0-47e8191c6b59 tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] Calling method '.version_select at 0x7f607384c700>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:22.424374 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3926a13c-45a6-4729-bad0-47e8191c6b59 tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1660063325" status: 202 len: 0 microversion: 2.1 time: 0.058827 Jun 20 11:59:22.429169 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 414/813] 10.222.0.27 () {58 vars in 1220 bytes} [Mon Jun 20 11:59:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1660063325 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:59:22.447075 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-606f9fd1-5555-4a26-85dc-cee097c8c5a0 req-f784aad5-af4c-456a-bdad-4c13980699c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "042df052-0ba8-4734-803c-c168858021f3", "tag": "462d3ed2-a733-4603-91af-98ab7f43db64"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:59:22.468976 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-606f9fd1-5555-4a26-85dc-cee097c8c5a0 req-f784aad5-af4c-456a-bdad-4c13980699c9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:22.470372 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-606f9fd1-5555-4a26-85dc-cee097c8c5a0 req-f784aad5-af4c-456a-bdad-4c13980699c9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:22.482222 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b3cc4cad-4547-481e-b21a-e222e8b89003 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/images/3600a08c-de7d-4769-906e-f9294057cb1a" status: 200 len: 1427 microversion: 2.1 time: 0.182634 Jun 20 11:59:22.490973 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 400/814] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 11:59:22 2022] GET /compute/v2.1/images/3600a08c-de7d-4769-906e-f9294057cb1a => generated 1427 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:22.499768 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-606f9fd1-5555-4a26-85dc-cee097c8c5a0 req-f784aad5-af4c-456a-bdad-4c13980699c9 service nova] Creating event network-changed:462d3ed2-a733-4603-91af-98ab7f43db64 for instance 042df052-0ba8-4734-803c-c168858021f3 on n-h1-master-1 Jun 20 11:59:22.511563 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-606f9fd1-5555-4a26-85dc-cee097c8c5a0 req-f784aad5-af4c-456a-bdad-4c13980699c9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075834 Jun 20 11:59:22.516382 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 415/815] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:59:22.540667 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d6035caa-0b8e-4458-86b2-5fed51c7a4cc tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:22.541800 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d6035caa-0b8e-4458-86b2-5fed51c7a4cc tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 72126702-46a5-4d4c-a6ae-430f43d8fdfb] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:22.548932 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6035caa-0b8e-4458-86b2-5fed51c7a4cc tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:22.550179 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6035caa-0b8e-4458-86b2-5fed51c7a4cc tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:22.551146 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6035caa-0b8e-4458-86b2-5fed51c7a4cc tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:22.551732 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6035caa-0b8e-4458-86b2-5fed51c7a4cc tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:22.563435 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ae556cf9-6a60-48e9-b680-2568f9a9c631 tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] Action: 'create', calling method: .version_select at 0x7f6073eea5e0>, body: {"keypair": {"name": "tempest-keypair-493883228", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAJDKW7oOyWYABXwpyqufrid7Y3wJKBn0kwfa2ZzYDgCv50fcV+j4Ql1xt1a1qdtnKxk/n5Ekrr73vzACRR5lS6D/5HwfCfqbjQkKkcj+1e3RX/pn7NKFUSfrI9IKZOUg=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:59:22.671863 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-ae556cf9-6a60-48e9-b680-2568f9a9c631 tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] Getting quotas for project 93b17c975ba54109949d2b6b622e324b. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:59:22.693111 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d6035caa-0b8e-4458-86b2-5fed51c7a4cc tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:22.697080 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-ae556cf9-6a60-48e9-b680-2568f9a9c631 tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] Getting quotas for user 5d3fbfa21de74c8194f6faa86d36779a and project 93b17c975ba54109949d2b6b622e324b. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:59:22.706179 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d6035caa-0b8e-4458-86b2-5fed51c7a4cc tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/72126702-46a5-4d4c-a6ae-430f43d8fdfb" status: 200 len: 1269 microversion: 2.1 time: 0.185428 Jun 20 11:59:22.710332 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 416/816] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:22 2022] GET /compute/v2.1/servers/72126702-46a5-4d4c-a6ae-430f43d8fdfb => generated 1269 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:22.791820 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ae556cf9-6a60-48e9-b680-2568f9a9c631 tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.287514 Jun 20 11:59:22.801635 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 401/817] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 11:59:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:59:22.805213 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-466d4389-661c-419f-b2c5-eb74cc1aaf65 tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] Calling method '.version_select at 0x7f6073b08670>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:22.845038 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-466d4389-661c-419f-b2c5-eb74cc1aaf65 tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-493883228" status: 202 len: 0 microversion: 2.1 time: 0.043774 Jun 20 11:59:22.849891 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 417/818] 10.222.0.27 () {58 vars in 1217 bytes} [Mon Jun 20 11:59:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-493883228 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:59:22.862176 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1cc6b982-e79a-4fdc-af61-6aed9144c361 tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] Action: 'create', calling method: .version_select at 0x7f6073be9310>, body: {"keypair": {"name": "tempest-keypair-428595989", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:59:22.912240 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-1cc6b982-e79a-4fdc-af61-6aed9144c361 tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] Getting quotas for project 93b17c975ba54109949d2b6b622e324b. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:59:22.927741 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-1cc6b982-e79a-4fdc-af61-6aed9144c361 tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] Getting quotas for user 5d3fbfa21de74c8194f6faa86d36779a and project 93b17c975ba54109949d2b6b622e324b. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:59:23.069782 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1cc6b982-e79a-4fdc-af61-6aed9144c361 tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.206725 Jun 20 11:59:23.074576 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 402/819] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 11:59:22 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:59:23.083903 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-76f0659a-14b4-421b-8b28-ea5aaa007dea tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] Calling method '.version_select at 0x7f6073a22940>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:23.146446 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-76f0659a-14b4-421b-8b28-ea5aaa007dea tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-428595989" status: 202 len: 0 microversion: 2.1 time: 0.066544 Jun 20 11:59:23.157545 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 418/820] 10.222.0.27 () {58 vars in 1217 bytes} [Mon Jun 20 11:59:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-428595989 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:59:23.161642 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a229b65b-87e4-4ca6-a815-baa57a9093d2 tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] Action: 'create', calling method: .version_select at 0x7f6073c6d940>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1348442519", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtZqzCxb9qjPxgIS8OqcsEVsfG3IWazRdAUcKDdIP+7evCotIwpEaOrymQE54AjU1njsZwEDi8bdDkCwO4DXu+J6sz3hPQ9mB/gPhjHRIm4fJ7TafxPEbEBOcO4r+4rQg=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:59:23.200162 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-a229b65b-87e4-4ca6-a815-baa57a9093d2 tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] Getting quotas for project 93b17c975ba54109949d2b6b622e324b. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:59:23.225326 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-a229b65b-87e4-4ca6-a815-baa57a9093d2 tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] Getting quotas for user 5d3fbfa21de74c8194f6faa86d36779a and project 93b17c975ba54109949d2b6b622e324b. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:59:23.264059 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:59:23.315897 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a229b65b-87e4-4ca6-a815-baa57a9093d2 tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.159706 Jun 20 11:59:23.319606 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 403/821] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 11:59:23 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:59:23.339384 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-67114acb-a978-44b6-ad3d-1c2fdff3f4e5 tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] Action: 'create', calling method: .version_select at 0x7f6073f44c10>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1794973273", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzxxqQ/82EelVJNE/uxQjjbz7Ee/1N2de3Q/mwHKUlkv180mblIqgatWbreatuDBEB14+b+TFB7M51a1ViGq31zuwWaqrNd0g+EskMOYgp0z1cJab80tZah4GvME6vyXg=="}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:59:23.382765 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e9886669-a382-409a-81c6-257cdcf79ec5 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:23.383965 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e9886669-a382-409a-81c6-257cdcf79ec5 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: 042df052-0ba8-4734-803c-c168858021f3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:23.405756 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e9886669-a382-409a-81c6-257cdcf79ec5 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:23.414110 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e9886669-a382-409a-81c6-257cdcf79ec5 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:23.417075 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-67114acb-a978-44b6-ad3d-1c2fdff3f4e5 tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] Getting quotas for project 93b17c975ba54109949d2b6b622e324b. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:59:23.417596 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e9886669-a382-409a-81c6-257cdcf79ec5 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:23.422121 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e9886669-a382-409a-81c6-257cdcf79ec5 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:23.443568 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-67114acb-a978-44b6-ad3d-1c2fdff3f4e5 tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] Getting quotas for user 5d3fbfa21de74c8194f6faa86d36779a and project 93b17c975ba54109949d2b6b622e324b. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:59:23.577492 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-67114acb-a978-44b6-ad3d-1c2fdff3f4e5 tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.249470 Jun 20 11:59:23.578129 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 419/822] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 11:59:23 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:59:23.601423 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-80cb57fb-98f9-4c1f-b2c9-4dbced59172f tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '.version_select at 0x7f608004b8b0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:23.785659 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e9886669-a382-409a-81c6-257cdcf79ec5 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f49b57013f4675a70bac9b13e0a229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8790cc26204435aaf4071847ee00288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:23.811590 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e9886669-a382-409a-81c6-257cdcf79ec5 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "GET /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3" status: 200 len: 1387 microversion: 2.1 time: 0.430598 Jun 20 11:59:23.815669 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 404/823] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:23 2022] GET /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3 => generated 1387 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:23.826630 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4c49d1de-1521-437d-bd41-6d5a53083ec1 tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] Action: 'create', calling method: .version_select at 0x7f6073eea4c0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-2127538788", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgY5NSuVj1mO0bjStqeV6J3k0LvFTB5K4+G3UaCyNaUCf4gkkpO2HlJxFfb505ENSRRLgjqMKoNdmCLxSnRmKh9zfutmh4KaZzReYjKClbKaIksR27/0RsJEZreSupMcQ=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:59:23.876333 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-4c49d1de-1521-437d-bd41-6d5a53083ec1 tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] Getting quotas for project 93b17c975ba54109949d2b6b622e324b. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:59:23.896712 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-4c49d1de-1521-437d-bd41-6d5a53083ec1 tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] Getting quotas for user 5d3fbfa21de74c8194f6faa86d36779a and project 93b17c975ba54109949d2b6b622e324b. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:59:23.992098 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4c49d1de-1521-437d-bd41-6d5a53083ec1 tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.173812 Jun 20 11:59:24.000994 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 405/824] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 11:59:23 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:59:24.027295 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-eb54b8f5-28bd-4316-a298-d50af061f820 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:24.031052 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-eb54b8f5-28bd-4316-a298-d50af061f820 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 72126702-46a5-4d4c-a6ae-430f43d8fdfb] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:24.050038 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb54b8f5-28bd-4316-a298-d50af061f820 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:24.057849 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb54b8f5-28bd-4316-a298-d50af061f820 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:24.059544 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb54b8f5-28bd-4316-a298-d50af061f820 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:24.066070 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb54b8f5-28bd-4316-a298-d50af061f820 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:24.263819 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-eb54b8f5-28bd-4316-a298-d50af061f820 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:24.272096 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-eb54b8f5-28bd-4316-a298-d50af061f820 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/72126702-46a5-4d4c-a6ae-430f43d8fdfb" status: 200 len: 1275 microversion: 2.1 time: 0.267108 Jun 20 11:59:24.275467 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 406/825] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:24 2022] GET /compute/v2.1/servers/72126702-46a5-4d4c-a6ae-430f43d8fdfb => generated 1275 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:24.296412 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-29417fc9-0dc7-4b95-83da-85d4f4bfcd1b tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] Calling method '.version_select at 0x7f6073be9a60>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:24.303920 n-d-master-1 devstack@n-api.service[119127]: WARNING oslo_db.sqlalchemy.utils [None req-29417fc9-0dc7-4b95-83da-85d4f4bfcd1b tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] Unique keys not in sort_keys. The sorting order may be unstable. Jun 20 11:59:24.356897 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-29417fc9-0dc7-4b95-83da-85d4f4bfcd1b tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 1094 microversion: 2.1 time: 0.069487 Jun 20 11:59:24.357999 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 407/826] 10.222.0.27 () {58 vars in 1136 bytes} [Mon Jun 20 11:59:24 2022] GET /compute/v2.1/os-keypairs => generated 1094 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:24.366017 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2492d91c-c4ef-4b21-9975-8f3726811765 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-929485972", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "7c57fb93-e580-4d64-8790-597bcac7a666"}], "security_groups": [{"name": "tempest-securitygroup--1086803022"}], "key_name": "tempest-keypair-2096760270", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:59:27.352478 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:59:27.576162 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-80cb57fb-98f9-4c1f-b2c9-4dbced59172f tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/images/3600a08c-de7d-4769-906e-f9294057cb1a" status: 200 len: 1427 microversion: 2.1 time: 3.985951 Jun 20 11:59:27.576809 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 420/827] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 11:59:23 2022] GET /compute/v2.1/images/3600a08c-de7d-4769-906e-f9294057cb1a => generated 1427 bytes in 3987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:27.590676 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-132ae2cf-7dde-4cf5-8f5f-f2148896a102 tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] Calling method '.version_select at 0x7f6073d31c10>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:27.621669 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:59:27.642558 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-132ae2cf-7dde-4cf5-8f5f-f2148896a102 tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2127538788" status: 202 len: 0 microversion: 2.1 time: 0.061527 Jun 20 11:59:27.648494 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 421/828] 10.222.0.27 () {58 vars in 1277 bytes} [Mon Jun 20 11:59:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2127538788 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:59:27.659423 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a7a42907-e932-4b63-a188-80732830fdc4 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:27.660684 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a7a42907-e932-4b63-a188-80732830fdc4 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: 042df052-0ba8-4734-803c-c168858021f3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:27.691313 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a7a42907-e932-4b63-a188-80732830fdc4 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:27.693444 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a7a42907-e932-4b63-a188-80732830fdc4 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:27.696489 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a7a42907-e932-4b63-a188-80732830fdc4 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:27.697129 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a7a42907-e932-4b63-a188-80732830fdc4 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:27.698009 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-2492d91c-c4ef-4b21-9975-8f3726811765 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] validate_networks() for [('7c57fb93-e580-4d64-8790-597bcac7a666', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:59:27.769249 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:59:28.351042 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-2492d91c-c4ef-4b21-9975-8f3726811765 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:59:28.351584 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-2492d91c-c4ef-4b21-9975-8f3726811765 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:59:28.352549 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-2492d91c-c4ef-4b21-9975-8f3726811765 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:59:28.353128 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-2492d91c-c4ef-4b21-9975-8f3726811765 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:59:28.353561 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-2492d91c-c4ef-4b21-9975-8f3726811765 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:59:28.363948 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2492d91c-c4ef-4b21-9975-8f3726811765 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:28.364771 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2492d91c-c4ef-4b21-9975-8f3726811765 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:28.365755 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2492d91c-c4ef-4b21-9975-8f3726811765 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:28.366458 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2492d91c-c4ef-4b21-9975-8f3726811765 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:28.390212 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-2492d91c-c4ef-4b21-9975-8f3726811765 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Getting quotas for project 7fdba36a70464a8e816944a7f29e47cf. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:59:28.399948 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-2492d91c-c4ef-4b21-9975-8f3726811765 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Getting quotas for user b429a092ac04479eb8644bc82972234e and project 7fdba36a70464a8e816944a7f29e47cf. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:59:28.411909 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:59:28.417615 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2492d91c-c4ef-4b21-9975-8f3726811765 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:59:28.420551 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2492d91c-c4ef-4b21-9975-8f3726811765 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:59:28.498826 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2492d91c-c4ef-4b21-9975-8f3726811765 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 4.138830 Jun 20 11:59:28.500144 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 408/829] 10.222.0.27 () {62 vars in 1187 bytes} [Mon Jun 20 11:59:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 4141 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 20 11:59:28.507356 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f56a7e0d-f6d1-4b6b-b831-7a0fedbd90e3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:28.508357 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f56a7e0d-f6d1-4b6b-b831-7a0fedbd90e3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 72126702-46a5-4d4c-a6ae-430f43d8fdfb] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:28.518292 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f56a7e0d-f6d1-4b6b-b831-7a0fedbd90e3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:28.519129 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f56a7e0d-f6d1-4b6b-b831-7a0fedbd90e3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:28.520168 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f56a7e0d-f6d1-4b6b-b831-7a0fedbd90e3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:28.521599 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f56a7e0d-f6d1-4b6b-b831-7a0fedbd90e3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:28.640954 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a7a42907-e932-4b63-a188-80732830fdc4 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f49b57013f4675a70bac9b13e0a229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8790cc26204435aaf4071847ee00288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:28.650510 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a7a42907-e932-4b63-a188-80732830fdc4 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "GET /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3" status: 200 len: 1387 microversion: 2.1 time: 1.000321 Jun 20 11:59:28.657131 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 422/830] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:27 2022] GET /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3 => generated 1387 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:28.664389 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-84fa7a60-40d0-4b0b-8425-b4bde2d70e8a req-c4ea15b0-ab73-4110-b3e3-6677fc94bb2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0", "name": "network-vif-plugged", "status": "completed", "tag": "736a1975-6c4b-4f19-83da-ab507fc213c8"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:59:28.679466 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-84fa7a60-40d0-4b0b-8425-b4bde2d70e8a req-c4ea15b0-ab73-4110-b3e3-6677fc94bb2a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:28.680246 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-84fa7a60-40d0-4b0b-8425-b4bde2d70e8a req-c4ea15b0-ab73-4110-b3e3-6677fc94bb2a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:28.704639 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-84fa7a60-40d0-4b0b-8425-b4bde2d70e8a req-c4ea15b0-ab73-4110-b3e3-6677fc94bb2a service nova] Creating event network-vif-plugged:736a1975-6c4b-4f19-83da-ab507fc213c8 for instance a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0 on n-h1-master-1 Jun 20 11:59:28.736105 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-84fa7a60-40d0-4b0b-8425-b4bde2d70e8a req-c4ea15b0-ab73-4110-b3e3-6677fc94bb2a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074274 Jun 20 11:59:28.737985 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 423/831] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:59:28.751289 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-88d78ca4-3a1a-4d89-a251-b6a0e9ee6fc5 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1832284969", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "db7d8a61-8928-4d10-aee5-665749b91fa9"}], "security_groups": [{"name": "tempest-securitygroup--999168787"}], "key_name": "tempest-keypair-1101819572", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:59:29.282585 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-88d78ca4-3a1a-4d89-a251-b6a0e9ee6fc5 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] validate_networks() for [('db7d8a61-8928-4d10-aee5-665749b91fa9', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:59:29.801095 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f56a7e0d-f6d1-4b6b-b831-7a0fedbd90e3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:29.819945 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f56a7e0d-f6d1-4b6b-b831-7a0fedbd90e3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/72126702-46a5-4d4c-a6ae-430f43d8fdfb" status: 200 len: 1317 microversion: 2.1 time: 1.317118 Jun 20 11:59:29.822357 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 409/832] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:28 2022] GET /compute/v2.1/servers/72126702-46a5-4d4c-a6ae-430f43d8fdfb => generated 1317 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:30.306577 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-88d78ca4-3a1a-4d89-a251-b6a0e9ee6fc5 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:59:30.307149 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-88d78ca4-3a1a-4d89-a251-b6a0e9ee6fc5 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:59:30.307440 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-88d78ca4-3a1a-4d89-a251-b6a0e9ee6fc5 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:59:30.308995 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-88d78ca4-3a1a-4d89-a251-b6a0e9ee6fc5 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:59:30.309575 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-88d78ca4-3a1a-4d89-a251-b6a0e9ee6fc5 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:59:30.322363 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88d78ca4-3a1a-4d89-a251-b6a0e9ee6fc5 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:30.323018 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88d78ca4-3a1a-4d89-a251-b6a0e9ee6fc5 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:30.324221 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88d78ca4-3a1a-4d89-a251-b6a0e9ee6fc5 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:30.324814 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88d78ca4-3a1a-4d89-a251-b6a0e9ee6fc5 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:30.345652 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-88d78ca4-3a1a-4d89-a251-b6a0e9ee6fc5 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Getting quotas for project ada715b6fd664c06b9ffcdff7f4ecb12. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:59:30.353695 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-88d78ca4-3a1a-4d89-a251-b6a0e9ee6fc5 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Getting quotas for user 0f0ad0b87eae43f6b7f6ee8fc60cac9d and project ada715b6fd664c06b9ffcdff7f4ecb12. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:59:30.377684 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-88d78ca4-3a1a-4d89-a251-b6a0e9ee6fc5 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:59:30.387352 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-88d78ca4-3a1a-4d89-a251-b6a0e9ee6fc5 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 3c12363c-ee46-445d-af50-77a1f0518a17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:59:30.403994 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d9c45b28-790b-4239-9f0f-d121bbed3c92 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Action: 'create', calling method: .version_select at 0x7f6073e984c0>, body: {"keypair": {"name": "tempest-keypair-1323207248", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAT+1Kf1Em1+LJAKXoVC08Zcrrcc49vsvclVs+G3zcJGgmHuV1g1ACdsfWqQZ0T1YW/V+2oX7MA4iSGAX2U85z9ZuOywPG6+UsZTWPJO3L23Z7pFb8/Ickaazo71njtigA=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:59:30.426011 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-d9c45b28-790b-4239-9f0f-d121bbed3c92 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Getting quotas for project 0f35cecfcbb948c6b60eef6140f87a3b. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:59:30.443795 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-d9c45b28-790b-4239-9f0f-d121bbed3c92 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Getting quotas for user a53f4e0e140c4a839d99b56ee9ffacc5 and project 0f35cecfcbb948c6b60eef6140f87a3b. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:59:30.490703 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d9c45b28-790b-4239-9f0f-d121bbed3c92 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.665054 Jun 20 11:59:30.492858 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 410/833] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 11:59:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:59:30.499813 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f4e1f603-c097-4416-8be4-663267df90e2 tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] Calling method '.version_select at 0x7f608299e790>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:30.542168 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f4e1f603-c097-4416-8be4-663267df90e2 tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1794973273" status: 202 len: 0 microversion: 2.1 time: 0.047136 Jun 20 11:59:30.546047 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 411/834] 10.222.0.27 () {58 vars in 1277 bytes} [Mon Jun 20 11:59:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1794973273 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:59:30.555844 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-88d78ca4-3a1a-4d89-a251-b6a0e9ee6fc5 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.816084 Jun 20 11:59:30.562724 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 424/835] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:59:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 1824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 11:59:30.567340 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-503f3614-624c-438c-a4c5-e791457d0238 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:30.572460 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-503f3614-624c-438c-a4c5-e791457d0238 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:30.573832 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-284efec8-8ecb-4813-b5ca-0990136fb8a7 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '.version_select at 0x7f6080351310>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:30.599894 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-503f3614-624c-438c-a4c5-e791457d0238 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:30.612189 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-503f3614-624c-438c-a4c5-e791457d0238 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:30.617839 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-503f3614-624c-438c-a4c5-e791457d0238 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:30.618795 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-503f3614-624c-438c-a4c5-e791457d0238 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:30.714715 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-284efec8-8ecb-4813-b5ca-0990136fb8a7 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/images/3600a08c-de7d-4769-906e-f9294057cb1a" status: 200 len: 1427 microversion: 2.1 time: 0.144917 Jun 20 11:59:30.721734 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 425/836] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 11:59:30 2022] GET /compute/v2.1/images/3600a08c-de7d-4769-906e-f9294057cb1a => generated 1427 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:30.741186 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-797ee4d2-f17c-40e4-bbc1-03752b6ab7b2 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:30.743275 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-797ee4d2-f17c-40e4-bbc1-03752b6ab7b2 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: 042df052-0ba8-4734-803c-c168858021f3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:30.770262 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-797ee4d2-f17c-40e4-bbc1-03752b6ab7b2 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:30.771148 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-797ee4d2-f17c-40e4-bbc1-03752b6ab7b2 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:30.772720 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-797ee4d2-f17c-40e4-bbc1-03752b6ab7b2 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:30.773324 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-797ee4d2-f17c-40e4-bbc1-03752b6ab7b2 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:30.974460 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-503f3614-624c-438c-a4c5-e791457d0238 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:30.988285 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-503f3614-624c-438c-a4c5-e791457d0238 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:30.993620 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-503f3614-624c-438c-a4c5-e791457d0238 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:30.996389 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-503f3614-624c-438c-a4c5-e791457d0238 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1355 microversion: 2.25 time: 0.447314 Jun 20 11:59:30.999218 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 412/837] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:59:30 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1355 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:59:31.035126 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-af9745c1-cc29-4df5-a5a3-5f67f51a0fe1 req-f70393dc-2a22-42be-88e4-1f062228c152 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72126702-46a5-4d4c-a6ae-430f43d8fdfb", "tag": "b53ee3ac-d73a-454f-90f9-5f3524df3e0f"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:59:31.053868 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-af9745c1-cc29-4df5-a5a3-5f67f51a0fe1 req-f70393dc-2a22-42be-88e4-1f062228c152 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:31.062476 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-af9745c1-cc29-4df5-a5a3-5f67f51a0fe1 req-f70393dc-2a22-42be-88e4-1f062228c152 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:31.083155 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-af9745c1-cc29-4df5-a5a3-5f67f51a0fe1 req-f70393dc-2a22-42be-88e4-1f062228c152 service nova] Creating event network-changed:b53ee3ac-d73a-454f-90f9-5f3524df3e0f for instance 72126702-46a5-4d4c-a6ae-430f43d8fdfb on n-h1-master-1 Jun 20 11:59:31.101227 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-af9745c1-cc29-4df5-a5a3-5f67f51a0fe1 req-f70393dc-2a22-42be-88e4-1f062228c152 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100107 Jun 20 11:59:31.102333 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 413/838] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:59:31.117574 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-84f84102-a877-4650-a086-059e5c269685 tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] Calling method '.version_select at 0x7f60801b0940>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:31.168394 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-84f84102-a877-4650-a086-059e5c269685 tempest-KeyPairsV2TestJSON-1430500158 tempest-KeyPairsV2TestJSON-1430500158-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1348442519" status: 202 len: 0 microversion: 2.1 time: 0.063957 Jun 20 11:59:31.175215 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 414/839] 10.222.0.27 () {58 vars in 1277 bytes} [Mon Jun 20 11:59:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1348442519 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:59:31.184809 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4350cc54-84df-4a05-9e60-9d11d2332581 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:31.189314 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4350cc54-84df-4a05-9e60-9d11d2332581 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 3c12363c-ee46-445d-af50-77a1f0518a17] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:31.253062 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-797ee4d2-f17c-40e4-bbc1-03752b6ab7b2 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f49b57013f4675a70bac9b13e0a229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8790cc26204435aaf4071847ee00288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:31.265451 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-797ee4d2-f17c-40e4-bbc1-03752b6ab7b2 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "GET /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3" status: 200 len: 1387 microversion: 2.1 time: 0.538516 Jun 20 11:59:31.266709 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 426/840] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:30 2022] GET /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3 => generated 1387 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:31.274769 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d2ccd7b0-9339-4698-83ae-2c88109bc64c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:31.275846 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d2ccd7b0-9339-4698-83ae-2c88109bc64c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 72126702-46a5-4d4c-a6ae-430f43d8fdfb] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:31.284510 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d2ccd7b0-9339-4698-83ae-2c88109bc64c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:31.285223 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d2ccd7b0-9339-4698-83ae-2c88109bc64c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:31.287210 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d2ccd7b0-9339-4698-83ae-2c88109bc64c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:31.287839 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d2ccd7b0-9339-4698-83ae-2c88109bc64c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:31.434633 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4350cc54-84df-4a05-9e60-9d11d2332581 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ad0b87eae43f6b7f6ee8fc60cac9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada715b6fd664c06b9ffcdff7f4ecb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:31.457490 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4350cc54-84df-4a05-9e60-9d11d2332581 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17" status: 200 len: 1242 microversion: 2.1 time: 0.280487 Jun 20 11:59:31.461066 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 415/841] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:31 2022] GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17 => generated 1242 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:31.586851 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d2ccd7b0-9339-4698-83ae-2c88109bc64c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:31.598505 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d2ccd7b0-9339-4698-83ae-2c88109bc64c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/72126702-46a5-4d4c-a6ae-430f43d8fdfb" status: 200 len: 1317 microversion: 2.1 time: 0.330437 Jun 20 11:59:31.599604 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 427/842] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:31 2022] GET /compute/v2.1/servers/72126702-46a5-4d4c-a6ae-430f43d8fdfb => generated 1317 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:31.730185 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b6a70b21-26ea-40fb-acc3-8be0d387b3f7 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '.version_select at 0x7f6073ca4f70>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:31.824536 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b6a70b21-26ea-40fb-acc3-8be0d387b3f7 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/images/3600a08c-de7d-4769-906e-f9294057cb1a" status: 200 len: 1427 microversion: 2.1 time: 0.100977 Jun 20 11:59:31.831461 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 416/843] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 11:59:31 2022] GET /compute/v2.1/images/3600a08c-de7d-4769-906e-f9294057cb1a => generated 1427 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:31.953666 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-06ae0825-6f8d-4a93-911d-34d333d81725 req-4b45f241-2acc-4386-93c8-f5415252b125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "042df052-0ba8-4734-803c-c168858021f3", "name": "network-vif-plugged", "status": "completed", "tag": "462d3ed2-a733-4603-91af-98ab7f43db64"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:59:31.972505 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-06ae0825-6f8d-4a93-911d-34d333d81725 req-4b45f241-2acc-4386-93c8-f5415252b125 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:31.974208 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-06ae0825-6f8d-4a93-911d-34d333d81725 req-4b45f241-2acc-4386-93c8-f5415252b125 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:32.005605 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-06ae0825-6f8d-4a93-911d-34d333d81725 req-4b45f241-2acc-4386-93c8-f5415252b125 service nova] Creating event network-vif-plugged:462d3ed2-a733-4603-91af-98ab7f43db64 for instance 042df052-0ba8-4734-803c-c168858021f3 on n-h1-master-1 Jun 20 11:59:32.018943 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8fad7f79-9e20-4580-86f9-4caea3b3d619 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:32.020251 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8fad7f79-9e20-4580-86f9-4caea3b3d619 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:32.037744 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-06ae0825-6f8d-4a93-911d-34d333d81725 req-4b45f241-2acc-4386-93c8-f5415252b125 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090629 Jun 20 11:59:32.039297 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 428/844] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:59:32.043471 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8fad7f79-9e20-4580-86f9-4caea3b3d619 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:32.044372 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8fad7f79-9e20-4580-86f9-4caea3b3d619 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:32.046245 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8fad7f79-9e20-4580-86f9-4caea3b3d619 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:32.050867 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8fad7f79-9e20-4580-86f9-4caea3b3d619 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:32.272137 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8fad7f79-9e20-4580-86f9-4caea3b3d619 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:32.285214 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8fad7f79-9e20-4580-86f9-4caea3b3d619 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:32.289424 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8fad7f79-9e20-4580-86f9-4caea3b3d619 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:32.289787 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-05c91fdb-bc2f-47ab-94d8-6c9f63b6b18f tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:32.290794 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-05c91fdb-bc2f-47ab-94d8-6c9f63b6b18f tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: 042df052-0ba8-4734-803c-c168858021f3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:32.292375 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8fad7f79-9e20-4580-86f9-4caea3b3d619 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1343 microversion: 2.25 time: 0.277405 Jun 20 11:59:32.302892 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 417/845] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:59:32 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1343 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:59:32.308711 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05c91fdb-bc2f-47ab-94d8-6c9f63b6b18f tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:32.311528 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05c91fdb-bc2f-47ab-94d8-6c9f63b6b18f tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:32.314348 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05c91fdb-bc2f-47ab-94d8-6c9f63b6b18f tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:32.315928 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05c91fdb-bc2f-47ab-94d8-6c9f63b6b18f tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:32.487374 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d1df9c61-5d49-4512-92eb-fee43af05f6b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:32.489583 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d1df9c61-5d49-4512-92eb-fee43af05f6b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 3c12363c-ee46-445d-af50-77a1f0518a17] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:32.508419 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d1df9c61-5d49-4512-92eb-fee43af05f6b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:32.509412 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d1df9c61-5d49-4512-92eb-fee43af05f6b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:32.510393 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d1df9c61-5d49-4512-92eb-fee43af05f6b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:32.514530 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d1df9c61-5d49-4512-92eb-fee43af05f6b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:32.528702 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:59:33.080250 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-05c91fdb-bc2f-47ab-94d8-6c9f63b6b18f tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f49b57013f4675a70bac9b13e0a229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8790cc26204435aaf4071847ee00288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:33.107133 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d1df9c61-5d49-4512-92eb-fee43af05f6b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ad0b87eae43f6b7f6ee8fc60cac9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada715b6fd664c06b9ffcdff7f4ecb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:33.107661 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-05c91fdb-bc2f-47ab-94d8-6c9f63b6b18f tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "GET /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3" status: 200 len: 1387 microversion: 2.1 time: 0.827299 Jun 20 11:59:33.110486 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 429/846] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:32 2022] GET /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3 => generated 1387 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:33.126334 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d1df9c61-5d49-4512-92eb-fee43af05f6b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17" status: 200 len: 1246 microversion: 2.1 time: 0.642689 Jun 20 11:59:33.141218 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 418/847] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:32 2022] GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17 => generated 1246 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:33.146893 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2ae7acc8-4693-438e-960b-f7bb08f08fa5 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:33.147596 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2ae7acc8-4693-438e-960b-f7bb08f08fa5 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 72126702-46a5-4d4c-a6ae-430f43d8fdfb] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:33.168134 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2ae7acc8-4693-438e-960b-f7bb08f08fa5 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:33.168479 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9f0fe9c2-ae89-4558-bdec-dddce05e0bc2 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '.version_select at 0x7f60802a4e50>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:33.179858 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2ae7acc8-4693-438e-960b-f7bb08f08fa5 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:33.182318 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2ae7acc8-4693-438e-960b-f7bb08f08fa5 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:33.186627 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2ae7acc8-4693-438e-960b-f7bb08f08fa5 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:33.321979 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9f0fe9c2-ae89-4558-bdec-dddce05e0bc2 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/images/3600a08c-de7d-4769-906e-f9294057cb1a" status: 200 len: 1427 microversion: 2.1 time: 0.178265 Jun 20 11:59:33.323174 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 419/848] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 11:59:33 2022] GET /compute/v2.1/images/3600a08c-de7d-4769-906e-f9294057cb1a => generated 1427 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:33.332088 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c000f79f-ea64-4725-b9f1-8f87ea2b12d5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:33.343786 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c000f79f-ea64-4725-b9f1-8f87ea2b12d5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:33.375391 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c000f79f-ea64-4725-b9f1-8f87ea2b12d5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:33.379219 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c000f79f-ea64-4725-b9f1-8f87ea2b12d5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:33.380852 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c000f79f-ea64-4725-b9f1-8f87ea2b12d5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:33.384235 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c000f79f-ea64-4725-b9f1-8f87ea2b12d5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:33.577719 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2ae7acc8-4693-438e-960b-f7bb08f08fa5 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:33.587545 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2ae7acc8-4693-438e-960b-f7bb08f08fa5 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/72126702-46a5-4d4c-a6ae-430f43d8fdfb" status: 200 len: 1317 microversion: 2.1 time: 0.475562 Jun 20 11:59:33.589629 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 430/849] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:33 2022] GET /compute/v2.1/servers/72126702-46a5-4d4c-a6ae-430f43d8fdfb => generated 1317 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:33.737607 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c000f79f-ea64-4725-b9f1-8f87ea2b12d5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:33.753965 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c000f79f-ea64-4725-b9f1-8f87ea2b12d5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:33.755590 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c000f79f-ea64-4725-b9f1-8f87ea2b12d5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:33.756772 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c000f79f-ea64-4725-b9f1-8f87ea2b12d5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1343 microversion: 2.25 time: 0.432390 Jun 20 11:59:33.775922 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 420/850] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:59:33 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1343 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:59:34.126626 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fb8bd23e-c58f-4421-bbcf-70526b7ee824 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:34.127911 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fb8bd23e-c58f-4421-bbcf-70526b7ee824 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: 042df052-0ba8-4734-803c-c168858021f3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:34.141406 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fb8bd23e-c58f-4421-bbcf-70526b7ee824 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:34.145353 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fb8bd23e-c58f-4421-bbcf-70526b7ee824 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:34.146977 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fb8bd23e-c58f-4421-bbcf-70526b7ee824 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:34.147219 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c01fae52-a5d5-431d-9c4d-915e14a61f7a tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:34.148536 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c01fae52-a5d5-431d-9c4d-915e14a61f7a tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 3c12363c-ee46-445d-af50-77a1f0518a17] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:34.149738 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fb8bd23e-c58f-4421-bbcf-70526b7ee824 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:34.159216 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c01fae52-a5d5-431d-9c4d-915e14a61f7a tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:34.171467 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c01fae52-a5d5-431d-9c4d-915e14a61f7a tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:34.174715 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c01fae52-a5d5-431d-9c4d-915e14a61f7a tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:34.177841 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c01fae52-a5d5-431d-9c4d-915e14a61f7a tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:34.382491 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c01fae52-a5d5-431d-9c4d-915e14a61f7a tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ad0b87eae43f6b7f6ee8fc60cac9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada715b6fd664c06b9ffcdff7f4ecb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:34.392371 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c01fae52-a5d5-431d-9c4d-915e14a61f7a tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17" status: 200 len: 1300 microversion: 2.1 time: 0.249730 Jun 20 11:59:34.413913 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 421/851] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:34 2022] GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17 => generated 1300 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:34.436301 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-45f8674d-5fe1-4ed4-8d4d-588be4df2382 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '.version_select at 0x7f6073edc0d0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:34.532739 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-45f8674d-5fe1-4ed4-8d4d-588be4df2382 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/images/3600a08c-de7d-4769-906e-f9294057cb1a" status: 200 len: 1427 microversion: 2.1 time: 0.112857 Jun 20 11:59:34.533334 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 422/852] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 11:59:34 2022] GET /compute/v2.1/images/3600a08c-de7d-4769-906e-f9294057cb1a => generated 1427 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:34.609238 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c17cf0f6-819e-422e-b67d-c2d1ee7e92a3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:34.609857 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c17cf0f6-819e-422e-b67d-c2d1ee7e92a3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 72126702-46a5-4d4c-a6ae-430f43d8fdfb] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:34.617683 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c17cf0f6-819e-422e-b67d-c2d1ee7e92a3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:34.618355 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c17cf0f6-819e-422e-b67d-c2d1ee7e92a3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:34.633564 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c17cf0f6-819e-422e-b67d-c2d1ee7e92a3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:34.636941 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c17cf0f6-819e-422e-b67d-c2d1ee7e92a3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:35.267932 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c17cf0f6-819e-422e-b67d-c2d1ee7e92a3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:35.285049 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c17cf0f6-819e-422e-b67d-c2d1ee7e92a3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/72126702-46a5-4d4c-a6ae-430f43d8fdfb" status: 200 len: 1317 microversion: 2.1 time: 0.680368 Jun 20 11:59:35.291444 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 423/853] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:34 2022] GET /compute/v2.1/servers/72126702-46a5-4d4c-a6ae-430f43d8fdfb => generated 1317 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:35.307583 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-723945f5-476d-46e2-b1f1-2eee541f925e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:35.309952 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-723945f5-476d-46e2-b1f1-2eee541f925e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:35.323480 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-723945f5-476d-46e2-b1f1-2eee541f925e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:35.325032 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-723945f5-476d-46e2-b1f1-2eee541f925e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:35.328478 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-723945f5-476d-46e2-b1f1-2eee541f925e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:35.329038 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-723945f5-476d-46e2-b1f1-2eee541f925e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:35.384068 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fb8bd23e-c58f-4421-bbcf-70526b7ee824 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f49b57013f4675a70bac9b13e0a229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8790cc26204435aaf4071847ee00288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:35.427191 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fb8bd23e-c58f-4421-bbcf-70526b7ee824 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "GET /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3" status: 200 len: 1387 microversion: 2.1 time: 1.300632 Jun 20 11:59:35.429501 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 431/854] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:34 2022] GET /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3 => generated 1387 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:35.464586 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c8be67dd-8dd5-4441-9a02-4f4e129e385b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:35.469591 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c8be67dd-8dd5-4441-9a02-4f4e129e385b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 3c12363c-ee46-445d-af50-77a1f0518a17] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:35.507622 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c8be67dd-8dd5-4441-9a02-4f4e129e385b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:35.508237 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c8be67dd-8dd5-4441-9a02-4f4e129e385b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:35.514454 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c8be67dd-8dd5-4441-9a02-4f4e129e385b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:35.515187 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c8be67dd-8dd5-4441-9a02-4f4e129e385b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:35.763633 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c8be67dd-8dd5-4441-9a02-4f4e129e385b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ad0b87eae43f6b7f6ee8fc60cac9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada715b6fd664c06b9ffcdff7f4ecb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:35.772909 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c8be67dd-8dd5-4441-9a02-4f4e129e385b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17" status: 200 len: 1300 microversion: 2.1 time: 0.339738 Jun 20 11:59:35.788883 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 432/855] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:35 2022] GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17 => generated 1300 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:35.794638 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-331c6512-e0e8-4ee1-9d1f-cb06e4210588 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '.version_select at 0x7f60739e8940>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:35.876391 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-331c6512-e0e8-4ee1-9d1f-cb06e4210588 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/images/3600a08c-de7d-4769-906e-f9294057cb1a" status: 200 len: 1427 microversion: 2.1 time: 0.085767 Jun 20 11:59:35.877169 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 433/856] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 11:59:35 2022] GET /compute/v2.1/images/3600a08c-de7d-4769-906e-f9294057cb1a => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:36.305661 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-508f86cf-9efa-4fff-9373-f95c86f73748 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:36.306298 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-508f86cf-9efa-4fff-9373-f95c86f73748 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 72126702-46a5-4d4c-a6ae-430f43d8fdfb] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:36.321965 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-508f86cf-9efa-4fff-9373-f95c86f73748 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:36.322426 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-508f86cf-9efa-4fff-9373-f95c86f73748 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:36.323213 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-508f86cf-9efa-4fff-9373-f95c86f73748 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:36.323653 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-508f86cf-9efa-4fff-9373-f95c86f73748 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:36.464744 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-723945f5-476d-46e2-b1f1-2eee541f925e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:36.476177 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-723945f5-476d-46e2-b1f1-2eee541f925e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:36.477867 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-723945f5-476d-46e2-b1f1-2eee541f925e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:36.489609 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-723945f5-476d-46e2-b1f1-2eee541f925e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1411 microversion: 2.25 time: 1.196621 Jun 20 11:59:36.490209 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 424/857] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:59:35 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1411 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:59:36.495439 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fc28090e-7b82-4dfe-83c4-626a2fa2dda5 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:36.496286 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fc28090e-7b82-4dfe-83c4-626a2fa2dda5 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: 042df052-0ba8-4734-803c-c168858021f3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:36.507686 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fc28090e-7b82-4dfe-83c4-626a2fa2dda5 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:36.513010 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fc28090e-7b82-4dfe-83c4-626a2fa2dda5 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:36.514208 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fc28090e-7b82-4dfe-83c4-626a2fa2dda5 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:36.514980 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fc28090e-7b82-4dfe-83c4-626a2fa2dda5 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:36.854724 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-508f86cf-9efa-4fff-9373-f95c86f73748 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:36.863882 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-508f86cf-9efa-4fff-9373-f95c86f73748 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/72126702-46a5-4d4c-a6ae-430f43d8fdfb" status: 200 len: 1317 microversion: 2.1 time: 0.562554 Jun 20 11:59:36.877052 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 434/858] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:36 2022] GET /compute/v2.1/servers/72126702-46a5-4d4c-a6ae-430f43d8fdfb => generated 1317 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:59:36.883683 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-62fe231c-7b09-4209-bf98-fc57a90174d8 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:36.894302 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-62fe231c-7b09-4209-bf98-fc57a90174d8 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 3c12363c-ee46-445d-af50-77a1f0518a17] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:36.912016 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-62fe231c-7b09-4209-bf98-fc57a90174d8 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:36.924684 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-62fe231c-7b09-4209-bf98-fc57a90174d8 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:36.925558 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-62fe231c-7b09-4209-bf98-fc57a90174d8 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:36.928131 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-62fe231c-7b09-4209-bf98-fc57a90174d8 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:37.074723 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-62fe231c-7b09-4209-bf98-fc57a90174d8 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ad0b87eae43f6b7f6ee8fc60cac9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada715b6fd664c06b9ffcdff7f4ecb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:37.083381 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-62fe231c-7b09-4209-bf98-fc57a90174d8 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17" status: 200 len: 1300 microversion: 2.1 time: 0.204900 Jun 20 11:59:37.087832 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 435/859] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:36 2022] GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17 => generated 1300 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:37.107546 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a035a630-8f10-4989-8b53-3b36ceece832 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '.version_select at 0x7f6073b08c10>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:37.153412 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fc28090e-7b82-4dfe-83c4-626a2fa2dda5 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f49b57013f4675a70bac9b13e0a229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8790cc26204435aaf4071847ee00288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:37.164577 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fc28090e-7b82-4dfe-83c4-626a2fa2dda5 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "GET /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3" status: 200 len: 1586 microversion: 2.1 time: 0.672797 Jun 20 11:59:37.174624 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 425/860] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:36 2022] GET /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3 => generated 1586 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:37.190405 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a035a630-8f10-4989-8b53-3b36ceece832 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/images/3600a08c-de7d-4769-906e-f9294057cb1a" status: 200 len: 1427 microversion: 2.1 time: 0.101071 Jun 20 11:59:37.191012 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fb463122-b307-40a6-b229-0e30c1e449d1 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1672000595", "imageRef": "8d492f10-ca73-4162-97e6-bfb6966755d4", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "557af763-ab91-405f-af60-149474d9ff02"}], "security_groups": [{"name": "tempest-securitygroup--956476010"}], "key_name": "tempest-keypair-1323207248", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:59:37.191455 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 436/861] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 11:59:37 2022] GET /compute/v2.1/images/3600a08c-de7d-4769-906e-f9294057cb1a => generated 1427 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:37.211589 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4ced8611-a44a-4eb7-865d-1099802bc985 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:37.214971 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4ced8611-a44a-4eb7-865d-1099802bc985 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: 042df052-0ba8-4734-803c-c168858021f3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:37.231233 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ced8611-a44a-4eb7-865d-1099802bc985 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:37.243176 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ced8611-a44a-4eb7-865d-1099802bc985 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:37.247171 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ced8611-a44a-4eb7-865d-1099802bc985 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:37.250277 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ced8611-a44a-4eb7-865d-1099802bc985 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:37.438315 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4ced8611-a44a-4eb7-865d-1099802bc985 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "GET /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.245546 Jun 20 11:59:37.439596 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 437/862] 10.222.0.27 () {58 vars in 1274 bytes} [Mon Jun 20 11:59:37 2022] GET /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3/os-interface => generated 285 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:59:37.507140 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e20d2fbf-0d9f-4c9f-9f57-f7c05602baff tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:37.508354 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e20d2fbf-0d9f-4c9f-9f57-f7c05602baff tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:37.520008 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e20d2fbf-0d9f-4c9f-9f57-f7c05602baff tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:37.521077 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e20d2fbf-0d9f-4c9f-9f57-f7c05602baff tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:37.524601 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e20d2fbf-0d9f-4c9f-9f57-f7c05602baff tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:37.525556 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e20d2fbf-0d9f-4c9f-9f57-f7c05602baff tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:38.036089 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-fb463122-b307-40a6-b229-0e30c1e449d1 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] validate_networks() for [('557af763-ab91-405f-af60-149474d9ff02', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:59:38.241365 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e20d2fbf-0d9f-4c9f-9f57-f7c05602baff tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:38.257498 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e20d2fbf-0d9f-4c9f-9f57-f7c05602baff tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:38.259133 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e20d2fbf-0d9f-4c9f-9f57-f7c05602baff tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:38.260369 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e20d2fbf-0d9f-4c9f-9f57-f7c05602baff tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1411 microversion: 2.25 time: 0.757263 Jun 20 11:59:38.278870 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 438/863] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:59:37 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1411 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 11:59:38.283832 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-56482036-1ff9-4d82-964c-9db3a676848c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:38.284869 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-56482036-1ff9-4d82-964c-9db3a676848c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 72126702-46a5-4d4c-a6ae-430f43d8fdfb] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:38.291769 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-56482036-1ff9-4d82-964c-9db3a676848c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:38.292542 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-56482036-1ff9-4d82-964c-9db3a676848c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:38.293676 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-56482036-1ff9-4d82-964c-9db3a676848c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:38.294266 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-56482036-1ff9-4d82-964c-9db3a676848c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:38.377454 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:59:39.281009 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-56482036-1ff9-4d82-964c-9db3a676848c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:39.297886 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-56482036-1ff9-4d82-964c-9db3a676848c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/72126702-46a5-4d4c-a6ae-430f43d8fdfb" status: 200 len: 1317 microversion: 2.1 time: 1.017751 Jun 20 11:59:39.333246 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 439/864] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:38 2022] GET /compute/v2.1/servers/72126702-46a5-4d4c-a6ae-430f43d8fdfb => generated 1317 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:39.365142 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-77a3ae81-f09a-4ba8-be78-c8108c57abc7 req-7b5875bd-3749-4d36-9a19-cdf79a242dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72126702-46a5-4d4c-a6ae-430f43d8fdfb", "name": "network-vif-plugged", "status": "completed", "tag": "b53ee3ac-d73a-454f-90f9-5f3524df3e0f"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:59:39.380488 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-77a3ae81-f09a-4ba8-be78-c8108c57abc7 req-7b5875bd-3749-4d36-9a19-cdf79a242dc4 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:39.381175 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-77a3ae81-f09a-4ba8-be78-c8108c57abc7 req-7b5875bd-3749-4d36-9a19-cdf79a242dc4 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:39.401600 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-77a3ae81-f09a-4ba8-be78-c8108c57abc7 req-7b5875bd-3749-4d36-9a19-cdf79a242dc4 service nova] Creating event network-vif-plugged:b53ee3ac-d73a-454f-90f9-5f3524df3e0f for instance 72126702-46a5-4d4c-a6ae-430f43d8fdfb on n-h1-master-1 Jun 20 11:59:39.413955 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-77a3ae81-f09a-4ba8-be78-c8108c57abc7 req-7b5875bd-3749-4d36-9a19-cdf79a242dc4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075521 Jun 20 11:59:39.415360 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 440/865] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:59:39.423739 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dc8c3660-c7f7-475c-b786-f49063b8e2f8 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:39.425028 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-dc8c3660-c7f7-475c-b786-f49063b8e2f8 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 3c12363c-ee46-445d-af50-77a1f0518a17] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:39.435148 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc8c3660-c7f7-475c-b786-f49063b8e2f8 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:39.435772 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc8c3660-c7f7-475c-b786-f49063b8e2f8 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:39.437389 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc8c3660-c7f7-475c-b786-f49063b8e2f8 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:39.438158 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc8c3660-c7f7-475c-b786-f49063b8e2f8 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:40.037518 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-dc8c3660-c7f7-475c-b786-f49063b8e2f8 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ad0b87eae43f6b7f6ee8fc60cac9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada715b6fd664c06b9ffcdff7f4ecb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:40.046241 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dc8c3660-c7f7-475c-b786-f49063b8e2f8 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17" status: 200 len: 1367 microversion: 2.1 time: 0.629302 Jun 20 11:59:40.050113 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 441/866] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:39 2022] GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17 => generated 1367 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:40.057448 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-01e22353-49a1-493c-8d5d-2723fda8bf70 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '.version_select at 0x7f60738bc820>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:40.141104 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-01e22353-49a1-493c-8d5d-2723fda8bf70 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/images/3600a08c-de7d-4769-906e-f9294057cb1a" status: 200 len: 1427 microversion: 2.1 time: 0.089659 Jun 20 11:59:40.141702 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 442/867] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 11:59:40 2022] GET /compute/v2.1/images/3600a08c-de7d-4769-906e-f9294057cb1a => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:40.156935 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1b18be93-a343-4baf-a75a-00d96cad1d46 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:40.157745 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1b18be93-a343-4baf-a75a-00d96cad1d46 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:40.164760 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1b18be93-a343-4baf-a75a-00d96cad1d46 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:40.165767 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1b18be93-a343-4baf-a75a-00d96cad1d46 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:40.167279 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1b18be93-a343-4baf-a75a-00d96cad1d46 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:40.167896 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1b18be93-a343-4baf-a75a-00d96cad1d46 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:40.335262 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=9 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:59:40.362212 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=34 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:59:40.440291 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1b18be93-a343-4baf-a75a-00d96cad1d46 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:40.452892 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1b18be93-a343-4baf-a75a-00d96cad1d46 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:40.458820 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1b18be93-a343-4baf-a75a-00d96cad1d46 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:40.463132 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1b18be93-a343-4baf-a75a-00d96cad1d46 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1411 microversion: 2.25 time: 0.320261 Jun 20 11:59:40.470243 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 443/868] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:59:40 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1411 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:59:40.481540 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-9eaf0d77-04a1-4163-b5e5-b1704db3a687 req-c98452c8-8390-42ec-826d-8ce780833f22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3db0bd7d-eed4-411a-a7b8-719b260233ed", "tag": "66a1f7cd-2c10-48c8-8f30-83c32f1d6186"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:59:40.497077 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9eaf0d77-04a1-4163-b5e5-b1704db3a687 req-c98452c8-8390-42ec-826d-8ce780833f22 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:40.497684 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9eaf0d77-04a1-4163-b5e5-b1704db3a687 req-c98452c8-8390-42ec-826d-8ce780833f22 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:40.519116 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-9eaf0d77-04a1-4163-b5e5-b1704db3a687 req-c98452c8-8390-42ec-826d-8ce780833f22 service nova] Creating event network-changed:66a1f7cd-2c10-48c8-8f30-83c32f1d6186 for instance 3db0bd7d-eed4-411a-a7b8-719b260233ed on n-h2-master-1 Jun 20 11:59:40.527906 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-9eaf0d77-04a1-4163-b5e5-b1704db3a687 req-c98452c8-8390-42ec-826d-8ce780833f22 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055550 Jun 20 11:59:40.529554 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 444/869] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:59:40.536871 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-897049be-52de-4683-ad9b-e8c6d4f43c90 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:40.537580 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-897049be-52de-4683-ad9b-e8c6d4f43c90 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: 042df052-0ba8-4734-803c-c168858021f3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:40.547562 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-897049be-52de-4683-ad9b-e8c6d4f43c90 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:40.548150 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-897049be-52de-4683-ad9b-e8c6d4f43c90 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:40.549071 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-897049be-52de-4683-ad9b-e8c6d4f43c90 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:40.549559 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-897049be-52de-4683-ad9b-e8c6d4f43c90 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:40.890400 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-897049be-52de-4683-ad9b-e8c6d4f43c90 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f49b57013f4675a70bac9b13e0a229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8790cc26204435aaf4071847ee00288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:40.904140 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-897049be-52de-4683-ad9b-e8c6d4f43c90 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "GET /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3" status: 200 len: 1586 microversion: 2.1 time: 0.373227 Jun 20 11:59:40.918298 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 445/870] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:40 2022] GET /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3 => generated 1586 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:40.954537 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-d8305da0-78ff-4236-8548-01ff2e43b259 req-db69762f-a181-4f26-92cb-c9c1fb6b7106 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "042df052-0ba8-4734-803c-c168858021f3", "tag": "462d3ed2-a733-4603-91af-98ab7f43db64"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:59:40.977175 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-d8305da0-78ff-4236-8548-01ff2e43b259 req-db69762f-a181-4f26-92cb-c9c1fb6b7106 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:40.977614 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-d8305da0-78ff-4236-8548-01ff2e43b259 req-db69762f-a181-4f26-92cb-c9c1fb6b7106 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:41.037165 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-d8305da0-78ff-4236-8548-01ff2e43b259 req-db69762f-a181-4f26-92cb-c9c1fb6b7106 service nova] Creating event network-changed:462d3ed2-a733-4603-91af-98ab7f43db64 for instance 042df052-0ba8-4734-803c-c168858021f3 on n-h1-master-1 Jun 20 11:59:41.066659 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-d8305da0-78ff-4236-8548-01ff2e43b259 req-db69762f-a181-4f26-92cb-c9c1fb6b7106 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146453 Jun 20 11:59:41.074349 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 446/871] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:59:41.164819 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-99040b27-71b2-40ba-9f9a-97f666f92fb5 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:41.164819 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-99040b27-71b2-40ba-9f9a-97f666f92fb5 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 72126702-46a5-4d4c-a6ae-430f43d8fdfb] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:41.170472 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-99040b27-71b2-40ba-9f9a-97f666f92fb5 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:41.171119 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-99040b27-71b2-40ba-9f9a-97f666f92fb5 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:41.175981 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-99040b27-71b2-40ba-9f9a-97f666f92fb5 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:41.176549 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-99040b27-71b2-40ba-9f9a-97f666f92fb5 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:41.185581 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:59:41.440151 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=16 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:59:42.206282 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-99040b27-71b2-40ba-9f9a-97f666f92fb5 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:42.245456 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-99040b27-71b2-40ba-9f9a-97f666f92fb5 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/72126702-46a5-4d4c-a6ae-430f43d8fdfb" status: 200 len: 1317 microversion: 2.1 time: 1.161524 Jun 20 11:59:42.251688 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 447/872] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:41 2022] GET /compute/v2.1/servers/72126702-46a5-4d4c-a6ae-430f43d8fdfb => generated 1317 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:42.269392 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-aaf8d484-3e63-4000-b052-72eea9fe6168 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:42.270278 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-aaf8d484-3e63-4000-b052-72eea9fe6168 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 3c12363c-ee46-445d-af50-77a1f0518a17] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:42.287497 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aaf8d484-3e63-4000-b052-72eea9fe6168 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:42.288457 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aaf8d484-3e63-4000-b052-72eea9fe6168 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:42.290123 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aaf8d484-3e63-4000-b052-72eea9fe6168 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:42.290783 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aaf8d484-3e63-4000-b052-72eea9fe6168 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:42.582969 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-fb463122-b307-40a6-b229-0e30c1e449d1 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:59:42.584284 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-fb463122-b307-40a6-b229-0e30c1e449d1 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:59:42.585004 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-fb463122-b307-40a6-b229-0e30c1e449d1 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:59:42.585617 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-fb463122-b307-40a6-b229-0e30c1e449d1 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:59:42.586525 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-fb463122-b307-40a6-b229-0e30c1e449d1 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:59:42.602749 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fb463122-b307-40a6-b229-0e30c1e449d1 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:42.603613 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fb463122-b307-40a6-b229-0e30c1e449d1 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:42.604796 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fb463122-b307-40a6-b229-0e30c1e449d1 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:42.605454 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fb463122-b307-40a6-b229-0e30c1e449d1 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:42.645335 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-fb463122-b307-40a6-b229-0e30c1e449d1 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Getting quotas for project 0f35cecfcbb948c6b60eef6140f87a3b. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:59:42.659978 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-fb463122-b307-40a6-b229-0e30c1e449d1 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Getting quotas for user a53f4e0e140c4a839d99b56ee9ffacc5 and project 0f35cecfcbb948c6b60eef6140f87a3b. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:59:42.688647 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fb463122-b307-40a6-b229-0e30c1e449d1 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:59:42.691091 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fb463122-b307-40a6-b229-0e30c1e449d1 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] [instance: 1c763272-042e-418c-b2f6-cc2e96f0c54d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8d492f10-ca73-4162-97e6-bfb6966755d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:59:42.737405 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-aaf8d484-3e63-4000-b052-72eea9fe6168 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ad0b87eae43f6b7f6ee8fc60cac9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada715b6fd664c06b9ffcdff7f4ecb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:42.746156 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-aaf8d484-3e63-4000-b052-72eea9fe6168 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17" status: 200 len: 1367 microversion: 2.1 time: 0.491656 Jun 20 11:59:42.750461 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 448/873] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:42 2022] GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17 => generated 1367 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:42.755617 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-05d529ac-1f18-4a8d-b4c1-9ae35825889d tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '.version_select at 0x7f60738bc9d0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:42.779136 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fb463122-b307-40a6-b229-0e30c1e449d1 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 5.602554 Jun 20 11:59:42.782367 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 426/874] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 11:59:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 5606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 11:59:42.795546 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3d70e814-1d82-41e6-bde6-a35862c48564 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:42.796193 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3d70e814-1d82-41e6-bde6-a35862c48564 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:42.823258 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3d70e814-1d82-41e6-bde6-a35862c48564 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:42.823721 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3d70e814-1d82-41e6-bde6-a35862c48564 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:42.824561 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3d70e814-1d82-41e6-bde6-a35862c48564 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:42.825002 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3d70e814-1d82-41e6-bde6-a35862c48564 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:42.834038 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-05d529ac-1f18-4a8d-b4c1-9ae35825889d tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/images/3600a08c-de7d-4769-906e-f9294057cb1a" status: 200 len: 1427 microversion: 2.1 time: 0.082170 Jun 20 11:59:42.834918 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 449/875] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 11:59:42 2022] GET /compute/v2.1/images/3600a08c-de7d-4769-906e-f9294057cb1a => generated 1427 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:42.842987 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-88696279-7825-40b1-ada3-95eef0e452a2 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:42.843916 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-88696279-7825-40b1-ada3-95eef0e452a2 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] [instance: 1c763272-042e-418c-b2f6-cc2e96f0c54d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:42.976170 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-88696279-7825-40b1-ada3-95eef0e452a2 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f4e0e140c4a839d99b56ee9ffacc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35cecfcbb948c6b60eef6140f87a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:42.987635 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-88696279-7825-40b1-ada3-95eef0e452a2 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] 10.222.0.27 "GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d" status: 200 len: 1246 microversion: 2.1 time: 0.151638 Jun 20 11:59:42.988256 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 450/876] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:42 2022] GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d => generated 1246 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:43.268851 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-25b1f99a-bdad-4cb6-bf6b-9783e311be0c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:43.270498 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-25b1f99a-bdad-4cb6-bf6b-9783e311be0c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 72126702-46a5-4d4c-a6ae-430f43d8fdfb] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:43.284522 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-25b1f99a-bdad-4cb6-bf6b-9783e311be0c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:43.285553 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-25b1f99a-bdad-4cb6-bf6b-9783e311be0c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:43.288359 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-25b1f99a-bdad-4cb6-bf6b-9783e311be0c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:43.291051 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-25b1f99a-bdad-4cb6-bf6b-9783e311be0c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:43.345908 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3d70e814-1d82-41e6-bde6-a35862c48564 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:43.360924 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3d70e814-1d82-41e6-bde6-a35862c48564 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:43.362725 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3d70e814-1d82-41e6-bde6-a35862c48564 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:43.366168 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3d70e814-1d82-41e6-bde6-a35862c48564 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1411 microversion: 2.25 time: 0.581666 Jun 20 11:59:43.366744 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 427/877] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:59:42 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1411 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:59:43.558000 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-25b1f99a-bdad-4cb6-bf6b-9783e311be0c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:43.568185 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-25b1f99a-bdad-4cb6-bf6b-9783e311be0c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/72126702-46a5-4d4c-a6ae-430f43d8fdfb" status: 200 len: 1467 microversion: 2.1 time: 0.304936 Jun 20 11:59:43.569444 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 451/878] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:43 2022] GET /compute/v2.1/servers/72126702-46a5-4d4c-a6ae-430f43d8fdfb => generated 1467 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:43.588699 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cb20e778-7bfe-4800-b060-94957b7ac5c8 tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:43.593445 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cb20e778-7bfe-4800-b060-94957b7ac5c8 tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] [instance: 72126702-46a5-4d4c-a6ae-430f43d8fdfb] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:43.602913 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cb20e778-7bfe-4800-b060-94957b7ac5c8 tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:43.603375 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cb20e778-7bfe-4800-b060-94957b7ac5c8 tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:43.604166 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cb20e778-7bfe-4800-b060-94957b7ac5c8 tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:43.604805 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cb20e778-7bfe-4800-b060-94957b7ac5c8 tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:43.783878 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b77a55e2-4d8a-4efd-a875-92f4dd871974 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:43.785168 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b77a55e2-4d8a-4efd-a875-92f4dd871974 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 3c12363c-ee46-445d-af50-77a1f0518a17] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:43.794508 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b77a55e2-4d8a-4efd-a875-92f4dd871974 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:43.794508 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b77a55e2-4d8a-4efd-a875-92f4dd871974 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:43.794508 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b77a55e2-4d8a-4efd-a875-92f4dd871974 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:43.807139 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b77a55e2-4d8a-4efd-a875-92f4dd871974 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:44.075047 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b77a55e2-4d8a-4efd-a875-92f4dd871974 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ad0b87eae43f6b7f6ee8fc60cac9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada715b6fd664c06b9ffcdff7f4ecb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:44.084423 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b77a55e2-4d8a-4efd-a875-92f4dd871974 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17" status: 200 len: 1367 microversion: 2.1 time: 0.321224 Jun 20 11:59:44.087657 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 452/879] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:43 2022] GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17 => generated 1367 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:44.092979 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-9d4961f7-bba6-4920-91b8-f9dfd69931e0 req-4c21dcc0-52e8-47fa-86c0-972fcc798801 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c12363c-ee46-445d-af50-77a1f0518a17", "tag": "0633c2cf-5ad3-4f49-95ea-6201e1ac2cc0"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:59:44.107821 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9d4961f7-bba6-4920-91b8-f9dfd69931e0 req-4c21dcc0-52e8-47fa-86c0-972fcc798801 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:44.108480 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9d4961f7-bba6-4920-91b8-f9dfd69931e0 req-4c21dcc0-52e8-47fa-86c0-972fcc798801 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:44.125219 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-9d4961f7-bba6-4920-91b8-f9dfd69931e0 req-4c21dcc0-52e8-47fa-86c0-972fcc798801 service nova] Creating event network-changed:0633c2cf-5ad3-4f49-95ea-6201e1ac2cc0 for instance 3c12363c-ee46-445d-af50-77a1f0518a17 on n-h1-master-1 Jun 20 11:59:44.131312 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-9d4961f7-bba6-4920-91b8-f9dfd69931e0 req-4c21dcc0-52e8-47fa-86c0-972fcc798801 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042186 Jun 20 11:59:44.133324 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 453/880] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:59:44.142050 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b7dd2772-4579-478a-a788-6a0c96a40d30 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '.version_select at 0x7f6073901ee0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:44.205619 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b7dd2772-4579-478a-a788-6a0c96a40d30 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/images/3600a08c-de7d-4769-906e-f9294057cb1a" status: 200 len: 1427 microversion: 2.1 time: 0.070357 Jun 20 11:59:44.206386 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 454/881] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 11:59:44 2022] GET /compute/v2.1/images/3600a08c-de7d-4769-906e-f9294057cb1a => generated 1427 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:44.210866 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-211540c7-55ff-4ad1-bfe9-923c370e3678 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:44.211730 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-211540c7-55ff-4ad1-bfe9-923c370e3678 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] [instance: 1c763272-042e-418c-b2f6-cc2e96f0c54d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:44.218911 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-211540c7-55ff-4ad1-bfe9-923c370e3678 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:44.219165 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-211540c7-55ff-4ad1-bfe9-923c370e3678 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:44.219945 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-211540c7-55ff-4ad1-bfe9-923c370e3678 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:44.220405 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-211540c7-55ff-4ad1-bfe9-923c370e3678 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:44.301737 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cb20e778-7bfe-4800-b060-94957b7ac5c8 tempest-ServersOnMultiNodesTest-1860050156 tempest-ServersOnMultiNodesTest-1860050156-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/72126702-46a5-4d4c-a6ae-430f43d8fdfb" status: 200 len: 1618 microversion: 2.1 time: 0.716849 Jun 20 11:59:44.308894 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 428/882] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:43 2022] GET /compute/v2.1/servers/72126702-46a5-4d4c-a6ae-430f43d8fdfb => generated 1618 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:44.350745 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-211540c7-55ff-4ad1-bfe9-923c370e3678 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f4e0e140c4a839d99b56ee9ffacc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35cecfcbb948c6b60eef6140f87a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:44.365153 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-211540c7-55ff-4ad1-bfe9-923c370e3678 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] 10.222.0.27 "GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d" status: 200 len: 1306 microversion: 2.1 time: 0.157924 Jun 20 11:59:44.373497 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 455/883] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:44 2022] GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d => generated 1306 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:44.376569 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d58c6904-be57-478a-b904-a087d05825e0 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:44.378931 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d58c6904-be57-478a-b904-a087d05825e0 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 72126702-46a5-4d4c-a6ae-430f43d8fdfb] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:44.385222 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-86f97b94-56d6-4074-9be9-bef9815fb0e2 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:44.386619 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-86f97b94-56d6-4074-9be9-bef9815fb0e2 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:44.398072 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-86f97b94-56d6-4074-9be9-bef9815fb0e2 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:44.399115 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-86f97b94-56d6-4074-9be9-bef9815fb0e2 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:44.401530 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-86f97b94-56d6-4074-9be9-bef9815fb0e2 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:44.403826 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d58c6904-be57-478a-b904-a087d05825e0 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:44.404537 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-86f97b94-56d6-4074-9be9-bef9815fb0e2 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:44.404712 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d58c6904-be57-478a-b904-a087d05825e0 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:44.405715 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d58c6904-be57-478a-b904-a087d05825e0 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:44.406311 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d58c6904-be57-478a-b904-a087d05825e0 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:44.469051 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d58c6904-be57-478a-b904-a087d05825e0 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 72126702-46a5-4d4c-a6ae-430f43d8fdfb] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 11:59:44.605513 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-86f97b94-56d6-4074-9be9-bef9815fb0e2 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:44.619450 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-86f97b94-56d6-4074-9be9-bef9815fb0e2 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:44.621431 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-86f97b94-56d6-4074-9be9-bef9815fb0e2 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:44.623003 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-86f97b94-56d6-4074-9be9-bef9815fb0e2 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1411 microversion: 2.25 time: 0.242432 Jun 20 11:59:44.634382 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 456/884] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:59:44 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1411 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 11:59:44.697552 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d58c6904-be57-478a-b904-a087d05825e0 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "DELETE /compute/v2.1/servers/72126702-46a5-4d4c-a6ae-430f43d8fdfb" status: 204 len: 0 microversion: 2.1 time: 0.335305 Jun 20 11:59:44.698205 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 429/885] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 11:59:44 2022] DELETE /compute/v2.1/servers/72126702-46a5-4d4c-a6ae-430f43d8fdfb => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:59:44.713664 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dd5855f5-279d-456f-a7e1-3ec5afedc1a8 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:44.720596 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-dd5855f5-279d-456f-a7e1-3ec5afedc1a8 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 72126702-46a5-4d4c-a6ae-430f43d8fdfb] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:44.733876 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dd5855f5-279d-456f-a7e1-3ec5afedc1a8 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:44.734356 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dd5855f5-279d-456f-a7e1-3ec5afedc1a8 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:44.735111 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dd5855f5-279d-456f-a7e1-3ec5afedc1a8 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:44.735529 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dd5855f5-279d-456f-a7e1-3ec5afedc1a8 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:44.927887 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-dd5855f5-279d-456f-a7e1-3ec5afedc1a8 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:44.942315 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dd5855f5-279d-456f-a7e1-3ec5afedc1a8 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/72126702-46a5-4d4c-a6ae-430f43d8fdfb" status: 200 len: 1473 microversion: 2.1 time: 0.239591 Jun 20 11:59:44.953326 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 457/886] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:44 2022] GET /compute/v2.1/servers/72126702-46a5-4d4c-a6ae-430f43d8fdfb => generated 1473 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:45.105573 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dd473f32-db2b-4d19-ba05-8b48bc1c7a12 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:45.106531 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dd473f32-db2b-4d19-ba05-8b48bc1c7a12 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 3c12363c-ee46-445d-af50-77a1f0518a17] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:45.121674 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd473f32-db2b-4d19-ba05-8b48bc1c7a12 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:45.121674 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd473f32-db2b-4d19-ba05-8b48bc1c7a12 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:45.121946 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd473f32-db2b-4d19-ba05-8b48bc1c7a12 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:45.122327 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd473f32-db2b-4d19-ba05-8b48bc1c7a12 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:45.220800 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bb099fb9-01c9-47dd-aaa1-34d3a80c3b1b tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '.version_select at 0x7f6073eb60d0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:45.298389 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bb099fb9-01c9-47dd-aaa1-34d3a80c3b1b tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/images/3600a08c-de7d-4769-906e-f9294057cb1a" status: 200 len: 1427 microversion: 2.1 time: 0.083276 Jun 20 11:59:45.299353 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 458/887] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 11:59:45 2022] GET /compute/v2.1/images/3600a08c-de7d-4769-906e-f9294057cb1a => generated 1427 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:59:45.390521 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f6d7c029-d620-44c6-9a4e-9889372e321d tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:45.391961 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f6d7c029-d620-44c6-9a4e-9889372e321d tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] [instance: 1c763272-042e-418c-b2f6-cc2e96f0c54d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:45.401962 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6d7c029-d620-44c6-9a4e-9889372e321d tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:45.405571 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6d7c029-d620-44c6-9a4e-9889372e321d tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:45.406733 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6d7c029-d620-44c6-9a4e-9889372e321d tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:45.407436 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6d7c029-d620-44c6-9a4e-9889372e321d tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:45.588840 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f6d7c029-d620-44c6-9a4e-9889372e321d tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f4e0e140c4a839d99b56ee9ffacc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35cecfcbb948c6b60eef6140f87a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:45.598415 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f6d7c029-d620-44c6-9a4e-9889372e321d tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] 10.222.0.27 "GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d" status: 200 len: 1306 microversion: 2.1 time: 0.212362 Jun 20 11:59:45.612439 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 459/888] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:45 2022] GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d => generated 1306 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:59:45.877871 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6570be2a-08b6-4336-b0b3-308ae42f36c7 tempest-FloatingIPsTestJSON-248285424 tempest-FloatingIPsTestJSON-248285424-project] Action: 'create', calling method: .version_select at 0x7f607385eb80>, body: {"pool": null} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:59:46.141686 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dd473f32-db2b-4d19-ba05-8b48bc1c7a12 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ad0b87eae43f6b7f6ee8fc60cac9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada715b6fd664c06b9ffcdff7f4ecb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:46.154175 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dd473f32-db2b-4d19-ba05-8b48bc1c7a12 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17" status: 200 len: 1367 microversion: 2.1 time: 1.053016 Jun 20 11:59:46.155410 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 430/889] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:45 2022] GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17 => generated 1367 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:46.162621 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4acad991-2dc8-4f5a-b2e1-6be64d1a7fb7 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:46.168150 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4acad991-2dc8-4f5a-b2e1-6be64d1a7fb7 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:46.182342 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4acad991-2dc8-4f5a-b2e1-6be64d1a7fb7 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:46.188891 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4acad991-2dc8-4f5a-b2e1-6be64d1a7fb7 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:46.190943 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4acad991-2dc8-4f5a-b2e1-6be64d1a7fb7 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:46.191538 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4acad991-2dc8-4f5a-b2e1-6be64d1a7fb7 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:46.475432 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4acad991-2dc8-4f5a-b2e1-6be64d1a7fb7 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:46.488168 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4acad991-2dc8-4f5a-b2e1-6be64d1a7fb7 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:46.489700 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4acad991-2dc8-4f5a-b2e1-6be64d1a7fb7 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:46.490841 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4acad991-2dc8-4f5a-b2e1-6be64d1a7fb7 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1411 microversion: 2.25 time: 0.334221 Jun 20 11:59:46.491419 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 431/890] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:59:46 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1411 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:59:46.524313 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c78a66af-b884-438b-a1a5-37e497aaf312 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:46.525903 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c78a66af-b884-438b-a1a5-37e497aaf312 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 72126702-46a5-4d4c-a6ae-430f43d8fdfb] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:46.533662 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c78a66af-b884-438b-a1a5-37e497aaf312 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:46.534096 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c78a66af-b884-438b-a1a5-37e497aaf312 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:46.537324 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c78a66af-b884-438b-a1a5-37e497aaf312 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:46.537853 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c78a66af-b884-438b-a1a5-37e497aaf312 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:46.893387 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c78a66af-b884-438b-a1a5-37e497aaf312 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:46.907601 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c78a66af-b884-438b-a1a5-37e497aaf312 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/72126702-46a5-4d4c-a6ae-430f43d8fdfb" status: 200 len: 1473 microversion: 2.1 time: 0.414939 Jun 20 11:59:46.909175 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 432/891] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:46 2022] GET /compute/v2.1/servers/72126702-46a5-4d4c-a6ae-430f43d8fdfb => generated 1473 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:46.923100 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-87ff211f-60d2-4794-8e8c-c888d9751c2a tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '.version_select at 0x7f6073a1a160>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:47.024610 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-87ff211f-60d2-4794-8e8c-c888d9751c2a tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/images/3600a08c-de7d-4769-906e-f9294057cb1a" status: 200 len: 1427 microversion: 2.1 time: 0.110742 Jun 20 11:59:47.042828 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 433/892] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 11:59:46 2022] GET /compute/v2.1/images/3600a08c-de7d-4769-906e-f9294057cb1a => generated 1427 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:47.050551 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7cd83b41-8b1b-4b89-a3f5-5041ba75f63b tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:47.059581 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7cd83b41-8b1b-4b89-a3f5-5041ba75f63b tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] [instance: 1c763272-042e-418c-b2f6-cc2e96f0c54d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:47.073545 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7cd83b41-8b1b-4b89-a3f5-5041ba75f63b tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:47.075101 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7cd83b41-8b1b-4b89-a3f5-5041ba75f63b tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:47.076715 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7cd83b41-8b1b-4b89-a3f5-5041ba75f63b tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:47.077466 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7cd83b41-8b1b-4b89-a3f5-5041ba75f63b tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:47.230894 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7cd83b41-8b1b-4b89-a3f5-5041ba75f63b tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f4e0e140c4a839d99b56ee9ffacc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35cecfcbb948c6b60eef6140f87a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:47.247026 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7cd83b41-8b1b-4b89-a3f5-5041ba75f63b tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] 10.222.0.27 "GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d" status: 200 len: 1316 microversion: 2.1 time: 0.200440 Jun 20 11:59:47.249777 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 434/893] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:47 2022] GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d => generated 1316 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:47.282524 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c9b43731-3d2a-4016-b423-820e811de25c tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:47.283280 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c9b43731-3d2a-4016-b423-820e811de25c tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 3c12363c-ee46-445d-af50-77a1f0518a17] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:47.301637 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c9b43731-3d2a-4016-b423-820e811de25c tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:47.304101 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c9b43731-3d2a-4016-b423-820e811de25c tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:47.306982 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c9b43731-3d2a-4016-b423-820e811de25c tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:47.307585 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c9b43731-3d2a-4016-b423-820e811de25c tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:47.897018 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c9b43731-3d2a-4016-b423-820e811de25c tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ad0b87eae43f6b7f6ee8fc60cac9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada715b6fd664c06b9ffcdff7f4ecb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:47.908591 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c9b43731-3d2a-4016-b423-820e811de25c tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17" status: 200 len: 1367 microversion: 2.1 time: 0.657423 Jun 20 11:59:47.913077 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 435/894] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:47 2022] GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17 => generated 1367 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:47.931181 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8156ae60-ee0e-48c0-812c-129e9e188f40 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:47.931806 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8156ae60-ee0e-48c0-812c-129e9e188f40 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:47.959243 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8156ae60-ee0e-48c0-812c-129e9e188f40 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:47.960135 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8156ae60-ee0e-48c0-812c-129e9e188f40 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:47.961545 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8156ae60-ee0e-48c0-812c-129e9e188f40 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:47.962148 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8156ae60-ee0e-48c0-812c-129e9e188f40 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:48.679211 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8156ae60-ee0e-48c0-812c-129e9e188f40 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:48.683994 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:59:48.696412 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8156ae60-ee0e-48c0-812c-129e9e188f40 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:48.697956 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8156ae60-ee0e-48c0-812c-129e9e188f40 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:48.699124 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8156ae60-ee0e-48c0-812c-129e9e188f40 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1411 microversion: 2.25 time: 0.778071 Jun 20 11:59:48.701582 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 436/895] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:59:47 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1411 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:59:48.717961 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-aadcd708-8a66-4c17-b0a2-ea2373fe05b4 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:48.718568 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-aadcd708-8a66-4c17-b0a2-ea2373fe05b4 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 72126702-46a5-4d4c-a6ae-430f43d8fdfb] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:48.737529 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aadcd708-8a66-4c17-b0a2-ea2373fe05b4 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:48.749958 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aadcd708-8a66-4c17-b0a2-ea2373fe05b4 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:48.751216 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aadcd708-8a66-4c17-b0a2-ea2373fe05b4 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:48.751835 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aadcd708-8a66-4c17-b0a2-ea2373fe05b4 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:48.986514 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-aadcd708-8a66-4c17-b0a2-ea2373fe05b4 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:48.996616 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-aadcd708-8a66-4c17-b0a2-ea2373fe05b4 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/72126702-46a5-4d4c-a6ae-430f43d8fdfb" status: 200 len: 1431 microversion: 2.1 time: 0.283024 Jun 20 11:59:49.000438 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 437/896] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:48 2022] GET /compute/v2.1/servers/72126702-46a5-4d4c-a6ae-430f43d8fdfb => generated 1431 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:49.024986 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0b55886b-5f12-49ce-87ca-194ccd1a048e tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '.version_select at 0x7f6073cb2c10>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:50.987914 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0b55886b-5f12-49ce-87ca-194ccd1a048e tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/images/3600a08c-de7d-4769-906e-f9294057cb1a" status: 200 len: 1436 microversion: 2.1 time: 1.984407 Jun 20 11:59:50.988595 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 438/897] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 11:59:49 2022] GET /compute/v2.1/images/3600a08c-de7d-4769-906e-f9294057cb1a => generated 1436 bytes in 1986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:51.025001 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-19092be7-4e66-45f0-aaa2-f6164728963a tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:51.025601 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-19092be7-4e66-45f0-aaa2-f6164728963a tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] [instance: 1c763272-042e-418c-b2f6-cc2e96f0c54d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:51.040312 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-19092be7-4e66-45f0-aaa2-f6164728963a tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:51.049632 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-19092be7-4e66-45f0-aaa2-f6164728963a tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:51.050764 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-19092be7-4e66-45f0-aaa2-f6164728963a tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:51.067384 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-19092be7-4e66-45f0-aaa2-f6164728963a tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:51.408812 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-19092be7-4e66-45f0-aaa2-f6164728963a tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f4e0e140c4a839d99b56ee9ffacc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35cecfcbb948c6b60eef6140f87a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:51.418109 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-19092be7-4e66-45f0-aaa2-f6164728963a tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] 10.222.0.27 "GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d" status: 200 len: 1371 microversion: 2.1 time: 0.428278 Jun 20 11:59:51.437902 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 439/898] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:50 2022] GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d => generated 1371 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:51.445555 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b1d22b3c-8636-44b3-809b-193814d7fe1d tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:51.446409 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b1d22b3c-8636-44b3-809b-193814d7fe1d tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 3c12363c-ee46-445d-af50-77a1f0518a17] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:51.465576 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b1d22b3c-8636-44b3-809b-193814d7fe1d tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:51.466054 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b1d22b3c-8636-44b3-809b-193814d7fe1d tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:51.470789 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b1d22b3c-8636-44b3-809b-193814d7fe1d tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:51.471580 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b1d22b3c-8636-44b3-809b-193814d7fe1d tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:52.289303 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b1d22b3c-8636-44b3-809b-193814d7fe1d tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ad0b87eae43f6b7f6ee8fc60cac9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada715b6fd664c06b9ffcdff7f4ecb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:52.299541 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b1d22b3c-8636-44b3-809b-193814d7fe1d tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17" status: 200 len: 1367 microversion: 2.1 time: 0.860426 Jun 20 11:59:52.313968 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 440/899] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:51 2022] GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17 => generated 1367 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:52.319072 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9d6aabd4-69fc-4b36-bd76-927b759e9265 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:52.327767 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9d6aabd4-69fc-4b36-bd76-927b759e9265 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:52.345195 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9d6aabd4-69fc-4b36-bd76-927b759e9265 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:52.345954 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9d6aabd4-69fc-4b36-bd76-927b759e9265 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:52.346915 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9d6aabd4-69fc-4b36-bd76-927b759e9265 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:52.347515 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9d6aabd4-69fc-4b36-bd76-927b759e9265 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:52.621299 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:59:52.671158 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:59:52.987601 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:59:53.107312 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9d6aabd4-69fc-4b36-bd76-927b759e9265 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:53.120318 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9d6aabd4-69fc-4b36-bd76-927b759e9265 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:53.122047 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9d6aabd4-69fc-4b36-bd76-927b759e9265 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:53.123222 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9d6aabd4-69fc-4b36-bd76-927b759e9265 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1411 microversion: 2.25 time: 0.808001 Jun 20 11:59:53.129689 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 441/900] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:59:52 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1411 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:59:53.149960 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-863ea5e1-e5ee-47d2-8a28-c24660c07f38 req-f2724cbe-c4c2-46c6-bf57-958a12194a55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72126702-46a5-4d4c-a6ae-430f43d8fdfb", "name": "network-vif-deleted", "tag": "b53ee3ac-d73a-454f-90f9-5f3524df3e0f"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:59:53.169641 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:59:53.179588 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-863ea5e1-e5ee-47d2-8a28-c24660c07f38 req-f2724cbe-c4c2-46c6-bf57-958a12194a55 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:53.180038 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-863ea5e1-e5ee-47d2-8a28-c24660c07f38 req-f2724cbe-c4c2-46c6-bf57-958a12194a55 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:53.210627 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-863ea5e1-e5ee-47d2-8a28-c24660c07f38 req-f2724cbe-c4c2-46c6-bf57-958a12194a55 service nova] Creating event network-vif-deleted:b53ee3ac-d73a-454f-90f9-5f3524df3e0f for instance 72126702-46a5-4d4c-a6ae-430f43d8fdfb on n-h1-master-1 Jun 20 11:59:53.222467 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-863ea5e1-e5ee-47d2-8a28-c24660c07f38 req-f2724cbe-c4c2-46c6-bf57-958a12194a55 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091535 Jun 20 11:59:53.227198 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 442/901] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:59:53.237018 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c418806d-b6dc-4695-bc6c-8e36320f7a39 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:53.249355 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c418806d-b6dc-4695-bc6c-8e36320f7a39 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 72126702-46a5-4d4c-a6ae-430f43d8fdfb] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:53.265373 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c418806d-b6dc-4695-bc6c-8e36320f7a39 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:53.267064 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c418806d-b6dc-4695-bc6c-8e36320f7a39 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:53.269902 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c418806d-b6dc-4695-bc6c-8e36320f7a39 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:53.275473 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c418806d-b6dc-4695-bc6c-8e36320f7a39 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:53.322583 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-c418806d-b6dc-4695-bc6c-8e36320f7a39 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] HTTP exception thrown: Instance 72126702-46a5-4d4c-a6ae-430f43d8fdfb could not be found. Jun 20 11:59:53.333636 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c418806d-b6dc-4695-bc6c-8e36320f7a39 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Request method failure captured: Jun 20 11:59:53.333636 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/72126702-46a5-4d4c-a6ae-430f43d8fdfb HTTP/1.1 Jun 20 11:59:53.333636 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:59:53.333636 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:59:53.333636 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:59:53.333636 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 11:59:53.333636 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:59:53.333636 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:59:53.333636 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:59:53.333636 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:59:53.333636 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGB04YgN2qwmpAbSVYBj1yKvqSaDSqYj7KhnXAwxLFlA52NG70o92gYPB0cXzYJvuf_7FOWrI99cZVPKh4xXLrAHLOP_L0Q9mNXdSZyTZrSw1bqTuU7pza7A3jlbg1NmxOK9BJccrrZRONfFPEpVpJShKEnusLTFdnHs8tSnnukr1cc Jun 20 11:59:53.333636 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:59:53.333636 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:59:53.333636 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:59:53.333636 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:59:53.333636 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:59:53.333636 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:59:53.333636 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: a6150795e7424cca91c71531840d88be Jun 20 11:59:53.333636 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersOnMultiNodesTest-1662406801 Jun 20 11:59:53.333636 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 11:59:53.333636 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 11:59:53.335107 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6150795e7424cca91c71531840d88be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6150795e7424cca91c71531840d88be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a6150795e7424cca91c71531840d88be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a6150795e7424cca91c71531840d88be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:59:53.335107 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersOnMultiNodesTest-1662406801 Jun 20 11:59:53.335107 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: a6150795e7424cca91c71531840d88be Jun 20 11:59:53.335107 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1662406801 Jun 20 11:59:53.335107 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersOnMultiNodesTest-1662406801-project Jun 20 11:59:53.335107 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:59:53.335107 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:59:53.335107 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 1297c1b206f845bcaf936313fd7eed9b Jun 20 11:59:53.335107 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersOnMultiNodesTest-1662406801-project Jun 20 11:59:53.335107 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 11:59:53.335107 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 72126702-46a5-4d4c-a6ae-430f43d8fdfb could not be found. Jun 20 11:59:53.335107 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '72126702-46a5-4d4c-a6ae-430f43d8fdfb'} Jun 20 11:59:53.335941 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:59:53.335941 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:59:53.335941 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:59:53.335941 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:59:53.335941 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:59:53.335941 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:59:53.335941 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:59:53.335941 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:59:53.335941 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:59:53.335941 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:59:53.335941 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72126702-46a5-4d4c-a6ae-430f43d8fdfb could not be found. Jun 20 11:59:53.335941 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:59:53.335941 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:59:53.335941 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:59:53.335941 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:59:53.335941 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:59:53.335941 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:59:53.335941 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:59:53.335941 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:59:53.335941 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:59:53.337459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:59:53.337459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:59:53.337459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:59:53.337459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:59:53.337459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:59:53.337459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:59:53.337459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:59:53.337459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72126702-46a5-4d4c-a6ae-430f43d8fdfb could not be found. Jun 20 11:59:53.337459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:59:53.337459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:59:53.337459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:59:53.337459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:59:53.337459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:59:53.337459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:59:53.337459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:59:53.337459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:59:53.337459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72126702-46a5-4d4c-a6ae-430f43d8fdfb could not be found. Jun 20 11:59:53.337459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:59:53.338623 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c418806d-b6dc-4695-bc6c-8e36320f7a39 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Returning 404 to user: Instance 72126702-46a5-4d4c-a6ae-430f43d8fdfb could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:59:53.339845 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c418806d-b6dc-4695-bc6c-8e36320f7a39 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/72126702-46a5-4d4c-a6ae-430f43d8fdfb" status: 404 len: 111 microversion: 2.1 time: 0.109959 Jun 20 11:59:53.343227 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 443/902] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:53 2022] GET /compute/v2.1/servers/72126702-46a5-4d4c-a6ae-430f43d8fdfb => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:59:53.359350 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-88ca612c-6245-420a-8837-d859c6a66000 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '.version_select at 0x7f6073ab6a60>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:53.467566 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-88ca612c-6245-420a-8837-d859c6a66000 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/images/3600a08c-de7d-4769-906e-f9294057cb1a" status: 200 len: 1436 microversion: 2.1 time: 0.123067 Jun 20 11:59:53.469434 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 444/903] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 11:59:53 2022] GET /compute/v2.1/images/3600a08c-de7d-4769-906e-f9294057cb1a => generated 1436 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:53.493027 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6570be2a-08b6-4336-b0b3-308ae42f36c7 tempest-FloatingIPsTestJSON-248285424 tempest-FloatingIPsTestJSON-248285424-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 7.886639 Jun 20 11:59:53.493553 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c734f94a-1d87-4785-9fca-a318bc76801e tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:53.494033 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 460/904] 10.222.0.27 () {60 vars in 1169 bytes} [Mon Jun 20 11:59:45 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 7889 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:59:53.499003 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-014c572d-201f-4eb4-981a-aaa12b0d6397 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:53.499417 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-014c572d-201f-4eb4-981a-aaa12b0d6397 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 3c12363c-ee46-445d-af50-77a1f0518a17] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:53.503650 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c734f94a-1d87-4785-9fca-a318bc76801e tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] [instance: 1c763272-042e-418c-b2f6-cc2e96f0c54d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:53.513710 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c734f94a-1d87-4785-9fca-a318bc76801e tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:53.514445 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c734f94a-1d87-4785-9fca-a318bc76801e tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:53.515684 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c734f94a-1d87-4785-9fca-a318bc76801e tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:53.516449 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c734f94a-1d87-4785-9fca-a318bc76801e tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:53.519297 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-014c572d-201f-4eb4-981a-aaa12b0d6397 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:53.519752 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-014c572d-201f-4eb4-981a-aaa12b0d6397 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:53.524922 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-014c572d-201f-4eb4-981a-aaa12b0d6397 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:53.529375 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-014c572d-201f-4eb4-981a-aaa12b0d6397 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:53.866340 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c734f94a-1d87-4785-9fca-a318bc76801e tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f4e0e140c4a839d99b56ee9ffacc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35cecfcbb948c6b60eef6140f87a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:53.890222 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c734f94a-1d87-4785-9fca-a318bc76801e tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] 10.222.0.27 "GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d" status: 200 len: 1371 microversion: 2.1 time: 0.416534 Jun 20 11:59:53.892460 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 445/905] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:53 2022] GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d => generated 1371 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:53.907262 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-51549440-1bff-4694-aeff-4527bf8efaba tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:53.907930 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-51549440-1bff-4694-aeff-4527bf8efaba tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: df847276-3f6d-4fbf-bd7c-defd0d1e633c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:53.921346 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51549440-1bff-4694-aeff-4527bf8efaba tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:53.921798 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51549440-1bff-4694-aeff-4527bf8efaba tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:53.922645 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51549440-1bff-4694-aeff-4527bf8efaba tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:53.923188 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51549440-1bff-4694-aeff-4527bf8efaba tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:53.991189 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-51549440-1bff-4694-aeff-4527bf8efaba tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: df847276-3f6d-4fbf-bd7c-defd0d1e633c] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 11:59:54.001921 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-014c572d-201f-4eb4-981a-aaa12b0d6397 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ad0b87eae43f6b7f6ee8fc60cac9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada715b6fd664c06b9ffcdff7f4ecb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:54.025725 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-014c572d-201f-4eb4-981a-aaa12b0d6397 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17" status: 200 len: 1367 microversion: 2.1 time: 0.530595 Jun 20 11:59:54.031845 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 461/906] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:53 2022] GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17 => generated 1367 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:54.037959 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-de6988d2-7e4d-48ef-993a-c77815ddae35 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:54.038800 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-de6988d2-7e4d-48ef-993a-c77815ddae35 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] [instance: a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:54.048756 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-de6988d2-7e4d-48ef-993a-c77815ddae35 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:54.049211 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-de6988d2-7e4d-48ef-993a-c77815ddae35 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:54.049997 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-de6988d2-7e4d-48ef-993a-c77815ddae35 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:54.050436 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-de6988d2-7e4d-48ef-993a-c77815ddae35 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:54.188228 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-51549440-1bff-4694-aeff-4527bf8efaba tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "DELETE /compute/v2.1/servers/df847276-3f6d-4fbf-bd7c-defd0d1e633c" status: 204 len: 0 microversion: 2.1 time: 0.294293 Jun 20 11:59:54.189555 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 446/907] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 11:59:53 2022] DELETE /compute/v2.1/servers/df847276-3f6d-4fbf-bd7c-defd0d1e633c => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:59:54.204955 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8bc1e64e-50ac-4264-9fc4-5af5cc6fda63 tempest-FloatingIPsTestJSON-248285424 tempest-FloatingIPsTestJSON-248285424-project] Calling method '.version_select at 0x7f6081e67e50>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:54.379564 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-de6988d2-7e4d-48ef-993a-c77815ddae35 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f4477b25804205a497458b38d66883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3842c54af1c84c5ead0c5cf6530df872', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:54.387731 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-de6988d2-7e4d-48ef-993a-c77815ddae35 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/servers/a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0" status: 200 len: 1464 microversion: 2.1 time: 0.354562 Jun 20 11:59:54.393065 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 462/908] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:54 2022] GET /compute/v2.1/servers/a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0 => generated 1464 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:54.405963 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-5d36f00c-32f0-49d8-ac9d-9200a4be419c req-4e4ebdd4-6f17-4420-8fa6-eda203375cbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c763272-042e-418c-b2f6-cc2e96f0c54d", "tag": "b71a2013-f702-4588-976a-47402b05752a"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:59:54.428293 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-5d36f00c-32f0-49d8-ac9d-9200a4be419c req-4e4ebdd4-6f17-4420-8fa6-eda203375cbb service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:54.428798 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-5d36f00c-32f0-49d8-ac9d-9200a4be419c req-4e4ebdd4-6f17-4420-8fa6-eda203375cbb service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:54.461193 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-5d36f00c-32f0-49d8-ac9d-9200a4be419c req-4e4ebdd4-6f17-4420-8fa6-eda203375cbb service nova] Creating event network-changed:b71a2013-f702-4588-976a-47402b05752a for instance 1c763272-042e-418c-b2f6-cc2e96f0c54d on n-h2-master-1 Jun 20 11:59:54.474237 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-5d36f00c-32f0-49d8-ac9d-9200a4be419c req-4e4ebdd4-6f17-4420-8fa6-eda203375cbb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079695 Jun 20 11:59:54.478743 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 463/909] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:59:54.484406 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cd1253fb-5052-48c1-9720-fc3ef7f5a21b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:54.490646 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cd1253fb-5052-48c1-9720-fc3ef7f5a21b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:54.504009 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cd1253fb-5052-48c1-9720-fc3ef7f5a21b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:54.508386 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cd1253fb-5052-48c1-9720-fc3ef7f5a21b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:54.509455 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cd1253fb-5052-48c1-9720-fc3ef7f5a21b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:54.510086 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cd1253fb-5052-48c1-9720-fc3ef7f5a21b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:54.653539 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8bc1e64e-50ac-4264-9fc4-5af5cc6fda63 tempest-FloatingIPsTestJSON-248285424 tempest-FloatingIPsTestJSON-248285424-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/19e22ec1-d628-4287-9237-f73a491ca45b" status: 200 len: 141 microversion: 2.1 time: 0.462470 Jun 20 11:59:54.654418 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 447/910] 10.222.0.27 () {58 vars in 1259 bytes} [Mon Jun 20 11:59:54 2022] GET /compute/v2.1/os-floating-ips/19e22ec1-d628-4287-9237-f73a491ca45b => generated 141 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:59:54.684726 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-da1622b8-2ca2-4d40-8851-374a6d6ab2c3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:54.686032 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-da1622b8-2ca2-4d40-8851-374a6d6ab2c3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: df847276-3f6d-4fbf-bd7c-defd0d1e633c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:54.699392 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da1622b8-2ca2-4d40-8851-374a6d6ab2c3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:54.700371 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da1622b8-2ca2-4d40-8851-374a6d6ab2c3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:54.701419 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da1622b8-2ca2-4d40-8851-374a6d6ab2c3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:54.702314 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da1622b8-2ca2-4d40-8851-374a6d6ab2c3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:54.778627 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-cd1253fb-5052-48c1-9720-fc3ef7f5a21b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:54.790826 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-cd1253fb-5052-48c1-9720-fc3ef7f5a21b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:54.793374 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-cd1253fb-5052-48c1-9720-fc3ef7f5a21b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:54.796288 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cd1253fb-5052-48c1-9720-fc3ef7f5a21b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1411 microversion: 2.25 time: 0.315915 Jun 20 11:59:54.797426 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 464/911] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:59:54 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1411 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:59:54.802483 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8f94a50f-26b6-492a-b229-7b4a4f36da45 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '.version_select at 0x7f6073b139d0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:54.913215 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-da1622b8-2ca2-4d40-8851-374a6d6ab2c3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:54.921759 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-da1622b8-2ca2-4d40-8851-374a6d6ab2c3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/df847276-3f6d-4fbf-bd7c-defd0d1e633c" status: 200 len: 1471 microversion: 2.1 time: 0.266246 Jun 20 11:59:54.931603 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 448/912] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:54 2022] GET /compute/v2.1/servers/df847276-3f6d-4fbf-bd7c-defd0d1e633c => generated 1471 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:54.937345 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c93f4279-4a07-4de2-a70d-7dc42936ec72 tempest-FloatingIPsTestJSON-248285424 tempest-FloatingIPsTestJSON-248285424-project] Calling method '.version_select at 0x7f6073be9e50>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:55.229273 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c93f4279-4a07-4de2-a70d-7dc42936ec72 tempest-FloatingIPsTestJSON-248285424 tempest-FloatingIPsTestJSON-248285424-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.296454 Jun 20 11:59:55.237959 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 449/913] 10.222.0.27 () {58 vars in 1148 bytes} [Mon Jun 20 11:59:54 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:59:55.243834 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9fdec320-f174-420c-8f3e-8877023e0d9d tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:55.244878 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9fdec320-f174-420c-8f3e-8877023e0d9d tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] [instance: 1c763272-042e-418c-b2f6-cc2e96f0c54d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:55.258901 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9fdec320-f174-420c-8f3e-8877023e0d9d tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:55.259376 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9fdec320-f174-420c-8f3e-8877023e0d9d tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:55.261339 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9fdec320-f174-420c-8f3e-8877023e0d9d tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:55.262929 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9fdec320-f174-420c-8f3e-8877023e0d9d tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:55.540152 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9fdec320-f174-420c-8f3e-8877023e0d9d tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f4e0e140c4a839d99b56ee9ffacc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35cecfcbb948c6b60eef6140f87a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:55.553809 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9fdec320-f174-420c-8f3e-8877023e0d9d tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] 10.222.0.27 "GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d" status: 200 len: 1371 microversion: 2.1 time: 0.314668 Jun 20 11:59:55.558790 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 450/914] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:55 2022] GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d => generated 1371 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:55.580636 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b513cc09-a82f-4fd0-8b81-e0fb2c1bff88 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:55.581467 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b513cc09-a82f-4fd0-8b81-e0fb2c1bff88 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 3c12363c-ee46-445d-af50-77a1f0518a17] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:55.590625 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b513cc09-a82f-4fd0-8b81-e0fb2c1bff88 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:55.591501 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b513cc09-a82f-4fd0-8b81-e0fb2c1bff88 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:55.593067 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b513cc09-a82f-4fd0-8b81-e0fb2c1bff88 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:55.594914 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b513cc09-a82f-4fd0-8b81-e0fb2c1bff88 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:56.229061 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8f94a50f-26b6-492a-b229-7b4a4f36da45 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "DELETE /compute/v2.1/images/3600a08c-de7d-4769-906e-f9294057cb1a" status: 204 len: 0 microversion: 2.1 time: 1.430138 Jun 20 11:59:56.229908 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 465/915] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:54 2022] DELETE /compute/v2.1/images/3600a08c-de7d-4769-906e-f9294057cb1a => generated 0 bytes in 1431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:59:56.234691 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-469f6eaf-325d-4cf1-80c2-3cf2356ccca1 req-527786ce-6130-4d13-9cf8-3483fd2cfef7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c12363c-ee46-445d-af50-77a1f0518a17", "name": "network-vif-plugged", "status": "completed", "tag": "0633c2cf-5ad3-4f49-95ea-6201e1ac2cc0"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:59:56.254883 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-469f6eaf-325d-4cf1-80c2-3cf2356ccca1 req-527786ce-6130-4d13-9cf8-3483fd2cfef7 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:56.263004 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-469f6eaf-325d-4cf1-80c2-3cf2356ccca1 req-527786ce-6130-4d13-9cf8-3483fd2cfef7 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:56.293078 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-469f6eaf-325d-4cf1-80c2-3cf2356ccca1 req-527786ce-6130-4d13-9cf8-3483fd2cfef7 service nova] Creating event network-vif-plugged:0633c2cf-5ad3-4f49-95ea-6201e1ac2cc0 for instance 3c12363c-ee46-445d-af50-77a1f0518a17 on n-h1-master-1 Jun 20 11:59:56.317403 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-469f6eaf-325d-4cf1-80c2-3cf2356ccca1 req-527786ce-6130-4d13-9cf8-3483fd2cfef7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085531 Jun 20 11:59:56.318269 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 466/916] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:59:56.339749 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-076b5ed2-e612-476d-b08b-ba092e7ddd66 tempest-FloatingIPsTestJSON-248285424 tempest-FloatingIPsTestJSON-248285424-project] Calling method '.version_select at 0x7f6073901040>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:57.012064 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b513cc09-a82f-4fd0-8b81-e0fb2c1bff88 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ad0b87eae43f6b7f6ee8fc60cac9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada715b6fd664c06b9ffcdff7f4ecb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:57.031699 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b513cc09-a82f-4fd0-8b81-e0fb2c1bff88 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17" status: 200 len: 1367 microversion: 2.1 time: 1.470701 Jun 20 11:59:57.032310 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 451/917] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:55 2022] GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17 => generated 1367 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:57.041209 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b0f27361-23a0-474a-9390-e95f82d5b102 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:57.041209 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b0f27361-23a0-474a-9390-e95f82d5b102 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:57.058482 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b0f27361-23a0-474a-9390-e95f82d5b102 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:57.058924 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b0f27361-23a0-474a-9390-e95f82d5b102 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:57.071555 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b0f27361-23a0-474a-9390-e95f82d5b102 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:57.072304 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b0f27361-23a0-474a-9390-e95f82d5b102 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:57.493176 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b0f27361-23a0-474a-9390-e95f82d5b102 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:57.503628 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b0f27361-23a0-474a-9390-e95f82d5b102 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:57.506274 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b0f27361-23a0-474a-9390-e95f82d5b102 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:57.510498 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b0f27361-23a0-474a-9390-e95f82d5b102 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1411 microversion: 2.25 time: 0.477091 Jun 20 11:59:57.513040 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 452/918] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:59:57 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1411 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:59:57.523205 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ba3b092a-33fc-4e97-a2d8-88396522364f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:57.524102 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ba3b092a-33fc-4e97-a2d8-88396522364f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: df847276-3f6d-4fbf-bd7c-defd0d1e633c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:57.536789 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ba3b092a-33fc-4e97-a2d8-88396522364f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:57.541214 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ba3b092a-33fc-4e97-a2d8-88396522364f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:57.543524 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ba3b092a-33fc-4e97-a2d8-88396522364f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:57.546479 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ba3b092a-33fc-4e97-a2d8-88396522364f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:58.432136 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ba3b092a-33fc-4e97-a2d8-88396522364f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:58.449202 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ba3b092a-33fc-4e97-a2d8-88396522364f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/df847276-3f6d-4fbf-bd7c-defd0d1e633c" status: 200 len: 1471 microversion: 2.1 time: 0.930301 Jun 20 11:59:58.455753 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 453/919] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:57 2022] GET /compute/v2.1/servers/df847276-3f6d-4fbf-bd7c-defd0d1e633c => generated 1471 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:58.466942 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1837e6df-d8e4-43ab-89af-f3775c964b6a tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '.version_select at 0x7f6073ca4700>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:58.571533 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-1837e6df-d8e4-43ab-89af-f3775c964b6a tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] HTTP exception thrown: Image not found. Jun 20 11:59:58.573561 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1837e6df-d8e4-43ab-89af-f3775c964b6a tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Request method failure captured: Jun 20 11:59:58.573561 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/images/dc3eda0e-770b-433b-861a-25a8d5c351a7 HTTP/1.1 Jun 20 11:59:58.573561 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 11:59:58.573561 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 11:59:58.573561 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 11:59:58.573561 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 11:59:58.573561 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 11:59:58.573561 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 11:59:58.573561 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 11:59:58.573561 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 11:59:58.573561 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGDXcoKLNnHk5Vd41xldZubTKAqVDvS1k_2LbhmvUD-6WypmR1ISt9eElY5yAacPbdpKNt2MkSTDbx6BooHUcU0GDvHVyyc3t-jzMKy0stovmf5GQMf0x9V3pGqV-V25xV1nyzNlRm1q-22x0oehPhdxFTyFC5pZoQrxEE9Wsq1Bl9Y Jun 20 11:59:58.573561 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 11:59:58.573561 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 11:59:58.573561 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 11:59:58.573561 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 11:59:58.573561 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 11:59:58.573561 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 11:59:58.573561 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 3842c54af1c84c5ead0c5cf6530df872 Jun 20 11:59:58.573561 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ImagesOneServerTestJSON-498983894 Jun 20 11:59:58.573561 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 11:59:58.573561 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 11:59:58.575277 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3842c54af1c84c5ead0c5cf6530df872"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3842c54af1c84c5ead0c5cf6530df872"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3842c54af1c84c5ead0c5cf6530df872"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3842c54af1c84c5ead0c5cf6530df872"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 11:59:58.575277 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ImagesOneServerTestJSON-498983894 Jun 20 11:59:58.575277 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 3842c54af1c84c5ead0c5cf6530df872 Jun 20 11:59:58.575277 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-498983894 Jun 20 11:59:58.575277 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ImagesOneServerTestJSON-498983894-project Jun 20 11:59:58.575277 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 11:59:58.575277 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 11:59:58.575277 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 04f4477b25804205a497458b38d66883 Jun 20 11:59:58.575277 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ImagesOneServerTestJSON-498983894-project Jun 20 11:59:58.575277 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 11:59:58.575277 n-d-master-1 devstack@n-api.service[119127]: exception: Image not found. Jun 20 11:59:58.575277 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'dc3eda0e-770b-433b-861a-25a8d5c351a7'} Jun 20 11:59:58.575277 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:59:58.575277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:59:58.576380 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 20 11:59:58.576380 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 20 11:59:58.576380 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 20 11:59:58.576380 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 20 11:59:58.576380 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 20 11:59:58.576380 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 20 11:59:58.576380 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 20 11:59:58.576380 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 20 11:59:58.576380 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 20 11:59:58.576380 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 20 11:59:58.576380 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 20 11:59:58.576380 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 20 11:59:58.576380 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 20 11:59:58.576380 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 20 11:59:58.576380 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image dc3eda0e-770b-433b-861a-25a8d5c351a7 to delete Jun 20 11:59:58.576380 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:59:58.576380 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:59:58.576380 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:59:58.576380 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:59:58.577989 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 20 11:59:58.577989 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 20 11:59:58.577989 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 20 11:59:58.577989 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 20 11:59:58.577989 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 20 11:59:58.577989 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 20 11:59:58.577989 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image dc3eda0e-770b-433b-861a-25a8d5c351a7 could not be found. Jun 20 11:59:58.577989 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:59:58.577989 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:59:58.577989 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:59:58.577989 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:59:58.577989 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:59:58.577989 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:59:58.577989 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:59:58.577989 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:59:58.577989 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 11:59:58.577989 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 11:59:58.577989 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:59:58.577989 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:59:58.577989 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 20 11:59:58.579558 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 20 11:59:58.579558 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 20 11:59:58.579558 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:59:58.579558 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:59:58.579558 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:59:58.579558 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:59:58.579558 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:59:58.579558 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:59:58.579558 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:59:58.579558 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:59:58.579558 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 20 11:59:58.579558 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 11:59:58.579558 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1837e6df-d8e4-43ab-89af-f3775c964b6a tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Returning 404 to user: Image not found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:59:58.579558 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1837e6df-d8e4-43ab-89af-f3775c964b6a tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "DELETE /compute/v2.1/images/dc3eda0e-770b-433b-861a-25a8d5c351a7" status: 404 len: 62 microversion: 2.1 time: 0.112267 Jun 20 11:59:58.579558 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 454/920] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:58 2022] DELETE /compute/v2.1/images/dc3eda0e-770b-433b-861a-25a8d5c351a7 => generated 62 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 11:59:58.608628 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ba572cf1-5043-42f6-a3be-97e7140b0631 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:58.611630 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ba572cf1-5043-42f6-a3be-97e7140b0631 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] [instance: 1c763272-042e-418c-b2f6-cc2e96f0c54d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:58.650701 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ba572cf1-5043-42f6-a3be-97e7140b0631 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:58.657096 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ba572cf1-5043-42f6-a3be-97e7140b0631 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:58.672123 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ba572cf1-5043-42f6-a3be-97e7140b0631 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:58.673030 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ba572cf1-5043-42f6-a3be-97e7140b0631 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:59.160647 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-076b5ed2-e612-476d-b08b-ba092e7ddd66 tempest-FloatingIPsTestJSON-248285424 tempest-FloatingIPsTestJSON-248285424-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/19e22ec1-d628-4287-9237-f73a491ca45b" status: 202 len: 0 microversion: 2.1 time: 2.838342 Jun 20 11:59:59.165658 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 467/921] 10.222.0.27 () {58 vars in 1262 bytes} [Mon Jun 20 11:59:56 2022] DELETE /compute/v2.1/os-floating-ips/19e22ec1-d628-4287-9237-f73a491ca45b => generated 0 bytes in 2846 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:59:59.170623 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-716d52ef-0b7a-4080-938d-205efccff9b4 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:59.178388 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-716d52ef-0b7a-4080-938d-205efccff9b4 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 3c12363c-ee46-445d-af50-77a1f0518a17] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:59.201734 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=88,nova_api:INSERT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:59:59.227196 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-716d52ef-0b7a-4080-938d-205efccff9b4 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:59.228132 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-716d52ef-0b7a-4080-938d-205efccff9b4 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:59.229695 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-716d52ef-0b7a-4080-938d-205efccff9b4 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:59.232974 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-716d52ef-0b7a-4080-938d-205efccff9b4 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:59.377497 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ba572cf1-5043-42f6-a3be-97e7140b0631 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f4e0e140c4a839d99b56ee9ffacc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35cecfcbb948c6b60eef6140f87a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:59.392611 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ba572cf1-5043-42f6-a3be-97e7140b0631 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] 10.222.0.27 "GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d" status: 200 len: 1371 microversion: 2.1 time: 0.815384 Jun 20 11:59:59.394019 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 455/922] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:58 2022] GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d => generated 1371 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:59.411707 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-f101a75c-6378-4aef-a029-5dd76ac3ff23 req-87ecefa9-92a8-4977-ae9b-d68e16daa975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0", "name": "network-vif-unplugged", "status": "completed", "tag": "736a1975-6c4b-4f19-83da-ab507fc213c8"}, {"server_uuid": "3db0bd7d-eed4-411a-a7b8-719b260233ed", "name": "network-vif-plugged", "status": "completed", "tag": "66a1f7cd-2c10-48c8-8f30-83c32f1d6186"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:59:59.437048 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-f101a75c-6378-4aef-a029-5dd76ac3ff23 req-87ecefa9-92a8-4977-ae9b-d68e16daa975 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:59.440352 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-f101a75c-6378-4aef-a029-5dd76ac3ff23 req-87ecefa9-92a8-4977-ae9b-d68e16daa975 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:59.490032 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-f101a75c-6378-4aef-a029-5dd76ac3ff23 req-87ecefa9-92a8-4977-ae9b-d68e16daa975 service nova] Creating event network-vif-unplugged:736a1975-6c4b-4f19-83da-ab507fc213c8 for instance a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0 on n-h1-master-1 Jun 20 11:59:59.490689 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-f101a75c-6378-4aef-a029-5dd76ac3ff23 req-87ecefa9-92a8-4977-ae9b-d68e16daa975 service nova] Creating event network-vif-plugged:66a1f7cd-2c10-48c8-8f30-83c32f1d6186 for instance 3db0bd7d-eed4-411a-a7b8-719b260233ed on n-h2-master-1 Jun 20 11:59:59.491059 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-716d52ef-0b7a-4080-938d-205efccff9b4 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ad0b87eae43f6b7f6ee8fc60cac9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada715b6fd664c06b9ffcdff7f4ecb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:59.502024 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-716d52ef-0b7a-4080-938d-205efccff9b4 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17" status: 200 len: 1557 microversion: 2.1 time: 0.332944 Jun 20 11:59:59.502628 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 468/923] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:59 2022] GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17 => generated 1557 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:59:59.513547 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-36a8ce09-1dc9-440b-8dfb-04c12e979c6b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:59.514215 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-36a8ce09-1dc9-440b-8dfb-04c12e979c6b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:59.518281 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-f101a75c-6378-4aef-a029-5dd76ac3ff23 req-87ecefa9-92a8-4977-ae9b-d68e16daa975 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.122558 Jun 20 11:59:59.523294 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 456/924] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:59:59.526894 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-36a8ce09-1dc9-440b-8dfb-04c12e979c6b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:59.528895 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-36a8ce09-1dc9-440b-8dfb-04c12e979c6b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:59.531027 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-36a8ce09-1dc9-440b-8dfb-04c12e979c6b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:59.531476 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-36a8ce09-1dc9-440b-8dfb-04c12e979c6b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:59.539416 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6f222426-a6a3-4e89-9419-0c41cd678398 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:59.541003 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6f222426-a6a3-4e89-9419-0c41cd678398 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] [instance: a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:59.552692 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6f222426-a6a3-4e89-9419-0c41cd678398 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:59.553676 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6f222426-a6a3-4e89-9419-0c41cd678398 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:59.555519 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6f222426-a6a3-4e89-9419-0c41cd678398 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:59.556305 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6f222426-a6a3-4e89-9419-0c41cd678398 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:59.589124 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6f222426-a6a3-4e89-9419-0c41cd678398 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] [instance: a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 11:59:59.640487 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:59:59.761176 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6f222426-a6a3-4e89-9419-0c41cd678398 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0" status: 204 len: 0 microversion: 2.1 time: 0.235537 Jun 20 11:59:59.762499 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 457/925] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 11:59:59 2022] DELETE /compute/v2.1/servers/a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:59:59.775933 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-47d0ce1d-1542-4236-b0da-e45758b13e7d req-7f412e91-a759-4073-9555-57cd9c0ae5e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df847276-3f6d-4fbf-bd7c-defd0d1e633c", "name": "network-vif-deleted", "tag": "cc9f210a-49d7-439a-8602-57e97b5de3d0"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:59:59.792435 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-47d0ce1d-1542-4236-b0da-e45758b13e7d req-7f412e91-a759-4073-9555-57cd9c0ae5e2 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:59.799845 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-47d0ce1d-1542-4236-b0da-e45758b13e7d req-7f412e91-a759-4073-9555-57cd9c0ae5e2 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:59.807262 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-36a8ce09-1dc9-440b-8dfb-04c12e979c6b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:59.819652 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-36a8ce09-1dc9-440b-8dfb-04c12e979c6b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:59.821193 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-36a8ce09-1dc9-440b-8dfb-04c12e979c6b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:59:59.822336 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-36a8ce09-1dc9-440b-8dfb-04c12e979c6b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1411 microversion: 2.25 time: 0.318078 Jun 20 11:59:59.823797 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-47d0ce1d-1542-4236-b0da-e45758b13e7d req-7f412e91-a759-4073-9555-57cd9c0ae5e2 service nova] Creating event network-vif-deleted:cc9f210a-49d7-439a-8602-57e97b5de3d0 for instance df847276-3f6d-4fbf-bd7c-defd0d1e633c on n-h2-master-1 Jun 20 11:59:59.828508 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 469/926] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 11:59:59 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1411 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:59:59.833323 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cb4cf49e-7c05-4957-86b8-dd123d90aa9a tempest-FloatingIPsTestJSON-248285424 tempest-FloatingIPsTestJSON-248285424-project] Action: 'create', calling method: .version_select at 0x7f6073968790>, body: {"pool": null} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:59:59.841704 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-47d0ce1d-1542-4236-b0da-e45758b13e7d req-7f412e91-a759-4073-9555-57cd9c0ae5e2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077558 Jun 20 11:59:59.842624 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 458/927] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 11:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:59:59.853173 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d9b7c746-b047-4f83-9792-c9bfc8761e05 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:59:59.854110 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d9b7c746-b047-4f83-9792-c9bfc8761e05 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: df847276-3f6d-4fbf-bd7c-defd0d1e633c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:59:59.881710 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9b7c746-b047-4f83-9792-c9bfc8761e05 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:59.881710 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9b7c746-b047-4f83-9792-c9bfc8761e05 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:59.881710 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9b7c746-b047-4f83-9792-c9bfc8761e05 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:59.881710 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9b7c746-b047-4f83-9792-c9bfc8761e05 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:59.961876 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9b7c746-b047-4f83-9792-c9bfc8761e05 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:59:59.962324 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9b7c746-b047-4f83-9792-c9bfc8761e05 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:59:59.962782 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-d9b7c746-b047-4f83-9792-c9bfc8761e05 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lazy-loading 'fault' on Instance uuid df847276-3f6d-4fbf-bd7c-defd0d1e633c {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:00:00.069359 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d9b7c746-b047-4f83-9792-c9bfc8761e05 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:00.085842 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d9b7c746-b047-4f83-9792-c9bfc8761e05 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/df847276-3f6d-4fbf-bd7c-defd0d1e633c" status: 200 len: 1306 microversion: 2.1 time: 0.242084 Jun 20 12:00:00.096116 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 459/928] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 11:59:59 2022] GET /compute/v2.1/servers/df847276-3f6d-4fbf-bd7c-defd0d1e633c => generated 1306 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:00.096116 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-92f78ed0-07cc-40d0-b225-a2f40c5a3b13 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:00.096116 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-92f78ed0-07cc-40d0-b225-a2f40c5a3b13 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 3c12363c-ee46-445d-af50-77a1f0518a17] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:00.111839 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-92f78ed0-07cc-40d0-b225-a2f40c5a3b13 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:00.112326 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-92f78ed0-07cc-40d0-b225-a2f40c5a3b13 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:00.113089 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-92f78ed0-07cc-40d0-b225-a2f40c5a3b13 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:00.113520 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-92f78ed0-07cc-40d0-b225-a2f40c5a3b13 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:00.523323 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-92f78ed0-07cc-40d0-b225-a2f40c5a3b13 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.434044 Jun 20 12:00:00.524971 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 460/929] 10.222.0.27 () {58 vars in 1274 bytes} [Mon Jun 20 12:00:00 2022] GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17/os-interface => generated 284 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:00:00.536462 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-51688675-120f-4054-87fd-d1d8f12bde3b tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:00.537360 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-51688675-120f-4054-87fd-d1d8f12bde3b tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] [instance: a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:00.550890 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51688675-120f-4054-87fd-d1d8f12bde3b tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:00.551662 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51688675-120f-4054-87fd-d1d8f12bde3b tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:00.553084 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51688675-120f-4054-87fd-d1d8f12bde3b tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:00.555164 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51688675-120f-4054-87fd-d1d8f12bde3b tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:01.250531 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-51688675-120f-4054-87fd-d1d8f12bde3b tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f4477b25804205a497458b38d66883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3842c54af1c84c5ead0c5cf6530df872', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:01.264919 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-51688675-120f-4054-87fd-d1d8f12bde3b tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/servers/a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0" status: 200 len: 1470 microversion: 2.1 time: 0.738278 Jun 20 12:00:01.275001 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 461/930] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:00 2022] GET /compute/v2.1/servers/a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0 => generated 1470 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:01.275001 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3777b3c8-8079-46bc-8fb2-018d78c7f908 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:01.275001 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3777b3c8-8079-46bc-8fb2-018d78c7f908 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] [instance: 1c763272-042e-418c-b2f6-cc2e96f0c54d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:01.290552 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3777b3c8-8079-46bc-8fb2-018d78c7f908 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:01.290859 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3777b3c8-8079-46bc-8fb2-018d78c7f908 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:01.291667 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3777b3c8-8079-46bc-8fb2-018d78c7f908 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:01.292157 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3777b3c8-8079-46bc-8fb2-018d78c7f908 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:02.104538 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3777b3c8-8079-46bc-8fb2-018d78c7f908 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f4e0e140c4a839d99b56ee9ffacc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35cecfcbb948c6b60eef6140f87a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:02.112365 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3777b3c8-8079-46bc-8fb2-018d78c7f908 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] 10.222.0.27 "GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d" status: 200 len: 1371 microversion: 2.1 time: 0.845739 Jun 20 12:00:02.121793 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 462/931] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:01 2022] GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d => generated 1371 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:02.125773 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-85742460-4c9a-4001-9bb7-6a7b69543722 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:02.126385 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-85742460-4c9a-4001-9bb7-6a7b69543722 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:02.139993 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-85742460-4c9a-4001-9bb7-6a7b69543722 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:02.148679 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-85742460-4c9a-4001-9bb7-6a7b69543722 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:02.149720 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-85742460-4c9a-4001-9bb7-6a7b69543722 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:02.150161 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-85742460-4c9a-4001-9bb7-6a7b69543722 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:02.178594 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cb4cf49e-7c05-4957-86b8-dd123d90aa9a tempest-FloatingIPsTestJSON-248285424 tempest-FloatingIPsTestJSON-248285424-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.348929 Jun 20 12:00:02.180286 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 470/932] 10.222.0.27 () {60 vars in 1169 bytes} [Mon Jun 20 11:59:59 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:00:02.191745 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0e0b9776-30bf-43ef-bd2f-9fc67d5c6663 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:02.192784 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0e0b9776-30bf-43ef-bd2f-9fc67d5c6663 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: df847276-3f6d-4fbf-bd7c-defd0d1e633c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:02.215831 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0e0b9776-30bf-43ef-bd2f-9fc67d5c6663 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:02.216762 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0e0b9776-30bf-43ef-bd2f-9fc67d5c6663 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:02.218736 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0e0b9776-30bf-43ef-bd2f-9fc67d5c6663 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:02.220335 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0e0b9776-30bf-43ef-bd2f-9fc67d5c6663 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:02.263514 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0e0b9776-30bf-43ef-bd2f-9fc67d5c6663 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:02.264252 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0e0b9776-30bf-43ef-bd2f-9fc67d5c6663 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:02.264939 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-0e0b9776-30bf-43ef-bd2f-9fc67d5c6663 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lazy-loading 'fault' on Instance uuid df847276-3f6d-4fbf-bd7c-defd0d1e633c {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:00:02.351961 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0e0b9776-30bf-43ef-bd2f-9fc67d5c6663 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:02.364277 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0e0b9776-30bf-43ef-bd2f-9fc67d5c6663 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/df847276-3f6d-4fbf-bd7c-defd0d1e633c" status: 200 len: 1306 microversion: 2.1 time: 0.182255 Jun 20 12:00:02.370996 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 471/933] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:02 2022] GET /compute/v2.1/servers/df847276-3f6d-4fbf-bd7c-defd0d1e633c => generated 1306 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:02.383998 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1658f56d-3c70-4e4b-b754-460d9ff1e5da tempest-FloatingIPsTestJSON-248285424 tempest-FloatingIPsTestJSON-248285424-project] Calling method '.version_select at 0x7f607385e940>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:02.719737 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-85742460-4c9a-4001-9bb7-6a7b69543722 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:02.730705 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-85742460-4c9a-4001-9bb7-6a7b69543722 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:02.732867 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-85742460-4c9a-4001-9bb7-6a7b69543722 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:02.734266 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-85742460-4c9a-4001-9bb7-6a7b69543722 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1411 microversion: 2.25 time: 0.616442 Jun 20 12:00:02.734798 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 463/934] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:00:02 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1411 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:00:02.749314 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6bc6a1b5-9b51-4614-b2ca-b040be9844df tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:02.749972 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6bc6a1b5-9b51-4614-b2ca-b040be9844df tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] [instance: a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:02.761086 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6bc6a1b5-9b51-4614-b2ca-b040be9844df tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:02.762133 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6bc6a1b5-9b51-4614-b2ca-b040be9844df tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:02.762973 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6bc6a1b5-9b51-4614-b2ca-b040be9844df tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:02.763605 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6bc6a1b5-9b51-4614-b2ca-b040be9844df tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:03.255889 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6bc6a1b5-9b51-4614-b2ca-b040be9844df tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f4477b25804205a497458b38d66883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3842c54af1c84c5ead0c5cf6530df872', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:03.269248 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1658f56d-3c70-4e4b-b754-460d9ff1e5da tempest-FloatingIPsTestJSON-248285424 tempest-FloatingIPsTestJSON-248285424-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/a60f0d7e-64bf-42f5-84cf-59cd97ce93ef" status: 202 len: 0 microversion: 2.1 time: 0.895356 Jun 20 12:00:03.270497 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 472/935] 10.222.0.27 () {58 vars in 1262 bytes} [Mon Jun 20 12:00:02 2022] DELETE /compute/v2.1/os-floating-ips/a60f0d7e-64bf-42f5-84cf-59cd97ce93ef => generated 0 bytes in 899 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:00:03.275456 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6bc6a1b5-9b51-4614-b2ca-b040be9844df tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/servers/a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0" status: 200 len: 1470 microversion: 2.1 time: 0.537198 Jun 20 12:00:03.276519 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b097ebb1-53e6-43ea-930e-31d5e1008bdd tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:03.277400 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b097ebb1-53e6-43ea-930e-31d5e1008bdd tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] [instance: 1c763272-042e-418c-b2f6-cc2e96f0c54d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:03.285182 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b097ebb1-53e6-43ea-930e-31d5e1008bdd tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:03.285959 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b097ebb1-53e6-43ea-930e-31d5e1008bdd tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:03.286975 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b097ebb1-53e6-43ea-930e-31d5e1008bdd tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:03.287654 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b097ebb1-53e6-43ea-930e-31d5e1008bdd tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:03.289918 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 464/936] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:02 2022] GET /compute/v2.1/servers/a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0 => generated 1470 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:03.300252 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-25ff531e-4125-461b-be74-da16e6598bb4 tempest-FloatingIPsTestJSON-248285424 tempest-FloatingIPsTestJSON-248285424-project] Calling method '.version_select at 0x7f6073a1eb80>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:03.376468 n-d-master-1 devstack@n-api.service[119127]: DEBUG neutronclient.v2_0.client [None req-25ff531e-4125-461b-be74-da16e6598bb4 tempest-FloatingIPsTestJSON-248285424 tempest-FloatingIPsTestJSON-248285424-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a60f0d7e-64bf-42f5-84cf-59cd97ce93ef could not be found", "detail": ""}} {{(pid=119127) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 20 12:00:03.377240 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-25ff531e-4125-461b-be74-da16e6598bb4 tempest-FloatingIPsTestJSON-248285424 tempest-FloatingIPsTestJSON-248285424-project] HTTP exception thrown: Floating IP not found for ID a60f0d7e-64bf-42f5-84cf-59cd97ce93ef Jun 20 12:00:03.382954 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-25ff531e-4125-461b-be74-da16e6598bb4 tempest-FloatingIPsTestJSON-248285424 tempest-FloatingIPsTestJSON-248285424-project] Request method failure captured: Jun 20 12:00:03.382954 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/os-floating-ips/a60f0d7e-64bf-42f5-84cf-59cd97ce93ef HTTP/1.1 Jun 20 12:00:03.382954 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:00:03.382954 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:00:03.382954 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:00:03.382954 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:00:03.382954 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:00:03.382954 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:00:03.382954 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:00:03.382954 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:00:03.382954 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGExYNeZYR9t7UWN8JZkasbj08M8qgeBmPGMdqY8aWogzsBylhLZCA1EoaxW8NBVTe1oy-5gXNbZcqygsf15ZZsLTBT6EVIrUOZzHzxQvCBdmotwDkUS__DaOX9K0BcX-g8WSxatJW87E0tyqwWHWyihS-NVJXjAJnTz2WgfD0INEyI Jun 20 12:00:03.382954 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:00:03.382954 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:00:03.382954 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:00:03.382954 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:00:03.382954 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:00:03.382954 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:00:03.382954 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 3983d3614d554269b5fc1cc6eafe6409 Jun 20 12:00:03.382954 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-FloatingIPsTestJSON-248285424 Jun 20 12:00:03.382954 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:00:03.382954 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:00:03.384817 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3983d3614d554269b5fc1cc6eafe6409"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3983d3614d554269b5fc1cc6eafe6409"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3983d3614d554269b5fc1cc6eafe6409"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3983d3614d554269b5fc1cc6eafe6409"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:00:03.384817 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-FloatingIPsTestJSON-248285424 Jun 20 12:00:03.384817 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 3983d3614d554269b5fc1cc6eafe6409 Jun 20 12:00:03.384817 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-FloatingIPsTestJSON-248285424 Jun 20 12:00:03.384817 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-FloatingIPsTestJSON-248285424-project Jun 20 12:00:03.384817 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:00:03.384817 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:00:03.384817 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: b01e342220604060b115c89ce0a1d188 Jun 20 12:00:03.384817 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-FloatingIPsTestJSON-248285424-project Jun 20 12:00:03.384817 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 12:00:03.384817 n-d-master-1 devstack@n-api.service[119127]: exception: Floating IP not found for ID a60f0d7e-64bf-42f5-84cf-59cd97ce93ef Jun 20 12:00:03.384817 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'a60f0d7e-64bf-42f5-84cf-59cd97ce93ef'} Jun 20 12:00:03.384817 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:00:03.385873 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:03.385873 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jun 20 12:00:03.385873 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jun 20 12:00:03.385873 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:00:03.385873 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:00:03.385873 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jun 20 12:00:03.385873 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jun 20 12:00:03.385873 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:00:03.385873 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:00:03.385873 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 20 12:00:03.385873 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 20 12:00:03.385873 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:00:03.385873 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:00:03.385873 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 20 12:00:03.385873 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 20 12:00:03.385873 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:00:03.385873 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:00:03.385873 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 20 12:00:03.385873 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 20 12:00:03.387573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:00:03.387573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:00:03.387573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 20 12:00:03.387573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 20 12:00:03.387573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 20 12:00:03.387573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 20 12:00:03.387573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a60f0d7e-64bf-42f5-84cf-59cd97ce93ef could not be found Jun 20 12:00:03.387573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-87469d07-e08b-45cc-ba80-0e3e01df5fea'] Jun 20 12:00:03.387573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:03.387573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:03.387573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:03.387573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:03.387573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jun 20 12:00:03.387573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jun 20 12:00:03.387573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jun 20 12:00:03.387573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jun 20 12:00:03.387573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a60f0d7e-64bf-42f5-84cf-59cd97ce93ef. Jun 20 12:00:03.387573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:03.387573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:03.387573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:03.389408 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:03.389408 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:03.389408 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:03.389408 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:00:03.389408 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:00:03.389408 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:00:03.389408 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:00:03.389408 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:00:03.389408 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:00:03.389408 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jun 20 12:00:03.389408 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 20 12:00:03.389408 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a60f0d7e-64bf-42f5-84cf-59cd97ce93ef Jun 20 12:00:03.389408 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:03.389408 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:03.389408 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:03.389408 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:03.389408 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:03.389408 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:03.389408 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:00:03.389408 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:00:03.391147 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a60f0d7e-64bf-42f5-84cf-59cd97ce93ef Jun 20 12:00:03.391147 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:03.391147 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-25ff531e-4125-461b-be74-da16e6598bb4 tempest-FloatingIPsTestJSON-248285424 tempest-FloatingIPsTestJSON-248285424-project] Returning 404 to user: Floating IP not found for ID a60f0d7e-64bf-42f5-84cf-59cd97ce93ef {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:00:03.391147 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-25ff531e-4125-461b-be74-da16e6598bb4 tempest-FloatingIPsTestJSON-248285424 tempest-FloatingIPsTestJSON-248285424-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/a60f0d7e-64bf-42f5-84cf-59cd97ce93ef" status: 404 len: 111 microversion: 2.1 time: 0.093855 Jun 20 12:00:03.391147 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 465/937] 10.222.0.27 () {58 vars in 1259 bytes} [Mon Jun 20 12:00:03 2022] GET /compute/v2.1/os-floating-ips/a60f0d7e-64bf-42f5-84cf-59cd97ce93ef => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:00:03.394553 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0350352f-8f54-4abd-bc85-6689cafe7300 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:03.395597 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0350352f-8f54-4abd-bc85-6689cafe7300 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: df847276-3f6d-4fbf-bd7c-defd0d1e633c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:03.403573 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0350352f-8f54-4abd-bc85-6689cafe7300 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:03.403938 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0350352f-8f54-4abd-bc85-6689cafe7300 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:03.404744 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0350352f-8f54-4abd-bc85-6689cafe7300 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:03.405837 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0350352f-8f54-4abd-bc85-6689cafe7300 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:03.442215 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0350352f-8f54-4abd-bc85-6689cafe7300 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:03.442798 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0350352f-8f54-4abd-bc85-6689cafe7300 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:03.443261 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-0350352f-8f54-4abd-bc85-6689cafe7300 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lazy-loading 'fault' on Instance uuid df847276-3f6d-4fbf-bd7c-defd0d1e633c {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:00:03.458132 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b097ebb1-53e6-43ea-930e-31d5e1008bdd tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f4e0e140c4a839d99b56ee9ffacc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35cecfcbb948c6b60eef6140f87a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:03.469248 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b097ebb1-53e6-43ea-930e-31d5e1008bdd tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] 10.222.0.27 "GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d" status: 200 len: 1371 microversion: 2.1 time: 0.197403 Jun 20 12:00:03.480564 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 473/938] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:03 2022] GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d => generated 1371 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:03.485872 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d517fdbd-3bdc-4b2d-bb57-fdbfdef41c1b tempest-FloatingIPsTestJSON-248285424 tempest-FloatingIPsTestJSON-248285424-project] Calling method '.version_select at 0x7f6073c31f70>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:03.539316 n-d-master-1 devstack@n-api.service[119128]: DEBUG neutronclient.v2_0.client [None req-d517fdbd-3bdc-4b2d-bb57-fdbfdef41c1b tempest-FloatingIPsTestJSON-248285424 tempest-FloatingIPsTestJSON-248285424-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a60f0d7e-64bf-42f5-84cf-59cd97ce93ef could not be found", "detail": ""}} {{(pid=119128) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 20 12:00:03.540039 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-d517fdbd-3bdc-4b2d-bb57-fdbfdef41c1b tempest-FloatingIPsTestJSON-248285424 tempest-FloatingIPsTestJSON-248285424-project] HTTP exception thrown: Floating IP not found for ID a60f0d7e-64bf-42f5-84cf-59cd97ce93ef Jun 20 12:00:03.542266 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d517fdbd-3bdc-4b2d-bb57-fdbfdef41c1b tempest-FloatingIPsTestJSON-248285424 tempest-FloatingIPsTestJSON-248285424-project] Request method failure captured: Jun 20 12:00:03.542266 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/os-floating-ips/a60f0d7e-64bf-42f5-84cf-59cd97ce93ef HTTP/1.1 Jun 20 12:00:03.542266 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:00:03.542266 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:00:03.542266 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:00:03.542266 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:00:03.542266 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:00:03.542266 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:00:03.542266 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:00:03.542266 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:00:03.542266 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGExYNeZYR9t7UWN8JZkasbj08M8qgeBmPGMdqY8aWogzsBylhLZCA1EoaxW8NBVTe1oy-5gXNbZcqygsf15ZZsLTBT6EVIrUOZzHzxQvCBdmotwDkUS__DaOX9K0BcX-g8WSxatJW87E0tyqwWHWyihS-NVJXjAJnTz2WgfD0INEyI Jun 20 12:00:03.542266 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:00:03.542266 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:00:03.542266 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:00:03.542266 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:00:03.542266 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:00:03.542266 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:00:03.542266 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 3983d3614d554269b5fc1cc6eafe6409 Jun 20 12:00:03.542266 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-FloatingIPsTestJSON-248285424 Jun 20 12:00:03.542266 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:00:03.542266 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:00:03.543890 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3983d3614d554269b5fc1cc6eafe6409"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3983d3614d554269b5fc1cc6eafe6409"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3983d3614d554269b5fc1cc6eafe6409"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3983d3614d554269b5fc1cc6eafe6409"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:00:03.543890 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-FloatingIPsTestJSON-248285424 Jun 20 12:00:03.543890 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 3983d3614d554269b5fc1cc6eafe6409 Jun 20 12:00:03.543890 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-FloatingIPsTestJSON-248285424 Jun 20 12:00:03.543890 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-FloatingIPsTestJSON-248285424-project Jun 20 12:00:03.543890 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:00:03.543890 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:00:03.543890 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: b01e342220604060b115c89ce0a1d188 Jun 20 12:00:03.543890 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-FloatingIPsTestJSON-248285424-project Jun 20 12:00:03.543890 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:00:03.543890 n-d-master-1 devstack@n-api.service[119128]: exception: Floating IP not found for ID a60f0d7e-64bf-42f5-84cf-59cd97ce93ef Jun 20 12:00:03.543890 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'a60f0d7e-64bf-42f5-84cf-59cd97ce93ef'} Jun 20 12:00:03.543890 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:00:03.544871 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:03.544871 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jun 20 12:00:03.544871 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jun 20 12:00:03.544871 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:00:03.544871 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:00:03.544871 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jun 20 12:00:03.544871 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jun 20 12:00:03.544871 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:00:03.544871 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:00:03.544871 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 20 12:00:03.544871 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 20 12:00:03.544871 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:00:03.544871 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:00:03.544871 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 20 12:00:03.544871 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 20 12:00:03.544871 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:00:03.544871 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:00:03.544871 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 20 12:00:03.544871 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 20 12:00:03.546256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:00:03.546256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:00:03.546256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 20 12:00:03.546256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 20 12:00:03.546256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 20 12:00:03.546256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 20 12:00:03.546256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a60f0d7e-64bf-42f5-84cf-59cd97ce93ef could not be found Jun 20 12:00:03.546256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dee910cf-e790-4771-8873-b50010e6ef98'] Jun 20 12:00:03.546256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:03.546256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:03.546256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:03.546256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:03.546256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jun 20 12:00:03.546256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jun 20 12:00:03.546256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jun 20 12:00:03.546256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jun 20 12:00:03.546256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a60f0d7e-64bf-42f5-84cf-59cd97ce93ef. Jun 20 12:00:03.546256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:03.546256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:03.546256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:03.547749 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:03.547749 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:03.547749 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:03.547749 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:00:03.547749 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:00:03.547749 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:00:03.547749 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:00:03.547749 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:00:03.547749 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:00:03.547749 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jun 20 12:00:03.547749 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 20 12:00:03.547749 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a60f0d7e-64bf-42f5-84cf-59cd97ce93ef Jun 20 12:00:03.547749 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:03.547749 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:03.547749 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:03.547749 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:03.547749 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:03.547749 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:03.547749 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:00:03.547749 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:00:03.549017 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a60f0d7e-64bf-42f5-84cf-59cd97ce93ef Jun 20 12:00:03.549017 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:03.549017 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d517fdbd-3bdc-4b2d-bb57-fdbfdef41c1b tempest-FloatingIPsTestJSON-248285424 tempest-FloatingIPsTestJSON-248285424-project] Returning 404 to user: Floating IP not found for ID a60f0d7e-64bf-42f5-84cf-59cd97ce93ef {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:00:03.549017 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d517fdbd-3bdc-4b2d-bb57-fdbfdef41c1b tempest-FloatingIPsTestJSON-248285424 tempest-FloatingIPsTestJSON-248285424-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/a60f0d7e-64bf-42f5-84cf-59cd97ce93ef" status: 404 len: 111 microversion: 2.1 time: 0.061941 Jun 20 12:00:03.549017 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 474/939] 10.222.0.27 () {58 vars in 1262 bytes} [Mon Jun 20 12:00:03 2022] DELETE /compute/v2.1/os-floating-ips/a60f0d7e-64bf-42f5-84cf-59cd97ce93ef => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:00:03.565106 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0350352f-8f54-4abd-bc85-6689cafe7300 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:03.575791 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0350352f-8f54-4abd-bc85-6689cafe7300 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/df847276-3f6d-4fbf-bd7c-defd0d1e633c" status: 200 len: 1306 microversion: 2.1 time: 0.186179 Jun 20 12:00:03.576624 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 466/940] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:03 2022] GET /compute/v2.1/servers/df847276-3f6d-4fbf-bd7c-defd0d1e633c => generated 1306 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:03.615616 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-863580fd-9e85-40ee-8d2f-45f92501f60a req-c6b1c614-9b0f-47bb-9294-b8ed214cc06a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0", "name": "network-vif-deleted", "tag": "736a1975-6c4b-4f19-83da-ab507fc213c8"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:03.625297 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-863580fd-9e85-40ee-8d2f-45f92501f60a req-c6b1c614-9b0f-47bb-9294-b8ed214cc06a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:03.626044 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-863580fd-9e85-40ee-8d2f-45f92501f60a req-c6b1c614-9b0f-47bb-9294-b8ed214cc06a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:03.637697 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-863580fd-9e85-40ee-8d2f-45f92501f60a req-c6b1c614-9b0f-47bb-9294-b8ed214cc06a service nova] Creating event network-vif-deleted:736a1975-6c4b-4f19-83da-ab507fc213c8 for instance a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0 on n-h1-master-1 Jun 20 12:00:03.642627 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-863580fd-9e85-40ee-8d2f-45f92501f60a req-c6b1c614-9b0f-47bb-9294-b8ed214cc06a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030678 Jun 20 12:00:03.643607 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 475/941] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:00:03.752949 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e04017e9-c48f-4ba8-b2a6-aafd959f2463 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:03.753837 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e04017e9-c48f-4ba8-b2a6-aafd959f2463 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:03.783505 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e04017e9-c48f-4ba8-b2a6-aafd959f2463 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:03.784010 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e04017e9-c48f-4ba8-b2a6-aafd959f2463 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:03.784782 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e04017e9-c48f-4ba8-b2a6-aafd959f2463 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:03.785224 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e04017e9-c48f-4ba8-b2a6-aafd959f2463 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:04.204007 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e04017e9-c48f-4ba8-b2a6-aafd959f2463 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:04.220667 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e04017e9-c48f-4ba8-b2a6-aafd959f2463 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:04.228121 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e04017e9-c48f-4ba8-b2a6-aafd959f2463 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:04.230795 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e04017e9-c48f-4ba8-b2a6-aafd959f2463 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1411 microversion: 2.25 time: 0.480725 Jun 20 12:00:04.232367 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 467/942] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:00:03 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1411 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:00:04.297104 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-22d94813-b283-4b49-bc07-74a2e270ac59 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:04.297877 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-22d94813-b283-4b49-bc07-74a2e270ac59 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] [instance: a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:04.321771 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22d94813-b283-4b49-bc07-74a2e270ac59 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:04.327274 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22d94813-b283-4b49-bc07-74a2e270ac59 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:04.330835 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22d94813-b283-4b49-bc07-74a2e270ac59 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:04.331517 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22d94813-b283-4b49-bc07-74a2e270ac59 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:04.349452 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:00:04.384673 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-22d94813-b283-4b49-bc07-74a2e270ac59 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] HTTP exception thrown: Instance a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0 could not be found. Jun 20 12:00:04.389067 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-22d94813-b283-4b49-bc07-74a2e270ac59 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Request method failure captured: Jun 20 12:00:04.389067 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0 HTTP/1.1 Jun 20 12:00:04.389067 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:00:04.389067 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:00:04.389067 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:00:04.389067 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:00:04.389067 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:00:04.389067 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:00:04.389067 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:00:04.389067 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:00:04.389067 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGDXcoKLNnHk5Vd41xldZubTKAqVDvS1k_2LbhmvUD-6WypmR1ISt9eElY5yAacPbdpKNt2MkSTDbx6BooHUcU0GDvHVyyc3t-jzMKy0stovmf5GQMf0x9V3pGqV-V25xV1nyzNlRm1q-22x0oehPhdxFTyFC5pZoQrxEE9Wsq1Bl9Y Jun 20 12:00:04.389067 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:00:04.389067 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:00:04.389067 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:00:04.389067 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:00:04.389067 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:00:04.389067 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:00:04.389067 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 3842c54af1c84c5ead0c5cf6530df872 Jun 20 12:00:04.389067 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ImagesOneServerTestJSON-498983894 Jun 20 12:00:04.389067 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:00:04.389067 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:00:04.390494 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3842c54af1c84c5ead0c5cf6530df872"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3842c54af1c84c5ead0c5cf6530df872"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3842c54af1c84c5ead0c5cf6530df872"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3842c54af1c84c5ead0c5cf6530df872"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:00:04.390494 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ImagesOneServerTestJSON-498983894 Jun 20 12:00:04.390494 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 3842c54af1c84c5ead0c5cf6530df872 Jun 20 12:00:04.390494 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-498983894 Jun 20 12:00:04.390494 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ImagesOneServerTestJSON-498983894-project Jun 20 12:00:04.390494 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:00:04.390494 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:00:04.390494 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 04f4477b25804205a497458b38d66883 Jun 20 12:00:04.390494 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ImagesOneServerTestJSON-498983894-project Jun 20 12:00:04.390494 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:00:04.390494 n-d-master-1 devstack@n-api.service[119128]: exception: Instance a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0 could not be found. Jun 20 12:00:04.390494 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0'} Jun 20 12:00:04.391262 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:00:04.391262 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:04.391262 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:00:04.391262 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:00:04.391262 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:00:04.391262 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:00:04.391262 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:00:04.391262 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:00:04.391262 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:00:04.391262 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:00:04.391262 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0 could not be found. Jun 20 12:00:04.391262 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:04.391262 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:04.391262 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:04.391262 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:04.391262 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:04.391262 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:04.391262 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:00:04.391262 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:00:04.391262 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:00:04.394083 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:00:04.394083 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:00:04.394083 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:00:04.394083 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:00:04.394083 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:00:04.394083 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:00:04.394083 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:00:04.394083 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0 could not be found. Jun 20 12:00:04.394083 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:04.394083 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:04.394083 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:04.394083 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:04.394083 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:04.394083 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:04.394083 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:00:04.394083 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:00:04.394083 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0 could not be found. Jun 20 12:00:04.394083 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:04.401599 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-22d94813-b283-4b49-bc07-74a2e270ac59 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] Returning 404 to user: Instance a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:00:04.403196 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-22d94813-b283-4b49-bc07-74a2e270ac59 tempest-ImagesOneServerTestJSON-498983894 tempest-ImagesOneServerTestJSON-498983894-project] 10.222.0.27 "GET /compute/v2.1/servers/a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0" status: 404 len: 111 microversion: 2.1 time: 0.113518 Jun 20 12:00:04.410318 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 476/943] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:04 2022] GET /compute/v2.1/servers/a6f4335d-e200-45ae-ab3c-e0c69f5aeaf0 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:00:04.488703 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4776c404-71ce-47fa-beb2-4e9afd6d842d tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:04.490503 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4776c404-71ce-47fa-beb2-4e9afd6d842d tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] [instance: 1c763272-042e-418c-b2f6-cc2e96f0c54d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:04.501578 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4776c404-71ce-47fa-beb2-4e9afd6d842d tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:04.505781 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4776c404-71ce-47fa-beb2-4e9afd6d842d tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:04.507156 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4776c404-71ce-47fa-beb2-4e9afd6d842d tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:04.509715 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4776c404-71ce-47fa-beb2-4e9afd6d842d tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:04.593584 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5aa5c065-6b11-45a0-8153-151d8dd32a88 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:04.594741 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5aa5c065-6b11-45a0-8153-151d8dd32a88 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: df847276-3f6d-4fbf-bd7c-defd0d1e633c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:04.608051 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5aa5c065-6b11-45a0-8153-151d8dd32a88 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:04.608663 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5aa5c065-6b11-45a0-8153-151d8dd32a88 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:04.609809 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5aa5c065-6b11-45a0-8153-151d8dd32a88 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:04.610547 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5aa5c065-6b11-45a0-8153-151d8dd32a88 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:04.644383 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-5aa5c065-6b11-45a0-8153-151d8dd32a88 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] HTTP exception thrown: Instance df847276-3f6d-4fbf-bd7c-defd0d1e633c could not be found. Jun 20 12:00:04.645960 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5aa5c065-6b11-45a0-8153-151d8dd32a88 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Request method failure captured: Jun 20 12:00:04.645960 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/df847276-3f6d-4fbf-bd7c-defd0d1e633c HTTP/1.1 Jun 20 12:00:04.645960 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:00:04.645960 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:00:04.645960 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:00:04.645960 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:00:04.645960 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:00:04.645960 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:00:04.645960 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:00:04.645960 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:00:04.645960 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGB04YgN2qwmpAbSVYBj1yKvqSaDSqYj7KhnXAwxLFlA52NG70o92gYPB0cXzYJvuf_7FOWrI99cZVPKh4xXLrAHLOP_L0Q9mNXdSZyTZrSw1bqTuU7pza7A3jlbg1NmxOK9BJccrrZRONfFPEpVpJShKEnusLTFdnHs8tSnnukr1cc Jun 20 12:00:04.645960 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:00:04.645960 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:00:04.645960 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:00:04.645960 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:00:04.645960 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:00:04.645960 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:00:04.645960 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: a6150795e7424cca91c71531840d88be Jun 20 12:00:04.645960 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersOnMultiNodesTest-1662406801 Jun 20 12:00:04.645960 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:00:04.645960 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:00:04.647582 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6150795e7424cca91c71531840d88be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6150795e7424cca91c71531840d88be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a6150795e7424cca91c71531840d88be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a6150795e7424cca91c71531840d88be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:00:04.647582 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersOnMultiNodesTest-1662406801 Jun 20 12:00:04.647582 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: a6150795e7424cca91c71531840d88be Jun 20 12:00:04.647582 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1662406801 Jun 20 12:00:04.647582 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersOnMultiNodesTest-1662406801-project Jun 20 12:00:04.647582 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:00:04.647582 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:00:04.647582 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 1297c1b206f845bcaf936313fd7eed9b Jun 20 12:00:04.647582 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersOnMultiNodesTest-1662406801-project Jun 20 12:00:04.647582 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:00:04.647582 n-d-master-1 devstack@n-api.service[119128]: exception: Instance df847276-3f6d-4fbf-bd7c-defd0d1e633c could not be found. Jun 20 12:00:04.647582 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'df847276-3f6d-4fbf-bd7c-defd0d1e633c'} Jun 20 12:00:04.648394 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:00:04.648394 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:04.648394 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:00:04.648394 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:00:04.648394 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:00:04.648394 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:00:04.648394 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:00:04.648394 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:00:04.648394 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:00:04.648394 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:00:04.648394 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df847276-3f6d-4fbf-bd7c-defd0d1e633c could not be found. Jun 20 12:00:04.648394 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:04.648394 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:04.648394 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:04.648394 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:04.648394 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:04.648394 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:04.648394 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:00:04.648394 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:00:04.648394 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:00:04.649726 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:00:04.649726 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:00:04.649726 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:00:04.649726 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:00:04.649726 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:00:04.649726 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:00:04.649726 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:00:04.649726 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df847276-3f6d-4fbf-bd7c-defd0d1e633c could not be found. Jun 20 12:00:04.649726 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:04.649726 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:04.649726 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:04.649726 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:04.649726 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:04.649726 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:04.649726 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:00:04.649726 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:00:04.649726 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df847276-3f6d-4fbf-bd7c-defd0d1e633c could not be found. Jun 20 12:00:04.649726 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:04.657900 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5aa5c065-6b11-45a0-8153-151d8dd32a88 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Returning 404 to user: Instance df847276-3f6d-4fbf-bd7c-defd0d1e633c could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:00:04.659148 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5aa5c065-6b11-45a0-8153-151d8dd32a88 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/df847276-3f6d-4fbf-bd7c-defd0d1e633c" status: 404 len: 111 microversion: 2.1 time: 0.070018 Jun 20 12:00:04.660665 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 477/944] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:04 2022] GET /compute/v2.1/servers/df847276-3f6d-4fbf-bd7c-defd0d1e633c => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:00:04.690798 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a561dff5-8be6-47f0-836c-143dc9b75671 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:04.695911 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a561dff5-8be6-47f0-836c-143dc9b75671 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 66d1074f-478d-4676-ab01-4dc1d4561a42] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:04.709617 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a561dff5-8be6-47f0-836c-143dc9b75671 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:04.712452 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a561dff5-8be6-47f0-836c-143dc9b75671 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:04.713486 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a561dff5-8be6-47f0-836c-143dc9b75671 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:04.715252 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a561dff5-8be6-47f0-836c-143dc9b75671 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:04.756755 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a561dff5-8be6-47f0-836c-143dc9b75671 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 66d1074f-478d-4676-ab01-4dc1d4561a42] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:00:04.775227 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4776c404-71ce-47fa-beb2-4e9afd6d842d tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f4e0e140c4a839d99b56ee9ffacc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35cecfcbb948c6b60eef6140f87a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:04.785414 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4776c404-71ce-47fa-beb2-4e9afd6d842d tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] 10.222.0.27 "GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d" status: 200 len: 1371 microversion: 2.1 time: 0.302232 Jun 20 12:00:04.788831 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 468/945] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:04 2022] GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d => generated 1371 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:04.912220 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a561dff5-8be6-47f0-836c-143dc9b75671 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "DELETE /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42" status: 204 len: 0 microversion: 2.1 time: 0.245622 Jun 20 12:00:04.912812 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 478/946] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:00:04 2022] DELETE /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:00:04.924601 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-16316766-2952-4bb9-af4e-761818455773 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:04.925230 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-16316766-2952-4bb9-af4e-761818455773 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 66d1074f-478d-4676-ab01-4dc1d4561a42] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:04.936838 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-16316766-2952-4bb9-af4e-761818455773 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:04.938046 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-16316766-2952-4bb9-af4e-761818455773 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:04.939082 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-16316766-2952-4bb9-af4e-761818455773 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:04.939723 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-16316766-2952-4bb9-af4e-761818455773 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:05.217954 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-16316766-2952-4bb9-af4e-761818455773 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:05.227523 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-16316766-2952-4bb9-af4e-761818455773 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42" status: 200 len: 1473 microversion: 2.1 time: 0.309848 Jun 20 12:00:05.228126 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 469/947] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:04 2022] GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42 => generated 1473 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:05.250679 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-66d65810-59cd-41d9-8b8c-298d2d864ed7 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:05.251077 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-66d65810-59cd-41d9-8b8c-298d2d864ed7 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:05.265359 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-66d65810-59cd-41d9-8b8c-298d2d864ed7 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:05.265841 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-66d65810-59cd-41d9-8b8c-298d2d864ed7 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:05.269607 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-66d65810-59cd-41d9-8b8c-298d2d864ed7 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:05.270192 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-66d65810-59cd-41d9-8b8c-298d2d864ed7 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:05.671745 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-1b76dc27-f2f3-4189-9c62-5d718c2858be req-9efb97b7-09a4-466a-b88e-029c67cd286d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c12363c-ee46-445d-af50-77a1f0518a17", "tag": "0633c2cf-5ad3-4f49-95ea-6201e1ac2cc0"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:05.690176 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-1b76dc27-f2f3-4189-9c62-5d718c2858be req-9efb97b7-09a4-466a-b88e-029c67cd286d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:05.690636 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-1b76dc27-f2f3-4189-9c62-5d718c2858be req-9efb97b7-09a4-466a-b88e-029c67cd286d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:05.713137 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-1b76dc27-f2f3-4189-9c62-5d718c2858be req-9efb97b7-09a4-466a-b88e-029c67cd286d service nova] Creating event network-changed:0633c2cf-5ad3-4f49-95ea-6201e1ac2cc0 for instance 3c12363c-ee46-445d-af50-77a1f0518a17 on n-h1-master-1 Jun 20 12:00:05.726750 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-1b76dc27-f2f3-4189-9c62-5d718c2858be req-9efb97b7-09a4-466a-b88e-029c67cd286d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059382 Jun 20 12:00:05.730228 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 470/948] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:00:05.807131 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bdfd8603-b33a-4cbb-b8fe-082de85ca204 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:05.815014 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bdfd8603-b33a-4cbb-b8fe-082de85ca204 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] [instance: 1c763272-042e-418c-b2f6-cc2e96f0c54d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:05.826878 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bdfd8603-b33a-4cbb-b8fe-082de85ca204 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:05.833552 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bdfd8603-b33a-4cbb-b8fe-082de85ca204 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:05.835265 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bdfd8603-b33a-4cbb-b8fe-082de85ca204 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:05.836221 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bdfd8603-b33a-4cbb-b8fe-082de85ca204 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:05.938993 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-66d65810-59cd-41d9-8b8c-298d2d864ed7 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:05.957051 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-66d65810-59cd-41d9-8b8c-298d2d864ed7 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:05.958838 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-66d65810-59cd-41d9-8b8c-298d2d864ed7 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:05.960149 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-66d65810-59cd-41d9-8b8c-298d2d864ed7 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1411 microversion: 2.25 time: 0.714318 Jun 20 12:00:05.965203 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 479/949] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:00:05 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1411 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:00:06.246442 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8dfd390f-fbea-4ad3-b2b5-9e2f67c6910d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:06.247070 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8dfd390f-fbea-4ad3-b2b5-9e2f67c6910d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 66d1074f-478d-4676-ab01-4dc1d4561a42] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:06.266768 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8dfd390f-fbea-4ad3-b2b5-9e2f67c6910d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:06.268373 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8dfd390f-fbea-4ad3-b2b5-9e2f67c6910d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:06.270031 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8dfd390f-fbea-4ad3-b2b5-9e2f67c6910d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:06.272112 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8dfd390f-fbea-4ad3-b2b5-9e2f67c6910d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:06.587473 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8dfd390f-fbea-4ad3-b2b5-9e2f67c6910d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:06.598688 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8dfd390f-fbea-4ad3-b2b5-9e2f67c6910d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42" status: 200 len: 1473 microversion: 2.1 time: 0.357914 Jun 20 12:00:06.610187 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 480/950] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:06 2022] GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42 => generated 1473 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:00:06.852081 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bdfd8603-b33a-4cbb-b8fe-082de85ca204 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f4e0e140c4a839d99b56ee9ffacc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35cecfcbb948c6b60eef6140f87a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:06.865747 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bdfd8603-b33a-4cbb-b8fe-082de85ca204 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] 10.222.0.27 "GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d" status: 200 len: 1371 microversion: 2.1 time: 1.061670 Jun 20 12:00:06.869161 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 471/951] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:05 2022] GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d => generated 1371 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:00:06.983782 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8b113799-87e1-4915-800c-f070d1f69edf tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:06.984680 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8b113799-87e1-4915-800c-f070d1f69edf tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:06.996664 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b113799-87e1-4915-800c-f070d1f69edf tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:06.998350 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b113799-87e1-4915-800c-f070d1f69edf tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:06.999445 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b113799-87e1-4915-800c-f070d1f69edf tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:07.000542 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b113799-87e1-4915-800c-f070d1f69edf tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:07.116950 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-29a715ef-cdb3-48dc-a92c-d59efecc9e76 tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] Action: 'create', calling method: .version_select at 0x7f6073968430>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHY7/MJT4be4XGAHpLO2zTGvczKcz+m2hJzH+Y7/qXEHwxNn/JxgP2HPjDm71r4HpCOXTjYZBXz0umEuzlzPJ59S97D7pYxiUhy81eHd/ETRkY38vKYiObTsmPBb4hOdjQ=="}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:07.122858 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-29a715ef-cdb3-48dc-a92c-d59efecc9e76 tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Jun 20 12:00:07.133383 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-29a715ef-cdb3-48dc-a92c-d59efecc9e76 tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] Request method failure captured: Jun 20 12:00:07.133383 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 20 12:00:07.133383 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:00:07.133383 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:00:07.133383 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:00:07.133383 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 257 Jun 20 12:00:07.133383 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:00:07.133383 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:00:07.133383 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:00:07.133383 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:00:07.133383 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGFGZbkTRh02D4FTvtPoEHqVyFVItJSHihNpMrBRLxgCBGG2q2cUgT3M66Iy9pB3QX2z4AQ47fqcLJZ2RZOMcprsbAHNFj5OXO6pQheTCzbHiB5bqOy6kKV-rPLPTzTnQmvkD5Z48cPahmfCTovTKQxkaMB-VbjEEH9nlWL0jNJxfX0 Jun 20 12:00:07.133383 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:00:07.133383 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:00:07.133383 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:00:07.133383 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:00:07.133383 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:00:07.133383 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:00:07.133383 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: e100ae4cabe741079b98c11e3a2642f6 Jun 20 12:00:07.133383 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-663340130 Jun 20 12:00:07.133383 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:00:07.133383 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:00:07.135213 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e100ae4cabe741079b98c11e3a2642f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e100ae4cabe741079b98c11e3a2642f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e100ae4cabe741079b98c11e3a2642f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e100ae4cabe741079b98c11e3a2642f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:00:07.135213 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-KeyPairsNegativeTestJSON-663340130 Jun 20 12:00:07.135213 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: e100ae4cabe741079b98c11e3a2642f6 Jun 20 12:00:07.135213 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-663340130 Jun 20 12:00:07.135213 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-KeyPairsNegativeTestJSON-663340130-project Jun 20 12:00:07.135213 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:00:07.135213 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:00:07.135213 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 40b3d19df0e64cd8916a7b49678d3def Jun 20 12:00:07.135213 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-KeyPairsNegativeTestJSON-663340130-project Jun 20 12:00:07.135213 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:00:07.135213 n-d-master-1 devstack@n-api.service[119128]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHY7/MJT4be4XGAHpLO2zTGvczKcz+m2hJzH+Y7/qXEHwxNn/JxgP2HPjDm71r4HpCOXTjYZBXz0umEuzlzPJ59S97D7pYxiUhy81eHd/ETRkY38vKYiObTsmPBb4hOdjQ=="}} Jun 20 12:00:07.135213 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:00:07.136007 n-d-master-1 devstack@n-api.service[119128]: exception: Keypair data is invalid: Keypair name contains unsafe characters Jun 20 12:00:07.136007 n-d-master-1 devstack@n-api.service[119128]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHY7/MJT4be4XGAHpLO2zTGvczKcz+m2hJzH+Y7/qXEHwxNn/JxgP2HPjDm71r4HpCOXTjYZBXz0umEuzlzPJ59S97D7pYxiUhy81eHd/ETRkY38vKYiObTsmPBb4hOdjQ=='}}} Jun 20 12:00:07.136007 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:00:07.136007 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:07.136007 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jun 20 12:00:07.136007 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jun 20 12:00:07.136007 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 20 12:00:07.136007 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 20 12:00:07.136007 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 12:00:07.136007 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 12:00:07.136007 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 12:00:07.136007 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 12:00:07.136007 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 20 12:00:07.136007 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 20 12:00:07.136007 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in import_key_pair Jun 20 12:00:07.136007 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) Jun 20 12:00:07.136007 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in _validate_new_key_pair Jun 20 12:00:07.136007 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jun 20 12:00:07.137175 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters Jun 20 12:00:07.137175 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.137175 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:07.137175 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.137175 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:07.137175 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:07.137175 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:07.137175 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:00:07.137175 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:00:07.137175 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:00:07.137175 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:00:07.137175 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:00:07.137175 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:00:07.137175 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:00:07.137175 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:00:07.137175 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:00:07.137175 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:00:07.137175 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jun 20 12:00:07.137175 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jun 20 12:00:07.137175 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jun 20 12:00:07.138451 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jun 20 12:00:07.138451 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters Jun 20 12:00:07.138451 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.138451 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:07.138451 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.138451 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:07.138451 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:07.138451 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:07.138451 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:00:07.138451 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:00:07.138451 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters Jun 20 12:00:07.138451 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.138451 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-29a715ef-cdb3-48dc-a92c-d59efecc9e76 tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:00:07.138451 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-29a715ef-cdb3-48dc-a92c-d59efecc9e76 tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.245216 Jun 20 12:00:07.139490 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 481/952] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 12:00:06 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 247 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:00:07.150269 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-31d8b947-b965-4ed9-8360-3476872ef2a6 tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] Action: 'create', calling method: .version_select at 0x7f607385eaf0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-610740619", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:07.167535 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-31d8b947-b965-4ed9-8360-3476872ef2a6 tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] Getting quotas for project e100ae4cabe741079b98c11e3a2642f6. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:00:07.173050 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-31d8b947-b965-4ed9-8360-3476872ef2a6 tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] Getting quotas for user 40b3d19df0e64cd8916a7b49678d3def and project e100ae4cabe741079b98c11e3a2642f6. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:00:07.190134 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-31d8b947-b965-4ed9-8360-3476872ef2a6 tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jun 20 12:00:07.201357 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-31d8b947-b965-4ed9-8360-3476872ef2a6 tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] Request method failure captured: Jun 20 12:00:07.201357 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 20 12:00:07.201357 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:00:07.201357 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:00:07.201357 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:00:07.201357 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 2166 Jun 20 12:00:07.201357 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:00:07.201357 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:00:07.201357 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:00:07.201357 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:00:07.201357 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGFGZbkTRh02D4FTvtPoEHqVyFVItJSHihNpMrBRLxgCBGG2q2cUgT3M66Iy9pB3QX2z4AQ47fqcLJZ2RZOMcprsbAHNFj5OXO6pQheTCzbHiB5bqOy6kKV-rPLPTzTnQmvkD5Z48cPahmfCTovTKQxkaMB-VbjEEH9nlWL0jNJxfX0 Jun 20 12:00:07.201357 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:00:07.201357 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:00:07.201357 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:00:07.201357 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:00:07.201357 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:00:07.201357 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:00:07.201357 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: e100ae4cabe741079b98c11e3a2642f6 Jun 20 12:00:07.201357 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-663340130 Jun 20 12:00:07.201357 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:00:07.201357 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:00:07.201357 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e100ae4cabe741079b98c11e3a2642f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e100ae4cabe741079b98c11e3a2642f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e100ae4cabe741079b98c11e3a2642f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e100ae4cabe741079b98c11e3a2642f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:00:07.201357 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-KeyPairsNegativeTestJSON-663340130 Jun 20 12:00:07.201357 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: e100ae4cabe741079b98c11e3a2642f6 Jun 20 12:00:07.201357 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-663340130 Jun 20 12:00:07.201357 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-KeyPairsNegativeTestJSON-663340130-project Jun 20 12:00:07.201357 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:00:07.201357 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:00:07.201357 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 40b3d19df0e64cd8916a7b49678d3def Jun 20 12:00:07.201357 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-KeyPairsNegativeTestJSON-663340130-project Jun 20 12:00:07.201357 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:00:07.201357 n-d-master-1 devstack@n-api.service[119128]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-610740619", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Jun 20 12:00:07.201357 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:00:07.201357 n-d-master-1 devstack@n-api.service[119128]: exception: Keypair data is invalid: failed to generate fingerprint Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-610740619', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:00:07.203937 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:00:07.216307 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:00:07.216307 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:00:07.216307 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:00:07.216307 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:00:07.216307 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jun 20 12:00:07.216307 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jun 20 12:00:07.216307 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jun 20 12:00:07.216307 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jun 20 12:00:07.216307 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jun 20 12:00:07.216307 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.216307 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:07.216307 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.216307 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:07.216307 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:07.216307 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:07.216307 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:00:07.216307 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:00:07.216307 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jun 20 12:00:07.216307 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.216307 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-31d8b947-b965-4ed9-8360-3476872ef2a6 tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:00:07.216307 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-31d8b947-b965-4ed9-8360-3476872ef2a6 tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.058209 Jun 20 12:00:07.216307 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 482/953] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Jun 20 12:00:07 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 20 12:00:07.222623 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e163725a-7162-4266-b3c1-1ce1e5b19a67 tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] Action: 'create', calling method: .version_select at 0x7f6073b5c0d0>, body: {"keypair": {"name": "tempest-keypair-118062601", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjr+5UYg5tM8B9AsmN1opMrXBJt9TO5JIab9VkhZuwi4gUuj1gujDggz9t74TOnlcZWXLMeV2ppP5PXgyx9zNCftfnZlozVquPNJ5dD+uj97rT7iUCUmIZb55A8BEk9iQ=="}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:07.226623 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8b113799-87e1-4915-800c-f070d1f69edf tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:07.237369 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8b113799-87e1-4915-800c-f070d1f69edf tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:07.238857 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8b113799-87e1-4915-800c-f070d1f69edf tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:07.239496 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-e163725a-7162-4266-b3c1-1ce1e5b19a67 tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] Getting quotas for project e100ae4cabe741079b98c11e3a2642f6. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:00:07.239966 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8b113799-87e1-4915-800c-f070d1f69edf tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1411 microversion: 2.25 time: 0.261203 Jun 20 12:00:07.240774 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 472/954] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:00:06 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1411 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:00:07.250682 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-e163725a-7162-4266-b3c1-1ce1e5b19a67 tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] Getting quotas for user 40b3d19df0e64cd8916a7b49678d3def and project e100ae4cabe741079b98c11e3a2642f6. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:00:07.284109 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e163725a-7162-4266-b3c1-1ce1e5b19a67 tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.070084 Jun 20 12:00:07.284920 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 483/955] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 12:00:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:00:07.297732 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-63a9a16d-9960-4ff3-b5f0-27b8047b72c8 tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] Action: 'create', calling method: .version_select at 0x7f6073a0f8b0>, body: {"keypair": {"name": "tempest-keypair-118062601", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0Bqhn/Y8I7vZQcwvxpPOhwiLmRS3cSFoiK7Pdk1tJniiwCVPA6uRHQJYTQW+Qhq4TW7sdzN7BaDc50seRTWr4+ZSSewzvPHoAY/kcFJ2qrvKWyMGGTUmiFxn0cMnkXFw=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:07.316911 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-63a9a16d-9960-4ff3-b5f0-27b8047b72c8 tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] Getting quotas for project e100ae4cabe741079b98c11e3a2642f6. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:00:07.322614 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-63a9a16d-9960-4ff3-b5f0-27b8047b72c8 tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] Getting quotas for user 40b3d19df0e64cd8916a7b49678d3def and project e100ae4cabe741079b98c11e3a2642f6. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:00:07.349653 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-63a9a16d-9960-4ff3-b5f0-27b8047b72c8 tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] HTTP exception thrown: Key pair 'tempest-keypair-118062601' already exists. Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-63a9a16d-9960-4ff3-b5f0-27b8047b72c8 tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] Request method failure captured: Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 272 Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGFGZbkTRh02D4FTvtPoEHqVyFVItJSHihNpMrBRLxgCBGG2q2cUgT3M66Iy9pB3QX2z4AQ47fqcLJZ2RZOMcprsbAHNFj5OXO6pQheTCzbHiB5bqOy6kKV-rPLPTzTnQmvkD5Z48cPahmfCTovTKQxkaMB-VbjEEH9nlWL0jNJxfX0 Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: e100ae4cabe741079b98c11e3a2642f6 Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-663340130 Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e100ae4cabe741079b98c11e3a2642f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e100ae4cabe741079b98c11e3a2642f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e100ae4cabe741079b98c11e3a2642f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e100ae4cabe741079b98c11e3a2642f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-KeyPairsNegativeTestJSON-663340130 Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: e100ae4cabe741079b98c11e3a2642f6 Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-663340130 Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-KeyPairsNegativeTestJSON-663340130-project Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 40b3d19df0e64cd8916a7b49678d3def Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-KeyPairsNegativeTestJSON-663340130-project Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: {"keypair": {"name": "tempest-keypair-118062601", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0Bqhn/Y8I7vZQcwvxpPOhwiLmRS3cSFoiK7Pdk1tJniiwCVPA6uRHQJYTQW+Qhq4TW7sdzN7BaDc50seRTWr4+ZSSewzvPHoAY/kcFJ2qrvKWyMGGTUmiFxn0cMnkXFw=="}} Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: exception: Key pair 'tempest-keypair-118062601' already exists. Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-118062601', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0Bqhn/Y8I7vZQcwvxpPOhwiLmRS3cSFoiK7Pdk1tJniiwCVPA6uRHQJYTQW+Qhq4TW7sdzN7BaDc50seRTWr4+ZSSewzvPHoAY/kcFJ2qrvKWyMGGTUmiFxn0cMnkXFw=='}}} Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result.read() Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '40b3d19df0e64cd8916a7b49678d3def-tempest-keypair-118062601' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jun 20 12:00:07.372574 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi kp.save(context.session) Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi session.flush() Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._flush(objects) Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi compat.raise_( Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi flush_context.execute() Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi rec.execute(self) Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result.read() Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 20 12:00:07.377160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '40b3d19df0e64cd8916a7b49678d3def-tempest-keypair-118062601' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 6, 20, 12, 0, 7, 342686), 'updated_at': None, 'name': 'tempest-keypair-118062601', 'user_id': '40b3d19df0e64cd8916a7b49678d3def', 'fingerprint': '8a:bf:c8:2b:72:c7:cd:a1:05:4b:e5:e3:aa:99:03:77', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0Bqhn/Y8I7vZQcwvxpPOhwiLmRS3cSFoiK7Pdk1tJniiwCVPA6uRHQJYTQW+Qhq4TW7sdzN7BaDc50seRTWr4+ZSSewzvPHoAY/kcFJ2qrvKWyMGGTUmiFxn0cMnkXFw==', 'type': 'ssh'}] Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6661, in import_key_pair Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi keypair.create() Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._create() Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-118062601' already exists. Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Jun 20 12:00:07.381245 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-118062601' already exists. Jun 20 12:00:07.386277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.386277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:07.386277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.386277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:07.386277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:07.386277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:07.386277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:00:07.386277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:00:07.386277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-118062601' already exists. Jun 20 12:00:07.386277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.386277 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-63a9a16d-9960-4ff3-b5f0-27b8047b72c8 tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] Returning 409 to user: Key pair 'tempest-keypair-118062601' already exists. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:00:07.386277 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-63a9a16d-9960-4ff3-b5f0-27b8047b72c8 tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.082045 Jun 20 12:00:07.386277 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 473/956] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 12:00:07 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 83 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:00:07.391701 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-092233b6-7230-4707-aa4c-7e82c59fda3c tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] Calling method '.version_select at 0x7f6073b08670>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:07.412798 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-092233b6-7230-4707-aa4c-7e82c59fda3c tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-118062601" status: 202 len: 0 microversion: 2.1 time: 0.027133 Jun 20 12:00:07.413744 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 484/957] 10.222.0.27 () {58 vars in 1217 bytes} [Mon Jun 20 12:00:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-118062601 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:00:07.426981 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9d00a5e0-60a4-4c73-bebc-1232a4803adb tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] Action: 'create', calling method: .version_select at 0x7f6073961310>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBb862Uv9ZPBZV8RP1e5intW5VWV0S6O/mK6a+0jCILdwfY7g/8SsWVdd1nxrdzxdGMsV7YFWFesSbZr39VykZSu+Qe+rF5u19Jtw1LQvCNlORc0xB39BXbwmhKCGeHkuQ=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9d00a5e0-60a4-4c73-bebc-1232a4803adb tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] Request method failure captured: Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 247 Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGFGZbkTRh02D4FTvtPoEHqVyFVItJSHihNpMrBRLxgCBGG2q2cUgT3M66Iy9pB3QX2z4AQ47fqcLJZ2RZOMcprsbAHNFj5OXO6pQheTCzbHiB5bqOy6kKV-rPLPTzTnQmvkD5Z48cPahmfCTovTKQxkaMB-VbjEEH9nlWL0jNJxfX0 Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: e100ae4cabe741079b98c11e3a2642f6 Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-663340130 Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e100ae4cabe741079b98c11e3a2642f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e100ae4cabe741079b98c11e3a2642f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e100ae4cabe741079b98c11e3a2642f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e100ae4cabe741079b98c11e3a2642f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-KeyPairsNegativeTestJSON-663340130 Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: e100ae4cabe741079b98c11e3a2642f6 Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-663340130 Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-KeyPairsNegativeTestJSON-663340130-project Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 40b3d19df0e64cd8916a7b49678d3def Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-KeyPairsNegativeTestJSON-663340130-project Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBb862Uv9ZPBZV8RP1e5intW5VWV0S6O/mK6a+0jCILdwfY7g/8SsWVdd1nxrdzxdGMsV7YFWFesSbZr39VykZSu+Qe+rF5u19Jtw1LQvCNlORc0xB39BXbwmhKCGeHkuQ=="}} Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: exception: Invalid input for field/attribute name. Value: . '' is too short Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBb862Uv9ZPBZV8RP1e5intW5VWV0S6O/mK6a+0jCILdwfY7g/8SsWVdd1nxrdzxdGMsV7YFWFesSbZr39VykZSu+Qe+rF5u19Jtw1LQvCNlORc0xB39BXbwmhKCGeHkuQ=='}}} Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise error Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi '' Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 12:00:07.429972 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 12:00:07.434651 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 12:00:07.434651 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 12:00:07.434651 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 12:00:07.434651 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 12:00:07.434651 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jun 20 12:00:07.434651 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.434651 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:07.434651 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.434651 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:07.434651 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:07.434651 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:07.434651 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 12:00:07.434651 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 12:00:07.434651 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jun 20 12:00:07.434651 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.437066 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9d00a5e0-60a4-4c73-bebc-1232a4803adb tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:00:07.437932 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9d00a5e0-60a4-4c73-bebc-1232a4803adb tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.016352 Jun 20 12:00:07.438519 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 474/958] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 12:00:07 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:00:07.448084 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5533f8cb-f209-40ed-9a11-edf7cb1b93b0 tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] Action: 'create', calling method: .version_select at 0x7f6081ef1700>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1323660800", "public_key": " "}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:07.462731 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-5533f8cb-f209-40ed-9a11-edf7cb1b93b0 tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] Getting quotas for project e100ae4cabe741079b98c11e3a2642f6. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:00:07.468585 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-5533f8cb-f209-40ed-9a11-edf7cb1b93b0 tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] Getting quotas for user 40b3d19df0e64cd8916a7b49678d3def and project e100ae4cabe741079b98c11e3a2642f6. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:00:07.485675 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-5533f8cb-f209-40ed-9a11-edf7cb1b93b0 tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5533f8cb-f209-40ed-9a11-edf7cb1b93b0 tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] Request method failure captured: Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 95 Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGFGZbkTRh02D4FTvtPoEHqVyFVItJSHihNpMrBRLxgCBGG2q2cUgT3M66Iy9pB3QX2z4AQ47fqcLJZ2RZOMcprsbAHNFj5OXO6pQheTCzbHiB5bqOy6kKV-rPLPTzTnQmvkD5Z48cPahmfCTovTKQxkaMB-VbjEEH9nlWL0jNJxfX0 Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: e100ae4cabe741079b98c11e3a2642f6 Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-663340130 Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e100ae4cabe741079b98c11e3a2642f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e100ae4cabe741079b98c11e3a2642f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e100ae4cabe741079b98c11e3a2642f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e100ae4cabe741079b98c11e3a2642f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-KeyPairsNegativeTestJSON-663340130 Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: e100ae4cabe741079b98c11e3a2642f6 Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-663340130 Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-KeyPairsNegativeTestJSON-663340130-project Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 40b3d19df0e64cd8916a7b49678d3def Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-KeyPairsNegativeTestJSON-663340130-project Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1323660800", "public_key": " "}} Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: exception: Keypair data is invalid: failed to generate fingerprint Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1323660800', 'public_key': ' '}}} Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.487978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:07.492835 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:07.492835 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:07.492835 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:00:07.492835 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:00:07.492835 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:00:07.492835 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:00:07.492835 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:00:07.492835 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:00:07.492835 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:00:07.492835 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:00:07.492835 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:00:07.492835 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:00:07.492835 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jun 20 12:00:07.492835 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jun 20 12:00:07.492835 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jun 20 12:00:07.492835 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jun 20 12:00:07.492835 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jun 20 12:00:07.492835 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.492835 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:07.492835 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.492835 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:07.492835 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:07.492835 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:07.492835 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:00:07.492835 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:00:07.492835 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jun 20 12:00:07.492835 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.492835 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5533f8cb-f209-40ed-9a11-edf7cb1b93b0 tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:00:07.492835 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5533f8cb-f209-40ed-9a11-edf7cb1b93b0 tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.046982 Jun 20 12:00:07.499236 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 485/959] 10.222.0.27 () {60 vars in 1157 bytes} [Mon Jun 20 12:00:07 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 20 12:00:07.506460 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-028e0ebf-fb1b-47a8-9335-587c5fcb5acd tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] Action: 'create', calling method: .version_select at 0x7f6073cb2ca0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPOtCcyrKhu/hW3IRKNvYbr+tc/dRRYr5QOX6cG9xHJzClesmW6bxiEvrBa3mp16FJ5lQQUoW0cWEXAZmpgwsMOMtS3++XFR6l0sf5QxSh+YBwzCuw5bJQNi+ffNih6DA=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-028e0ebf-fb1b-47a8-9335-587c5fcb5acd tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] Request method failure captured: Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 507 Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGFGZbkTRh02D4FTvtPoEHqVyFVItJSHihNpMrBRLxgCBGG2q2cUgT3M66Iy9pB3QX2z4AQ47fqcLJZ2RZOMcprsbAHNFj5OXO6pQheTCzbHiB5bqOy6kKV-rPLPTzTnQmvkD5Z48cPahmfCTovTKQxkaMB-VbjEEH9nlWL0jNJxfX0 Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: e100ae4cabe741079b98c11e3a2642f6 Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-663340130 Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e100ae4cabe741079b98c11e3a2642f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e100ae4cabe741079b98c11e3a2642f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e100ae4cabe741079b98c11e3a2642f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e100ae4cabe741079b98c11e3a2642f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-KeyPairsNegativeTestJSON-663340130 Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: e100ae4cabe741079b98c11e3a2642f6 Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-663340130 Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-KeyPairsNegativeTestJSON-663340130-project Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 40b3d19df0e64cd8916a7b49678d3def Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-KeyPairsNegativeTestJSON-663340130-project Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPOtCcyrKhu/hW3IRKNvYbr+tc/dRRYr5QOX6cG9xHJzClesmW6bxiEvrBa3mp16FJ5lQQUoW0cWEXAZmpgwsMOMtS3++XFR6l0sf5QxSh+YBwzCuw5bJQNi+ffNih6DA=="}} Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPOtCcyrKhu/hW3IRKNvYbr+tc/dRRYr5QOX6cG9xHJzClesmW6bxiEvrBa3mp16FJ5lQQUoW0cWEXAZmpgwsMOMtS3++XFR6l0sf5QxSh+YBwzCuw5bJQNi+ffNih6DA=='}}} Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise error Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Jun 20 12:00:07.509705 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.513397 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:07.513397 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.513397 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:07.513397 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:07.513397 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:07.513397 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:00:07.513397 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:00:07.513397 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:00:07.513397 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:00:07.513397 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:00:07.513397 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:00:07.513397 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:00:07.513397 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:00:07.513397 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 12:00:07.513397 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 12:00:07.513397 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 12:00:07.513397 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 12:00:07.513397 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 12:00:07.513397 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 12:00:07.513397 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jun 20 12:00:07.513397 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.513397 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:07.513397 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.513397 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:07.513397 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:07.513397 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:07.513397 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 12:00:07.513397 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 12:00:07.513397 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jun 20 12:00:07.513397 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.513397 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-028e0ebf-fb1b-47a8-9335-587c5fcb5acd tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:00:07.513397 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-028e0ebf-fb1b-47a8-9335-587c5fcb5acd tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.009299 Jun 20 12:00:07.513397 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 475/960] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 12:00:07 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:00:07.521400 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-77177f62-1ccd-4381-8d44-3745669fed5a tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] Action: 'create', calling method: .version_select at 0x7f60739e8c10>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1870983826", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:07.536070 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-77177f62-1ccd-4381-8d44-3745669fed5a tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] Getting quotas for project e100ae4cabe741079b98c11e3a2642f6. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:00:07.541632 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-77177f62-1ccd-4381-8d44-3745669fed5a tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] Getting quotas for user 40b3d19df0e64cd8916a7b49678d3def and project e100ae4cabe741079b98c11e3a2642f6. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:00:07.560261 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-77177f62-1ccd-4381-8d44-3745669fed5a tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-77177f62-1ccd-4381-8d44-3745669fed5a tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] Request method failure captured: Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 118 Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGFGZbkTRh02D4FTvtPoEHqVyFVItJSHihNpMrBRLxgCBGG2q2cUgT3M66Iy9pB3QX2z4AQ47fqcLJZ2RZOMcprsbAHNFj5OXO6pQheTCzbHiB5bqOy6kKV-rPLPTzTnQmvkD5Z48cPahmfCTovTKQxkaMB-VbjEEH9nlWL0jNJxfX0 Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: e100ae4cabe741079b98c11e3a2642f6 Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-663340130 Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e100ae4cabe741079b98c11e3a2642f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e100ae4cabe741079b98c11e3a2642f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e100ae4cabe741079b98c11e3a2642f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e100ae4cabe741079b98c11e3a2642f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-KeyPairsNegativeTestJSON-663340130 Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: e100ae4cabe741079b98c11e3a2642f6 Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-663340130 Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-KeyPairsNegativeTestJSON-663340130-project Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 40b3d19df0e64cd8916a7b49678d3def Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-KeyPairsNegativeTestJSON-663340130-project Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1870983826", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: exception: Keypair data is invalid: failed to generate fingerprint Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1870983826', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jun 20 12:00:07.563110 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jun 20 12:00:07.567757 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jun 20 12:00:07.567757 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jun 20 12:00:07.567757 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jun 20 12:00:07.567757 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.567757 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:07.567757 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.567757 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:07.567757 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:07.567757 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:07.567757 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:00:07.567757 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:00:07.567757 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:00:07.567757 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:00:07.567757 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:00:07.567757 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:00:07.567757 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:00:07.567757 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:00:07.567757 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:00:07.567757 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:00:07.567757 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jun 20 12:00:07.567757 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jun 20 12:00:07.567757 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jun 20 12:00:07.567757 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jun 20 12:00:07.567757 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jun 20 12:00:07.567757 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.567757 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:07.567757 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.567757 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:07.567757 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:07.567757 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:07.567757 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:00:07.567757 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:00:07.567757 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jun 20 12:00:07.567757 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.567757 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-77177f62-1ccd-4381-8d44-3745669fed5a tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:00:07.567757 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-77177f62-1ccd-4381-8d44-3745669fed5a tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.047348 Jun 20 12:00:07.567757 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 486/961] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 12:00:07 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 20 12:00:07.575898 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5725b047-c129-4682-99dc-285b7cfd16b8 tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] Calling method '.version_select at 0x7f607396f8b0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:07.588378 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-5725b047-c129-4682-99dc-285b7cfd16b8 tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-222175092 not found for user 40b3d19df0e64cd8916a7b49678d3def Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5725b047-c129-4682-99dc-285b7cfd16b8 tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] Request method failure captured: Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-222175092 HTTP/1.1 Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGFGZbkTRh02D4FTvtPoEHqVyFVItJSHihNpMrBRLxgCBGG2q2cUgT3M66Iy9pB3QX2z4AQ47fqcLJZ2RZOMcprsbAHNFj5OXO6pQheTCzbHiB5bqOy6kKV-rPLPTzTnQmvkD5Z48cPahmfCTovTKQxkaMB-VbjEEH9nlWL0jNJxfX0 Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: e100ae4cabe741079b98c11e3a2642f6 Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-663340130 Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e100ae4cabe741079b98c11e3a2642f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e100ae4cabe741079b98c11e3a2642f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e100ae4cabe741079b98c11e3a2642f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e100ae4cabe741079b98c11e3a2642f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-KeyPairsNegativeTestJSON-663340130 Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: e100ae4cabe741079b98c11e3a2642f6 Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-663340130 Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-KeyPairsNegativeTestJSON-663340130-project Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 40b3d19df0e64cd8916a7b49678d3def Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-KeyPairsNegativeTestJSON-663340130-project Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: exception: Keypair tempest-keypair-non-existent-222175092 not found for user 40b3d19df0e64cd8916a7b49678d3def Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'tempest-keypair-non-existent-222175092'} Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-222175092 not found for user 40b3d19df0e64cd8916a7b49678d3def Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.590322 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:07.600118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.600118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:07.600118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:07.600118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:07.600118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:00:07.600118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:00:07.600118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:00:07.600118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:00:07.600118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 20 12:00:07.600118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:00:07.600118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:00:07.600118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:00:07.600118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jun 20 12:00:07.600118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jun 20 12:00:07.600118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jun 20 12:00:07.600118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jun 20 12:00:07.600118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-222175092 not found for user 40b3d19df0e64cd8916a7b49678d3def Jun 20 12:00:07.600118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.600118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:07.600118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.600118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:07.600118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:07.600118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:07.600118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:00:07.600118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:00:07.600118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-222175092 not found for user 40b3d19df0e64cd8916a7b49678d3def Jun 20 12:00:07.600118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:07.600118 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5725b047-c129-4682-99dc-285b7cfd16b8 tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] Returning 404 to user: Keypair tempest-keypair-non-existent-222175092 not found for user 40b3d19df0e64cd8916a7b49678d3def {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:00:07.600118 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5725b047-c129-4682-99dc-285b7cfd16b8 tempest-KeyPairsNegativeTestJSON-663340130 tempest-KeyPairsNegativeTestJSON-663340130-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-222175092" status: 404 len: 144 microversion: 2.1 time: 0.019922 Jun 20 12:00:07.600118 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 476/962] 10.222.0.27 () {58 vars in 1256 bytes} [Mon Jun 20 12:00:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-222175092 => generated 144 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:00:07.620951 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3bab1d54-ac78-4bdd-94cc-7f442384843c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:07.621784 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3bab1d54-ac78-4bdd-94cc-7f442384843c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 66d1074f-478d-4676-ab01-4dc1d4561a42] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:07.637015 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3bab1d54-ac78-4bdd-94cc-7f442384843c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:07.637526 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3bab1d54-ac78-4bdd-94cc-7f442384843c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:07.638785 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3bab1d54-ac78-4bdd-94cc-7f442384843c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:07.639234 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3bab1d54-ac78-4bdd-94cc-7f442384843c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:07.887265 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-05e6d9a2-2e9f-4e2b-a9ef-05e0d1d1b817 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:07.888570 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-05e6d9a2-2e9f-4e2b-a9ef-05e0d1d1b817 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] [instance: 1c763272-042e-418c-b2f6-cc2e96f0c54d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:07.897354 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-05e6d9a2-2e9f-4e2b-a9ef-05e0d1d1b817 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:07.899389 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-05e6d9a2-2e9f-4e2b-a9ef-05e0d1d1b817 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:07.900428 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-05e6d9a2-2e9f-4e2b-a9ef-05e0d1d1b817 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:07.901028 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-05e6d9a2-2e9f-4e2b-a9ef-05e0d1d1b817 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:07.967713 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3bab1d54-ac78-4bdd-94cc-7f442384843c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:07.978098 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3bab1d54-ac78-4bdd-94cc-7f442384843c tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42" status: 200 len: 1473 microversion: 2.1 time: 0.364171 Jun 20 12:00:07.983477 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 487/963] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:07 2022] GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42 => generated 1473 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:08.122901 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-05e6d9a2-2e9f-4e2b-a9ef-05e0d1d1b817 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f4e0e140c4a839d99b56ee9ffacc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35cecfcbb948c6b60eef6140f87a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:08.139583 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-05e6d9a2-2e9f-4e2b-a9ef-05e0d1d1b817 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] 10.222.0.27 "GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d" status: 200 len: 1371 microversion: 2.1 time: 0.257326 Jun 20 12:00:08.140229 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 477/964] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:07 2022] GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d => generated 1371 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:08.258874 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-94b35a79-22f4-49be-80e7-7f290306f8cf tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:08.260315 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-94b35a79-22f4-49be-80e7-7f290306f8cf tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:08.281743 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94b35a79-22f4-49be-80e7-7f290306f8cf tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:08.283906 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94b35a79-22f4-49be-80e7-7f290306f8cf tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:08.285808 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94b35a79-22f4-49be-80e7-7f290306f8cf tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:08.287716 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94b35a79-22f4-49be-80e7-7f290306f8cf tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:08.628916 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-94b35a79-22f4-49be-80e7-7f290306f8cf tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:08.663177 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-94b35a79-22f4-49be-80e7-7f290306f8cf tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:08.686272 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-94b35a79-22f4-49be-80e7-7f290306f8cf tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:08.688171 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-94b35a79-22f4-49be-80e7-7f290306f8cf tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1411 microversion: 2.25 time: 0.433704 Jun 20 12:00:08.689989 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 488/965] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:00:08 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1411 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:00:08.999211 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5edbe6de-18cf-4537-a806-8159b8d3c675 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:09.000261 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5edbe6de-18cf-4537-a806-8159b8d3c675 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 66d1074f-478d-4676-ab01-4dc1d4561a42] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:09.022903 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5edbe6de-18cf-4537-a806-8159b8d3c675 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:09.023478 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5edbe6de-18cf-4537-a806-8159b8d3c675 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:09.024132 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5edbe6de-18cf-4537-a806-8159b8d3c675 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:09.024603 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5edbe6de-18cf-4537-a806-8159b8d3c675 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:09.156932 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c7a9fd12-092b-4007-b705-a39ecb22d658 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:09.158016 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c7a9fd12-092b-4007-b705-a39ecb22d658 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] [instance: 1c763272-042e-418c-b2f6-cc2e96f0c54d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:09.174975 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c7a9fd12-092b-4007-b705-a39ecb22d658 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:09.181014 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c7a9fd12-092b-4007-b705-a39ecb22d658 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:09.181959 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c7a9fd12-092b-4007-b705-a39ecb22d658 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:09.182505 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c7a9fd12-092b-4007-b705-a39ecb22d658 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:09.265386 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5edbe6de-18cf-4537-a806-8159b8d3c675 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:09.284729 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5edbe6de-18cf-4537-a806-8159b8d3c675 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42" status: 200 len: 1473 microversion: 2.1 time: 0.287909 Jun 20 12:00:09.297010 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 478/966] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:08 2022] GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42 => generated 1473 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:09.717234 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5c90a5a7-9de8-44b8-81d0-5f6603831fe1 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:09.722353 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5c90a5a7-9de8-44b8-81d0-5f6603831fe1 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:09.746256 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5c90a5a7-9de8-44b8-81d0-5f6603831fe1 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:09.749574 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5c90a5a7-9de8-44b8-81d0-5f6603831fe1 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:09.751933 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5c90a5a7-9de8-44b8-81d0-5f6603831fe1 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:09.752849 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5c90a5a7-9de8-44b8-81d0-5f6603831fe1 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:09.947999 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c7a9fd12-092b-4007-b705-a39ecb22d658 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f4e0e140c4a839d99b56ee9ffacc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35cecfcbb948c6b60eef6140f87a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:09.957944 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c7a9fd12-092b-4007-b705-a39ecb22d658 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] 10.222.0.27 "GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d" status: 200 len: 1371 microversion: 2.1 time: 0.805509 Jun 20 12:00:09.969531 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 489/967] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:09 2022] GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d => generated 1371 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:00:10.280096 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2a64a014-5513-408c-819c-8cb63451a521 tempest-AbsoluteLimitsTestJSON-1071692 tempest-AbsoluteLimitsTestJSON-1071692-project] Calling method '.version_select at 0x7f607378a3a0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:10.309816 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a64a014-5513-408c-819c-8cb63451a521 tempest-AbsoluteLimitsTestJSON-1071692 tempest-AbsoluteLimitsTestJSON-1071692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:10.312395 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a64a014-5513-408c-819c-8cb63451a521 tempest-AbsoluteLimitsTestJSON-1071692 tempest-AbsoluteLimitsTestJSON-1071692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:10.313499 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a64a014-5513-408c-819c-8cb63451a521 tempest-AbsoluteLimitsTestJSON-1071692 tempest-AbsoluteLimitsTestJSON-1071692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:10.314951 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a64a014-5513-408c-819c-8cb63451a521 tempest-AbsoluteLimitsTestJSON-1071692 tempest-AbsoluteLimitsTestJSON-1071692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:10.386411 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2a64a014-5513-408c-819c-8cb63451a521 tempest-AbsoluteLimitsTestJSON-1071692 tempest-AbsoluteLimitsTestJSON-1071692-project] 10.222.0.27 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.414932 Jun 20 12:00:10.387604 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 490/968] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jun 20 12:00:09 2022] GET /compute/v2.1/limits => generated 511 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:00:10.392592 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2dd28596-6dcf-4461-a5d0-797723111c07 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:10.393582 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2dd28596-6dcf-4461-a5d0-797723111c07 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 66d1074f-478d-4676-ab01-4dc1d4561a42] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:10.433377 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2dd28596-6dcf-4461-a5d0-797723111c07 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:10.434247 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2dd28596-6dcf-4461-a5d0-797723111c07 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:10.435110 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2dd28596-6dcf-4461-a5d0-797723111c07 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:10.435556 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2dd28596-6dcf-4461-a5d0-797723111c07 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:10.959517 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5c90a5a7-9de8-44b8-81d0-5f6603831fe1 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:10.964834 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:00:10.975874 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5c90a5a7-9de8-44b8-81d0-5f6603831fe1 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:10.978987 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5c90a5a7-9de8-44b8-81d0-5f6603831fe1 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:10.981057 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5c90a5a7-9de8-44b8-81d0-5f6603831fe1 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1411 microversion: 2.25 time: 1.277887 Jun 20 12:00:10.982271 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 479/969] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:00:09 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1411 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:00:11.005089 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d39a4702-6f42-46c1-9e79-17b0dc67871d tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:11.012248 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d39a4702-6f42-46c1-9e79-17b0dc67871d tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] [instance: 1c763272-042e-418c-b2f6-cc2e96f0c54d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:11.021525 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d39a4702-6f42-46c1-9e79-17b0dc67871d tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:11.022407 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d39a4702-6f42-46c1-9e79-17b0dc67871d tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:11.023457 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d39a4702-6f42-46c1-9e79-17b0dc67871d tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:11.024100 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d39a4702-6f42-46c1-9e79-17b0dc67871d tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:11.395705 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d39a4702-6f42-46c1-9e79-17b0dc67871d tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f4e0e140c4a839d99b56ee9ffacc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35cecfcbb948c6b60eef6140f87a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:11.407660 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d39a4702-6f42-46c1-9e79-17b0dc67871d tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] 10.222.0.27 "GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d" status: 200 len: 1371 microversion: 2.1 time: 0.420819 Jun 20 12:00:11.411289 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 480/970] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:10 2022] GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d => generated 1371 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:11.417530 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-ef6dd4fa-5eda-46e8-9582-3b74246f4e5b req-bec35061-cc50-464c-83ce-db0a8dcbd68c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66d1074f-478d-4676-ab01-4dc1d4561a42", "name": "network-vif-deleted", "tag": "72a638fb-8a29-4a15-ac3c-30318a976b7a"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:11.449652 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ef6dd4fa-5eda-46e8-9582-3b74246f4e5b req-bec35061-cc50-464c-83ce-db0a8dcbd68c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:11.452935 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ef6dd4fa-5eda-46e8-9582-3b74246f4e5b req-bec35061-cc50-464c-83ce-db0a8dcbd68c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:11.479646 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-ef6dd4fa-5eda-46e8-9582-3b74246f4e5b req-bec35061-cc50-464c-83ce-db0a8dcbd68c service nova] Creating event network-vif-deleted:72a638fb-8a29-4a15-ac3c-30318a976b7a for instance 66d1074f-478d-4676-ab01-4dc1d4561a42 on n-h2-master-1 Jun 20 12:00:11.489738 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-ef6dd4fa-5eda-46e8-9582-3b74246f4e5b req-bec35061-cc50-464c-83ce-db0a8dcbd68c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076851 Jun 20 12:00:11.490925 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 481/971] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:00:11.504425 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2dd28596-6dcf-4461-a5d0-797723111c07 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:11.528195 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2dd28596-6dcf-4461-a5d0-797723111c07 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42" status: 200 len: 1473 microversion: 2.1 time: 1.139177 Jun 20 12:00:11.540598 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 491/972] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:10 2022] GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42 => generated 1473 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:12.016053 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-54d16d9f-9f66-4230-b433-839c77f051ae tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:12.016991 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-54d16d9f-9f66-4230-b433-839c77f051ae tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:12.033904 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-54d16d9f-9f66-4230-b433-839c77f051ae tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:12.034620 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-54d16d9f-9f66-4230-b433-839c77f051ae tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:12.041642 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-54d16d9f-9f66-4230-b433-839c77f051ae tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:12.044329 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-54d16d9f-9f66-4230-b433-839c77f051ae tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:12.428779 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-461d65c7-bd70-44b7-a7d0-bafea902eb89 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:12.430046 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-461d65c7-bd70-44b7-a7d0-bafea902eb89 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] [instance: 1c763272-042e-418c-b2f6-cc2e96f0c54d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:12.446288 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-461d65c7-bd70-44b7-a7d0-bafea902eb89 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:12.447874 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-461d65c7-bd70-44b7-a7d0-bafea902eb89 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:12.449790 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-461d65c7-bd70-44b7-a7d0-bafea902eb89 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:12.450528 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-461d65c7-bd70-44b7-a7d0-bafea902eb89 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:12.463938 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-54d16d9f-9f66-4230-b433-839c77f051ae tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:12.481710 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-54d16d9f-9f66-4230-b433-839c77f051ae tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:12.492841 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-54d16d9f-9f66-4230-b433-839c77f051ae tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:12.494377 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-54d16d9f-9f66-4230-b433-839c77f051ae tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1608 microversion: 2.25 time: 0.488584 Jun 20 12:00:12.495730 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 482/973] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:00:11 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1608 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:00:12.516364 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ced3983c-1049-4264-afb9-2ce13261526e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:12.517321 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ced3983c-1049-4264-afb9-2ce13261526e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:12.528805 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ced3983c-1049-4264-afb9-2ce13261526e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:12.533988 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ced3983c-1049-4264-afb9-2ce13261526e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:12.537146 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ced3983c-1049-4264-afb9-2ce13261526e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:12.537561 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ced3983c-1049-4264-afb9-2ce13261526e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:12.704254 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ced3983c-1049-4264-afb9-2ce13261526e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.195927 Jun 20 12:00:12.705436 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 483/974] 10.222.0.27 () {60 vars in 1315 bytes} [Mon Jun 20 12:00:12 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed/os-interface => generated 285 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:00:12.711719 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8bcff491-1276-4b31-a179-f5922d51f864 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:12.713135 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8bcff491-1276-4b31-a179-f5922d51f864 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 66d1074f-478d-4676-ab01-4dc1d4561a42] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:12.729899 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bcff491-1276-4b31-a179-f5922d51f864 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:12.732727 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bcff491-1276-4b31-a179-f5922d51f864 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:12.733982 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bcff491-1276-4b31-a179-f5922d51f864 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:12.736844 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bcff491-1276-4b31-a179-f5922d51f864 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:12.774076 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-8bcff491-1276-4b31-a179-f5922d51f864 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] HTTP exception thrown: Instance 66d1074f-478d-4676-ab01-4dc1d4561a42 could not be found. Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8bcff491-1276-4b31-a179-f5922d51f864 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Request method failure captured: Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42 HTTP/1.1 Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGB04YgN2qwmpAbSVYBj1yKvqSaDSqYj7KhnXAwxLFlA52NG70o92gYPB0cXzYJvuf_7FOWrI99cZVPKh4xXLrAHLOP_L0Q9mNXdSZyTZrSw1bqTuU7pza7A3jlbg1NmxOK9BJccrrZRONfFPEpVpJShKEnusLTFdnHs8tSnnukr1cc Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: a6150795e7424cca91c71531840d88be Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersOnMultiNodesTest-1662406801 Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6150795e7424cca91c71531840d88be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6150795e7424cca91c71531840d88be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a6150795e7424cca91c71531840d88be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a6150795e7424cca91c71531840d88be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersOnMultiNodesTest-1662406801 Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: a6150795e7424cca91c71531840d88be Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1662406801 Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersOnMultiNodesTest-1662406801-project Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 1297c1b206f845bcaf936313fd7eed9b Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersOnMultiNodesTest-1662406801-project Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 66d1074f-478d-4676-ab01-4dc1d4561a42 could not be found. Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '66d1074f-478d-4676-ab01-4dc1d4561a42'} Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66d1074f-478d-4676-ab01-4dc1d4561a42 could not be found. Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66d1074f-478d-4676-ab01-4dc1d4561a42 could not be found. Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:12.776130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:12.780607 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:12.780607 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:12.780607 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:12.780607 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:00:12.780607 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:00:12.780607 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66d1074f-478d-4676-ab01-4dc1d4561a42 could not be found. Jun 20 12:00:12.780607 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:12.780607 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8bcff491-1276-4b31-a179-f5922d51f864 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Returning 404 to user: Instance 66d1074f-478d-4676-ab01-4dc1d4561a42 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:00:12.782381 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8bcff491-1276-4b31-a179-f5922d51f864 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42" status: 404 len: 111 microversion: 2.1 time: 0.074711 Jun 20 12:00:12.786217 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 484/975] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:12 2022] GET /compute/v2.1/servers/66d1074f-478d-4676-ab01-4dc1d4561a42 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:00:12.794928 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-57ea1799-9b16-445f-9613-899d1ffe5eed tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:12.795428 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-57ea1799-9b16-445f-9613-899d1ffe5eed tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: a20958a4-d7af-4e1b-bb62-823c89c60073] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:12.810860 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57ea1799-9b16-445f-9613-899d1ffe5eed tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:12.811611 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57ea1799-9b16-445f-9613-899d1ffe5eed tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:12.817881 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57ea1799-9b16-445f-9613-899d1ffe5eed tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:12.819100 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57ea1799-9b16-445f-9613-899d1ffe5eed tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:12.901319 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-57ea1799-9b16-445f-9613-899d1ffe5eed tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: a20958a4-d7af-4e1b-bb62-823c89c60073] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:00:12.905533 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-461d65c7-bd70-44b7-a7d0-bafea902eb89 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f4e0e140c4a839d99b56ee9ffacc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35cecfcbb948c6b60eef6140f87a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:12.919311 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-461d65c7-bd70-44b7-a7d0-bafea902eb89 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] 10.222.0.27 "GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d" status: 200 len: 1371 microversion: 2.1 time: 0.496101 Jun 20 12:00:12.927732 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 492/976] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:12 2022] GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d => generated 1371 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:00:13.075219 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:00:13.103358 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-57ea1799-9b16-445f-9613-899d1ffe5eed tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a20958a4-d7af-4e1b-bb62-823c89c60073" status: 204 len: 0 microversion: 2.1 time: 0.314790 Jun 20 12:00:13.106137 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 485/977] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:00:12 2022] DELETE /compute/v2.1/servers/a20958a4-d7af-4e1b-bb62-823c89c60073 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:00:13.115336 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3c49b9d2-b161-4a6b-a19c-7c86cb6ef987 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:13.117132 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3c49b9d2-b161-4a6b-a19c-7c86cb6ef987 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 1a618cf4-fd96-4675-a17c-899544a65dcf] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:13.133868 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3c49b9d2-b161-4a6b-a19c-7c86cb6ef987 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:13.144985 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3c49b9d2-b161-4a6b-a19c-7c86cb6ef987 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:13.147900 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3c49b9d2-b161-4a6b-a19c-7c86cb6ef987 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:13.148609 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3c49b9d2-b161-4a6b-a19c-7c86cb6ef987 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:13.215891 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3c49b9d2-b161-4a6b-a19c-7c86cb6ef987 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 1a618cf4-fd96-4675-a17c-899544a65dcf] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:00:13.487920 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3c49b9d2-b161-4a6b-a19c-7c86cb6ef987 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1a618cf4-fd96-4675-a17c-899544a65dcf" status: 204 len: 0 microversion: 2.1 time: 0.376413 Jun 20 12:00:13.490044 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 493/978] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:00:13 2022] DELETE /compute/v2.1/servers/1a618cf4-fd96-4675-a17c-899544a65dcf => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:00:13.499340 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c6d22db8-2f8f-4a30-afb5-dce2fc4fbd98 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:13.500681 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c6d22db8-2f8f-4a30-afb5-dce2fc4fbd98 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: a20958a4-d7af-4e1b-bb62-823c89c60073] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:13.521271 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6d22db8-2f8f-4a30-afb5-dce2fc4fbd98 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:13.522290 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6d22db8-2f8f-4a30-afb5-dce2fc4fbd98 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:13.528289 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6d22db8-2f8f-4a30-afb5-dce2fc4fbd98 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:13.529593 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6d22db8-2f8f-4a30-afb5-dce2fc4fbd98 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:13.956523 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1f6be958-1bcf-46e7-bc17-221147a67477 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:13.957988 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1f6be958-1bcf-46e7-bc17-221147a67477 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] [instance: 1c763272-042e-418c-b2f6-cc2e96f0c54d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:13.982399 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f6be958-1bcf-46e7-bc17-221147a67477 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:13.983144 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f6be958-1bcf-46e7-bc17-221147a67477 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:13.984682 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f6be958-1bcf-46e7-bc17-221147a67477 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:13.985672 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f6be958-1bcf-46e7-bc17-221147a67477 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:14.318018 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1f6be958-1bcf-46e7-bc17-221147a67477 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f4e0e140c4a839d99b56ee9ffacc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35cecfcbb948c6b60eef6140f87a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:14.352584 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1f6be958-1bcf-46e7-bc17-221147a67477 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] 10.222.0.27 "GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d" status: 200 len: 1371 microversion: 2.1 time: 0.409030 Jun 20 12:00:14.356656 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 494/979] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:13 2022] GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d => generated 1371 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:14.491859 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c6d22db8-2f8f-4a30-afb5-dce2fc4fbd98 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:14.508063 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c6d22db8-2f8f-4a30-afb5-dce2fc4fbd98 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/a20958a4-d7af-4e1b-bb62-823c89c60073" status: 200 len: 1475 microversion: 2.1 time: 1.012778 Jun 20 12:00:14.508791 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 486/980] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:13 2022] GET /compute/v2.1/servers/a20958a4-d7af-4e1b-bb62-823c89c60073 => generated 1475 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:14.662857 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fe671005-a93b-4f9c-9dcf-a58f70a1dcba tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:14.663482 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fe671005-a93b-4f9c-9dcf-a58f70a1dcba tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: 042df052-0ba8-4734-803c-c168858021f3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:14.666770 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:00:14.679077 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe671005-a93b-4f9c-9dcf-a58f70a1dcba tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:14.711943 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe671005-a93b-4f9c-9dcf-a58f70a1dcba tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:14.715361 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe671005-a93b-4f9c-9dcf-a58f70a1dcba tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:14.715791 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe671005-a93b-4f9c-9dcf-a58f70a1dcba tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:14.829101 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fe671005-a93b-4f9c-9dcf-a58f70a1dcba tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: 042df052-0ba8-4734-803c-c168858021f3] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:00:14.963004 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:00:15.044303 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fe671005-a93b-4f9c-9dcf-a58f70a1dcba tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "DELETE /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3" status: 204 len: 0 microversion: 2.1 time: 0.386324 Jun 20 12:00:15.045871 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 495/981] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:00:14 2022] DELETE /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:00:15.054579 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b6302ea2-2330-4841-b7f5-dc63554ddbbc tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:15.055823 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b6302ea2-2330-4841-b7f5-dc63554ddbbc tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: 042df052-0ba8-4734-803c-c168858021f3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:15.069974 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b6302ea2-2330-4841-b7f5-dc63554ddbbc tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:15.070627 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b6302ea2-2330-4841-b7f5-dc63554ddbbc tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:15.071491 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b6302ea2-2330-4841-b7f5-dc63554ddbbc tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:15.071929 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b6302ea2-2330-4841-b7f5-dc63554ddbbc tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:15.376538 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-15140bc2-ed8a-48fb-8bf3-d8ea8ff8c8b8 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:15.378086 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-15140bc2-ed8a-48fb-8bf3-d8ea8ff8c8b8 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] [instance: 1c763272-042e-418c-b2f6-cc2e96f0c54d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:15.390188 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-15140bc2-ed8a-48fb-8bf3-d8ea8ff8c8b8 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:15.391369 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-15140bc2-ed8a-48fb-8bf3-d8ea8ff8c8b8 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:15.393017 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-15140bc2-ed8a-48fb-8bf3-d8ea8ff8c8b8 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:15.394048 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-15140bc2-ed8a-48fb-8bf3-d8ea8ff8c8b8 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:15.768510 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-15140bc2-ed8a-48fb-8bf3-d8ea8ff8c8b8 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f4e0e140c4a839d99b56ee9ffacc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35cecfcbb948c6b60eef6140f87a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:15.780761 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-15140bc2-ed8a-48fb-8bf3-d8ea8ff8c8b8 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] 10.222.0.27 "GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d" status: 200 len: 1371 microversion: 2.1 time: 0.410877 Jun 20 12:00:15.781360 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 496/982] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:15 2022] GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d => generated 1371 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:15.798045 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-12f38a2a-97d1-4934-9cc1-8aa575bdad07 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:15.798987 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-12f38a2a-97d1-4934-9cc1-8aa575bdad07 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: a20958a4-d7af-4e1b-bb62-823c89c60073] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:15.804740 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b6302ea2-2330-4841-b7f5-dc63554ddbbc tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f49b57013f4675a70bac9b13e0a229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8790cc26204435aaf4071847ee00288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:15.813795 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-12f38a2a-97d1-4934-9cc1-8aa575bdad07 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:15.821974 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b6302ea2-2330-4841-b7f5-dc63554ddbbc tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "GET /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3" status: 200 len: 1710 microversion: 2.1 time: 0.770591 Jun 20 12:00:15.823054 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-12f38a2a-97d1-4934-9cc1-8aa575bdad07 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:15.824016 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 487/983] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:15 2022] GET /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3 => generated 1710 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:15.824290 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-12f38a2a-97d1-4934-9cc1-8aa575bdad07 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:15.824842 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-12f38a2a-97d1-4934-9cc1-8aa575bdad07 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:15.829226 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-d221c2eb-eb33-429a-892a-f5f32be45a9e req-c403a642-bc13-40be-aee7-e941b8230b56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3db0bd7d-eed4-411a-a7b8-719b260233ed", "tag": "66a1f7cd-2c10-48c8-8f30-83c32f1d6186"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:15.850538 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-d221c2eb-eb33-429a-892a-f5f32be45a9e req-c403a642-bc13-40be-aee7-e941b8230b56 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:15.860898 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-d221c2eb-eb33-429a-892a-f5f32be45a9e req-c403a642-bc13-40be-aee7-e941b8230b56 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:15.877182 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-d221c2eb-eb33-429a-892a-f5f32be45a9e req-c403a642-bc13-40be-aee7-e941b8230b56 service nova] Creating event network-changed:66a1f7cd-2c10-48c8-8f30-83c32f1d6186 for instance 3db0bd7d-eed4-411a-a7b8-719b260233ed on n-h2-master-1 Jun 20 12:00:15.882508 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-d221c2eb-eb33-429a-892a-f5f32be45a9e req-c403a642-bc13-40be-aee7-e941b8230b56 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056756 Jun 20 12:00:15.883695 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 488/984] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:00:16.413011 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-12f38a2a-97d1-4934-9cc1-8aa575bdad07 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:16.424658 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-12f38a2a-97d1-4934-9cc1-8aa575bdad07 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/a20958a4-d7af-4e1b-bb62-823c89c60073" status: 200 len: 1475 microversion: 2.1 time: 0.641848 Jun 20 12:00:16.427702 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 497/985] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:15 2022] GET /compute/v2.1/servers/a20958a4-d7af-4e1b-bb62-823c89c60073 => generated 1475 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:16.809733 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-57dfc303-17ff-415c-a0ff-74bfb8b3b5fe tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:16.811541 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-57dfc303-17ff-415c-a0ff-74bfb8b3b5fe tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] [instance: 1c763272-042e-418c-b2f6-cc2e96f0c54d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:16.845098 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-13596c25-a168-4ace-8ee8-6b55eb866f52 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:16.845996 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-13596c25-a168-4ace-8ee8-6b55eb866f52 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: 042df052-0ba8-4734-803c-c168858021f3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:16.863173 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57dfc303-17ff-415c-a0ff-74bfb8b3b5fe tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:16.869274 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13596c25-a168-4ace-8ee8-6b55eb866f52 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:16.872894 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57dfc303-17ff-415c-a0ff-74bfb8b3b5fe tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:16.874480 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13596c25-a168-4ace-8ee8-6b55eb866f52 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:16.875592 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57dfc303-17ff-415c-a0ff-74bfb8b3b5fe tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:16.876730 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13596c25-a168-4ace-8ee8-6b55eb866f52 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:16.878199 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57dfc303-17ff-415c-a0ff-74bfb8b3b5fe tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:16.879871 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13596c25-a168-4ace-8ee8-6b55eb866f52 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:17.332451 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=4 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:00:17.614309 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-13596c25-a168-4ace-8ee8-6b55eb866f52 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f49b57013f4675a70bac9b13e0a229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8790cc26204435aaf4071847ee00288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:17.654481 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-13596c25-a168-4ace-8ee8-6b55eb866f52 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "GET /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3" status: 200 len: 1710 microversion: 2.1 time: 0.814605 Jun 20 12:00:17.676488 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 498/986] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:16 2022] GET /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3 => generated 1710 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:17.726480 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-7aee79dc-b55a-4d20-8933-7915a9f3fee7 req-c260b719-688a-4e91-999a-4c9f82604006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c763272-042e-418c-b2f6-cc2e96f0c54d", "name": "network-vif-plugged", "status": "completed", "tag": "b71a2013-f702-4588-976a-47402b05752a"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:17.757096 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-7aee79dc-b55a-4d20-8933-7915a9f3fee7 req-c260b719-688a-4e91-999a-4c9f82604006 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:17.763686 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-7aee79dc-b55a-4d20-8933-7915a9f3fee7 req-c260b719-688a-4e91-999a-4c9f82604006 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:17.810661 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-7aee79dc-b55a-4d20-8933-7915a9f3fee7 req-c260b719-688a-4e91-999a-4c9f82604006 service nova] Creating event network-vif-plugged:b71a2013-f702-4588-976a-47402b05752a for instance 1c763272-042e-418c-b2f6-cc2e96f0c54d on n-h2-master-1 Jun 20 12:00:17.829576 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-7aee79dc-b55a-4d20-8933-7915a9f3fee7 req-c260b719-688a-4e91-999a-4c9f82604006 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120398 Jun 20 12:00:17.830480 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 499/987] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:00:17.836900 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8ce3fa7e-6275-4a0d-8ffc-105e64b1598f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:17.838517 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8ce3fa7e-6275-4a0d-8ffc-105e64b1598f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: a20958a4-d7af-4e1b-bb62-823c89c60073] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:17.893547 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ce3fa7e-6275-4a0d-8ffc-105e64b1598f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:17.894014 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ce3fa7e-6275-4a0d-8ffc-105e64b1598f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:17.894816 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ce3fa7e-6275-4a0d-8ffc-105e64b1598f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:17.906390 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ce3fa7e-6275-4a0d-8ffc-105e64b1598f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:17.958606 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-8ce3fa7e-6275-4a0d-8ffc-105e64b1598f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] HTTP exception thrown: Instance a20958a4-d7af-4e1b-bb62-823c89c60073 could not be found. Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8ce3fa7e-6275-4a0d-8ffc-105e64b1598f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Request method failure captured: Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/a20958a4-d7af-4e1b-bb62-823c89c60073 HTTP/1.1 Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGB04YgN2qwmpAbSVYBj1yKvqSaDSqYj7KhnXAwxLFlA52NG70o92gYPB0cXzYJvuf_7FOWrI99cZVPKh4xXLrAHLOP_L0Q9mNXdSZyTZrSw1bqTuU7pza7A3jlbg1NmxOK9BJccrrZRONfFPEpVpJShKEnusLTFdnHs8tSnnukr1cc Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: a6150795e7424cca91c71531840d88be Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersOnMultiNodesTest-1662406801 Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6150795e7424cca91c71531840d88be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6150795e7424cca91c71531840d88be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a6150795e7424cca91c71531840d88be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a6150795e7424cca91c71531840d88be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersOnMultiNodesTest-1662406801 Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: a6150795e7424cca91c71531840d88be Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1662406801 Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersOnMultiNodesTest-1662406801-project Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 1297c1b206f845bcaf936313fd7eed9b Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersOnMultiNodesTest-1662406801-project Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: exception: Instance a20958a4-d7af-4e1b-bb62-823c89c60073 could not be found. Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'a20958a4-d7af-4e1b-bb62-823c89c60073'} Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a20958a4-d7af-4e1b-bb62-823c89c60073 could not be found. Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a20958a4-d7af-4e1b-bb62-823c89c60073 could not be found. Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:17.961496 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:17.966390 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:17.966390 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:17.966390 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:17.966390 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:00:17.966390 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:00:17.966390 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a20958a4-d7af-4e1b-bb62-823c89c60073 could not be found. Jun 20 12:00:17.966390 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:17.981467 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8ce3fa7e-6275-4a0d-8ffc-105e64b1598f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Returning 404 to user: Instance a20958a4-d7af-4e1b-bb62-823c89c60073 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:00:17.982725 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8ce3fa7e-6275-4a0d-8ffc-105e64b1598f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/a20958a4-d7af-4e1b-bb62-823c89c60073" status: 404 len: 111 microversion: 2.1 time: 0.150806 Jun 20 12:00:17.983438 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 500/988] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:17 2022] GET /compute/v2.1/servers/a20958a4-d7af-4e1b-bb62-823c89c60073 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:00:17.994576 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-23d45c53-bdc8-469f-9668-a600e8561bd6 req-f930e77f-29e6-463a-8c30-e337f5049fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a618cf4-fd96-4675-a17c-899544a65dcf", "name": "network-vif-deleted", "tag": "909ad315-4767-4718-9c17-767afc417cdf"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:18.029856 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-23d45c53-bdc8-469f-9668-a600e8561bd6 req-f930e77f-29e6-463a-8c30-e337f5049fb6 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:18.030319 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-23d45c53-bdc8-469f-9668-a600e8561bd6 req-f930e77f-29e6-463a-8c30-e337f5049fb6 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:18.063707 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-23d45c53-bdc8-469f-9668-a600e8561bd6 req-f930e77f-29e6-463a-8c30-e337f5049fb6 service nova] Creating event network-vif-deleted:909ad315-4767-4718-9c17-767afc417cdf for instance 1a618cf4-fd96-4675-a17c-899544a65dcf on n-h2-master-1 Jun 20 12:00:18.069355 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-23d45c53-bdc8-469f-9668-a600e8561bd6 req-f930e77f-29e6-463a-8c30-e337f5049fb6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081289 Jun 20 12:00:18.071479 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 501/989] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:00:18.078108 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-e1ec3352-0198-4acb-bf4e-d13a61904c0e req-018a65dc-8cb1-4035-8a5a-97948e43e1b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a20958a4-d7af-4e1b-bb62-823c89c60073", "name": "network-vif-deleted", "tag": "c3c36f49-931c-4f7b-b496-69341db3256c"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:18.091198 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e1ec3352-0198-4acb-bf4e-d13a61904c0e req-018a65dc-8cb1-4035-8a5a-97948e43e1b9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:18.091729 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e1ec3352-0198-4acb-bf4e-d13a61904c0e req-018a65dc-8cb1-4035-8a5a-97948e43e1b9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:18.098532 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-57dfc303-17ff-415c-a0ff-74bfb8b3b5fe tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f4e0e140c4a839d99b56ee9ffacc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35cecfcbb948c6b60eef6140f87a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:18.125184 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-57dfc303-17ff-415c-a0ff-74bfb8b3b5fe tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] 10.222.0.27 "GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d" status: 200 len: 1371 microversion: 2.1 time: 1.319870 Jun 20 12:00:18.126089 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 489/990] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:16 2022] GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d => generated 1371 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:18.189380 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-e1ec3352-0198-4acb-bf4e-d13a61904c0e req-018a65dc-8cb1-4035-8a5a-97948e43e1b9 service nova] Creating event network-vif-deleted:c3c36f49-931c-4f7b-b496-69341db3256c for instance a20958a4-d7af-4e1b-bb62-823c89c60073 on n-h1-master-1 Jun 20 12:00:18.191487 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5e791f26-54c6-490a-b87e-a3dc23fd11df tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:18.198570 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5e791f26-54c6-490a-b87e-a3dc23fd11df tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 1a618cf4-fd96-4675-a17c-899544a65dcf] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:18.220931 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5e791f26-54c6-490a-b87e-a3dc23fd11df tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:18.221674 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-e1ec3352-0198-4acb-bf4e-d13a61904c0e req-018a65dc-8cb1-4035-8a5a-97948e43e1b9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148181 Jun 20 12:00:18.222764 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 502/991] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:00:18.225027 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5e791f26-54c6-490a-b87e-a3dc23fd11df tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:18.227357 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5e791f26-54c6-490a-b87e-a3dc23fd11df tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:18.228120 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5e791f26-54c6-490a-b87e-a3dc23fd11df tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:18.315864 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5e791f26-54c6-490a-b87e-a3dc23fd11df tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:18.316720 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5e791f26-54c6-490a-b87e-a3dc23fd11df tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:18.318776 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-5e791f26-54c6-490a-b87e-a3dc23fd11df tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lazy-loading 'fault' on Instance uuid 1a618cf4-fd96-4675-a17c-899544a65dcf {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:00:18.530645 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5e791f26-54c6-490a-b87e-a3dc23fd11df tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:18.556494 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5e791f26-54c6-490a-b87e-a3dc23fd11df tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/1a618cf4-fd96-4675-a17c-899544a65dcf" status: 200 len: 1309 microversion: 2.1 time: 0.423723 Jun 20 12:00:18.569139 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 490/992] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:18 2022] GET /compute/v2.1/servers/1a618cf4-fd96-4675-a17c-899544a65dcf => generated 1309 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:18.676979 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cdba5537-849a-4b5c-9637-376b4cd4c54f tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:18.677607 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cdba5537-849a-4b5c-9637-376b4cd4c54f tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: 042df052-0ba8-4734-803c-c168858021f3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:18.695037 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cdba5537-849a-4b5c-9637-376b4cd4c54f tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:18.696004 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cdba5537-849a-4b5c-9637-376b4cd4c54f tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:18.700074 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cdba5537-849a-4b5c-9637-376b4cd4c54f tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:18.700780 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cdba5537-849a-4b5c-9637-376b4cd4c54f tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:19.040918 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-cdba5537-849a-4b5c-9637-376b4cd4c54f tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f49b57013f4675a70bac9b13e0a229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8790cc26204435aaf4071847ee00288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:19.058921 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cdba5537-849a-4b5c-9637-376b4cd4c54f tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "GET /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3" status: 200 len: 1710 microversion: 2.1 time: 0.391145 Jun 20 12:00:19.060175 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 503/993] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:18 2022] GET /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3 => generated 1710 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:19.146480 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1ff66057-842e-49be-a44c-a400b8bd78ff tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:19.147398 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1ff66057-842e-49be-a44c-a400b8bd78ff tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] [instance: 1c763272-042e-418c-b2f6-cc2e96f0c54d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:19.156342 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1ff66057-842e-49be-a44c-a400b8bd78ff tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:19.156798 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1ff66057-842e-49be-a44c-a400b8bd78ff tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:19.157591 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1ff66057-842e-49be-a44c-a400b8bd78ff tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:19.158035 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1ff66057-842e-49be-a44c-a400b8bd78ff tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:19.537722 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1ff66057-842e-49be-a44c-a400b8bd78ff tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f4e0e140c4a839d99b56ee9ffacc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35cecfcbb948c6b60eef6140f87a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:19.551250 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1ff66057-842e-49be-a44c-a400b8bd78ff tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] 10.222.0.27 "GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d" status: 200 len: 1371 microversion: 2.1 time: 0.409132 Jun 20 12:00:19.552890 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 491/994] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:19 2022] GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d => generated 1371 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:19.599007 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-eee83700-d538-4832-9458-932a6f3ca22b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:19.604910 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-eee83700-d538-4832-9458-932a6f3ca22b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 1a618cf4-fd96-4675-a17c-899544a65dcf] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:19.617689 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eee83700-d538-4832-9458-932a6f3ca22b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:19.620285 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eee83700-d538-4832-9458-932a6f3ca22b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:19.621569 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eee83700-d538-4832-9458-932a6f3ca22b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:19.622339 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eee83700-d538-4832-9458-932a6f3ca22b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:19.663863 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-eee83700-d538-4832-9458-932a6f3ca22b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] HTTP exception thrown: Instance 1a618cf4-fd96-4675-a17c-899544a65dcf could not be found. Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-eee83700-d538-4832-9458-932a6f3ca22b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Request method failure captured: Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/1a618cf4-fd96-4675-a17c-899544a65dcf HTTP/1.1 Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGB04YgN2qwmpAbSVYBj1yKvqSaDSqYj7KhnXAwxLFlA52NG70o92gYPB0cXzYJvuf_7FOWrI99cZVPKh4xXLrAHLOP_L0Q9mNXdSZyTZrSw1bqTuU7pza7A3jlbg1NmxOK9BJccrrZRONfFPEpVpJShKEnusLTFdnHs8tSnnukr1cc Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: a6150795e7424cca91c71531840d88be Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersOnMultiNodesTest-1662406801 Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6150795e7424cca91c71531840d88be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6150795e7424cca91c71531840d88be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a6150795e7424cca91c71531840d88be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a6150795e7424cca91c71531840d88be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersOnMultiNodesTest-1662406801 Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: a6150795e7424cca91c71531840d88be Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1662406801 Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersOnMultiNodesTest-1662406801-project Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 1297c1b206f845bcaf936313fd7eed9b Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersOnMultiNodesTest-1662406801-project Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 1a618cf4-fd96-4675-a17c-899544a65dcf could not be found. Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '1a618cf4-fd96-4675-a17c-899544a65dcf'} Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a618cf4-fd96-4675-a17c-899544a65dcf could not be found. Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a618cf4-fd96-4675-a17c-899544a65dcf could not be found. Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:19.666129 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:19.673533 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:19.673533 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:19.673533 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:19.673533 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:00:19.673533 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:00:19.673533 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a618cf4-fd96-4675-a17c-899544a65dcf could not be found. Jun 20 12:00:19.673533 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:19.676466 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-eee83700-d538-4832-9458-932a6f3ca22b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Returning 404 to user: Instance 1a618cf4-fd96-4675-a17c-899544a65dcf could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:00:19.687238 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-eee83700-d538-4832-9458-932a6f3ca22b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/1a618cf4-fd96-4675-a17c-899544a65dcf" status: 404 len: 111 microversion: 2.1 time: 0.094339 Jun 20 12:00:19.703175 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5e204dd4-39fb-4b23-a3a8-f7efc5e7164d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:19.714248 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 504/995] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:19 2022] GET /compute/v2.1/servers/1a618cf4-fd96-4675-a17c-899544a65dcf => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:00:19.823022 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5e204dd4-39fb-4b23-a3a8-f7efc5e7164d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/bfbb54d0-ba33-4556-8511-9ce0bdc7ca52" status: 204 len: 0 microversion: 2.1 time: 0.127642 Jun 20 12:00:19.827705 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 492/996] 10.222.0.27 () {58 vars in 1265 bytes} [Mon Jun 20 12:00:19 2022] DELETE /compute/v2.1/os-server-groups/bfbb54d0-ba33-4556-8511-9ce0bdc7ca52 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:00:19.836955 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3c79b8af-8555-46e1-99bc-be3d2a4a5f24 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:19.837512 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3c79b8af-8555-46e1-99bc-be3d2a4a5f24 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 5156dcdb-2590-41b9-8b02-3f04c5c4acf7] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:19.845779 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3c79b8af-8555-46e1-99bc-be3d2a4a5f24 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:19.847186 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3c79b8af-8555-46e1-99bc-be3d2a4a5f24 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:19.848666 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3c79b8af-8555-46e1-99bc-be3d2a4a5f24 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:19.850920 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3c79b8af-8555-46e1-99bc-be3d2a4a5f24 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:19.931992 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3c79b8af-8555-46e1-99bc-be3d2a4a5f24 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 5156dcdb-2590-41b9-8b02-3f04c5c4acf7] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:00:20.082052 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-23c19b6a-074c-49f6-a12f-ec1395b6ba87 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:20.082700 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-23c19b6a-074c-49f6-a12f-ec1395b6ba87 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: 042df052-0ba8-4734-803c-c168858021f3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:20.090707 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-23c19b6a-074c-49f6-a12f-ec1395b6ba87 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:20.091082 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-23c19b6a-074c-49f6-a12f-ec1395b6ba87 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:20.101358 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-23c19b6a-074c-49f6-a12f-ec1395b6ba87 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:20.104032 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-23c19b6a-074c-49f6-a12f-ec1395b6ba87 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:20.148566 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3c79b8af-8555-46e1-99bc-be3d2a4a5f24 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5156dcdb-2590-41b9-8b02-3f04c5c4acf7" status: 204 len: 0 microversion: 2.1 time: 0.312842 Jun 20 12:00:20.150313 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 505/997] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:00:19 2022] DELETE /compute/v2.1/servers/5156dcdb-2590-41b9-8b02-3f04c5c4acf7 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:00:20.177270 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f2438cf7-b0b0-4fea-80fd-c0d20364d75f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:20.182029 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f2438cf7-b0b0-4fea-80fd-c0d20364d75f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 097ee17d-f450-475a-8f33-fe596f6d98a0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:20.209618 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f2438cf7-b0b0-4fea-80fd-c0d20364d75f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:20.210426 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f2438cf7-b0b0-4fea-80fd-c0d20364d75f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:20.219188 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f2438cf7-b0b0-4fea-80fd-c0d20364d75f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:20.219653 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f2438cf7-b0b0-4fea-80fd-c0d20364d75f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:20.273795 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f2438cf7-b0b0-4fea-80fd-c0d20364d75f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 097ee17d-f450-475a-8f33-fe596f6d98a0] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:00:20.310788 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=18 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:00:20.358007 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:00:20.442563 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f2438cf7-b0b0-4fea-80fd-c0d20364d75f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "DELETE /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0" status: 204 len: 0 microversion: 2.1 time: 0.286677 Jun 20 12:00:20.443419 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 506/998] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:00:20 2022] DELETE /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:00:20.454452 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9643e0d7-660a-4bb3-90d9-c0fec0196f41 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:20.455990 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9643e0d7-660a-4bb3-90d9-c0fec0196f41 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 5156dcdb-2590-41b9-8b02-3f04c5c4acf7] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:20.474366 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9643e0d7-660a-4bb3-90d9-c0fec0196f41 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:20.477428 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9643e0d7-660a-4bb3-90d9-c0fec0196f41 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:20.481346 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9643e0d7-660a-4bb3-90d9-c0fec0196f41 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:20.483089 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9643e0d7-660a-4bb3-90d9-c0fec0196f41 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:20.723141 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-23c19b6a-074c-49f6-a12f-ec1395b6ba87 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f49b57013f4675a70bac9b13e0a229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8790cc26204435aaf4071847ee00288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:20.749736 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-23c19b6a-074c-49f6-a12f-ec1395b6ba87 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "GET /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3" status: 200 len: 1643 microversion: 2.1 time: 0.663705 Jun 20 12:00:20.750625 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 493/999] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:20 2022] GET /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3 => generated 1643 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:00:20.782549 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3a4f97ff-3cab-4a7f-8679-33f1c6032509 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:20.801313 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3a4f97ff-3cab-4a7f-8679-33f1c6032509 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] [instance: 1c763272-042e-418c-b2f6-cc2e96f0c54d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:20.828746 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a4f97ff-3cab-4a7f-8679-33f1c6032509 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:20.830115 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a4f97ff-3cab-4a7f-8679-33f1c6032509 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:20.833961 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a4f97ff-3cab-4a7f-8679-33f1c6032509 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:20.839352 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a4f97ff-3cab-4a7f-8679-33f1c6032509 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:20.856232 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9643e0d7-660a-4bb3-90d9-c0fec0196f41 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:20.872484 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9643e0d7-660a-4bb3-90d9-c0fec0196f41 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/5156dcdb-2590-41b9-8b02-3f04c5c4acf7" status: 200 len: 1472 microversion: 2.1 time: 0.423407 Jun 20 12:00:20.878398 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 507/1000] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:20 2022] GET /compute/v2.1/servers/5156dcdb-2590-41b9-8b02-3f04c5c4acf7 => generated 1472 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:00:20.895751 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-bbbcdc19-3421-4ed0-b092-c816c413d5a1 req-0121d799-6d24-4c85-bb0b-aa87d0a092f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "042df052-0ba8-4734-803c-c168858021f3", "name": "network-vif-deleted", "tag": "462d3ed2-a733-4603-91af-98ab7f43db64"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:20.923039 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-bbbcdc19-3421-4ed0-b092-c816c413d5a1 req-0121d799-6d24-4c85-bb0b-aa87d0a092f2 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:20.926417 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-bbbcdc19-3421-4ed0-b092-c816c413d5a1 req-0121d799-6d24-4c85-bb0b-aa87d0a092f2 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:20.956143 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-bbbcdc19-3421-4ed0-b092-c816c413d5a1 req-0121d799-6d24-4c85-bb0b-aa87d0a092f2 service nova] Creating event network-vif-deleted:462d3ed2-a733-4603-91af-98ab7f43db64 for instance 042df052-0ba8-4734-803c-c168858021f3 on n-h1-master-1 Jun 20 12:00:20.964644 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-bbbcdc19-3421-4ed0-b092-c816c413d5a1 req-0121d799-6d24-4c85-bb0b-aa87d0a092f2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084734 Jun 20 12:00:20.968517 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 508/1001] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:00:21.356259 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3a4f97ff-3cab-4a7f-8679-33f1c6032509 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f4e0e140c4a839d99b56ee9ffacc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35cecfcbb948c6b60eef6140f87a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:21.372463 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3a4f97ff-3cab-4a7f-8679-33f1c6032509 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] 10.222.0.27 "GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d" status: 200 len: 1558 microversion: 2.1 time: 0.615795 Jun 20 12:00:21.373897 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 494/1002] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:20 2022] GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d => generated 1558 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:21.400994 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7ac3b1aa-d83d-4028-9ccb-560bde8f0ef7 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:21.401598 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7ac3b1aa-d83d-4028-9ccb-560bde8f0ef7 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] [instance: 1c763272-042e-418c-b2f6-cc2e96f0c54d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:21.417160 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ac3b1aa-d83d-4028-9ccb-560bde8f0ef7 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:21.417650 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ac3b1aa-d83d-4028-9ccb-560bde8f0ef7 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:21.418928 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ac3b1aa-d83d-4028-9ccb-560bde8f0ef7 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:21.418928 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ac3b1aa-d83d-4028-9ccb-560bde8f0ef7 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:21.756905 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7ac3b1aa-d83d-4028-9ccb-560bde8f0ef7 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] 10.222.0.27 "GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.368527 Jun 20 12:00:21.758061 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 509/1003] 10.222.0.27 () {58 vars in 1274 bytes} [Mon Jun 20 12:00:21 2022] GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d/os-interface => generated 285 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:00:21.767397 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ebc4c769-2110-41c2-8749-96cdbdfccec7 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:21.768340 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ebc4c769-2110-41c2-8749-96cdbdfccec7 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: 042df052-0ba8-4734-803c-c168858021f3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:21.788106 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebc4c769-2110-41c2-8749-96cdbdfccec7 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:21.789852 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebc4c769-2110-41c2-8749-96cdbdfccec7 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:21.791563 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebc4c769-2110-41c2-8749-96cdbdfccec7 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:21.815793 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebc4c769-2110-41c2-8749-96cdbdfccec7 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:21.898544 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ae0de201-4ebc-4d58-8085-379d3476ec6d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:21.899590 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ae0de201-4ebc-4d58-8085-379d3476ec6d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 5156dcdb-2590-41b9-8b02-3f04c5c4acf7] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:21.907251 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-ebc4c769-2110-41c2-8749-96cdbdfccec7 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] HTTP exception thrown: Instance 042df052-0ba8-4734-803c-c168858021f3 could not be found. Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ebc4c769-2110-41c2-8749-96cdbdfccec7 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Request method failure captured: Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3 HTTP/1.1 Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGCf4Uuy3QB1PoMR1xxglERsWi60EPPymMOqRUeuzMEbwxSDQvoYvaIA6dd0ew5jlS0MqbjKpHHSKTIHmmQq4aY6udUDrYXzn-KC9EB5fazwTNAgF2wDtizokaJt5ieReW9Tdjpn-odcREZpN1aKb9C81BKcFpy4crxdOqiIMDGfLN0 Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: d8790cc26204435aaf4071847ee00288 Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-795633055 Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d8790cc26204435aaf4071847ee00288"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d8790cc26204435aaf4071847ee00288"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d8790cc26204435aaf4071847ee00288"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d8790cc26204435aaf4071847ee00288"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-795633055 Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: d8790cc26204435aaf4071847ee00288 Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-795633055 Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersWithSpecificFlavorTestJSON-795633055-project Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: f5f49b57013f4675a70bac9b13e0a229 Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-795633055-project Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 042df052-0ba8-4734-803c-c168858021f3 could not be found. Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '042df052-0ba8-4734-803c-c168858021f3'} Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 042df052-0ba8-4734-803c-c168858021f3 could not be found. Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 042df052-0ba8-4734-803c-c168858021f3 could not be found. Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:21.909750 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:21.925231 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:21.925231 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:21.925231 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:21.925231 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:21.925231 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:00:21.925231 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:00:21.925231 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 042df052-0ba8-4734-803c-c168858021f3 could not be found. Jun 20 12:00:21.925231 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:21.962612 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ae0de201-4ebc-4d58-8085-379d3476ec6d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:21.963102 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ae0de201-4ebc-4d58-8085-379d3476ec6d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:21.969867 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ae0de201-4ebc-4d58-8085-379d3476ec6d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:21.970327 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ae0de201-4ebc-4d58-8085-379d3476ec6d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:21.980946 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ebc4c769-2110-41c2-8749-96cdbdfccec7 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Returning 404 to user: Instance 042df052-0ba8-4734-803c-c168858021f3 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:00:21.989131 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ebc4c769-2110-41c2-8749-96cdbdfccec7 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "GET /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3" status: 404 len: 111 microversion: 2.1 time: 0.221159 Jun 20 12:00:21.994212 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 495/1004] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:21 2022] GET /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3 => generated 111 bytes in 231 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:00:22.033499 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-93087ff0-b2d2-413a-8589-bbfede2cb8b6 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:22.034719 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-93087ff0-b2d2-413a-8589-bbfede2cb8b6 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: adee1d54-6e18-4a4e-96ac-48a6fc56345d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:22.058218 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93087ff0-b2d2-413a-8589-bbfede2cb8b6 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:22.064034 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93087ff0-b2d2-413a-8589-bbfede2cb8b6 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:22.066807 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93087ff0-b2d2-413a-8589-bbfede2cb8b6 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:22.067893 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93087ff0-b2d2-413a-8589-bbfede2cb8b6 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:22.121939 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-93087ff0-b2d2-413a-8589-bbfede2cb8b6 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] HTTP exception thrown: Instance adee1d54-6e18-4a4e-96ac-48a6fc56345d could not be found. Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-93087ff0-b2d2-413a-8589-bbfede2cb8b6 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Request method failure captured: Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d HTTP/1.1 Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGCf4Uuy3QB1PoMR1xxglERsWi60EPPymMOqRUeuzMEbwxSDQvoYvaIA6dd0ew5jlS0MqbjKpHHSKTIHmmQq4aY6udUDrYXzn-KC9EB5fazwTNAgF2wDtizokaJt5ieReW9Tdjpn-odcREZpN1aKb9C81BKcFpy4crxdOqiIMDGfLN0 Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: d8790cc26204435aaf4071847ee00288 Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-795633055 Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d8790cc26204435aaf4071847ee00288"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d8790cc26204435aaf4071847ee00288"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d8790cc26204435aaf4071847ee00288"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d8790cc26204435aaf4071847ee00288"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-795633055 Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: d8790cc26204435aaf4071847ee00288 Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-795633055 Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersWithSpecificFlavorTestJSON-795633055-project Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: f5f49b57013f4675a70bac9b13e0a229 Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-795633055-project Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: exception: Instance adee1d54-6e18-4a4e-96ac-48a6fc56345d could not be found. Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'adee1d54-6e18-4a4e-96ac-48a6fc56345d'} Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adee1d54-6e18-4a4e-96ac-48a6fc56345d could not be found. Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:00:22.137779 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:00:22.146725 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adee1d54-6e18-4a4e-96ac-48a6fc56345d could not be found. Jun 20 12:00:22.146725 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:22.146725 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:22.146725 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:22.146725 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:22.146725 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:22.146725 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:22.146725 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:00:22.146725 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:00:22.146725 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adee1d54-6e18-4a4e-96ac-48a6fc56345d could not be found. Jun 20 12:00:22.146725 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:22.152759 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-93087ff0-b2d2-413a-8589-bbfede2cb8b6 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Returning 404 to user: Instance adee1d54-6e18-4a4e-96ac-48a6fc56345d could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:00:22.154323 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-93087ff0-b2d2-413a-8589-bbfede2cb8b6 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "DELETE /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d" status: 404 len: 111 microversion: 2.1 time: 0.148923 Jun 20 12:00:22.155680 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 496/1005] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:00:22 2022] DELETE /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:00:22.166762 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1a364ec6-0731-4d1a-a074-041b8c538ad7 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:22.168694 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1a364ec6-0731-4d1a-a074-041b8c538ad7 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: adee1d54-6e18-4a4e-96ac-48a6fc56345d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:22.184561 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a364ec6-0731-4d1a-a074-041b8c538ad7 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:22.186930 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a364ec6-0731-4d1a-a074-041b8c538ad7 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:22.189610 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a364ec6-0731-4d1a-a074-041b8c538ad7 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:22.191705 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a364ec6-0731-4d1a-a074-041b8c538ad7 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:22.234533 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-1a364ec6-0731-4d1a-a074-041b8c538ad7 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] HTTP exception thrown: Instance adee1d54-6e18-4a4e-96ac-48a6fc56345d could not be found. Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1a364ec6-0731-4d1a-a074-041b8c538ad7 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Request method failure captured: Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d HTTP/1.1 Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGCf4Uuy3QB1PoMR1xxglERsWi60EPPymMOqRUeuzMEbwxSDQvoYvaIA6dd0ew5jlS0MqbjKpHHSKTIHmmQq4aY6udUDrYXzn-KC9EB5fazwTNAgF2wDtizokaJt5ieReW9Tdjpn-odcREZpN1aKb9C81BKcFpy4crxdOqiIMDGfLN0 Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: d8790cc26204435aaf4071847ee00288 Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-795633055 Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d8790cc26204435aaf4071847ee00288"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d8790cc26204435aaf4071847ee00288"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d8790cc26204435aaf4071847ee00288"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d8790cc26204435aaf4071847ee00288"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-795633055 Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: d8790cc26204435aaf4071847ee00288 Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-795633055 Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersWithSpecificFlavorTestJSON-795633055-project Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: f5f49b57013f4675a70bac9b13e0a229 Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-795633055-project Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: exception: Instance adee1d54-6e18-4a4e-96ac-48a6fc56345d could not be found. Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'adee1d54-6e18-4a4e-96ac-48a6fc56345d'} Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adee1d54-6e18-4a4e-96ac-48a6fc56345d could not be found. Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adee1d54-6e18-4a4e-96ac-48a6fc56345d could not be found. Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:22.236948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:22.243209 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:22.243209 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:22.243209 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:22.243209 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:22.243209 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:00:22.243209 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:00:22.243209 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adee1d54-6e18-4a4e-96ac-48a6fc56345d could not be found. Jun 20 12:00:22.243209 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:22.245958 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1a364ec6-0731-4d1a-a074-041b8c538ad7 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Returning 404 to user: Instance adee1d54-6e18-4a4e-96ac-48a6fc56345d could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:00:22.247182 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1a364ec6-0731-4d1a-a074-041b8c538ad7 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "GET /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d" status: 404 len: 111 microversion: 2.1 time: 0.085963 Jun 20 12:00:22.248333 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 497/1006] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:22 2022] GET /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:00:22.267087 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3902a7ef-dc17-43b6-90e7-eab055c328f9 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '.version_select at 0x7f6073eea940>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:22.360143 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3902a7ef-dc17-43b6-90e7-eab055c328f9 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-830207600" status: 202 len: 0 microversion: 2.1 time: 0.101553 Jun 20 12:00:22.367977 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 498/1007] 10.222.0.27 () {58 vars in 1217 bytes} [Mon Jun 20 12:00:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-830207600 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:00:23.065488 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ae0de201-4ebc-4d58-8085-379d3476ec6d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:23.078573 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ae0de201-4ebc-4d58-8085-379d3476ec6d tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/5156dcdb-2590-41b9-8b02-3f04c5c4acf7" status: 200 len: 1472 microversion: 2.1 time: 1.187157 Jun 20 12:00:23.081872 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 510/1008] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:21 2022] GET /compute/v2.1/servers/5156dcdb-2590-41b9-8b02-3f04c5c4acf7 => generated 1472 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:24.100120 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ab4a7e18-4a6d-4d51-8b89-2a18562b0f4b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:24.100829 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ab4a7e18-4a6d-4d51-8b89-2a18562b0f4b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 5156dcdb-2590-41b9-8b02-3f04c5c4acf7] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:24.121024 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ab4a7e18-4a6d-4d51-8b89-2a18562b0f4b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:24.121478 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ab4a7e18-4a6d-4d51-8b89-2a18562b0f4b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:24.122271 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ab4a7e18-4a6d-4d51-8b89-2a18562b0f4b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:24.122712 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ab4a7e18-4a6d-4d51-8b89-2a18562b0f4b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:24.473866 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ab4a7e18-4a6d-4d51-8b89-2a18562b0f4b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:24.486577 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ab4a7e18-4a6d-4d51-8b89-2a18562b0f4b tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/5156dcdb-2590-41b9-8b02-3f04c5c4acf7" status: 200 len: 1472 microversion: 2.1 time: 0.387361 Jun 20 12:00:24.487217 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 499/1009] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:24 2022] GET /compute/v2.1/servers/5156dcdb-2590-41b9-8b02-3f04c5c4acf7 => generated 1472 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:24.897489 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-f67bf858-c576-4823-bc25-366ae78c801d req-a1fb6822-0dca-4ab6-936c-3e7a5da809f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "097ee17d-f450-475a-8f33-fe596f6d98a0", "name": "network-vif-deleted", "tag": "b542790e-8718-43ca-9777-dbb16ec436a1"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:24.922918 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-f67bf858-c576-4823-bc25-366ae78c801d req-a1fb6822-0dca-4ab6-936c-3e7a5da809f5 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:24.928097 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-f67bf858-c576-4823-bc25-366ae78c801d req-a1fb6822-0dca-4ab6-936c-3e7a5da809f5 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:24.961502 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-f67bf858-c576-4823-bc25-366ae78c801d req-a1fb6822-0dca-4ab6-936c-3e7a5da809f5 service nova] Creating event network-vif-deleted:b542790e-8718-43ca-9777-dbb16ec436a1 for instance 097ee17d-f450-475a-8f33-fe596f6d98a0 on n-h2-master-1 Jun 20 12:00:24.972257 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-f67bf858-c576-4823-bc25-366ae78c801d req-a1fb6822-0dca-4ab6-936c-3e7a5da809f5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085941 Jun 20 12:00:24.974039 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 511/1010] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:00:25.514211 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2cc15a69-3806-4173-a982-15c56ea86c97 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:25.516064 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2cc15a69-3806-4173-a982-15c56ea86c97 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 5156dcdb-2590-41b9-8b02-3f04c5c4acf7] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:25.535890 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2cc15a69-3806-4173-a982-15c56ea86c97 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:25.536578 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2cc15a69-3806-4173-a982-15c56ea86c97 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:25.537511 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2cc15a69-3806-4173-a982-15c56ea86c97 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:25.538284 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2cc15a69-3806-4173-a982-15c56ea86c97 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:25.703744 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2cc15a69-3806-4173-a982-15c56ea86c97 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:25.726276 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:00:25.773834 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2cc15a69-3806-4173-a982-15c56ea86c97 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/5156dcdb-2590-41b9-8b02-3f04c5c4acf7" status: 200 len: 1430 microversion: 2.1 time: 0.271705 Jun 20 12:00:25.780016 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 500/1011] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:25 2022] GET /compute/v2.1/servers/5156dcdb-2590-41b9-8b02-3f04c5c4acf7 => generated 1430 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:26.328914 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-53e983ed-e35d-4b5d-8e8a-c66685c908b9 req-aaf20daa-a9e6-42cc-938b-d6519843a6eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5156dcdb-2590-41b9-8b02-3f04c5c4acf7", "name": "network-vif-deleted", "tag": "75217176-413a-4759-ac3b-e85684959c38"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:26.359361 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-53e983ed-e35d-4b5d-8e8a-c66685c908b9 req-aaf20daa-a9e6-42cc-938b-d6519843a6eb service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:26.370301 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-53e983ed-e35d-4b5d-8e8a-c66685c908b9 req-aaf20daa-a9e6-42cc-938b-d6519843a6eb service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:26.403394 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-53e983ed-e35d-4b5d-8e8a-c66685c908b9 req-aaf20daa-a9e6-42cc-938b-d6519843a6eb service nova] Creating event network-vif-deleted:75217176-413a-4759-ac3b-e85684959c38 for instance 5156dcdb-2590-41b9-8b02-3f04c5c4acf7 on n-h2-master-1 Jun 20 12:00:26.414508 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-53e983ed-e35d-4b5d-8e8a-c66685c908b9 req-aaf20daa-a9e6-42cc-938b-d6519843a6eb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091541 Jun 20 12:00:26.417243 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 512/1012] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:00:26.737654 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-395fc83e-bb54-4a86-a465-c57f28239650 tempest-ServersWithSpecificFlavorTestJSON-1780513578 tempest-ServersWithSpecificFlavorTestJSON-1780513578-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:26.738600 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:00:26.738600 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 12:00:26.766333 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-395fc83e-bb54-4a86-a465-c57f28239650 tempest-ServersWithSpecificFlavorTestJSON-1780513578 tempest-ServersWithSpecificFlavorTestJSON-1780513578-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1311349000" status: 202 len: 0 microversion: 2.1 time: 0.033070 Jun 20 12:00:26.782057 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 501/1013] 10.222.0.27 () {58 vars in 1160 bytes} [Mon Jun 20 12:00:26 2022] DELETE /compute/v2.1/flavors/1311349000 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:00:26.791165 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-713355a0-1278-4491-8fb9-ceb8620bb07d tempest-ServersWithSpecificFlavorTestJSON-1780513578 tempest-ServersWithSpecificFlavorTestJSON-1780513578-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:26.815727 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-51442f14-7e85-4411-bc0c-dca2cbcb2139 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:26.822084 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-51442f14-7e85-4411-bc0c-dca2cbcb2139 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 5156dcdb-2590-41b9-8b02-3f04c5c4acf7] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:26.848593 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51442f14-7e85-4411-bc0c-dca2cbcb2139 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:26.848988 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51442f14-7e85-4411-bc0c-dca2cbcb2139 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:26.855922 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51442f14-7e85-4411-bc0c-dca2cbcb2139 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:26.859375 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51442f14-7e85-4411-bc0c-dca2cbcb2139 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:26.864411 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-713355a0-1278-4491-8fb9-ceb8620bb07d tempest-ServersWithSpecificFlavorTestJSON-1780513578 tempest-ServersWithSpecificFlavorTestJSON-1780513578-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5402 microversion: 2.1 time: 0.078362 Jun 20 12:00:26.876118 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 513/1014] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 12:00:26 2022] GET /compute/v2.1/flavors/detail => generated 5402 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:26.894694 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8eaae3b8-2916-470b-a614-d7e06a1ae70a tempest-ServersWithSpecificFlavorTestJSON-1780513578 tempest-ServersWithSpecificFlavorTestJSON-1780513578-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:26.896621 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:00:26.896621 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 12:00:26.961717 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8eaae3b8-2916-470b-a614-d7e06a1ae70a tempest-ServersWithSpecificFlavorTestJSON-1780513578 tempest-ServersWithSpecificFlavorTestJSON-1780513578-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/982151523" status: 202 len: 0 microversion: 2.1 time: 0.071468 Jun 20 12:00:26.965434 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 514/1015] 10.222.0.27 () {58 vars in 1157 bytes} [Mon Jun 20 12:00:26 2022] DELETE /compute/v2.1/flavors/982151523 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 12:00:26.979608 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-73bfffa1-705c-46db-a9ab-b7c165f1344e tempest-ServersWithSpecificFlavorTestJSON-1780513578 tempest-ServersWithSpecificFlavorTestJSON-1780513578-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:26.997613 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51442f14-7e85-4411-bc0c-dca2cbcb2139 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:26.998077 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51442f14-7e85-4411-bc0c-dca2cbcb2139 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:26.998549 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-51442f14-7e85-4411-bc0c-dca2cbcb2139 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lazy-loading 'fault' on Instance uuid 5156dcdb-2590-41b9-8b02-3f04c5c4acf7 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:00:27.049437 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-73bfffa1-705c-46db-a9ab-b7c165f1344e tempest-ServersWithSpecificFlavorTestJSON-1780513578 tempest-ServersWithSpecificFlavorTestJSON-1780513578-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.073413 Jun 20 12:00:27.057643 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 515/1016] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 12:00:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:27.083801 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5e2c32ba-c957-4a4f-814c-b1713b95a3d0 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:27.084978 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5e2c32ba-c957-4a4f-814c-b1713b95a3d0 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: 042df052-0ba8-4734-803c-c168858021f3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:27.096750 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e2c32ba-c957-4a4f-814c-b1713b95a3d0 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:27.105157 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e2c32ba-c957-4a4f-814c-b1713b95a3d0 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:27.112146 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-51442f14-7e85-4411-bc0c-dca2cbcb2139 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:27.117157 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e2c32ba-c957-4a4f-814c-b1713b95a3d0 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:27.121773 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-51442f14-7e85-4411-bc0c-dca2cbcb2139 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/5156dcdb-2590-41b9-8b02-3f04c5c4acf7" status: 200 len: 1307 microversion: 2.1 time: 0.320636 Jun 20 12:00:27.125676 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 502/1017] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:26 2022] GET /compute/v2.1/servers/5156dcdb-2590-41b9-8b02-3f04c5c4acf7 => generated 1307 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:27.126582 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e2c32ba-c957-4a4f-814c-b1713b95a3d0 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:27.157704 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-5e2c32ba-c957-4a4f-814c-b1713b95a3d0 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] HTTP exception thrown: Instance 042df052-0ba8-4734-803c-c168858021f3 could not be found. Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5e2c32ba-c957-4a4f-814c-b1713b95a3d0 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Request method failure captured: Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3 HTTP/1.1 Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGCf4Uuy3QB1PoMR1xxglERsWi60EPPymMOqRUeuzMEbwxSDQvoYvaIA6dd0ew5jlS0MqbjKpHHSKTIHmmQq4aY6udUDrYXzn-KC9EB5fazwTNAgF2wDtizokaJt5ieReW9Tdjpn-odcREZpN1aKb9C81BKcFpy4crxdOqiIMDGfLN0 Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: d8790cc26204435aaf4071847ee00288 Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-795633055 Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d8790cc26204435aaf4071847ee00288"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d8790cc26204435aaf4071847ee00288"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d8790cc26204435aaf4071847ee00288"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d8790cc26204435aaf4071847ee00288"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-795633055 Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: d8790cc26204435aaf4071847ee00288 Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-795633055 Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersWithSpecificFlavorTestJSON-795633055-project Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: f5f49b57013f4675a70bac9b13e0a229 Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-795633055-project Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 042df052-0ba8-4734-803c-c168858021f3 could not be found. Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '042df052-0ba8-4734-803c-c168858021f3'} Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 042df052-0ba8-4734-803c-c168858021f3 could not be found. Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:00:27.160663 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:00:27.164905 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 042df052-0ba8-4734-803c-c168858021f3 could not be found. Jun 20 12:00:27.164905 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:27.164905 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:27.164905 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:27.164905 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:27.164905 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:27.164905 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:27.164905 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:00:27.164905 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:00:27.164905 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 042df052-0ba8-4734-803c-c168858021f3 could not be found. Jun 20 12:00:27.164905 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:27.167126 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5e2c32ba-c957-4a4f-814c-b1713b95a3d0 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Returning 404 to user: Instance 042df052-0ba8-4734-803c-c168858021f3 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:00:27.168297 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5e2c32ba-c957-4a4f-814c-b1713b95a3d0 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "DELETE /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3" status: 404 len: 111 microversion: 2.1 time: 0.088744 Jun 20 12:00:27.169415 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 516/1018] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:00:27 2022] DELETE /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:00:27.178110 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-93623767-8190-4e05-bbbc-dc6102697d21 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:27.178840 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-93623767-8190-4e05-bbbc-dc6102697d21 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: 042df052-0ba8-4734-803c-c168858021f3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:27.192434 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93623767-8190-4e05-bbbc-dc6102697d21 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:27.193188 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93623767-8190-4e05-bbbc-dc6102697d21 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:27.194333 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93623767-8190-4e05-bbbc-dc6102697d21 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:27.196189 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93623767-8190-4e05-bbbc-dc6102697d21 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:27.215383 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-93623767-8190-4e05-bbbc-dc6102697d21 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] HTTP exception thrown: Instance 042df052-0ba8-4734-803c-c168858021f3 could not be found. Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-93623767-8190-4e05-bbbc-dc6102697d21 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Request method failure captured: Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3 HTTP/1.1 Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGCf4Uuy3QB1PoMR1xxglERsWi60EPPymMOqRUeuzMEbwxSDQvoYvaIA6dd0ew5jlS0MqbjKpHHSKTIHmmQq4aY6udUDrYXzn-KC9EB5fazwTNAgF2wDtizokaJt5ieReW9Tdjpn-odcREZpN1aKb9C81BKcFpy4crxdOqiIMDGfLN0 Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: d8790cc26204435aaf4071847ee00288 Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-795633055 Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d8790cc26204435aaf4071847ee00288"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d8790cc26204435aaf4071847ee00288"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d8790cc26204435aaf4071847ee00288"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d8790cc26204435aaf4071847ee00288"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-795633055 Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: d8790cc26204435aaf4071847ee00288 Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-795633055 Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersWithSpecificFlavorTestJSON-795633055-project Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: f5f49b57013f4675a70bac9b13e0a229 Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-795633055-project Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 042df052-0ba8-4734-803c-c168858021f3 could not be found. Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '042df052-0ba8-4734-803c-c168858021f3'} Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 042df052-0ba8-4734-803c-c168858021f3 could not be found. Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 042df052-0ba8-4734-803c-c168858021f3 could not be found. Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:27.217698 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:27.221771 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:27.221771 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:27.221771 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:27.221771 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:27.221771 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:00:27.221771 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:00:27.221771 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 042df052-0ba8-4734-803c-c168858021f3 could not be found. Jun 20 12:00:27.221771 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:27.224104 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-93623767-8190-4e05-bbbc-dc6102697d21 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Returning 404 to user: Instance 042df052-0ba8-4734-803c-c168858021f3 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:00:27.225360 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-93623767-8190-4e05-bbbc-dc6102697d21 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "GET /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3" status: 404 len: 111 microversion: 2.1 time: 0.052157 Jun 20 12:00:27.226618 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 503/1019] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:27 2022] GET /compute/v2.1/servers/042df052-0ba8-4734-803c-c168858021f3 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:00:27.235451 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-58671e54-8ab2-41bf-bf64-f7531da608a9 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:27.237180 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-58671e54-8ab2-41bf-bf64-f7531da608a9 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: adee1d54-6e18-4a4e-96ac-48a6fc56345d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:27.244864 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-58671e54-8ab2-41bf-bf64-f7531da608a9 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:27.245655 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-58671e54-8ab2-41bf-bf64-f7531da608a9 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:27.246842 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-58671e54-8ab2-41bf-bf64-f7531da608a9 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:27.247850 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-58671e54-8ab2-41bf-bf64-f7531da608a9 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:27.287363 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-58671e54-8ab2-41bf-bf64-f7531da608a9 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] HTTP exception thrown: Instance adee1d54-6e18-4a4e-96ac-48a6fc56345d could not be found. Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-58671e54-8ab2-41bf-bf64-f7531da608a9 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Request method failure captured: Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d HTTP/1.1 Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGCf4Uuy3QB1PoMR1xxglERsWi60EPPymMOqRUeuzMEbwxSDQvoYvaIA6dd0ew5jlS0MqbjKpHHSKTIHmmQq4aY6udUDrYXzn-KC9EB5fazwTNAgF2wDtizokaJt5ieReW9Tdjpn-odcREZpN1aKb9C81BKcFpy4crxdOqiIMDGfLN0 Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: d8790cc26204435aaf4071847ee00288 Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-795633055 Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d8790cc26204435aaf4071847ee00288"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d8790cc26204435aaf4071847ee00288"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d8790cc26204435aaf4071847ee00288"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d8790cc26204435aaf4071847ee00288"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-795633055 Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: d8790cc26204435aaf4071847ee00288 Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-795633055 Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersWithSpecificFlavorTestJSON-795633055-project Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: f5f49b57013f4675a70bac9b13e0a229 Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-795633055-project Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: exception: Instance adee1d54-6e18-4a4e-96ac-48a6fc56345d could not be found. Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'adee1d54-6e18-4a4e-96ac-48a6fc56345d'} Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adee1d54-6e18-4a4e-96ac-48a6fc56345d could not be found. Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:00:27.291903 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:00:27.296051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adee1d54-6e18-4a4e-96ac-48a6fc56345d could not be found. Jun 20 12:00:27.296051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:27.296051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:27.296051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:27.296051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:27.296051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:27.296051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:27.296051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:00:27.296051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:00:27.296051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adee1d54-6e18-4a4e-96ac-48a6fc56345d could not be found. Jun 20 12:00:27.296051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:27.301906 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-58671e54-8ab2-41bf-bf64-f7531da608a9 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Returning 404 to user: Instance adee1d54-6e18-4a4e-96ac-48a6fc56345d could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:00:27.308629 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-58671e54-8ab2-41bf-bf64-f7531da608a9 tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "DELETE /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d" status: 404 len: 111 microversion: 2.1 time: 0.074650 Jun 20 12:00:27.313609 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 517/1020] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:00:27 2022] DELETE /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:00:27.324617 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ff25f7a6-0922-4155-be5e-032815995d4b tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:27.325677 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ff25f7a6-0922-4155-be5e-032815995d4b tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] [instance: adee1d54-6e18-4a4e-96ac-48a6fc56345d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:27.337849 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff25f7a6-0922-4155-be5e-032815995d4b tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:27.339082 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff25f7a6-0922-4155-be5e-032815995d4b tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:27.344378 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff25f7a6-0922-4155-be5e-032815995d4b tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:27.345969 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff25f7a6-0922-4155-be5e-032815995d4b tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:27.383690 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-ff25f7a6-0922-4155-be5e-032815995d4b tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] HTTP exception thrown: Instance adee1d54-6e18-4a4e-96ac-48a6fc56345d could not be found. Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ff25f7a6-0922-4155-be5e-032815995d4b tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Request method failure captured: Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d HTTP/1.1 Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGCf4Uuy3QB1PoMR1xxglERsWi60EPPymMOqRUeuzMEbwxSDQvoYvaIA6dd0ew5jlS0MqbjKpHHSKTIHmmQq4aY6udUDrYXzn-KC9EB5fazwTNAgF2wDtizokaJt5ieReW9Tdjpn-odcREZpN1aKb9C81BKcFpy4crxdOqiIMDGfLN0 Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: d8790cc26204435aaf4071847ee00288 Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-795633055 Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d8790cc26204435aaf4071847ee00288"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d8790cc26204435aaf4071847ee00288"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d8790cc26204435aaf4071847ee00288"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d8790cc26204435aaf4071847ee00288"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-795633055 Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: d8790cc26204435aaf4071847ee00288 Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-795633055 Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersWithSpecificFlavorTestJSON-795633055-project Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: f5f49b57013f4675a70bac9b13e0a229 Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-795633055-project Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: exception: Instance adee1d54-6e18-4a4e-96ac-48a6fc56345d could not be found. Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'adee1d54-6e18-4a4e-96ac-48a6fc56345d'} Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adee1d54-6e18-4a4e-96ac-48a6fc56345d could not be found. Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adee1d54-6e18-4a4e-96ac-48a6fc56345d could not be found. Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:27.394114 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:27.398265 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:27.398265 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:27.398265 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:27.398265 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:27.398265 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:00:27.398265 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:00:27.398265 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adee1d54-6e18-4a4e-96ac-48a6fc56345d could not be found. Jun 20 12:00:27.398265 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:27.401560 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ff25f7a6-0922-4155-be5e-032815995d4b tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] Returning 404 to user: Instance adee1d54-6e18-4a4e-96ac-48a6fc56345d could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:00:27.403639 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ff25f7a6-0922-4155-be5e-032815995d4b tempest-ServersWithSpecificFlavorTestJSON-795633055 tempest-ServersWithSpecificFlavorTestJSON-795633055-project] 10.222.0.27 "GET /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d" status: 404 len: 111 microversion: 2.1 time: 0.084040 Jun 20 12:00:27.406941 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 504/1021] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:27 2022] GET /compute/v2.1/servers/adee1d54-6e18-4a4e-96ac-48a6fc56345d => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:00:28.142255 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dbc1d1f0-27e9-4f52-a79c-c49f74f028c3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:28.143076 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-dbc1d1f0-27e9-4f52-a79c-c49f74f028c3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 5156dcdb-2590-41b9-8b02-3f04c5c4acf7] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:28.158170 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dbc1d1f0-27e9-4f52-a79c-c49f74f028c3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:28.164280 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dbc1d1f0-27e9-4f52-a79c-c49f74f028c3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:28.166866 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dbc1d1f0-27e9-4f52-a79c-c49f74f028c3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:28.171158 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dbc1d1f0-27e9-4f52-a79c-c49f74f028c3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:28.218986 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-dbc1d1f0-27e9-4f52-a79c-c49f74f028c3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] HTTP exception thrown: Instance 5156dcdb-2590-41b9-8b02-3f04c5c4acf7 could not be found. Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dbc1d1f0-27e9-4f52-a79c-c49f74f028c3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Request method failure captured: Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/5156dcdb-2590-41b9-8b02-3f04c5c4acf7 HTTP/1.1 Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGB04YgN2qwmpAbSVYBj1yKvqSaDSqYj7KhnXAwxLFlA52NG70o92gYPB0cXzYJvuf_7FOWrI99cZVPKh4xXLrAHLOP_L0Q9mNXdSZyTZrSw1bqTuU7pza7A3jlbg1NmxOK9BJccrrZRONfFPEpVpJShKEnusLTFdnHs8tSnnukr1cc Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: a6150795e7424cca91c71531840d88be Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersOnMultiNodesTest-1662406801 Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6150795e7424cca91c71531840d88be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6150795e7424cca91c71531840d88be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a6150795e7424cca91c71531840d88be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a6150795e7424cca91c71531840d88be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersOnMultiNodesTest-1662406801 Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: a6150795e7424cca91c71531840d88be Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1662406801 Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersOnMultiNodesTest-1662406801-project Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 1297c1b206f845bcaf936313fd7eed9b Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersOnMultiNodesTest-1662406801-project Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 5156dcdb-2590-41b9-8b02-3f04c5c4acf7 could not be found. Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '5156dcdb-2590-41b9-8b02-3f04c5c4acf7'} Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5156dcdb-2590-41b9-8b02-3f04c5c4acf7 could not be found. Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5156dcdb-2590-41b9-8b02-3f04c5c4acf7 could not be found. Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:28.225733 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:28.231441 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:28.231441 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:28.231441 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:28.231441 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:00:28.231441 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:00:28.231441 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5156dcdb-2590-41b9-8b02-3f04c5c4acf7 could not be found. Jun 20 12:00:28.231441 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:28.236334 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dbc1d1f0-27e9-4f52-a79c-c49f74f028c3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Returning 404 to user: Instance 5156dcdb-2590-41b9-8b02-3f04c5c4acf7 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:00:28.246086 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dbc1d1f0-27e9-4f52-a79c-c49f74f028c3 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/5156dcdb-2590-41b9-8b02-3f04c5c4acf7" status: 404 len: 111 microversion: 2.1 time: 0.107508 Jun 20 12:00:28.251554 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 518/1022] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:28 2022] GET /compute/v2.1/servers/5156dcdb-2590-41b9-8b02-3f04c5c4acf7 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:00:28.259268 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-efb92089-dc09-4dd5-8802-e3c6debaa1b9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:28.260136 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-efb92089-dc09-4dd5-8802-e3c6debaa1b9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: 097ee17d-f450-475a-8f33-fe596f6d98a0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:28.294769 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-efb92089-dc09-4dd5-8802-e3c6debaa1b9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:28.301359 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-efb92089-dc09-4dd5-8802-e3c6debaa1b9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:28.303528 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-efb92089-dc09-4dd5-8802-e3c6debaa1b9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:28.306822 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-efb92089-dc09-4dd5-8802-e3c6debaa1b9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:28.372133 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-efb92089-dc09-4dd5-8802-e3c6debaa1b9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] HTTP exception thrown: Instance 097ee17d-f450-475a-8f33-fe596f6d98a0 could not be found. Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-efb92089-dc09-4dd5-8802-e3c6debaa1b9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Request method failure captured: Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0 HTTP/1.1 Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGB04YgN2qwmpAbSVYBj1yKvqSaDSqYj7KhnXAwxLFlA52NG70o92gYPB0cXzYJvuf_7FOWrI99cZVPKh4xXLrAHLOP_L0Q9mNXdSZyTZrSw1bqTuU7pza7A3jlbg1NmxOK9BJccrrZRONfFPEpVpJShKEnusLTFdnHs8tSnnukr1cc Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: a6150795e7424cca91c71531840d88be Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersOnMultiNodesTest-1662406801 Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6150795e7424cca91c71531840d88be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6150795e7424cca91c71531840d88be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a6150795e7424cca91c71531840d88be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a6150795e7424cca91c71531840d88be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersOnMultiNodesTest-1662406801 Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: a6150795e7424cca91c71531840d88be Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1662406801 Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersOnMultiNodesTest-1662406801-project Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 1297c1b206f845bcaf936313fd7eed9b Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersOnMultiNodesTest-1662406801-project Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 097ee17d-f450-475a-8f33-fe596f6d98a0 could not be found. Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '097ee17d-f450-475a-8f33-fe596f6d98a0'} Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 097ee17d-f450-475a-8f33-fe596f6d98a0 could not be found. Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 097ee17d-f450-475a-8f33-fe596f6d98a0 could not be found. Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:28.374852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:28.379156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:28.379156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:28.379156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:28.379156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:00:28.379156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:00:28.379156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 097ee17d-f450-475a-8f33-fe596f6d98a0 could not be found. Jun 20 12:00:28.379156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:28.379156 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-efb92089-dc09-4dd5-8802-e3c6debaa1b9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Returning 404 to user: Instance 097ee17d-f450-475a-8f33-fe596f6d98a0 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:00:28.379156 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-efb92089-dc09-4dd5-8802-e3c6debaa1b9 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0" status: 404 len: 111 microversion: 2.1 time: 0.123743 Jun 20 12:00:28.384822 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 505/1023] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:28 2022] GET /compute/v2.1/servers/097ee17d-f450-475a-8f33-fe596f6d98a0 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:00:28.390623 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-574682d4-a9fd-45c8-bd2a-c63ca7d36c7f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:28.484585 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-a738fdd8-584f-4fdb-bf8a-ece4c0c4b1d8 req-2bb43682-278b-4898-b60d-72a64b3a5ff9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c763272-042e-418c-b2f6-cc2e96f0c54d", "tag": "b71a2013-f702-4588-976a-47402b05752a"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:28.491850 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-574682d4-a9fd-45c8-bd2a-c63ca7d36c7f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/77cab7ed-5f36-44be-8700-82f38c90fe27" status: 204 len: 0 microversion: 2.1 time: 0.107994 Jun 20 12:00:28.497701 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 519/1024] 10.222.0.27 () {58 vars in 1265 bytes} [Mon Jun 20 12:00:28 2022] DELETE /compute/v2.1/os-server-groups/77cab7ed-5f36-44be-8700-82f38c90fe27 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 12:00:28.509722 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6ad210bd-f0d0-4958-9f16-68649ad6f58f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:28.512698 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6ad210bd-f0d0-4958-9f16-68649ad6f58f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: c5afa776-6f61-4b7a-b586-c5047b5fbe5e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:28.515726 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-a738fdd8-584f-4fdb-bf8a-ece4c0c4b1d8 req-2bb43682-278b-4898-b60d-72a64b3a5ff9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:28.527218 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-a738fdd8-584f-4fdb-bf8a-ece4c0c4b1d8 req-2bb43682-278b-4898-b60d-72a64b3a5ff9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:28.529413 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ad210bd-f0d0-4958-9f16-68649ad6f58f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:28.531685 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ad210bd-f0d0-4958-9f16-68649ad6f58f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:28.535494 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ad210bd-f0d0-4958-9f16-68649ad6f58f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:28.537439 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ad210bd-f0d0-4958-9f16-68649ad6f58f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:28.573645 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-a738fdd8-584f-4fdb-bf8a-ece4c0c4b1d8 req-2bb43682-278b-4898-b60d-72a64b3a5ff9 service nova] Creating event network-changed:b71a2013-f702-4588-976a-47402b05752a for instance 1c763272-042e-418c-b2f6-cc2e96f0c54d on n-h2-master-1 Jun 20 12:00:28.581193 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-a738fdd8-584f-4fdb-bf8a-ece4c0c4b1d8 req-2bb43682-278b-4898-b60d-72a64b3a5ff9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105627 Jun 20 12:00:28.586221 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 506/1025] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:00:28.633411 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6ad210bd-f0d0-4958-9f16-68649ad6f58f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: c5afa776-6f61-4b7a-b586-c5047b5fbe5e] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:00:28.646170 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:00:28.848922 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6ad210bd-f0d0-4958-9f16-68649ad6f58f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c5afa776-6f61-4b7a-b586-c5047b5fbe5e" status: 204 len: 0 microversion: 2.1 time: 0.339640 Jun 20 12:00:28.852687 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 520/1026] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:00:28 2022] DELETE /compute/v2.1/servers/c5afa776-6f61-4b7a-b586-c5047b5fbe5e => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:00:28.862499 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3bc27c4c-b036-4e2c-aa06-82323d82c203 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:28.863224 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3bc27c4c-b036-4e2c-aa06-82323d82c203 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: c5afa776-6f61-4b7a-b586-c5047b5fbe5e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:28.873631 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3bc27c4c-b036-4e2c-aa06-82323d82c203 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:28.874087 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3bc27c4c-b036-4e2c-aa06-82323d82c203 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:28.879900 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3bc27c4c-b036-4e2c-aa06-82323d82c203 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:28.886949 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3bc27c4c-b036-4e2c-aa06-82323d82c203 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:29.961577 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3bc27c4c-b036-4e2c-aa06-82323d82c203 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:29.977835 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3bc27c4c-b036-4e2c-aa06-82323d82c203 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/c5afa776-6f61-4b7a-b586-c5047b5fbe5e" status: 200 len: 1473 microversion: 2.1 time: 1.120702 Jun 20 12:00:29.984878 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 507/1027] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:28 2022] GET /compute/v2.1/servers/c5afa776-6f61-4b7a-b586-c5047b5fbe5e => generated 1473 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:30.704826 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-499e452f-e127-4e49-9045-fbe3dc6167d5 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] Action: 'create', calling method: .version_select at 0x7f6073968c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-325478017", "description": "tempest-description-1366953563"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:30.974945 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e9b293c3-5599-41cf-997c-d7ccfff9aff3 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-664240326", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "5bb6175f-cf24-43c6-9d27-54937f852000"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:31.117420 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-e9b293c3-5599-41cf-997c-d7ccfff9aff3 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] validate_networks() for [('5bb6175f-cf24-43c6-9d27-54937f852000', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:00:31.224367 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-499e452f-e127-4e49-9045-fbe3dc6167d5 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.827626 Jun 20 12:00:31.225597 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 521/1028] 10.222.0.27 () {60 vars in 1179 bytes} [Mon Jun 20 12:00:30 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:00:31.232538 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1cc9a7c8-82db-40cf-b6ff-7fa765cace2f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:31.234048 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1cc9a7c8-82db-40cf-b6ff-7fa765cace2f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: c5afa776-6f61-4b7a-b586-c5047b5fbe5e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:31.249797 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1cc9a7c8-82db-40cf-b6ff-7fa765cace2f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:31.250759 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1cc9a7c8-82db-40cf-b6ff-7fa765cace2f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:31.252465 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1cc9a7c8-82db-40cf-b6ff-7fa765cace2f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:31.253098 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1cc9a7c8-82db-40cf-b6ff-7fa765cace2f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:31.614045 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1cc9a7c8-82db-40cf-b6ff-7fa765cace2f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1297c1b206f845bcaf936313fd7eed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6150795e7424cca91c71531840d88be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:31.625754 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1cc9a7c8-82db-40cf-b6ff-7fa765cace2f tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/c5afa776-6f61-4b7a-b586-c5047b5fbe5e" status: 200 len: 1473 microversion: 2.1 time: 0.398540 Jun 20 12:00:31.626525 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 522/1029] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:31 2022] GET /compute/v2.1/servers/c5afa776-6f61-4b7a-b586-c5047b5fbe5e => generated 1473 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:31.642929 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c9093896-03c9-4b32-b0cd-b8a0c1c5d483 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] Action: 'create', calling method: .version_select at 0x7f6073797040>, body: {"security_group_rule": {"parent_group_id": "46b90c27-6816-4215-a767-4e72e7912db7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:32.205991 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c9093896-03c9-4b32-b0cd-b8a0c1c5d483 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.571533 Jun 20 12:00:32.207667 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 523/1030] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Jun 20 12:00:31 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:00:32.214942 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-e2e895e2-98af-40a8-af89-fd8118a24d54 req-f4ff7018-92f9-41db-b177-b727fbc6459b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5afa776-6f61-4b7a-b586-c5047b5fbe5e", "name": "network-vif-deleted", "tag": "76925e12-773d-4c10-a31b-fe42c389e3f4"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:32.242313 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e2e895e2-98af-40a8-af89-fd8118a24d54 req-f4ff7018-92f9-41db-b177-b727fbc6459b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:32.242766 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e2e895e2-98af-40a8-af89-fd8118a24d54 req-f4ff7018-92f9-41db-b177-b727fbc6459b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:32.278715 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-e2e895e2-98af-40a8-af89-fd8118a24d54 req-f4ff7018-92f9-41db-b177-b727fbc6459b service nova] Creating event network-vif-deleted:76925e12-773d-4c10-a31b-fe42c389e3f4 for instance c5afa776-6f61-4b7a-b586-c5047b5fbe5e on n-h1-master-1 Jun 20 12:00:32.290197 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-e2e895e2-98af-40a8-af89-fd8118a24d54 req-f4ff7018-92f9-41db-b177-b727fbc6459b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080785 Jun 20 12:00:32.291972 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 524/1031] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:00:32.305498 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e08a395a-68a6-4c9e-a53d-9411bfae2c06 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] Action: 'create', calling method: .version_select at 0x7f60737978b0>, body: {"security_group_rule": {"parent_group_id": "46b90c27-6816-4215-a767-4e72e7912db7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:32.392941 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-e08a395a-68a6-4c9e-a53d-9411bfae2c06 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] HTTP exception thrown: This rule already exists in group 46b90c27-6816-4215-a767-4e72e7912db7 Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e08a395a-68a6-4c9e-a53d-9411bfae2c06 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] Request method failure captured: Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 138 Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGFexRYjver4QYOSpv36nzk_6NZcy38yxc_cad84AeN7VeWFvmbQMKoaqurYLph1afI_h__vsMKWP1PhXfpHfuFan58SyPKAfdyk5l-bJys7xAbxNmzUpP8WLR4X8uXXtj-vfhXWFvE1gYiJcpcpR85mrOv2q4_BbmpVVHLCGngkHZ4 Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 0485135750e34669aba376a238aa5f79 Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1592832125 Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0485135750e34669aba376a238aa5f79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0485135750e34669aba376a238aa5f79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0485135750e34669aba376a238aa5f79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0485135750e34669aba376a238aa5f79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1592832125 Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 0485135750e34669aba376a238aa5f79 Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1592832125 Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 270646b6bb1e44cbb6fbf9263571b465 Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: {"security_group_rule": {"parent_group_id": "46b90c27-6816-4215-a767-4e72e7912db7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: exception: This rule already exists in group 46b90c27-6816-4215-a767-4e72e7912db7 Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: action_args: {'body': {'security_group_rule': {'parent_group_id': '46b90c27-6816-4215-a767-4e72e7912db7', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 46b90c27-6816-4215-a767-4e72e7912db7 Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 46b90c27-6816-4215-a767-4e72e7912db7 Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:32.404792 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:32.410846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:00:32.410846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:00:32.410846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 46b90c27-6816-4215-a767-4e72e7912db7 Jun 20 12:00:32.410846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:32.410846 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e08a395a-68a6-4c9e-a53d-9411bfae2c06 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] Returning 400 to user: This rule already exists in group 46b90c27-6816-4215-a767-4e72e7912db7 {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:00:32.410846 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e08a395a-68a6-4c9e-a53d-9411bfae2c06 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.112836 Jun 20 12:00:32.410846 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 525/1032] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Jun 20 12:00:32 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 117 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:00:32.418707 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-489b05bb-596a-4626-9a19-3494a3677e1d tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] Calling method '.version_select at 0x7f60739e8f70>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:32.762679 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-489b05bb-596a-4626-9a19-3494a3677e1d tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-group-rules/660589b8-a0ae-4a06-a2f9-b79d013c75cd" status: 202 len: 0 microversion: 2.1 time: 0.350004 Jun 20 12:00:32.763609 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 526/1033] 10.222.0.27 () {58 vars in 1286 bytes} [Mon Jun 20 12:00:32 2022] DELETE /compute/v2.1/os-security-group-rules/660589b8-a0ae-4a06-a2f9-b79d013c75cd => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:00:32.769628 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-375d2181-0d44-4ae4-9133-a597761b2a49 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:32.770873 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-375d2181-0d44-4ae4-9133-a597761b2a49 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] [instance: c5afa776-6f61-4b7a-b586-c5047b5fbe5e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:32.797966 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-375d2181-0d44-4ae4-9133-a597761b2a49 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:32.798218 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-375d2181-0d44-4ae4-9133-a597761b2a49 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:32.799232 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-375d2181-0d44-4ae4-9133-a597761b2a49 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:32.806036 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-375d2181-0d44-4ae4-9133-a597761b2a49 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:32.872453 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-375d2181-0d44-4ae4-9133-a597761b2a49 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] HTTP exception thrown: Instance c5afa776-6f61-4b7a-b586-c5047b5fbe5e could not be found. Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-375d2181-0d44-4ae4-9133-a597761b2a49 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Request method failure captured: Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/c5afa776-6f61-4b7a-b586-c5047b5fbe5e HTTP/1.1 Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGB04YgN2qwmpAbSVYBj1yKvqSaDSqYj7KhnXAwxLFlA52NG70o92gYPB0cXzYJvuf_7FOWrI99cZVPKh4xXLrAHLOP_L0Q9mNXdSZyTZrSw1bqTuU7pza7A3jlbg1NmxOK9BJccrrZRONfFPEpVpJShKEnusLTFdnHs8tSnnukr1cc Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: a6150795e7424cca91c71531840d88be Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersOnMultiNodesTest-1662406801 Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6150795e7424cca91c71531840d88be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a6150795e7424cca91c71531840d88be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a6150795e7424cca91c71531840d88be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a6150795e7424cca91c71531840d88be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersOnMultiNodesTest-1662406801 Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: a6150795e7424cca91c71531840d88be Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1662406801 Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersOnMultiNodesTest-1662406801-project Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 1297c1b206f845bcaf936313fd7eed9b Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersOnMultiNodesTest-1662406801-project Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: exception: Instance c5afa776-6f61-4b7a-b586-c5047b5fbe5e could not be found. Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'c5afa776-6f61-4b7a-b586-c5047b5fbe5e'} Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5afa776-6f61-4b7a-b586-c5047b5fbe5e could not be found. Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5afa776-6f61-4b7a-b586-c5047b5fbe5e could not be found. Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:32.874568 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:32.879649 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:32.879649 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:32.879649 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:32.879649 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:00:32.879649 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:00:32.879649 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5afa776-6f61-4b7a-b586-c5047b5fbe5e could not be found. Jun 20 12:00:32.879649 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:32.879649 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-375d2181-0d44-4ae4-9133-a597761b2a49 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] Returning 404 to user: Instance c5afa776-6f61-4b7a-b586-c5047b5fbe5e could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:00:32.882654 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-375d2181-0d44-4ae4-9133-a597761b2a49 tempest-ServersOnMultiNodesTest-1662406801 tempest-ServersOnMultiNodesTest-1662406801-project] 10.222.0.27 "GET /compute/v2.1/servers/c5afa776-6f61-4b7a-b586-c5047b5fbe5e" status: 404 len: 111 microversion: 2.1 time: 0.115488 Jun 20 12:00:32.883201 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 527/1034] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:32 2022] GET /compute/v2.1/servers/c5afa776-6f61-4b7a-b586-c5047b5fbe5e => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:00:32.906178 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-59d91890-0d4b-494e-9084-e8535d3a2239 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] Action: 'create', calling method: .version_select at 0x7f60737c6f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-888740620", "description": "tempest-description-261614848"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:33.205429 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-e9b293c3-5599-41cf-997c-d7ccfff9aff3 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:00:33.207032 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-e9b293c3-5599-41cf-997c-d7ccfff9aff3 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:00:33.207765 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-e9b293c3-5599-41cf-997c-d7ccfff9aff3 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:00:33.208523 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-e9b293c3-5599-41cf-997c-d7ccfff9aff3 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:00:33.209630 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-e9b293c3-5599-41cf-997c-d7ccfff9aff3 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:00:33.239233 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e9b293c3-5599-41cf-997c-d7ccfff9aff3 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:33.240314 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e9b293c3-5599-41cf-997c-d7ccfff9aff3 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:33.241652 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e9b293c3-5599-41cf-997c-d7ccfff9aff3 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:33.242355 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e9b293c3-5599-41cf-997c-d7ccfff9aff3 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:33.305452 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-e9b293c3-5599-41cf-997c-d7ccfff9aff3 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Getting quotas for project 2b350a5088d64f94bc850fc1b423cf2d. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:00:33.329780 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-e9b293c3-5599-41cf-997c-d7ccfff9aff3 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Getting quotas for user f9a5483adf06454cabe761d1c17e2732 and project 2b350a5088d64f94bc850fc1b423cf2d. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:00:33.367796 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e9b293c3-5599-41cf-997c-d7ccfff9aff3 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:00:33.382058 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e9b293c3-5599-41cf-997c-d7ccfff9aff3 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] [instance: a06342ec-4969-4552-a343-aefc73138aa1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:00:33.426481 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-59d91890-0d4b-494e-9084-e8535d3a2239 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.530671 Jun 20 12:00:33.427193 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 528/1035] 10.222.0.27 () {60 vars in 1179 bytes} [Mon Jun 20 12:00:32 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:00:33.445787 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cb5aaff1-f9b3-4e28-8e18-0110d42899d0 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] Action: 'create', calling method: .version_select at 0x7f6073797940>, body: {"security_group_rule": {"parent_group_id": "85c1e576-2930-4420-ab03-773c3f015bd6", "ip_protocol": "tcp", "from_port": 1591009860, "to_port": 22}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:33.514982 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e9b293c3-5599-41cf-997c-d7ccfff9aff3 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.684245 Jun 20 12:00:33.518034 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 508/1036] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:00:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:00:33.531388 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-15dd01a2-e50b-4b17-a19a-7e8c2461b708 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:33.557425 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-15dd01a2-e50b-4b17-a19a-7e8c2461b708 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] [instance: a06342ec-4969-4552-a343-aefc73138aa1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:33.607743 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-cb5aaff1-f9b3-4e28-8e18-0110d42899d0 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] HTTP exception thrown: Invalid port range 1591009860:22. Former value cannot be greater than the later Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cb5aaff1-f9b3-4e28-8e18-0110d42899d0 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] Request method failure captured: Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 146 Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGFexRYjver4QYOSpv36nzk_6NZcy38yxc_cad84AeN7VeWFvmbQMKoaqurYLph1afI_h__vsMKWP1PhXfpHfuFan58SyPKAfdyk5l-bJys7xAbxNmzUpP8WLR4X8uXXtj-vfhXWFvE1gYiJcpcpR85mrOv2q4_BbmpVVHLCGngkHZ4 Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 0485135750e34669aba376a238aa5f79 Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1592832125 Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0485135750e34669aba376a238aa5f79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0485135750e34669aba376a238aa5f79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0485135750e34669aba376a238aa5f79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0485135750e34669aba376a238aa5f79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1592832125 Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 0485135750e34669aba376a238aa5f79 Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1592832125 Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 270646b6bb1e44cbb6fbf9263571b465 Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: {"security_group_rule": {"parent_group_id": "85c1e576-2930-4420-ab03-773c3f015bd6", "ip_protocol": "tcp", "from_port": 1591009860, "to_port": 22}} Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: exception: Invalid port range 1591009860:22. Former value cannot be greater than the later Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: action_args: {'body': {'security_group_rule': {'parent_group_id': '85c1e576-2930-4420-ab03-773c3f015bd6', 'ip_protocol': 'tcp', 'from_port': 1591009860, 'to_port': 22}}} Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1591009860:22. Former value cannot be greater than the later Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1591009860:22. Former value cannot be greater than the later Jun 20 12:00:33.609631 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:33.614727 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:33.614727 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:33.614727 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:33.614727 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:33.614727 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:33.614727 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:00:33.614727 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:00:33.614727 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1591009860:22. Former value cannot be greater than the later Jun 20 12:00:33.614727 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:33.616753 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cb5aaff1-f9b3-4e28-8e18-0110d42899d0 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] Returning 400 to user: Invalid port range 1591009860:22. Former value cannot be greater than the later {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:00:33.618250 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cb5aaff1-f9b3-4e28-8e18-0110d42899d0 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.179264 Jun 20 12:00:33.619531 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 529/1037] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Jun 20 12:00:33 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 181 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 20 12:00:33.631980 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bb8b729d-db84-4377-bd2e-cf72ed43b51c tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] Action: 'create', calling method: .version_select at 0x7f607378a5e0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-261318321", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:33.635151 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-bb8b729d-db84-4377-bd2e-cf72ed43b51c tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] HTTP exception thrown: Security group id should be uuid Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bb8b729d-db84-4377-bd2e-cf72ed43b51c tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] Request method failure captured: Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 130 Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGFexRYjver4QYOSpv36nzk_6NZcy38yxc_cad84AeN7VeWFvmbQMKoaqurYLph1afI_h__vsMKWP1PhXfpHfuFan58SyPKAfdyk5l-bJys7xAbxNmzUpP8WLR4X8uXXtj-vfhXWFvE1gYiJcpcpR85mrOv2q4_BbmpVVHLCGngkHZ4 Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 0485135750e34669aba376a238aa5f79 Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1592832125 Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0485135750e34669aba376a238aa5f79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0485135750e34669aba376a238aa5f79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0485135750e34669aba376a238aa5f79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0485135750e34669aba376a238aa5f79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1592832125 Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 0485135750e34669aba376a238aa5f79 Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1592832125 Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 270646b6bb1e44cbb6fbf9263571b465 Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-261318321", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: exception: Security group id should be uuid Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-261318321', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:00:33.636948 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:00:33.642976 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Jun 20 12:00:33.642976 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:33.644131 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bb8b729d-db84-4377-bd2e-cf72ed43b51c tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] Returning 400 to user: Security group id should be uuid {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:00:33.646951 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bb8b729d-db84-4377-bd2e-cf72ed43b51c tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.020521 Jun 20 12:00:33.650896 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 530/1038] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Jun 20 12:00:33 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 20 12:00:33.663863 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1bc3b5e3-8e48-4b90-bef6-6b8a19fde636 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] Action: 'create', calling method: .version_select at 0x7f6073e93940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1382649686", "description": "tempest-description-351179847"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:33.748789 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-15dd01a2-e50b-4b17-a19a-7e8c2461b708 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a5483adf06454cabe761d1c17e2732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b350a5088d64f94bc850fc1b423cf2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:33.757074 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-15dd01a2-e50b-4b17-a19a-7e8c2461b708 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] 10.222.0.27 "GET /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1" status: 200 len: 1231 microversion: 2.1 time: 0.231378 Jun 20 12:00:33.761971 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 509/1039] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:33 2022] GET /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1 => generated 1231 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:34.329790 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1bc3b5e3-8e48-4b90-bef6-6b8a19fde636 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.674056 Jun 20 12:00:34.330685 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 531/1040] 10.222.0.27 () {60 vars in 1179 bytes} [Mon Jun 20 12:00:33 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:00:34.349091 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f23168a4-6093-42bb-8739-d76fcc008116 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] Action: 'create', calling method: .version_select at 0x7f607376f4c0>, body: {"security_group_rule": {"parent_group_id": "2b8eb6da-ab27-47b3-b569-a9a7c6ba34e4", "ip_protocol": "tempest-999-2131871692", "from_port": 22, "to_port": 22}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:34.590438 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-f23168a4-6093-42bb-8739-d76fcc008116 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] HTTP exception thrown: Invalid IP protocol tempest-999-2131871692. Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f23168a4-6093-42bb-8739-d76fcc008116 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] Request method failure captured: Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 157 Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGFexRYjver4QYOSpv36nzk_6NZcy38yxc_cad84AeN7VeWFvmbQMKoaqurYLph1afI_h__vsMKWP1PhXfpHfuFan58SyPKAfdyk5l-bJys7xAbxNmzUpP8WLR4X8uXXtj-vfhXWFvE1gYiJcpcpR85mrOv2q4_BbmpVVHLCGngkHZ4 Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 0485135750e34669aba376a238aa5f79 Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1592832125 Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0485135750e34669aba376a238aa5f79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0485135750e34669aba376a238aa5f79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0485135750e34669aba376a238aa5f79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0485135750e34669aba376a238aa5f79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1592832125 Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 0485135750e34669aba376a238aa5f79 Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1592832125 Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 270646b6bb1e44cbb6fbf9263571b465 Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: {"security_group_rule": {"parent_group_id": "2b8eb6da-ab27-47b3-b569-a9a7c6ba34e4", "ip_protocol": "tempest-999-2131871692", "from_port": 22, "to_port": 22}} Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: exception: Invalid IP protocol tempest-999-2131871692. Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: action_args: {'body': {'security_group_rule': {'parent_group_id': '2b8eb6da-ab27-47b3-b569-a9a7c6ba34e4', 'ip_protocol': 'tempest-999-2131871692', 'from_port': 22, 'to_port': 22}}} Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-2131871692. Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-2131871692. Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:34.593037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:34.597703 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:34.597703 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:34.597703 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:34.597703 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:34.597703 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:00:34.597703 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:00:34.597703 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-2131871692. Jun 20 12:00:34.597703 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:34.599462 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f23168a4-6093-42bb-8739-d76fcc008116 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] Returning 400 to user: Invalid IP protocol tempest-999-2131871692. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:00:34.600560 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f23168a4-6093-42bb-8739-d76fcc008116 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.258687 Jun 20 12:00:34.602709 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 510/1041] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Jun 20 12:00:34 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 262 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 20 12:00:34.614960 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e9a3c3e2-a96c-4b78-9044-0c8d2c22ac32 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] Action: 'create', calling method: .version_select at 0x7f607375d1f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1161827998", "description": "tempest-description-34343000"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:34.782622 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-308b6944-5572-4bd8-ab6e-24ee214a7e7f tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:34.783370 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-308b6944-5572-4bd8-ab6e-24ee214a7e7f tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] [instance: a06342ec-4969-4552-a343-aefc73138aa1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:34.791973 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-308b6944-5572-4bd8-ab6e-24ee214a7e7f tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:34.800315 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-308b6944-5572-4bd8-ab6e-24ee214a7e7f tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:34.802514 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-308b6944-5572-4bd8-ab6e-24ee214a7e7f tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:34.803355 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-308b6944-5572-4bd8-ab6e-24ee214a7e7f tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:34.882914 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e9a3c3e2-a96c-4b78-9044-0c8d2c22ac32 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.272520 Jun 20 12:00:34.883749 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 532/1042] 10.222.0.27 () {60 vars in 1179 bytes} [Mon Jun 20 12:00:34 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:00:34.899316 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3403ffed-1d0e-458e-95ac-d91584eeff04 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] Action: 'create', calling method: .version_select at 0x7f607375d8b0>, body: {"security_group_rule": {"parent_group_id": "99854a74-307f-45df-b994-b9981dd924c4", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:34.981001 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-308b6944-5572-4bd8-ab6e-24ee214a7e7f tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a5483adf06454cabe761d1c17e2732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b350a5088d64f94bc850fc1b423cf2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:34.989247 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-3403ffed-1d0e-458e-95ac-d91584eeff04 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Jun 20 12:00:34.990601 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-308b6944-5572-4bd8-ab6e-24ee214a7e7f tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] 10.222.0.27 "GET /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1" status: 200 len: 1227 microversion: 2.1 time: 0.212116 Jun 20 12:00:34.991203 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 511/1043] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:34 2022] GET /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1 => generated 1227 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3403ffed-1d0e-458e-95ac-d91584eeff04 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] Request method failure captured: Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 138 Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGFexRYjver4QYOSpv36nzk_6NZcy38yxc_cad84AeN7VeWFvmbQMKoaqurYLph1afI_h__vsMKWP1PhXfpHfuFan58SyPKAfdyk5l-bJys7xAbxNmzUpP8WLR4X8uXXtj-vfhXWFvE1gYiJcpcpR85mrOv2q4_BbmpVVHLCGngkHZ4 Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 0485135750e34669aba376a238aa5f79 Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1592832125 Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0485135750e34669aba376a238aa5f79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0485135750e34669aba376a238aa5f79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0485135750e34669aba376a238aa5f79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0485135750e34669aba376a238aa5f79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1592832125 Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 0485135750e34669aba376a238aa5f79 Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1592832125 Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 270646b6bb1e44cbb6fbf9263571b465 Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: {"security_group_rule": {"parent_group_id": "99854a74-307f-45df-b994-b9981dd924c4", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: exception: Invalid port range 22:21. Former value cannot be greater than the later Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: action_args: {'body': {'security_group_rule': {'parent_group_id': '99854a74-307f-45df-b994-b9981dd924c4', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Jun 20 12:00:35.000010 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:35.003821 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:35.003821 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:35.003821 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:35.003821 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:35.003821 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:35.003821 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:00:35.003821 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:00:35.003821 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Jun 20 12:00:35.003821 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:35.003821 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3403ffed-1d0e-458e-95ac-d91584eeff04 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:00:35.003821 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3403ffed-1d0e-458e-95ac-d91584eeff04 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.102166 Jun 20 12:00:35.003821 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 533/1044] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Jun 20 12:00:34 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 20 12:00:35.015584 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-12785dc7-4807-4031-a79c-1cdb335133ef tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] Action: 'create', calling method: .version_select at 0x7f6073968d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-858789399", "description": "tempest-description-1171855079"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:35.263181 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-12785dc7-4807-4031-a79c-1cdb335133ef tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.260972 Jun 20 12:00:35.272984 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 534/1045] 10.222.0.27 () {60 vars in 1179 bytes} [Mon Jun 20 12:00:35 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:00:35.279387 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7a322903-9704-4734-a292-54201c42d825 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] Action: 'create', calling method: .version_select at 0x7f60737283a0>, body: {"security_group_rule": {"parent_group_id": "4422feae-23c2-48bc-9886-fc75c631c80b", "ip_protocol": "tcp", "from_port": 22, "to_port": 1856333309}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:35.557804 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-7a322903-9704-4734-a292-54201c42d825 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] HTTP exception thrown: Invalid port range 22:1856333309. Valid TCP ports should be between 1-65535 Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7a322903-9704-4734-a292-54201c42d825 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] Request method failure captured: Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 146 Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGFexRYjver4QYOSpv36nzk_6NZcy38yxc_cad84AeN7VeWFvmbQMKoaqurYLph1afI_h__vsMKWP1PhXfpHfuFan58SyPKAfdyk5l-bJys7xAbxNmzUpP8WLR4X8uXXtj-vfhXWFvE1gYiJcpcpR85mrOv2q4_BbmpVVHLCGngkHZ4 Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 0485135750e34669aba376a238aa5f79 Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1592832125 Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0485135750e34669aba376a238aa5f79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0485135750e34669aba376a238aa5f79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0485135750e34669aba376a238aa5f79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0485135750e34669aba376a238aa5f79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1592832125 Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 0485135750e34669aba376a238aa5f79 Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1592832125 Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 270646b6bb1e44cbb6fbf9263571b465 Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: {"security_group_rule": {"parent_group_id": "4422feae-23c2-48bc-9886-fc75c631c80b", "ip_protocol": "tcp", "from_port": 22, "to_port": 1856333309}} Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: exception: Invalid port range 22:1856333309. Valid TCP ports should be between 1-65535 Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: action_args: {'body': {'security_group_rule': {'parent_group_id': '4422feae-23c2-48bc-9886-fc75c631c80b', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1856333309}}} Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1856333309. Valid TCP ports should be between 1-65535 Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1856333309. Valid TCP ports should be between 1-65535 Jun 20 12:00:35.559475 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:35.563800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:35.563800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:35.563800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:35.563800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:35.563800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:35.563800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:00:35.563800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:00:35.563800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1856333309. Valid TCP ports should be between 1-65535 Jun 20 12:00:35.563800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:35.563800 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7a322903-9704-4734-a292-54201c42d825 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] Returning 400 to user: Invalid port range 22:1856333309. Valid TCP ports should be between 1-65535 {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:00:35.569734 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7a322903-9704-4734-a292-54201c42d825 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.290772 Jun 20 12:00:35.570403 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 512/1046] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Jun 20 12:00:35 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 299 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 20 12:00:35.582400 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c4b987c2-0d44-43b7-96ec-c0dff5f64dc9 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] Action: 'create', calling method: .version_select at 0x7f607375da60>, body: {"security_group_rule": {"parent_group_id": "514ffbc7-eab8-41fc-9415-0ae5f7325a51", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:35.646956 n-d-master-1 devstack@n-api.service[119128]: DEBUG neutronclient.v2_0.client [None req-c4b987c2-0d44-43b7-96ec-c0dff5f64dc9 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 514ffbc7-eab8-41fc-9415-0ae5f7325a51 does not exist", "detail": ""}} {{(pid=119128) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 20 12:00:35.647592 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.security_group_api [None req-c4b987c2-0d44-43b7-96ec-c0dff5f64dc9 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] Neutron security group 514ffbc7-eab8-41fc-9415-0ae5f7325a51 not found {{(pid=119128) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 20 12:00:35.648885 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-c4b987c2-0d44-43b7-96ec-c0dff5f64dc9 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] HTTP exception thrown: Security group 514ffbc7-eab8-41fc-9415-0ae5f7325a51 does not exist Jun 20 12:00:35.648885 n-d-master-1 devstack@n-api.service[119128]: Neutron server returns request_ids: ['req-0d52dd9d-7906-486d-af2f-3b61067cfb9b'] Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c4b987c2-0d44-43b7-96ec-c0dff5f64dc9 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] Request method failure captured: Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 138 Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGFexRYjver4QYOSpv36nzk_6NZcy38yxc_cad84AeN7VeWFvmbQMKoaqurYLph1afI_h__vsMKWP1PhXfpHfuFan58SyPKAfdyk5l-bJys7xAbxNmzUpP8WLR4X8uXXtj-vfhXWFvE1gYiJcpcpR85mrOv2q4_BbmpVVHLCGngkHZ4 Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 0485135750e34669aba376a238aa5f79 Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1592832125 Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0485135750e34669aba376a238aa5f79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0485135750e34669aba376a238aa5f79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0485135750e34669aba376a238aa5f79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0485135750e34669aba376a238aa5f79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1592832125 Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 0485135750e34669aba376a238aa5f79 Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1592832125 Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 270646b6bb1e44cbb6fbf9263571b465 Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: {"security_group_rule": {"parent_group_id": "514ffbc7-eab8-41fc-9415-0ae5f7325a51", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: exception: Security group 514ffbc7-eab8-41fc-9415-0ae5f7325a51 does not exist Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: Neutron server returns request_ids: ['req-0d52dd9d-7906-486d-af2f-3b61067cfb9b'] Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: action_args: {'body': {'security_group_rule': {'parent_group_id': '514ffbc7-eab8-41fc-9415-0ae5f7325a51', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 20 12:00:35.650907 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 514ffbc7-eab8-41fc-9415-0ae5f7325a51 does not exist Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0d52dd9d-7906-486d-af2f-3b61067cfb9b'] Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 514ffbc7-eab8-41fc-9415-0ae5f7325a51 does not exist Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0d52dd9d-7906-486d-af2f-3b61067cfb9b'] Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 514ffbc7-eab8-41fc-9415-0ae5f7325a51 does not exist Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0d52dd9d-7906-486d-af2f-3b61067cfb9b'] Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 514ffbc7-eab8-41fc-9415-0ae5f7325a51 does not exist Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0d52dd9d-7906-486d-af2f-3b61067cfb9b'] Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c4b987c2-0d44-43b7-96ec-c0dff5f64dc9 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] Returning 404 to user: Security group 514ffbc7-eab8-41fc-9415-0ae5f7325a51 does not exist Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: Neutron server returns request_ids: ['req-0d52dd9d-7906-486d-af2f-3b61067cfb9b'] {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c4b987c2-0d44-43b7-96ec-c0dff5f64dc9 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.074372 Jun 20 12:00:35.661343 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 535/1047] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Jun 20 12:00:35 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:00:35.664672 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-98a144de-0378-46c5-a63f-555db6219c42 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] Calling method '.version_select at 0x7f607370fc10>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:36.010885 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-448f3c5e-8f64-4015-9e61-bfb12e739fcd tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:36.011505 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-448f3c5e-8f64-4015-9e61-bfb12e739fcd tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] [instance: a06342ec-4969-4552-a343-aefc73138aa1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:36.044346 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-448f3c5e-8f64-4015-9e61-bfb12e739fcd tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:36.044836 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-448f3c5e-8f64-4015-9e61-bfb12e739fcd tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:36.045647 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-448f3c5e-8f64-4015-9e61-bfb12e739fcd tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:36.046085 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-448f3c5e-8f64-4015-9e61-bfb12e739fcd tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:36.118880 n-d-master-1 devstack@n-api.service[119127]: DEBUG neutronclient.v2_0.client [None req-98a144de-0378-46c5-a63f-555db6219c42 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule e9ed0f32-bd22-44a6-9189-ec487cc2b623 does not exist", "detail": ""}} {{(pid=119127) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 20 12:00:36.119494 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.security_group_api [None req-98a144de-0378-46c5-a63f-555db6219c42 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] Neutron security group rule e9ed0f32-bd22-44a6-9189-ec487cc2b623 not found {{(pid=119127) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Jun 20 12:00:36.120025 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-98a144de-0378-46c5-a63f-555db6219c42 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] HTTP exception thrown: Security group rule e9ed0f32-bd22-44a6-9189-ec487cc2b623 does not exist Jun 20 12:00:36.120025 n-d-master-1 devstack@n-api.service[119127]: Neutron server returns request_ids: ['req-c5a00fef-c85a-4779-a3f6-8288bd3e3fe7'] Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-98a144de-0378-46c5-a63f-555db6219c42 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] Request method failure captured: Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/os-security-group-rules/e9ed0f32-bd22-44a6-9189-ec487cc2b623 HTTP/1.1 Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGFexRYjver4QYOSpv36nzk_6NZcy38yxc_cad84AeN7VeWFvmbQMKoaqurYLph1afI_h__vsMKWP1PhXfpHfuFan58SyPKAfdyk5l-bJys7xAbxNmzUpP8WLR4X8uXXtj-vfhXWFvE1gYiJcpcpR85mrOv2q4_BbmpVVHLCGngkHZ4 Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 0485135750e34669aba376a238aa5f79 Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1592832125 Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0485135750e34669aba376a238aa5f79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0485135750e34669aba376a238aa5f79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0485135750e34669aba376a238aa5f79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0485135750e34669aba376a238aa5f79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1592832125 Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 0485135750e34669aba376a238aa5f79 Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1592832125 Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 270646b6bb1e44cbb6fbf9263571b465 Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: exception: Security group rule e9ed0f32-bd22-44a6-9189-ec487cc2b623 does not exist Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: Neutron server returns request_ids: ['req-c5a00fef-c85a-4779-a3f6-8288bd3e3fe7'] Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'e9ed0f32-bd22-44a6-9189-ec487cc2b623'} Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 20 12:00:36.122754 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule e9ed0f32-bd22-44a6-9189-ec487cc2b623 does not exist Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5a00fef-c85a-4779-a3f6-8288bd3e3fe7'] Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule e9ed0f32-bd22-44a6-9189-ec487cc2b623 does not exist Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5a00fef-c85a-4779-a3f6-8288bd3e3fe7'] Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule e9ed0f32-bd22-44a6-9189-ec487cc2b623 does not exist Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5a00fef-c85a-4779-a3f6-8288bd3e3fe7'] Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule e9ed0f32-bd22-44a6-9189-ec487cc2b623 does not exist Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5a00fef-c85a-4779-a3f6-8288bd3e3fe7'] Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-98a144de-0378-46c5-a63f-555db6219c42 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] Returning 404 to user: Security group rule e9ed0f32-bd22-44a6-9189-ec487cc2b623 does not exist Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: Neutron server returns request_ids: ['req-c5a00fef-c85a-4779-a3f6-8288bd3e3fe7'] {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-98a144de-0378-46c5-a63f-555db6219c42 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-group-rules/e9ed0f32-bd22-44a6-9189-ec487cc2b623" status: 404 len: 199 microversion: 2.1 time: 0.463770 Jun 20 12:00:36.126911 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 513/1048] 10.222.0.27 () {58 vars in 1286 bytes} [Mon Jun 20 12:00:35 2022] DELETE /compute/v2.1/os-security-group-rules/e9ed0f32-bd22-44a6-9189-ec487cc2b623 => generated 199 bytes in 465 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:00:36.136713 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a8ae3f34-143c-4273-90d8-b2d7988d41b7 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] Calling method '.version_select at 0x7f607370ed30>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:36.249485 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-448f3c5e-8f64-4015-9e61-bfb12e739fcd tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a5483adf06454cabe761d1c17e2732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b350a5088d64f94bc850fc1b423cf2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:36.264186 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-448f3c5e-8f64-4015-9e61-bfb12e739fcd tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] 10.222.0.27 "GET /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1" status: 200 len: 1289 microversion: 2.1 time: 0.259908 Jun 20 12:00:36.268582 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 536/1049] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:36 2022] GET /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1 => generated 1289 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:37.306917 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-58438897-2b9e-4fa5-8c0e-134857299319 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:37.307764 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-58438897-2b9e-4fa5-8c0e-134857299319 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] [instance: a06342ec-4969-4552-a343-aefc73138aa1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:37.315226 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-58438897-2b9e-4fa5-8c0e-134857299319 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:37.315811 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-58438897-2b9e-4fa5-8c0e-134857299319 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:37.323934 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-58438897-2b9e-4fa5-8c0e-134857299319 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:37.326465 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-58438897-2b9e-4fa5-8c0e-134857299319 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:37.489625 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-58438897-2b9e-4fa5-8c0e-134857299319 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a5483adf06454cabe761d1c17e2732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b350a5088d64f94bc850fc1b423cf2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:37.516259 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-58438897-2b9e-4fa5-8c0e-134857299319 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] 10.222.0.27 "GET /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1" status: 200 len: 1289 microversion: 2.1 time: 0.224511 Jun 20 12:00:37.536994 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 537/1050] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:37 2022] GET /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1 => generated 1289 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:00:37.604779 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a8ae3f34-143c-4273-90d8-b2d7988d41b7 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/4422feae-23c2-48bc-9886-fc75c631c80b" status: 202 len: 0 microversion: 2.1 time: 1.472174 Jun 20 12:00:37.605557 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 514/1051] 10.222.0.27 () {58 vars in 1271 bytes} [Mon Jun 20 12:00:36 2022] DELETE /compute/v2.1/os-security-groups/4422feae-23c2-48bc-9886-fc75c631c80b => generated 0 bytes in 1475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:00:37.614983 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2092fbca-1712-4f33-9810-2709a070e252 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] Calling method '.version_select at 0x7f607371f5e0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:38.234228 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2092fbca-1712-4f33-9810-2709a070e252 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/99854a74-307f-45df-b994-b9981dd924c4" status: 202 len: 0 microversion: 2.1 time: 0.624268 Jun 20 12:00:38.235104 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 538/1052] 10.222.0.27 () {58 vars in 1271 bytes} [Mon Jun 20 12:00:37 2022] DELETE /compute/v2.1/os-security-groups/99854a74-307f-45df-b994-b9981dd924c4 => generated 0 bytes in 626 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:00:38.245991 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-19684118-4e08-4975-a2ce-6244149b6e5d tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] Calling method '.version_select at 0x7f607376f3a0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:38.570666 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-aa1e4a76-de84-494b-a4cb-2214b34a2566 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:38.573768 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-aa1e4a76-de84-494b-a4cb-2214b34a2566 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] [instance: a06342ec-4969-4552-a343-aefc73138aa1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:38.593305 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=4,nova_api:DELETE=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:00:38.600039 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aa1e4a76-de84-494b-a4cb-2214b34a2566 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:38.601052 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aa1e4a76-de84-494b-a4cb-2214b34a2566 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:38.602792 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aa1e4a76-de84-494b-a4cb-2214b34a2566 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:38.604378 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aa1e4a76-de84-494b-a4cb-2214b34a2566 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:38.864040 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-aa1e4a76-de84-494b-a4cb-2214b34a2566 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a5483adf06454cabe761d1c17e2732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b350a5088d64f94bc850fc1b423cf2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:38.875902 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-aa1e4a76-de84-494b-a4cb-2214b34a2566 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] 10.222.0.27 "GET /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1" status: 200 len: 1289 microversion: 2.1 time: 0.331358 Jun 20 12:00:38.877709 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 539/1053] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:38 2022] GET /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1 => generated 1289 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:39.894838 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-97cb2ace-b01e-4acf-abc0-0d275dd615a4 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:39.896296 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-97cb2ace-b01e-4acf-abc0-0d275dd615a4 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] [instance: a06342ec-4969-4552-a343-aefc73138aa1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:39.903487 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-97cb2ace-b01e-4acf-abc0-0d275dd615a4 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:39.904236 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-97cb2ace-b01e-4acf-abc0-0d275dd615a4 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:39.909305 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-97cb2ace-b01e-4acf-abc0-0d275dd615a4 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:39.909997 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-97cb2ace-b01e-4acf-abc0-0d275dd615a4 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:40.059037 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-19684118-4e08-4975-a2ce-6244149b6e5d tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/2b8eb6da-ab27-47b3-b569-a9a7c6ba34e4" status: 202 len: 0 microversion: 2.1 time: 1.818870 Jun 20 12:00:40.060145 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 515/1054] 10.222.0.27 () {58 vars in 1271 bytes} [Mon Jun 20 12:00:38 2022] DELETE /compute/v2.1/os-security-groups/2b8eb6da-ab27-47b3-b569-a9a7c6ba34e4 => generated 0 bytes in 1821 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:00:40.071119 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-17d75c49-ba5a-451b-9ec4-2f24acf26a2a tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] Calling method '.version_select at 0x7f6073728280>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:40.343804 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-97cb2ace-b01e-4acf-abc0-0d275dd615a4 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a5483adf06454cabe761d1c17e2732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b350a5088d64f94bc850fc1b423cf2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:40.370743 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-97cb2ace-b01e-4acf-abc0-0d275dd615a4 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] 10.222.0.27 "GET /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1" status: 200 len: 1331 microversion: 2.1 time: 0.480282 Jun 20 12:00:40.371308 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 540/1055] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:39 2022] GET /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1 => generated 1331 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:40.573209 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ce476bfe-acf5-4801-9a32-8c786a19a1fd tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1920593175", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:40.696590 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-ce476bfe-acf5-4801-9a32-8c786a19a1fd tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] validate_networks() for None {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:00:41.209453 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-ce476bfe-acf5-4801-9a32-8c786a19a1fd tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:00:41.210579 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-ce476bfe-acf5-4801-9a32-8c786a19a1fd tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:00:41.211058 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-ce476bfe-acf5-4801-9a32-8c786a19a1fd tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:00:41.211465 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-ce476bfe-acf5-4801-9a32-8c786a19a1fd tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:00:41.211924 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-ce476bfe-acf5-4801-9a32-8c786a19a1fd tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:00:41.228233 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce476bfe-acf5-4801-9a32-8c786a19a1fd tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:41.228958 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce476bfe-acf5-4801-9a32-8c786a19a1fd tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:41.229792 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce476bfe-acf5-4801-9a32-8c786a19a1fd tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:41.230211 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce476bfe-acf5-4801-9a32-8c786a19a1fd tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:41.264895 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-ce476bfe-acf5-4801-9a32-8c786a19a1fd tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Getting quotas for project 9132021d1e124022b4fb79bacb8bdff4. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:00:41.278182 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-ce476bfe-acf5-4801-9a32-8c786a19a1fd tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Getting quotas for user 0460c29101ce4965aec21238001e4698 and project 9132021d1e124022b4fb79bacb8bdff4. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:00:41.298212 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ce476bfe-acf5-4801-9a32-8c786a19a1fd tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:00:41.301392 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ce476bfe-acf5-4801-9a32-8c786a19a1fd tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] [instance: 05f6d43e-7e1a-47b1-901e-30ecf12e39cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:00:41.354664 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ce476bfe-acf5-4801-9a32-8c786a19a1fd tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.975301 Jun 20 12:00:41.355457 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 541/1056] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:00:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:00:41.378374 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f9742d48-e234-4cfa-9737-19b9b2ae7dfd tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:41.379254 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f9742d48-e234-4cfa-9737-19b9b2ae7dfd tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] [instance: 05f6d43e-7e1a-47b1-901e-30ecf12e39cc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:41.528061 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f9742d48-e234-4cfa-9737-19b9b2ae7dfd tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0460c29101ce4965aec21238001e4698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9132021d1e124022b4fb79bacb8bdff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:41.543781 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f9742d48-e234-4cfa-9737-19b9b2ae7dfd tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] 10.222.0.27 "GET /compute/v2.1/servers/05f6d43e-7e1a-47b1-901e-30ecf12e39cc" status: 200 len: 1214 microversion: 2.1 time: 0.174439 Jun 20 12:00:41.544186 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 542/1057] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:41 2022] GET /compute/v2.1/servers/05f6d43e-7e1a-47b1-901e-30ecf12e39cc => generated 1214 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:41.553335 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-77080305-6f63-4a32-85ab-00bcaa9e0b57 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:41.557403 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-77080305-6f63-4a32-85ab-00bcaa9e0b57 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] [instance: a06342ec-4969-4552-a343-aefc73138aa1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:41.565962 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-77080305-6f63-4a32-85ab-00bcaa9e0b57 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:41.566416 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-77080305-6f63-4a32-85ab-00bcaa9e0b57 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:41.567385 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-77080305-6f63-4a32-85ab-00bcaa9e0b57 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:41.568009 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-77080305-6f63-4a32-85ab-00bcaa9e0b57 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:41.670994 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-17d75c49-ba5a-451b-9ec4-2f24acf26a2a tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/85c1e576-2930-4420-ab03-773c3f015bd6" status: 202 len: 0 microversion: 2.1 time: 1.605495 Jun 20 12:00:41.673807 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 516/1058] 10.222.0.27 () {58 vars in 1271 bytes} [Mon Jun 20 12:00:40 2022] DELETE /compute/v2.1/os-security-groups/85c1e576-2930-4420-ab03-773c3f015bd6 => generated 0 bytes in 1610 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:00:41.699129 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-aa8db421-69ff-411b-a6be-4254b53b09a5 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4cf6c5f-ba0e-479f-a06e-ed4077e0260b"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:41.706331 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-aa8db421-69ff-411b-a6be-4254b53b09a5 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 3c12363c-ee46-445d-af50-77a1f0518a17] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:41.724989 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa8db421-69ff-411b-a6be-4254b53b09a5 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:41.725716 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa8db421-69ff-411b-a6be-4254b53b09a5 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:41.759000 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa8db421-69ff-411b-a6be-4254b53b09a5 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:41.764796 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa8db421-69ff-411b-a6be-4254b53b09a5 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:42.531556 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-aa8db421-69ff-411b-a6be-4254b53b09a5 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "POST /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.852684 Jun 20 12:00:42.532765 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 517/1059] 10.222.0.27 () {60 vars in 1322 bytes} [Mon Jun 20 12:00:41 2022] POST /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17/os-volume_attachments => generated 194 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:00:42.556577 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a2592939-3b80-43bc-9b04-5d0378deae95 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] Calling method '.version_select at 0x7f60736dfaf0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:42.583589 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-77080305-6f63-4a32-85ab-00bcaa9e0b57 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a5483adf06454cabe761d1c17e2732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b350a5088d64f94bc850fc1b423cf2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:42.597286 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-77080305-6f63-4a32-85ab-00bcaa9e0b57 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] 10.222.0.27 "GET /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1" status: 200 len: 1331 microversion: 2.1 time: 1.050876 Jun 20 12:00:42.612234 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 543/1060] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:41 2022] GET /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1 => generated 1331 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:42.617518 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-8c2c423b-8e88-4777-8022-df3b95775b1e req-41c0472b-a30e-4357-82f8-7ccc2c3f5d8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a06342ec-4969-4552-a343-aefc73138aa1", "tag": "16e6c137-ef3b-42fb-9ac9-913d43c2af22"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:42.642829 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-8c2c423b-8e88-4777-8022-df3b95775b1e req-41c0472b-a30e-4357-82f8-7ccc2c3f5d8a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:42.643595 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-8c2c423b-8e88-4777-8022-df3b95775b1e req-41c0472b-a30e-4357-82f8-7ccc2c3f5d8a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:42.664443 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-8c2c423b-8e88-4777-8022-df3b95775b1e req-41c0472b-a30e-4357-82f8-7ccc2c3f5d8a service nova] Creating event network-changed:16e6c137-ef3b-42fb-9ac9-913d43c2af22 for instance a06342ec-4969-4552-a343-aefc73138aa1 on n-h1-master-1 Jun 20 12:00:42.675034 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-8c2c423b-8e88-4777-8022-df3b95775b1e req-41c0472b-a30e-4357-82f8-7ccc2c3f5d8a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073375 Jun 20 12:00:42.676673 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 544/1061] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:00:42.698556 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b601a672-2f9d-4bac-b2be-01f1398cbad3 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:42.700564 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b601a672-2f9d-4bac-b2be-01f1398cbad3 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] [instance: 05f6d43e-7e1a-47b1-901e-30ecf12e39cc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:42.710069 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b601a672-2f9d-4bac-b2be-01f1398cbad3 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:42.710992 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b601a672-2f9d-4bac-b2be-01f1398cbad3 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:42.712107 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b601a672-2f9d-4bac-b2be-01f1398cbad3 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:42.712811 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b601a672-2f9d-4bac-b2be-01f1398cbad3 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:42.880563 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b601a672-2f9d-4bac-b2be-01f1398cbad3 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0460c29101ce4965aec21238001e4698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9132021d1e124022b4fb79bacb8bdff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:42.896873 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b601a672-2f9d-4bac-b2be-01f1398cbad3 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] 10.222.0.27 "GET /compute/v2.1/servers/05f6d43e-7e1a-47b1-901e-30ecf12e39cc" status: 200 len: 1210 microversion: 2.1 time: 0.218557 Jun 20 12:00:42.897505 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 545/1062] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:42 2022] GET /compute/v2.1/servers/05f6d43e-7e1a-47b1-901e-30ecf12e39cc => generated 1210 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:43.216399 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a2592939-3b80-43bc-9b04-5d0378deae95 tempest-SecurityGroupRulesNegativeTestJSON-1592832125 tempest-SecurityGroupRulesNegativeTestJSON-1592832125-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/46b90c27-6816-4215-a767-4e72e7912db7" status: 202 len: 0 microversion: 2.1 time: 0.671809 Jun 20 12:00:43.218625 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 518/1063] 10.222.0.27 () {58 vars in 1271 bytes} [Mon Jun 20 12:00:42 2022] DELETE /compute/v2.1/os-security-groups/46b90c27-6816-4215-a767-4e72e7912db7 => generated 0 bytes in 685 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:00:43.632532 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f9566fed-556f-4a25-8522-7ca54ba09b66 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:43.633532 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f9566fed-556f-4a25-8522-7ca54ba09b66 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] [instance: a06342ec-4969-4552-a343-aefc73138aa1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:43.669398 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f9566fed-556f-4a25-8522-7ca54ba09b66 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:43.671607 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f9566fed-556f-4a25-8522-7ca54ba09b66 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:43.679857 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f9566fed-556f-4a25-8522-7ca54ba09b66 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:43.681091 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f9566fed-556f-4a25-8522-7ca54ba09b66 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:43.913917 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:00:43.915409 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=8 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:00:43.925737 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-01925628-72c5-4809-82df-8090926eb23d tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:43.931125 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-01925628-72c5-4809-82df-8090926eb23d tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] [instance: 05f6d43e-7e1a-47b1-901e-30ecf12e39cc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:43.938481 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:DELETE=7,nova_api:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:00:43.958707 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01925628-72c5-4809-82df-8090926eb23d tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:43.959559 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01925628-72c5-4809-82df-8090926eb23d tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:43.961690 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01925628-72c5-4809-82df-8090926eb23d tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:43.962162 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01925628-72c5-4809-82df-8090926eb23d tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:44.294347 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-01925628-72c5-4809-82df-8090926eb23d tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0460c29101ce4965aec21238001e4698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9132021d1e124022b4fb79bacb8bdff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:44.318002 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f9566fed-556f-4a25-8522-7ca54ba09b66 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a5483adf06454cabe761d1c17e2732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b350a5088d64f94bc850fc1b423cf2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:44.318988 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-01925628-72c5-4809-82df-8090926eb23d tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] 10.222.0.27 "GET /compute/v2.1/servers/05f6d43e-7e1a-47b1-901e-30ecf12e39cc" status: 200 len: 1272 microversion: 2.1 time: 0.407249 Jun 20 12:00:44.320010 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 519/1064] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:43 2022] GET /compute/v2.1/servers/05f6d43e-7e1a-47b1-901e-30ecf12e39cc => generated 1272 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:44.341349 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f9566fed-556f-4a25-8522-7ca54ba09b66 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] 10.222.0.27 "GET /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1" status: 200 len: 1331 microversion: 2.1 time: 0.718185 Jun 20 12:00:44.358733 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 546/1065] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:43 2022] GET /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1 => generated 1331 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:45.338162 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bc4c213a-0e14-4f82-bcc8-3efda09c7df3 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:45.339887 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bc4c213a-0e14-4f82-bcc8-3efda09c7df3 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] [instance: 05f6d43e-7e1a-47b1-901e-30ecf12e39cc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:45.357554 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc4c213a-0e14-4f82-bcc8-3efda09c7df3 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:45.360387 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc4c213a-0e14-4f82-bcc8-3efda09c7df3 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:45.362171 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc4c213a-0e14-4f82-bcc8-3efda09c7df3 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:45.365274 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3b561e90-1976-4a71-8d98-4bda43820548 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:45.366011 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3b561e90-1976-4a71-8d98-4bda43820548 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] [instance: a06342ec-4969-4552-a343-aefc73138aa1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:45.366857 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc4c213a-0e14-4f82-bcc8-3efda09c7df3 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:45.386307 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b561e90-1976-4a71-8d98-4bda43820548 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:45.386855 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b561e90-1976-4a71-8d98-4bda43820548 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:45.387712 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b561e90-1976-4a71-8d98-4bda43820548 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:45.388288 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b561e90-1976-4a71-8d98-4bda43820548 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:45.541728 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bc4c213a-0e14-4f82-bcc8-3efda09c7df3 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0460c29101ce4965aec21238001e4698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9132021d1e124022b4fb79bacb8bdff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:45.571411 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bc4c213a-0e14-4f82-bcc8-3efda09c7df3 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] 10.222.0.27 "GET /compute/v2.1/servers/05f6d43e-7e1a-47b1-901e-30ecf12e39cc" status: 200 len: 1272 microversion: 2.1 time: 0.229452 Jun 20 12:00:45.579277 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 520/1066] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:45 2022] GET /compute/v2.1/servers/05f6d43e-7e1a-47b1-901e-30ecf12e39cc => generated 1272 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:46.221623 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3b561e90-1976-4a71-8d98-4bda43820548 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a5483adf06454cabe761d1c17e2732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b350a5088d64f94bc850fc1b423cf2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:46.241524 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3b561e90-1976-4a71-8d98-4bda43820548 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] 10.222.0.27 "GET /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1" status: 200 len: 1331 microversion: 2.1 time: 0.880143 Jun 20 12:00:46.242371 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 547/1067] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:45 2022] GET /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1 => generated 1331 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:46.598546 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7692e5ec-8e23-4093-a873-1abc1e98ec24 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:46.600727 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7692e5ec-8e23-4093-a873-1abc1e98ec24 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] [instance: 05f6d43e-7e1a-47b1-901e-30ecf12e39cc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:46.627816 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7692e5ec-8e23-4093-a873-1abc1e98ec24 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:46.630078 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7692e5ec-8e23-4093-a873-1abc1e98ec24 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:46.631387 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7692e5ec-8e23-4093-a873-1abc1e98ec24 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:46.633840 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7692e5ec-8e23-4093-a873-1abc1e98ec24 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:47.275486 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c8c3aa12-de32-45e1-acc2-5b665ef0d7d7 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:47.284890 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c8c3aa12-de32-45e1-acc2-5b665ef0d7d7 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] [instance: a06342ec-4969-4552-a343-aefc73138aa1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:47.312589 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c8c3aa12-de32-45e1-acc2-5b665ef0d7d7 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:47.313449 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c8c3aa12-de32-45e1-acc2-5b665ef0d7d7 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:47.321436 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c8c3aa12-de32-45e1-acc2-5b665ef0d7d7 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:47.322473 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c8c3aa12-de32-45e1-acc2-5b665ef0d7d7 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:47.901092 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c8c3aa12-de32-45e1-acc2-5b665ef0d7d7 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a5483adf06454cabe761d1c17e2732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b350a5088d64f94bc850fc1b423cf2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:47.910424 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c8c3aa12-de32-45e1-acc2-5b665ef0d7d7 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] 10.222.0.27 "GET /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1" status: 200 len: 1331 microversion: 2.1 time: 0.645100 Jun 20 12:00:47.917457 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 548/1068] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:47 2022] GET /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1 => generated 1331 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:48.000164 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7692e5ec-8e23-4093-a873-1abc1e98ec24 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0460c29101ce4965aec21238001e4698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9132021d1e124022b4fb79bacb8bdff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:48.030590 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7692e5ec-8e23-4093-a873-1abc1e98ec24 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] 10.222.0.27 "GET /compute/v2.1/servers/05f6d43e-7e1a-47b1-901e-30ecf12e39cc" status: 200 len: 1314 microversion: 2.1 time: 1.437326 Jun 20 12:00:48.034823 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 521/1069] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:46 2022] GET /compute/v2.1/servers/05f6d43e-7e1a-47b1-901e-30ecf12e39cc => generated 1314 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:48.939607 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8d851eb0-3a06-4be5-a2a6-3e1ca3a96915 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:48.943178 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8d851eb0-3a06-4be5-a2a6-3e1ca3a96915 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] [instance: a06342ec-4969-4552-a343-aefc73138aa1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:48.972654 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8d851eb0-3a06-4be5-a2a6-3e1ca3a96915 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:48.974112 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8d851eb0-3a06-4be5-a2a6-3e1ca3a96915 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:48.978866 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8d851eb0-3a06-4be5-a2a6-3e1ca3a96915 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:48.981311 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8d851eb0-3a06-4be5-a2a6-3e1ca3a96915 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:49.053661 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0c9532f8-ece3-4c13-b5ad-12fd577aa034 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:49.056174 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0c9532f8-ece3-4c13-b5ad-12fd577aa034 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] [instance: 05f6d43e-7e1a-47b1-901e-30ecf12e39cc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:49.077961 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0c9532f8-ece3-4c13-b5ad-12fd577aa034 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:49.079382 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0c9532f8-ece3-4c13-b5ad-12fd577aa034 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:49.080726 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0c9532f8-ece3-4c13-b5ad-12fd577aa034 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:49.088631 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0c9532f8-ece3-4c13-b5ad-12fd577aa034 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:49.779169 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8d851eb0-3a06-4be5-a2a6-3e1ca3a96915 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a5483adf06454cabe761d1c17e2732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b350a5088d64f94bc850fc1b423cf2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:49.802034 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8d851eb0-3a06-4be5-a2a6-3e1ca3a96915 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] 10.222.0.27 "GET /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1" status: 200 len: 1331 microversion: 2.1 time: 0.874933 Jun 20 12:00:49.815463 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 549/1070] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:48 2022] GET /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1 => generated 1331 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:49.815463 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-3f840b4b-17ca-4591-9e3a-7a946c4648df req-9c5ac6cf-a0a2-49fa-8f44-7d21570704d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a06342ec-4969-4552-a343-aefc73138aa1", "name": "network-vif-plugged", "status": "completed", "tag": "16e6c137-ef3b-42fb-9ac9-913d43c2af22"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:49.850323 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-3f840b4b-17ca-4591-9e3a-7a946c4648df req-9c5ac6cf-a0a2-49fa-8f44-7d21570704d9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:49.850842 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-3f840b4b-17ca-4591-9e3a-7a946c4648df req-9c5ac6cf-a0a2-49fa-8f44-7d21570704d9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:49.882478 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-3f840b4b-17ca-4591-9e3a-7a946c4648df req-9c5ac6cf-a0a2-49fa-8f44-7d21570704d9 service nova] Creating event network-vif-plugged:16e6c137-ef3b-42fb-9ac9-913d43c2af22 for instance a06342ec-4969-4552-a343-aefc73138aa1 on n-h1-master-1 Jun 20 12:00:49.915589 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-3f840b4b-17ca-4591-9e3a-7a946c4648df req-9c5ac6cf-a0a2-49fa-8f44-7d21570704d9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110846 Jun 20 12:00:49.923656 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 550/1071] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:00:49.966666 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-5091ebc9-7241-44f7-93ce-be714169af68 req-e612e529-adbe-44d4-b349-b07281d81801 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05f6d43e-7e1a-47b1-901e-30ecf12e39cc", "tag": "f9dd358c-52c3-411f-bce5-44c933209e47"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:50.008464 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-5091ebc9-7241-44f7-93ce-be714169af68 req-e612e529-adbe-44d4-b349-b07281d81801 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:50.009029 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-5091ebc9-7241-44f7-93ce-be714169af68 req-e612e529-adbe-44d4-b349-b07281d81801 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:50.045218 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-5091ebc9-7241-44f7-93ce-be714169af68 req-e612e529-adbe-44d4-b349-b07281d81801 service nova] Creating event network-changed:f9dd358c-52c3-411f-bce5-44c933209e47 for instance 05f6d43e-7e1a-47b1-901e-30ecf12e39cc on n-h2-master-1 Jun 20 12:00:50.057880 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-5091ebc9-7241-44f7-93ce-be714169af68 req-e612e529-adbe-44d4-b349-b07281d81801 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104434 Jun 20 12:00:50.061291 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 551/1072] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:00:50.541039 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0c9532f8-ece3-4c13-b5ad-12fd577aa034 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0460c29101ce4965aec21238001e4698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9132021d1e124022b4fb79bacb8bdff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:50.554178 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0c9532f8-ece3-4c13-b5ad-12fd577aa034 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] 10.222.0.27 "GET /compute/v2.1/servers/05f6d43e-7e1a-47b1-901e-30ecf12e39cc" status: 200 len: 1314 microversion: 2.1 time: 1.506308 Jun 20 12:00:50.555394 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 522/1073] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:49 2022] GET /compute/v2.1/servers/05f6d43e-7e1a-47b1-901e-30ecf12e39cc => generated 1314 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:50.832250 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a1e5c08b-4cd4-4fa9-8486-44449f48a191 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:50.834401 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a1e5c08b-4cd4-4fa9-8486-44449f48a191 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] [instance: a06342ec-4969-4552-a343-aefc73138aa1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:50.858969 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a1e5c08b-4cd4-4fa9-8486-44449f48a191 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:50.867424 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a1e5c08b-4cd4-4fa9-8486-44449f48a191 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:50.868839 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a1e5c08b-4cd4-4fa9-8486-44449f48a191 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:50.875195 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a1e5c08b-4cd4-4fa9-8486-44449f48a191 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:51.170461 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a1e5c08b-4cd4-4fa9-8486-44449f48a191 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a5483adf06454cabe761d1c17e2732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b350a5088d64f94bc850fc1b423cf2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:51.188894 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a1e5c08b-4cd4-4fa9-8486-44449f48a191 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] 10.222.0.27 "GET /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1" status: 200 len: 1331 microversion: 2.1 time: 0.362748 Jun 20 12:00:51.193682 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 552/1074] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:50 2022] GET /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1 => generated 1331 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:51.571434 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-34764f78-d66a-4d48-8aa5-962ed11c50c1 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:51.572093 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-34764f78-d66a-4d48-8aa5-962ed11c50c1 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] [instance: 05f6d43e-7e1a-47b1-901e-30ecf12e39cc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:51.587536 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-34764f78-d66a-4d48-8aa5-962ed11c50c1 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:51.587985 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-34764f78-d66a-4d48-8aa5-962ed11c50c1 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:51.588815 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-34764f78-d66a-4d48-8aa5-962ed11c50c1 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:51.589245 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-34764f78-d66a-4d48-8aa5-962ed11c50c1 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:52.102903 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-34764f78-d66a-4d48-8aa5-962ed11c50c1 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0460c29101ce4965aec21238001e4698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9132021d1e124022b4fb79bacb8bdff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:52.119977 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-34764f78-d66a-4d48-8aa5-962ed11c50c1 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] 10.222.0.27 "GET /compute/v2.1/servers/05f6d43e-7e1a-47b1-901e-30ecf12e39cc" status: 200 len: 1314 microversion: 2.1 time: 0.552510 Jun 20 12:00:52.121816 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 523/1075] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:51 2022] GET /compute/v2.1/servers/05f6d43e-7e1a-47b1-901e-30ecf12e39cc => generated 1314 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:52.206255 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:00:52.209749 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=8 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:00:52.231826 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4961bdbc-2ad3-4013-9bf9-f21dc81e7e4a tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:52.238392 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4961bdbc-2ad3-4013-9bf9-f21dc81e7e4a tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] [instance: a06342ec-4969-4552-a343-aefc73138aa1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:52.257086 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4961bdbc-2ad3-4013-9bf9-f21dc81e7e4a tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:52.258718 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4961bdbc-2ad3-4013-9bf9-f21dc81e7e4a tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:52.261016 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4961bdbc-2ad3-4013-9bf9-f21dc81e7e4a tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:52.262328 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4961bdbc-2ad3-4013-9bf9-f21dc81e7e4a tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:52.634944 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4961bdbc-2ad3-4013-9bf9-f21dc81e7e4a tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a5483adf06454cabe761d1c17e2732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b350a5088d64f94bc850fc1b423cf2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:52.644418 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:00:52.649750 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4961bdbc-2ad3-4013-9bf9-f21dc81e7e4a tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] 10.222.0.27 "GET /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1" status: 200 len: 1533 microversion: 2.1 time: 0.445210 Jun 20 12:00:52.651987 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 553/1076] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:52 2022] GET /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1 => generated 1533 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:52.690169 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4d76022b-6bd0-48f5-a6c7-5aac557428aa tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Action: 'create', calling method: .version_select at 0x7f60736e5280>, body: {"pool": "3ed3a8e4-7c00-428f-937b-200c1d0b8ae0"} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:53.144094 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1dc6fa0d-7c55-4a5f-a309-d71f18568b8b tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:53.144953 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1dc6fa0d-7c55-4a5f-a309-d71f18568b8b tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] [instance: 05f6d43e-7e1a-47b1-901e-30ecf12e39cc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:53.162658 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1dc6fa0d-7c55-4a5f-a309-d71f18568b8b tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:53.164356 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1dc6fa0d-7c55-4a5f-a309-d71f18568b8b tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:53.166202 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1dc6fa0d-7c55-4a5f-a309-d71f18568b8b tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:53.166654 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1dc6fa0d-7c55-4a5f-a309-d71f18568b8b tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:53.577955 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1dc6fa0d-7c55-4a5f-a309-d71f18568b8b tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0460c29101ce4965aec21238001e4698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9132021d1e124022b4fb79bacb8bdff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:53.591056 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1dc6fa0d-7c55-4a5f-a309-d71f18568b8b tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] 10.222.0.27 "GET /compute/v2.1/servers/05f6d43e-7e1a-47b1-901e-30ecf12e39cc" status: 200 len: 1314 microversion: 2.1 time: 0.451831 Jun 20 12:00:53.601695 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 554/1077] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:53 2022] GET /compute/v2.1/servers/05f6d43e-7e1a-47b1-901e-30ecf12e39cc => generated 1314 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:54.607537 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ed1000a6-1e85-495c-b7c9-f81da345ca0b tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:54.608385 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ed1000a6-1e85-495c-b7c9-f81da345ca0b tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] [instance: 05f6d43e-7e1a-47b1-901e-30ecf12e39cc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:54.644300 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed1000a6-1e85-495c-b7c9-f81da345ca0b tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:54.645033 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed1000a6-1e85-495c-b7c9-f81da345ca0b tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:54.648046 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed1000a6-1e85-495c-b7c9-f81da345ca0b tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:54.650683 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed1000a6-1e85-495c-b7c9-f81da345ca0b tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:55.014319 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ed1000a6-1e85-495c-b7c9-f81da345ca0b tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0460c29101ce4965aec21238001e4698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9132021d1e124022b4fb79bacb8bdff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:55.027680 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ed1000a6-1e85-495c-b7c9-f81da345ca0b tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] 10.222.0.27 "GET /compute/v2.1/servers/05f6d43e-7e1a-47b1-901e-30ecf12e39cc" status: 200 len: 1314 microversion: 2.1 time: 0.424157 Jun 20 12:00:55.041270 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 555/1078] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:54 2022] GET /compute/v2.1/servers/05f6d43e-7e1a-47b1-901e-30ecf12e39cc => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:56.164716 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4d76022b-6bd0-48f5-a6c7-5aac557428aa tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.494361 Jun 20 12:00:56.165652 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 524/1079] 10.222.0.27 () {60 vars in 1169 bytes} [Mon Jun 20 12:00:52 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:00:56.175026 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1b1f385a-8331-4f9c-912d-455df30e62b2 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:56.175888 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1b1f385a-8331-4f9c-912d-455df30e62b2 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] [instance: 05f6d43e-7e1a-47b1-901e-30ecf12e39cc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:56.193853 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1b1f385a-8331-4f9c-912d-455df30e62b2 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:56.194512 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1b1f385a-8331-4f9c-912d-455df30e62b2 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:56.195497 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1b1f385a-8331-4f9c-912d-455df30e62b2 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:56.196102 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1b1f385a-8331-4f9c-912d-455df30e62b2 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:56.358042 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6df27d42-ebd2-4a9b-9542-3d4d435f01a0 tempest-AZV2TestJSON-390676835 tempest-AZV2TestJSON-390676835-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:56.362559 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6df27d42-ebd2-4a9b-9542-3d4d435f01a0 tempest-AZV2TestJSON-390676835 tempest-AZV2TestJSON-390676835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:56.363385 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6df27d42-ebd2-4a9b-9542-3d4d435f01a0 tempest-AZV2TestJSON-390676835 tempest-AZV2TestJSON-390676835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:56.364962 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6df27d42-ebd2-4a9b-9542-3d4d435f01a0 tempest-AZV2TestJSON-390676835 tempest-AZV2TestJSON-390676835-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:56.365741 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6df27d42-ebd2-4a9b-9542-3d4d435f01a0 tempest-AZV2TestJSON-390676835 tempest-AZV2TestJSON-390676835-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:56.448792 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6df27d42-ebd2-4a9b-9542-3d4d435f01a0 tempest-AZV2TestJSON-390676835 tempest-AZV2TestJSON-390676835-project] 10.222.0.27 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.592016 Jun 20 12:00:56.450653 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 556/1080] 10.222.0.27 () {58 vars in 1163 bytes} [Mon Jun 20 12:00:55 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:00:56.475414 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f989668a-4e39-461b-9c2a-179ea5712fd5 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Action: 'action', calling method: .version_select at 0x7f6082d353a0>, body: {"addFloatingIp": {"address": "172.35.2.199"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:56.481233 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f989668a-4e39-461b-9c2a-179ea5712fd5 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] [instance: a06342ec-4969-4552-a343-aefc73138aa1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:56.496722 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f989668a-4e39-461b-9c2a-179ea5712fd5 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:56.498016 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f989668a-4e39-461b-9c2a-179ea5712fd5 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:56.500575 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f989668a-4e39-461b-9c2a-179ea5712fd5 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:56.501920 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f989668a-4e39-461b-9c2a-179ea5712fd5 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:56.584807 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1b1f385a-8331-4f9c-912d-455df30e62b2 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0460c29101ce4965aec21238001e4698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9132021d1e124022b4fb79bacb8bdff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:56.603340 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1b1f385a-8331-4f9c-912d-455df30e62b2 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] 10.222.0.27 "GET /compute/v2.1/servers/05f6d43e-7e1a-47b1-901e-30ecf12e39cc" status: 200 len: 1314 microversion: 2.1 time: 0.436145 Jun 20 12:00:56.604608 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 525/1081] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:56 2022] GET /compute/v2.1/servers/05f6d43e-7e1a-47b1-901e-30ecf12e39cc => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:56.658603 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f989668a-4e39-461b-9c2a-179ea5712fd5 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Acquired lock "refresh_cache-a06342ec-4969-4552-a343-aefc73138aa1" {{(pid=119128) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 20 12:00:56.724749 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-5e4fecdf-13de-4ff5-ab78-8d41fa5faea5 req-2a8b01ae-021c-46a4-8c30-57b9708d1967 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05f6d43e-7e1a-47b1-901e-30ecf12e39cc", "name": "network-vif-plugged", "status": "completed", "tag": "f9dd358c-52c3-411f-bce5-44c933209e47"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:56.736690 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-5e4fecdf-13de-4ff5-ab78-8d41fa5faea5 req-2a8b01ae-021c-46a4-8c30-57b9708d1967 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:56.737493 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-5e4fecdf-13de-4ff5-ab78-8d41fa5faea5 req-2a8b01ae-021c-46a4-8c30-57b9708d1967 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:56.762182 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:00:56.771116 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-5e4fecdf-13de-4ff5-ab78-8d41fa5faea5 req-2a8b01ae-021c-46a4-8c30-57b9708d1967 service nova] Creating event network-vif-plugged:f9dd358c-52c3-411f-bce5-44c933209e47 for instance 05f6d43e-7e1a-47b1-901e-30ecf12e39cc on n-h2-master-1 Jun 20 12:00:56.787724 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-5e4fecdf-13de-4ff5-ab78-8d41fa5faea5 req-2a8b01ae-021c-46a4-8c30-57b9708d1967 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070092 Jun 20 12:00:56.791267 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 526/1082] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:00:57.624531 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c57419db-108b-43ba-a761-7e153be2848b tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:57.625568 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c57419db-108b-43ba-a761-7e153be2848b tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] [instance: 05f6d43e-7e1a-47b1-901e-30ecf12e39cc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:57.654252 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c57419db-108b-43ba-a761-7e153be2848b tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:57.656403 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c57419db-108b-43ba-a761-7e153be2848b tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:57.657562 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c57419db-108b-43ba-a761-7e153be2848b tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:57.661058 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c57419db-108b-43ba-a761-7e153be2848b tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:58.157529 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c57419db-108b-43ba-a761-7e153be2848b tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0460c29101ce4965aec21238001e4698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9132021d1e124022b4fb79bacb8bdff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:58.196459 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c57419db-108b-43ba-a761-7e153be2848b tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] 10.222.0.27 "GET /compute/v2.1/servers/05f6d43e-7e1a-47b1-901e-30ecf12e39cc" status: 200 len: 1314 microversion: 2.1 time: 0.577066 Jun 20 12:00:58.253871 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 527/1083] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:57 2022] GET /compute/v2.1/servers/05f6d43e-7e1a-47b1-901e-30ecf12e39cc => generated 1314 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:00:58.687422 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-11dd8933-8142-4ffb-8f49-4d93f90e0208 tempest-FlavorMetadataValidation-24442179 tempest-FlavorMetadataValidation-24442179-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-2103768698", "id": 1898616476, "os-flavor-access:is_public": "True"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:58.699607 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:00:58.699607 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 12:00:58.732893 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-11dd8933-8142-4ffb-8f49-4d93f90e0208 tempest-FlavorMetadataValidation-24442179 tempest-FlavorMetadataValidation-24442179-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.473953 Jun 20 12:00:58.736424 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 528/1084] 10.222.0.27 () {62 vars in 1187 bytes} [Mon Jun 20 12:00:58 2022] POST /compute/v2.1/flavors => generated 471 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:00:58.777595 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0ebc3a0f-7bbf-4984-9aa8-7bd1ddc119b3 tempest-FlavorMetadataValidation-24442179 tempest-FlavorMetadataValidation-24442179-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:00:58.780117 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:00:58.780117 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 12:00:59.134963 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0ebc3a0f-7bbf-4984-9aa8-7bd1ddc119b3 tempest-FlavorMetadataValidation-24442179 tempest-FlavorMetadataValidation-24442179-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1898616476/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.380779 Jun 20 12:00:59.136349 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 529/1085] 10.222.0.27 () {62 vars in 1264 bytes} [Mon Jun 20 12:00:58 2022] POST /compute/v2.1/flavors/1898616476/os-extra_specs => generated 62 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:00:59.153390 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0966a56e-f650-4dcf-9c84-3ddd485d4c0d tempest-FlavorMetadataValidation-24442179 tempest-FlavorMetadataValidation-24442179-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:59.154232 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:00:59.154232 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 12:00:59.192858 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0966a56e-f650-4dcf-9c84-3ddd485d4c0d tempest-FlavorMetadataValidation-24442179 tempest-FlavorMetadataValidation-24442179-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1898616476" status: 202 len: 0 microversion: 2.86 time: 0.048267 Jun 20 12:00:59.193445 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 530/1086] 10.222.0.27 () {60 vars in 1201 bytes} [Mon Jun 20 12:00:59 2022] DELETE /compute/v2.1/flavors/1898616476 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:00:59.208927 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f1c883c4-30fb-4126-ac01-d4a9321ed56f tempest-FlavorMetadataValidation-24442179 tempest-FlavorMetadataValidation-24442179-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:59.261971 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f1c883c4-30fb-4126-ac01-d4a9321ed56f tempest-FlavorMetadataValidation-24442179 tempest-FlavorMetadataValidation-24442179-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.063901 Jun 20 12:00:59.263096 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 531/1087] 10.222.0.27 () {60 vars in 1186 bytes} [Mon Jun 20 12:00:59 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:00:59.269538 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dab46486-ab65-41d8-a619-e7b8a159508b tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:00:59.270460 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dab46486-ab65-41d8-a619-e7b8a159508b tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] [instance: 05f6d43e-7e1a-47b1-901e-30ecf12e39cc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:00:59.325269 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dab46486-ab65-41d8-a619-e7b8a159508b tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:59.326337 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dab46486-ab65-41d8-a619-e7b8a159508b tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:59.328062 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dab46486-ab65-41d8-a619-e7b8a159508b tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:00:59.328693 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dab46486-ab65-41d8-a619-e7b8a159508b tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:00:59.695826 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dab46486-ab65-41d8-a619-e7b8a159508b tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0460c29101ce4965aec21238001e4698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9132021d1e124022b4fb79bacb8bdff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:00:59.719425 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dab46486-ab65-41d8-a619-e7b8a159508b tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] 10.222.0.27 "GET /compute/v2.1/servers/05f6d43e-7e1a-47b1-901e-30ecf12e39cc" status: 200 len: 1464 microversion: 2.1 time: 0.454447 Jun 20 12:00:59.720452 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 532/1088] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:00:59 2022] GET /compute/v2.1/servers/05f6d43e-7e1a-47b1-901e-30ecf12e39cc => generated 1464 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:01:00.278734 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ecf1c606-3588-4a63-a3bd-13ae5e22669d tempest-TenantUsagesTestJSON-6289042 tempest-TenantUsagesTestJSON-6289042-project-admin] Calling method '.version_select at 0x7f60736b83a0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:00.306667 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-f989668a-4e39-461b-9c2a-179ea5712fd5 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] [instance: a06342ec-4969-4552-a343-aefc73138aa1] Building network info cache for instance {{(pid=119128) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 20 12:01:00.336790 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ecf1c606-3588-4a63-a3bd-13ae5e22669d tempest-TenantUsagesTestJSON-6289042 tempest-TenantUsagesTestJSON-6289042-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:00.337240 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ecf1c606-3588-4a63-a3bd-13ae5e22669d tempest-TenantUsagesTestJSON-6289042 tempest-TenantUsagesTestJSON-6289042-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:00.418826 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ecf1c606-3588-4a63-a3bd-13ae5e22669d tempest-TenantUsagesTestJSON-6289042 tempest-TenantUsagesTestJSON-6289042-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:00.421886 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ecf1c606-3588-4a63-a3bd-13ae5e22669d tempest-TenantUsagesTestJSON-6289042 tempest-TenantUsagesTestJSON-6289042-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:00.488595 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ecf1c606-3588-4a63-a3bd-13ae5e22669d tempest-TenantUsagesTestJSON-6289042 tempest-TenantUsagesTestJSON-6289042-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/9132021d1e124022b4fb79bacb8bdff4?start=2022-06-19T12%3A00%3A59.729754&end=2022-06-21T12%3A00%3A59.729754" status: 200 len: 695 microversion: 2.1 time: 0.754797 Jun 20 12:01:00.489775 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 533/1089] 10.222.0.27 () {58 vars in 1411 bytes} [Mon Jun 20 12:00:59 2022] GET /compute/v2.1/os-simple-tenant-usage/9132021d1e124022b4fb79bacb8bdff4?start=2022-06-19T12%3A00%3A59.729754&end=2022-06-21T12%3A00%3A59.729754 => generated 695 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:01:00.495805 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-f531cafa-4850-4ed1-8d8b-a5414aedadc7 req-dfc02eb5-e948-455d-8137-f5357b8bfebf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a06342ec-4969-4552-a343-aefc73138aa1", "tag": "16e6c137-ef3b-42fb-9ac9-913d43c2af22"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:01:00.511482 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-f531cafa-4850-4ed1-8d8b-a5414aedadc7 req-dfc02eb5-e948-455d-8137-f5357b8bfebf service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:00.512140 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-f531cafa-4850-4ed1-8d8b-a5414aedadc7 req-dfc02eb5-e948-455d-8137-f5357b8bfebf service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:00.569984 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-f531cafa-4850-4ed1-8d8b-a5414aedadc7 req-dfc02eb5-e948-455d-8137-f5357b8bfebf service nova] Creating event network-changed:16e6c137-ef3b-42fb-9ac9-913d43c2af22 for instance a06342ec-4969-4552-a343-aefc73138aa1 on n-h1-master-1 Jun 20 12:01:00.602251 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-f531cafa-4850-4ed1-8d8b-a5414aedadc7 req-dfc02eb5-e948-455d-8137-f5357b8bfebf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108138 Jun 20 12:01:00.612108 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 534/1090] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:01:00.631736 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7d7bad0e-bf4b-40e0-9f97-996ee2582d0a tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Calling method '.version_select at 0x7f6073728670>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:00.654539 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7d7bad0e-bf4b-40e0-9f97-996ee2582d0a tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:00.654992 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7d7bad0e-bf4b-40e0-9f97-996ee2582d0a tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:00.670200 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7d7bad0e-bf4b-40e0-9f97-996ee2582d0a tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:00.670726 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7d7bad0e-bf4b-40e0-9f97-996ee2582d0a tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:00.703073 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7d7bad0e-bf4b-40e0-9f97-996ee2582d0a tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/9132021d1e124022b4fb79bacb8bdff4?start=2022-06-19T12%3A00%3A59.729754&end=2022-06-21T12%3A00%3A59.729754" status: 200 len: 695 microversion: 2.1 time: 0.086866 Jun 20 12:01:00.712342 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 535/1091] 10.222.0.27 () {58 vars in 1411 bytes} [Mon Jun 20 12:01:00 2022] GET /compute/v2.1/os-simple-tenant-usage/9132021d1e124022b4fb79bacb8bdff4?start=2022-06-19T12%3A00%3A59.729754&end=2022-06-21T12%3A00%3A59.729754 => generated 695 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:01:00.741990 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bf4e652f-32bd-4962-9d1b-e3e7b24b5209 tempest-TenantUsagesTestJSON-6289042 tempest-TenantUsagesTestJSON-6289042-project-admin] Calling method '.version_select at 0x7f6073737e50>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:00.777142 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf4e652f-32bd-4962-9d1b-e3e7b24b5209 tempest-TenantUsagesTestJSON-6289042 tempest-TenantUsagesTestJSON-6289042-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:00.783680 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf4e652f-32bd-4962-9d1b-e3e7b24b5209 tempest-TenantUsagesTestJSON-6289042 tempest-TenantUsagesTestJSON-6289042-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:00.842309 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf4e652f-32bd-4962-9d1b-e3e7b24b5209 tempest-TenantUsagesTestJSON-6289042 tempest-TenantUsagesTestJSON-6289042-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:00.843401 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf4e652f-32bd-4962-9d1b-e3e7b24b5209 tempest-TenantUsagesTestJSON-6289042 tempest-TenantUsagesTestJSON-6289042-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:00.947763 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bf4e652f-32bd-4962-9d1b-e3e7b24b5209 tempest-TenantUsagesTestJSON-6289042 tempest-TenantUsagesTestJSON-6289042-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-19T12%3A00%3A59.729754&end=2022-06-21T12%3A00%3A59.729754&detailed=1" status: 200 len: 14128 microversion: 2.1 time: 0.228298 Jun 20 12:01:00.960995 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 536/1092] 10.222.0.27 () {58 vars in 1334 bytes} [Mon Jun 20 12:01:00 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-19T12%3A00%3A59.729754&end=2022-06-21T12%3A00%3A59.729754&detailed=1 => generated 14128 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:01:00.981392 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d11dd769-6ca9-4e09-a5a2-ca8557f3ea05 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Action: 'create', calling method: .version_select at 0x7f60736baa60>, body: {"keypair": {"name": "tempest-keypair-1945698217", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIVs8Me+ZLJpenjRgiYXfh3B7/bN9tuhFEvIb/Vq9SCYUgE8Vnv9lusLvAhQ7gyQw78Bdesj7PZD3wbkRsl5kKpU49eYu5AXhFqsGE/Yhaeh3j8xswhXUALG9oKLhuU8Q=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:01:01.102885 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-d11dd769-6ca9-4e09-a5a2-ca8557f3ea05 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Getting quotas for project d0f00ab2137741e781c812172c3642b3. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:01:01.143114 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-d11dd769-6ca9-4e09-a5a2-ca8557f3ea05 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Getting quotas for user e233a90ea23c44468b93a9316739f642 and project d0f00ab2137741e781c812172c3642b3. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:01:01.247861 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d11dd769-6ca9-4e09-a5a2-ca8557f3ea05 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.285174 Jun 20 12:01:01.249976 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 537/1093] 10.222.0.27 () {62 vars in 1199 bytes} [Mon Jun 20 12:01:00 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 288 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 20 12:01:01.258422 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7227bb17-eb55-4486-9eda-06172e53f1e6 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:01.259737 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7227bb17-eb55-4486-9eda-06172e53f1e6 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] [instance: 05f6d43e-7e1a-47b1-901e-30ecf12e39cc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:01.271494 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7227bb17-eb55-4486-9eda-06172e53f1e6 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:01.272278 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7227bb17-eb55-4486-9eda-06172e53f1e6 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:01.279721 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7227bb17-eb55-4486-9eda-06172e53f1e6 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:01.280914 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7227bb17-eb55-4486-9eda-06172e53f1e6 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:01.325479 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7227bb17-eb55-4486-9eda-06172e53f1e6 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] [instance: 05f6d43e-7e1a-47b1-901e-30ecf12e39cc] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:01:01.478716 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7227bb17-eb55-4486-9eda-06172e53f1e6 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] 10.222.0.27 "DELETE /compute/v2.1/servers/05f6d43e-7e1a-47b1-901e-30ecf12e39cc" status: 204 len: 0 microversion: 2.1 time: 0.224009 Jun 20 12:01:01.481400 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 538/1094] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:01:01 2022] DELETE /compute/v2.1/servers/05f6d43e-7e1a-47b1-901e-30ecf12e39cc => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:01:01.496454 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-de448c73-f110-41c1-9780-70bcb4816758 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:01.501626 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-de448c73-f110-41c1-9780-70bcb4816758 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] [instance: 05f6d43e-7e1a-47b1-901e-30ecf12e39cc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:01.517703 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-de448c73-f110-41c1-9780-70bcb4816758 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:01.518901 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-de448c73-f110-41c1-9780-70bcb4816758 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:01.522503 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-de448c73-f110-41c1-9780-70bcb4816758 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:01.523941 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-de448c73-f110-41c1-9780-70bcb4816758 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:01.801067 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-de448c73-f110-41c1-9780-70bcb4816758 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0460c29101ce4965aec21238001e4698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9132021d1e124022b4fb79bacb8bdff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:01.813051 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-de448c73-f110-41c1-9780-70bcb4816758 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] 10.222.0.27 "GET /compute/v2.1/servers/05f6d43e-7e1a-47b1-901e-30ecf12e39cc" status: 200 len: 1470 microversion: 2.1 time: 0.324843 Jun 20 12:01:01.814734 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 539/1095] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:01 2022] GET /compute/v2.1/servers/05f6d43e-7e1a-47b1-901e-30ecf12e39cc => generated 1470 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:01:02.412635 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8543d8a2-c774-41bc-b07b-8b391574d4a5 tempest-VolumesAdminNegativeTest-1650635258 tempest-VolumesAdminNegativeTest-1650635258-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "40f99786-68f2-470e-9bce-b74c500fc61c"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:01:02.421921 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8543d8a2-c774-41bc-b07b-8b391574d4a5 tempest-VolumesAdminNegativeTest-1650635258 tempest-VolumesAdminNegativeTest-1650635258-project-admin] [instance: 3c12363c-ee46-445d-af50-77a1f0518a17] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:02.437804 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8543d8a2-c774-41bc-b07b-8b391574d4a5 tempest-VolumesAdminNegativeTest-1650635258 tempest-VolumesAdminNegativeTest-1650635258-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:02.439694 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8543d8a2-c774-41bc-b07b-8b391574d4a5 tempest-VolumesAdminNegativeTest-1650635258 tempest-VolumesAdminNegativeTest-1650635258-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:02.442458 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8543d8a2-c774-41bc-b07b-8b391574d4a5 tempest-VolumesAdminNegativeTest-1650635258 tempest-VolumesAdminNegativeTest-1650635258-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:02.446710 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8543d8a2-c774-41bc-b07b-8b391574d4a5 tempest-VolumesAdminNegativeTest-1650635258 tempest-VolumesAdminNegativeTest-1650635258-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:02.477911 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-f989668a-4e39-461b-9c2a-179ea5712fd5 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] [instance: a06342ec-4969-4552-a343-aefc73138aa1] Updating instance_info_cache with network_info: [{"id": "16e6c137-ef3b-42fb-9ac9-913d43c2af22", "address": "fa:16:3e:05:75:0d", "network": {"id": "5bb6175f-cf24-43c6-9d27-54937f852000", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-90489678-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.2.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2b350a5088d64f94bc850fc1b423cf2d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap16e6c137-ef", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119128) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 20 12:01:02.502880 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f989668a-4e39-461b-9c2a-179ea5712fd5 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Releasing lock "refresh_cache-a06342ec-4969-4552-a343-aefc73138aa1" {{(pid=119128) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 20 12:01:02.503852 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f989668a-4e39-461b-9c2a-179ea5712fd5 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] 10.222.0.27 "POST /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1/action" status: 202 len: 0 microversion: 2.1 time: 6.051505 Jun 20 12:01:02.505916 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 557/1096] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:00:56 2022] POST /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1/action => generated 0 bytes in 6054 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 20 12:01:02.514059 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ea0e72a2-9b5d-44f1-b65f-e77415fcb588 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Action: 'create', calling method: .version_select at 0x7f6073b13670>, body: {"pool": "3ed3a8e4-7c00-428f-937b-200c1d0b8ae0"} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:01:02.973048 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-8543d8a2-c774-41bc-b07b-8b391574d4a5 tempest-VolumesAdminNegativeTest-1650635258 tempest-VolumesAdminNegativeTest-1650635258-project-admin] HTTP exception thrown: Volume 40f99786-68f2-470e-9bce-b74c500fc61c could not be found. Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8543d8a2-c774-41bc-b07b-8b391574d4a5 tempest-VolumesAdminNegativeTest-1650635258 tempest-VolumesAdminNegativeTest-1650635258-project-admin] Request method failure captured: Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: request: PUT /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17/os-volume_attachments/c4cf6c5f-ba0e-479f-a06e-ed4077e0260b HTTP/1.1 Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 74 Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGEY8NcazffjFVF-ZxS_uy66FDhiKPgFg_dFaQBp0mjl4HblpVugpUGOFES-xGWovVUpC0xC2D8xdrPQWlrKqxB6iAI2rvyBtZxJsxBB1N1evRRXiDXjwGHp7IKjsED6bogT5gq4JQwLtdobuLbeJU9w9-HJvYn54sjBhenfavdMXn4 Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 9ff893063bf94753b94aebf9aaa32072 Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-VolumesAdminNegativeTest-1650635258 Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member,admin Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member,admin Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9ff893063bf94753b94aebf9aaa32072"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9ff893063bf94753b94aebf9aaa32072"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9ff893063bf94753b94aebf9aaa32072"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9ff893063bf94753b94aebf9aaa32072"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-VolumesAdminNegativeTest-1650635258 Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 9ff893063bf94753b94aebf9aaa32072 Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1650635258 Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-VolumesAdminNegativeTest-1650635258-project-admin Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: e88a910aeeaa4892927e635f9a2a6d4c Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-VolumesAdminNegativeTest-1650635258-project-admin Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: {"volumeAttachment": {"volumeId": "40f99786-68f2-470e-9bce-b74c500fc61c"}} Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: exception: Volume 40f99786-68f2-470e-9bce-b74c500fc61c could not be found. Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: action_args: {'server_id': '3c12363c-ee46-445d-af50-77a1f0518a17', 'id': 'c4cf6c5f-ba0e-479f-a06e-ed4077e0260b', 'body': {'volumeAttachment': {'volumeId': '40f99786-68f2-470e-9bce-b74c500fc61c'}}} Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 40f99786-68f2-470e-9bce-b74c500fc61c could not be found. (HTTP 404) (Request-ID: req-794f9f90-35ec-4281-ad1f-b3348f37fde5) Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 12:01:03.030073 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 40f99786-68f2-470e-9bce-b74c500fc61c could not be found. Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 40f99786-68f2-470e-9bce-b74c500fc61c could not be found. Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 40f99786-68f2-470e-9bce-b74c500fc61c could not be found. Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8543d8a2-c774-41bc-b07b-8b391574d4a5 tempest-VolumesAdminNegativeTest-1650635258 tempest-VolumesAdminNegativeTest-1650635258-project-admin] Returning 400 to user: Volume 40f99786-68f2-470e-9bce-b74c500fc61c could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8543d8a2-c774-41bc-b07b-8b391574d4a5 tempest-VolumesAdminNegativeTest-1650635258 tempest-VolumesAdminNegativeTest-1650635258-project-admin] 10.222.0.27 "PUT /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17/os-volume_attachments/c4cf6c5f-ba0e-479f-a06e-ed4077e0260b" status: 400 len: 107 microversion: 2.1 time: 1.215748 Jun 20 12:01:03.040035 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 540/1097] 10.222.0.27 () {60 vars in 1432 bytes} [Mon Jun 20 12:01:01 2022] PUT /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17/os-volume_attachments/c4cf6c5f-ba0e-479f-a06e-ed4077e0260b => generated 107 bytes in 1218 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:01:03.051331 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-04c59721-2c0c-4a95-869d-73facc58858b tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:03.051331 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-04c59721-2c0c-4a95-869d-73facc58858b tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] [instance: 05f6d43e-7e1a-47b1-901e-30ecf12e39cc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:03.065994 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-04c59721-2c0c-4a95-869d-73facc58858b tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:03.066564 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-04c59721-2c0c-4a95-869d-73facc58858b tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:03.073520 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-04c59721-2c0c-4a95-869d-73facc58858b tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:03.075375 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-04c59721-2c0c-4a95-869d-73facc58858b tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:03.597473 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-04c59721-2c0c-4a95-869d-73facc58858b tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0460c29101ce4965aec21238001e4698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9132021d1e124022b4fb79bacb8bdff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:03.611911 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-04c59721-2c0c-4a95-869d-73facc58858b tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] 10.222.0.27 "GET /compute/v2.1/servers/05f6d43e-7e1a-47b1-901e-30ecf12e39cc" status: 200 len: 1470 microversion: 2.1 time: 0.577654 Jun 20 12:01:03.612543 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 541/1098] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:03 2022] GET /compute/v2.1/servers/05f6d43e-7e1a-47b1-901e-30ecf12e39cc => generated 1470 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:01:03.626981 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9b31557d-58a1-43ac-be0f-3dac8a84dbea tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:03.632888 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9b31557d-58a1-43ac-be0f-3dac8a84dbea tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 3c12363c-ee46-445d-af50-77a1f0518a17] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:03.646568 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b31557d-58a1-43ac-be0f-3dac8a84dbea tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:03.652042 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b31557d-58a1-43ac-be0f-3dac8a84dbea tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:03.653362 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b31557d-58a1-43ac-be0f-3dac8a84dbea tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:03.663843 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b31557d-58a1-43ac-be0f-3dac8a84dbea tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:04.028905 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-9b31557d-58a1-43ac-be0f-3dac8a84dbea tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lazy-loading 'services' on Instance uuid 3c12363c-ee46-445d-af50-77a1f0518a17 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:01:04.317902 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9b31557d-58a1-43ac-be0f-3dac8a84dbea tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17/os-volume_attachments/c4cf6c5f-ba0e-479f-a06e-ed4077e0260b" status: 202 len: 0 microversion: 2.1 time: 0.694573 Jun 20 12:01:04.322065 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 542/1099] 10.222.0.27 () {58 vars in 1415 bytes} [Mon Jun 20 12:01:03 2022] DELETE /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17/os-volume_attachments/c4cf6c5f-ba0e-479f-a06e-ed4077e0260b => generated 0 bytes in 700 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:01:04.332186 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bfd7c7d8-6037-41d4-a030-1f40e309179d tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:04.336793 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bfd7c7d8-6037-41d4-a030-1f40e309179d tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 3c12363c-ee46-445d-af50-77a1f0518a17] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:04.356589 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bfd7c7d8-6037-41d4-a030-1f40e309179d tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:04.357469 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bfd7c7d8-6037-41d4-a030-1f40e309179d tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:04.358769 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bfd7c7d8-6037-41d4-a030-1f40e309179d tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:04.359576 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bfd7c7d8-6037-41d4-a030-1f40e309179d tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:04.431619 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bfd7c7d8-6037-41d4-a030-1f40e309179d tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104874 Jun 20 12:01:04.440296 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 543/1100] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:01:04 2022] GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:01:04.629265 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-16381999-3159-46d5-b06f-351451cff1af tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:04.630280 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-16381999-3159-46d5-b06f-351451cff1af tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] [instance: 05f6d43e-7e1a-47b1-901e-30ecf12e39cc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:04.648161 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-16381999-3159-46d5-b06f-351451cff1af tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:04.648846 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-16381999-3159-46d5-b06f-351451cff1af tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:04.649846 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-16381999-3159-46d5-b06f-351451cff1af tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:04.650294 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-16381999-3159-46d5-b06f-351451cff1af tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:05.243566 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-16381999-3159-46d5-b06f-351451cff1af tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0460c29101ce4965aec21238001e4698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9132021d1e124022b4fb79bacb8bdff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:05.260854 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-16381999-3159-46d5-b06f-351451cff1af tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] 10.222.0.27 "GET /compute/v2.1/servers/05f6d43e-7e1a-47b1-901e-30ecf12e39cc" status: 200 len: 1470 microversion: 2.1 time: 0.633148 Jun 20 12:01:05.261511 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 544/1101] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:04 2022] GET /compute/v2.1/servers/05f6d43e-7e1a-47b1-901e-30ecf12e39cc => generated 1470 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:01:05.301587 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-2a64f0e2-2d7b-43d5-8ec3-db9e649b92df req-a8017675-a3e0-4dbe-a80b-a390124ea91d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05f6d43e-7e1a-47b1-901e-30ecf12e39cc", "name": "network-vif-deleted", "tag": "f9dd358c-52c3-411f-bce5-44c933209e47"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:01:05.319593 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-2a64f0e2-2d7b-43d5-8ec3-db9e649b92df req-a8017675-a3e0-4dbe-a80b-a390124ea91d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:05.320041 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-2a64f0e2-2d7b-43d5-8ec3-db9e649b92df req-a8017675-a3e0-4dbe-a80b-a390124ea91d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:05.350253 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-2a64f0e2-2d7b-43d5-8ec3-db9e649b92df req-a8017675-a3e0-4dbe-a80b-a390124ea91d service nova] Creating event network-vif-deleted:f9dd358c-52c3-411f-bce5-44c933209e47 for instance 05f6d43e-7e1a-47b1-901e-30ecf12e39cc on n-h2-master-1 Jun 20 12:01:05.366050 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-2a64f0e2-2d7b-43d5-8ec3-db9e649b92df req-a8017675-a3e0-4dbe-a80b-a390124ea91d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068101 Jun 20 12:01:05.367345 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 545/1102] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:01:05.449140 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bc3b945b-9054-4a94-a9e1-7dca61cc6c48 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:05.450230 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bc3b945b-9054-4a94-a9e1-7dca61cc6c48 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 3c12363c-ee46-445d-af50-77a1f0518a17] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:05.471339 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc3b945b-9054-4a94-a9e1-7dca61cc6c48 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:05.472002 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc3b945b-9054-4a94-a9e1-7dca61cc6c48 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:05.479338 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc3b945b-9054-4a94-a9e1-7dca61cc6c48 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:05.484194 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc3b945b-9054-4a94-a9e1-7dca61cc6c48 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:05.565925 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bc3b945b-9054-4a94-a9e1-7dca61cc6c48 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121830 Jun 20 12:01:05.568344 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 546/1103] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:01:05 2022] GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:01:06.294258 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-044982e9-535c-475e-8541-c5a66a7a2822 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:06.295009 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-044982e9-535c-475e-8541-c5a66a7a2822 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] [instance: 05f6d43e-7e1a-47b1-901e-30ecf12e39cc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:06.313947 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-044982e9-535c-475e-8541-c5a66a7a2822 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:06.314559 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-044982e9-535c-475e-8541-c5a66a7a2822 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:06.315559 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-044982e9-535c-475e-8541-c5a66a7a2822 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:06.325986 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-044982e9-535c-475e-8541-c5a66a7a2822 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:06.367336 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-044982e9-535c-475e-8541-c5a66a7a2822 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] HTTP exception thrown: Instance 05f6d43e-7e1a-47b1-901e-30ecf12e39cc could not be found. Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-044982e9-535c-475e-8541-c5a66a7a2822 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Request method failure captured: Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/05f6d43e-7e1a-47b1-901e-30ecf12e39cc HTTP/1.1 Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGFmXw-Q847IOtfja-ahRvl5cYtcsHDu8tIvVlDXWtRiTYISRgccNMRphIyFzd7r3eXolYoPhtktyHi_Q4dR9RRoZW6EPmYTEyFBdo10bPGksgC84oCJp5DLqmNR8yo8Az1YJpqlgaAj-FpxnNV8znuMJ7n9VSISgZSqT6IrDFzx2XE Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 9132021d1e124022b4fb79bacb8bdff4 Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-TenantUsagesTestJSON-294176087 Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9132021d1e124022b4fb79bacb8bdff4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9132021d1e124022b4fb79bacb8bdff4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9132021d1e124022b4fb79bacb8bdff4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9132021d1e124022b4fb79bacb8bdff4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-TenantUsagesTestJSON-294176087 Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 9132021d1e124022b4fb79bacb8bdff4 Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-TenantUsagesTestJSON-294176087 Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-TenantUsagesTestJSON-294176087-project Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 0460c29101ce4965aec21238001e4698 Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-TenantUsagesTestJSON-294176087-project Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 05f6d43e-7e1a-47b1-901e-30ecf12e39cc could not be found. Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '05f6d43e-7e1a-47b1-901e-30ecf12e39cc'} Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05f6d43e-7e1a-47b1-901e-30ecf12e39cc could not be found. Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05f6d43e-7e1a-47b1-901e-30ecf12e39cc could not be found. Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:06.369487 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:06.376995 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:06.376995 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:06.376995 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:06.376995 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:01:06.376995 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:01:06.376995 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05f6d43e-7e1a-47b1-901e-30ecf12e39cc could not be found. Jun 20 12:01:06.376995 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:06.384813 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-044982e9-535c-475e-8541-c5a66a7a2822 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] Returning 404 to user: Instance 05f6d43e-7e1a-47b1-901e-30ecf12e39cc could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:01:06.386651 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-044982e9-535c-475e-8541-c5a66a7a2822 tempest-TenantUsagesTestJSON-294176087 tempest-TenantUsagesTestJSON-294176087-project] 10.222.0.27 "GET /compute/v2.1/servers/05f6d43e-7e1a-47b1-901e-30ecf12e39cc" status: 404 len: 111 microversion: 2.1 time: 0.111212 Jun 20 12:01:06.387494 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 547/1104] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:06 2022] GET /compute/v2.1/servers/05f6d43e-7e1a-47b1-901e-30ecf12e39cc => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:01:06.390752 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:01:06.494199 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:01:06.579352 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d5148d59-606a-402b-b6cc-bbe9494013c7 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:06.581365 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d5148d59-606a-402b-b6cc-bbe9494013c7 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 3c12363c-ee46-445d-af50-77a1f0518a17] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:06.599291 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d5148d59-606a-402b-b6cc-bbe9494013c7 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:06.603652 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d5148d59-606a-402b-b6cc-bbe9494013c7 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:06.606255 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d5148d59-606a-402b-b6cc-bbe9494013c7 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:06.607359 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d5148d59-606a-402b-b6cc-bbe9494013c7 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:06.753872 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d5148d59-606a-402b-b6cc-bbe9494013c7 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.176123 Jun 20 12:01:06.756858 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 548/1105] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:01:06 2022] GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:01:06.955629 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ea0e72a2-9b5d-44f1-b65f-e77415fcb588 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.445601 Jun 20 12:01:06.956687 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 558/1106] 10.222.0.27 () {60 vars in 1169 bytes} [Mon Jun 20 12:01:02 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:01:06.975482 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-01ba360b-e17b-413a-b443-9d6a870eeee0 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Action: 'action', calling method: .version_select at 0x7f6082d3ba60>, body: {"addFloatingIp": {"address": "172.35.2.14"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:01:06.977703 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-01ba360b-e17b-413a-b443-9d6a870eeee0 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] [instance: a06342ec-4969-4552-a343-aefc73138aa1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:07.019023 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01ba360b-e17b-413a-b443-9d6a870eeee0 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:07.022298 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01ba360b-e17b-413a-b443-9d6a870eeee0 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:07.023429 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01ba360b-e17b-413a-b443-9d6a870eeee0 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:07.023984 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01ba360b-e17b-413a-b443-9d6a870eeee0 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:07.230844 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01ba360b-e17b-413a-b443-9d6a870eeee0 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Acquired lock "refresh_cache-a06342ec-4969-4552-a343-aefc73138aa1" {{(pid=119127) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 20 12:01:07.943252 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f33a46e2-2e3d-49b8-996c-57c0d7ba72c9 tempest-HypervisorAdminV253TestBase-645925516 tempest-HypervisorAdminV253TestBase-645925516-project-admin] Calling method '.version_select at 0x7f607375dca0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:07.947171 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:01:07.947171 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 12:01:07.964932 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f33a46e2-2e3d-49b8-996c-57c0d7ba72c9 tempest-HypervisorAdminV253TestBase-645925516 tempest-HypervisorAdminV253TestBase-645925516-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:07.966201 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f33a46e2-2e3d-49b8-996c-57c0d7ba72c9 tempest-HypervisorAdminV253TestBase-645925516 tempest-HypervisorAdminV253TestBase-645925516-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:08.016796 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f33a46e2-2e3d-49b8-996c-57c0d7ba72c9 tempest-HypervisorAdminV253TestBase-645925516 tempest-HypervisorAdminV253TestBase-645925516-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:08.018868 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f33a46e2-2e3d-49b8-996c-57c0d7ba72c9 tempest-HypervisorAdminV253TestBase-645925516 tempest-HypervisorAdminV253TestBase-645925516-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:08.101122 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f33a46e2-2e3d-49b8-996c-57c0d7ba72c9 tempest-HypervisorAdminV253TestBase-645925516 tempest-HypervisorAdminV253TestBase-645925516-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:08.101578 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f33a46e2-2e3d-49b8-996c-57c0d7ba72c9 tempest-HypervisorAdminV253TestBase-645925516 tempest-HypervisorAdminV253TestBase-645925516-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:08.142000 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f33a46e2-2e3d-49b8-996c-57c0d7ba72c9 tempest-HypervisorAdminV253TestBase-645925516 tempest-HypervisorAdminV253TestBase-645925516-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:08.144704 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f33a46e2-2e3d-49b8-996c-57c0d7ba72c9 tempest-HypervisorAdminV253TestBase-645925516 tempest-HypervisorAdminV253TestBase-645925516-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:08.188910 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f33a46e2-2e3d-49b8-996c-57c0d7ba72c9 tempest-HypervisorAdminV253TestBase-645925516 tempest-HypervisorAdminV253TestBase-645925516-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:08.189354 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f33a46e2-2e3d-49b8-996c-57c0d7ba72c9 tempest-HypervisorAdminV253TestBase-645925516 tempest-HypervisorAdminV253TestBase-645925516-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:08.198190 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f33a46e2-2e3d-49b8-996c-57c0d7ba72c9 tempest-HypervisorAdminV253TestBase-645925516 tempest-HypervisorAdminV253TestBase-645925516-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 2073 microversion: 2.53 time: 0.582212 Jun 20 12:01:08.210999 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 559/1107] 10.222.0.27 () {60 vars in 1242 bytes} [Mon Jun 20 12:01:07 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 2073 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:01:08.216441 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3a62b8ab-0a27-4991-8caa-704db62566bc tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:08.217629 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3a62b8ab-0a27-4991-8caa-704db62566bc tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 3c12363c-ee46-445d-af50-77a1f0518a17] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:08.225291 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3a62b8ab-0a27-4991-8caa-704db62566bc tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:08.226039 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3a62b8ab-0a27-4991-8caa-704db62566bc tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:08.227048 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3a62b8ab-0a27-4991-8caa-704db62566bc tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:08.227723 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3a62b8ab-0a27-4991-8caa-704db62566bc tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:08.276180 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3a62b8ab-0a27-4991-8caa-704db62566bc tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062992 Jun 20 12:01:08.277209 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 560/1108] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:01:08 2022] GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:01:08.282478 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-87e7fce6-4494-41f6-b9d7-ca19a11a5f84 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-806652085", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "cda138f2-888d-4c8e-8dea-c28cb64caf20"}, {"port": "47ca3986-e119-41f2-8d32-b4933a808468", "tag": "port-1"}, {"port": "f8436f92-9119-4a95-9ea8-7e547b5c7945", "tag": "port-2"}, {"uuid": "a8482225-b51b-4c26-9238-765a984eb9f0", "tag": "net-1"}, {"uuid": "a8482225-b51b-4c26-9238-765a984eb9f0"}, {"uuid": "4d2e5d59-8622-4428-962f-bd48ad9392c4", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "4d2e5d59-8622-4428-962f-bd48ad9392c4", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "1409bafe-dadb-4c1a-aea2-66df05e1aab0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "f6a7b73d-3afa-4e99-872f-f23c3eb1294b", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "c257e295-a1b4-4025-a16b-a31f298a243b", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--2075683331"}], "key_name": "tempest-keypair-1945698217", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:01:08.471272 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-87e7fce6-4494-41f6-b9d7-ca19a11a5f84 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] validate_networks() for [('cda138f2-888d-4c8e-8dea-c28cb64caf20', None, None, None, None, None), (None, None, '47ca3986-e119-41f2-8d32-b4933a808468', None, None, None), (None, None, 'f8436f92-9119-4a95-9ea8-7e547b5c7945', None, None, None), ('a8482225-b51b-4c26-9238-765a984eb9f0', None, None, None, None, None), ('a8482225-b51b-4c26-9238-765a984eb9f0', None, None, None, None, None), ('4d2e5d59-8622-4428-962f-bd48ad9392c4', '10.2.2.100', None, None, None, None), ('4d2e5d59-8622-4428-962f-bd48ad9392c4', '10.2.2.200', None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:01:09.061880 n-d-master-1 devstack@n-api.service[119127]: DEBUG neutronclient.v2_0.client [None req-01ba360b-e17b-413a-b443-9d6a870eeee0 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.2.14 (05d4d260-309a-4331-9594-e58466dc4264) with port 16e6c137-ef3b-42fb-9ac9-913d43c2af22 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 3ed3a8e4-7c00-428f-937b-200c1d0b8ae0.", "detail": ""}} {{(pid=119127) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 20 12:01:09.062762 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01ba360b-e17b-413a-b443-9d6a870eeee0 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Releasing lock "refresh_cache-a06342ec-4969-4552-a343-aefc73138aa1" {{(pid=119127) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 20 12:01:09.063092 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-01ba360b-e17b-413a-b443-9d6a870eeee0 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] HTTP exception thrown: Cannot associate floating IP 172.35.2.14 (05d4d260-309a-4331-9594-e58466dc4264) with port 16e6c137-ef3b-42fb-9ac9-913d43c2af22 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 3ed3a8e4-7c00-428f-937b-200c1d0b8ae0. Jun 20 12:01:09.063092 n-d-master-1 devstack@n-api.service[119127]: Neutron server returns request_ids: ['req-4cf19b92-fa7e-4dac-a5b6-d6a01116886b'] Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-01ba360b-e17b-413a-b443-9d6a870eeee0 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Request method failure captured: Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1/action HTTP/1.1 Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 45 Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGFeOSkjO7QVhq_kAlPPVwEuiohP1ogOf2CINEg2WlWjze0BpRIv0BAyw6GjRgi0Iq5i9osKBLbPM7Ft0vYO5-tKi43F0ZIsu9Cjxve6zq_YnTQ97L_e_4Uv4-RKsgcYAdfTF3-Me3SyT18SvLX7AAiH_JATl2e5UqUF44JkKbFiy38 Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 2b350a5088d64f94bc850fc1b423cf2d Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2b350a5088d64f94bc850fc1b423cf2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2b350a5088d64f94bc850fc1b423cf2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2b350a5088d64f94bc850fc1b423cf2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2b350a5088d64f94bc850fc1b423cf2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 2b350a5088d64f94bc850fc1b423cf2d Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: f9a5483adf06454cabe761d1c17e2732 Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: {"addFloatingIp": {"address": "172.35.2.14"}} Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: exception: Cannot associate floating IP 172.35.2.14 (05d4d260-309a-4331-9594-e58466dc4264) with port 16e6c137-ef3b-42fb-9ac9-913d43c2af22 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 3ed3a8e4-7c00-428f-937b-200c1d0b8ae0. Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: Neutron server returns request_ids: ['req-4cf19b92-fa7e-4dac-a5b6-d6a01116886b'] Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'a06342ec-4969-4552-a343-aefc73138aa1', 'body': {'addFloatingIp': {'address': '172.35.2.14'}}} Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 20 12:01:09.065533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.35.2.14 (05d4d260-309a-4331-9594-e58466dc4264) with port 16e6c137-ef3b-42fb-9ac9-913d43c2af22 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 3ed3a8e4-7c00-428f-937b-200c1d0b8ae0. Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4cf19b92-fa7e-4dac-a5b6-d6a01116886b'] Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.35.2.14 (05d4d260-309a-4331-9594-e58466dc4264) with port 16e6c137-ef3b-42fb-9ac9-913d43c2af22 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 3ed3a8e4-7c00-428f-937b-200c1d0b8ae0. Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4cf19b92-fa7e-4dac-a5b6-d6a01116886b'] Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.35.2.14 (05d4d260-309a-4331-9594-e58466dc4264) with port 16e6c137-ef3b-42fb-9ac9-913d43c2af22 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 3ed3a8e4-7c00-428f-937b-200c1d0b8ae0. Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4cf19b92-fa7e-4dac-a5b6-d6a01116886b'] Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.35.2.14 (05d4d260-309a-4331-9594-e58466dc4264) with port 16e6c137-ef3b-42fb-9ac9-913d43c2af22 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 3ed3a8e4-7c00-428f-937b-200c1d0b8ae0. Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4cf19b92-fa7e-4dac-a5b6-d6a01116886b'] Jun 20 12:01:09.074822 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:09.085441 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-01ba360b-e17b-413a-b443-9d6a870eeee0 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Returning 400 to user: Cannot associate floating IP 172.35.2.14 (05d4d260-309a-4331-9594-e58466dc4264) with port 16e6c137-ef3b-42fb-9ac9-913d43c2af22 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 3ed3a8e4-7c00-428f-937b-200c1d0b8ae0. Jun 20 12:01:09.085441 n-d-master-1 devstack@n-api.service[119127]: Neutron server returns request_ids: ['req-4cf19b92-fa7e-4dac-a5b6-d6a01116886b'] {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:01:09.085441 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-01ba360b-e17b-413a-b443-9d6a870eeee0 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] 10.222.0.27 "POST /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1/action" status: 400 len: 380 microversion: 2.1 time: 2.099657 Jun 20 12:01:09.085441 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 549/1109] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:01:06 2022] POST /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1/action => generated 380 bytes in 2101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:01:09.085441 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-aba851fe-a5c9-4b41-8234-343489558fd2 tempest-HypervisorAdminV253TestBase-645925516 tempest-HypervisorAdminV253TestBase-645925516-project-admin] Calling method '.version_select at 0x7f6073485a60>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:09.085441 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:01:09.085441 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 12:01:09.088085 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aba851fe-a5c9-4b41-8234-343489558fd2 tempest-HypervisorAdminV253TestBase-645925516 tempest-HypervisorAdminV253TestBase-645925516-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:09.088593 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aba851fe-a5c9-4b41-8234-343489558fd2 tempest-HypervisorAdminV253TestBase-645925516 tempest-HypervisorAdminV253TestBase-645925516-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:09.122846 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aba851fe-a5c9-4b41-8234-343489558fd2 tempest-HypervisorAdminV253TestBase-645925516 tempest-HypervisorAdminV253TestBase-645925516-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:09.124219 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aba851fe-a5c9-4b41-8234-343489558fd2 tempest-HypervisorAdminV253TestBase-645925516 tempest-HypervisorAdminV253TestBase-645925516-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:09.165335 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:01:09.177471 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aba851fe-a5c9-4b41-8234-343489558fd2 tempest-HypervisorAdminV253TestBase-645925516 tempest-HypervisorAdminV253TestBase-645925516-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:09.178176 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aba851fe-a5c9-4b41-8234-343489558fd2 tempest-HypervisorAdminV253TestBase-645925516 tempest-HypervisorAdminV253TestBase-645925516-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:09.197822 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aba851fe-a5c9-4b41-8234-343489558fd2 tempest-HypervisorAdminV253TestBase-645925516 tempest-HypervisorAdminV253TestBase-645925516-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:09.198710 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aba851fe-a5c9-4b41-8234-343489558fd2 tempest-HypervisorAdminV253TestBase-645925516 tempest-HypervisorAdminV253TestBase-645925516-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:09.230456 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:01:09.238813 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aba851fe-a5c9-4b41-8234-343489558fd2 tempest-HypervisorAdminV253TestBase-645925516 tempest-HypervisorAdminV253TestBase-645925516-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:09.239859 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aba851fe-a5c9-4b41-8234-343489558fd2 tempest-HypervisorAdminV253TestBase-645925516 tempest-HypervisorAdminV253TestBase-645925516-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:09.249010 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-aba851fe-a5c9-4b41-8234-343489558fd2 tempest-HypervisorAdminV253TestBase-645925516 tempest-HypervisorAdminV253TestBase-645925516-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 765 microversion: 2.53 time: 0.179629 Jun 20 12:01:09.250043 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 550/1110] 10.222.0.27 () {60 vars in 1221 bytes} [Mon Jun 20 12:01:09 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 765 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:01:09.265246 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6a99ee0f-fde8-4af8-9498-e1eaae8c1c88 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Calling method '.version_select at 0x7f607350de50>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:10.831490 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:01:11.166227 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=4 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:01:11.219295 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6a99ee0f-fde8-4af8-9498-e1eaae8c1c88 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/05d4d260-309a-4331-9594-e58466dc4264" status: 202 len: 0 microversion: 2.1 time: 1.958995 Jun 20 12:01:11.220115 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 551/1111] 10.222.0.27 () {58 vars in 1262 bytes} [Mon Jun 20 12:01:09 2022] DELETE /compute/v2.1/os-floating-ips/05d4d260-309a-4331-9594-e58466dc4264 => generated 0 bytes in 1961 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:01:11.235664 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3151b86c-f5e1-4f23-af9c-94161ce4524a tempest-HypervisorAdminV253TestBase-645925516 tempest-HypervisorAdminV253TestBase-645925516-project-admin] Calling method '.version_select at 0x7f6073485c10>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:11.237599 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:01:11.237599 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 12:01:11.240896 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3151b86c-f5e1-4f23-af9c-94161ce4524a tempest-HypervisorAdminV253TestBase-645925516 tempest-HypervisorAdminV253TestBase-645925516-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:11.241835 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3151b86c-f5e1-4f23-af9c-94161ce4524a tempest-HypervisorAdminV253TestBase-645925516 tempest-HypervisorAdminV253TestBase-645925516-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:11.266147 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3151b86c-f5e1-4f23-af9c-94161ce4524a tempest-HypervisorAdminV253TestBase-645925516 tempest-HypervisorAdminV253TestBase-645925516-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:11.266864 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3151b86c-f5e1-4f23-af9c-94161ce4524a tempest-HypervisorAdminV253TestBase-645925516 tempest-HypervisorAdminV253TestBase-645925516-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:11.276965 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3151b86c-f5e1-4f23-af9c-94161ce4524a tempest-HypervisorAdminV253TestBase-645925516 tempest-HypervisorAdminV253TestBase-645925516-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/99439c03-bd00-4c85-a9e3-ffb33cb65360" status: 200 len: 792 microversion: 2.53 time: 0.052521 Jun 20 12:01:11.287768 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 552/1112] 10.222.0.27 () {60 vars in 1297 bytes} [Mon Jun 20 12:01:11 2022] GET /compute/v2.1/os-hypervisors/99439c03-bd00-4c85-a9e3-ffb33cb65360 => generated 792 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:01:11.295030 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ce86ffa8-a17f-4e7d-8a58-7266822c59d3 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:11.296720 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ce86ffa8-a17f-4e7d-8a58-7266822c59d3 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 3c12363c-ee46-445d-af50-77a1f0518a17] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:11.315103 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ce86ffa8-a17f-4e7d-8a58-7266822c59d3 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:11.318297 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ce86ffa8-a17f-4e7d-8a58-7266822c59d3 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:11.319656 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ce86ffa8-a17f-4e7d-8a58-7266822c59d3 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:11.320123 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ce86ffa8-a17f-4e7d-8a58-7266822c59d3 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:11.446303 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ce86ffa8-a17f-4e7d-8a58-7266822c59d3 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154795 Jun 20 12:01:11.447673 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 553/1113] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:01:11 2022] GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:01:11.460538 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a841df5b-929a-4bb6-aca7-26dcbd5e866e tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Action: 'action', calling method: .version_select at 0x7f6082d3b8b0>, body: {"removeFloatingIp": {"address": "172.35.2.199"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:01:12.401305 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a841df5b-929a-4bb6-aca7-26dcbd5e866e tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] [instance: a06342ec-4969-4552-a343-aefc73138aa1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:12.422226 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a841df5b-929a-4bb6-aca7-26dcbd5e866e tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:12.425158 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a841df5b-929a-4bb6-aca7-26dcbd5e866e tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:12.426791 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a841df5b-929a-4bb6-aca7-26dcbd5e866e tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:12.429104 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a841df5b-929a-4bb6-aca7-26dcbd5e866e tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:13.105418 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a841df5b-929a-4bb6-aca7-26dcbd5e866e tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Acquired lock "refresh_cache-a06342ec-4969-4552-a343-aefc73138aa1" {{(pid=119127) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 20 12:01:14.105715 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-87e7fce6-4494-41f6-b9d7-ca19a11a5f84 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:01:14.106860 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-87e7fce6-4494-41f6-b9d7-ca19a11a5f84 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:01:14.107556 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-87e7fce6-4494-41f6-b9d7-ca19a11a5f84 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:01:14.110233 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-87e7fce6-4494-41f6-b9d7-ca19a11a5f84 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:01:14.112119 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-87e7fce6-4494-41f6-b9d7-ca19a11a5f84 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:01:14.138008 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-87e7fce6-4494-41f6-b9d7-ca19a11a5f84 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:14.138784 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-87e7fce6-4494-41f6-b9d7-ca19a11a5f84 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:14.139988 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-87e7fce6-4494-41f6-b9d7-ca19a11a5f84 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:14.140667 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-87e7fce6-4494-41f6-b9d7-ca19a11a5f84 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:14.168375 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-87e7fce6-4494-41f6-b9d7-ca19a11a5f84 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Getting quotas for project d0f00ab2137741e781c812172c3642b3. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:01:14.176385 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-87e7fce6-4494-41f6-b9d7-ca19a11a5f84 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Getting quotas for user e233a90ea23c44468b93a9316739f642 and project d0f00ab2137741e781c812172c3642b3. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:01:14.474897 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-87e7fce6-4494-41f6-b9d7-ca19a11a5f84 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:01:14.478005 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-87e7fce6-4494-41f6-b9d7-ca19a11a5f84 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='1409bafe-dadb-4c1a-aea2-66df05e1aab0',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='f6a7b73d-3afa-4e99-872f-f23c3eb1294b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c257e295-a1b4-4025-a16b-a31f298a243b',volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:01:15.091529 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-87e7fce6-4494-41f6-b9d7-ca19a11a5f84 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 6.810455 Jun 20 12:01:15.095954 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 561/1114] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Jun 20 12:01:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 6818 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 20 12:01:15.122435 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-addb6c0c-1f38-4bfd-9a55-647d19b46afd tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:15.128191 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-addb6c0c-1f38-4bfd-9a55-647d19b46afd tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 3c12363c-ee46-445d-af50-77a1f0518a17] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:15.146745 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-addb6c0c-1f38-4bfd-9a55-647d19b46afd tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:15.155458 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-addb6c0c-1f38-4bfd-9a55-647d19b46afd tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:15.157712 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-addb6c0c-1f38-4bfd-9a55-647d19b46afd tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:15.158700 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-addb6c0c-1f38-4bfd-9a55-647d19b46afd tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:15.218486 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-addb6c0c-1f38-4bfd-9a55-647d19b46afd tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.118865 Jun 20 12:01:15.220230 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 562/1115] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:01:15 2022] GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17/os-volume_attachments => generated 25 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:01:15.378419 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-a841df5b-929a-4bb6-aca7-26dcbd5e866e tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] [instance: a06342ec-4969-4552-a343-aefc73138aa1] Building network info cache for instance {{(pid=119127) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 20 12:01:15.666820 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-707629e5-64e6-4737-84de-9cc2e35d9a30 tempest-TenantUsagesNegativeTestJSON-1343202954 tempest-TenantUsagesNegativeTestJSON-1343202954-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-06-19T12%3A01%3A13.203513&end=2022-06-21T12%3A01%3A13.203513" status: 404 len: 112 microversion: - time: 0.445263 Jun 20 12:01:15.667362 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 563/1116] 10.222.0.27 () {58 vars in 1315 bytes} [Mon Jun 20 12:01:15 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-06-19T12%3A01%3A13.203513&end=2022-06-21T12%3A01%3A13.203513 => generated 112 bytes in 446 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 20 12:01:15.684026 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8d74be55-48b3-4119-86d5-763d8a1a0460 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:15.685991 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8d74be55-48b3-4119-86d5-763d8a1a0460 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:15.792182 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8d74be55-48b3-4119-86d5-763d8a1a0460 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:15.804677 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8d74be55-48b3-4119-86d5-763d8a1a0460 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:15.806780 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8d74be55-48b3-4119-86d5-763d8a1a0460 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:15.809123 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8d74be55-48b3-4119-86d5-763d8a1a0460 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1285 microversion: 2.42 time: 0.129826 Jun 20 12:01:15.810793 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 564/1117] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:01:15 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1285 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:01:15.829347 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-6e9545f1-d1ee-4108-a18e-39081323196e req-0bee5d8e-9bba-4f31-8af4-73cdf42d8352 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a06342ec-4969-4552-a343-aefc73138aa1", "tag": "16e6c137-ef3b-42fb-9ac9-913d43c2af22"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:01:15.864983 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-6e9545f1-d1ee-4108-a18e-39081323196e req-0bee5d8e-9bba-4f31-8af4-73cdf42d8352 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:15.867097 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-6e9545f1-d1ee-4108-a18e-39081323196e req-0bee5d8e-9bba-4f31-8af4-73cdf42d8352 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:15.907395 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-6e9545f1-d1ee-4108-a18e-39081323196e req-0bee5d8e-9bba-4f31-8af4-73cdf42d8352 service nova] Creating event network-changed:16e6c137-ef3b-42fb-9ac9-913d43c2af22 for instance a06342ec-4969-4552-a343-aefc73138aa1 on n-h1-master-1 Jun 20 12:01:15.921490 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-6e9545f1-d1ee-4108-a18e-39081323196e req-0bee5d8e-9bba-4f31-8af4-73cdf42d8352 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095946 Jun 20 12:01:15.925574 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 565/1118] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:01:15.934108 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5ebd7958-ea94-4a26-af47-46b392fa878f tempest-TenantUsagesNegativeTestJSON-1343202954 tempest-TenantUsagesNegativeTestJSON-1343202954-project-admin] Calling method '.version_select at 0x7f6073671310>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:15.957840 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-5ebd7958-ea94-4a26-af47-46b392fa878f tempest-TenantUsagesNegativeTestJSON-1343202954 tempest-TenantUsagesNegativeTestJSON-1343202954-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5ebd7958-ea94-4a26-af47-46b392fa878f tempest-TenantUsagesNegativeTestJSON-1343202954 tempest-TenantUsagesNegativeTestJSON-1343202954-project-admin] Request method failure captured: Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/os-simple-tenant-usage/bd2e4a865ee14196a17d17e3249e459e?start=2022-06-21T12%3A01%3A13.203513&end=2022-06-19T12%3A01%3A13.203513 HTTP/1.1 Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGGIyzvHKkTtJiBdeYrIKnUG36lzrX0jPNqJhifLbf0pQwbIsmGkrZCD6CL5dijIEST7GXioRQyWkP_rsMppu3wUhJNp8s40RenbXrRRCCqg44u_C8GHyWP48aVuQLa-p33opDnMPIsOyQpI1B2oV5-2pSMXYpszJuHVYqzSwUWIx5M Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: a0d82583989547bf8376fb18626a9edd Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1343202954 Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member,admin Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member,admin Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0d82583989547bf8376fb18626a9edd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0d82583989547bf8376fb18626a9edd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a0d82583989547bf8376fb18626a9edd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a0d82583989547bf8376fb18626a9edd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1343202954 Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: a0d82583989547bf8376fb18626a9edd Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1343202954 Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-TenantUsagesNegativeTestJSON-1343202954-project-admin Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: e72a7f888a094cef820df79850a7554b Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1343202954-project-admin Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: exception: Invalid start time. The start time cannot occur after the end time. Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'bd2e4a865ee14196a17d17e3249e459e'} Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Jun 20 12:01:15.967530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:15.976105 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5ebd7958-ea94-4a26-af47-46b392fa878f tempest-TenantUsagesNegativeTestJSON-1343202954 tempest-TenantUsagesNegativeTestJSON-1343202954-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:01:15.980542 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5ebd7958-ea94-4a26-af47-46b392fa878f tempest-TenantUsagesNegativeTestJSON-1343202954 tempest-TenantUsagesNegativeTestJSON-1343202954-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/bd2e4a865ee14196a17d17e3249e459e?start=2022-06-21T12%3A01%3A13.203513&end=2022-06-19T12%3A01%3A13.203513" status: 400 len: 111 microversion: 2.1 time: 0.053255 Jun 20 12:01:15.981761 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 566/1119] 10.222.0.27 () {58 vars in 1411 bytes} [Mon Jun 20 12:01:15 2022] GET /compute/v2.1/os-simple-tenant-usage/bd2e4a865ee14196a17d17e3249e459e?start=2022-06-21T12%3A01%3A13.203513&end=2022-06-19T12%3A01%3A13.203513 => generated 111 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:01:15.998606 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3eccf346-66bf-4f59-96ae-032e57cf1a6a tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-510099280", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "db7d8a61-8928-4d10-aee5-665749b91fa9"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:01:16.104860 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-3eccf346-66bf-4f59-96ae-032e57cf1a6a tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] validate_networks() for [('db7d8a61-8928-4d10-aee5-665749b91fa9', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:01:16.610992 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-a841df5b-929a-4bb6-aca7-26dcbd5e866e tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] [instance: a06342ec-4969-4552-a343-aefc73138aa1] Updating instance_info_cache with network_info: [{"id": "16e6c137-ef3b-42fb-9ac9-913d43c2af22", "address": "fa:16:3e:05:75:0d", "network": {"id": "5bb6175f-cf24-43c6-9d27-54937f852000", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-90489678-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2b350a5088d64f94bc850fc1b423cf2d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap16e6c137-ef", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119127) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 20 12:01:16.638195 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a841df5b-929a-4bb6-aca7-26dcbd5e866e tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Releasing lock "refresh_cache-a06342ec-4969-4552-a343-aefc73138aa1" {{(pid=119127) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 20 12:01:16.642755 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a841df5b-929a-4bb6-aca7-26dcbd5e866e tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] 10.222.0.27 "POST /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1/action" status: 202 len: 0 microversion: 2.1 time: 5.192934 Jun 20 12:01:16.647399 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 554/1120] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:01:11 2022] POST /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1/action => generated 0 bytes in 5198 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 20 12:01:17.469419 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-3eccf346-66bf-4f59-96ae-032e57cf1a6a tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:01:17.471687 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-3eccf346-66bf-4f59-96ae-032e57cf1a6a tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:01:17.473822 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-3eccf346-66bf-4f59-96ae-032e57cf1a6a tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:01:17.475703 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-3eccf346-66bf-4f59-96ae-032e57cf1a6a tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:01:17.486241 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-3eccf346-66bf-4f59-96ae-032e57cf1a6a tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:01:17.523311 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3eccf346-66bf-4f59-96ae-032e57cf1a6a tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:17.527268 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3eccf346-66bf-4f59-96ae-032e57cf1a6a tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:17.529267 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3eccf346-66bf-4f59-96ae-032e57cf1a6a tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:17.537109 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3eccf346-66bf-4f59-96ae-032e57cf1a6a tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:17.619061 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-3eccf346-66bf-4f59-96ae-032e57cf1a6a tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Getting quotas for project ada715b6fd664c06b9ffcdff7f4ecb12. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:01:17.626449 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-3eccf346-66bf-4f59-96ae-032e57cf1a6a tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Getting quotas for user 0f0ad0b87eae43f6b7f6ee8fc60cac9d and project ada715b6fd664c06b9ffcdff7f4ecb12. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:01:17.652121 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2622dac0-0787-4d2c-b15a-e8f36b74f324 tempest-TenantUsagesNegativeTestJSON-1816305890 tempest-TenantUsagesNegativeTestJSON-1816305890-project] Calling method '.version_select at 0x7f6073457310>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:17.655952 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2622dac0-0787-4d2c-b15a-e8f36b74f324 tempest-TenantUsagesNegativeTestJSON-1816305890 tempest-TenantUsagesNegativeTestJSON-1816305890-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '3d7767c47b8f4425ac39b457eaf071a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2e4a865ee14196a17d17e3249e459e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2622dac0-0787-4d2c-b15a-e8f36b74f324 tempest-TenantUsagesNegativeTestJSON-1816305890 tempest-TenantUsagesNegativeTestJSON-1816305890-project] Request method failure captured: Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-19T12%3A01%3A13.203513&end=2022-06-21T12%3A01%3A13.203513&detailed=1 HTTP/1.1 Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGGHKAw3IVM-V1t7g4OnLj3ilo0IGSXspigkpZVDECTUlWJUCxWWPeivYAGSeuBYCAoVF2WnTcHHumBgrRxz1IUJJbnfqSmhVX3HrHn-AT1ebJG_0PU1YxzrswX5TlN2RTCTcReNJixXx-GOMr0HFa9CyzR6t71Q-u57iAjAh7uY_bY Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: bd2e4a865ee14196a17d17e3249e459e Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1816305890 Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bd2e4a865ee14196a17d17e3249e459e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bd2e4a865ee14196a17d17e3249e459e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bd2e4a865ee14196a17d17e3249e459e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bd2e4a865ee14196a17d17e3249e459e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1816305890 Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: bd2e4a865ee14196a17d17e3249e459e Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1816305890 Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-TenantUsagesNegativeTestJSON-1816305890-project Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 3d7767c47b8f4425ac39b457eaf071a4 Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1816305890-project Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: action_args: {} Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._index(req) Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 20 12:01:17.662526 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 20 12:01:17.666824 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jun 20 12:01:17.666824 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:17.666824 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:17.666824 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:17.666824 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:17.666824 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:17.666824 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:17.666824 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 20 12:01:17.666824 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 20 12:01:17.666824 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jun 20 12:01:17.666824 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:17.671911 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2622dac0-0787-4d2c-b15a-e8f36b74f324 tempest-TenantUsagesNegativeTestJSON-1816305890 tempest-TenantUsagesNegativeTestJSON-1816305890-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:01:17.676796 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2622dac0-0787-4d2c-b15a-e8f36b74f324 tempest-TenantUsagesNegativeTestJSON-1816305890 tempest-TenantUsagesNegativeTestJSON-1816305890-project] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-19T12%3A01%3A13.203513&end=2022-06-21T12%3A01%3A13.203513&detailed=1" status: 403 len: 123 microversion: 2.1 time: 1.026801 Jun 20 12:01:17.678507 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 555/1121] 10.222.0.27 () {58 vars in 1334 bytes} [Mon Jun 20 12:01:16 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-19T12%3A01%3A13.203513&end=2022-06-21T12%3A01%3A13.203513&detailed=1 => generated 123 bytes in 1030 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:01:17.684366 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3eccf346-66bf-4f59-96ae-032e57cf1a6a tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:01:17.694244 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3eccf346-66bf-4f59-96ae-032e57cf1a6a tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 6ec5c954-ce85-4eb3-be16-31ef89f47bf2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:01:17.792944 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3eccf346-66bf-4f59-96ae-032e57cf1a6a tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.801214 Jun 20 12:01:17.803236 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 567/1122] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:01:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:01:17.830888 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-23c03252-4485-4942-99d7-66c44fe12356 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Calling method '.version_select at 0x7f60736108b0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:18.059218 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-731db4ef-62a0-41fb-b795-61eb420216d6 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1012910925", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "25724adf-e301-4183-8c20-574ec029a516"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:01:18.217950 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-731db4ef-62a0-41fb-b795-61eb420216d6 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] validate_networks() for [('25724adf-e301-4183-8c20-574ec029a516', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:01:19.173234 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-731db4ef-62a0-41fb-b795-61eb420216d6 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:01:19.174098 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-731db4ef-62a0-41fb-b795-61eb420216d6 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:01:19.174868 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-731db4ef-62a0-41fb-b795-61eb420216d6 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:01:19.175717 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-731db4ef-62a0-41fb-b795-61eb420216d6 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:01:19.176255 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-731db4ef-62a0-41fb-b795-61eb420216d6 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:01:19.189417 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-731db4ef-62a0-41fb-b795-61eb420216d6 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:19.191398 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-731db4ef-62a0-41fb-b795-61eb420216d6 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:19.193688 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-731db4ef-62a0-41fb-b795-61eb420216d6 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:19.194456 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-731db4ef-62a0-41fb-b795-61eb420216d6 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:19.224379 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-731db4ef-62a0-41fb-b795-61eb420216d6 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Getting quotas for project 7dbe3d6c4b7a41fa8181a805a992c173. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:01:19.231530 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-731db4ef-62a0-41fb-b795-61eb420216d6 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Getting quotas for user 3495d9dc8b714809b2f3f777cbabda29 and project 7dbe3d6c4b7a41fa8181a805a992c173. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:01:19.250845 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-731db4ef-62a0-41fb-b795-61eb420216d6 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:01:19.256434 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-731db4ef-62a0-41fb-b795-61eb420216d6 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 0c2f393e-08cc-4112-a898-0ef1830570d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:01:19.326434 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-731db4ef-62a0-41fb-b795-61eb420216d6 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.638641 Jun 20 12:01:19.327530 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 556/1123] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:01:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:01:19.334333 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ec50e674-8446-49c5-bf0c-097dd96fff6e tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:19.335311 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ec50e674-8446-49c5-bf0c-097dd96fff6e tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:19.343611 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ec50e674-8446-49c5-bf0c-097dd96fff6e tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:19.344834 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ec50e674-8446-49c5-bf0c-097dd96fff6e tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:19.346146 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ec50e674-8446-49c5-bf0c-097dd96fff6e tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:19.347043 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ec50e674-8446-49c5-bf0c-097dd96fff6e tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:19.653192 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ec50e674-8446-49c5-bf0c-097dd96fff6e tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:19.668010 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ec50e674-8446-49c5-bf0c-097dd96fff6e tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:19.680086 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ec50e674-8446-49c5-bf0c-097dd96fff6e tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:19.683581 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ec50e674-8446-49c5-bf0c-097dd96fff6e tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1583 microversion: 2.42 time: 0.353698 Jun 20 12:01:19.687366 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 557/1124] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:01:19 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1583 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:01:19.710139 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a19897c7-6b7b-4141-b737-d0ba326dc3aa tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:19.713260 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a19897c7-6b7b-4141-b737-d0ba326dc3aa tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 6ec5c954-ce85-4eb3-be16-31ef89f47bf2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:19.737362 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a19897c7-6b7b-4141-b737-d0ba326dc3aa tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:19.739257 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a19897c7-6b7b-4141-b737-d0ba326dc3aa tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:19.741371 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a19897c7-6b7b-4141-b737-d0ba326dc3aa tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:19.742598 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a19897c7-6b7b-4141-b737-d0ba326dc3aa tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:19.919292 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a19897c7-6b7b-4141-b737-d0ba326dc3aa tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ad0b87eae43f6b7f6ee8fc60cac9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada715b6fd664c06b9ffcdff7f4ecb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:19.947533 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a19897c7-6b7b-4141-b737-d0ba326dc3aa tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec5c954-ce85-4eb3-be16-31ef89f47bf2" status: 200 len: 1269 microversion: 2.1 time: 0.258102 Jun 20 12:01:19.949145 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 558/1125] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:19 2022] GET /compute/v2.1/servers/6ec5c954-ce85-4eb3-be16-31ef89f47bf2 => generated 1269 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:01:19.958448 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ff615d5b-350f-4d04-b536-756e3ea1eb3d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:19.959726 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ff615d5b-350f-4d04-b536-756e3ea1eb3d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 0c2f393e-08cc-4112-a898-0ef1830570d9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:20.089675 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ff615d5b-350f-4d04-b536-756e3ea1eb3d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:20.107182 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ff615d5b-350f-4d04-b536-756e3ea1eb3d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9" status: 200 len: 1215 microversion: 2.1 time: 0.153487 Jun 20 12:01:20.108499 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 559/1126] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:19 2022] GET /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9 => generated 1215 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:01:20.550669 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-23c03252-4485-4942-99d7-66c44fe12356 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/91da6da8-c72c-41f6-862b-5c2f010cd4ba" status: 202 len: 0 microversion: 2.1 time: 2.743646 Jun 20 12:01:20.552164 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 568/1127] 10.222.0.27 () {58 vars in 1262 bytes} [Mon Jun 20 12:01:17 2022] DELETE /compute/v2.1/os-floating-ips/91da6da8-c72c-41f6-862b-5c2f010cd4ba => generated 0 bytes in 2747 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:01:20.566667 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5d653e29-84d1-48c7-96ae-7abed809c323 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5d653e29-84d1-48c7-96ae-7abed809c323 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Request method failure captured: Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1/action HTTP/1.1 Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 34 Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGFeOSkjO7QVhq_kAlPPVwEuiohP1ogOf2CINEg2WlWjze0BpRIv0BAyw6GjRgi0Iq5i9osKBLbPM7Ft0vYO5-tKi43F0ZIsu9Cjxve6zq_YnTQ97L_e_4Uv4-RKsgcYAdfTF3-Me3SyT18SvLX7AAiH_JATl2e5UqUF44JkKbFiy38 Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 2b350a5088d64f94bc850fc1b423cf2d Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2b350a5088d64f94bc850fc1b423cf2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2b350a5088d64f94bc850fc1b423cf2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2b350a5088d64f94bc850fc1b423cf2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2b350a5088d64f94bc850fc1b423cf2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 2b350a5088d64f94bc850fc1b423cf2d Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: f9a5483adf06454cabe761d1c17e2732 Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: {"addFloatingIp": {"address": ""}} Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'a06342ec-4969-4552-a343-aefc73138aa1', 'body': {'addFloatingIp': {'address': ''}}} Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise error Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi '' Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 12:01:20.569481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 12:01:20.573911 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 12:01:20.573911 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jun 20 12:01:20.573911 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:20.573911 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:20.573911 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:20.573911 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:20.573911 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:20.573911 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:20.573911 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 12:01:20.573911 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 12:01:20.573911 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jun 20 12:01:20.573911 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:20.580161 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5d653e29-84d1-48c7-96ae-7abed809c323 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:01:20.581376 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5d653e29-84d1-48c7-96ae-7abed809c323 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] 10.222.0.27 "POST /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1/action" status: 400 len: 142 microversion: 2.1 time: 0.020118 Jun 20 12:01:20.582281 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 569/1128] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:01:20 2022] POST /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1/action => generated 142 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 20 12:01:20.595559 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d31a05d4-7e4a-4048-8b35-2cf520396977 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:01:20.613066 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d31a05d4-7e4a-4048-8b35-2cf520396977 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] [instance: a06342ec-4969-4552-a343-aefc73138aa1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:20.632381 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d31a05d4-7e4a-4048-8b35-2cf520396977 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:20.633181 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d31a05d4-7e4a-4048-8b35-2cf520396977 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:20.634376 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d31a05d4-7e4a-4048-8b35-2cf520396977 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:20.637581 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d31a05d4-7e4a-4048-8b35-2cf520396977 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:20.672786 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-da421b6c-dcf8-4923-8d39-c824e75ff1c2 tempest-HypervisorAdminNegativeUnderV252Test-376037874 tempest-HypervisorAdminNegativeUnderV252Test-376037874-project-admin] Calling method '.version_select at 0x7f6073453c10>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:20.674504 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:01:20.674504 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 12:01:20.676896 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da421b6c-dcf8-4923-8d39-c824e75ff1c2 tempest-HypervisorAdminNegativeUnderV252Test-376037874 tempest-HypervisorAdminNegativeUnderV252Test-376037874-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:20.680350 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da421b6c-dcf8-4923-8d39-c824e75ff1c2 tempest-HypervisorAdminNegativeUnderV252Test-376037874 tempest-HypervisorAdminNegativeUnderV252Test-376037874-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:20.701600 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d31a05d4-7e4a-4048-8b35-2cf520396977 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Acquired lock "refresh_cache-a06342ec-4969-4552-a343-aefc73138aa1" {{(pid=119128) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 20 12:01:20.773781 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da421b6c-dcf8-4923-8d39-c824e75ff1c2 tempest-HypervisorAdminNegativeUnderV252Test-376037874 tempest-HypervisorAdminNegativeUnderV252Test-376037874-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:20.779888 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da421b6c-dcf8-4923-8d39-c824e75ff1c2 tempest-HypervisorAdminNegativeUnderV252Test-376037874 tempest-HypervisorAdminNegativeUnderV252Test-376037874-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:20.840345 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da421b6c-dcf8-4923-8d39-c824e75ff1c2 tempest-HypervisorAdminNegativeUnderV252Test-376037874 tempest-HypervisorAdminNegativeUnderV252Test-376037874-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:20.843596 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da421b6c-dcf8-4923-8d39-c824e75ff1c2 tempest-HypervisorAdminNegativeUnderV252Test-376037874 tempest-HypervisorAdminNegativeUnderV252Test-376037874-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:20.858329 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-da421b6c-dcf8-4923-8d39-c824e75ff1c2 tempest-HypervisorAdminNegativeUnderV252Test-376037874 tempest-HypervisorAdminNegativeUnderV252Test-376037874-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.660609 Jun 20 12:01:20.859036 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 560/1129] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 12:01:20 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:01:20.895249 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0839d8d2-8ee6-4dbd-a225-279ee78c98f4 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:20.895925 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0839d8d2-8ee6-4dbd-a225-279ee78c98f4 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:20.929335 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0839d8d2-8ee6-4dbd-a225-279ee78c98f4 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:20.930108 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0839d8d2-8ee6-4dbd-a225-279ee78c98f4 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:20.931101 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0839d8d2-8ee6-4dbd-a225-279ee78c98f4 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:20.932005 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0839d8d2-8ee6-4dbd-a225-279ee78c98f4 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:21.027374 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d31a05d4-7e4a-4048-8b35-2cf520396977 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Releasing lock "refresh_cache-a06342ec-4969-4552-a343-aefc73138aa1" {{(pid=119128) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 20 12:01:21.028343 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-d31a05d4-7e4a-4048-8b35-2cf520396977 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] HTTP exception thrown: floating IP not found Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d31a05d4-7e4a-4048-8b35-2cf520396977 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Request method failure captured: Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1/action HTTP/1.1 Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 41 Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGFeOSkjO7QVhq_kAlPPVwEuiohP1ogOf2CINEg2WlWjze0BpRIv0BAyw6GjRgi0Iq5i9osKBLbPM7Ft0vYO5-tKi43F0ZIsu9Cjxve6zq_YnTQ97L_e_4Uv4-RKsgcYAdfTF3-Me3SyT18SvLX7AAiH_JATl2e5UqUF44JkKbFiy38 Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 2b350a5088d64f94bc850fc1b423cf2d Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2b350a5088d64f94bc850fc1b423cf2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2b350a5088d64f94bc850fc1b423cf2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2b350a5088d64f94bc850fc1b423cf2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2b350a5088d64f94bc850fc1b423cf2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 2b350a5088d64f94bc850fc1b423cf2d Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: f9a5483adf06454cabe761d1c17e2732 Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: {"addFloatingIp": {"address": "0.0.0.0"}} Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: exception: floating IP not found Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'a06342ec-4969-4552-a343-aefc73138aa1', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Jun 20 12:01:21.030298 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:21.035446 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:21.035446 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:21.035446 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:21.035446 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:21.035446 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:21.035446 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:01:21.035446 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:01:21.035446 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Jun 20 12:01:21.035446 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:21.037451 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d31a05d4-7e4a-4048-8b35-2cf520396977 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Returning 404 to user: floating IP not found {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:01:21.038523 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d31a05d4-7e4a-4048-8b35-2cf520396977 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] 10.222.0.27 "POST /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1/action" status: 404 len: 67 microversion: 2.1 time: 0.448698 Jun 20 12:01:21.039632 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 570/1130] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:01:20 2022] POST /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1/action => generated 67 bytes in 450 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:01:21.317534 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0839d8d2-8ee6-4dbd-a225-279ee78c98f4 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:21.333856 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0839d8d2-8ee6-4dbd-a225-279ee78c98f4 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:21.354770 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0839d8d2-8ee6-4dbd-a225-279ee78c98f4 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:21.371545 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0839d8d2-8ee6-4dbd-a225-279ee78c98f4 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1593 microversion: 2.42 time: 0.494524 Jun 20 12:01:21.372528 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 561/1131] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:01:20 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1593 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:01:21.389090 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b612c7cc-9a0c-4e9f-9b3b-f26c52670bff tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:21.390791 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b612c7cc-9a0c-4e9f-9b3b-f26c52670bff tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 6ec5c954-ce85-4eb3-be16-31ef89f47bf2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:21.428070 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b612c7cc-9a0c-4e9f-9b3b-f26c52670bff tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:21.429416 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b612c7cc-9a0c-4e9f-9b3b-f26c52670bff tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:21.431071 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b612c7cc-9a0c-4e9f-9b3b-f26c52670bff tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:21.433950 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b612c7cc-9a0c-4e9f-9b3b-f26c52670bff tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:21.655389 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e5a49585-6690-4ecc-957a-43af96c26b4c tempest-HypervisorAdminNegativeUnderV252Test-1534154373 tempest-HypervisorAdminNegativeUnderV252Test-1534154373-project] Calling method '.version_select at 0x7f60736711f0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:21.664181 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:01:21.664181 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 12:01:21.665684 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e5a49585-6690-4ecc-957a-43af96c26b4c tempest-HypervisorAdminNegativeUnderV252Test-1534154373 tempest-HypervisorAdminNegativeUnderV252Test-1534154373-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '494b2d7145d74337b7df5b95b4194a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe677703974689bad558125c371fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e5a49585-6690-4ecc-957a-43af96c26b4c tempest-HypervisorAdminNegativeUnderV252Test-1534154373 tempest-HypervisorAdminNegativeUnderV252Test-1534154373-project] Request method failure captured: Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/os-hypervisors/n-h1-master-1/search HTTP/1.1 Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGGONrKMSnisur1WZsh0uVtQsm-gfz0jhMY5a6x035JIOHqWBu39QyRXsjbhulCSqUhGErvahT60HyMsh5Zpa411UgtU2bIblY8Y65XInK0t_7K_O1tjDJHvfU69OD9OMtl2M9Is0KOZYvsQrPfDiFwNAlukRq_E5cni1vVumsh4TuQ Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: a4fe677703974689bad558125c371fd4 Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1534154373 Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a4fe677703974689bad558125c371fd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a4fe677703974689bad558125c371fd4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a4fe677703974689bad558125c371fd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a4fe677703974689bad558125c371fd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1534154373 Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: a4fe677703974689bad558125c371fd4 Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1534154373 Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1534154373-project Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 494b2d7145d74337b7df5b95b4194a39 Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1534154373-project Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'n-h1-master-1'} Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:21.671720 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:21.676128 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:21.676128 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:21.676128 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:21.676128 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 20 12:01:21.676128 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 20 12:01:21.676128 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jun 20 12:01:21.676128 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:21.676128 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e5a49585-6690-4ecc-957a-43af96c26b4c tempest-HypervisorAdminNegativeUnderV252Test-1534154373 tempest-HypervisorAdminNegativeUnderV252Test-1534154373-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:01:21.679338 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e5a49585-6690-4ecc-957a-43af96c26b4c tempest-HypervisorAdminNegativeUnderV252Test-1534154373 tempest-HypervisorAdminNegativeUnderV252Test-1534154373-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/n-h1-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.638264 Jun 20 12:01:21.679969 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 571/1132] 10.222.0.27 () {58 vars in 1208 bytes} [Mon Jun 20 12:01:21 2022] GET /compute/v2.1/os-hypervisors/n-h1-master-1/search => generated 117 bytes in 640 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:01:21.699052 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b612c7cc-9a0c-4e9f-9b3b-f26c52670bff tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ad0b87eae43f6b7f6ee8fc60cac9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada715b6fd664c06b9ffcdff7f4ecb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:21.702414 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7db4ba5a-a943-4a8e-9338-03bba31eeaed tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Action: 'action', calling method: .version_select at 0x7f6082d351f0>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:01:21.712917 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b612c7cc-9a0c-4e9f-9b3b-f26c52670bff tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec5c954-ce85-4eb3-be16-31ef89f47bf2" status: 200 len: 1275 microversion: 2.1 time: 0.336159 Jun 20 12:01:21.716977 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 562/1133] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:21 2022] GET /compute/v2.1/servers/6ec5c954-ce85-4eb3-be16-31ef89f47bf2 => generated 1275 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:01:21.743379 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-544f95f2-735e-4181-97df-6204cacadcad tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:21.744401 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-544f95f2-735e-4181-97df-6204cacadcad tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 0c2f393e-08cc-4112-a898-0ef1830570d9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:21.755208 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-544f95f2-735e-4181-97df-6204cacadcad tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:21.755659 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-544f95f2-735e-4181-97df-6204cacadcad tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:21.756705 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-544f95f2-735e-4181-97df-6204cacadcad tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:21.757161 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-544f95f2-735e-4181-97df-6204cacadcad tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:21.876378 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-544f95f2-735e-4181-97df-6204cacadcad tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:21.887205 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-7db4ba5a-a943-4a8e-9338-03bba31eeaed tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7db4ba5a-a943-4a8e-9338-03bba31eeaed tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Request method failure captured: Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1/action HTTP/1.1 Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 44 Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGFeOSkjO7QVhq_kAlPPVwEuiohP1ogOf2CINEg2WlWjze0BpRIv0BAyw6GjRgi0Iq5i9osKBLbPM7Ft0vYO5-tKi43F0ZIsu9Cjxve6zq_YnTQ97L_e_4Uv4-RKsgcYAdfTF3-Me3SyT18SvLX7AAiH_JATl2e5UqUF44JkKbFiy38 Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 2b350a5088d64f94bc850fc1b423cf2d Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2b350a5088d64f94bc850fc1b423cf2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2b350a5088d64f94bc850fc1b423cf2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2b350a5088d64f94bc850fc1b423cf2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2b350a5088d64f94bc850fc1b423cf2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 2b350a5088d64f94bc850fc1b423cf2d Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: f9a5483adf06454cabe761d1c17e2732 Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: {"removeFloatingIp": {"address": "0.0.0.0"}} Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: exception: Floating IP not found for address 0.0.0.0. Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'a06342ec-4969-4552-a343-aefc73138aa1', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Jun 20 12:01:21.888861 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Jun 20 12:01:21.893747 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Jun 20 12:01:21.893747 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:21.893747 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:21.893747 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:21.893747 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:21.893747 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:21.893747 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:21.893747 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:01:21.893747 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:01:21.893747 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Jun 20 12:01:21.893747 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:21.896156 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7db4ba5a-a943-4a8e-9338-03bba31eeaed tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:01:21.897271 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7db4ba5a-a943-4a8e-9338-03bba31eeaed tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] 10.222.0.27 "POST /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1/action" status: 404 len: 88 microversion: 2.1 time: 0.215515 Jun 20 12:01:21.898036 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 572/1134] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:01:21 2022] POST /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1/action => generated 88 bytes in 217 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:01:21.908836 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-693aa6a0-8b68-4141-8ac9-51b5c69bb9d9 tempest-HypervisorAdminNegativeUnderV252Test-376037874 tempest-HypervisorAdminNegativeUnderV252Test-376037874-project-admin] Calling method '.version_select at 0x7f607361eb80>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:21.909483 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-544f95f2-735e-4181-97df-6204cacadcad tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9" status: 200 len: 1273 microversion: 2.1 time: 0.189895 Jun 20 12:01:21.912881 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 563/1135] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:21 2022] GET /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9 => generated 1273 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:01:21.916418 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-693aa6a0-8b68-4141-8ac9-51b5c69bb9d9 tempest-HypervisorAdminNegativeUnderV252Test-376037874 tempest-HypervisorAdminNegativeUnderV252Test-376037874-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:21.917301 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-693aa6a0-8b68-4141-8ac9-51b5c69bb9d9 tempest-HypervisorAdminNegativeUnderV252Test-376037874 tempest-HypervisorAdminNegativeUnderV252Test-376037874-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:21.933981 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-497e0852-da88-4c36-aea0-014b83819a42 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:21.934559 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-693aa6a0-8b68-4141-8ac9-51b5c69bb9d9 tempest-HypervisorAdminNegativeUnderV252Test-376037874 tempest-HypervisorAdminNegativeUnderV252Test-376037874-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jun 20 12:01:21.935961 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-497e0852-da88-4c36-aea0-014b83819a42 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] [instance: a06342ec-4969-4552-a343-aefc73138aa1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-693aa6a0-8b68-4141-8ac9-51b5c69bb9d9 tempest-HypervisorAdminNegativeUnderV252Test-376037874 tempest-HypervisorAdminNegativeUnderV252Test-376037874-project-admin] Request method failure captured: Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGGPInFVBfN9nt7BV60Kivw41r9lG7UXm2m8wWUOw-0zoRlryY5wlf7uUVb_8CCwjB_DjUbKFRzX_3M-rYOMZelXGD8hqd8fRnW4aMF4cNU3ONVKZKDdoEbp0f0PFpN6T10WnV-L2Z9yN9pxhYPPuuAvJZY33P2hqrejSnP99WDFGjE Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: e7e3fb3ff37440b08f1fc7978f64d9fe Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-376037874 Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member,admin Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member,admin Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7e3fb3ff37440b08f1fc7978f64d9fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7e3fb3ff37440b08f1fc7978f64d9fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e7e3fb3ff37440b08f1fc7978f64d9fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e7e3fb3ff37440b08f1fc7978f64d9fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-376037874 Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: e7e3fb3ff37440b08f1fc7978f64d9fe Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-376037874 Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-376037874-project-admin Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: a26ee4e929d1445f9164437338c0254a Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-376037874-project-admin Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'nonexistent_hypervisor_name'} Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jun 20 12:01:21.938276 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:21.945789 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-693aa6a0-8b68-4141-8ac9-51b5c69bb9d9 tempest-HypervisorAdminNegativeUnderV252Test-376037874 tempest-HypervisorAdminNegativeUnderV252Test-376037874-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:01:21.952492 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-693aa6a0-8b68-4141-8ac9-51b5c69bb9d9 tempest-HypervisorAdminNegativeUnderV252Test-376037874 tempest-HypervisorAdminNegativeUnderV252Test-376037874-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.053168 Jun 20 12:01:21.953427 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 573/1136] 10.222.0.27 () {58 vars in 1250 bytes} [Mon Jun 20 12:01:21 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:01:21.955117 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-497e0852-da88-4c36-aea0-014b83819a42 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:21.955738 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-497e0852-da88-4c36-aea0-014b83819a42 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:21.958405 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-497e0852-da88-4c36-aea0-014b83819a42 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:21.961133 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-497e0852-da88-4c36-aea0-014b83819a42 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:21.965015 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-82520119-136f-4039-82d1-86e1a6befaf6 tempest-HypervisorAdminNegativeUnderV252Test-376037874 tempest-HypervisorAdminNegativeUnderV252Test-376037874-project-admin] Calling method '.version_select at 0x7f6073671af0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:21.966139 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:01:21.966139 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 12:01:21.968496 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-82520119-136f-4039-82d1-86e1a6befaf6 tempest-HypervisorAdminNegativeUnderV252Test-376037874 tempest-HypervisorAdminNegativeUnderV252Test-376037874-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:21.971983 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-82520119-136f-4039-82d1-86e1a6befaf6 tempest-HypervisorAdminNegativeUnderV252Test-376037874 tempest-HypervisorAdminNegativeUnderV252Test-376037874-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:22.012774 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-497e0852-da88-4c36-aea0-014b83819a42 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] [instance: a06342ec-4969-4552-a343-aefc73138aa1] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:01:22.015583 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-82520119-136f-4039-82d1-86e1a6befaf6 tempest-HypervisorAdminNegativeUnderV252Test-376037874 tempest-HypervisorAdminNegativeUnderV252Test-376037874-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:22.018295 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-82520119-136f-4039-82d1-86e1a6befaf6 tempest-HypervisorAdminNegativeUnderV252Test-376037874 tempest-HypervisorAdminNegativeUnderV252Test-376037874-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:22.060437 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-82520119-136f-4039-82d1-86e1a6befaf6 tempest-HypervisorAdminNegativeUnderV252Test-376037874 tempest-HypervisorAdminNegativeUnderV252Test-376037874-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:22.064559 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-82520119-136f-4039-82d1-86e1a6befaf6 tempest-HypervisorAdminNegativeUnderV252Test-376037874 tempest-HypervisorAdminNegativeUnderV252Test-376037874-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:22.083429 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-82520119-136f-4039-82d1-86e1a6befaf6 tempest-HypervisorAdminNegativeUnderV252Test-376037874 tempest-HypervisorAdminNegativeUnderV252Test-376037874-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.122263 Jun 20 12:01:22.084332 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 574/1137] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 12:01:21 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:01:22.101560 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ab673cc2-0170-4bd3-9140-405588d5cb80 tempest-HypervisorAdminNegativeUnderV252Test-1534154373 tempest-HypervisorAdminNegativeUnderV252Test-1534154373-project] Calling method '.version_select at 0x7f607361e940>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:22.106970 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:01:22.106970 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 12:01:22.113359 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ab673cc2-0170-4bd3-9140-405588d5cb80 tempest-HypervisorAdminNegativeUnderV252Test-1534154373 tempest-HypervisorAdminNegativeUnderV252Test-1534154373-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '494b2d7145d74337b7df5b95b4194a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fe677703974689bad558125c371fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ab673cc2-0170-4bd3-9140-405588d5cb80 tempest-HypervisorAdminNegativeUnderV252Test-1534154373 tempest-HypervisorAdminNegativeUnderV252Test-1534154373-project] Request method failure captured: Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGGONrKMSnisur1WZsh0uVtQsm-gfz0jhMY5a6x035JIOHqWBu39QyRXsjbhulCSqUhGErvahT60HyMsh5Zpa411UgtU2bIblY8Y65XInK0t_7K_O1tjDJHvfU69OD9OMtl2M9Is0KOZYvsQrPfDiFwNAlukRq_E5cni1vVumsh4TuQ Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: a4fe677703974689bad558125c371fd4 Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1534154373 Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a4fe677703974689bad558125c371fd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a4fe677703974689bad558125c371fd4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a4fe677703974689bad558125c371fd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a4fe677703974689bad558125c371fd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1534154373 Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: a4fe677703974689bad558125c371fd4 Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1534154373 Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1534154373-project Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 494b2d7145d74337b7df5b95b4194a39 Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1534154373-project Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '1'} Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise self.value Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:22.122675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:22.128599 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:22.128599 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:22.128599 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:22.128599 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 20 12:01:22.128599 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 20 12:01:22.128599 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jun 20 12:01:22.128599 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:22.130610 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ab673cc2-0170-4bd3-9140-405588d5cb80 tempest-HypervisorAdminNegativeUnderV252Test-1534154373 tempest-HypervisorAdminNegativeUnderV252Test-1534154373-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:01:22.131904 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ab673cc2-0170-4bd3-9140-405588d5cb80 tempest-HypervisorAdminNegativeUnderV252Test-1534154373 tempest-HypervisorAdminNegativeUnderV252Test-1534154373-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.040767 Jun 20 12:01:22.133019 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 575/1138] 10.222.0.27 () {58 vars in 1175 bytes} [Mon Jun 20 12:01:22 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:01:22.148322 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-878d7ee8-40ac-4977-818a-ccff0576b6c8 tempest-HypervisorAdminNegativeUnderV252Test-376037874 tempest-HypervisorAdminNegativeUnderV252Test-376037874-project-admin] Calling method '.version_select at 0x7f60736718b0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:22.152303 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-878d7ee8-40ac-4977-818a-ccff0576b6c8 tempest-HypervisorAdminNegativeUnderV252Test-376037874 tempest-HypervisorAdminNegativeUnderV252Test-376037874-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:22.153554 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-878d7ee8-40ac-4977-818a-ccff0576b6c8 tempest-HypervisorAdminNegativeUnderV252Test-376037874 tempest-HypervisorAdminNegativeUnderV252Test-376037874-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:22.174841 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-878d7ee8-40ac-4977-818a-ccff0576b6c8 tempest-HypervisorAdminNegativeUnderV252Test-376037874 tempest-HypervisorAdminNegativeUnderV252Test-376037874-project-admin] HTTP exception thrown: No hypervisor matching '8c25bce7-c6f6-4e59-9d93-900c6e60ac7a' could be found. Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-878d7ee8-40ac-4977-818a-ccff0576b6c8 tempest-HypervisorAdminNegativeUnderV252Test-376037874 tempest-HypervisorAdminNegativeUnderV252Test-376037874-project-admin] Request method failure captured: Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/os-hypervisors/8c25bce7-c6f6-4e59-9d93-900c6e60ac7a/servers HTTP/1.1 Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGGPInFVBfN9nt7BV60Kivw41r9lG7UXm2m8wWUOw-0zoRlryY5wlf7uUVb_8CCwjB_DjUbKFRzX_3M-rYOMZelXGD8hqd8fRnW4aMF4cNU3ONVKZKDdoEbp0f0PFpN6T10WnV-L2Z9yN9pxhYPPuuAvJZY33P2hqrejSnP99WDFGjE Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: e7e3fb3ff37440b08f1fc7978f64d9fe Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-376037874 Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member,admin Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member,admin Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7e3fb3ff37440b08f1fc7978f64d9fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7e3fb3ff37440b08f1fc7978f64d9fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e7e3fb3ff37440b08f1fc7978f64d9fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e7e3fb3ff37440b08f1fc7978f64d9fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-376037874 Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: e7e3fb3ff37440b08f1fc7978f64d9fe Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-376037874 Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-376037874-project-admin Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: a26ee4e929d1445f9164437338c0254a Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-376037874-project-admin Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: exception: No hypervisor matching '8c25bce7-c6f6-4e59-9d93-900c6e60ac7a' could be found. Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '8c25bce7-c6f6-4e59-9d93-900c6e60ac7a'} Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '8c25bce7-c6f6-4e59-9d93-900c6e60ac7a' could be found. Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '8c25bce7-c6f6-4e59-9d93-900c6e60ac7a' could be found. Jun 20 12:01:22.180954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:22.187960 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-497e0852-da88-4c36-aea0-014b83819a42 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1" status: 204 len: 0 microversion: 2.1 time: 0.263793 Jun 20 12:01:22.187960 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 564/1139] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:01:21 2022] DELETE /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:01:22.188547 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-878d7ee8-40ac-4977-818a-ccff0576b6c8 tempest-HypervisorAdminNegativeUnderV252Test-376037874 tempest-HypervisorAdminNegativeUnderV252Test-376037874-project-admin] Returning 404 to user: No hypervisor matching '8c25bce7-c6f6-4e59-9d93-900c6e60ac7a' could be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:01:22.188547 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-878d7ee8-40ac-4977-818a-ccff0576b6c8 tempest-HypervisorAdminNegativeUnderV252Test-376037874 tempest-HypervisorAdminNegativeUnderV252Test-376037874-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/8c25bce7-c6f6-4e59-9d93-900c6e60ac7a/servers" status: 404 len: 123 microversion: 2.1 time: 0.044259 Jun 20 12:01:22.188547 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 576/1140] 10.222.0.27 () {58 vars in 1280 bytes} [Mon Jun 20 12:01:22 2022] GET /compute/v2.1/os-hypervisors/8c25bce7-c6f6-4e59-9d93-900c6e60ac7a/servers => generated 123 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:01:22.194058 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-10e36baa-ed84-49a2-8844-9ce52fed1b6d tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:22.194847 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-10e36baa-ed84-49a2-8844-9ce52fed1b6d tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] [instance: a06342ec-4969-4552-a343-aefc73138aa1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:22.203604 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-10e36baa-ed84-49a2-8844-9ce52fed1b6d tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:22.204338 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-10e36baa-ed84-49a2-8844-9ce52fed1b6d tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:22.205407 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-10e36baa-ed84-49a2-8844-9ce52fed1b6d tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:22.206550 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-10e36baa-ed84-49a2-8844-9ce52fed1b6d tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:22.411456 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1d5b4cab-2669-41ed-91db-9c5b337a2d24 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:22.412902 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1d5b4cab-2669-41ed-91db-9c5b337a2d24 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:22.459847 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d5b4cab-2669-41ed-91db-9c5b337a2d24 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:22.460695 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d5b4cab-2669-41ed-91db-9c5b337a2d24 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:22.461837 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d5b4cab-2669-41ed-91db-9c5b337a2d24 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:22.464240 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d5b4cab-2669-41ed-91db-9c5b337a2d24 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:22.814879 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-10e36baa-ed84-49a2-8844-9ce52fed1b6d tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a5483adf06454cabe761d1c17e2732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b350a5088d64f94bc850fc1b423cf2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:22.831330 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-10e36baa-ed84-49a2-8844-9ce52fed1b6d tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] 10.222.0.27 "GET /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1" status: 200 len: 1539 microversion: 2.1 time: 0.642196 Jun 20 12:01:22.839615 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 565/1141] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:22 2022] GET /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1 => generated 1539 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:01:22.848407 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-22fdba90-4ba5-4a01-8e98-f096764357ba tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:22.855180 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-22fdba90-4ba5-4a01-8e98-f096764357ba tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 6ec5c954-ce85-4eb3-be16-31ef89f47bf2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:22.877713 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-22fdba90-4ba5-4a01-8e98-f096764357ba tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:22.878706 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-22fdba90-4ba5-4a01-8e98-f096764357ba tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:22.879759 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-22fdba90-4ba5-4a01-8e98-f096764357ba tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:22.883667 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-22fdba90-4ba5-4a01-8e98-f096764357ba tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:22.915574 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1d5b4cab-2669-41ed-91db-9c5b337a2d24 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:22.943272 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1d5b4cab-2669-41ed-91db-9c5b337a2d24 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:22.956586 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1d5b4cab-2669-41ed-91db-9c5b337a2d24 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:22.970522 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1d5b4cab-2669-41ed-91db-9c5b337a2d24 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1593 microversion: 2.42 time: 0.565976 Jun 20 12:01:22.975236 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 577/1142] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:01:22 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1593 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:01:22.996390 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e480228d-5528-4cce-be84-df1f0228a379 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:23.007028 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e480228d-5528-4cce-be84-df1f0228a379 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 0c2f393e-08cc-4112-a898-0ef1830570d9] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:23.034862 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e480228d-5528-4cce-be84-df1f0228a379 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:23.035669 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e480228d-5528-4cce-be84-df1f0228a379 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:23.042934 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e480228d-5528-4cce-be84-df1f0228a379 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:23.043536 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e480228d-5528-4cce-be84-df1f0228a379 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:23.334338 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e480228d-5528-4cce-be84-df1f0228a379 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:23.336990 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=79,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:01:23.373526 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e480228d-5528-4cce-be84-df1f0228a379 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9" status: 200 len: 1273 microversion: 2.1 time: 0.388724 Jun 20 12:01:23.386021 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 578/1143] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:22 2022] GET /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9 => generated 1273 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:01:23.610464 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-22fdba90-4ba5-4a01-8e98-f096764357ba tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ad0b87eae43f6b7f6ee8fc60cac9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada715b6fd664c06b9ffcdff7f4ecb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:23.634618 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-22fdba90-4ba5-4a01-8e98-f096764357ba tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec5c954-ce85-4eb3-be16-31ef89f47bf2" status: 200 len: 1317 microversion: 2.1 time: 0.793196 Jun 20 12:01:23.637955 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 566/1144] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:22 2022] GET /compute/v2.1/servers/6ec5c954-ce85-4eb3-be16-31ef89f47bf2 => generated 1317 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:01:23.858460 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d4a9a6ab-471f-4f4a-b66e-deb29bb17069 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:23.859082 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d4a9a6ab-471f-4f4a-b66e-deb29bb17069 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] [instance: a06342ec-4969-4552-a343-aefc73138aa1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:23.891588 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4a9a6ab-471f-4f4a-b66e-deb29bb17069 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:23.897778 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4a9a6ab-471f-4f4a-b66e-deb29bb17069 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:23.898798 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4a9a6ab-471f-4f4a-b66e-deb29bb17069 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:23.899064 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4a9a6ab-471f-4f4a-b66e-deb29bb17069 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:23.992571 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-91b61b46-7b50-4a44-8760-743525a91e83 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:23.993253 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-91b61b46-7b50-4a44-8760-743525a91e83 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:24.023682 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91b61b46-7b50-4a44-8760-743525a91e83 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:24.024166 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91b61b46-7b50-4a44-8760-743525a91e83 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:24.025103 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91b61b46-7b50-4a44-8760-743525a91e83 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:24.026699 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91b61b46-7b50-4a44-8760-743525a91e83 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:24.084027 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:01:24.615834 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d4a9a6ab-471f-4f4a-b66e-deb29bb17069 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a5483adf06454cabe761d1c17e2732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b350a5088d64f94bc850fc1b423cf2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:24.650578 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d4a9a6ab-471f-4f4a-b66e-deb29bb17069 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] 10.222.0.27 "GET /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1" status: 200 len: 1539 microversion: 2.1 time: 0.793221 Jun 20 12:01:24.667967 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 579/1145] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:23 2022] GET /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1 => generated 1539 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:01:24.691319 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-655ed327-4885-4e97-a4ab-a172d3f2fd0d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:24.691319 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-655ed327-4885-4e97-a4ab-a172d3f2fd0d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 0c2f393e-08cc-4112-a898-0ef1830570d9] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:24.705484 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-655ed327-4885-4e97-a4ab-a172d3f2fd0d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:24.713365 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-655ed327-4885-4e97-a4ab-a172d3f2fd0d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:24.714279 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-655ed327-4885-4e97-a4ab-a172d3f2fd0d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:24.714727 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-655ed327-4885-4e97-a4ab-a172d3f2fd0d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:25.134308 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-91b61b46-7b50-4a44-8760-743525a91e83 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:25.144491 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-91b61b46-7b50-4a44-8760-743525a91e83 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:25.158776 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-91b61b46-7b50-4a44-8760-743525a91e83 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:25.160516 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-91b61b46-7b50-4a44-8760-743525a91e83 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1661 microversion: 2.42 time: 1.173272 Jun 20 12:01:25.161355 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 567/1146] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:01:23 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1661 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:01:25.188713 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f86c6d37-9eb5-4b15-8e10-7c62eb0496b6 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:25.190013 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f86c6d37-9eb5-4b15-8e10-7c62eb0496b6 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 6ec5c954-ce85-4eb3-be16-31ef89f47bf2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:25.205268 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f86c6d37-9eb5-4b15-8e10-7c62eb0496b6 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:25.212135 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f86c6d37-9eb5-4b15-8e10-7c62eb0496b6 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:25.213561 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f86c6d37-9eb5-4b15-8e10-7c62eb0496b6 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:25.214639 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f86c6d37-9eb5-4b15-8e10-7c62eb0496b6 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:25.645508 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f86c6d37-9eb5-4b15-8e10-7c62eb0496b6 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ad0b87eae43f6b7f6ee8fc60cac9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada715b6fd664c06b9ffcdff7f4ecb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:25.662316 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f86c6d37-9eb5-4b15-8e10-7c62eb0496b6 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec5c954-ce85-4eb3-be16-31ef89f47bf2" status: 200 len: 1317 microversion: 2.1 time: 0.488465 Jun 20 12:01:25.663478 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 568/1147] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:25 2022] GET /compute/v2.1/servers/6ec5c954-ce85-4eb3-be16-31ef89f47bf2 => generated 1317 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:01:25.989352 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-eeca2b28-9738-42a6-9668-fca28256b2f7 tempest-ImagesMetadataNegativeTestJSON-195034789 tempest-ImagesMetadataNegativeTestJSON-195034789-project] Calling method '.version_select at 0x7f6073495a60>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:26.032636 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-eeca2b28-9738-42a6-9668-fca28256b2f7 tempest-ImagesMetadataNegativeTestJSON-195034789 tempest-ImagesMetadataNegativeTestJSON-195034789-project] HTTP exception thrown: Image not found. Jun 20 12:01:26.058552 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-655ed327-4885-4e97-a4ab-a172d3f2fd0d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-eeca2b28-9738-42a6-9668-fca28256b2f7 tempest-ImagesMetadataNegativeTestJSON-195034789 tempest-ImagesMetadataNegativeTestJSON-195034789-project] Request method failure captured: Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/images/decf4b6e-9ee2-4722-b87c-edef685f26b0/metadata/os_distro HTTP/1.1 Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGGVRckakPbBqPZZL3a4zCW6g0Xd2K28STk1TNPJWRuCAaIEZcKpWt7LkpMLq9frGQ1EvrxPs5wMR3-9ouVNs_5U3q3l7DrJV0LxFLM-pmQIhsWeoF_KDVLHDCUWKdG9cxLY9lpjcHJOGlfVAji_qbL7zDOrnsQ5wpXWrIy-WO2VWTA Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 908ca66e685e42d88851d0e12cf84666 Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-195034789 Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/908ca66e685e42d88851d0e12cf84666"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/908ca66e685e42d88851d0e12cf84666"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/908ca66e685e42d88851d0e12cf84666"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_908ca66e685e42d88851d0e12cf84666"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-195034789 Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 908ca66e685e42d88851d0e12cf84666 Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-195034789 Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ImagesMetadataNegativeTestJSON-195034789-project Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 62e57f13720b494bad56445fb7c10701 Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-195034789-project Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: exception: Image not found. Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: action_args: {'image_id': 'decf4b6e-9ee2-4722-b87c-edef685f26b0', 'id': 'os_distro'} Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID decf4b6e-9ee2-4722-b87c-edef685f26b0 Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 20 12:01:26.060974 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image decf4b6e-9ee2-4722-b87c-edef685f26b0 could not be found. Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 20 12:01:26.068766 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:26.088517 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-eeca2b28-9738-42a6-9668-fca28256b2f7 tempest-ImagesMetadataNegativeTestJSON-195034789 tempest-ImagesMetadataNegativeTestJSON-195034789-project] Returning 404 to user: Image not found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:01:26.094929 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-eeca2b28-9738-42a6-9668-fca28256b2f7 tempest-ImagesMetadataNegativeTestJSON-195034789 tempest-ImagesMetadataNegativeTestJSON-195034789-project] 10.222.0.27 "DELETE /compute/v2.1/images/decf4b6e-9ee2-4722-b87c-edef685f26b0/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.410972 Jun 20 12:01:26.101843 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 569/1148] 10.222.0.27 () {58 vars in 1292 bytes} [Mon Jun 20 12:01:25 2022] DELETE /compute/v2.1/images/decf4b6e-9ee2-4722-b87c-edef685f26b0/metadata/os_distro => generated 62 bytes in 433 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:01:26.121018 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-655ed327-4885-4e97-a4ab-a172d3f2fd0d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9" status: 200 len: 1315 microversion: 2.1 time: 1.451550 Jun 20 12:01:26.134270 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1a8bc60c-d862-4bdc-bc6b-eae8be9feef7 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:26.135350 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1a8bc60c-d862-4bdc-bc6b-eae8be9feef7 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] [instance: a06342ec-4969-4552-a343-aefc73138aa1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:26.136021 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 580/1149] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:24 2022] GET /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9 => generated 1315 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:01:26.141509 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-8037834d-42ca-47a3-a3a1-289ce8da6b18 req-b5fb0788-0b49-4faf-91e8-0341ea1f3b9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ec5c954-ce85-4eb3-be16-31ef89f47bf2", "tag": "5d77b210-d5fc-4f5f-99cb-0e76e6b76970"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:01:26.172048 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-8037834d-42ca-47a3-a3a1-289ce8da6b18 req-b5fb0788-0b49-4faf-91e8-0341ea1f3b9b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:26.172831 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-8037834d-42ca-47a3-a3a1-289ce8da6b18 req-b5fb0788-0b49-4faf-91e8-0341ea1f3b9b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:26.181894 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a8bc60c-d862-4bdc-bc6b-eae8be9feef7 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:26.182511 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a8bc60c-d862-4bdc-bc6b-eae8be9feef7 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:26.188360 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a8bc60c-d862-4bdc-bc6b-eae8be9feef7 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:26.189307 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a8bc60c-d862-4bdc-bc6b-eae8be9feef7 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:26.217640 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-8037834d-42ca-47a3-a3a1-289ce8da6b18 req-b5fb0788-0b49-4faf-91e8-0341ea1f3b9b service nova] Creating event network-changed:5d77b210-d5fc-4f5f-99cb-0e76e6b76970 for instance 6ec5c954-ce85-4eb3-be16-31ef89f47bf2 on n-h2-master-1 Jun 20 12:01:26.235127 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-8037834d-42ca-47a3-a3a1-289ce8da6b18 req-b5fb0788-0b49-4faf-91e8-0341ea1f3b9b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096984 Jun 20 12:01:26.236144 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 581/1150] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:01:26.254805 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2b756c6c-1703-4abd-bd10-54feac366e00 tempest-ImagesMetadataNegativeTestJSON-195034789 tempest-ImagesMetadataNegativeTestJSON-195034789-project] Calling method '.version_select at 0x7f6073726ca0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:26.409683 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-2b756c6c-1703-4abd-bd10-54feac366e00 tempest-ImagesMetadataNegativeTestJSON-195034789 tempest-ImagesMetadataNegativeTestJSON-195034789-project] HTTP exception thrown: Image not found. Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2b756c6c-1703-4abd-bd10-54feac366e00 tempest-ImagesMetadataNegativeTestJSON-195034789 tempest-ImagesMetadataNegativeTestJSON-195034789-project] Request method failure captured: Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/images/17caf2b7-478e-4603-b2dd-05e42178f838/metadata/os_version HTTP/1.1 Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGGVRckakPbBqPZZL3a4zCW6g0Xd2K28STk1TNPJWRuCAaIEZcKpWt7LkpMLq9frGQ1EvrxPs5wMR3-9ouVNs_5U3q3l7DrJV0LxFLM-pmQIhsWeoF_KDVLHDCUWKdG9cxLY9lpjcHJOGlfVAji_qbL7zDOrnsQ5wpXWrIy-WO2VWTA Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 908ca66e685e42d88851d0e12cf84666 Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-195034789 Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/908ca66e685e42d88851d0e12cf84666"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/908ca66e685e42d88851d0e12cf84666"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/908ca66e685e42d88851d0e12cf84666"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_908ca66e685e42d88851d0e12cf84666"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-195034789 Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 908ca66e685e42d88851d0e12cf84666 Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-195034789 Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ImagesMetadataNegativeTestJSON-195034789-project Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 62e57f13720b494bad56445fb7c10701 Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-195034789-project Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: exception: Image not found. Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: action_args: {'image_id': '17caf2b7-478e-4603-b2dd-05e42178f838', 'id': 'os_version'} Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 17caf2b7-478e-4603-b2dd-05e42178f838 Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 20 12:01:26.418654 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 17caf2b7-478e-4603-b2dd-05e42178f838 could not be found. Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2b756c6c-1703-4abd-bd10-54feac366e00 tempest-ImagesMetadataNegativeTestJSON-195034789 tempest-ImagesMetadataNegativeTestJSON-195034789-project] Returning 404 to user: Image not found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2b756c6c-1703-4abd-bd10-54feac366e00 tempest-ImagesMetadataNegativeTestJSON-195034789 tempest-ImagesMetadataNegativeTestJSON-195034789-project] 10.222.0.27 "GET /compute/v2.1/images/17caf2b7-478e-4603-b2dd-05e42178f838/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.182886 Jun 20 12:01:26.424057 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 582/1151] 10.222.0.27 () {58 vars in 1292 bytes} [Mon Jun 20 12:01:26 2022] GET /compute/v2.1/images/17caf2b7-478e-4603-b2dd-05e42178f838/metadata/os_version => generated 62 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:01:26.458857 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-32e942dd-b003-4471-98a0-dabbc6c0ea9c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:26.471153 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-32e942dd-b003-4471-98a0-dabbc6c0ea9c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:26.491535 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1a8bc60c-d862-4bdc-bc6b-eae8be9feef7 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a5483adf06454cabe761d1c17e2732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b350a5088d64f94bc850fc1b423cf2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:26.498204 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-32e942dd-b003-4471-98a0-dabbc6c0ea9c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:26.498660 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-32e942dd-b003-4471-98a0-dabbc6c0ea9c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:26.499453 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-32e942dd-b003-4471-98a0-dabbc6c0ea9c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:26.499895 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-32e942dd-b003-4471-98a0-dabbc6c0ea9c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:26.510328 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1a8bc60c-d862-4bdc-bc6b-eae8be9feef7 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] 10.222.0.27 "GET /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1" status: 200 len: 1316 microversion: 2.1 time: 0.390685 Jun 20 12:01:26.511668 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 570/1152] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:26 2022] GET /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1 => generated 1316 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:01:26.521947 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b6b64d23-df14-4fdf-bfbf-38293de2ab2c tempest-ImagesMetadataNegativeTestJSON-195034789 tempest-ImagesMetadataNegativeTestJSON-195034789-project] Calling method '.version_select at 0x7f6073648280>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:26.610277 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-b6b64d23-df14-4fdf-bfbf-38293de2ab2c tempest-ImagesMetadataNegativeTestJSON-195034789 tempest-ImagesMetadataNegativeTestJSON-195034789-project] HTTP exception thrown: Image not found. Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b6b64d23-df14-4fdf-bfbf-38293de2ab2c tempest-ImagesMetadataNegativeTestJSON-195034789 tempest-ImagesMetadataNegativeTestJSON-195034789-project] Request method failure captured: Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/images/6e84316a-4433-4c57-92d1-e944a4c7d4cc/metadata HTTP/1.1 Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGGVRckakPbBqPZZL3a4zCW6g0Xd2K28STk1TNPJWRuCAaIEZcKpWt7LkpMLq9frGQ1EvrxPs5wMR3-9ouVNs_5U3q3l7DrJV0LxFLM-pmQIhsWeoF_KDVLHDCUWKdG9cxLY9lpjcHJOGlfVAji_qbL7zDOrnsQ5wpXWrIy-WO2VWTA Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 908ca66e685e42d88851d0e12cf84666 Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-195034789 Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/908ca66e685e42d88851d0e12cf84666"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/908ca66e685e42d88851d0e12cf84666"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/908ca66e685e42d88851d0e12cf84666"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_908ca66e685e42d88851d0e12cf84666"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-195034789 Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 908ca66e685e42d88851d0e12cf84666 Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-195034789 Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ImagesMetadataNegativeTestJSON-195034789-project Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 62e57f13720b494bad56445fb7c10701 Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-195034789-project Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: exception: Image not found. Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: action_args: {'image_id': '6e84316a-4433-4c57-92d1-e944a4c7d4cc'} Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6e84316a-4433-4c57-92d1-e944a4c7d4cc Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 20 12:01:26.612837 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6e84316a-4433-4c57-92d1-e944a4c7d4cc could not be found. Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 20 12:01:26.619349 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:26.627862 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b6b64d23-df14-4fdf-bfbf-38293de2ab2c tempest-ImagesMetadataNegativeTestJSON-195034789 tempest-ImagesMetadataNegativeTestJSON-195034789-project] Returning 404 to user: Image not found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:01:26.630331 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b6b64d23-df14-4fdf-bfbf-38293de2ab2c tempest-ImagesMetadataNegativeTestJSON-195034789 tempest-ImagesMetadataNegativeTestJSON-195034789-project] 10.222.0.27 "GET /compute/v2.1/images/6e84316a-4433-4c57-92d1-e944a4c7d4cc/metadata" status: 404 len: 62 microversion: 2.1 time: 0.116595 Jun 20 12:01:26.638608 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 571/1153] 10.222.0.27 () {58 vars in 1259 bytes} [Mon Jun 20 12:01:26 2022] GET /compute/v2.1/images/6e84316a-4433-4c57-92d1-e944a4c7d4cc/metadata => generated 62 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:01:26.663965 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-17ac715d-b8f2-4378-b483-5879ddaf1830 tempest-ImagesMetadataNegativeTestJSON-195034789 tempest-ImagesMetadataNegativeTestJSON-195034789-project] Action: 'update_all', calling method: .version_select at 0x7f60735ba040>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:01:26.726143 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-17ac715d-b8f2-4378-b483-5879ddaf1830 tempest-ImagesMetadataNegativeTestJSON-195034789 tempest-ImagesMetadataNegativeTestJSON-195034789-project] HTTP exception thrown: Image not found. Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-17ac715d-b8f2-4378-b483-5879ddaf1830 tempest-ImagesMetadataNegativeTestJSON-195034789 tempest-ImagesMetadataNegativeTestJSON-195034789-project] Request method failure captured: Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: request: PUT /compute/v2.1/images/de9c1947-e085-4b8d-8fa4-699d58caa393/metadata HTTP/1.1 Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 57 Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGGVRckakPbBqPZZL3a4zCW6g0Xd2K28STk1TNPJWRuCAaIEZcKpWt7LkpMLq9frGQ1EvrxPs5wMR3-9ouVNs_5U3q3l7DrJV0LxFLM-pmQIhsWeoF_KDVLHDCUWKdG9cxLY9lpjcHJOGlfVAji_qbL7zDOrnsQ5wpXWrIy-WO2VWTA Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 908ca66e685e42d88851d0e12cf84666 Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-195034789 Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/908ca66e685e42d88851d0e12cf84666"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/908ca66e685e42d88851d0e12cf84666"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/908ca66e685e42d88851d0e12cf84666"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_908ca66e685e42d88851d0e12cf84666"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-195034789 Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 908ca66e685e42d88851d0e12cf84666 Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-195034789 Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ImagesMetadataNegativeTestJSON-195034789-project Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 62e57f13720b494bad56445fb7c10701 Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-195034789-project Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: exception: Image not found. Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: action_args: {'image_id': 'de9c1947-e085-4b8d-8fa4-699d58caa393', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID de9c1947-e085-4b8d-8fa4-699d58caa393 Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 20 12:01:26.732094 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image de9c1947-e085-4b8d-8fa4-699d58caa393 could not be found. Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-17ac715d-b8f2-4378-b483-5879ddaf1830 tempest-ImagesMetadataNegativeTestJSON-195034789 tempest-ImagesMetadataNegativeTestJSON-195034789-project] Returning 404 to user: Image not found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-17ac715d-b8f2-4378-b483-5879ddaf1830 tempest-ImagesMetadataNegativeTestJSON-195034789 tempest-ImagesMetadataNegativeTestJSON-195034789-project] 10.222.0.27 "PUT /compute/v2.1/images/de9c1947-e085-4b8d-8fa4-699d58caa393/metadata" status: 404 len: 62 microversion: 2.1 time: 0.095955 Jun 20 12:01:26.750232 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 572/1154] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Jun 20 12:01:26 2022] PUT /compute/v2.1/images/de9c1947-e085-4b8d-8fa4-699d58caa393/metadata => generated 62 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:01:26.760618 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a0b60429-fab5-4bd6-aaab-24f34c7aec88 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:26.760618 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a0b60429-fab5-4bd6-aaab-24f34c7aec88 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 6ec5c954-ce85-4eb3-be16-31ef89f47bf2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:26.792684 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a0b60429-fab5-4bd6-aaab-24f34c7aec88 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:26.794898 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a0b60429-fab5-4bd6-aaab-24f34c7aec88 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:26.798135 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a0b60429-fab5-4bd6-aaab-24f34c7aec88 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:26.799122 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a0b60429-fab5-4bd6-aaab-24f34c7aec88 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:27.028522 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-32e942dd-b003-4471-98a0-dabbc6c0ea9c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:27.053987 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-32e942dd-b003-4471-98a0-dabbc6c0ea9c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:27.060911 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-32e942dd-b003-4471-98a0-dabbc6c0ea9c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:27.067057 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-32e942dd-b003-4471-98a0-dabbc6c0ea9c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1661 microversion: 2.42 time: 0.622252 Jun 20 12:01:27.071335 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 583/1155] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:01:26 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1661 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:01:27.100709 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b332aaf6-3158-4c94-abe8-15c361e4b5b8 tempest-ImagesMetadataNegativeTestJSON-195034789 tempest-ImagesMetadataNegativeTestJSON-195034789-project] Action: 'update', calling method: .version_select at 0x7f607361eca0>, body: {"meta": {"os_distro": "alt"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:01:27.149101 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-b332aaf6-3158-4c94-abe8-15c361e4b5b8 tempest-ImagesMetadataNegativeTestJSON-195034789 tempest-ImagesMetadataNegativeTestJSON-195034789-project] HTTP exception thrown: Image not found. Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b332aaf6-3158-4c94-abe8-15c361e4b5b8 tempest-ImagesMetadataNegativeTestJSON-195034789 tempest-ImagesMetadataNegativeTestJSON-195034789-project] Request method failure captured: Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: request: PUT /compute/v2.1/images/31014509-0440-4504-966b-e1123125aa5f/metadata/os_distro HTTP/1.1 Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 30 Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGGVRckakPbBqPZZL3a4zCW6g0Xd2K28STk1TNPJWRuCAaIEZcKpWt7LkpMLq9frGQ1EvrxPs5wMR3-9ouVNs_5U3q3l7DrJV0LxFLM-pmQIhsWeoF_KDVLHDCUWKdG9cxLY9lpjcHJOGlfVAji_qbL7zDOrnsQ5wpXWrIy-WO2VWTA Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 908ca66e685e42d88851d0e12cf84666 Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-195034789 Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/908ca66e685e42d88851d0e12cf84666"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/908ca66e685e42d88851d0e12cf84666"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/908ca66e685e42d88851d0e12cf84666"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_908ca66e685e42d88851d0e12cf84666"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-195034789 Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 908ca66e685e42d88851d0e12cf84666 Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-195034789 Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ImagesMetadataNegativeTestJSON-195034789-project Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 62e57f13720b494bad56445fb7c10701 Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-195034789-project Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: {"meta": {"os_distro": "alt"}} Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: exception: Image not found. Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: action_args: {'image_id': '31014509-0440-4504-966b-e1123125aa5f', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 31014509-0440-4504-966b-e1123125aa5f Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 20 12:01:27.152468 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 31014509-0440-4504-966b-e1123125aa5f could not be found. Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 20 12:01:27.158595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:27.165771 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b332aaf6-3158-4c94-abe8-15c361e4b5b8 tempest-ImagesMetadataNegativeTestJSON-195034789 tempest-ImagesMetadataNegativeTestJSON-195034789-project] Returning 404 to user: Image not found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:01:27.165771 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b332aaf6-3158-4c94-abe8-15c361e4b5b8 tempest-ImagesMetadataNegativeTestJSON-195034789 tempest-ImagesMetadataNegativeTestJSON-195034789-project] 10.222.0.27 "PUT /compute/v2.1/images/31014509-0440-4504-966b-e1123125aa5f/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.088897 Jun 20 12:01:27.165771 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 584/1156] 10.222.0.27 () {60 vars in 1309 bytes} [Mon Jun 20 12:01:27 2022] PUT /compute/v2.1/images/31014509-0440-4504-966b-e1123125aa5f/metadata/os_distro => generated 62 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:01:27.173452 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bf13c422-eed0-4766-a448-f08365a2820d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:27.174360 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bf13c422-eed0-4766-a448-f08365a2820d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 0c2f393e-08cc-4112-a898-0ef1830570d9] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:27.186882 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bf13c422-eed0-4766-a448-f08365a2820d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:27.187626 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bf13c422-eed0-4766-a448-f08365a2820d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:27.188825 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bf13c422-eed0-4766-a448-f08365a2820d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:27.189658 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bf13c422-eed0-4766-a448-f08365a2820d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:27.325012 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a0b60429-fab5-4bd6-aaab-24f34c7aec88 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ad0b87eae43f6b7f6ee8fc60cac9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada715b6fd664c06b9ffcdff7f4ecb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:27.339395 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a0b60429-fab5-4bd6-aaab-24f34c7aec88 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec5c954-ce85-4eb3-be16-31ef89f47bf2" status: 200 len: 1317 microversion: 2.1 time: 0.599069 Jun 20 12:01:27.344944 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 573/1157] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:26 2022] GET /compute/v2.1/servers/6ec5c954-ce85-4eb3-be16-31ef89f47bf2 => generated 1317 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:01:27.350522 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-95e2dae8-71ff-4463-9e93-63fa193c721b tempest-ImagesMetadataNegativeTestJSON-195034789 tempest-ImagesMetadataNegativeTestJSON-195034789-project] Action: 'create', calling method: .version_select at 0x7f607370fee0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:01:27.461191 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-95e2dae8-71ff-4463-9e93-63fa193c721b tempest-ImagesMetadataNegativeTestJSON-195034789 tempest-ImagesMetadataNegativeTestJSON-195034789-project] HTTP exception thrown: Image not found. Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-95e2dae8-71ff-4463-9e93-63fa193c721b tempest-ImagesMetadataNegativeTestJSON-195034789 tempest-ImagesMetadataNegativeTestJSON-195034789-project] Request method failure captured: Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/images/bbd68407-6fa5-4ddb-9d38-3a4c5323d9d3/metadata HTTP/1.1 Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 57 Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGGVRckakPbBqPZZL3a4zCW6g0Xd2K28STk1TNPJWRuCAaIEZcKpWt7LkpMLq9frGQ1EvrxPs5wMR3-9ouVNs_5U3q3l7DrJV0LxFLM-pmQIhsWeoF_KDVLHDCUWKdG9cxLY9lpjcHJOGlfVAji_qbL7zDOrnsQ5wpXWrIy-WO2VWTA Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 908ca66e685e42d88851d0e12cf84666 Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-195034789 Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/908ca66e685e42d88851d0e12cf84666"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/908ca66e685e42d88851d0e12cf84666"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/908ca66e685e42d88851d0e12cf84666"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_908ca66e685e42d88851d0e12cf84666"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-195034789 Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 908ca66e685e42d88851d0e12cf84666 Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-195034789 Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ImagesMetadataNegativeTestJSON-195034789-project Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 62e57f13720b494bad56445fb7c10701 Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-195034789-project Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: exception: Image not found. Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: action_args: {'image_id': 'bbd68407-6fa5-4ddb-9d38-3a4c5323d9d3', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID bbd68407-6fa5-4ddb-9d38-3a4c5323d9d3 Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 20 12:01:27.470973 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bbd68407-6fa5-4ddb-9d38-3a4c5323d9d3 could not be found. Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:27.480533 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-95e2dae8-71ff-4463-9e93-63fa193c721b tempest-ImagesMetadataNegativeTestJSON-195034789 tempest-ImagesMetadataNegativeTestJSON-195034789-project] Returning 404 to user: Image not found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:01:27.492967 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-95e2dae8-71ff-4463-9e93-63fa193c721b tempest-ImagesMetadataNegativeTestJSON-195034789 tempest-ImagesMetadataNegativeTestJSON-195034789-project] 10.222.0.27 "POST /compute/v2.1/images/bbd68407-6fa5-4ddb-9d38-3a4c5323d9d3/metadata" status: 404 len: 62 microversion: 2.1 time: 0.135340 Jun 20 12:01:27.492967 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 574/1158] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Jun 20 12:01:27 2022] POST /compute/v2.1/images/bbd68407-6fa5-4ddb-9d38-3a4c5323d9d3/metadata => generated 62 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:01:27.535573 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9e19a6e3-e991-4c3a-8d65-5345ec9395b5 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:27.539710 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9e19a6e3-e991-4c3a-8d65-5345ec9395b5 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] [instance: a06342ec-4969-4552-a343-aefc73138aa1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:27.547556 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9e19a6e3-e991-4c3a-8d65-5345ec9395b5 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:27.548744 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9e19a6e3-e991-4c3a-8d65-5345ec9395b5 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:27.550510 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9e19a6e3-e991-4c3a-8d65-5345ec9395b5 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:27.551252 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9e19a6e3-e991-4c3a-8d65-5345ec9395b5 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:27.564479 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=4 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:01:27.618873 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-9e19a6e3-e991-4c3a-8d65-5345ec9395b5 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] HTTP exception thrown: Instance a06342ec-4969-4552-a343-aefc73138aa1 could not be found. Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9e19a6e3-e991-4c3a-8d65-5345ec9395b5 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Request method failure captured: Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1 HTTP/1.1 Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGFeOSkjO7QVhq_kAlPPVwEuiohP1ogOf2CINEg2WlWjze0BpRIv0BAyw6GjRgi0Iq5i9osKBLbPM7Ft0vYO5-tKi43F0ZIsu9Cjxve6zq_YnTQ97L_e_4Uv4-RKsgcYAdfTF3-Me3SyT18SvLX7AAiH_JATl2e5UqUF44JkKbFiy38 Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 2b350a5088d64f94bc850fc1b423cf2d Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2b350a5088d64f94bc850fc1b423cf2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2b350a5088d64f94bc850fc1b423cf2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2b350a5088d64f94bc850fc1b423cf2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2b350a5088d64f94bc850fc1b423cf2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 2b350a5088d64f94bc850fc1b423cf2d Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: f9a5483adf06454cabe761d1c17e2732 Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: exception: Instance a06342ec-4969-4552-a343-aefc73138aa1 could not be found. Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'a06342ec-4969-4552-a343-aefc73138aa1'} Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a06342ec-4969-4552-a343-aefc73138aa1 could not be found. Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a06342ec-4969-4552-a343-aefc73138aa1 could not be found. Jun 20 12:01:27.623796 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:27.633580 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:27.633580 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:27.633580 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:27.633580 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:27.633580 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:27.633580 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:01:27.633580 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:01:27.633580 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a06342ec-4969-4552-a343-aefc73138aa1 could not be found. Jun 20 12:01:27.633580 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:27.639999 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9e19a6e3-e991-4c3a-8d65-5345ec9395b5 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] Returning 404 to user: Instance a06342ec-4969-4552-a343-aefc73138aa1 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:01:27.641861 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=14 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:01:27.642437 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9e19a6e3-e991-4c3a-8d65-5345ec9395b5 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297 tempest-FloatingIPsAssociationNegativeTestJSON-1871475297-project] 10.222.0.27 "GET /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1" status: 404 len: 111 microversion: 2.1 time: 0.116662 Jun 20 12:01:27.644328 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 575/1159] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:27 2022] GET /compute/v2.1/servers/a06342ec-4969-4552-a343-aefc73138aa1 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:01:27.830289 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-bf13c422-eed0-4766-a448-f08365a2820d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:27.848216 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bf13c422-eed0-4766-a448-f08365a2820d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9" status: 200 len: 1315 microversion: 2.1 time: 0.681541 Jun 20 12:01:27.848601 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 585/1160] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:27 2022] GET /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9 => generated 1315 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:01:28.094883 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c3806e92-f6d1-4f74-95fa-d5c6d0a6f858 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:28.096720 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c3806e92-f6d1-4f74-95fa-d5c6d0a6f858 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:28.134582 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c3806e92-f6d1-4f74-95fa-d5c6d0a6f858 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:28.138498 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c3806e92-f6d1-4f74-95fa-d5c6d0a6f858 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:28.146846 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c3806e92-f6d1-4f74-95fa-d5c6d0a6f858 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:28.147707 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c3806e92-f6d1-4f74-95fa-d5c6d0a6f858 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:28.414346 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-45895236-9d22-4734-94e0-99286479e94d req-dfbc99e0-36a9-4420-b8d1-e476d7998695 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c2f393e-08cc-4112-a898-0ef1830570d9", "tag": "432208f0-522f-47e6-b7ce-adb33fb6b55e"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:01:28.436770 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-45895236-9d22-4734-94e0-99286479e94d req-dfbc99e0-36a9-4420-b8d1-e476d7998695 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:28.443211 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-45895236-9d22-4734-94e0-99286479e94d req-dfbc99e0-36a9-4420-b8d1-e476d7998695 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:28.474112 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c3806e92-f6d1-4f74-95fa-d5c6d0a6f858 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:28.526609 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-45895236-9d22-4734-94e0-99286479e94d req-dfbc99e0-36a9-4420-b8d1-e476d7998695 service nova] Creating event network-changed:432208f0-522f-47e6-b7ce-adb33fb6b55e for instance 0c2f393e-08cc-4112-a898-0ef1830570d9 on n-h1-master-1 Jun 20 12:01:28.540429 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c3806e92-f6d1-4f74-95fa-d5c6d0a6f858 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:28.548383 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c3806e92-f6d1-4f74-95fa-d5c6d0a6f858 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:28.551324 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c3806e92-f6d1-4f74-95fa-d5c6d0a6f858 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1708 microversion: 2.42 time: 0.464165 Jun 20 12:01:28.551922 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-45895236-9d22-4734-94e0-99286479e94d req-dfbc99e0-36a9-4420-b8d1-e476d7998695 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.529107 Jun 20 12:01:28.554386 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 586/1161] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:01:28 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1708 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:01:28.555580 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 576/1162] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:01:28.567898 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b2905ec8-1eb8-4933-a6c3-af81122efaec tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:28.579504 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-a02945a7-397d-410a-9d48-a6c7603ee43e req-de7bcd79-31da-42e1-bc95-19c05c25245c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a06342ec-4969-4552-a343-aefc73138aa1", "name": "network-vif-deleted", "tag": "16e6c137-ef3b-42fb-9ac9-913d43c2af22"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:01:28.581958 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b2905ec8-1eb8-4933-a6c3-af81122efaec tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 6ec5c954-ce85-4eb3-be16-31ef89f47bf2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:28.590432 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2905ec8-1eb8-4933-a6c3-af81122efaec tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:28.591150 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2905ec8-1eb8-4933-a6c3-af81122efaec tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:28.592108 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2905ec8-1eb8-4933-a6c3-af81122efaec tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:28.592739 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2905ec8-1eb8-4933-a6c3-af81122efaec tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:28.607225 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-a02945a7-397d-410a-9d48-a6c7603ee43e req-de7bcd79-31da-42e1-bc95-19c05c25245c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:28.607671 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-a02945a7-397d-410a-9d48-a6c7603ee43e req-de7bcd79-31da-42e1-bc95-19c05c25245c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:28.648675 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-a02945a7-397d-410a-9d48-a6c7603ee43e req-de7bcd79-31da-42e1-bc95-19c05c25245c service nova] Creating event network-vif-deleted:16e6c137-ef3b-42fb-9ac9-913d43c2af22 for instance a06342ec-4969-4552-a343-aefc73138aa1 on n-h1-master-1 Jun 20 12:01:28.658580 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-a02945a7-397d-410a-9d48-a6c7603ee43e req-de7bcd79-31da-42e1-bc95-19c05c25245c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099541 Jun 20 12:01:28.659705 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 577/1163] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:01:28.872723 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2a048c7b-05d2-4b4a-97c9-9d5489989628 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:28.873982 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2a048c7b-05d2-4b4a-97c9-9d5489989628 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 0c2f393e-08cc-4112-a898-0ef1830570d9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:28.885261 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2a048c7b-05d2-4b4a-97c9-9d5489989628 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:28.886264 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2a048c7b-05d2-4b4a-97c9-9d5489989628 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:28.887242 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2a048c7b-05d2-4b4a-97c9-9d5489989628 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:28.887877 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2a048c7b-05d2-4b4a-97c9-9d5489989628 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:28.914335 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b2905ec8-1eb8-4933-a6c3-af81122efaec tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ad0b87eae43f6b7f6ee8fc60cac9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada715b6fd664c06b9ffcdff7f4ecb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:28.933545 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b2905ec8-1eb8-4933-a6c3-af81122efaec tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec5c954-ce85-4eb3-be16-31ef89f47bf2" status: 200 len: 1317 microversion: 2.1 time: 0.369893 Jun 20 12:01:28.946208 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 587/1164] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:28 2022] GET /compute/v2.1/servers/6ec5c954-ce85-4eb3-be16-31ef89f47bf2 => generated 1317 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:01:29.207799 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:01:29.302895 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2a048c7b-05d2-4b4a-97c9-9d5489989628 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:29.314852 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2a048c7b-05d2-4b4a-97c9-9d5489989628 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9" status: 200 len: 1315 microversion: 2.1 time: 0.452061 Jun 20 12:01:29.319531 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 578/1165] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:28 2022] GET /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9 => generated 1315 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:01:29.581420 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-95e41208-54bf-4e8a-9152-bf12114daa30 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:29.582343 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-95e41208-54bf-4e8a-9152-bf12114daa30 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:29.590359 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95e41208-54bf-4e8a-9152-bf12114daa30 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:29.593687 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95e41208-54bf-4e8a-9152-bf12114daa30 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:29.600768 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95e41208-54bf-4e8a-9152-bf12114daa30 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:29.602627 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95e41208-54bf-4e8a-9152-bf12114daa30 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:29.709998 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f14cf7b3-4963-4c36-925d-103113385229 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:29.712178 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f14cf7b3-4963-4c36-925d-103113385229 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:29.746716 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f14cf7b3-4963-4c36-925d-103113385229 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:29.749593 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f14cf7b3-4963-4c36-925d-103113385229 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:29.750579 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f14cf7b3-4963-4c36-925d-103113385229 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:29.760444 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f14cf7b3-4963-4c36-925d-103113385229 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:29.982886 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-95e41208-54bf-4e8a-9152-bf12114daa30 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:30.004674 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-95e41208-54bf-4e8a-9152-bf12114daa30 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:30.012942 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-95e41208-54bf-4e8a-9152-bf12114daa30 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:30.020425 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-95e41208-54bf-4e8a-9152-bf12114daa30 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1708 microversion: 2.42 time: 0.442790 Jun 20 12:01:30.032229 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 588/1166] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:01:29 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1708 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:01:30.033351 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f6ed9b9d-6525-4c6e-89ec-b35eb1c1c6fd tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:30.034178 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f6ed9b9d-6525-4c6e-89ec-b35eb1c1c6fd tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 6ec5c954-ce85-4eb3-be16-31ef89f47bf2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:30.049533 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6ed9b9d-6525-4c6e-89ec-b35eb1c1c6fd tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:30.055309 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6ed9b9d-6525-4c6e-89ec-b35eb1c1c6fd tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:30.060881 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6ed9b9d-6525-4c6e-89ec-b35eb1c1c6fd tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:30.072153 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6ed9b9d-6525-4c6e-89ec-b35eb1c1c6fd tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:30.106207 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=8 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:01:30.658105 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-f14cf7b3-4963-4c36-925d-103113385229 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lazy-loading 'services' on Instance uuid 3db0bd7d-eed4-411a-a7b8-719b260233ed {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:01:30.691353 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f14cf7b3-4963-4c36-925d-103113385229 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 2345 microversion: 2.25 time: 0.987533 Jun 20 12:01:30.693156 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 579/1167] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:01:29 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 2345 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:01:30.712496 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bbe18d40-b3c2-43a0-86e9-e989cc50ebc4 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:30.714653 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bbe18d40-b3c2-43a0-86e9-e989cc50ebc4 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 0c2f393e-08cc-4112-a898-0ef1830570d9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:30.728802 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bbe18d40-b3c2-43a0-86e9-e989cc50ebc4 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:30.729745 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bbe18d40-b3c2-43a0-86e9-e989cc50ebc4 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:30.730688 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bbe18d40-b3c2-43a0-86e9-e989cc50ebc4 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:30.737112 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bbe18d40-b3c2-43a0-86e9-e989cc50ebc4 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:31.230559 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f6ed9b9d-6525-4c6e-89ec-b35eb1c1c6fd tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ad0b87eae43f6b7f6ee8fc60cac9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada715b6fd664c06b9ffcdff7f4ecb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:31.266882 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f6ed9b9d-6525-4c6e-89ec-b35eb1c1c6fd tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec5c954-ce85-4eb3-be16-31ef89f47bf2" status: 200 len: 1317 microversion: 2.1 time: 1.243859 Jun 20 12:01:31.268367 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 589/1168] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:30 2022] GET /compute/v2.1/servers/6ec5c954-ce85-4eb3-be16-31ef89f47bf2 => generated 1317 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:01:31.291065 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7170ca82-2ba9-4e05-9d62-1fab56e34bce tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:31.294597 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:01:31.294597 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 12:01:31.297595 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7170ca82-2ba9-4e05-9d62-1fab56e34bce tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:31.302684 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7170ca82-2ba9-4e05-9d62-1fab56e34bce tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:31.307240 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7170ca82-2ba9-4e05-9d62-1fab56e34bce tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:31.314230 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7170ca82-2ba9-4e05-9d62-1fab56e34bce tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:31.397183 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7170ca82-2ba9-4e05-9d62-1fab56e34bce tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.125329 Jun 20 12:01:31.409999 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 590/1169] 10.222.0.27 () {60 vars in 1216 bytes} [Mon Jun 20 12:01:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:01:31.425884 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f8a51cfa-647b-4fb0-8f4c-deb92fe0d1f6 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:31.427443 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f8a51cfa-647b-4fb0-8f4c-deb92fe0d1f6 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:31.435862 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8a51cfa-647b-4fb0-8f4c-deb92fe0d1f6 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:31.436688 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8a51cfa-647b-4fb0-8f4c-deb92fe0d1f6 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:31.438544 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8a51cfa-647b-4fb0-8f4c-deb92fe0d1f6 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:31.439175 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8a51cfa-647b-4fb0-8f4c-deb92fe0d1f6 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:31.727181 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bbe18d40-b3c2-43a0-86e9-e989cc50ebc4 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:31.740049 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bbe18d40-b3c2-43a0-86e9-e989cc50ebc4 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9" status: 200 len: 1315 microversion: 2.1 time: 1.045526 Jun 20 12:01:31.741764 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 580/1170] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:30 2022] GET /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9 => generated 1315 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:01:32.290191 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-484298a2-4c9c-4b83-ae68-4879c962e62c tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:32.291144 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-484298a2-4c9c-4b83-ae68-4879c962e62c tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 6ec5c954-ce85-4eb3-be16-31ef89f47bf2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:32.313994 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-484298a2-4c9c-4b83-ae68-4879c962e62c tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:32.319574 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-484298a2-4c9c-4b83-ae68-4879c962e62c tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:32.322702 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-484298a2-4c9c-4b83-ae68-4879c962e62c tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:32.324432 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-484298a2-4c9c-4b83-ae68-4879c962e62c tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:32.427814 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f8a51cfa-647b-4fb0-8f4c-deb92fe0d1f6 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:32.449100 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f8a51cfa-647b-4fb0-8f4c-deb92fe0d1f6 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:32.460955 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f8a51cfa-647b-4fb0-8f4c-deb92fe0d1f6 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:32.463679 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f8a51cfa-647b-4fb0-8f4c-deb92fe0d1f6 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1755 microversion: 2.42 time: 1.051160 Jun 20 12:01:32.476671 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 591/1171] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:01:31 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1755 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:01:32.759554 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-698c4ee7-1772-4b48-939a-04eae0116701 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:32.761731 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-698c4ee7-1772-4b48-939a-04eae0116701 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 0c2f393e-08cc-4112-a898-0ef1830570d9] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:32.777335 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-698c4ee7-1772-4b48-939a-04eae0116701 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:32.777789 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-698c4ee7-1772-4b48-939a-04eae0116701 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:32.778806 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-698c4ee7-1772-4b48-939a-04eae0116701 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:32.779429 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-698c4ee7-1772-4b48-939a-04eae0116701 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:33.161104 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-484298a2-4c9c-4b83-ae68-4879c962e62c tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ad0b87eae43f6b7f6ee8fc60cac9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada715b6fd664c06b9ffcdff7f4ecb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:33.174074 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-484298a2-4c9c-4b83-ae68-4879c962e62c tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec5c954-ce85-4eb3-be16-31ef89f47bf2" status: 200 len: 1317 microversion: 2.1 time: 0.891304 Jun 20 12:01:33.177744 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 581/1172] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:32 2022] GET /compute/v2.1/servers/6ec5c954-ce85-4eb3-be16-31ef89f47bf2 => generated 1317 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:01:33.484078 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-29979aec-2ee6-43a6-996c-80b7cef53b78 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:33.484735 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-29979aec-2ee6-43a6-996c-80b7cef53b78 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:33.502330 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-29979aec-2ee6-43a6-996c-80b7cef53b78 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:33.503493 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-29979aec-2ee6-43a6-996c-80b7cef53b78 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:33.504978 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-29979aec-2ee6-43a6-996c-80b7cef53b78 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:33.517257 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-29979aec-2ee6-43a6-996c-80b7cef53b78 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:33.649847 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-698c4ee7-1772-4b48-939a-04eae0116701 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:33.676945 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-698c4ee7-1772-4b48-939a-04eae0116701 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9" status: 200 len: 1315 microversion: 2.1 time: 0.910502 Jun 20 12:01:33.677684 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 592/1173] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:32 2022] GET /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9 => generated 1315 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:01:33.967730 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-29979aec-2ee6-43a6-996c-80b7cef53b78 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:33.996276 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-29979aec-2ee6-43a6-996c-80b7cef53b78 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:33.999922 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-29979aec-2ee6-43a6-996c-80b7cef53b78 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:34.023838 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-29979aec-2ee6-43a6-996c-80b7cef53b78 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1755 microversion: 2.42 time: 0.543218 Jun 20 12:01:34.024847 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 582/1174] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:01:33 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1755 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:01:34.195283 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-85d03168-495d-4f6f-8e92-8a1d5bd99721 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:34.196629 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-85d03168-495d-4f6f-8e92-8a1d5bd99721 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 6ec5c954-ce85-4eb3-be16-31ef89f47bf2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:34.224163 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bb565d35-20d2-4d5b-9153-e2169960c4ac tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63df072b-0912-4ef8-8a2f-5ba514117165", "device": "/dev/xvdb"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:01:34.226079 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-85d03168-495d-4f6f-8e92-8a1d5bd99721 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:34.226418 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bb565d35-20d2-4d5b-9153-e2169960c4ac tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:34.227003 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-85d03168-495d-4f6f-8e92-8a1d5bd99721 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:34.228030 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-85d03168-495d-4f6f-8e92-8a1d5bd99721 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:34.228720 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-85d03168-495d-4f6f-8e92-8a1d5bd99721 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:34.248278 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bb565d35-20d2-4d5b-9153-e2169960c4ac tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:34.248737 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bb565d35-20d2-4d5b-9153-e2169960c4ac tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:34.256180 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bb565d35-20d2-4d5b-9153-e2169960c4ac tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:34.258861 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bb565d35-20d2-4d5b-9153-e2169960c4ac tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:34.759950 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bb565d35-20d2-4d5b-9153-e2169960c4ac tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "POST /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.543067 Jun 20 12:01:34.760626 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 583/1175] 10.222.0.27 () {62 vars in 1363 bytes} [Mon Jun 20 12:01:34 2022] POST /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed/os-volume_attachments => generated 194 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:01:34.975682 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-9260aa7e-7f70-41b8-adb7-b4febdfde48c req-7faa8584-6141-4e82-95e3-32a17206ebbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c2f393e-08cc-4112-a898-0ef1830570d9", "name": "network-vif-plugged", "status": "completed", "tag": "432208f0-522f-47e6-b7ce-adb33fb6b55e"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:01:34.996727 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-9260aa7e-7f70-41b8-adb7-b4febdfde48c req-7faa8584-6141-4e82-95e3-32a17206ebbb service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:34.998270 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-9260aa7e-7f70-41b8-adb7-b4febdfde48c req-7faa8584-6141-4e82-95e3-32a17206ebbb service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:35.020722 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-9260aa7e-7f70-41b8-adb7-b4febdfde48c req-7faa8584-6141-4e82-95e3-32a17206ebbb service nova] Creating event network-vif-plugged:432208f0-522f-47e6-b7ce-adb33fb6b55e for instance 0c2f393e-08cc-4112-a898-0ef1830570d9 on n-h1-master-1 Jun 20 12:01:35.027442 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-9260aa7e-7f70-41b8-adb7-b4febdfde48c req-7faa8584-6141-4e82-95e3-32a17206ebbb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.265435 Jun 20 12:01:35.028542 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 584/1176] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:01:35.036486 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6c578d27-3775-4ea5-b1c8-f3afcbc157f6 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:35.037518 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6c578d27-3775-4ea5-b1c8-f3afcbc157f6 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 0c2f393e-08cc-4112-a898-0ef1830570d9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:35.045618 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c578d27-3775-4ea5-b1c8-f3afcbc157f6 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:35.046366 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c578d27-3775-4ea5-b1c8-f3afcbc157f6 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:35.047943 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c578d27-3775-4ea5-b1c8-f3afcbc157f6 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:35.049960 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c578d27-3775-4ea5-b1c8-f3afcbc157f6 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:35.420834 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-85d03168-495d-4f6f-8e92-8a1d5bd99721 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ad0b87eae43f6b7f6ee8fc60cac9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada715b6fd664c06b9ffcdff7f4ecb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:35.433165 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-85d03168-495d-4f6f-8e92-8a1d5bd99721 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec5c954-ce85-4eb3-be16-31ef89f47bf2" status: 200 len: 1317 microversion: 2.1 time: 1.243174 Jun 20 12:01:35.434265 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 593/1177] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:34 2022] GET /compute/v2.1/servers/6ec5c954-ce85-4eb3-be16-31ef89f47bf2 => generated 1317 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:01:35.450956 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-21342882-4d89-4a6e-bdd1-a7f44832721d tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:35.458617 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-21342882-4d89-4a6e-bdd1-a7f44832721d tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:35.480408 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-21342882-4d89-4a6e-bdd1-a7f44832721d tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:35.481397 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-21342882-4d89-4a6e-bdd1-a7f44832721d tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:35.482470 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-21342882-4d89-4a6e-bdd1-a7f44832721d tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:35.483453 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-21342882-4d89-4a6e-bdd1-a7f44832721d tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:35.522887 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6c578d27-3775-4ea5-b1c8-f3afcbc157f6 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:35.536417 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6c578d27-3775-4ea5-b1c8-f3afcbc157f6 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9" status: 200 len: 1315 microversion: 2.1 time: 0.503844 Jun 20 12:01:35.545878 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 585/1178] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:35 2022] GET /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9 => generated 1315 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:01:36.301100 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-21342882-4d89-4a6e-bdd1-a7f44832721d tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:36.318059 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-21342882-4d89-4a6e-bdd1-a7f44832721d tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:36.324490 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-21342882-4d89-4a6e-bdd1-a7f44832721d tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:36.328780 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-21342882-4d89-4a6e-bdd1-a7f44832721d tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1802 microversion: 2.42 time: 0.891299 Jun 20 12:01:36.330960 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 594/1179] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:01:35 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1802 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:01:36.451911 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ec4d0e3e-c75c-4ab3-837b-50a70dfd4c1b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:36.452654 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ec4d0e3e-c75c-4ab3-837b-50a70dfd4c1b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 6ec5c954-ce85-4eb3-be16-31ef89f47bf2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:36.465709 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ec4d0e3e-c75c-4ab3-837b-50a70dfd4c1b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:36.466167 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ec4d0e3e-c75c-4ab3-837b-50a70dfd4c1b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:36.467030 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ec4d0e3e-c75c-4ab3-837b-50a70dfd4c1b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:36.467708 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ec4d0e3e-c75c-4ab3-837b-50a70dfd4c1b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:36.553790 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5e2cfd19-98a6-476e-8fe3-828fdd179c0e tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:36.554379 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5e2cfd19-98a6-476e-8fe3-828fdd179c0e tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 0c2f393e-08cc-4112-a898-0ef1830570d9] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:36.557655 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:01:36.570642 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e2cfd19-98a6-476e-8fe3-828fdd179c0e tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:36.571550 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e2cfd19-98a6-476e-8fe3-828fdd179c0e tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:36.576025 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e2cfd19-98a6-476e-8fe3-828fdd179c0e tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:36.581119 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e2cfd19-98a6-476e-8fe3-828fdd179c0e tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:36.742418 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ec4d0e3e-c75c-4ab3-837b-50a70dfd4c1b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ad0b87eae43f6b7f6ee8fc60cac9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada715b6fd664c06b9ffcdff7f4ecb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:36.751974 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ec4d0e3e-c75c-4ab3-837b-50a70dfd4c1b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec5c954-ce85-4eb3-be16-31ef89f47bf2" status: 200 len: 1317 microversion: 2.1 time: 0.304787 Jun 20 12:01:36.753267 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 586/1180] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:36 2022] GET /compute/v2.1/servers/6ec5c954-ce85-4eb3-be16-31ef89f47bf2 => generated 1317 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:01:37.252893 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5e2cfd19-98a6-476e-8fe3-828fdd179c0e tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:37.258146 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-330f29c8-b592-4db6-91e0-66860a25c355 req-9fe3a2e4-8f19-4969-8235-6fa83e92bb29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ec5c954-ce85-4eb3-be16-31ef89f47bf2", "name": "network-vif-plugged", "status": "completed", "tag": "5d77b210-d5fc-4f5f-99cb-0e76e6b76970"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:01:37.276754 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-330f29c8-b592-4db6-91e0-66860a25c355 req-9fe3a2e4-8f19-4969-8235-6fa83e92bb29 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:37.277201 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-330f29c8-b592-4db6-91e0-66860a25c355 req-9fe3a2e4-8f19-4969-8235-6fa83e92bb29 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:37.281013 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5e2cfd19-98a6-476e-8fe3-828fdd179c0e tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9" status: 200 len: 1315 microversion: 2.1 time: 0.720680 Jun 20 12:01:37.281865 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 595/1181] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:36 2022] GET /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9 => generated 1315 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:01:37.309056 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-330f29c8-b592-4db6-91e0-66860a25c355 req-9fe3a2e4-8f19-4969-8235-6fa83e92bb29 service nova] Creating event network-vif-plugged:5d77b210-d5fc-4f5f-99cb-0e76e6b76970 for instance 6ec5c954-ce85-4eb3-be16-31ef89f47bf2 on n-h2-master-1 Jun 20 12:01:37.318672 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-330f29c8-b592-4db6-91e0-66860a25c355 req-9fe3a2e4-8f19-4969-8235-6fa83e92bb29 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064048 Jun 20 12:01:37.321934 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 587/1182] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:01:37.353218 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-87caab09-c5c3-4409-8494-e3a2f301a467 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:37.354111 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-87caab09-c5c3-4409-8494-e3a2f301a467 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:37.368273 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-87caab09-c5c3-4409-8494-e3a2f301a467 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:37.369082 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-87caab09-c5c3-4409-8494-e3a2f301a467 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:37.370181 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-87caab09-c5c3-4409-8494-e3a2f301a467 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:37.370866 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-87caab09-c5c3-4409-8494-e3a2f301a467 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:37.771695 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f7bae458-e100-4a8f-81ed-ba8398bd0ba0 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:37.772435 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f7bae458-e100-4a8f-81ed-ba8398bd0ba0 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 6ec5c954-ce85-4eb3-be16-31ef89f47bf2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:37.785341 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f7bae458-e100-4a8f-81ed-ba8398bd0ba0 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:37.785819 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f7bae458-e100-4a8f-81ed-ba8398bd0ba0 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:37.786858 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f7bae458-e100-4a8f-81ed-ba8398bd0ba0 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:37.787294 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f7bae458-e100-4a8f-81ed-ba8398bd0ba0 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:38.039359 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f7bae458-e100-4a8f-81ed-ba8398bd0ba0 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ad0b87eae43f6b7f6ee8fc60cac9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada715b6fd664c06b9ffcdff7f4ecb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:38.054829 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f7bae458-e100-4a8f-81ed-ba8398bd0ba0 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec5c954-ce85-4eb3-be16-31ef89f47bf2" status: 200 len: 1317 microversion: 2.1 time: 0.288846 Jun 20 12:01:38.055435 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 588/1183] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:37 2022] GET /compute/v2.1/servers/6ec5c954-ce85-4eb3-be16-31ef89f47bf2 => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:01:38.298682 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b4d7e1a5-3f4d-43de-bce5-a31a7ad671bc tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:38.299288 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b4d7e1a5-3f4d-43de-bce5-a31a7ad671bc tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 0c2f393e-08cc-4112-a898-0ef1830570d9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:38.311911 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b4d7e1a5-3f4d-43de-bce5-a31a7ad671bc tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:38.312392 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b4d7e1a5-3f4d-43de-bce5-a31a7ad671bc tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:38.313174 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b4d7e1a5-3f4d-43de-bce5-a31a7ad671bc tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:38.316466 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b4d7e1a5-3f4d-43de-bce5-a31a7ad671bc tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:38.393175 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-87caab09-c5c3-4409-8494-e3a2f301a467 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:38.428480 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-87caab09-c5c3-4409-8494-e3a2f301a467 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:38.442454 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-87caab09-c5c3-4409-8494-e3a2f301a467 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:38.445149 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-87caab09-c5c3-4409-8494-e3a2f301a467 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1802 microversion: 2.42 time: 1.096378 Jun 20 12:01:38.450918 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 596/1184] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:01:37 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1802 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:01:38.600885 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b4d7e1a5-3f4d-43de-bce5-a31a7ad671bc tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:38.610156 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:01:38.616243 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b4d7e1a5-3f4d-43de-bce5-a31a7ad671bc tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9" status: 200 len: 1502 microversion: 2.1 time: 0.321442 Jun 20 12:01:38.618293 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 589/1185] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:38 2022] GET /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9 => generated 1502 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:01:38.635826 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6a8b7452-49f3-4fa9-b3bc-e053462050ce tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:38.638828 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6a8b7452-49f3-4fa9-b3bc-e053462050ce tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 0c2f393e-08cc-4112-a898-0ef1830570d9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:38.649566 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6a8b7452-49f3-4fa9-b3bc-e053462050ce tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:38.650459 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6a8b7452-49f3-4fa9-b3bc-e053462050ce tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:38.651594 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6a8b7452-49f3-4fa9-b3bc-e053462050ce tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:38.652604 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6a8b7452-49f3-4fa9-b3bc-e053462050ce tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:38.707374 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6a8b7452-49f3-4fa9-b3bc-e053462050ce tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 0c2f393e-08cc-4112-a898-0ef1830570d9] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:01:38.779337 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-75a68d25-9580-47af-a0df-d1821ebdc0b2 tempest-ImagesDeleteNegativeTestJSON-825452504 tempest-ImagesDeleteNegativeTestJSON-825452504-project] 10.222.0.27 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.290839 Jun 20 12:01:38.791367 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 597/1186] 10.222.0.27 () {58 vars in 1127 bytes} [Mon Jun 20 12:01:38 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 20 12:01:38.804266 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ead94eb5-35bb-495a-b33e-91d056afabd7 tempest-ImagesDeleteNegativeTestJSON-825452504 tempest-ImagesDeleteNegativeTestJSON-825452504-project] Calling method '.version_select at 0x7f607361ec10>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:38.829160 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6a8b7452-49f3-4fa9-b3bc-e053462050ce tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9" status: 204 len: 0 microversion: 2.1 time: 0.197801 Jun 20 12:01:38.835180 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 590/1187] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:01:38 2022] DELETE /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:01:38.848069 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-72c73ea6-a058-4fbb-b88b-3e7a6690ae83 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:38.849215 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-72c73ea6-a058-4fbb-b88b-3e7a6690ae83 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 0c2f393e-08cc-4112-a898-0ef1830570d9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:38.859279 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:01:38.872362 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-72c73ea6-a058-4fbb-b88b-3e7a6690ae83 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:38.873385 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-72c73ea6-a058-4fbb-b88b-3e7a6690ae83 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:38.875051 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-72c73ea6-a058-4fbb-b88b-3e7a6690ae83 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:38.876176 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-ead94eb5-35bb-495a-b33e-91d056afabd7 tempest-ImagesDeleteNegativeTestJSON-825452504 tempest-ImagesDeleteNegativeTestJSON-825452504-project] HTTP exception thrown: Image not found. Jun 20 12:01:38.876612 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-72c73ea6-a058-4fbb-b88b-3e7a6690ae83 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ead94eb5-35bb-495a-b33e-91d056afabd7 tempest-ImagesDeleteNegativeTestJSON-825452504 tempest-ImagesDeleteNegativeTestJSON-825452504-project] Request method failure captured: Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGGiq1NU6aNdk8fTE5DRRIdxMsIhXDxlf-zgUrUjEqV5lHoEpbrhLSOkTAFflAaYa_GfE8NhzvPr3wuMhVMLROP3oFiJ0H9PynC6WoibkSYG8LxI8rYYkuCrfcsTtpJ4GSkQVfnYvb82PhmoSO8w8WV1MKH1QDVyb_oJGksDW8oJHXU Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 4459ccdb236847a3a11df0bddbc60602 Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-825452504 Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4459ccdb236847a3a11df0bddbc60602"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4459ccdb236847a3a11df0bddbc60602"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4459ccdb236847a3a11df0bddbc60602"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4459ccdb236847a3a11df0bddbc60602"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-825452504 Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 4459ccdb236847a3a11df0bddbc60602 Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-825452504 Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ImagesDeleteNegativeTestJSON-825452504-project Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 15ece6a90ec5419c8c6807c7d0a448ac Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-825452504-project Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: exception: Image not found. Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '-1'} Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:38.881058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:38.886664 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:38.886664 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:38.886664 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:01:38.886664 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:01:38.886664 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:01:38.886664 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:01:38.886664 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:01:38.886664 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:01:38.886664 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 20 12:01:38.886664 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 20 12:01:38.886664 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 20 12:01:38.886664 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:38.886664 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:38.886664 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:38.886664 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:38.886664 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:38.886664 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:38.886664 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:01:38.886664 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:01:38.886664 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 20 12:01:38.886664 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:38.892477 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ead94eb5-35bb-495a-b33e-91d056afabd7 tempest-ImagesDeleteNegativeTestJSON-825452504 tempest-ImagesDeleteNegativeTestJSON-825452504-project] Returning 404 to user: Image not found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:01:38.894766 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ead94eb5-35bb-495a-b33e-91d056afabd7 tempest-ImagesDeleteNegativeTestJSON-825452504 tempest-ImagesDeleteNegativeTestJSON-825452504-project] 10.222.0.27 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.101912 Jun 20 12:01:38.895763 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 598/1188] 10.222.0.27 () {58 vars in 1133 bytes} [Mon Jun 20 12:01:38 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:01:38.914039 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1ffb6517-0009-4f95-83c7-883bb8eae151 tempest-ImagesDeleteNegativeTestJSON-825452504 tempest-ImagesDeleteNegativeTestJSON-825452504-project] Calling method '.version_select at 0x7f607361e160>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:38.973748 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-1ffb6517-0009-4f95-83c7-883bb8eae151 tempest-ImagesDeleteNegativeTestJSON-825452504 tempest-ImagesDeleteNegativeTestJSON-825452504-project] HTTP exception thrown: Image not found. Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1ffb6517-0009-4f95-83c7-883bb8eae151 tempest-ImagesDeleteNegativeTestJSON-825452504 tempest-ImagesDeleteNegativeTestJSON-825452504-project] Request method failure captured: Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/images/1a4bd96d-e403-47f6-af8a-35ef6c832ebj HTTP/1.1 Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGGiq1NU6aNdk8fTE5DRRIdxMsIhXDxlf-zgUrUjEqV5lHoEpbrhLSOkTAFflAaYa_GfE8NhzvPr3wuMhVMLROP3oFiJ0H9PynC6WoibkSYG8LxI8rYYkuCrfcsTtpJ4GSkQVfnYvb82PhmoSO8w8WV1MKH1QDVyb_oJGksDW8oJHXU Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 4459ccdb236847a3a11df0bddbc60602 Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-825452504 Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4459ccdb236847a3a11df0bddbc60602"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4459ccdb236847a3a11df0bddbc60602"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4459ccdb236847a3a11df0bddbc60602"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4459ccdb236847a3a11df0bddbc60602"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-825452504 Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 4459ccdb236847a3a11df0bddbc60602 Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-825452504 Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ImagesDeleteNegativeTestJSON-825452504-project Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 15ece6a90ec5419c8c6807c7d0a448ac Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-825452504-project Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: exception: Image not found. Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '1a4bd96d-e403-47f6-af8a-35ef6c832ebj'} Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1a4bd96d-e403-47f6-af8a-35ef6c832ebj to delete Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1a4bd96d-e403-47f6-af8a-35ef6c832ebj could not be found. Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:38.976059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:38.982054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:38.982054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:38.982054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:38.982054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:01:38.982054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:01:38.982054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:01:38.982054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:01:38.982054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:01:38.982054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:01:38.982054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 20 12:01:38.982054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 20 12:01:38.982054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 20 12:01:38.982054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:38.982054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:38.982054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:38.982054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:38.982054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:38.982054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:38.982054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:01:38.982054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:01:38.982054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 20 12:01:38.982054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:38.986023 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1ffb6517-0009-4f95-83c7-883bb8eae151 tempest-ImagesDeleteNegativeTestJSON-825452504 tempest-ImagesDeleteNegativeTestJSON-825452504-project] Returning 404 to user: Image not found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:01:38.987666 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1ffb6517-0009-4f95-83c7-883bb8eae151 tempest-ImagesDeleteNegativeTestJSON-825452504 tempest-ImagesDeleteNegativeTestJSON-825452504-project] 10.222.0.27 "DELETE /compute/v2.1/images/1a4bd96d-e403-47f6-af8a-35ef6c832ebj" status: 404 len: 62 microversion: 2.1 time: 0.085248 Jun 20 12:01:38.988982 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 599/1189] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:38 2022] DELETE /compute/v2.1/images/1a4bd96d-e403-47f6-af8a-35ef6c832ebj => generated 62 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:01:38.999239 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f3a56905-dba9-4e07-9609-7c94b5e53b78 tempest-ImagesDeleteNegativeTestJSON-825452504 tempest-ImagesDeleteNegativeTestJSON-825452504-project] Calling method '.version_select at 0x7f607365c430>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:39.023468 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-f3a56905-dba9-4e07-9609-7c94b5e53b78 tempest-ImagesDeleteNegativeTestJSON-825452504 tempest-ImagesDeleteNegativeTestJSON-825452504-project] HTTP exception thrown: Image not found. Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f3a56905-dba9-4e07-9609-7c94b5e53b78 tempest-ImagesDeleteNegativeTestJSON-825452504 tempest-ImagesDeleteNegativeTestJSON-825452504-project] Request method failure captured: Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/images/964be44e-cd25-44f5-99fc-8871bb39710c1 HTTP/1.1 Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGGiq1NU6aNdk8fTE5DRRIdxMsIhXDxlf-zgUrUjEqV5lHoEpbrhLSOkTAFflAaYa_GfE8NhzvPr3wuMhVMLROP3oFiJ0H9PynC6WoibkSYG8LxI8rYYkuCrfcsTtpJ4GSkQVfnYvb82PhmoSO8w8WV1MKH1QDVyb_oJGksDW8oJHXU Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 4459ccdb236847a3a11df0bddbc60602 Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-825452504 Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4459ccdb236847a3a11df0bddbc60602"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4459ccdb236847a3a11df0bddbc60602"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4459ccdb236847a3a11df0bddbc60602"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4459ccdb236847a3a11df0bddbc60602"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-825452504 Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 4459ccdb236847a3a11df0bddbc60602 Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-825452504 Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ImagesDeleteNegativeTestJSON-825452504-project Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 15ece6a90ec5419c8c6807c7d0a448ac Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-825452504-project Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: exception: Image not found. Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '964be44e-cd25-44f5-99fc-8871bb39710c1'} Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 964be44e-cd25-44f5-99fc-8871bb39710c1 to delete Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 964be44e-cd25-44f5-99fc-8871bb39710c1 could not be found. Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:39.025954 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:39.031608 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:39.031608 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:39.031608 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:39.031608 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:01:39.031608 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:01:39.031608 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:01:39.031608 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:01:39.031608 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:01:39.031608 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:01:39.031608 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 20 12:01:39.031608 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 20 12:01:39.031608 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 20 12:01:39.031608 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:39.031608 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:39.031608 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:39.031608 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:39.031608 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:39.031608 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:39.031608 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:01:39.031608 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:01:39.031608 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 20 12:01:39.031608 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:39.036080 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f3a56905-dba9-4e07-9609-7c94b5e53b78 tempest-ImagesDeleteNegativeTestJSON-825452504 tempest-ImagesDeleteNegativeTestJSON-825452504-project] Returning 404 to user: Image not found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:01:39.037338 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f3a56905-dba9-4e07-9609-7c94b5e53b78 tempest-ImagesDeleteNegativeTestJSON-825452504 tempest-ImagesDeleteNegativeTestJSON-825452504-project] 10.222.0.27 "DELETE /compute/v2.1/images/964be44e-cd25-44f5-99fc-8871bb39710c1" status: 404 len: 62 microversion: 2.1 time: 0.043287 Jun 20 12:01:39.043442 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 600/1190] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:01:38 2022] DELETE /compute/v2.1/images/964be44e-cd25-44f5-99fc-8871bb39710c1 => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 20 12:01:39.049136 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b209ff2a-4c41-4a69-b8a5-cff613a03d31 tempest-ImagesDeleteNegativeTestJSON-825452504 tempest-ImagesDeleteNegativeTestJSON-825452504-project] Calling method '.version_select at 0x7f6073525d30>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:39.078028 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-b209ff2a-4c41-4a69-b8a5-cff613a03d31 tempest-ImagesDeleteNegativeTestJSON-825452504 tempest-ImagesDeleteNegativeTestJSON-825452504-project] HTTP exception thrown: Image not found. Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b209ff2a-4c41-4a69-b8a5-cff613a03d31 tempest-ImagesDeleteNegativeTestJSON-825452504 tempest-ImagesDeleteNegativeTestJSON-825452504-project] Request method failure captured: Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/images/tempest-invalid-705370995 HTTP/1.1 Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGGiq1NU6aNdk8fTE5DRRIdxMsIhXDxlf-zgUrUjEqV5lHoEpbrhLSOkTAFflAaYa_GfE8NhzvPr3wuMhVMLROP3oFiJ0H9PynC6WoibkSYG8LxI8rYYkuCrfcsTtpJ4GSkQVfnYvb82PhmoSO8w8WV1MKH1QDVyb_oJGksDW8oJHXU Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 4459ccdb236847a3a11df0bddbc60602 Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-825452504 Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4459ccdb236847a3a11df0bddbc60602"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4459ccdb236847a3a11df0bddbc60602"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4459ccdb236847a3a11df0bddbc60602"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4459ccdb236847a3a11df0bddbc60602"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-825452504 Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 4459ccdb236847a3a11df0bddbc60602 Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-825452504 Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ImagesDeleteNegativeTestJSON-825452504-project Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 15ece6a90ec5419c8c6807c7d0a448ac Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-825452504-project Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: exception: Image not found. Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'tempest-invalid-705370995'} Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-705370995 to delete Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-705370995 could not be found. Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:39.080615 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:39.086372 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:39.086372 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:39.086372 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:01:39.086372 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:01:39.086372 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:01:39.086372 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:01:39.086372 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:01:39.086372 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:01:39.086372 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 20 12:01:39.086372 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 20 12:01:39.086372 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 20 12:01:39.086372 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:39.086372 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:39.086372 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:39.086372 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:39.086372 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:39.086372 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:39.086372 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:01:39.086372 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:01:39.086372 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 20 12:01:39.086372 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:01:39.086372 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b209ff2a-4c41-4a69-b8a5-cff613a03d31 tempest-ImagesDeleteNegativeTestJSON-825452504 tempest-ImagesDeleteNegativeTestJSON-825452504-project] Returning 404 to user: Image not found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:01:39.086372 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b209ff2a-4c41-4a69-b8a5-cff613a03d31 tempest-ImagesDeleteNegativeTestJSON-825452504 tempest-ImagesDeleteNegativeTestJSON-825452504-project] 10.222.0.27 "DELETE /compute/v2.1/images/tempest-invalid-705370995" status: 404 len: 62 microversion: 2.1 time: 0.037857 Jun 20 12:01:39.099239 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 601/1191] 10.222.0.27 () {58 vars in 1202 bytes} [Mon Jun 20 12:01:39 2022] DELETE /compute/v2.1/images/tempest-invalid-705370995 => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:01:39.121528 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bee23485-1bcc-41f8-8fb8-3dd627f247ce tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:39.127103 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bee23485-1bcc-41f8-8fb8-3dd627f247ce tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 6ec5c954-ce85-4eb3-be16-31ef89f47bf2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:39.137102 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bee23485-1bcc-41f8-8fb8-3dd627f247ce tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:39.138488 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bee23485-1bcc-41f8-8fb8-3dd627f247ce tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:39.140312 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bee23485-1bcc-41f8-8fb8-3dd627f247ce tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:39.141045 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bee23485-1bcc-41f8-8fb8-3dd627f247ce tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:39.367066 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-72c73ea6-a058-4fbb-b88b-3e7a6690ae83 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:39.377114 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-72c73ea6-a058-4fbb-b88b-3e7a6690ae83 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9" status: 200 len: 1508 microversion: 2.1 time: 0.537641 Jun 20 12:01:39.377770 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 591/1192] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:38 2022] GET /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9 => generated 1508 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:01:39.397205 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f0928f42-163e-4abc-9025-774ad99fe960 tempest-ImagesDeleteNegativeTestJSON-825452504 tempest-ImagesDeleteNegativeTestJSON-825452504-project] Calling method '.version_select at 0x7f60733d81f0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:39.425646 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-f0928f42-163e-4abc-9025-774ad99fe960 tempest-ImagesDeleteNegativeTestJSON-825452504 tempest-ImagesDeleteNegativeTestJSON-825452504-project] HTTP exception thrown: Image not found. Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f0928f42-163e-4abc-9025-774ad99fe960 tempest-ImagesDeleteNegativeTestJSON-825452504 tempest-ImagesDeleteNegativeTestJSON-825452504-project] Request method failure captured: Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/images/fe06a9a6-dcc8-4cc2-81bd-8560e8460be4 HTTP/1.1 Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGGiq1NU6aNdk8fTE5DRRIdxMsIhXDxlf-zgUrUjEqV5lHoEpbrhLSOkTAFflAaYa_GfE8NhzvPr3wuMhVMLROP3oFiJ0H9PynC6WoibkSYG8LxI8rYYkuCrfcsTtpJ4GSkQVfnYvb82PhmoSO8w8WV1MKH1QDVyb_oJGksDW8oJHXU Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 4459ccdb236847a3a11df0bddbc60602 Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-825452504 Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4459ccdb236847a3a11df0bddbc60602"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4459ccdb236847a3a11df0bddbc60602"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4459ccdb236847a3a11df0bddbc60602"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4459ccdb236847a3a11df0bddbc60602"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-825452504 Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 4459ccdb236847a3a11df0bddbc60602 Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-825452504 Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ImagesDeleteNegativeTestJSON-825452504-project Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 15ece6a90ec5419c8c6807c7d0a448ac Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-825452504-project Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: exception: Image not found. Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'fe06a9a6-dcc8-4cc2-81bd-8560e8460be4'} Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image fe06a9a6-dcc8-4cc2-81bd-8560e8460be4 to delete Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fe06a9a6-dcc8-4cc2-81bd-8560e8460be4 could not be found. Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:39.427906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:39.432687 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:39.432687 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:39.432687 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:39.432687 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:01:39.432687 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:01:39.432687 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:01:39.432687 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:01:39.432687 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:01:39.432687 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:01:39.432687 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 20 12:01:39.432687 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 20 12:01:39.432687 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 20 12:01:39.432687 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:39.432687 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:39.432687 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:39.432687 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:39.432687 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:39.432687 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:39.432687 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:01:39.432687 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:01:39.432687 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 20 12:01:39.432687 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:39.432687 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f0928f42-163e-4abc-9025-774ad99fe960 tempest-ImagesDeleteNegativeTestJSON-825452504 tempest-ImagesDeleteNegativeTestJSON-825452504-project] Returning 404 to user: Image not found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:01:39.432687 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f0928f42-163e-4abc-9025-774ad99fe960 tempest-ImagesDeleteNegativeTestJSON-825452504 tempest-ImagesDeleteNegativeTestJSON-825452504-project] 10.222.0.27 "DELETE /compute/v2.1/images/fe06a9a6-dcc8-4cc2-81bd-8560e8460be4" status: 404 len: 62 microversion: 2.1 time: 0.040543 Jun 20 12:01:39.432687 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 592/1193] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:39 2022] DELETE /compute/v2.1/images/fe06a9a6-dcc8-4cc2-81bd-8560e8460be4 => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:01:39.465848 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ee80c6e9-5bb0-40e4-a54d-49da319c14da tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:39.467025 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ee80c6e9-5bb0-40e4-a54d-49da319c14da tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:39.475949 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee80c6e9-5bb0-40e4-a54d-49da319c14da tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:39.477101 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee80c6e9-5bb0-40e4-a54d-49da319c14da tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:39.478552 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee80c6e9-5bb0-40e4-a54d-49da319c14da tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:39.479243 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee80c6e9-5bb0-40e4-a54d-49da319c14da tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:39.864018 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ee80c6e9-5bb0-40e4-a54d-49da319c14da tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:39.879300 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ee80c6e9-5bb0-40e4-a54d-49da319c14da tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:39.886282 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ee80c6e9-5bb0-40e4-a54d-49da319c14da tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:39.887710 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ee80c6e9-5bb0-40e4-a54d-49da319c14da tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1849 microversion: 2.42 time: 0.426369 Jun 20 12:01:39.890758 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 593/1194] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:01:39 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1849 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:01:40.400599 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a413e941-6a66-4bc9-8458-adee1a33ce2f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:40.405564 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a413e941-6a66-4bc9-8458-adee1a33ce2f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 0c2f393e-08cc-4112-a898-0ef1830570d9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:40.442301 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a413e941-6a66-4bc9-8458-adee1a33ce2f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:40.443366 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a413e941-6a66-4bc9-8458-adee1a33ce2f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:40.446586 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a413e941-6a66-4bc9-8458-adee1a33ce2f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:40.447054 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a413e941-6a66-4bc9-8458-adee1a33ce2f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:40.785693 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-bee23485-1bcc-41f8-8fb8-3dd627f247ce tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ad0b87eae43f6b7f6ee8fc60cac9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada715b6fd664c06b9ffcdff7f4ecb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:40.798984 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bee23485-1bcc-41f8-8fb8-3dd627f247ce tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec5c954-ce85-4eb3-be16-31ef89f47bf2" status: 200 len: 1317 microversion: 2.1 time: 1.698452 Jun 20 12:01:40.809838 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 602/1195] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:39 2022] GET /compute/v2.1/servers/6ec5c954-ce85-4eb3-be16-31ef89f47bf2 => generated 1317 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:01:40.851499 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a413e941-6a66-4bc9-8458-adee1a33ce2f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:40.863462 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a413e941-6a66-4bc9-8458-adee1a33ce2f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9" status: 200 len: 1508 microversion: 2.1 time: 0.470594 Jun 20 12:01:40.872808 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 594/1196] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:40 2022] GET /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9 => generated 1508 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:01:40.912591 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4990c5cd-07a6-4b18-9ac9-d4eaf9afd3a5 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:40.913525 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4990c5cd-07a6-4b18-9ac9-d4eaf9afd3a5 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:40.928800 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4990c5cd-07a6-4b18-9ac9-d4eaf9afd3a5 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:40.929568 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4990c5cd-07a6-4b18-9ac9-d4eaf9afd3a5 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:40.931962 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4990c5cd-07a6-4b18-9ac9-d4eaf9afd3a5 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:40.932783 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4990c5cd-07a6-4b18-9ac9-d4eaf9afd3a5 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:41.347890 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:01:41.838392 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e7e6a06b-714d-453e-a88e-50d5d2a4faae tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:41.844385 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e7e6a06b-714d-453e-a88e-50d5d2a4faae tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 6ec5c954-ce85-4eb3-be16-31ef89f47bf2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:41.864818 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e7e6a06b-714d-453e-a88e-50d5d2a4faae tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:41.865413 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e7e6a06b-714d-453e-a88e-50d5d2a4faae tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:41.866546 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e7e6a06b-714d-453e-a88e-50d5d2a4faae tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:41.868650 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e7e6a06b-714d-453e-a88e-50d5d2a4faae tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:42.061036 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e7e6a06b-714d-453e-a88e-50d5d2a4faae tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ad0b87eae43f6b7f6ee8fc60cac9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada715b6fd664c06b9ffcdff7f4ecb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:42.072806 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e7e6a06b-714d-453e-a88e-50d5d2a4faae tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec5c954-ce85-4eb3-be16-31ef89f47bf2" status: 200 len: 1507 microversion: 2.1 time: 0.257187 Jun 20 12:01:42.074298 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 595/1197] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:41 2022] GET /compute/v2.1/servers/6ec5c954-ce85-4eb3-be16-31ef89f47bf2 => generated 1507 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:01:42.078951 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-36c7694e-341c-4304-8c38-3f4aa89994cf tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:42.079753 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-36c7694e-341c-4304-8c38-3f4aa89994cf tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 0c2f393e-08cc-4112-a898-0ef1830570d9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:42.088235 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36c7694e-341c-4304-8c38-3f4aa89994cf tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:42.088703 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36c7694e-341c-4304-8c38-3f4aa89994cf tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:42.089523 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36c7694e-341c-4304-8c38-3f4aa89994cf tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:42.089964 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36c7694e-341c-4304-8c38-3f4aa89994cf tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:42.185811 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4990c5cd-07a6-4b18-9ac9-d4eaf9afd3a5 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:42.190773 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:01:42.227136 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4990c5cd-07a6-4b18-9ac9-d4eaf9afd3a5 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:42.230938 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4990c5cd-07a6-4b18-9ac9-d4eaf9afd3a5 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:42.232134 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4990c5cd-07a6-4b18-9ac9-d4eaf9afd3a5 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1849 microversion: 2.42 time: 1.324884 Jun 20 12:01:42.244176 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 603/1198] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:01:40 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1849 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:01:42.408552 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-36c7694e-341c-4304-8c38-3f4aa89994cf tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:42.428303 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-36c7694e-341c-4304-8c38-3f4aa89994cf tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9" status: 200 len: 1508 microversion: 2.1 time: 0.352629 Jun 20 12:01:42.429285 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 596/1199] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:42 2022] GET /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9 => generated 1508 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:01:42.788876 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-d75f1e4d-4abb-466a-b28a-a31c9cc2f3ad req-5e03f509-1fcc-4e96-8912-b9e102734c54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f59e801d-2548-4edc-8283-af47c991d92a", "tag": "32d33855-eec9-4f47-8a63-741b0283b523"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:01:42.809903 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-d75f1e4d-4abb-466a-b28a-a31c9cc2f3ad req-5e03f509-1fcc-4e96-8912-b9e102734c54 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:42.810342 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-d75f1e4d-4abb-466a-b28a-a31c9cc2f3ad req-5e03f509-1fcc-4e96-8912-b9e102734c54 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:42.831352 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-d75f1e4d-4abb-466a-b28a-a31c9cc2f3ad req-5e03f509-1fcc-4e96-8912-b9e102734c54 service nova] Creating event network-changed:32d33855-eec9-4f47-8a63-741b0283b523 for instance f59e801d-2548-4edc-8283-af47c991d92a on n-h2-master-1 Jun 20 12:01:42.850071 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-d75f1e4d-4abb-466a-b28a-a31c9cc2f3ad req-5e03f509-1fcc-4e96-8912-b9e102734c54 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065235 Jun 20 12:01:42.851126 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 604/1200] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:01:43.251382 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-61169f18-bdf0-4248-8f6e-c3f867994b69 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:43.252869 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-61169f18-bdf0-4248-8f6e-c3f867994b69 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:43.272043 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-61169f18-bdf0-4248-8f6e-c3f867994b69 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:43.275790 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-61169f18-bdf0-4248-8f6e-c3f867994b69 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:43.277662 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-61169f18-bdf0-4248-8f6e-c3f867994b69 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:43.278357 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-61169f18-bdf0-4248-8f6e-c3f867994b69 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:43.447737 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-649aabbb-ca3a-4650-8dd9-0aa21b30e1ca tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:43.449156 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-649aabbb-ca3a-4650-8dd9-0aa21b30e1ca tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 0c2f393e-08cc-4112-a898-0ef1830570d9] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:43.473924 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-649aabbb-ca3a-4650-8dd9-0aa21b30e1ca tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:43.474439 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-649aabbb-ca3a-4650-8dd9-0aa21b30e1ca tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:43.486552 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-649aabbb-ca3a-4650-8dd9-0aa21b30e1ca tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:43.486979 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-649aabbb-ca3a-4650-8dd9-0aa21b30e1ca tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:43.967076 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-649aabbb-ca3a-4650-8dd9-0aa21b30e1ca tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:44.011191 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-649aabbb-ca3a-4650-8dd9-0aa21b30e1ca tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9" status: 200 len: 1466 microversion: 2.1 time: 0.569462 Jun 20 12:01:44.014828 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 605/1201] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:43 2022] GET /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9 => generated 1466 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:01:44.742616 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-61169f18-bdf0-4248-8f6e-c3f867994b69 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:44.768125 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-61169f18-bdf0-4248-8f6e-c3f867994b69 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:44.778356 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-61169f18-bdf0-4248-8f6e-c3f867994b69 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:44.783201 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-61169f18-bdf0-4248-8f6e-c3f867994b69 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1849 microversion: 2.42 time: 1.532461 Jun 20 12:01:44.786867 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 597/1202] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:01:43 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1849 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:01:44.967047 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-0daf4bb5-2020-4c89-a86f-a2a680e9f9b9 req-f05daa06-7bdf-48de-9af5-a18137deccc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c2f393e-08cc-4112-a898-0ef1830570d9", "name": "network-vif-deleted", "tag": "432208f0-522f-47e6-b7ce-adb33fb6b55e"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:01:44.988443 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-0daf4bb5-2020-4c89-a86f-a2a680e9f9b9 req-f05daa06-7bdf-48de-9af5-a18137deccc0 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:45.013782 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-0daf4bb5-2020-4c89-a86f-a2a680e9f9b9 req-f05daa06-7bdf-48de-9af5-a18137deccc0 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:45.030759 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-12d6ba8e-e7dd-435c-8bf6-4adf207e45a7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:45.031479 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-12d6ba8e-e7dd-435c-8bf6-4adf207e45a7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 0c2f393e-08cc-4112-a898-0ef1830570d9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:45.054274 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-12d6ba8e-e7dd-435c-8bf6-4adf207e45a7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:45.057037 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-12d6ba8e-e7dd-435c-8bf6-4adf207e45a7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:45.061155 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-12d6ba8e-e7dd-435c-8bf6-4adf207e45a7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:45.066182 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-12d6ba8e-e7dd-435c-8bf6-4adf207e45a7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:45.071066 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-0daf4bb5-2020-4c89-a86f-a2a680e9f9b9 req-f05daa06-7bdf-48de-9af5-a18137deccc0 service nova] Creating event network-vif-deleted:432208f0-522f-47e6-b7ce-adb33fb6b55e for instance 0c2f393e-08cc-4112-a898-0ef1830570d9 on n-h1-master-1 Jun 20 12:01:45.085522 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-0daf4bb5-2020-4c89-a86f-a2a680e9f9b9 req-f05daa06-7bdf-48de-9af5-a18137deccc0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121934 Jun 20 12:01:45.089957 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 606/1203] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:01:45.130589 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-12d6ba8e-e7dd-435c-8bf6-4adf207e45a7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] HTTP exception thrown: Instance 0c2f393e-08cc-4112-a898-0ef1830570d9 could not be found. Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-12d6ba8e-e7dd-435c-8bf6-4adf207e45a7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Request method failure captured: Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9 HTTP/1.1 Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGGM0_Rgon_QXChHIK_Ikyu0N9hux8u1Ms08jFhXlxkRDQgHGZCrxeBLJGVow3P3B7-C_d1lwOFEoVq18fpBt5bYVFsDOyFchFBnf15eYmBoM5W3iquFzY2ZI2UJK0DkPKTj0Fv6tDqgY5whthvLS8glHLsBu0Y3_K5TIG0-QwQVU5w Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 3495d9dc8b714809b2f3f777cbabda29 Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 0c2f393e-08cc-4112-a898-0ef1830570d9 could not be found. Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '0c2f393e-08cc-4112-a898-0ef1830570d9'} Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c2f393e-08cc-4112-a898-0ef1830570d9 could not be found. Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c2f393e-08cc-4112-a898-0ef1830570d9 could not be found. Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:45.135548 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:45.139789 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:45.139789 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:45.139789 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:45.139789 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:01:45.139789 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:01:45.139789 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c2f393e-08cc-4112-a898-0ef1830570d9 could not be found. Jun 20 12:01:45.139789 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:45.139789 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-12d6ba8e-e7dd-435c-8bf6-4adf207e45a7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Returning 404 to user: Instance 0c2f393e-08cc-4112-a898-0ef1830570d9 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:01:45.139789 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-12d6ba8e-e7dd-435c-8bf6-4adf207e45a7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9" status: 404 len: 111 microversion: 2.1 time: 0.112287 Jun 20 12:01:45.151038 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 598/1204] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:45 2022] GET /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:01:45.430927 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6fc44472-4f73-477d-8f60-9dd590468d42 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-917547455", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "25724adf-e301-4183-8c20-574ec029a516"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:01:45.560831 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-6fc44472-4f73-477d-8f60-9dd590468d42 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] validate_networks() for [('25724adf-e301-4183-8c20-574ec029a516', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:01:45.805466 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e8edc40c-7a90-4f25-874b-4d1a7a66747b tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:45.807819 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e8edc40c-7a90-4f25-874b-4d1a7a66747b tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:45.835897 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e8edc40c-7a90-4f25-874b-4d1a7a66747b tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:45.838205 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e8edc40c-7a90-4f25-874b-4d1a7a66747b tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:45.841751 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e8edc40c-7a90-4f25-874b-4d1a7a66747b tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:45.844103 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e8edc40c-7a90-4f25-874b-4d1a7a66747b tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:46.425740 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e8edc40c-7a90-4f25-874b-4d1a7a66747b tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:46.444055 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e8edc40c-7a90-4f25-874b-4d1a7a66747b tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:46.445962 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e8edc40c-7a90-4f25-874b-4d1a7a66747b tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:46.447742 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e8edc40c-7a90-4f25-874b-4d1a7a66747b tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1870 microversion: 2.42 time: 0.646685 Jun 20 12:01:46.453009 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 599/1205] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:01:45 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1870 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:01:47.475934 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6cade94c-a6b0-49ac-99f6-648cf882f3d1 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:47.477652 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6cade94c-a6b0-49ac-99f6-648cf882f3d1 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:47.499117 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6cade94c-a6b0-49ac-99f6-648cf882f3d1 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:47.504290 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6cade94c-a6b0-49ac-99f6-648cf882f3d1 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:47.505427 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6cade94c-a6b0-49ac-99f6-648cf882f3d1 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:47.513614 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6cade94c-a6b0-49ac-99f6-648cf882f3d1 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:47.991823 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6cade94c-a6b0-49ac-99f6-648cf882f3d1 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:48.017374 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6cade94c-a6b0-49ac-99f6-648cf882f3d1 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:48.020162 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6cade94c-a6b0-49ac-99f6-648cf882f3d1 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:48.021984 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6cade94c-a6b0-49ac-99f6-648cf882f3d1 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1870 microversion: 2.42 time: 0.552795 Jun 20 12:01:48.036846 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 600/1206] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:01:47 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1870 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:01:48.050198 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-993ffce6-9e8a-4be8-9831-d0c0bfe4d4cd tempest-VolumesAdminNegativeTest-1650635258 tempest-VolumesAdminNegativeTest-1650635258-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "8b5c1786-b70a-47ae-83b5-f28a80048533"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:01:48.052828 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-993ffce6-9e8a-4be8-9831-d0c0bfe4d4cd tempest-VolumesAdminNegativeTest-1650635258 tempest-VolumesAdminNegativeTest-1650635258-project-admin] [instance: 6ec5c954-ce85-4eb3-be16-31ef89f47bf2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:48.069452 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-993ffce6-9e8a-4be8-9831-d0c0bfe4d4cd tempest-VolumesAdminNegativeTest-1650635258 tempest-VolumesAdminNegativeTest-1650635258-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:48.069914 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-993ffce6-9e8a-4be8-9831-d0c0bfe4d4cd tempest-VolumesAdminNegativeTest-1650635258 tempest-VolumesAdminNegativeTest-1650635258-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:48.070737 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-993ffce6-9e8a-4be8-9831-d0c0bfe4d4cd tempest-VolumesAdminNegativeTest-1650635258 tempest-VolumesAdminNegativeTest-1650635258-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:48.071158 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-993ffce6-9e8a-4be8-9831-d0c0bfe4d4cd tempest-VolumesAdminNegativeTest-1650635258 tempest-VolumesAdminNegativeTest-1650635258-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:48.165960 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-993ffce6-9e8a-4be8-9831-d0c0bfe4d4cd tempest-VolumesAdminNegativeTest-1650635258 tempest-VolumesAdminNegativeTest-1650635258-project-admin] HTTP exception thrown: Volume 02180cdc-bcf0-4fe1-a60a-25230dfecd6e could not be found. Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-993ffce6-9e8a-4be8-9831-d0c0bfe4d4cd tempest-VolumesAdminNegativeTest-1650635258 tempest-VolumesAdminNegativeTest-1650635258-project-admin] Request method failure captured: Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: request: PUT /compute/v2.1/servers/6ec5c954-ce85-4eb3-be16-31ef89f47bf2/os-volume_attachments/02180cdc-bcf0-4fe1-a60a-25230dfecd6e HTTP/1.1 Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 74 Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGEY8NcazffjFVF-ZxS_uy66FDhiKPgFg_dFaQBp0mjl4HblpVugpUGOFES-xGWovVUpC0xC2D8xdrPQWlrKqxB6iAI2rvyBtZxJsxBB1N1evRRXiDXjwGHp7IKjsED6bogT5gq4JQwLtdobuLbeJU9w9-HJvYn54sjBhenfavdMXn4 Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 9ff893063bf94753b94aebf9aaa32072 Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-VolumesAdminNegativeTest-1650635258 Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member,admin Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member,admin Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9ff893063bf94753b94aebf9aaa32072"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9ff893063bf94753b94aebf9aaa32072"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9ff893063bf94753b94aebf9aaa32072"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9ff893063bf94753b94aebf9aaa32072"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-VolumesAdminNegativeTest-1650635258 Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 9ff893063bf94753b94aebf9aaa32072 Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1650635258 Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-VolumesAdminNegativeTest-1650635258-project-admin Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: e88a910aeeaa4892927e635f9a2a6d4c Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-VolumesAdminNegativeTest-1650635258-project-admin Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: {"volumeAttachment": {"volumeId": "8b5c1786-b70a-47ae-83b5-f28a80048533"}} Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: exception: Volume 02180cdc-bcf0-4fe1-a60a-25230dfecd6e could not be found. Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: action_args: {'server_id': '6ec5c954-ce85-4eb3-be16-31ef89f47bf2', 'id': '02180cdc-bcf0-4fe1-a60a-25230dfecd6e', 'body': {'volumeAttachment': {'volumeId': '8b5c1786-b70a-47ae-83b5-f28a80048533'}}} Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 02180cdc-bcf0-4fe1-a60a-25230dfecd6e could not be found. (HTTP 404) (Request-ID: req-194463f6-6b4b-4b2c-bd68-850099a860f2) Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 12:01:48.169324 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 02180cdc-bcf0-4fe1-a60a-25230dfecd6e could not be found. Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 02180cdc-bcf0-4fe1-a60a-25230dfecd6e could not be found. Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 02180cdc-bcf0-4fe1-a60a-25230dfecd6e could not be found. Jun 20 12:01:48.173682 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:01:48.178855 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-993ffce6-9e8a-4be8-9831-d0c0bfe4d4cd tempest-VolumesAdminNegativeTest-1650635258 tempest-VolumesAdminNegativeTest-1650635258-project-admin] Returning 404 to user: Volume 02180cdc-bcf0-4fe1-a60a-25230dfecd6e could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:01:48.178855 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-993ffce6-9e8a-4be8-9831-d0c0bfe4d4cd tempest-VolumesAdminNegativeTest-1650635258 tempest-VolumesAdminNegativeTest-1650635258-project-admin] 10.222.0.27 "PUT /compute/v2.1/servers/6ec5c954-ce85-4eb3-be16-31ef89f47bf2/os-volume_attachments/02180cdc-bcf0-4fe1-a60a-25230dfecd6e" status: 404 len: 109 microversion: 2.1 time: 0.140735 Jun 20 12:01:48.181226 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 601/1207] 10.222.0.27 () {60 vars in 1432 bytes} [Mon Jun 20 12:01:48 2022] PUT /compute/v2.1/servers/6ec5c954-ce85-4eb3-be16-31ef89f47bf2/os-volume_attachments/02180cdc-bcf0-4fe1-a60a-25230dfecd6e => generated 109 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:01:48.193467 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5b0fc95e-eef4-4978-a7ed-b91619e85856 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ecd5865b-b017-4542-89e4-3b6b180988b8"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:01:48.204953 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5b0fc95e-eef4-4978-a7ed-b91619e85856 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] [instance: 1c763272-042e-418c-b2f6-cc2e96f0c54d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:48.222777 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b0fc95e-eef4-4978-a7ed-b91619e85856 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:48.224891 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b0fc95e-eef4-4978-a7ed-b91619e85856 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:48.227442 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b0fc95e-eef4-4978-a7ed-b91619e85856 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:48.232371 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b0fc95e-eef4-4978-a7ed-b91619e85856 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:48.974695 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5b0fc95e-eef4-4978-a7ed-b91619e85856 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] 10.222.0.27 "POST /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.791371 Jun 20 12:01:48.982281 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 602/1208] 10.222.0.27 () {60 vars in 1322 bytes} [Mon Jun 20 12:01:48 2022] POST /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d/os-volume_attachments => generated 194 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:01:49.044548 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-18384d7e-e16f-421f-b3c6-a516214de211 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:49.045777 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-18384d7e-e16f-421f-b3c6-a516214de211 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:49.058654 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-18384d7e-e16f-421f-b3c6-a516214de211 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:49.059661 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-18384d7e-e16f-421f-b3c6-a516214de211 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:49.062816 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-18384d7e-e16f-421f-b3c6-a516214de211 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:49.063637 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-18384d7e-e16f-421f-b3c6-a516214de211 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:49.922480 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-18384d7e-e16f-421f-b3c6-a516214de211 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:49.969074 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-18384d7e-e16f-421f-b3c6-a516214de211 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:49.979226 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-18384d7e-e16f-421f-b3c6-a516214de211 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:49.981469 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-18384d7e-e16f-421f-b3c6-a516214de211 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1870 microversion: 2.42 time: 0.941347 Jun 20 12:01:49.982963 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 603/1209] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:01:49 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1870 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:01:50.623810 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-f7dd12d8-2b46-4afe-83a9-c5e7f817ebf7 req-a840760e-a5cf-4990-b49c-3502780c4348 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f59e801d-2548-4edc-8283-af47c991d92a", "tag": "47ca3986-e119-41f2-8d32-b4933a808468"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:01:50.644083 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-f7dd12d8-2b46-4afe-83a9-c5e7f817ebf7 req-a840760e-a5cf-4990-b49c-3502780c4348 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:50.644569 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-f7dd12d8-2b46-4afe-83a9-c5e7f817ebf7 req-a840760e-a5cf-4990-b49c-3502780c4348 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:50.673492 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-f7dd12d8-2b46-4afe-83a9-c5e7f817ebf7 req-a840760e-a5cf-4990-b49c-3502780c4348 service nova] Creating event network-changed:47ca3986-e119-41f2-8d32-b4933a808468 for instance f59e801d-2548-4edc-8283-af47c991d92a on n-h2-master-1 Jun 20 12:01:50.700145 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-f7dd12d8-2b46-4afe-83a9-c5e7f817ebf7 req-a840760e-a5cf-4990-b49c-3502780c4348 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077396 Jun 20 12:01:50.701683 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 604/1210] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:01:50.908630 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-6fc44472-4f73-477d-8f60-9dd590468d42 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:01:50.909212 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-6fc44472-4f73-477d-8f60-9dd590468d42 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:01:50.909960 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-6fc44472-4f73-477d-8f60-9dd590468d42 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:01:50.910501 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-6fc44472-4f73-477d-8f60-9dd590468d42 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:01:50.911036 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-6fc44472-4f73-477d-8f60-9dd590468d42 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:01:50.943947 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6fc44472-4f73-477d-8f60-9dd590468d42 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:50.953268 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6fc44472-4f73-477d-8f60-9dd590468d42 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:50.954379 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6fc44472-4f73-477d-8f60-9dd590468d42 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:50.954935 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6fc44472-4f73-477d-8f60-9dd590468d42 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:51.002361 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-46f14039-c6ec-48f1-bb5f-2c8fef6ef306 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:51.003058 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-46f14039-c6ec-48f1-bb5f-2c8fef6ef306 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:51.016752 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-46f14039-c6ec-48f1-bb5f-2c8fef6ef306 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:51.025106 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-46f14039-c6ec-48f1-bb5f-2c8fef6ef306 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:51.027376 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-46f14039-c6ec-48f1-bb5f-2c8fef6ef306 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:51.029637 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-46f14039-c6ec-48f1-bb5f-2c8fef6ef306 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:51.041387 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-6fc44472-4f73-477d-8f60-9dd590468d42 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Getting quotas for project 7dbe3d6c4b7a41fa8181a805a992c173. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:01:51.075053 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-6fc44472-4f73-477d-8f60-9dd590468d42 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Getting quotas for user 3495d9dc8b714809b2f3f777cbabda29 and project 7dbe3d6c4b7a41fa8181a805a992c173. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:01:51.138871 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6fc44472-4f73-477d-8f60-9dd590468d42 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:01:51.142273 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6fc44472-4f73-477d-8f60-9dd590468d42 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: f678dc35-c774-4c0a-9ebb-579688adecb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:01:51.322347 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6fc44472-4f73-477d-8f60-9dd590468d42 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.894030 Jun 20 12:01:51.332295 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 607/1211] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:01:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 5907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:01:51.347041 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b33c3455-27e7-4d65-a90e-7a043412b026 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:51.348472 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b33c3455-27e7-4d65-a90e-7a043412b026 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: f678dc35-c774-4c0a-9ebb-579688adecb0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:52.004993 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b33c3455-27e7-4d65-a90e-7a043412b026 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:52.019439 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b33c3455-27e7-4d65-a90e-7a043412b026 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0" status: 200 len: 1214 microversion: 2.1 time: 0.684534 Jun 20 12:01:52.034031 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 608/1212] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:51 2022] GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0 => generated 1214 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:01:52.744124 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-46f14039-c6ec-48f1-bb5f-2c8fef6ef306 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:52.768831 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-46f14039-c6ec-48f1-bb5f-2c8fef6ef306 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:52.773124 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-46f14039-c6ec-48f1-bb5f-2c8fef6ef306 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:52.775864 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-46f14039-c6ec-48f1-bb5f-2c8fef6ef306 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1870 microversion: 2.42 time: 1.779119 Jun 20 12:01:52.778702 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 605/1213] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:01:50 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1870 bytes in 1783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:01:53.047821 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6e0b156e-2896-435a-adf3-74ab7d9d49b7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:53.050029 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6e0b156e-2896-435a-adf3-74ab7d9d49b7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: f678dc35-c774-4c0a-9ebb-579688adecb0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:53.065189 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6e0b156e-2896-435a-adf3-74ab7d9d49b7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:53.072954 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6e0b156e-2896-435a-adf3-74ab7d9d49b7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:53.074107 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6e0b156e-2896-435a-adf3-74ab7d9d49b7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:53.075231 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6e0b156e-2896-435a-adf3-74ab7d9d49b7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:53.328451 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6e0b156e-2896-435a-adf3-74ab7d9d49b7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:53.345436 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6e0b156e-2896-435a-adf3-74ab7d9d49b7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0" status: 200 len: 1266 microversion: 2.1 time: 0.301749 Jun 20 12:01:53.346102 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 609/1214] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:53 2022] GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0 => generated 1266 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:01:53.796641 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-eacca158-99dc-4a23-aa49-69b6f789d0be tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:53.797871 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-eacca158-99dc-4a23-aa49-69b6f789d0be tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:53.814390 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eacca158-99dc-4a23-aa49-69b6f789d0be tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:53.824428 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eacca158-99dc-4a23-aa49-69b6f789d0be tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:53.824660 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eacca158-99dc-4a23-aa49-69b6f789d0be tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:53.825199 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eacca158-99dc-4a23-aa49-69b6f789d0be tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:53.841187 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:01:54.363183 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-65da555a-77cc-49f8-8c97-30e1554a992f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:54.363842 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-65da555a-77cc-49f8-8c97-30e1554a992f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: f678dc35-c774-4c0a-9ebb-579688adecb0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:54.375197 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65da555a-77cc-49f8-8c97-30e1554a992f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:54.375958 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65da555a-77cc-49f8-8c97-30e1554a992f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:54.379394 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65da555a-77cc-49f8-8c97-30e1554a992f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:54.380022 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65da555a-77cc-49f8-8c97-30e1554a992f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:54.602033 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-65da555a-77cc-49f8-8c97-30e1554a992f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:54.616959 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-65da555a-77cc-49f8-8c97-30e1554a992f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0" status: 200 len: 1272 microversion: 2.1 time: 0.257884 Jun 20 12:01:54.618613 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 610/1215] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:54 2022] GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0 => generated 1272 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:01:54.783068 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-eacca158-99dc-4a23-aa49-69b6f789d0be tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:54.799103 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-eacca158-99dc-4a23-aa49-69b6f789d0be tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:54.803838 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-eacca158-99dc-4a23-aa49-69b6f789d0be tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:54.812466 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-eacca158-99dc-4a23-aa49-69b6f789d0be tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1891 microversion: 2.42 time: 1.019684 Jun 20 12:01:54.813260 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 606/1216] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:01:53 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1891 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:01:55.636483 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-61ceb281-1e49-410a-a1dc-df756235e4a3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:55.637248 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-61ceb281-1e49-410a-a1dc-df756235e4a3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: f678dc35-c774-4c0a-9ebb-579688adecb0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:55.662217 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-61ceb281-1e49-410a-a1dc-df756235e4a3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:55.662668 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-61ceb281-1e49-410a-a1dc-df756235e4a3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:55.677076 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-61ceb281-1e49-410a-a1dc-df756235e4a3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:55.677544 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-61ceb281-1e49-410a-a1dc-df756235e4a3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:55.875761 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-201d3d3f-866f-4a1f-a984-6f689d4af9c3 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-937123953", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "273933ae-12c1-46aa-8cec-5d68676765e7"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:01:55.882607 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-61ceb281-1e49-410a-a1dc-df756235e4a3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:55.896991 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-61ceb281-1e49-410a-a1dc-df756235e4a3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0" status: 200 len: 1272 microversion: 2.1 time: 0.265810 Jun 20 12:01:55.907560 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 607/1217] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:55 2022] GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0 => generated 1272 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:01:55.923356 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e3ba3821-4b19-4189-a484-67c3f7615138 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:55.924046 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e3ba3821-4b19-4189-a484-67c3f7615138 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:55.935300 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e3ba3821-4b19-4189-a484-67c3f7615138 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:55.935732 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e3ba3821-4b19-4189-a484-67c3f7615138 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:55.971208 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e3ba3821-4b19-4189-a484-67c3f7615138 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:55.972472 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e3ba3821-4b19-4189-a484-67c3f7615138 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:56.005602 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-201d3d3f-866f-4a1f-a984-6f689d4af9c3 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] validate_networks() for [('273933ae-12c1-46aa-8cec-5d68676765e7', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:01:56.418437 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e3ba3821-4b19-4189-a484-67c3f7615138 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:56.435404 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e3ba3821-4b19-4189-a484-67c3f7615138 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:56.437701 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e3ba3821-4b19-4189-a484-67c3f7615138 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:56.442153 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e3ba3821-4b19-4189-a484-67c3f7615138 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1891 microversion: 2.42 time: 0.531098 Jun 20 12:01:56.444881 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 608/1218] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:01:55 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1891 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:01:56.467424 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-4b7a6cc1-a052-4ba5-9886-697cd70d3767 req-c59bb017-2a02-472b-8468-b99eb3126e66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f59e801d-2548-4edc-8283-af47c991d92a", "tag": "f8436f92-9119-4a95-9ea8-7e547b5c7945"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:01:56.490073 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-4b7a6cc1-a052-4ba5-9886-697cd70d3767 req-c59bb017-2a02-472b-8468-b99eb3126e66 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:56.490793 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-4b7a6cc1-a052-4ba5-9886-697cd70d3767 req-c59bb017-2a02-472b-8468-b99eb3126e66 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:56.521489 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-4b7a6cc1-a052-4ba5-9886-697cd70d3767 req-c59bb017-2a02-472b-8468-b99eb3126e66 service nova] Creating event network-changed:f8436f92-9119-4a95-9ea8-7e547b5c7945 for instance f59e801d-2548-4edc-8283-af47c991d92a on n-h2-master-1 Jun 20 12:01:56.534306 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-4b7a6cc1-a052-4ba5-9886-697cd70d3767 req-c59bb017-2a02-472b-8468-b99eb3126e66 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076804 Jun 20 12:01:56.535429 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 609/1219] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:01:56.917048 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7a277058-d731-41ae-b84a-4fd98ea007cc tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:56.917048 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7a277058-d731-41ae-b84a-4fd98ea007cc tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: f678dc35-c774-4c0a-9ebb-579688adecb0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:56.933681 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7a277058-d731-41ae-b84a-4fd98ea007cc tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:56.948388 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7a277058-d731-41ae-b84a-4fd98ea007cc tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:56.949553 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7a277058-d731-41ae-b84a-4fd98ea007cc tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:56.952161 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7a277058-d731-41ae-b84a-4fd98ea007cc tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:57.118390 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7a277058-d731-41ae-b84a-4fd98ea007cc tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:57.133786 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7a277058-d731-41ae-b84a-4fd98ea007cc tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0" status: 200 len: 1272 microversion: 2.1 time: 0.223223 Jun 20 12:01:57.134809 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 610/1220] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:56 2022] GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0 => generated 1272 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:01:57.463877 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9f0f8dd7-061b-48f7-b9a4-79ccee157703 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:57.464899 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9f0f8dd7-061b-48f7-b9a4-79ccee157703 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:57.489624 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9f0f8dd7-061b-48f7-b9a4-79ccee157703 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:57.489624 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9f0f8dd7-061b-48f7-b9a4-79ccee157703 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:57.490714 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9f0f8dd7-061b-48f7-b9a4-79ccee157703 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:57.497998 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9f0f8dd7-061b-48f7-b9a4-79ccee157703 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:58.105773 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9f0f8dd7-061b-48f7-b9a4-79ccee157703 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:58.129738 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9f0f8dd7-061b-48f7-b9a4-79ccee157703 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:58.132114 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-201d3d3f-866f-4a1f-a984-6f689d4af9c3 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:01:58.132667 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9f0f8dd7-061b-48f7-b9a4-79ccee157703 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:58.134515 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-201d3d3f-866f-4a1f-a984-6f689d4af9c3 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:01:58.135324 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-201d3d3f-866f-4a1f-a984-6f689d4af9c3 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:01:58.135811 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9f0f8dd7-061b-48f7-b9a4-79ccee157703 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1891 microversion: 2.42 time: 0.677309 Jun 20 12:01:58.136101 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-201d3d3f-866f-4a1f-a984-6f689d4af9c3 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:01:58.136727 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-201d3d3f-866f-4a1f-a984-6f689d4af9c3 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:01:58.139179 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 611/1221] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:01:57 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1891 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:01:58.156104 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e59aed39-04ab-47d5-ab5d-66a5c96397c0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:58.157287 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e59aed39-04ab-47d5-ab5d-66a5c96397c0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: f678dc35-c774-4c0a-9ebb-579688adecb0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:58.161632 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-201d3d3f-866f-4a1f-a984-6f689d4af9c3 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:58.162260 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-201d3d3f-866f-4a1f-a984-6f689d4af9c3 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:58.163165 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-201d3d3f-866f-4a1f-a984-6f689d4af9c3 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:58.169759 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-201d3d3f-866f-4a1f-a984-6f689d4af9c3 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:58.170842 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e59aed39-04ab-47d5-ab5d-66a5c96397c0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:58.174697 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e59aed39-04ab-47d5-ab5d-66a5c96397c0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:58.176472 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e59aed39-04ab-47d5-ab5d-66a5c96397c0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:58.177759 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e59aed39-04ab-47d5-ab5d-66a5c96397c0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:58.227521 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-201d3d3f-866f-4a1f-a984-6f689d4af9c3 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Getting quotas for project 953509c8c92e497eb38e96860bbc28ee. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:01:58.235605 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-201d3d3f-866f-4a1f-a984-6f689d4af9c3 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Getting quotas for user 257f6182a93f4cea86956b9894802513 and project 953509c8c92e497eb38e96860bbc28ee. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:01:58.274623 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-201d3d3f-866f-4a1f-a984-6f689d4af9c3 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:01:58.277270 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-201d3d3f-866f-4a1f-a984-6f689d4af9c3 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] [instance: 210b34c5-64e5-4416-ba9d-26ead5ff8a82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:01:58.467898 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-201d3d3f-866f-4a1f-a984-6f689d4af9c3 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.970369 Jun 20 12:01:58.469419 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 611/1222] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:01:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:01:58.490475 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d99fb2c0-a420-4e0d-8172-7a5be65d7c38 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:58.496361 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d99fb2c0-a420-4e0d-8172-7a5be65d7c38 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] [instance: 210b34c5-64e5-4416-ba9d-26ead5ff8a82] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:58.609315 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e59aed39-04ab-47d5-ab5d-66a5c96397c0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:58.621806 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e59aed39-04ab-47d5-ab5d-66a5c96397c0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0" status: 200 len: 1314 microversion: 2.1 time: 0.469733 Jun 20 12:01:58.628568 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 612/1223] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:58 2022] GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0 => generated 1314 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:01:58.919194 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d99fb2c0-a420-4e0d-8172-7a5be65d7c38 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257f6182a93f4cea86956b9894802513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953509c8c92e497eb38e96860bbc28ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:58.928017 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d99fb2c0-a420-4e0d-8172-7a5be65d7c38 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] 10.222.0.27 "GET /compute/v2.1/servers/210b34c5-64e5-4416-ba9d-26ead5ff8a82" status: 200 len: 1216 microversion: 2.1 time: 0.451778 Jun 20 12:01:58.945688 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 612/1224] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:58 2022] GET /compute/v2.1/servers/210b34c5-64e5-4416-ba9d-26ead5ff8a82 => generated 1216 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:01:59.161738 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-da50d344-39f4-4629-89fd-8eabf842a7c4 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:59.162276 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-da50d344-39f4-4629-89fd-8eabf842a7c4 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:59.176302 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da50d344-39f4-4629-89fd-8eabf842a7c4 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:59.176723 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da50d344-39f4-4629-89fd-8eabf842a7c4 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:59.177531 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da50d344-39f4-4629-89fd-8eabf842a7c4 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:59.177985 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da50d344-39f4-4629-89fd-8eabf842a7c4 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:59.640364 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d4b2c76e-60ef-491c-bbea-265dd058c3e3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:01:59.641245 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d4b2c76e-60ef-491c-bbea-265dd058c3e3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: f678dc35-c774-4c0a-9ebb-579688adecb0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:01:59.656360 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4b2c76e-60ef-491c-bbea-265dd058c3e3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:59.657279 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4b2c76e-60ef-491c-bbea-265dd058c3e3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:59.668480 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4b2c76e-60ef-491c-bbea-265dd058c3e3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:59.669731 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4b2c76e-60ef-491c-bbea-265dd058c3e3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:59.837240 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-da50d344-39f4-4629-89fd-8eabf842a7c4 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:59.854778 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-da50d344-39f4-4629-89fd-8eabf842a7c4 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:59.864628 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-da50d344-39f4-4629-89fd-8eabf842a7c4 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:01:59.870252 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-da50d344-39f4-4629-89fd-8eabf842a7c4 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1891 microversion: 2.42 time: 0.712917 Jun 20 12:01:59.870849 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 613/1225] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:01:59 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1891 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:01:59.913803 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-72fe1577-ae48-48f8-8172-a5edbab92ede req-7706a732-3ab3-4ee9-bedf-e24266436519 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f59e801d-2548-4edc-8283-af47c991d92a", "tag": "094c45ad-d8c1-4802-908a-41730c77c870"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:01:59.925140 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-72fe1577-ae48-48f8-8172-a5edbab92ede req-7706a732-3ab3-4ee9-bedf-e24266436519 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:01:59.925498 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-72fe1577-ae48-48f8-8172-a5edbab92ede req-7706a732-3ab3-4ee9-bedf-e24266436519 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:01:59.963116 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-72fe1577-ae48-48f8-8172-a5edbab92ede req-7706a732-3ab3-4ee9-bedf-e24266436519 service nova] Creating event network-changed:094c45ad-d8c1-4802-908a-41730c77c870 for instance f59e801d-2548-4edc-8283-af47c991d92a on n-h2-master-1 Jun 20 12:01:59.981308 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-72fe1577-ae48-48f8-8172-a5edbab92ede req-7706a732-3ab3-4ee9-bedf-e24266436519 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071290 Jun 20 12:01:59.981959 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 614/1226] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:01:59.998803 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c034251a-3b13-4d53-be18-4c3f023037ee tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:00.011392 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c034251a-3b13-4d53-be18-4c3f023037ee tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] [instance: 210b34c5-64e5-4416-ba9d-26ead5ff8a82] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:00.036125 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c034251a-3b13-4d53-be18-4c3f023037ee tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:00.036816 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c034251a-3b13-4d53-be18-4c3f023037ee tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:00.037887 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c034251a-3b13-4d53-be18-4c3f023037ee tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:00.038550 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c034251a-3b13-4d53-be18-4c3f023037ee tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:00.243995 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c034251a-3b13-4d53-be18-4c3f023037ee tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257f6182a93f4cea86956b9894802513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953509c8c92e497eb38e96860bbc28ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:00.264434 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c034251a-3b13-4d53-be18-4c3f023037ee tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] 10.222.0.27 "GET /compute/v2.1/servers/210b34c5-64e5-4416-ba9d-26ead5ff8a82" status: 200 len: 1212 microversion: 2.1 time: 0.275782 Jun 20 12:02:00.267083 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 615/1227] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:59 2022] GET /compute/v2.1/servers/210b34c5-64e5-4416-ba9d-26ead5ff8a82 => generated 1212 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:00.513245 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1fbdc660-1b0a-482c-8fc0-cb7fdd380982 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1776782623", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "448d3162-a599-4fc0-8849-3443fb8e458f"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:02:00.650250 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-1fbdc660-1b0a-482c-8fc0-cb7fdd380982 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] validate_networks() for [('448d3162-a599-4fc0-8849-3443fb8e458f', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:02:00.722786 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d4b2c76e-60ef-491c-bbea-265dd058c3e3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:00.730914 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d4b2c76e-60ef-491c-bbea-265dd058c3e3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0" status: 200 len: 1314 microversion: 2.1 time: 1.095552 Jun 20 12:02:00.739520 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 613/1228] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:01:59 2022] GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0 => generated 1314 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:02:00.896904 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-91c2705c-0c05-4fe7-bfe4-152665f788ca tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:00.897944 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-91c2705c-0c05-4fe7-bfe4-152665f788ca tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:00.909441 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-91c2705c-0c05-4fe7-bfe4-152665f788ca tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:00.910290 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-91c2705c-0c05-4fe7-bfe4-152665f788ca tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:00.911597 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-91c2705c-0c05-4fe7-bfe4-152665f788ca tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:00.916157 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-91c2705c-0c05-4fe7-bfe4-152665f788ca tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:02.235434 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-91c2705c-0c05-4fe7-bfe4-152665f788ca tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:02.255680 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-91c2705c-0c05-4fe7-bfe4-152665f788ca tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:02.266533 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-91c2705c-0c05-4fe7-bfe4-152665f788ca tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:02.273125 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-91c2705c-0c05-4fe7-bfe4-152665f788ca tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1891 microversion: 2.42 time: 1.385967 Jun 20 12:02:02.274502 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 614/1229] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:00 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1891 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:02:02.289223 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0cc7eedc-e809-4d55-995b-aefe6246716e tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:02.292957 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0cc7eedc-e809-4d55-995b-aefe6246716e tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] [instance: 210b34c5-64e5-4416-ba9d-26ead5ff8a82] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:02.328260 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cc7eedc-e809-4d55-995b-aefe6246716e tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:02.328909 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cc7eedc-e809-4d55-995b-aefe6246716e tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:02.329875 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cc7eedc-e809-4d55-995b-aefe6246716e tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:02.330593 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cc7eedc-e809-4d55-995b-aefe6246716e tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:03.488335 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0cc7eedc-e809-4d55-995b-aefe6246716e tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257f6182a93f4cea86956b9894802513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953509c8c92e497eb38e96860bbc28ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:03.502645 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0cc7eedc-e809-4d55-995b-aefe6246716e tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] 10.222.0.27 "GET /compute/v2.1/servers/210b34c5-64e5-4416-ba9d-26ead5ff8a82" status: 200 len: 1274 microversion: 2.1 time: 1.225752 Jun 20 12:02:03.504982 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 615/1230] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:02 2022] GET /compute/v2.1/servers/210b34c5-64e5-4416-ba9d-26ead5ff8a82 => generated 1274 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:03.525471 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8cc98eb7-dec9-41f4-b87d-4385a8413ebe tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:03.528591 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8cc98eb7-dec9-41f4-b87d-4385a8413ebe tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: f678dc35-c774-4c0a-9ebb-579688adecb0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:03.544565 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8cc98eb7-dec9-41f4-b87d-4385a8413ebe tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:03.546391 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8cc98eb7-dec9-41f4-b87d-4385a8413ebe tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:03.547593 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8cc98eb7-dec9-41f4-b87d-4385a8413ebe tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:03.550592 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8cc98eb7-dec9-41f4-b87d-4385a8413ebe tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:04.205243 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-1fbdc660-1b0a-482c-8fc0-cb7fdd380982 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:02:04.205759 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-1fbdc660-1b0a-482c-8fc0-cb7fdd380982 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:02:04.206118 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-1fbdc660-1b0a-482c-8fc0-cb7fdd380982 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:02:04.206521 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-1fbdc660-1b0a-482c-8fc0-cb7fdd380982 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:02:04.206928 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-1fbdc660-1b0a-482c-8fc0-cb7fdd380982 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:02:04.225351 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1fbdc660-1b0a-482c-8fc0-cb7fdd380982 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:04.225797 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1fbdc660-1b0a-482c-8fc0-cb7fdd380982 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:04.226595 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1fbdc660-1b0a-482c-8fc0-cb7fdd380982 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:04.229128 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1fbdc660-1b0a-482c-8fc0-cb7fdd380982 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:04.298385 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-1fbdc660-1b0a-482c-8fc0-cb7fdd380982 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Getting quotas for project f4a572c10cb94add92e01db93f744ef0. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:02:04.328269 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-1fbdc660-1b0a-482c-8fc0-cb7fdd380982 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Getting quotas for user 7ce407df032342ddad0dec89baf9b6ea and project f4a572c10cb94add92e01db93f744ef0. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:02:04.372832 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1fbdc660-1b0a-482c-8fc0-cb7fdd380982 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:02:04.379912 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1fbdc660-1b0a-482c-8fc0-cb7fdd380982 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] [instance: 5c4349cc-0bb9-472f-acc5-e7cf3f616853] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:02:04.542260 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1fbdc660-1b0a-482c-8fc0-cb7fdd380982 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.269711 Jun 20 12:02:04.543620 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 616/1231] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:02:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 4276 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:02:04.564191 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ddf3db5f-2787-4a8c-ab4e-1e0313433416 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:04.566990 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ddf3db5f-2787-4a8c-ab4e-1e0313433416 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 6ec5c954-ce85-4eb3-be16-31ef89f47bf2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:04.593596 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ddf3db5f-2787-4a8c-ab4e-1e0313433416 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:04.609053 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8cc98eb7-dec9-41f4-b87d-4385a8413ebe tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:04.610154 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ddf3db5f-2787-4a8c-ab4e-1e0313433416 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:04.611637 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ddf3db5f-2787-4a8c-ab4e-1e0313433416 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:04.612901 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ddf3db5f-2787-4a8c-ab4e-1e0313433416 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:04.622345 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8cc98eb7-dec9-41f4-b87d-4385a8413ebe tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0" status: 200 len: 1314 microversion: 2.1 time: 1.109517 Jun 20 12:02:04.627111 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 616/1232] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:03 2022] GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0 => generated 1314 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:04.671422 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3fab840e-ca0b-4f0d-ac07-1defd1b2c753 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:04.676846 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3fab840e-ca0b-4f0d-ac07-1defd1b2c753 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:04.683504 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ddf3db5f-2787-4a8c-ab4e-1e0313433416 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 6ec5c954-ce85-4eb3-be16-31ef89f47bf2] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:02:04.706961 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3fab840e-ca0b-4f0d-ac07-1defd1b2c753 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:04.727379 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3fab840e-ca0b-4f0d-ac07-1defd1b2c753 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:04.733709 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3fab840e-ca0b-4f0d-ac07-1defd1b2c753 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:04.734172 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3fab840e-ca0b-4f0d-ac07-1defd1b2c753 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:04.844732 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ddf3db5f-2787-4a8c-ab4e-1e0313433416 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6ec5c954-ce85-4eb3-be16-31ef89f47bf2" status: 204 len: 0 microversion: 2.1 time: 0.299168 Jun 20 12:02:04.845472 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 617/1233] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:02:04 2022] DELETE /compute/v2.1/servers/6ec5c954-ce85-4eb3-be16-31ef89f47bf2 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:02:04.851780 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-cb43b53e-f86f-4beb-8697-7c3ba8de1989 req-900fd6ea-a3f4-4057-b36c-d0d271562c3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f678dc35-c774-4c0a-9ebb-579688adecb0", "tag": "4f3fd793-2c2d-4d98-8201-6c1a6e0b5190"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:02:04.870897 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-cb43b53e-f86f-4beb-8697-7c3ba8de1989 req-900fd6ea-a3f4-4057-b36c-d0d271562c3c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:04.871661 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-cb43b53e-f86f-4beb-8697-7c3ba8de1989 req-900fd6ea-a3f4-4057-b36c-d0d271562c3c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:04.899265 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-cb43b53e-f86f-4beb-8697-7c3ba8de1989 req-900fd6ea-a3f4-4057-b36c-d0d271562c3c service nova] Creating event network-changed:4f3fd793-2c2d-4d98-8201-6c1a6e0b5190 for instance f678dc35-c774-4c0a-9ebb-579688adecb0 on n-h1-master-1 Jun 20 12:02:04.911263 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-cb43b53e-f86f-4beb-8697-7c3ba8de1989 req-900fd6ea-a3f4-4057-b36c-d0d271562c3c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063807 Jun 20 12:02:04.911882 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 618/1234] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:02:04.925651 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8f2cd213-fa80-4274-8cf8-c649bc8529cd tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:04.926520 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8f2cd213-fa80-4274-8cf8-c649bc8529cd tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:04.945937 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8f2cd213-fa80-4274-8cf8-c649bc8529cd tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:04.946451 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8f2cd213-fa80-4274-8cf8-c649bc8529cd tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:04.947266 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8f2cd213-fa80-4274-8cf8-c649bc8529cd tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:04.947703 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8f2cd213-fa80-4274-8cf8-c649bc8529cd tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:05.400904 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-8f2cd213-fa80-4274-8cf8-c649bc8529cd tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lazy-loading 'services' on Instance uuid 3db0bd7d-eed4-411a-a7b8-719b260233ed {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:02:05.445035 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8f2cd213-fa80-4274-8cf8-c649bc8529cd tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 2423 microversion: 2.25 time: 0.530545 Jun 20 12:02:05.446704 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 619/1235] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:04 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 2423 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:05.464777 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-96a1ac3d-c11c-459d-88c0-ea7225ad21f0 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:05.465867 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-96a1ac3d-c11c-459d-88c0-ea7225ad21f0 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] [instance: 210b34c5-64e5-4416-ba9d-26ead5ff8a82] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:05.479961 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-96a1ac3d-c11c-459d-88c0-ea7225ad21f0 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:05.482942 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-96a1ac3d-c11c-459d-88c0-ea7225ad21f0 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:05.486956 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-96a1ac3d-c11c-459d-88c0-ea7225ad21f0 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:05.487832 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-96a1ac3d-c11c-459d-88c0-ea7225ad21f0 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:05.761145 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3fab840e-ca0b-4f0d-ac07-1defd1b2c753 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:05.778509 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3fab840e-ca0b-4f0d-ac07-1defd1b2c753 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:05.786723 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3fab840e-ca0b-4f0d-ac07-1defd1b2c753 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:05.793186 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3fab840e-ca0b-4f0d-ac07-1defd1b2c753 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1879 microversion: 2.42 time: 1.152485 Jun 20 12:02:05.794253 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 617/1236] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:04 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1879 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:05.799617 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8e961ad5-d86e-4bba-97b7-99577e3c2bac tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:05.805753 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8e961ad5-d86e-4bba-97b7-99577e3c2bac tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] [instance: 5c4349cc-0bb9-472f-acc5-e7cf3f616853] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:05.821524 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e961ad5-d86e-4bba-97b7-99577e3c2bac tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:05.829104 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e961ad5-d86e-4bba-97b7-99577e3c2bac tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:05.837732 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e961ad5-d86e-4bba-97b7-99577e3c2bac tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:05.838549 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e961ad5-d86e-4bba-97b7-99577e3c2bac tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:06.049983 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8e961ad5-d86e-4bba-97b7-99577e3c2bac tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce407df032342ddad0dec89baf9b6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a572c10cb94add92e01db93f744ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:06.060488 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8e961ad5-d86e-4bba-97b7-99577e3c2bac tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] 10.222.0.27 "GET /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853" status: 200 len: 1212 microversion: 2.1 time: 0.264878 Jun 20 12:02:06.061123 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 618/1237] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:05 2022] GET /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853 => generated 1212 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:06.084285 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b34cf77d-3c60-43d6-b79c-d07dfd18ba02 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:06.084832 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b34cf77d-3c60-43d6-b79c-d07dfd18ba02 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 6ec5c954-ce85-4eb3-be16-31ef89f47bf2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:06.123512 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b34cf77d-3c60-43d6-b79c-d07dfd18ba02 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:06.123968 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b34cf77d-3c60-43d6-b79c-d07dfd18ba02 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:06.127855 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b34cf77d-3c60-43d6-b79c-d07dfd18ba02 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:06.131404 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b34cf77d-3c60-43d6-b79c-d07dfd18ba02 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:06.586220 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b34cf77d-3c60-43d6-b79c-d07dfd18ba02 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ad0b87eae43f6b7f6ee8fc60cac9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada715b6fd664c06b9ffcdff7f4ecb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:06.595010 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b34cf77d-3c60-43d6-b79c-d07dfd18ba02 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec5c954-ce85-4eb3-be16-31ef89f47bf2" status: 200 len: 1513 microversion: 2.1 time: 0.520058 Jun 20 12:02:06.596406 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 619/1238] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:06 2022] GET /compute/v2.1/servers/6ec5c954-ce85-4eb3-be16-31ef89f47bf2 => generated 1513 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:06.610090 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-96a1ac3d-c11c-459d-88c0-ea7225ad21f0 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257f6182a93f4cea86956b9894802513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953509c8c92e497eb38e96860bbc28ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:06.610927 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7c400cac-a134-451f-aeb4-d9ab2ca02f14 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": "auto"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:02:06.612440 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7c400cac-a134-451f-aeb4-d9ab2ca02f14 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:06.620707 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-96a1ac3d-c11c-459d-88c0-ea7225ad21f0 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] 10.222.0.27 "GET /compute/v2.1/servers/210b34c5-64e5-4416-ba9d-26ead5ff8a82" status: 200 len: 1316 microversion: 2.1 time: 1.172388 Jun 20 12:02:06.638280 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 620/1239] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:05 2022] GET /compute/v2.1/servers/210b34c5-64e5-4416-ba9d-26ead5ff8a82 => generated 1316 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:06.639452 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:06.645701 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7c400cac-a134-451f-aeb4-d9ab2ca02f14 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:06.646539 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7c400cac-a134-451f-aeb4-d9ab2ca02f14 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:06.647781 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7c400cac-a134-451f-aeb4-d9ab2ca02f14 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:06.649678 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-74a816e6-9548-4fa6-870c-0003de31a081 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:06.650355 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-74a816e6-9548-4fa6-870c-0003de31a081 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: f678dc35-c774-4c0a-9ebb-579688adecb0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:06.650788 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7c400cac-a134-451f-aeb4-d9ab2ca02f14 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:06.671735 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-74a816e6-9548-4fa6-870c-0003de31a081 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:06.672462 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-74a816e6-9548-4fa6-870c-0003de31a081 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:06.673451 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-74a816e6-9548-4fa6-870c-0003de31a081 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:06.681749 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-74a816e6-9548-4fa6-870c-0003de31a081 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:06.714344 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-7c400cac-a134-451f-aeb4-d9ab2ca02f14 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lazy-loading 'flavor' on Instance uuid 3db0bd7d-eed4-411a-a7b8-719b260233ed {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:02:06.750500 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7c400cac-a134-451f-aeb4-d9ab2ca02f14 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Going to try to live migrate instance to n-h1-master-1 {{(pid=119128) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 20 12:02:08.199661 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=4 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:08.231371 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-74a816e6-9548-4fa6-870c-0003de31a081 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:08.245624 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-74a816e6-9548-4fa6-870c-0003de31a081 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0" status: 200 len: 1314 microversion: 2.1 time: 1.603981 Jun 20 12:02:08.260889 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 621/1240] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:06 2022] GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0 => generated 1314 bytes in 1622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:08.271270 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4c9e1b34-1e27-4d60-8fdf-bcab76befa3c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:08.273889 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4c9e1b34-1e27-4d60-8fdf-bcab76befa3c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:08.304675 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4c9e1b34-1e27-4d60-8fdf-bcab76befa3c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:08.305775 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4c9e1b34-1e27-4d60-8fdf-bcab76befa3c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:08.311869 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4c9e1b34-1e27-4d60-8fdf-bcab76befa3c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:08.317363 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4c9e1b34-1e27-4d60-8fdf-bcab76befa3c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:08.928843 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=16 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:09.159033 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4c9e1b34-1e27-4d60-8fdf-bcab76befa3c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:09.172055 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4c9e1b34-1e27-4d60-8fdf-bcab76befa3c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:09.187799 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4c9e1b34-1e27-4d60-8fdf-bcab76befa3c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:09.191195 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4c9e1b34-1e27-4d60-8fdf-bcab76befa3c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1879 microversion: 2.42 time: 0.928998 Jun 20 12:02:09.199609 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 622/1241] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:08 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1879 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:09.219028 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-6e8c48ba-cdcb-4938-9e62-4383f33777b5 req-b147e854-9a6b-4c55-8b82-4e3c5d8a41c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f59e801d-2548-4edc-8283-af47c991d92a", "tag": "60eddb1c-4042-4f66-9e7b-bb3e6459de20"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:02:09.246247 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:09.277240 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-6e8c48ba-cdcb-4938-9e62-4383f33777b5 req-b147e854-9a6b-4c55-8b82-4e3c5d8a41c6 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:09.278045 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-6e8c48ba-cdcb-4938-9e62-4383f33777b5 req-b147e854-9a6b-4c55-8b82-4e3c5d8a41c6 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:09.322676 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-6e8c48ba-cdcb-4938-9e62-4383f33777b5 req-b147e854-9a6b-4c55-8b82-4e3c5d8a41c6 service nova] Creating event network-changed:60eddb1c-4042-4f66-9e7b-bb3e6459de20 for instance f59e801d-2548-4edc-8283-af47c991d92a on n-h2-master-1 Jun 20 12:02:09.346659 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-6e8c48ba-cdcb-4938-9e62-4383f33777b5 req-b147e854-9a6b-4c55-8b82-4e3c5d8a41c6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145120 Jun 20 12:02:09.347977 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 623/1242] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:02:09.369381 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-51ae2d89-a314-4be1-9993-fd8474a1ce3b tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:09.370393 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-51ae2d89-a314-4be1-9993-fd8474a1ce3b tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] [instance: 5c4349cc-0bb9-472f-acc5-e7cf3f616853] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:09.384233 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51ae2d89-a314-4be1-9993-fd8474a1ce3b tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:09.391708 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51ae2d89-a314-4be1-9993-fd8474a1ce3b tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:09.401228 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51ae2d89-a314-4be1-9993-fd8474a1ce3b tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:09.410301 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51ae2d89-a314-4be1-9993-fd8474a1ce3b tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:09.469198 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:09.620243 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-51ae2d89-a314-4be1-9993-fd8474a1ce3b tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce407df032342ddad0dec89baf9b6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a572c10cb94add92e01db93f744ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:09.628637 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-51ae2d89-a314-4be1-9993-fd8474a1ce3b tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] 10.222.0.27 "GET /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853" status: 200 len: 1274 microversion: 2.1 time: 0.278960 Jun 20 12:02:09.631801 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 624/1243] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:09 2022] GET /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853 => generated 1274 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:09.646488 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0abcda92-4808-4ff9-834f-f11aa0b2ce5d tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:09.649060 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0abcda92-4808-4ff9-834f-f11aa0b2ce5d tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 6ec5c954-ce85-4eb3-be16-31ef89f47bf2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:09.673380 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0abcda92-4808-4ff9-834f-f11aa0b2ce5d tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:09.674326 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0abcda92-4808-4ff9-834f-f11aa0b2ce5d tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:09.675428 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0abcda92-4808-4ff9-834f-f11aa0b2ce5d tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:09.676626 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0abcda92-4808-4ff9-834f-f11aa0b2ce5d tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:09.695421 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-0abcda92-4808-4ff9-834f-f11aa0b2ce5d tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] HTTP exception thrown: Instance 6ec5c954-ce85-4eb3-be16-31ef89f47bf2 could not be found. Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0abcda92-4808-4ff9-834f-f11aa0b2ce5d tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Request method failure captured: Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/6ec5c954-ce85-4eb3-be16-31ef89f47bf2 HTTP/1.1 Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGEHUjOwPo-Otg4b-Zr2qzvU2wL21k1ZFnRkwuzOJ4uoFui9R9sBqH-yiQNroT_wklBgV3khNCW_BOWX3S9jJm7rR_vK92WJqqH-8eviF6VWjvhaSSTa1O8eNwnhvq_stoTHUsrixOIUT7gFzHjJj8pXApb8apAKIckZDSkRD9M4PTA Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: ada715b6fd664c06b9ffcdff7f4ecb12 Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-VolumesAdminNegativeTest-1649886887 Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ada715b6fd664c06b9ffcdff7f4ecb12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ada715b6fd664c06b9ffcdff7f4ecb12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ada715b6fd664c06b9ffcdff7f4ecb12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ada715b6fd664c06b9ffcdff7f4ecb12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-VolumesAdminNegativeTest-1649886887 Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: ada715b6fd664c06b9ffcdff7f4ecb12 Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1649886887 Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-VolumesAdminNegativeTest-1649886887-project Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 0f0ad0b87eae43f6b7f6ee8fc60cac9d Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-VolumesAdminNegativeTest-1649886887-project Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 6ec5c954-ce85-4eb3-be16-31ef89f47bf2 could not be found. Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '6ec5c954-ce85-4eb3-be16-31ef89f47bf2'} Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ec5c954-ce85-4eb3-be16-31ef89f47bf2 could not be found. Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ec5c954-ce85-4eb3-be16-31ef89f47bf2 could not be found. Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:02:09.697601 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:09.702544 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:09.702544 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:02:09.702544 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:02:09.702544 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:02:09.702544 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:02:09.702544 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ec5c954-ce85-4eb3-be16-31ef89f47bf2 could not be found. Jun 20 12:02:09.702544 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:09.707751 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0abcda92-4808-4ff9-834f-f11aa0b2ce5d tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Returning 404 to user: Instance 6ec5c954-ce85-4eb3-be16-31ef89f47bf2 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:02:09.709061 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0abcda92-4808-4ff9-834f-f11aa0b2ce5d tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec5c954-ce85-4eb3-be16-31ef89f47bf2" status: 404 len: 111 microversion: 2.1 time: 0.075509 Jun 20 12:02:09.710246 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 625/1244] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:09 2022] GET /compute/v2.1/servers/6ec5c954-ce85-4eb3-be16-31ef89f47bf2 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:02:09.728741 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-32a36bdc-dbf1-4987-a0c9-bc3bff23c257 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:09.733565 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-32a36bdc-dbf1-4987-a0c9-bc3bff23c257 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] [instance: 210b34c5-64e5-4416-ba9d-26ead5ff8a82] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:09.749223 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-32a36bdc-dbf1-4987-a0c9-bc3bff23c257 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:09.749950 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-32a36bdc-dbf1-4987-a0c9-bc3bff23c257 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:09.750982 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-32a36bdc-dbf1-4987-a0c9-bc3bff23c257 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:09.751662 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-32a36bdc-dbf1-4987-a0c9-bc3bff23c257 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:10.861334 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-32a36bdc-dbf1-4987-a0c9-bc3bff23c257 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257f6182a93f4cea86956b9894802513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953509c8c92e497eb38e96860bbc28ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:10.880443 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-32a36bdc-dbf1-4987-a0c9-bc3bff23c257 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] 10.222.0.27 "GET /compute/v2.1/servers/210b34c5-64e5-4416-ba9d-26ead5ff8a82" status: 200 len: 1316 microversion: 2.1 time: 1.167263 Jun 20 12:02:10.882249 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 626/1245] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:09 2022] GET /compute/v2.1/servers/210b34c5-64e5-4416-ba9d-26ead5ff8a82 => generated 1316 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:11.038875 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-6b3d9541-2c62-4189-a5db-6d8d196afbe4 req-597bb9f3-f964-4b14-a59f-d07b96533081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ec5c954-ce85-4eb3-be16-31ef89f47bf2", "name": "network-vif-deleted", "tag": "5d77b210-d5fc-4f5f-99cb-0e76e6b76970"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:02:11.059204 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-6b3d9541-2c62-4189-a5db-6d8d196afbe4 req-597bb9f3-f964-4b14-a59f-d07b96533081 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:11.059697 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-6b3d9541-2c62-4189-a5db-6d8d196afbe4 req-597bb9f3-f964-4b14-a59f-d07b96533081 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:11.131918 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-6b3d9541-2c62-4189-a5db-6d8d196afbe4 req-597bb9f3-f964-4b14-a59f-d07b96533081 service nova] Creating event network-vif-deleted:5d77b210-d5fc-4f5f-99cb-0e76e6b76970 for instance 6ec5c954-ce85-4eb3-be16-31ef89f47bf2 on n-h2-master-1 Jun 20 12:02:11.146157 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-6b3d9541-2c62-4189-a5db-6d8d196afbe4 req-597bb9f3-f964-4b14-a59f-d07b96533081 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.260655 Jun 20 12:02:11.147373 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 627/1246] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:02:11.154081 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2bfa9f56-2c86-46d2-aced-8ed1a6541b64 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:11.155469 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2bfa9f56-2c86-46d2-aced-8ed1a6541b64 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: f678dc35-c774-4c0a-9ebb-579688adecb0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:11.166854 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2bfa9f56-2c86-46d2-aced-8ed1a6541b64 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:11.167556 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2bfa9f56-2c86-46d2-aced-8ed1a6541b64 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:11.168583 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2bfa9f56-2c86-46d2-aced-8ed1a6541b64 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:11.169249 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2bfa9f56-2c86-46d2-aced-8ed1a6541b64 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:11.409988 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7c400cac-a134-451f-aeb4-d9ab2ca02f14 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed/action" status: 202 len: 0 microversion: 2.25 time: 4.812091 Jun 20 12:02:11.411666 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 620/1247] 10.222.0.27 () {62 vars in 1318 bytes} [Mon Jun 20 12:02:06 2022] POST /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed/action => generated 0 bytes in 4815 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:02:11.424212 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a9cb0858-9a2c-49d2-95dc-044a61887f03 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:11.424846 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a9cb0858-9a2c-49d2-95dc-044a61887f03 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:11.461101 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a9cb0858-9a2c-49d2-95dc-044a61887f03 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:11.462052 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a9cb0858-9a2c-49d2-95dc-044a61887f03 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:11.463044 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a9cb0858-9a2c-49d2-95dc-044a61887f03 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:11.467514 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a9cb0858-9a2c-49d2-95dc-044a61887f03 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:11.523754 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2bfa9f56-2c86-46d2-aced-8ed1a6541b64 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:11.532629 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2bfa9f56-2c86-46d2-aced-8ed1a6541b64 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0" status: 200 len: 1314 microversion: 2.1 time: 0.383691 Jun 20 12:02:11.540829 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 628/1248] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:11 2022] GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0 => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:11.551431 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9025ade5-5164-430c-9e30-0fc00493f23e tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:11.553576 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9025ade5-5164-430c-9e30-0fc00493f23e tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] [instance: 5c4349cc-0bb9-472f-acc5-e7cf3f616853] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:11.572437 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9025ade5-5164-430c-9e30-0fc00493f23e tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:11.574099 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9025ade5-5164-430c-9e30-0fc00493f23e tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:11.575489 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9025ade5-5164-430c-9e30-0fc00493f23e tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:11.577323 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9025ade5-5164-430c-9e30-0fc00493f23e tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:11.752393 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9025ade5-5164-430c-9e30-0fc00493f23e tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce407df032342ddad0dec89baf9b6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a572c10cb94add92e01db93f744ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:11.760478 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9025ade5-5164-430c-9e30-0fc00493f23e tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] 10.222.0.27 "GET /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853" status: 200 len: 1274 microversion: 2.1 time: 0.218136 Jun 20 12:02:11.761799 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 629/1249] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:11 2022] GET /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853 => generated 1274 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:11.982995 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-df3f08ed-47ca-422f-b2d0-017e8db4f4e2 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:11.984784 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-df3f08ed-47ca-422f-b2d0-017e8db4f4e2 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:11.995703 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df3f08ed-47ca-422f-b2d0-017e8db4f4e2 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:11.996430 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df3f08ed-47ca-422f-b2d0-017e8db4f4e2 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:11.997618 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df3f08ed-47ca-422f-b2d0-017e8db4f4e2 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:11.998440 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df3f08ed-47ca-422f-b2d0-017e8db4f4e2 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:12.285520 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a9cb0858-9a2c-49d2-95dc-044a61887f03 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:12.296470 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a9cb0858-9a2c-49d2-95dc-044a61887f03 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:12.310084 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a9cb0858-9a2c-49d2-95dc-044a61887f03 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:12.311706 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a9cb0858-9a2c-49d2-95dc-044a61887f03 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1879 microversion: 2.42 time: 0.897404 Jun 20 12:02:12.315709 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 621/1250] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:11 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1879 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:12.329627 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-4b3ab399-04e8-4014-9114-f83da4d6cfcf req-b76cf31e-1497-47fb-8793-58de30ce3b2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f59e801d-2548-4edc-8283-af47c991d92a", "tag": "24d1960a-4d01-49b2-80a0-84252c3d23d4"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:02:12.345840 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-4b3ab399-04e8-4014-9114-f83da4d6cfcf req-b76cf31e-1497-47fb-8793-58de30ce3b2a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:12.352623 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-4b3ab399-04e8-4014-9114-f83da4d6cfcf req-b76cf31e-1497-47fb-8793-58de30ce3b2a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:12.383364 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-4b3ab399-04e8-4014-9114-f83da4d6cfcf req-b76cf31e-1497-47fb-8793-58de30ce3b2a service nova] Creating event network-changed:24d1960a-4d01-49b2-80a0-84252c3d23d4 for instance f59e801d-2548-4edc-8283-af47c991d92a on n-h2-master-1 Jun 20 12:02:12.388755 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-4b3ab399-04e8-4014-9114-f83da4d6cfcf req-b76cf31e-1497-47fb-8793-58de30ce3b2a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071013 Jun 20 12:02:12.390056 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 622/1251] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:02:12.400535 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8435b0e3-3df5-4402-807a-83b4845bb12f tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:12.401490 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8435b0e3-3df5-4402-807a-83b4845bb12f tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] [instance: 210b34c5-64e5-4416-ba9d-26ead5ff8a82] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:12.411599 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8435b0e3-3df5-4402-807a-83b4845bb12f tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:12.415200 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8435b0e3-3df5-4402-807a-83b4845bb12f tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:12.416058 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8435b0e3-3df5-4402-807a-83b4845bb12f tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:12.416552 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8435b0e3-3df5-4402-807a-83b4845bb12f tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:12.575403 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-df3f08ed-47ca-422f-b2d0-017e8db4f4e2 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:12.590401 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-df3f08ed-47ca-422f-b2d0-017e8db4f4e2 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:12.591928 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-df3f08ed-47ca-422f-b2d0-017e8db4f4e2 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:12.593189 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-df3f08ed-47ca-422f-b2d0-017e8db4f4e2 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1815 microversion: 2.25 time: 0.830128 Jun 20 12:02:12.606809 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 630/1252] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:11 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1815 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:12.617902 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-48d07ca4-ec64-4725-a2be-cb1bdeafa856 req-5b412788-89bc-4f66-b7c7-30657996a71b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f678dc35-c774-4c0a-9ebb-579688adecb0", "name": "network-vif-plugged", "status": "completed", "tag": "4f3fd793-2c2d-4d98-8201-6c1a6e0b5190"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:02:12.633302 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-48d07ca4-ec64-4725-a2be-cb1bdeafa856 req-5b412788-89bc-4f66-b7c7-30657996a71b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:12.634216 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-48d07ca4-ec64-4725-a2be-cb1bdeafa856 req-5b412788-89bc-4f66-b7c7-30657996a71b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:12.670880 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-48d07ca4-ec64-4725-a2be-cb1bdeafa856 req-5b412788-89bc-4f66-b7c7-30657996a71b service nova] Creating event network-vif-plugged:4f3fd793-2c2d-4d98-8201-6c1a6e0b5190 for instance f678dc35-c774-4c0a-9ebb-579688adecb0 on n-h1-master-1 Jun 20 12:02:12.686197 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-48d07ca4-ec64-4725-a2be-cb1bdeafa856 req-5b412788-89bc-4f66-b7c7-30657996a71b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077729 Jun 20 12:02:12.687144 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 631/1253] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:02:12.711837 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9fa63560-c815-4896-853b-c1689df4c00b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:12.712637 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9fa63560-c815-4896-853b-c1689df4c00b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: f678dc35-c774-4c0a-9ebb-579688adecb0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:12.721201 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9fa63560-c815-4896-853b-c1689df4c00b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:12.721711 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9fa63560-c815-4896-853b-c1689df4c00b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:12.722458 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9fa63560-c815-4896-853b-c1689df4c00b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:12.722907 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9fa63560-c815-4896-853b-c1689df4c00b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:13.059029 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8435b0e3-3df5-4402-807a-83b4845bb12f tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257f6182a93f4cea86956b9894802513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953509c8c92e497eb38e96860bbc28ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:13.062455 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:13.075847 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8435b0e3-3df5-4402-807a-83b4845bb12f tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] 10.222.0.27 "GET /compute/v2.1/servers/210b34c5-64e5-4416-ba9d-26ead5ff8a82" status: 200 len: 1316 microversion: 2.1 time: 0.683680 Jun 20 12:02:13.086329 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 623/1254] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:12 2022] GET /compute/v2.1/servers/210b34c5-64e5-4416-ba9d-26ead5ff8a82 => generated 1316 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:13.090132 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8fd76f80-01fc-4faa-93e2-3f65afc17203 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:13.092186 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8fd76f80-01fc-4faa-93e2-3f65afc17203 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] [instance: 5c4349cc-0bb9-472f-acc5-e7cf3f616853] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:13.092914 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9fa63560-c815-4896-853b-c1689df4c00b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:13.100536 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8fd76f80-01fc-4faa-93e2-3f65afc17203 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:13.101456 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8fd76f80-01fc-4faa-93e2-3f65afc17203 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:13.102888 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8fd76f80-01fc-4faa-93e2-3f65afc17203 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:13.103533 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8fd76f80-01fc-4faa-93e2-3f65afc17203 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:13.105220 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9fa63560-c815-4896-853b-c1689df4c00b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0" status: 200 len: 1314 microversion: 2.1 time: 0.416837 Jun 20 12:02:13.106271 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 632/1255] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:12 2022] GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0 => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:13.181679 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-f1f26440-00ae-4a51-9713-84dbea7df8c4 req-85633498-ca52-482e-8b4f-7967cfb5c33c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "210b34c5-64e5-4416-ba9d-26ead5ff8a82", "tag": "9c2c694f-91c6-4816-b3b0-ae94cace44cb"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:02:13.198745 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-f1f26440-00ae-4a51-9713-84dbea7df8c4 req-85633498-ca52-482e-8b4f-7967cfb5c33c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:13.199627 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-f1f26440-00ae-4a51-9713-84dbea7df8c4 req-85633498-ca52-482e-8b4f-7967cfb5c33c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:13.240841 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-f1f26440-00ae-4a51-9713-84dbea7df8c4 req-85633498-ca52-482e-8b4f-7967cfb5c33c service nova] Creating event network-changed:9c2c694f-91c6-4816-b3b0-ae94cace44cb for instance 210b34c5-64e5-4416-ba9d-26ead5ff8a82 on n-h1-master-1 Jun 20 12:02:13.251603 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-f1f26440-00ae-4a51-9713-84dbea7df8c4 req-85633498-ca52-482e-8b4f-7967cfb5c33c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073427 Jun 20 12:02:13.254214 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 633/1256] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:02:13.345735 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ffeb52e9-1d55-4286-b3df-8e2ba7ffd098 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:13.346794 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ffeb52e9-1d55-4286-b3df-8e2ba7ffd098 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:13.366107 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ffeb52e9-1d55-4286-b3df-8e2ba7ffd098 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:13.368442 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ffeb52e9-1d55-4286-b3df-8e2ba7ffd098 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:13.369486 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ffeb52e9-1d55-4286-b3df-8e2ba7ffd098 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:13.372411 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ffeb52e9-1d55-4286-b3df-8e2ba7ffd098 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:13.978675 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ffeb52e9-1d55-4286-b3df-8e2ba7ffd098 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:13.997091 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ffeb52e9-1d55-4286-b3df-8e2ba7ffd098 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:14.002609 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ffeb52e9-1d55-4286-b3df-8e2ba7ffd098 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:14.003606 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ffeb52e9-1d55-4286-b3df-8e2ba7ffd098 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1879 microversion: 2.42 time: 0.664326 Jun 20 12:02:14.009168 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 634/1257] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:13 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1879 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:02:14.016378 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1731343c-8009-43c3-9feb-350acae3addf tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:14.023524 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1731343c-8009-43c3-9feb-350acae3addf tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:14.055933 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1731343c-8009-43c3-9feb-350acae3addf tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:14.056445 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1731343c-8009-43c3-9feb-350acae3addf tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:14.057259 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1731343c-8009-43c3-9feb-350acae3addf tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:14.057693 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1731343c-8009-43c3-9feb-350acae3addf tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:14.154043 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8fd76f80-01fc-4faa-93e2-3f65afc17203 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce407df032342ddad0dec89baf9b6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a572c10cb94add92e01db93f744ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:14.186660 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8fd76f80-01fc-4faa-93e2-3f65afc17203 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] 10.222.0.27 "GET /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853" status: 200 len: 1316 microversion: 2.1 time: 1.105275 Jun 20 12:02:14.191545 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 624/1258] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:13 2022] GET /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853 => generated 1316 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:14.204151 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-95ab8891-9d36-4e90-8813-75ba8d1e066a tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:14.205617 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-95ab8891-9d36-4e90-8813-75ba8d1e066a tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] [instance: 210b34c5-64e5-4416-ba9d-26ead5ff8a82] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:14.223073 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95ab8891-9d36-4e90-8813-75ba8d1e066a tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:14.223840 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95ab8891-9d36-4e90-8813-75ba8d1e066a tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:14.224849 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95ab8891-9d36-4e90-8813-75ba8d1e066a tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:14.225454 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95ab8891-9d36-4e90-8813-75ba8d1e066a tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:14.279791 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:14.359269 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:14.518238 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1731343c-8009-43c3-9feb-350acae3addf tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:14.544239 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1731343c-8009-43c3-9feb-350acae3addf tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:14.564096 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1731343c-8009-43c3-9feb-350acae3addf tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:14.565322 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1731343c-8009-43c3-9feb-350acae3addf tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1815 microversion: 2.25 time: 0.554799 Jun 20 12:02:14.584643 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 635/1259] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:14 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1815 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:14.589921 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a8435fb4-75fb-4758-a82b-47fb67a42052 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:14.597652 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a8435fb4-75fb-4758-a82b-47fb67a42052 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] [instance: 1c763272-042e-418c-b2f6-cc2e96f0c54d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:14.622603 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a8435fb4-75fb-4758-a82b-47fb67a42052 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:14.623062 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a8435fb4-75fb-4758-a82b-47fb67a42052 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:14.624677 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a8435fb4-75fb-4758-a82b-47fb67a42052 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:14.625315 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a8435fb4-75fb-4758-a82b-47fb67a42052 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:14.677596 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a8435fb4-75fb-4758-a82b-47fb67a42052 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] 10.222.0.27 "GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091708 Jun 20 12:02:14.686152 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 636/1260] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:02:14 2022] GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:02:14.687792 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7b03a84e-33d7-4dba-8b61-2cd97bd5d7d0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:14.688950 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7b03a84e-33d7-4dba-8b61-2cd97bd5d7d0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: f678dc35-c774-4c0a-9ebb-579688adecb0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:14.702460 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7b03a84e-33d7-4dba-8b61-2cd97bd5d7d0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:14.703067 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7b03a84e-33d7-4dba-8b61-2cd97bd5d7d0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:14.703862 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7b03a84e-33d7-4dba-8b61-2cd97bd5d7d0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:14.704463 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7b03a84e-33d7-4dba-8b61-2cd97bd5d7d0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:14.829159 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-95ab8891-9d36-4e90-8813-75ba8d1e066a tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257f6182a93f4cea86956b9894802513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953509c8c92e497eb38e96860bbc28ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:14.842674 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-95ab8891-9d36-4e90-8813-75ba8d1e066a tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] 10.222.0.27 "GET /compute/v2.1/servers/210b34c5-64e5-4416-ba9d-26ead5ff8a82" status: 200 len: 1316 microversion: 2.1 time: 0.648044 Jun 20 12:02:14.853373 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 625/1261] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:14 2022] GET /compute/v2.1/servers/210b34c5-64e5-4416-ba9d-26ead5ff8a82 => generated 1316 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:14.858375 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-a61ca9a6-f9b3-4b65-901c-4a606808b2d8 req-49a17845-79a9-4e93-8714-b311f860351a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f59e801d-2548-4edc-8283-af47c991d92a", "tag": "b010dc80-2c35-44a9-a8d1-6aa254f13aa2"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:02:14.870196 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-a61ca9a6-f9b3-4b65-901c-4a606808b2d8 req-49a17845-79a9-4e93-8714-b311f860351a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:14.870701 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-a61ca9a6-f9b3-4b65-901c-4a606808b2d8 req-49a17845-79a9-4e93-8714-b311f860351a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:14.892051 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-a61ca9a6-f9b3-4b65-901c-4a606808b2d8 req-49a17845-79a9-4e93-8714-b311f860351a service nova] Creating event network-changed:b010dc80-2c35-44a9-a8d1-6aa254f13aa2 for instance f59e801d-2548-4edc-8283-af47c991d92a on n-h2-master-1 Jun 20 12:02:14.902825 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-a61ca9a6-f9b3-4b65-901c-4a606808b2d8 req-49a17845-79a9-4e93-8714-b311f860351a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047992 Jun 20 12:02:14.905226 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 626/1262] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:02:14.913110 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2189ddab-0bdc-46f7-94f9-4e358518cf83 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:14.914888 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2189ddab-0bdc-46f7-94f9-4e358518cf83 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] [instance: 1c763272-042e-418c-b2f6-cc2e96f0c54d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:14.924988 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2189ddab-0bdc-46f7-94f9-4e358518cf83 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:14.926153 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2189ddab-0bdc-46f7-94f9-4e358518cf83 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:14.927126 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2189ddab-0bdc-46f7-94f9-4e358518cf83 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:14.927780 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2189ddab-0bdc-46f7-94f9-4e358518cf83 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:15.040576 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7b03a84e-33d7-4dba-8b61-2cd97bd5d7d0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:15.068573 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7b03a84e-33d7-4dba-8b61-2cd97bd5d7d0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0" status: 200 len: 1502 microversion: 2.1 time: 0.388147 Jun 20 12:02:15.072159 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 637/1263] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:14 2022] GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0 => generated 1502 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:15.078836 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b041634a-6531-497d-ac26-136ccd86da6d tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:15.079677 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b041634a-6531-497d-ac26-136ccd86da6d tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:15.088836 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b041634a-6531-497d-ac26-136ccd86da6d tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:15.089367 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b041634a-6531-497d-ac26-136ccd86da6d tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:15.090936 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b041634a-6531-497d-ac26-136ccd86da6d tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:15.093675 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b041634a-6531-497d-ac26-136ccd86da6d tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:15.349540 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b041634a-6531-497d-ac26-136ccd86da6d tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:15.361162 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b041634a-6531-497d-ac26-136ccd86da6d tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:15.365103 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b041634a-6531-497d-ac26-136ccd86da6d tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:15.370522 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b041634a-6531-497d-ac26-136ccd86da6d tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1879 microversion: 2.42 time: 0.295889 Jun 20 12:02:15.373062 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 638/1264] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:15 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1879 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:15.393976 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a67fdf32-8055-4997-9acd-e958d00db563 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:15.395180 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a67fdf32-8055-4997-9acd-e958d00db563 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] [instance: 5c4349cc-0bb9-472f-acc5-e7cf3f616853] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:15.425768 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a67fdf32-8055-4997-9acd-e958d00db563 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:15.432900 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a67fdf32-8055-4997-9acd-e958d00db563 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:15.434391 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a67fdf32-8055-4997-9acd-e958d00db563 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:15.435044 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a67fdf32-8055-4997-9acd-e958d00db563 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:15.679734 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a67fdf32-8055-4997-9acd-e958d00db563 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce407df032342ddad0dec89baf9b6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a572c10cb94add92e01db93f744ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:15.699503 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a67fdf32-8055-4997-9acd-e958d00db563 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] 10.222.0.27 "GET /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853" status: 200 len: 1316 microversion: 2.1 time: 0.323288 Jun 20 12:02:15.701231 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 639/1265] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:15 2022] GET /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853 => generated 1316 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:15.706965 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-300d6bcd-6856-4a07-8e7d-7514573cd8bb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:15.708117 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-300d6bcd-6856-4a07-8e7d-7514573cd8bb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:15.725258 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-300d6bcd-6856-4a07-8e7d-7514573cd8bb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:15.726139 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-300d6bcd-6856-4a07-8e7d-7514573cd8bb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:15.727394 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-300d6bcd-6856-4a07-8e7d-7514573cd8bb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:15.728067 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-300d6bcd-6856-4a07-8e7d-7514573cd8bb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:15.729684 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-2189ddab-0bdc-46f7-94f9-4e358518cf83 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lazy-loading 'services' on Instance uuid 1c763272-042e-418c-b2f6-cc2e96f0c54d {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:02:16.004923 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2189ddab-0bdc-46f7-94f9-4e358518cf83 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d/os-volume_attachments/ecd5865b-b017-4542-89e4-3b6b180988b8" status: 202 len: 0 microversion: 2.1 time: 1.085552 Jun 20 12:02:16.009684 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 627/1266] 10.222.0.27 () {58 vars in 1415 bytes} [Mon Jun 20 12:02:14 2022] DELETE /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d/os-volume_attachments/ecd5865b-b017-4542-89e4-3b6b180988b8 => generated 0 bytes in 1104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:02:16.010151 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-300d6bcd-6856-4a07-8e7d-7514573cd8bb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:16.024783 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-300d6bcd-6856-4a07-8e7d-7514573cd8bb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:16.031353 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-300d6bcd-6856-4a07-8e7d-7514573cd8bb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:16.035094 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-300d6bcd-6856-4a07-8e7d-7514573cd8bb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1815 microversion: 2.25 time: 0.332155 Jun 20 12:02:16.039906 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 640/1267] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:15 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1815 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:16.052550 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-b6b18ae4-a481-4ac9-9370-545f0f4acabd req-0c119e50-00c4-4076-a57b-6c5b62656c86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "210b34c5-64e5-4416-ba9d-26ead5ff8a82", "name": "network-vif-plugged", "status": "completed", "tag": "9c2c694f-91c6-4816-b3b0-ae94cace44cb"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:02:16.054674 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c928f6c2-09a7-4f92-b5e3-e703f7e986aa tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:16.059102 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c928f6c2-09a7-4f92-b5e3-e703f7e986aa tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 3c12363c-ee46-445d-af50-77a1f0518a17] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:16.073359 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b6b18ae4-a481-4ac9-9370-545f0f4acabd req-0c119e50-00c4-4076-a57b-6c5b62656c86 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:16.077067 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b6b18ae4-a481-4ac9-9370-545f0f4acabd req-0c119e50-00c4-4076-a57b-6c5b62656c86 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:16.109158 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c928f6c2-09a7-4f92-b5e3-e703f7e986aa tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:16.110021 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c928f6c2-09a7-4f92-b5e3-e703f7e986aa tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:16.113457 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-b6b18ae4-a481-4ac9-9370-545f0f4acabd req-0c119e50-00c4-4076-a57b-6c5b62656c86 service nova] Creating event network-vif-plugged:9c2c694f-91c6-4816-b3b0-ae94cace44cb for instance 210b34c5-64e5-4416-ba9d-26ead5ff8a82 on n-h1-master-1 Jun 20 12:02:16.113930 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c928f6c2-09a7-4f92-b5e3-e703f7e986aa tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:16.114602 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c928f6c2-09a7-4f92-b5e3-e703f7e986aa tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:16.122908 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-b6b18ae4-a481-4ac9-9370-545f0f4acabd req-0c119e50-00c4-4076-a57b-6c5b62656c86 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081524 Jun 20 12:02:16.127206 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 641/1268] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:02:16.140027 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bbfb8e96-697c-4528-80b6-46fa781d2c37 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:16.145164 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bbfb8e96-697c-4528-80b6-46fa781d2c37 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] [instance: 210b34c5-64e5-4416-ba9d-26ead5ff8a82] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:16.163347 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bbfb8e96-697c-4528-80b6-46fa781d2c37 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:16.165523 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bbfb8e96-697c-4528-80b6-46fa781d2c37 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:16.166767 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bbfb8e96-697c-4528-80b6-46fa781d2c37 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:16.171967 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bbfb8e96-697c-4528-80b6-46fa781d2c37 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:16.245933 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c928f6c2-09a7-4f92-b5e3-e703f7e986aa tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 3c12363c-ee46-445d-af50-77a1f0518a17] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:02:16.453233 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c928f6c2-09a7-4f92-b5e3-e703f7e986aa tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17" status: 204 len: 0 microversion: 2.1 time: 0.424296 Jun 20 12:02:16.453844 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 628/1269] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:02:16 2022] DELETE /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:02:16.464178 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f5cb2b86-9603-4bc8-be2e-44843db35b67 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:16.464900 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f5cb2b86-9603-4bc8-be2e-44843db35b67 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:16.481369 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f5cb2b86-9603-4bc8-be2e-44843db35b67 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:16.488620 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f5cb2b86-9603-4bc8-be2e-44843db35b67 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:16.491479 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f5cb2b86-9603-4bc8-be2e-44843db35b67 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:16.492375 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f5cb2b86-9603-4bc8-be2e-44843db35b67 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:16.616878 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bbfb8e96-697c-4528-80b6-46fa781d2c37 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257f6182a93f4cea86956b9894802513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953509c8c92e497eb38e96860bbc28ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:16.634480 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bbfb8e96-697c-4528-80b6-46fa781d2c37 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] 10.222.0.27 "GET /compute/v2.1/servers/210b34c5-64e5-4416-ba9d-26ead5ff8a82" status: 200 len: 1316 microversion: 2.1 time: 0.505744 Jun 20 12:02:16.635280 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 642/1270] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:16 2022] GET /compute/v2.1/servers/210b34c5-64e5-4416-ba9d-26ead5ff8a82 => generated 1316 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:16.645466 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a24ae5ca-44d4-464e-8b3b-6f6d8512a7c8 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:16.653440 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a24ae5ca-44d4-464e-8b3b-6f6d8512a7c8 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 3c12363c-ee46-445d-af50-77a1f0518a17] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:16.670590 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a24ae5ca-44d4-464e-8b3b-6f6d8512a7c8 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:16.671052 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a24ae5ca-44d4-464e-8b3b-6f6d8512a7c8 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:16.671860 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a24ae5ca-44d4-464e-8b3b-6f6d8512a7c8 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:16.672512 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a24ae5ca-44d4-464e-8b3b-6f6d8512a7c8 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:16.833377 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f5cb2b86-9603-4bc8-be2e-44843db35b67 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:16.849223 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f5cb2b86-9603-4bc8-be2e-44843db35b67 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:16.853439 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f5cb2b86-9603-4bc8-be2e-44843db35b67 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:16.855819 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f5cb2b86-9603-4bc8-be2e-44843db35b67 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1879 microversion: 2.42 time: 0.400059 Jun 20 12:02:16.858536 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 629/1271] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:16 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1879 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:16.872450 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-adaca25f-3b2e-43b9-8e85-4e9cdfd9ac43 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:16.872980 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-adaca25f-3b2e-43b9-8e85-4e9cdfd9ac43 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] [instance: 5c4349cc-0bb9-472f-acc5-e7cf3f616853] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:16.888704 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-adaca25f-3b2e-43b9-8e85-4e9cdfd9ac43 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:16.889173 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-adaca25f-3b2e-43b9-8e85-4e9cdfd9ac43 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:16.892308 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-adaca25f-3b2e-43b9-8e85-4e9cdfd9ac43 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:16.892774 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-adaca25f-3b2e-43b9-8e85-4e9cdfd9ac43 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:17.055933 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a24ae5ca-44d4-464e-8b3b-6f6d8512a7c8 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ad0b87eae43f6b7f6ee8fc60cac9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada715b6fd664c06b9ffcdff7f4ecb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:17.075111 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a24ae5ca-44d4-464e-8b3b-6f6d8512a7c8 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17" status: 200 len: 1682 microversion: 2.1 time: 0.438539 Jun 20 12:02:17.076126 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 643/1272] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:16 2022] GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17 => generated 1682 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:17.084485 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4e520669-bbd6-4beb-acd7-61de940dbece tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:17.097736 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4e520669-bbd6-4beb-acd7-61de940dbece tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:17.107882 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4e520669-bbd6-4beb-acd7-61de940dbece tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:17.121903 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4e520669-bbd6-4beb-acd7-61de940dbece tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:17.123521 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4e520669-bbd6-4beb-acd7-61de940dbece tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:17.124592 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4e520669-bbd6-4beb-acd7-61de940dbece tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:17.136303 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:17.361371 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-adaca25f-3b2e-43b9-8e85-4e9cdfd9ac43 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce407df032342ddad0dec89baf9b6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a572c10cb94add92e01db93f744ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:17.374772 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-adaca25f-3b2e-43b9-8e85-4e9cdfd9ac43 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] 10.222.0.27 "GET /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853" status: 200 len: 1316 microversion: 2.1 time: 0.514263 Jun 20 12:02:17.378024 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 630/1273] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:16 2022] GET /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853 => generated 1316 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:17.405956 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4e520669-bbd6-4beb-acd7-61de940dbece tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:17.417188 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4e520669-bbd6-4beb-acd7-61de940dbece tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:17.418669 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4e520669-bbd6-4beb-acd7-61de940dbece tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:17.420071 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4e520669-bbd6-4beb-acd7-61de940dbece tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1815 microversion: 2.25 time: 0.342647 Jun 20 12:02:17.421210 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 644/1274] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:17 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1815 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:17.659117 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b423d708-7c03-423b-b3aa-07ab1084705c tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:17.660568 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b423d708-7c03-423b-b3aa-07ab1084705c tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] [instance: 210b34c5-64e5-4416-ba9d-26ead5ff8a82] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:17.669349 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b423d708-7c03-423b-b3aa-07ab1084705c tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:17.670861 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b423d708-7c03-423b-b3aa-07ab1084705c tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:17.673749 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b423d708-7c03-423b-b3aa-07ab1084705c tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:17.674546 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b423d708-7c03-423b-b3aa-07ab1084705c tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:17.843902 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-832f5fa7-7e70-4e5e-8f32-acef3f57a258 req-939eea32-ae4f-4e1d-8249-17ab4c957516 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c4349cc-0bb9-472f-acc5-e7cf3f616853", "tag": "33d25283-959e-4f57-8e3e-462da79d8264"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:02:17.895116 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-832f5fa7-7e70-4e5e-8f32-acef3f57a258 req-939eea32-ae4f-4e1d-8249-17ab4c957516 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:17.895809 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-832f5fa7-7e70-4e5e-8f32-acef3f57a258 req-939eea32-ae4f-4e1d-8249-17ab4c957516 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:17.932464 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-832f5fa7-7e70-4e5e-8f32-acef3f57a258 req-939eea32-ae4f-4e1d-8249-17ab4c957516 service nova] Creating event network-changed:33d25283-959e-4f57-8e3e-462da79d8264 for instance 5c4349cc-0bb9-472f-acc5-e7cf3f616853 on n-h1-master-1 Jun 20 12:02:17.945470 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-832f5fa7-7e70-4e5e-8f32-acef3f57a258 req-939eea32-ae4f-4e1d-8249-17ab4c957516 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109906 Jun 20 12:02:17.946788 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 645/1275] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:02:17.964402 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ef42dcb3-90a9-41ce-b989-cef3962e8bcc tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:17.965587 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ef42dcb3-90a9-41ce-b989-cef3962e8bcc tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:17.978384 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef42dcb3-90a9-41ce-b989-cef3962e8bcc tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:17.979201 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef42dcb3-90a9-41ce-b989-cef3962e8bcc tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:17.980188 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef42dcb3-90a9-41ce-b989-cef3962e8bcc tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:17.980789 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef42dcb3-90a9-41ce-b989-cef3962e8bcc tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:18.406469 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ef42dcb3-90a9-41ce-b989-cef3962e8bcc tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:18.412111 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b423d708-7c03-423b-b3aa-07ab1084705c tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257f6182a93f4cea86956b9894802513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953509c8c92e497eb38e96860bbc28ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:18.454618 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b423d708-7c03-423b-b3aa-07ab1084705c tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] 10.222.0.27 "GET /compute/v2.1/servers/210b34c5-64e5-4416-ba9d-26ead5ff8a82" status: 200 len: 1316 microversion: 2.1 time: 0.803185 Jun 20 12:02:18.458101 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 631/1276] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:17 2022] GET /compute/v2.1/servers/210b34c5-64e5-4416-ba9d-26ead5ff8a82 => generated 1316 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:18.461610 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ef42dcb3-90a9-41ce-b989-cef3962e8bcc tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:18.467410 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ef42dcb3-90a9-41ce-b989-cef3962e8bcc tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:18.468920 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ef42dcb3-90a9-41ce-b989-cef3962e8bcc tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1879 microversion: 2.42 time: 0.520763 Jun 20 12:02:18.469422 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-51389720-7f0f-41f6-8c30-44fae0ad1a22 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:18.470320 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-51389720-7f0f-41f6-8c30-44fae0ad1a22 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 3c12363c-ee46-445d-af50-77a1f0518a17] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:18.481647 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 646/1277] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:17 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1879 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:18.481647 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4e1a44cd-02eb-4b86-97fc-f968ca5ae826 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:18.481647 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4e1a44cd-02eb-4b86-97fc-f968ca5ae826 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] [instance: 5c4349cc-0bb9-472f-acc5-e7cf3f616853] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:18.485338 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-51389720-7f0f-41f6-8c30-44fae0ad1a22 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:18.485985 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-51389720-7f0f-41f6-8c30-44fae0ad1a22 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:18.486775 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-51389720-7f0f-41f6-8c30-44fae0ad1a22 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:18.487213 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-51389720-7f0f-41f6-8c30-44fae0ad1a22 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:18.507470 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4e1a44cd-02eb-4b86-97fc-f968ca5ae826 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:18.507928 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4e1a44cd-02eb-4b86-97fc-f968ca5ae826 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:18.508759 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4e1a44cd-02eb-4b86-97fc-f968ca5ae826 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:18.509200 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4e1a44cd-02eb-4b86-97fc-f968ca5ae826 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:18.886913 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4e1a44cd-02eb-4b86-97fc-f968ca5ae826 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce407df032342ddad0dec89baf9b6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a572c10cb94add92e01db93f744ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:18.901347 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-51389720-7f0f-41f6-8c30-44fae0ad1a22 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ad0b87eae43f6b7f6ee8fc60cac9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada715b6fd664c06b9ffcdff7f4ecb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:18.905443 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4e1a44cd-02eb-4b86-97fc-f968ca5ae826 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] 10.222.0.27 "GET /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853" status: 200 len: 1316 microversion: 2.1 time: 0.432356 Jun 20 12:02:18.918124 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-51389720-7f0f-41f6-8c30-44fae0ad1a22 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17" status: 200 len: 1682 microversion: 2.1 time: 0.453440 Jun 20 12:02:18.918124 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 632/1278] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:18 2022] GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17 => generated 1682 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:18.918896 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 647/1279] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:18 2022] GET /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853 => generated 1316 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:18.927934 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9c1cf443-7f94-458c-a501-aa136368e0ff tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:18.929144 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9c1cf443-7f94-458c-a501-aa136368e0ff tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:18.948801 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c1cf443-7f94-458c-a501-aa136368e0ff tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:18.948801 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c1cf443-7f94-458c-a501-aa136368e0ff tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:18.948801 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c1cf443-7f94-458c-a501-aa136368e0ff tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:18.948801 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c1cf443-7f94-458c-a501-aa136368e0ff tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:19.021240 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2b9fe3fa-c0b1-4e08-baaf-652549d44edd tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-372426465", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "c2bcaf29-2650-4e29-8ebc-39da1df0e1bf"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:02:19.085796 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-2b9fe3fa-c0b1-4e08-baaf-652549d44edd tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] validate_networks() for [('c2bcaf29-2650-4e29-8ebc-39da1df0e1bf', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:02:19.379139 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9c1cf443-7f94-458c-a501-aa136368e0ff tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:19.391897 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9c1cf443-7f94-458c-a501-aa136368e0ff tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:19.393491 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9c1cf443-7f94-458c-a501-aa136368e0ff tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:19.395221 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9c1cf443-7f94-458c-a501-aa136368e0ff tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1815 microversion: 2.25 time: 0.480359 Jun 20 12:02:19.405965 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 633/1280] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:18 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1815 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:19.475096 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-589442e9-8dcc-49fb-bcba-666ae308558c tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:19.475751 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-589442e9-8dcc-49fb-bcba-666ae308558c tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] [instance: 210b34c5-64e5-4416-ba9d-26ead5ff8a82] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:19.492486 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-589442e9-8dcc-49fb-bcba-666ae308558c tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:19.492924 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-589442e9-8dcc-49fb-bcba-666ae308558c tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:19.493721 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-589442e9-8dcc-49fb-bcba-666ae308558c tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:19.499464 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-589442e9-8dcc-49fb-bcba-666ae308558c tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:19.676138 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-2b9fe3fa-c0b1-4e08-baaf-652549d44edd tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:02:19.678379 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-2b9fe3fa-c0b1-4e08-baaf-652549d44edd tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:02:19.679353 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-2b9fe3fa-c0b1-4e08-baaf-652549d44edd tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:02:19.679944 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-2b9fe3fa-c0b1-4e08-baaf-652549d44edd tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:02:19.680553 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-2b9fe3fa-c0b1-4e08-baaf-652549d44edd tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:02:19.693439 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2b9fe3fa-c0b1-4e08-baaf-652549d44edd tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:19.694521 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2b9fe3fa-c0b1-4e08-baaf-652549d44edd tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:19.697120 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2b9fe3fa-c0b1-4e08-baaf-652549d44edd tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:19.697814 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2b9fe3fa-c0b1-4e08-baaf-652549d44edd tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:19.722877 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-2b9fe3fa-c0b1-4e08-baaf-652549d44edd tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Getting quotas for project 5cf9c3f1d5c64a75b49099a15fe087ee. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:02:19.729116 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-2b9fe3fa-c0b1-4e08-baaf-652549d44edd tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Getting quotas for user 3f16b216588946a790b42450b795ee00 and project 5cf9c3f1d5c64a75b49099a15fe087ee. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:02:19.767185 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2b9fe3fa-c0b1-4e08-baaf-652549d44edd tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:02:19.769984 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2b9fe3fa-c0b1-4e08-baaf-652549d44edd tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 49a35510-1821-49de-8e39-d45901095c80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:02:19.856557 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2b9fe3fa-c0b1-4e08-baaf-652549d44edd tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.936236 Jun 20 12:02:19.857222 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 648/1281] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:02:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:02:19.863320 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f44f997d-f520-4519-9883-edd7285d55b1 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:19.863941 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f44f997d-f520-4519-9883-edd7285d55b1 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:19.895534 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f44f997d-f520-4519-9883-edd7285d55b1 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:19.896179 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f44f997d-f520-4519-9883-edd7285d55b1 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:19.896992 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f44f997d-f520-4519-9883-edd7285d55b1 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:19.897432 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f44f997d-f520-4519-9883-edd7285d55b1 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:20.045610 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-589442e9-8dcc-49fb-bcba-666ae308558c tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257f6182a93f4cea86956b9894802513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953509c8c92e497eb38e96860bbc28ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:20.055239 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-589442e9-8dcc-49fb-bcba-666ae308558c tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] 10.222.0.27 "GET /compute/v2.1/servers/210b34c5-64e5-4416-ba9d-26ead5ff8a82" status: 200 len: 1504 microversion: 2.1 time: 0.585086 Jun 20 12:02:20.059361 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 634/1282] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:19 2022] GET /compute/v2.1/servers/210b34c5-64e5-4416-ba9d-26ead5ff8a82 => generated 1504 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:20.069261 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9c7dc790-0a7a-4752-bcc5-ef19cd423eee tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:20.073139 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9c7dc790-0a7a-4752-bcc5-ef19cd423eee tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:20.167802 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9c7dc790-0a7a-4752-bcc5-ef19cd423eee tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:20.179225 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9c7dc790-0a7a-4752-bcc5-ef19cd423eee tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80" status: 200 len: 1210 microversion: 2.1 time: 0.115906 Jun 20 12:02:20.179947 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 635/1283] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:20 2022] GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 => generated 1210 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:20.185620 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2460b6b0-0193-4b6e-a00c-b90276eb0483 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:20.192999 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2460b6b0-0193-4b6e-a00c-b90276eb0483 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] [instance: 5c4349cc-0bb9-472f-acc5-e7cf3f616853] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:20.216607 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2460b6b0-0193-4b6e-a00c-b90276eb0483 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:20.217450 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2460b6b0-0193-4b6e-a00c-b90276eb0483 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:20.218489 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2460b6b0-0193-4b6e-a00c-b90276eb0483 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:20.219012 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2460b6b0-0193-4b6e-a00c-b90276eb0483 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:20.372939 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f44f997d-f520-4519-9883-edd7285d55b1 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:20.390805 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f44f997d-f520-4519-9883-edd7285d55b1 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:20.397758 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f44f997d-f520-4519-9883-edd7285d55b1 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:20.402483 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f44f997d-f520-4519-9883-edd7285d55b1 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1879 microversion: 2.42 time: 0.544007 Jun 20 12:02:20.403041 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 649/1284] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:19 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1879 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:20.445675 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-20c187d3-146e-40b9-887b-f7abd5b88b4d tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:20.446314 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-20c187d3-146e-40b9-887b-f7abd5b88b4d tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 3c12363c-ee46-445d-af50-77a1f0518a17] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:20.462481 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-20c187d3-146e-40b9-887b-f7abd5b88b4d tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:20.462944 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-20c187d3-146e-40b9-887b-f7abd5b88b4d tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:20.463760 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-20c187d3-146e-40b9-887b-f7abd5b88b4d tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:20.464181 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-20c187d3-146e-40b9-887b-f7abd5b88b4d tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:20.772440 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-20c187d3-146e-40b9-887b-f7abd5b88b4d tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ad0b87eae43f6b7f6ee8fc60cac9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada715b6fd664c06b9ffcdff7f4ecb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:20.785945 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-20c187d3-146e-40b9-887b-f7abd5b88b4d tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17" status: 200 len: 1615 microversion: 2.1 time: 0.366804 Jun 20 12:02:20.798478 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 650/1285] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:20 2022] GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17 => generated 1615 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:20.818543 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b6f72826-c225-430b-83dd-09283de23777 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:20.820058 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b6f72826-c225-430b-83dd-09283de23777 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] [instance: 210b34c5-64e5-4416-ba9d-26ead5ff8a82] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:20.835492 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b6f72826-c225-430b-83dd-09283de23777 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:20.836006 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b6f72826-c225-430b-83dd-09283de23777 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:20.839325 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b6f72826-c225-430b-83dd-09283de23777 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:20.839774 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b6f72826-c225-430b-83dd-09283de23777 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:20.905603 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b6f72826-c225-430b-83dd-09283de23777 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] 10.222.0.27 "GET /compute/v2.1/servers/210b34c5-64e5-4416-ba9d-26ead5ff8a82/ips" status: 200 len: 108 microversion: 2.1 time: 0.105514 Jun 20 12:02:20.908364 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 651/1286] 10.222.0.27 () {58 vars in 1247 bytes} [Mon Jun 20 12:02:20 2022] GET /compute/v2.1/servers/210b34c5-64e5-4416-ba9d-26ead5ff8a82/ips => generated 108 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:02:20.913599 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fc6470f9-2c3b-491d-827a-959b2d949d83 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:20.914305 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fc6470f9-2c3b-491d-827a-959b2d949d83 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:20.935955 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fc6470f9-2c3b-491d-827a-959b2d949d83 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:20.957919 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fc6470f9-2c3b-491d-827a-959b2d949d83 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:20.958954 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fc6470f9-2c3b-491d-827a-959b2d949d83 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:20.959404 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fc6470f9-2c3b-491d-827a-959b2d949d83 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:21.136337 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2460b6b0-0193-4b6e-a00c-b90276eb0483 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce407df032342ddad0dec89baf9b6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a572c10cb94add92e01db93f744ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:21.145976 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2460b6b0-0193-4b6e-a00c-b90276eb0483 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] 10.222.0.27 "GET /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853" status: 200 len: 1316 microversion: 2.1 time: 0.964532 Jun 20 12:02:21.156865 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 636/1287] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:20 2022] GET /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853 => generated 1316 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:21.166221 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e124d201-b9f5-4bde-bf29-3dd6ffe294d0 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:21.169433 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e124d201-b9f5-4bde-bf29-3dd6ffe294d0 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] [instance: 210b34c5-64e5-4416-ba9d-26ead5ff8a82] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:21.184095 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e124d201-b9f5-4bde-bf29-3dd6ffe294d0 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:21.184886 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e124d201-b9f5-4bde-bf29-3dd6ffe294d0 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:21.185719 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e124d201-b9f5-4bde-bf29-3dd6ffe294d0 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:21.186152 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e124d201-b9f5-4bde-bf29-3dd6ffe294d0 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:21.247534 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e124d201-b9f5-4bde-bf29-3dd6ffe294d0 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] 10.222.0.27 "GET /compute/v2.1/servers/210b34c5-64e5-4416-ba9d-26ead5ff8a82/ips" status: 200 len: 108 microversion: 2.1 time: 0.080212 Jun 20 12:02:21.248294 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 637/1288] 10.222.0.27 () {58 vars in 1247 bytes} [Mon Jun 20 12:02:21 2022] GET /compute/v2.1/servers/210b34c5-64e5-4416-ba9d-26ead5ff8a82/ips => generated 108 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:02:21.257733 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-14feddbb-2072-4f45-b119-234276b05dd4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:21.260592 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-14feddbb-2072-4f45-b119-234276b05dd4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:21.275311 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-14feddbb-2072-4f45-b119-234276b05dd4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:21.275729 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-14feddbb-2072-4f45-b119-234276b05dd4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:21.276786 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-14feddbb-2072-4f45-b119-234276b05dd4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:21.277380 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-14feddbb-2072-4f45-b119-234276b05dd4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:21.325893 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fc6470f9-2c3b-491d-827a-959b2d949d83 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:21.346930 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fc6470f9-2c3b-491d-827a-959b2d949d83 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:21.351781 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fc6470f9-2c3b-491d-827a-959b2d949d83 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:21.353045 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fc6470f9-2c3b-491d-827a-959b2d949d83 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1815 microversion: 2.25 time: 0.443661 Jun 20 12:02:21.360778 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 652/1289] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:20 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1815 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:21.368013 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8c4c4394-562a-4250-a2d9-85650cedbb5d tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:21.368726 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8c4c4394-562a-4250-a2d9-85650cedbb5d tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] [instance: 210b34c5-64e5-4416-ba9d-26ead5ff8a82] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:21.376804 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8c4c4394-562a-4250-a2d9-85650cedbb5d tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:21.377292 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8c4c4394-562a-4250-a2d9-85650cedbb5d tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:21.378114 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8c4c4394-562a-4250-a2d9-85650cedbb5d tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:21.379146 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8c4c4394-562a-4250-a2d9-85650cedbb5d tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:21.423821 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8c4c4394-562a-4250-a2d9-85650cedbb5d tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] 10.222.0.27 "GET /compute/v2.1/servers/210b34c5-64e5-4416-ba9d-26ead5ff8a82/ips/tempest-ServerAddressesTestJSON-49471012-network" status: 200 len: 93 microversion: 2.1 time: 0.061522 Jun 20 12:02:21.425173 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 653/1290] 10.222.0.27 () {58 vars in 1394 bytes} [Mon Jun 20 12:02:21 2022] GET /compute/v2.1/servers/210b34c5-64e5-4416-ba9d-26ead5ff8a82/ips/tempest-ServerAddressesTestJSON-49471012-network => generated 93 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:02:21.430792 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-19e0d210-3221-448c-b495-d841ef6af43b tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:21.432030 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-19e0d210-3221-448c-b495-d841ef6af43b tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:21.439632 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-19e0d210-3221-448c-b495-d841ef6af43b tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:21.440418 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-19e0d210-3221-448c-b495-d841ef6af43b tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:21.441392 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-19e0d210-3221-448c-b495-d841ef6af43b tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:21.441996 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-19e0d210-3221-448c-b495-d841ef6af43b tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:21.962659 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-14feddbb-2072-4f45-b119-234276b05dd4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:21.977546 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-14feddbb-2072-4f45-b119-234276b05dd4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80" status: 200 len: 1262 microversion: 2.1 time: 0.727231 Jun 20 12:02:21.987716 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 638/1291] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:21 2022] GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 => generated 1262 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:21.995001 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9896159a-51b2-48c5-8203-c46bcdb47e07 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:22.010151 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9896159a-51b2-48c5-8203-c46bcdb47e07 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] [instance: 210b34c5-64e5-4416-ba9d-26ead5ff8a82] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:22.025883 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9896159a-51b2-48c5-8203-c46bcdb47e07 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:22.026620 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9896159a-51b2-48c5-8203-c46bcdb47e07 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:22.027416 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9896159a-51b2-48c5-8203-c46bcdb47e07 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:22.027889 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9896159a-51b2-48c5-8203-c46bcdb47e07 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:22.035704 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-19e0d210-3221-448c-b495-d841ef6af43b tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:22.047989 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-19e0d210-3221-448c-b495-d841ef6af43b tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:22.049658 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-19e0d210-3221-448c-b495-d841ef6af43b tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:22.050825 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-19e0d210-3221-448c-b495-d841ef6af43b tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1879 microversion: 2.42 time: 0.624519 Jun 20 12:02:22.051378 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 654/1292] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:21 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1879 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:22.082456 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-822245a6-7b08-47ed-ad85-cd56e8db981f tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:22.083443 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-822245a6-7b08-47ed-ad85-cd56e8db981f tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 3c12363c-ee46-445d-af50-77a1f0518a17] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:22.095226 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-822245a6-7b08-47ed-ad85-cd56e8db981f tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:22.096473 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-822245a6-7b08-47ed-ad85-cd56e8db981f tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:22.097481 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-822245a6-7b08-47ed-ad85-cd56e8db981f tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:22.097635 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9896159a-51b2-48c5-8203-c46bcdb47e07 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] [instance: 210b34c5-64e5-4416-ba9d-26ead5ff8a82] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:02:22.099876 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-822245a6-7b08-47ed-ad85-cd56e8db981f tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:22.256900 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:22.306169 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-822245a6-7b08-47ed-ad85-cd56e8db981f tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ad0b87eae43f6b7f6ee8fc60cac9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada715b6fd664c06b9ffcdff7f4ecb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:22.326541 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-822245a6-7b08-47ed-ad85-cd56e8db981f tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17" status: 200 len: 1615 microversion: 2.1 time: 0.252251 Jun 20 12:02:22.341581 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 655/1293] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:22 2022] GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17 => generated 1615 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:22.354090 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-66d8041c-f59b-4590-b07e-73a3b89cb577 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:22.354973 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-66d8041c-f59b-4590-b07e-73a3b89cb577 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] [instance: 5c4349cc-0bb9-472f-acc5-e7cf3f616853] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:22.372654 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66d8041c-f59b-4590-b07e-73a3b89cb577 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:22.375272 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66d8041c-f59b-4590-b07e-73a3b89cb577 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:22.376921 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66d8041c-f59b-4590-b07e-73a3b89cb577 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:22.378098 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66d8041c-f59b-4590-b07e-73a3b89cb577 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:22.404866 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9896159a-51b2-48c5-8203-c46bcdb47e07 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] 10.222.0.27 "DELETE /compute/v2.1/servers/210b34c5-64e5-4416-ba9d-26ead5ff8a82" status: 204 len: 0 microversion: 2.1 time: 0.414947 Jun 20 12:02:22.408428 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 639/1294] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:02:21 2022] DELETE /compute/v2.1/servers/210b34c5-64e5-4416-ba9d-26ead5ff8a82 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:02:22.422556 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-c76dd665-31bf-4f03-97e8-38216996f606 req-5ee1db96-d384-4e40-bb24-a8d342a24153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c12363c-ee46-445d-af50-77a1f0518a17", "name": "network-vif-deleted", "tag": "0633c2cf-5ad3-4f49-95ea-6201e1ac2cc0"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:02:22.446341 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-c76dd665-31bf-4f03-97e8-38216996f606 req-5ee1db96-d384-4e40-bb24-a8d342a24153 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:22.450391 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-c76dd665-31bf-4f03-97e8-38216996f606 req-5ee1db96-d384-4e40-bb24-a8d342a24153 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:22.481766 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-c76dd665-31bf-4f03-97e8-38216996f606 req-5ee1db96-d384-4e40-bb24-a8d342a24153 service nova] Creating event network-vif-deleted:0633c2cf-5ad3-4f49-95ea-6201e1ac2cc0 for instance 3c12363c-ee46-445d-af50-77a1f0518a17 on n-h1-master-1 Jun 20 12:02:22.488506 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-c76dd665-31bf-4f03-97e8-38216996f606 req-5ee1db96-d384-4e40-bb24-a8d342a24153 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078078 Jun 20 12:02:22.489668 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 640/1295] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:02:22.496648 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-56316507-bed5-4e29-bfae-7264f264ab7e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:22.497897 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-56316507-bed5-4e29-bfae-7264f264ab7e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:22.507947 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-56316507-bed5-4e29-bfae-7264f264ab7e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:22.508722 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-56316507-bed5-4e29-bfae-7264f264ab7e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:22.509686 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-56316507-bed5-4e29-bfae-7264f264ab7e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:22.510288 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-56316507-bed5-4e29-bfae-7264f264ab7e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:22.716357 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-66d8041c-f59b-4590-b07e-73a3b89cb577 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce407df032342ddad0dec89baf9b6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a572c10cb94add92e01db93f744ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:22.728520 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-66d8041c-f59b-4590-b07e-73a3b89cb577 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] 10.222.0.27 "GET /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853" status: 200 len: 1316 microversion: 2.1 time: 0.382585 Jun 20 12:02:22.730302 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 656/1296] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:22 2022] GET /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853 => generated 1316 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:22.743805 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e6580aec-624f-44f8-852c-4c79e8e4c6c1 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:22.744349 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e6580aec-624f-44f8-852c-4c79e8e4c6c1 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] [instance: 210b34c5-64e5-4416-ba9d-26ead5ff8a82] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:22.760978 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e6580aec-624f-44f8-852c-4c79e8e4c6c1 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:22.761437 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e6580aec-624f-44f8-852c-4c79e8e4c6c1 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:22.763055 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e6580aec-624f-44f8-852c-4c79e8e4c6c1 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:22.763509 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e6580aec-624f-44f8-852c-4c79e8e4c6c1 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:22.830130 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-56316507-bed5-4e29-bfae-7264f264ab7e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:22.839674 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-56316507-bed5-4e29-bfae-7264f264ab7e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:22.842987 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-56316507-bed5-4e29-bfae-7264f264ab7e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:22.846150 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-56316507-bed5-4e29-bfae-7264f264ab7e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1815 microversion: 2.25 time: 0.354954 Jun 20 12:02:22.847230 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 641/1297] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:22 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1815 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:22.995064 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f48b439d-b526-4f31-b96a-dd375ffecba4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:22.995808 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f48b439d-b526-4f31-b96a-dd375ffecba4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:23.004237 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f48b439d-b526-4f31-b96a-dd375ffecba4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:23.010421 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f48b439d-b526-4f31-b96a-dd375ffecba4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:23.011421 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f48b439d-b526-4f31-b96a-dd375ffecba4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:23.011965 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f48b439d-b526-4f31-b96a-dd375ffecba4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:23.102610 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f48b439d-b526-4f31-b96a-dd375ffecba4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:23.123897 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f48b439d-b526-4f31-b96a-dd375ffecba4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80" status: 200 len: 1268 microversion: 2.1 time: 0.132751 Jun 20 12:02:23.124812 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 642/1298] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:22 2022] GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 => generated 1268 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:02:23.137970 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a66361f7-4082-417b-9f16-bbb5a63fa3d6 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:23.138752 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a66361f7-4082-417b-9f16-bbb5a63fa3d6 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:23.147687 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a66361f7-4082-417b-9f16-bbb5a63fa3d6 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:23.148530 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a66361f7-4082-417b-9f16-bbb5a63fa3d6 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:23.149805 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a66361f7-4082-417b-9f16-bbb5a63fa3d6 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:23.150458 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a66361f7-4082-417b-9f16-bbb5a63fa3d6 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:23.251195 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e6580aec-624f-44f8-852c-4c79e8e4c6c1 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257f6182a93f4cea86956b9894802513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953509c8c92e497eb38e96860bbc28ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:23.259303 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e6580aec-624f-44f8-852c-4c79e8e4c6c1 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] 10.222.0.27 "GET /compute/v2.1/servers/210b34c5-64e5-4416-ba9d-26ead5ff8a82" status: 200 len: 1510 microversion: 2.1 time: 0.526368 Jun 20 12:02:23.263226 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 657/1299] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:22 2022] GET /compute/v2.1/servers/210b34c5-64e5-4416-ba9d-26ead5ff8a82 => generated 1510 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:23.348629 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d896be24-8dcc-4d7f-883f-955cfd7e643b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:23.349307 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d896be24-8dcc-4d7f-883f-955cfd7e643b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 3c12363c-ee46-445d-af50-77a1f0518a17] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:23.355508 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d896be24-8dcc-4d7f-883f-955cfd7e643b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:23.355945 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d896be24-8dcc-4d7f-883f-955cfd7e643b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:23.356746 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d896be24-8dcc-4d7f-883f-955cfd7e643b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:23.357337 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d896be24-8dcc-4d7f-883f-955cfd7e643b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:23.440594 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d896be24-8dcc-4d7f-883f-955cfd7e643b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:23.441049 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d896be24-8dcc-4d7f-883f-955cfd7e643b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:23.445157 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-d896be24-8dcc-4d7f-883f-955cfd7e643b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lazy-loading 'fault' on Instance uuid 3c12363c-ee46-445d-af50-77a1f0518a17 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:02:23.527965 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d896be24-8dcc-4d7f-883f-955cfd7e643b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f0ad0b87eae43f6b7f6ee8fc60cac9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada715b6fd664c06b9ffcdff7f4ecb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:23.547818 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d896be24-8dcc-4d7f-883f-955cfd7e643b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17" status: 200 len: 1332 microversion: 2.1 time: 0.203284 Jun 20 12:02:23.548802 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 658/1300] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:23 2022] GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17 => generated 1332 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:02:23.575465 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a66361f7-4082-417b-9f16-bbb5a63fa3d6 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:23.594045 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a66361f7-4082-417b-9f16-bbb5a63fa3d6 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:23.598497 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a66361f7-4082-417b-9f16-bbb5a63fa3d6 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:23.600128 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a66361f7-4082-417b-9f16-bbb5a63fa3d6 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1879 microversion: 2.42 time: 0.474200 Jun 20 12:02:23.608496 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 643/1301] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:23 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1879 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:23.748521 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ec4223cf-ad65-4633-bd26-64a050c764ab tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:23.749326 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ec4223cf-ad65-4633-bd26-64a050c764ab tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] [instance: 5c4349cc-0bb9-472f-acc5-e7cf3f616853] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:23.764517 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ec4223cf-ad65-4633-bd26-64a050c764ab tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:23.766473 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ec4223cf-ad65-4633-bd26-64a050c764ab tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:23.767595 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ec4223cf-ad65-4633-bd26-64a050c764ab tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:23.768333 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ec4223cf-ad65-4633-bd26-64a050c764ab tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:23.867025 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-73ba5841-01a5-49fd-941d-08f59606aa46 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:23.868959 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-73ba5841-01a5-49fd-941d-08f59606aa46 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:23.889357 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-73ba5841-01a5-49fd-941d-08f59606aa46 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:23.889873 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-73ba5841-01a5-49fd-941d-08f59606aa46 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:23.891321 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-73ba5841-01a5-49fd-941d-08f59606aa46 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:23.894839 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-73ba5841-01a5-49fd-941d-08f59606aa46 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:24.007022 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ec4223cf-ad65-4633-bd26-64a050c764ab tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce407df032342ddad0dec89baf9b6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a572c10cb94add92e01db93f744ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:24.017328 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ec4223cf-ad65-4633-bd26-64a050c764ab tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] 10.222.0.27 "GET /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853" status: 200 len: 1316 microversion: 2.1 time: 0.273913 Jun 20 12:02:24.018659 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 659/1302] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:23 2022] GET /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853 => generated 1316 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:24.025063 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-96019c5b-5b70-48c6-a2bb-09b14b3e1f9a req-d6246164-06b7-4d0e-9294-b8e3a1c26770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c4349cc-0bb9-472f-acc5-e7cf3f616853", "name": "network-vif-plugged", "status": "completed", "tag": "33d25283-959e-4f57-8e3e-462da79d8264"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:02:24.038030 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-96019c5b-5b70-48c6-a2bb-09b14b3e1f9a req-d6246164-06b7-4d0e-9294-b8e3a1c26770 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:24.038840 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-96019c5b-5b70-48c6-a2bb-09b14b3e1f9a req-d6246164-06b7-4d0e-9294-b8e3a1c26770 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:24.053983 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-96019c5b-5b70-48c6-a2bb-09b14b3e1f9a req-d6246164-06b7-4d0e-9294-b8e3a1c26770 service nova] Creating event network-vif-plugged:33d25283-959e-4f57-8e3e-462da79d8264 for instance 5c4349cc-0bb9-472f-acc5-e7cf3f616853 on n-h1-master-1 Jun 20 12:02:24.060673 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-96019c5b-5b70-48c6-a2bb-09b14b3e1f9a req-d6246164-06b7-4d0e-9294-b8e3a1c26770 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040431 Jun 20 12:02:24.062797 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 660/1303] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:02:24.149850 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e37ae726-9d20-4b9b-bf26-905bea36e7cd tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:24.151489 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e37ae726-9d20-4b9b-bf26-905bea36e7cd tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:24.165404 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e37ae726-9d20-4b9b-bf26-905bea36e7cd tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:24.173595 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e37ae726-9d20-4b9b-bf26-905bea36e7cd tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:24.177905 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e37ae726-9d20-4b9b-bf26-905bea36e7cd tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:24.178598 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e37ae726-9d20-4b9b-bf26-905bea36e7cd tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:24.301536 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-73ba5841-01a5-49fd-941d-08f59606aa46 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:24.322839 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-73ba5841-01a5-49fd-941d-08f59606aa46 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:24.324571 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-73ba5841-01a5-49fd-941d-08f59606aa46 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:24.325908 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-73ba5841-01a5-49fd-941d-08f59606aa46 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1815 microversion: 2.25 time: 0.464267 Jun 20 12:02:24.326578 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 644/1304] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:23 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1815 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:24.331907 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-536b8d6d-ef32-4a25-83cc-155a89226ba6 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:24.345332 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-536b8d6d-ef32-4a25-83cc-155a89226ba6 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] [instance: 210b34c5-64e5-4416-ba9d-26ead5ff8a82] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:24.352715 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-536b8d6d-ef32-4a25-83cc-155a89226ba6 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:24.353429 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-536b8d6d-ef32-4a25-83cc-155a89226ba6 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:24.354465 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-536b8d6d-ef32-4a25-83cc-155a89226ba6 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:24.355135 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-536b8d6d-ef32-4a25-83cc-155a89226ba6 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:24.539129 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e37ae726-9d20-4b9b-bf26-905bea36e7cd tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:24.552275 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e37ae726-9d20-4b9b-bf26-905bea36e7cd tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80" status: 200 len: 1310 microversion: 2.1 time: 0.413925 Jun 20 12:02:24.565543 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 661/1305] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:24 2022] GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 => generated 1310 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:24.574098 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fb64d39f-1c00-4f56-bad5-0d18b8164706 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:24.576365 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fb64d39f-1c00-4f56-bad5-0d18b8164706 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] [instance: 3c12363c-ee46-445d-af50-77a1f0518a17] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:24.585009 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fb64d39f-1c00-4f56-bad5-0d18b8164706 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:24.586089 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fb64d39f-1c00-4f56-bad5-0d18b8164706 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:24.587175 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fb64d39f-1c00-4f56-bad5-0d18b8164706 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:24.587998 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fb64d39f-1c00-4f56-bad5-0d18b8164706 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:24.609691 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-fb64d39f-1c00-4f56-bad5-0d18b8164706 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] HTTP exception thrown: Instance 3c12363c-ee46-445d-af50-77a1f0518a17 could not be found. Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fb64d39f-1c00-4f56-bad5-0d18b8164706 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Request method failure captured: Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17 HTTP/1.1 Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGEHUjOwPo-Otg4b-Zr2qzvU2wL21k1ZFnRkwuzOJ4uoFui9R9sBqH-yiQNroT_wklBgV3khNCW_BOWX3S9jJm7rR_vK92WJqqH-8eviF6VWjvhaSSTa1O8eNwnhvq_stoTHUsrixOIUT7gFzHjJj8pXApb8apAKIckZDSkRD9M4PTA Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: ada715b6fd664c06b9ffcdff7f4ecb12 Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-VolumesAdminNegativeTest-1649886887 Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ada715b6fd664c06b9ffcdff7f4ecb12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ada715b6fd664c06b9ffcdff7f4ecb12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ada715b6fd664c06b9ffcdff7f4ecb12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ada715b6fd664c06b9ffcdff7f4ecb12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-VolumesAdminNegativeTest-1649886887 Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: ada715b6fd664c06b9ffcdff7f4ecb12 Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1649886887 Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-VolumesAdminNegativeTest-1649886887-project Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 0f0ad0b87eae43f6b7f6ee8fc60cac9d Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-VolumesAdminNegativeTest-1649886887-project Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 3c12363c-ee46-445d-af50-77a1f0518a17 could not be found. Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '3c12363c-ee46-445d-af50-77a1f0518a17'} Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c12363c-ee46-445d-af50-77a1f0518a17 could not be found. Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c12363c-ee46-445d-af50-77a1f0518a17 could not be found. Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:02:24.611569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:24.617274 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:24.617274 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:02:24.617274 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:02:24.617274 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:02:24.617274 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:02:24.617274 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c12363c-ee46-445d-af50-77a1f0518a17 could not be found. Jun 20 12:02:24.617274 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:24.617274 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fb64d39f-1c00-4f56-bad5-0d18b8164706 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Returning 404 to user: Instance 3c12363c-ee46-445d-af50-77a1f0518a17 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:02:24.617274 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fb64d39f-1c00-4f56-bad5-0d18b8164706 tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17" status: 404 len: 111 microversion: 2.1 time: 0.045848 Jun 20 12:02:24.617274 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 662/1306] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:24 2022] GET /compute/v2.1/servers/3c12363c-ee46-445d-af50-77a1f0518a17 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:02:24.630978 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7bc9b87b-f5cd-4ea9-ab8d-9e1df374725b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] Calling method '.version_select at 0x7f60733065e0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:24.652519 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7bc9b87b-f5cd-4ea9-ab8d-9e1df374725b tempest-VolumesAdminNegativeTest-1649886887 tempest-VolumesAdminNegativeTest-1649886887-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1101819572" status: 202 len: 0 microversion: 2.1 time: 0.032367 Jun 20 12:02:24.656737 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 663/1307] 10.222.0.27 () {58 vars in 1220 bytes} [Mon Jun 20 12:02:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1101819572 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:02:24.662312 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-93ca965c-b458-4aa6-a103-fb4ec61d57f2 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:24.663086 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-93ca965c-b458-4aa6-a103-fb4ec61d57f2 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:24.670477 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:24.672173 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93ca965c-b458-4aa6-a103-fb4ec61d57f2 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:24.673005 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93ca965c-b458-4aa6-a103-fb4ec61d57f2 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:24.674062 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93ca965c-b458-4aa6-a103-fb4ec61d57f2 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:24.674647 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93ca965c-b458-4aa6-a103-fb4ec61d57f2 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:24.931291 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-536b8d6d-ef32-4a25-83cc-155a89226ba6 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257f6182a93f4cea86956b9894802513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953509c8c92e497eb38e96860bbc28ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:24.942866 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-536b8d6d-ef32-4a25-83cc-155a89226ba6 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] 10.222.0.27 "GET /compute/v2.1/servers/210b34c5-64e5-4416-ba9d-26ead5ff8a82" status: 200 len: 1510 microversion: 2.1 time: 0.614959 Jun 20 12:02:24.954606 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 645/1308] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:24 2022] GET /compute/v2.1/servers/210b34c5-64e5-4416-ba9d-26ead5ff8a82 => generated 1510 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:24.989164 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-93ca965c-b458-4aa6-a103-fb4ec61d57f2 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:24.995191 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:25.006794 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-93ca965c-b458-4aa6-a103-fb4ec61d57f2 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:25.009082 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-93ca965c-b458-4aa6-a103-fb4ec61d57f2 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:25.010584 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-93ca965c-b458-4aa6-a103-fb4ec61d57f2 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1879 microversion: 2.42 time: 0.352765 Jun 20 12:02:25.021748 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 664/1309] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:24 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1879 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:25.036852 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6a6299df-fdbe-4481-90f8-7faf18d245ff tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:25.037470 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6a6299df-fdbe-4481-90f8-7faf18d245ff tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] [instance: 5c4349cc-0bb9-472f-acc5-e7cf3f616853] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:25.048077 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a6299df-fdbe-4481-90f8-7faf18d245ff tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:25.049699 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a6299df-fdbe-4481-90f8-7faf18d245ff tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:25.050848 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a6299df-fdbe-4481-90f8-7faf18d245ff tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:25.051526 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a6299df-fdbe-4481-90f8-7faf18d245ff tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:25.344447 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-51bff954-f8c4-432a-8621-a1fd5c353016 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:25.344447 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-51bff954-f8c4-432a-8621-a1fd5c353016 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:25.354673 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51bff954-f8c4-432a-8621-a1fd5c353016 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:25.357204 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51bff954-f8c4-432a-8621-a1fd5c353016 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:25.358364 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51bff954-f8c4-432a-8621-a1fd5c353016 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:25.361907 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51bff954-f8c4-432a-8621-a1fd5c353016 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:25.581113 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6a6299df-fdbe-4481-90f8-7faf18d245ff tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce407df032342ddad0dec89baf9b6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a572c10cb94add92e01db93f744ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:25.605056 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6a6299df-fdbe-4481-90f8-7faf18d245ff tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] 10.222.0.27 "GET /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853" status: 200 len: 1316 microversion: 2.1 time: 0.573858 Jun 20 12:02:25.606022 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 646/1310] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:25 2022] GET /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853 => generated 1316 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:25.610988 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-493642de-0784-4afb-ae1e-47d411e8f730 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:25.611841 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-493642de-0784-4afb-ae1e-47d411e8f730 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:25.629428 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-493642de-0784-4afb-ae1e-47d411e8f730 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:25.630330 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-493642de-0784-4afb-ae1e-47d411e8f730 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:25.631379 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-493642de-0784-4afb-ae1e-47d411e8f730 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:25.632040 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-493642de-0784-4afb-ae1e-47d411e8f730 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:25.793982 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-51bff954-f8c4-432a-8621-a1fd5c353016 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:25.803679 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-51bff954-f8c4-432a-8621-a1fd5c353016 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:25.810097 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-51bff954-f8c4-432a-8621-a1fd5c353016 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:25.820433 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-51bff954-f8c4-432a-8621-a1fd5c353016 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1815 microversion: 2.25 time: 0.480411 Jun 20 12:02:25.821596 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 665/1311] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:25 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1815 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:25.870174 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-415a70e5-93db-4992-b611-c432c8836481 req-38fe4c8f-75d5-44fd-b801-65c6b3d4b6d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "210b34c5-64e5-4416-ba9d-26ead5ff8a82", "name": "network-vif-deleted", "tag": "9c2c694f-91c6-4816-b3b0-ae94cace44cb"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:02:25.889299 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-415a70e5-93db-4992-b611-c432c8836481 req-38fe4c8f-75d5-44fd-b801-65c6b3d4b6d0 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:25.889414 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-415a70e5-93db-4992-b611-c432c8836481 req-38fe4c8f-75d5-44fd-b801-65c6b3d4b6d0 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:25.911912 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-415a70e5-93db-4992-b611-c432c8836481 req-38fe4c8f-75d5-44fd-b801-65c6b3d4b6d0 service nova] Creating event network-vif-deleted:9c2c694f-91c6-4816-b3b0-ae94cace44cb for instance 210b34c5-64e5-4416-ba9d-26ead5ff8a82 on n-h1-master-1 Jun 20 12:02:25.917945 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-415a70e5-93db-4992-b611-c432c8836481 req-38fe4c8f-75d5-44fd-b801-65c6b3d4b6d0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051301 Jun 20 12:02:25.925449 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 666/1312] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:02:25.956688 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-493642de-0784-4afb-ae1e-47d411e8f730 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:25.961679 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-419c4637-a88e-461e-a014-2cf1bd999bcf tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:25.962680 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-419c4637-a88e-461e-a014-2cf1bd999bcf tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] [instance: 210b34c5-64e5-4416-ba9d-26ead5ff8a82] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:25.964536 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-493642de-0784-4afb-ae1e-47d411e8f730 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80" status: 200 len: 1310 microversion: 2.1 time: 0.357249 Jun 20 12:02:25.970894 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 647/1313] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:25 2022] GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 => generated 1310 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:25.979422 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-419c4637-a88e-461e-a014-2cf1bd999bcf tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:25.979948 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-419c4637-a88e-461e-a014-2cf1bd999bcf tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:25.980905 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-419c4637-a88e-461e-a014-2cf1bd999bcf tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:25.981407 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-419c4637-a88e-461e-a014-2cf1bd999bcf tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:26.030466 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1a5e40bc-90e5-42e1-b28f-233c6baf4bd7 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:26.031201 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1a5e40bc-90e5-42e1-b28f-233c6baf4bd7 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:26.057629 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a5e40bc-90e5-42e1-b28f-233c6baf4bd7 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:26.058208 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a5e40bc-90e5-42e1-b28f-233c6baf4bd7 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:26.062824 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a5e40bc-90e5-42e1-b28f-233c6baf4bd7 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:26.064100 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a5e40bc-90e5-42e1-b28f-233c6baf4bd7 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:26.082190 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-419c4637-a88e-461e-a014-2cf1bd999bcf tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:26.096402 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-419c4637-a88e-461e-a014-2cf1bd999bcf tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:26.097010 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-419c4637-a88e-461e-a014-2cf1bd999bcf tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lazy-loading 'fault' on Instance uuid 210b34c5-64e5-4416-ba9d-26ead5ff8a82 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:02:26.327210 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-419c4637-a88e-461e-a014-2cf1bd999bcf tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257f6182a93f4cea86956b9894802513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953509c8c92e497eb38e96860bbc28ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:26.347650 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-419c4637-a88e-461e-a014-2cf1bd999bcf tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] 10.222.0.27 "GET /compute/v2.1/servers/210b34c5-64e5-4416-ba9d-26ead5ff8a82" status: 200 len: 1306 microversion: 2.1 time: 0.391001 Jun 20 12:02:26.350753 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 667/1314] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:25 2022] GET /compute/v2.1/servers/210b34c5-64e5-4416-ba9d-26ead5ff8a82 => generated 1306 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:02:26.365120 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-cd12b4e3-891a-48b8-a3fe-c55ec86ee3b8 req-26cbc9bc-cedb-483d-a0a8-b59058b10803 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49a35510-1821-49de-8e39-d45901095c80", "tag": "bab393cc-844a-468b-9b51-51cf37ed5c0a"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:02:26.386770 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-cd12b4e3-891a-48b8-a3fe-c55ec86ee3b8 req-26cbc9bc-cedb-483d-a0a8-b59058b10803 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:26.387747 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-cd12b4e3-891a-48b8-a3fe-c55ec86ee3b8 req-26cbc9bc-cedb-483d-a0a8-b59058b10803 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:26.405895 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-cd12b4e3-891a-48b8-a3fe-c55ec86ee3b8 req-26cbc9bc-cedb-483d-a0a8-b59058b10803 service nova] Creating event network-changed:bab393cc-844a-468b-9b51-51cf37ed5c0a for instance 49a35510-1821-49de-8e39-d45901095c80 on n-h2-master-1 Jun 20 12:02:26.416882 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-cd12b4e3-891a-48b8-a3fe-c55ec86ee3b8 req-26cbc9bc-cedb-483d-a0a8-b59058b10803 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061208 Jun 20 12:02:26.418150 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 668/1315] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:02:26.489662 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1a5e40bc-90e5-42e1-b28f-233c6baf4bd7 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:26.499449 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1a5e40bc-90e5-42e1-b28f-233c6baf4bd7 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:26.501816 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1a5e40bc-90e5-42e1-b28f-233c6baf4bd7 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:26.503207 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1a5e40bc-90e5-42e1-b28f-233c6baf4bd7 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1879 microversion: 2.42 time: 0.477705 Jun 20 12:02:26.514483 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 648/1316] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:26 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1879 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:26.623648 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f184c19c-c667-468a-976c-7e7f7d18f630 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:26.624703 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f184c19c-c667-468a-976c-7e7f7d18f630 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] [instance: 5c4349cc-0bb9-472f-acc5-e7cf3f616853] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:26.634216 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f184c19c-c667-468a-976c-7e7f7d18f630 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:26.635051 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f184c19c-c667-468a-976c-7e7f7d18f630 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:26.636515 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f184c19c-c667-468a-976c-7e7f7d18f630 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:26.637196 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f184c19c-c667-468a-976c-7e7f7d18f630 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:26.849211 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4b732fa6-a369-4555-910a-59c9e352d129 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:26.850861 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4b732fa6-a369-4555-910a-59c9e352d129 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:26.865819 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4b732fa6-a369-4555-910a-59c9e352d129 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:26.868793 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4b732fa6-a369-4555-910a-59c9e352d129 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:26.870687 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4b732fa6-a369-4555-910a-59c9e352d129 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:26.874092 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4b732fa6-a369-4555-910a-59c9e352d129 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:26.997767 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f184c19c-c667-468a-976c-7e7f7d18f630 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce407df032342ddad0dec89baf9b6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a572c10cb94add92e01db93f744ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:27.009754 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f184c19c-c667-468a-976c-7e7f7d18f630 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] 10.222.0.27 "GET /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853" status: 200 len: 1504 microversion: 2.1 time: 0.389621 Jun 20 12:02:27.011847 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 669/1317] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:26 2022] GET /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853 => generated 1504 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:27.019001 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5331b3fc-8bba-43e6-9c60-fc936ab2ed3a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f05689a4-6b8d-4425-b2db-c1c88d9f5c5c"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:02:27.020890 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5331b3fc-8bba-43e6-9c60-fc936ab2ed3a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: f678dc35-c774-4c0a-9ebb-579688adecb0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:27.027968 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5331b3fc-8bba-43e6-9c60-fc936ab2ed3a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:27.028813 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5331b3fc-8bba-43e6-9c60-fc936ab2ed3a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:27.030236 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5331b3fc-8bba-43e6-9c60-fc936ab2ed3a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:27.030888 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5331b3fc-8bba-43e6-9c60-fc936ab2ed3a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:27.191702 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4b732fa6-a369-4555-910a-59c9e352d129 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:27.208662 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4b732fa6-a369-4555-910a-59c9e352d129 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:27.215721 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4b732fa6-a369-4555-910a-59c9e352d129 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:27.217367 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4b732fa6-a369-4555-910a-59c9e352d129 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1815 microversion: 2.25 time: 0.382420 Jun 20 12:02:27.229212 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 649/1318] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:26 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1815 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:27.239707 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5351d6d7-5961-470e-805e-3cc4cd6726bd tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:27.241105 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5351d6d7-5961-470e-805e-3cc4cd6726bd tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] [instance: 1c763272-042e-418c-b2f6-cc2e96f0c54d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:27.255289 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5351d6d7-5961-470e-805e-3cc4cd6726bd tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:27.257466 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5351d6d7-5961-470e-805e-3cc4cd6726bd tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:27.258595 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5351d6d7-5961-470e-805e-3cc4cd6726bd tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:27.259900 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5351d6d7-5961-470e-805e-3cc4cd6726bd tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:27.300142 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5351d6d7-5961-470e-805e-3cc4cd6726bd tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] 10.222.0.27 "GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069175 Jun 20 12:02:27.305692 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 650/1319] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:02:27 2022] GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:02:27.311064 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-11970604-fa13-4e8a-8efd-24e6ee1c1181 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:27.312167 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-11970604-fa13-4e8a-8efd-24e6ee1c1181 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:27.321353 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-11970604-fa13-4e8a-8efd-24e6ee1c1181 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:27.322315 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-11970604-fa13-4e8a-8efd-24e6ee1c1181 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:27.323687 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-11970604-fa13-4e8a-8efd-24e6ee1c1181 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:27.324417 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-11970604-fa13-4e8a-8efd-24e6ee1c1181 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:27.402787 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5331b3fc-8bba-43e6-9c60-fc936ab2ed3a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "POST /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.388104 Jun 20 12:02:27.406241 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 670/1320] 10.222.0.27 () {60 vars in 1322 bytes} [Mon Jun 20 12:02:27 2022] POST /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0/os-volume_attachments => generated 194 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:02:27.413233 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c568156f-86d6-40ae-95f9-c6e5e9cb566f tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:27.414299 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c568156f-86d6-40ae-95f9-c6e5e9cb566f tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] [instance: 5c4349cc-0bb9-472f-acc5-e7cf3f616853] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:27.424768 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c568156f-86d6-40ae-95f9-c6e5e9cb566f tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:27.425564 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c568156f-86d6-40ae-95f9-c6e5e9cb566f tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:27.426638 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c568156f-86d6-40ae-95f9-c6e5e9cb566f tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:27.427347 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c568156f-86d6-40ae-95f9-c6e5e9cb566f tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:27.467524 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c568156f-86d6-40ae-95f9-c6e5e9cb566f tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] [instance: 5c4349cc-0bb9-472f-acc5-e7cf3f616853] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:02:27.612827 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c568156f-86d6-40ae-95f9-c6e5e9cb566f tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853" status: 204 len: 0 microversion: 2.1 time: 0.199876 Jun 20 12:02:27.617285 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 671/1321] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:02:27 2022] DELETE /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:02:27.626653 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0b8fa5c9-67f8-4170-a314-ee90c42308c9 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:27.627557 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0b8fa5c9-67f8-4170-a314-ee90c42308c9 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] [instance: 210b34c5-64e5-4416-ba9d-26ead5ff8a82] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:27.635516 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0b8fa5c9-67f8-4170-a314-ee90c42308c9 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:27.636329 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0b8fa5c9-67f8-4170-a314-ee90c42308c9 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:27.637459 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0b8fa5c9-67f8-4170-a314-ee90c42308c9 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:27.638272 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0b8fa5c9-67f8-4170-a314-ee90c42308c9 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:27.658908 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-0b8fa5c9-67f8-4170-a314-ee90c42308c9 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] HTTP exception thrown: Instance 210b34c5-64e5-4416-ba9d-26ead5ff8a82 could not be found. Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0b8fa5c9-67f8-4170-a314-ee90c42308c9 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Request method failure captured: Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/210b34c5-64e5-4416-ba9d-26ead5ff8a82 HTTP/1.1 Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGGzN-cEewGpSWf5ngMzlm1b8E72iZeGKr216hMXc6KFUYa6lvr1JL4WYWGoBH4icPda6E6tk-ToAPnOrvPbhS8LADO_6rAuvV_3aqJLuNKdYr5tNtj_wh2w7oJuSi6nn_o_oTwFRhJoCN-P0BnO2NKnbuGJRD3GMHLgbbM4sPR9KPQ Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 953509c8c92e497eb38e96860bbc28ee Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServerAddressesTestJSON-1355490589 Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/953509c8c92e497eb38e96860bbc28ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/953509c8c92e497eb38e96860bbc28ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/953509c8c92e497eb38e96860bbc28ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_953509c8c92e497eb38e96860bbc28ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServerAddressesTestJSON-1355490589 Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 953509c8c92e497eb38e96860bbc28ee Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1355490589 Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServerAddressesTestJSON-1355490589-project Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 257f6182a93f4cea86956b9894802513 Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServerAddressesTestJSON-1355490589-project Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 210b34c5-64e5-4416-ba9d-26ead5ff8a82 could not be found. Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '210b34c5-64e5-4416-ba9d-26ead5ff8a82'} Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 210b34c5-64e5-4416-ba9d-26ead5ff8a82 could not be found. Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 210b34c5-64e5-4416-ba9d-26ead5ff8a82 could not be found. Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:02:27.661115 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:27.667292 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:27.667292 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:02:27.667292 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:02:27.667292 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:02:27.667292 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:02:27.667292 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 210b34c5-64e5-4416-ba9d-26ead5ff8a82 could not be found. Jun 20 12:02:27.667292 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:27.669275 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0b8fa5c9-67f8-4170-a314-ee90c42308c9 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] Returning 404 to user: Instance 210b34c5-64e5-4416-ba9d-26ead5ff8a82 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:02:27.670213 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0b8fa5c9-67f8-4170-a314-ee90c42308c9 tempest-ServerAddressesTestJSON-1355490589 tempest-ServerAddressesTestJSON-1355490589-project] 10.222.0.27 "GET /compute/v2.1/servers/210b34c5-64e5-4416-ba9d-26ead5ff8a82" status: 404 len: 111 microversion: 2.1 time: 0.052348 Jun 20 12:02:27.674588 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 672/1322] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:27 2022] GET /compute/v2.1/servers/210b34c5-64e5-4416-ba9d-26ead5ff8a82 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:02:27.676666 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-192bb426-c379-4aa0-9267-24708a256b57 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:27.677746 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-192bb426-c379-4aa0-9267-24708a256b57 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] [instance: 1c763272-042e-418c-b2f6-cc2e96f0c54d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:27.684788 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-192bb426-c379-4aa0-9267-24708a256b57 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:27.685364 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-192bb426-c379-4aa0-9267-24708a256b57 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:27.686280 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-192bb426-c379-4aa0-9267-24708a256b57 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:27.686940 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-192bb426-c379-4aa0-9267-24708a256b57 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:27.723770 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-192bb426-c379-4aa0-9267-24708a256b57 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] 10.222.0.27 "GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051198 Jun 20 12:02:27.729120 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 673/1323] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:02:27 2022] GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:02:27.738909 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e27e6e61-2f25-451f-8243-51e48033d04f tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:27.740735 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e27e6e61-2f25-451f-8243-51e48033d04f tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:27.747379 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e27e6e61-2f25-451f-8243-51e48033d04f tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:27.747912 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e27e6e61-2f25-451f-8243-51e48033d04f tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:27.748844 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e27e6e61-2f25-451f-8243-51e48033d04f tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:27.749340 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e27e6e61-2f25-451f-8243-51e48033d04f tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:27.824445 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-11970604-fa13-4e8a-8efd-24e6ee1c1181 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:27.833820 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-11970604-fa13-4e8a-8efd-24e6ee1c1181 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80" status: 200 len: 1310 microversion: 2.1 time: 0.526826 Jun 20 12:02:27.843649 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 651/1324] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:27 2022] GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 => generated 1310 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:27.849618 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0f8a501c-6a46-4501-aeae-1fa50694d315 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:27.850236 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0f8a501c-6a46-4501-aeae-1fa50694d315 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] [instance: 5c4349cc-0bb9-472f-acc5-e7cf3f616853] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:27.856649 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f8a501c-6a46-4501-aeae-1fa50694d315 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:27.857101 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f8a501c-6a46-4501-aeae-1fa50694d315 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:27.858077 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f8a501c-6a46-4501-aeae-1fa50694d315 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:27.858683 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f8a501c-6a46-4501-aeae-1fa50694d315 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:28.086418 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e27e6e61-2f25-451f-8243-51e48033d04f tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:28.099025 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e27e6e61-2f25-451f-8243-51e48033d04f tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:28.100887 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e27e6e61-2f25-451f-8243-51e48033d04f tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:28.102775 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e27e6e61-2f25-451f-8243-51e48033d04f tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1879 microversion: 2.42 time: 0.376791 Jun 20 12:02:28.103864 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 674/1325] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:27 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1879 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:28.109942 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-17fc980b-7aeb-43a2-917d-499437d98240 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:28.110709 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-17fc980b-7aeb-43a2-917d-499437d98240 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] [instance: 1c763272-042e-418c-b2f6-cc2e96f0c54d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:28.121563 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17fc980b-7aeb-43a2-917d-499437d98240 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:28.122304 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17fc980b-7aeb-43a2-917d-499437d98240 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:28.123254 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17fc980b-7aeb-43a2-917d-499437d98240 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:28.123837 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17fc980b-7aeb-43a2-917d-499437d98240 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:28.135522 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0f8a501c-6a46-4501-aeae-1fa50694d315 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce407df032342ddad0dec89baf9b6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a572c10cb94add92e01db93f744ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:28.148757 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0f8a501c-6a46-4501-aeae-1fa50694d315 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] 10.222.0.27 "GET /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853" status: 200 len: 1510 microversion: 2.1 time: 0.303592 Jun 20 12:02:28.150323 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 652/1326] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:27 2022] GET /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853 => generated 1510 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:28.151574 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-17fc980b-7aeb-43a2-917d-499437d98240 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] [instance: 1c763272-042e-418c-b2f6-cc2e96f0c54d] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:02:28.241531 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dbfd6ff7-4097-4431-bc22-7c26cd1c42be tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:28.242656 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-dbfd6ff7-4097-4431-bc22-7c26cd1c42be tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:28.249316 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dbfd6ff7-4097-4431-bc22-7c26cd1c42be tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:28.250123 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dbfd6ff7-4097-4431-bc22-7c26cd1c42be tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:28.250494 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-17fc980b-7aeb-43a2-917d-499437d98240 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d" status: 204 len: 0 microversion: 2.1 time: 0.143563 Jun 20 12:02:28.252147 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 675/1327] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:02:28 2022] DELETE /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:02:28.255533 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dbfd6ff7-4097-4431-bc22-7c26cd1c42be tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:28.256397 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dbfd6ff7-4097-4431-bc22-7c26cd1c42be tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:28.267636 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-35e3c106-96e4-4be1-9074-1295189751d9 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:28.268551 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-35e3c106-96e4-4be1-9074-1295189751d9 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] [instance: 1c763272-042e-418c-b2f6-cc2e96f0c54d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:28.278104 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-35e3c106-96e4-4be1-9074-1295189751d9 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:28.278104 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-35e3c106-96e4-4be1-9074-1295189751d9 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:28.279750 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-35e3c106-96e4-4be1-9074-1295189751d9 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:28.280332 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-35e3c106-96e4-4be1-9074-1295189751d9 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:28.521997 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-dbfd6ff7-4097-4431-bc22-7c26cd1c42be tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:28.536216 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-35e3c106-96e4-4be1-9074-1295189751d9 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f4e0e140c4a839d99b56ee9ffacc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35cecfcbb948c6b60eef6140f87a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:28.539624 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-dbfd6ff7-4097-4431-bc22-7c26cd1c42be tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:28.546393 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-dbfd6ff7-4097-4431-bc22-7c26cd1c42be tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:28.547685 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dbfd6ff7-4097-4431-bc22-7c26cd1c42be tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1815 microversion: 2.25 time: 0.310699 Jun 20 12:02:28.550253 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 653/1328] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:28 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1815 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:02:28.554131 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-35e3c106-96e4-4be1-9074-1295189751d9 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] 10.222.0.27 "GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d" status: 200 len: 1681 microversion: 2.1 time: 0.296853 Jun 20 12:02:28.556602 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 676/1329] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:28 2022] GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d => generated 1681 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:28.851052 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-67396514-27b8-477a-a16d-66c275e532bc tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:28.851372 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-67396514-27b8-477a-a16d-66c275e532bc tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:28.862324 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-67396514-27b8-477a-a16d-66c275e532bc tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:28.864362 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-67396514-27b8-477a-a16d-66c275e532bc tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:28.865917 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-67396514-27b8-477a-a16d-66c275e532bc tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:28.868272 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-67396514-27b8-477a-a16d-66c275e532bc tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:29.126178 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d00124a3-846a-470b-be9f-b30e35068fc4 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:29.126804 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d00124a3-846a-470b-be9f-b30e35068fc4 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:29.139930 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d00124a3-846a-470b-be9f-b30e35068fc4 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:29.142900 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d00124a3-846a-470b-be9f-b30e35068fc4 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:29.153279 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d00124a3-846a-470b-be9f-b30e35068fc4 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:29.154016 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d00124a3-846a-470b-be9f-b30e35068fc4 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:29.395567 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-67396514-27b8-477a-a16d-66c275e532bc tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:29.404041 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-67396514-27b8-477a-a16d-66c275e532bc tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80" status: 200 len: 1310 microversion: 2.1 time: 0.557050 Jun 20 12:02:29.404668 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 654/1330] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:28 2022] GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 => generated 1310 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:29.439857 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6022e4aa-9038-4414-b169-23a59c93f1f5 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:29.440088 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6022e4aa-9038-4414-b169-23a59c93f1f5 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] [instance: 5c4349cc-0bb9-472f-acc5-e7cf3f616853] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:29.456351 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6022e4aa-9038-4414-b169-23a59c93f1f5 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:29.457519 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6022e4aa-9038-4414-b169-23a59c93f1f5 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:29.459872 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6022e4aa-9038-4414-b169-23a59c93f1f5 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:29.460737 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6022e4aa-9038-4414-b169-23a59c93f1f5 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:29.571829 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d00124a3-846a-470b-be9f-b30e35068fc4 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:29.585056 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d00124a3-846a-470b-be9f-b30e35068fc4 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:29.586573 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d00124a3-846a-470b-be9f-b30e35068fc4 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:29.587777 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d00124a3-846a-470b-be9f-b30e35068fc4 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1879 microversion: 2.42 time: 0.467706 Jun 20 12:02:29.590975 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 677/1331] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:29 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1879 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:02:29.603440 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-eb34d317-a4b7-45b5-9d4a-12421be4c058 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:29.604187 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-eb34d317-a4b7-45b5-9d4a-12421be4c058 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:29.619641 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb34d317-a4b7-45b5-9d4a-12421be4c058 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:29.620102 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb34d317-a4b7-45b5-9d4a-12421be4c058 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:29.620932 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb34d317-a4b7-45b5-9d4a-12421be4c058 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:29.621368 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb34d317-a4b7-45b5-9d4a-12421be4c058 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:29.685235 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:29.712952 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:29.742498 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:29.919149 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-eb34d317-a4b7-45b5-9d4a-12421be4c058 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:29.920896 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6022e4aa-9038-4414-b169-23a59c93f1f5 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce407df032342ddad0dec89baf9b6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a572c10cb94add92e01db93f744ef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:29.931135 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:29.947992 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-eb34d317-a4b7-45b5-9d4a-12421be4c058 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:29.947992 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-eb34d317-a4b7-45b5-9d4a-12421be4c058 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:29.947992 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-eb34d317-a4b7-45b5-9d4a-12421be4c058 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1815 microversion: 2.25 time: 0.354763 Jun 20 12:02:29.955939 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6022e4aa-9038-4414-b169-23a59c93f1f5 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] 10.222.0.27 "GET /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853" status: 200 len: 1510 microversion: 2.1 time: 0.533621 Jun 20 12:02:29.957558 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 678/1332] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:29 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1815 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:29.967050 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 655/1333] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:29 2022] GET /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853 => generated 1510 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:29.973952 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-78559062-0cac-47f3-961e-221fe41e518e tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:29.976934 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-78559062-0cac-47f3-961e-221fe41e518e tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] [instance: 1c763272-042e-418c-b2f6-cc2e96f0c54d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:29.985855 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-78559062-0cac-47f3-961e-221fe41e518e tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:29.986304 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-78559062-0cac-47f3-961e-221fe41e518e tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:29.987080 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-78559062-0cac-47f3-961e-221fe41e518e tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:29.987517 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-78559062-0cac-47f3-961e-221fe41e518e tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:30.427627 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5e5c3774-8997-40c5-8a50-6ef63426cb41 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:30.429329 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5e5c3774-8997-40c5-8a50-6ef63426cb41 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:30.436979 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:30.442525 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e5c3774-8997-40c5-8a50-6ef63426cb41 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:30.443946 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e5c3774-8997-40c5-8a50-6ef63426cb41 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:30.444996 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e5c3774-8997-40c5-8a50-6ef63426cb41 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:30.445617 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e5c3774-8997-40c5-8a50-6ef63426cb41 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:30.822936 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-78559062-0cac-47f3-961e-221fe41e518e tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f4e0e140c4a839d99b56ee9ffacc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35cecfcbb948c6b60eef6140f87a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:30.833183 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-78559062-0cac-47f3-961e-221fe41e518e tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] 10.222.0.27 "GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d" status: 200 len: 1681 microversion: 2.1 time: 0.873175 Jun 20 12:02:30.838448 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 679/1334] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:29 2022] GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d => generated 1681 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:30.856923 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-42a6955e-d131-4e78-bcf1-d3c7bb2377cf tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:30.858323 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-42a6955e-d131-4e78-bcf1-d3c7bb2377cf tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:30.884729 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-42a6955e-d131-4e78-bcf1-d3c7bb2377cf tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:30.890275 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-42a6955e-d131-4e78-bcf1-d3c7bb2377cf tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:30.891659 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-42a6955e-d131-4e78-bcf1-d3c7bb2377cf tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:30.903105 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-42a6955e-d131-4e78-bcf1-d3c7bb2377cf tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:31.429366 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5e5c3774-8997-40c5-8a50-6ef63426cb41 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:31.440841 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5e5c3774-8997-40c5-8a50-6ef63426cb41 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80" status: 200 len: 1310 microversion: 2.1 time: 1.020858 Jun 20 12:02:31.453270 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 656/1335] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:30 2022] GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 => generated 1310 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:31.459478 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-ef6fc7d0-d6ac-4d9e-8486-fb58baa6f2e8 req-64aa6ba4-b075-4a2c-bc2b-05ed08b9794b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c4349cc-0bb9-472f-acc5-e7cf3f616853", "name": "network-vif-deleted", "tag": "33d25283-959e-4f57-8e3e-462da79d8264"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:02:31.473731 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-ef6fc7d0-d6ac-4d9e-8486-fb58baa6f2e8 req-64aa6ba4-b075-4a2c-bc2b-05ed08b9794b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:31.474779 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-ef6fc7d0-d6ac-4d9e-8486-fb58baa6f2e8 req-64aa6ba4-b075-4a2c-bc2b-05ed08b9794b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:31.499377 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-ef6fc7d0-d6ac-4d9e-8486-fb58baa6f2e8 req-64aa6ba4-b075-4a2c-bc2b-05ed08b9794b service nova] Creating event network-vif-deleted:33d25283-959e-4f57-8e3e-462da79d8264 for instance 5c4349cc-0bb9-472f-acc5-e7cf3f616853 on n-h1-master-1 Jun 20 12:02:31.507242 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-ef6fc7d0-d6ac-4d9e-8486-fb58baa6f2e8 req-64aa6ba4-b075-4a2c-bc2b-05ed08b9794b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050916 Jun 20 12:02:31.508584 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 657/1336] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:02:31.516765 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8beee564-ee04-4e66-be7a-fad550fb42c9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:31.517851 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8beee564-ee04-4e66-be7a-fad550fb42c9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:31.527171 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8beee564-ee04-4e66-be7a-fad550fb42c9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:31.528020 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8beee564-ee04-4e66-be7a-fad550fb42c9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:31.529097 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8beee564-ee04-4e66-be7a-fad550fb42c9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:31.529787 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8beee564-ee04-4e66-be7a-fad550fb42c9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:32.147931 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8beee564-ee04-4e66-be7a-fad550fb42c9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:32.176355 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8beee564-ee04-4e66-be7a-fad550fb42c9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:32.178003 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8beee564-ee04-4e66-be7a-fad550fb42c9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:32.185597 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8beee564-ee04-4e66-be7a-fad550fb42c9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1815 microversion: 2.25 time: 0.674194 Jun 20 12:02:32.197668 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 658/1337] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:31 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1815 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:32.206807 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7f430f82-c21f-4f65-977a-6fd49afb2ed2 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:32.216906 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7f430f82-c21f-4f65-977a-6fd49afb2ed2 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] [instance: 5c4349cc-0bb9-472f-acc5-e7cf3f616853] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:32.234099 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f430f82-c21f-4f65-977a-6fd49afb2ed2 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:32.235001 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f430f82-c21f-4f65-977a-6fd49afb2ed2 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:32.236085 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f430f82-c21f-4f65-977a-6fd49afb2ed2 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:32.239380 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f430f82-c21f-4f65-977a-6fd49afb2ed2 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:32.279321 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-7f430f82-c21f-4f65-977a-6fd49afb2ed2 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] HTTP exception thrown: Instance 5c4349cc-0bb9-472f-acc5-e7cf3f616853 could not be found. Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7f430f82-c21f-4f65-977a-6fd49afb2ed2 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Request method failure captured: Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853 HTTP/1.1 Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGG3F5-dsECkor8F7fBEXoxqB6FiS9BsfOgmzITw4k_IO4TSexDR_8xf_x_AUqaMrFi0TlXzf7AZG8o8D1Hr7oPLP6gSLaepKQ8kjFxxf6nwWxtHg_RrWN5IM9N6984B2Gz_A2GLJS6ELn9H4tRKPu6lPjIQQ_5E4z5xA1r7BU7_VZU Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: f4a572c10cb94add92e01db93f744ef0 Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ImagesNegativeTestJSON-1919180375 Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4a572c10cb94add92e01db93f744ef0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4a572c10cb94add92e01db93f744ef0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4a572c10cb94add92e01db93f744ef0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4a572c10cb94add92e01db93f744ef0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ImagesNegativeTestJSON-1919180375 Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: f4a572c10cb94add92e01db93f744ef0 Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1919180375 Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ImagesNegativeTestJSON-1919180375-project Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 7ce407df032342ddad0dec89baf9b6ea Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ImagesNegativeTestJSON-1919180375-project Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 5c4349cc-0bb9-472f-acc5-e7cf3f616853 could not be found. Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '5c4349cc-0bb9-472f-acc5-e7cf3f616853'} Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c4349cc-0bb9-472f-acc5-e7cf3f616853 could not be found. Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c4349cc-0bb9-472f-acc5-e7cf3f616853 could not be found. Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:02:32.282208 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:02:32.286724 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:32.286724 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:02:32.286724 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:02:32.286724 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:02:32.286724 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:02:32.286724 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c4349cc-0bb9-472f-acc5-e7cf3f616853 could not be found. Jun 20 12:02:32.286724 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:02:32.295111 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7f430f82-c21f-4f65-977a-6fd49afb2ed2 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Returning 404 to user: Instance 5c4349cc-0bb9-472f-acc5-e7cf3f616853 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:02:32.298725 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7f430f82-c21f-4f65-977a-6fd49afb2ed2 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] 10.222.0.27 "GET /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853" status: 404 len: 111 microversion: 2.1 time: 0.098790 Jun 20 12:02:32.304016 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 659/1338] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:32 2022] GET /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:02:32.310256 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ad701298-53d3-4e1d-9f5f-8ad4af472a6d tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:32.311160 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ad701298-53d3-4e1d-9f5f-8ad4af472a6d tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] [instance: 1c763272-042e-418c-b2f6-cc2e96f0c54d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:32.321011 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ad701298-53d3-4e1d-9f5f-8ad4af472a6d tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:32.321863 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ad701298-53d3-4e1d-9f5f-8ad4af472a6d tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:32.323609 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ad701298-53d3-4e1d-9f5f-8ad4af472a6d tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:32.324322 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ad701298-53d3-4e1d-9f5f-8ad4af472a6d tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:32.394386 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-42a6955e-d131-4e78-bcf1-d3c7bb2377cf tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:32.412261 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-42a6955e-d131-4e78-bcf1-d3c7bb2377cf tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:32.414096 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-42a6955e-d131-4e78-bcf1-d3c7bb2377cf tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:32.416940 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-42a6955e-d131-4e78-bcf1-d3c7bb2377cf tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1879 microversion: 2.42 time: 1.576986 Jun 20 12:02:32.423341 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 680/1339] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:30 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1879 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:32.441286 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d9c860a3-38c7-49ad-9f2d-bbaa02b747ce tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-684561533", "metadata": {"image_type": "test"}}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:02:32.444712 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d9c860a3-38c7-49ad-9f2d-bbaa02b747ce tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] [instance: 5c4349cc-0bb9-472f-acc5-e7cf3f616853] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:32.483949 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9c860a3-38c7-49ad-9f2d-bbaa02b747ce tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:32.487087 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9c860a3-38c7-49ad-9f2d-bbaa02b747ce tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:32.488051 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9c860a3-38c7-49ad-9f2d-bbaa02b747ce tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:32.489197 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9c860a3-38c7-49ad-9f2d-bbaa02b747ce tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:32.526322 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-d9c860a3-38c7-49ad-9f2d-bbaa02b747ce tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] HTTP exception thrown: Instance 5c4349cc-0bb9-472f-acc5-e7cf3f616853 could not be found. Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d9c860a3-38c7-49ad-9f2d-bbaa02b747ce tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Request method failure captured: Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853/action HTTP/1.1 Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 111 Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGG3F5-dsECkor8F7fBEXoxqB6FiS9BsfOgmzITw4k_IO4TSexDR_8xf_x_AUqaMrFi0TlXzf7AZG8o8D1Hr7oPLP6gSLaepKQ8kjFxxf6nwWxtHg_RrWN5IM9N6984B2Gz_A2GLJS6ELn9H4tRKPu6lPjIQQ_5E4z5xA1r7BU7_VZU Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: f4a572c10cb94add92e01db93f744ef0 Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ImagesNegativeTestJSON-1919180375 Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4a572c10cb94add92e01db93f744ef0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4a572c10cb94add92e01db93f744ef0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4a572c10cb94add92e01db93f744ef0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4a572c10cb94add92e01db93f744ef0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ImagesNegativeTestJSON-1919180375 Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: f4a572c10cb94add92e01db93f744ef0 Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1919180375 Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ImagesNegativeTestJSON-1919180375-project Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 7ce407df032342ddad0dec89baf9b6ea Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ImagesNegativeTestJSON-1919180375-project Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-684561533", "metadata": {"image_type": "test"}}} Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 5c4349cc-0bb9-472f-acc5-e7cf3f616853 could not be found. Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '5c4349cc-0bb9-472f-acc5-e7cf3f616853', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-684561533', 'metadata': {'image_type': 'test'}}}} Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c4349cc-0bb9-472f-acc5-e7cf3f616853 could not be found. Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 20 12:02:32.531247 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:02:32.536117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:02:32.536117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:02:32.536117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:02:32.536117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c4349cc-0bb9-472f-acc5-e7cf3f616853 could not be found. Jun 20 12:02:32.536117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:32.536117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:02:32.536117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:32.536117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:32.536117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:02:32.536117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:02:32.536117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:02:32.536117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:02:32.536117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c4349cc-0bb9-472f-acc5-e7cf3f616853 could not be found. Jun 20 12:02:32.536117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:32.540700 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d9c860a3-38c7-49ad-9f2d-bbaa02b747ce tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Returning 404 to user: Instance 5c4349cc-0bb9-472f-acc5-e7cf3f616853 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:02:32.541883 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d9c860a3-38c7-49ad-9f2d-bbaa02b747ce tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] 10.222.0.27 "POST /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853/action" status: 404 len: 111 microversion: 2.1 time: 0.112585 Jun 20 12:02:32.543058 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 681/1340] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Jun 20 12:02:32 2022] POST /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853/action => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:02:32.548611 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-de4e514c-30e5-4a72-b1b4-3b34546f3fb9 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:32.550196 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-de4e514c-30e5-4a72-b1b4-3b34546f3fb9 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:32.557621 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-de4e514c-30e5-4a72-b1b4-3b34546f3fb9 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:32.558656 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-de4e514c-30e5-4a72-b1b4-3b34546f3fb9 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:32.560313 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-de4e514c-30e5-4a72-b1b4-3b34546f3fb9 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:32.560963 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-de4e514c-30e5-4a72-b1b4-3b34546f3fb9 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:32.887109 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-de4e514c-30e5-4a72-b1b4-3b34546f3fb9 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:32.897929 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-de4e514c-30e5-4a72-b1b4-3b34546f3fb9 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80" status: 200 len: 1310 microversion: 2.1 time: 0.353384 Jun 20 12:02:32.902087 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 682/1341] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:32 2022] GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 => generated 1310 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:32.925633 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0a33b674-d184-4da4-a46d-c337b5ea4fed tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-337110618", "metadata": {"image_type": "test"}}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:02:32.929179 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0a33b674-d184-4da4-a46d-c337b5ea4fed tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Failed to fetch instance by id tempest-invalid-1956290352 {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 20 12:02:32.930906 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-0a33b674-d184-4da4-a46d-c337b5ea4fed tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] HTTP exception thrown: Instance tempest-invalid-1956290352 could not be found. Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0a33b674-d184-4da4-a46d-c337b5ea4fed tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Request method failure captured: Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers/tempest-invalid-1956290352/action HTTP/1.1 Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 111 Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGG3F5-dsECkor8F7fBEXoxqB6FiS9BsfOgmzITw4k_IO4TSexDR_8xf_x_AUqaMrFi0TlXzf7AZG8o8D1Hr7oPLP6gSLaepKQ8kjFxxf6nwWxtHg_RrWN5IM9N6984B2Gz_A2GLJS6ELn9H4tRKPu6lPjIQQ_5E4z5xA1r7BU7_VZU Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: f4a572c10cb94add92e01db93f744ef0 Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ImagesNegativeTestJSON-1919180375 Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4a572c10cb94add92e01db93f744ef0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4a572c10cb94add92e01db93f744ef0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4a572c10cb94add92e01db93f744ef0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4a572c10cb94add92e01db93f744ef0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ImagesNegativeTestJSON-1919180375 Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: f4a572c10cb94add92e01db93f744ef0 Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1919180375 Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ImagesNegativeTestJSON-1919180375-project Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 7ce407df032342ddad0dec89baf9b6ea Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ImagesNegativeTestJSON-1919180375-project Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-337110618", "metadata": {"image_type": "test"}}} Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: exception: Instance tempest-invalid-1956290352 could not be found. Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'tempest-invalid-1956290352', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-337110618', 'metadata': {'image_type': 'test'}}}} Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1956290352 could not be found. Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:02:32.935410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1956290352 could not be found. Jun 20 12:02:32.940133 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:32.940133 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:02:32.940133 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:32.940133 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:32.940133 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:02:32.940133 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:02:32.940133 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:02:32.940133 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:02:32.940133 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1956290352 could not be found. Jun 20 12:02:32.940133 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:32.942359 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0a33b674-d184-4da4-a46d-c337b5ea4fed tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Returning 404 to user: Instance tempest-invalid-1956290352 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:02:32.943274 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0a33b674-d184-4da4-a46d-c337b5ea4fed tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] 10.222.0.27 "POST /compute/v2.1/servers/tempest-invalid-1956290352/action" status: 404 len: 101 microversion: 2.1 time: 0.028008 Jun 20 12:02:32.943862 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 683/1342] 10.222.0.27 () {60 vars in 1248 bytes} [Mon Jun 20 12:02:32 2022] POST /compute/v2.1/servers/tempest-invalid-1956290352/action => generated 101 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:02:32.953492 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-42393cb0-52b3-4f46-990b-2d094bc68748 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-720560829"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:02:32.954770 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-42393cb0-52b3-4f46-990b-2d094bc68748 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 20 12:02:32.955258 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-42393cb0-52b3-4f46-990b-2d094bc68748 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-42393cb0-52b3-4f46-990b-2d094bc68748 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Request method failure captured: Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 56 Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGG3F5-dsECkor8F7fBEXoxqB6FiS9BsfOgmzITw4k_IO4TSexDR_8xf_x_AUqaMrFi0TlXzf7AZG8o8D1Hr7oPLP6gSLaepKQ8kjFxxf6nwWxtHg_RrWN5IM9N6984B2Gz_A2GLJS6ELn9H4tRKPu6lPjIQQ_5E4z5xA1r7BU7_VZU Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: f4a572c10cb94add92e01db93f744ef0 Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ImagesNegativeTestJSON-1919180375 Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4a572c10cb94add92e01db93f744ef0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4a572c10cb94add92e01db93f744ef0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4a572c10cb94add92e01db93f744ef0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4a572c10cb94add92e01db93f744ef0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ImagesNegativeTestJSON-1919180375 Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: f4a572c10cb94add92e01db93f744ef0 Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1919180375 Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ImagesNegativeTestJSON-1919180375-project Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 7ce407df032342ddad0dec89baf9b6ea Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ImagesNegativeTestJSON-1919180375-project Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: {"createImage": {"name": "tempest-test-snap-720560829"}} Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-720560829'}}} Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 20 12:02:32.956874 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:32.961326 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:02:32.961326 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:32.961326 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:32.961326 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:02:32.961326 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:02:32.961326 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:02:32.961326 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:02:32.961326 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 20 12:02:32.961326 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:32.961326 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-42393cb0-52b3-4f46-990b-2d094bc68748 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:02:32.961326 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-42393cb0-52b3-4f46-990b-2d094bc68748 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] 10.222.0.27 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.008871 Jun 20 12:02:32.961326 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 684/1343] 10.222.0.27 () {60 vars in 1274 bytes} [Mon Jun 20 12:02:32 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:02:32.975052 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-abb7538a-486e-46d7-be1d-5e4f45238439 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-855818519"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:02:32.976051 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-abb7538a-486e-46d7-be1d-5e4f45238439 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 20 12:02:32.985571 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-abb7538a-486e-46d7-be1d-5e4f45238439 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-abb7538a-486e-46d7-be1d-5e4f45238439 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Request method failure captured: Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 56 Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGG3F5-dsECkor8F7fBEXoxqB6FiS9BsfOgmzITw4k_IO4TSexDR_8xf_x_AUqaMrFi0TlXzf7AZG8o8D1Hr7oPLP6gSLaepKQ8kjFxxf6nwWxtHg_RrWN5IM9N6984B2Gz_A2GLJS6ELn9H4tRKPu6lPjIQQ_5E4z5xA1r7BU7_VZU Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: f4a572c10cb94add92e01db93f744ef0 Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ImagesNegativeTestJSON-1919180375 Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4a572c10cb94add92e01db93f744ef0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4a572c10cb94add92e01db93f744ef0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4a572c10cb94add92e01db93f744ef0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4a572c10cb94add92e01db93f744ef0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ImagesNegativeTestJSON-1919180375 Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: f4a572c10cb94add92e01db93f744ef0 Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1919180375 Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ImagesNegativeTestJSON-1919180375-project Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 7ce407df032342ddad0dec89baf9b6ea Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ImagesNegativeTestJSON-1919180375-project Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: {"createImage": {"name": "tempest-test-snap-855818519"}} Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-855818519'}}} Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 20 12:02:32.989318 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:32.997681 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:02:32.997681 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:32.997681 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:32.997681 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:02:32.997681 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:02:32.997681 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:02:32.997681 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:02:32.997681 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 20 12:02:32.997681 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:33.007764 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-abb7538a-486e-46d7-be1d-5e4f45238439 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:02:33.014210 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-abb7538a-486e-46d7-be1d-5e4f45238439 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] 10.222.0.27 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.039008 Jun 20 12:02:33.017242 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 685/1344] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Jun 20 12:02:32 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:02:33.031908 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-15316674-bed3-4f8e-9d37-d6fae2f2bed3 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:33.032880 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-15316674-bed3-4f8e-9d37-d6fae2f2bed3 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] [instance: 5c4349cc-0bb9-472f-acc5-e7cf3f616853] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:33.040400 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-15316674-bed3-4f8e-9d37-d6fae2f2bed3 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:33.041105 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-15316674-bed3-4f8e-9d37-d6fae2f2bed3 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:33.042170 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-15316674-bed3-4f8e-9d37-d6fae2f2bed3 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:33.043716 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-15316674-bed3-4f8e-9d37-d6fae2f2bed3 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:33.062303 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-15316674-bed3-4f8e-9d37-d6fae2f2bed3 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] HTTP exception thrown: Instance 5c4349cc-0bb9-472f-acc5-e7cf3f616853 could not be found. Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-15316674-bed3-4f8e-9d37-d6fae2f2bed3 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Request method failure captured: Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853 HTTP/1.1 Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGG3F5-dsECkor8F7fBEXoxqB6FiS9BsfOgmzITw4k_IO4TSexDR_8xf_x_AUqaMrFi0TlXzf7AZG8o8D1Hr7oPLP6gSLaepKQ8kjFxxf6nwWxtHg_RrWN5IM9N6984B2Gz_A2GLJS6ELn9H4tRKPu6lPjIQQ_5E4z5xA1r7BU7_VZU Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: f4a572c10cb94add92e01db93f744ef0 Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ImagesNegativeTestJSON-1919180375 Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4a572c10cb94add92e01db93f744ef0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4a572c10cb94add92e01db93f744ef0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4a572c10cb94add92e01db93f744ef0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4a572c10cb94add92e01db93f744ef0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ImagesNegativeTestJSON-1919180375 Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: f4a572c10cb94add92e01db93f744ef0 Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1919180375 Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ImagesNegativeTestJSON-1919180375-project Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 7ce407df032342ddad0dec89baf9b6ea Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ImagesNegativeTestJSON-1919180375-project Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 5c4349cc-0bb9-472f-acc5-e7cf3f616853 could not be found. Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '5c4349cc-0bb9-472f-acc5-e7cf3f616853'} Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c4349cc-0bb9-472f-acc5-e7cf3f616853 could not be found. Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:02:33.064929 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:02:33.069923 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c4349cc-0bb9-472f-acc5-e7cf3f616853 could not be found. Jun 20 12:02:33.069923 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:33.069923 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:02:33.069923 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:33.069923 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:33.069923 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:02:33.069923 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:02:33.069923 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:02:33.069923 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:02:33.069923 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c4349cc-0bb9-472f-acc5-e7cf3f616853 could not be found. Jun 20 12:02:33.069923 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:33.071815 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-15316674-bed3-4f8e-9d37-d6fae2f2bed3 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Returning 404 to user: Instance 5c4349cc-0bb9-472f-acc5-e7cf3f616853 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:02:33.074601 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-15316674-bed3-4f8e-9d37-d6fae2f2bed3 tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853" status: 404 len: 111 microversion: 2.1 time: 0.047131 Jun 20 12:02:33.078312 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 686/1345] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:02:33 2022] DELETE /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:02:33.086180 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3af7f34f-722e-4da5-8140-2cdccb085cfb tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:33.086806 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3af7f34f-722e-4da5-8140-2cdccb085cfb tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] [instance: 5c4349cc-0bb9-472f-acc5-e7cf3f616853] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:33.098685 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3af7f34f-722e-4da5-8140-2cdccb085cfb tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:33.099300 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3af7f34f-722e-4da5-8140-2cdccb085cfb tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:33.100593 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3af7f34f-722e-4da5-8140-2cdccb085cfb tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:33.101278 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3af7f34f-722e-4da5-8140-2cdccb085cfb tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:33.129653 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-3af7f34f-722e-4da5-8140-2cdccb085cfb tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] HTTP exception thrown: Instance 5c4349cc-0bb9-472f-acc5-e7cf3f616853 could not be found. Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3af7f34f-722e-4da5-8140-2cdccb085cfb tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Request method failure captured: Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853 HTTP/1.1 Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGG3F5-dsECkor8F7fBEXoxqB6FiS9BsfOgmzITw4k_IO4TSexDR_8xf_x_AUqaMrFi0TlXzf7AZG8o8D1Hr7oPLP6gSLaepKQ8kjFxxf6nwWxtHg_RrWN5IM9N6984B2Gz_A2GLJS6ELn9H4tRKPu6lPjIQQ_5E4z5xA1r7BU7_VZU Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: f4a572c10cb94add92e01db93f744ef0 Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ImagesNegativeTestJSON-1919180375 Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4a572c10cb94add92e01db93f744ef0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4a572c10cb94add92e01db93f744ef0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4a572c10cb94add92e01db93f744ef0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4a572c10cb94add92e01db93f744ef0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ImagesNegativeTestJSON-1919180375 Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: f4a572c10cb94add92e01db93f744ef0 Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1919180375 Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ImagesNegativeTestJSON-1919180375-project Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 7ce407df032342ddad0dec89baf9b6ea Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ImagesNegativeTestJSON-1919180375-project Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 5c4349cc-0bb9-472f-acc5-e7cf3f616853 could not be found. Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '5c4349cc-0bb9-472f-acc5-e7cf3f616853'} Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c4349cc-0bb9-472f-acc5-e7cf3f616853 could not be found. Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c4349cc-0bb9-472f-acc5-e7cf3f616853 could not be found. Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:02:33.131375 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:33.137369 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:33.137369 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:02:33.137369 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:02:33.137369 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:02:33.137369 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:02:33.137369 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c4349cc-0bb9-472f-acc5-e7cf3f616853 could not be found. Jun 20 12:02:33.137369 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:33.137369 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3af7f34f-722e-4da5-8140-2cdccb085cfb tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] Returning 404 to user: Instance 5c4349cc-0bb9-472f-acc5-e7cf3f616853 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:02:33.137369 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3af7f34f-722e-4da5-8140-2cdccb085cfb tempest-ImagesNegativeTestJSON-1919180375 tempest-ImagesNegativeTestJSON-1919180375-project] 10.222.0.27 "GET /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853" status: 404 len: 111 microversion: 2.1 time: 0.050878 Jun 20 12:02:33.138558 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 687/1346] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:33 2022] GET /compute/v2.1/servers/5c4349cc-0bb9-472f-acc5-e7cf3f616853 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:02:33.197517 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ad701298-53d3-4e1d-9f5f-8ad4af472a6d tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f4e0e140c4a839d99b56ee9ffacc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35cecfcbb948c6b60eef6140f87a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:33.214994 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2b2b9dc7-751e-43c1-988e-e74f6e2819f9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:33.216903 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2b2b9dc7-751e-43c1-988e-e74f6e2819f9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:33.229758 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2b2b9dc7-751e-43c1-988e-e74f6e2819f9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:33.231656 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ad701298-53d3-4e1d-9f5f-8ad4af472a6d tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] 10.222.0.27 "GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d" status: 200 len: 1681 microversion: 2.1 time: 0.926147 Jun 20 12:02:33.233701 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 660/1347] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:32 2022] GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d => generated 1681 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:33.236167 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2b2b9dc7-751e-43c1-988e-e74f6e2819f9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:33.238690 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2b2b9dc7-751e-43c1-988e-e74f6e2819f9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:33.239440 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2b2b9dc7-751e-43c1-988e-e74f6e2819f9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:33.442532 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e38e9aa6-a818-40e8-abd1-87c4d2b8ff20 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:33.443694 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e38e9aa6-a818-40e8-abd1-87c4d2b8ff20 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:33.451509 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e38e9aa6-a818-40e8-abd1-87c4d2b8ff20 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:33.452556 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e38e9aa6-a818-40e8-abd1-87c4d2b8ff20 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:33.453604 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e38e9aa6-a818-40e8-abd1-87c4d2b8ff20 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:33.454760 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e38e9aa6-a818-40e8-abd1-87c4d2b8ff20 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:33.781165 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2b2b9dc7-751e-43c1-988e-e74f6e2819f9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:33.794301 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2b2b9dc7-751e-43c1-988e-e74f6e2819f9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:33.796574 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2b2b9dc7-751e-43c1-988e-e74f6e2819f9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:33.799371 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2b2b9dc7-751e-43c1-988e-e74f6e2819f9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1815 microversion: 2.25 time: 0.596655 Jun 20 12:02:33.824736 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 688/1348] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:33 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1815 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:33.870108 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e38e9aa6-a818-40e8-abd1-87c4d2b8ff20 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:33.883636 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e38e9aa6-a818-40e8-abd1-87c4d2b8ff20 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:33.885671 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e38e9aa6-a818-40e8-abd1-87c4d2b8ff20 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:33.887406 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e38e9aa6-a818-40e8-abd1-87c4d2b8ff20 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1879 microversion: 2.42 time: 0.449155 Jun 20 12:02:33.888546 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 661/1349] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:33 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1879 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:02:33.922369 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-682371b0-63b6-4918-930e-b6bd1dc2ccaa tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:33.923574 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-682371b0-63b6-4918-930e-b6bd1dc2ccaa tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:33.935481 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-682371b0-63b6-4918-930e-b6bd1dc2ccaa tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:33.937426 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-682371b0-63b6-4918-930e-b6bd1dc2ccaa tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:33.940523 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-682371b0-63b6-4918-930e-b6bd1dc2ccaa tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:33.941381 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-682371b0-63b6-4918-930e-b6bd1dc2ccaa tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:34.254499 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-19657f33-4581-4a28-8e2f-66c43d2111fc tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:34.255429 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-19657f33-4581-4a28-8e2f-66c43d2111fc tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] [instance: 1c763272-042e-418c-b2f6-cc2e96f0c54d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:34.261689 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:34.280006 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-19657f33-4581-4a28-8e2f-66c43d2111fc tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:34.280561 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-19657f33-4581-4a28-8e2f-66c43d2111fc tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:34.290322 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-19657f33-4581-4a28-8e2f-66c43d2111fc tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:34.290843 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-19657f33-4581-4a28-8e2f-66c43d2111fc tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:34.456150 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-19657f33-4581-4a28-8e2f-66c43d2111fc tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f4e0e140c4a839d99b56ee9ffacc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35cecfcbb948c6b60eef6140f87a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:34.465719 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-19657f33-4581-4a28-8e2f-66c43d2111fc tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] 10.222.0.27 "GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d" status: 200 len: 1614 microversion: 2.1 time: 0.219614 Jun 20 12:02:34.466303 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 662/1350] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:34 2022] GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d => generated 1614 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:34.481127 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-9950653b-c21f-4241-a6e8-0b88bd641d1e req-6070698e-428f-4d2f-94e7-f1d21b24b5b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c763272-042e-418c-b2f6-cc2e96f0c54d", "name": "network-vif-deleted", "tag": "b71a2013-f702-4588-976a-47402b05752a"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:02:34.493632 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9950653b-c21f-4241-a6e8-0b88bd641d1e req-6070698e-428f-4d2f-94e7-f1d21b24b5b5 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:34.494390 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9950653b-c21f-4241-a6e8-0b88bd641d1e req-6070698e-428f-4d2f-94e7-f1d21b24b5b5 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:34.509914 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-9950653b-c21f-4241-a6e8-0b88bd641d1e req-6070698e-428f-4d2f-94e7-f1d21b24b5b5 service nova] Creating event network-vif-deleted:b71a2013-f702-4588-976a-47402b05752a for instance 1c763272-042e-418c-b2f6-cc2e96f0c54d on n-h2-master-1 Jun 20 12:02:34.518860 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-9950653b-c21f-4241-a6e8-0b88bd641d1e req-6070698e-428f-4d2f-94e7-f1d21b24b5b5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041641 Jun 20 12:02:34.521706 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 663/1351] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:02:34.612559 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-7716e044-8166-4974-ad5c-05132609e42e req-076d3363-4ce8-4bba-ac66-e747c4d7e624 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49a35510-1821-49de-8e39-d45901095c80", "name": "network-vif-plugged", "status": "completed", "tag": "bab393cc-844a-468b-9b51-51cf37ed5c0a"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:02:34.629930 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-7716e044-8166-4974-ad5c-05132609e42e req-076d3363-4ce8-4bba-ac66-e747c4d7e624 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:34.630675 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-7716e044-8166-4974-ad5c-05132609e42e req-076d3363-4ce8-4bba-ac66-e747c4d7e624 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:34.662866 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-7716e044-8166-4974-ad5c-05132609e42e req-076d3363-4ce8-4bba-ac66-e747c4d7e624 service nova] Creating event network-vif-plugged:bab393cc-844a-468b-9b51-51cf37ed5c0a for instance 49a35510-1821-49de-8e39-d45901095c80 on n-h2-master-1 Jun 20 12:02:34.668285 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-7716e044-8166-4974-ad5c-05132609e42e req-076d3363-4ce8-4bba-ac66-e747c4d7e624 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060838 Jun 20 12:02:34.669191 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 664/1352] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:02:34.828548 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-17f2d43a-4857-489c-b41d-6af46860575b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:34.829338 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-17f2d43a-4857-489c-b41d-6af46860575b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:34.836277 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-17f2d43a-4857-489c-b41d-6af46860575b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:34.837172 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-17f2d43a-4857-489c-b41d-6af46860575b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:34.838344 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-17f2d43a-4857-489c-b41d-6af46860575b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:34.839077 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-17f2d43a-4857-489c-b41d-6af46860575b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:35.141774 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-682371b0-63b6-4918-930e-b6bd1dc2ccaa tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:35.154010 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-682371b0-63b6-4918-930e-b6bd1dc2ccaa tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80" status: 200 len: 1310 microversion: 2.1 time: 1.238547 Jun 20 12:02:35.165641 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 689/1353] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:33 2022] GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 => generated 1310 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:35.166565 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-17f2d43a-4857-489c-b41d-6af46860575b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:35.184474 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-17f2d43a-4857-489c-b41d-6af46860575b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:35.185858 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5f671dd3-2e72-496b-9c9e-267daddb628f tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:35.186625 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5f671dd3-2e72-496b-9c9e-267daddb628f tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:35.196831 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-17f2d43a-4857-489c-b41d-6af46860575b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:35.197108 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f671dd3-2e72-496b-9c9e-267daddb628f tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:35.197342 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f671dd3-2e72-496b-9c9e-267daddb628f tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:35.198119 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-17f2d43a-4857-489c-b41d-6af46860575b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1815 microversion: 2.25 time: 0.374899 Jun 20 12:02:35.198254 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f671dd3-2e72-496b-9c9e-267daddb628f tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:35.198563 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f671dd3-2e72-496b-9c9e-267daddb628f tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:35.209819 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 665/1354] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:34 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1815 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:02:35.500723 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-30fb3cdc-717b-4aa1-b11f-11cd17cc538c tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:35.501630 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-30fb3cdc-717b-4aa1-b11f-11cd17cc538c tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] [instance: 1c763272-042e-418c-b2f6-cc2e96f0c54d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:35.521494 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-30fb3cdc-717b-4aa1-b11f-11cd17cc538c tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:35.522523 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-30fb3cdc-717b-4aa1-b11f-11cd17cc538c tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:35.524299 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-30fb3cdc-717b-4aa1-b11f-11cd17cc538c tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:35.525194 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-30fb3cdc-717b-4aa1-b11f-11cd17cc538c tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:35.542578 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-30fb3cdc-717b-4aa1-b11f-11cd17cc538c tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] HTTP exception thrown: Instance 1c763272-042e-418c-b2f6-cc2e96f0c54d could not be found. Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-30fb3cdc-717b-4aa1-b11f-11cd17cc538c tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Request method failure captured: Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d HTTP/1.1 Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGDomgWnML-smVb-CCAM4sNg9bmysAT8z2TXwmZtbYkJWKUzHC6MExUsWzmTItIawkLf-DRxz6hvBEKb5PP4cuOeqlS4guW4PDCKcVfJVLKtsYdtyzWdffLsbVGvV9zgjiBoRFLns3ef106CA1s8qH6TIOZ_Vyi7X04n81fOJGdXz60 Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 0f35cecfcbb948c6b60eef6140f87a3b Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1792448931 Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0f35cecfcbb948c6b60eef6140f87a3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0f35cecfcbb948c6b60eef6140f87a3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0f35cecfcbb948c6b60eef6140f87a3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0f35cecfcbb948c6b60eef6140f87a3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1792448931 Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 0f35cecfcbb948c6b60eef6140f87a3b Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1792448931 Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-AttachSCSIVolumeTestJSON-1792448931-project Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: a53f4e0e140c4a839d99b56ee9ffacc5 Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1792448931-project Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 1c763272-042e-418c-b2f6-cc2e96f0c54d could not be found. Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '1c763272-042e-418c-b2f6-cc2e96f0c54d'} Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c763272-042e-418c-b2f6-cc2e96f0c54d could not be found. Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c763272-042e-418c-b2f6-cc2e96f0c54d could not be found. Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:02:35.544530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:02:35.550368 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:35.550368 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:02:35.550368 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:02:35.550368 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:02:35.550368 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:02:35.550368 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c763272-042e-418c-b2f6-cc2e96f0c54d could not be found. Jun 20 12:02:35.550368 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:02:35.553723 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-30fb3cdc-717b-4aa1-b11f-11cd17cc538c tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Returning 404 to user: Instance 1c763272-042e-418c-b2f6-cc2e96f0c54d could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:02:35.554952 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-30fb3cdc-717b-4aa1-b11f-11cd17cc538c tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] 10.222.0.27 "GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d" status: 404 len: 111 microversion: 2.1 time: 0.067383 Jun 20 12:02:35.559653 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 666/1355] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:35 2022] GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:02:35.565281 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d919041a-91f5-47a3-bad1-b716162f12cf tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Calling method '.version_select at 0x7f6073671430>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:35.590609 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d919041a-91f5-47a3-bad1-b716162f12cf tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1323207248" status: 202 len: 0 microversion: 2.1 time: 0.029498 Jun 20 12:02:35.595201 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 667/1356] 10.222.0.27 () {58 vars in 1220 bytes} [Mon Jun 20 12:02:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1323207248 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:02:36.119308 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5f671dd3-2e72-496b-9c9e-267daddb628f tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:36.184285 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5f671dd3-2e72-496b-9c9e-267daddb628f tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:36.185746 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-03533d2a-3627-4b21-905e-58e4a6e51b9d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:36.186756 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-03533d2a-3627-4b21-905e-58e4a6e51b9d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:36.187377 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5f671dd3-2e72-496b-9c9e-267daddb628f tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:36.203957 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5f671dd3-2e72-496b-9c9e-267daddb628f tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1879 microversion: 2.42 time: 1.032170 Jun 20 12:02:36.205539 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 690/1357] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:35 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1879 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:36.208834 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-03533d2a-3627-4b21-905e-58e4a6e51b9d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:36.209657 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-03533d2a-3627-4b21-905e-58e4a6e51b9d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:36.211048 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-03533d2a-3627-4b21-905e-58e4a6e51b9d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:36.215729 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-03533d2a-3627-4b21-905e-58e4a6e51b9d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:36.226176 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7467e14b-dbca-43ad-8112-a712843be3a8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:36.228837 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7467e14b-dbca-43ad-8112-a712843be3a8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:36.245026 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7467e14b-dbca-43ad-8112-a712843be3a8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:36.245765 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7467e14b-dbca-43ad-8112-a712843be3a8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:36.246761 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7467e14b-dbca-43ad-8112-a712843be3a8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:36.249522 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7467e14b-dbca-43ad-8112-a712843be3a8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:36.884003 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-03533d2a-3627-4b21-905e-58e4a6e51b9d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:36.898951 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-03533d2a-3627-4b21-905e-58e4a6e51b9d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80" status: 200 len: 1310 microversion: 2.1 time: 0.720081 Jun 20 12:02:36.899769 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 668/1358] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:36 2022] GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 => generated 1310 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:36.906277 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-432ab408-e9ce-42bb-8f47-d65aa0fec117 req-a34b43e4-fa4d-4c38-996c-f22b29609c55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3db0bd7d-eed4-411a-a7b8-719b260233ed", "name": "network-vif-unplugged", "status": "completed", "tag": "66a1f7cd-2c10-48c8-8f30-83c32f1d6186"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:02:36.920959 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-432ab408-e9ce-42bb-8f47-d65aa0fec117 req-a34b43e4-fa4d-4c38-996c-f22b29609c55 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:36.921744 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-432ab408-e9ce-42bb-8f47-d65aa0fec117 req-a34b43e4-fa4d-4c38-996c-f22b29609c55 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:36.962074 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-432ab408-e9ce-42bb-8f47-d65aa0fec117 req-a34b43e4-fa4d-4c38-996c-f22b29609c55 service nova] Creating event network-vif-unplugged:66a1f7cd-2c10-48c8-8f30-83c32f1d6186 for instance 3db0bd7d-eed4-411a-a7b8-719b260233ed on n-h2-master-1 Jun 20 12:02:36.969202 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-432ab408-e9ce-42bb-8f47-d65aa0fec117 req-a34b43e4-fa4d-4c38-996c-f22b29609c55 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067078 Jun 20 12:02:36.970256 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 669/1359] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:02:37.227316 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f15952d2-f5ee-4cbc-9630-1a7c64bfdf6c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:37.228253 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f15952d2-f5ee-4cbc-9630-1a7c64bfdf6c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:37.244541 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f15952d2-f5ee-4cbc-9630-1a7c64bfdf6c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:37.246331 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f15952d2-f5ee-4cbc-9630-1a7c64bfdf6c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:37.247391 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f15952d2-f5ee-4cbc-9630-1a7c64bfdf6c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:37.248671 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f15952d2-f5ee-4cbc-9630-1a7c64bfdf6c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:37.282054 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7467e14b-dbca-43ad-8112-a712843be3a8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:37.296051 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7467e14b-dbca-43ad-8112-a712843be3a8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:37.300640 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7467e14b-dbca-43ad-8112-a712843be3a8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:37.302490 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7467e14b-dbca-43ad-8112-a712843be3a8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1815 microversion: 2.25 time: 1.088445 Jun 20 12:02:37.303868 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 691/1360] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:36 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1815 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:37.715035 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f15952d2-f5ee-4cbc-9630-1a7c64bfdf6c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:37.727075 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f15952d2-f5ee-4cbc-9630-1a7c64bfdf6c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:37.731607 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f15952d2-f5ee-4cbc-9630-1a7c64bfdf6c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:37.737590 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f15952d2-f5ee-4cbc-9630-1a7c64bfdf6c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1879 microversion: 2.42 time: 0.512802 Jun 20 12:02:37.743097 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 670/1361] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:37 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1879 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:02:37.920034 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-492b84aa-a462-4473-bfd3-8d3781b09865 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:37.921182 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-492b84aa-a462-4473-bfd3-8d3781b09865 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:37.937915 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-492b84aa-a462-4473-bfd3-8d3781b09865 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:37.939261 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-492b84aa-a462-4473-bfd3-8d3781b09865 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:37.940571 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-492b84aa-a462-4473-bfd3-8d3781b09865 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:37.941296 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-492b84aa-a462-4473-bfd3-8d3781b09865 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:38.322245 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-05b1047d-ac16-46c9-9e3a-f916cddaa675 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:38.323663 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-05b1047d-ac16-46c9-9e3a-f916cddaa675 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:38.334604 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05b1047d-ac16-46c9-9e3a-f916cddaa675 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:38.335773 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05b1047d-ac16-46c9-9e3a-f916cddaa675 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:38.336886 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05b1047d-ac16-46c9-9e3a-f916cddaa675 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:38.337589 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05b1047d-ac16-46c9-9e3a-f916cddaa675 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:38.486989 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-492b84aa-a462-4473-bfd3-8d3781b09865 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:38.499774 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-492b84aa-a462-4473-bfd3-8d3781b09865 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80" status: 200 len: 1492 microversion: 2.1 time: 0.585216 Jun 20 12:02:38.500846 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 692/1362] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:37 2022] GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 => generated 1492 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:02:38.565019 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-05b1047d-ac16-46c9-9e3a-f916cddaa675 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:38.575814 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-05b1047d-ac16-46c9-9e3a-f916cddaa675 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:38.578549 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-05b1047d-ac16-46c9-9e3a-f916cddaa675 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:38.579796 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-05b1047d-ac16-46c9-9e3a-f916cddaa675 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1815 microversion: 2.25 time: 0.260706 Jun 20 12:02:38.590186 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 671/1363] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:38 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1815 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:02:38.759648 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6def9200-376c-452b-ab05-92fb01ae0f1a tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:38.761235 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6def9200-376c-452b-ab05-92fb01ae0f1a tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:38.770066 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6def9200-376c-452b-ab05-92fb01ae0f1a tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:38.771084 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6def9200-376c-452b-ab05-92fb01ae0f1a tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:38.772355 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6def9200-376c-452b-ab05-92fb01ae0f1a tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:38.772978 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6def9200-376c-452b-ab05-92fb01ae0f1a tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:38.800879 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-24f2a755-60e9-40a4-94a2-c5ede098bd4d tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:38.801681 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-24f2a755-60e9-40a4-94a2-c5ede098bd4d tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:38.816809 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-24f2a755-60e9-40a4-94a2-c5ede098bd4d tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:38.825360 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-24f2a755-60e9-40a4-94a2-c5ede098bd4d tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:38.826359 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-24f2a755-60e9-40a4-94a2-c5ede098bd4d tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:38.829899 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-24f2a755-60e9-40a4-94a2-c5ede098bd4d tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:39.073204 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6def9200-376c-452b-ab05-92fb01ae0f1a tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:39.088067 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6def9200-376c-452b-ab05-92fb01ae0f1a tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:39.089983 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6def9200-376c-452b-ab05-92fb01ae0f1a tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:39.093225 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6def9200-376c-452b-ab05-92fb01ae0f1a tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1879 microversion: 2.42 time: 0.339912 Jun 20 12:02:39.095370 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 672/1364] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:38 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1879 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:39.100752 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-ebc89faa-50d4-43b2-ac32-0b611753a886 req-885478c8-a8da-43ab-a0e1-5f98871405fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3db0bd7d-eed4-411a-a7b8-719b260233ed", "tag": "66a1f7cd-2c10-48c8-8f30-83c32f1d6186"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:02:39.110865 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-ebc89faa-50d4-43b2-ac32-0b611753a886 req-885478c8-a8da-43ab-a0e1-5f98871405fa service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:39.111629 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-ebc89faa-50d4-43b2-ac32-0b611753a886 req-885478c8-a8da-43ab-a0e1-5f98871405fa service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:39.128381 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-ebc89faa-50d4-43b2-ac32-0b611753a886 req-885478c8-a8da-43ab-a0e1-5f98871405fa service nova] Creating event network-changed:66a1f7cd-2c10-48c8-8f30-83c32f1d6186 for instance 3db0bd7d-eed4-411a-a7b8-719b260233ed on n-h2-master-1 Jun 20 12:02:39.136215 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-ebc89faa-50d4-43b2-ac32-0b611753a886 req-885478c8-a8da-43ab-a0e1-5f98871405fa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038351 Jun 20 12:02:39.141693 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 673/1365] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:02:39.482077 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-24f2a755-60e9-40a4-94a2-c5ede098bd4d tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80" status: 200 len: 1643 microversion: 2.1 time: 0.966663 Jun 20 12:02:39.483085 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 693/1366] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:38 2022] GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 => generated 1643 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:39.499755 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-19983839-2d6e-4ab2-95c2-7d1aac9f6fb5 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:39.501134 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-19983839-2d6e-4ab2-95c2-7d1aac9f6fb5 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:39.511261 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-19983839-2d6e-4ab2-95c2-7d1aac9f6fb5 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:39.512745 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-19983839-2d6e-4ab2-95c2-7d1aac9f6fb5 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:39.514023 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-19983839-2d6e-4ab2-95c2-7d1aac9f6fb5 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:39.514839 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-19983839-2d6e-4ab2-95c2-7d1aac9f6fb5 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:39.597582 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9e5fba91-3f54-4a6a-91ee-35aa255b03e0 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:39.599077 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9e5fba91-3f54-4a6a-91ee-35aa255b03e0 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:39.607662 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9e5fba91-3f54-4a6a-91ee-35aa255b03e0 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:39.612934 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9e5fba91-3f54-4a6a-91ee-35aa255b03e0 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:39.614153 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9e5fba91-3f54-4a6a-91ee-35aa255b03e0 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:39.614839 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9e5fba91-3f54-4a6a-91ee-35aa255b03e0 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:39.834940 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-19983839-2d6e-4ab2-95c2-7d1aac9f6fb5 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80" status: 200 len: 1643 microversion: 2.1 time: 0.340136 Jun 20 12:02:39.838044 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 674/1367] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:39 2022] GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 => generated 1643 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:39.853729 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7e67a216-2b8f-4c35-be48-6a0dfaf0338c tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:39.855214 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:02:39.855214 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 12:02:39.857038 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7e67a216-2b8f-4c35-be48-6a0dfaf0338c tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:39.857749 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7e67a216-2b8f-4c35-be48-6a0dfaf0338c tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:39.858880 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7e67a216-2b8f-4c35-be48-6a0dfaf0338c tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:39.859699 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7e67a216-2b8f-4c35-be48-6a0dfaf0338c tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:39.927253 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7e67a216-2b8f-4c35-be48-6a0dfaf0338c tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.077201 Jun 20 12:02:39.930619 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 675/1368] 10.222.0.27 () {58 vars in 1175 bytes} [Mon Jun 20 12:02:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:02:39.949354 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3f1b3cdc-30b6-44b1-aa6c-6e1affd879b3 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:02:39.952103 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3f1b3cdc-30b6-44b1-aa6c-6e1affd879b3 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:39.972783 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3f1b3cdc-30b6-44b1-aa6c-6e1affd879b3 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:39.972783 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3f1b3cdc-30b6-44b1-aa6c-6e1affd879b3 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:39.972783 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3f1b3cdc-30b6-44b1-aa6c-6e1affd879b3 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:39.972783 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3f1b3cdc-30b6-44b1-aa6c-6e1affd879b3 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:40.011127 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-3f1b3cdc-30b6-44b1-aa6c-6e1affd879b3 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lazy-loading 'flavor' on Instance uuid 49a35510-1821-49de-8e39-d45901095c80 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:02:40.032958 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3f1b3cdc-30b6-44b1-aa6c-6e1affd879b3 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] [instance: 49a35510-1821-49de-8e39-d45901095c80] Going to try to live migrate instance to n-h1-master-1 {{(pid=119128) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 20 12:02:40.143329 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:40.185065 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9e5fba91-3f54-4a6a-91ee-35aa255b03e0 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:40.195174 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9e5fba91-3f54-4a6a-91ee-35aa255b03e0 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:40.212165 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9e5fba91-3f54-4a6a-91ee-35aa255b03e0 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:40.213458 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9e5fba91-3f54-4a6a-91ee-35aa255b03e0 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1815 microversion: 2.25 time: 0.620313 Jun 20 12:02:40.217108 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 694/1369] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:39 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1815 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:40.226112 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-387eb9bc-e1a8-4ca7-8b40-914bc2993422 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:40.239098 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-387eb9bc-e1a8-4ca7-8b40-914bc2993422 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:40.248132 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-387eb9bc-e1a8-4ca7-8b40-914bc2993422 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:40.249386 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-387eb9bc-e1a8-4ca7-8b40-914bc2993422 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:40.251748 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-387eb9bc-e1a8-4ca7-8b40-914bc2993422 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:40.252426 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-387eb9bc-e1a8-4ca7-8b40-914bc2993422 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:41.108511 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-387eb9bc-e1a8-4ca7-8b40-914bc2993422 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:41.155296 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-387eb9bc-e1a8-4ca7-8b40-914bc2993422 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:41.169357 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-387eb9bc-e1a8-4ca7-8b40-914bc2993422 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:41.177513 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-387eb9bc-e1a8-4ca7-8b40-914bc2993422 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1879 microversion: 2.42 time: 0.955820 Jun 20 12:02:41.180676 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 695/1370] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:40 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1879 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:41.237852 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-44a48e4b-148a-4f06-827c-d7b12160d133 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:41.239548 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-44a48e4b-148a-4f06-827c-d7b12160d133 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:41.272043 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-44a48e4b-148a-4f06-827c-d7b12160d133 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:41.272732 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-44a48e4b-148a-4f06-827c-d7b12160d133 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:41.273709 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-44a48e4b-148a-4f06-827c-d7b12160d133 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:41.274317 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-44a48e4b-148a-4f06-827c-d7b12160d133 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:41.753214 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-44a48e4b-148a-4f06-827c-d7b12160d133 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:41.771372 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-44a48e4b-148a-4f06-827c-d7b12160d133 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:41.772889 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-44a48e4b-148a-4f06-827c-d7b12160d133 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:41.774090 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-44a48e4b-148a-4f06-827c-d7b12160d133 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1815 microversion: 2.25 time: 0.542745 Jun 20 12:02:41.774685 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 696/1371] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:41 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1815 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:02:42.200677 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-93dcbfc7-a810-47c8-b858-859e4d491c79 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:42.201289 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-93dcbfc7-a810-47c8-b858-859e4d491c79 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:42.209201 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93dcbfc7-a810-47c8-b858-859e4d491c79 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:42.209650 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93dcbfc7-a810-47c8-b858-859e4d491c79 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:42.210431 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93dcbfc7-a810-47c8-b858-859e4d491c79 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:42.210862 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93dcbfc7-a810-47c8-b858-859e4d491c79 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:42.484087 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3f1b3cdc-30b6-44b1-aa6c-6e1affd879b3 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80/action" status: 202 len: 0 microversion: 2.1 time: 2.545241 Jun 20 12:02:42.490225 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 676/1372] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:02:39 2022] POST /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80/action => generated 0 bytes in 2553 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 12:02:42.507252 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ccd1140f-e119-4abd-a6ea-3b80b8044cb6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:42.510477 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ccd1140f-e119-4abd-a6ea-3b80b8044cb6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:42.533093 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ccd1140f-e119-4abd-a6ea-3b80b8044cb6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:42.534698 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ccd1140f-e119-4abd-a6ea-3b80b8044cb6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:42.536763 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ccd1140f-e119-4abd-a6ea-3b80b8044cb6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:42.539076 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ccd1140f-e119-4abd-a6ea-3b80b8044cb6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:42.713292 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-93dcbfc7-a810-47c8-b858-859e4d491c79 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:42.724603 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-93dcbfc7-a810-47c8-b858-859e4d491c79 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:42.726317 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-93dcbfc7-a810-47c8-b858-859e4d491c79 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:42.727902 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-93dcbfc7-a810-47c8-b858-859e4d491c79 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1879 microversion: 2.42 time: 0.531151 Jun 20 12:02:42.729052 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 697/1373] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:42 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1879 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:02:42.793181 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2fbce062-7b5b-4e62-898d-d87a7bc3ea35 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:42.794136 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2fbce062-7b5b-4e62-898d-d87a7bc3ea35 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:42.800634 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2fbce062-7b5b-4e62-898d-d87a7bc3ea35 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:42.801119 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2fbce062-7b5b-4e62-898d-d87a7bc3ea35 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:42.801976 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2fbce062-7b5b-4e62-898d-d87a7bc3ea35 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:42.802507 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2fbce062-7b5b-4e62-898d-d87a7bc3ea35 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:42.968805 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2fbce062-7b5b-4e62-898d-d87a7bc3ea35 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:42.982631 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2fbce062-7b5b-4e62-898d-d87a7bc3ea35 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:42.987584 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2fbce062-7b5b-4e62-898d-d87a7bc3ea35 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:42.990445 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2fbce062-7b5b-4e62-898d-d87a7bc3ea35 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1815 microversion: 2.25 time: 0.200625 Jun 20 12:02:42.991874 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 698/1374] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:42 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1815 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:02:43.083974 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ff94fd76-e4b8-4e7c-bd30-4b74d2f30719 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:43.084730 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ff94fd76-e4b8-4e7c-bd30-4b74d2f30719 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: f678dc35-c774-4c0a-9ebb-579688adecb0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:43.091438 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff94fd76-e4b8-4e7c-bd30-4b74d2f30719 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:43.092150 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff94fd76-e4b8-4e7c-bd30-4b74d2f30719 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:43.093136 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff94fd76-e4b8-4e7c-bd30-4b74d2f30719 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:43.093968 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff94fd76-e4b8-4e7c-bd30-4b74d2f30719 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:43.106904 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ccd1140f-e119-4abd-a6ea-3b80b8044cb6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:43.122927 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ccd1140f-e119-4abd-a6ea-3b80b8044cb6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80" status: 200 len: 1502 microversion: 2.1 time: 0.627789 Jun 20 12:02:43.132383 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 677/1375] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:42 2022] GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 => generated 1502 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:43.132593 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ff94fd76-e4b8-4e7c-bd30-4b74d2f30719 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: f678dc35-c774-4c0a-9ebb-579688adecb0] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:02:43.155639 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:43.311469 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ff94fd76-e4b8-4e7c-bd30-4b74d2f30719 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0" status: 204 len: 0 microversion: 2.1 time: 0.229533 Jun 20 12:02:43.319183 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 699/1376] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:02:43 2022] DELETE /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:02:43.324151 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9cc7d825-9761-4cae-b132-1a365c7cdb09 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:43.324794 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9cc7d825-9761-4cae-b132-1a365c7cdb09 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: f678dc35-c774-4c0a-9ebb-579688adecb0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:43.331816 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9cc7d825-9761-4cae-b132-1a365c7cdb09 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:43.332292 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9cc7d825-9761-4cae-b132-1a365c7cdb09 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:43.333075 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9cc7d825-9761-4cae-b132-1a365c7cdb09 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:43.333509 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9cc7d825-9761-4cae-b132-1a365c7cdb09 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:43.752751 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-04b236e0-ce8f-4b0f-a59b-21965b2997db tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:43.753479 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-04b236e0-ce8f-4b0f-a59b-21965b2997db tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:43.771422 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-04b236e0-ce8f-4b0f-a59b-21965b2997db tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:43.771890 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-04b236e0-ce8f-4b0f-a59b-21965b2997db tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:43.772725 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-04b236e0-ce8f-4b0f-a59b-21965b2997db tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:43.775357 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-04b236e0-ce8f-4b0f-a59b-21965b2997db tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:44.041599 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9cc7d825-9761-4cae-b132-1a365c7cdb09 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:44.050849 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9cc7d825-9761-4cae-b132-1a365c7cdb09 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0" status: 200 len: 1554 microversion: 2.1 time: 0.730505 Jun 20 12:02:44.052899 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 678/1377] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:43 2022] GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0 => generated 1554 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:44.082746 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-95babf92-ef0b-4351-a173-7cb75d9c6fd5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:44.085145 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-95babf92-ef0b-4351-a173-7cb75d9c6fd5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:44.105951 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95babf92-ef0b-4351-a173-7cb75d9c6fd5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:44.106971 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95babf92-ef0b-4351-a173-7cb75d9c6fd5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:44.108008 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95babf92-ef0b-4351-a173-7cb75d9c6fd5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:44.108661 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95babf92-ef0b-4351-a173-7cb75d9c6fd5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:44.260729 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-04b236e0-ce8f-4b0f-a59b-21965b2997db tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:44.275528 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-04b236e0-ce8f-4b0f-a59b-21965b2997db tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:44.278510 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-04b236e0-ce8f-4b0f-a59b-21965b2997db tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:44.288100 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-04b236e0-ce8f-4b0f-a59b-21965b2997db tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1879 microversion: 2.42 time: 0.534167 Jun 20 12:02:44.304810 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 700/1378] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:43 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1879 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:44.312963 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-85dc24d1-72bb-42e2-a96e-ae1fef288328 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:44.313686 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-85dc24d1-72bb-42e2-a96e-ae1fef288328 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:44.333602 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-85dc24d1-72bb-42e2-a96e-ae1fef288328 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:44.333975 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-85dc24d1-72bb-42e2-a96e-ae1fef288328 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:44.334859 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-85dc24d1-72bb-42e2-a96e-ae1fef288328 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:44.335297 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-85dc24d1-72bb-42e2-a96e-ae1fef288328 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:44.584010 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-85dc24d1-72bb-42e2-a96e-ae1fef288328 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:44.596067 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-85dc24d1-72bb-42e2-a96e-ae1fef288328 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80" status: 200 len: 1502 microversion: 2.1 time: 0.289958 Jun 20 12:02:44.599045 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 701/1379] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:44 2022] GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 => generated 1502 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:44.609293 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f9774cba-fca7-4d6a-a65c-acbb8202589a tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:44.616422 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f9774cba-fca7-4d6a-a65c-acbb8202589a tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] [instance: 1c763272-042e-418c-b2f6-cc2e96f0c54d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:44.631767 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9774cba-fca7-4d6a-a65c-acbb8202589a tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:44.637547 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9774cba-fca7-4d6a-a65c-acbb8202589a tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:44.639676 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9774cba-fca7-4d6a-a65c-acbb8202589a tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:44.644881 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9774cba-fca7-4d6a-a65c-acbb8202589a tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:44.704237 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-f9774cba-fca7-4d6a-a65c-acbb8202589a tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] HTTP exception thrown: Instance 1c763272-042e-418c-b2f6-cc2e96f0c54d could not be found. Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f9774cba-fca7-4d6a-a65c-acbb8202589a tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Request method failure captured: Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d HTTP/1.1 Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGDomgWnML-smVb-CCAM4sNg9bmysAT8z2TXwmZtbYkJWKUzHC6MExUsWzmTItIawkLf-DRxz6hvBEKb5PP4cuOeqlS4guW4PDCKcVfJVLKtsYdtyzWdffLsbVGvV9zgjiBoRFLns3ef106CA1s8qH6TIOZ_Vyi7X04n81fOJGdXz60 Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 0f35cecfcbb948c6b60eef6140f87a3b Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1792448931 Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0f35cecfcbb948c6b60eef6140f87a3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0f35cecfcbb948c6b60eef6140f87a3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0f35cecfcbb948c6b60eef6140f87a3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0f35cecfcbb948c6b60eef6140f87a3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1792448931 Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 0f35cecfcbb948c6b60eef6140f87a3b Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1792448931 Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-AttachSCSIVolumeTestJSON-1792448931-project Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: a53f4e0e140c4a839d99b56ee9ffacc5 Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1792448931-project Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 1c763272-042e-418c-b2f6-cc2e96f0c54d could not be found. Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '1c763272-042e-418c-b2f6-cc2e96f0c54d'} Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c763272-042e-418c-b2f6-cc2e96f0c54d could not be found. Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:02:44.705979 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:02:44.711090 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c763272-042e-418c-b2f6-cc2e96f0c54d could not be found. Jun 20 12:02:44.711090 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:44.711090 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:02:44.711090 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:44.711090 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:44.711090 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:02:44.711090 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:02:44.711090 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:02:44.711090 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:02:44.711090 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c763272-042e-418c-b2f6-cc2e96f0c54d could not be found. Jun 20 12:02:44.711090 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:44.711090 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f9774cba-fca7-4d6a-a65c-acbb8202589a tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Returning 404 to user: Instance 1c763272-042e-418c-b2f6-cc2e96f0c54d could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:02:44.711090 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f9774cba-fca7-4d6a-a65c-acbb8202589a tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d" status: 404 len: 111 microversion: 2.1 time: 0.107187 Jun 20 12:02:44.717177 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 702/1380] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:02:44 2022] DELETE /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:02:44.724524 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d0692992-510e-4e0a-b3ea-43ed4e4de128 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:44.730069 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d0692992-510e-4e0a-b3ea-43ed4e4de128 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] [instance: 1c763272-042e-418c-b2f6-cc2e96f0c54d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:44.744469 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d0692992-510e-4e0a-b3ea-43ed4e4de128 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:44.744985 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d0692992-510e-4e0a-b3ea-43ed4e4de128 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:44.747274 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d0692992-510e-4e0a-b3ea-43ed4e4de128 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:44.752124 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d0692992-510e-4e0a-b3ea-43ed4e4de128 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:44.799170 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-95babf92-ef0b-4351-a173-7cb75d9c6fd5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:44.811640 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-95babf92-ef0b-4351-a173-7cb75d9c6fd5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:44.815481 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-d0692992-510e-4e0a-b3ea-43ed4e4de128 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] HTTP exception thrown: Instance 1c763272-042e-418c-b2f6-cc2e96f0c54d could not be found. Jun 20 12:02:44.816629 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-95babf92-ef0b-4351-a173-7cb75d9c6fd5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:44.819219 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-95babf92-ef0b-4351-a173-7cb75d9c6fd5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1815 microversion: 2.25 time: 0.765049 Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d0692992-510e-4e0a-b3ea-43ed4e4de128 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Request method failure captured: Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d HTTP/1.1 Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGDomgWnML-smVb-CCAM4sNg9bmysAT8z2TXwmZtbYkJWKUzHC6MExUsWzmTItIawkLf-DRxz6hvBEKb5PP4cuOeqlS4guW4PDCKcVfJVLKtsYdtyzWdffLsbVGvV9zgjiBoRFLns3ef106CA1s8qH6TIOZ_Vyi7X04n81fOJGdXz60 Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 0f35cecfcbb948c6b60eef6140f87a3b Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1792448931 Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0f35cecfcbb948c6b60eef6140f87a3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0f35cecfcbb948c6b60eef6140f87a3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0f35cecfcbb948c6b60eef6140f87a3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0f35cecfcbb948c6b60eef6140f87a3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1792448931 Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 0f35cecfcbb948c6b60eef6140f87a3b Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1792448931 Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-AttachSCSIVolumeTestJSON-1792448931-project Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: a53f4e0e140c4a839d99b56ee9ffacc5 Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1792448931-project Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 1c763272-042e-418c-b2f6-cc2e96f0c54d could not be found. Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '1c763272-042e-418c-b2f6-cc2e96f0c54d'} Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c763272-042e-418c-b2f6-cc2e96f0c54d could not be found. Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c763272-042e-418c-b2f6-cc2e96f0c54d could not be found. Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:02:44.821082 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:44.826713 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:44.826713 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:02:44.826713 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:02:44.826713 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:02:44.826713 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:02:44.826713 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c763272-042e-418c-b2f6-cc2e96f0c54d could not be found. Jun 20 12:02:44.826713 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:44.826713 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d0692992-510e-4e0a-b3ea-43ed4e4de128 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] Returning 404 to user: Instance 1c763272-042e-418c-b2f6-cc2e96f0c54d could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:02:44.828658 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d0692992-510e-4e0a-b3ea-43ed4e4de128 tempest-AttachSCSIVolumeTestJSON-1792448931 tempest-AttachSCSIVolumeTestJSON-1792448931-project] 10.222.0.27 "GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d" status: 404 len: 111 microversion: 2.1 time: 0.108383 Jun 20 12:02:44.828658 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 703/1381] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:44 2022] GET /compute/v2.1/servers/1c763272-042e-418c-b2f6-cc2e96f0c54d => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:02:44.832262 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 679/1382] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:44 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1815 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:45.070026 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a84476fc-e72e-4052-8de8-787fd83b5a7f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:45.070503 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a84476fc-e72e-4052-8de8-787fd83b5a7f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: f678dc35-c774-4c0a-9ebb-579688adecb0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:45.094468 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a84476fc-e72e-4052-8de8-787fd83b5a7f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:45.094812 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a84476fc-e72e-4052-8de8-787fd83b5a7f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:45.095626 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a84476fc-e72e-4052-8de8-787fd83b5a7f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:45.104290 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a84476fc-e72e-4052-8de8-787fd83b5a7f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:45.309908 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-af412870-9812-429a-adfc-02b9f001d58c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:45.311170 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-af412870-9812-429a-adfc-02b9f001d58c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:45.322356 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-af412870-9812-429a-adfc-02b9f001d58c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:45.323723 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-af412870-9812-429a-adfc-02b9f001d58c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:45.324773 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-af412870-9812-429a-adfc-02b9f001d58c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:45.327559 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-af412870-9812-429a-adfc-02b9f001d58c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:45.480651 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a84476fc-e72e-4052-8de8-787fd83b5a7f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:45.499262 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a84476fc-e72e-4052-8de8-787fd83b5a7f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0" status: 200 len: 1554 microversion: 2.1 time: 0.429109 Jun 20 12:02:45.501745 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 704/1383] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:45 2022] GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0 => generated 1554 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:45.617429 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4993fa73-c5ae-42ef-9b9a-6b90cbe7f28d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:45.617979 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4993fa73-c5ae-42ef-9b9a-6b90cbe7f28d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:45.628095 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4993fa73-c5ae-42ef-9b9a-6b90cbe7f28d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:45.628574 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4993fa73-c5ae-42ef-9b9a-6b90cbe7f28d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:45.629367 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4993fa73-c5ae-42ef-9b9a-6b90cbe7f28d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:45.629806 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4993fa73-c5ae-42ef-9b9a-6b90cbe7f28d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:46.120929 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4993fa73-c5ae-42ef-9b9a-6b90cbe7f28d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:46.131140 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4993fa73-c5ae-42ef-9b9a-6b90cbe7f28d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80" status: 200 len: 1502 microversion: 2.1 time: 0.520010 Jun 20 12:02:46.131734 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 705/1384] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:45 2022] GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 => generated 1502 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:46.160732 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b3693301-c6fa-4007-9547-a0d57b7f7cb9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:46.165114 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b3693301-c6fa-4007-9547-a0d57b7f7cb9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:46.179404 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3693301-c6fa-4007-9547-a0d57b7f7cb9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:46.180084 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3693301-c6fa-4007-9547-a0d57b7f7cb9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:46.182269 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3693301-c6fa-4007-9547-a0d57b7f7cb9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:46.184302 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3693301-c6fa-4007-9547-a0d57b7f7cb9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:46.519673 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b3693301-c6fa-4007-9547-a0d57b7f7cb9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:46.538291 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b3693301-c6fa-4007-9547-a0d57b7f7cb9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:46.543674 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b3693301-c6fa-4007-9547-a0d57b7f7cb9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:46.547178 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b3693301-c6fa-4007-9547-a0d57b7f7cb9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1815 microversion: 2.25 time: 0.397462 Jun 20 12:02:46.549051 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 706/1385] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:46 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1815 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:46.561218 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-08aa19af-8ee0-4f43-ac4d-8d5b1b0c064c req-2c455802-adbc-4f63-9f16-c8869025da8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3db0bd7d-eed4-411a-a7b8-719b260233ed", "name": "network-vif-unplugged", "status": "completed", "tag": "66a1f7cd-2c10-48c8-8f30-83c32f1d6186"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:02:46.575530 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:46.587911 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-08aa19af-8ee0-4f43-ac4d-8d5b1b0c064c req-2c455802-adbc-4f63-9f16-c8869025da8e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:46.588403 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-08aa19af-8ee0-4f43-ac4d-8d5b1b0c064c req-2c455802-adbc-4f63-9f16-c8869025da8e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:46.625404 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-08aa19af-8ee0-4f43-ac4d-8d5b1b0c064c req-2c455802-adbc-4f63-9f16-c8869025da8e service nova] Creating event network-vif-unplugged:66a1f7cd-2c10-48c8-8f30-83c32f1d6186 for instance 3db0bd7d-eed4-411a-a7b8-719b260233ed on n-h2-master-1 Jun 20 12:02:46.631525 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-08aa19af-8ee0-4f43-ac4d-8d5b1b0c064c req-2c455802-adbc-4f63-9f16-c8869025da8e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079923 Jun 20 12:02:46.632767 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 707/1386] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:02:46.640685 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-004926cd-93ba-48b0-84fa-e40b99e30688 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:46.641851 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-004926cd-93ba-48b0-84fa-e40b99e30688 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: f678dc35-c774-4c0a-9ebb-579688adecb0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:46.649531 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-004926cd-93ba-48b0-84fa-e40b99e30688 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:46.650672 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-004926cd-93ba-48b0-84fa-e40b99e30688 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:46.652513 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-004926cd-93ba-48b0-84fa-e40b99e30688 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:46.652952 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-004926cd-93ba-48b0-84fa-e40b99e30688 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:46.943264 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-004926cd-93ba-48b0-84fa-e40b99e30688 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:46.964514 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-004926cd-93ba-48b0-84fa-e40b99e30688 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0" status: 200 len: 1554 microversion: 2.1 time: 0.330261 Jun 20 12:02:46.965463 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 708/1387] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:46 2022] GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0 => generated 1554 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:47.152112 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-81fa8943-de38-4fd7-adcb-e893b2d14b3d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:47.152988 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-81fa8943-de38-4fd7-adcb-e893b2d14b3d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:47.160447 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-81fa8943-de38-4fd7-adcb-e893b2d14b3d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:47.161216 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-81fa8943-de38-4fd7-adcb-e893b2d14b3d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:47.162200 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-81fa8943-de38-4fd7-adcb-e893b2d14b3d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:47.162840 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-81fa8943-de38-4fd7-adcb-e893b2d14b3d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:47.413594 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-81fa8943-de38-4fd7-adcb-e893b2d14b3d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:47.429871 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-81fa8943-de38-4fd7-adcb-e893b2d14b3d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80" status: 200 len: 1502 microversion: 2.1 time: 0.280066 Jun 20 12:02:47.430701 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 709/1388] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:47 2022] GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 => generated 1502 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:47.567416 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-99ac9583-8705-4fe5-bb14-1f01ae6bc390 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:47.568879 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-99ac9583-8705-4fe5-bb14-1f01ae6bc390 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:47.578368 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-99ac9583-8705-4fe5-bb14-1f01ae6bc390 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:47.582190 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-99ac9583-8705-4fe5-bb14-1f01ae6bc390 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:47.583132 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-99ac9583-8705-4fe5-bb14-1f01ae6bc390 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:47.583644 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-99ac9583-8705-4fe5-bb14-1f01ae6bc390 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:47.905618 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-99ac9583-8705-4fe5-bb14-1f01ae6bc390 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:47.924152 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-99ac9583-8705-4fe5-bb14-1f01ae6bc390 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:47.928342 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-99ac9583-8705-4fe5-bb14-1f01ae6bc390 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:47.930005 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-99ac9583-8705-4fe5-bb14-1f01ae6bc390 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1815 microversion: 2.25 time: 0.366643 Jun 20 12:02:47.931511 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 710/1389] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:47 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1815 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:02:47.983909 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2b0368ee-b3f1-4f74-9c4d-72a6f4204c61 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:47.985554 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2b0368ee-b3f1-4f74-9c4d-72a6f4204c61 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: f678dc35-c774-4c0a-9ebb-579688adecb0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:48.011009 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2b0368ee-b3f1-4f74-9c4d-72a6f4204c61 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:48.011485 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2b0368ee-b3f1-4f74-9c4d-72a6f4204c61 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:48.012328 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2b0368ee-b3f1-4f74-9c4d-72a6f4204c61 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:48.017561 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2b0368ee-b3f1-4f74-9c4d-72a6f4204c61 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:48.074483 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-af412870-9812-429a-adfc-02b9f001d58c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:48.106554 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-af412870-9812-429a-adfc-02b9f001d58c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:48.112109 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-af412870-9812-429a-adfc-02b9f001d58c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:48.113417 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-af412870-9812-429a-adfc-02b9f001d58c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1879 microversion: 2.42 time: 2.809984 Jun 20 12:02:48.113987 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 680/1390] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:45 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1879 bytes in 2811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:02:48.339323 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2b0368ee-b3f1-4f74-9c4d-72a6f4204c61 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:48.352233 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2b0368ee-b3f1-4f74-9c4d-72a6f4204c61 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0" status: 200 len: 1554 microversion: 2.1 time: 0.373078 Jun 20 12:02:48.369327 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 711/1391] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:47 2022] GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0 => generated 1554 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:02:48.454157 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c6f36ca9-86d6-4c0a-a8cf-70705f824cd0 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:48.455126 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c6f36ca9-86d6-4c0a-a8cf-70705f824cd0 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:48.466117 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c6f36ca9-86d6-4c0a-a8cf-70705f824cd0 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:48.467942 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c6f36ca9-86d6-4c0a-a8cf-70705f824cd0 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:48.469143 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c6f36ca9-86d6-4c0a-a8cf-70705f824cd0 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:48.472381 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c6f36ca9-86d6-4c0a-a8cf-70705f824cd0 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:49.005301 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ece45b6f-8095-40f0-b1ca-30984aaf46a4 tempest-FlavorsV2NegativeTest-1472222259 tempest-FlavorsV2NegativeTest-1472222259-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:49.014929 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ece45b6f-8095-40f0-b1ca-30984aaf46a4 tempest-FlavorsV2NegativeTest-1472222259 tempest-FlavorsV2NegativeTest-1472222259-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.242202 Jun 20 12:02:49.016029 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 712/1392] 10.222.0.27 () {58 vars in 1136 bytes} [Mon Jun 20 12:02:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:02:49.028914 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b889e462-bd5f-45d0-bb35-2a60f29e46b8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:49.029674 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b889e462-bd5f-45d0-bb35-2a60f29e46b8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:49.037755 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b889e462-bd5f-45d0-bb35-2a60f29e46b8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:49.038273 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b889e462-bd5f-45d0-bb35-2a60f29e46b8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:49.039103 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b889e462-bd5f-45d0-bb35-2a60f29e46b8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:49.039544 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b889e462-bd5f-45d0-bb35-2a60f29e46b8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:49.312568 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b889e462-bd5f-45d0-bb35-2a60f29e46b8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:49.331599 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b889e462-bd5f-45d0-bb35-2a60f29e46b8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:49.337830 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b889e462-bd5f-45d0-bb35-2a60f29e46b8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:49.344367 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b889e462-bd5f-45d0-bb35-2a60f29e46b8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1815 microversion: 2.25 time: 0.324287 Jun 20 12:02:49.346267 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 713/1393] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:49 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1815 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:49.374680 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8e188a18-6441-4f87-9dd4-4c2fd60f5d98 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:49.376620 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8e188a18-6441-4f87-9dd4-4c2fd60f5d98 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:49.390245 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8e188a18-6441-4f87-9dd4-4c2fd60f5d98 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:49.391183 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8e188a18-6441-4f87-9dd4-4c2fd60f5d98 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:49.393555 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8e188a18-6441-4f87-9dd4-4c2fd60f5d98 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:49.394670 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8e188a18-6441-4f87-9dd4-4c2fd60f5d98 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:49.423802 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c6f36ca9-86d6-4c0a-a8cf-70705f824cd0 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:49.431783 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c6f36ca9-86d6-4c0a-a8cf-70705f824cd0 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80" status: 200 len: 1502 microversion: 2.1 time: 0.982803 Jun 20 12:02:49.440003 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 681/1394] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:48 2022] GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 => generated 1502 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:49.446459 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-f8084644-bf8f-45b6-8e20-c0bfc692e0d4 req-9058f7ac-bccb-4825-a4bc-5edbff4ae142 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f678dc35-c774-4c0a-9ebb-579688adecb0", "name": "network-vif-deleted", "tag": "4f3fd793-2c2d-4d98-8201-6c1a6e0b5190"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:02:49.490746 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-f8084644-bf8f-45b6-8e20-c0bfc692e0d4 req-9058f7ac-bccb-4825-a4bc-5edbff4ae142 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:49.491189 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-f8084644-bf8f-45b6-8e20-c0bfc692e0d4 req-9058f7ac-bccb-4825-a4bc-5edbff4ae142 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:49.511648 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-f8084644-bf8f-45b6-8e20-c0bfc692e0d4 req-9058f7ac-bccb-4825-a4bc-5edbff4ae142 service nova] Creating event network-vif-deleted:4f3fd793-2c2d-4d98-8201-6c1a6e0b5190 for instance f678dc35-c774-4c0a-9ebb-579688adecb0 on n-h1-master-1 Jun 20 12:02:49.534087 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-f8084644-bf8f-45b6-8e20-c0bfc692e0d4 req-9058f7ac-bccb-4825-a4bc-5edbff4ae142 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091228 Jun 20 12:02:49.536294 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 682/1395] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:02:49.542344 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7c698d94-d298-4eef-94c1-502931395c14 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:49.543758 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7c698d94-d298-4eef-94c1-502931395c14 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: f678dc35-c774-4c0a-9ebb-579688adecb0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:49.563168 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7c698d94-d298-4eef-94c1-502931395c14 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:49.564607 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7c698d94-d298-4eef-94c1-502931395c14 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:49.566167 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7c698d94-d298-4eef-94c1-502931395c14 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:49.567282 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7c698d94-d298-4eef-94c1-502931395c14 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:49.828718 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8e188a18-6441-4f87-9dd4-4c2fd60f5d98 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:49.841485 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8e188a18-6441-4f87-9dd4-4c2fd60f5d98 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:49.843517 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8e188a18-6441-4f87-9dd4-4c2fd60f5d98 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:49.845163 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8e188a18-6441-4f87-9dd4-4c2fd60f5d98 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1879 microversion: 2.42 time: 0.496282 Jun 20 12:02:49.846543 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 714/1396] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:49 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1879 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:49.882479 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:49.929707 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7c698d94-d298-4eef-94c1-502931395c14 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:49.941387 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7c698d94-d298-4eef-94c1-502931395c14 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0" status: 200 len: 1345 microversion: 2.1 time: 0.403648 Jun 20 12:02:49.941996 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 683/1397] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:49 2022] GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0 => generated 1345 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:50.027187 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c46d9f0f-a0e0-418d-a66e-7ed27d6766d2 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Action: 'create', calling method: .version_select at 0x7f60734574c0>, body: {"keypair": {"name": "tempest-keypair-1629663406", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfwUZvifHCRkquR4rU4LJgStUvvmURthSOmcxAI1OCaQzkS6JGM1COxzPRuIEwYHZOoaG3U/tMUTmUJcQPb70TJx42aIq5jumRh2cpNRr5SiYqvvrUiJmu2Ci0kglimLQ=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:02:50.061161 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-c46d9f0f-a0e0-418d-a66e-7ed27d6766d2 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Getting quotas for project 1c91a95e8a5e45d7a143b12dd45d3428. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:02:50.067281 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-c46d9f0f-a0e0-418d-a66e-7ed27d6766d2 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Getting quotas for user cb51867d72414ec1be15477cd5a86acb and project 1c91a95e8a5e45d7a143b12dd45d3428. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:02:50.111213 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c46d9f0f-a0e0-418d-a66e-7ed27d6766d2 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.263260 Jun 20 12:02:50.119562 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 715/1398] 10.222.0.27 () {62 vars in 1198 bytes} [Mon Jun 20 12:02:49 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 272 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 20 12:02:50.131285 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-68bc546e-c005-4f6c-9db7-9654fd4b2ce8 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Calling method '.version_select at 0x7f6073405a60>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:50.155085 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-68bc546e-c005-4f6c-9db7-9654fd4b2ce8 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-1629663406" status: 200 len: 513 microversion: 2.2 time: 0.028666 Jun 20 12:02:50.156714 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-771d8565-a37b-4ad5-b156-77869a2e9209 tempest-FlavorsV2NegativeTest-1472222259 tempest-FlavorsV2NegativeTest-1472222259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-31022782", "imageRef": "2819d506-6443-4e7a-86f6-38cfa6682403", "flavorRef": "452"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:02:50.156976 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 684/1399] 10.222.0.27 () {60 vars in 1257 bytes} [Mon Jun 20 12:02:50 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1629663406 => generated 513 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:02:50.173835 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e034d015-2df9-4b26-9ac7-0813891e5b9f tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Calling method '.version_select at 0x7f60735259d0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:50.210871 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e034d015-2df9-4b26-9ac7-0813891e5b9f tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1629663406" status: 204 len: 0 microversion: 2.2 time: 0.044735 Jun 20 12:02:50.212158 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 685/1400] 10.222.0.27 () {60 vars in 1260 bytes} [Mon Jun 20 12:02:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1629663406 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:02:50.227419 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-771d8565-a37b-4ad5-b156-77869a2e9209 tempest-FlavorsV2NegativeTest-1472222259 tempest-FlavorsV2NegativeTest-1472222259-project] validate_networks() for None {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:02:50.227617 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4a46130f-463a-4145-84f7-8e728a881a2b tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Action: 'create', calling method: .version_select at 0x7f60733ffee0>, body: {"keypair": {"name": "tempest-keypair-1411137944", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKK7PaYbXyZmHI46KrjPgrBfn4BfPsni3XElyMSBTM53S+sC6/wptvD/ELnryeC8MGJkX1Va2Qu3wGAuvjY0l+LaHrr/UW1wUMp2PTg5ro5vXuRObcuurL0s4gE7hVtzg=="}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:02:50.256555 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-4a46130f-463a-4145-84f7-8e728a881a2b tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Getting quotas for project 1c91a95e8a5e45d7a143b12dd45d3428. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:02:50.266455 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-4a46130f-463a-4145-84f7-8e728a881a2b tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Getting quotas for user cb51867d72414ec1be15477cd5a86acb and project 1c91a95e8a5e45d7a143b12dd45d3428. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:02:50.326257 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4a46130f-463a-4145-84f7-8e728a881a2b tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.103940 Jun 20 12:02:50.329482 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 686/1401] 10.222.0.27 () {62 vars in 1198 bytes} [Mon Jun 20 12:02:50 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 108 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 20 12:02:50.339278 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b21d786c-4f92-4fe2-afb3-5ba5fab43a93 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Calling method '.version_select at 0x7f607343c550>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:50.376916 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b21d786c-4f92-4fe2-afb3-5ba5fab43a93 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1411137944" status: 204 len: 0 microversion: 2.2 time: 0.041057 Jun 20 12:02:50.381781 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 687/1402] 10.222.0.27 () {60 vars in 1260 bytes} [Mon Jun 20 12:02:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1411137944 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:02:50.386875 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ba9a1ff0-0a7e-4e36-b992-86a741924edf tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:50.387485 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ba9a1ff0-0a7e-4e36-b992-86a741924edf tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:50.395066 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba9a1ff0-0a7e-4e36-b992-86a741924edf tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:50.395819 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba9a1ff0-0a7e-4e36-b992-86a741924edf tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:50.396811 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba9a1ff0-0a7e-4e36-b992-86a741924edf tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:50.397414 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba9a1ff0-0a7e-4e36-b992-86a741924edf tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:50.511455 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-771d8565-a37b-4ad5-b156-77869a2e9209 tempest-FlavorsV2NegativeTest-1472222259 tempest-FlavorsV2NegativeTest-1472222259-project] HTTP exception thrown: Flavor's memory is too small for requested image. Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-771d8565-a37b-4ad5-b156-77869a2e9209 tempest-FlavorsV2NegativeTest-1472222259 tempest-FlavorsV2NegativeTest-1472222259-project] Request method failure captured: Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 141 Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGHoAOliOT6j95k7rWntpYtGX4l6sbcMV7DZSU8E7G_yO60af8w5N4FiCROMb-dXDCxqDDvqtPBigaZaTkFpBGrOfGCPHky7s-sAkf5T1yBlJh2WTx53McPTSgfQ16woBfxEO3WpGy5LQLHQDgudRHlg6ApIiZ-zYOrVcG0_mzUiE9o Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 1bb0274eb4e9427196845df93a4d1eba Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-FlavorsV2NegativeTest-1472222259 Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1bb0274eb4e9427196845df93a4d1eba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1bb0274eb4e9427196845df93a4d1eba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1bb0274eb4e9427196845df93a4d1eba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1bb0274eb4e9427196845df93a4d1eba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-FlavorsV2NegativeTest-1472222259 Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 1bb0274eb4e9427196845df93a4d1eba Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1472222259 Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-FlavorsV2NegativeTest-1472222259-project Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: fd177efb63574dd6baf33fb5b67e667a Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-FlavorsV2NegativeTest-1472222259-project Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-31022782", "imageRef": "2819d506-6443-4e7a-86f6-38cfa6682403", "flavorRef": "452"}} Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: exception: Flavor's memory is too small for requested image. Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-31022782', 'imageRef': '2819d506-6443-4e7a-86f6-38cfa6682403', 'flavorRef': '452'}}} Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 669, in _validate_flavor_image Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 737, in _validate_flavor_image_nostatus Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:02:50.513596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:02:50.520105 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:02:50.520105 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:02:50.520105 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 20 12:02:50.520105 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jun 20 12:02:50.520105 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jun 20 12:02:50.520105 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Jun 20 12:02:50.520105 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:50.520105 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:02:50.520105 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:50.520105 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:50.520105 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:02:50.520105 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:02:50.520105 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:02:50.520105 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:02:50.520105 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Jun 20 12:02:50.520105 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:50.520105 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-771d8565-a37b-4ad5-b156-77869a2e9209 tempest-FlavorsV2NegativeTest-1472222259 tempest-FlavorsV2NegativeTest-1472222259-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:02:50.520105 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-771d8565-a37b-4ad5-b156-77869a2e9209 tempest-FlavorsV2NegativeTest-1472222259 tempest-FlavorsV2NegativeTest-1472222259-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.369330 Jun 20 12:02:50.520105 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 716/1403] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:02:50 2022] POST /compute/v2.1/servers => generated 93 bytes in 371 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 20 12:02:50.523999 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bba65b5a-02fe-4f93-a7e6-ad64388deab0 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Action: 'create', calling method: .version_select at 0x7f60732eac10>, body: {"keypair": {"name": "tempest-keypair-1589764577", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:02:50.541442 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-bba65b5a-02fe-4f93-a7e6-ad64388deab0 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Getting quotas for project 1c91a95e8a5e45d7a143b12dd45d3428. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:02:50.548438 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-bba65b5a-02fe-4f93-a7e6-ad64388deab0 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Getting quotas for user cb51867d72414ec1be15477cd5a86acb and project 1c91a95e8a5e45d7a143b12dd45d3428. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:02:50.581494 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bba65b5a-02fe-4f93-a7e6-ad64388deab0 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.063834 Jun 20 12:02:50.582543 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 717/1404] 10.222.0.27 () {62 vars in 1198 bytes} [Mon Jun 20 12:02:50 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 66 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 20 12:02:50.587999 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-722d132a-2876-452e-a9d1-00ae93d82b40 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:50.588686 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-722d132a-2876-452e-a9d1-00ae93d82b40 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:50.595392 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-722d132a-2876-452e-a9d1-00ae93d82b40 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:50.595852 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-722d132a-2876-452e-a9d1-00ae93d82b40 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:50.597225 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-722d132a-2876-452e-a9d1-00ae93d82b40 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:50.597737 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-722d132a-2876-452e-a9d1-00ae93d82b40 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:50.809821 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-722d132a-2876-452e-a9d1-00ae93d82b40 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:50.820778 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-722d132a-2876-452e-a9d1-00ae93d82b40 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80" status: 200 len: 1502 microversion: 2.1 time: 0.236870 Jun 20 12:02:50.821871 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 718/1405] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:50 2022] GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 => generated 1502 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:50.826979 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ed9524aa-2c83-47ff-b8e4-b0d558d9b0c9 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Calling method '.version_select at 0x7f60733d9b80>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:50.850674 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ed9524aa-2c83-47ff-b8e4-b0d558d9b0c9 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1589764577" status: 204 len: 0 microversion: 2.2 time: 0.027280 Jun 20 12:02:50.858457 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 719/1406] 10.222.0.27 () {60 vars in 1260 bytes} [Mon Jun 20 12:02:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1589764577 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:02:50.867011 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-550378db-f5d8-4a3e-91bc-410c94289de2 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:50.868032 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-550378db-f5d8-4a3e-91bc-410c94289de2 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:50.875062 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-550378db-f5d8-4a3e-91bc-410c94289de2 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:50.875952 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-550378db-f5d8-4a3e-91bc-410c94289de2 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:50.877014 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-550378db-f5d8-4a3e-91bc-410c94289de2 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:50.877835 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-550378db-f5d8-4a3e-91bc-410c94289de2 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:51.157696 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-550378db-f5d8-4a3e-91bc-410c94289de2 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:51.169185 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-550378db-f5d8-4a3e-91bc-410c94289de2 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:51.170850 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-550378db-f5d8-4a3e-91bc-410c94289de2 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:51.172269 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-550378db-f5d8-4a3e-91bc-410c94289de2 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1879 microversion: 2.42 time: 0.310515 Jun 20 12:02:51.184290 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 720/1407] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:50 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1879 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:02:51.190345 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7dfe8aef-e17e-4c00-8ead-d6878952fdd5 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Action: 'create', calling method: .version_select at 0x7f6073457280>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-776377772", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJLKC2J8RYFa0SxFLWKjDn5EqOaExjnGTwrg1na2MYWhq/eLPo7WJyiBOtt/9tS2D8OiHjKiLRS8K49diy+jRY13n8llRFVd+7DDrcaxQaiL93uGqCdEKBuNmMeSdMPrQ=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:02:51.207201 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-7dfe8aef-e17e-4c00-8ead-d6878952fdd5 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Getting quotas for project 1c91a95e8a5e45d7a143b12dd45d3428. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:02:51.212995 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-7dfe8aef-e17e-4c00-8ead-d6878952fdd5 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Getting quotas for user cb51867d72414ec1be15477cd5a86acb and project 1c91a95e8a5e45d7a143b12dd45d3428. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:02:51.241420 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7dfe8aef-e17e-4c00-8ead-d6878952fdd5 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.055058 Jun 20 12:02:51.242844 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 721/1408] 10.222.0.27 () {62 vars in 1198 bytes} [Mon Jun 20 12:02:51 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 58 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 20 12:02:51.250014 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-28c6a118-8aa4-494e-bf9b-8034bcbcc11f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:51.251655 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-28c6a118-8aa4-494e-bf9b-8034bcbcc11f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: f678dc35-c774-4c0a-9ebb-579688adecb0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:51.263419 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28c6a118-8aa4-494e-bf9b-8034bcbcc11f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:51.264650 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28c6a118-8aa4-494e-bf9b-8034bcbcc11f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:51.265583 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28c6a118-8aa4-494e-bf9b-8034bcbcc11f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:51.266108 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28c6a118-8aa4-494e-bf9b-8034bcbcc11f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:51.346807 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-28c6a118-8aa4-494e-bf9b-8034bcbcc11f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:51.355667 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-28c6a118-8aa4-494e-bf9b-8034bcbcc11f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0" status: 200 len: 1345 microversion: 2.1 time: 0.111414 Jun 20 12:02:51.356589 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 722/1409] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:51 2022] GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0 => generated 1345 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:51.374745 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e1458c6a-a73c-41aa-93e8-42961db12fee tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Action: 'create', calling method: .version_select at 0x7f60732c1dc0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-460122262", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlsquu+eETaH4q5Z4yRHAEfpMgPHZ1TF32uA/RkaQ+g+iuFOrXWiDBxnxpfb65wjsKslrR7QXWc6+WAki5lN5iRxq0+tAX9elNMsDAaG6SOW/eo/FrBBvLcEWC6Y0Zv9w=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:02:51.401498 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ba9a1ff0-0a7e-4e36-b992-86a741924edf tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:51.410216 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-e1458c6a-a73c-41aa-93e8-42961db12fee tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Getting quotas for project 1c91a95e8a5e45d7a143b12dd45d3428. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:02:51.413063 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ba9a1ff0-0a7e-4e36-b992-86a741924edf tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:51.418046 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ba9a1ff0-0a7e-4e36-b992-86a741924edf tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:51.422961 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ba9a1ff0-0a7e-4e36-b992-86a741924edf tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1815 microversion: 2.25 time: 1.039811 Jun 20 12:02:51.423641 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-e1458c6a-a73c-41aa-93e8-42961db12fee tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Getting quotas for user cb51867d72414ec1be15477cd5a86acb and project 1c91a95e8a5e45d7a143b12dd45d3428. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:02:51.434297 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 688/1410] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:50 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1815 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:51.494862 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e1458c6a-a73c-41aa-93e8-42961db12fee tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.136941 Jun 20 12:02:51.495481 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 723/1411] 10.222.0.27 () {62 vars in 1198 bytes} [Mon Jun 20 12:02:51 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 138 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 20 12:02:51.509807 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d4202a75-4429-4be0-9e80-955e26de9ff9 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Action: 'create', calling method: .version_select at 0x7f60733f7e50>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1225375137", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnriYD8RScdV5rSjggzgNCQroemqJb2UQQHvd6iYiGy6nMK52lwqZx1uJ4OdXg01R+BRgGZsCV7WnrQOv8E/ugX0TXn5CHp7/npnr7lXhs/o8ylHwtEMf5Jv2b3OVxJyQ=="}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:02:51.529156 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-d4202a75-4429-4be0-9e80-955e26de9ff9 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Getting quotas for project 1c91a95e8a5e45d7a143b12dd45d3428. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:02:51.535337 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-d4202a75-4429-4be0-9e80-955e26de9ff9 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Getting quotas for user cb51867d72414ec1be15477cd5a86acb and project 1c91a95e8a5e45d7a143b12dd45d3428. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:02:51.563018 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d4202a75-4429-4be0-9e80-955e26de9ff9 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.058747 Jun 20 12:02:51.573839 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ead33906-80f6-45f8-b68a-19d64401685a tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Calling method '.version_select at 0x7f6073457700>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:51.576818 n-d-master-1 devstack@n-api.service[119127]: WARNING oslo_db.sqlalchemy.utils [None req-ead33906-80f6-45f8-b68a-19d64401685a tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Unique keys not in sort_keys. The sorting order may be unstable. Jun 20 12:02:51.580417 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 689/1412] 10.222.0.27 () {62 vars in 1198 bytes} [Mon Jun 20 12:02:51 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 77 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 20 12:02:51.608138 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ead33906-80f6-45f8-b68a-19d64401685a tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.038474 Jun 20 12:02:51.616762 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 724/1413] 10.222.0.27 () {60 vars in 1176 bytes} [Mon Jun 20 12:02:51 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:51.630044 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7e067231-c6ea-4ca7-9e41-4c4e6a0f1bc9 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Calling method '.version_select at 0x7f6073410ca0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:51.664443 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7e067231-c6ea-4ca7-9e41-4c4e6a0f1bc9 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1225375137" status: 204 len: 0 microversion: 2.2 time: 0.040188 Jun 20 12:02:51.665048 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 690/1414] 10.222.0.27 () {60 vars in 1320 bytes} [Mon Jun 20 12:02:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1225375137 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:02:51.673963 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-71262c59-a7c5-4afb-9c2e-3123be896f94 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Calling method '.version_select at 0x7f60735baee0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:51.699736 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-71262c59-a7c5-4afb-9c2e-3123be896f94 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-460122262" status: 204 len: 0 microversion: 2.2 time: 0.030210 Jun 20 12:02:51.712447 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e274704f-1664-45a3-825b-27a83975f419 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Calling method '.version_select at 0x7f6073405670>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:51.717853 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 725/1415] 10.222.0.27 () {60 vars in 1317 bytes} [Mon Jun 20 12:02:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-460122262 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 12:02:51.756503 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e274704f-1664-45a3-825b-27a83975f419 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-776377772" status: 204 len: 0 microversion: 2.2 time: 0.034499 Jun 20 12:02:51.758817 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 691/1416] 10.222.0.27 () {60 vars in 1317 bytes} [Mon Jun 20 12:02:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-776377772 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:02:51.774690 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-aa64d9cf-4f55-4afc-8a4e-2064c67d947c tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Action: 'create', calling method: .version_select at 0x7f60735baca0>, body: {"keypair": {"name": "tempest-keypair-1093247810", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEBYP5+yR8EkKNonDkF2UMeLpA3MEszNzVgG4bQytzlVQ+PgYslXuWI2N55PKX2k2o1HuSZvPq8E/39BUcOEidL05JzkPEefMslmcDSChakO6X5v4EMCobt0C4IjmoptVw=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:02:51.808548 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-aa64d9cf-4f55-4afc-8a4e-2064c67d947c tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Getting quotas for project 1c91a95e8a5e45d7a143b12dd45d3428. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:02:51.825795 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-aa64d9cf-4f55-4afc-8a4e-2064c67d947c tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Getting quotas for user cb51867d72414ec1be15477cd5a86acb and project 1c91a95e8a5e45d7a143b12dd45d3428. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:02:51.842400 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3d3f2846-b144-4ef4-8bd6-fd5674aec0f1 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:51.843476 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3d3f2846-b144-4ef4-8bd6-fd5674aec0f1 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:51.866097 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3d3f2846-b144-4ef4-8bd6-fd5674aec0f1 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:51.867839 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3d3f2846-b144-4ef4-8bd6-fd5674aec0f1 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:51.873476 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3d3f2846-b144-4ef4-8bd6-fd5674aec0f1 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:51.875470 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3d3f2846-b144-4ef4-8bd6-fd5674aec0f1 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:51.878252 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-aa64d9cf-4f55-4afc-8a4e-2064c67d947c tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.108443 Jun 20 12:02:51.885932 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 726/1417] 10.222.0.27 () {62 vars in 1198 bytes} [Mon Jun 20 12:02:51 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 117 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 20 12:02:51.900017 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4629a683-bc70-4113-a769-b8df02e13490 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Calling method '.version_select at 0x7f607338ef70>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:51.922886 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4629a683-bc70-4113-a769-b8df02e13490 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-1093247810" status: 200 len: 513 microversion: 2.2 time: 0.035725 Jun 20 12:02:51.940780 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 727/1418] 10.222.0.27 () {60 vars in 1257 bytes} [Mon Jun 20 12:02:51 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1093247810 => generated 513 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:02:51.951682 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4b1dfb31-ffa7-417b-8480-0b7cdc267c05 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Calling method '.version_select at 0x7f60736b8670>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:51.954695 n-d-master-1 devstack@n-api.service[119127]: WARNING oslo_db.sqlalchemy.utils [None req-4b1dfb31-ffa7-417b-8480-0b7cdc267c05 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Unique keys not in sort_keys. The sorting order may be unstable. Jun 20 12:02:51.971142 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4b1dfb31-ffa7-417b-8480-0b7cdc267c05 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.023250 Jun 20 12:02:51.976672 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 728/1419] 10.222.0.27 () {60 vars in 1176 bytes} [Mon Jun 20 12:02:51 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:02:51.982145 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a673fe3c-8c15-496f-a54c-10f2cfc0d793 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Calling method '.version_select at 0x7f60732f0820>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:52.020841 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:52.030419 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a673fe3c-8c15-496f-a54c-10f2cfc0d793 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1093247810" status: 204 len: 0 microversion: 2.2 time: 0.052021 Jun 20 12:02:52.031263 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 729/1420] 10.222.0.27 () {60 vars in 1260 bytes} [Mon Jun 20 12:02:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1093247810 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:02:52.043378 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fe793dc7-7624-41f1-a9db-7df9cb7d8720 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Action: 'create', calling method: .version_select at 0x7f60733064c0>, body: {"keypair": {"name": "tempest-keypair-67048328", "type": "x509"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:02:52.062187 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-fe793dc7-7624-41f1-a9db-7df9cb7d8720 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Getting quotas for project 1c91a95e8a5e45d7a143b12dd45d3428. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:02:52.072741 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-fe793dc7-7624-41f1-a9db-7df9cb7d8720 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Getting quotas for user cb51867d72414ec1be15477cd5a86acb and project 1c91a95e8a5e45d7a143b12dd45d3428. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:02:52.135234 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.processutils [None req-fe793dc7-7624-41f1-a9db-7df9cb7d8720 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpxrhvhq2q/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpxrhvhq2q/temp.key -subj /CN=cb51867d72414ec1be15477cd5a86acb -extensions v3_req_client {{(pid=119127) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 20 12:02:52.416841 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.processutils [None req-fe793dc7-7624-41f1-a9db-7df9cb7d8720 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpxrhvhq2q/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpxrhvhq2q/temp.key -subj /CN=cb51867d72414ec1be15477cd5a86acb -extensions v3_req_client" returned: 0 in 0.281s {{(pid=119127) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 20 12:02:52.419318 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.processutils [None req-fe793dc7-7624-41f1-a9db-7df9cb7d8720 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpxrhvhq2q/temp.key -password pass: {{(pid=119127) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 20 12:02:52.484433 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.processutils [None req-fe793dc7-7624-41f1-a9db-7df9cb7d8720 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpxrhvhq2q/temp.key -password pass:" returned: 0 in 0.063s {{(pid=119127) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 20 12:02:52.582799 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-fe793dc7-7624-41f1-a9db-7df9cb7d8720 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Getting quotas for project 1c91a95e8a5e45d7a143b12dd45d3428. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:02:52.601196 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-fe793dc7-7624-41f1-a9db-7df9cb7d8720 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Getting quotas for user cb51867d72414ec1be15477cd5a86acb and project 1c91a95e8a5e45d7a143b12dd45d3428. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:02:52.645193 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fe793dc7-7624-41f1-a9db-7df9cb7d8720 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 4691 microversion: 2.2 time: 0.608476 Jun 20 12:02:52.646150 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 730/1421] 10.222.0.27 () {62 vars in 1197 bytes} [Mon Jun 20 12:02:52 2022] POST /compute/v2.1/os-keypairs => generated 4691 bytes in 610 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) Jun 20 12:02:52.652233 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3d3f2846-b144-4ef4-8bd6-fd5674aec0f1 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:52.661797 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-39d181dc-9654-41af-8f59-b9c1cf1016a9 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:52.662508 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-39d181dc-9654-41af-8f59-b9c1cf1016a9 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:52.668763 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3d3f2846-b144-4ef4-8bd6-fd5674aec0f1 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80" status: 200 len: 1502 microversion: 2.1 time: 0.833200 Jun 20 12:02:52.678177 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 692/1422] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:51 2022] GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 => generated 1502 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:52.678177 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a9ef47d9-1eb8-48c0-8558-b1005827c005 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:52.678177 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a9ef47d9-1eb8-48c0-8558-b1005827c005 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: f678dc35-c774-4c0a-9ebb-579688adecb0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:52.685707 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-39d181dc-9654-41af-8f59-b9c1cf1016a9 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:52.686815 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-39d181dc-9654-41af-8f59-b9c1cf1016a9 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:52.688117 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-39d181dc-9654-41af-8f59-b9c1cf1016a9 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:52.689743 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-39d181dc-9654-41af-8f59-b9c1cf1016a9 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:52.690845 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a9ef47d9-1eb8-48c0-8558-b1005827c005 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:52.691520 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a9ef47d9-1eb8-48c0-8558-b1005827c005 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:52.692500 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a9ef47d9-1eb8-48c0-8558-b1005827c005 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:52.704992 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a9ef47d9-1eb8-48c0-8558-b1005827c005 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:52.750303 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:52.930552 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a9ef47d9-1eb8-48c0-8558-b1005827c005 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:52.961414 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a9ef47d9-1eb8-48c0-8558-b1005827c005 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0" status: 200 len: 1345 microversion: 2.1 time: 0.289394 Jun 20 12:02:52.963093 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 693/1423] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:52 2022] GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0 => generated 1345 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:52.971678 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-389b69af-4425-4223-915b-49f738a65ace tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:52.986949 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-389b69af-4425-4223-915b-49f738a65ace tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:53.012813 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-389b69af-4425-4223-915b-49f738a65ace tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:53.019035 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-389b69af-4425-4223-915b-49f738a65ace tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:53.021363 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-389b69af-4425-4223-915b-49f738a65ace tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:53.025371 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-389b69af-4425-4223-915b-49f738a65ace tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:53.734794 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-389b69af-4425-4223-915b-49f738a65ace tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:53.758026 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-389b69af-4425-4223-915b-49f738a65ace tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:53.767584 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-389b69af-4425-4223-915b-49f738a65ace tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:53.774439 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-389b69af-4425-4223-915b-49f738a65ace tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1815 microversion: 2.25 time: 0.806600 Jun 20 12:02:53.778643 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 694/1424] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:52 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1815 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:53.799748 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e2198994-61f0-4a44-97d9-efe5e56c7474 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Calling method '.version_select at 0x7f6073405a60>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:53.829357 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=5,nova_api:INSERT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:53.864742 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e2198994-61f0-4a44-97d9-efe5e56c7474 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-67048328" status: 200 len: 1532 microversion: 2.2 time: 0.079075 Jun 20 12:02:53.868256 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 695/1425] 10.222.0.27 () {60 vars in 1251 bytes} [Mon Jun 20 12:02:53 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-67048328 => generated 1532 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:53.896505 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1f5b2e3a-5536-4688-bc0f-210bf0061d55 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:53.897203 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1f5b2e3a-5536-4688-bc0f-210bf0061d55 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:53.926329 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f5b2e3a-5536-4688-bc0f-210bf0061d55 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:53.926781 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f5b2e3a-5536-4688-bc0f-210bf0061d55 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:53.934524 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f5b2e3a-5536-4688-bc0f-210bf0061d55 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:53.935178 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f5b2e3a-5536-4688-bc0f-210bf0061d55 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:54.366078 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-39d181dc-9654-41af-8f59-b9c1cf1016a9 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:54.387421 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-39d181dc-9654-41af-8f59-b9c1cf1016a9 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:54.395385 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-39d181dc-9654-41af-8f59-b9c1cf1016a9 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:54.401268 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-39d181dc-9654-41af-8f59-b9c1cf1016a9 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1879 microversion: 2.42 time: 1.752993 Jun 20 12:02:54.402828 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 731/1426] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:52 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1879 bytes in 1756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:54.418493 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0fbc79f5-302d-45a3-a589-c99cd79a8246 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Calling method '.version_select at 0x7f6073453550>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:54.429641 n-d-master-1 devstack@n-api.service[119127]: WARNING oslo_db.sqlalchemy.utils [None req-0fbc79f5-302d-45a3-a589-c99cd79a8246 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Unique keys not in sort_keys. The sorting order may be unstable. Jun 20 12:02:54.444308 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0fbc79f5-302d-45a3-a589-c99cd79a8246 tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 1389 microversion: 2.2 time: 0.036726 Jun 20 12:02:54.448211 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 732/1427] 10.222.0.27 () {60 vars in 1176 bytes} [Mon Jun 20 12:02:54 2022] GET /compute/v2.1/os-keypairs => generated 1389 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:54.459072 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9a39a2dc-a0c8-4acf-abe9-943864aa935b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:54.459759 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9a39a2dc-a0c8-4acf-abe9-943864aa935b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: f678dc35-c774-4c0a-9ebb-579688adecb0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:54.481941 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a39a2dc-a0c8-4acf-abe9-943864aa935b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:54.486511 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a39a2dc-a0c8-4acf-abe9-943864aa935b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:54.487466 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a39a2dc-a0c8-4acf-abe9-943864aa935b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:54.487935 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a39a2dc-a0c8-4acf-abe9-943864aa935b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:54.801954 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9a39a2dc-a0c8-4acf-abe9-943864aa935b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:54.818817 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9a39a2dc-a0c8-4acf-abe9-943864aa935b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0" status: 200 len: 1345 microversion: 2.1 time: 0.369416 Jun 20 12:02:54.822967 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 733/1428] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:54 2022] GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0 => generated 1345 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:54.833917 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a8318a94-018d-4e6b-8ca6-c4eabfc03a3c tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] Calling method '.version_select at 0x7f60733065e0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:54.894384 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1f5b2e3a-5536-4688-bc0f-210bf0061d55 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:54.900300 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a8318a94-018d-4e6b-8ca6-c4eabfc03a3c tempest-KeyPairsV22TestJSON-2048414584 tempest-KeyPairsV22TestJSON-2048414584-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-67048328" status: 204 len: 0 microversion: 2.2 time: 0.072657 Jun 20 12:02:54.902267 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 734/1429] 10.222.0.27 () {60 vars in 1254 bytes} [Mon Jun 20 12:02:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-67048328 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:02:54.916913 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-962ebfa7-e7e1-4357-8910-dda894fb59a7 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:54.919284 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1f5b2e3a-5536-4688-bc0f-210bf0061d55 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80" status: 200 len: 1502 microversion: 2.1 time: 1.037975 Jun 20 12:02:54.925357 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 696/1430] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:53 2022] GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 => generated 1502 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:54.928307 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-962ebfa7-e7e1-4357-8910-dda894fb59a7 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:54.951536 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-962ebfa7-e7e1-4357-8910-dda894fb59a7 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:54.953222 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-962ebfa7-e7e1-4357-8910-dda894fb59a7 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:54.959050 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-962ebfa7-e7e1-4357-8910-dda894fb59a7 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:54.962387 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-962ebfa7-e7e1-4357-8910-dda894fb59a7 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:55.422437 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f23f1e29-c452-44c2-8125-405ae7f86b7d tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:55.423895 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f23f1e29-c452-44c2-8125-405ae7f86b7d tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:55.437676 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f23f1e29-c452-44c2-8125-405ae7f86b7d tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:55.438125 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f23f1e29-c452-44c2-8125-405ae7f86b7d tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:55.443192 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f23f1e29-c452-44c2-8125-405ae7f86b7d tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:55.443883 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f23f1e29-c452-44c2-8125-405ae7f86b7d tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:55.723454 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-962ebfa7-e7e1-4357-8910-dda894fb59a7 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:55.735520 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-962ebfa7-e7e1-4357-8910-dda894fb59a7 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:55.742303 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-962ebfa7-e7e1-4357-8910-dda894fb59a7 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:55.749942 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-962ebfa7-e7e1-4357-8910-dda894fb59a7 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1815 microversion: 2.25 time: 0.844063 Jun 20 12:02:55.757620 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 735/1431] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:54 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1815 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:55.846678 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-58f33d14-f91a-4a7b-bcfa-d376e8e52ed3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:55.847307 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-58f33d14-f91a-4a7b-bcfa-d376e8e52ed3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: f678dc35-c774-4c0a-9ebb-579688adecb0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:55.870628 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-58f33d14-f91a-4a7b-bcfa-d376e8e52ed3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:55.871081 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-58f33d14-f91a-4a7b-bcfa-d376e8e52ed3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:55.871887 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-58f33d14-f91a-4a7b-bcfa-d376e8e52ed3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:55.872360 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-58f33d14-f91a-4a7b-bcfa-d376e8e52ed3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:55.924454 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f23f1e29-c452-44c2-8125-405ae7f86b7d tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:55.942966 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f23f1e29-c452-44c2-8125-405ae7f86b7d tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:55.945702 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f23f1e29-c452-44c2-8125-405ae7f86b7d tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:55.961878 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f23f1e29-c452-44c2-8125-405ae7f86b7d tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1879 microversion: 2.42 time: 0.529950 Jun 20 12:02:55.963325 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 697/1432] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:55 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1879 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:02:55.969554 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-940cec63-9e01-4ecc-92c0-e6ab5328d4b4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:55.970591 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-940cec63-9e01-4ecc-92c0-e6ab5328d4b4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:55.979217 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-940cec63-9e01-4ecc-92c0-e6ab5328d4b4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:55.981344 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-940cec63-9e01-4ecc-92c0-e6ab5328d4b4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:55.988372 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-940cec63-9e01-4ecc-92c0-e6ab5328d4b4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:55.989281 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-940cec63-9e01-4ecc-92c0-e6ab5328d4b4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:56.166054 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-940cec63-9e01-4ecc-92c0-e6ab5328d4b4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:56.177620 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-940cec63-9e01-4ecc-92c0-e6ab5328d4b4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80" status: 200 len: 1502 microversion: 2.1 time: 0.210402 Jun 20 12:02:56.190123 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 698/1433] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:55 2022] GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 => generated 1502 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:56.257884 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-58f33d14-f91a-4a7b-bcfa-d376e8e52ed3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:56.274068 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-58f33d14-f91a-4a7b-bcfa-d376e8e52ed3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0" status: 200 len: 1345 microversion: 2.1 time: 0.438813 Jun 20 12:02:56.275840 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 736/1434] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:55 2022] GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0 => generated 1345 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:56.770321 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-51da7f40-ca3c-44e3-afa7-0f413049c552 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:56.771339 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-51da7f40-ca3c-44e3-afa7-0f413049c552 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:56.778616 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-51da7f40-ca3c-44e3-afa7-0f413049c552 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:56.779462 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-51da7f40-ca3c-44e3-afa7-0f413049c552 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:56.780617 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-51da7f40-ca3c-44e3-afa7-0f413049c552 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:56.781295 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-51da7f40-ca3c-44e3-afa7-0f413049c552 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:56.985735 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-20a61d0e-38c3-4ea4-933c-41580d2d4fcb tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:56.987161 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-20a61d0e-38c3-4ea4-933c-41580d2d4fcb tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:57.010489 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-20a61d0e-38c3-4ea4-933c-41580d2d4fcb tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:57.012961 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-20a61d0e-38c3-4ea4-933c-41580d2d4fcb tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:57.014602 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-20a61d0e-38c3-4ea4-933c-41580d2d4fcb tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:57.015470 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-20a61d0e-38c3-4ea4-933c-41580d2d4fcb tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:57.091983 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-51da7f40-ca3c-44e3-afa7-0f413049c552 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:57.104578 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-51da7f40-ca3c-44e3-afa7-0f413049c552 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:57.106109 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-51da7f40-ca3c-44e3-afa7-0f413049c552 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:57.107322 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-51da7f40-ca3c-44e3-afa7-0f413049c552 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1805 microversion: 2.25 time: 0.341478 Jun 20 12:02:57.112305 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 699/1435] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:56 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1805 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:57.130709 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6dcb37e6-46a9-4a79-954a-0992626f6e4f tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Calling method '.version_select at 0x7f6073432700>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:57.133377 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6dcb37e6-46a9-4a79-954a-0992626f6e4f tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:57.134038 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6dcb37e6-46a9-4a79-954a-0992626f6e4f tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:57.185762 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6dcb37e6-46a9-4a79-954a-0992626f6e4f tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 2183 microversion: 2.25 time: 0.057733 Jun 20 12:02:57.187233 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 700/1436] 10.222.0.27 () {60 vars in 1183 bytes} [Mon Jun 20 12:02:57 2022] GET /compute/v2.1/os-migrations => generated 2183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:02:57.203457 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bae69acc-7774-4496-833c-52a4e92253b3 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:57.204954 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bae69acc-7774-4496-833c-52a4e92253b3 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:57.213821 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bae69acc-7774-4496-833c-52a4e92253b3 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:57.214646 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bae69acc-7774-4496-833c-52a4e92253b3 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:57.216360 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bae69acc-7774-4496-833c-52a4e92253b3 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:57.217060 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bae69acc-7774-4496-833c-52a4e92253b3 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:57.458948 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-bae69acc-7774-4496-833c-52a4e92253b3 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lazy-loading 'services' on Instance uuid 3db0bd7d-eed4-411a-a7b8-719b260233ed {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:02:57.480768 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bae69acc-7774-4496-833c-52a4e92253b3 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 2423 microversion: 2.25 time: 0.284349 Jun 20 12:02:57.481977 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 701/1437] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:57 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 2423 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:02:57.498468 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-556a995f-76a0-489a-8bf7-01799d233dba tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:57.504439 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-556a995f-76a0-489a-8bf7-01799d233dba tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:57.525794 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-556a995f-76a0-489a-8bf7-01799d233dba tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:57.526261 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-556a995f-76a0-489a-8bf7-01799d233dba tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:57.527048 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-556a995f-76a0-489a-8bf7-01799d233dba tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:57.527490 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-556a995f-76a0-489a-8bf7-01799d233dba tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:57.581957 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:57.607609 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-20a61d0e-38c3-4ea4-933c-41580d2d4fcb tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:57.636638 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-20a61d0e-38c3-4ea4-933c-41580d2d4fcb tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:57.638494 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-20a61d0e-38c3-4ea4-933c-41580d2d4fcb tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:57.644075 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-20a61d0e-38c3-4ea4-933c-41580d2d4fcb tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1879 microversion: 2.42 time: 0.665267 Jun 20 12:02:57.658966 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 737/1438] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:56 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1879 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:57.664380 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-239a5d41-a24e-4745-9a5d-2d7798dcb4e2 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:57.665263 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-239a5d41-a24e-4745-9a5d-2d7798dcb4e2 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: f678dc35-c774-4c0a-9ebb-579688adecb0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:57.688578 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-239a5d41-a24e-4745-9a5d-2d7798dcb4e2 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:57.691475 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-239a5d41-a24e-4745-9a5d-2d7798dcb4e2 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:57.692560 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-239a5d41-a24e-4745-9a5d-2d7798dcb4e2 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:57.694677 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-239a5d41-a24e-4745-9a5d-2d7798dcb4e2 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:57.774644 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-239a5d41-a24e-4745-9a5d-2d7798dcb4e2 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:57.775293 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-239a5d41-a24e-4745-9a5d-2d7798dcb4e2 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:57.776027 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-239a5d41-a24e-4745-9a5d-2d7798dcb4e2 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lazy-loading 'fault' on Instance uuid f678dc35-c774-4c0a-9ebb-579688adecb0 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:02:57.986946 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-556a995f-76a0-489a-8bf7-01799d233dba tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:57.996261 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-556a995f-76a0-489a-8bf7-01799d233dba tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80" status: 200 len: 1502 microversion: 2.1 time: 0.512987 Jun 20 12:02:57.997456 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 702/1439] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:57 2022] GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 => generated 1502 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:58.002368 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3885efd9-5ec0-4441-bbdd-51ada5ee6d09 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:58.003213 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3885efd9-5ec0-4441-bbdd-51ada5ee6d09 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:58.009842 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3885efd9-5ec0-4441-bbdd-51ada5ee6d09 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:58.010571 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3885efd9-5ec0-4441-bbdd-51ada5ee6d09 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:58.011535 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3885efd9-5ec0-4441-bbdd-51ada5ee6d09 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:58.012137 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3885efd9-5ec0-4441-bbdd-51ada5ee6d09 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:58.076335 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-239a5d41-a24e-4745-9a5d-2d7798dcb4e2 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:58.087041 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-239a5d41-a24e-4745-9a5d-2d7798dcb4e2 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0" status: 200 len: 1304 microversion: 2.1 time: 0.426600 Jun 20 12:02:58.103167 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 738/1440] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:57 2022] GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0 => generated 1304 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:58.663813 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0f0936f2-42c5-4287-b8a9-fa39e814a8c6 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:58.665220 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0f0936f2-42c5-4287-b8a9-fa39e814a8c6 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:58.679934 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f0936f2-42c5-4287-b8a9-fa39e814a8c6 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:58.681255 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f0936f2-42c5-4287-b8a9-fa39e814a8c6 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:58.685768 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f0936f2-42c5-4287-b8a9-fa39e814a8c6 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:58.687001 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f0936f2-42c5-4287-b8a9-fa39e814a8c6 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:58.778961 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-3885efd9-5ec0-4441-bbdd-51ada5ee6d09 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lazy-loading 'services' on Instance uuid 3db0bd7d-eed4-411a-a7b8-719b260233ed {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:02:58.819466 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3885efd9-5ec0-4441-bbdd-51ada5ee6d09 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 2423 microversion: 2.25 time: 0.820704 Jun 20 12:02:58.820074 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 703/1441] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:57 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 2423 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:02:58.966929 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4eaa0a3e-e1af-4866-a57a-f6ebaae710a9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:58.967621 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4eaa0a3e-e1af-4866-a57a-f6ebaae710a9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:58.979177 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4eaa0a3e-e1af-4866-a57a-f6ebaae710a9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:58.980268 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4eaa0a3e-e1af-4866-a57a-f6ebaae710a9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:58.988948 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4eaa0a3e-e1af-4866-a57a-f6ebaae710a9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:58.990077 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4eaa0a3e-e1af-4866-a57a-f6ebaae710a9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:59.152840 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-4eaa0a3e-e1af-4866-a57a-f6ebaae710a9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lazy-loading 'services' on Instance uuid 3db0bd7d-eed4-411a-a7b8-719b260233ed {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:02:59.337662 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4eaa0a3e-e1af-4866-a57a-f6ebaae710a9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed/os-volume_attachments/63df072b-0912-4ef8-8a2f-5ba514117165" status: 202 len: 0 microversion: 2.25 time: 0.375510 Jun 20 12:02:59.339445 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0f0936f2-42c5-4287-b8a9-fa39e814a8c6 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:59.341065 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 704/1442] 10.222.0.27 () {60 vars in 1456 bytes} [Mon Jun 20 12:02:58 2022] DELETE /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed/os-volume_attachments/63df072b-0912-4ef8-8a2f-5ba514117165 => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:02:59.350704 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-da4862c9-ebce-4c41-adb3-a58f8165fbcf tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:59.352048 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-da4862c9-ebce-4c41-adb3-a58f8165fbcf tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:59.366958 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-da4862c9-ebce-4c41-adb3-a58f8165fbcf tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:59.368054 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-da4862c9-ebce-4c41-adb3-a58f8165fbcf tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:59.370821 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0f0936f2-42c5-4287-b8a9-fa39e814a8c6 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:59.373262 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0f0936f2-42c5-4287-b8a9-fa39e814a8c6 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:59.373756 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-da4862c9-ebce-4c41-adb3-a58f8165fbcf tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:59.374599 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0f0936f2-42c5-4287-b8a9-fa39e814a8c6 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1879 microversion: 2.42 time: 0.715441 Jun 20 12:02:59.374798 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-da4862c9-ebce-4c41-adb3-a58f8165fbcf tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:59.394026 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 739/1443] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:02:58 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1879 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:02:59.406644 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6a525404-8d86-4340-ab25-70a09b5eb0b0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:59.414460 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6a525404-8d86-4340-ab25-70a09b5eb0b0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: f678dc35-c774-4c0a-9ebb-579688adecb0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:59.431721 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6a525404-8d86-4340-ab25-70a09b5eb0b0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:59.432180 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6a525404-8d86-4340-ab25-70a09b5eb0b0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:59.441997 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6a525404-8d86-4340-ab25-70a09b5eb0b0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:59.442464 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6a525404-8d86-4340-ab25-70a09b5eb0b0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:59.490212 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-6a525404-8d86-4340-ab25-70a09b5eb0b0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] HTTP exception thrown: Instance f678dc35-c774-4c0a-9ebb-579688adecb0 could not be found. Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6a525404-8d86-4340-ab25-70a09b5eb0b0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Request method failure captured: Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0 HTTP/1.1 Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGGM0_Rgon_QXChHIK_Ikyu0N9hux8u1Ms08jFhXlxkRDQgHGZCrxeBLJGVow3P3B7-C_d1lwOFEoVq18fpBt5bYVFsDOyFchFBnf15eYmBoM5W3iquFzY2ZI2UJK0DkPKTj0Fv6tDqgY5whthvLS8glHLsBu0Y3_K5TIG0-QwQVU5w Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 3495d9dc8b714809b2f3f777cbabda29 Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: exception: Instance f678dc35-c774-4c0a-9ebb-579688adecb0 could not be found. Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'f678dc35-c774-4c0a-9ebb-579688adecb0'} Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f678dc35-c774-4c0a-9ebb-579688adecb0 could not be found. Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f678dc35-c774-4c0a-9ebb-579688adecb0 could not be found. Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:02:59.500969 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:59.506229 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:02:59.506229 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:02:59.506229 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:02:59.506229 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:02:59.506229 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:02:59.506229 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f678dc35-c774-4c0a-9ebb-579688adecb0 could not be found. Jun 20 12:02:59.506229 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:02:59.506229 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6a525404-8d86-4340-ab25-70a09b5eb0b0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Returning 404 to user: Instance f678dc35-c774-4c0a-9ebb-579688adecb0 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:02:59.506229 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6a525404-8d86-4340-ab25-70a09b5eb0b0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0" status: 404 len: 111 microversion: 2.1 time: 0.107102 Jun 20 12:02:59.507140 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 740/1444] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:59 2022] GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:02:59.811074 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c0b40cc5-ac1a-4dc2-8c06-62ce6a83177b tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-903047120", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "6aa6b610-1579-43cb-a813-45f19c25b7b5"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:02:59.816904 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-da4862c9-ebce-4c41-adb3-a58f8165fbcf tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:02:59.831921 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-da4862c9-ebce-4c41-adb3-a58f8165fbcf tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80" status: 200 len: 1502 microversion: 2.1 time: 0.489527 Jun 20 12:02:59.845086 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 705/1445] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:02:59 2022] GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 => generated 1502 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:02:59.862060 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0c218d00-f797-4f08-b8ec-2d1dd4dc729d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:59.868750 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0c218d00-f797-4f08-b8ec-2d1dd4dc729d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:02:59.894250 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c218d00-f797-4f08-b8ec-2d1dd4dc729d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:59.895807 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c218d00-f797-4f08-b8ec-2d1dd4dc729d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:59.901538 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c218d00-f797-4f08-b8ec-2d1dd4dc729d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:02:59.902605 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c218d00-f797-4f08-b8ec-2d1dd4dc729d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:02:59.914630 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-c0b40cc5-ac1a-4dc2-8c06-62ce6a83177b tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] validate_networks() for [('6aa6b610-1579-43cb-a813-45f19c25b7b5', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:02:59.971952 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0c218d00-f797-4f08-b8ec-2d1dd4dc729d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.125139 Jun 20 12:02:59.988118 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 706/1446] 10.222.0.27 () {60 vars in 1342 bytes} [Mon Jun 20 12:02:59 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:02:59.993473 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8e0622f9-c8bb-4e1f-8eed-d5de02e063fb tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:02:59.997983 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8e0622f9-c8bb-4e1f-8eed-d5de02e063fb tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: f678dc35-c774-4c0a-9ebb-579688adecb0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:00.012054 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e0622f9-c8bb-4e1f-8eed-d5de02e063fb tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:00.013175 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e0622f9-c8bb-4e1f-8eed-d5de02e063fb tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:00.014154 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e0622f9-c8bb-4e1f-8eed-d5de02e063fb tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:00.018510 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e0622f9-c8bb-4e1f-8eed-d5de02e063fb tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:00.062395 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-8e0622f9-c8bb-4e1f-8eed-d5de02e063fb tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] HTTP exception thrown: Instance f678dc35-c774-4c0a-9ebb-579688adecb0 could not be found. Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8e0622f9-c8bb-4e1f-8eed-d5de02e063fb tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Request method failure captured: Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0/os-volume_attachments HTTP/1.1 Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGGM0_Rgon_QXChHIK_Ikyu0N9hux8u1Ms08jFhXlxkRDQgHGZCrxeBLJGVow3P3B7-C_d1lwOFEoVq18fpBt5bYVFsDOyFchFBnf15eYmBoM5W3iquFzY2ZI2UJK0DkPKTj0Fv6tDqgY5whthvLS8glHLsBu0Y3_K5TIG0-QwQVU5w Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 3495d9dc8b714809b2f3f777cbabda29 Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: exception: Instance f678dc35-c774-4c0a-9ebb-579688adecb0 could not be found. Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: action_args: {'server_id': 'f678dc35-c774-4c0a-9ebb-579688adecb0'} Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f678dc35-c774-4c0a-9ebb-579688adecb0 could not be found. Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:03:00.065100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:03:00.070059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f678dc35-c774-4c0a-9ebb-579688adecb0 could not be found. Jun 20 12:03:00.070059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:03:00.070059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:03:00.070059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:03:00.070059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:03:00.070059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:03:00.070059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:03:00.070059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:03:00.070059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:03:00.070059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f678dc35-c774-4c0a-9ebb-579688adecb0 could not be found. Jun 20 12:03:00.070059 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:03:00.071812 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8e0622f9-c8bb-4e1f-8eed-d5de02e063fb tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Returning 404 to user: Instance f678dc35-c774-4c0a-9ebb-579688adecb0 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:03:00.072904 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8e0622f9-c8bb-4e1f-8eed-d5de02e063fb tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.083712 Jun 20 12:03:00.077150 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 707/1447] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:02:59 2022] GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0/os-volume_attachments => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:03:00.393626 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5ecb0958-dc27-4ea2-8641-10ccc6763c82 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:00.394162 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5ecb0958-dc27-4ea2-8641-10ccc6763c82 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:00.404583 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5ecb0958-dc27-4ea2-8641-10ccc6763c82 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:00.405040 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5ecb0958-dc27-4ea2-8641-10ccc6763c82 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:00.409029 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5ecb0958-dc27-4ea2-8641-10ccc6763c82 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:00.409549 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5ecb0958-dc27-4ea2-8641-10ccc6763c82 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:01.545288 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=8 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:01.609130 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5ecb0958-dc27-4ea2-8641-10ccc6763c82 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:01.642309 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5ecb0958-dc27-4ea2-8641-10ccc6763c82 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:01.643958 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5ecb0958-dc27-4ea2-8641-10ccc6763c82 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:01.655762 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5ecb0958-dc27-4ea2-8641-10ccc6763c82 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1879 microversion: 2.42 time: 1.266237 Jun 20 12:03:01.672240 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 708/1448] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:03:00 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1879 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:03:01.684028 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f7a6c230-9eea-42f2-bdb9-394aea5af1ae tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1435524606", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "25724adf-e301-4183-8c20-574ec029a516"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:03:01.812023 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-f7a6c230-9eea-42f2-bdb9-394aea5af1ae tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] validate_networks() for [('25724adf-e301-4183-8c20-574ec029a516', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:03:01.937181 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-c0b40cc5-ac1a-4dc2-8c06-62ce6a83177b tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:03:01.938156 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-c0b40cc5-ac1a-4dc2-8c06-62ce6a83177b tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:03:01.938668 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-c0b40cc5-ac1a-4dc2-8c06-62ce6a83177b tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:03:01.939087 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-c0b40cc5-ac1a-4dc2-8c06-62ce6a83177b tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:03:01.939512 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-c0b40cc5-ac1a-4dc2-8c06-62ce6a83177b tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:03:01.960054 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c0b40cc5-ac1a-4dc2-8c06-62ce6a83177b tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:01.960632 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c0b40cc5-ac1a-4dc2-8c06-62ce6a83177b tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:01.962628 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c0b40cc5-ac1a-4dc2-8c06-62ce6a83177b tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:01.963146 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c0b40cc5-ac1a-4dc2-8c06-62ce6a83177b tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:02.001602 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-c0b40cc5-ac1a-4dc2-8c06-62ce6a83177b tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Getting quotas for project 66b95313b30841b7bd2616ddf6baa4bc. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:03:02.015653 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-c0b40cc5-ac1a-4dc2-8c06-62ce6a83177b tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Getting quotas for user 0700362f578248e5a1a60be519daf5a2 and project 66b95313b30841b7bd2616ddf6baa4bc. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:03:02.037174 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c0b40cc5-ac1a-4dc2-8c06-62ce6a83177b tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:03:02.040086 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c0b40cc5-ac1a-4dc2-8c06-62ce6a83177b tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] [instance: ad7eb6c8-eba3-4dfc-92d6-d09bf5280668] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:03:02.131803 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c0b40cc5-ac1a-4dc2-8c06-62ce6a83177b tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.623564 Jun 20 12:03:02.133462 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 741/1449] 10.222.0.27 () {62 vars in 1187 bytes} [Mon Jun 20 12:02:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2626 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 20 12:03:02.156992 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-32eb011c-62ef-442a-be2e-b2101fb9688d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:02.157998 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-32eb011c-62ef-442a-be2e-b2101fb9688d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:02.165511 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-32eb011c-62ef-442a-be2e-b2101fb9688d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:02.166320 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-32eb011c-62ef-442a-be2e-b2101fb9688d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:02.167332 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-32eb011c-62ef-442a-be2e-b2101fb9688d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:02.167991 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-32eb011c-62ef-442a-be2e-b2101fb9688d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:02.588380 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-32eb011c-62ef-442a-be2e-b2101fb9688d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:02.600580 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-32eb011c-62ef-442a-be2e-b2101fb9688d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80" status: 200 len: 1502 microversion: 2.1 time: 0.453577 Jun 20 12:03:02.611784 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 742/1450] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:02 2022] GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 => generated 1502 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:02.620869 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-c57198e3-6800-4589-ae38-42d0f11ed0c7 req-347b75be-9bae-4a7a-ac30-b321197f7154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f59e801d-2548-4edc-8283-af47c991d92a", "name": "network-vif-plugged", "status": "completed", "tag": "60eddb1c-4042-4f66-9e7b-bb3e6459de20"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:03:02.646062 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-c57198e3-6800-4589-ae38-42d0f11ed0c7 req-347b75be-9bae-4a7a-ac30-b321197f7154 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:02.646781 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-c57198e3-6800-4589-ae38-42d0f11ed0c7 req-347b75be-9bae-4a7a-ac30-b321197f7154 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:02.675985 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-c57198e3-6800-4589-ae38-42d0f11ed0c7 req-347b75be-9bae-4a7a-ac30-b321197f7154 service nova] Creating event network-vif-plugged:60eddb1c-4042-4f66-9e7b-bb3e6459de20 for instance f59e801d-2548-4edc-8283-af47c991d92a on n-h2-master-1 Jun 20 12:03:02.688778 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-c57198e3-6800-4589-ae38-42d0f11ed0c7 req-347b75be-9bae-4a7a-ac30-b321197f7154 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075246 Jun 20 12:03:02.691818 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 743/1451] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:03:02.721968 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-13ab3c92-5a6a-43eb-8ea3-e4f20d878084 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:02.723635 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-13ab3c92-5a6a-43eb-8ea3-e4f20d878084 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:02.740331 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-13ab3c92-5a6a-43eb-8ea3-e4f20d878084 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:02.741209 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-13ab3c92-5a6a-43eb-8ea3-e4f20d878084 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:02.750190 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-13ab3c92-5a6a-43eb-8ea3-e4f20d878084 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:02.750965 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-13ab3c92-5a6a-43eb-8ea3-e4f20d878084 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:02.808721 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-13ab3c92-5a6a-43eb-8ea3-e4f20d878084 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.112378 Jun 20 12:03:02.809654 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 744/1452] 10.222.0.27 () {60 vars in 1342 bytes} [Mon Jun 20 12:03:02 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:03:02.815017 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-945401e2-1395-4507-8ccf-0d7414e75908 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:02.815643 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-945401e2-1395-4507-8ccf-0d7414e75908 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] [instance: ad7eb6c8-eba3-4dfc-92d6-d09bf5280668] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:03.021877 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-945401e2-1395-4507-8ccf-0d7414e75908 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0700362f578248e5a1a60be519daf5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b95313b30841b7bd2616ddf6baa4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:03.033454 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-945401e2-1395-4507-8ccf-0d7414e75908 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0700362f578248e5a1a60be519daf5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b95313b30841b7bd2616ddf6baa4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:03.044544 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-945401e2-1395-4507-8ccf-0d7414e75908 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0700362f578248e5a1a60be519daf5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b95313b30841b7bd2616ddf6baa4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:03.046298 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-945401e2-1395-4507-8ccf-0d7414e75908 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] 10.222.0.27 "GET /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668" status: 200 len: 1261 microversion: 2.26 time: 0.235213 Jun 20 12:03:03.046911 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 745/1453] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:03:02 2022] GET /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668 => generated 1261 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:03:03.067935 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1f5d8a59-96de-4a86-80c9-b7eb49702402 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:03.069020 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1f5d8a59-96de-4a86-80c9-b7eb49702402 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:03.107703 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f5d8a59-96de-4a86-80c9-b7eb49702402 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:03.108186 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f5d8a59-96de-4a86-80c9-b7eb49702402 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:03.109289 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f5d8a59-96de-4a86-80c9-b7eb49702402 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:03.112026 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f5d8a59-96de-4a86-80c9-b7eb49702402 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:04.231690 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1f5d8a59-96de-4a86-80c9-b7eb49702402 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:04.262232 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1f5d8a59-96de-4a86-80c9-b7eb49702402 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:04.268371 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1f5d8a59-96de-4a86-80c9-b7eb49702402 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:04.275940 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1f5d8a59-96de-4a86-80c9-b7eb49702402 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1879 microversion: 2.42 time: 1.227899 Jun 20 12:03:04.281253 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 746/1454] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:03:03 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1879 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:03:04.297046 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-309efb73-fe58-40e9-8b46-bd15ca49c866 req-fb363fd2-0975-44ca-89f2-7b2e4f317092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49a35510-1821-49de-8e39-d45901095c80", "name": "network-vif-unplugged", "status": "completed", "tag": "bab393cc-844a-468b-9b51-51cf37ed5c0a"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:03:04.342480 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-309efb73-fe58-40e9-8b46-bd15ca49c866 req-fb363fd2-0975-44ca-89f2-7b2e4f317092 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:04.343450 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-309efb73-fe58-40e9-8b46-bd15ca49c866 req-fb363fd2-0975-44ca-89f2-7b2e4f317092 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:04.375589 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-309efb73-fe58-40e9-8b46-bd15ca49c866 req-fb363fd2-0975-44ca-89f2-7b2e4f317092 service nova] Creating event network-vif-unplugged:bab393cc-844a-468b-9b51-51cf37ed5c0a for instance 49a35510-1821-49de-8e39-d45901095c80 on n-h2-master-1 Jun 20 12:03:04.385205 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-309efb73-fe58-40e9-8b46-bd15ca49c866 req-fb363fd2-0975-44ca-89f2-7b2e4f317092 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100569 Jun 20 12:03:04.392957 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 747/1455] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:03:04.401906 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b2dcd9ec-3305-46ba-be9a-742d3c54387e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:04.413116 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b2dcd9ec-3305-46ba-be9a-742d3c54387e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:04.427666 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b2dcd9ec-3305-46ba-be9a-742d3c54387e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:04.430909 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b2dcd9ec-3305-46ba-be9a-742d3c54387e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:04.432865 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b2dcd9ec-3305-46ba-be9a-742d3c54387e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:04.433725 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b2dcd9ec-3305-46ba-be9a-742d3c54387e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:04.944019 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b2dcd9ec-3305-46ba-be9a-742d3c54387e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:04.955286 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b2dcd9ec-3305-46ba-be9a-742d3c54387e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80" status: 200 len: 1502 microversion: 2.1 time: 0.560728 Jun 20 12:03:04.971016 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 748/1456] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:04 2022] GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 => generated 1502 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:04.977420 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5bc85b25-9362-4284-94a6-69bdbde263c5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:04.984113 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5bc85b25-9362-4284-94a6-69bdbde263c5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:05.013583 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5bc85b25-9362-4284-94a6-69bdbde263c5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:05.024285 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5bc85b25-9362-4284-94a6-69bdbde263c5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:05.027196 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5bc85b25-9362-4284-94a6-69bdbde263c5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:05.028761 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5bc85b25-9362-4284-94a6-69bdbde263c5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:05.111918 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5bc85b25-9362-4284-94a6-69bdbde263c5 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.138855 Jun 20 12:03:05.113251 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 749/1457] 10.222.0.27 () {60 vars in 1342 bytes} [Mon Jun 20 12:03:04 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:03:05.118384 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-33a9702c-db79-446b-97f0-927af7d5a8ed tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:05.123340 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-33a9702c-db79-446b-97f0-927af7d5a8ed tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] [instance: ad7eb6c8-eba3-4dfc-92d6-d09bf5280668] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:05.134817 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-33a9702c-db79-446b-97f0-927af7d5a8ed tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:05.141751 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-33a9702c-db79-446b-97f0-927af7d5a8ed tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:05.142935 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-33a9702c-db79-446b-97f0-927af7d5a8ed tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:05.144870 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-33a9702c-db79-446b-97f0-927af7d5a8ed tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:05.708568 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-33a9702c-db79-446b-97f0-927af7d5a8ed tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0700362f578248e5a1a60be519daf5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b95313b30841b7bd2616ddf6baa4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:05.731060 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-33a9702c-db79-446b-97f0-927af7d5a8ed tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0700362f578248e5a1a60be519daf5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b95313b30841b7bd2616ddf6baa4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:05.733493 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-33a9702c-db79-446b-97f0-927af7d5a8ed tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0700362f578248e5a1a60be519daf5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b95313b30841b7bd2616ddf6baa4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:05.737603 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-33a9702c-db79-446b-97f0-927af7d5a8ed tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] 10.222.0.27 "GET /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668" status: 200 len: 1361 microversion: 2.26 time: 0.622969 Jun 20 12:03:05.741829 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 750/1458] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:03:05 2022] GET /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668 => generated 1361 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:03:05.750521 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-d3511a45-d66b-4555-a7fe-120255d13302 req-1f4fd4ec-51b1-4071-904a-f745fb1e2532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f59e801d-2548-4edc-8283-af47c991d92a", "name": "network-vif-plugged", "status": "completed", "tag": "b010dc80-2c35-44a9-a8d1-6aa254f13aa2"}, {"server_uuid": "f59e801d-2548-4edc-8283-af47c991d92a", "name": "network-vif-plugged", "status": "completed", "tag": "24d1960a-4d01-49b2-80a0-84252c3d23d4"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:03:05.779593 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-d3511a45-d66b-4555-a7fe-120255d13302 req-1f4fd4ec-51b1-4071-904a-f745fb1e2532 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:05.780983 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-d3511a45-d66b-4555-a7fe-120255d13302 req-1f4fd4ec-51b1-4071-904a-f745fb1e2532 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:05.811158 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-d3511a45-d66b-4555-a7fe-120255d13302 req-1f4fd4ec-51b1-4071-904a-f745fb1e2532 service nova] Creating event network-vif-plugged:b010dc80-2c35-44a9-a8d1-6aa254f13aa2 for instance f59e801d-2548-4edc-8283-af47c991d92a on n-h2-master-1 Jun 20 12:03:05.813529 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-d3511a45-d66b-4555-a7fe-120255d13302 req-1f4fd4ec-51b1-4071-904a-f745fb1e2532 service nova] Creating event network-vif-plugged:24d1960a-4d01-49b2-80a0-84252c3d23d4 for instance f59e801d-2548-4edc-8283-af47c991d92a on n-h2-master-1 Jun 20 12:03:05.830329 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-d3511a45-d66b-4555-a7fe-120255d13302 req-1f4fd4ec-51b1-4071-904a-f745fb1e2532 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.086684 Jun 20 12:03:05.831342 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 751/1459] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:03:05.836635 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2102c651-7214-4c50-9451-d21e1fcf4a7a tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:05.841721 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2102c651-7214-4c50-9451-d21e1fcf4a7a tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:05.870154 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2102c651-7214-4c50-9451-d21e1fcf4a7a tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:05.870611 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2102c651-7214-4c50-9451-d21e1fcf4a7a tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:05.871408 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2102c651-7214-4c50-9451-d21e1fcf4a7a tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:05.871840 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2102c651-7214-4c50-9451-d21e1fcf4a7a tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:06.009103 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-f7a6c230-9eea-42f2-bdb9-394aea5af1ae tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:03:06.009103 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-f7a6c230-9eea-42f2-bdb9-394aea5af1ae tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:03:06.009103 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-f7a6c230-9eea-42f2-bdb9-394aea5af1ae tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:03:06.009103 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-f7a6c230-9eea-42f2-bdb9-394aea5af1ae tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:03:06.009911 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-f7a6c230-9eea-42f2-bdb9-394aea5af1ae tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:03:06.028143 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7a6c230-9eea-42f2-bdb9-394aea5af1ae tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:06.028765 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7a6c230-9eea-42f2-bdb9-394aea5af1ae tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:06.032061 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7a6c230-9eea-42f2-bdb9-394aea5af1ae tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:06.032954 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7a6c230-9eea-42f2-bdb9-394aea5af1ae tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:06.076066 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-f7a6c230-9eea-42f2-bdb9-394aea5af1ae tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Getting quotas for project 7dbe3d6c4b7a41fa8181a805a992c173. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:03:06.085165 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-f7a6c230-9eea-42f2-bdb9-394aea5af1ae tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Getting quotas for user 3495d9dc8b714809b2f3f777cbabda29 and project 7dbe3d6c4b7a41fa8181a805a992c173. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:03:06.104255 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f7a6c230-9eea-42f2-bdb9-394aea5af1ae tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:03:06.107217 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f7a6c230-9eea-42f2-bdb9-394aea5af1ae tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: e630e2d9-52e2-4127-b6b5-9716df8f9a9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:03:06.196905 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f7a6c230-9eea-42f2-bdb9-394aea5af1ae tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.532503 Jun 20 12:03:06.197847 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 709/1460] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:03:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 4535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:03:06.207944 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8d9132d3-afd0-47a0-81e5-ec0439c71926 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:06.208993 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8d9132d3-afd0-47a0-81e5-ec0439c71926 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:06.217667 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8d9132d3-afd0-47a0-81e5-ec0439c71926 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:06.218402 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8d9132d3-afd0-47a0-81e5-ec0439c71926 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:06.219420 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8d9132d3-afd0-47a0-81e5-ec0439c71926 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:06.220417 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8d9132d3-afd0-47a0-81e5-ec0439c71926 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:06.473333 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8d9132d3-afd0-47a0-81e5-ec0439c71926 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:06.482989 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8d9132d3-afd0-47a0-81e5-ec0439c71926 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80" status: 200 len: 1502 microversion: 2.1 time: 0.282605 Jun 20 12:03:06.495003 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 710/1461] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:06 2022] GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 => generated 1502 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:06.501907 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-956281cc-41cb-4d2d-b679-5949155a3fed tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:06.503996 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-956281cc-41cb-4d2d-b679-5949155a3fed tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:06.512181 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-956281cc-41cb-4d2d-b679-5949155a3fed tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:06.512411 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2102c651-7214-4c50-9451-d21e1fcf4a7a tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:06.513216 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-956281cc-41cb-4d2d-b679-5949155a3fed tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:06.514246 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-956281cc-41cb-4d2d-b679-5949155a3fed tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:06.515916 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-956281cc-41cb-4d2d-b679-5949155a3fed tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:06.529700 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2102c651-7214-4c50-9451-d21e1fcf4a7a tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:06.532011 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2102c651-7214-4c50-9451-d21e1fcf4a7a tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:06.543049 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2102c651-7214-4c50-9451-d21e1fcf4a7a tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1879 microversion: 2.42 time: 0.701001 Jun 20 12:03:06.544549 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 752/1462] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:03:05 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1879 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:03:06.556483 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-338ce337-eb51-4742-9a9e-4f7d4174b508 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:06.558340 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-338ce337-eb51-4742-9a9e-4f7d4174b508 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: e630e2d9-52e2-4127-b6b5-9716df8f9a9c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:06.592991 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-956281cc-41cb-4d2d-b679-5949155a3fed tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.096286 Jun 20 12:03:06.595416 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 711/1463] 10.222.0.27 () {60 vars in 1342 bytes} [Mon Jun 20 12:03:06 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:03:06.607353 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-fc78c097-99d6-4b1d-9b55-4973d2d7785d req-d0e4befc-ef29-4391-a2f7-1daa8643b91c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49a35510-1821-49de-8e39-d45901095c80", "tag": "bab393cc-844a-468b-9b51-51cf37ed5c0a"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:03:06.628128 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-fc78c097-99d6-4b1d-9b55-4973d2d7785d req-d0e4befc-ef29-4391-a2f7-1daa8643b91c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:06.629411 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-fc78c097-99d6-4b1d-9b55-4973d2d7785d req-d0e4befc-ef29-4391-a2f7-1daa8643b91c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:06.662880 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-fc78c097-99d6-4b1d-9b55-4973d2d7785d req-d0e4befc-ef29-4391-a2f7-1daa8643b91c service nova] Creating event network-changed:bab393cc-844a-468b-9b51-51cf37ed5c0a for instance 49a35510-1821-49de-8e39-d45901095c80 on n-h2-master-1 Jun 20 12:03:06.675383 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-fc78c097-99d6-4b1d-9b55-4973d2d7785d req-d0e4befc-ef29-4391-a2f7-1daa8643b91c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077585 Jun 20 12:03:06.676469 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 712/1464] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:03:06.730294 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-338ce337-eb51-4742-9a9e-4f7d4174b508 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:06.738872 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-338ce337-eb51-4742-9a9e-4f7d4174b508 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/e630e2d9-52e2-4127-b6b5-9716df8f9a9c" status: 200 len: 1215 microversion: 2.1 time: 0.192070 Jun 20 12:03:06.756479 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-55b866f3-a1ec-4967-b8a4-1a2ad1e43e69 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:06.757094 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-55b866f3-a1ec-4967-b8a4-1a2ad1e43e69 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: e630e2d9-52e2-4127-b6b5-9716df8f9a9c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:06.760518 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 753/1465] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:06 2022] GET /compute/v2.1/servers/e630e2d9-52e2-4127-b6b5-9716df8f9a9c => generated 1215 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:06.766026 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2f9e5510-d9cc-453a-b82d-62ad4c8c3562 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:06.766648 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2f9e5510-d9cc-453a-b82d-62ad4c8c3562 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] [instance: ad7eb6c8-eba3-4dfc-92d6-d09bf5280668] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:06.792182 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-55b866f3-a1ec-4967-b8a4-1a2ad1e43e69 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: e630e2d9-52e2-4127-b6b5-9716df8f9a9c] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:03:06.793919 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2f9e5510-d9cc-453a-b82d-62ad4c8c3562 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:06.794796 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2f9e5510-d9cc-453a-b82d-62ad4c8c3562 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:06.796394 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2f9e5510-d9cc-453a-b82d-62ad4c8c3562 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:06.797355 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2f9e5510-d9cc-453a-b82d-62ad4c8c3562 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:07.389576 n-d-master-1 devstack@n-api.service[119128]: INFO nova.scheduler.client.report [None req-55b866f3-a1ec-4967-b8a4-1a2ad1e43e69 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Deleted allocations for instance e630e2d9-52e2-4127-b6b5-9716df8f9a9c Jun 20 12:03:07.423442 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2f9e5510-d9cc-453a-b82d-62ad4c8c3562 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0700362f578248e5a1a60be519daf5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b95313b30841b7bd2616ddf6baa4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:07.423571 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-55b866f3-a1ec-4967-b8a4-1a2ad1e43e69 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e630e2d9-52e2-4127-b6b5-9716df8f9a9c" status: 204 len: 0 microversion: 2.1 time: 0.671662 Jun 20 12:03:07.426999 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 713/1466] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:03:06 2022] DELETE /compute/v2.1/servers/e630e2d9-52e2-4127-b6b5-9716df8f9a9c => generated 0 bytes in 674 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:07.431452 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:07.436768 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-69b271e7-951d-4331-99e2-f6d81966c08d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:07.438101 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-69b271e7-951d-4331-99e2-f6d81966c08d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: e630e2d9-52e2-4127-b6b5-9716df8f9a9c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:07.451976 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2f9e5510-d9cc-453a-b82d-62ad4c8c3562 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0700362f578248e5a1a60be519daf5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b95313b30841b7bd2616ddf6baa4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:07.452439 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-69b271e7-951d-4331-99e2-f6d81966c08d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:07.453090 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-69b271e7-951d-4331-99e2-f6d81966c08d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:07.454285 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-69b271e7-951d-4331-99e2-f6d81966c08d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:07.454913 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-69b271e7-951d-4331-99e2-f6d81966c08d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:07.457021 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2f9e5510-d9cc-453a-b82d-62ad4c8c3562 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0700362f578248e5a1a60be519daf5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b95313b30841b7bd2616ddf6baa4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:07.458249 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2f9e5510-d9cc-453a-b82d-62ad4c8c3562 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] 10.222.0.27 "GET /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668" status: 200 len: 1361 microversion: 2.26 time: 0.696599 Jun 20 12:03:07.473220 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 754/1467] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:03:06 2022] GET /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668 => generated 1361 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:03:07.484830 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-69b271e7-951d-4331-99e2-f6d81966c08d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] HTTP exception thrown: Instance e630e2d9-52e2-4127-b6b5-9716df8f9a9c could not be found. Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-69b271e7-951d-4331-99e2-f6d81966c08d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Request method failure captured: Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/e630e2d9-52e2-4127-b6b5-9716df8f9a9c HTTP/1.1 Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGGM0_Rgon_QXChHIK_Ikyu0N9hux8u1Ms08jFhXlxkRDQgHGZCrxeBLJGVow3P3B7-C_d1lwOFEoVq18fpBt5bYVFsDOyFchFBnf15eYmBoM5W3iquFzY2ZI2UJK0DkPKTj0Fv6tDqgY5whthvLS8glHLsBu0Y3_K5TIG0-QwQVU5w Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 3495d9dc8b714809b2f3f777cbabda29 Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: exception: Instance e630e2d9-52e2-4127-b6b5-9716df8f9a9c could not be found. Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'e630e2d9-52e2-4127-b6b5-9716df8f9a9c'} Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e630e2d9-52e2-4127-b6b5-9716df8f9a9c could not be found. Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e630e2d9-52e2-4127-b6b5-9716df8f9a9c could not be found. Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:03:07.488139 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:03:07.493540 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:03:07.493540 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:03:07.493540 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:03:07.493540 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:03:07.493540 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:03:07.493540 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e630e2d9-52e2-4127-b6b5-9716df8f9a9c could not be found. Jun 20 12:03:07.493540 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:03:07.493540 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-69b271e7-951d-4331-99e2-f6d81966c08d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Returning 404 to user: Instance e630e2d9-52e2-4127-b6b5-9716df8f9a9c could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:03:07.493540 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-69b271e7-951d-4331-99e2-f6d81966c08d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/e630e2d9-52e2-4127-b6b5-9716df8f9a9c" status: 404 len: 111 microversion: 2.1 time: 0.061683 Jun 20 12:03:07.502552 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dd4026f6-e8b9-49aa-b918-bc0223a56319 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:07.503663 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dd4026f6-e8b9-49aa-b918-bc0223a56319 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:07.523498 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 714/1468] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:07 2022] GET /compute/v2.1/servers/e630e2d9-52e2-4127-b6b5-9716df8f9a9c => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:03:07.533163 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd4026f6-e8b9-49aa-b918-bc0223a56319 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:07.534345 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd4026f6-e8b9-49aa-b918-bc0223a56319 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:07.535351 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd4026f6-e8b9-49aa-b918-bc0223a56319 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:07.536282 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd4026f6-e8b9-49aa-b918-bc0223a56319 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:07.563903 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bc679cb7-0a1d-4409-bebc-c764e58e2878 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:07.564980 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bc679cb7-0a1d-4409-bebc-c764e58e2878 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:07.575470 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bc679cb7-0a1d-4409-bebc-c764e58e2878 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:07.577800 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bc679cb7-0a1d-4409-bebc-c764e58e2878 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:07.578845 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bc679cb7-0a1d-4409-bebc-c764e58e2878 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:07.582379 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bc679cb7-0a1d-4409-bebc-c764e58e2878 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:08.248177 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dd4026f6-e8b9-49aa-b918-bc0223a56319 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:08.262526 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dd4026f6-e8b9-49aa-b918-bc0223a56319 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80" status: 200 len: 1502 microversion: 2.1 time: 0.765192 Jun 20 12:03:08.271096 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 755/1469] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:07 2022] GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 => generated 1502 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:08.279628 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8cf878bf-c6ec-4953-a91c-cc64f7c3dfda tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-371919152", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "25724adf-e301-4183-8c20-574ec029a516"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:03:08.409274 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-8cf878bf-c6ec-4953-a91c-cc64f7c3dfda tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] validate_networks() for [('25724adf-e301-4183-8c20-574ec029a516', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:03:09.028112 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-8cf878bf-c6ec-4953-a91c-cc64f7c3dfda tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:03:09.028766 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-8cf878bf-c6ec-4953-a91c-cc64f7c3dfda tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:03:09.029344 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-8cf878bf-c6ec-4953-a91c-cc64f7c3dfda tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:03:09.029913 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-8cf878bf-c6ec-4953-a91c-cc64f7c3dfda tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:03:09.030414 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-8cf878bf-c6ec-4953-a91c-cc64f7c3dfda tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:03:09.043780 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8cf878bf-c6ec-4953-a91c-cc64f7c3dfda tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:09.044954 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8cf878bf-c6ec-4953-a91c-cc64f7c3dfda tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:09.046082 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8cf878bf-c6ec-4953-a91c-cc64f7c3dfda tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:09.046779 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8cf878bf-c6ec-4953-a91c-cc64f7c3dfda tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:09.085897 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:09.086504 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-bc679cb7-0a1d-4409-bebc-c764e58e2878 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:09.095417 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-8cf878bf-c6ec-4953-a91c-cc64f7c3dfda tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Getting quotas for project 7dbe3d6c4b7a41fa8181a805a992c173. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:03:09.105807 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-bc679cb7-0a1d-4409-bebc-c764e58e2878 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:09.107198 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-bc679cb7-0a1d-4409-bebc-c764e58e2878 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:09.111109 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bc679cb7-0a1d-4409-bebc-c764e58e2878 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1879 microversion: 2.42 time: 1.549270 Jun 20 12:03:09.114842 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 715/1470] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:03:07 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1879 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:03:09.120253 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-8cf878bf-c6ec-4953-a91c-cc64f7c3dfda tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Getting quotas for user 3495d9dc8b714809b2f3f777cbabda29 and project 7dbe3d6c4b7a41fa8181a805a992c173. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:03:09.129357 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2b28feca-2c69-4bd8-a2ab-625cb3f9b4c6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:09.133145 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2b28feca-2c69-4bd8-a2ab-625cb3f9b4c6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:09.147685 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2b28feca-2c69-4bd8-a2ab-625cb3f9b4c6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:09.150280 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2b28feca-2c69-4bd8-a2ab-625cb3f9b4c6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:09.152835 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2b28feca-2c69-4bd8-a2ab-625cb3f9b4c6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:09.155845 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2b28feca-2c69-4bd8-a2ab-625cb3f9b4c6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:09.166645 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8cf878bf-c6ec-4953-a91c-cc64f7c3dfda tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:03:09.176808 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8cf878bf-c6ec-4953-a91c-cc64f7c3dfda tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 7cff5b7f-6801-45ae-b6bd-5e062ce73b18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:03:09.250058 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2b28feca-2c69-4bd8-a2ab-625cb3f9b4c6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.132766 Jun 20 12:03:09.257118 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 716/1471] 10.222.0.27 () {60 vars in 1342 bytes} [Mon Jun 20 12:03:09 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:03:09.271016 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-1fc386f4-67eb-47ff-9720-0592a4f63c37 req-0a40fd65-258d-4927-916e-57d4f397db4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f59e801d-2548-4edc-8283-af47c991d92a", "name": "network-vif-plugged", "status": "completed", "tag": "47ca3986-e119-41f2-8d32-b4933a808468"}, {"server_uuid": "f59e801d-2548-4edc-8283-af47c991d92a", "name": "network-vif-plugged", "status": "completed", "tag": "094c45ad-d8c1-4802-908a-41730c77c870"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:03:09.279662 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8cf878bf-c6ec-4953-a91c-cc64f7c3dfda tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.006751 Jun 20 12:03:09.288446 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 756/1472] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:03:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:03:09.288730 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-1fc386f4-67eb-47ff-9720-0592a4f63c37 req-0a40fd65-258d-4927-916e-57d4f397db4b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:09.292265 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-1fc386f4-67eb-47ff-9720-0592a4f63c37 req-0a40fd65-258d-4927-916e-57d4f397db4b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:09.313045 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-406fc31a-199d-4514-9d34-363d6a13b04e tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:09.315387 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-406fc31a-199d-4514-9d34-363d6a13b04e tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] [instance: ad7eb6c8-eba3-4dfc-92d6-d09bf5280668] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:09.321227 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-1fc386f4-67eb-47ff-9720-0592a4f63c37 req-0a40fd65-258d-4927-916e-57d4f397db4b service nova] Creating event network-vif-plugged:47ca3986-e119-41f2-8d32-b4933a808468 for instance f59e801d-2548-4edc-8283-af47c991d92a on n-h2-master-1 Jun 20 12:03:09.321754 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-1fc386f4-67eb-47ff-9720-0592a4f63c37 req-0a40fd65-258d-4927-916e-57d4f397db4b service nova] Creating event network-vif-plugged:094c45ad-d8c1-4802-908a-41730c77c870 for instance f59e801d-2548-4edc-8283-af47c991d92a on n-h2-master-1 Jun 20 12:03:09.327731 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-406fc31a-199d-4514-9d34-363d6a13b04e tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:09.328739 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-406fc31a-199d-4514-9d34-363d6a13b04e tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:09.329844 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-406fc31a-199d-4514-9d34-363d6a13b04e tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:09.330525 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-406fc31a-199d-4514-9d34-363d6a13b04e tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:09.335383 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-1fc386f4-67eb-47ff-9720-0592a4f63c37 req-0a40fd65-258d-4927-916e-57d4f397db4b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.076862 Jun 20 12:03:09.336367 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 717/1473] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:03:09.341726 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-7661f3dd-fbcb-46a4-91c9-3f0bcdbf8100 req-bb7efa97-c351-4795-b9a7-d731afac31f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad7eb6c8-eba3-4dfc-92d6-d09bf5280668", "tag": "065c8200-3fb1-4b3f-8885-c13738ca5b23"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:03:09.375917 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-7661f3dd-fbcb-46a4-91c9-3f0bcdbf8100 req-bb7efa97-c351-4795-b9a7-d731afac31f1 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:09.376725 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-7661f3dd-fbcb-46a4-91c9-3f0bcdbf8100 req-bb7efa97-c351-4795-b9a7-d731afac31f1 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:09.401283 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-7661f3dd-fbcb-46a4-91c9-3f0bcdbf8100 req-bb7efa97-c351-4795-b9a7-d731afac31f1 service nova] Creating event network-changed:065c8200-3fb1-4b3f-8885-c13738ca5b23 for instance ad7eb6c8-eba3-4dfc-92d6-d09bf5280668 on n-h1-master-1 Jun 20 12:03:09.411505 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-7661f3dd-fbcb-46a4-91c9-3f0bcdbf8100 req-bb7efa97-c351-4795-b9a7-d731afac31f1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073513 Jun 20 12:03:09.415574 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 718/1474] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:03:09.429857 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ee2cc863-70cb-4761-8a9b-274507818ea7 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:09.433875 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ee2cc863-70cb-4761-8a9b-274507818ea7 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:09.451589 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ee2cc863-70cb-4761-8a9b-274507818ea7 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:09.453167 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ee2cc863-70cb-4761-8a9b-274507818ea7 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:09.456170 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ee2cc863-70cb-4761-8a9b-274507818ea7 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:09.458240 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ee2cc863-70cb-4761-8a9b-274507818ea7 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:09.957098 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ee2cc863-70cb-4761-8a9b-274507818ea7 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:09.971073 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ee2cc863-70cb-4761-8a9b-274507818ea7 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80" status: 200 len: 1502 microversion: 2.1 time: 0.551314 Jun 20 12:03:09.974687 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 719/1475] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:09 2022] GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 => generated 1502 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:09.989947 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-febe780a-7d89-4727-ab2b-a0523012353f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:09.990829 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-febe780a-7d89-4727-ab2b-a0523012353f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 7cff5b7f-6801-45ae-b6bd-5e062ce73b18] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:10.262171 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-febe780a-7d89-4727-ab2b-a0523012353f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:10.270411 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-febe780a-7d89-4727-ab2b-a0523012353f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18" status: 200 len: 1214 microversion: 2.1 time: 0.293984 Jun 20 12:03:10.274606 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 720/1476] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:09 2022] GET /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18 => generated 1214 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:10.302980 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-127dfe9c-2d45-4f0d-b974-5001c6d3de50 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:10.304645 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-127dfe9c-2d45-4f0d-b974-5001c6d3de50 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:10.319119 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-127dfe9c-2d45-4f0d-b974-5001c6d3de50 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:10.319767 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-127dfe9c-2d45-4f0d-b974-5001c6d3de50 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:10.320643 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-127dfe9c-2d45-4f0d-b974-5001c6d3de50 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:10.321118 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-127dfe9c-2d45-4f0d-b974-5001c6d3de50 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:10.604528 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-406fc31a-199d-4514-9d34-363d6a13b04e tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0700362f578248e5a1a60be519daf5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b95313b30841b7bd2616ddf6baa4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:10.620062 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-406fc31a-199d-4514-9d34-363d6a13b04e tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0700362f578248e5a1a60be519daf5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b95313b30841b7bd2616ddf6baa4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:10.632662 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-406fc31a-199d-4514-9d34-363d6a13b04e tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0700362f578248e5a1a60be519daf5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b95313b30841b7bd2616ddf6baa4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:10.634033 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-406fc31a-199d-4514-9d34-363d6a13b04e tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] 10.222.0.27 "GET /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668" status: 200 len: 1361 microversion: 2.26 time: 1.347187 Jun 20 12:03:10.634661 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 757/1477] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:03:09 2022] GET /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668 => generated 1361 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:03:10.640421 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-266f1986-1493-4d61-a971-f3ad64e2ccbb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:10.644512 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-266f1986-1493-4d61-a971-f3ad64e2ccbb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:10.668182 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-266f1986-1493-4d61-a971-f3ad64e2ccbb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:10.668714 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-266f1986-1493-4d61-a971-f3ad64e2ccbb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:10.669516 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-266f1986-1493-4d61-a971-f3ad64e2ccbb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:10.674391 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-266f1986-1493-4d61-a971-f3ad64e2ccbb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:10.743607 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-266f1986-1493-4d61-a971-f3ad64e2ccbb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.107803 Jun 20 12:03:10.744673 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 758/1478] 10.222.0.27 () {60 vars in 1342 bytes} [Mon Jun 20 12:03:10 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed/os-volume_attachments => generated 25 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:10.990131 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5dd91eb7-12d2-4290-9a59-b65171137108 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:10.990852 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5dd91eb7-12d2-4290-9a59-b65171137108 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:11.014503 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5dd91eb7-12d2-4290-9a59-b65171137108 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:11.014959 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5dd91eb7-12d2-4290-9a59-b65171137108 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:11.015788 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5dd91eb7-12d2-4290-9a59-b65171137108 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:11.016319 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5dd91eb7-12d2-4290-9a59-b65171137108 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:11.785424 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5dd91eb7-12d2-4290-9a59-b65171137108 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:11.799224 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5dd91eb7-12d2-4290-9a59-b65171137108 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80" status: 200 len: 1502 microversion: 2.1 time: 0.813361 Jun 20 12:03:11.799832 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 759/1479] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:10 2022] GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 => generated 1502 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:11.822303 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f8c91adf-0dde-46cb-a211-330b583ca2ad tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:11.823283 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f8c91adf-0dde-46cb-a211-330b583ca2ad tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 7cff5b7f-6801-45ae-b6bd-5e062ce73b18] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:11.849107 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f8c91adf-0dde-46cb-a211-330b583ca2ad tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:11.849558 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f8c91adf-0dde-46cb-a211-330b583ca2ad tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:11.855545 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f8c91adf-0dde-46cb-a211-330b583ca2ad tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:11.860012 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f8c91adf-0dde-46cb-a211-330b583ca2ad tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:11.909214 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-127dfe9c-2d45-4f0d-b974-5001c6d3de50 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:11.930934 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-127dfe9c-2d45-4f0d-b974-5001c6d3de50 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:11.937786 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-127dfe9c-2d45-4f0d-b974-5001c6d3de50 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:11.943016 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-127dfe9c-2d45-4f0d-b974-5001c6d3de50 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1879 microversion: 2.42 time: 1.663446 Jun 20 12:03:11.944516 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 721/1480] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:03:10 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1879 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:03:11.960603 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-a40ef136-1f68-428a-ab05-a59c6db2478f req-d90ce306-9d02-4a1a-a810-579dc7e6d706 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f59e801d-2548-4edc-8283-af47c991d92a", "name": "network-vif-plugged", "status": "completed", "tag": "32d33855-eec9-4f47-8a63-741b0283b523"}, {"server_uuid": "f59e801d-2548-4edc-8283-af47c991d92a", "name": "network-vif-plugged", "status": "completed", "tag": "f8436f92-9119-4a95-9ea8-7e547b5c7945"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:03:11.989003 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-a40ef136-1f68-428a-ab05-a59c6db2478f req-d90ce306-9d02-4a1a-a810-579dc7e6d706 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:11.989495 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-a40ef136-1f68-428a-ab05-a59c6db2478f req-d90ce306-9d02-4a1a-a810-579dc7e6d706 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:12.048863 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-a40ef136-1f68-428a-ab05-a59c6db2478f req-d90ce306-9d02-4a1a-a810-579dc7e6d706 service nova] Creating event network-vif-plugged:32d33855-eec9-4f47-8a63-741b0283b523 for instance f59e801d-2548-4edc-8283-af47c991d92a on n-h2-master-1 Jun 20 12:03:12.058255 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-a40ef136-1f68-428a-ab05-a59c6db2478f req-d90ce306-9d02-4a1a-a810-579dc7e6d706 service nova] Creating event network-vif-plugged:f8436f92-9119-4a95-9ea8-7e547b5c7945 for instance f59e801d-2548-4edc-8283-af47c991d92a on n-h2-master-1 Jun 20 12:03:12.075374 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-a40ef136-1f68-428a-ab05-a59c6db2478f req-d90ce306-9d02-4a1a-a810-579dc7e6d706 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.129354 Jun 20 12:03:12.085805 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 722/1481] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:03:12.284470 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-91437a67-2052-4a1f-8b0f-6fda47fc4374 tempest-FloatingIPDetailsTestJSON-271562628 tempest-FloatingIPDetailsTestJSON-271562628-project] Action: 'create', calling method: .version_select at 0x7f607361e040>, body: {"pool": null} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:03:12.648349 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f8c91adf-0dde-46cb-a211-330b583ca2ad tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:12.686771 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f8c91adf-0dde-46cb-a211-330b583ca2ad tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18" status: 200 len: 1272 microversion: 2.1 time: 0.881198 Jun 20 12:03:12.698731 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 760/1482] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:11 2022] GET /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18 => generated 1272 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:12.723673 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-48c4fc67-8a05-4d1d-a0be-2ca3c66213da tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:12.726743 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-48c4fc67-8a05-4d1d-a0be-2ca3c66213da tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] [instance: ad7eb6c8-eba3-4dfc-92d6-d09bf5280668] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:12.744534 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-48c4fc67-8a05-4d1d-a0be-2ca3c66213da tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:12.745010 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-48c4fc67-8a05-4d1d-a0be-2ca3c66213da tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:12.745827 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-48c4fc67-8a05-4d1d-a0be-2ca3c66213da tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:12.746269 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-48c4fc67-8a05-4d1d-a0be-2ca3c66213da tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:13.362202 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-48c4fc67-8a05-4d1d-a0be-2ca3c66213da tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0700362f578248e5a1a60be519daf5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b95313b30841b7bd2616ddf6baa4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:13.380153 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-48c4fc67-8a05-4d1d-a0be-2ca3c66213da tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0700362f578248e5a1a60be519daf5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b95313b30841b7bd2616ddf6baa4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:13.382866 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-48c4fc67-8a05-4d1d-a0be-2ca3c66213da tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0700362f578248e5a1a60be519daf5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b95313b30841b7bd2616ddf6baa4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:13.384699 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-48c4fc67-8a05-4d1d-a0be-2ca3c66213da tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] 10.222.0.27 "GET /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668" status: 200 len: 1361 microversion: 2.26 time: 0.684463 Jun 20 12:03:13.385865 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 761/1483] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:03:12 2022] GET /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668 => generated 1361 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:03:13.397250 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-83f42094-2b35-4a27-91a1-92bf032aab06 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:13.398218 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-83f42094-2b35-4a27-91a1-92bf032aab06 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:13.408665 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-83f42094-2b35-4a27-91a1-92bf032aab06 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:13.409431 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-83f42094-2b35-4a27-91a1-92bf032aab06 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:13.410565 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-83f42094-2b35-4a27-91a1-92bf032aab06 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:13.411288 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-83f42094-2b35-4a27-91a1-92bf032aab06 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:14.709950 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-83f42094-2b35-4a27-91a1-92bf032aab06 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:14.719275 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-83f42094-2b35-4a27-91a1-92bf032aab06 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80" status: 200 len: 1502 microversion: 2.1 time: 1.331968 Jun 20 12:03:14.737344 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 762/1484] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:13 2022] GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 => generated 1502 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:14.743014 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-53f856c8-32e3-4768-9efe-36e1967e10c3 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:14.751385 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-53f856c8-32e3-4768-9efe-36e1967e10c3 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:14.766263 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-53f856c8-32e3-4768-9efe-36e1967e10c3 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:14.767076 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-53f856c8-32e3-4768-9efe-36e1967e10c3 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:14.772775 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-53f856c8-32e3-4768-9efe-36e1967e10c3 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:14.773729 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-53f856c8-32e3-4768-9efe-36e1967e10c3 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:15.544310 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-91437a67-2052-4a1f-8b0f-6fda47fc4374 tempest-FloatingIPDetailsTestJSON-271562628 tempest-FloatingIPDetailsTestJSON-271562628-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.456853 Jun 20 12:03:15.546827 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 723/1485] 10.222.0.27 () {60 vars in 1169 bytes} [Mon Jun 20 12:03:12 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:03:15.552917 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-88b8314a-2f4e-47b9-91d6-00b7d5c82cd0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:15.553987 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-88b8314a-2f4e-47b9-91d6-00b7d5c82cd0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 7cff5b7f-6801-45ae-b6bd-5e062ce73b18] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:15.564674 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88b8314a-2f4e-47b9-91d6-00b7d5c82cd0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:15.565462 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88b8314a-2f4e-47b9-91d6-00b7d5c82cd0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:15.566978 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88b8314a-2f4e-47b9-91d6-00b7d5c82cd0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:15.567656 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88b8314a-2f4e-47b9-91d6-00b7d5c82cd0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:15.620464 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-53f856c8-32e3-4768-9efe-36e1967e10c3 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:15.635539 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-53f856c8-32e3-4768-9efe-36e1967e10c3 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:15.637646 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-53f856c8-32e3-4768-9efe-36e1967e10c3 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:15.640046 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-53f856c8-32e3-4768-9efe-36e1967e10c3 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 1879 microversion: 2.42 time: 0.900473 Jun 20 12:03:15.642796 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 763/1486] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:03:14 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 1879 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:03:15.654761 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-e3c22d70-256b-4e09-8578-8ccd23c68d9b req-ab95592c-3f7e-4ae0-a342-a79713e6d294 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49a35510-1821-49de-8e39-d45901095c80", "name": "network-vif-unplugged", "status": "completed", "tag": "bab393cc-844a-468b-9b51-51cf37ed5c0a"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:03:15.684945 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-e3c22d70-256b-4e09-8578-8ccd23c68d9b req-ab95592c-3f7e-4ae0-a342-a79713e6d294 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:15.685408 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-e3c22d70-256b-4e09-8578-8ccd23c68d9b req-ab95592c-3f7e-4ae0-a342-a79713e6d294 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:15.718754 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-e3c22d70-256b-4e09-8578-8ccd23c68d9b req-ab95592c-3f7e-4ae0-a342-a79713e6d294 service nova] Creating event network-vif-unplugged:bab393cc-844a-468b-9b51-51cf37ed5c0a for instance 49a35510-1821-49de-8e39-d45901095c80 on n-h2-master-1 Jun 20 12:03:15.734699 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-e3c22d70-256b-4e09-8578-8ccd23c68d9b req-ab95592c-3f7e-4ae0-a342-a79713e6d294 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090186 Jun 20 12:03:15.735695 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 764/1487] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:03:15.741193 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-3689ba9d-843c-40e3-919d-645c89108c2f req-3f6bfca6-b200-4c72-9d24-abdba9710ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49a35510-1821-49de-8e39-d45901095c80", "name": "network-vif-unplugged", "status": "completed", "tag": "bab393cc-844a-468b-9b51-51cf37ed5c0a"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:03:15.751661 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-88b8314a-2f4e-47b9-91d6-00b7d5c82cd0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:15.764865 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-3689ba9d-843c-40e3-919d-645c89108c2f req-3f6bfca6-b200-4c72-9d24-abdba9710ef1 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:15.768517 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-88b8314a-2f4e-47b9-91d6-00b7d5c82cd0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18" status: 200 len: 1272 microversion: 2.1 time: 0.215167 Jun 20 12:03:15.769359 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-3689ba9d-843c-40e3-919d-645c89108c2f req-3f6bfca6-b200-4c72-9d24-abdba9710ef1 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:15.770590 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 724/1488] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:15 2022] GET /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18 => generated 1272 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:15.784162 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c0eba727-6f87-4fa2-b474-2259d5fa26c3 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:15.786928 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-3689ba9d-843c-40e3-919d-645c89108c2f req-3f6bfca6-b200-4c72-9d24-abdba9710ef1 service nova] Creating event network-vif-unplugged:bab393cc-844a-468b-9b51-51cf37ed5c0a for instance 49a35510-1821-49de-8e39-d45901095c80 on n-h2-master-1 Jun 20 12:03:15.788149 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c0eba727-6f87-4fa2-b474-2259d5fa26c3 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] [instance: ad7eb6c8-eba3-4dfc-92d6-d09bf5280668] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:15.810336 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-3689ba9d-843c-40e3-919d-645c89108c2f req-3f6bfca6-b200-4c72-9d24-abdba9710ef1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072993 Jun 20 12:03:15.811660 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 765/1489] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:03:15.814997 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c0eba727-6f87-4fa2-b474-2259d5fa26c3 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:15.817263 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c0eba727-6f87-4fa2-b474-2259d5fa26c3 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:15.817524 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5f73bb30-02bc-4a18-95a1-9e18d001bf6b tempest-FloatingIPDetailsTestJSON-271562628 tempest-FloatingIPDetailsTestJSON-271562628-project] Action: 'create', calling method: .version_select at 0x7f6073738dc0>, body: {"pool": null} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:03:15.819570 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c0eba727-6f87-4fa2-b474-2259d5fa26c3 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:15.822808 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c0eba727-6f87-4fa2-b474-2259d5fa26c3 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:16.060629 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:16.282453 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c0eba727-6f87-4fa2-b474-2259d5fa26c3 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0700362f578248e5a1a60be519daf5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b95313b30841b7bd2616ddf6baa4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:16.289740 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:16.312620 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c0eba727-6f87-4fa2-b474-2259d5fa26c3 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0700362f578248e5a1a60be519daf5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b95313b30841b7bd2616ddf6baa4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:16.323458 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c0eba727-6f87-4fa2-b474-2259d5fa26c3 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0700362f578248e5a1a60be519daf5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b95313b30841b7bd2616ddf6baa4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:16.325968 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c0eba727-6f87-4fa2-b474-2259d5fa26c3 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] 10.222.0.27 "GET /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668" status: 200 len: 1361 microversion: 2.26 time: 0.554392 Jun 20 12:03:16.332480 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 725/1490] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:03:15 2022] GET /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668 => generated 1361 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:03:16.357519 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0446ef10-86ec-4af3-b704-293f0050a546 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:16.358424 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0446ef10-86ec-4af3-b704-293f0050a546 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:16.386067 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0446ef10-86ec-4af3-b704-293f0050a546 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:16.386522 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0446ef10-86ec-4af3-b704-293f0050a546 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:16.387313 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0446ef10-86ec-4af3-b704-293f0050a546 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:16.387743 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0446ef10-86ec-4af3-b704-293f0050a546 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:16.870783 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0446ef10-86ec-4af3-b704-293f0050a546 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:16.887117 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0446ef10-86ec-4af3-b704-293f0050a546 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80" status: 200 len: 1502 microversion: 2.1 time: 0.532101 Jun 20 12:03:16.889064 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 726/1491] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:16 2022] GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 => generated 1502 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:16.902952 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0cddc1b0-8e2f-4b3d-b6a4-29af9fca88cf tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:16.926029 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0cddc1b0-8e2f-4b3d-b6a4-29af9fca88cf tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:16.940112 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cddc1b0-8e2f-4b3d-b6a4-29af9fca88cf tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:16.941145 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cddc1b0-8e2f-4b3d-b6a4-29af9fca88cf tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:16.946068 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cddc1b0-8e2f-4b3d-b6a4-29af9fca88cf tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:16.946942 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cddc1b0-8e2f-4b3d-b6a4-29af9fca88cf tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:17.462209 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0cddc1b0-8e2f-4b3d-b6a4-29af9fca88cf tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:17.482728 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0cddc1b0-8e2f-4b3d-b6a4-29af9fca88cf tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:17.485743 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0cddc1b0-8e2f-4b3d-b6a4-29af9fca88cf tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:17.487577 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0cddc1b0-8e2f-4b3d-b6a4-29af9fca88cf tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 2837 microversion: 2.42 time: 0.597169 Jun 20 12:03:17.488759 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 727/1492] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:03:16 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 2837 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:03:17.497234 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c4847f6c-6897-488b-8933-db6d0ddbfeea tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:17.498268 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c4847f6c-6897-488b-8933-db6d0ddbfeea tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 7cff5b7f-6801-45ae-b6bd-5e062ce73b18] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:17.507347 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4847f6c-6897-488b-8933-db6d0ddbfeea tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:17.508609 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4847f6c-6897-488b-8933-db6d0ddbfeea tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:17.509777 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4847f6c-6897-488b-8933-db6d0ddbfeea tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:17.510437 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4847f6c-6897-488b-8933-db6d0ddbfeea tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:17.787893 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c4847f6c-6897-488b-8933-db6d0ddbfeea tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:17.797021 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c4847f6c-6897-488b-8933-db6d0ddbfeea tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18" status: 200 len: 1314 microversion: 2.1 time: 0.306904 Jun 20 12:03:17.799147 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 728/1493] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:17 2022] GET /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:17.804413 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-92a8cef6-d09a-4026-978d-78e60fbe3a71 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:17.805180 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-92a8cef6-d09a-4026-978d-78e60fbe3a71 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] [instance: ad7eb6c8-eba3-4dfc-92d6-d09bf5280668] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:17.813049 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-92a8cef6-d09a-4026-978d-78e60fbe3a71 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:17.813654 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-92a8cef6-d09a-4026-978d-78e60fbe3a71 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:17.814818 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-92a8cef6-d09a-4026-978d-78e60fbe3a71 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:17.815383 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-92a8cef6-d09a-4026-978d-78e60fbe3a71 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:18.024875 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-92a8cef6-d09a-4026-978d-78e60fbe3a71 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0700362f578248e5a1a60be519daf5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b95313b30841b7bd2616ddf6baa4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:18.039836 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-92a8cef6-d09a-4026-978d-78e60fbe3a71 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0700362f578248e5a1a60be519daf5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b95313b30841b7bd2616ddf6baa4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:18.041676 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-92a8cef6-d09a-4026-978d-78e60fbe3a71 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0700362f578248e5a1a60be519daf5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b95313b30841b7bd2616ddf6baa4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:18.050208 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-92a8cef6-d09a-4026-978d-78e60fbe3a71 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] 10.222.0.27 "GET /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668" status: 200 len: 1361 microversion: 2.26 time: 0.249817 Jun 20 12:03:18.050951 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 729/1494] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:03:17 2022] GET /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668 => generated 1361 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:03:18.060036 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0a2b1e5a-fc08-4f20-a002-1b8abe9acf46 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:18.061096 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0a2b1e5a-fc08-4f20-a002-1b8abe9acf46 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:18.081752 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a2b1e5a-fc08-4f20-a002-1b8abe9acf46 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:18.085009 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a2b1e5a-fc08-4f20-a002-1b8abe9acf46 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:18.088856 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a2b1e5a-fc08-4f20-a002-1b8abe9acf46 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:18.089308 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a2b1e5a-fc08-4f20-a002-1b8abe9acf46 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:18.315101 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0a2b1e5a-fc08-4f20-a002-1b8abe9acf46 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.262826 Jun 20 12:03:18.323468 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 730/1495] 10.222.0.27 () {60 vars in 1315 bytes} [Mon Jun 20 12:03:18 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a/os-interface => generated 1831 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:03:18.323468 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a6ef3513-9b0d-4d17-9f8f-04a03bc1228b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:18.323468 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a6ef3513-9b0d-4d17-9f8f-04a03bc1228b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:18.346224 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6ef3513-9b0d-4d17-9f8f-04a03bc1228b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:18.348250 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6ef3513-9b0d-4d17-9f8f-04a03bc1228b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:18.349199 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6ef3513-9b0d-4d17-9f8f-04a03bc1228b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:18.349650 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6ef3513-9b0d-4d17-9f8f-04a03bc1228b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:19.072923 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=4 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:19.154401 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=44 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:19.391286 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a6ef3513-9b0d-4d17-9f8f-04a03bc1228b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:19.414830 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a6ef3513-9b0d-4d17-9f8f-04a03bc1228b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80" status: 200 len: 1502 microversion: 2.1 time: 1.097447 Jun 20 12:03:19.415426 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 731/1496] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:18 2022] GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 => generated 1502 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:19.429132 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-33cc21a0-d008-4ced-a66a-6b66955b7133 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:19.429829 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-33cc21a0-d008-4ced-a66a-6b66955b7133 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 7cff5b7f-6801-45ae-b6bd-5e062ce73b18] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:19.451696 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:19.473383 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-33cc21a0-d008-4ced-a66a-6b66955b7133 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:19.473832 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-33cc21a0-d008-4ced-a66a-6b66955b7133 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:19.481399 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-33cc21a0-d008-4ced-a66a-6b66955b7133 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:19.482281 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-33cc21a0-d008-4ced-a66a-6b66955b7133 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:20.269785 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=10 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:21.236957 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-33cc21a0-d008-4ced-a66a-6b66955b7133 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:21.252160 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-33cc21a0-d008-4ced-a66a-6b66955b7133 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18" status: 200 len: 1314 microversion: 2.1 time: 1.835539 Jun 20 12:03:21.255441 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 732/1497] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:19 2022] GET /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18 => generated 1314 bytes in 1839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:21.269098 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-842c7bf3-fcc1-496c-aa48-b848e72be5ff req-98a12951-a26d-4959-af39-055a86060aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad7eb6c8-eba3-4dfc-92d6-d09bf5280668", "name": "network-vif-plugged", "status": "completed", "tag": "065c8200-3fb1-4b3f-8885-c13738ca5b23"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:03:21.295406 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-842c7bf3-fcc1-496c-aa48-b848e72be5ff req-98a12951-a26d-4959-af39-055a86060aa3 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:21.296660 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-842c7bf3-fcc1-496c-aa48-b848e72be5ff req-98a12951-a26d-4959-af39-055a86060aa3 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:21.330743 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-842c7bf3-fcc1-496c-aa48-b848e72be5ff req-98a12951-a26d-4959-af39-055a86060aa3 service nova] Creating event network-vif-plugged:065c8200-3fb1-4b3f-8885-c13738ca5b23 for instance ad7eb6c8-eba3-4dfc-92d6-d09bf5280668 on n-h1-master-1 Jun 20 12:03:21.339775 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-842c7bf3-fcc1-496c-aa48-b848e72be5ff req-98a12951-a26d-4959-af39-055a86060aa3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082620 Jun 20 12:03:21.341485 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 733/1498] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:03:21.347567 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cb547ec8-2eb4-4085-9c1e-ce5e248cd6ca tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:21.348132 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cb547ec8-2eb4-4085-9c1e-ce5e248cd6ca tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] [instance: ad7eb6c8-eba3-4dfc-92d6-d09bf5280668] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:21.355574 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb547ec8-2eb4-4085-9c1e-ce5e248cd6ca tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:21.356378 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb547ec8-2eb4-4085-9c1e-ce5e248cd6ca tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:21.357409 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb547ec8-2eb4-4085-9c1e-ce5e248cd6ca tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:21.358914 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb547ec8-2eb4-4085-9c1e-ce5e248cd6ca tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:22.218239 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5f73bb30-02bc-4a18-95a1-9e18d001bf6b tempest-FloatingIPDetailsTestJSON-271562628 tempest-FloatingIPDetailsTestJSON-271562628-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.404725 Jun 20 12:03:22.219598 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 766/1499] 10.222.0.27 () {60 vars in 1169 bytes} [Mon Jun 20 12:03:15 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:03:22.225275 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4623ffad-80c2-4e6a-baf6-b859b556aeef tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:22.227053 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4623ffad-80c2-4e6a-baf6-b859b556aeef tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:22.236869 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4623ffad-80c2-4e6a-baf6-b859b556aeef tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:22.237639 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4623ffad-80c2-4e6a-baf6-b859b556aeef tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:22.239041 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4623ffad-80c2-4e6a-baf6-b859b556aeef tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:22.239658 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4623ffad-80c2-4e6a-baf6-b859b556aeef tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:22.312810 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-cb547ec8-2eb4-4085-9c1e-ce5e248cd6ca tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0700362f578248e5a1a60be519daf5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b95313b30841b7bd2616ddf6baa4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:22.328503 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-cb547ec8-2eb4-4085-9c1e-ce5e248cd6ca tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0700362f578248e5a1a60be519daf5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b95313b30841b7bd2616ddf6baa4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:22.336806 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-cb547ec8-2eb4-4085-9c1e-ce5e248cd6ca tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0700362f578248e5a1a60be519daf5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b95313b30841b7bd2616ddf6baa4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:22.338266 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cb547ec8-2eb4-4085-9c1e-ce5e248cd6ca tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] 10.222.0.27 "GET /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668" status: 200 len: 1361 microversion: 2.26 time: 0.995037 Jun 20 12:03:22.339505 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 734/1500] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:03:21 2022] GET /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668 => generated 1361 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:03:22.345251 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-412e4781-e891-48cf-a483-5b8773bdcfcd req-452cc7be-7a68-4ea5-9443-3e58961df4de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cff5b7f-6801-45ae-b6bd-5e062ce73b18", "tag": "13b8fe10-f2db-4e80-8847-a189ff6fe1c7"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:03:22.384045 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-412e4781-e891-48cf-a483-5b8773bdcfcd req-452cc7be-7a68-4ea5-9443-3e58961df4de service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:22.388361 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-412e4781-e891-48cf-a483-5b8773bdcfcd req-452cc7be-7a68-4ea5-9443-3e58961df4de service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:22.417810 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-412e4781-e891-48cf-a483-5b8773bdcfcd req-452cc7be-7a68-4ea5-9443-3e58961df4de service nova] Creating event network-changed:13b8fe10-f2db-4e80-8847-a189ff6fe1c7 for instance 7cff5b7f-6801-45ae-b6bd-5e062ce73b18 on n-h2-master-1 Jun 20 12:03:22.437824 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-412e4781-e891-48cf-a483-5b8773bdcfcd req-452cc7be-7a68-4ea5-9443-3e58961df4de service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096905 Jun 20 12:03:22.446094 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 735/1501] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:03:22.461314 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-35353282-99a6-4177-b12e-3c799852cad8 tempest-FloatingIPDetailsTestJSON-271562628 tempest-FloatingIPDetailsTestJSON-271562628-project] Action: 'create', calling method: .version_select at 0x7f607343cf70>, body: {"pool": null} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:03:22.626637 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4623ffad-80c2-4e6a-baf6-b859b556aeef tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:22.642584 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4623ffad-80c2-4e6a-baf6-b859b556aeef tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80" status: 200 len: 1492 microversion: 2.1 time: 0.420595 Jun 20 12:03:22.645736 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 767/1502] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:22 2022] GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 => generated 1492 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:22.655778 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b3a797b6-9742-4152-b646-adf1ecf7a489 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:22.657148 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b3a797b6-9742-4152-b646-adf1ecf7a489 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 7cff5b7f-6801-45ae-b6bd-5e062ce73b18] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:22.687639 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3a797b6-9742-4152-b646-adf1ecf7a489 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:22.688174 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3a797b6-9742-4152-b646-adf1ecf7a489 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:22.693605 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3a797b6-9742-4152-b646-adf1ecf7a489 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:22.695197 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3a797b6-9742-4152-b646-adf1ecf7a489 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:22.936607 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b3a797b6-9742-4152-b646-adf1ecf7a489 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:22.957910 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b3a797b6-9742-4152-b646-adf1ecf7a489 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18" status: 200 len: 1314 microversion: 2.1 time: 0.310301 Jun 20 12:03:22.958672 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 768/1503] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:22 2022] GET /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:22.974197 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d1c598da-5237-40ac-be3b-2dc31688d1f0 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Calling method '.version_select at 0x7f60732f0430>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:22.977487 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d1c598da-5237-40ac-be3b-2dc31688d1f0 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:22.978230 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d1c598da-5237-40ac-be3b-2dc31688d1f0 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:22.993608 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d1c598da-5237-40ac-be3b-2dc31688d1f0 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1552 microversion: 2.1 time: 0.031690 Jun 20 12:03:22.995845 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 769/1504] 10.222.0.27 () {58 vars in 1142 bytes} [Mon Jun 20 12:03:22 2022] GET /compute/v2.1/os-migrations => generated 1552 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:23.007568 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-78d2e535-2d08-4c9e-a4a8-4fcfb9dc29e7 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:23.008240 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-78d2e535-2d08-4c9e-a4a8-4fcfb9dc29e7 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:23.019273 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-78d2e535-2d08-4c9e-a4a8-4fcfb9dc29e7 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:23.019731 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-78d2e535-2d08-4c9e-a4a8-4fcfb9dc29e7 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:23.024478 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-78d2e535-2d08-4c9e-a4a8-4fcfb9dc29e7 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:23.025410 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-78d2e535-2d08-4c9e-a4a8-4fcfb9dc29e7 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:23.288847 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-78d2e535-2d08-4c9e-a4a8-4fcfb9dc29e7 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80" status: 200 len: 1643 microversion: 2.1 time: 0.285083 Jun 20 12:03:23.290540 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 770/1505] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:23 2022] GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 => generated 1643 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:03:23.359677 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-005d2f1a-d95a-4c4c-89d4-f610784674e9 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:23.360446 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-005d2f1a-d95a-4c4c-89d4-f610784674e9 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] [instance: ad7eb6c8-eba3-4dfc-92d6-d09bf5280668] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:23.372699 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-005d2f1a-d95a-4c4c-89d4-f610784674e9 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:23.373516 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-005d2f1a-d95a-4c4c-89d4-f610784674e9 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:23.374578 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-005d2f1a-d95a-4c4c-89d4-f610784674e9 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:23.375082 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-005d2f1a-d95a-4c4c-89d4-f610784674e9 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:23.594944 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-005d2f1a-d95a-4c4c-89d4-f610784674e9 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0700362f578248e5a1a60be519daf5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b95313b30841b7bd2616ddf6baa4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:23.605024 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-005d2f1a-d95a-4c4c-89d4-f610784674e9 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0700362f578248e5a1a60be519daf5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b95313b30841b7bd2616ddf6baa4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:23.606541 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-005d2f1a-d95a-4c4c-89d4-f610784674e9 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0700362f578248e5a1a60be519daf5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b95313b30841b7bd2616ddf6baa4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:23.607970 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-005d2f1a-d95a-4c4c-89d4-f610784674e9 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] 10.222.0.27 "GET /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668" status: 200 len: 1544 microversion: 2.26 time: 0.254396 Jun 20 12:03:23.608561 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 771/1506] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:03:23 2022] GET /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668 => generated 1544 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:03:23.613905 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-812fe3b2-7405-4e83-96f1-590a685b193d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-631700695", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "c2bcaf29-2650-4e29-8ebc-39da1df0e1bf"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:03:23.690614 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-812fe3b2-7405-4e83-96f1-590a685b193d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] validate_networks() for [('c2bcaf29-2650-4e29-8ebc-39da1df0e1bf', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:03:24.334573 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-812fe3b2-7405-4e83-96f1-590a685b193d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:03:24.335126 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-812fe3b2-7405-4e83-96f1-590a685b193d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:03:24.335635 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-812fe3b2-7405-4e83-96f1-590a685b193d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:03:24.336314 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-812fe3b2-7405-4e83-96f1-590a685b193d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:03:24.345700 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-812fe3b2-7405-4e83-96f1-590a685b193d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:03:24.376465 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-812fe3b2-7405-4e83-96f1-590a685b193d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:24.377206 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-812fe3b2-7405-4e83-96f1-590a685b193d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:24.378344 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-812fe3b2-7405-4e83-96f1-590a685b193d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:24.378998 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-812fe3b2-7405-4e83-96f1-590a685b193d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:24.440572 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-812fe3b2-7405-4e83-96f1-590a685b193d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Getting quotas for project 5cf9c3f1d5c64a75b49099a15fe087ee. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:03:24.466154 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-812fe3b2-7405-4e83-96f1-590a685b193d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Getting quotas for user 3f16b216588946a790b42450b795ee00 and project 5cf9c3f1d5c64a75b49099a15fe087ee. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:03:24.495075 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-812fe3b2-7405-4e83-96f1-590a685b193d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:03:24.497947 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-812fe3b2-7405-4e83-96f1-590a685b193d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: d348abab-aae7-4b81-84db-f856c9cf4907] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:03:24.601563 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-812fe3b2-7405-4e83-96f1-590a685b193d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.990512 Jun 20 12:03:24.613467 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 772/1507] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:03:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:03:24.656052 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-913d8d32-8626-423c-abd1-78592fd1d870 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Calling method '.version_select at 0x7f60732f0dc0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:24.691868 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-913d8d32-8626-423c-abd1-78592fd1d870 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:24.692549 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-913d8d32-8626-423c-abd1-78592fd1d870 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:24.693525 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-913d8d32-8626-423c-abd1-78592fd1d870 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] [instance: ad7eb6c8-eba3-4dfc-92d6-d09bf5280668] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:24.702083 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-913d8d32-8626-423c-abd1-78592fd1d870 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:24.704332 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-913d8d32-8626-423c-abd1-78592fd1d870 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:24.705528 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-913d8d32-8626-423c-abd1-78592fd1d870 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:24.706293 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-913d8d32-8626-423c-abd1-78592fd1d870 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:24.738252 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-913d8d32-8626-423c-abd1-78592fd1d870 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:24.739607 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-913d8d32-8626-423c-abd1-78592fd1d870 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:24.771984 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-913d8d32-8626-423c-abd1-78592fd1d870 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:24.772669 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-913d8d32-8626-423c-abd1-78592fd1d870 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:24.809128 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-913d8d32-8626-423c-abd1-78592fd1d870 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lazy-loading 'flavor' on Instance uuid ad7eb6c8-eba3-4dfc-92d6-d09bf5280668 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:03:24.886229 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-913d8d32-8626-423c-abd1-78592fd1d870 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] 10.222.0.27 "PUT /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668/tags/tempest-tag-1575652463" status: 201 len: 0 microversion: 2.26 time: 0.269698 Jun 20 12:03:24.887227 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 773/1508] 10.222.0.27 () {62 vars in 1379 bytes} [Mon Jun 20 12:03:24 2022] PUT /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668/tags/tempest-tag-1575652463 => generated 0 bytes in 271 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jun 20 12:03:24.892949 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-19c9a107-f5da-448b-9caa-672ff9113c46 req-17053c35-2969-4b30-8360-445cd2116fea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f59e801d-2548-4edc-8283-af47c991d92a", "tag": "32d33855-eec9-4f47-8a63-741b0283b523"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:03:24.904854 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-19c9a107-f5da-448b-9caa-672ff9113c46 req-17053c35-2969-4b30-8360-445cd2116fea service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:24.907517 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-19c9a107-f5da-448b-9caa-672ff9113c46 req-17053c35-2969-4b30-8360-445cd2116fea service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:24.922225 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:24.925620 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-19c9a107-f5da-448b-9caa-672ff9113c46 req-17053c35-2969-4b30-8360-445cd2116fea service nova] Creating event network-changed:32d33855-eec9-4f47-8a63-741b0283b523 for instance f59e801d-2548-4edc-8283-af47c991d92a on n-h2-master-1 Jun 20 12:03:24.932891 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-19c9a107-f5da-448b-9caa-672ff9113c46 req-17053c35-2969-4b30-8360-445cd2116fea service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043844 Jun 20 12:03:24.933722 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 774/1509] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:03:24.940025 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-900e01a4-49a8-422d-92ac-e12981025c44 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:24.940762 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-900e01a4-49a8-422d-92ac-e12981025c44 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 7cff5b7f-6801-45ae-b6bd-5e062ce73b18] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:24.951152 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-900e01a4-49a8-422d-92ac-e12981025c44 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:24.951617 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-900e01a4-49a8-422d-92ac-e12981025c44 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:24.967253 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-900e01a4-49a8-422d-92ac-e12981025c44 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:24.967712 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-900e01a4-49a8-422d-92ac-e12981025c44 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:25.954525 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-900e01a4-49a8-422d-92ac-e12981025c44 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:25.969074 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-900e01a4-49a8-422d-92ac-e12981025c44 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18" status: 200 len: 1314 microversion: 2.1 time: 1.033940 Jun 20 12:03:25.977693 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 775/1510] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:24 2022] GET /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18 => generated 1314 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:25.983164 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1e5569f4-f5a2-42a6-bcda-bb675149b943 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:25.987607 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1e5569f4-f5a2-42a6-bcda-bb675149b943 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: d348abab-aae7-4b81-84db-f856c9cf4907] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:26.005413 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1e5569f4-f5a2-42a6-bcda-bb675149b943 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:26.009486 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1e5569f4-f5a2-42a6-bcda-bb675149b943 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:26.010772 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1e5569f4-f5a2-42a6-bcda-bb675149b943 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:26.014791 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1e5569f4-f5a2-42a6-bcda-bb675149b943 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:26.189127 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1e5569f4-f5a2-42a6-bcda-bb675149b943 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:26.202768 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1e5569f4-f5a2-42a6-bcda-bb675149b943 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907" status: 200 len: 1262 microversion: 2.1 time: 0.223572 Jun 20 12:03:26.204140 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 776/1511] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:25 2022] GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907 => generated 1262 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:26.217495 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ab183ec9-4ff9-4189-8c3e-d407557c63b6 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Calling method '.version_select at 0x7f6073457550>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:26.229789 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ab183ec9-4ff9-4189-8c3e-d407557c63b6 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:26.232531 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ab183ec9-4ff9-4189-8c3e-d407557c63b6 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:26.251032 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ab183ec9-4ff9-4189-8c3e-d407557c63b6 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] 10.222.0.27 "GET /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668/tags/tempest-tag-1575652463" status: 204 len: 0 microversion: 2.26 time: 0.039877 Jun 20 12:03:26.257037 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 777/1512] 10.222.0.27 () {60 vars in 1360 bytes} [Mon Jun 20 12:03:26 2022] GET /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668/tags/tempest-tag-1575652463 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 12:03:26.266450 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-83715671-6a17-440c-b5e4-4a816bad52d1 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Calling method '.version_select at 0x7f6073738a60>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:26.283192 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-83715671-6a17-440c-b5e4-4a816bad52d1 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:26.284563 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-83715671-6a17-440c-b5e4-4a816bad52d1 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:26.285796 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-83715671-6a17-440c-b5e4-4a816bad52d1 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] [instance: ad7eb6c8-eba3-4dfc-92d6-d09bf5280668] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:26.325439 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-83715671-6a17-440c-b5e4-4a816bad52d1 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:26.326317 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-83715671-6a17-440c-b5e4-4a816bad52d1 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:26.328215 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-83715671-6a17-440c-b5e4-4a816bad52d1 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:26.330526 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-83715671-6a17-440c-b5e4-4a816bad52d1 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:26.443923 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-83715671-6a17-440c-b5e4-4a816bad52d1 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:26.446994 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-83715671-6a17-440c-b5e4-4a816bad52d1 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:26.519664 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-83715671-6a17-440c-b5e4-4a816bad52d1 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lazy-loading 'flavor' on Instance uuid ad7eb6c8-eba3-4dfc-92d6-d09bf5280668 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:03:26.550789 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-83715671-6a17-440c-b5e4-4a816bad52d1 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668/tags" status: 204 len: 0 microversion: 2.26 time: 0.292271 Jun 20 12:03:26.556642 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 778/1513] 10.222.0.27 () {60 vars in 1294 bytes} [Mon Jun 20 12:03:26 2022] DELETE /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668/tags => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 12:03:26.565912 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-84939c66-5565-4526-be2b-4896da437948 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Calling method '.version_select at 0x7f6073457790>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:26.586745 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-84939c66-5565-4526-be2b-4896da437948 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:26.589471 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-84939c66-5565-4526-be2b-4896da437948 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:26.637257 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-84939c66-5565-4526-be2b-4896da437948 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] 10.222.0.27 "GET /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668/tags" status: 200 len: 12 microversion: 2.26 time: 0.078924 Jun 20 12:03:26.642056 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 779/1514] 10.222.0.27 () {60 vars in 1291 bytes} [Mon Jun 20 12:03:26 2022] GET /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668/tags => generated 12 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:26.659281 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b23272d1-a734-4b1f-8720-ce9c4908429d tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Calling method '.version_select at 0x7f6073648670>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:26.680463 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b23272d1-a734-4b1f-8720-ce9c4908429d tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:26.681533 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b23272d1-a734-4b1f-8720-ce9c4908429d tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:26.681533 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b23272d1-a734-4b1f-8720-ce9c4908429d tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] [instance: ad7eb6c8-eba3-4dfc-92d6-d09bf5280668] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:26.697369 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b23272d1-a734-4b1f-8720-ce9c4908429d tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:26.700974 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b23272d1-a734-4b1f-8720-ce9c4908429d tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:26.702020 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b23272d1-a734-4b1f-8720-ce9c4908429d tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:26.702463 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b23272d1-a734-4b1f-8720-ce9c4908429d tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:26.751836 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b23272d1-a734-4b1f-8720-ce9c4908429d tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:26.752312 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b23272d1-a734-4b1f-8720-ce9c4908429d tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:26.767515 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b23272d1-a734-4b1f-8720-ce9c4908429d tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:26.767515 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b23272d1-a734-4b1f-8720-ce9c4908429d tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:26.798910 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-b23272d1-a734-4b1f-8720-ce9c4908429d tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lazy-loading 'flavor' on Instance uuid ad7eb6c8-eba3-4dfc-92d6-d09bf5280668 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:03:26.820607 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b23272d1-a734-4b1f-8720-ce9c4908429d tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] 10.222.0.27 "PUT /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668/tags/tempest-tag-438740169" status: 201 len: 0 microversion: 2.26 time: 0.171504 Jun 20 12:03:26.821297 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 780/1515] 10.222.0.27 () {62 vars in 1376 bytes} [Mon Jun 20 12:03:26 2022] PUT /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668/tags/tempest-tag-438740169 => generated 0 bytes in 173 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jun 20 12:03:26.842130 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-98a4fd77-eb44-4b8c-88d6-dfdfb6ed0ab4 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Calling method '.version_select at 0x7f60733ba790>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:26.854592 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-98a4fd77-eb44-4b8c-88d6-dfdfb6ed0ab4 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:26.855639 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-98a4fd77-eb44-4b8c-88d6-dfdfb6ed0ab4 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:26.870425 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-98a4fd77-eb44-4b8c-88d6-dfdfb6ed0ab4 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] 10.222.0.27 "GET /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668/tags" status: 200 len: 35 microversion: 2.26 time: 0.038224 Jun 20 12:03:26.876408 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 781/1516] 10.222.0.27 () {60 vars in 1291 bytes} [Mon Jun 20 12:03:26 2022] GET /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668/tags => generated 35 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:26.882820 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0d32f835-eaca-4094-902a-aadbfa6dd60f tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Calling method '.version_select at 0x7f6073728310>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:26.895476 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0d32f835-eaca-4094-902a-aadbfa6dd60f tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:26.895720 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0d32f835-eaca-4094-902a-aadbfa6dd60f tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:26.896100 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0d32f835-eaca-4094-902a-aadbfa6dd60f tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] [instance: ad7eb6c8-eba3-4dfc-92d6-d09bf5280668] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:26.903479 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0d32f835-eaca-4094-902a-aadbfa6dd60f tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:26.903934 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0d32f835-eaca-4094-902a-aadbfa6dd60f tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:26.905161 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0d32f835-eaca-4094-902a-aadbfa6dd60f tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:26.905601 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0d32f835-eaca-4094-902a-aadbfa6dd60f tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:26.938475 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0d32f835-eaca-4094-902a-aadbfa6dd60f tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:26.939617 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0d32f835-eaca-4094-902a-aadbfa6dd60f tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:26.977139 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-0d32f835-eaca-4094-902a-aadbfa6dd60f tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lazy-loading 'flavor' on Instance uuid ad7eb6c8-eba3-4dfc-92d6-d09bf5280668 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:03:27.000276 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0d32f835-eaca-4094-902a-aadbfa6dd60f tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668/tags/tempest-tag-438740169" status: 204 len: 0 microversion: 2.26 time: 0.122439 Jun 20 12:03:27.022734 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 782/1517] 10.222.0.27 () {60 vars in 1360 bytes} [Mon Jun 20 12:03:26 2022] DELETE /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668/tags/tempest-tag-438740169 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 12:03:27.042088 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4632ba9e-ad9a-41c9-b801-681e63ae8236 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:27.043113 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4632ba9e-ad9a-41c9-b801-681e63ae8236 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 7cff5b7f-6801-45ae-b6bd-5e062ce73b18] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:27.059515 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4632ba9e-ad9a-41c9-b801-681e63ae8236 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:27.059515 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4632ba9e-ad9a-41c9-b801-681e63ae8236 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:27.062977 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4632ba9e-ad9a-41c9-b801-681e63ae8236 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:27.064713 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4632ba9e-ad9a-41c9-b801-681e63ae8236 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:27.501093 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4632ba9e-ad9a-41c9-b801-681e63ae8236 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:27.520771 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4632ba9e-ad9a-41c9-b801-681e63ae8236 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18" status: 200 len: 1314 microversion: 2.1 time: 0.492378 Jun 20 12:03:27.531162 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 783/1518] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:27 2022] GET /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18 => generated 1314 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:27.531888 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b87c4903-0dec-4e30-8035-a6e703417203 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Calling method '.version_select at 0x7f6073af1a60>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:27.540541 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b87c4903-0dec-4e30-8035-a6e703417203 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:27.546853 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b87c4903-0dec-4e30-8035-a6e703417203 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:27.569990 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b87c4903-0dec-4e30-8035-a6e703417203 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] 10.222.0.27 "GET /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668/tags" status: 200 len: 12 microversion: 2.26 time: 0.044889 Jun 20 12:03:27.574508 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 784/1519] 10.222.0.27 () {60 vars in 1291 bytes} [Mon Jun 20 12:03:27 2022] GET /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668/tags => generated 12 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:27.582451 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-be0cd727-4070-4ab3-b7e0-c4bc14c187ba tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:27.583089 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-be0cd727-4070-4ab3-b7e0-c4bc14c187ba tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: d348abab-aae7-4b81-84db-f856c9cf4907] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:27.601100 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-be0cd727-4070-4ab3-b7e0-c4bc14c187ba tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:27.613800 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-be0cd727-4070-4ab3-b7e0-c4bc14c187ba tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:27.613800 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-be0cd727-4070-4ab3-b7e0-c4bc14c187ba tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:27.613800 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-be0cd727-4070-4ab3-b7e0-c4bc14c187ba tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:27.743858 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-be0cd727-4070-4ab3-b7e0-c4bc14c187ba tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:27.757601 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-be0cd727-4070-4ab3-b7e0-c4bc14c187ba tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907" status: 200 len: 1268 microversion: 2.1 time: 0.181875 Jun 20 12:03:27.758311 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 785/1520] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:27 2022] GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907 => generated 1268 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:27.770575 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-79461da3-378c-42d1-8f1a-5e0da83c1dfe tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Calling method '.version_select at 0x7f60737383a0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:27.789428 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-79461da3-378c-42d1-8f1a-5e0da83c1dfe tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:27.791863 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-79461da3-378c-42d1-8f1a-5e0da83c1dfe tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:27.796671 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-79461da3-378c-42d1-8f1a-5e0da83c1dfe tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] [instance: ad7eb6c8-eba3-4dfc-92d6-d09bf5280668] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:27.809843 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-79461da3-378c-42d1-8f1a-5e0da83c1dfe tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:27.810546 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-79461da3-378c-42d1-8f1a-5e0da83c1dfe tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:27.812043 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-79461da3-378c-42d1-8f1a-5e0da83c1dfe tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:27.812767 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-79461da3-378c-42d1-8f1a-5e0da83c1dfe tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:27.849812 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-79461da3-378c-42d1-8f1a-5e0da83c1dfe tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:27.850493 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-79461da3-378c-42d1-8f1a-5e0da83c1dfe tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:27.865552 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-79461da3-378c-42d1-8f1a-5e0da83c1dfe tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lazy-loading 'flavor' on Instance uuid ad7eb6c8-eba3-4dfc-92d6-d09bf5280668 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:03:27.909800 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-79461da3-378c-42d1-8f1a-5e0da83c1dfe tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668/tags" status: 204 len: 0 microversion: 2.26 time: 0.149018 Jun 20 12:03:27.910455 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 786/1521] 10.222.0.27 () {60 vars in 1294 bytes} [Mon Jun 20 12:03:27 2022] DELETE /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668/tags => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 12:03:27.931837 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c9e14bfa-a279-466d-a03d-6896f904791a tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Calling method '.version_select at 0x7f607338e3a0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:27.963853 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c9e14bfa-a279-466d-a03d-6896f904791a tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:27.966151 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c9e14bfa-a279-466d-a03d-6896f904791a tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:27.967816 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c9e14bfa-a279-466d-a03d-6896f904791a tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] [instance: ad7eb6c8-eba3-4dfc-92d6-d09bf5280668] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:27.985610 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c9e14bfa-a279-466d-a03d-6896f904791a tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:27.987752 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c9e14bfa-a279-466d-a03d-6896f904791a tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:27.993324 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c9e14bfa-a279-466d-a03d-6896f904791a tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:27.995687 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c9e14bfa-a279-466d-a03d-6896f904791a tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:28.024826 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-35353282-99a6-4177-b12e-3c799852cad8 tempest-FloatingIPDetailsTestJSON-271562628 tempest-FloatingIPDetailsTestJSON-271562628-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.574299 Jun 20 12:03:28.025463 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 736/1522] 10.222.0.27 () {60 vars in 1169 bytes} [Mon Jun 20 12:03:22 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:03:28.040091 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3c5a1c53-ed52-4879-b9c4-8301b435c3c3 tempest-FloatingIPDetailsTestJSON-271562628 tempest-FloatingIPDetailsTestJSON-271562628-project] Action: 'create', calling method: .version_select at 0x7f60733f78b0>, body: {"pool": null} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:03:28.076656 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c9e14bfa-a279-466d-a03d-6896f904791a tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:28.077810 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c9e14bfa-a279-466d-a03d-6896f904791a tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:28.097737 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c9e14bfa-a279-466d-a03d-6896f904791a tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:28.099128 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c9e14bfa-a279-466d-a03d-6896f904791a tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:28.171127 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-c9e14bfa-a279-466d-a03d-6896f904791a tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lazy-loading 'flavor' on Instance uuid ad7eb6c8-eba3-4dfc-92d6-d09bf5280668 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:03:28.179182 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=91,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:28.209471 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c9e14bfa-a279-466d-a03d-6896f904791a tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] 10.222.0.27 "PUT /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668/tags/tempest-tag-2103906979" status: 201 len: 0 microversion: 2.26 time: 0.282868 Jun 20 12:03:28.214068 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 787/1523] 10.222.0.27 () {62 vars in 1379 bytes} [Mon Jun 20 12:03:27 2022] PUT /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668/tags/tempest-tag-2103906979 => generated 0 bytes in 289 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Jun 20 12:03:28.238622 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f5a1b4f2-adcb-4993-b576-2b14e1d9d9d1 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Calling method '.version_select at 0x7f6073648ee0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:28.263315 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5a1b4f2-adcb-4993-b576-2b14e1d9d9d1 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:28.266498 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5a1b4f2-adcb-4993-b576-2b14e1d9d9d1 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:28.268027 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f5a1b4f2-adcb-4993-b576-2b14e1d9d9d1 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] [instance: ad7eb6c8-eba3-4dfc-92d6-d09bf5280668] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:28.277320 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5a1b4f2-adcb-4993-b576-2b14e1d9d9d1 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:28.277886 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5a1b4f2-adcb-4993-b576-2b14e1d9d9d1 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:28.279198 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5a1b4f2-adcb-4993-b576-2b14e1d9d9d1 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:28.279714 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5a1b4f2-adcb-4993-b576-2b14e1d9d9d1 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:28.315102 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5a1b4f2-adcb-4993-b576-2b14e1d9d9d1 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:28.315787 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5a1b4f2-adcb-4993-b576-2b14e1d9d9d1 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:28.372184 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5a1b4f2-adcb-4993-b576-2b14e1d9d9d1 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:28.374206 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5a1b4f2-adcb-4993-b576-2b14e1d9d9d1 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:28.436590 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-f5a1b4f2-adcb-4993-b576-2b14e1d9d9d1 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lazy-loading 'flavor' on Instance uuid ad7eb6c8-eba3-4dfc-92d6-d09bf5280668 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:03:28.498992 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f5a1b4f2-adcb-4993-b576-2b14e1d9d9d1 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] 10.222.0.27 "PUT /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668/tags/tempest-tag-535388133" status: 201 len: 0 microversion: 2.26 time: 0.277198 Jun 20 12:03:28.500390 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 788/1524] 10.222.0.27 () {62 vars in 1376 bytes} [Mon Jun 20 12:03:28 2022] PUT /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668/tags/tempest-tag-535388133 => generated 0 bytes in 281 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Jun 20 12:03:28.809837 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0c14bbbb-62fe-4a9d-b331-cc4676419a4d tempest-SecurityGroupsNegativeTestJSON-449275478 tempest-SecurityGroupsNegativeTestJSON-449275478-project] Calling method '.version_select at 0x7f60736559d0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:28.919821 n-d-master-1 devstack@n-api.service[119127]: DEBUG neutronclient.v2_0.client [None req-0c14bbbb-62fe-4a9d-b331-cc4676419a4d tempest-SecurityGroupsNegativeTestJSON-449275478 tempest-SecurityGroupsNegativeTestJSON-449275478-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 38eed3e3-ca45-4755-87c3-f0407b7ea8a2 does not exist", "detail": ""}} {{(pid=119127) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 20 12:03:28.921435 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.security_group_api [None req-0c14bbbb-62fe-4a9d-b331-cc4676419a4d tempest-SecurityGroupsNegativeTestJSON-449275478 tempest-SecurityGroupsNegativeTestJSON-449275478-project] Neutron security group 38eed3e3-ca45-4755-87c3-f0407b7ea8a2 not found {{(pid=119127) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 20 12:03:28.921435 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-0c14bbbb-62fe-4a9d-b331-cc4676419a4d tempest-SecurityGroupsNegativeTestJSON-449275478 tempest-SecurityGroupsNegativeTestJSON-449275478-project] HTTP exception thrown: Security group 38eed3e3-ca45-4755-87c3-f0407b7ea8a2 does not exist Jun 20 12:03:28.921435 n-d-master-1 devstack@n-api.service[119127]: Neutron server returns request_ids: ['req-20125c17-adc3-49a2-a542-efc52e79dca7'] Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0c14bbbb-62fe-4a9d-b331-cc4676419a4d tempest-SecurityGroupsNegativeTestJSON-449275478 tempest-SecurityGroupsNegativeTestJSON-449275478-project] Request method failure captured: Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/os-security-groups/38eed3e3-ca45-4755-87c3-f0407b7ea8a2 HTTP/1.1 Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGIQuYrBkSfiR-SWn_N0IleaNc81tIqQ-SxBo3t1oSDkzQqxl9FLKyCBusrmvRTXFJbKj1t8UO5SlsfRP5Ox658Fk_pB6qSB_U08TSHpOowSN24wEs98vGAzyOHH6lgCrdj_NBEe1DdTfiDZt4Nq_sC84GpJw-QEvqJo6q9aVleQAQg Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: d1052626389b4889b99c292679b993dd Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-449275478 Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1052626389b4889b99c292679b993dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1052626389b4889b99c292679b993dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d1052626389b4889b99c292679b993dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d1052626389b4889b99c292679b993dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-449275478 Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: d1052626389b4889b99c292679b993dd Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-449275478 Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-SecurityGroupsNegativeTestJSON-449275478-project Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 59c5942044e843b68071eb5e3fa6601a Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-449275478-project Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: exception: Security group 38eed3e3-ca45-4755-87c3-f0407b7ea8a2 does not exist Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: Neutron server returns request_ids: ['req-20125c17-adc3-49a2-a542-efc52e79dca7'] Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '38eed3e3-ca45-4755-87c3-f0407b7ea8a2'} Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 20 12:03:28.923573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 38eed3e3-ca45-4755-87c3-f0407b7ea8a2 does not exist Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-20125c17-adc3-49a2-a542-efc52e79dca7'] Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 38eed3e3-ca45-4755-87c3-f0407b7ea8a2 does not exist Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-20125c17-adc3-49a2-a542-efc52e79dca7'] Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 38eed3e3-ca45-4755-87c3-f0407b7ea8a2 does not exist Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-20125c17-adc3-49a2-a542-efc52e79dca7'] Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 38eed3e3-ca45-4755-87c3-f0407b7ea8a2 does not exist Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-20125c17-adc3-49a2-a542-efc52e79dca7'] Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0c14bbbb-62fe-4a9d-b331-cc4676419a4d tempest-SecurityGroupsNegativeTestJSON-449275478 tempest-SecurityGroupsNegativeTestJSON-449275478-project] Returning 404 to user: Security group 38eed3e3-ca45-4755-87c3-f0407b7ea8a2 does not exist Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: Neutron server returns request_ids: ['req-20125c17-adc3-49a2-a542-efc52e79dca7'] {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:03:28.931186 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0c14bbbb-62fe-4a9d-b331-cc4676419a4d tempest-SecurityGroupsNegativeTestJSON-449275478 tempest-SecurityGroupsNegativeTestJSON-449275478-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/38eed3e3-ca45-4755-87c3-f0407b7ea8a2" status: 404 len: 194 microversion: 2.1 time: 0.419844 Jun 20 12:03:28.940765 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 789/1525] 10.222.0.27 () {58 vars in 1271 bytes} [Mon Jun 20 12:03:28 2022] DELETE /compute/v2.1/os-security-groups/38eed3e3-ca45-4755-87c3-f0407b7ea8a2 => generated 194 bytes in 431 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:03:28.940765 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dd43a9b7-9098-466e-83b5-c4b62edbe174 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Calling method '.version_select at 0x7f60736ba040>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:28.967091 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:28.973613 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd43a9b7-9098-466e-83b5-c4b62edbe174 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:28.974503 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd43a9b7-9098-466e-83b5-c4b62edbe174 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:28.975252 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dd43a9b7-9098-466e-83b5-c4b62edbe174 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] [instance: ad7eb6c8-eba3-4dfc-92d6-d09bf5280668] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:28.987560 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd43a9b7-9098-466e-83b5-c4b62edbe174 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:28.989853 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd43a9b7-9098-466e-83b5-c4b62edbe174 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:28.991354 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd43a9b7-9098-466e-83b5-c4b62edbe174 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:28.992017 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd43a9b7-9098-466e-83b5-c4b62edbe174 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:29.032953 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd43a9b7-9098-466e-83b5-c4b62edbe174 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:29.034011 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd43a9b7-9098-466e-83b5-c4b62edbe174 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:29.069184 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-dd43a9b7-9098-466e-83b5-c4b62edbe174 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lazy-loading 'flavor' on Instance uuid ad7eb6c8-eba3-4dfc-92d6-d09bf5280668 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:03:29.096298 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dd43a9b7-9098-466e-83b5-c4b62edbe174 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668/tags" status: 204 len: 0 microversion: 2.26 time: 0.162596 Jun 20 12:03:29.102875 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 790/1526] 10.222.0.27 () {60 vars in 1294 bytes} [Mon Jun 20 12:03:28 2022] DELETE /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668/tags => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 12:03:29.114518 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6c3c98af-d840-4ee3-9de4-28dedc5b9dbd tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:29.115705 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6c3c98af-d840-4ee3-9de4-28dedc5b9dbd tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 7cff5b7f-6801-45ae-b6bd-5e062ce73b18] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:29.122648 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c3c98af-d840-4ee3-9de4-28dedc5b9dbd tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:29.123996 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c3c98af-d840-4ee3-9de4-28dedc5b9dbd tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:29.128648 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c3c98af-d840-4ee3-9de4-28dedc5b9dbd tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:29.129682 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c3c98af-d840-4ee3-9de4-28dedc5b9dbd tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:30.008872 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6c3c98af-d840-4ee3-9de4-28dedc5b9dbd tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:30.021789 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6c3c98af-d840-4ee3-9de4-28dedc5b9dbd tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18" status: 200 len: 1314 microversion: 2.1 time: 0.916652 Jun 20 12:03:30.022660 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 791/1527] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:29 2022] GET /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18 => generated 1314 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:30.032525 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f2f301cd-22c4-48aa-a792-305fed875b1a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:30.034634 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f2f301cd-22c4-48aa-a792-305fed875b1a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: d348abab-aae7-4b81-84db-f856c9cf4907] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:30.051521 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f2f301cd-22c4-48aa-a792-305fed875b1a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:30.053085 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f2f301cd-22c4-48aa-a792-305fed875b1a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:30.056430 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f2f301cd-22c4-48aa-a792-305fed875b1a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:30.057466 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f2f301cd-22c4-48aa-a792-305fed875b1a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:30.642300 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f2f301cd-22c4-48aa-a792-305fed875b1a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:30.655522 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f2f301cd-22c4-48aa-a792-305fed875b1a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907" status: 200 len: 1310 microversion: 2.1 time: 0.628693 Jun 20 12:03:30.657064 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 792/1528] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:30 2022] GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907 => generated 1310 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:30.677168 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-29cda5db-48c0-48d9-b0f6-d14f439fc035 tempest-SecurityGroupsNegativeTestJSON-449275478 tempest-SecurityGroupsNegativeTestJSON-449275478-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.018553 Jun 20 12:03:30.677812 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 793/1529] 10.222.0.27 () {58 vars in 1163 bytes} [Mon Jun 20 12:03:30 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 20 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 20 12:03:30.688399 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fe8553c5-1248-4fb3-a5c8-a0409f07f266 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Calling method '.version_select at 0x7f6073655430>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:30.710544 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fe8553c5-1248-4fb3-a5c8-a0409f07f266 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:30.711007 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fe8553c5-1248-4fb3-a5c8-a0409f07f266 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:30.738174 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fe8553c5-1248-4fb3-a5c8-a0409f07f266 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] 10.222.0.27 "GET /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668/tags" status: 200 len: 12 microversion: 2.26 time: 0.058843 Jun 20 12:03:30.739065 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 794/1530] 10.222.0.27 () {60 vars in 1291 bytes} [Mon Jun 20 12:03:30 2022] GET /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668/tags => generated 12 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:30.756982 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9ef64837-5715-46cc-b296-333136b97917 tempest-SecurityGroupsNegativeTestJSON-449275478 tempest-SecurityGroupsNegativeTestJSON-449275478-project] Calling method '.version_select at 0x7f60736f3e50>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:31.574297 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9ef64837-5715-46cc-b296-333136b97917 tempest-SecurityGroupsNegativeTestJSON-449275478 tempest-SecurityGroupsNegativeTestJSON-449275478-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.831174 Jun 20 12:03:31.576065 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 795/1531] 10.222.0.27 () {58 vars in 1157 bytes} [Mon Jun 20 12:03:30 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:03:31.583348 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-386a8349-3341-41d0-ba4b-ba218c4b3d67 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Calling method '.version_select at 0x7f60736a6550>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:31.604756 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-386a8349-3341-41d0-ba4b-ba218c4b3d67 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:31.608459 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-386a8349-3341-41d0-ba4b-ba218c4b3d67 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:31.609379 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-386a8349-3341-41d0-ba4b-ba218c4b3d67 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] [instance: ad7eb6c8-eba3-4dfc-92d6-d09bf5280668] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:31.628489 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-386a8349-3341-41d0-ba4b-ba218c4b3d67 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:31.629334 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-386a8349-3341-41d0-ba4b-ba218c4b3d67 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:31.630543 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-386a8349-3341-41d0-ba4b-ba218c4b3d67 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:31.634558 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-386a8349-3341-41d0-ba4b-ba218c4b3d67 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:31.689383 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-386a8349-3341-41d0-ba4b-ba218c4b3d67 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:31.690176 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-386a8349-3341-41d0-ba4b-ba218c4b3d67 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:31.719049 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-386a8349-3341-41d0-ba4b-ba218c4b3d67 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lazy-loading 'flavor' on Instance uuid ad7eb6c8-eba3-4dfc-92d6-d09bf5280668 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:03:31.756608 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-386a8349-3341-41d0-ba4b-ba218c4b3d67 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668/tags" status: 204 len: 0 microversion: 2.26 time: 0.177937 Jun 20 12:03:31.758893 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 796/1532] 10.222.0.27 () {60 vars in 1294 bytes} [Mon Jun 20 12:03:31 2022] DELETE /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668/tags => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 12:03:31.770286 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-9d2264b6-5cbd-4bcc-9c3a-95986fc96fe0 req-cbf83915-dfb8-44f5-b886-22ba739d884e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d348abab-aae7-4b81-84db-f856c9cf4907", "tag": "adf99a3e-442f-4468-a4d4-3b83b4155c6c"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:03:31.789193 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-9d2264b6-5cbd-4bcc-9c3a-95986fc96fe0 req-cbf83915-dfb8-44f5-b886-22ba739d884e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:31.790134 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-9d2264b6-5cbd-4bcc-9c3a-95986fc96fe0 req-cbf83915-dfb8-44f5-b886-22ba739d884e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:31.818906 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-9d2264b6-5cbd-4bcc-9c3a-95986fc96fe0 req-cbf83915-dfb8-44f5-b886-22ba739d884e service nova] Creating event network-changed:adf99a3e-442f-4468-a4d4-3b83b4155c6c for instance d348abab-aae7-4b81-84db-f856c9cf4907 on n-h2-master-1 Jun 20 12:03:31.828553 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-9d2264b6-5cbd-4bcc-9c3a-95986fc96fe0 req-cbf83915-dfb8-44f5-b886-22ba739d884e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067927 Jun 20 12:03:31.831412 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 797/1533] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:03:31.839894 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9d5b88ce-616d-44ff-a88f-8079bbd92682 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:31.847514 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9d5b88ce-616d-44ff-a88f-8079bbd92682 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 7cff5b7f-6801-45ae-b6bd-5e062ce73b18] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:31.857516 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9d5b88ce-616d-44ff-a88f-8079bbd92682 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:31.868891 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9d5b88ce-616d-44ff-a88f-8079bbd92682 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:31.870184 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9d5b88ce-616d-44ff-a88f-8079bbd92682 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:31.870875 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9d5b88ce-616d-44ff-a88f-8079bbd92682 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:32.078487 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3c5a1c53-ed52-4879-b9c4-8301b435c3c3 tempest-FloatingIPDetailsTestJSON-271562628 tempest-FloatingIPDetailsTestJSON-271562628-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.044941 Jun 20 12:03:32.093151 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 737/1534] 10.222.0.27 () {60 vars in 1169 bytes} [Mon Jun 20 12:03:28 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4055 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:03:32.093151 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-11c0f874-a099-4975-b7e5-2c32a28f297e tempest-SecurityGroupsNegativeTestJSON-449275478 tempest-SecurityGroupsNegativeTestJSON-449275478-project] Calling method '.version_select at 0x7f607350cca0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:32.374867 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9d5b88ce-616d-44ff-a88f-8079bbd92682 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:32.383653 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=7 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:32.388609 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9d5b88ce-616d-44ff-a88f-8079bbd92682 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18" status: 200 len: 1314 microversion: 2.1 time: 0.550745 Jun 20 12:03:32.390068 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 798/1535] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:31 2022] GET /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18 => generated 1314 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:32.401501 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=51 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:32.402039 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4d43671a-44c4-404e-88f2-250e59461a9e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:32.402896 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4d43671a-44c4-404e-88f2-250e59461a9e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: d348abab-aae7-4b81-84db-f856c9cf4907] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:32.428843 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d43671a-44c4-404e-88f2-250e59461a9e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:32.429307 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d43671a-44c4-404e-88f2-250e59461a9e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:32.430104 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d43671a-44c4-404e-88f2-250e59461a9e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:32.430462 n-d-master-1 devstack@n-api.service[119128]: DEBUG neutronclient.v2_0.client [None req-11c0f874-a099-4975-b7e5-2c32a28f297e tempest-SecurityGroupsNegativeTestJSON-449275478 tempest-SecurityGroupsNegativeTestJSON-449275478-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=119128) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 20 12:03:32.430644 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d43671a-44c4-404e-88f2-250e59461a9e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:32.431224 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-11c0f874-a099-4975-b7e5-2c32a28f297e tempest-SecurityGroupsNegativeTestJSON-449275478 tempest-SecurityGroupsNegativeTestJSON-449275478-project] HTTP exception thrown: Insufficient rights for removing default security group. Jun 20 12:03:32.431224 n-d-master-1 devstack@n-api.service[119128]: Neutron server returns request_ids: ['req-16b605c6-1767-4ecb-949a-8aae53ea093e'] Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-11c0f874-a099-4975-b7e5-2c32a28f297e tempest-SecurityGroupsNegativeTestJSON-449275478 tempest-SecurityGroupsNegativeTestJSON-449275478-project] Request method failure captured: Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/os-security-groups/3b3a7e99-9557-4864-8a77-cc019da3b32e HTTP/1.1 Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGIQuYrBkSfiR-SWn_N0IleaNc81tIqQ-SxBo3t1oSDkzQqxl9FLKyCBusrmvRTXFJbKj1t8UO5SlsfRP5Ox658Fk_pB6qSB_U08TSHpOowSN24wEs98vGAzyOHH6lgCrdj_NBEe1DdTfiDZt4Nq_sC84GpJw-QEvqJo6q9aVleQAQg Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: d1052626389b4889b99c292679b993dd Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-449275478 Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1052626389b4889b99c292679b993dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1052626389b4889b99c292679b993dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d1052626389b4889b99c292679b993dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d1052626389b4889b99c292679b993dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-449275478 Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: d1052626389b4889b99c292679b993dd Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-449275478 Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-SecurityGroupsNegativeTestJSON-449275478-project Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 59c5942044e843b68071eb5e3fa6601a Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-449275478-project Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: exception: Insufficient rights for removing default security group. Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: Neutron server returns request_ids: ['req-16b605c6-1767-4ecb-949a-8aae53ea093e'] Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '3b3a7e99-9557-4864-8a77-cc019da3b32e'} Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 20 12:03:32.434256 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-16b605c6-1767-4ecb-949a-8aae53ea093e'] Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-16b605c6-1767-4ecb-949a-8aae53ea093e'] Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-16b605c6-1767-4ecb-949a-8aae53ea093e'] Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-16b605c6-1767-4ecb-949a-8aae53ea093e'] Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-11c0f874-a099-4975-b7e5-2c32a28f297e tempest-SecurityGroupsNegativeTestJSON-449275478 tempest-SecurityGroupsNegativeTestJSON-449275478-project] Returning 400 to user: Insufficient rights for removing default security group. Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: Neutron server returns request_ids: ['req-16b605c6-1767-4ecb-949a-8aae53ea093e'] {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:03:32.439291 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-11c0f874-a099-4975-b7e5-2c32a28f297e tempest-SecurityGroupsNegativeTestJSON-449275478 tempest-SecurityGroupsNegativeTestJSON-449275478-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/3b3a7e99-9557-4864-8a77-cc019da3b32e" status: 400 len: 182 microversion: 2.1 time: 0.347263 Jun 20 12:03:32.447784 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 738/1536] 10.222.0.27 () {58 vars in 1271 bytes} [Mon Jun 20 12:03:32 2022] DELETE /compute/v2.1/os-security-groups/3b3a7e99-9557-4864-8a77-cc019da3b32e => generated 182 bytes in 360 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:03:32.456255 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-afd767d3-9d94-49e9-a21c-0704e2ab4db7 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Calling method '.version_select at 0x7f60733ff1f0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:32.470377 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-afd767d3-9d94-49e9-a21c-0704e2ab4db7 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:32.472824 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-afd767d3-9d94-49e9-a21c-0704e2ab4db7 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:32.474459 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-afd767d3-9d94-49e9-a21c-0704e2ab4db7 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] [instance: ad7eb6c8-eba3-4dfc-92d6-d09bf5280668] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:32.484070 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-afd767d3-9d94-49e9-a21c-0704e2ab4db7 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:32.485094 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-afd767d3-9d94-49e9-a21c-0704e2ab4db7 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:32.486167 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-afd767d3-9d94-49e9-a21c-0704e2ab4db7 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:32.486878 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-afd767d3-9d94-49e9-a21c-0704e2ab4db7 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:32.522563 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-afd767d3-9d94-49e9-a21c-0704e2ab4db7 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:32.523115 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-afd767d3-9d94-49e9-a21c-0704e2ab4db7 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:32.543518 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-afd767d3-9d94-49e9-a21c-0704e2ab4db7 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:32.545363 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-afd767d3-9d94-49e9-a21c-0704e2ab4db7 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:32.597860 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-afd767d3-9d94-49e9-a21c-0704e2ab4db7 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lazy-loading 'flavor' on Instance uuid ad7eb6c8-eba3-4dfc-92d6-d09bf5280668 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:03:32.719964 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-afd767d3-9d94-49e9-a21c-0704e2ab4db7 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] 10.222.0.27 "PUT /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668/tags/tempest-tag-676200349" status: 201 len: 0 microversion: 2.26 time: 0.265228 Jun 20 12:03:32.726428 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 739/1537] 10.222.0.27 () {62 vars in 1376 bytes} [Mon Jun 20 12:03:32 2022] PUT /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668/tags/tempest-tag-676200349 => generated 0 bytes in 272 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jun 20 12:03:32.737594 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d21a1d82-3b68-4d36-964b-e93c5d6510e3 tempest-FloatingIPDetailsTestJSON-271562628 tempest-FloatingIPDetailsTestJSON-271562628-project] Calling method '.version_select at 0x7f60733281f0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:33.151834 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4d43671a-44c4-404e-88f2-250e59461a9e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:33.166496 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4d43671a-44c4-404e-88f2-250e59461a9e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907" status: 200 len: 1310 microversion: 2.1 time: 0.774796 Jun 20 12:03:33.169247 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 799/1538] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:32 2022] GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907 => generated 1310 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:33.188128 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-30c6bc48-9b7c-4af8-b290-58578c3b9537 tempest-SecurityGroupsNegativeTestJSON-449275478 tempest-SecurityGroupsNegativeTestJSON-449275478-project] Calling method '.version_select at 0x7f6073738e50>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:33.195984 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d21a1d82-3b68-4d36-964b-e93c5d6510e3 tempest-FloatingIPDetailsTestJSON-271562628 tempest-FloatingIPDetailsTestJSON-271562628-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/539384f2-e795-4e91-b05f-e5ee58bf463d" status: 200 len: 142 microversion: 2.1 time: 0.464431 Jun 20 12:03:33.196936 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 740/1539] 10.222.0.27 () {58 vars in 1259 bytes} [Mon Jun 20 12:03:32 2022] GET /compute/v2.1/os-floating-ips/539384f2-e795-4e91-b05f-e5ee58bf463d => generated 142 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:03:33.208970 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-fdb214d1-cb7d-4293-9fee-f4e2bafc9b9d req-1eb93e41-3825-4722-96ec-5cd7a181558d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cff5b7f-6801-45ae-b6bd-5e062ce73b18", "name": "network-vif-plugged", "status": "completed", "tag": "13b8fe10-f2db-4e80-8847-a189ff6fe1c7"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:03:33.222698 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-fdb214d1-cb7d-4293-9fee-f4e2bafc9b9d req-1eb93e41-3825-4722-96ec-5cd7a181558d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:33.223206 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-fdb214d1-cb7d-4293-9fee-f4e2bafc9b9d req-1eb93e41-3825-4722-96ec-5cd7a181558d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:33.249822 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-fdb214d1-cb7d-4293-9fee-f4e2bafc9b9d req-1eb93e41-3825-4722-96ec-5cd7a181558d service nova] Creating event network-vif-plugged:13b8fe10-f2db-4e80-8847-a189ff6fe1c7 for instance 7cff5b7f-6801-45ae-b6bd-5e062ce73b18 on n-h2-master-1 Jun 20 12:03:33.258544 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-fdb214d1-cb7d-4293-9fee-f4e2bafc9b9d req-1eb93e41-3825-4722-96ec-5cd7a181558d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059179 Jun 20 12:03:33.259158 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 741/1540] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:03:33.266927 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-de4f6c14-897f-4f52-872f-ecda90356be1 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Calling method '.version_select at 0x7f6073324040>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:33.276518 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-de4f6c14-897f-4f52-872f-ecda90356be1 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:33.277256 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-de4f6c14-897f-4f52-872f-ecda90356be1 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:33.278016 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-de4f6c14-897f-4f52-872f-ecda90356be1 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] [instance: ad7eb6c8-eba3-4dfc-92d6-d09bf5280668] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:33.285189 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-de4f6c14-897f-4f52-872f-ecda90356be1 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:33.285817 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-de4f6c14-897f-4f52-872f-ecda90356be1 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:33.286923 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-de4f6c14-897f-4f52-872f-ecda90356be1 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:33.287530 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-de4f6c14-897f-4f52-872f-ecda90356be1 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:33.303579 n-d-master-1 devstack@n-api.service[119127]: DEBUG neutronclient.v2_0.client [None req-30c6bc48-9b7c-4af8-b290-58578c3b9537 tempest-SecurityGroupsNegativeTestJSON-449275478 tempest-SecurityGroupsNegativeTestJSON-449275478-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 421d9ba3-1a01-4cbc-8cb7-8e771f60b8f2 does not exist", "detail": ""}} {{(pid=119127) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 20 12:03:33.304335 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.security_group_api [None req-30c6bc48-9b7c-4af8-b290-58578c3b9537 tempest-SecurityGroupsNegativeTestJSON-449275478 tempest-SecurityGroupsNegativeTestJSON-449275478-project] Neutron security group 421d9ba3-1a01-4cbc-8cb7-8e771f60b8f2 not found {{(pid=119127) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 20 12:03:33.305200 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-30c6bc48-9b7c-4af8-b290-58578c3b9537 tempest-SecurityGroupsNegativeTestJSON-449275478 tempest-SecurityGroupsNegativeTestJSON-449275478-project] HTTP exception thrown: Security group 421d9ba3-1a01-4cbc-8cb7-8e771f60b8f2 does not exist Jun 20 12:03:33.305200 n-d-master-1 devstack@n-api.service[119127]: Neutron server returns request_ids: ['req-cb950a4c-4bf0-4ac4-9594-306d9f70a536'] Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-30c6bc48-9b7c-4af8-b290-58578c3b9537 tempest-SecurityGroupsNegativeTestJSON-449275478 tempest-SecurityGroupsNegativeTestJSON-449275478-project] Request method failure captured: Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/os-security-groups/421d9ba3-1a01-4cbc-8cb7-8e771f60b8f2 HTTP/1.1 Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGIQuYrBkSfiR-SWn_N0IleaNc81tIqQ-SxBo3t1oSDkzQqxl9FLKyCBusrmvRTXFJbKj1t8UO5SlsfRP5Ox658Fk_pB6qSB_U08TSHpOowSN24wEs98vGAzyOHH6lgCrdj_NBEe1DdTfiDZt4Nq_sC84GpJw-QEvqJo6q9aVleQAQg Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: d1052626389b4889b99c292679b993dd Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-449275478 Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1052626389b4889b99c292679b993dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1052626389b4889b99c292679b993dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d1052626389b4889b99c292679b993dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d1052626389b4889b99c292679b993dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-449275478 Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: d1052626389b4889b99c292679b993dd Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-449275478 Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-SecurityGroupsNegativeTestJSON-449275478-project Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 59c5942044e843b68071eb5e3fa6601a Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-449275478-project Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: exception: Security group 421d9ba3-1a01-4cbc-8cb7-8e771f60b8f2 does not exist Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: Neutron server returns request_ids: ['req-cb950a4c-4bf0-4ac4-9594-306d9f70a536'] Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '421d9ba3-1a01-4cbc-8cb7-8e771f60b8f2'} Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 20 12:03:33.307706 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 421d9ba3-1a01-4cbc-8cb7-8e771f60b8f2 does not exist Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb950a4c-4bf0-4ac4-9594-306d9f70a536'] Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 421d9ba3-1a01-4cbc-8cb7-8e771f60b8f2 does not exist Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb950a4c-4bf0-4ac4-9594-306d9f70a536'] Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 421d9ba3-1a01-4cbc-8cb7-8e771f60b8f2 does not exist Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb950a4c-4bf0-4ac4-9594-306d9f70a536'] Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 421d9ba3-1a01-4cbc-8cb7-8e771f60b8f2 does not exist Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb950a4c-4bf0-4ac4-9594-306d9f70a536'] Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-30c6bc48-9b7c-4af8-b290-58578c3b9537 tempest-SecurityGroupsNegativeTestJSON-449275478 tempest-SecurityGroupsNegativeTestJSON-449275478-project] Returning 404 to user: Security group 421d9ba3-1a01-4cbc-8cb7-8e771f60b8f2 does not exist Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: Neutron server returns request_ids: ['req-cb950a4c-4bf0-4ac4-9594-306d9f70a536'] {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-30c6bc48-9b7c-4af8-b290-58578c3b9537 tempest-SecurityGroupsNegativeTestJSON-449275478 tempest-SecurityGroupsNegativeTestJSON-449275478-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/421d9ba3-1a01-4cbc-8cb7-8e771f60b8f2" status: 404 len: 194 microversion: 2.1 time: 0.136953 Jun 20 12:03:33.320924 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 800/1541] 10.222.0.27 () {58 vars in 1268 bytes} [Mon Jun 20 12:03:33 2022] GET /compute/v2.1/os-security-groups/421d9ba3-1a01-4cbc-8cb7-8e771f60b8f2 => generated 194 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:03:33.324479 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-de4f6c14-897f-4f52-872f-ecda90356be1 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:33.324479 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-de4f6c14-897f-4f52-872f-ecda90356be1 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:33.324677 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3012805b-d830-4189-bab8-440345fc7731 tempest-FloatingIPDetailsTestJSON-271562628 tempest-FloatingIPDetailsTestJSON-271562628-project] Calling method '.version_select at 0x7f6073655f70>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:33.332723 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-de4f6c14-897f-4f52-872f-ecda90356be1 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:33.333526 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-de4f6c14-897f-4f52-872f-ecda90356be1 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:33.377030 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-de4f6c14-897f-4f52-872f-ecda90356be1 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lazy-loading 'flavor' on Instance uuid ad7eb6c8-eba3-4dfc-92d6-d09bf5280668 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:03:33.419111 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-de4f6c14-897f-4f52-872f-ecda90356be1 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] 10.222.0.27 "PUT /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668/tags/tempest-tag-1022613928" status: 201 len: 0 microversion: 2.26 time: 0.158469 Jun 20 12:03:33.429731 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 742/1542] 10.222.0.27 () {62 vars in 1379 bytes} [Mon Jun 20 12:03:33 2022] PUT /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668/tags/tempest-tag-1022613928 => generated 0 bytes in 170 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jun 20 12:03:33.437195 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e4a2c291-dc4b-4ed3-92e3-d160ae076d2d tempest-SecurityGroupsNegativeTestJSON-449275478 tempest-SecurityGroupsNegativeTestJSON-449275478-project] Action: 'update', calling method: .version_select at 0x7f60733f7790>, body: {"security_group": {"name": "tempest-sg-1828811667", "description": "tempest-description-15860674"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:03:33.463901 n-d-master-1 devstack@n-api.service[119128]: DEBUG neutronclient.v2_0.client [None req-e4a2c291-dc4b-4ed3-92e3-d160ae076d2d tempest-SecurityGroupsNegativeTestJSON-449275478 tempest-SecurityGroupsNegativeTestJSON-449275478-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ab8005f6-88bf-494f-899d-5cb76bf92bda does not exist", "detail": ""}} {{(pid=119128) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 20 12:03:33.464932 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.security_group_api [None req-e4a2c291-dc4b-4ed3-92e3-d160ae076d2d tempest-SecurityGroupsNegativeTestJSON-449275478 tempest-SecurityGroupsNegativeTestJSON-449275478-project] Neutron security group ab8005f6-88bf-494f-899d-5cb76bf92bda not found {{(pid=119128) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 20 12:03:33.476544 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-e4a2c291-dc4b-4ed3-92e3-d160ae076d2d tempest-SecurityGroupsNegativeTestJSON-449275478 tempest-SecurityGroupsNegativeTestJSON-449275478-project] HTTP exception thrown: Security group ab8005f6-88bf-494f-899d-5cb76bf92bda does not exist Jun 20 12:03:33.476544 n-d-master-1 devstack@n-api.service[119128]: Neutron server returns request_ids: ['req-c2692170-45f1-43c4-96b0-20d0b26dcfa8'] Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e4a2c291-dc4b-4ed3-92e3-d160ae076d2d tempest-SecurityGroupsNegativeTestJSON-449275478 tempest-SecurityGroupsNegativeTestJSON-449275478-project] Request method failure captured: Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: request: PUT /compute/v2.1/os-security-groups/ab8005f6-88bf-494f-899d-5cb76bf92bda HTTP/1.1 Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 100 Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGIQuYrBkSfiR-SWn_N0IleaNc81tIqQ-SxBo3t1oSDkzQqxl9FLKyCBusrmvRTXFJbKj1t8UO5SlsfRP5Ox658Fk_pB6qSB_U08TSHpOowSN24wEs98vGAzyOHH6lgCrdj_NBEe1DdTfiDZt4Nq_sC84GpJw-QEvqJo6q9aVleQAQg Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: d1052626389b4889b99c292679b993dd Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-449275478 Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1052626389b4889b99c292679b993dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d1052626389b4889b99c292679b993dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d1052626389b4889b99c292679b993dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d1052626389b4889b99c292679b993dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-449275478 Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: d1052626389b4889b99c292679b993dd Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-449275478 Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-SecurityGroupsNegativeTestJSON-449275478-project Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 59c5942044e843b68071eb5e3fa6601a Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-449275478-project Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: {"security_group": {"name": "tempest-sg-1828811667", "description": "tempest-description-15860674"}} Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: exception: Security group ab8005f6-88bf-494f-899d-5cb76bf92bda does not exist Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: Neutron server returns request_ids: ['req-c2692170-45f1-43c4-96b0-20d0b26dcfa8'] Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'ab8005f6-88bf-494f-899d-5cb76bf92bda', 'body': {'security_group': {'name': 'tempest-sg-1828811667', 'description': 'tempest-description-15860674'}}} Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 20 12:03:33.481447 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 20 12:03:33.486868 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 20 12:03:33.486868 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ab8005f6-88bf-494f-899d-5cb76bf92bda does not exist Jun 20 12:03:33.486868 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c2692170-45f1-43c4-96b0-20d0b26dcfa8'] Jun 20 12:03:33.486868 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:03:33.486868 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:03:33.486868 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:03:33.486868 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:03:33.486868 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Jun 20 12:03:33.486868 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 20 12:03:33.486868 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 20 12:03:33.486868 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 20 12:03:33.486868 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ab8005f6-88bf-494f-899d-5cb76bf92bda does not exist Jun 20 12:03:33.486868 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c2692170-45f1-43c4-96b0-20d0b26dcfa8'] Jun 20 12:03:33.486868 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:03:33.486868 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:03:33.486868 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:03:33.486868 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:03:33.486868 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:03:33.486868 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:03:33.486868 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:03:33.486868 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:03:33.486868 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:03:33.486868 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:03:33.486868 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:03:33.486868 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:03:33.486868 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Jun 20 12:03:33.486868 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 20 12:03:33.486868 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ab8005f6-88bf-494f-899d-5cb76bf92bda does not exist Jun 20 12:03:33.486868 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c2692170-45f1-43c4-96b0-20d0b26dcfa8'] Jun 20 12:03:33.486868 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:03:33.486868 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:03:33.486868 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:03:33.486868 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:03:33.486868 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:03:33.486868 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:03:33.486868 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:03:33.486868 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:03:33.486868 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ab8005f6-88bf-494f-899d-5cb76bf92bda does not exist Jun 20 12:03:33.486868 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c2692170-45f1-43c4-96b0-20d0b26dcfa8'] Jun 20 12:03:33.486868 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:03:33.495384 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e4a2c291-dc4b-4ed3-92e3-d160ae076d2d tempest-SecurityGroupsNegativeTestJSON-449275478 tempest-SecurityGroupsNegativeTestJSON-449275478-project] Returning 404 to user: Security group ab8005f6-88bf-494f-899d-5cb76bf92bda does not exist Jun 20 12:03:33.495384 n-d-master-1 devstack@n-api.service[119128]: Neutron server returns request_ids: ['req-c2692170-45f1-43c4-96b0-20d0b26dcfa8'] {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:03:33.495384 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e4a2c291-dc4b-4ed3-92e3-d160ae076d2d tempest-SecurityGroupsNegativeTestJSON-449275478 tempest-SecurityGroupsNegativeTestJSON-449275478-project] 10.222.0.27 "PUT /compute/v2.1/os-security-groups/ab8005f6-88bf-494f-899d-5cb76bf92bda" status: 404 len: 194 microversion: 2.1 time: 0.063457 Jun 20 12:03:33.496242 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 743/1543] 10.222.0.27 () {60 vars in 1289 bytes} [Mon Jun 20 12:03:33 2022] PUT /compute/v2.1/os-security-groups/ab8005f6-88bf-494f-899d-5cb76bf92bda => generated 194 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:03:33.502498 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b635fbc0-9004-458a-a6d2-9d9c83cfa4a9 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:33.503927 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b635fbc0-9004-458a-a6d2-9d9c83cfa4a9 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 7cff5b7f-6801-45ae-b6bd-5e062ce73b18] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:33.516976 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b635fbc0-9004-458a-a6d2-9d9c83cfa4a9 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:33.517612 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b635fbc0-9004-458a-a6d2-9d9c83cfa4a9 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:33.518728 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b635fbc0-9004-458a-a6d2-9d9c83cfa4a9 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:33.519349 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b635fbc0-9004-458a-a6d2-9d9c83cfa4a9 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:33.770289 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b635fbc0-9004-458a-a6d2-9d9c83cfa4a9 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:33.798432 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b635fbc0-9004-458a-a6d2-9d9c83cfa4a9 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18" status: 200 len: 1314 microversion: 2.1 time: 0.300569 Jun 20 12:03:33.809765 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 744/1544] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:33 2022] GET /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:33.832244 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-51fc13bf-49e4-4040-9377-88881bda96bd tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Action: 'update_all', calling method: .version_select at 0x7f60733f7310>, body: {"tags": ["tempest-tag-416712834", "tempest-tag-324766043"]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:03:33.855946 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-51fc13bf-49e4-4040-9377-88881bda96bd tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:33.856736 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-51fc13bf-49e4-4040-9377-88881bda96bd tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:33.857118 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-51fc13bf-49e4-4040-9377-88881bda96bd tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] [instance: ad7eb6c8-eba3-4dfc-92d6-d09bf5280668] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:33.868888 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-51fc13bf-49e4-4040-9377-88881bda96bd tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:33.869543 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-51fc13bf-49e4-4040-9377-88881bda96bd tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:33.870642 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-51fc13bf-49e4-4040-9377-88881bda96bd tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:33.871401 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-51fc13bf-49e4-4040-9377-88881bda96bd tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:33.904324 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-51fc13bf-49e4-4040-9377-88881bda96bd tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:33.905390 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-51fc13bf-49e4-4040-9377-88881bda96bd tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:33.941363 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-51fc13bf-49e4-4040-9377-88881bda96bd tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lazy-loading 'flavor' on Instance uuid ad7eb6c8-eba3-4dfc-92d6-d09bf5280668 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:03:33.981129 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-51fc13bf-49e4-4040-9377-88881bda96bd tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] 10.222.0.27 "PUT /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668/tags" status: 200 len: 60 microversion: 2.26 time: 0.179559 Jun 20 12:03:33.982325 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 745/1545] 10.222.0.27 () {62 vars in 1311 bytes} [Mon Jun 20 12:03:33 2022] PUT /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668/tags => generated 60 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:33.993339 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1e9a782d-ee47-4286-ae8f-46e21eb82778 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Calling method '.version_select at 0x7f6073306940>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:34.013544 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e9a782d-ee47-4286-ae8f-46e21eb82778 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:34.014305 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e9a782d-ee47-4286-ae8f-46e21eb82778 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:34.028994 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1e9a782d-ee47-4286-ae8f-46e21eb82778 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] 10.222.0.27 "GET /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668/tags" status: 200 len: 60 microversion: 2.26 time: 0.040266 Jun 20 12:03:34.037632 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 746/1546] 10.222.0.27 () {60 vars in 1291 bytes} [Mon Jun 20 12:03:33 2022] GET /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668/tags => generated 60 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:34.049939 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3f149d28-1712-4c28-9531-9d66585d6c53 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Calling method '.version_select at 0x7f60733bb8b0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:34.074859 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3f149d28-1712-4c28-9531-9d66585d6c53 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:34.075713 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3f149d28-1712-4c28-9531-9d66585d6c53 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:34.076450 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3f149d28-1712-4c28-9531-9d66585d6c53 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] [instance: ad7eb6c8-eba3-4dfc-92d6-d09bf5280668] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:34.085819 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3f149d28-1712-4c28-9531-9d66585d6c53 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:34.086789 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3f149d28-1712-4c28-9531-9d66585d6c53 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:34.087840 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3f149d28-1712-4c28-9531-9d66585d6c53 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:34.088475 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3f149d28-1712-4c28-9531-9d66585d6c53 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:34.172668 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3f149d28-1712-4c28-9531-9d66585d6c53 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:34.173125 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3f149d28-1712-4c28-9531-9d66585d6c53 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:34.207700 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-3f149d28-1712-4c28-9531-9d66585d6c53 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lazy-loading 'flavor' on Instance uuid ad7eb6c8-eba3-4dfc-92d6-d09bf5280668 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:03:34.230180 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3f149d28-1712-4c28-9531-9d66585d6c53 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668/tags" status: 204 len: 0 microversion: 2.26 time: 0.190832 Jun 20 12:03:34.235729 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 747/1547] 10.222.0.27 () {60 vars in 1294 bytes} [Mon Jun 20 12:03:34 2022] DELETE /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668/tags => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 12:03:34.249663 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ba4e8d2d-3025-4459-a124-630a69f8c829 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:34.250585 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ba4e8d2d-3025-4459-a124-630a69f8c829 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: d348abab-aae7-4b81-84db-f856c9cf4907] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:34.271208 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba4e8d2d-3025-4459-a124-630a69f8c829 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:34.271651 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba4e8d2d-3025-4459-a124-630a69f8c829 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:34.272655 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba4e8d2d-3025-4459-a124-630a69f8c829 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:34.273436 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba4e8d2d-3025-4459-a124-630a69f8c829 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:34.409790 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:34.483479 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:35.172264 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ba4e8d2d-3025-4459-a124-630a69f8c829 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:35.187901 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ba4e8d2d-3025-4459-a124-630a69f8c829 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907" status: 200 len: 1310 microversion: 2.1 time: 0.949281 Jun 20 12:03:35.189761 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 748/1548] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:34 2022] GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907 => generated 1310 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:35.203302 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bd69991b-2120-4c22-a9f2-0c0b8d83011b tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:35.206043 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bd69991b-2120-4c22-a9f2-0c0b8d83011b tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] [instance: ad7eb6c8-eba3-4dfc-92d6-d09bf5280668] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:35.223171 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bd69991b-2120-4c22-a9f2-0c0b8d83011b tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:35.226149 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bd69991b-2120-4c22-a9f2-0c0b8d83011b tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:35.229282 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bd69991b-2120-4c22-a9f2-0c0b8d83011b tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:35.230052 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bd69991b-2120-4c22-a9f2-0c0b8d83011b tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:35.272111 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bd69991b-2120-4c22-a9f2-0c0b8d83011b tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] [instance: ad7eb6c8-eba3-4dfc-92d6-d09bf5280668] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:03:35.405008 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3012805b-d830-4189-bab8-440345fc7731 tempest-FloatingIPDetailsTestJSON-271562628 tempest-FloatingIPDetailsTestJSON-271562628-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/539384f2-e795-4e91-b05f-e5ee58bf463d" status: 202 len: 0 microversion: 2.1 time: 2.091638 Jun 20 12:03:35.405710 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 801/1549] 10.222.0.27 () {58 vars in 1262 bytes} [Mon Jun 20 12:03:33 2022] DELETE /compute/v2.1/os-floating-ips/539384f2-e795-4e91-b05f-e5ee58bf463d => generated 0 bytes in 2094 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:03:35.424473 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f4f2d64a-a259-47a5-a1c4-548e9318e6a1 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:35.441710 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f4f2d64a-a259-47a5-a1c4-548e9318e6a1 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 7cff5b7f-6801-45ae-b6bd-5e062ce73b18] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:35.468743 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bd69991b-2120-4c22-a9f2-0c0b8d83011b tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668" status: 204 len: 0 microversion: 2.26 time: 0.274854 Jun 20 12:03:35.470768 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f4f2d64a-a259-47a5-a1c4-548e9318e6a1 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:35.472932 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 749/1550] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Jun 20 12:03:35 2022] DELETE /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 12:03:35.478710 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f4f2d64a-a259-47a5-a1c4-548e9318e6a1 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:35.480740 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f4f2d64a-a259-47a5-a1c4-548e9318e6a1 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:35.484901 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9cb54a01-a67e-41dd-89f0-5ebede769ff5 tempest-FloatingIPDetailsTestJSON-271562628 tempest-FloatingIPDetailsTestJSON-271562628-project] Calling method '.version_select at 0x7f6073306550>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:35.487404 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f4f2d64a-a259-47a5-a1c4-548e9318e6a1 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:35.880991 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9cb54a01-a67e-41dd-89f0-5ebede769ff5 tempest-FloatingIPDetailsTestJSON-271562628 tempest-FloatingIPDetailsTestJSON-271562628-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.406302 Jun 20 12:03:35.882095 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 750/1551] 10.222.0.27 () {58 vars in 1163 bytes} [Mon Jun 20 12:03:35 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:03:35.886998 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f166e06f-bc1d-406c-a953-da56744674ad tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:35.887983 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f166e06f-bc1d-406c-a953-da56744674ad tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] [instance: ad7eb6c8-eba3-4dfc-92d6-d09bf5280668] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:35.903215 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f166e06f-bc1d-406c-a953-da56744674ad tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:35.906943 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f166e06f-bc1d-406c-a953-da56744674ad tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:35.908079 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f166e06f-bc1d-406c-a953-da56744674ad tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:35.910669 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f166e06f-bc1d-406c-a953-da56744674ad tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:36.189758 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f166e06f-bc1d-406c-a953-da56744674ad tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0700362f578248e5a1a60be519daf5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b95313b30841b7bd2616ddf6baa4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:36.198696 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f166e06f-bc1d-406c-a953-da56744674ad tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0700362f578248e5a1a60be519daf5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b95313b30841b7bd2616ddf6baa4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:36.205324 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f166e06f-bc1d-406c-a953-da56744674ad tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0700362f578248e5a1a60be519daf5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b95313b30841b7bd2616ddf6baa4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:36.206896 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f166e06f-bc1d-406c-a953-da56744674ad tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] 10.222.0.27 "GET /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668" status: 200 len: 1550 microversion: 2.26 time: 0.323599 Jun 20 12:03:36.211719 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 751/1552] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:03:35 2022] GET /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668 => generated 1550 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:03:36.219773 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bf156527-a95d-42c4-a7e9-8eb5ea8b2eb1 tempest-FloatingIPDetailsTestJSON-271562628 tempest-FloatingIPDetailsTestJSON-271562628-project] Calling method '.version_select at 0x7f6073306ca0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:36.246660 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f4f2d64a-a259-47a5-a1c4-548e9318e6a1 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:36.263424 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f4f2d64a-a259-47a5-a1c4-548e9318e6a1 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18" status: 200 len: 1314 microversion: 2.1 time: 0.855703 Jun 20 12:03:36.264367 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 802/1553] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:35 2022] GET /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18 => generated 1314 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:36.276609 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-18031275-c4e5-429a-afac-83bd932b47b9 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:36.279355 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-18031275-c4e5-429a-afac-83bd932b47b9 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: d348abab-aae7-4b81-84db-f856c9cf4907] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:36.293109 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-18031275-c4e5-429a-afac-83bd932b47b9 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:36.293817 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-18031275-c4e5-429a-afac-83bd932b47b9 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:36.297537 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-18031275-c4e5-429a-afac-83bd932b47b9 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:36.298265 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-18031275-c4e5-429a-afac-83bd932b47b9 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:36.762566 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bf156527-a95d-42c4-a7e9-8eb5ea8b2eb1 tempest-FloatingIPDetailsTestJSON-271562628 tempest-FloatingIPDetailsTestJSON-271562628-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.549368 Jun 20 12:03:36.763294 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 752/1554] 10.222.0.27 () {58 vars in 1148 bytes} [Mon Jun 20 12:03:36 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:03:36.777442 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6ff4f152-ef50-44df-a73d-2b223d72f8ea tempest-FloatingIPDetailsTestJSON-271562628 tempest-FloatingIPDetailsTestJSON-271562628-project] Calling method '.version_select at 0x7f6073328820>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:37.322667 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-18031275-c4e5-429a-afac-83bd932b47b9 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:37.340163 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-18031275-c4e5-429a-afac-83bd932b47b9 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907" status: 200 len: 1310 microversion: 2.1 time: 1.073710 Jun 20 12:03:37.344854 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 803/1555] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:36 2022] GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907 => generated 1310 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:37.358787 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-adf52700-7a2b-4b53-8dcd-71b751def1cf tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:37.360482 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-adf52700-7a2b-4b53-8dcd-71b751def1cf tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] [instance: ad7eb6c8-eba3-4dfc-92d6-d09bf5280668] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:37.379033 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-adf52700-7a2b-4b53-8dcd-71b751def1cf tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:37.379429 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-adf52700-7a2b-4b53-8dcd-71b751def1cf tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:37.380473 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-adf52700-7a2b-4b53-8dcd-71b751def1cf tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:37.380909 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-adf52700-7a2b-4b53-8dcd-71b751def1cf tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:37.926625 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-adf52700-7a2b-4b53-8dcd-71b751def1cf tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0700362f578248e5a1a60be519daf5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b95313b30841b7bd2616ddf6baa4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:37.946952 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-adf52700-7a2b-4b53-8dcd-71b751def1cf tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0700362f578248e5a1a60be519daf5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b95313b30841b7bd2616ddf6baa4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:37.951353 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-adf52700-7a2b-4b53-8dcd-71b751def1cf tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0700362f578248e5a1a60be519daf5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b95313b30841b7bd2616ddf6baa4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:37.961122 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-adf52700-7a2b-4b53-8dcd-71b751def1cf tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] 10.222.0.27 "GET /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668" status: 200 len: 1550 microversion: 2.26 time: 0.613554 Jun 20 12:03:37.964954 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 804/1556] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:03:37 2022] GET /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668 => generated 1550 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:03:37.982122 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1a3086b3-1347-4b44-8547-0c8e652c291d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:37.985130 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1a3086b3-1347-4b44-8547-0c8e652c291d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 7cff5b7f-6801-45ae-b6bd-5e062ce73b18] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:38.002385 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a3086b3-1347-4b44-8547-0c8e652c291d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:38.003503 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a3086b3-1347-4b44-8547-0c8e652c291d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:38.004948 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a3086b3-1347-4b44-8547-0c8e652c291d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:38.007090 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a3086b3-1347-4b44-8547-0c8e652c291d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:38.454172 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1a3086b3-1347-4b44-8547-0c8e652c291d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:38.467203 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1a3086b3-1347-4b44-8547-0c8e652c291d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18" status: 200 len: 1501 microversion: 2.1 time: 0.497477 Jun 20 12:03:38.470380 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 805/1557] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:37 2022] GET /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18 => generated 1501 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:38.615486 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d3cbe1cc-9c41-4689-9ea6-0a374bfe36ca tempest-FloatingIPDetailsNegativeTestJSON-1602993564 tempest-FloatingIPDetailsNegativeTestJSON-1602993564-project] Calling method '.version_select at 0x7f6073655d30>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:38.727440 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6ff4f152-ef50-44df-a73d-2b223d72f8ea tempest-FloatingIPDetailsTestJSON-271562628 tempest-FloatingIPDetailsTestJSON-271562628-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/b3d72636-02da-4d3b-b950-2b7512d19a4c" status: 202 len: 0 microversion: 2.1 time: 1.953838 Jun 20 12:03:38.728513 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 753/1558] 10.222.0.27 () {58 vars in 1262 bytes} [Mon Jun 20 12:03:36 2022] DELETE /compute/v2.1/os-floating-ips/b3d72636-02da-4d3b-b950-2b7512d19a4c => generated 0 bytes in 1956 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 12:03:38.736326 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-24343744-f12d-4837-9176-b3f630fec154 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:38.737214 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-24343744-f12d-4837-9176-b3f630fec154 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: d348abab-aae7-4b81-84db-f856c9cf4907] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:38.751335 n-d-master-1 devstack@n-api.service[119127]: DEBUG neutronclient.v2_0.client [None req-d3cbe1cc-9c41-4689-9ea6-0a374bfe36ca tempest-FloatingIPDetailsNegativeTestJSON-1602993564 tempest-FloatingIPDetailsNegativeTestJSON-1602993564-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP bb58f3a1-e4b2-4dd4-a5a4-d507a8542835 could not be found", "detail": ""}} {{(pid=119127) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 20 12:03:38.752464 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-d3cbe1cc-9c41-4689-9ea6-0a374bfe36ca tempest-FloatingIPDetailsNegativeTestJSON-1602993564 tempest-FloatingIPDetailsNegativeTestJSON-1602993564-project] HTTP exception thrown: Floating IP not found for ID bb58f3a1-e4b2-4dd4-a5a4-d507a8542835 Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d3cbe1cc-9c41-4689-9ea6-0a374bfe36ca tempest-FloatingIPDetailsNegativeTestJSON-1602993564 tempest-FloatingIPDetailsNegativeTestJSON-1602993564-project] Request method failure captured: Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/os-floating-ips/bb58f3a1-e4b2-4dd4-a5a4-d507a8542835 HTTP/1.1 Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGIZTiX9Ng7G46uZBmkFfxS3zcypTVJpQ3vDB2He41aFWZGxrrLVWH9M_4A6eFJdrlvwSrJl0V2C2_BJchw1JW9QsLMlGwOl8ReVDNNML5gODjwSia0EQnnMMd2hzZQ1VMw7mmyYdX13Ba4K_xqrlFNQgu0k3Ra09Rba7XzG146qLb8 Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 63ded3015c324230bd0a9aa24f567c11 Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1602993564 Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63ded3015c324230bd0a9aa24f567c11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/63ded3015c324230bd0a9aa24f567c11"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/63ded3015c324230bd0a9aa24f567c11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_63ded3015c324230bd0a9aa24f567c11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1602993564 Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 63ded3015c324230bd0a9aa24f567c11 Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1602993564 Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1602993564-project Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 86728a1908cd48daa8aeb9e308073426 Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1602993564-project Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: exception: Floating IP not found for ID bb58f3a1-e4b2-4dd4-a5a4-d507a8542835 Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'bb58f3a1-e4b2-4dd4-a5a4-d507a8542835'} Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP bb58f3a1-e4b2-4dd4-a5a4-d507a8542835 could not be found Jun 20 12:03:38.754571 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bc70a244-28f7-4045-9dc2-815cbf004cde'] Jun 20 12:03:38.760561 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:03:38.760561 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:03:38.760561 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:03:38.760561 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:03:38.760561 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jun 20 12:03:38.760561 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jun 20 12:03:38.760561 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jun 20 12:03:38.760561 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jun 20 12:03:38.760561 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID bb58f3a1-e4b2-4dd4-a5a4-d507a8542835. Jun 20 12:03:38.760561 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:03:38.760561 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:03:38.760561 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:03:38.760561 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:03:38.760561 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:03:38.760561 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:03:38.760561 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:03:38.760561 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:03:38.760561 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:03:38.760561 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:03:38.760561 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:03:38.760561 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:03:38.760561 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jun 20 12:03:38.760561 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 20 12:03:38.760561 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID bb58f3a1-e4b2-4dd4-a5a4-d507a8542835 Jun 20 12:03:38.760561 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:03:38.760561 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:03:38.760561 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:03:38.760561 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:03:38.760561 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:03:38.760561 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:03:38.760561 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:03:38.760561 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:03:38.760561 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID bb58f3a1-e4b2-4dd4-a5a4-d507a8542835 Jun 20 12:03:38.760561 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:03:38.760561 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d3cbe1cc-9c41-4689-9ea6-0a374bfe36ca tempest-FloatingIPDetailsNegativeTestJSON-1602993564 tempest-FloatingIPDetailsNegativeTestJSON-1602993564-project] Returning 404 to user: Floating IP not found for ID bb58f3a1-e4b2-4dd4-a5a4-d507a8542835 {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:03:38.765770 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d3cbe1cc-9c41-4689-9ea6-0a374bfe36ca tempest-FloatingIPDetailsNegativeTestJSON-1602993564 tempest-FloatingIPDetailsNegativeTestJSON-1602993564-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/bb58f3a1-e4b2-4dd4-a5a4-d507a8542835" status: 404 len: 111 microversion: 2.1 time: 0.271203 Jun 20 12:03:38.767250 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 806/1559] 10.222.0.27 () {58 vars in 1259 bytes} [Mon Jun 20 12:03:38 2022] GET /compute/v2.1/os-floating-ips/bb58f3a1-e4b2-4dd4-a5a4-d507a8542835 => generated 111 bytes in 282 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:03:38.784519 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-24343744-f12d-4837-9176-b3f630fec154 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:38.787764 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d71e2e53-9423-495e-9a1b-f185eaf67555 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:03:38.788903 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-24343744-f12d-4837-9176-b3f630fec154 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:38.792240 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d71e2e53-9423-495e-9a1b-f185eaf67555 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 7cff5b7f-6801-45ae-b6bd-5e062ce73b18] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:38.794319 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-24343744-f12d-4837-9176-b3f630fec154 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:38.795767 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-24343744-f12d-4837-9176-b3f630fec154 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:38.813851 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d71e2e53-9423-495e-9a1b-f185eaf67555 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:38.814935 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d71e2e53-9423-495e-9a1b-f185eaf67555 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:38.818166 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d71e2e53-9423-495e-9a1b-f185eaf67555 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:38.821406 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d71e2e53-9423-495e-9a1b-f185eaf67555 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:38.942006 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:38.962767 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d71e2e53-9423-495e-9a1b-f185eaf67555 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "POST /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18/action" status: 202 len: 0 microversion: 2.1 time: 0.193869 Jun 20 12:03:38.967412 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 807/1560] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:03:38 2022] POST /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:03:38.973998 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-894c68f9-ec4d-4633-8c7f-bc5383fccc33 tempest-FloatingIPDetailsTestJSON-271562628 tempest-FloatingIPDetailsTestJSON-271562628-project] Calling method '.version_select at 0x7f60737609d0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:39.441895 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-24343744-f12d-4837-9176-b3f630fec154 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:39.449782 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=4,nova_cell1:RELEASE=2,nova_cell1:DELETE=2,nova_cell1:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:39.489297 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-24343744-f12d-4837-9176-b3f630fec154 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907" status: 200 len: 1310 microversion: 2.1 time: 0.758964 Jun 20 12:03:39.499782 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 754/1561] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:38 2022] GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907 => generated 1310 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:39.499782 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-29431661-ab43-4449-bc04-b17c2a5aa47d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:39.499782 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-29431661-ab43-4449-bc04-b17c2a5aa47d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 7cff5b7f-6801-45ae-b6bd-5e062ce73b18] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:39.506953 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-29431661-ab43-4449-bc04-b17c2a5aa47d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:39.507533 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-29431661-ab43-4449-bc04-b17c2a5aa47d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:39.508249 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-29431661-ab43-4449-bc04-b17c2a5aa47d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:39.508692 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-29431661-ab43-4449-bc04-b17c2a5aa47d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:39.828375 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-29431661-ab43-4449-bc04-b17c2a5aa47d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:39.847309 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-29431661-ab43-4449-bc04-b17c2a5aa47d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18" status: 200 len: 1486 microversion: 2.1 time: 0.354230 Jun 20 12:03:39.862906 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 755/1562] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:39 2022] GET /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18 => generated 1486 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:39.872260 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e017bd5b-3b28-401f-8e3b-bb8535a71082 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:39.873746 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e017bd5b-3b28-401f-8e3b-bb8535a71082 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] [instance: ad7eb6c8-eba3-4dfc-92d6-d09bf5280668] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:39.930979 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e017bd5b-3b28-401f-8e3b-bb8535a71082 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:39.933455 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e017bd5b-3b28-401f-8e3b-bb8535a71082 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:39.944177 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e017bd5b-3b28-401f-8e3b-bb8535a71082 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:39.945090 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e017bd5b-3b28-401f-8e3b-bb8535a71082 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:40.135503 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e017bd5b-3b28-401f-8e3b-bb8535a71082 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:40.135958 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e017bd5b-3b28-401f-8e3b-bb8535a71082 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:40.140803 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-e017bd5b-3b28-401f-8e3b-bb8535a71082 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lazy-loading 'fault' on Instance uuid ad7eb6c8-eba3-4dfc-92d6-d09bf5280668 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:03:40.471466 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e017bd5b-3b28-401f-8e3b-bb8535a71082 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0700362f578248e5a1a60be519daf5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b95313b30841b7bd2616ddf6baa4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:40.507815 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e017bd5b-3b28-401f-8e3b-bb8535a71082 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0700362f578248e5a1a60be519daf5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b95313b30841b7bd2616ddf6baa4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:40.512885 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e017bd5b-3b28-401f-8e3b-bb8535a71082 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0700362f578248e5a1a60be519daf5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b95313b30841b7bd2616ddf6baa4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:40.521816 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e017bd5b-3b28-401f-8e3b-bb8535a71082 tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] 10.222.0.27 "GET /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668" status: 200 len: 1351 microversion: 2.26 time: 0.657002 Jun 20 12:03:40.526078 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 756/1563] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:03:39 2022] GET /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668 => generated 1351 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:03:40.539461 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-6e78bed6-ce57-4382-a84d-dce5bcda0e24 req-7314cebe-2b8d-4684-a26d-af42691d37ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad7eb6c8-eba3-4dfc-92d6-d09bf5280668", "name": "network-vif-deleted", "tag": "065c8200-3fb1-4b3f-8885-c13738ca5b23"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:03:40.598398 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-6e78bed6-ce57-4382-a84d-dce5bcda0e24 req-7314cebe-2b8d-4684-a26d-af42691d37ae service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:40.600018 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-6e78bed6-ce57-4382-a84d-dce5bcda0e24 req-7314cebe-2b8d-4684-a26d-af42691d37ae service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:40.654406 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-6e78bed6-ce57-4382-a84d-dce5bcda0e24 req-7314cebe-2b8d-4684-a26d-af42691d37ae service nova] Creating event network-vif-deleted:065c8200-3fb1-4b3f-8885-c13738ca5b23 for instance ad7eb6c8-eba3-4dfc-92d6-d09bf5280668 on n-h1-master-1 Jun 20 12:03:40.672033 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-6e78bed6-ce57-4382-a84d-dce5bcda0e24 req-7314cebe-2b8d-4684-a26d-af42691d37ae service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143197 Jun 20 12:03:40.674654 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 757/1564] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:03:40.694191 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-109a7321-d562-42ef-a201-97c939e6b9f8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:40.697606 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-109a7321-d562-42ef-a201-97c939e6b9f8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 7cff5b7f-6801-45ae-b6bd-5e062ce73b18] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:40.719043 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-109a7321-d562-42ef-a201-97c939e6b9f8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:40.723138 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-109a7321-d562-42ef-a201-97c939e6b9f8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:40.726691 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-109a7321-d562-42ef-a201-97c939e6b9f8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:40.728633 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-109a7321-d562-42ef-a201-97c939e6b9f8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:40.874100 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-109a7321-d562-42ef-a201-97c939e6b9f8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 7cff5b7f-6801-45ae-b6bd-5e062ce73b18] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:03:41.030814 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-894c68f9-ec4d-4633-8c7f-bc5383fccc33 tempest-FloatingIPDetailsTestJSON-271562628 tempest-FloatingIPDetailsTestJSON-271562628-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/86ea99a5-b313-49ca-9c3b-be8130a42335" status: 202 len: 0 microversion: 2.1 time: 2.061547 Jun 20 12:03:41.031990 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 808/1565] 10.222.0.27 () {58 vars in 1262 bytes} [Mon Jun 20 12:03:38 2022] DELETE /compute/v2.1/os-floating-ips/86ea99a5-b313-49ca-9c3b-be8130a42335 => generated 0 bytes in 2064 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:03:41.038391 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3375c277-9196-4f8f-97a7-84c60938cea3 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:41.039461 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3375c277-9196-4f8f-97a7-84c60938cea3 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: d348abab-aae7-4b81-84db-f856c9cf4907] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:41.085645 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3375c277-9196-4f8f-97a7-84c60938cea3 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:41.092941 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3375c277-9196-4f8f-97a7-84c60938cea3 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:41.097107 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3375c277-9196-4f8f-97a7-84c60938cea3 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:41.097566 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3375c277-9196-4f8f-97a7-84c60938cea3 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:41.140429 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-109a7321-d562-42ef-a201-97c939e6b9f8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18" status: 204 len: 0 microversion: 2.1 time: 0.463600 Jun 20 12:03:41.143597 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 758/1566] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:03:40 2022] DELETE /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:41.152460 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b844ba19-a9fa-49ca-8942-135c5b20071c tempest-FloatingIPDetailsTestJSON-271562628 tempest-FloatingIPDetailsTestJSON-271562628-project] Calling method '.version_select at 0x7f60733fff70>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:41.444779 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3375c277-9196-4f8f-97a7-84c60938cea3 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:41.457282 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3375c277-9196-4f8f-97a7-84c60938cea3 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907" status: 200 len: 1310 microversion: 2.1 time: 0.423728 Jun 20 12:03:41.458840 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 809/1567] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:41 2022] GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907 => generated 1310 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:41.467213 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-690ea34d-17a2-4259-b81e-6c04b5fb2c4f req-9dca7887-ec93-4a2f-809e-58b3fc34bf9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d348abab-aae7-4b81-84db-f856c9cf4907", "name": "network-vif-plugged", "status": "completed", "tag": "adf99a3e-442f-4468-a4d4-3b83b4155c6c"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:03:41.479100 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-690ea34d-17a2-4259-b81e-6c04b5fb2c4f req-9dca7887-ec93-4a2f-809e-58b3fc34bf9b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:41.480304 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-690ea34d-17a2-4259-b81e-6c04b5fb2c4f req-9dca7887-ec93-4a2f-809e-58b3fc34bf9b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:41.499253 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-690ea34d-17a2-4259-b81e-6c04b5fb2c4f req-9dca7887-ec93-4a2f-809e-58b3fc34bf9b service nova] Creating event network-vif-plugged:adf99a3e-442f-4468-a4d4-3b83b4155c6c for instance d348abab-aae7-4b81-84db-f856c9cf4907 on n-h2-master-1 Jun 20 12:03:41.505821 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-690ea34d-17a2-4259-b81e-6c04b5fb2c4f req-9dca7887-ec93-4a2f-809e-58b3fc34bf9b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044862 Jun 20 12:03:41.508145 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 810/1568] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:03:41.516120 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-06a07c65-537a-4fb6-b4c6-618dcf91a3c8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:41.517186 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-06a07c65-537a-4fb6-b4c6-618dcf91a3c8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 7cff5b7f-6801-45ae-b6bd-5e062ce73b18] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:41.527425 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06a07c65-537a-4fb6-b4c6-618dcf91a3c8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:41.528345 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06a07c65-537a-4fb6-b4c6-618dcf91a3c8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:41.529372 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06a07c65-537a-4fb6-b4c6-618dcf91a3c8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:41.529970 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06a07c65-537a-4fb6-b4c6-618dcf91a3c8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:41.772142 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-06a07c65-537a-4fb6-b4c6-618dcf91a3c8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:41.782994 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-06a07c65-537a-4fb6-b4c6-618dcf91a3c8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18" status: 200 len: 1492 microversion: 2.1 time: 0.273298 Jun 20 12:03:41.785945 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 811/1569] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:41 2022] GET /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18 => generated 1492 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:41.791391 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bc17ad54-1cf4-43ca-bf2a-7ccc2aa51a2c tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:41.792031 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bc17ad54-1cf4-43ca-bf2a-7ccc2aa51a2c tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] [instance: ad7eb6c8-eba3-4dfc-92d6-d09bf5280668] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:41.804872 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc17ad54-1cf4-43ca-bf2a-7ccc2aa51a2c tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:41.805204 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc17ad54-1cf4-43ca-bf2a-7ccc2aa51a2c tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:41.805829 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc17ad54-1cf4-43ca-bf2a-7ccc2aa51a2c tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:41.806268 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc17ad54-1cf4-43ca-bf2a-7ccc2aa51a2c tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:41.840460 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-bc17ad54-1cf4-43ca-bf2a-7ccc2aa51a2c tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] HTTP exception thrown: Instance ad7eb6c8-eba3-4dfc-92d6-d09bf5280668 could not be found. Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bc17ad54-1cf4-43ca-bf2a-7ccc2aa51a2c tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Request method failure captured: Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668 HTTP/1.1 Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGHyJPSPyWM4-bT42-tFN5PkL073-i-hlPAE_FEuCBfxGmCaMytT4G4q5vz5bzAzqlh288BWFfGjL2wKRVNia1xM8ZR6Sj9l9QBYRLcUYskNWmDW2FC6dRwq7Yactgi2lBuShKAo6AIxQUi8Bv2Iy4IFcrEX7WsFchMD1gjFQAoJqU0 Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: X-Openstack-Nova-Api-Version: 2.26 Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 66b95313b30841b7bd2616ddf6baa4bc Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServerTagsTestJSON-330824667 Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/66b95313b30841b7bd2616ddf6baa4bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/66b95313b30841b7bd2616ddf6baa4bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/66b95313b30841b7bd2616ddf6baa4bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_66b95313b30841b7bd2616ddf6baa4bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServerTagsTestJSON-330824667 Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 66b95313b30841b7bd2616ddf6baa4bc Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServerTagsTestJSON-330824667 Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServerTagsTestJSON-330824667-project Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 0700362f578248e5a1a60be519daf5a2 Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServerTagsTestJSON-330824667-project Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: exception: Instance ad7eb6c8-eba3-4dfc-92d6-d09bf5280668 could not be found. Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'ad7eb6c8-eba3-4dfc-92d6-d09bf5280668'} Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad7eb6c8-eba3-4dfc-92d6-d09bf5280668 could not be found. Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad7eb6c8-eba3-4dfc-92d6-d09bf5280668 could not be found. Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:03:41.843165 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:03:41.849187 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:03:41.849187 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:03:41.849187 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:03:41.849187 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:03:41.849187 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:03:41.849187 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad7eb6c8-eba3-4dfc-92d6-d09bf5280668 could not be found. Jun 20 12:03:41.849187 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:03:41.849187 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bc17ad54-1cf4-43ca-bf2a-7ccc2aa51a2c tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] Returning 404 to user: Instance ad7eb6c8-eba3-4dfc-92d6-d09bf5280668 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:03:41.849187 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bc17ad54-1cf4-43ca-bf2a-7ccc2aa51a2c tempest-ServerTagsTestJSON-330824667 tempest-ServerTagsTestJSON-330824667-project] 10.222.0.27 "GET /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668" status: 404 len: 111 microversion: 2.26 time: 0.061407 Jun 20 12:03:41.855460 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 812/1570] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:03:41 2022] GET /compute/v2.1/servers/ad7eb6c8-eba3-4dfc-92d6-d09bf5280668 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:03:42.478137 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d1004e1d-8335-4e45-97fd-a87fd71d30ec tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:42.480561 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d1004e1d-8335-4e45-97fd-a87fd71d30ec tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: d348abab-aae7-4b81-84db-f856c9cf4907] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:42.515920 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d1004e1d-8335-4e45-97fd-a87fd71d30ec tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:42.523507 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d1004e1d-8335-4e45-97fd-a87fd71d30ec tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:42.526337 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d1004e1d-8335-4e45-97fd-a87fd71d30ec tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:42.529511 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d1004e1d-8335-4e45-97fd-a87fd71d30ec tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:43.022134 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d1004e1d-8335-4e45-97fd-a87fd71d30ec tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:43.036952 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d1004e1d-8335-4e45-97fd-a87fd71d30ec tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907" status: 200 len: 1310 microversion: 2.1 time: 0.564898 Jun 20 12:03:43.038190 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 813/1571] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:42 2022] GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907 => generated 1310 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:43.046059 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-71be6d0b-5958-4f59-b570-23eb3af8941a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:43.049002 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-71be6d0b-5958-4f59-b570-23eb3af8941a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 7cff5b7f-6801-45ae-b6bd-5e062ce73b18] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:43.063401 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-71be6d0b-5958-4f59-b570-23eb3af8941a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:43.064144 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-71be6d0b-5958-4f59-b570-23eb3af8941a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:43.065640 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-71be6d0b-5958-4f59-b570-23eb3af8941a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:43.069368 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-71be6d0b-5958-4f59-b570-23eb3af8941a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:43.954873 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-71be6d0b-5958-4f59-b570-23eb3af8941a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:43.977605 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-71be6d0b-5958-4f59-b570-23eb3af8941a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18" status: 200 len: 1492 microversion: 2.1 time: 0.938096 Jun 20 12:03:43.979447 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 814/1572] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:43 2022] GET /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18 => generated 1492 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:44.057138 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f1ade54a-567e-4545-8489-838797675c73 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:44.058098 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f1ade54a-567e-4545-8489-838797675c73 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: d348abab-aae7-4b81-84db-f856c9cf4907] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:44.070266 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f1ade54a-567e-4545-8489-838797675c73 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:44.071016 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f1ade54a-567e-4545-8489-838797675c73 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:44.071919 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f1ade54a-567e-4545-8489-838797675c73 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:44.073807 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f1ade54a-567e-4545-8489-838797675c73 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:44.263791 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b844ba19-a9fa-49ca-8942-135c5b20071c tempest-FloatingIPDetailsTestJSON-271562628 tempest-FloatingIPDetailsTestJSON-271562628-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/9f1e393f-52ac-499a-98cd-f2ecc147f36e" status: 202 len: 0 microversion: 2.1 time: 3.118134 Jun 20 12:03:44.265987 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 759/1573] 10.222.0.27 () {58 vars in 1262 bytes} [Mon Jun 20 12:03:41 2022] DELETE /compute/v2.1/os-floating-ips/9f1e393f-52ac-499a-98cd-f2ecc147f36e => generated 0 bytes in 3121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:03:44.544582 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4140c330-194c-4513-8d5e-e55fcdb3bd1f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-397113081", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "7c57fb93-e580-4d64-8790-597bcac7a666"}], "block_device_mapping_v2": [{"uuid": "b46e4adc-d332-4fec-8aab-c23da8e5256d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:03:44.650412 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-4140c330-194c-4513-8d5e-e55fcdb3bd1f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] validate_networks() for [('7c57fb93-e580-4d64-8790-597bcac7a666', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:03:44.693278 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f1ade54a-567e-4545-8489-838797675c73 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:44.703222 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f1ade54a-567e-4545-8489-838797675c73 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907" status: 200 len: 1310 microversion: 2.1 time: 0.651994 Jun 20 12:03:44.718610 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 815/1574] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:44 2022] GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907 => generated 1310 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:03:44.961522 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-fca5c662-a72c-434a-83e5-73bc0ffc8230 req-afbab721-c84e-4168-bb6a-1b0bcc3428d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cff5b7f-6801-45ae-b6bd-5e062ce73b18", "name": "network-vif-deleted", "tag": "13b8fe10-f2db-4e80-8847-a189ff6fe1c7"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:03:44.978539 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-fca5c662-a72c-434a-83e5-73bc0ffc8230 req-afbab721-c84e-4168-bb6a-1b0bcc3428d8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:44.980022 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-fca5c662-a72c-434a-83e5-73bc0ffc8230 req-afbab721-c84e-4168-bb6a-1b0bcc3428d8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:44.998941 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-fca5c662-a72c-434a-83e5-73bc0ffc8230 req-afbab721-c84e-4168-bb6a-1b0bcc3428d8 service nova] Creating event network-vif-deleted:13b8fe10-f2db-4e80-8847-a189ff6fe1c7 for instance 7cff5b7f-6801-45ae-b6bd-5e062ce73b18 on n-h2-master-1 Jun 20 12:03:45.013718 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-fca5c662-a72c-434a-83e5-73bc0ffc8230 req-afbab721-c84e-4168-bb6a-1b0bcc3428d8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056131 Jun 20 12:03:45.016301 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 816/1575] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:03:45.036300 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3ef13d14-46d1-4e22-b699-7b835d5d15aa tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:45.037016 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3ef13d14-46d1-4e22-b699-7b835d5d15aa tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 7cff5b7f-6801-45ae-b6bd-5e062ce73b18] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:45.046075 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3ef13d14-46d1-4e22-b699-7b835d5d15aa tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:45.046892 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3ef13d14-46d1-4e22-b699-7b835d5d15aa tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:45.047883 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3ef13d14-46d1-4e22-b699-7b835d5d15aa tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:45.048510 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3ef13d14-46d1-4e22-b699-7b835d5d15aa tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:45.184927 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3ef13d14-46d1-4e22-b699-7b835d5d15aa tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:45.205262 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3ef13d14-46d1-4e22-b699-7b835d5d15aa tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18" status: 200 len: 1284 microversion: 2.1 time: 0.169920 Jun 20 12:03:45.217101 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 817/1576] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:45 2022] GET /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18 => generated 1284 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:45.670005 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-4140c330-194c-4513-8d5e-e55fcdb3bd1f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:03:45.674383 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-4140c330-194c-4513-8d5e-e55fcdb3bd1f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:03:45.675188 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-4140c330-194c-4513-8d5e-e55fcdb3bd1f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:03:45.675930 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-4140c330-194c-4513-8d5e-e55fcdb3bd1f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:03:45.676581 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-4140c330-194c-4513-8d5e-e55fcdb3bd1f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:03:45.698997 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4140c330-194c-4513-8d5e-e55fcdb3bd1f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:45.700945 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4140c330-194c-4513-8d5e-e55fcdb3bd1f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:45.702194 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4140c330-194c-4513-8d5e-e55fcdb3bd1f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:45.702825 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4140c330-194c-4513-8d5e-e55fcdb3bd1f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:45.721735 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-36feefd1-e053-4cb6-8ec1-1896e89d36b0 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:45.722353 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-36feefd1-e053-4cb6-8ec1-1896e89d36b0 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: d348abab-aae7-4b81-84db-f856c9cf4907] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:45.741671 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36feefd1-e053-4cb6-8ec1-1896e89d36b0 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:45.742206 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36feefd1-e053-4cb6-8ec1-1896e89d36b0 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:45.743106 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36feefd1-e053-4cb6-8ec1-1896e89d36b0 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:45.760013 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-4140c330-194c-4513-8d5e-e55fcdb3bd1f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Getting quotas for project 7fdba36a70464a8e816944a7f29e47cf. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:03:45.766119 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36feefd1-e053-4cb6-8ec1-1896e89d36b0 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:45.795551 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-4140c330-194c-4513-8d5e-e55fcdb3bd1f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Getting quotas for user b429a092ac04479eb8644bc82972234e and project 7fdba36a70464a8e816944a7f29e47cf. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:03:45.907844 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4140c330-194c-4513-8d5e-e55fcdb3bd1f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:03:45.910819 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4140c330-194c-4513-8d5e-e55fcdb3bd1f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b46e4adc-d332-4fec-8aab-c23da8e5256d',volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:03:46.184429 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4140c330-194c-4513-8d5e-e55fcdb3bd1f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.646918 Jun 20 12:03:46.191139 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 760/1577] 10.222.0.27 () {62 vars in 1187 bytes} [Mon Jun 20 12:03:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1654 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 20 12:03:46.201179 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b756902f-879a-473f-a529-a1e8e186f229 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:46.202031 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b756902f-879a-473f-a529-a1e8e186f229 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:46.203991 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-36feefd1-e053-4cb6-8ec1-1896e89d36b0 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:46.212579 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-36feefd1-e053-4cb6-8ec1-1896e89d36b0 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907" status: 200 len: 1492 microversion: 2.1 time: 0.494791 Jun 20 12:03:46.213176 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 818/1578] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:45 2022] GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907 => generated 1492 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:46.225140 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f5c9b75c-ba40-48e6-8bce-b5899b9c10b0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:46.228511 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f5c9b75c-ba40-48e6-8bce-b5899b9c10b0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 7cff5b7f-6801-45ae-b6bd-5e062ce73b18] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:46.243030 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5c9b75c-ba40-48e6-8bce-b5899b9c10b0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:46.243486 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5c9b75c-ba40-48e6-8bce-b5899b9c10b0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:46.244313 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5c9b75c-ba40-48e6-8bce-b5899b9c10b0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:46.244757 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5c9b75c-ba40-48e6-8bce-b5899b9c10b0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:46.280147 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-f5c9b75c-ba40-48e6-8bce-b5899b9c10b0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] HTTP exception thrown: Instance 7cff5b7f-6801-45ae-b6bd-5e062ce73b18 could not be found. Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f5c9b75c-ba40-48e6-8bce-b5899b9c10b0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Request method failure captured: Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18 HTTP/1.1 Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGGM0_Rgon_QXChHIK_Ikyu0N9hux8u1Ms08jFhXlxkRDQgHGZCrxeBLJGVow3P3B7-C_d1lwOFEoVq18fpBt5bYVFsDOyFchFBnf15eYmBoM5W3iquFzY2ZI2UJK0DkPKTj0Fv6tDqgY5whthvLS8glHLsBu0Y3_K5TIG0-QwQVU5w Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 3495d9dc8b714809b2f3f777cbabda29 Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 7cff5b7f-6801-45ae-b6bd-5e062ce73b18 could not be found. Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '7cff5b7f-6801-45ae-b6bd-5e062ce73b18'} Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cff5b7f-6801-45ae-b6bd-5e062ce73b18 could not be found. Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cff5b7f-6801-45ae-b6bd-5e062ce73b18 could not be found. Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:03:46.283084 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:03:46.302075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:03:46.302075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:03:46.302075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:03:46.302075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:03:46.302075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:03:46.302075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cff5b7f-6801-45ae-b6bd-5e062ce73b18 could not be found. Jun 20 12:03:46.302075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:03:46.302075 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f5c9b75c-ba40-48e6-8bce-b5899b9c10b0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Returning 404 to user: Instance 7cff5b7f-6801-45ae-b6bd-5e062ce73b18 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:03:46.302075 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f5c9b75c-ba40-48e6-8bce-b5899b9c10b0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18" status: 404 len: 111 microversion: 2.1 time: 0.063278 Jun 20 12:03:46.302075 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 819/1579] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:46 2022] GET /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:03:46.302075 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b1879bd5-6abd-4c6c-8979-c0de1cded24b tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:46.302075 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b1879bd5-6abd-4c6c-8979-c0de1cded24b tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] [instance: d348abab-aae7-4b81-84db-f856c9cf4907] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:46.318316 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b1879bd5-6abd-4c6c-8979-c0de1cded24b tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:46.318813 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b1879bd5-6abd-4c6c-8979-c0de1cded24b tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:46.319574 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b1879bd5-6abd-4c6c-8979-c0de1cded24b tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:46.320020 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b1879bd5-6abd-4c6c-8979-c0de1cded24b tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:46.412252 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b756902f-879a-473f-a529-a1e8e186f229 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:46.431552 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b756902f-879a-473f-a529-a1e8e186f229 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:46.440890 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b756902f-879a-473f-a529-a1e8e186f229 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:46.445346 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b756902f-879a-473f-a529-a1e8e186f229 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1103 microversion: 2.25 time: 0.249619 Jun 20 12:03:46.460808 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 761/1580] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:03:46 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1103 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:03:46.569409 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8b46d395-f1e3-41f3-a3b9-6dd233aa60ad tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-139222163", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "25724adf-e301-4183-8c20-574ec029a516"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:03:46.671345 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-8b46d395-f1e3-41f3-a3b9-6dd233aa60ad tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] validate_networks() for [('25724adf-e301-4183-8c20-574ec029a516', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:03:46.847118 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b1879bd5-6abd-4c6c-8979-c0de1cded24b tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907" status: 200 len: 1643 microversion: 2.1 time: 0.557105 Jun 20 12:03:46.848261 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 820/1581] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:46 2022] GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907 => generated 1643 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:46.865530 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3b4dbad0-8ccf-44b4-bab5-77a4013cc3e9 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:46.869237 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3b4dbad0-8ccf-44b4-bab5-77a4013cc3e9 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] [instance: d348abab-aae7-4b81-84db-f856c9cf4907] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:46.878471 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3b4dbad0-8ccf-44b4-bab5-77a4013cc3e9 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:46.879772 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3b4dbad0-8ccf-44b4-bab5-77a4013cc3e9 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:46.882938 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3b4dbad0-8ccf-44b4-bab5-77a4013cc3e9 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:46.883608 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3b4dbad0-8ccf-44b4-bab5-77a4013cc3e9 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:47.143221 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3b4dbad0-8ccf-44b4-bab5-77a4013cc3e9 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907" status: 200 len: 1643 microversion: 2.1 time: 0.283371 Jun 20 12:03:47.144108 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 821/1582] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:46 2022] GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907 => generated 1643 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:47.162131 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ac4ff7cd-c243-4eaa-aca3-6bfc43d9af19 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:47.165425 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:03:47.165425 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 12:03:47.167145 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac4ff7cd-c243-4eaa-aca3-6bfc43d9af19 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:47.167780 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac4ff7cd-c243-4eaa-aca3-6bfc43d9af19 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:47.170847 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac4ff7cd-c243-4eaa-aca3-6bfc43d9af19 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:47.171647 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac4ff7cd-c243-4eaa-aca3-6bfc43d9af19 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:47.246551 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ac4ff7cd-c243-4eaa-aca3-6bfc43d9af19 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.088251 Jun 20 12:03:47.252451 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 822/1583] 10.222.0.27 () {58 vars in 1175 bytes} [Mon Jun 20 12:03:47 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:03:47.260044 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ec7f6bcc-13df-41bf-aca0-39c5e0068fa8 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:03:47.261677 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ec7f6bcc-13df-41bf-aca0-39c5e0068fa8 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] [instance: d348abab-aae7-4b81-84db-f856c9cf4907] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:47.273763 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ec7f6bcc-13df-41bf-aca0-39c5e0068fa8 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:47.275184 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ec7f6bcc-13df-41bf-aca0-39c5e0068fa8 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:47.276503 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ec7f6bcc-13df-41bf-aca0-39c5e0068fa8 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:47.277439 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ec7f6bcc-13df-41bf-aca0-39c5e0068fa8 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:47.396733 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ec7f6bcc-13df-41bf-aca0-39c5e0068fa8 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907/action" status: 202 len: 0 microversion: 2.1 time: 0.141024 Jun 20 12:03:47.398047 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 823/1584] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:03:47 2022] POST /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:03:47.423809 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ce1266d7-6bbe-4228-b0b5-2b0a69de19f7 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:47.424751 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ce1266d7-6bbe-4228-b0b5-2b0a69de19f7 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] [instance: d348abab-aae7-4b81-84db-f856c9cf4907] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:47.439283 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ce1266d7-6bbe-4228-b0b5-2b0a69de19f7 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:47.439743 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ce1266d7-6bbe-4228-b0b5-2b0a69de19f7 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:47.440572 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ce1266d7-6bbe-4228-b0b5-2b0a69de19f7 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:47.447558 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ce1266d7-6bbe-4228-b0b5-2b0a69de19f7 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:48.035652 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-8b46d395-f1e3-41f3-a3b9-6dd233aa60ad tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:03:48.037718 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-8b46d395-f1e3-41f3-a3b9-6dd233aa60ad tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:03:48.037718 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-8b46d395-f1e3-41f3-a3b9-6dd233aa60ad tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:03:48.039441 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-8b46d395-f1e3-41f3-a3b9-6dd233aa60ad tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:03:48.039441 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-8b46d395-f1e3-41f3-a3b9-6dd233aa60ad tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:03:48.064708 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8b46d395-f1e3-41f3-a3b9-6dd233aa60ad tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:48.065297 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8b46d395-f1e3-41f3-a3b9-6dd233aa60ad tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:48.066833 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8b46d395-f1e3-41f3-a3b9-6dd233aa60ad tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:48.067386 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8b46d395-f1e3-41f3-a3b9-6dd233aa60ad tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:48.114901 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-8b46d395-f1e3-41f3-a3b9-6dd233aa60ad tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Getting quotas for project 7dbe3d6c4b7a41fa8181a805a992c173. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:03:48.125510 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-8b46d395-f1e3-41f3-a3b9-6dd233aa60ad tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Getting quotas for user 3495d9dc8b714809b2f3f777cbabda29 and project 7dbe3d6c4b7a41fa8181a805a992c173. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:03:48.140484 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8b46d395-f1e3-41f3-a3b9-6dd233aa60ad tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:03:48.142874 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8b46d395-f1e3-41f3-a3b9-6dd233aa60ad tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:03:48.206661 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8b46d395-f1e3-41f3-a3b9-6dd233aa60ad tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.656154 Jun 20 12:03:48.212495 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 762/1585] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:03:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 12:03:48.218579 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e64cdd12-cf93-4ff1-8249-18e160c668d4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:48.219445 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e64cdd12-cf93-4ff1-8249-18e160c668d4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:48.226598 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e64cdd12-cf93-4ff1-8249-18e160c668d4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:48.227051 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e64cdd12-cf93-4ff1-8249-18e160c668d4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:48.227981 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e64cdd12-cf93-4ff1-8249-18e160c668d4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:48.228746 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e64cdd12-cf93-4ff1-8249-18e160c668d4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:48.319736 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ce1266d7-6bbe-4228-b0b5-2b0a69de19f7 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907" status: 200 len: 1648 microversion: 2.1 time: 0.917412 Jun 20 12:03:48.321858 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 824/1586] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:47 2022] GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907 => generated 1648 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:48.326742 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6af58fdc-85e2-43b2-aa07-f0011e6b0c02 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:48.337754 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6af58fdc-85e2-43b2-aa07-f0011e6b0c02 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:48.355516 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e64cdd12-cf93-4ff1-8249-18e160c668d4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:48.367917 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e64cdd12-cf93-4ff1-8249-18e160c668d4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:48.373154 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e64cdd12-cf93-4ff1-8249-18e160c668d4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:48.375357 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e64cdd12-cf93-4ff1-8249-18e160c668d4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1250 microversion: 2.25 time: 0.161805 Jun 20 12:03:48.394320 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 763/1587] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:03:48 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1250 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:03:48.536381 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6af58fdc-85e2-43b2-aa07-f0011e6b0c02 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:48.557778 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6af58fdc-85e2-43b2-aa07-f0011e6b0c02 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1214 microversion: 2.1 time: 0.230969 Jun 20 12:03:48.559000 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 825/1588] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:48 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1214 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:49.339097 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-63fba8d0-c3d9-43c6-9eca-801a6cd4a7c9 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:49.339832 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-63fba8d0-c3d9-43c6-9eca-801a6cd4a7c9 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] [instance: d348abab-aae7-4b81-84db-f856c9cf4907] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:49.351102 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-63fba8d0-c3d9-43c6-9eca-801a6cd4a7c9 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:49.359466 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-63fba8d0-c3d9-43c6-9eca-801a6cd4a7c9 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:49.360750 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-63fba8d0-c3d9-43c6-9eca-801a6cd4a7c9 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:49.361399 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-63fba8d0-c3d9-43c6-9eca-801a6cd4a7c9 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:49.395259 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6482970b-8d2e-4f59-9668-6d1ed2d0e50a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:49.396780 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6482970b-8d2e-4f59-9668-6d1ed2d0e50a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:49.436525 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6482970b-8d2e-4f59-9668-6d1ed2d0e50a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:49.440872 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6482970b-8d2e-4f59-9668-6d1ed2d0e50a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:49.455929 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6482970b-8d2e-4f59-9668-6d1ed2d0e50a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:49.457429 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6482970b-8d2e-4f59-9668-6d1ed2d0e50a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:49.824508 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6482970b-8d2e-4f59-9668-6d1ed2d0e50a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:49.853287 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6482970b-8d2e-4f59-9668-6d1ed2d0e50a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:49.857914 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6482970b-8d2e-4f59-9668-6d1ed2d0e50a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:49.867325 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6482970b-8d2e-4f59-9668-6d1ed2d0e50a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1250 microversion: 2.25 time: 0.476029 Jun 20 12:03:49.885091 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 826/1589] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:03:49 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1250 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:03:49.904838 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b7ed90a1-2aaf-4299-a198-3bbf498fe80e tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:49.906459 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b7ed90a1-2aaf-4299-a198-3bbf498fe80e tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:49.918799 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b7ed90a1-2aaf-4299-a198-3bbf498fe80e tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:49.919599 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b7ed90a1-2aaf-4299-a198-3bbf498fe80e tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:49.920810 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b7ed90a1-2aaf-4299-a198-3bbf498fe80e tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:49.921479 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b7ed90a1-2aaf-4299-a198-3bbf498fe80e tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:50.066781 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b7ed90a1-2aaf-4299-a198-3bbf498fe80e tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:50.081182 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b7ed90a1-2aaf-4299-a198-3bbf498fe80e tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1266 microversion: 2.1 time: 0.184417 Jun 20 12:03:50.083461 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 827/1590] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:49 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:50.107905 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-63fba8d0-c3d9-43c6-9eca-801a6cd4a7c9 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907" status: 200 len: 1628 microversion: 2.1 time: 0.771969 Jun 20 12:03:50.108648 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 764/1591] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:49 2022] GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907 => generated 1628 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:50.130272 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c2e276c0-db10-4177-a36e-a85ae2173df0 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:03:50.132265 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c2e276c0-db10-4177-a36e-a85ae2173df0 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] [instance: d348abab-aae7-4b81-84db-f856c9cf4907] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:50.140984 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c2e276c0-db10-4177-a36e-a85ae2173df0 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:50.141711 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c2e276c0-db10-4177-a36e-a85ae2173df0 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:50.142852 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c2e276c0-db10-4177-a36e-a85ae2173df0 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:50.143500 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c2e276c0-db10-4177-a36e-a85ae2173df0 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:50.173682 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-c2e276c0-db10-4177-a36e-a85ae2173df0 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lazy-loading 'flavor' on Instance uuid d348abab-aae7-4b81-84db-f856c9cf4907 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:03:50.188976 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:50.193036 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c2e276c0-db10-4177-a36e-a85ae2173df0 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] [instance: d348abab-aae7-4b81-84db-f856c9cf4907] Going to try to live migrate instance to n-h1-master-1 {{(pid=119127) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 20 12:03:50.901554 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dfc38d5f-1bdf-4b6d-a2fa-daa322992046 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:50.902165 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-dfc38d5f-1bdf-4b6d-a2fa-daa322992046 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:50.937930 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dfc38d5f-1bdf-4b6d-a2fa-daa322992046 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:50.938967 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dfc38d5f-1bdf-4b6d-a2fa-daa322992046 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:50.940342 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dfc38d5f-1bdf-4b6d-a2fa-daa322992046 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:50.940904 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dfc38d5f-1bdf-4b6d-a2fa-daa322992046 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:51.291552 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-dfc38d5f-1bdf-4b6d-a2fa-daa322992046 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:51.309315 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-dfc38d5f-1bdf-4b6d-a2fa-daa322992046 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:51.327849 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-dfc38d5f-1bdf-4b6d-a2fa-daa322992046 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:51.333992 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dfc38d5f-1bdf-4b6d-a2fa-daa322992046 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1250 microversion: 2.25 time: 0.436999 Jun 20 12:03:51.335158 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 765/1592] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:03:50 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1250 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:03:51.346512 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f7c1a7d7-a98f-40d7-a449-a3cb5265c9dd tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:51.347865 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f7c1a7d7-a98f-40d7-a449-a3cb5265c9dd tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:51.367557 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7c1a7d7-a98f-40d7-a449-a3cb5265c9dd tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:51.368186 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7c1a7d7-a98f-40d7-a449-a3cb5265c9dd tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:51.370266 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7c1a7d7-a98f-40d7-a449-a3cb5265c9dd tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:51.371462 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7c1a7d7-a98f-40d7-a449-a3cb5265c9dd tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:51.549990 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f7c1a7d7-a98f-40d7-a449-a3cb5265c9dd tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:51.560510 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f7c1a7d7-a98f-40d7-a449-a3cb5265c9dd tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1272 microversion: 2.1 time: 0.223548 Jun 20 12:03:51.561854 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 766/1593] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:51 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1272 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:52.355814 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d778bcb5-81b3-4fbc-b798-535b5cafc266 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:52.356845 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d778bcb5-81b3-4fbc-b798-535b5cafc266 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:52.382833 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d778bcb5-81b3-4fbc-b798-535b5cafc266 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:52.385117 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d778bcb5-81b3-4fbc-b798-535b5cafc266 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:52.388077 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d778bcb5-81b3-4fbc-b798-535b5cafc266 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:52.389896 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d778bcb5-81b3-4fbc-b798-535b5cafc266 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:53.077075 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d778bcb5-81b3-4fbc-b798-535b5cafc266 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:53.145747 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d778bcb5-81b3-4fbc-b798-535b5cafc266 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:53.171094 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d778bcb5-81b3-4fbc-b798-535b5cafc266 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:53.194145 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d778bcb5-81b3-4fbc-b798-535b5cafc266 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1292 microversion: 2.25 time: 0.842493 Jun 20 12:03:53.197447 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 767/1594] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:03:52 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1292 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:03:53.223796 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-14b0df4d-f73e-4f91-a46f-39e9702ab911 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:53.232868 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-14b0df4d-f73e-4f91-a46f-39e9702ab911 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:53.256645 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:53.282145 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-14b0df4d-f73e-4f91-a46f-39e9702ab911 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:53.282604 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-14b0df4d-f73e-4f91-a46f-39e9702ab911 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:53.283396 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-14b0df4d-f73e-4f91-a46f-39e9702ab911 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:53.283832 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-14b0df4d-f73e-4f91-a46f-39e9702ab911 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:53.631382 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-14b0df4d-f73e-4f91-a46f-39e9702ab911 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:53.651009 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-14b0df4d-f73e-4f91-a46f-39e9702ab911 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1272 microversion: 2.1 time: 0.449903 Jun 20 12:03:53.663679 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 768/1595] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:53 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1272 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:54.219191 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e033d21e-8640-46e1-81e4-bf6a1e3e3bfb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:54.220584 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e033d21e-8640-46e1-81e4-bf6a1e3e3bfb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:54.263913 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e033d21e-8640-46e1-81e4-bf6a1e3e3bfb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:54.264920 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e033d21e-8640-46e1-81e4-bf6a1e3e3bfb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:54.266876 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e033d21e-8640-46e1-81e4-bf6a1e3e3bfb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:54.267789 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e033d21e-8640-46e1-81e4-bf6a1e3e3bfb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:55.287728 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c2e276c0-db10-4177-a36e-a85ae2173df0 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907/action" status: 202 len: 0 microversion: 2.1 time: 5.162430 Jun 20 12:03:55.296147 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 828/1596] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:03:50 2022] POST /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907/action => generated 0 bytes in 5173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:03:55.305985 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-05dd4dfe-5d78-433f-9c5f-b5ba2e7dd7d4 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:55.307843 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-05dd4dfe-5d78-433f-9c5f-b5ba2e7dd7d4 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:55.353475 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-05dd4dfe-5d78-433f-9c5f-b5ba2e7dd7d4 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:55.353952 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-05dd4dfe-5d78-433f-9c5f-b5ba2e7dd7d4 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:55.365439 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-05dd4dfe-5d78-433f-9c5f-b5ba2e7dd7d4 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:55.372294 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-05dd4dfe-5d78-433f-9c5f-b5ba2e7dd7d4 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:55.826939 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e033d21e-8640-46e1-81e4-bf6a1e3e3bfb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:55.849871 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e033d21e-8640-46e1-81e4-bf6a1e3e3bfb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:55.874600 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e033d21e-8640-46e1-81e4-bf6a1e3e3bfb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:55.878425 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e033d21e-8640-46e1-81e4-bf6a1e3e3bfb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1292 microversion: 2.25 time: 1.665901 Jun 20 12:03:55.886628 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 769/1597] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:03:54 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1292 bytes in 1677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:03:55.900920 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b4977a97-d06a-4b00-8022-892af91901a4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:55.916388 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b4977a97-d06a-4b00-8022-892af91901a4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: d348abab-aae7-4b81-84db-f856c9cf4907] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:55.938370 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b4977a97-d06a-4b00-8022-892af91901a4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:55.939357 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b4977a97-d06a-4b00-8022-892af91901a4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:55.940755 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b4977a97-d06a-4b00-8022-892af91901a4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:55.941443 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b4977a97-d06a-4b00-8022-892af91901a4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:56.748971 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b4977a97-d06a-4b00-8022-892af91901a4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:56.765121 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b4977a97-d06a-4b00-8022-892af91901a4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907" status: 200 len: 1502 microversion: 2.1 time: 0.876506 Jun 20 12:03:56.765727 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 770/1598] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:55 2022] GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907 => generated 1502 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:56.795017 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e0ac6f15-211d-4495-a0ff-9aeead891dcb tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] Calling method '.version_select at 0x7f6073432280>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:56.807092 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-05dd4dfe-5d78-433f-9c5f-b5ba2e7dd7d4 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:56.844664 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-05dd4dfe-5d78-433f-9c5f-b5ba2e7dd7d4 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1314 microversion: 2.1 time: 1.546983 Jun 20 12:03:56.845688 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 829/1599] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:55 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1314 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:56.877196 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e0ac6f15-211d-4495-a0ff-9aeead891dcb tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] 10.222.0.27 "GET /compute/v2.1/images/606928f5-c71e-4193-93c5-4ad285c0e81f" status: 200 len: 637 microversion: 2.1 time: 0.086529 Jun 20 12:03:56.879750 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 771/1600] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:03:56 2022] GET /compute/v2.1/images/606928f5-c71e-4193-93c5-4ad285c0e81f => generated 637 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:03:56.891949 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-31affc53-00f7-4242-9d49-dc679a43729c tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] Action: 'update_all', calling method: .version_select at 0x7f6073edc0d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:03:56.901911 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7705a010-dcdc-442e-8036-f4f520d0765d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:56.902582 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7705a010-dcdc-442e-8036-f4f520d0765d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:56.942723 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7705a010-dcdc-442e-8036-f4f520d0765d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:56.943300 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7705a010-dcdc-442e-8036-f4f520d0765d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:56.944010 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7705a010-dcdc-442e-8036-f4f520d0765d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:56.955252 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7705a010-dcdc-442e-8036-f4f520d0765d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:56.988576 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-31affc53-00f7-4242-9d49-dc679a43729c tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] Getting quotas for project 73da2750c2f94931977efbfdbee30f1b. Resources: dict_keys(['metadata_items']) {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:03:57.012850 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-31affc53-00f7-4242-9d49-dc679a43729c tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] Getting quotas for user 5252ea377f314931827401131ed5aad6 and project 73da2750c2f94931977efbfdbee30f1b. Resources: dict_keys(['metadata_items']) {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:03:57.393675 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:57.614488 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-31affc53-00f7-4242-9d49-dc679a43729c tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] 10.222.0.27 "PUT /compute/v2.1/images/606928f5-c71e-4193-93c5-4ad285c0e81f/metadata" status: 200 len: 61 microversion: 2.1 time: 0.727373 Jun 20 12:03:57.619361 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 830/1601] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Jun 20 12:03:56 2022] PUT /compute/v2.1/images/606928f5-c71e-4193-93c5-4ad285c0e81f/metadata => generated 61 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:03:57.625069 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bd2b341b-310a-4df6-97f5-baf7cad11e6f tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] Calling method '.version_select at 0x7f607370e4c0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:58.094791 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=4 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:58.110150 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7705a010-dcdc-442e-8036-f4f520d0765d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:58.135042 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=14 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:58.140170 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7705a010-dcdc-442e-8036-f4f520d0765d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:58.146904 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7705a010-dcdc-442e-8036-f4f520d0765d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:58.149844 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7705a010-dcdc-442e-8036-f4f520d0765d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1292 microversion: 2.25 time: 1.252436 Jun 20 12:03:58.153780 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 772/1602] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:03:56 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1292 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:03:58.163561 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-314a75a3-e2c5-4f7b-9ee9-8c01a4baa5ee tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:58.166073 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-314a75a3-e2c5-4f7b-9ee9-8c01a4baa5ee tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: d348abab-aae7-4b81-84db-f856c9cf4907] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:58.173390 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bd2b341b-310a-4df6-97f5-baf7cad11e6f tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] 10.222.0.27 "DELETE /compute/v2.1/images/606928f5-c71e-4193-93c5-4ad285c0e81f/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.552257 Jun 20 12:03:58.175315 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-314a75a3-e2c5-4f7b-9ee9-8c01a4baa5ee tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:58.176074 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-314a75a3-e2c5-4f7b-9ee9-8c01a4baa5ee tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:58.177121 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-314a75a3-e2c5-4f7b-9ee9-8c01a4baa5ee tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:58.177250 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 831/1603] 10.222.0.27 () {58 vars in 1295 bytes} [Mon Jun 20 12:03:57 2022] DELETE /compute/v2.1/images/606928f5-c71e-4193-93c5-4ad285c0e81f/metadata/os_version => generated 0 bytes in 557 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 12:03:58.177992 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-314a75a3-e2c5-4f7b-9ee9-8c01a4baa5ee tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:58.187786 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9ec6b295-c89b-4b0d-b199-43ca3740f426 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:58.188884 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9ec6b295-c89b-4b0d-b199-43ca3740f426 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:58.198984 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ec6b295-c89b-4b0d-b199-43ca3740f426 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:58.200070 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ec6b295-c89b-4b0d-b199-43ca3740f426 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:58.201114 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ec6b295-c89b-4b0d-b199-43ca3740f426 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:58.203591 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ec6b295-c89b-4b0d-b199-43ca3740f426 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:58.641814 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-314a75a3-e2c5-4f7b-9ee9-8c01a4baa5ee tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:58.664650 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-314a75a3-e2c5-4f7b-9ee9-8c01a4baa5ee tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907" status: 200 len: 1502 microversion: 2.1 time: 0.504013 Jun 20 12:03:58.666634 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 773/1604] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:58 2022] GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907 => generated 1502 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:58.680612 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-aa403dda-626d-42ca-a48e-9343d1edc190 req-903dd27a-d265-4b06-bf09-bbdf16d696e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21b4c645-d527-4d43-a7fb-5c866fa59022", "tag": "b8bd2b04-702a-4d5a-97c4-9bb7561531a4"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:03:58.703795 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-aa403dda-626d-42ca-a48e-9343d1edc190 req-903dd27a-d265-4b06-bf09-bbdf16d696e0 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:58.704266 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-aa403dda-626d-42ca-a48e-9343d1edc190 req-903dd27a-d265-4b06-bf09-bbdf16d696e0 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:58.746122 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-aa403dda-626d-42ca-a48e-9343d1edc190 req-903dd27a-d265-4b06-bf09-bbdf16d696e0 service nova] Creating event network-changed:b8bd2b04-702a-4d5a-97c4-9bb7561531a4 for instance 21b4c645-d527-4d43-a7fb-5c866fa59022 on n-h1-master-1 Jun 20 12:03:58.758582 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-aa403dda-626d-42ca-a48e-9343d1edc190 req-903dd27a-d265-4b06-bf09-bbdf16d696e0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088590 Jun 20 12:03:58.761393 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 774/1605] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:03:58.774054 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b8478e4c-f8ab-4e52-a444-b7e5b852e0da tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] Calling method '.version_select at 0x7f60734103a0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:58.839971 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b8478e4c-f8ab-4e52-a444-b7e5b852e0da tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] 10.222.0.27 "GET /compute/v2.1/images/606928f5-c71e-4193-93c5-4ad285c0e81f/metadata" status: 200 len: 37 microversion: 2.1 time: 0.077152 Jun 20 12:03:58.841781 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 775/1606] 10.222.0.27 () {58 vars in 1259 bytes} [Mon Jun 20 12:03:58 2022] GET /compute/v2.1/images/606928f5-c71e-4193-93c5-4ad285c0e81f/metadata => generated 37 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:03:58.862673 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6eccfb67-1689-419a-9ce4-320a6ae785ed tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] Action: 'update_all', calling method: .version_select at 0x7f6073533af0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:03:58.959450 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-6eccfb67-1689-419a-9ce4-320a6ae785ed tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] Getting quotas for project 73da2750c2f94931977efbfdbee30f1b. Resources: dict_keys(['metadata_items']) {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:03:58.974309 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-6eccfb67-1689-419a-9ce4-320a6ae785ed tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] Getting quotas for user 5252ea377f314931827401131ed5aad6 and project 73da2750c2f94931977efbfdbee30f1b. Resources: dict_keys(['metadata_items']) {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:03:59.233926 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9ec6b295-c89b-4b0d-b199-43ca3740f426 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:59.246618 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9ec6b295-c89b-4b0d-b199-43ca3740f426 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1314 microversion: 2.1 time: 1.068175 Jun 20 12:03:59.248989 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 832/1607] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:58 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1314 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:59.256325 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9869163b-0160-42d8-a1ba-271a00dc3395 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:59.262013 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9869163b-0160-42d8-a1ba-271a00dc3395 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:59.266059 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=88 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:59.281969 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9869163b-0160-42d8-a1ba-271a00dc3395 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:59.283469 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9869163b-0160-42d8-a1ba-271a00dc3395 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:59.286101 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9869163b-0160-42d8-a1ba-271a00dc3395 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:59.289027 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9869163b-0160-42d8-a1ba-271a00dc3395 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:59.505127 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6eccfb67-1689-419a-9ce4-320a6ae785ed tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] 10.222.0.27 "PUT /compute/v2.1/images/606928f5-c71e-4193-93c5-4ad285c0e81f/metadata" status: 200 len: 61 microversion: 2.1 time: 0.655762 Jun 20 12:03:59.510683 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 776/1608] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Jun 20 12:03:58 2022] PUT /compute/v2.1/images/606928f5-c71e-4193-93c5-4ad285c0e81f/metadata => generated 61 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:03:59.516069 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1b8028ff-439d-42f8-9e19-51217ed61d0d tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] Calling method '.version_select at 0x7f6073eb6550>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:59.581845 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1b8028ff-439d-42f8-9e19-51217ed61d0d tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] 10.222.0.27 "GET /compute/v2.1/images/606928f5-c71e-4193-93c5-4ad285c0e81f/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.070858 Jun 20 12:03:59.583791 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 777/1609] 10.222.0.27 () {58 vars in 1289 bytes} [Mon Jun 20 12:03:59 2022] GET /compute/v2.1/images/606928f5-c71e-4193-93c5-4ad285c0e81f/metadata/os_distro => generated 33 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:03:59.602404 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c905b15b-13fa-4c77-b9f9-fd4a43c60f0d tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] Action: 'update_all', calling method: .version_select at 0x7f6073533160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:03:59.686414 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-c905b15b-13fa-4c77-b9f9-fd4a43c60f0d tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] Getting quotas for project 73da2750c2f94931977efbfdbee30f1b. Resources: dict_keys(['metadata_items']) {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:03:59.706565 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-c905b15b-13fa-4c77-b9f9-fd4a43c60f0d tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] Getting quotas for user 5252ea377f314931827401131ed5aad6 and project 73da2750c2f94931977efbfdbee30f1b. Resources: dict_keys(['metadata_items']) {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:03:59.879225 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9869163b-0160-42d8-a1ba-271a00dc3395 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:59.892060 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9869163b-0160-42d8-a1ba-271a00dc3395 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:59.899045 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9869163b-0160-42d8-a1ba-271a00dc3395 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:03:59.901459 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9869163b-0160-42d8-a1ba-271a00dc3395 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1292 microversion: 2.25 time: 0.649051 Jun 20 12:03:59.914368 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 833/1610] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:03:59 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1292 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:03:59.928186 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3e1a24c1-443c-4a30-8c75-c1a082d79710 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:03:59.929224 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3e1a24c1-443c-4a30-8c75-c1a082d79710 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: d348abab-aae7-4b81-84db-f856c9cf4907] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:03:59.943681 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e1a24c1-443c-4a30-8c75-c1a082d79710 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:59.944811 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e1a24c1-443c-4a30-8c75-c1a082d79710 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:03:59.947135 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e1a24c1-443c-4a30-8c75-c1a082d79710 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:03:59.953097 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e1a24c1-443c-4a30-8c75-c1a082d79710 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:00.053898 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c905b15b-13fa-4c77-b9f9-fd4a43c60f0d tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] 10.222.0.27 "PUT /compute/v2.1/images/606928f5-c71e-4193-93c5-4ad285c0e81f/metadata" status: 200 len: 61 microversion: 2.1 time: 0.462039 Jun 20 12:04:00.054493 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 778/1611] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Jun 20 12:03:59 2022] PUT /compute/v2.1/images/606928f5-c71e-4193-93c5-4ad285c0e81f/metadata => generated 61 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:04:00.073931 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-269d48bb-3a59-4fee-a457-55bc4f2f8d41 req-c814a240-e16c-4a63-9115-4732c34e8733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d348abab-aae7-4b81-84db-f856c9cf4907", "name": "network-vif-unplugged", "status": "completed", "tag": "adf99a3e-442f-4468-a4d4-3b83b4155c6c"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:00.095541 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-269d48bb-3a59-4fee-a457-55bc4f2f8d41 req-c814a240-e16c-4a63-9115-4732c34e8733 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:00.096150 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-269d48bb-3a59-4fee-a457-55bc4f2f8d41 req-c814a240-e16c-4a63-9115-4732c34e8733 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:00.101916 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:00.113733 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-269d48bb-3a59-4fee-a457-55bc4f2f8d41 req-c814a240-e16c-4a63-9115-4732c34e8733 service nova] Creating event network-vif-unplugged:adf99a3e-442f-4468-a4d4-3b83b4155c6c for instance d348abab-aae7-4b81-84db-f856c9cf4907 on n-h2-master-1 Jun 20 12:04:00.123750 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-269d48bb-3a59-4fee-a457-55bc4f2f8d41 req-c814a240-e16c-4a63-9115-4732c34e8733 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060619 Jun 20 12:04:00.125825 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 779/1612] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:00.132432 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b6660e40-eacf-4901-9678-4ce404cb8298 tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] Calling method '.version_select at 0x7f60733ffa60>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:00.200851 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b6660e40-eacf-4901-9678-4ce404cb8298 tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] 10.222.0.27 "GET /compute/v2.1/images/606928f5-c71e-4193-93c5-4ad285c0e81f/metadata" status: 200 len: 61 microversion: 2.1 time: 0.073225 Jun 20 12:04:00.201616 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 780/1613] 10.222.0.27 () {58 vars in 1259 bytes} [Mon Jun 20 12:04:00 2022] GET /compute/v2.1/images/606928f5-c71e-4193-93c5-4ad285c0e81f/metadata => generated 61 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:04:00.215294 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c5382413-fc38-42b0-8a98-550225feb3e7 tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] Action: 'update_all', calling method: .version_select at 0x7f60733bbb80>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:00.307712 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-c5382413-fc38-42b0-8a98-550225feb3e7 tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] Getting quotas for project 73da2750c2f94931977efbfdbee30f1b. Resources: dict_keys(['metadata_items']) {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:04:00.341292 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-c5382413-fc38-42b0-8a98-550225feb3e7 tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] Getting quotas for user 5252ea377f314931827401131ed5aad6 and project 73da2750c2f94931977efbfdbee30f1b. Resources: dict_keys(['metadata_items']) {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:04:00.823152 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c5382413-fc38-42b0-8a98-550225feb3e7 tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] 10.222.0.27 "PUT /compute/v2.1/images/606928f5-c71e-4193-93c5-4ad285c0e81f/metadata" status: 200 len: 61 microversion: 2.1 time: 0.614535 Jun 20 12:04:00.823948 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 781/1614] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Jun 20 12:04:00 2022] PUT /compute/v2.1/images/606928f5-c71e-4193-93c5-4ad285c0e81f/metadata => generated 61 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:04:00.837041 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6bdb339f-9802-4996-b146-6baeaa47d744 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:00.838399 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6bdb339f-9802-4996-b146-6baeaa47d744 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:00.851456 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6bdb339f-9802-4996-b146-6baeaa47d744 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:00.852523 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6bdb339f-9802-4996-b146-6baeaa47d744 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:00.854625 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6bdb339f-9802-4996-b146-6baeaa47d744 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:00.855832 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3e1a24c1-443c-4a30-8c75-c1a082d79710 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:00.857747 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6bdb339f-9802-4996-b146-6baeaa47d744 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:00.874464 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3e1a24c1-443c-4a30-8c75-c1a082d79710 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907" status: 200 len: 1502 microversion: 2.1 time: 0.958202 Jun 20 12:04:00.881205 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 834/1615] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:03:59 2022] GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907 => generated 1502 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:01.165767 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d1c3c625-9d3c-4d8b-8618-f70eaca29f2e tempest-QuotasTestJSON-1961194988 tempest-QuotasTestJSON-1961194988-project] Calling method '.version_select at 0x7f607397e3a0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:01.287194 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d1c3c625-9d3c-4d8b-8618-f70eaca29f2e tempest-QuotasTestJSON-1961194988 tempest-QuotasTestJSON-1961194988-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/8fcbc4a652a94c7bb99d091f7c0a8cc8/defaults" status: 200 len: 371 microversion: 2.1 time: 0.404512 Jun 20 12:04:01.288095 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 835/1616] 10.222.0.27 () {58 vars in 1268 bytes} [Mon Jun 20 12:04:00 2022] GET /compute/v2.1/os-quota-sets/8fcbc4a652a94c7bb99d091f7c0a8cc8/defaults => generated 371 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:01.301000 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f20fbad4-de9a-4366-bf46-b310d3f2dad5 tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] Action: 'update_all', calling method: .version_select at 0x7f607370e040>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:01.375176 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6bdb339f-9802-4996-b146-6baeaa47d744 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:01.386720 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6bdb339f-9802-4996-b146-6baeaa47d744 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1314 microversion: 2.1 time: 0.561615 Jun 20 12:04:01.387991 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 782/1617] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:00 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1314 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:01.393581 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-90d2522c-f9e1-43f3-b2a4-bae290853933 req-fb2297ae-dcd3-4a5f-a1ba-d3c6d1b3f79e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b52985a9-6859-4d8b-b248-d4d2289f7da1", "tag": "cb6f9a61-ee67-4712-b7c2-c06766244aa9"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:01.398799 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-f20fbad4-de9a-4366-bf46-b310d3f2dad5 tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] Getting quotas for project 73da2750c2f94931977efbfdbee30f1b. Resources: dict_keys(['metadata_items']) {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:04:01.415003 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-f20fbad4-de9a-4366-bf46-b310d3f2dad5 tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] Getting quotas for user 5252ea377f314931827401131ed5aad6 and project 73da2750c2f94931977efbfdbee30f1b. Resources: dict_keys(['metadata_items']) {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:04:01.419764 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-90d2522c-f9e1-43f3-b2a4-bae290853933 req-fb2297ae-dcd3-4a5f-a1ba-d3c6d1b3f79e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:01.427015 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-90d2522c-f9e1-43f3-b2a4-bae290853933 req-fb2297ae-dcd3-4a5f-a1ba-d3c6d1b3f79e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:01.456401 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-90d2522c-f9e1-43f3-b2a4-bae290853933 req-fb2297ae-dcd3-4a5f-a1ba-d3c6d1b3f79e service nova] Creating event network-changed:cb6f9a61-ee67-4712-b7c2-c06766244aa9 for instance b52985a9-6859-4d8b-b248-d4d2289f7da1 on n-h2-master-1 Jun 20 12:04:01.472622 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-90d2522c-f9e1-43f3-b2a4-bae290853933 req-fb2297ae-dcd3-4a5f-a1ba-d3c6d1b3f79e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081652 Jun 20 12:04:01.474096 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 783/1618] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:01.486630 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3b9f3615-0cdc-472b-9b7f-d56aa5b85a66 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:01.489021 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3b9f3615-0cdc-472b-9b7f-d56aa5b85a66 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:01.499834 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b9f3615-0cdc-472b-9b7f-d56aa5b85a66 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:01.500391 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b9f3615-0cdc-472b-9b7f-d56aa5b85a66 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:01.501229 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b9f3615-0cdc-472b-9b7f-d56aa5b85a66 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:01.501883 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b9f3615-0cdc-472b-9b7f-d56aa5b85a66 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:01.839160 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3b9f3615-0cdc-472b-9b7f-d56aa5b85a66 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:01.857401 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3b9f3615-0cdc-472b-9b7f-d56aa5b85a66 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:01.860440 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3b9f3615-0cdc-472b-9b7f-d56aa5b85a66 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:01.863834 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3b9f3615-0cdc-472b-9b7f-d56aa5b85a66 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1280 microversion: 2.25 time: 0.386366 Jun 20 12:04:01.875717 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 784/1619] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:04:01 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1280 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:04:01.880319 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-156792f6-d596-416a-a681-ef5b903005b7 tempest-QuotasTestJSON-1961194988 tempest-QuotasTestJSON-1961194988-project] Calling method '.version_select at 0x7f6073523700>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:02.018142 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-156792f6-d596-416a-a681-ef5b903005b7 tempest-QuotasTestJSON-1961194988 tempest-QuotasTestJSON-1961194988-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/8fcbc4a652a94c7bb99d091f7c0a8cc8" status: 200 len: 371 microversion: 2.1 time: 0.152069 Jun 20 12:04:02.024581 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 785/1620] 10.222.0.27 () {58 vars in 1241 bytes} [Mon Jun 20 12:04:01 2022] GET /compute/v2.1/os-quota-sets/8fcbc4a652a94c7bb99d091f7c0a8cc8 => generated 371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:02.038710 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7c7010c8-e533-480a-93d5-c17afa45ddd1 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:02.040282 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7c7010c8-e533-480a-93d5-c17afa45ddd1 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: d348abab-aae7-4b81-84db-f856c9cf4907] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:02.055865 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7c7010c8-e533-480a-93d5-c17afa45ddd1 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:02.057068 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7c7010c8-e533-480a-93d5-c17afa45ddd1 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:02.058605 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7c7010c8-e533-480a-93d5-c17afa45ddd1 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:02.060386 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7c7010c8-e533-480a-93d5-c17afa45ddd1 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:02.094982 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f20fbad4-de9a-4366-bf46-b310d3f2dad5 tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] 10.222.0.27 "PUT /compute/v2.1/images/606928f5-c71e-4193-93c5-4ad285c0e81f/metadata" status: 200 len: 64 microversion: 2.1 time: 0.805470 Jun 20 12:04:02.097862 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 836/1621] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Jun 20 12:04:01 2022] PUT /compute/v2.1/images/606928f5-c71e-4193-93c5-4ad285c0e81f/metadata => generated 64 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:04:02.107409 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4b37f14e-1ca0-459f-b4e2-df062535f981 tempest-QuotasTestJSON-1961194988 tempest-QuotasTestJSON-1961194988-project] Calling method '.version_select at 0x7f6073edc1f0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:02.236778 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4b37f14e-1ca0-459f-b4e2-df062535f981 tempest-QuotasTestJSON-1961194988 tempest-QuotasTestJSON-1961194988-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/8fcbc4a652a94c7bb99d091f7c0a8cc8/defaults" status: 200 len: 371 microversion: 2.1 time: 0.137403 Jun 20 12:04:02.238139 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 837/1622] 10.222.0.27 () {58 vars in 1268 bytes} [Mon Jun 20 12:04:02 2022] GET /compute/v2.1/os-quota-sets/8fcbc4a652a94c7bb99d091f7c0a8cc8/defaults => generated 371 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:02.244717 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-846ee2d7-cf2d-42d0-b807-4203748d38e0 tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] Calling method '.version_select at 0x7f6073a0f4c0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:02.312794 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-846ee2d7-cf2d-42d0-b807-4203748d38e0 tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] 10.222.0.27 "GET /compute/v2.1/images/606928f5-c71e-4193-93c5-4ad285c0e81f/metadata" status: 200 len: 64 microversion: 2.1 time: 0.072884 Jun 20 12:04:02.313986 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 838/1623] 10.222.0.27 () {58 vars in 1259 bytes} [Mon Jun 20 12:04:02 2022] GET /compute/v2.1/images/606928f5-c71e-4193-93c5-4ad285c0e81f/metadata => generated 64 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:04:02.325138 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-b4756ca0-6cc5-4228-abbc-c6644bcf43d8 req-07a6b7da-4ee5-4f58-8c23-b60892bb13b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d348abab-aae7-4b81-84db-f856c9cf4907", "tag": "adf99a3e-442f-4468-a4d4-3b83b4155c6c"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:02.340640 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b4756ca0-6cc5-4228-abbc-c6644bcf43d8 req-07a6b7da-4ee5-4f58-8c23-b60892bb13b5 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:02.341212 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b4756ca0-6cc5-4228-abbc-c6644bcf43d8 req-07a6b7da-4ee5-4f58-8c23-b60892bb13b5 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:02.356925 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-b4756ca0-6cc5-4228-abbc-c6644bcf43d8 req-07a6b7da-4ee5-4f58-8c23-b60892bb13b5 service nova] Creating event network-changed:adf99a3e-442f-4468-a4d4-3b83b4155c6c for instance d348abab-aae7-4b81-84db-f856c9cf4907 on n-h2-master-1 Jun 20 12:04:02.363644 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-b4756ca0-6cc5-4228-abbc-c6644bcf43d8 req-07a6b7da-4ee5-4f58-8c23-b60892bb13b5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047774 Jun 20 12:04:02.364748 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 839/1624] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:02.370665 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-09297034-d796-47d3-9bc9-8faa6199c8f7 tempest-QuotasTestJSON-1961194988 tempest-QuotasTestJSON-1961194988-project] Calling method '.version_select at 0x7f60736a6dc0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:02.496277 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-09297034-d796-47d3-9bc9-8faa6199c8f7 tempest-QuotasTestJSON-1961194988 tempest-QuotasTestJSON-1961194988-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/8fcbc4a652a94c7bb99d091f7c0a8cc8" status: 200 len: 371 microversion: 2.1 time: 0.126133 Jun 20 12:04:02.497284 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 840/1625] 10.222.0.27 () {58 vars in 1241 bytes} [Mon Jun 20 12:04:02 2022] GET /compute/v2.1/os-quota-sets/8fcbc4a652a94c7bb99d091f7c0a8cc8 => generated 371 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:02.500682 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7c7010c8-e533-480a-93d5-c17afa45ddd1 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:02.506906 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fefed114-9ffe-42b4-9a2c-2bc1b8e3595a tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] Action: 'update_all', calling method: .version_select at 0x7f6073a0f040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:02.509956 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7c7010c8-e533-480a-93d5-c17afa45ddd1 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907" status: 200 len: 1502 microversion: 2.1 time: 0.483929 Jun 20 12:04:02.518406 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 786/1626] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:02 2022] GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907 => generated 1502 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:02.534715 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fc2b9db5-17a9-4575-9e2f-db6b274c4035 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:02.538145 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fc2b9db5-17a9-4575-9e2f-db6b274c4035 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:02.552479 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fc2b9db5-17a9-4575-9e2f-db6b274c4035 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:02.557739 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fc2b9db5-17a9-4575-9e2f-db6b274c4035 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:02.558796 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fc2b9db5-17a9-4575-9e2f-db6b274c4035 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:02.559564 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fc2b9db5-17a9-4575-9e2f-db6b274c4035 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:02.603933 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-fefed114-9ffe-42b4-9a2c-2bc1b8e3595a tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] Getting quotas for project 73da2750c2f94931977efbfdbee30f1b. Resources: dict_keys(['metadata_items']) {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:04:02.625296 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-fefed114-9ffe-42b4-9a2c-2bc1b8e3595a tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] Getting quotas for user 5252ea377f314931827401131ed5aad6 and project 73da2750c2f94931977efbfdbee30f1b. Resources: dict_keys(['metadata_items']) {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:04:02.934902 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fc2b9db5-17a9-4575-9e2f-db6b274c4035 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:02.958008 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fc2b9db5-17a9-4575-9e2f-db6b274c4035 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1314 microversion: 2.1 time: 0.438096 Jun 20 12:04:02.958976 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 787/1627] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:02 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:02.988765 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bc595e86-5680-4da4-b1df-7acca56b78fa tempest-QuotasTestJSON-1961194988 tempest-QuotasTestJSON-1961194988-project] Calling method '.version_select at 0x7f60733bb280>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:03.174080 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bc595e86-5680-4da4-b1df-7acca56b78fa tempest-QuotasTestJSON-1961194988 tempest-QuotasTestJSON-1961194988-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/8fcbc4a652a94c7bb99d091f7c0a8cc8?user_id=c3e23759583c4cdb8a9eccf618b0b505" status: 200 len: 371 microversion: 2.1 time: 0.199879 Jun 20 12:04:03.175444 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 788/1628] 10.222.0.27 () {58 vars in 1322 bytes} [Mon Jun 20 12:04:02 2022] GET /compute/v2.1/os-quota-sets/8fcbc4a652a94c7bb99d091f7c0a8cc8?user_id=c3e23759583c4cdb8a9eccf618b0b505 => generated 371 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:03.200445 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d052b3d3-fd57-487a-816d-59fae1608815 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:03.201114 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d052b3d3-fd57-487a-816d-59fae1608815 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:03.225002 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d052b3d3-fd57-487a-816d-59fae1608815 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:03.227094 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d052b3d3-fd57-487a-816d-59fae1608815 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:03.229838 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d052b3d3-fd57-487a-816d-59fae1608815 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:03.232892 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d052b3d3-fd57-487a-816d-59fae1608815 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:03.553490 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fefed114-9ffe-42b4-9a2c-2bc1b8e3595a tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] 10.222.0.27 "PUT /compute/v2.1/images/606928f5-c71e-4193-93c5-4ad285c0e81f/metadata" status: 200 len: 61 microversion: 2.1 time: 1.052746 Jun 20 12:04:03.554113 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 841/1629] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Jun 20 12:04:02 2022] PUT /compute/v2.1/images/606928f5-c71e-4193-93c5-4ad285c0e81f/metadata => generated 61 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:04:03.559849 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-67c83e00-3a32-46e8-a067-c54bccf29db6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:03.564451 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-67c83e00-3a32-46e8-a067-c54bccf29db6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: d348abab-aae7-4b81-84db-f856c9cf4907] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:03.579357 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-67c83e00-3a32-46e8-a067-c54bccf29db6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:03.581864 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-67c83e00-3a32-46e8-a067-c54bccf29db6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:03.585393 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-67c83e00-3a32-46e8-a067-c54bccf29db6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:03.586411 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-67c83e00-3a32-46e8-a067-c54bccf29db6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:03.647913 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d052b3d3-fd57-487a-816d-59fae1608815 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:03.678025 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d052b3d3-fd57-487a-816d-59fae1608815 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:03.682711 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d052b3d3-fd57-487a-816d-59fae1608815 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:03.698262 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d052b3d3-fd57-487a-816d-59fae1608815 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1280 microversion: 2.25 time: 0.520169 Jun 20 12:04:03.713273 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 789/1630] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:04:03 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1280 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:04:03.727806 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e6820395-0987-483a-aa43-660df5310876 tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] Action: 'update', calling method: .version_select at 0x7f60733bbaf0>, body: {"meta": {"os_version": "alt"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:03.828802 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-e6820395-0987-483a-aa43-660df5310876 tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] Getting quotas for project 73da2750c2f94931977efbfdbee30f1b. Resources: dict_keys(['metadata_items']) {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:04:03.849942 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-e6820395-0987-483a-aa43-660df5310876 tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] Getting quotas for user 5252ea377f314931827401131ed5aad6 and project 73da2750c2f94931977efbfdbee30f1b. Resources: dict_keys(['metadata_items']) {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:04:04.482992 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e6820395-0987-483a-aa43-660df5310876 tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] 10.222.0.27 "PUT /compute/v2.1/images/606928f5-c71e-4193-93c5-4ad285c0e81f/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.764999 Jun 20 12:04:04.484064 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 790/1631] 10.222.0.27 () {60 vars in 1312 bytes} [Mon Jun 20 12:04:03 2022] PUT /compute/v2.1/images/606928f5-c71e-4193-93c5-4ad285c0e81f/metadata/os_version => generated 31 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:04:04.490753 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-077fc5c9-e767-49f5-ab3e-e9965d81ee5a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:04.491757 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-077fc5c9-e767-49f5-ab3e-e9965d81ee5a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:04.505659 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-077fc5c9-e767-49f5-ab3e-e9965d81ee5a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:04.570023 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-077fc5c9-e767-49f5-ab3e-e9965d81ee5a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:04.572378 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-077fc5c9-e767-49f5-ab3e-e9965d81ee5a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:04.573786 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-077fc5c9-e767-49f5-ab3e-e9965d81ee5a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:04.808839 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-077fc5c9-e767-49f5-ab3e-e9965d81ee5a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:04.825826 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-077fc5c9-e767-49f5-ab3e-e9965d81ee5a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1314 microversion: 2.1 time: 0.338722 Jun 20 12:04:04.829347 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 791/1632] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:04 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:04.838542 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-31363579-101a-4065-a4ab-014294037644 tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] Calling method '.version_select at 0x7f6073410700>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:04.889729 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-31363579-101a-4065-a4ab-014294037644 tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] 10.222.0.27 "GET /compute/v2.1/images/606928f5-c71e-4193-93c5-4ad285c0e81f/metadata" status: 200 len: 58 microversion: 2.1 time: 0.059170 Jun 20 12:04:04.890305 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 792/1633] 10.222.0.27 () {58 vars in 1259 bytes} [Mon Jun 20 12:04:04 2022] GET /compute/v2.1/images/606928f5-c71e-4193-93c5-4ad285c0e81f/metadata => generated 58 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:04:04.897124 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6a56e2d3-efa1-48d5-92eb-48fdae27c557 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:04.897734 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6a56e2d3-efa1-48d5-92eb-48fdae27c557 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:04.904949 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a56e2d3-efa1-48d5-92eb-48fdae27c557 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:04.905392 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a56e2d3-efa1-48d5-92eb-48fdae27c557 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:04.906170 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a56e2d3-efa1-48d5-92eb-48fdae27c557 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:04.906624 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a56e2d3-efa1-48d5-92eb-48fdae27c557 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:05.071181 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6a56e2d3-efa1-48d5-92eb-48fdae27c557 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:05.080435 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6a56e2d3-efa1-48d5-92eb-48fdae27c557 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:05.083213 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6a56e2d3-efa1-48d5-92eb-48fdae27c557 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:05.084512 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6a56e2d3-efa1-48d5-92eb-48fdae27c557 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1280 microversion: 2.25 time: 0.192836 Jun 20 12:04:05.085174 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 793/1634] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:04:04 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1280 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:04:05.090721 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e9e42e9c-352a-4c80-8ebc-b3d533b58f5e tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] Action: 'update_all', calling method: .version_select at 0x7f60733bb0d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:05.143332 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-e9e42e9c-352a-4c80-8ebc-b3d533b58f5e tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] Getting quotas for project 73da2750c2f94931977efbfdbee30f1b. Resources: dict_keys(['metadata_items']) {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:04:05.148350 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-e9e42e9c-352a-4c80-8ebc-b3d533b58f5e tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] Getting quotas for user 5252ea377f314931827401131ed5aad6 and project 73da2750c2f94931977efbfdbee30f1b. Resources: dict_keys(['metadata_items']) {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:04:05.168475 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-67c83e00-3a32-46e8-a067-c54bccf29db6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:05.181900 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-67c83e00-3a32-46e8-a067-c54bccf29db6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907" status: 200 len: 1502 microversion: 2.1 time: 1.624528 Jun 20 12:04:05.182808 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 842/1635] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:03 2022] GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907 => generated 1502 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:05.690876 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e9e42e9c-352a-4c80-8ebc-b3d533b58f5e tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] 10.222.0.27 "PUT /compute/v2.1/images/606928f5-c71e-4193-93c5-4ad285c0e81f/metadata" status: 200 len: 61 microversion: 2.1 time: 0.604310 Jun 20 12:04:05.695575 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 794/1636] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Jun 20 12:04:05 2022] PUT /compute/v2.1/images/606928f5-c71e-4193-93c5-4ad285c0e81f/metadata => generated 61 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:04:05.705027 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2d0b1ea7-11b6-4a78-bfaa-a6d11e3e83c2 tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] Action: 'create', calling method: .version_select at 0x7f6073970b80>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:05.786141 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-2d0b1ea7-11b6-4a78-bfaa-a6d11e3e83c2 tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] Getting quotas for project 73da2750c2f94931977efbfdbee30f1b. Resources: dict_keys(['metadata_items']) {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:04:05.794426 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-2d0b1ea7-11b6-4a78-bfaa-a6d11e3e83c2 tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] Getting quotas for user 5252ea377f314931827401131ed5aad6 and project 73da2750c2f94931977efbfdbee30f1b. Resources: dict_keys(['metadata_items']) {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:04:06.105040 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0dfbd3d4-3592-4e8b-9063-f113f7fb0b15 tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] Action: 'create', calling method: .version_select at 0x7f6073533af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-387243775"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:06.300637 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2d0b1ea7-11b6-4a78-bfaa-a6d11e3e83c2 tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] 10.222.0.27 "POST /compute/v2.1/images/606928f5-c71e-4193-93c5-4ad285c0e81f/metadata" status: 200 len: 85 microversion: 2.1 time: 0.603436 Jun 20 12:04:06.301258 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 843/1637] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Jun 20 12:04:05 2022] POST /compute/v2.1/images/606928f5-c71e-4193-93c5-4ad285c0e81f/metadata => generated 85 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:04:06.309600 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e511c6a8-9850-4d23-9bad-18996367a4db tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:06.310265 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e511c6a8-9850-4d23-9bad-18996367a4db tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:06.317700 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e511c6a8-9850-4d23-9bad-18996367a4db tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:06.318677 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e511c6a8-9850-4d23-9bad-18996367a4db tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:06.319546 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e511c6a8-9850-4d23-9bad-18996367a4db tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:06.320110 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e511c6a8-9850-4d23-9bad-18996367a4db tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:06.676054 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0dfbd3d4-3592-4e8b-9063-f113f7fb0b15 tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.859911 Jun 20 12:04:06.679097 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 795/1638] 10.222.0.27 () {60 vars in 1154 bytes} [Mon Jun 20 12:04:05 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 864 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 20 12:04:06.693643 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-14dd85e3-6655-423e-b2c6-fb7a1be4dbba tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:06.694462 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-14dd85e3-6655-423e-b2c6-fb7a1be4dbba tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:06.705185 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-14dd85e3-6655-423e-b2c6-fb7a1be4dbba tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:06.712835 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-14dd85e3-6655-423e-b2c6-fb7a1be4dbba tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:06.713977 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-14dd85e3-6655-423e-b2c6-fb7a1be4dbba tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:06.714635 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-14dd85e3-6655-423e-b2c6-fb7a1be4dbba tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:06.955533 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e511c6a8-9850-4d23-9bad-18996367a4db tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:06.969128 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e511c6a8-9850-4d23-9bad-18996367a4db tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1314 microversion: 2.1 time: 0.664075 Jun 20 12:04:06.971623 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-14dd85e3-6655-423e-b2c6-fb7a1be4dbba tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:06.972841 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 844/1639] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:06 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1314 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:06.979409 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-86cb5b42-e847-4813-8c84-1c5ad0834266 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:06.980884 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-86cb5b42-e847-4813-8c84-1c5ad0834266 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:06.985757 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-14dd85e3-6655-423e-b2c6-fb7a1be4dbba tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:06.988654 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-14dd85e3-6655-423e-b2c6-fb7a1be4dbba tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:06.990413 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86cb5b42-e847-4813-8c84-1c5ad0834266 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:06.991147 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86cb5b42-e847-4813-8c84-1c5ad0834266 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:06.992316 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-14dd85e3-6655-423e-b2c6-fb7a1be4dbba tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1280 microversion: 2.25 time: 0.311568 Jun 20 12:04:06.992821 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86cb5b42-e847-4813-8c84-1c5ad0834266 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:06.993353 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86cb5b42-e847-4813-8c84-1c5ad0834266 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:06.995128 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 796/1640] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:04:06 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1280 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:04:07.006755 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-91954633-5e63-4337-8414-da5f30af2f5d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:07.009361 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-91954633-5e63-4337-8414-da5f30af2f5d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: d348abab-aae7-4b81-84db-f856c9cf4907] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:07.024811 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-91954633-5e63-4337-8414-da5f30af2f5d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:07.028244 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-91954633-5e63-4337-8414-da5f30af2f5d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:07.029712 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-91954633-5e63-4337-8414-da5f30af2f5d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:07.032018 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-91954633-5e63-4337-8414-da5f30af2f5d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:07.213468 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-91954633-5e63-4337-8414-da5f30af2f5d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:07.232866 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-91954633-5e63-4337-8414-da5f30af2f5d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907" status: 200 len: 1502 microversion: 2.1 time: 0.235580 Jun 20 12:04:07.243141 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 797/1641] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:06 2022] GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907 => generated 1502 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:07.249356 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f42bd9c1-7ea3-4f80-9d8d-d3707f2cbf58 tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] Calling method '.version_select at 0x7f6073523820>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:07.295652 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f42bd9c1-7ea3-4f80-9d8d-d3707f2cbf58 tempest-ImagesMetadataTestJSON-1781649432 tempest-ImagesMetadataTestJSON-1781649432-project] 10.222.0.27 "GET /compute/v2.1/images/606928f5-c71e-4193-93c5-4ad285c0e81f/metadata" status: 200 len: 85 microversion: 2.1 time: 0.050862 Jun 20 12:04:07.296635 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 798/1642] 10.222.0.27 () {58 vars in 1259 bytes} [Mon Jun 20 12:04:07 2022] GET /compute/v2.1/images/606928f5-c71e-4193-93c5-4ad285c0e81f/metadata => generated 85 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:04:07.302135 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4ec58aa3-4e4c-44b6-937b-0e7db733d908 tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] Calling method '.version_select at 0x7f607350cd30>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:07.388080 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4ec58aa3-4e4c-44b6-937b-0e7db733d908 tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/737d27fc-a38d-456d-a941-809e9dc563db" status: 200 len: 344 microversion: 2.1 time: 0.090124 Jun 20 12:04:07.388936 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 799/1643] 10.222.0.27 () {58 vars in 1244 bytes} [Mon Jun 20 12:04:07 2022] GET /compute/v2.1/os-volumes/737d27fc-a38d-456d-a941-809e9dc563db => generated 344 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:07.637823 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-466ca070-3064-41b9-a13c-62e471690dea req-bd60d0a4-9ca6-4cf2-891d-1d45d9c4bb8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d348abab-aae7-4b81-84db-f856c9cf4907", "name": "network-vif-unplugged", "status": "completed", "tag": "adf99a3e-442f-4468-a4d4-3b83b4155c6c"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:07.658296 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-466ca070-3064-41b9-a13c-62e471690dea req-bd60d0a4-9ca6-4cf2-891d-1d45d9c4bb8b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:07.659035 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-466ca070-3064-41b9-a13c-62e471690dea req-bd60d0a4-9ca6-4cf2-891d-1d45d9c4bb8b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:07.688910 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-466ca070-3064-41b9-a13c-62e471690dea req-bd60d0a4-9ca6-4cf2-891d-1d45d9c4bb8b service nova] Creating event network-vif-unplugged:adf99a3e-442f-4468-a4d4-3b83b4155c6c for instance d348abab-aae7-4b81-84db-f856c9cf4907 on n-h2-master-1 Jun 20 12:04:07.704673 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-466ca070-3064-41b9-a13c-62e471690dea req-bd60d0a4-9ca6-4cf2-891d-1d45d9c4bb8b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071440 Jun 20 12:04:07.705596 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 800/1644] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:07.999553 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bbc59bcc-aa14-4112-93ce-89f4e8614234 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:08.022180 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bbc59bcc-aa14-4112-93ce-89f4e8614234 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:08.046012 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bbc59bcc-aa14-4112-93ce-89f4e8614234 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:08.048547 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bbc59bcc-aa14-4112-93ce-89f4e8614234 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:08.050704 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bbc59bcc-aa14-4112-93ce-89f4e8614234 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:08.052018 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bbc59bcc-aa14-4112-93ce-89f4e8614234 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:08.150276 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-86cb5b42-e847-4813-8c84-1c5ad0834266 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:08.174988 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-86cb5b42-e847-4813-8c84-1c5ad0834266 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:08.182425 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-86cb5b42-e847-4813-8c84-1c5ad0834266 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:08.187764 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-86cb5b42-e847-4813-8c84-1c5ad0834266 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 2954 microversion: 2.42 time: 1.211362 Jun 20 12:04:08.188435 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 845/1645] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:04:06 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 2954 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:04:08.221172 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e6df8f27-c21d-4ccc-9489-7b4db9c818eb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:08.222585 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e6df8f27-c21d-4ccc-9489-7b4db9c818eb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:08.248167 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e6df8f27-c21d-4ccc-9489-7b4db9c818eb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:08.249746 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-bbc59bcc-aa14-4112-93ce-89f4e8614234 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:08.251422 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e6df8f27-c21d-4ccc-9489-7b4db9c818eb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:08.253748 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e6df8f27-c21d-4ccc-9489-7b4db9c818eb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:08.257418 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e6df8f27-c21d-4ccc-9489-7b4db9c818eb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:08.262153 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bbc59bcc-aa14-4112-93ce-89f4e8614234 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1314 microversion: 2.1 time: 0.274438 Jun 20 12:04:08.265196 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 801/1646] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:07 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:04:08.274942 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9080bdb5-cf1d-4a23-9ad7-38f56acce2be tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:08.275775 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9080bdb5-cf1d-4a23-9ad7-38f56acce2be tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:08.285195 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9080bdb5-cf1d-4a23-9ad7-38f56acce2be tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:08.285947 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9080bdb5-cf1d-4a23-9ad7-38f56acce2be tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:08.287036 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9080bdb5-cf1d-4a23-9ad7-38f56acce2be tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:08.287701 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9080bdb5-cf1d-4a23-9ad7-38f56acce2be tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:08.452924 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9080bdb5-cf1d-4a23-9ad7-38f56acce2be tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.186230 Jun 20 12:04:08.454190 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 802/1647] 10.222.0.27 () {60 vars in 1315 bytes} [Mon Jun 20 12:04:08 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a/os-interface => generated 1831 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:04:08.463020 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5506427a-9870-4616-b982-b0791ffdff16 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:08.464388 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5506427a-9870-4616-b982-b0791ffdff16 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: d348abab-aae7-4b81-84db-f856c9cf4907] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:08.472922 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5506427a-9870-4616-b982-b0791ffdff16 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:08.473880 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5506427a-9870-4616-b982-b0791ffdff16 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:08.474949 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5506427a-9870-4616-b982-b0791ffdff16 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:08.475585 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5506427a-9870-4616-b982-b0791ffdff16 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:08.662607 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5506427a-9870-4616-b982-b0791ffdff16 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:08.673249 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5506427a-9870-4616-b982-b0791ffdff16 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907" status: 200 len: 1502 microversion: 2.1 time: 0.217367 Jun 20 12:04:08.676103 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 803/1648] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:08 2022] GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907 => generated 1502 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:08.686504 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3ab5dce6-5a08-41b9-a12f-75d41b68439c tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] Calling method '.version_select at 0x7f6073523670>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:08.781047 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3ab5dce6-5a08-41b9-a12f-75d41b68439c tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/737d27fc-a38d-456d-a941-809e9dc563db" status: 200 len: 345 microversion: 2.1 time: 0.103050 Jun 20 12:04:08.783844 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 804/1649] 10.222.0.27 () {58 vars in 1244 bytes} [Mon Jun 20 12:04:08 2022] GET /compute/v2.1/os-volumes/737d27fc-a38d-456d-a941-809e9dc563db => generated 345 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:08.791632 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-31561097-2667-4bb7-98f9-aeed8e6873d9 req-e3161430-3435-48a4-84b7-9806e3d9ac65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b52985a9-6859-4d8b-b248-d4d2289f7da1", "name": "network-vif-plugged", "status": "completed", "tag": "cb6f9a61-ee67-4712-b7c2-c06766244aa9"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:08.807454 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-31561097-2667-4bb7-98f9-aeed8e6873d9 req-e3161430-3435-48a4-84b7-9806e3d9ac65 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:08.808026 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-31561097-2667-4bb7-98f9-aeed8e6873d9 req-e3161430-3435-48a4-84b7-9806e3d9ac65 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:08.825961 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-31561097-2667-4bb7-98f9-aeed8e6873d9 req-e3161430-3435-48a4-84b7-9806e3d9ac65 service nova] Creating event network-vif-plugged:cb6f9a61-ee67-4712-b7c2-c06766244aa9 for instance b52985a9-6859-4d8b-b248-d4d2289f7da1 on n-h2-master-1 Jun 20 12:04:08.858739 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-31561097-2667-4bb7-98f9-aeed8e6873d9 req-e3161430-3435-48a4-84b7-9806e3d9ac65 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071449 Jun 20 12:04:08.859590 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 805/1650] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:08.868480 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e29ce5fd-1b55-469c-bc2b-bf940cb54504 tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] Action: 'create', calling method: .version_select at 0x7f6073533dc0>, body: {"snapshot": {"volume_id": "737d27fc-a38d-456d-a941-809e9dc563db", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1953492597"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:09.140446 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e6df8f27-c21d-4ccc-9489-7b4db9c818eb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:09.150826 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e6df8f27-c21d-4ccc-9489-7b4db9c818eb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:09.154088 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e6df8f27-c21d-4ccc-9489-7b4db9c818eb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:09.155447 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e6df8f27-c21d-4ccc-9489-7b4db9c818eb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1280 microversion: 2.25 time: 0.963792 Jun 20 12:04:09.174336 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e29ce5fd-1b55-469c-bc2b-bf940cb54504 tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] 10.222.0.27 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.312301 Jun 20 12:04:09.175459 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 806/1651] 10.222.0.27 () {60 vars in 1161 bytes} [Mon Jun 20 12:04:08 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:09.186160 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 846/1652] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:04:08 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1280 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:04:09.199063 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-12947080-bb27-49b5-8ac8-9ac216abac3d tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] Calling method '.version_select at 0x7f60736a6940>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:09.326401 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-12947080-bb27-49b5-8ac8-9ac216abac3d tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/c42e3c7e-40aa-4e2a-9d0c-49c0c1dfbdf1" status: 200 len: 287 microversion: 2.1 time: 0.138658 Jun 20 12:04:09.328030 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 847/1653] 10.222.0.27 () {58 vars in 1250 bytes} [Mon Jun 20 12:04:09 2022] GET /compute/v2.1/os-snapshots/c42e3c7e-40aa-4e2a-9d0c-49c0c1dfbdf1 => generated 287 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:09.337992 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0fb32cc9-e3ac-49e2-9312-906fb39625ab tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:09.338808 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0fb32cc9-e3ac-49e2-9312-906fb39625ab tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:09.349877 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0fb32cc9-e3ac-49e2-9312-906fb39625ab tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:09.350633 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0fb32cc9-e3ac-49e2-9312-906fb39625ab tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:09.351718 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0fb32cc9-e3ac-49e2-9312-906fb39625ab tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:09.352440 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0fb32cc9-e3ac-49e2-9312-906fb39625ab tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:09.552703 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c0830d97-70f1-495d-a7d5-2e25270834b2 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Action: 'create', calling method: .version_select at 0x7f6073523700>, body: {"keypair": {"name": "tempest-keypair-1445460862", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxgPYt4yfUQE6jgmecFb19f0pdZlgLYR5zBOayHKM+X9FdUPwtIwjDIZVllBWT5z1ElG6i9vnc5cSpK3clmSXUohVcI3NuEaec9rQoTVTxSUCIlU6izUtedoZinlTYbPQ=="}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:09.604181 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-c0830d97-70f1-495d-a7d5-2e25270834b2 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Getting quotas for project 15f7335fd515401090c1d0a1e91d0107. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:04:09.628390 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-c0830d97-70f1-495d-a7d5-2e25270834b2 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Getting quotas for user 47b13de70dd3481684ec50bef063d049 and project 15f7335fd515401090c1d0a1e91d0107. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:04:09.638718 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:09.691034 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c0830d97-70f1-495d-a7d5-2e25270834b2 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.514314 Jun 20 12:04:09.691660 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 807/1654] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 12:04:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:09.696606 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-11ceb9cd-0e22-49c4-af44-d8b61eafd3f2 tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] Calling method '.version_select at 0x7f6073523430>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:09.785275 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-11ceb9cd-0e22-49c4-af44-d8b61eafd3f2 tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.092276 Jun 20 12:04:09.791637 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 808/1655] 10.222.0.27 () {58 vars in 1139 bytes} [Mon Jun 20 12:04:09 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:09.798353 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-83c5cc47-3d24-4464-8c7e-b1f7e2cf144f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:09.799334 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-83c5cc47-3d24-4464-8c7e-b1f7e2cf144f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: d348abab-aae7-4b81-84db-f856c9cf4907] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:09.807946 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-83c5cc47-3d24-4464-8c7e-b1f7e2cf144f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:09.809079 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-83c5cc47-3d24-4464-8c7e-b1f7e2cf144f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:09.810586 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-83c5cc47-3d24-4464-8c7e-b1f7e2cf144f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:09.811483 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-83c5cc47-3d24-4464-8c7e-b1f7e2cf144f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:10.171886 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-83c5cc47-3d24-4464-8c7e-b1f7e2cf144f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:10.180831 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0fb32cc9-e3ac-49e2-9312-906fb39625ab tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:10.183127 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-83c5cc47-3d24-4464-8c7e-b1f7e2cf144f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907" status: 200 len: 1502 microversion: 2.1 time: 0.390055 Jun 20 12:04:10.202534 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0fb32cc9-e3ac-49e2-9312-906fb39625ab tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1314 microversion: 2.1 time: 0.873075 Jun 20 12:04:10.203483 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 848/1657] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:09 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1314 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:10.217086 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-585cbea6-b10d-4859-8fa1-25b6600236df tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] Calling method '.version_select at 0x7f607370ec10>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:10.220230 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 809/1657] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:09 2022] GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907 => generated 1502 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:10.234600 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e4560586-8cc2-48ea-8460-46075c93be7b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:10.235226 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e4560586-8cc2-48ea-8460-46075c93be7b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:10.260406 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e4560586-8cc2-48ea-8460-46075c93be7b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:10.267192 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e4560586-8cc2-48ea-8460-46075c93be7b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:10.268192 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e4560586-8cc2-48ea-8460-46075c93be7b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:10.268677 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e4560586-8cc2-48ea-8460-46075c93be7b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:10.312917 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-585cbea6-b10d-4859-8fa1-25b6600236df tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/c42e3c7e-40aa-4e2a-9d0c-49c0c1dfbdf1" status: 200 len: 287 microversion: 2.1 time: 0.107901 Jun 20 12:04:10.314016 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 849/1658] 10.222.0.27 () {58 vars in 1250 bytes} [Mon Jun 20 12:04:10 2022] GET /compute/v2.1/os-snapshots/c42e3c7e-40aa-4e2a-9d0c-49c0c1dfbdf1 => generated 287 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:10.593381 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e4560586-8cc2-48ea-8460-46075c93be7b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:10.612867 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e4560586-8cc2-48ea-8460-46075c93be7b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:10.614498 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e4560586-8cc2-48ea-8460-46075c93be7b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:10.615664 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e4560586-8cc2-48ea-8460-46075c93be7b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1280 microversion: 2.25 time: 0.394109 Jun 20 12:04:10.620939 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 810/1659] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:04:10 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1280 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:04:10.916841 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-7047ff91-eb8e-4dee-8e64-9586ae64819c req-07d6b14c-a215-43ef-9bd0-4af2b9ebe39e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21b4c645-d527-4d43-a7fb-5c866fa59022", "name": "network-vif-plugged", "status": "completed", "tag": "b8bd2b04-702a-4d5a-97c4-9bb7561531a4"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:10.939169 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-7047ff91-eb8e-4dee-8e64-9586ae64819c req-07d6b14c-a215-43ef-9bd0-4af2b9ebe39e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:10.940104 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-7047ff91-eb8e-4dee-8e64-9586ae64819c req-07d6b14c-a215-43ef-9bd0-4af2b9ebe39e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:10.964742 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-7047ff91-eb8e-4dee-8e64-9586ae64819c req-07d6b14c-a215-43ef-9bd0-4af2b9ebe39e service nova] Creating event network-vif-plugged:b8bd2b04-702a-4d5a-97c4-9bb7561531a4 for instance 21b4c645-d527-4d43-a7fb-5c866fa59022 on n-h1-master-1 Jun 20 12:04:10.975596 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-7047ff91-eb8e-4dee-8e64-9586ae64819c req-07d6b14c-a215-43ef-9bd0-4af2b9ebe39e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063877 Jun 20 12:04:10.978723 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 850/1660] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:11.202429 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3015ded2-d99e-41d9-87ff-531f5c4e363e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:11.203149 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3015ded2-d99e-41d9-87ff-531f5c4e363e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: d348abab-aae7-4b81-84db-f856c9cf4907] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:11.214156 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3015ded2-d99e-41d9-87ff-531f5c4e363e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:11.217541 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3015ded2-d99e-41d9-87ff-531f5c4e363e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:11.218449 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3015ded2-d99e-41d9-87ff-531f5c4e363e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:11.218894 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3015ded2-d99e-41d9-87ff-531f5c4e363e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:11.222420 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a19b2bc7-fcd9-471f-942f-c7c85e2de4d6 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:11.223737 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a19b2bc7-fcd9-471f-942f-c7c85e2de4d6 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:11.240361 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a19b2bc7-fcd9-471f-942f-c7c85e2de4d6 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:11.241271 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a19b2bc7-fcd9-471f-942f-c7c85e2de4d6 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:11.242284 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a19b2bc7-fcd9-471f-942f-c7c85e2de4d6 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:11.244989 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a19b2bc7-fcd9-471f-942f-c7c85e2de4d6 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:11.828465 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a19b2bc7-fcd9-471f-942f-c7c85e2de4d6 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:11.846388 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a19b2bc7-fcd9-471f-942f-c7c85e2de4d6 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1314 microversion: 2.1 time: 0.624207 Jun 20 12:04:11.847078 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 851/1661] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:11 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1314 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:11.859044 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0f5dcd42-9f9f-4481-bf41-52536cc6e923 tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] Calling method '.version_select at 0x7f60801b0ee0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:11.949344 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0f5dcd42-9f9f-4481-bf41-52536cc6e923 tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/c42e3c7e-40aa-4e2a-9d0c-49c0c1dfbdf1" status: 200 len: 287 microversion: 2.1 time: 0.099206 Jun 20 12:04:11.950651 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 852/1662] 10.222.0.27 () {58 vars in 1250 bytes} [Mon Jun 20 12:04:11 2022] GET /compute/v2.1/os-snapshots/c42e3c7e-40aa-4e2a-9d0c-49c0c1dfbdf1 => generated 287 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:11.956867 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9e9433a3-27ec-4fc9-b9d7-c94b579c2480 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:11.958370 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9e9433a3-27ec-4fc9-b9d7-c94b579c2480 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:11.974154 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9e9433a3-27ec-4fc9-b9d7-c94b579c2480 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:11.974773 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9e9433a3-27ec-4fc9-b9d7-c94b579c2480 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:11.976328 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9e9433a3-27ec-4fc9-b9d7-c94b579c2480 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:11.977462 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9e9433a3-27ec-4fc9-b9d7-c94b579c2480 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:12.280599 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3015ded2-d99e-41d9-87ff-531f5c4e363e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:12.309981 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3015ded2-d99e-41d9-87ff-531f5c4e363e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907" status: 200 len: 1477 microversion: 2.1 time: 1.104954 Jun 20 12:04:12.309981 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 811/1663] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:11 2022] GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907 => generated 1477 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:12.334174 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-064469d0-b209-4118-a935-b175fb59ba2e tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Calling method '.version_select at 0x7f60733ffa60>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:12.351149 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-064469d0-b209-4118-a935-b175fb59ba2e tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:12.356483 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-064469d0-b209-4118-a935-b175fb59ba2e tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:12.399653 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-064469d0-b209-4118-a935-b175fb59ba2e tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1936 microversion: 2.1 time: 0.078689 Jun 20 12:04:12.405296 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 812/1664] 10.222.0.27 () {58 vars in 1142 bytes} [Mon Jun 20 12:04:12 2022] GET /compute/v2.1/os-migrations => generated 1936 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:12.452905 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-edf710ae-d4e8-4fa2-ac92-b3f8d5a2e53d tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:12.453813 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-edf710ae-d4e8-4fa2-ac92-b3f8d5a2e53d tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] [instance: d348abab-aae7-4b81-84db-f856c9cf4907] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:12.468548 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-edf710ae-d4e8-4fa2-ac92-b3f8d5a2e53d tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:12.480799 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-edf710ae-d4e8-4fa2-ac92-b3f8d5a2e53d tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:12.482003 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-edf710ae-d4e8-4fa2-ac92-b3f8d5a2e53d tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:12.482624 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-edf710ae-d4e8-4fa2-ac92-b3f8d5a2e53d tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:12.530361 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:12.697403 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9e9433a3-27ec-4fc9-b9d7-c94b579c2480 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:12.713278 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9e9433a3-27ec-4fc9-b9d7-c94b579c2480 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:12.721836 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9e9433a3-27ec-4fc9-b9d7-c94b579c2480 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:12.724040 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9e9433a3-27ec-4fc9-b9d7-c94b579c2480 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1280 microversion: 2.25 time: 0.772094 Jun 20 12:04:12.727869 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 853/1665] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:04:11 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1280 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:04:12.848986 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-edf710ae-d4e8-4fa2-ac92-b3f8d5a2e53d tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907" status: 200 len: 1628 microversion: 2.1 time: 0.429621 Jun 20 12:04:12.849886 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 813/1666] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:12 2022] GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907 => generated 1628 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:12.862902 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-99c88211-ca71-42f2-a245-b991fb90e95b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:12.863810 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-99c88211-ca71-42f2-a245-b991fb90e95b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:12.877125 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6b32f4d2-0146-4559-8293-2e65b481aca0 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Action: 'create', calling method: .version_select at 0x7f607343c280>, body: {"keypair": {"name": "tempest-keypair-483441270", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtS3fhJQtpFey+KUzDiFYAgUFHB7gty9+z+WoQOuwPEDlTbu5whjecvXj74cSfN+4LdcKKWFiozFDy+XEMmc6C60rB3T+ckrbLE7inCCrl81p1bOmP0nwfbDsgsJs4EKw=="}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:12.879718 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-99c88211-ca71-42f2-a245-b991fb90e95b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:12.880185 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-99c88211-ca71-42f2-a245-b991fb90e95b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:12.881010 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-99c88211-ca71-42f2-a245-b991fb90e95b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:12.881453 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-99c88211-ca71-42f2-a245-b991fb90e95b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:12.905851 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-6b32f4d2-0146-4559-8293-2e65b481aca0 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Getting quotas for project 5cf9c3f1d5c64a75b49099a15fe087ee. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:04:12.918027 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-6b32f4d2-0146-4559-8293-2e65b481aca0 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Getting quotas for user 3f16b216588946a790b42450b795ee00 and project 5cf9c3f1d5c64a75b49099a15fe087ee. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:04:12.959079 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6b32f4d2-0146-4559-8293-2e65b481aca0 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.086591 Jun 20 12:04:12.960866 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 814/1667] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 12:04:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:04:12.971765 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fbdd4776-53b8-45cd-bb37-c72c09df53d6 tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] Calling method '.version_select at 0x7f60734323a0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:13.029329 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fbdd4776-53b8-45cd-bb37-c72c09df53d6 tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/c42e3c7e-40aa-4e2a-9d0c-49c0c1dfbdf1" status: 200 len: 288 microversion: 2.1 time: 0.064973 Jun 20 12:04:13.030057 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 815/1668] 10.222.0.27 () {58 vars in 1250 bytes} [Mon Jun 20 12:04:12 2022] GET /compute/v2.1/os-snapshots/c42e3c7e-40aa-4e2a-9d0c-49c0c1dfbdf1 => generated 288 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:13.044593 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a2a8dcfb-bc76-4c09-a845-64a7df3818d6 tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] Calling method '.version_select at 0x7f6073432f70>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:13.163787 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a2a8dcfb-bc76-4c09-a845-64a7df3818d6 tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] 10.222.0.27 "DELETE /compute/v2.1/os-snapshots/c42e3c7e-40aa-4e2a-9d0c-49c0c1dfbdf1" status: 202 len: 0 microversion: 2.1 time: 0.126765 Jun 20 12:04:13.166664 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 816/1669] 10.222.0.27 () {58 vars in 1253 bytes} [Mon Jun 20 12:04:13 2022] DELETE /compute/v2.1/os-snapshots/c42e3c7e-40aa-4e2a-9d0c-49c0c1dfbdf1 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:04:13.179098 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a767d8be-9b92-4883-98ec-06b421fe079a tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] Calling method '.version_select at 0x7f60735785e0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:13.301563 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a767d8be-9b92-4883-98ec-06b421fe079a tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/c42e3c7e-40aa-4e2a-9d0c-49c0c1dfbdf1" status: 200 len: 287 microversion: 2.1 time: 0.130800 Jun 20 12:04:13.303517 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 817/1670] 10.222.0.27 () {58 vars in 1250 bytes} [Mon Jun 20 12:04:13 2022] GET /compute/v2.1/os-snapshots/c42e3c7e-40aa-4e2a-9d0c-49c0c1dfbdf1 => generated 287 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:13.591226 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-99c88211-ca71-42f2-a245-b991fb90e95b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:13.603341 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-99c88211-ca71-42f2-a245-b991fb90e95b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1501 microversion: 2.1 time: 0.744306 Jun 20 12:04:13.611438 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 854/1671] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:12 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1501 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:13.627934 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-66e14629-e488-4ca6-842c-47f79eedba9b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:13.629220 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-66e14629-e488-4ca6-842c-47f79eedba9b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:13.647969 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-66e14629-e488-4ca6-842c-47f79eedba9b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:13.648391 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-66e14629-e488-4ca6-842c-47f79eedba9b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:13.656562 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-66e14629-e488-4ca6-842c-47f79eedba9b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:13.657026 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-66e14629-e488-4ca6-842c-47f79eedba9b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:13.747694 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-34cc12d3-9292-441d-b281-f5a9198fbe78 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:13.748618 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-34cc12d3-9292-441d-b281-f5a9198fbe78 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:13.751318 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-66e14629-e488-4ca6-842c-47f79eedba9b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lazy-loading 'flavor' on Instance uuid b52985a9-6859-4d8b-b248-d4d2289f7da1 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:04:13.756849 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-34cc12d3-9292-441d-b281-f5a9198fbe78 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:13.762171 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-34cc12d3-9292-441d-b281-f5a9198fbe78 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:13.770405 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-34cc12d3-9292-441d-b281-f5a9198fbe78 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:13.771019 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-34cc12d3-9292-441d-b281-f5a9198fbe78 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:14.202292 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-34cc12d3-9292-441d-b281-f5a9198fbe78 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:14.227769 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-34cc12d3-9292-441d-b281-f5a9198fbe78 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:14.230003 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-34cc12d3-9292-441d-b281-f5a9198fbe78 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:14.231675 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-34cc12d3-9292-441d-b281-f5a9198fbe78 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1476 microversion: 2.25 time: 0.488867 Jun 20 12:04:14.235730 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 855/1672] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:04:13 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1476 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:04:14.254524 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9844b4f8-ffbb-4993-801e-e6fa1d0beb39 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:14.255321 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9844b4f8-ffbb-4993-801e-e6fa1d0beb39 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:14.263040 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9844b4f8-ffbb-4993-801e-e6fa1d0beb39 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:14.264037 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9844b4f8-ffbb-4993-801e-e6fa1d0beb39 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:14.265209 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9844b4f8-ffbb-4993-801e-e6fa1d0beb39 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:14.265884 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9844b4f8-ffbb-4993-801e-e6fa1d0beb39 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:14.421918 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-66e14629-e488-4ca6-842c-47f79eedba9b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "POST /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1/action" status: 202 len: 0 microversion: 2.1 time: 0.797442 Jun 20 12:04:14.423340 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 818/1673] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:04:13 2022] POST /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1/action => generated 0 bytes in 803 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:04:14.450606 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bff460dc-4037-436e-9198-f7c9f7b36c4e tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] Calling method '.version_select at 0x7f6073432430>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:14.500437 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bff460dc-4037-436e-9198-f7c9f7b36c4e tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/c42e3c7e-40aa-4e2a-9d0c-49c0c1dfbdf1" status: 200 len: 287 microversion: 2.1 time: 0.075370 Jun 20 12:04:14.501556 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 819/1674] 10.222.0.27 () {58 vars in 1250 bytes} [Mon Jun 20 12:04:14 2022] GET /compute/v2.1/os-snapshots/c42e3c7e-40aa-4e2a-9d0c-49c0c1dfbdf1 => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:14.514034 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9af66e7e-52eb-494a-aa5d-c10e2a33b224 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:14.516482 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9af66e7e-52eb-494a-aa5d-c10e2a33b224 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:14.528880 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9af66e7e-52eb-494a-aa5d-c10e2a33b224 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:14.533733 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9af66e7e-52eb-494a-aa5d-c10e2a33b224 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:14.535638 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9af66e7e-52eb-494a-aa5d-c10e2a33b224 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:14.552071 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9af66e7e-52eb-494a-aa5d-c10e2a33b224 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:14.875877 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9af66e7e-52eb-494a-aa5d-c10e2a33b224 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:14.898083 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9af66e7e-52eb-494a-aa5d-c10e2a33b224 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1507 microversion: 2.1 time: 0.393022 Jun 20 12:04:14.899137 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 820/1675] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:14 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1507 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:14.914193 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a84b0312-1d0b-4eac-8ef3-8b339edb732a tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f60733bbaf0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:14.997313 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a84b0312-1d0b-4eac-8ef3-8b339edb732a tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/c43fda91-93d0-46b5-910b-de0926d5caf1" status: 200 len: 661 microversion: 2.1 time: 0.092528 Jun 20 12:04:14.998636 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 821/1676] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:04:14 2022] GET /compute/v2.1/images/c43fda91-93d0-46b5-910b-de0926d5caf1 => generated 661 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:15.014292 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b75ba425-0b5f-433e-8193-133f28e3f3f5 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f607350c040>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:15.077053 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b75ba425-0b5f-433e-8193-133f28e3f3f5 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/c43fda91-93d0-46b5-910b-de0926d5caf1" status: 200 len: 661 microversion: 2.1 time: 0.071121 Jun 20 12:04:15.078364 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 822/1677] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:04:15 2022] GET /compute/v2.1/images/c43fda91-93d0-46b5-910b-de0926d5caf1 => generated 661 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:15.190849 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:15.191366 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-9844b4f8-ffbb-4993-801e-e6fa1d0beb39 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lazy-loading 'services' on Instance uuid 21b4c645-d527-4d43-a7fb-5c866fa59022 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:04:15.253747 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9844b4f8-ffbb-4993-801e-e6fa1d0beb39 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1968 microversion: 2.25 time: 0.992178 Jun 20 12:04:15.256994 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 856/1678] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:04:14 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1968 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:04:15.275875 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5672b7a9-8081-4e60-818f-6f26c37aa8e4 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:15.276563 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5672b7a9-8081-4e60-818f-6f26c37aa8e4 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:15.293045 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5672b7a9-8081-4e60-818f-6f26c37aa8e4 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:15.294026 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5672b7a9-8081-4e60-818f-6f26c37aa8e4 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:15.296831 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5672b7a9-8081-4e60-818f-6f26c37aa8e4 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:15.298311 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5672b7a9-8081-4e60-818f-6f26c37aa8e4 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:15.430337 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d277681c-0dcb-4700-a40f-d5d8266493d1 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1674993051", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "45ceda3b-038d-4ae1-85b3-92ac48156d73"}], "security_groups": [{"name": "tempest-securitygroup--2054151625"}], "key_name": "tempest-keypair-1445460862", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:15.808732 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=20 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:15.843402 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-d277681c-0dcb-4700-a40f-d5d8266493d1 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] validate_networks() for [('45ceda3b-038d-4ae1-85b3-92ac48156d73', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:04:16.147184 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-5672b7a9-8081-4e60-818f-6f26c37aa8e4 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lazy-loading 'services' on Instance uuid 21b4c645-d527-4d43-a7fb-5c866fa59022 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:04:16.195890 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5672b7a9-8081-4e60-818f-6f26c37aa8e4 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1968 microversion: 2.25 time: 0.925074 Jun 20 12:04:16.201648 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 823/1679] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:04:15 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1968 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:04:16.216430 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d1fceee3-e9d6-4b0d-aade-206e831aebfa tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] Calling method '.version_select at 0x7f60735238b0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:16.262237 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-d1fceee3-e9d6-4b0d-aade-206e831aebfa tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] HTTP exception thrown: Snapshot c42e3c7e-40aa-4e2a-9d0c-49c0c1dfbdf1 could not be found. Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d1fceee3-e9d6-4b0d-aade-206e831aebfa tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] Request method failure captured: Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/os-snapshots/c42e3c7e-40aa-4e2a-9d0c-49c0c1dfbdf1 HTTP/1.1 Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGI1VHKXjS0MpZ1hO0J7fbHcXy4yB9QUaaBRMMnyFPuBux72X0Nk0DEwckFcMiJ4VLvVQ1qN7IsR0-69kqCVvhFqD2qb5p_5p0aeI9ex8UoNbfaMLc9FnNHqfwkBGiH1k3MBmd1FMktVRSFs3xhHEgC2r5QNwpjO7UAO4efpbxAUfbQ Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 356a756c060343df91bc61d83b682371 Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1045199698 Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/356a756c060343df91bc61d83b682371"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/356a756c060343df91bc61d83b682371"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/356a756c060343df91bc61d83b682371"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_356a756c060343df91bc61d83b682371"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1045199698 Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 356a756c060343df91bc61d83b682371 Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1045199698 Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-VolumesSnapshotsTestJSON-1045199698-project Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: c9559b9fc091417dbc3051c8329dee77 Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1045199698-project Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: exception: Snapshot c42e3c7e-40aa-4e2a-9d0c-49c0c1dfbdf1 could not be found. Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'c42e3c7e-40aa-4e2a-9d0c-49c0c1dfbdf1'} Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c42e3c7e-40aa-4e2a-9d0c-49c0c1dfbdf1 could not be found. (HTTP 404) (Request-ID: req-32e486b5-599e-4270-88ce-e671588eaaa5) Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 12:04:16.274459 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 12:04:16.281212 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 20 12:04:16.281212 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 20 12:04:16.281212 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 20 12:04:16.281212 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 20 12:04:16.281212 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 20 12:04:16.281212 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 20 12:04:16.281212 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 12:04:16.281212 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 12:04:16.281212 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 12:04:16.281212 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 12:04:16.281212 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 12:04:16.281212 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 12:04:16.281212 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 12:04:16.281212 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 12:04:16.281212 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c42e3c7e-40aa-4e2a-9d0c-49c0c1dfbdf1 could not be found. Jun 20 12:04:16.281212 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:04:16.281212 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:04:16.281212 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:04:16.281212 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:04:16.281212 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:04:16.281212 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:04:16.281212 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:04:16.281212 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:04:16.281212 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:04:16.281212 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:04:16.281212 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:04:16.281212 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:04:16.281212 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 20 12:04:16.281212 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:04:16.281212 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c42e3c7e-40aa-4e2a-9d0c-49c0c1dfbdf1 could not be found. Jun 20 12:04:16.281212 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:04:16.281212 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:04:16.281212 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:04:16.281212 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:04:16.281212 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:04:16.281212 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:04:16.281212 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:04:16.281212 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:04:16.281212 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c42e3c7e-40aa-4e2a-9d0c-49c0c1dfbdf1 could not be found. Jun 20 12:04:16.281212 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:04:16.293487 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d1fceee3-e9d6-4b0d-aade-206e831aebfa tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] Returning 404 to user: Snapshot c42e3c7e-40aa-4e2a-9d0c-49c0c1dfbdf1 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:04:16.294638 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d1fceee3-e9d6-4b0d-aade-206e831aebfa tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/c42e3c7e-40aa-4e2a-9d0c-49c0c1dfbdf1" status: 404 len: 111 microversion: 2.1 time: 0.091507 Jun 20 12:04:16.295820 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 824/1680] 10.222.0.27 () {58 vars in 1250 bytes} [Mon Jun 20 12:04:16 2022] GET /compute/v2.1/os-snapshots/c42e3c7e-40aa-4e2a-9d0c-49c0c1dfbdf1 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:04:16.312214 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-aa43936b-0e48-4fe6-9ce1-d70003af5805 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:16.315838 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-aa43936b-0e48-4fe6-9ce1-d70003af5805 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:16.341921 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aa43936b-0e48-4fe6-9ce1-d70003af5805 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:16.342381 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aa43936b-0e48-4fe6-9ce1-d70003af5805 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:16.343473 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aa43936b-0e48-4fe6-9ce1-d70003af5805 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:16.344091 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aa43936b-0e48-4fe6-9ce1-d70003af5805 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:16.583029 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-d277681c-0dcb-4700-a40f-d5d8266493d1 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Getting quotas for project 15f7335fd515401090c1d0a1e91d0107. Resources: dict_keys(['metadata_items']) {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:04:16.588778 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-d277681c-0dcb-4700-a40f-d5d8266493d1 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Getting quotas for user 47b13de70dd3481684ec50bef063d049 and project 15f7335fd515401090c1d0a1e91d0107. Resources: dict_keys(['metadata_items']) {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:04:16.608972 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-d277681c-0dcb-4700-a40f-d5d8266493d1 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:04:16.609477 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-d277681c-0dcb-4700-a40f-d5d8266493d1 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:04:16.609986 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-d277681c-0dcb-4700-a40f-d5d8266493d1 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:04:16.610395 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-d277681c-0dcb-4700-a40f-d5d8266493d1 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:04:16.610833 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-d277681c-0dcb-4700-a40f-d5d8266493d1 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:04:16.619418 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d277681c-0dcb-4700-a40f-d5d8266493d1 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:16.619867 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d277681c-0dcb-4700-a40f-d5d8266493d1 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:16.620701 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d277681c-0dcb-4700-a40f-d5d8266493d1 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:16.621255 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d277681c-0dcb-4700-a40f-d5d8266493d1 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:16.640458 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-d277681c-0dcb-4700-a40f-d5d8266493d1 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Getting quotas for project 15f7335fd515401090c1d0a1e91d0107. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:04:16.645170 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-aa43936b-0e48-4fe6-9ce1-d70003af5805 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:16.647260 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-d277681c-0dcb-4700-a40f-d5d8266493d1 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Getting quotas for user 47b13de70dd3481684ec50bef063d049 and project 15f7335fd515401090c1d0a1e91d0107. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:04:16.656309 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-aa43936b-0e48-4fe6-9ce1-d70003af5805 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1507 microversion: 2.1 time: 0.359106 Jun 20 12:04:16.660278 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 825/1681] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:16 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1507 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:16.669174 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-aab1066d-f375-43e2-8b6b-c0bf0dc9c8ae tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:16.670688 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:04:16.670688 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 12:04:16.672328 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d277681c-0dcb-4700-a40f-d5d8266493d1 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:04:16.672540 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aab1066d-f375-43e2-8b6b-c0bf0dc9c8ae tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:16.673335 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aab1066d-f375-43e2-8b6b-c0bf0dc9c8ae tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:16.674237 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aab1066d-f375-43e2-8b6b-c0bf0dc9c8ae tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:16.674697 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aab1066d-f375-43e2-8b6b-c0bf0dc9c8ae tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:16.675547 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d277681c-0dcb-4700-a40f-d5d8266493d1 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] [instance: c9290d77-4370-4fb5-a6ef-f1c1b6872b90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:04:16.706678 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-aab1066d-f375-43e2-8b6b-c0bf0dc9c8ae tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.045148 Jun 20 12:04:16.707607 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 826/1682] 10.222.0.27 () {60 vars in 1216 bytes} [Mon Jun 20 12:04:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:04:16.720494 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0ad745df-e7c1-4d60-a294-59df46376517 tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] Calling method '.version_select at 0x7f607347b550>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:16.736157 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d277681c-0dcb-4700-a40f-d5d8266493d1 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.310189 Jun 20 12:04:16.737464 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 857/1683] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:04:15 2022] POST /compute/v2.1/servers => generated 409 bytes in 1312 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 12:04:16.836932 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0ad745df-e7c1-4d60-a294-59df46376517 tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/737d27fc-a38d-456d-a941-809e9dc563db" status: 202 len: 0 microversion: 2.1 time: 0.120304 Jun 20 12:04:16.841283 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 827/1684] 10.222.0.27 () {58 vars in 1247 bytes} [Mon Jun 20 12:04:16 2022] DELETE /compute/v2.1/os-volumes/737d27fc-a38d-456d-a941-809e9dc563db => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:04:16.844686 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6ca1bdc1-705c-4023-846f-aada01385c0b tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f607350c040>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:16.890353 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7597a82f-f1d7-4639-a7e2-d891b09b8ccf tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1650063921", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "ab5a97aa-06fd-4e21-892e-d2f2bb854bdb"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:16.942031 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6ca1bdc1-705c-4023-846f-aada01385c0b tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/eca6174d-0dbb-4733-b8da-463bc2da35a4" status: 200 len: 660 microversion: 2.1 time: 0.102429 Jun 20 12:04:16.942886 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 828/1685] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:04:16 2022] GET /compute/v2.1/images/eca6174d-0dbb-4733-b8da-463bc2da35a4 => generated 660 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:16.968511 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3e2859a7-0a01-4ecb-8383-d98e3d97a73e tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": "auto"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:16.970080 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3e2859a7-0a01-4ecb-8383-d98e3d97a73e tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:16.970677 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-7597a82f-f1d7-4639-a7e2-d891b09b8ccf tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] validate_networks() for [('ab5a97aa-06fd-4e21-892e-d2f2bb854bdb', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:04:16.988625 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3e2859a7-0a01-4ecb-8383-d98e3d97a73e tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:16.989176 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3e2859a7-0a01-4ecb-8383-d98e3d97a73e tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:16.989999 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3e2859a7-0a01-4ecb-8383-d98e3d97a73e tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:16.991032 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3e2859a7-0a01-4ecb-8383-d98e3d97a73e tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:17.068343 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-3e2859a7-0a01-4ecb-8383-d98e3d97a73e tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lazy-loading 'flavor' on Instance uuid 21b4c645-d527-4d43-a7fb-5c866fa59022 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:04:17.093179 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3e2859a7-0a01-4ecb-8383-d98e3d97a73e tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Going to try to live migrate instance to n-h2-master-1 {{(pid=119128) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 20 12:04:17.593024 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-7597a82f-f1d7-4639-a7e2-d891b09b8ccf tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:04:17.593511 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-7597a82f-f1d7-4639-a7e2-d891b09b8ccf tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:04:17.594071 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-7597a82f-f1d7-4639-a7e2-d891b09b8ccf tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:04:17.594582 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-7597a82f-f1d7-4639-a7e2-d891b09b8ccf tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:04:17.595080 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-7597a82f-f1d7-4639-a7e2-d891b09b8ccf tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:04:17.612712 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7597a82f-f1d7-4639-a7e2-d891b09b8ccf tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:17.614286 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7597a82f-f1d7-4639-a7e2-d891b09b8ccf tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:17.617614 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7597a82f-f1d7-4639-a7e2-d891b09b8ccf tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:17.618135 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7597a82f-f1d7-4639-a7e2-d891b09b8ccf tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:17.642806 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-7597a82f-f1d7-4639-a7e2-d891b09b8ccf tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Getting quotas for project 615573a78a9d4e75a36ada9bd9de7e15. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:04:17.648925 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-7597a82f-f1d7-4639-a7e2-d891b09b8ccf tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Getting quotas for user 8b2304d9c7dd493983542a54b6799989 and project 615573a78a9d4e75a36ada9bd9de7e15. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:04:17.667391 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7597a82f-f1d7-4639-a7e2-d891b09b8ccf tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:04:17.670788 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7597a82f-f1d7-4639-a7e2-d891b09b8ccf tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:04:17.712003 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:17.738797 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7597a82f-f1d7-4639-a7e2-d891b09b8ccf tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.000279 Jun 20 12:04:17.745427 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 858/1686] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:04:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:04:17.752246 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d6e2bf2e-3a5f-4c86-aa8c-144d89870636 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:17.753157 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d6e2bf2e-3a5f-4c86-aa8c-144d89870636 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] [instance: c9290d77-4370-4fb5-a6ef-f1c1b6872b90] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:17.762798 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d6e2bf2e-3a5f-4c86-aa8c-144d89870636 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:17.763704 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d6e2bf2e-3a5f-4c86-aa8c-144d89870636 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:17.764935 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d6e2bf2e-3a5f-4c86-aa8c-144d89870636 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:17.765756 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d6e2bf2e-3a5f-4c86-aa8c-144d89870636 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:17.855508 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d6e2bf2e-3a5f-4c86-aa8c-144d89870636 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b13de70dd3481684ec50bef063d049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f7335fd515401090c1d0a1e91d0107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:17.864282 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d6e2bf2e-3a5f-4c86-aa8c-144d89870636 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] 10.222.0.27 "GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90" status: 200 len: 1274 microversion: 2.1 time: 0.117005 Jun 20 12:04:17.866530 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 859/1687] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:17 2022] GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90 => generated 1274 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:17.871725 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f98aa273-74fa-43f3-a772-9eb599e99d4c tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] Calling method '.version_select at 0x7f60736f3160>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:17.954779 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f98aa273-74fa-43f3-a772-9eb599e99d4c tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/737d27fc-a38d-456d-a941-809e9dc563db" status: 200 len: 344 microversion: 2.1 time: 0.086850 Jun 20 12:04:17.955790 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 860/1688] 10.222.0.27 () {58 vars in 1244 bytes} [Mon Jun 20 12:04:17 2022] GET /compute/v2.1/os-volumes/737d27fc-a38d-456d-a941-809e9dc563db => generated 344 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:17.963534 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9b2d1e6a-876a-4e25-9e8a-1605d9a3f0d4 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073fb7820>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:18.070015 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9b2d1e6a-876a-4e25-9e8a-1605d9a3f0d4 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/eca6174d-0dbb-4733-b8da-463bc2da35a4" status: 200 len: 660 microversion: 2.1 time: 0.111787 Jun 20 12:04:18.072924 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 861/1689] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:04:17 2022] GET /compute/v2.1/images/eca6174d-0dbb-4733-b8da-463bc2da35a4 => generated 660 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:18.087427 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7a0e19b2-0b4d-4a27-be16-24f9211b6bd6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-639412065", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "c2bcaf29-2650-4e29-8ebc-39da1df0e1bf"}], "security_groups": [{"name": "tempest-securitygroup--1785753081"}], "key_name": "tempest-keypair-483441270", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:18.359205 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-7a0e19b2-0b4d-4a27-be16-24f9211b6bd6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] validate_networks() for [('c2bcaf29-2650-4e29-8ebc-39da1df0e1bf', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:04:19.009482 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-7a0e19b2-0b4d-4a27-be16-24f9211b6bd6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:04:19.010180 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-7a0e19b2-0b4d-4a27-be16-24f9211b6bd6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:04:19.010355 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-7a0e19b2-0b4d-4a27-be16-24f9211b6bd6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:04:19.010954 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-7a0e19b2-0b4d-4a27-be16-24f9211b6bd6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:04:19.011605 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-7a0e19b2-0b4d-4a27-be16-24f9211b6bd6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:04:19.031045 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7a0e19b2-0b4d-4a27-be16-24f9211b6bd6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:19.031509 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7a0e19b2-0b4d-4a27-be16-24f9211b6bd6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:19.032323 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7a0e19b2-0b4d-4a27-be16-24f9211b6bd6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:19.032765 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7a0e19b2-0b4d-4a27-be16-24f9211b6bd6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:19.106985 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-7a0e19b2-0b4d-4a27-be16-24f9211b6bd6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Getting quotas for project 5cf9c3f1d5c64a75b49099a15fe087ee. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:04:19.119554 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-7a0e19b2-0b4d-4a27-be16-24f9211b6bd6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Getting quotas for user 3f16b216588946a790b42450b795ee00 and project 5cf9c3f1d5c64a75b49099a15fe087ee. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:04:19.151310 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7a0e19b2-0b4d-4a27-be16-24f9211b6bd6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:04:19.156133 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7a0e19b2-0b4d-4a27-be16-24f9211b6bd6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:04:19.271810 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7a0e19b2-0b4d-4a27-be16-24f9211b6bd6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.197337 Jun 20 12:04:19.285063 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 862/1690] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:04:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 1211 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:04:19.290327 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cea8880b-24f9-4233-99b5-fed80d4729ea tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:19.300407 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cea8880b-24f9-4233-99b5-fed80d4729ea tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:19.326016 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cea8880b-24f9-4233-99b5-fed80d4729ea tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:19.332051 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cea8880b-24f9-4233-99b5-fed80d4729ea tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:19.333192 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cea8880b-24f9-4233-99b5-fed80d4729ea tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:19.335007 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cea8880b-24f9-4233-99b5-fed80d4729ea tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:19.890120 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cea8880b-24f9-4233-99b5-fed80d4729ea tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:19.893004 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3e2859a7-0a01-4ecb-8383-d98e3d97a73e tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022/action" status: 202 len: 0 microversion: 2.25 time: 2.936484 Jun 20 12:04:19.894653 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 829/1691] 10.222.0.27 () {62 vars in 1318 bytes} [Mon Jun 20 12:04:16 2022] POST /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022/action => generated 0 bytes in 2940 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:04:19.899181 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cea8880b-24f9-4233-99b5-fed80d4729ea tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1507 microversion: 2.1 time: 0.612665 Jun 20 12:04:19.900315 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 863/1692] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:19 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1507 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:19.900644 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3c5e2e76-6ca0-43ba-ae05-9a5e0cfdf9c5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:19.901367 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3c5e2e76-6ca0-43ba-ae05-9a5e0cfdf9c5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:19.905357 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cbdbae02-b842-496a-84ff-42365749b6fd tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:19.906096 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cbdbae02-b842-496a-84ff-42365749b6fd tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] [instance: c9290d77-4370-4fb5-a6ef-f1c1b6872b90] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:19.913418 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cbdbae02-b842-496a-84ff-42365749b6fd tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:19.914334 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cbdbae02-b842-496a-84ff-42365749b6fd tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:19.915583 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cbdbae02-b842-496a-84ff-42365749b6fd tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:19.916263 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cbdbae02-b842-496a-84ff-42365749b6fd tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:19.916877 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3c5e2e76-6ca0-43ba-ae05-9a5e0cfdf9c5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:19.917335 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3c5e2e76-6ca0-43ba-ae05-9a5e0cfdf9c5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:19.918177 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3c5e2e76-6ca0-43ba-ae05-9a5e0cfdf9c5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:19.918801 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3c5e2e76-6ca0-43ba-ae05-9a5e0cfdf9c5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:19.997599 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3c5e2e76-6ca0-43ba-ae05-9a5e0cfdf9c5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:20.009804 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3c5e2e76-6ca0-43ba-ae05-9a5e0cfdf9c5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a" status: 200 len: 1260 microversion: 2.1 time: 0.113577 Jun 20 12:04:20.012975 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 830/1693] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:19 2022] GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a => generated 1260 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:20.026405 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-da31315a-6cbf-4b99-9346-84df034b445b tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] Calling method '.version_select at 0x7f6073578310>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:20.101421 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cbdbae02-b842-496a-84ff-42365749b6fd tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b13de70dd3481684ec50bef063d049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f7335fd515401090c1d0a1e91d0107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:20.115561 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cbdbae02-b842-496a-84ff-42365749b6fd tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] 10.222.0.27 "GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90" status: 200 len: 1336 microversion: 2.1 time: 0.208981 Jun 20 12:04:20.119339 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 864/1694] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:19 2022] GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90 => generated 1336 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:20.132662 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f81d88ea-57df-43c2-8c23-e1cd0d9aac01 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:20.136831 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f81d88ea-57df-43c2-8c23-e1cd0d9aac01 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:20.177190 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-da31315a-6cbf-4b99-9346-84df034b445b tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/737d27fc-a38d-456d-a941-809e9dc563db" status: 200 len: 344 microversion: 2.1 time: 0.161175 Jun 20 12:04:20.177765 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 831/1695] 10.222.0.27 () {58 vars in 1244 bytes} [Mon Jun 20 12:04:20 2022] GET /compute/v2.1/os-volumes/737d27fc-a38d-456d-a941-809e9dc563db => generated 344 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:20.184788 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-356fa8d7-afe6-4698-adb5-e4c16bd5091b tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f607361e550>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:20.278488 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-356fa8d7-afe6-4698-adb5-e4c16bd5091b tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/0f92dbd3-7b57-4ed1-bae6-da74b57b9ce7" status: 200 len: 662 microversion: 2.1 time: 0.098965 Jun 20 12:04:20.280051 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 832/1696] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:04:20 2022] GET /compute/v2.1/images/0f92dbd3-7b57-4ed1-bae6-da74b57b9ce7 => generated 662 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:20.292690 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9ea909cd-884d-4a65-947e-f4dc5014ff4b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:20.295741 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9ea909cd-884d-4a65-947e-f4dc5014ff4b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:20.308232 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9ea909cd-884d-4a65-947e-f4dc5014ff4b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:20.317068 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9ea909cd-884d-4a65-947e-f4dc5014ff4b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:20.318689 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9ea909cd-884d-4a65-947e-f4dc5014ff4b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:20.319185 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f81d88ea-57df-43c2-8c23-e1cd0d9aac01 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:20.319759 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9ea909cd-884d-4a65-947e-f4dc5014ff4b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:20.334669 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f81d88ea-57df-43c2-8c23-e1cd0d9aac01 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1233 microversion: 2.1 time: 0.213913 Jun 20 12:04:20.335579 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 865/1697] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:20 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1233 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:20.351747 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5734042b-7f2d-452e-8569-d1d51a226633 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f608299e5e0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:20.410051 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5734042b-7f2d-452e-8569-d1d51a226633 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/0f92dbd3-7b57-4ed1-bae6-da74b57b9ce7" status: 200 len: 662 microversion: 2.1 time: 0.063913 Jun 20 12:04:20.411079 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 866/1698] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:04:20 2022] GET /compute/v2.1/images/0f92dbd3-7b57-4ed1-bae6-da74b57b9ce7 => generated 662 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:20.570766 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-538621eb-1f0d-4117-80e8-1f20d538b01a tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1072093524", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:20.663312 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-538621eb-1f0d-4117-80e8-1f20d538b01a tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] validate_networks() for None {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:04:20.694748 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9ea909cd-884d-4a65-947e-f4dc5014ff4b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:20.713133 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9ea909cd-884d-4a65-947e-f4dc5014ff4b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:20.715118 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9ea909cd-884d-4a65-947e-f4dc5014ff4b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:20.719528 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9ea909cd-884d-4a65-947e-f4dc5014ff4b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1486 microversion: 2.25 time: 0.437266 Jun 20 12:04:20.722969 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 833/1699] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:04:20 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1486 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:04:20.917045 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-30e6f0b5-476b-4b3f-b017-b1d41a078252 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:20.918605 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-30e6f0b5-476b-4b3f-b017-b1d41a078252 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:20.925636 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-30e6f0b5-476b-4b3f-b017-b1d41a078252 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:20.926467 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-30e6f0b5-476b-4b3f-b017-b1d41a078252 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:20.927502 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-30e6f0b5-476b-4b3f-b017-b1d41a078252 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:20.928191 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-30e6f0b5-476b-4b3f-b017-b1d41a078252 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:21.130885 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-30e6f0b5-476b-4b3f-b017-b1d41a078252 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:21.149694 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-30e6f0b5-476b-4b3f-b017-b1d41a078252 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1507 microversion: 2.1 time: 0.236535 Jun 20 12:04:21.156380 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 834/1700] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:20 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1507 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:21.172177 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-017e11be-4d91-4bc4-9ee5-b6db9cbcb6a1 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:21.173316 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-017e11be-4d91-4bc4-9ee5-b6db9cbcb6a1 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:21.192581 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-017e11be-4d91-4bc4-9ee5-b6db9cbcb6a1 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:21.194508 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-017e11be-4d91-4bc4-9ee5-b6db9cbcb6a1 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:21.202824 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-017e11be-4d91-4bc4-9ee5-b6db9cbcb6a1 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:21.204594 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-017e11be-4d91-4bc4-9ee5-b6db9cbcb6a1 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:21.376607 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-017e11be-4d91-4bc4-9ee5-b6db9cbcb6a1 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:21.391913 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-017e11be-4d91-4bc4-9ee5-b6db9cbcb6a1 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a" status: 200 len: 1266 microversion: 2.1 time: 0.234121 Jun 20 12:04:21.405287 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 835/1701] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:21 2022] GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a => generated 1266 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:21.417230 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1145f9ab-7d21-4592-ab8f-993fc8c6f0d9 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:21.418343 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1145f9ab-7d21-4592-ab8f-993fc8c6f0d9 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] [instance: c9290d77-4370-4fb5-a6ef-f1c1b6872b90] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:21.440513 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1145f9ab-7d21-4592-ab8f-993fc8c6f0d9 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:21.441248 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1145f9ab-7d21-4592-ab8f-993fc8c6f0d9 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:21.442249 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1145f9ab-7d21-4592-ab8f-993fc8c6f0d9 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:21.442855 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1145f9ab-7d21-4592-ab8f-993fc8c6f0d9 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:21.564555 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1145f9ab-7d21-4592-ab8f-993fc8c6f0d9 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b13de70dd3481684ec50bef063d049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f7335fd515401090c1d0a1e91d0107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:21.578850 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1145f9ab-7d21-4592-ab8f-993fc8c6f0d9 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] 10.222.0.27 "GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90" status: 200 len: 1336 microversion: 2.1 time: 0.172020 Jun 20 12:04:21.588318 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 836/1702] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:21 2022] GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90 => generated 1336 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:21.600055 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d37cffae-34d9-4cce-bdb2-9a4def1ec6fa tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] Calling method '.version_select at 0x7f6073578d30>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:21.651359 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-d37cffae-34d9-4cce-bdb2-9a4def1ec6fa tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] HTTP exception thrown: Volume 737d27fc-a38d-456d-a941-809e9dc563db could not be found. Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d37cffae-34d9-4cce-bdb2-9a4def1ec6fa tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] Request method failure captured: Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/os-volumes/737d27fc-a38d-456d-a941-809e9dc563db HTTP/1.1 Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGI1VHKXjS0MpZ1hO0J7fbHcXy4yB9QUaaBRMMnyFPuBux72X0Nk0DEwckFcMiJ4VLvVQ1qN7IsR0-69kqCVvhFqD2qb5p_5p0aeI9ex8UoNbfaMLc9FnNHqfwkBGiH1k3MBmd1FMktVRSFs3xhHEgC2r5QNwpjO7UAO4efpbxAUfbQ Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 356a756c060343df91bc61d83b682371 Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1045199698 Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/356a756c060343df91bc61d83b682371"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/356a756c060343df91bc61d83b682371"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/356a756c060343df91bc61d83b682371"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_356a756c060343df91bc61d83b682371"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1045199698 Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 356a756c060343df91bc61d83b682371 Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1045199698 Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-VolumesSnapshotsTestJSON-1045199698-project Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: c9559b9fc091417dbc3051c8329dee77 Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1045199698-project Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: exception: Volume 737d27fc-a38d-456d-a941-809e9dc563db could not be found. Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '737d27fc-a38d-456d-a941-809e9dc563db'} Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 737d27fc-a38d-456d-a941-809e9dc563db could not be found. (HTTP 404) (Request-ID: req-12b9c270-af6a-4bab-a4e1-440979220d82) Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 12:04:21.653904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 737d27fc-a38d-456d-a941-809e9dc563db could not be found. Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 737d27fc-a38d-456d-a941-809e9dc563db could not be found. Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 737d27fc-a38d-456d-a941-809e9dc563db could not be found. Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d37cffae-34d9-4cce-bdb2-9a4def1ec6fa tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] Returning 404 to user: Volume 737d27fc-a38d-456d-a941-809e9dc563db could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:04:21.658822 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d37cffae-34d9-4cce-bdb2-9a4def1ec6fa tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/737d27fc-a38d-456d-a941-809e9dc563db" status: 404 len: 109 microversion: 2.1 time: 0.065627 Jun 20 12:04:21.665214 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 837/1703] 10.222.0.27 () {58 vars in 1244 bytes} [Mon Jun 20 12:04:21 2022] GET /compute/v2.1/os-volumes/737d27fc-a38d-456d-a941-809e9dc563db => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:04:21.668920 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-64087980-e9b5-4475-84d4-476953c5712a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:21.669826 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-64087980-e9b5-4475-84d4-476953c5712a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:21.694640 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64087980-e9b5-4475-84d4-476953c5712a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:21.695215 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64087980-e9b5-4475-84d4-476953c5712a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:21.696021 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64087980-e9b5-4475-84d4-476953c5712a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:21.696521 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64087980-e9b5-4475-84d4-476953c5712a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:21.850642 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-64087980-e9b5-4475-84d4-476953c5712a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:21.860540 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-64087980-e9b5-4475-84d4-476953c5712a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1291 microversion: 2.1 time: 0.196003 Jun 20 12:04:21.861352 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 838/1704] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:21 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1291 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:21.861951 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-538621eb-1f0d-4117-80e8-1f20d538b01a tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:04:21.862436 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-538621eb-1f0d-4117-80e8-1f20d538b01a tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:04:21.863194 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-538621eb-1f0d-4117-80e8-1f20d538b01a tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:04:21.863914 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-538621eb-1f0d-4117-80e8-1f20d538b01a tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:04:21.864522 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-538621eb-1f0d-4117-80e8-1f20d538b01a tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:04:21.867259 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2b1aceef-d8d7-4248-bef1-0dc005db045e tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] Calling method '.version_select at 0x7f6073525430>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:21.882476 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-538621eb-1f0d-4117-80e8-1f20d538b01a tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:21.883356 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-538621eb-1f0d-4117-80e8-1f20d538b01a tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:21.884495 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-538621eb-1f0d-4117-80e8-1f20d538b01a tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:21.887800 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-538621eb-1f0d-4117-80e8-1f20d538b01a tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:21.908294 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-2b1aceef-d8d7-4248-bef1-0dc005db045e tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] HTTP exception thrown: Volume 737d27fc-a38d-456d-a941-809e9dc563db could not be found. Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2b1aceef-d8d7-4248-bef1-0dc005db045e tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] Request method failure captured: Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/os-volumes/737d27fc-a38d-456d-a941-809e9dc563db HTTP/1.1 Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGI1VHKXjS0MpZ1hO0J7fbHcXy4yB9QUaaBRMMnyFPuBux72X0Nk0DEwckFcMiJ4VLvVQ1qN7IsR0-69kqCVvhFqD2qb5p_5p0aeI9ex8UoNbfaMLc9FnNHqfwkBGiH1k3MBmd1FMktVRSFs3xhHEgC2r5QNwpjO7UAO4efpbxAUfbQ Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 356a756c060343df91bc61d83b682371 Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1045199698 Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/356a756c060343df91bc61d83b682371"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/356a756c060343df91bc61d83b682371"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/356a756c060343df91bc61d83b682371"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_356a756c060343df91bc61d83b682371"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1045199698 Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 356a756c060343df91bc61d83b682371 Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1045199698 Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-VolumesSnapshotsTestJSON-1045199698-project Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: c9559b9fc091417dbc3051c8329dee77 Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1045199698-project Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: exception: Volume 737d27fc-a38d-456d-a941-809e9dc563db could not be found. Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '737d27fc-a38d-456d-a941-809e9dc563db'} Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 737d27fc-a38d-456d-a941-809e9dc563db could not be found. (HTTP 404) (Request-ID: req-428ad1bb-f63d-4725-b8cf-ceb30118131d) Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 12:04:21.913219 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 12:04:21.920539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 12:04:21.920539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 12:04:21.920539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 12:04:21.920539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 12:04:21.920539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 12:04:21.920539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 12:04:21.920539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 12:04:21.920539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 12:04:21.920539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 12:04:21.920539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 12:04:21.920539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 12:04:21.920539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 12:04:21.920539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 12:04:21.920539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 737d27fc-a38d-456d-a941-809e9dc563db could not be found. Jun 20 12:04:21.920539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:04:21.920539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:04:21.920539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:04:21.920539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:04:21.920539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:04:21.920539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:04:21.920539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:04:21.920539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:04:21.920539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:04:21.920539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:04:21.920539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:04:21.920539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:04:21.920539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 20 12:04:21.920539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:04:21.920539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 737d27fc-a38d-456d-a941-809e9dc563db could not be found. Jun 20 12:04:21.920539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:04:21.920539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:04:21.920539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:04:21.920539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:04:21.920539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:04:21.920539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:04:21.920539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:04:21.920539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:04:21.920539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 737d27fc-a38d-456d-a941-809e9dc563db could not be found. Jun 20 12:04:21.920539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:04:21.929312 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2b1aceef-d8d7-4248-bef1-0dc005db045e tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] Returning 404 to user: Volume 737d27fc-a38d-456d-a941-809e9dc563db could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:04:21.929312 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2b1aceef-d8d7-4248-bef1-0dc005db045e tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/737d27fc-a38d-456d-a941-809e9dc563db" status: 404 len: 109 microversion: 2.1 time: 0.063448 Jun 20 12:04:21.929312 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 839/1705] 10.222.0.27 () {58 vars in 1247 bytes} [Mon Jun 20 12:04:21 2022] DELETE /compute/v2.1/os-volumes/737d27fc-a38d-456d-a941-809e9dc563db => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:04:21.936733 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-533be942-4839-4c02-86e0-e6419a40627f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:21.941738 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-533be942-4839-4c02-86e0-e6419a40627f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:21.944437 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-538621eb-1f0d-4117-80e8-1f20d538b01a tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Getting quotas for project 3a8c8766d4f143349b61f27d8f2566fb. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:04:21.957012 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-538621eb-1f0d-4117-80e8-1f20d538b01a tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Getting quotas for user 286e4b475bbc4d108ca00497ecd3e55a and project 3a8c8766d4f143349b61f27d8f2566fb. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:04:21.960811 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-533be942-4839-4c02-86e0-e6419a40627f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:21.961653 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-533be942-4839-4c02-86e0-e6419a40627f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:21.962628 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-533be942-4839-4c02-86e0-e6419a40627f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:21.963235 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-533be942-4839-4c02-86e0-e6419a40627f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:21.988661 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-538621eb-1f0d-4117-80e8-1f20d538b01a tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:04:21.989364 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:22.001526 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-538621eb-1f0d-4117-80e8-1f20d538b01a tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: 838db96b-0c7a-4d7f-9807-44194bc73cff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:04:22.074155 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-538621eb-1f0d-4117-80e8-1f20d538b01a tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.507924 Jun 20 12:04:22.075838 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 867/1706] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:04:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 12:04:22.084035 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b1c4a63c-c00d-471b-8c43-3a6198980078 tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] Calling method '.version_select at 0x7f607370e5e0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:22.148064 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-b1c4a63c-c00d-471b-8c43-3a6198980078 tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] HTTP exception thrown: Volume 737d27fc-a38d-456d-a941-809e9dc563db could not be found. Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b1c4a63c-c00d-471b-8c43-3a6198980078 tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] Request method failure captured: Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/os-volumes/737d27fc-a38d-456d-a941-809e9dc563db HTTP/1.1 Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGI1VHKXjS0MpZ1hO0J7fbHcXy4yB9QUaaBRMMnyFPuBux72X0Nk0DEwckFcMiJ4VLvVQ1qN7IsR0-69kqCVvhFqD2qb5p_5p0aeI9ex8UoNbfaMLc9FnNHqfwkBGiH1k3MBmd1FMktVRSFs3xhHEgC2r5QNwpjO7UAO4efpbxAUfbQ Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 356a756c060343df91bc61d83b682371 Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1045199698 Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/356a756c060343df91bc61d83b682371"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/356a756c060343df91bc61d83b682371"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/356a756c060343df91bc61d83b682371"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_356a756c060343df91bc61d83b682371"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1045199698 Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 356a756c060343df91bc61d83b682371 Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1045199698 Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-VolumesSnapshotsTestJSON-1045199698-project Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: c9559b9fc091417dbc3051c8329dee77 Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1045199698-project Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: exception: Volume 737d27fc-a38d-456d-a941-809e9dc563db could not be found. Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '737d27fc-a38d-456d-a941-809e9dc563db'} Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 737d27fc-a38d-456d-a941-809e9dc563db could not be found. (HTTP 404) (Request-ID: req-94638bec-6fa6-4979-b2e7-bb2382506b1b) Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 12:04:22.150599 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 737d27fc-a38d-456d-a941-809e9dc563db could not be found. Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 737d27fc-a38d-456d-a941-809e9dc563db could not be found. Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 737d27fc-a38d-456d-a941-809e9dc563db could not be found. Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b1c4a63c-c00d-471b-8c43-3a6198980078 tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] Returning 404 to user: Volume 737d27fc-a38d-456d-a941-809e9dc563db could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b1c4a63c-c00d-471b-8c43-3a6198980078 tempest-VolumesSnapshotsTestJSON-1045199698 tempest-VolumesSnapshotsTestJSON-1045199698-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/737d27fc-a38d-456d-a941-809e9dc563db" status: 404 len: 109 microversion: 2.1 time: 0.076334 Jun 20 12:04:22.156817 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 868/1707] 10.222.0.27 () {58 vars in 1244 bytes} [Mon Jun 20 12:04:22 2022] GET /compute/v2.1/os-volumes/737d27fc-a38d-456d-a941-809e9dc563db => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:04:22.166446 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3f5469e4-a7a1-44ac-8fcd-fd3f0b8a024e tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1592257730", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:22.273130 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-3f5469e4-a7a1-44ac-8fcd-fd3f0b8a024e tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] validate_networks() for None {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:04:22.331437 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-533be942-4839-4c02-86e0-e6419a40627f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:22.344551 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-533be942-4839-4c02-86e0-e6419a40627f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:22.347580 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-533be942-4839-4c02-86e0-e6419a40627f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:22.351001 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-533be942-4839-4c02-86e0-e6419a40627f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1486 microversion: 2.25 time: 0.422736 Jun 20 12:04:22.363753 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 840/1708] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:04:21 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1486 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:04:22.363753 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3b4973e8-2315-4584-9e80-410f1f13f4be tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:22.363753 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3b4973e8-2315-4584-9e80-410f1f13f4be tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:22.379611 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b4973e8-2315-4584-9e80-410f1f13f4be tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:22.382573 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b4973e8-2315-4584-9e80-410f1f13f4be tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:22.384505 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b4973e8-2315-4584-9e80-410f1f13f4be tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:22.385710 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b4973e8-2315-4584-9e80-410f1f13f4be tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:22.826258 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3b4973e8-2315-4584-9e80-410f1f13f4be tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:22.839042 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3b4973e8-2315-4584-9e80-410f1f13f4be tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1507 microversion: 2.1 time: 0.482804 Jun 20 12:04:22.840424 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 841/1709] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:22 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1507 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:22.847293 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d928e6bc-eed0-49d1-afe7-66919db0e425 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:22.848020 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d928e6bc-eed0-49d1-afe7-66919db0e425 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:22.872964 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d928e6bc-eed0-49d1-afe7-66919db0e425 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:22.873553 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d928e6bc-eed0-49d1-afe7-66919db0e425 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:22.874699 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d928e6bc-eed0-49d1-afe7-66919db0e425 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:22.876256 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d928e6bc-eed0-49d1-afe7-66919db0e425 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:22.941584 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=34 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:23.039934 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d928e6bc-eed0-49d1-afe7-66919db0e425 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:23.054450 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d928e6bc-eed0-49d1-afe7-66919db0e425 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a" status: 200 len: 1266 microversion: 2.1 time: 0.211396 Jun 20 12:04:23.055529 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 842/1710] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:22 2022] GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:23.079278 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7ca37a27-9e58-475b-a458-d78b34b5b924 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:23.080252 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7ca37a27-9e58-475b-a458-d78b34b5b924 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] [instance: c9290d77-4370-4fb5-a6ef-f1c1b6872b90] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:23.101437 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ca37a27-9e58-475b-a458-d78b34b5b924 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:23.101897 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ca37a27-9e58-475b-a458-d78b34b5b924 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:23.106822 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ca37a27-9e58-475b-a458-d78b34b5b924 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:23.109275 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ca37a27-9e58-475b-a458-d78b34b5b924 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:23.406079 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-3f5469e4-a7a1-44ac-8fcd-fd3f0b8a024e tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:04:23.406780 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-3f5469e4-a7a1-44ac-8fcd-fd3f0b8a024e tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:04:23.407360 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-3f5469e4-a7a1-44ac-8fcd-fd3f0b8a024e tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:04:23.408045 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-3f5469e4-a7a1-44ac-8fcd-fd3f0b8a024e tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:04:23.408702 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-3f5469e4-a7a1-44ac-8fcd-fd3f0b8a024e tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:04:23.430423 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3f5469e4-a7a1-44ac-8fcd-fd3f0b8a024e tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:23.433550 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3f5469e4-a7a1-44ac-8fcd-fd3f0b8a024e tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:23.435448 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3f5469e4-a7a1-44ac-8fcd-fd3f0b8a024e tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:23.441216 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3f5469e4-a7a1-44ac-8fcd-fd3f0b8a024e tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:23.476000 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-3f5469e4-a7a1-44ac-8fcd-fd3f0b8a024e tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Getting quotas for project 3a8c8766d4f143349b61f27d8f2566fb. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:04:23.484544 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-3f5469e4-a7a1-44ac-8fcd-fd3f0b8a024e tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Getting quotas for user 286e4b475bbc4d108ca00497ecd3e55a and project 3a8c8766d4f143349b61f27d8f2566fb. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:04:23.499077 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3f5469e4-a7a1-44ac-8fcd-fd3f0b8a024e tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:04:23.501560 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3f5469e4-a7a1-44ac-8fcd-fd3f0b8a024e tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: f7d2499c-a9c8-4c2e-8445-667070737f1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:04:23.559042 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7ca37a27-9e58-475b-a458-d78b34b5b924 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b13de70dd3481684ec50bef063d049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f7335fd515401090c1d0a1e91d0107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:23.560126 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3f5469e4-a7a1-44ac-8fcd-fd3f0b8a024e tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.404250 Jun 20 12:04:23.561034 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 869/1711] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:04:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1406 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:04:23.566423 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c2dd55e7-a79b-4dd8-8701-1852d7ed8593 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:23.567260 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c2dd55e7-a79b-4dd8-8701-1852d7ed8593 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:23.575092 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7ca37a27-9e58-475b-a458-d78b34b5b924 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] 10.222.0.27 "GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90" status: 200 len: 1404 microversion: 2.1 time: 0.504064 Jun 20 12:04:23.576345 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c2dd55e7-a79b-4dd8-8701-1852d7ed8593 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:23.576995 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c2dd55e7-a79b-4dd8-8701-1852d7ed8593 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:23.578005 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c2dd55e7-a79b-4dd8-8701-1852d7ed8593 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:23.578702 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 843/1712] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:23 2022] GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90 => generated 1404 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:23.578983 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c2dd55e7-a79b-4dd8-8701-1852d7ed8593 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:23.622003 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5a5624a5-4881-4a03-8c67-193877b2ec05 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:23.641110 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5a5624a5-4881-4a03-8c67-193877b2ec05 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:23.651058 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a5624a5-4881-4a03-8c67-193877b2ec05 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:23.651907 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a5624a5-4881-4a03-8c67-193877b2ec05 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:23.653263 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a5624a5-4881-4a03-8c67-193877b2ec05 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:23.658499 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a5624a5-4881-4a03-8c67-193877b2ec05 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:24.022187 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5a5624a5-4881-4a03-8c67-193877b2ec05 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:24.039429 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5a5624a5-4881-4a03-8c67-193877b2ec05 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:24.041998 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5a5624a5-4881-4a03-8c67-193877b2ec05 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:24.051193 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5a5624a5-4881-4a03-8c67-193877b2ec05 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1486 microversion: 2.25 time: 0.437088 Jun 20 12:04:24.056995 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 844/1713] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:04:23 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1486 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:04:24.063377 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e170d55d-ae67-444c-9435-75cbde08c4cd tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:24.071135 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e170d55d-ae67-444c-9435-75cbde08c4cd tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: f7d2499c-a9c8-4c2e-8445-667070737f1f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:24.078924 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c2dd55e7-a79b-4dd8-8701-1852d7ed8593 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:24.101127 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c2dd55e7-a79b-4dd8-8701-1852d7ed8593 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1359 microversion: 2.1 time: 0.535472 Jun 20 12:04:24.103375 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 870/1714] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:23 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1359 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:24.125867 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1847eb14-2365-42c2-8be3-4f00f0b2efa3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:24.136036 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1847eb14-2365-42c2-8be3-4f00f0b2efa3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:24.173105 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e170d55d-ae67-444c-9435-75cbde08c4cd tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286e4b475bbc4d108ca00497ecd3e55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8c8766d4f143349b61f27d8f2566fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:24.174536 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1847eb14-2365-42c2-8be3-4f00f0b2efa3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:24.176975 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1847eb14-2365-42c2-8be3-4f00f0b2efa3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:24.181224 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1847eb14-2365-42c2-8be3-4f00f0b2efa3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:24.181999 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1847eb14-2365-42c2-8be3-4f00f0b2efa3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:24.190849 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e170d55d-ae67-444c-9435-75cbde08c4cd tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f" status: 200 len: 1218 microversion: 2.1 time: 0.132236 Jun 20 12:04:24.196354 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 845/1715] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:24 2022] GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f => generated 1218 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:24.211140 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f8f3ae82-0781-48d1-bf01-7d285000e95a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:24.214443 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f8f3ae82-0781-48d1-bf01-7d285000e95a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:24.242063 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8f3ae82-0781-48d1-bf01-7d285000e95a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:24.242780 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8f3ae82-0781-48d1-bf01-7d285000e95a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:24.243784 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8f3ae82-0781-48d1-bf01-7d285000e95a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:24.245058 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8f3ae82-0781-48d1-bf01-7d285000e95a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:24.664567 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f8f3ae82-0781-48d1-bf01-7d285000e95a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:24.674048 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f8f3ae82-0781-48d1-bf01-7d285000e95a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a" status: 200 len: 1308 microversion: 2.1 time: 0.476279 Jun 20 12:04:24.674655 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 846/1716] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:24 2022] GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a => generated 1308 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:24.706931 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7be84f07-0a72-4648-be76-fa8a9a53646b tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:24.707989 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7be84f07-0a72-4648-be76-fa8a9a53646b tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] [instance: c9290d77-4370-4fb5-a6ef-f1c1b6872b90] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:24.718832 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7be84f07-0a72-4648-be76-fa8a9a53646b tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:24.719682 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7be84f07-0a72-4648-be76-fa8a9a53646b tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:24.722926 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7be84f07-0a72-4648-be76-fa8a9a53646b tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:24.723905 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7be84f07-0a72-4648-be76-fa8a9a53646b tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:24.997086 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7be84f07-0a72-4648-be76-fa8a9a53646b tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b13de70dd3481684ec50bef063d049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f7335fd515401090c1d0a1e91d0107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:25.021350 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7be84f07-0a72-4648-be76-fa8a9a53646b tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] 10.222.0.27 "GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90" status: 200 len: 1404 microversion: 2.1 time: 0.340830 Jun 20 12:04:25.022146 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 847/1717] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:24 2022] GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90 => generated 1404 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:25.074675 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ab004796-9952-4fa0-8d69-6974c794780d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:25.075511 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ab004796-9952-4fa0-8d69-6974c794780d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:25.087599 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ab004796-9952-4fa0-8d69-6974c794780d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:25.088048 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ab004796-9952-4fa0-8d69-6974c794780d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:25.089064 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ab004796-9952-4fa0-8d69-6974c794780d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:25.091175 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ab004796-9952-4fa0-8d69-6974c794780d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:25.277775 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1847eb14-2365-42c2-8be3-4f00f0b2efa3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:25.288741 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1847eb14-2365-42c2-8be3-4f00f0b2efa3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1507 microversion: 2.1 time: 1.184124 Jun 20 12:04:25.302385 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 871/1718] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:24 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1507 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:25.318811 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e5616acd-f226-41a3-83d8-667ff2c79e19 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:25.319570 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e5616acd-f226-41a3-83d8-667ff2c79e19 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:25.340659 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e5616acd-f226-41a3-83d8-667ff2c79e19 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:25.345187 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e5616acd-f226-41a3-83d8-667ff2c79e19 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:25.348250 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e5616acd-f226-41a3-83d8-667ff2c79e19 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:25.348991 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e5616acd-f226-41a3-83d8-667ff2c79e19 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:25.664943 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ab004796-9952-4fa0-8d69-6974c794780d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:25.684460 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ab004796-9952-4fa0-8d69-6974c794780d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:25.688853 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ab004796-9952-4fa0-8d69-6974c794780d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:25.690518 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ab004796-9952-4fa0-8d69-6974c794780d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1486 microversion: 2.25 time: 0.620055 Jun 20 12:04:25.692521 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 848/1719] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:04:25 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1486 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:04:25.711503 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-97aa60db-1869-4340-8d65-1516f70bc405 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:25.712593 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-97aa60db-1869-4340-8d65-1516f70bc405 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: f7d2499c-a9c8-4c2e-8445-667070737f1f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:25.727217 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-97aa60db-1869-4340-8d65-1516f70bc405 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:25.728023 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-97aa60db-1869-4340-8d65-1516f70bc405 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:25.729436 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-97aa60db-1869-4340-8d65-1516f70bc405 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:25.730216 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-97aa60db-1869-4340-8d65-1516f70bc405 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:25.885248 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-97aa60db-1869-4340-8d65-1516f70bc405 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286e4b475bbc4d108ca00497ecd3e55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8c8766d4f143349b61f27d8f2566fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:25.909128 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-97aa60db-1869-4340-8d65-1516f70bc405 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f" status: 200 len: 1278 microversion: 2.1 time: 0.202067 Jun 20 12:04:25.910163 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 849/1720] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:25 2022] GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f => generated 1278 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:25.923108 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-7fec5d25-5332-49fc-852b-d1cedae8cb0b req-1e2d7a11-1cbe-4ea8-bb16-2580000d8547 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31066575-9374-412f-9c63-ad5162254777", "tag": "e914de0d-b9de-410a-8338-f6ffef3981c1"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:25.937055 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-7fec5d25-5332-49fc-852b-d1cedae8cb0b req-1e2d7a11-1cbe-4ea8-bb16-2580000d8547 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:25.937712 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-7fec5d25-5332-49fc-852b-d1cedae8cb0b req-1e2d7a11-1cbe-4ea8-bb16-2580000d8547 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:25.957813 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-7fec5d25-5332-49fc-852b-d1cedae8cb0b req-1e2d7a11-1cbe-4ea8-bb16-2580000d8547 service nova] Creating event network-changed:e914de0d-b9de-410a-8338-f6ffef3981c1 for instance 31066575-9374-412f-9c63-ad5162254777 on n-h1-master-1 Jun 20 12:04:25.965673 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-7fec5d25-5332-49fc-852b-d1cedae8cb0b req-1e2d7a11-1cbe-4ea8-bb16-2580000d8547 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054121 Jun 20 12:04:25.966544 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 850/1721] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:25.972952 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e59a2901-d01f-43d1-af53-499db4f962a3 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:25.974193 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e59a2901-d01f-43d1-af53-499db4f962a3 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:25.983810 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e59a2901-d01f-43d1-af53-499db4f962a3 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:25.984558 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e59a2901-d01f-43d1-af53-499db4f962a3 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:25.985515 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e59a2901-d01f-43d1-af53-499db4f962a3 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:25.987125 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e59a2901-d01f-43d1-af53-499db4f962a3 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:26.298152 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e59a2901-d01f-43d1-af53-499db4f962a3 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:26.324329 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e59a2901-d01f-43d1-af53-499db4f962a3 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a" status: 200 len: 1308 microversion: 2.1 time: 0.355829 Jun 20 12:04:26.325465 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 851/1722] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:25 2022] GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a => generated 1308 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:26.338011 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c13aafb6-2797-4fc0-8196-c1c14e8f8cd0 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:26.338940 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c13aafb6-2797-4fc0-8196-c1c14e8f8cd0 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] [instance: c9290d77-4370-4fb5-a6ef-f1c1b6872b90] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:26.347971 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c13aafb6-2797-4fc0-8196-c1c14e8f8cd0 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:26.352661 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c13aafb6-2797-4fc0-8196-c1c14e8f8cd0 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:26.357334 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c13aafb6-2797-4fc0-8196-c1c14e8f8cd0 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:26.357988 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c13aafb6-2797-4fc0-8196-c1c14e8f8cd0 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:26.376870 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e5616acd-f226-41a3-83d8-667ff2c79e19 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:26.389812 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e5616acd-f226-41a3-83d8-667ff2c79e19 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1359 microversion: 2.1 time: 1.083386 Jun 20 12:04:26.391375 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 872/1723] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:25 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1359 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:26.406783 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-102eb67a-074d-4e84-8d4b-0d4aa6422f84 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:26.408372 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-102eb67a-074d-4e84-8d4b-0d4aa6422f84 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:26.427579 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-102eb67a-074d-4e84-8d4b-0d4aa6422f84 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:26.428571 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-102eb67a-074d-4e84-8d4b-0d4aa6422f84 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:26.429648 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-102eb67a-074d-4e84-8d4b-0d4aa6422f84 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:26.430334 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-102eb67a-074d-4e84-8d4b-0d4aa6422f84 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:26.562542 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c13aafb6-2797-4fc0-8196-c1c14e8f8cd0 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b13de70dd3481684ec50bef063d049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f7335fd515401090c1d0a1e91d0107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:26.573102 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c13aafb6-2797-4fc0-8196-c1c14e8f8cd0 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] 10.222.0.27 "GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90" status: 200 len: 1404 microversion: 2.1 time: 0.246308 Jun 20 12:04:26.574890 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 852/1724] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:26 2022] GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90 => generated 1404 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:26.711343 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a33ee3de-7fee-4c41-9cae-44091d68e1be tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:26.712278 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a33ee3de-7fee-4c41-9cae-44091d68e1be tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:26.718997 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:26.721463 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a33ee3de-7fee-4c41-9cae-44091d68e1be tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:26.722146 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a33ee3de-7fee-4c41-9cae-44091d68e1be tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:26.723496 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a33ee3de-7fee-4c41-9cae-44091d68e1be tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:26.724113 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a33ee3de-7fee-4c41-9cae-44091d68e1be tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:26.896710 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a33ee3de-7fee-4c41-9cae-44091d68e1be tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:26.906291 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a33ee3de-7fee-4c41-9cae-44091d68e1be tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:26.908030 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a33ee3de-7fee-4c41-9cae-44091d68e1be tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:26.909628 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a33ee3de-7fee-4c41-9cae-44091d68e1be tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1486 microversion: 2.25 time: 0.203286 Jun 20 12:04:26.910371 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 853/1725] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:04:26 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1486 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:04:26.928186 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2254ffe7-387e-4f61-9e17-99517a565fd2 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:26.928876 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2254ffe7-387e-4f61-9e17-99517a565fd2 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: f7d2499c-a9c8-4c2e-8445-667070737f1f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:26.940556 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2254ffe7-387e-4f61-9e17-99517a565fd2 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:26.941255 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2254ffe7-387e-4f61-9e17-99517a565fd2 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:26.942450 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2254ffe7-387e-4f61-9e17-99517a565fd2 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:26.943119 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2254ffe7-387e-4f61-9e17-99517a565fd2 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:27.040820 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2254ffe7-387e-4f61-9e17-99517a565fd2 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286e4b475bbc4d108ca00497ecd3e55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8c8766d4f143349b61f27d8f2566fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:27.052970 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-102eb67a-074d-4e84-8d4b-0d4aa6422f84 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:27.055681 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2254ffe7-387e-4f61-9e17-99517a565fd2 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f" status: 200 len: 1276 microversion: 2.1 time: 0.130494 Jun 20 12:04:27.057659 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 854/1726] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:26 2022] GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f => generated 1276 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:27.072009 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-102eb67a-074d-4e84-8d4b-0d4aa6422f84 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1507 microversion: 2.1 time: 0.677352 Jun 20 12:04:27.081780 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 873/1727] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:26 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1507 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:27.347188 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bcb2e3fa-61a5-41cd-a619-6328553da277 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:27.349652 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bcb2e3fa-61a5-41cd-a619-6328553da277 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:27.370003 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bcb2e3fa-61a5-41cd-a619-6328553da277 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:27.372997 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bcb2e3fa-61a5-41cd-a619-6328553da277 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:27.374708 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bcb2e3fa-61a5-41cd-a619-6328553da277 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:27.385818 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bcb2e3fa-61a5-41cd-a619-6328553da277 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:27.408846 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d94641e7-42a8-415f-ba2b-3d321b2a7f50 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:27.409635 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d94641e7-42a8-415f-ba2b-3d321b2a7f50 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:27.429519 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d94641e7-42a8-415f-ba2b-3d321b2a7f50 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:27.430765 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d94641e7-42a8-415f-ba2b-3d321b2a7f50 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:27.433001 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d94641e7-42a8-415f-ba2b-3d321b2a7f50 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:27.435820 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d94641e7-42a8-415f-ba2b-3d321b2a7f50 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:27.791981 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-bcb2e3fa-61a5-41cd-a619-6328553da277 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:27.800979 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bcb2e3fa-61a5-41cd-a619-6328553da277 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a" status: 200 len: 1308 microversion: 2.1 time: 0.463715 Jun 20 12:04:27.804006 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 855/1728] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:27 2022] GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a => generated 1308 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:27.810344 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-35becf7f-a2fc-422c-85c2-77667c0556de tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:27.815318 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-35becf7f-a2fc-422c-85c2-77667c0556de tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] [instance: c9290d77-4370-4fb5-a6ef-f1c1b6872b90] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:27.835548 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-35becf7f-a2fc-422c-85c2-77667c0556de tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:27.836461 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-35becf7f-a2fc-422c-85c2-77667c0556de tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:27.837488 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-35becf7f-a2fc-422c-85c2-77667c0556de tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:27.838092 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-35becf7f-a2fc-422c-85c2-77667c0556de tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:28.241070 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-35becf7f-a2fc-422c-85c2-77667c0556de tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b13de70dd3481684ec50bef063d049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f7335fd515401090c1d0a1e91d0107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:28.253415 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-35becf7f-a2fc-422c-85c2-77667c0556de tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] 10.222.0.27 "GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90" status: 200 len: 1404 microversion: 2.1 time: 0.447935 Jun 20 12:04:28.254008 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 856/1729] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:27 2022] GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90 => generated 1404 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:28.277312 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-68f50a10-e495-4988-a922-8171d0d45be6 req-aeffdbc7-ca2b-487f-9490-7b3eb021f74e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9290d77-4370-4fb5-a6ef-f1c1b6872b90", "tag": "df0d5349-d128-45d1-bb70-d0936101a5ee"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:28.295687 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-68f50a10-e495-4988-a922-8171d0d45be6 req-aeffdbc7-ca2b-487f-9490-7b3eb021f74e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:28.296139 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-68f50a10-e495-4988-a922-8171d0d45be6 req-aeffdbc7-ca2b-487f-9490-7b3eb021f74e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:28.324057 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-68f50a10-e495-4988-a922-8171d0d45be6 req-aeffdbc7-ca2b-487f-9490-7b3eb021f74e service nova] Creating event network-changed:df0d5349-d128-45d1-bb70-d0936101a5ee for instance c9290d77-4370-4fb5-a6ef-f1c1b6872b90 on n-h2-master-1 Jun 20 12:04:28.366040 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-68f50a10-e495-4988-a922-8171d0d45be6 req-aeffdbc7-ca2b-487f-9490-7b3eb021f74e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110777 Jun 20 12:04:28.366805 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 857/1730] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:28.376435 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-db4fce93-7adc-4b9a-a317-012603685c92 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:28.377050 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-db4fce93-7adc-4b9a-a317-012603685c92 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:28.383641 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-db4fce93-7adc-4b9a-a317-012603685c92 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:28.384386 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-db4fce93-7adc-4b9a-a317-012603685c92 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:28.385368 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-db4fce93-7adc-4b9a-a317-012603685c92 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:28.385971 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-db4fce93-7adc-4b9a-a317-012603685c92 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:28.542354 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d94641e7-42a8-415f-ba2b-3d321b2a7f50 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:28.559676 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d94641e7-42a8-415f-ba2b-3d321b2a7f50 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1359 microversion: 2.1 time: 1.155433 Jun 20 12:04:28.560722 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 874/1731] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:27 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1359 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:28.576721 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d31793b6-7a05-4c2c-8680-86180ae69c57 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:28.587769 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d31793b6-7a05-4c2c-8680-86180ae69c57 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: f7d2499c-a9c8-4c2e-8445-667070737f1f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:28.615956 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d31793b6-7a05-4c2c-8680-86180ae69c57 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:28.619423 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d31793b6-7a05-4c2c-8680-86180ae69c57 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:28.620938 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d31793b6-7a05-4c2c-8680-86180ae69c57 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:28.621381 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d31793b6-7a05-4c2c-8680-86180ae69c57 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:28.744309 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-db4fce93-7adc-4b9a-a317-012603685c92 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:28.765922 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-db4fce93-7adc-4b9a-a317-012603685c92 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:28.767433 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-db4fce93-7adc-4b9a-a317-012603685c92 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:28.768717 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-db4fce93-7adc-4b9a-a317-012603685c92 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1486 microversion: 2.25 time: 0.400921 Jun 20 12:04:28.769299 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 858/1732] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:04:28 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1486 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:04:28.774584 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-33eff8ba-8fbe-443f-a725-25086cbe0bba tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:28.775473 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-33eff8ba-8fbe-443f-a725-25086cbe0bba tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:28.789607 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-33eff8ba-8fbe-443f-a725-25086cbe0bba tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:28.791773 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-33eff8ba-8fbe-443f-a725-25086cbe0bba tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:28.794296 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-33eff8ba-8fbe-443f-a725-25086cbe0bba tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:28.795816 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-33eff8ba-8fbe-443f-a725-25086cbe0bba tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:28.845437 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:29.027633 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d31793b6-7a05-4c2c-8680-86180ae69c57 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286e4b475bbc4d108ca00497ecd3e55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8c8766d4f143349b61f27d8f2566fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:29.041235 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d31793b6-7a05-4c2c-8680-86180ae69c57 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f" status: 200 len: 1276 microversion: 2.1 time: 0.467634 Jun 20 12:04:29.042718 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 875/1733] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:28 2022] GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f => generated 1276 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:29.056973 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-28d03963-5ed3-44e3-a746-6e9964a77963 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:29.060187 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-28d03963-5ed3-44e3-a746-6e9964a77963 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:29.074769 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28d03963-5ed3-44e3-a746-6e9964a77963 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:29.075834 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28d03963-5ed3-44e3-a746-6e9964a77963 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:29.077091 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28d03963-5ed3-44e3-a746-6e9964a77963 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:29.077783 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28d03963-5ed3-44e3-a746-6e9964a77963 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:29.215930 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-33eff8ba-8fbe-443f-a725-25086cbe0bba tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:29.228532 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-33eff8ba-8fbe-443f-a725-25086cbe0bba tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1507 microversion: 2.1 time: 0.457587 Jun 20 12:04:29.229554 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 859/1734] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:28 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1507 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:29.273945 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c02b7c32-67d7-41f6-a29f-19f4778110b1 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:29.276257 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c02b7c32-67d7-41f6-a29f-19f4778110b1 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] [instance: c9290d77-4370-4fb5-a6ef-f1c1b6872b90] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:29.288776 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c02b7c32-67d7-41f6-a29f-19f4778110b1 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:29.289833 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c02b7c32-67d7-41f6-a29f-19f4778110b1 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:29.291708 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c02b7c32-67d7-41f6-a29f-19f4778110b1 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:29.292481 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c02b7c32-67d7-41f6-a29f-19f4778110b1 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:29.518123 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c02b7c32-67d7-41f6-a29f-19f4778110b1 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b13de70dd3481684ec50bef063d049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f7335fd515401090c1d0a1e91d0107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:29.536437 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c02b7c32-67d7-41f6-a29f-19f4778110b1 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] 10.222.0.27 "GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90" status: 200 len: 1404 microversion: 2.1 time: 0.268913 Jun 20 12:04:29.537886 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 860/1735] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:29 2022] GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90 => generated 1404 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:29.578434 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-94148bc8-de0b-4fe2-9a70-fb657b7cea73 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:29.579380 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-94148bc8-de0b-4fe2-9a70-fb657b7cea73 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:29.587024 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94148bc8-de0b-4fe2-9a70-fb657b7cea73 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:29.587717 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94148bc8-de0b-4fe2-9a70-fb657b7cea73 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:29.589712 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94148bc8-de0b-4fe2-9a70-fb657b7cea73 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:29.590535 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94148bc8-de0b-4fe2-9a70-fb657b7cea73 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:29.776059 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-94148bc8-de0b-4fe2-9a70-fb657b7cea73 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:29.784722 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-94148bc8-de0b-4fe2-9a70-fb657b7cea73 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1359 microversion: 2.1 time: 0.210916 Jun 20 12:04:29.798583 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 861/1736] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:29 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1359 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:29.804445 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9a59b1d3-cf34-404e-8430-bbfe3b01fcc7 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:29.805335 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9a59b1d3-cf34-404e-8430-bbfe3b01fcc7 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:29.812024 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:29.814085 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9a59b1d3-cf34-404e-8430-bbfe3b01fcc7 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:29.814891 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9a59b1d3-cf34-404e-8430-bbfe3b01fcc7 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:29.817415 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9a59b1d3-cf34-404e-8430-bbfe3b01fcc7 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:29.820120 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9a59b1d3-cf34-404e-8430-bbfe3b01fcc7 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:30.096478 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9a59b1d3-cf34-404e-8430-bbfe3b01fcc7 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:30.111646 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9a59b1d3-cf34-404e-8430-bbfe3b01fcc7 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:30.113260 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9a59b1d3-cf34-404e-8430-bbfe3b01fcc7 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:30.114507 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9a59b1d3-cf34-404e-8430-bbfe3b01fcc7 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1486 microversion: 2.25 time: 0.314480 Jun 20 12:04:30.115507 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 862/1737] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:04:29 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1486 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:04:30.120218 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0bdc6998-8f7d-4b6e-9bdd-8459a1d3b8de tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:30.121245 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0bdc6998-8f7d-4b6e-9bdd-8459a1d3b8de tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: f7d2499c-a9c8-4c2e-8445-667070737f1f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:30.131415 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-28d03963-5ed3-44e3-a746-6e9964a77963 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:30.133558 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0bdc6998-8f7d-4b6e-9bdd-8459a1d3b8de tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:30.134018 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0bdc6998-8f7d-4b6e-9bdd-8459a1d3b8de tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:30.135231 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0bdc6998-8f7d-4b6e-9bdd-8459a1d3b8de tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:30.135231 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0bdc6998-8f7d-4b6e-9bdd-8459a1d3b8de tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:30.143465 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-28d03963-5ed3-44e3-a746-6e9964a77963 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a" status: 200 len: 1308 microversion: 2.1 time: 1.098167 Jun 20 12:04:30.157345 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 876/1738] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:29 2022] GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a => generated 1308 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:30.241402 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0bdc6998-8f7d-4b6e-9bdd-8459a1d3b8de tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286e4b475bbc4d108ca00497ecd3e55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8c8766d4f143349b61f27d8f2566fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:30.250056 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-020eced1-21e1-46b8-b724-bc68600893fd tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:30.251104 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-020eced1-21e1-46b8-b724-bc68600893fd tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:30.255490 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0bdc6998-8f7d-4b6e-9bdd-8459a1d3b8de tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f" status: 200 len: 1276 microversion: 2.1 time: 0.138707 Jun 20 12:04:30.256313 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 863/1739] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:30 2022] GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:30.266578 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-020eced1-21e1-46b8-b724-bc68600893fd tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:30.267050 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-020eced1-21e1-46b8-b724-bc68600893fd tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:30.267855 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-020eced1-21e1-46b8-b724-bc68600893fd tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:30.268336 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-020eced1-21e1-46b8-b724-bc68600893fd tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:30.279663 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-3919c65d-1a1b-4613-9020-77ecbc6a3eac req-5c87d489-4671-4277-9175-23221fea6aaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31066575-9374-412f-9c63-ad5162254777", "name": "network-vif-plugged", "status": "completed", "tag": "e914de0d-b9de-410a-8338-f6ffef3981c1"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:30.298552 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-3919c65d-1a1b-4613-9020-77ecbc6a3eac req-5c87d489-4671-4277-9175-23221fea6aaa service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:30.301649 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-3919c65d-1a1b-4613-9020-77ecbc6a3eac req-5c87d489-4671-4277-9175-23221fea6aaa service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:30.319268 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-3919c65d-1a1b-4613-9020-77ecbc6a3eac req-5c87d489-4671-4277-9175-23221fea6aaa service nova] Creating event network-vif-plugged:e914de0d-b9de-410a-8338-f6ffef3981c1 for instance 31066575-9374-412f-9c63-ad5162254777 on n-h1-master-1 Jun 20 12:04:30.334746 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-3919c65d-1a1b-4613-9020-77ecbc6a3eac req-5c87d489-4671-4277-9175-23221fea6aaa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061717 Jun 20 12:04:30.336273 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 864/1740] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:04:30.554698 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5625608d-faa2-43d1-9914-d23909d0581c tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:30.555502 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5625608d-faa2-43d1-9914-d23909d0581c tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] [instance: c9290d77-4370-4fb5-a6ef-f1c1b6872b90] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:30.564699 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5625608d-faa2-43d1-9914-d23909d0581c tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:30.565246 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5625608d-faa2-43d1-9914-d23909d0581c tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:30.566308 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5625608d-faa2-43d1-9914-d23909d0581c tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:30.566922 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5625608d-faa2-43d1-9914-d23909d0581c tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:30.754501 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5625608d-faa2-43d1-9914-d23909d0581c tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b13de70dd3481684ec50bef063d049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f7335fd515401090c1d0a1e91d0107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:30.770968 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5625608d-faa2-43d1-9914-d23909d0581c tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] 10.222.0.27 "GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90" status: 200 len: 1404 microversion: 2.1 time: 0.220822 Jun 20 12:04:30.771740 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 865/1741] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:30 2022] GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90 => generated 1404 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:30.778072 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-e050c0cc-7f3a-40f6-b40e-b2b4bdc0caaa req-59f7ec61-ae25-40e6-b1d3-1f5c9c7a81e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b9e1026-a6f6-47f2-8734-4b05eeff8b9a", "tag": "d4607934-f3b3-445b-8374-03fb586d6121"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:30.789020 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e050c0cc-7f3a-40f6-b40e-b2b4bdc0caaa req-59f7ec61-ae25-40e6-b1d3-1f5c9c7a81e3 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:30.789592 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e050c0cc-7f3a-40f6-b40e-b2b4bdc0caaa req-59f7ec61-ae25-40e6-b1d3-1f5c9c7a81e3 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:30.802962 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-e050c0cc-7f3a-40f6-b40e-b2b4bdc0caaa req-59f7ec61-ae25-40e6-b1d3-1f5c9c7a81e3 service nova] Creating event network-changed:d4607934-f3b3-445b-8374-03fb586d6121 for instance 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a on n-h2-master-1 Jun 20 12:04:30.810193 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-e050c0cc-7f3a-40f6-b40e-b2b4bdc0caaa req-59f7ec61-ae25-40e6-b1d3-1f5c9c7a81e3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036584 Jun 20 12:04:30.810823 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 866/1742] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:30.818140 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-91b0dcde-1389-441f-9032-097b8c901327 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:30.818932 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-91b0dcde-1389-441f-9032-097b8c901327 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:30.831162 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-91b0dcde-1389-441f-9032-097b8c901327 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:30.831981 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-91b0dcde-1389-441f-9032-097b8c901327 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:30.832923 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-91b0dcde-1389-441f-9032-097b8c901327 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:30.833471 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-91b0dcde-1389-441f-9032-097b8c901327 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:30.967137 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-020eced1-21e1-46b8-b724-bc68600893fd tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:30.977354 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-020eced1-21e1-46b8-b724-bc68600893fd tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1507 microversion: 2.1 time: 0.734748 Jun 20 12:04:30.978484 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 877/1743] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:30 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1507 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:04:31.071164 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-91b0dcde-1389-441f-9032-097b8c901327 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:31.080713 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-91b0dcde-1389-441f-9032-097b8c901327 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1359 microversion: 2.1 time: 0.268376 Jun 20 12:04:31.081828 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 867/1744] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:30 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1359 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:31.132461 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c4bdc171-7781-42ff-8258-13ad007e9ac6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:31.133728 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c4bdc171-7781-42ff-8258-13ad007e9ac6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:31.144126 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c4bdc171-7781-42ff-8258-13ad007e9ac6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:31.144624 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c4bdc171-7781-42ff-8258-13ad007e9ac6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:31.145457 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c4bdc171-7781-42ff-8258-13ad007e9ac6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:31.145895 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c4bdc171-7781-42ff-8258-13ad007e9ac6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:31.164128 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-db9693f2-2c34-4ab0-8bd2-e94b3b85fa8b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:31.165206 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-db9693f2-2c34-4ab0-8bd2-e94b3b85fa8b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:31.177745 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-db9693f2-2c34-4ab0-8bd2-e94b3b85fa8b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:31.179007 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-db9693f2-2c34-4ab0-8bd2-e94b3b85fa8b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:31.180289 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-db9693f2-2c34-4ab0-8bd2-e94b3b85fa8b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:31.181877 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-db9693f2-2c34-4ab0-8bd2-e94b3b85fa8b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:31.368226 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-db9693f2-2c34-4ab0-8bd2-e94b3b85fa8b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:31.378307 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-db9693f2-2c34-4ab0-8bd2-e94b3b85fa8b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a" status: 200 len: 1308 microversion: 2.1 time: 0.219302 Jun 20 12:04:31.388232 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 868/1745] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:31 2022] GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a => generated 1308 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:31.388232 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0c2c2643-0e6b-4330-ba2c-c69e2f689ae7 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:31.388232 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0c2c2643-0e6b-4330-ba2c-c69e2f689ae7 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: f7d2499c-a9c8-4c2e-8445-667070737f1f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:31.397399 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c2c2643-0e6b-4330-ba2c-c69e2f689ae7 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:31.398458 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c2c2643-0e6b-4330-ba2c-c69e2f689ae7 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:31.399158 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c2c2643-0e6b-4330-ba2c-c69e2f689ae7 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:31.399660 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c2c2643-0e6b-4330-ba2c-c69e2f689ae7 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:31.463909 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c4bdc171-7781-42ff-8258-13ad007e9ac6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:31.480856 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c4bdc171-7781-42ff-8258-13ad007e9ac6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:31.482753 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c4bdc171-7781-42ff-8258-13ad007e9ac6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:31.489162 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c4bdc171-7781-42ff-8258-13ad007e9ac6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1486 microversion: 2.25 time: 0.360344 Jun 20 12:04:31.505960 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 878/1746] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:04:31 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1486 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:04:31.589736 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0c2c2643-0e6b-4330-ba2c-c69e2f689ae7 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286e4b475bbc4d108ca00497ecd3e55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8c8766d4f143349b61f27d8f2566fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:31.599418 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0c2c2643-0e6b-4330-ba2c-c69e2f689ae7 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f" status: 200 len: 1318 microversion: 2.1 time: 0.218929 Jun 20 12:04:31.600190 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 869/1747] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:31 2022] GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:31.790161 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-633fe18c-230e-4712-a7aa-ca82e7fc93ae tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:31.790863 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-633fe18c-230e-4712-a7aa-ca82e7fc93ae tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] [instance: c9290d77-4370-4fb5-a6ef-f1c1b6872b90] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:31.801308 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-633fe18c-230e-4712-a7aa-ca82e7fc93ae tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:31.807183 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-633fe18c-230e-4712-a7aa-ca82e7fc93ae tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:31.808083 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-633fe18c-230e-4712-a7aa-ca82e7fc93ae tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:31.808559 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-633fe18c-230e-4712-a7aa-ca82e7fc93ae tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:31.995007 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ede5edf4-88e7-4895-b5b3-d2d7b0ab55d0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:31.996137 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ede5edf4-88e7-4895-b5b3-d2d7b0ab55d0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:32.006007 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ede5edf4-88e7-4895-b5b3-d2d7b0ab55d0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:32.006523 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ede5edf4-88e7-4895-b5b3-d2d7b0ab55d0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:32.007344 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ede5edf4-88e7-4895-b5b3-d2d7b0ab55d0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:32.007841 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ede5edf4-88e7-4895-b5b3-d2d7b0ab55d0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:32.071154 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-633fe18c-230e-4712-a7aa-ca82e7fc93ae tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b13de70dd3481684ec50bef063d049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f7335fd515401090c1d0a1e91d0107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:32.084056 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-633fe18c-230e-4712-a7aa-ca82e7fc93ae tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] 10.222.0.27 "GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90" status: 200 len: 1404 microversion: 2.1 time: 0.298595 Jun 20 12:04:32.085999 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 879/1748] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:31 2022] GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90 => generated 1404 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:32.098397 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-43e8f149-71c0-4aee-9217-5e4abdb8ec21 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:32.099232 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-43e8f149-71c0-4aee-9217-5e4abdb8ec21 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:32.108423 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-43e8f149-71c0-4aee-9217-5e4abdb8ec21 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:32.109277 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-43e8f149-71c0-4aee-9217-5e4abdb8ec21 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:32.110582 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-43e8f149-71c0-4aee-9217-5e4abdb8ec21 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:32.111191 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-43e8f149-71c0-4aee-9217-5e4abdb8ec21 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:32.175321 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ede5edf4-88e7-4895-b5b3-d2d7b0ab55d0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:32.191190 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ede5edf4-88e7-4895-b5b3-d2d7b0ab55d0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1507 microversion: 2.1 time: 0.199893 Jun 20 12:04:32.191826 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 870/1749] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:31 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1507 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:32.315649 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-43e8f149-71c0-4aee-9217-5e4abdb8ec21 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:32.324978 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-43e8f149-71c0-4aee-9217-5e4abdb8ec21 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1541 microversion: 2.1 time: 0.230572 Jun 20 12:04:32.325817 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 880/1750] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:32 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1541 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:04:32.342741 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b00fec44-9088-45a2-bfad-0934647a5007 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:32.343486 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b00fec44-9088-45a2-bfad-0934647a5007 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:32.351186 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b00fec44-9088-45a2-bfad-0934647a5007 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:32.351662 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b00fec44-9088-45a2-bfad-0934647a5007 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:32.352492 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b00fec44-9088-45a2-bfad-0934647a5007 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:32.352950 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b00fec44-9088-45a2-bfad-0934647a5007 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:32.395057 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0086877f-dc3f-4cb4-85ba-bc846ffc957c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:32.396000 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0086877f-dc3f-4cb4-85ba-bc846ffc957c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:32.403795 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0086877f-dc3f-4cb4-85ba-bc846ffc957c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:32.404435 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0086877f-dc3f-4cb4-85ba-bc846ffc957c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:32.405137 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0086877f-dc3f-4cb4-85ba-bc846ffc957c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:32.405666 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0086877f-dc3f-4cb4-85ba-bc846ffc957c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:32.423237 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:32.448463 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b00fec44-9088-45a2-bfad-0934647a5007 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109826 Jun 20 12:04:32.449373 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 871/1751] 10.222.0.27 () {58 vars in 1274 bytes} [Mon Jun 20 12:04:32 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:32.514815 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1436bcb8-b8f3-48bb-af37-6d8789523d37 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:32.515443 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1436bcb8-b8f3-48bb-af37-6d8789523d37 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:32.523711 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1436bcb8-b8f3-48bb-af37-6d8789523d37 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:32.524730 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1436bcb8-b8f3-48bb-af37-6d8789523d37 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:32.526847 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1436bcb8-b8f3-48bb-af37-6d8789523d37 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:32.529281 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1436bcb8-b8f3-48bb-af37-6d8789523d37 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:32.596415 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0086877f-dc3f-4cb4-85ba-bc846ffc957c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:32.609208 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0086877f-dc3f-4cb4-85ba-bc846ffc957c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a" status: 200 len: 1308 microversion: 2.1 time: 0.217935 Jun 20 12:04:32.611717 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 881/1752] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:32 2022] GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a => generated 1308 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:32.616331 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-491690fc-1a19-4a26-b289-ce0931eaf2c6 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:32.616940 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-491690fc-1a19-4a26-b289-ce0931eaf2c6 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: f7d2499c-a9c8-4c2e-8445-667070737f1f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:32.624324 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-491690fc-1a19-4a26-b289-ce0931eaf2c6 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:32.624851 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-491690fc-1a19-4a26-b289-ce0931eaf2c6 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:32.625630 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-491690fc-1a19-4a26-b289-ce0931eaf2c6 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:32.626066 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-491690fc-1a19-4a26-b289-ce0931eaf2c6 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:32.779648 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-491690fc-1a19-4a26-b289-ce0931eaf2c6 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286e4b475bbc4d108ca00497ecd3e55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8c8766d4f143349b61f27d8f2566fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:32.790150 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-491690fc-1a19-4a26-b289-ce0931eaf2c6 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f" status: 200 len: 1318 microversion: 2.1 time: 0.177534 Jun 20 12:04:32.790763 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 882/1753] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:32 2022] GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:32.793656 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1436bcb8-b8f3-48bb-af37-6d8789523d37 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:32.802366 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1436bcb8-b8f3-48bb-af37-6d8789523d37 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:32.803871 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1436bcb8-b8f3-48bb-af37-6d8789523d37 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:32.805095 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1436bcb8-b8f3-48bb-af37-6d8789523d37 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1486 microversion: 2.25 time: 0.295866 Jun 20 12:04:32.805976 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 872/1754] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:04:32 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1486 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:04:32.833315 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-b27df65c-be37-4b1d-92a4-60efd095c9d7 req-7d3dae0e-f4a1-4955-bb0a-bf417795bc01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "838db96b-0c7a-4d7f-9807-44194bc73cff", "tag": "1e4f16ac-a73c-4854-8d0f-a050fb989db4"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:32.842271 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b27df65c-be37-4b1d-92a4-60efd095c9d7 req-7d3dae0e-f4a1-4955-bb0a-bf417795bc01 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:32.843017 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b27df65c-be37-4b1d-92a4-60efd095c9d7 req-7d3dae0e-f4a1-4955-bb0a-bf417795bc01 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:32.854730 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-b27df65c-be37-4b1d-92a4-60efd095c9d7 req-7d3dae0e-f4a1-4955-bb0a-bf417795bc01 service nova] Creating event network-changed:1e4f16ac-a73c-4854-8d0f-a050fb989db4 for instance 838db96b-0c7a-4d7f-9807-44194bc73cff on n-h1-master-1 Jun 20 12:04:32.860646 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-b27df65c-be37-4b1d-92a4-60efd095c9d7 req-7d3dae0e-f4a1-4955-bb0a-bf417795bc01 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030992 Jun 20 12:04:32.861502 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 883/1755] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:33.107718 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-07eba07b-c87e-4b90-8f2b-311e8e601cb0 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:33.108757 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-07eba07b-c87e-4b90-8f2b-311e8e601cb0 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] [instance: c9290d77-4370-4fb5-a6ef-f1c1b6872b90] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:33.117386 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-07eba07b-c87e-4b90-8f2b-311e8e601cb0 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:33.118323 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-07eba07b-c87e-4b90-8f2b-311e8e601cb0 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:33.119309 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-07eba07b-c87e-4b90-8f2b-311e8e601cb0 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:33.119915 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-07eba07b-c87e-4b90-8f2b-311e8e601cb0 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:33.214126 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5b07bf7e-ace1-478e-92f9-cc41d0e88880 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:33.215132 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5b07bf7e-ace1-478e-92f9-cc41d0e88880 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:33.224069 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b07bf7e-ace1-478e-92f9-cc41d0e88880 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:33.224627 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b07bf7e-ace1-478e-92f9-cc41d0e88880 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:33.225491 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b07bf7e-ace1-478e-92f9-cc41d0e88880 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:33.226371 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b07bf7e-ace1-478e-92f9-cc41d0e88880 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:33.462403 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=10 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:33.493138 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=36 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:33.516479 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-07eba07b-c87e-4b90-8f2b-311e8e601cb0 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b13de70dd3481684ec50bef063d049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f7335fd515401090c1d0a1e91d0107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:33.530033 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-07eba07b-c87e-4b90-8f2b-311e8e601cb0 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] 10.222.0.27 "GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90" status: 200 len: 1404 microversion: 2.1 time: 0.429240 Jun 20 12:04:33.531061 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 873/1756] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:33 2022] GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90 => generated 1404 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:33.628872 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-62d5f0b1-8a8a-43d7-89d6-7269f0397c99 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:33.629473 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-62d5f0b1-8a8a-43d7-89d6-7269f0397c99 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:33.637934 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-62d5f0b1-8a8a-43d7-89d6-7269f0397c99 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:33.639343 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-62d5f0b1-8a8a-43d7-89d6-7269f0397c99 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:33.640775 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-62d5f0b1-8a8a-43d7-89d6-7269f0397c99 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:33.641041 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5b07bf7e-ace1-478e-92f9-cc41d0e88880 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:33.641606 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-62d5f0b1-8a8a-43d7-89d6-7269f0397c99 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:33.650495 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5b07bf7e-ace1-478e-92f9-cc41d0e88880 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1507 microversion: 2.1 time: 0.444127 Jun 20 12:04:33.651957 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 884/1757] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:33 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1507 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:33.807882 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-47022ecf-391c-4075-8f58-04b071b6d678 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:33.808907 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-47022ecf-391c-4075-8f58-04b071b6d678 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: f7d2499c-a9c8-4c2e-8445-667070737f1f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:33.815826 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-47022ecf-391c-4075-8f58-04b071b6d678 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:33.816617 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-47022ecf-391c-4075-8f58-04b071b6d678 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:33.817608 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-47022ecf-391c-4075-8f58-04b071b6d678 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:33.818372 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-47022ecf-391c-4075-8f58-04b071b6d678 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:33.880499 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-62d5f0b1-8a8a-43d7-89d6-7269f0397c99 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:33.900456 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-62d5f0b1-8a8a-43d7-89d6-7269f0397c99 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a" status: 200 len: 1308 microversion: 2.1 time: 0.275231 Jun 20 12:04:33.902003 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 874/1758] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:33 2022] GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a => generated 1308 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:04:33.907635 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-37db0537-c29c-4897-8557-06fe2779c58e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:33.908994 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-37db0537-c29c-4897-8557-06fe2779c58e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:33.921849 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-37db0537-c29c-4897-8557-06fe2779c58e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:33.922572 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-37db0537-c29c-4897-8557-06fe2779c58e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:33.923593 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-37db0537-c29c-4897-8557-06fe2779c58e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:33.924226 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-37db0537-c29c-4897-8557-06fe2779c58e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:34.190494 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:34.213864 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-47022ecf-391c-4075-8f58-04b071b6d678 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286e4b475bbc4d108ca00497ecd3e55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8c8766d4f143349b61f27d8f2566fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:34.224384 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-37db0537-c29c-4897-8557-06fe2779c58e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:34.231108 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-47022ecf-391c-4075-8f58-04b071b6d678 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f" status: 200 len: 1318 microversion: 2.1 time: 0.423878 Jun 20 12:04:34.232786 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 885/1759] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:33 2022] GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f => generated 1318 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:04:34.233967 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-37db0537-c29c-4897-8557-06fe2779c58e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:34.237500 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-37db0537-c29c-4897-8557-06fe2779c58e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:34.237500 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-37db0537-c29c-4897-8557-06fe2779c58e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1486 microversion: 2.25 time: 0.333111 Jun 20 12:04:34.260949 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 875/1760] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:04:33 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1486 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:04:34.368740 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-d53bacfc-e6df-4482-88b6-f92e9cd41718 req-4c8125d7-2106-42bd-99b1-55011946bb4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31066575-9374-412f-9c63-ad5162254777", "tag": "e914de0d-b9de-410a-8338-f6ffef3981c1"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:34.380861 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-d53bacfc-e6df-4482-88b6-f92e9cd41718 req-4c8125d7-2106-42bd-99b1-55011946bb4b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:34.381622 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-d53bacfc-e6df-4482-88b6-f92e9cd41718 req-4c8125d7-2106-42bd-99b1-55011946bb4b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:34.394999 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-d53bacfc-e6df-4482-88b6-f92e9cd41718 req-4c8125d7-2106-42bd-99b1-55011946bb4b service nova] Creating event network-changed:e914de0d-b9de-410a-8338-f6ffef3981c1 for instance 31066575-9374-412f-9c63-ad5162254777 on n-h1-master-1 Jun 20 12:04:34.402586 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-d53bacfc-e6df-4482-88b6-f92e9cd41718 req-4c8125d7-2106-42bd-99b1-55011946bb4b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037639 Jun 20 12:04:34.403977 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 886/1761] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:34.548580 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e15730d0-6a04-4e10-a306-daf210f72b18 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:34.549170 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e15730d0-6a04-4e10-a306-daf210f72b18 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] [instance: c9290d77-4370-4fb5-a6ef-f1c1b6872b90] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:34.568238 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e15730d0-6a04-4e10-a306-daf210f72b18 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:34.568716 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e15730d0-6a04-4e10-a306-daf210f72b18 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:34.569851 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e15730d0-6a04-4e10-a306-daf210f72b18 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:34.572887 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e15730d0-6a04-4e10-a306-daf210f72b18 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:34.678685 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-058a10ca-23c5-45b5-a80d-33b6624fed15 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:34.682707 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-058a10ca-23c5-45b5-a80d-33b6624fed15 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:34.709361 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-058a10ca-23c5-45b5-a80d-33b6624fed15 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:34.710697 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-058a10ca-23c5-45b5-a80d-33b6624fed15 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:34.711735 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-058a10ca-23c5-45b5-a80d-33b6624fed15 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:34.712372 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-058a10ca-23c5-45b5-a80d-33b6624fed15 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:35.040122 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-058a10ca-23c5-45b5-a80d-33b6624fed15 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:35.052030 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-058a10ca-23c5-45b5-a80d-33b6624fed15 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1507 microversion: 2.1 time: 0.387345 Jun 20 12:04:35.054697 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e15730d0-6a04-4e10-a306-daf210f72b18 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b13de70dd3481684ec50bef063d049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f7335fd515401090c1d0a1e91d0107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:35.063461 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 887/1762] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:34 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1507 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:35.068836 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e15730d0-6a04-4e10-a306-daf210f72b18 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] 10.222.0.27 "GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90" status: 200 len: 1404 microversion: 2.1 time: 0.524378 Jun 20 12:04:35.069739 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 876/1763] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:34 2022] GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90 => generated 1404 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:35.072012 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-dbf52bae-539f-4646-8ae5-a2eb19a34b0e req-909c46fa-417a-4c8b-99af-2ff867ef66dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7d2499c-a9c8-4c2e-8445-667070737f1f", "tag": "4b377c25-4bc9-46b4-9743-511faa7773d1"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:35.078523 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-eed82171-7682-422f-8e28-a54ac29c136e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:35.079141 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-eed82171-7682-422f-8e28-a54ac29c136e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:35.085607 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-dbf52bae-539f-4646-8ae5-a2eb19a34b0e req-909c46fa-417a-4c8b-99af-2ff867ef66dd service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:35.086500 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-dbf52bae-539f-4646-8ae5-a2eb19a34b0e req-909c46fa-417a-4c8b-99af-2ff867ef66dd service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:35.095773 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eed82171-7682-422f-8e28-a54ac29c136e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:35.096512 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eed82171-7682-422f-8e28-a54ac29c136e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:35.097298 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eed82171-7682-422f-8e28-a54ac29c136e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:35.097732 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eed82171-7682-422f-8e28-a54ac29c136e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:35.102575 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-dbf52bae-539f-4646-8ae5-a2eb19a34b0e req-909c46fa-417a-4c8b-99af-2ff867ef66dd service nova] Creating event network-changed:4b377c25-4bc9-46b4-9743-511faa7773d1 for instance f7d2499c-a9c8-4c2e-8445-667070737f1f on n-h2-master-1 Jun 20 12:04:35.110151 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-dbf52bae-539f-4646-8ae5-a2eb19a34b0e req-909c46fa-417a-4c8b-99af-2ff867ef66dd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043061 Jun 20 12:04:35.115287 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 888/1764] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:35.252716 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-48b674ad-f982-4ce9-9d30-f22d0e9fbfc8 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:35.253624 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-48b674ad-f982-4ce9-9d30-f22d0e9fbfc8 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: f7d2499c-a9c8-4c2e-8445-667070737f1f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:35.258650 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:INSERT=10,nova_api:SELECT=90 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:35.270104 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-48b674ad-f982-4ce9-9d30-f22d0e9fbfc8 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:35.282612 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-48b674ad-f982-4ce9-9d30-f22d0e9fbfc8 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:35.283548 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-48b674ad-f982-4ce9-9d30-f22d0e9fbfc8 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:35.287587 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-48b674ad-f982-4ce9-9d30-f22d0e9fbfc8 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:35.358800 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-eed82171-7682-422f-8e28-a54ac29c136e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:35.362358 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:35.373035 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-eed82171-7682-422f-8e28-a54ac29c136e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a" status: 200 len: 1308 microversion: 2.1 time: 0.300542 Jun 20 12:04:35.375936 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 877/1765] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:35 2022] GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a => generated 1308 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:35.390877 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e08e69e1-0cc1-4a42-a117-fb534f9a7503 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:35.393794 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e08e69e1-0cc1-4a42-a117-fb534f9a7503 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:35.410861 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e08e69e1-0cc1-4a42-a117-fb534f9a7503 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:35.411301 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e08e69e1-0cc1-4a42-a117-fb534f9a7503 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:35.412100 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e08e69e1-0cc1-4a42-a117-fb534f9a7503 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:35.419719 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e08e69e1-0cc1-4a42-a117-fb534f9a7503 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:35.802787 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e08e69e1-0cc1-4a42-a117-fb534f9a7503 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:35.816564 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e08e69e1-0cc1-4a42-a117-fb534f9a7503 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:35.818790 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e08e69e1-0cc1-4a42-a117-fb534f9a7503 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:35.820697 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e08e69e1-0cc1-4a42-a117-fb534f9a7503 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1486 microversion: 2.25 time: 0.441325 Jun 20 12:04:35.821520 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 878/1766] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:04:35 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1486 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:04:36.071911 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0f0260d5-fea2-498c-b98f-3c9a6b8b4800 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:36.074011 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0f0260d5-fea2-498c-b98f-3c9a6b8b4800 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:36.081389 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f0260d5-fea2-498c-b98f-3c9a6b8b4800 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:36.082573 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f0260d5-fea2-498c-b98f-3c9a6b8b4800 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:36.083783 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f0260d5-fea2-498c-b98f-3c9a6b8b4800 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:36.084472 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f0260d5-fea2-498c-b98f-3c9a6b8b4800 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:36.328508 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-48b674ad-f982-4ce9-9d30-f22d0e9fbfc8 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286e4b475bbc4d108ca00497ecd3e55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8c8766d4f143349b61f27d8f2566fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:36.341401 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-48b674ad-f982-4ce9-9d30-f22d0e9fbfc8 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f" status: 200 len: 1318 microversion: 2.1 time: 1.096452 Jun 20 12:04:36.343138 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 889/1767] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:35 2022] GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f => generated 1318 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:36.356167 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4c728f38-5b58-43da-9e85-75284729cae1 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:36.363013 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4c728f38-5b58-43da-9e85-75284729cae1 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] [instance: c9290d77-4370-4fb5-a6ef-f1c1b6872b90] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:36.368865 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0f0260d5-fea2-498c-b98f-3c9a6b8b4800 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:36.375564 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4c728f38-5b58-43da-9e85-75284729cae1 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:36.379630 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4c728f38-5b58-43da-9e85-75284729cae1 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:36.380757 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4c728f38-5b58-43da-9e85-75284729cae1 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:36.381386 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4c728f38-5b58-43da-9e85-75284729cae1 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:36.383522 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0f0260d5-fea2-498c-b98f-3c9a6b8b4800 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1507 microversion: 2.1 time: 0.317333 Jun 20 12:04:36.397115 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 879/1768] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:36 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1507 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:04:36.407345 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-94163b0e-11e8-461b-bfdb-c01c60883c80 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:36.409070 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-94163b0e-11e8-461b-bfdb-c01c60883c80 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:36.420584 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94163b0e-11e8-461b-bfdb-c01c60883c80 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:36.422034 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94163b0e-11e8-461b-bfdb-c01c60883c80 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:36.426445 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94163b0e-11e8-461b-bfdb-c01c60883c80 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:36.427179 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94163b0e-11e8-461b-bfdb-c01c60883c80 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:36.668747 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-94163b0e-11e8-461b-bfdb-c01c60883c80 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:36.686272 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-94163b0e-11e8-461b-bfdb-c01c60883c80 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a" status: 200 len: 1308 microversion: 2.1 time: 0.285483 Jun 20 12:04:36.687025 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 880/1769] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:36 2022] GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a => generated 1308 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:36.693350 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-d12685a9-2fb0-4321-b9fc-aaeed4950f31 req-ee1745ee-a0ce-414f-aef8-1d1e62ac0be1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "838db96b-0c7a-4d7f-9807-44194bc73cff", "name": "network-vif-plugged", "status": "completed", "tag": "1e4f16ac-a73c-4854-8d0f-a050fb989db4"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:36.702490 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-d12685a9-2fb0-4321-b9fc-aaeed4950f31 req-ee1745ee-a0ce-414f-aef8-1d1e62ac0be1 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:36.703210 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-d12685a9-2fb0-4321-b9fc-aaeed4950f31 req-ee1745ee-a0ce-414f-aef8-1d1e62ac0be1 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:36.715413 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-d12685a9-2fb0-4321-b9fc-aaeed4950f31 req-ee1745ee-a0ce-414f-aef8-1d1e62ac0be1 service nova] Creating event network-vif-plugged:1e4f16ac-a73c-4854-8d0f-a050fb989db4 for instance 838db96b-0c7a-4d7f-9807-44194bc73cff on n-h1-master-1 Jun 20 12:04:36.720868 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-d12685a9-2fb0-4321-b9fc-aaeed4950f31 req-ee1745ee-a0ce-414f-aef8-1d1e62ac0be1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031658 Jun 20 12:04:36.721474 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 881/1770] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:36.843356 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8dd495e4-b666-4832-a539-7621fe55fe3a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:36.844468 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8dd495e4-b666-4832-a539-7621fe55fe3a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:36.852814 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8dd495e4-b666-4832-a539-7621fe55fe3a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:36.853270 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8dd495e4-b666-4832-a539-7621fe55fe3a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:36.854945 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8dd495e4-b666-4832-a539-7621fe55fe3a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:36.855523 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8dd495e4-b666-4832-a539-7621fe55fe3a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:37.042593 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4c728f38-5b58-43da-9e85-75284729cae1 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b13de70dd3481684ec50bef063d049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f7335fd515401090c1d0a1e91d0107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:37.052772 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4c728f38-5b58-43da-9e85-75284729cae1 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] 10.222.0.27 "GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90" status: 200 len: 1404 microversion: 2.1 time: 0.706670 Jun 20 12:04:37.053699 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 890/1771] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:36 2022] GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90 => generated 1404 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:37.063991 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8dd495e4-b666-4832-a539-7621fe55fe3a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:37.070529 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8dd495e4-b666-4832-a539-7621fe55fe3a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:37.072066 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8dd495e4-b666-4832-a539-7621fe55fe3a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:37.073286 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8dd495e4-b666-4832-a539-7621fe55fe3a tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1486 microversion: 2.25 time: 0.236202 Jun 20 12:04:37.074382 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 882/1772] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:04:36 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1486 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:04:37.364477 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dc155cee-a0c8-46bc-8fb0-fe0b8cb37311 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:37.365420 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dc155cee-a0c8-46bc-8fb0-fe0b8cb37311 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: f7d2499c-a9c8-4c2e-8445-667070737f1f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:37.391359 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc155cee-a0c8-46bc-8fb0-fe0b8cb37311 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:37.392675 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc155cee-a0c8-46bc-8fb0-fe0b8cb37311 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:37.395498 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc155cee-a0c8-46bc-8fb0-fe0b8cb37311 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:37.396668 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc155cee-a0c8-46bc-8fb0-fe0b8cb37311 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:37.407758 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2ad72d9b-3aa9-4697-93d2-6dbc47d7befc tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:37.408422 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2ad72d9b-3aa9-4697-93d2-6dbc47d7befc tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:37.419913 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2ad72d9b-3aa9-4697-93d2-6dbc47d7befc tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:37.424318 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2ad72d9b-3aa9-4697-93d2-6dbc47d7befc tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:37.425374 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2ad72d9b-3aa9-4697-93d2-6dbc47d7befc tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:37.425839 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2ad72d9b-3aa9-4697-93d2-6dbc47d7befc tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:37.600841 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2ad72d9b-3aa9-4697-93d2-6dbc47d7befc tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:37.610612 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2ad72d9b-3aa9-4697-93d2-6dbc47d7befc tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1507 microversion: 2.1 time: 0.210794 Jun 20 12:04:37.611358 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 883/1773] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:37 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1507 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:04:37.705165 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-47aa5d0f-625b-4325-bd41-485f36bde4ac tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:37.706481 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-47aa5d0f-625b-4325-bd41-485f36bde4ac tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:37.713512 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-47aa5d0f-625b-4325-bd41-485f36bde4ac tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:37.714370 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-47aa5d0f-625b-4325-bd41-485f36bde4ac tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:37.715704 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-47aa5d0f-625b-4325-bd41-485f36bde4ac tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:37.716298 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-47aa5d0f-625b-4325-bd41-485f36bde4ac tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:37.749647 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dc155cee-a0c8-46bc-8fb0-fe0b8cb37311 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286e4b475bbc4d108ca00497ecd3e55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8c8766d4f143349b61f27d8f2566fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:37.758648 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dc155cee-a0c8-46bc-8fb0-fe0b8cb37311 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f" status: 200 len: 1318 microversion: 2.1 time: 0.403719 Jun 20 12:04:37.759506 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 891/1774] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:37 2022] GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f => generated 1318 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:37.882271 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-47aa5d0f-625b-4325-bd41-485f36bde4ac tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:37.891148 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-47aa5d0f-625b-4325-bd41-485f36bde4ac tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a" status: 200 len: 1308 microversion: 2.1 time: 0.191314 Jun 20 12:04:37.892293 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 884/1775] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:37 2022] GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a => generated 1308 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:38.071078 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9b6cf962-9699-4258-8b6c-de6ff4112147 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:38.071701 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9b6cf962-9699-4258-8b6c-de6ff4112147 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] [instance: c9290d77-4370-4fb5-a6ef-f1c1b6872b90] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:38.078605 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b6cf962-9699-4258-8b6c-de6ff4112147 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:38.079059 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b6cf962-9699-4258-8b6c-de6ff4112147 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:38.079839 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b6cf962-9699-4258-8b6c-de6ff4112147 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:38.080316 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b6cf962-9699-4258-8b6c-de6ff4112147 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:38.095994 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-46c1ad77-ba9f-491a-9923-4fe661f08d7c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:38.096813 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-46c1ad77-ba9f-491a-9923-4fe661f08d7c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:38.103280 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-46c1ad77-ba9f-491a-9923-4fe661f08d7c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:38.104283 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-46c1ad77-ba9f-491a-9923-4fe661f08d7c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:38.105539 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-46c1ad77-ba9f-491a-9923-4fe661f08d7c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:38.106219 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-46c1ad77-ba9f-491a-9923-4fe661f08d7c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:38.250215 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9b6cf962-9699-4258-8b6c-de6ff4112147 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b13de70dd3481684ec50bef063d049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f7335fd515401090c1d0a1e91d0107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:38.260722 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9b6cf962-9699-4258-8b6c-de6ff4112147 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] 10.222.0.27 "GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90" status: 200 len: 1404 microversion: 2.1 time: 0.193508 Jun 20 12:04:38.271881 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 892/1776] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:38 2022] GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90 => generated 1404 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:38.286632 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-46c1ad77-ba9f-491a-9923-4fe661f08d7c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:38.297381 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-46c1ad77-ba9f-491a-9923-4fe661f08d7c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:38.299898 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-46c1ad77-ba9f-491a-9923-4fe661f08d7c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:38.301200 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-46c1ad77-ba9f-491a-9923-4fe661f08d7c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1486 microversion: 2.25 time: 0.209841 Jun 20 12:04:38.301848 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 885/1777] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:04:38 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1486 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:04:38.628178 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d8f664f3-599d-45f9-bf10-d4472ec2b2ea tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:38.628838 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d8f664f3-599d-45f9-bf10-d4472ec2b2ea tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:38.635476 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d8f664f3-599d-45f9-bf10-d4472ec2b2ea tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:38.635934 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d8f664f3-599d-45f9-bf10-d4472ec2b2ea tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:38.636740 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d8f664f3-599d-45f9-bf10-d4472ec2b2ea tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:38.637188 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d8f664f3-599d-45f9-bf10-d4472ec2b2ea tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:38.748172 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-4287841e-b0f0-4048-91bb-2bbe0b83d4b7 req-8d4da7cd-895b-4ede-915e-952576b9b8c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9290d77-4370-4fb5-a6ef-f1c1b6872b90", "name": "network-vif-plugged", "status": "completed", "tag": "df0d5349-d128-45d1-bb70-d0936101a5ee"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:38.759108 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-4287841e-b0f0-4048-91bb-2bbe0b83d4b7 req-8d4da7cd-895b-4ede-915e-952576b9b8c5 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:38.759784 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-4287841e-b0f0-4048-91bb-2bbe0b83d4b7 req-8d4da7cd-895b-4ede-915e-952576b9b8c5 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:38.778403 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-4287841e-b0f0-4048-91bb-2bbe0b83d4b7 req-8d4da7cd-895b-4ede-915e-952576b9b8c5 service nova] Creating event network-vif-plugged:df0d5349-d128-45d1-bb70-d0936101a5ee for instance c9290d77-4370-4fb5-a6ef-f1c1b6872b90 on n-h2-master-1 Jun 20 12:04:38.785654 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-4287841e-b0f0-4048-91bb-2bbe0b83d4b7 req-8d4da7cd-895b-4ede-915e-952576b9b8c5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041767 Jun 20 12:04:38.786351 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 886/1778] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:38.788486 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d8f664f3-599d-45f9-bf10-d4472ec2b2ea tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:38.793562 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0fc6315d-c14d-4f0d-ae09-1c9683cbf290 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:38.794737 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0fc6315d-c14d-4f0d-ae09-1c9683cbf290 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: f7d2499c-a9c8-4c2e-8445-667070737f1f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:38.802759 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0fc6315d-c14d-4f0d-ae09-1c9683cbf290 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:38.803282 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0fc6315d-c14d-4f0d-ae09-1c9683cbf290 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:38.803467 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d8f664f3-599d-45f9-bf10-d4472ec2b2ea tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1507 microversion: 2.1 time: 0.178882 Jun 20 12:04:38.803929 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 893/1779] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:38 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1507 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:38.804185 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0fc6315d-c14d-4f0d-ae09-1c9683cbf290 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:38.804864 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0fc6315d-c14d-4f0d-ae09-1c9683cbf290 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:38.911381 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8b4a7e11-a9da-4d0c-aa77-31cc40906eda tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:38.912023 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8b4a7e11-a9da-4d0c-aa77-31cc40906eda tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:38.920477 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b4a7e11-a9da-4d0c-aa77-31cc40906eda tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:38.920918 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b4a7e11-a9da-4d0c-aa77-31cc40906eda tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:38.921708 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b4a7e11-a9da-4d0c-aa77-31cc40906eda tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:38.922141 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b4a7e11-a9da-4d0c-aa77-31cc40906eda tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:38.964341 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0fc6315d-c14d-4f0d-ae09-1c9683cbf290 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286e4b475bbc4d108ca00497ecd3e55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8c8766d4f143349b61f27d8f2566fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:38.973124 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0fc6315d-c14d-4f0d-ae09-1c9683cbf290 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f" status: 200 len: 1318 microversion: 2.1 time: 0.185361 Jun 20 12:04:38.983454 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 887/1780] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:38 2022] GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:39.099318 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8b4a7e11-a9da-4d0c-aa77-31cc40906eda tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:39.107704 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8b4a7e11-a9da-4d0c-aa77-31cc40906eda tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a" status: 200 len: 1308 microversion: 2.1 time: 0.200319 Jun 20 12:04:39.108510 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 894/1781] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:38 2022] GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a => generated 1308 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:04:39.281014 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-77d24dfa-62b6-4ffc-acc6-c040ac72ea7a tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:39.282897 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-77d24dfa-62b6-4ffc-acc6-c040ac72ea7a tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] [instance: c9290d77-4370-4fb5-a6ef-f1c1b6872b90] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:39.291214 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-77d24dfa-62b6-4ffc-acc6-c040ac72ea7a tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:39.292101 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-77d24dfa-62b6-4ffc-acc6-c040ac72ea7a tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:39.293409 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-77d24dfa-62b6-4ffc-acc6-c040ac72ea7a tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:39.294175 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-77d24dfa-62b6-4ffc-acc6-c040ac72ea7a tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:39.331077 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b12b4020-0d1c-4855-8e88-9c1cfac58a4f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:39.332122 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b12b4020-0d1c-4855-8e88-9c1cfac58a4f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:39.342206 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b12b4020-0d1c-4855-8e88-9c1cfac58a4f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:39.342915 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b12b4020-0d1c-4855-8e88-9c1cfac58a4f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:39.344982 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b12b4020-0d1c-4855-8e88-9c1cfac58a4f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:39.346510 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b12b4020-0d1c-4855-8e88-9c1cfac58a4f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:39.534634 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-77d24dfa-62b6-4ffc-acc6-c040ac72ea7a tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b13de70dd3481684ec50bef063d049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f7335fd515401090c1d0a1e91d0107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:39.554636 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-77d24dfa-62b6-4ffc-acc6-c040ac72ea7a tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] 10.222.0.27 "GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90" status: 200 len: 1404 microversion: 2.1 time: 0.278628 Jun 20 12:04:39.555710 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 888/1782] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:39 2022] GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90 => generated 1404 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:39.570301 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b12b4020-0d1c-4855-8e88-9c1cfac58a4f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:39.581491 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b12b4020-0d1c-4855-8e88-9c1cfac58a4f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:39.588347 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b12b4020-0d1c-4855-8e88-9c1cfac58a4f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:39.589728 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b12b4020-0d1c-4855-8e88-9c1cfac58a4f tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1486 microversion: 2.25 time: 0.272075 Jun 20 12:04:39.590241 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 895/1783] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:04:39 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1486 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:04:39.823202 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c8247b27-89ba-44fb-bd7a-245dbc415140 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:39.824442 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c8247b27-89ba-44fb-bd7a-245dbc415140 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:39.831897 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c8247b27-89ba-44fb-bd7a-245dbc415140 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:39.832369 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c8247b27-89ba-44fb-bd7a-245dbc415140 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:39.833161 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c8247b27-89ba-44fb-bd7a-245dbc415140 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:39.833616 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c8247b27-89ba-44fb-bd7a-245dbc415140 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:39.969732 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c8247b27-89ba-44fb-bd7a-245dbc415140 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:39.978228 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c8247b27-89ba-44fb-bd7a-245dbc415140 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1507 microversion: 2.1 time: 0.159497 Jun 20 12:04:39.978827 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 889/1784] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:39 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:39.991176 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-77aa3ac5-643e-460e-8d7a-697a547e98b7 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:39.991884 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-77aa3ac5-643e-460e-8d7a-697a547e98b7 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: f7d2499c-a9c8-4c2e-8445-667070737f1f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:39.998690 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-77aa3ac5-643e-460e-8d7a-697a547e98b7 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:39.999146 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-77aa3ac5-643e-460e-8d7a-697a547e98b7 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:40.000139 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-77aa3ac5-643e-460e-8d7a-697a547e98b7 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:40.000522 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-77aa3ac5-643e-460e-8d7a-697a547e98b7 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:40.125883 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f8ac2c20-edb4-4a98-8cde-0fe37deaabdf tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:40.127002 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f8ac2c20-edb4-4a98-8cde-0fe37deaabdf tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:40.133653 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8ac2c20-edb4-4a98-8cde-0fe37deaabdf tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:40.134366 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8ac2c20-edb4-4a98-8cde-0fe37deaabdf tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:40.135145 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8ac2c20-edb4-4a98-8cde-0fe37deaabdf tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:40.135584 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8ac2c20-edb4-4a98-8cde-0fe37deaabdf tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:40.162699 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-77aa3ac5-643e-460e-8d7a-697a547e98b7 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286e4b475bbc4d108ca00497ecd3e55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8c8766d4f143349b61f27d8f2566fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:40.172476 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-77aa3ac5-643e-460e-8d7a-697a547e98b7 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f" status: 200 len: 1318 microversion: 2.1 time: 0.185845 Jun 20 12:04:40.173854 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 896/1785] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:39 2022] GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:40.324568 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f8ac2c20-edb4-4a98-8cde-0fe37deaabdf tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:40.336156 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f8ac2c20-edb4-4a98-8cde-0fe37deaabdf tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a" status: 200 len: 1308 microversion: 2.1 time: 0.214416 Jun 20 12:04:40.346813 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 890/1786] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:40 2022] GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a => generated 1308 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:40.574033 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4dd78a4a-22c6-422a-be6b-ae0b3d7f43c3 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:40.574809 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4dd78a4a-22c6-422a-be6b-ae0b3d7f43c3 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] [instance: c9290d77-4370-4fb5-a6ef-f1c1b6872b90] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:40.581599 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4dd78a4a-22c6-422a-be6b-ae0b3d7f43c3 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:40.582052 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4dd78a4a-22c6-422a-be6b-ae0b3d7f43c3 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:40.582874 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4dd78a4a-22c6-422a-be6b-ae0b3d7f43c3 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:40.583307 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4dd78a4a-22c6-422a-be6b-ae0b3d7f43c3 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:40.612535 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f41e5e77-9a47-438d-abd0-3a6e360ce4c4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:40.613562 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f41e5e77-9a47-438d-abd0-3a6e360ce4c4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:40.621033 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f41e5e77-9a47-438d-abd0-3a6e360ce4c4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:40.621901 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f41e5e77-9a47-438d-abd0-3a6e360ce4c4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:40.622684 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f41e5e77-9a47-438d-abd0-3a6e360ce4c4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:40.623118 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f41e5e77-9a47-438d-abd0-3a6e360ce4c4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:40.730873 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4dd78a4a-22c6-422a-be6b-ae0b3d7f43c3 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b13de70dd3481684ec50bef063d049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f7335fd515401090c1d0a1e91d0107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:40.740471 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4dd78a4a-22c6-422a-be6b-ae0b3d7f43c3 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] 10.222.0.27 "GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90" status: 200 len: 1404 microversion: 2.1 time: 0.170104 Jun 20 12:04:40.741732 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 897/1787] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:40 2022] GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90 => generated 1404 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:40.780510 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f41e5e77-9a47-438d-abd0-3a6e360ce4c4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:40.789794 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f41e5e77-9a47-438d-abd0-3a6e360ce4c4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:40.791896 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f41e5e77-9a47-438d-abd0-3a6e360ce4c4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:40.793713 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f41e5e77-9a47-438d-abd0-3a6e360ce4c4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1486 microversion: 2.25 time: 0.185409 Jun 20 12:04:40.794490 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 891/1788] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:04:40 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1486 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:04:40.810171 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-7fc1ceb1-e0f0-49b8-9fe8-2f3b43c475cb req-1045698f-ee24-4464-8664-4d523060e5c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b9e1026-a6f6-47f2-8734-4b05eeff8b9a", "name": "network-vif-plugged", "status": "completed", "tag": "d4607934-f3b3-445b-8374-03fb586d6121"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:40.819021 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-7fc1ceb1-e0f0-49b8-9fe8-2f3b43c475cb req-1045698f-ee24-4464-8664-4d523060e5c4 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:40.819581 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-7fc1ceb1-e0f0-49b8-9fe8-2f3b43c475cb req-1045698f-ee24-4464-8664-4d523060e5c4 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:40.835085 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-7fc1ceb1-e0f0-49b8-9fe8-2f3b43c475cb req-1045698f-ee24-4464-8664-4d523060e5c4 service nova] Creating event network-vif-plugged:d4607934-f3b3-445b-8374-03fb586d6121 for instance 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a on n-h2-master-1 Jun 20 12:04:40.840786 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-7fc1ceb1-e0f0-49b8-9fe8-2f3b43c475cb req-1045698f-ee24-4464-8664-4d523060e5c4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034973 Jun 20 12:04:40.841409 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 898/1789] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:41.001650 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6acbb38f-4a6a-462c-b849-a9a15ff62f57 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:41.002348 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6acbb38f-4a6a-462c-b849-a9a15ff62f57 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:41.009379 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6acbb38f-4a6a-462c-b849-a9a15ff62f57 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:41.009833 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6acbb38f-4a6a-462c-b849-a9a15ff62f57 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:41.010615 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6acbb38f-4a6a-462c-b849-a9a15ff62f57 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:41.011183 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6acbb38f-4a6a-462c-b849-a9a15ff62f57 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:41.155701 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6acbb38f-4a6a-462c-b849-a9a15ff62f57 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:41.163460 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6acbb38f-4a6a-462c-b849-a9a15ff62f57 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1507 microversion: 2.1 time: 0.165735 Jun 20 12:04:41.164028 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 892/1790] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:40 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:41.191241 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-81f70c91-da4d-47a3-9c25-a72a13b4c9ab tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:41.192351 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-81f70c91-da4d-47a3-9c25-a72a13b4c9ab tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: f7d2499c-a9c8-4c2e-8445-667070737f1f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:41.199792 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-81f70c91-da4d-47a3-9c25-a72a13b4c9ab tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:41.200373 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-81f70c91-da4d-47a3-9c25-a72a13b4c9ab tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:41.201546 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-81f70c91-da4d-47a3-9c25-a72a13b4c9ab tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:41.202190 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-81f70c91-da4d-47a3-9c25-a72a13b4c9ab tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:41.346246 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-81f70c91-da4d-47a3-9c25-a72a13b4c9ab tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286e4b475bbc4d108ca00497ecd3e55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8c8766d4f143349b61f27d8f2566fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:41.352877 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-349ee8cd-129b-46e8-8cf9-e82c8229de6c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:41.353576 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-349ee8cd-129b-46e8-8cf9-e82c8229de6c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:41.356870 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-81f70c91-da4d-47a3-9c25-a72a13b4c9ab tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f" status: 200 len: 1318 microversion: 2.1 time: 0.169818 Jun 20 12:04:41.357447 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 899/1791] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:41 2022] GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:41.360908 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-349ee8cd-129b-46e8-8cf9-e82c8229de6c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:41.364429 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-349ee8cd-129b-46e8-8cf9-e82c8229de6c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:41.365311 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-349ee8cd-129b-46e8-8cf9-e82c8229de6c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:41.365813 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-349ee8cd-129b-46e8-8cf9-e82c8229de6c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:41.507237 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-349ee8cd-129b-46e8-8cf9-e82c8229de6c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:41.518484 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-349ee8cd-129b-46e8-8cf9-e82c8229de6c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a" status: 200 len: 1308 microversion: 2.1 time: 0.169559 Jun 20 12:04:41.519510 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 893/1792] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:41 2022] GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a => generated 1308 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:41.758753 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ff8a3683-4f55-4d30-a89b-8f8b2bcf6411 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:41.759369 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ff8a3683-4f55-4d30-a89b-8f8b2bcf6411 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] [instance: c9290d77-4370-4fb5-a6ef-f1c1b6872b90] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:41.766748 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff8a3683-4f55-4d30-a89b-8f8b2bcf6411 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:41.767189 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff8a3683-4f55-4d30-a89b-8f8b2bcf6411 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:41.768166 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff8a3683-4f55-4d30-a89b-8f8b2bcf6411 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:41.768641 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff8a3683-4f55-4d30-a89b-8f8b2bcf6411 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:41.813651 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-070c2149-4ed3-41ee-ae0e-464336c5592e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:41.814445 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-070c2149-4ed3-41ee-ae0e-464336c5592e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:41.821053 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-070c2149-4ed3-41ee-ae0e-464336c5592e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:41.821729 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-070c2149-4ed3-41ee-ae0e-464336c5592e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:41.822646 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-070c2149-4ed3-41ee-ae0e-464336c5592e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:41.823226 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-070c2149-4ed3-41ee-ae0e-464336c5592e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:41.940315 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ff8a3683-4f55-4d30-a89b-8f8b2bcf6411 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b13de70dd3481684ec50bef063d049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f7335fd515401090c1d0a1e91d0107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:41.943385 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:41.951732 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ff8a3683-4f55-4d30-a89b-8f8b2bcf6411 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] 10.222.0.27 "GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90" status: 200 len: 1404 microversion: 2.1 time: 0.196560 Jun 20 12:04:41.952950 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 900/1793] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:41 2022] GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90 => generated 1404 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:42.003939 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-070c2149-4ed3-41ee-ae0e-464336c5592e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:42.018239 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-070c2149-4ed3-41ee-ae0e-464336c5592e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:42.020426 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-070c2149-4ed3-41ee-ae0e-464336c5592e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:42.022234 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-070c2149-4ed3-41ee-ae0e-464336c5592e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1486 microversion: 2.25 time: 0.213346 Jun 20 12:04:42.022968 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 894/1794] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:04:41 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1486 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:04:42.180506 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b908fd87-88ec-4b63-94a0-7c9a4334f25d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:42.181735 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b908fd87-88ec-4b63-94a0-7c9a4334f25d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:42.188897 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b908fd87-88ec-4b63-94a0-7c9a4334f25d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:42.189413 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b908fd87-88ec-4b63-94a0-7c9a4334f25d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:42.190133 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b908fd87-88ec-4b63-94a0-7c9a4334f25d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:42.190623 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b908fd87-88ec-4b63-94a0-7c9a4334f25d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:42.337638 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b908fd87-88ec-4b63-94a0-7c9a4334f25d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:42.346634 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b908fd87-88ec-4b63-94a0-7c9a4334f25d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1528 microversion: 2.1 time: 0.170228 Jun 20 12:04:42.347222 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 901/1795] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:42 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1528 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:42.374218 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-80704245-b253-4c98-8d48-66012d7e672a tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:42.375567 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-80704245-b253-4c98-8d48-66012d7e672a tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: f7d2499c-a9c8-4c2e-8445-667070737f1f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:42.382189 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80704245-b253-4c98-8d48-66012d7e672a tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:42.382654 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80704245-b253-4c98-8d48-66012d7e672a tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:42.383507 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80704245-b253-4c98-8d48-66012d7e672a tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:42.383981 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80704245-b253-4c98-8d48-66012d7e672a tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:42.534665 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-80704245-b253-4c98-8d48-66012d7e672a tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286e4b475bbc4d108ca00497ecd3e55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8c8766d4f143349b61f27d8f2566fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:42.535022 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-da85242a-78c3-440a-9cb9-abce34507c8b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:42.535669 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-da85242a-78c3-440a-9cb9-abce34507c8b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:42.540594 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:42.541969 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da85242a-78c3-440a-9cb9-abce34507c8b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:42.542480 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da85242a-78c3-440a-9cb9-abce34507c8b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:42.543572 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da85242a-78c3-440a-9cb9-abce34507c8b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:42.544014 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da85242a-78c3-440a-9cb9-abce34507c8b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:42.551214 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-80704245-b253-4c98-8d48-66012d7e672a tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f" status: 200 len: 1318 microversion: 2.1 time: 0.179137 Jun 20 12:04:42.563534 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 895/1796] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:42 2022] GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:42.695780 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-da85242a-78c3-440a-9cb9-abce34507c8b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:42.704971 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-da85242a-78c3-440a-9cb9-abce34507c8b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a" status: 200 len: 1308 microversion: 2.1 time: 0.173826 Jun 20 12:04:42.706037 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 902/1797] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:42 2022] GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a => generated 1308 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:04:42.970112 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8c561b52-09e5-4044-a558-d371b29e2ccd tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:42.970940 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8c561b52-09e5-4044-a558-d371b29e2ccd tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] [instance: c9290d77-4370-4fb5-a6ef-f1c1b6872b90] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:42.979585 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8c561b52-09e5-4044-a558-d371b29e2ccd tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:42.980119 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8c561b52-09e5-4044-a558-d371b29e2ccd tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:42.981202 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8c561b52-09e5-4044-a558-d371b29e2ccd tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:42.981821 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8c561b52-09e5-4044-a558-d371b29e2ccd tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:43.043277 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1a1cfdb7-6e9c-44d7-be3a-3d8757cba5d8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:43.043985 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1a1cfdb7-6e9c-44d7-be3a-3d8757cba5d8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:43.051068 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a1cfdb7-6e9c-44d7-be3a-3d8757cba5d8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:43.051860 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a1cfdb7-6e9c-44d7-be3a-3d8757cba5d8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:43.052875 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a1cfdb7-6e9c-44d7-be3a-3d8757cba5d8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:43.053495 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a1cfdb7-6e9c-44d7-be3a-3d8757cba5d8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:43.173546 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8c561b52-09e5-4044-a558-d371b29e2ccd tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b13de70dd3481684ec50bef063d049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f7335fd515401090c1d0a1e91d0107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:43.188768 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8c561b52-09e5-4044-a558-d371b29e2ccd tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] 10.222.0.27 "GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90" status: 200 len: 1404 microversion: 2.1 time: 0.223080 Jun 20 12:04:43.201368 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 896/1798] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:42 2022] GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90 => generated 1404 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:43.379905 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1a1cfdb7-6e9c-44d7-be3a-3d8757cba5d8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:43.390880 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fa63d4ef-9b98-4f9d-a8a9-db7982d00dd7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:43.393432 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fa63d4ef-9b98-4f9d-a8a9-db7982d00dd7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:43.402001 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1a1cfdb7-6e9c-44d7-be3a-3d8757cba5d8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:43.406710 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1a1cfdb7-6e9c-44d7-be3a-3d8757cba5d8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:43.409704 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1a1cfdb7-6e9c-44d7-be3a-3d8757cba5d8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1486 microversion: 2.25 time: 0.371340 Jun 20 12:04:43.411519 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 903/1799] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:04:43 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1486 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:04:43.422340 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fa63d4ef-9b98-4f9d-a8a9-db7982d00dd7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:43.428431 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fa63d4ef-9b98-4f9d-a8a9-db7982d00dd7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:43.430153 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fa63d4ef-9b98-4f9d-a8a9-db7982d00dd7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:43.430943 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fa63d4ef-9b98-4f9d-a8a9-db7982d00dd7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:43.573314 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-04096895-52a5-4588-9be3-15a69678c633 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:43.574742 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-04096895-52a5-4588-9be3-15a69678c633 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: f7d2499c-a9c8-4c2e-8445-667070737f1f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:43.583481 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-04096895-52a5-4588-9be3-15a69678c633 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:43.584511 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-04096895-52a5-4588-9be3-15a69678c633 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:43.585580 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-04096895-52a5-4588-9be3-15a69678c633 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:43.586243 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-04096895-52a5-4588-9be3-15a69678c633 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:43.743611 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fa63d4ef-9b98-4f9d-a8a9-db7982d00dd7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:43.759775 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fa63d4ef-9b98-4f9d-a8a9-db7982d00dd7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1528 microversion: 2.1 time: 0.395382 Jun 20 12:04:43.761652 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 897/1800] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:43 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1528 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:43.768628 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-c6d1bff9-ea73-4d84-8934-5dde98439625 req-1e830c83-e6d1-453d-8419-727ba928d83a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21b4c645-d527-4d43-a7fb-5c866fa59022", "name": "network-vif-unplugged", "status": "completed", "tag": "b8bd2b04-702a-4d5a-97c4-9bb7561531a4"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:43.779749 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-c6d1bff9-ea73-4d84-8934-5dde98439625 req-1e830c83-e6d1-453d-8419-727ba928d83a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:43.780809 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-c6d1bff9-ea73-4d84-8934-5dde98439625 req-1e830c83-e6d1-453d-8419-727ba928d83a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:43.817931 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-c6d1bff9-ea73-4d84-8934-5dde98439625 req-1e830c83-e6d1-453d-8419-727ba928d83a service nova] Creating event network-vif-unplugged:b8bd2b04-702a-4d5a-97c4-9bb7561531a4 for instance 21b4c645-d527-4d43-a7fb-5c866fa59022 on n-h1-master-1 Jun 20 12:04:43.845825 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-c6d1bff9-ea73-4d84-8934-5dde98439625 req-1e830c83-e6d1-453d-8419-727ba928d83a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079787 Jun 20 12:04:43.847081 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 898/1801] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:43.854278 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f6471f25-acb7-4d83-aec7-9d5ffc489c02 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:43.856496 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f6471f25-acb7-4d83-aec7-9d5ffc489c02 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:43.865256 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6471f25-acb7-4d83-aec7-9d5ffc489c02 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:43.865924 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6471f25-acb7-4d83-aec7-9d5ffc489c02 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:43.867765 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6471f25-acb7-4d83-aec7-9d5ffc489c02 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:43.868339 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6471f25-acb7-4d83-aec7-9d5ffc489c02 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:44.010364 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-04096895-52a5-4588-9be3-15a69678c633 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286e4b475bbc4d108ca00497ecd3e55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8c8766d4f143349b61f27d8f2566fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:44.027241 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-04096895-52a5-4588-9be3-15a69678c633 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f" status: 200 len: 1318 microversion: 2.1 time: 0.459059 Jun 20 12:04:44.030299 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 904/1802] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:43 2022] GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f => generated 1318 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:44.118112 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f6471f25-acb7-4d83-aec7-9d5ffc489c02 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:44.127549 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f6471f25-acb7-4d83-aec7-9d5ffc489c02 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a" status: 200 len: 1308 microversion: 2.1 time: 0.278888 Jun 20 12:04:44.128148 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 899/1803] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:43 2022] GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a => generated 1308 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:44.210300 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c39f32f7-de04-4032-a914-7298f5fbf560 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:44.211599 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c39f32f7-de04-4032-a914-7298f5fbf560 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] [instance: c9290d77-4370-4fb5-a6ef-f1c1b6872b90] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:44.222752 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c39f32f7-de04-4032-a914-7298f5fbf560 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:44.236724 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c39f32f7-de04-4032-a914-7298f5fbf560 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:44.259687 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c39f32f7-de04-4032-a914-7298f5fbf560 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:44.260516 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c39f32f7-de04-4032-a914-7298f5fbf560 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:44.429829 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a40aa605-0c2b-421f-a069-c55f642fb259 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:44.430444 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a40aa605-0c2b-421f-a069-c55f642fb259 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:44.440574 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a40aa605-0c2b-421f-a069-c55f642fb259 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:44.443592 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a40aa605-0c2b-421f-a069-c55f642fb259 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:44.444662 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a40aa605-0c2b-421f-a069-c55f642fb259 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:44.446924 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a40aa605-0c2b-421f-a069-c55f642fb259 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:44.504102 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c39f32f7-de04-4032-a914-7298f5fbf560 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b13de70dd3481684ec50bef063d049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f7335fd515401090c1d0a1e91d0107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:44.514706 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c39f32f7-de04-4032-a914-7298f5fbf560 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] 10.222.0.27 "GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90" status: 200 len: 1591 microversion: 2.1 time: 0.311354 Jun 20 12:04:44.516163 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 905/1804] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:44 2022] GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90 => generated 1591 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:44.532595 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-47a779c9-cc2a-43e3-89ac-aa58f02db245 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:44.533222 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-47a779c9-cc2a-43e3-89ac-aa58f02db245 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] [instance: c9290d77-4370-4fb5-a6ef-f1c1b6872b90] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:44.540291 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-47a779c9-cc2a-43e3-89ac-aa58f02db245 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:44.540746 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-47a779c9-cc2a-43e3-89ac-aa58f02db245 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:44.541535 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-47a779c9-cc2a-43e3-89ac-aa58f02db245 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:44.541972 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-47a779c9-cc2a-43e3-89ac-aa58f02db245 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:44.648316 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-47a779c9-cc2a-43e3-89ac-aa58f02db245 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] 10.222.0.27 "GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.119996 Jun 20 12:04:44.648998 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 906/1805] 10.222.0.27 () {58 vars in 1274 bytes} [Mon Jun 20 12:04:44 2022] GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:04:44.720970 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a40aa605-0c2b-421f-a069-c55f642fb259 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:44.732677 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a40aa605-0c2b-421f-a069-c55f642fb259 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:44.736124 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a40aa605-0c2b-421f-a069-c55f642fb259 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:44.737674 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a40aa605-0c2b-421f-a069-c55f642fb259 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1486 microversion: 2.25 time: 0.311942 Jun 20 12:04:44.738517 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 900/1806] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:04:44 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1486 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:04:44.785844 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-311ada7d-dea8-4b90-aa48-8fa69633d921 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:44.786901 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-311ada7d-dea8-4b90-aa48-8fa69633d921 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:44.794808 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-311ada7d-dea8-4b90-aa48-8fa69633d921 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:44.795669 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-311ada7d-dea8-4b90-aa48-8fa69633d921 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:44.796657 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-311ada7d-dea8-4b90-aa48-8fa69633d921 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:44.797258 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-311ada7d-dea8-4b90-aa48-8fa69633d921 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:45.048877 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c1d34d93-0bd7-41ce-b1cd-210d33256b18 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:45.049987 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c1d34d93-0bd7-41ce-b1cd-210d33256b18 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: f7d2499c-a9c8-4c2e-8445-667070737f1f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:45.063609 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c1d34d93-0bd7-41ce-b1cd-210d33256b18 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:45.064267 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c1d34d93-0bd7-41ce-b1cd-210d33256b18 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:45.065971 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c1d34d93-0bd7-41ce-b1cd-210d33256b18 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:45.066825 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c1d34d93-0bd7-41ce-b1cd-210d33256b18 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:45.097733 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-311ada7d-dea8-4b90-aa48-8fa69633d921 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:45.113716 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-311ada7d-dea8-4b90-aa48-8fa69633d921 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1528 microversion: 2.1 time: 0.336608 Jun 20 12:04:45.115306 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 907/1807] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:44 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1528 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:45.145205 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5fb5e172-871d-481a-a14f-b759818872c7 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:45.146966 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5fb5e172-871d-481a-a14f-b759818872c7 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:45.157701 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5fb5e172-871d-481a-a14f-b759818872c7 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:45.158534 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5fb5e172-871d-481a-a14f-b759818872c7 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:45.164356 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5fb5e172-871d-481a-a14f-b759818872c7 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:45.165237 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5fb5e172-871d-481a-a14f-b759818872c7 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:45.283778 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c1d34d93-0bd7-41ce-b1cd-210d33256b18 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286e4b475bbc4d108ca00497ecd3e55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8c8766d4f143349b61f27d8f2566fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:45.293962 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c1d34d93-0bd7-41ce-b1cd-210d33256b18 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f" status: 200 len: 1318 microversion: 2.1 time: 0.251495 Jun 20 12:04:45.294591 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 901/1808] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:45 2022] GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:45.493249 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5fb5e172-871d-481a-a14f-b759818872c7 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:45.501982 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5fb5e172-871d-481a-a14f-b759818872c7 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a" status: 200 len: 1489 microversion: 2.1 time: 0.360735 Jun 20 12:04:45.502927 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 908/1809] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:45 2022] GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a => generated 1489 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:45.530888 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-369d8100-60b3-45e6-afdc-b7f93ce10ca5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:45.532378 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-369d8100-60b3-45e6-afdc-b7f93ce10ca5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:45.544651 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-369d8100-60b3-45e6-afdc-b7f93ce10ca5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:45.544988 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-369d8100-60b3-45e6-afdc-b7f93ce10ca5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:45.546148 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-369d8100-60b3-45e6-afdc-b7f93ce10ca5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:45.546765 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-369d8100-60b3-45e6-afdc-b7f93ce10ca5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:45.632059 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-369d8100-60b3-45e6-afdc-b7f93ce10ca5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "POST /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a/action" status: 202 len: 0 microversion: 2.1 time: 0.115995 Jun 20 12:04:45.633634 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 902/1810] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:04:45 2022] POST /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 12:04:45.650544 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dc9e8994-0780-443b-81e6-e7ca78e27fbe tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:45.652731 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dc9e8994-0780-443b-81e6-e7ca78e27fbe tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:45.682018 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc9e8994-0780-443b-81e6-e7ca78e27fbe tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:45.686853 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc9e8994-0780-443b-81e6-e7ca78e27fbe tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:45.688166 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc9e8994-0780-443b-81e6-e7ca78e27fbe tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:45.688913 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc9e8994-0780-443b-81e6-e7ca78e27fbe tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:45.765679 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-237c7cf4-c0ad-4a57-b162-bcec30a51e52 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:45.766985 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-237c7cf4-c0ad-4a57-b162-bcec30a51e52 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:45.778117 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-237c7cf4-c0ad-4a57-b162-bcec30a51e52 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:45.779270 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-237c7cf4-c0ad-4a57-b162-bcec30a51e52 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:45.780898 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-237c7cf4-c0ad-4a57-b162-bcec30a51e52 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:45.781914 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-237c7cf4-c0ad-4a57-b162-bcec30a51e52 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:46.010523 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-237c7cf4-c0ad-4a57-b162-bcec30a51e52 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:46.020496 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-237c7cf4-c0ad-4a57-b162-bcec30a51e52 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:46.025787 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-237c7cf4-c0ad-4a57-b162-bcec30a51e52 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:46.027569 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-237c7cf4-c0ad-4a57-b162-bcec30a51e52 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1486 microversion: 2.25 time: 0.270611 Jun 20 12:04:46.028369 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 903/1811] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:04:45 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1486 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:04:46.029797 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dc9e8994-0780-443b-81e6-e7ca78e27fbe tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:46.033762 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-561a5da9-5851-4064-bf2c-64157ad88c6a req-4311a2f7-81c5-4859-83d6-1409b7a216e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21b4c645-d527-4d43-a7fb-5c866fa59022", "tag": "b8bd2b04-702a-4d5a-97c4-9bb7561531a4"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:46.038769 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dc9e8994-0780-443b-81e6-e7ca78e27fbe tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a" status: 200 len: 1494 microversion: 2.1 time: 0.393024 Jun 20 12:04:46.040726 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 909/1812] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:45 2022] GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a => generated 1494 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:46.048797 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-561a5da9-5851-4064-bf2c-64157ad88c6a req-4311a2f7-81c5-4859-83d6-1409b7a216e2 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:46.050279 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-561a5da9-5851-4064-bf2c-64157ad88c6a req-4311a2f7-81c5-4859-83d6-1409b7a216e2 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:46.086465 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-561a5da9-5851-4064-bf2c-64157ad88c6a req-4311a2f7-81c5-4859-83d6-1409b7a216e2 service nova] Creating event network-changed:b8bd2b04-702a-4d5a-97c4-9bb7561531a4 for instance 21b4c645-d527-4d43-a7fb-5c866fa59022 on n-h1-master-1 Jun 20 12:04:46.094029 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-561a5da9-5851-4064-bf2c-64157ad88c6a req-4311a2f7-81c5-4859-83d6-1409b7a216e2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063009 Jun 20 12:04:46.094804 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 904/1813] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:46.134049 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a130aa2b-88ba-4d22-943d-12dd77eb666f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:46.135751 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a130aa2b-88ba-4d22-943d-12dd77eb666f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:46.147834 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a130aa2b-88ba-4d22-943d-12dd77eb666f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:46.148372 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a130aa2b-88ba-4d22-943d-12dd77eb666f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:46.149564 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a130aa2b-88ba-4d22-943d-12dd77eb666f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:46.150117 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a130aa2b-88ba-4d22-943d-12dd77eb666f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:46.316982 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-41176094-e686-422e-9871-44f0a83d3e37 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:46.319600 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-41176094-e686-422e-9871-44f0a83d3e37 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: f7d2499c-a9c8-4c2e-8445-667070737f1f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:46.334109 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-41176094-e686-422e-9871-44f0a83d3e37 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:46.334662 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-41176094-e686-422e-9871-44f0a83d3e37 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:46.335885 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-41176094-e686-422e-9871-44f0a83d3e37 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:46.336430 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-41176094-e686-422e-9871-44f0a83d3e37 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:46.563159 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-41176094-e686-422e-9871-44f0a83d3e37 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286e4b475bbc4d108ca00497ecd3e55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8c8766d4f143349b61f27d8f2566fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:46.577228 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-41176094-e686-422e-9871-44f0a83d3e37 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f" status: 200 len: 1318 microversion: 2.1 time: 0.269243 Jun 20 12:04:46.578155 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 905/1814] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:46 2022] GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:04:46.788972 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a130aa2b-88ba-4d22-943d-12dd77eb666f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:46.799212 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a130aa2b-88ba-4d22-943d-12dd77eb666f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1528 microversion: 2.1 time: 0.670482 Jun 20 12:04:46.801988 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 910/1815] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:46 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1528 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:46.805074 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d63e7992-9878-4009-8d80-84e3c8e16f52 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:46.805955 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d63e7992-9878-4009-8d80-84e3c8e16f52 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] [instance: c9290d77-4370-4fb5-a6ef-f1c1b6872b90] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:46.815002 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d63e7992-9878-4009-8d80-84e3c8e16f52 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:46.815684 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d63e7992-9878-4009-8d80-84e3c8e16f52 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:46.823238 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d63e7992-9878-4009-8d80-84e3c8e16f52 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:46.824088 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d63e7992-9878-4009-8d80-84e3c8e16f52 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:46.984107 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d63e7992-9878-4009-8d80-84e3c8e16f52 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b13de70dd3481684ec50bef063d049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f7335fd515401090c1d0a1e91d0107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:46.992801 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d63e7992-9878-4009-8d80-84e3c8e16f52 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] 10.222.0.27 "GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90" status: 200 len: 1591 microversion: 2.1 time: 0.191680 Jun 20 12:04:46.994004 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 906/1816] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:46 2022] GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90 => generated 1591 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:04:47.048744 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cbed0692-fbbf-4d16-a095-6249b8cf22e2 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:47.049664 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cbed0692-fbbf-4d16-a095-6249b8cf22e2 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:47.057349 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cbed0692-fbbf-4d16-a095-6249b8cf22e2 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:47.057595 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-98a25ef4-3ddb-4895-99a5-8367ecd0a12e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:47.057847 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cbed0692-fbbf-4d16-a095-6249b8cf22e2 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:47.058358 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-98a25ef4-3ddb-4895-99a5-8367ecd0a12e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:47.059302 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cbed0692-fbbf-4d16-a095-6249b8cf22e2 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:47.059847 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cbed0692-fbbf-4d16-a095-6249b8cf22e2 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:47.070208 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-98a25ef4-3ddb-4895-99a5-8367ecd0a12e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:47.078965 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-98a25ef4-3ddb-4895-99a5-8367ecd0a12e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:47.080076 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-98a25ef4-3ddb-4895-99a5-8367ecd0a12e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:47.080836 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-98a25ef4-3ddb-4895-99a5-8367ecd0a12e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:47.221641 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cbed0692-fbbf-4d16-a095-6249b8cf22e2 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:47.233531 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cbed0692-fbbf-4d16-a095-6249b8cf22e2 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:47.235037 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cbed0692-fbbf-4d16-a095-6249b8cf22e2 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:47.236233 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cbed0692-fbbf-4d16-a095-6249b8cf22e2 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1486 microversion: 2.25 time: 0.192525 Jun 20 12:04:47.240249 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 911/1817] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:04:47 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1486 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:04:47.288655 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-98a25ef4-3ddb-4895-99a5-8367ecd0a12e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:47.297017 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-98a25ef4-3ddb-4895-99a5-8367ecd0a12e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a" status: 200 len: 1474 microversion: 2.1 time: 0.243515 Jun 20 12:04:47.298398 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 907/1818] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:47 2022] GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a => generated 1474 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:04:47.315817 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d4830d3c-a500-46ec-9bf4-b686c14ee505 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-192235032"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:47.317198 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d4830d3c-a500-46ec-9bf4-b686c14ee505 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:47.324234 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d4830d3c-a500-46ec-9bf4-b686c14ee505 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:47.324964 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d4830d3c-a500-46ec-9bf4-b686c14ee505 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:47.325757 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d4830d3c-a500-46ec-9bf4-b686c14ee505 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:47.326202 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d4830d3c-a500-46ec-9bf4-b686c14ee505 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:47.594082 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0ba297b8-cbb6-4bb4-8371-2b84e6c9c06b tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:47.594965 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0ba297b8-cbb6-4bb4-8371-2b84e6c9c06b tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: f7d2499c-a9c8-4c2e-8445-667070737f1f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:47.603328 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0ba297b8-cbb6-4bb4-8371-2b84e6c9c06b tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:47.603897 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0ba297b8-cbb6-4bb4-8371-2b84e6c9c06b tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:47.604929 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0ba297b8-cbb6-4bb4-8371-2b84e6c9c06b tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:47.606578 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0ba297b8-cbb6-4bb4-8371-2b84e6c9c06b tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:47.644330 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d4830d3c-a500-46ec-9bf4-b686c14ee505 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "POST /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a/action" status: 202 len: 0 microversion: 2.1 time: 0.332087 Jun 20 12:04:47.645552 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 912/1819] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:04:47 2022] POST /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 20 12:04:47.666685 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6be66788-f24c-475a-b677-2bccba0e1301 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f6073a0f430>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:47.718071 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6be66788-f24c-475a-b677-2bccba0e1301 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/79ed6967-cc63-4288-a465-d14d880ced9f" status: 200 len: 1411 microversion: 2.1 time: 0.060390 Jun 20 12:04:47.719170 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 913/1820] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:04:47 2022] GET /compute/v2.1/images/79ed6967-cc63-4288-a465-d14d880ced9f => generated 1411 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:47.813954 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0ba297b8-cbb6-4bb4-8371-2b84e6c9c06b tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286e4b475bbc4d108ca00497ecd3e55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8c8766d4f143349b61f27d8f2566fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:47.819457 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c81973a5-79ab-4257-bea1-ec25f4407424 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:47.820278 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c81973a5-79ab-4257-bea1-ec25f4407424 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:47.822054 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0ba297b8-cbb6-4bb4-8371-2b84e6c9c06b tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f" status: 200 len: 1318 microversion: 2.1 time: 0.231602 Jun 20 12:04:47.822261 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 908/1821] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:47 2022] GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:47.828446 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c81973a5-79ab-4257-bea1-ec25f4407424 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:47.828896 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c81973a5-79ab-4257-bea1-ec25f4407424 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:47.829909 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c81973a5-79ab-4257-bea1-ec25f4407424 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:47.830349 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c81973a5-79ab-4257-bea1-ec25f4407424 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:48.005282 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c81973a5-79ab-4257-bea1-ec25f4407424 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:48.014978 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c81973a5-79ab-4257-bea1-ec25f4407424 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1528 microversion: 2.1 time: 0.199619 Jun 20 12:04:48.015660 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 914/1822] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:47 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1528 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:04:48.145315 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-e266ad1f-c1e6-4d08-87f9-f47e78d823c4 req-64f232ca-952e-456c-9f96-59ee871ccd0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9290d77-4370-4fb5-a6ef-f1c1b6872b90", "tag": "df0d5349-d128-45d1-bb70-d0936101a5ee"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:48.155420 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e266ad1f-c1e6-4d08-87f9-f47e78d823c4 req-64f232ca-952e-456c-9f96-59ee871ccd0d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:48.155854 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e266ad1f-c1e6-4d08-87f9-f47e78d823c4 req-64f232ca-952e-456c-9f96-59ee871ccd0d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:48.169182 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-e266ad1f-c1e6-4d08-87f9-f47e78d823c4 req-64f232ca-952e-456c-9f96-59ee871ccd0d service nova] Creating event network-changed:df0d5349-d128-45d1-bb70-d0936101a5ee for instance c9290d77-4370-4fb5-a6ef-f1c1b6872b90 on n-h2-master-1 Jun 20 12:04:48.175551 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-e266ad1f-c1e6-4d08-87f9-f47e78d823c4 req-64f232ca-952e-456c-9f96-59ee871ccd0d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033071 Jun 20 12:04:48.176257 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 909/1823] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:48.255905 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-20299950-3eda-453c-9341-68bde816ca02 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:48.256766 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-20299950-3eda-453c-9341-68bde816ca02 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:48.263856 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-20299950-3eda-453c-9341-68bde816ca02 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:48.264336 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-20299950-3eda-453c-9341-68bde816ca02 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:48.265224 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-20299950-3eda-453c-9341-68bde816ca02 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:48.265658 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-20299950-3eda-453c-9341-68bde816ca02 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:48.443624 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-20299950-3eda-453c-9341-68bde816ca02 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:48.452952 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-20299950-3eda-453c-9341-68bde816ca02 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:48.454564 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-20299950-3eda-453c-9341-68bde816ca02 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:48.455733 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-20299950-3eda-453c-9341-68bde816ca02 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1486 microversion: 2.25 time: 0.204594 Jun 20 12:04:48.456370 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 915/1824] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:04:48 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1486 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:04:48.733569 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-84105fff-0b9e-4df8-a243-20512b84a816 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f607365cd30>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:48.798593 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-84105fff-0b9e-4df8-a243-20512b84a816 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/79ed6967-cc63-4288-a465-d14d880ced9f" status: 200 len: 1411 microversion: 2.1 time: 0.069705 Jun 20 12:04:48.799186 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 910/1825] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:04:48 2022] GET /compute/v2.1/images/79ed6967-cc63-4288-a465-d14d880ced9f => generated 1411 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:48.838737 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-34146c35-ae63-440d-a5fc-a273b177132f tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:48.840449 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-34146c35-ae63-440d-a5fc-a273b177132f tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: f7d2499c-a9c8-4c2e-8445-667070737f1f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:48.847540 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-34146c35-ae63-440d-a5fc-a273b177132f tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:48.848194 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-34146c35-ae63-440d-a5fc-a273b177132f tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:48.849186 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-34146c35-ae63-440d-a5fc-a273b177132f tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:48.849791 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-34146c35-ae63-440d-a5fc-a273b177132f tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:49.033799 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-402df5c2-ad18-4d91-8500-355d83625202 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:49.034835 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-402df5c2-ad18-4d91-8500-355d83625202 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:49.041677 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-402df5c2-ad18-4d91-8500-355d83625202 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:49.042709 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-402df5c2-ad18-4d91-8500-355d83625202 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:49.043864 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-402df5c2-ad18-4d91-8500-355d83625202 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:49.044550 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-402df5c2-ad18-4d91-8500-355d83625202 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:49.135879 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-34146c35-ae63-440d-a5fc-a273b177132f tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286e4b475bbc4d108ca00497ecd3e55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8c8766d4f143349b61f27d8f2566fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:49.149187 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-34146c35-ae63-440d-a5fc-a273b177132f tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f" status: 200 len: 1318 microversion: 2.1 time: 0.314080 Jun 20 12:04:49.149799 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 916/1826] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:48 2022] GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f => generated 1318 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:49.192783 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-0eca7f69-b2f8-469b-9890-05f5f82828da req-e7f38874-704a-4c07-b763-42855d368b7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7d2499c-a9c8-4c2e-8445-667070737f1f", "name": "network-vif-plugged", "status": "completed", "tag": "4b377c25-4bc9-46b4-9743-511faa7773d1"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:49.202697 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-0eca7f69-b2f8-469b-9890-05f5f82828da req-e7f38874-704a-4c07-b763-42855d368b7f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:49.203409 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-0eca7f69-b2f8-469b-9890-05f5f82828da req-e7f38874-704a-4c07-b763-42855d368b7f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:49.222957 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-0eca7f69-b2f8-469b-9890-05f5f82828da req-e7f38874-704a-4c07-b763-42855d368b7f service nova] Creating event network-vif-plugged:4b377c25-4bc9-46b4-9743-511faa7773d1 for instance f7d2499c-a9c8-4c2e-8445-667070737f1f on n-h2-master-1 Jun 20 12:04:49.229202 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-0eca7f69-b2f8-469b-9890-05f5f82828da req-e7f38874-704a-4c07-b763-42855d368b7f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039882 Jun 20 12:04:49.231103 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 917/1827] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:04:49.393784 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-402df5c2-ad18-4d91-8500-355d83625202 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:49.412067 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-402df5c2-ad18-4d91-8500-355d83625202 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1528 microversion: 2.1 time: 0.383188 Jun 20 12:04:49.415007 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 911/1828] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:49 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1528 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:49.476141 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bc27441a-d43b-48f1-a7bd-b93864941cf8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:49.477619 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bc27441a-d43b-48f1-a7bd-b93864941cf8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:49.497540 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc27441a-d43b-48f1-a7bd-b93864941cf8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:49.498429 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc27441a-d43b-48f1-a7bd-b93864941cf8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:49.499843 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc27441a-d43b-48f1-a7bd-b93864941cf8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:49.500909 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc27441a-d43b-48f1-a7bd-b93864941cf8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:49.513972 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:49.788409 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bc27441a-d43b-48f1-a7bd-b93864941cf8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:49.797710 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bc27441a-d43b-48f1-a7bd-b93864941cf8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:49.800290 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bc27441a-d43b-48f1-a7bd-b93864941cf8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:49.802253 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bc27441a-d43b-48f1-a7bd-b93864941cf8 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1486 microversion: 2.25 time: 0.330866 Jun 20 12:04:49.813549 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 918/1829] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:04:49 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1486 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:04:49.813786 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-02064a66-7481-4ad8-ad96-4e6c378670a1 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f607361ec10>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:49.869557 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-02064a66-7481-4ad8-ad96-4e6c378670a1 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/79ed6967-cc63-4288-a465-d14d880ced9f" status: 200 len: 1411 microversion: 2.1 time: 0.061844 Jun 20 12:04:49.876174 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 912/1830] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:04:49 2022] GET /compute/v2.1/images/79ed6967-cc63-4288-a465-d14d880ced9f => generated 1411 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:04:50.172004 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8f853564-34e4-4914-9faf-aba0d0aa1da9 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:50.173432 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8f853564-34e4-4914-9faf-aba0d0aa1da9 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: f7d2499c-a9c8-4c2e-8445-667070737f1f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:50.186545 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8f853564-34e4-4914-9faf-aba0d0aa1da9 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:50.188350 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8f853564-34e4-4914-9faf-aba0d0aa1da9 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:50.190991 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8f853564-34e4-4914-9faf-aba0d0aa1da9 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:50.191466 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8f853564-34e4-4914-9faf-aba0d0aa1da9 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:50.436499 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8b88b2c7-f09e-49d0-995b-b26e4fe0a879 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:50.437228 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8b88b2c7-f09e-49d0-995b-b26e4fe0a879 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:50.472178 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8b88b2c7-f09e-49d0-995b-b26e4fe0a879 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:50.473499 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8b88b2c7-f09e-49d0-995b-b26e4fe0a879 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:50.480432 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8b88b2c7-f09e-49d0-995b-b26e4fe0a879 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:50.481222 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8b88b2c7-f09e-49d0-995b-b26e4fe0a879 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:50.509396 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8f853564-34e4-4914-9faf-aba0d0aa1da9 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286e4b475bbc4d108ca00497ecd3e55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8c8766d4f143349b61f27d8f2566fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:50.519405 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8f853564-34e4-4914-9faf-aba0d0aa1da9 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f" status: 200 len: 1318 microversion: 2.1 time: 0.356060 Jun 20 12:04:50.524684 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 919/1831] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:50 2022] GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f => generated 1318 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:50.723218 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8b88b2c7-f09e-49d0-995b-b26e4fe0a879 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:50.733916 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8b88b2c7-f09e-49d0-995b-b26e4fe0a879 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1523 microversion: 2.1 time: 0.306514 Jun 20 12:04:50.735048 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 913/1832] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:50 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1523 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:04:50.828552 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-83274740-4743-4f23-8735-a8df9a66b0e6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:50.831944 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-83274740-4743-4f23-8735-a8df9a66b0e6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:50.850799 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-83274740-4743-4f23-8735-a8df9a66b0e6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:50.851255 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-83274740-4743-4f23-8735-a8df9a66b0e6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:50.852121 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-83274740-4743-4f23-8735-a8df9a66b0e6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:50.852584 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-83274740-4743-4f23-8735-a8df9a66b0e6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:50.885007 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-728ad253-aa92-43b9-b5d4-1e4e87b3f5b0 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f6073523790>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:50.941146 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-728ad253-aa92-43b9-b5d4-1e4e87b3f5b0 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/79ed6967-cc63-4288-a465-d14d880ced9f" status: 200 len: 1411 microversion: 2.1 time: 0.061545 Jun 20 12:04:50.942397 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 914/1833] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:04:50 2022] GET /compute/v2.1/images/79ed6967-cc63-4288-a465-d14d880ced9f => generated 1411 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:04:51.071712 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-83274740-4743-4f23-8735-a8df9a66b0e6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:51.082148 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-83274740-4743-4f23-8735-a8df9a66b0e6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:51.086663 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-83274740-4743-4f23-8735-a8df9a66b0e6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:51.088122 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-83274740-4743-4f23-8735-a8df9a66b0e6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1486 microversion: 2.25 time: 0.270371 Jun 20 12:04:51.089235 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 920/1834] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:04:50 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1486 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:04:51.265480 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-e1ad496c-3ffe-494b-9dd0-53faef3819db req-81a6ea07-9de6-4b3c-8d00-4ed58f2aba0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b52985a9-6859-4d8b-b248-d4d2289f7da1", "name": "network-vif-plugged", "status": "completed", "tag": "cb6f9a61-ee67-4712-b7c2-c06766244aa9"}, {"server_uuid": "21b4c645-d527-4d43-a7fb-5c866fa59022", "name": "network-vif-unplugged", "status": "completed", "tag": "b8bd2b04-702a-4d5a-97c4-9bb7561531a4"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:51.302948 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:51.312135 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e1ad496c-3ffe-494b-9dd0-53faef3819db req-81a6ea07-9de6-4b3c-8d00-4ed58f2aba0b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:51.312783 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e1ad496c-3ffe-494b-9dd0-53faef3819db req-81a6ea07-9de6-4b3c-8d00-4ed58f2aba0b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:51.336634 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-e1ad496c-3ffe-494b-9dd0-53faef3819db req-81a6ea07-9de6-4b3c-8d00-4ed58f2aba0b service nova] Creating event network-vif-plugged:cb6f9a61-ee67-4712-b7c2-c06766244aa9 for instance b52985a9-6859-4d8b-b248-d4d2289f7da1 on n-h2-master-1 Jun 20 12:04:51.337433 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-e1ad496c-3ffe-494b-9dd0-53faef3819db req-81a6ea07-9de6-4b3c-8d00-4ed58f2aba0b service nova] Creating event network-vif-unplugged:b8bd2b04-702a-4d5a-97c4-9bb7561531a4 for instance 21b4c645-d527-4d43-a7fb-5c866fa59022 on n-h1-master-1 Jun 20 12:04:51.347837 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-e1ad496c-3ffe-494b-9dd0-53faef3819db req-81a6ea07-9de6-4b3c-8d00-4ed58f2aba0b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.091975 Jun 20 12:04:51.349014 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 915/1835] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:04:51.539886 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1fc3793c-a648-46e0-ade3-a15c4106306d tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:51.540550 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1fc3793c-a648-46e0-ade3-a15c4106306d tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: f7d2499c-a9c8-4c2e-8445-667070737f1f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:51.552502 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1fc3793c-a648-46e0-ade3-a15c4106306d tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:51.552952 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1fc3793c-a648-46e0-ade3-a15c4106306d tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:51.554958 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1fc3793c-a648-46e0-ade3-a15c4106306d tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:51.559100 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1fc3793c-a648-46e0-ade3-a15c4106306d tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:51.755743 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b26937b8-070d-4806-bac2-e983eb5ae21a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:51.760467 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b26937b8-070d-4806-bac2-e983eb5ae21a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:51.785615 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b26937b8-070d-4806-bac2-e983eb5ae21a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:51.786078 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b26937b8-070d-4806-bac2-e983eb5ae21a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:51.787541 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b26937b8-070d-4806-bac2-e983eb5ae21a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:51.787985 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b26937b8-070d-4806-bac2-e983eb5ae21a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:52.019508 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1fc3793c-a648-46e0-ade3-a15c4106306d tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286e4b475bbc4d108ca00497ecd3e55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8c8766d4f143349b61f27d8f2566fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:52.032823 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1fc3793c-a648-46e0-ade3-a15c4106306d tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f" status: 200 len: 1318 microversion: 2.1 time: 0.498443 Jun 20 12:04:52.033599 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 921/1836] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:51 2022] GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f => generated 1318 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:52.050744 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-386b3d40-bbd5-49ad-ac03-546229b7333f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f607370e430>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:52.216423 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b26937b8-070d-4806-bac2-e983eb5ae21a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:52.227403 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b26937b8-070d-4806-bac2-e983eb5ae21a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1523 microversion: 2.1 time: 0.476738 Jun 20 12:04:52.239350 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 916/1837] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:51 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1523 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:04:52.245900 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e0811777-f03b-4f10-8ff6-83fc6368c780 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:52.246536 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e0811777-f03b-4f10-8ff6-83fc6368c780 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:52.256316 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e0811777-f03b-4f10-8ff6-83fc6368c780 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:52.256782 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e0811777-f03b-4f10-8ff6-83fc6368c780 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:52.257679 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e0811777-f03b-4f10-8ff6-83fc6368c780 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:52.258123 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e0811777-f03b-4f10-8ff6-83fc6368c780 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:52.264430 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:52.368467 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-386b3d40-bbd5-49ad-ac03-546229b7333f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/79ed6967-cc63-4288-a465-d14d880ced9f" status: 200 len: 1411 microversion: 2.1 time: 0.333594 Jun 20 12:04:52.369353 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 922/1838] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:04:52 2022] GET /compute/v2.1/images/79ed6967-cc63-4288-a465-d14d880ced9f => generated 1411 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:52.532653 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e0811777-f03b-4f10-8ff6-83fc6368c780 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:52.547074 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e0811777-f03b-4f10-8ff6-83fc6368c780 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:52.616365 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e0811777-f03b-4f10-8ff6-83fc6368c780 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:52.616365 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e0811777-f03b-4f10-8ff6-83fc6368c780 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1486 microversion: 2.25 time: 0.363890 Jun 20 12:04:52.616365 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 917/1839] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:04:52 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1486 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:04:53.050779 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9694f7b0-75b3-4436-9ee6-55e2490be29d tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:53.051484 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9694f7b0-75b3-4436-9ee6-55e2490be29d tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: f7d2499c-a9c8-4c2e-8445-667070737f1f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:53.066441 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9694f7b0-75b3-4436-9ee6-55e2490be29d tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:53.066842 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9694f7b0-75b3-4436-9ee6-55e2490be29d tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:53.069630 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9694f7b0-75b3-4436-9ee6-55e2490be29d tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:53.071627 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9694f7b0-75b3-4436-9ee6-55e2490be29d tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:53.246837 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5fb69f2a-2bfd-486f-871f-34f6493f629b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:53.248016 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5fb69f2a-2bfd-486f-871f-34f6493f629b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:53.258531 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5fb69f2a-2bfd-486f-871f-34f6493f629b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:53.258980 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5fb69f2a-2bfd-486f-871f-34f6493f629b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:53.259769 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5fb69f2a-2bfd-486f-871f-34f6493f629b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:53.260229 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5fb69f2a-2bfd-486f-871f-34f6493f629b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:53.402940 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9694f7b0-75b3-4436-9ee6-55e2490be29d tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286e4b475bbc4d108ca00497ecd3e55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8c8766d4f143349b61f27d8f2566fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:53.416183 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9694f7b0-75b3-4436-9ee6-55e2490be29d tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f" status: 200 len: 1468 microversion: 2.1 time: 0.370558 Jun 20 12:04:53.418305 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 923/1840] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:53 2022] GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f => generated 1468 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:53.437158 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4d1a1fe0-a836-477a-a32c-a2b5aaa03c4f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f60801b0ee0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:53.536363 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4d1a1fe0-a836-477a-a32c-a2b5aaa03c4f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/79ed6967-cc63-4288-a465-d14d880ced9f" status: 200 len: 1411 microversion: 2.1 time: 0.115625 Jun 20 12:04:53.536983 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 924/1841] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:04:53 2022] GET /compute/v2.1/images/79ed6967-cc63-4288-a465-d14d880ced9f => generated 1411 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:53.555405 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-77959ca9-5dce-4396-85e1-5cb0c845f968 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:53.559851 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5fb69f2a-2bfd-486f-871f-34f6493f629b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:53.560715 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-77959ca9-5dce-4396-85e1-5cb0c845f968 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: 838db96b-0c7a-4d7f-9807-44194bc73cff] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:53.585527 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5fb69f2a-2bfd-486f-871f-34f6493f629b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1523 microversion: 2.1 time: 0.341366 Jun 20 12:04:53.587009 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-77959ca9-5dce-4396-85e1-5cb0c845f968 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:53.587708 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-77959ca9-5dce-4396-85e1-5cb0c845f968 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:53.588680 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-77959ca9-5dce-4396-85e1-5cb0c845f968 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:53.589220 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 918/1842] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:53 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1523 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:53.589387 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-77959ca9-5dce-4396-85e1-5cb0c845f968 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:53.624378 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-171f415b-9858-4177-b147-27ea7c08c38c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:53.625221 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-171f415b-9858-4177-b147-27ea7c08c38c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:53.638596 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-171f415b-9858-4177-b147-27ea7c08c38c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:53.639596 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-171f415b-9858-4177-b147-27ea7c08c38c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:53.640728 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-171f415b-9858-4177-b147-27ea7c08c38c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:53.643644 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-171f415b-9858-4177-b147-27ea7c08c38c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:53.901166 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-77959ca9-5dce-4396-85e1-5cb0c845f968 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286e4b475bbc4d108ca00497ecd3e55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8c8766d4f143349b61f27d8f2566fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:53.911971 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-77959ca9-5dce-4396-85e1-5cb0c845f968 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/servers/838db96b-0c7a-4d7f-9807-44194bc73cff" status: 200 len: 1468 microversion: 2.1 time: 0.373118 Jun 20 12:04:53.913387 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 925/1843] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:53 2022] GET /compute/v2.1/servers/838db96b-0c7a-4d7f-9807-44194bc73cff => generated 1468 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:53.920055 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-171f415b-9858-4177-b147-27ea7c08c38c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:53.943646 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-171f415b-9858-4177-b147-27ea7c08c38c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:53.946225 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-171f415b-9858-4177-b147-27ea7c08c38c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:53.946574 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-75e3b0b1-b43d-4253-a909-52051f8000b1 req-d491cd26-c4f8-407a-bfde-ac0e6084f203 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b9e1026-a6f6-47f2-8734-4b05eeff8b9a", "name": "network-vif-plugged", "status": "completed", "tag": "d4607934-f3b3-445b-8374-03fb586d6121"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:53.947981 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-171f415b-9858-4177-b147-27ea7c08c38c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1486 microversion: 2.25 time: 0.328555 Jun 20 12:04:53.958778 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-75e3b0b1-b43d-4253-a909-52051f8000b1 req-d491cd26-c4f8-407a-bfde-ac0e6084f203 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:53.959605 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-75e3b0b1-b43d-4253-a909-52051f8000b1 req-d491cd26-c4f8-407a-bfde-ac0e6084f203 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:53.960671 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 919/1844] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:04:53 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1486 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:04:53.968455 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-262dc285-9ae3-443a-8c83-fbc338d482e2 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1884292742"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:04:53.969829 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-262dc285-9ae3-443a-8c83-fbc338d482e2 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: 838db96b-0c7a-4d7f-9807-44194bc73cff] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:53.978475 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-262dc285-9ae3-443a-8c83-fbc338d482e2 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:53.979342 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-262dc285-9ae3-443a-8c83-fbc338d482e2 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:53.982753 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-262dc285-9ae3-443a-8c83-fbc338d482e2 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:53.983517 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-262dc285-9ae3-443a-8c83-fbc338d482e2 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:54.006787 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-75e3b0b1-b43d-4253-a909-52051f8000b1 req-d491cd26-c4f8-407a-bfde-ac0e6084f203 service nova] Creating event network-vif-plugged:d4607934-f3b3-445b-8374-03fb586d6121 for instance 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a on n-h2-master-1 Jun 20 12:04:54.018033 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-75e3b0b1-b43d-4253-a909-52051f8000b1 req-d491cd26-c4f8-407a-bfde-ac0e6084f203 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102559 Jun 20 12:04:54.019091 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 926/1845] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:04:54.425407 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-262dc285-9ae3-443a-8c83-fbc338d482e2 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "POST /compute/v2.1/servers/838db96b-0c7a-4d7f-9807-44194bc73cff/action" status: 202 len: 0 microversion: 2.1 time: 0.461695 Jun 20 12:04:54.427663 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 920/1846] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:04:53 2022] POST /compute/v2.1/servers/838db96b-0c7a-4d7f-9807-44194bc73cff/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 20 12:04:54.460764 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-14f7cd12-5992-4378-90c4-b96a8d2808e9 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073a8e3a0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:54.541997 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-14f7cd12-5992-4378-90c4-b96a8d2808e9 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/320c8800-5d83-4fef-b8fc-e287df641bad" status: 200 len: 1455 microversion: 2.1 time: 0.104214 Jun 20 12:04:54.555752 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e6af9708-e382-4560-9b37-13544c1e06a6 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f6073671670>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:54.561282 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 927/1847] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:04:54 2022] GET /compute/v2.1/images/320c8800-5d83-4fef-b8fc-e287df641bad => generated 1455 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:54.610494 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7df67d1b-04bc-418c-899b-10fe5f582336 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:54.611610 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7df67d1b-04bc-418c-899b-10fe5f582336 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:54.619609 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7df67d1b-04bc-418c-899b-10fe5f582336 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:54.621465 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7df67d1b-04bc-418c-899b-10fe5f582336 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:54.624539 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7df67d1b-04bc-418c-899b-10fe5f582336 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:54.626127 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7df67d1b-04bc-418c-899b-10fe5f582336 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:54.630801 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e6af9708-e382-4560-9b37-13544c1e06a6 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/79ed6967-cc63-4288-a465-d14d880ced9f" status: 200 len: 1411 microversion: 2.1 time: 0.079736 Jun 20 12:04:54.632031 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 921/1848] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:04:54 2022] GET /compute/v2.1/images/79ed6967-cc63-4288-a465-d14d880ced9f => generated 1411 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:54.803548 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7df67d1b-04bc-418c-899b-10fe5f582336 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:54.823552 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7df67d1b-04bc-418c-899b-10fe5f582336 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1523 microversion: 2.1 time: 0.217297 Jun 20 12:04:54.828502 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 928/1849] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:54 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:54.968233 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d0c8ea2c-1b3c-4511-86c1-025844a43514 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:54.969266 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d0c8ea2c-1b3c-4511-86c1-025844a43514 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:54.981674 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d0c8ea2c-1b3c-4511-86c1-025844a43514 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:54.982133 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d0c8ea2c-1b3c-4511-86c1-025844a43514 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:54.983003 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d0c8ea2c-1b3c-4511-86c1-025844a43514 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:54.983449 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d0c8ea2c-1b3c-4511-86c1-025844a43514 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:55.575258 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d61cc257-6e75-47eb-b684-77f0435026e5 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f60737609d0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:55.641455 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d61cc257-6e75-47eb-b684-77f0435026e5 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/320c8800-5d83-4fef-b8fc-e287df641bad" status: 200 len: 1455 microversion: 2.1 time: 0.071569 Jun 20 12:04:55.647740 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 929/1850] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:04:55 2022] GET /compute/v2.1/images/320c8800-5d83-4fef-b8fc-e287df641bad => generated 1455 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:55.653487 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3c179868-4bab-40f8-a980-9052ec1913d6 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f6073ebe430>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:55.723084 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d0c8ea2c-1b3c-4511-86c1-025844a43514 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:55.726258 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3c179868-4bab-40f8-a980-9052ec1913d6 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/79ed6967-cc63-4288-a465-d14d880ced9f" status: 200 len: 1411 microversion: 2.1 time: 0.077050 Jun 20 12:04:55.733605 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 930/1851] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:04:55 2022] GET /compute/v2.1/images/79ed6967-cc63-4288-a465-d14d880ced9f => generated 1411 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:55.737279 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d0c8ea2c-1b3c-4511-86c1-025844a43514 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:55.739207 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d0c8ea2c-1b3c-4511-86c1-025844a43514 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:55.740712 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d0c8ea2c-1b3c-4511-86c1-025844a43514 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1476 microversion: 2.25 time: 0.777456 Jun 20 12:04:55.755767 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 922/1852] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:04:54 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1476 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:04:55.761512 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-433b7e96-8418-4f1a-9a4c-d0acae655a4d tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Calling method '.version_select at 0x7f6073b17790>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:55.765145 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-433b7e96-8418-4f1a-9a4c-d0acae655a4d tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:55.766101 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-433b7e96-8418-4f1a-9a4c-d0acae655a4d tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:55.777936 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-433b7e96-8418-4f1a-9a4c-d0acae655a4d tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 2536 microversion: 2.25 time: 0.021988 Jun 20 12:04:55.780257 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 931/1853] 10.222.0.27 () {60 vars in 1183 bytes} [Mon Jun 20 12:04:55 2022] GET /compute/v2.1/os-migrations => generated 2536 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:04:55.790944 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1013af96-043f-42a4-a678-ac2eee6285d6 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:55.791855 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1013af96-043f-42a4-a678-ac2eee6285d6 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:55.800490 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1013af96-043f-42a4-a678-ac2eee6285d6 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:55.801359 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1013af96-043f-42a4-a678-ac2eee6285d6 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:55.802658 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1013af96-043f-42a4-a678-ac2eee6285d6 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:55.803479 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1013af96-043f-42a4-a678-ac2eee6285d6 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:55.845094 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6fdbe4ed-b5e6-4402-8ef4-4f2dadf8d9a3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:55.846089 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6fdbe4ed-b5e6-4402-8ef4-4f2dadf8d9a3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:55.862267 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6fdbe4ed-b5e6-4402-8ef4-4f2dadf8d9a3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:55.862932 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6fdbe4ed-b5e6-4402-8ef4-4f2dadf8d9a3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:55.865223 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6fdbe4ed-b5e6-4402-8ef4-4f2dadf8d9a3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:55.865946 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6fdbe4ed-b5e6-4402-8ef4-4f2dadf8d9a3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:56.073402 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6fdbe4ed-b5e6-4402-8ef4-4f2dadf8d9a3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:56.087940 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6fdbe4ed-b5e6-4402-8ef4-4f2dadf8d9a3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1523 microversion: 2.1 time: 0.247286 Jun 20 12:04:56.099284 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-1013af96-043f-42a4-a678-ac2eee6285d6 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] Lazy-loading 'services' on Instance uuid 21b4c645-d527-4d43-a7fb-5c866fa59022 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:04:56.104129 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 932/1854] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:55 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1523 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:56.127537 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1013af96-043f-42a4-a678-ac2eee6285d6 tempest-LiveAutoBlockMigrationV225Test-1870946608 tempest-LiveAutoBlockMigrationV225Test-1870946608-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1968 microversion: 2.25 time: 0.338965 Jun 20 12:04:56.128784 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 923/1855] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:04:55 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1968 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:04:56.159808 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5d5aa642-0c52-4c5e-b362-7663d7938487 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:56.160399 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5d5aa642-0c52-4c5e-b362-7663d7938487 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:56.168445 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5d5aa642-0c52-4c5e-b362-7663d7938487 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:56.168956 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5d5aa642-0c52-4c5e-b362-7663d7938487 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:56.169870 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5d5aa642-0c52-4c5e-b362-7663d7938487 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:56.170270 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5d5aa642-0c52-4c5e-b362-7663d7938487 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:56.201482 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5d5aa642-0c52-4c5e-b362-7663d7938487 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:04:56.346871 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5d5aa642-0c52-4c5e-b362-7663d7938487 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "DELETE /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 204 len: 0 microversion: 2.25 time: 0.191597 Jun 20 12:04:56.347886 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 933/1856] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Jun 20 12:04:56 2022] DELETE /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 12:04:56.357164 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5202134a-aa98-40d6-b448-b16f926561dd tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:56.365652 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5202134a-aa98-40d6-b448-b16f926561dd tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:56.394295 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5202134a-aa98-40d6-b448-b16f926561dd tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:56.402648 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5202134a-aa98-40d6-b448-b16f926561dd tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:56.403887 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5202134a-aa98-40d6-b448-b16f926561dd tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:56.404558 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5202134a-aa98-40d6-b448-b16f926561dd tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:56.615714 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5202134a-aa98-40d6-b448-b16f926561dd tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:56.627059 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5202134a-aa98-40d6-b448-b16f926561dd tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:56.629636 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5202134a-aa98-40d6-b448-b16f926561dd tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:56.631378 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5202134a-aa98-40d6-b448-b16f926561dd tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1482 microversion: 2.25 time: 0.279367 Jun 20 12:04:56.632273 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 924/1857] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:04:56 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1482 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:04:56.656335 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1c67b50a-aa04-4eef-aa81-ad30e905aa55 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f608299e0d0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:56.740394 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f6ba505f-7167-479c-9fa4-40840ba32d4c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f60737485e0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:56.878106 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1c67b50a-aa04-4eef-aa81-ad30e905aa55 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/320c8800-5d83-4fef-b8fc-e287df641bad" status: 200 len: 1455 microversion: 2.1 time: 0.226785 Jun 20 12:04:56.878767 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 934/1858] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:04:56 2022] GET /compute/v2.1/images/320c8800-5d83-4fef-b8fc-e287df641bad => generated 1455 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:56.936814 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f6ba505f-7167-479c-9fa4-40840ba32d4c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/79ed6967-cc63-4288-a465-d14d880ced9f" status: 200 len: 1411 microversion: 2.1 time: 0.199745 Jun 20 12:04:56.947117 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 925/1859] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:04:56 2022] GET /compute/v2.1/images/79ed6967-cc63-4288-a465-d14d880ced9f => generated 1411 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:57.108377 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dce3b5bb-2743-4bee-a6fc-0a1e16025aa7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:57.110007 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dce3b5bb-2743-4bee-a6fc-0a1e16025aa7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:57.120853 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dce3b5bb-2743-4bee-a6fc-0a1e16025aa7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:57.121625 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dce3b5bb-2743-4bee-a6fc-0a1e16025aa7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:57.122669 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dce3b5bb-2743-4bee-a6fc-0a1e16025aa7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:57.123322 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dce3b5bb-2743-4bee-a6fc-0a1e16025aa7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:57.289034 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dce3b5bb-2743-4bee-a6fc-0a1e16025aa7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:57.298676 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dce3b5bb-2743-4bee-a6fc-0a1e16025aa7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1523 microversion: 2.1 time: 0.193798 Jun 20 12:04:57.310343 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 935/1860] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:04:57 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1523 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:57.661425 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-89bb1180-611a-49cd-b642-4189d0d3bdea tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:57.662356 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-89bb1180-611a-49cd-b642-4189d0d3bdea tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:04:57.677056 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-89bb1180-611a-49cd-b642-4189d0d3bdea tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:57.677851 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-89bb1180-611a-49cd-b642-4189d0d3bdea tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:57.679120 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-89bb1180-611a-49cd-b642-4189d0d3bdea tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:04:57.679812 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-89bb1180-611a-49cd-b642-4189d0d3bdea tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:04:57.893116 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-47effae7-a4bb-4ac9-a2f1-41983a981203 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073ec74c0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:04:57.896727 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-89bb1180-611a-49cd-b642-4189d0d3bdea tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:57.914294 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-89bb1180-611a-49cd-b642-4189d0d3bdea tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:57.920347 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-89bb1180-611a-49cd-b642-4189d0d3bdea tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:04:57.926936 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-89bb1180-611a-49cd-b642-4189d0d3bdea tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1482 microversion: 2.25 time: 0.275411 Jun 20 12:04:57.928692 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 926/1861] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:04:57 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1482 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:04:57.952575 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-df0f5839-5e79-4822-b972-2480182d27c6 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f6073748af0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:04.540115 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-df0f5839-5e79-4822-b972-2480182d27c6 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/79ed6967-cc63-4288-a465-d14d880ced9f" status: 200 len: 1411 microversion: 2.1 time: 6.591018 Jun 20 12:05:04.547038 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-47effae7-a4bb-4ac9-a2f1-41983a981203 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/320c8800-5d83-4fef-b8fc-e287df641bad" status: 200 len: 1455 microversion: 2.1 time: 6.654915 Jun 20 12:05:04.550442 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 927/1862] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:04:57 2022] GET /compute/v2.1/images/79ed6967-cc63-4288-a465-d14d880ced9f => generated 1411 bytes in 6604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:04.551197 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 936/1863] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:04:57 2022] GET /compute/v2.1/images/320c8800-5d83-4fef-b8fc-e287df641bad => generated 1455 bytes in 6663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:05:04.558480 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-af586f9d-2e00-46b8-90ee-9396cad93787 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:04.559151 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-af586f9d-2e00-46b8-90ee-9396cad93787 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:04.562429 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-1a9bc4ce-c02a-48a5-a65a-5ce4e6107a79 req-76cc85ca-06eb-42ba-a5db-140446150eac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21b4c645-d527-4d43-a7fb-5c866fa59022", "name": "network-vif-deleted", "tag": "b8bd2b04-702a-4d5a-97c4-9bb7561531a4"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:05:04.575743 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-1a9bc4ce-c02a-48a5-a65a-5ce4e6107a79 req-76cc85ca-06eb-42ba-a5db-140446150eac service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:04.576958 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-1a9bc4ce-c02a-48a5-a65a-5ce4e6107a79 req-76cc85ca-06eb-42ba-a5db-140446150eac service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:04.590726 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-af586f9d-2e00-46b8-90ee-9396cad93787 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:04.591188 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-af586f9d-2e00-46b8-90ee-9396cad93787 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:04.591988 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-af586f9d-2e00-46b8-90ee-9396cad93787 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:04.592350 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-1a9bc4ce-c02a-48a5-a65a-5ce4e6107a79 req-76cc85ca-06eb-42ba-a5db-140446150eac service nova] Creating event network-vif-deleted:b8bd2b04-702a-4d5a-97c4-9bb7561531a4 for instance 21b4c645-d527-4d43-a7fb-5c866fa59022 on n-h2-master-1 Jun 20 12:05:04.592461 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-af586f9d-2e00-46b8-90ee-9396cad93787 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:04.598978 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-1a9bc4ce-c02a-48a5-a65a-5ce4e6107a79 req-76cc85ca-06eb-42ba-a5db-140446150eac service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046175 Jun 20 12:05:04.605235 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 937/1864] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:05:04.612656 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-63940fb6-3613-46f6-bfe4-2585184daffa req-745a87e2-5bbb-4120-9ed7-a1ddccb30bd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "838db96b-0c7a-4d7f-9807-44194bc73cff", "name": "network-vif-plugged", "status": "completed", "tag": "1e4f16ac-a73c-4854-8d0f-a050fb989db4"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:05:04.632189 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-63940fb6-3613-46f6-bfe4-2585184daffa req-745a87e2-5bbb-4120-9ed7-a1ddccb30bd7 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:04.632983 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-63940fb6-3613-46f6-bfe4-2585184daffa req-745a87e2-5bbb-4120-9ed7-a1ddccb30bd7 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:04.650459 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-63940fb6-3613-46f6-bfe4-2585184daffa req-745a87e2-5bbb-4120-9ed7-a1ddccb30bd7 service nova] Creating event network-vif-plugged:1e4f16ac-a73c-4854-8d0f-a050fb989db4 for instance 838db96b-0c7a-4d7f-9807-44194bc73cff on n-h1-master-1 Jun 20 12:05:04.656600 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-63940fb6-3613-46f6-bfe4-2585184daffa req-745a87e2-5bbb-4120-9ed7-a1ddccb30bd7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049428 Jun 20 12:05:04.658264 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 938/1865] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:05:04.668718 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7847e886-72ab-427a-8c9e-0ea8c9e65f2c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:04.671123 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7847e886-72ab-427a-8c9e-0ea8c9e65f2c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:04.679724 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7847e886-72ab-427a-8c9e-0ea8c9e65f2c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:04.680451 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7847e886-72ab-427a-8c9e-0ea8c9e65f2c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:04.682355 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7847e886-72ab-427a-8c9e-0ea8c9e65f2c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:04.683044 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7847e886-72ab-427a-8c9e-0ea8c9e65f2c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:04.771736 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7847e886-72ab-427a-8c9e-0ea8c9e65f2c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:04.787893 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7847e886-72ab-427a-8c9e-0ea8c9e65f2c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:04.790490 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7847e886-72ab-427a-8c9e-0ea8c9e65f2c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:04.792001 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7847e886-72ab-427a-8c9e-0ea8c9e65f2c tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 200 len: 1265 microversion: 2.25 time: 0.132324 Jun 20 12:05:04.794059 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 939/1866] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:05:04 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 1265 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:05:04.816513 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-af586f9d-2e00-46b8-90ee-9396cad93787 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:04.828551 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-af586f9d-2e00-46b8-90ee-9396cad93787 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1523 microversion: 2.1 time: 0.275151 Jun 20 12:05:04.829252 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 928/1867] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:04 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1523 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:05.565411 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-73b35ebc-73d6-472c-9783-ca7fb3da6c99 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073968160>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:05.587076 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-058cc2d2-2865-4024-a436-70ce6ee7b8b1 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f6073ec7820>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:10.724291 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-058cc2d2-2865-4024-a436-70ce6ee7b8b1 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/79ed6967-cc63-4288-a465-d14d880ced9f" status: 200 len: 1420 microversion: 2.1 time: 5.167406 Jun 20 12:05:10.725920 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 940/1868] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:05 2022] GET /compute/v2.1/images/79ed6967-cc63-4288-a465-d14d880ced9f => generated 1420 bytes in 5170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:10.745109 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0874444f-906b-4e4a-8c77-513adc969e08 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:10.745911 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0874444f-906b-4e4a-8c77-513adc969e08 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 21b4c645-d527-4d43-a7fb-5c866fa59022] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:10.750320 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-73b35ebc-73d6-472c-9783-ca7fb3da6c99 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/320c8800-5d83-4fef-b8fc-e287df641bad" status: 200 len: 1455 microversion: 2.1 time: 5.188840 Jun 20 12:05:10.752832 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 929/1869] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:05 2022] GET /compute/v2.1/images/320c8800-5d83-4fef-b8fc-e287df641bad => generated 1455 bytes in 5192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:10.759242 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:10.762703 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-aa6c50a8-fc9f-4634-a21c-41fce59a14ec tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:10.763409 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0874444f-906b-4e4a-8c77-513adc969e08 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:10.763886 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0874444f-906b-4e4a-8c77-513adc969e08 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:10.764750 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0874444f-906b-4e4a-8c77-513adc969e08 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:10.765211 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0874444f-906b-4e4a-8c77-513adc969e08 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:10.766355 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-aa6c50a8-fc9f-4634-a21c-41fce59a14ec tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:10.778020 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aa6c50a8-fc9f-4634-a21c-41fce59a14ec tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:10.778631 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aa6c50a8-fc9f-4634-a21c-41fce59a14ec tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:10.779604 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aa6c50a8-fc9f-4634-a21c-41fce59a14ec tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:10.780310 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aa6c50a8-fc9f-4634-a21c-41fce59a14ec tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:10.809389 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-0874444f-906b-4e4a-8c77-513adc969e08 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] HTTP exception thrown: Instance 21b4c645-d527-4d43-a7fb-5c866fa59022 could not be found. Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0874444f-906b-4e4a-8c77-513adc969e08 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Request method failure captured: Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 HTTP/1.1 Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGCBMY-AP50A_VodPQvWrCmK6cXM5FqVZ1Pch-fMzkO-vU11pLif_nsOE3Xirc2LdA-h5YH9YMy3iUoYQpFUAPIvhKDhJqQ51C-klgng5GbH2nJvx6tYGl1866FAd9Thfxo6R2nY1yufJdzq8zol8PXJyP8omaOMbimX0RhCXlsHuPY Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: X-Openstack-Nova-Api-Version: 2.25 Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 7fdba36a70464a8e816944a7f29e47cf Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1789359872 Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7fdba36a70464a8e816944a7f29e47cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7fdba36a70464a8e816944a7f29e47cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7fdba36a70464a8e816944a7f29e47cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7fdba36a70464a8e816944a7f29e47cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1789359872 Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 7fdba36a70464a8e816944a7f29e47cf Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1789359872 Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-LiveAutoBlockMigrationV225Test-1789359872-project Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: b429a092ac04479eb8644bc82972234e Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1789359872-project Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 21b4c645-d527-4d43-a7fb-5c866fa59022 could not be found. Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '21b4c645-d527-4d43-a7fb-5c866fa59022'} Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21b4c645-d527-4d43-a7fb-5c866fa59022 could not be found. Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21b4c645-d527-4d43-a7fb-5c866fa59022 could not be found. Jun 20 12:05:10.815764 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:05:10.820113 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:05:10.820113 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:05:10.820113 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:05:10.820113 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:05:10.820113 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:05:10.820113 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:05:10.820113 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:05:10.820113 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21b4c645-d527-4d43-a7fb-5c866fa59022 could not be found. Jun 20 12:05:10.820113 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:05:10.821759 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0874444f-906b-4e4a-8c77-513adc969e08 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Returning 404 to user: Instance 21b4c645-d527-4d43-a7fb-5c866fa59022 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:05:10.824159 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0874444f-906b-4e4a-8c77-513adc969e08 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022" status: 404 len: 111 microversion: 2.25 time: 0.097093 Jun 20 12:05:10.824791 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 941/1870] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:05:10 2022] GET /compute/v2.1/servers/21b4c645-d527-4d43-a7fb-5c866fa59022 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:05:10.854367 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-c52b834b-1cb6-4598-b65b-add5c3cedab8 req-33a20d79-4cf0-422a-86a0-9e62805dec86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b52985a9-6859-4d8b-b248-d4d2289f7da1", "name": "network-vif-unplugged", "status": "completed", "tag": "cb6f9a61-ee67-4712-b7c2-c06766244aa9"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:05:10.894477 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-c52b834b-1cb6-4598-b65b-add5c3cedab8 req-33a20d79-4cf0-422a-86a0-9e62805dec86 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:10.898745 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-c52b834b-1cb6-4598-b65b-add5c3cedab8 req-33a20d79-4cf0-422a-86a0-9e62805dec86 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:10.960243 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.compute.server_external_events [req-c52b834b-1cb6-4598-b65b-add5c3cedab8 req-33a20d79-4cf0-422a-86a0-9e62805dec86 service nova] Unable to find a host for instance b52985a9-6859-4d8b-b248-d4d2289f7da1. Dropping event network-vif-unplugged {{(pid=119127) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 20 12:05:10.964619 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-c52b834b-1cb6-4598-b65b-add5c3cedab8 req-33a20d79-4cf0-422a-86a0-9e62805dec86 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.136005 Jun 20 12:05:10.970636 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 942/1871] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 145 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 20 12:05:10.988435 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-aa6c50a8-fc9f-4634-a21c-41fce59a14ec tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:10.988745 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-66bbb711-7f3b-49b0-acfc-439864be6b7e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f6073961310>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:11.005916 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-aa6c50a8-fc9f-4634-a21c-41fce59a14ec tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 200 len: 1448 microversion: 2.1 time: 0.250470 Jun 20 12:05:11.025034 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 930/1872] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:10 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 1448 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:11.030811 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a577e9cc-c911-4c5e-9f24-b073fa1cf5c3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:11.031448 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a577e9cc-c911-4c5e-9f24-b073fa1cf5c3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:11.042151 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a577e9cc-c911-4c5e-9f24-b073fa1cf5c3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:11.043035 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a577e9cc-c911-4c5e-9f24-b073fa1cf5c3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:11.044886 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a577e9cc-c911-4c5e-9f24-b073fa1cf5c3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:11.048300 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a577e9cc-c911-4c5e-9f24-b073fa1cf5c3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:11.100896 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a577e9cc-c911-4c5e-9f24-b073fa1cf5c3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:05:11.109126 n-d-master-1 devstack@n-api.service[119128]: INFO nova.compute.api [None req-a577e9cc-c911-4c5e-9f24-b073fa1cf5c3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Working on deleting snapshot 4d5014b4-6760-4935-833a-e326a331d566 from shelved instance... Jun 20 12:05:11.154061 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-66bbb711-7f3b-49b0-acfc-439864be6b7e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/79ed6967-cc63-4288-a465-d14d880ced9f" status: 200 len: 1420 microversion: 2.1 time: 0.180861 Jun 20 12:05:11.154679 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 943/1873] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:10 2022] GET /compute/v2.1/images/79ed6967-cc63-4288-a465-d14d880ced9f => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:11.166792 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-79faa122-2d49-4a6a-abc0-aaf857844174 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f6073a4b8b0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:12.098821 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a577e9cc-c911-4c5e-9f24-b073fa1cf5c3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Doing local delete in cell d5df985c-a080-4240-bcef-1787de3aeb9e(cell1) {{(pid=119128) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 20 12:05:12.099804 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a577e9cc-c911-4c5e-9f24-b073fa1cf5c3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:12.104630 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a577e9cc-c911-4c5e-9f24-b073fa1cf5c3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:12.107103 n-d-master-1 devstack@n-api.service[119128]: INFO nova.compute.api [None req-a577e9cc-c911-4c5e-9f24-b073fa1cf5c3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jun 20 12:05:12.116679 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-a577e9cc-c911-4c5e-9f24-b073fa1cf5c3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] deallocate_for_instance() {{(pid=119128) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jun 20 12:05:12.741783 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-a577e9cc-c911-4c5e-9f24-b073fa1cf5c3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Updating instance_info_cache with network_info: [] {{(pid=119128) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 20 12:05:12.913819 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-79faa122-2d49-4a6a-abc0-aaf857844174 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "DELETE /compute/v2.1/images/79ed6967-cc63-4288-a465-d14d880ced9f" status: 204 len: 0 microversion: 2.1 time: 1.751228 Jun 20 12:05:12.914473 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 944/1874] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:11 2022] DELETE /compute/v2.1/images/79ed6967-cc63-4288-a465-d14d880ced9f => generated 0 bytes in 1752 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 12:05:12.928017 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-12fa7443-d35b-4eb1-bb24-69bef2ecd5cf tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:12.928692 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-12fa7443-d35b-4eb1-bb24-69bef2ecd5cf tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:12.948745 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-12fa7443-d35b-4eb1-bb24-69bef2ecd5cf tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:12.949338 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-12fa7443-d35b-4eb1-bb24-69bef2ecd5cf tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:12.950185 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-12fa7443-d35b-4eb1-bb24-69bef2ecd5cf tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:12.950627 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-12fa7443-d35b-4eb1-bb24-69bef2ecd5cf tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:13.018218 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=7,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:13.059504 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a577e9cc-c911-4c5e-9f24-b073fa1cf5c3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 204 len: 0 microversion: 2.1 time: 2.021375 Jun 20 12:05:13.063768 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 931/1875] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:05:11 2022] DELETE /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 0 bytes in 2034 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 12:05:13.070297 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3311ee86-db03-4880-b1c3-b6d38aae5569 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073797670>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:13.154450 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3311ee86-db03-4880-b1c3-b6d38aae5569 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/320c8800-5d83-4fef-b8fc-e287df641bad" status: 200 len: 1455 microversion: 2.1 time: 0.089285 Jun 20 12:05:13.155192 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 932/1876] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:13 2022] GET /compute/v2.1/images/320c8800-5d83-4fef-b8fc-e287df641bad => generated 1455 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:13.170009 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-37de54aa-03dd-432d-a68b-7e7dfe70f1d2 req-3d2f8bcf-f667-461a-8420-c93750bb3c8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b52985a9-6859-4d8b-b248-d4d2289f7da1", "name": "network-vif-deleted", "tag": "cb6f9a61-ee67-4712-b7c2-c06766244aa9"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:05:13.186773 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-37de54aa-03dd-432d-a68b-7e7dfe70f1d2 req-3d2f8bcf-f667-461a-8420-c93750bb3c8d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:13.187513 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-37de54aa-03dd-432d-a68b-7e7dfe70f1d2 req-3d2f8bcf-f667-461a-8420-c93750bb3c8d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:13.214108 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.compute.server_external_events [req-37de54aa-03dd-432d-a68b-7e7dfe70f1d2 req-3d2f8bcf-f667-461a-8420-c93750bb3c8d service nova] Unable to find a host for instance b52985a9-6859-4d8b-b248-d4d2289f7da1. Dropping event network-vif-deleted {{(pid=119128) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 20 12:05:13.215406 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-37de54aa-03dd-432d-a68b-7e7dfe70f1d2 req-3d2f8bcf-f667-461a-8420-c93750bb3c8d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.058938 Jun 20 12:05:13.220509 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 933/1877] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 64 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 20 12:05:13.225409 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bcadf593-9248-484d-86ae-5c50796a1f87 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:13.247853 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bcadf593-9248-484d-86ae-5c50796a1f87 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:13.262769 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bcadf593-9248-484d-86ae-5c50796a1f87 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:13.263306 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bcadf593-9248-484d-86ae-5c50796a1f87 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:13.264108 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bcadf593-9248-484d-86ae-5c50796a1f87 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:13.264580 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bcadf593-9248-484d-86ae-5c50796a1f87 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:13.347369 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bcadf593-9248-484d-86ae-5c50796a1f87 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:05:13.467479 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-12fa7443-d35b-4eb1-bb24-69bef2ecd5cf tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1811 microversion: 2.1 time: 0.551497 Jun 20 12:05:13.471569 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 945/1878] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:12 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1811 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:13.484950 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3ad4d3c8-7156-4b06-87aa-cfbea11a695c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:13.485905 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3ad4d3c8-7156-4b06-87aa-cfbea11a695c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:13.501396 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3ad4d3c8-7156-4b06-87aa-cfbea11a695c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:13.503652 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3ad4d3c8-7156-4b06-87aa-cfbea11a695c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:13.504663 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3ad4d3c8-7156-4b06-87aa-cfbea11a695c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:13.506939 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3ad4d3c8-7156-4b06-87aa-cfbea11a695c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:13.540853 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-3ad4d3c8-7156-4b06-87aa-cfbea11a695c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] HTTP exception thrown: Instance b52985a9-6859-4d8b-b248-d4d2289f7da1 could not be found. Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3ad4d3c8-7156-4b06-87aa-cfbea11a695c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Request method failure captured: Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 HTTP/1.1 Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGGM0_Rgon_QXChHIK_Ikyu0N9hux8u1Ms08jFhXlxkRDQgHGZCrxeBLJGVow3P3B7-C_d1lwOFEoVq18fpBt5bYVFsDOyFchFBnf15eYmBoM5W3iquFzY2ZI2UJK0DkPKTj0Fv6tDqgY5whthvLS8glHLsBu0Y3_K5TIG0-QwQVU5w Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 3495d9dc8b714809b2f3f777cbabda29 Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: exception: Instance b52985a9-6859-4d8b-b248-d4d2289f7da1 could not be found. Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'b52985a9-6859-4d8b-b248-d4d2289f7da1'} Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b52985a9-6859-4d8b-b248-d4d2289f7da1 could not be found. Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b52985a9-6859-4d8b-b248-d4d2289f7da1 could not be found. Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:05:13.543422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:05:13.546744 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:05:13.546744 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:05:13.546744 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:05:13.546744 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:05:13.546744 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:05:13.546744 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b52985a9-6859-4d8b-b248-d4d2289f7da1 could not be found. Jun 20 12:05:13.546744 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:05:13.553036 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3ad4d3c8-7156-4b06-87aa-cfbea11a695c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Returning 404 to user: Instance b52985a9-6859-4d8b-b248-d4d2289f7da1 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:05:13.554240 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3ad4d3c8-7156-4b06-87aa-cfbea11a695c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 404 len: 111 microversion: 2.1 time: 0.081206 Jun 20 12:05:13.555413 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 946/1879] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:13 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:05:13.572239 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bcadf593-9248-484d-86ae-5c50796a1f87 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a" status: 204 len: 0 microversion: 2.1 time: 0.347379 Jun 20 12:05:13.591999 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fc505ecd-e2a4-4ceb-9519-9dc070dc8fc8 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:13.592800 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 934/1880] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:05:13 2022] DELETE /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:05:13.596973 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:05:13.596973 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 12:05:13.597828 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fc505ecd-e2a4-4ceb-9519-9dc070dc8fc8 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:13.598287 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fc505ecd-e2a4-4ceb-9519-9dc070dc8fc8 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:13.599166 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fc505ecd-e2a4-4ceb-9519-9dc070dc8fc8 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:13.599665 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fc505ecd-e2a4-4ceb-9519-9dc070dc8fc8 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:13.634468 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fc505ecd-e2a4-4ceb-9519-9dc070dc8fc8 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.077604 Jun 20 12:05:13.635690 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 947/1881] 10.222.0.27 () {58 vars in 1175 bytes} [Mon Jun 20 12:05:13 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:05:13.750818 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-49d98f26-feeb-43bf-8cde-de67c5df5e43 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-327351675", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "25724adf-e301-4183-8c20-574ec029a516"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:05:13.864465 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-49d98f26-feeb-43bf-8cde-de67c5df5e43 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] validate_networks() for [('25724adf-e301-4183-8c20-574ec029a516', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:05:13.881150 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4f026919-2f1c-4341-89eb-61250fe3b266 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1056168390", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "ab5a97aa-06fd-4e21-892e-d2f2bb854bdb"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:05:13.958013 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-4f026919-2f1c-4341-89eb-61250fe3b266 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] validate_networks() for [('ab5a97aa-06fd-4e21-892e-d2f2bb854bdb', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:05:14.454546 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-49d98f26-feeb-43bf-8cde-de67c5df5e43 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:05:14.455087 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-49d98f26-feeb-43bf-8cde-de67c5df5e43 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:05:14.455424 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-49d98f26-feeb-43bf-8cde-de67c5df5e43 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:05:14.455830 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-49d98f26-feeb-43bf-8cde-de67c5df5e43 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:05:14.456258 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-49d98f26-feeb-43bf-8cde-de67c5df5e43 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:05:14.470713 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-49d98f26-feeb-43bf-8cde-de67c5df5e43 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:14.471173 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-49d98f26-feeb-43bf-8cde-de67c5df5e43 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:14.471974 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-49d98f26-feeb-43bf-8cde-de67c5df5e43 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:14.472437 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-49d98f26-feeb-43bf-8cde-de67c5df5e43 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:14.518092 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-49d98f26-feeb-43bf-8cde-de67c5df5e43 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Getting quotas for project 7dbe3d6c4b7a41fa8181a805a992c173. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:05:14.532363 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-49d98f26-feeb-43bf-8cde-de67c5df5e43 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Getting quotas for user 3495d9dc8b714809b2f3f777cbabda29 and project 7dbe3d6c4b7a41fa8181a805a992c173. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:05:14.556280 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-49d98f26-feeb-43bf-8cde-de67c5df5e43 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:05:14.559508 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-49d98f26-feeb-43bf-8cde-de67c5df5e43 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:05:14.665960 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-49d98f26-feeb-43bf-8cde-de67c5df5e43 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.919756 Jun 20 12:05:14.674609 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 935/1882] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:05:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:05:14.683879 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1a9ebe11-0be6-4956-a60f-81f2f6f61952 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f60734103a0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:14.786413 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1a9ebe11-0be6-4956-a60f-81f2f6f61952 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/320c8800-5d83-4fef-b8fc-e287df641bad" status: 200 len: 1455 microversion: 2.1 time: 0.110614 Jun 20 12:05:14.792023 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 936/1883] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:14 2022] GET /compute/v2.1/images/320c8800-5d83-4fef-b8fc-e287df641bad => generated 1455 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:14.807725 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-df411dea-eccb-469f-b0ad-5dceb6f77975 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:14.814510 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-df411dea-eccb-469f-b0ad-5dceb6f77975 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:14.829612 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-4f026919-2f1c-4341-89eb-61250fe3b266 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:05:14.830150 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-4f026919-2f1c-4341-89eb-61250fe3b266 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:05:14.830623 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-4f026919-2f1c-4341-89eb-61250fe3b266 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:05:14.831047 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-4f026919-2f1c-4341-89eb-61250fe3b266 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:05:14.831469 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-4f026919-2f1c-4341-89eb-61250fe3b266 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:05:14.847514 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4f026919-2f1c-4341-89eb-61250fe3b266 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:14.848004 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4f026919-2f1c-4341-89eb-61250fe3b266 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:14.848810 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4f026919-2f1c-4341-89eb-61250fe3b266 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:14.849247 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4f026919-2f1c-4341-89eb-61250fe3b266 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:14.898418 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-4f026919-2f1c-4341-89eb-61250fe3b266 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Getting quotas for project 615573a78a9d4e75a36ada9bd9de7e15. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:05:14.917809 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-4f026919-2f1c-4341-89eb-61250fe3b266 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Getting quotas for user 8b2304d9c7dd493983542a54b6799989 and project 615573a78a9d4e75a36ada9bd9de7e15. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:05:14.929727 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-df411dea-eccb-469f-b0ad-5dceb6f77975 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:14.941650 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-df411dea-eccb-469f-b0ad-5dceb6f77975 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1214 microversion: 2.1 time: 0.146298 Jun 20 12:05:14.951478 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 937/1884] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:14 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1214 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:14.951664 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4f026919-2f1c-4341-89eb-61250fe3b266 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:05:14.951664 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4f026919-2f1c-4341-89eb-61250fe3b266 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:05:15.069799 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4f026919-2f1c-4341-89eb-61250fe3b266 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.191800 Jun 20 12:05:15.092098 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a63f6aa3-8533-4aef-a518-37ec0b53f583 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:15.092786 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a63f6aa3-8533-4aef-a518-37ec0b53f583 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:15.101059 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 948/1885] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:05:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1224 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:05:15.281253 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a63f6aa3-8533-4aef-a518-37ec0b53f583 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:15.297024 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a63f6aa3-8533-4aef-a518-37ec0b53f583 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 200 len: 1208 microversion: 2.1 time: 0.209190 Jun 20 12:05:15.305589 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 938/1886] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:15 2022] GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 1208 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:05:15.744068 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-a4d2a500-aaba-41e5-810e-39015f2b2612 req-27d57f0e-8fa2-4d3e-93b3-a68c240c3294 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b9e1026-a6f6-47f2-8734-4b05eeff8b9a", "name": "network-vif-unplugged", "status": "completed", "tag": "d4607934-f3b3-445b-8374-03fb586d6121"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:05:15.795764 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-a4d2a500-aaba-41e5-810e-39015f2b2612 req-27d57f0e-8fa2-4d3e-93b3-a68c240c3294 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:15.804015 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-a4d2a500-aaba-41e5-810e-39015f2b2612 req-27d57f0e-8fa2-4d3e-93b3-a68c240c3294 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:15.814781 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a07d44c1-3809-496c-a1c0-bdbb026f5196 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073797d30>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:15.833751 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:15.886109 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-a4d2a500-aaba-41e5-810e-39015f2b2612 req-27d57f0e-8fa2-4d3e-93b3-a68c240c3294 service nova] Creating event network-vif-unplugged:d4607934-f3b3-445b-8374-03fb586d6121 for instance 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a on n-h2-master-1 Jun 20 12:05:15.904569 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a07d44c1-3809-496c-a1c0-bdbb026f5196 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/320c8800-5d83-4fef-b8fc-e287df641bad" status: 200 len: 1455 microversion: 2.1 time: 0.108584 Jun 20 12:05:15.908847 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 939/1887] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:15 2022] GET /compute/v2.1/images/320c8800-5d83-4fef-b8fc-e287df641bad => generated 1455 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:15.920537 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-a4d2a500-aaba-41e5-810e-39015f2b2612 req-27d57f0e-8fa2-4d3e-93b3-a68c240c3294 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.178444 Jun 20 12:05:15.922628 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 949/1888] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:05:15.959858 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8cf47ce5-8d34-45b7-8dbb-4f4c77ee8adb tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:15.960478 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8cf47ce5-8d34-45b7-8dbb-4f4c77ee8adb tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:15.968437 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8cf47ce5-8d34-45b7-8dbb-4f4c77ee8adb tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:15.969051 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8cf47ce5-8d34-45b7-8dbb-4f4c77ee8adb tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:15.970888 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8cf47ce5-8d34-45b7-8dbb-4f4c77ee8adb tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:15.971529 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8cf47ce5-8d34-45b7-8dbb-4f4c77ee8adb tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:16.068385 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8cf47ce5-8d34-45b7-8dbb-4f4c77ee8adb tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:16.083744 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8cf47ce5-8d34-45b7-8dbb-4f4c77ee8adb tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1210 microversion: 2.1 time: 0.122836 Jun 20 12:05:16.097536 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 940/1889] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:15 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1210 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:16.324692 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-93f72bbb-067c-4b19-81ed-ea342d6d643b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:16.326587 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-93f72bbb-067c-4b19-81ed-ea342d6d643b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:16.470602 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-93f72bbb-067c-4b19-81ed-ea342d6d643b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:16.477962 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-93f72bbb-067c-4b19-81ed-ea342d6d643b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 200 len: 1208 microversion: 2.1 time: 0.158814 Jun 20 12:05:16.486423 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 950/1890] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:16 2022] GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 1208 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:16.564955 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a999100f-1c0f-4162-9d75-0c369119dfa6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:16.566242 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a999100f-1c0f-4162-9d75-0c369119dfa6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:16.594743 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a999100f-1c0f-4162-9d75-0c369119dfa6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:16.595239 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a999100f-1c0f-4162-9d75-0c369119dfa6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:16.601342 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a999100f-1c0f-4162-9d75-0c369119dfa6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:16.604488 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a999100f-1c0f-4162-9d75-0c369119dfa6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:16.629083 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-878b259b-4dc3-435b-9846-4df24db5a62f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bede6f21-4f14-4842-8290-34a322b9f1de", "device": "/dev/xvdb"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:05:16.630654 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-878b259b-4dc3-435b-9846-4df24db5a62f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:16.655339 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-878b259b-4dc3-435b-9846-4df24db5a62f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:16.658627 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-878b259b-4dc3-435b-9846-4df24db5a62f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:16.659640 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-878b259b-4dc3-435b-9846-4df24db5a62f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:16.660053 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-878b259b-4dc3-435b-9846-4df24db5a62f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:16.761154 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a999100f-1c0f-4162-9d75-0c369119dfa6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:05:17.065802 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a999100f-1c0f-4162-9d75-0c369119dfa6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 204 len: 0 microversion: 2.25 time: 0.505839 Jun 20 12:05:17.089294 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 941/1891] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Jun 20 12:05:16 2022] DELETE /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 0 bytes in 530 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 12:05:17.112007 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b20edb39-29bf-44a7-bbb5-d28879ff3e40 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6081f99310>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:17.302199 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-878b259b-4dc3-435b-9846-4df24db5a62f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "POST /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.681001 Jun 20 12:05:17.303475 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 951/1892] 10.222.0.27 () {60 vars in 1322 bytes} [Mon Jun 20 12:05:16 2022] POST /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777/os-volume_attachments => generated 194 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:05:17.311455 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a0522d75-3600-4763-91f1-ce72edf767e3 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:17.312550 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a0522d75-3600-4763-91f1-ce72edf767e3 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:17.323801 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a0522d75-3600-4763-91f1-ce72edf767e3 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:17.325167 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a0522d75-3600-4763-91f1-ce72edf767e3 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:17.327223 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a0522d75-3600-4763-91f1-ce72edf767e3 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:17.328135 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a0522d75-3600-4763-91f1-ce72edf767e3 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:17.393122 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b20edb39-29bf-44a7-bbb5-d28879ff3e40 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/320c8800-5d83-4fef-b8fc-e287df641bad" status: 200 len: 1455 microversion: 2.1 time: 0.301269 Jun 20 12:05:17.407780 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 942/1893] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:17 2022] GET /compute/v2.1/images/320c8800-5d83-4fef-b8fc-e287df641bad => generated 1455 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:17.473825 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a850f53a-faa5-4dfa-a3ca-60a332742432 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:17.474600 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a850f53a-faa5-4dfa-a3ca-60a332742432 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:17.531668 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a850f53a-faa5-4dfa-a3ca-60a332742432 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:17.532117 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a850f53a-faa5-4dfa-a3ca-60a332742432 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:17.532971 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a850f53a-faa5-4dfa-a3ca-60a332742432 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:17.533436 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a850f53a-faa5-4dfa-a3ca-60a332742432 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:17.696080 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a850f53a-faa5-4dfa-a3ca-60a332742432 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:17.717281 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a850f53a-faa5-4dfa-a3ca-60a332742432 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1272 microversion: 2.1 time: 0.307404 Jun 20 12:05:17.730360 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 943/1894] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:17 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1272 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:17.739010 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a236e78c-df11-4ebb-9a85-8fece33e9747 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:17.739681 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a236e78c-df11-4ebb-9a85-8fece33e9747 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:17.749144 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a236e78c-df11-4ebb-9a85-8fece33e9747 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:17.749939 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a236e78c-df11-4ebb-9a85-8fece33e9747 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:17.751180 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a236e78c-df11-4ebb-9a85-8fece33e9747 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:17.766662 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a236e78c-df11-4ebb-9a85-8fece33e9747 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:18.072551 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a236e78c-df11-4ebb-9a85-8fece33e9747 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:18.087848 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a236e78c-df11-4ebb-9a85-8fece33e9747 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 200 len: 1268 microversion: 2.1 time: 0.361256 Jun 20 12:05:18.097097 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 944/1895] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:17 2022] GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 1268 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:18.118294 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-cb2c32e9-c50a-4fe3-a8f7-a8ab1b7d338d req-59f9cc1e-184b-4f73-bc28-422b63113119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b9e1026-a6f6-47f2-8734-4b05eeff8b9a", "name": "network-vif-deleted", "tag": "d4607934-f3b3-445b-8374-03fb586d6121"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:05:18.154328 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-cb2c32e9-c50a-4fe3-a8f7-a8ab1b7d338d req-59f9cc1e-184b-4f73-bc28-422b63113119 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:18.155189 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-cb2c32e9-c50a-4fe3-a8f7-a8ab1b7d338d req-59f9cc1e-184b-4f73-bc28-422b63113119 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:18.191506 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-cb2c32e9-c50a-4fe3-a8f7-a8ab1b7d338d req-59f9cc1e-184b-4f73-bc28-422b63113119 service nova] Creating event network-vif-deleted:d4607934-f3b3-445b-8374-03fb586d6121 for instance 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a on n-h2-master-1 Jun 20 12:05:18.208365 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-cb2c32e9-c50a-4fe3-a8f7-a8ab1b7d338d req-59f9cc1e-184b-4f73-bc28-422b63113119 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109071 Jun 20 12:05:18.210137 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 945/1896] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:05:18.440932 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a0522d75-3600-4763-91f1-ce72edf767e3 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:18.463681 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a0522d75-3600-4763-91f1-ce72edf767e3 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:18.472965 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a0522d75-3600-4763-91f1-ce72edf767e3 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:18.475331 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a0522d75-3600-4763-91f1-ce72edf767e3 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1733 microversion: 2.25 time: 1.170288 Jun 20 12:05:18.497388 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 952/1897] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:05:17 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1733 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:05:18.513458 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a3805f0b-7220-4b7c-a2df-0bb9f2704a01 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073901ee0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:18.597911 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a3805f0b-7220-4b7c-a2df-0bb9f2704a01 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/320c8800-5d83-4fef-b8fc-e287df641bad" status: 200 len: 1455 microversion: 2.1 time: 0.088856 Jun 20 12:05:18.607182 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 946/1898] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:18 2022] GET /compute/v2.1/images/320c8800-5d83-4fef-b8fc-e287df641bad => generated 1455 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:18.739983 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f5143abd-fdd4-4071-adaa-36c3fa11d1a0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:18.740948 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f5143abd-fdd4-4071-adaa-36c3fa11d1a0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:18.763086 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5143abd-fdd4-4071-adaa-36c3fa11d1a0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:18.763549 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5143abd-fdd4-4071-adaa-36c3fa11d1a0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:18.769377 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5143abd-fdd4-4071-adaa-36c3fa11d1a0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:18.774836 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5143abd-fdd4-4071-adaa-36c3fa11d1a0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:19.093074 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f5143abd-fdd4-4071-adaa-36c3fa11d1a0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:19.108560 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f5143abd-fdd4-4071-adaa-36c3fa11d1a0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1272 microversion: 2.1 time: 0.372793 Jun 20 12:05:19.109171 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 953/1899] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:18 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1272 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:19.114247 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d42e37a4-c7ba-4159-aca3-fc465476067c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:19.115099 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d42e37a4-c7ba-4159-aca3-fc465476067c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:19.137979 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d42e37a4-c7ba-4159-aca3-fc465476067c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:19.144754 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d42e37a4-c7ba-4159-aca3-fc465476067c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:19.150252 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d42e37a4-c7ba-4159-aca3-fc465476067c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:19.150794 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d42e37a4-c7ba-4159-aca3-fc465476067c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:19.389306 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d42e37a4-c7ba-4159-aca3-fc465476067c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:19.404961 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d42e37a4-c7ba-4159-aca3-fc465476067c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 200 len: 1266 microversion: 2.1 time: 0.296391 Jun 20 12:05:19.410091 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 947/1900] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:19 2022] GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 1266 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:19.514449 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dbb1e4ed-4f8c-4ccb-874b-b6d182f543b3 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:19.515230 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dbb1e4ed-4f8c-4ccb-874b-b6d182f543b3 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:19.526018 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dbb1e4ed-4f8c-4ccb-874b-b6d182f543b3 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:19.533972 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dbb1e4ed-4f8c-4ccb-874b-b6d182f543b3 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:19.534880 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dbb1e4ed-4f8c-4ccb-874b-b6d182f543b3 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:19.535333 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dbb1e4ed-4f8c-4ccb-874b-b6d182f543b3 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:19.611489 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-03e4abe4-f89c-4a34-b44a-ec9d2ce6b16b tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073901c10>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:19.743949 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-03e4abe4-f89c-4a34-b44a-ec9d2ce6b16b tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/320c8800-5d83-4fef-b8fc-e287df641bad" status: 200 len: 1455 microversion: 2.1 time: 0.136854 Jun 20 12:05:19.750030 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 948/1901] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:19 2022] GET /compute/v2.1/images/320c8800-5d83-4fef-b8fc-e287df641bad => generated 1455 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:05:19.840348 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-21cea6be-40c2-427f-8b20-51d0cc988fe4 req-1b023e95-af51-433b-9e9b-e8a1ed864f52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3db0bd7d-eed4-411a-a7b8-719b260233ed", "name": "network-vif-deleted", "tag": "66a1f7cd-2c10-48c8-8f30-83c32f1d6186"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:05:19.890198 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-21cea6be-40c2-427f-8b20-51d0cc988fe4 req-1b023e95-af51-433b-9e9b-e8a1ed864f52 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:19.900476 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-21cea6be-40c2-427f-8b20-51d0cc988fe4 req-1b023e95-af51-433b-9e9b-e8a1ed864f52 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:19.967494 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-21cea6be-40c2-427f-8b20-51d0cc988fe4 req-1b023e95-af51-433b-9e9b-e8a1ed864f52 service nova] Creating event network-vif-deleted:66a1f7cd-2c10-48c8-8f30-83c32f1d6186 for instance 3db0bd7d-eed4-411a-a7b8-719b260233ed on n-h1-master-1 Jun 20 12:05:19.988183 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-21cea6be-40c2-427f-8b20-51d0cc988fe4 req-1b023e95-af51-433b-9e9b-e8a1ed864f52 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154060 Jun 20 12:05:19.999648 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 949/1902] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:05:20.131620 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c5acac80-e952-40c6-b6f7-411a79cf754c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:20.133217 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c5acac80-e952-40c6-b6f7-411a79cf754c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:20.161566 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c5acac80-e952-40c6-b6f7-411a79cf754c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:20.162365 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c5acac80-e952-40c6-b6f7-411a79cf754c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:20.163476 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c5acac80-e952-40c6-b6f7-411a79cf754c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:20.164160 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c5acac80-e952-40c6-b6f7-411a79cf754c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:20.305184 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c5acac80-e952-40c6-b6f7-411a79cf754c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:20.318463 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c5acac80-e952-40c6-b6f7-411a79cf754c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1272 microversion: 2.1 time: 0.192406 Jun 20 12:05:20.345254 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 950/1903] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:20 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1272 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:20.429557 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c8a66535-34d4-49d3-a6af-332259823a35 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:20.430079 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c8a66535-34d4-49d3-a6af-332259823a35 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:20.445818 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c8a66535-34d4-49d3-a6af-332259823a35 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:20.446676 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c8a66535-34d4-49d3-a6af-332259823a35 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:20.453566 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c8a66535-34d4-49d3-a6af-332259823a35 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:20.454654 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c8a66535-34d4-49d3-a6af-332259823a35 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:20.564176 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c8a66535-34d4-49d3-a6af-332259823a35 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:20.574757 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c8a66535-34d4-49d3-a6af-332259823a35 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 200 len: 1266 microversion: 2.1 time: 0.149535 Jun 20 12:05:20.584322 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 951/1904] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:20 2022] GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:20.626626 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dbb1e4ed-4f8c-4ccb-874b-b6d182f543b3 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:20.651491 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dbb1e4ed-4f8c-4ccb-874b-b6d182f543b3 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:20.659474 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dbb1e4ed-4f8c-4ccb-874b-b6d182f543b3 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:20.664840 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dbb1e4ed-4f8c-4ccb-874b-b6d182f543b3 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 200 len: 1665 microversion: 2.25 time: 1.153624 Jun 20 12:05:20.693667 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 954/1905] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:05:19 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 1665 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:05:20.758086 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-47202773-c322-42e4-a55c-fb263de25453 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f60736e79d0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:20.857543 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-47202773-c322-42e4-a55c-fb263de25453 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/320c8800-5d83-4fef-b8fc-e287df641bad" status: 200 len: 1455 microversion: 2.1 time: 0.104160 Jun 20 12:05:20.859182 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 952/1906] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:20 2022] GET /compute/v2.1/images/320c8800-5d83-4fef-b8fc-e287df641bad => generated 1455 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:21.342254 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d7844ccb-629a-4cf9-8f45-bb9c7b3b4a8c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:21.343691 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d7844ccb-629a-4cf9-8f45-bb9c7b3b4a8c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:21.359806 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d7844ccb-629a-4cf9-8f45-bb9c7b3b4a8c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:21.375192 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d7844ccb-629a-4cf9-8f45-bb9c7b3b4a8c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:21.376247 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d7844ccb-629a-4cf9-8f45-bb9c7b3b4a8c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:21.377893 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d7844ccb-629a-4cf9-8f45-bb9c7b3b4a8c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:21.597537 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-65f97f3d-5d69-4b7e-a9eb-083de46be43b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:21.598874 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-65f97f3d-5d69-4b7e-a9eb-083de46be43b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:21.604516 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:21.619770 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65f97f3d-5d69-4b7e-a9eb-083de46be43b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:21.620614 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65f97f3d-5d69-4b7e-a9eb-083de46be43b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:21.622692 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65f97f3d-5d69-4b7e-a9eb-083de46be43b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:21.626164 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65f97f3d-5d69-4b7e-a9eb-083de46be43b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:21.987265 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d7844ccb-629a-4cf9-8f45-bb9c7b3b4a8c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:22.003509 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d7844ccb-629a-4cf9-8f45-bb9c7b3b4a8c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1314 microversion: 2.1 time: 0.668592 Jun 20 12:05:22.004904 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 955/1907] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:21 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1314 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:22.020235 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-65f97f3d-5d69-4b7e-a9eb-083de46be43b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:22.047088 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-37bc2393-5b40-40ba-a2ff-6e7bd4aa1efb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:22.049072 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-65f97f3d-5d69-4b7e-a9eb-083de46be43b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 200 len: 1308 microversion: 2.1 time: 0.459453 Jun 20 12:05:22.049785 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-37bc2393-5b40-40ba-a2ff-6e7bd4aa1efb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 3db0bd7d-eed4-411a-a7b8-719b260233ed] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:22.065250 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 953/1908] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:21 2022] GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 1308 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:22.077647 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-37bc2393-5b40-40ba-a2ff-6e7bd4aa1efb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:22.079925 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-37bc2393-5b40-40ba-a2ff-6e7bd4aa1efb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:22.083037 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-37bc2393-5b40-40ba-a2ff-6e7bd4aa1efb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:22.083844 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-37bc2393-5b40-40ba-a2ff-6e7bd4aa1efb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:22.085706 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-10641877-91dc-45e5-a19f-a2cfbce4565f tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f607365c790>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:22.118899 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-37bc2393-5b40-40ba-a2ff-6e7bd4aa1efb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] HTTP exception thrown: Instance 3db0bd7d-eed4-411a-a7b8-719b260233ed could not be found. Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-37bc2393-5b40-40ba-a2ff-6e7bd4aa1efb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Request method failure captured: Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed HTTP/1.1 Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGCBMY-AP50A_VodPQvWrCmK6cXM5FqVZ1Pch-fMzkO-vU11pLif_nsOE3Xirc2LdA-h5YH9YMy3iUoYQpFUAPIvhKDhJqQ51C-klgng5GbH2nJvx6tYGl1866FAd9Thfxo6R2nY1yufJdzq8zol8PXJyP8omaOMbimX0RhCXlsHuPY Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: X-Openstack-Nova-Api-Version: 2.25 Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 7fdba36a70464a8e816944a7f29e47cf Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1789359872 Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7fdba36a70464a8e816944a7f29e47cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7fdba36a70464a8e816944a7f29e47cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7fdba36a70464a8e816944a7f29e47cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7fdba36a70464a8e816944a7f29e47cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1789359872 Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 7fdba36a70464a8e816944a7f29e47cf Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1789359872 Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-LiveAutoBlockMigrationV225Test-1789359872-project Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: b429a092ac04479eb8644bc82972234e Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1789359872-project Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 3db0bd7d-eed4-411a-a7b8-719b260233ed could not be found. Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '3db0bd7d-eed4-411a-a7b8-719b260233ed'} Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3db0bd7d-eed4-411a-a7b8-719b260233ed could not be found. Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3db0bd7d-eed4-411a-a7b8-719b260233ed could not be found. Jun 20 12:05:22.121413 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:05:22.125455 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:05:22.125455 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:05:22.125455 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:05:22.125455 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:05:22.125455 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:05:22.125455 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:05:22.125455 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:05:22.125455 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3db0bd7d-eed4-411a-a7b8-719b260233ed could not be found. Jun 20 12:05:22.125455 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:05:22.127906 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-37bc2393-5b40-40ba-a2ff-6e7bd4aa1efb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Returning 404 to user: Instance 3db0bd7d-eed4-411a-a7b8-719b260233ed could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:05:22.130800 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-37bc2393-5b40-40ba-a2ff-6e7bd4aa1efb tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed" status: 404 len: 111 microversion: 2.25 time: 0.123292 Jun 20 12:05:22.133595 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 956/1909] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:05:22 2022] GET /compute/v2.1/servers/3db0bd7d-eed4-411a-a7b8-719b260233ed => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:05:22.148963 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d1d323c2-0c9c-4833-b353-3bc7d22b818b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '.version_select at 0x7f607331ac10>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:22.186493 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d1d323c2-0c9c-4833-b353-3bc7d22b818b tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2096760270" status: 204 len: 0 microversion: 2.25 time: 0.041833 Jun 20 12:05:22.187089 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 957/1910] 10.222.0.27 () {60 vars in 1261 bytes} [Mon Jun 20 12:05:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2096760270 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 12:05:22.220080 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-10641877-91dc-45e5-a19f-a2cfbce4565f tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/320c8800-5d83-4fef-b8fc-e287df641bad" status: 200 len: 1455 microversion: 2.1 time: 0.151603 Jun 20 12:05:22.221335 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 954/1911] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:22 2022] GET /compute/v2.1/images/320c8800-5d83-4fef-b8fc-e287df641bad => generated 1455 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:23.024180 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4e36ea09-7025-4107-906f-67fe37e91db8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:23.025409 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4e36ea09-7025-4107-906f-67fe37e91db8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:23.050304 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4e36ea09-7025-4107-906f-67fe37e91db8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:23.051500 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4e36ea09-7025-4107-906f-67fe37e91db8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:23.053730 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4e36ea09-7025-4107-906f-67fe37e91db8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:23.055603 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4e36ea09-7025-4107-906f-67fe37e91db8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:23.071763 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e8a629b5-a245-49c8-982d-340091ad75f9 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:23.072997 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e8a629b5-a245-49c8-982d-340091ad75f9 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:23.092155 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e8a629b5-a245-49c8-982d-340091ad75f9 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:23.093022 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e8a629b5-a245-49c8-982d-340091ad75f9 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:23.094202 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e8a629b5-a245-49c8-982d-340091ad75f9 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:23.096456 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e8a629b5-a245-49c8-982d-340091ad75f9 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:23.590039 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e8a629b5-a245-49c8-982d-340091ad75f9 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:23.594037 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:UPDATE=12,nova_cell1:DELETE=2,nova_cell1:SELECT=84,nova_cell1:INSERT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:23.604494 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e8a629b5-a245-49c8-982d-340091ad75f9 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 200 len: 1308 microversion: 2.1 time: 0.536427 Jun 20 12:05:23.607446 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 955/1912] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:23 2022] GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 1308 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:23.625609 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-99f3729a-ad48-4629-a57e-38736dd150d5 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f608029a160>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:23.736905 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-99f3729a-ad48-4629-a57e-38736dd150d5 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/320c8800-5d83-4fef-b8fc-e287df641bad" status: 200 len: 1455 microversion: 2.1 time: 0.127227 Jun 20 12:05:23.737714 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 956/1913] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:23 2022] GET /compute/v2.1/images/320c8800-5d83-4fef-b8fc-e287df641bad => generated 1455 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:23.782142 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4e36ea09-7025-4107-906f-67fe37e91db8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:23.794195 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4e36ea09-7025-4107-906f-67fe37e91db8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1314 microversion: 2.1 time: 0.776000 Jun 20 12:05:23.794790 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 958/1914] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:23 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1314 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:23.915321 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f976fe94-2be1-49f3-8123-3d9b3724437d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:23.919141 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f976fe94-2be1-49f3-8123-3d9b3724437d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 29575605-7785-45df-becf-359b0da6db4e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:23.933307 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f976fe94-2be1-49f3-8123-3d9b3724437d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:23.933633 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f976fe94-2be1-49f3-8123-3d9b3724437d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:23.934996 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f976fe94-2be1-49f3-8123-3d9b3724437d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:23.934996 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f976fe94-2be1-49f3-8123-3d9b3724437d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:23.970962 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f976fe94-2be1-49f3-8123-3d9b3724437d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 29575605-7785-45df-becf-359b0da6db4e] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:05:24.055849 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-f74bbd03-02ad-4add-9b78-7b0f1427dbed req-ca6183f0-bacd-4038-981b-831e7a23d375 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6a95c21-d3d4-4867-9ae6-7e9f3183f974", "tag": "8bda50e5-6e28-4aed-a096-d1e45e7df107"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:05:24.108779 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-f74bbd03-02ad-4add-9b78-7b0f1427dbed req-ca6183f0-bacd-4038-981b-831e7a23d375 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:24.110657 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-f74bbd03-02ad-4add-9b78-7b0f1427dbed req-ca6183f0-bacd-4038-981b-831e7a23d375 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:24.113504 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f976fe94-2be1-49f3-8123-3d9b3724437d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "DELETE /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e" status: 204 len: 0 microversion: 2.25 time: 0.201735 Jun 20 12:05:24.114907 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 957/1915] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Jun 20 12:05:23 2022] DELETE /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 12:05:24.137225 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4ac5ef9b-08ff-40ea-92b4-ff02d0ca5da3 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:24.138670 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4ac5ef9b-08ff-40ea-92b4-ff02d0ca5da3 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 29575605-7785-45df-becf-359b0da6db4e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:24.146590 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ac5ef9b-08ff-40ea-92b4-ff02d0ca5da3 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:24.147489 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ac5ef9b-08ff-40ea-92b4-ff02d0ca5da3 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:24.148340 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ac5ef9b-08ff-40ea-92b4-ff02d0ca5da3 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:24.148789 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ac5ef9b-08ff-40ea-92b4-ff02d0ca5da3 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:24.151358 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-f74bbd03-02ad-4add-9b78-7b0f1427dbed req-ca6183f0-bacd-4038-981b-831e7a23d375 service nova] Creating event network-changed:8bda50e5-6e28-4aed-a096-d1e45e7df107 for instance c6a95c21-d3d4-4867-9ae6-7e9f3183f974 on n-h2-master-1 Jun 20 12:05:24.169480 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-f74bbd03-02ad-4add-9b78-7b0f1427dbed req-ca6183f0-bacd-4038-981b-831e7a23d375 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117383 Jun 20 12:05:24.170271 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 959/1916] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:05:24.366886 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4ac5ef9b-08ff-40ea-92b4-ff02d0ca5da3 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:24.379553 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4ac5ef9b-08ff-40ea-92b4-ff02d0ca5da3 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:24.382317 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4ac5ef9b-08ff-40ea-92b4-ff02d0ca5da3 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:24.385496 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4ac5ef9b-08ff-40ea-92b4-ff02d0ca5da3 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e" status: 200 len: 1550 microversion: 2.25 time: 0.258746 Jun 20 12:05:24.391286 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 958/1917] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:05:24 2022] GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e => generated 1550 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:05:24.626688 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-21bda20a-24af-4cd5-80f8-299d8433f111 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:24.628802 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-21bda20a-24af-4cd5-80f8-299d8433f111 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:24.644729 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21bda20a-24af-4cd5-80f8-299d8433f111 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:24.645433 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21bda20a-24af-4cd5-80f8-299d8433f111 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:24.647561 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21bda20a-24af-4cd5-80f8-299d8433f111 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:24.648284 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21bda20a-24af-4cd5-80f8-299d8433f111 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:24.750939 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b719c965-4024-4c72-b5d4-2094afd08944 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f60735254c0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:24.757777 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:24.824537 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b719c965-4024-4c72-b5d4-2094afd08944 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/320c8800-5d83-4fef-b8fc-e287df641bad" status: 200 len: 1464 microversion: 2.1 time: 0.077388 Jun 20 12:05:24.831840 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 959/1918] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:24 2022] GET /compute/v2.1/images/320c8800-5d83-4fef-b8fc-e287df641bad => generated 1464 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:24.845288 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f0c65ec6-38c6-4f51-a2dc-add07be885ba tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:24.845903 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f0c65ec6-38c6-4f51-a2dc-add07be885ba tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:24.859536 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f0c65ec6-38c6-4f51-a2dc-add07be885ba tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:24.860335 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f0c65ec6-38c6-4f51-a2dc-add07be885ba tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:24.861415 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f0c65ec6-38c6-4f51-a2dc-add07be885ba tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:24.862139 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f0c65ec6-38c6-4f51-a2dc-add07be885ba tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:24.875180 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=4 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:25.126332 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-21bda20a-24af-4cd5-80f8-299d8433f111 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:25.140610 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-21bda20a-24af-4cd5-80f8-299d8433f111 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 200 len: 1308 microversion: 2.1 time: 0.517464 Jun 20 12:05:25.141535 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 960/1919] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:24 2022] GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 1308 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:25.153620 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b2562ae8-9bd3-4745-b348-640b74de9156 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073e9eee0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:25.221089 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b2562ae8-9bd3-4745-b348-640b74de9156 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/320c8800-5d83-4fef-b8fc-e287df641bad" status: 200 len: 1464 microversion: 2.1 time: 0.071919 Jun 20 12:05:25.221969 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 961/1920] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:25 2022] GET /compute/v2.1/images/320c8800-5d83-4fef-b8fc-e287df641bad => generated 1464 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:25.242545 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-695e8774-311f-4779-ba45-7779c395bb5d tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:25.243645 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-695e8774-311f-4779-ba45-7779c395bb5d tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: 838db96b-0c7a-4d7f-9807-44194bc73cff] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:25.269122 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-695e8774-311f-4779-ba45-7779c395bb5d tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:25.269973 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-695e8774-311f-4779-ba45-7779c395bb5d tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:25.272797 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-695e8774-311f-4779-ba45-7779c395bb5d tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:25.276172 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-695e8774-311f-4779-ba45-7779c395bb5d tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:25.293465 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=10 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:25.365238 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f0c65ec6-38c6-4f51-a2dc-add07be885ba tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:25.411632 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f0c65ec6-38c6-4f51-a2dc-add07be885ba tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1314 microversion: 2.1 time: 0.578072 Jun 20 12:05:25.412653 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 960/1921] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:24 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1314 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:25.421871 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e295850b-c1b6-498f-91dd-9898f46a03da tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:25.423670 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e295850b-c1b6-498f-91dd-9898f46a03da tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 29575605-7785-45df-becf-359b0da6db4e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:25.474481 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e295850b-c1b6-498f-91dd-9898f46a03da tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:25.476567 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e295850b-c1b6-498f-91dd-9898f46a03da tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:25.477619 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e295850b-c1b6-498f-91dd-9898f46a03da tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:25.483655 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e295850b-c1b6-498f-91dd-9898f46a03da tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:25.638088 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-695e8774-311f-4779-ba45-7779c395bb5d tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286e4b475bbc4d108ca00497ecd3e55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8c8766d4f143349b61f27d8f2566fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:25.648078 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-695e8774-311f-4779-ba45-7779c395bb5d tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/servers/838db96b-0c7a-4d7f-9807-44194bc73cff" status: 200 len: 1468 microversion: 2.1 time: 0.409600 Jun 20 12:05:25.648078 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 962/1922] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:25 2022] GET /compute/v2.1/servers/838db96b-0c7a-4d7f-9807-44194bc73cff => generated 1468 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:25.663399 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c663e67e-be76-41aa-b9e9-9f90a06434c8 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1269171047"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:05:25.664766 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c663e67e-be76-41aa-b9e9-9f90a06434c8 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: f7d2499c-a9c8-4c2e-8445-667070737f1f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:25.671390 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c663e67e-be76-41aa-b9e9-9f90a06434c8 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:25.672051 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c663e67e-be76-41aa-b9e9-9f90a06434c8 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:25.672997 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c663e67e-be76-41aa-b9e9-9f90a06434c8 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:25.673573 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c663e67e-be76-41aa-b9e9-9f90a06434c8 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:25.882399 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e295850b-c1b6-498f-91dd-9898f46a03da tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:25.893834 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e295850b-c1b6-498f-91dd-9898f46a03da tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:25.903245 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e295850b-c1b6-498f-91dd-9898f46a03da tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:25.904503 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e295850b-c1b6-498f-91dd-9898f46a03da tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e" status: 200 len: 1550 microversion: 2.25 time: 0.489189 Jun 20 12:05:25.905401 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 961/1923] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:05:25 2022] GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e => generated 1550 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:05:25.920318 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-a35b79dd-dfc3-4b42-ba3c-b0027e2a2f8e req-9f5b9d05-e83c-4e30-b3d3-e2b47e919463 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29575605-7785-45df-becf-359b0da6db4e", "name": "network-vif-deleted", "tag": "e0f1c5e6-79d0-4e55-a956-27d25ee10457"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:05:25.936380 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-a35b79dd-dfc3-4b42-ba3c-b0027e2a2f8e req-9f5b9d05-e83c-4e30-b3d3-e2b47e919463 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:25.936851 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-a35b79dd-dfc3-4b42-ba3c-b0027e2a2f8e req-9f5b9d05-e83c-4e30-b3d3-e2b47e919463 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:25.971719 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-a35b79dd-dfc3-4b42-ba3c-b0027e2a2f8e req-9f5b9d05-e83c-4e30-b3d3-e2b47e919463 service nova] Creating event network-vif-deleted:e0f1c5e6-79d0-4e55-a956-27d25ee10457 for instance 29575605-7785-45df-becf-359b0da6db4e on n-h1-master-1 Jun 20 12:05:25.987513 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-a35b79dd-dfc3-4b42-ba3c-b0027e2a2f8e req-9f5b9d05-e83c-4e30-b3d3-e2b47e919463 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080845 Jun 20 12:05:25.992988 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 962/1924] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:05:26.159315 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-65fe20e7-d509-4b7d-88c0-c663b768aceb tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:26.160426 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-65fe20e7-d509-4b7d-88c0-c663b768aceb tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:26.167957 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65fe20e7-d509-4b7d-88c0-c663b768aceb tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:26.168791 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65fe20e7-d509-4b7d-88c0-c663b768aceb tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:26.169806 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65fe20e7-d509-4b7d-88c0-c663b768aceb tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:26.170541 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65fe20e7-d509-4b7d-88c0-c663b768aceb tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:26.215834 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c663e67e-be76-41aa-b9e9-9f90a06434c8 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "POST /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f/action" status: 202 len: 0 microversion: 2.1 time: 0.556065 Jun 20 12:05:26.217201 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 963/1925] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:05:25 2022] POST /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f/action => generated 0 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jun 20 12:05:26.224754 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-9f8dd2ff-05ce-4e76-abe7-6fd128a89b07 req-63ef75e2-5a08-4204-9a64-c608b26cf5d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9be8ed90-c9d0-4d98-b1b8-cc3395caffd1", "tag": "67d89a40-681d-4bfe-91dc-777e7d773c40"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:05:26.235160 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-9f8dd2ff-05ce-4e76-abe7-6fd128a89b07 req-63ef75e2-5a08-4204-9a64-c608b26cf5d4 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:26.235932 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-9f8dd2ff-05ce-4e76-abe7-6fd128a89b07 req-63ef75e2-5a08-4204-9a64-c608b26cf5d4 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:26.254527 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-9f8dd2ff-05ce-4e76-abe7-6fd128a89b07 req-63ef75e2-5a08-4204-9a64-c608b26cf5d4 service nova] Creating event network-changed:67d89a40-681d-4bfe-91dc-777e7d773c40 for instance 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 on n-h2-master-1 Jun 20 12:05:26.261639 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-9f8dd2ff-05ce-4e76-abe7-6fd128a89b07 req-63ef75e2-5a08-4204-9a64-c608b26cf5d4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042118 Jun 20 12:05:26.262550 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 964/1926] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:05:26.269258 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a8477eba-c987-4333-8d87-f6594c13a2c4 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073d97ca0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:26.338579 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a8477eba-c987-4333-8d87-f6594c13a2c4 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba" status: 200 len: 1455 microversion: 2.1 time: 0.074298 Jun 20 12:05:26.339556 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 965/1927] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:26 2022] GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba => generated 1455 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:26.409328 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-65fe20e7-d509-4b7d-88c0-c663b768aceb tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:26.425997 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-65fe20e7-d509-4b7d-88c0-c663b768aceb tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 200 len: 1308 microversion: 2.1 time: 0.271746 Jun 20 12:05:26.426836 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 963/1928] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:26 2022] GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 1308 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:05:26.432883 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-80bcd097-cb4c-40b3-8d7f-f6d52cb80b9d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:26.434148 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-80bcd097-cb4c-40b3-8d7f-f6d52cb80b9d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:26.442112 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-80bcd097-cb4c-40b3-8d7f-f6d52cb80b9d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:26.443192 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-80bcd097-cb4c-40b3-8d7f-f6d52cb80b9d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:26.444254 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-80bcd097-cb4c-40b3-8d7f-f6d52cb80b9d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:26.444702 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-80bcd097-cb4c-40b3-8d7f-f6d52cb80b9d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:26.489041 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=8 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:26.627140 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-80bcd097-cb4c-40b3-8d7f-f6d52cb80b9d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:26.635863 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-80bcd097-cb4c-40b3-8d7f-f6d52cb80b9d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1314 microversion: 2.1 time: 0.209428 Jun 20 12:05:26.636805 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 966/1929] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:26 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:05:26.923150 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7f152557-bd51-467b-aede-c321bad63d9d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:26.923664 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7f152557-bd51-467b-aede-c321bad63d9d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: 29575605-7785-45df-becf-359b0da6db4e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:26.930237 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f152557-bd51-467b-aede-c321bad63d9d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:26.930749 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f152557-bd51-467b-aede-c321bad63d9d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:26.931497 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f152557-bd51-467b-aede-c321bad63d9d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:26.932409 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f152557-bd51-467b-aede-c321bad63d9d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:26.946303 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-7f152557-bd51-467b-aede-c321bad63d9d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] HTTP exception thrown: Instance 29575605-7785-45df-becf-359b0da6db4e could not be found. Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7f152557-bd51-467b-aede-c321bad63d9d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Request method failure captured: Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e HTTP/1.1 Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGCBMY-AP50A_VodPQvWrCmK6cXM5FqVZ1Pch-fMzkO-vU11pLif_nsOE3Xirc2LdA-h5YH9YMy3iUoYQpFUAPIvhKDhJqQ51C-klgng5GbH2nJvx6tYGl1866FAd9Thfxo6R2nY1yufJdzq8zol8PXJyP8omaOMbimX0RhCXlsHuPY Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: X-Openstack-Nova-Api-Version: 2.25 Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 7fdba36a70464a8e816944a7f29e47cf Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1789359872 Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7fdba36a70464a8e816944a7f29e47cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7fdba36a70464a8e816944a7f29e47cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7fdba36a70464a8e816944a7f29e47cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7fdba36a70464a8e816944a7f29e47cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1789359872 Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 7fdba36a70464a8e816944a7f29e47cf Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1789359872 Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-LiveAutoBlockMigrationV225Test-1789359872-project Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: b429a092ac04479eb8644bc82972234e Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1789359872-project Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 29575605-7785-45df-becf-359b0da6db4e could not be found. Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '29575605-7785-45df-becf-359b0da6db4e'} Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29575605-7785-45df-becf-359b0da6db4e could not be found. Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29575605-7785-45df-becf-359b0da6db4e could not be found. Jun 20 12:05:26.948182 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:05:26.953484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:05:26.953484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:05:26.953484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:05:26.953484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:05:26.953484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:05:26.953484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:05:26.953484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:05:26.953484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29575605-7785-45df-becf-359b0da6db4e could not be found. Jun 20 12:05:26.953484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:05:26.953484 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7f152557-bd51-467b-aede-c321bad63d9d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Returning 404 to user: Instance 29575605-7785-45df-becf-359b0da6db4e could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:05:26.953484 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7f152557-bd51-467b-aede-c321bad63d9d tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e" status: 404 len: 111 microversion: 2.25 time: 0.030702 Jun 20 12:05:26.953484 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 964/1930] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:05:26 2022] GET /compute/v2.1/servers/29575605-7785-45df-becf-359b0da6db4e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:05:26.959167 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d85aeb0f-aff3-4bbe-b594-1f391d1d48c0 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:26.959839 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d85aeb0f-aff3-4bbe-b594-1f391d1d48c0 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:26.966400 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d85aeb0f-aff3-4bbe-b594-1f391d1d48c0 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:26.966904 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d85aeb0f-aff3-4bbe-b594-1f391d1d48c0 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:26.967666 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d85aeb0f-aff3-4bbe-b594-1f391d1d48c0 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:26.968098 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d85aeb0f-aff3-4bbe-b594-1f391d1d48c0 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:26.994566 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d85aeb0f-aff3-4bbe-b594-1f391d1d48c0 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:05:27.090544 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d85aeb0f-aff3-4bbe-b594-1f391d1d48c0 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f" status: 204 len: 0 microversion: 2.25 time: 0.135089 Jun 20 12:05:27.091693 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 967/1931] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Jun 20 12:05:26 2022] DELETE /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 12:05:27.099739 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f4067f13-b908-4615-8a29-50ad73f16bc6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:27.100741 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f4067f13-b908-4615-8a29-50ad73f16bc6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:27.109691 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f4067f13-b908-4615-8a29-50ad73f16bc6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:27.110364 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f4067f13-b908-4615-8a29-50ad73f16bc6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:27.111364 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f4067f13-b908-4615-8a29-50ad73f16bc6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:27.112086 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f4067f13-b908-4615-8a29-50ad73f16bc6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:27.254864 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f4067f13-b908-4615-8a29-50ad73f16bc6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:27.264665 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f4067f13-b908-4615-8a29-50ad73f16bc6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:27.266395 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f4067f13-b908-4615-8a29-50ad73f16bc6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:27.267617 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f4067f13-b908-4615-8a29-50ad73f16bc6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f" status: 200 len: 1563 microversion: 2.25 time: 0.171980 Jun 20 12:05:27.268405 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 965/1932] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:05:27 2022] GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f => generated 1563 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:05:27.353059 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-54afe8e2-9a25-467f-b37a-1691a7571fba tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073d978b0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:27.400469 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-54afe8e2-9a25-467f-b37a-1691a7571fba tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba" status: 200 len: 1455 microversion: 2.1 time: 0.051571 Jun 20 12:05:27.401145 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 968/1933] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:27 2022] GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba => generated 1455 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:27.443303 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-60c6e1ad-3830-4865-846b-4b7aac4bf0af tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:27.443891 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-60c6e1ad-3830-4865-846b-4b7aac4bf0af tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:27.451876 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-60c6e1ad-3830-4865-846b-4b7aac4bf0af tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:27.452354 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-60c6e1ad-3830-4865-846b-4b7aac4bf0af tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:27.453148 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-60c6e1ad-3830-4865-846b-4b7aac4bf0af tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:27.454022 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-60c6e1ad-3830-4865-846b-4b7aac4bf0af tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:27.590004 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-60c6e1ad-3830-4865-846b-4b7aac4bf0af tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:27.600247 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-60c6e1ad-3830-4865-846b-4b7aac4bf0af tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 200 len: 1308 microversion: 2.1 time: 0.160849 Jun 20 12:05:27.601022 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 966/1934] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:27 2022] GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 1308 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:27.654206 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cb87e971-fd08-4d46-a9b3-004e830c23c5 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:27.655018 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cb87e971-fd08-4d46-a9b3-004e830c23c5 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:27.661386 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cb87e971-fd08-4d46-a9b3-004e830c23c5 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:27.661899 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cb87e971-fd08-4d46-a9b3-004e830c23c5 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:27.662807 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cb87e971-fd08-4d46-a9b3-004e830c23c5 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:27.663242 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cb87e971-fd08-4d46-a9b3-004e830c23c5 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:27.666088 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:27.879685 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cb87e971-fd08-4d46-a9b3-004e830c23c5 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:27.888924 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cb87e971-fd08-4d46-a9b3-004e830c23c5 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1314 microversion: 2.1 time: 0.239114 Jun 20 12:05:27.889493 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 969/1935] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:27 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:28.288763 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f7e8f482-65f5-47ee-8e9c-d1677e68bb72 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:28.289710 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f7e8f482-65f5-47ee-8e9c-d1677e68bb72 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:28.298121 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7e8f482-65f5-47ee-8e9c-d1677e68bb72 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:28.298984 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7e8f482-65f5-47ee-8e9c-d1677e68bb72 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:28.299921 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7e8f482-65f5-47ee-8e9c-d1677e68bb72 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:28.300550 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7e8f482-65f5-47ee-8e9c-d1677e68bb72 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:28.418468 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9770e5f3-67a9-454a-8cad-0994fd42b78e tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f607329be50>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:28.484273 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9770e5f3-67a9-454a-8cad-0994fd42b78e tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba" status: 200 len: 1455 microversion: 2.1 time: 0.073905 Jun 20 12:05:28.486900 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 970/1936] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:28 2022] GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba => generated 1455 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:28.494636 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-a937da27-b540-433a-87a4-2281f3e64db8 req-0a491dab-914c-487b-ae65-98df69403879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "838db96b-0c7a-4d7f-9807-44194bc73cff", "name": "network-vif-unplugged", "status": "completed", "tag": "1e4f16ac-a73c-4854-8d0f-a050fb989db4"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:05:28.509631 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-a937da27-b540-433a-87a4-2281f3e64db8 req-0a491dab-914c-487b-ae65-98df69403879 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:28.510520 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-a937da27-b540-433a-87a4-2281f3e64db8 req-0a491dab-914c-487b-ae65-98df69403879 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:28.526353 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-a937da27-b540-433a-87a4-2281f3e64db8 req-0a491dab-914c-487b-ae65-98df69403879 service nova] Creating event network-vif-unplugged:1e4f16ac-a73c-4854-8d0f-a050fb989db4 for instance 838db96b-0c7a-4d7f-9807-44194bc73cff on n-h1-master-1 Jun 20 12:05:28.526967 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f7e8f482-65f5-47ee-8e9c-d1677e68bb72 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:28.533515 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-a937da27-b540-433a-87a4-2281f3e64db8 req-0a491dab-914c-487b-ae65-98df69403879 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045195 Jun 20 12:05:28.535459 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 971/1937] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:05:28.535645 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f7e8f482-65f5-47ee-8e9c-d1677e68bb72 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:28.537457 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f7e8f482-65f5-47ee-8e9c-d1677e68bb72 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:28.538364 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f7e8f482-65f5-47ee-8e9c-d1677e68bb72 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f" status: 200 len: 1563 microversion: 2.25 time: 0.255950 Jun 20 12:05:28.539570 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 967/1938] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:05:28 2022] GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f => generated 1563 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:05:28.620282 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-83886f91-9dfb-4152-80c6-598b34babc60 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:28.622462 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-83886f91-9dfb-4152-80c6-598b34babc60 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:28.631865 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-83886f91-9dfb-4152-80c6-598b34babc60 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:28.632605 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-83886f91-9dfb-4152-80c6-598b34babc60 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:28.633844 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-83886f91-9dfb-4152-80c6-598b34babc60 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:28.634933 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-83886f91-9dfb-4152-80c6-598b34babc60 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:28.906098 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-714ae393-91f7-4cc3-8012-1ac058c7d169 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:28.906945 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-714ae393-91f7-4cc3-8012-1ac058c7d169 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:28.913857 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-714ae393-91f7-4cc3-8012-1ac058c7d169 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:28.914537 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-714ae393-91f7-4cc3-8012-1ac058c7d169 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:28.915651 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-714ae393-91f7-4cc3-8012-1ac058c7d169 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:28.916271 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-714ae393-91f7-4cc3-8012-1ac058c7d169 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:28.950191 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-83886f91-9dfb-4152-80c6-598b34babc60 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:28.959115 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-83886f91-9dfb-4152-80c6-598b34babc60 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 200 len: 1308 microversion: 2.1 time: 0.345104 Jun 20 12:05:28.959715 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 972/1939] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:28 2022] GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 1308 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:05:29.059506 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-714ae393-91f7-4cc3-8012-1ac058c7d169 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:29.067801 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-714ae393-91f7-4cc3-8012-1ac058c7d169 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1314 microversion: 2.1 time: 0.165816 Jun 20 12:05:29.068499 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 968/1940] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:28 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:05:29.497783 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-db046354-f86d-4bb5-988a-43f150a31801 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073f253a0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:29.545324 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-db046354-f86d-4bb5-988a-43f150a31801 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba" status: 200 len: 1455 microversion: 2.1 time: 0.051959 Jun 20 12:05:29.545919 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 973/1941] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:29 2022] GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba => generated 1455 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:29.559650 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-31aa5299-105d-4d2b-8d4b-012328e99c16 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:29.560323 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-31aa5299-105d-4d2b-8d4b-012328e99c16 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:29.568014 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-31aa5299-105d-4d2b-8d4b-012328e99c16 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:29.568502 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-31aa5299-105d-4d2b-8d4b-012328e99c16 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:29.569293 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-31aa5299-105d-4d2b-8d4b-012328e99c16 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:29.569741 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-31aa5299-105d-4d2b-8d4b-012328e99c16 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:29.713368 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-31aa5299-105d-4d2b-8d4b-012328e99c16 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:29.725743 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-31aa5299-105d-4d2b-8d4b-012328e99c16 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:29.728182 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-31aa5299-105d-4d2b-8d4b-012328e99c16 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:29.729811 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-31aa5299-105d-4d2b-8d4b-012328e99c16 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f" status: 200 len: 1563 microversion: 2.25 time: 0.174825 Jun 20 12:05:29.730492 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 969/1942] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:05:29 2022] GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f => generated 1563 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:05:29.976190 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ae0e4f80-8bc3-4144-bc14-c7b0e12d0d2d tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:29.977322 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ae0e4f80-8bc3-4144-bc14-c7b0e12d0d2d tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:29.984084 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ae0e4f80-8bc3-4144-bc14-c7b0e12d0d2d tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:29.984679 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ae0e4f80-8bc3-4144-bc14-c7b0e12d0d2d tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:29.985460 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ae0e4f80-8bc3-4144-bc14-c7b0e12d0d2d tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:29.985899 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ae0e4f80-8bc3-4144-bc14-c7b0e12d0d2d tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:30.084757 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-edd2a4a8-d384-4e8d-ad48-49ddb7aa388f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:30.085379 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-edd2a4a8-d384-4e8d-ad48-49ddb7aa388f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:30.091956 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-edd2a4a8-d384-4e8d-ad48-49ddb7aa388f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:30.092465 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-edd2a4a8-d384-4e8d-ad48-49ddb7aa388f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:30.093242 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-edd2a4a8-d384-4e8d-ad48-49ddb7aa388f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:30.093744 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-edd2a4a8-d384-4e8d-ad48-49ddb7aa388f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:30.130737 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ae0e4f80-8bc3-4144-bc14-c7b0e12d0d2d tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:30.139543 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ae0e4f80-8bc3-4144-bc14-c7b0e12d0d2d tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 200 len: 1308 microversion: 2.1 time: 0.167425 Jun 20 12:05:30.140447 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 974/1943] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:29 2022] GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 1308 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:30.252658 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-edd2a4a8-d384-4e8d-ad48-49ddb7aa388f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:30.260153 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-edd2a4a8-d384-4e8d-ad48-49ddb7aa388f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1314 microversion: 2.1 time: 0.179140 Jun 20 12:05:30.260926 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 970/1944] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:30 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:05:30.559218 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d82bd8b7-4b86-404e-b084-6fb694dad6c0 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073ca4310>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:30.608919 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d82bd8b7-4b86-404e-b084-6fb694dad6c0 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba" status: 200 len: 1455 microversion: 2.1 time: 0.053808 Jun 20 12:05:30.609507 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 975/1945] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:30 2022] GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba => generated 1455 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:30.752516 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-94e1d83b-dd62-48fa-be4f-c684e3a3b4f9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:30.754435 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-94e1d83b-dd62-48fa-be4f-c684e3a3b4f9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:30.767013 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94e1d83b-dd62-48fa-be4f-c684e3a3b4f9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:30.768134 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94e1d83b-dd62-48fa-be4f-c684e3a3b4f9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:30.769963 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94e1d83b-dd62-48fa-be4f-c684e3a3b4f9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:30.770969 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94e1d83b-dd62-48fa-be4f-c684e3a3b4f9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:31.050267 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-94e1d83b-dd62-48fa-be4f-c684e3a3b4f9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:31.060150 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-94e1d83b-dd62-48fa-be4f-c684e3a3b4f9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:31.061710 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-94e1d83b-dd62-48fa-be4f-c684e3a3b4f9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:31.062901 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-94e1d83b-dd62-48fa-be4f-c684e3a3b4f9 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f" status: 200 len: 1563 microversion: 2.25 time: 0.317677 Jun 20 12:05:31.063430 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 971/1946] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:05:30 2022] GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f => generated 1563 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:05:31.157374 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-017d1208-509a-4e44-9a0b-7018ca8324bf tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:31.157987 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-017d1208-509a-4e44-9a0b-7018ca8324bf tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:31.168064 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-017d1208-509a-4e44-9a0b-7018ca8324bf tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:31.168636 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-017d1208-509a-4e44-9a0b-7018ca8324bf tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:31.169446 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-017d1208-509a-4e44-9a0b-7018ca8324bf tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:31.169889 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-017d1208-509a-4e44-9a0b-7018ca8324bf tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:31.278048 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-82efd13e-f5af-4870-a3df-713444504c09 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:31.278840 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-82efd13e-f5af-4870-a3df-713444504c09 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:31.291882 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-82efd13e-f5af-4870-a3df-713444504c09 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:31.292875 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-82efd13e-f5af-4870-a3df-713444504c09 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:31.293870 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-82efd13e-f5af-4870-a3df-713444504c09 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:31.294700 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-82efd13e-f5af-4870-a3df-713444504c09 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:31.320378 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-017d1208-509a-4e44-9a0b-7018ca8324bf tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:31.338150 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-017d1208-509a-4e44-9a0b-7018ca8324bf tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 200 len: 1308 microversion: 2.1 time: 0.183826 Jun 20 12:05:31.348092 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 976/1947] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:31 2022] GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 1308 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:31.517711 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-82efd13e-f5af-4870-a3df-713444504c09 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:31.525555 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-82efd13e-f5af-4870-a3df-713444504c09 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1314 microversion: 2.1 time: 0.251789 Jun 20 12:05:31.526301 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 972/1948] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:31 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:31.624053 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-58888832-0d1b-4c4f-a3e6-d8a6b96ad378 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073b17790>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:31.668949 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-58888832-0d1b-4c4f-a3e6-d8a6b96ad378 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba" status: 200 len: 1455 microversion: 2.1 time: 0.049533 Jun 20 12:05:31.669765 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 977/1949] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:31 2022] GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba => generated 1455 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:32.081903 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c30335d5-e8b0-4e9d-a1b5-c14d2e9b54f4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:32.082457 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c30335d5-e8b0-4e9d-a1b5-c14d2e9b54f4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:32.089437 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c30335d5-e8b0-4e9d-a1b5-c14d2e9b54f4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:32.089896 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c30335d5-e8b0-4e9d-a1b5-c14d2e9b54f4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:32.090684 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c30335d5-e8b0-4e9d-a1b5-c14d2e9b54f4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:32.091122 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c30335d5-e8b0-4e9d-a1b5-c14d2e9b54f4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:32.355475 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f30809b9-a4b0-400f-a0da-46a7ecc3cea0 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:32.356101 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f30809b9-a4b0-400f-a0da-46a7ecc3cea0 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:32.371382 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f30809b9-a4b0-400f-a0da-46a7ecc3cea0 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:32.372122 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f30809b9-a4b0-400f-a0da-46a7ecc3cea0 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:32.373183 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f30809b9-a4b0-400f-a0da-46a7ecc3cea0 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:32.373826 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f30809b9-a4b0-400f-a0da-46a7ecc3cea0 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:32.391601 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c30335d5-e8b0-4e9d-a1b5-c14d2e9b54f4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:32.404396 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c30335d5-e8b0-4e9d-a1b5-c14d2e9b54f4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:32.407145 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c30335d5-e8b0-4e9d-a1b5-c14d2e9b54f4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:32.408927 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c30335d5-e8b0-4e9d-a1b5-c14d2e9b54f4 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f" status: 200 len: 1563 microversion: 2.25 time: 0.330959 Jun 20 12:05:32.422242 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 973/1950] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:05:32 2022] GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f => generated 1563 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:05:32.544118 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-57f46665-c088-41c4-aad1-f6feff9dda05 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:32.544825 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-57f46665-c088-41c4-aad1-f6feff9dda05 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:32.553316 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-57f46665-c088-41c4-aad1-f6feff9dda05 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:32.557209 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-57f46665-c088-41c4-aad1-f6feff9dda05 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:32.559575 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-57f46665-c088-41c4-aad1-f6feff9dda05 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:32.561088 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-57f46665-c088-41c4-aad1-f6feff9dda05 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:32.571560 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:32.743308 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f30809b9-a4b0-400f-a0da-46a7ecc3cea0 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:32.755102 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f30809b9-a4b0-400f-a0da-46a7ecc3cea0 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 200 len: 1308 microversion: 2.1 time: 0.403658 Jun 20 12:05:32.756347 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 978/1951] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:32 2022] GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 1308 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:05:32.762832 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dd091254-813d-4121-a60e-12a1c5cba82d tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073b76f70>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:32.826535 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dd091254-813d-4121-a60e-12a1c5cba82d tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba" status: 200 len: 1455 microversion: 2.1 time: 0.068612 Jun 20 12:05:32.827142 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 979/1952] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:32 2022] GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba => generated 1455 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:32.833215 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-322d4a96-e94c-4f26-81a8-ee93520f0ee8 req-571ffdda-cc20-4d5a-ab3e-7bc70ca92bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6a95c21-d3d4-4867-9ae6-7e9f3183f974", "name": "network-vif-plugged", "status": "completed", "tag": "8bda50e5-6e28-4aed-a096-d1e45e7df107"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:05:32.844718 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-322d4a96-e94c-4f26-81a8-ee93520f0ee8 req-571ffdda-cc20-4d5a-ab3e-7bc70ca92bf2 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:32.845440 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-322d4a96-e94c-4f26-81a8-ee93520f0ee8 req-571ffdda-cc20-4d5a-ab3e-7bc70ca92bf2 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:32.862872 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-322d4a96-e94c-4f26-81a8-ee93520f0ee8 req-571ffdda-cc20-4d5a-ab3e-7bc70ca92bf2 service nova] Creating event network-vif-plugged:8bda50e5-6e28-4aed-a096-d1e45e7df107 for instance c6a95c21-d3d4-4867-9ae6-7e9f3183f974 on n-h2-master-1 Jun 20 12:05:32.893604 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-322d4a96-e94c-4f26-81a8-ee93520f0ee8 req-571ffdda-cc20-4d5a-ab3e-7bc70ca92bf2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062466 Jun 20 12:05:32.894941 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 980/1953] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:05:33.044811 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-574badc8-d204-43d6-bdd7-a0db7fe3da2c tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:33.045886 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-574badc8-d204-43d6-bdd7-a0db7fe3da2c tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:33.059081 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-574badc8-d204-43d6-bdd7-a0db7fe3da2c tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:33.059540 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-574badc8-d204-43d6-bdd7-a0db7fe3da2c tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:33.060549 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-574badc8-d204-43d6-bdd7-a0db7fe3da2c tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:33.060994 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-574badc8-d204-43d6-bdd7-a0db7fe3da2c tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:33.221392 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-57f46665-c088-41c4-aad1-f6feff9dda05 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:33.230107 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-57f46665-c088-41c4-aad1-f6feff9dda05 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1314 microversion: 2.1 time: 0.691096 Jun 20 12:05:33.231132 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 974/1954] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:32 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1314 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:33.372646 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-574badc8-d204-43d6-bdd7-a0db7fe3da2c tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1857 microversion: 2.1 time: 0.332553 Jun 20 12:05:33.373672 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 981/1955] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:33 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1857 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:33.389844 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d62a88da-1172-4b3a-b515-357364ce77f3 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:05:33.391037 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d62a88da-1172-4b3a-b515-357364ce77f3 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:33.397779 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d62a88da-1172-4b3a-b515-357364ce77f3 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:33.398226 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d62a88da-1172-4b3a-b515-357364ce77f3 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:33.399174 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d62a88da-1172-4b3a-b515-357364ce77f3 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:33.399645 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d62a88da-1172-4b3a-b515-357364ce77f3 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:33.430310 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8c78cd64-9048-48fd-8eef-856484b3174e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:33.431100 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8c78cd64-9048-48fd-8eef-856484b3174e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:33.439088 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8c78cd64-9048-48fd-8eef-856484b3174e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:33.439565 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8c78cd64-9048-48fd-8eef-856484b3174e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:33.440341 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8c78cd64-9048-48fd-8eef-856484b3174e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:33.441076 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8c78cd64-9048-48fd-8eef-856484b3174e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:33.456656 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-d62a88da-1172-4b3a-b515-357364ce77f3 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lazy-loading 'flavor' on Instance uuid 31066575-9374-412f-9c63-ad5162254777 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:05:33.475411 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d62a88da-1172-4b3a-b515-357364ce77f3 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] [instance: 31066575-9374-412f-9c63-ad5162254777] Going to try to live migrate instance to n-h2-master-1 {{(pid=119128) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 20 12:05:33.542449 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8c78cd64-9048-48fd-8eef-856484b3174e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:33.551646 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8c78cd64-9048-48fd-8eef-856484b3174e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:33.553227 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8c78cd64-9048-48fd-8eef-856484b3174e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:33.554414 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8c78cd64-9048-48fd-8eef-856484b3174e tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f" status: 200 len: 1521 microversion: 2.25 time: 0.128353 Jun 20 12:05:33.554987 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 982/1956] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:05:33 2022] GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f => generated 1521 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:05:33.565813 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-b0f2f980-d740-4bf9-bb5c-72a65e87366f req-5898c25c-481c-4f88-8f41-6afc90672f09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddbdd7f1-6b17-4f7a-9793-873b18c7a92f", "name": "network-vif-deleted", "tag": "be0d0765-87a0-4732-987c-66193517041e"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:05:33.575260 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b0f2f980-d740-4bf9-bb5c-72a65e87366f req-5898c25c-481c-4f88-8f41-6afc90672f09 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:33.575776 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b0f2f980-d740-4bf9-bb5c-72a65e87366f req-5898c25c-481c-4f88-8f41-6afc90672f09 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:33.588538 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-b0f2f980-d740-4bf9-bb5c-72a65e87366f req-5898c25c-481c-4f88-8f41-6afc90672f09 service nova] Creating event network-vif-deleted:be0d0765-87a0-4732-987c-66193517041e for instance ddbdd7f1-6b17-4f7a-9793-873b18c7a92f on n-h2-master-1 Jun 20 12:05:33.593924 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-b0f2f980-d740-4bf9-bb5c-72a65e87366f req-5898c25c-481c-4f88-8f41-6afc90672f09 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037769 Jun 20 12:05:33.594532 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 983/1957] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:05:33.782902 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-54f732c2-edc6-44f5-a220-bc90a68d3276 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:33.784154 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-54f732c2-edc6-44f5-a220-bc90a68d3276 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:33.805498 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-54f732c2-edc6-44f5-a220-bc90a68d3276 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:33.806553 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-54f732c2-edc6-44f5-a220-bc90a68d3276 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:33.808731 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-54f732c2-edc6-44f5-a220-bc90a68d3276 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:33.809529 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-54f732c2-edc6-44f5-a220-bc90a68d3276 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:34.009427 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-54f732c2-edc6-44f5-a220-bc90a68d3276 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:34.024894 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-54f732c2-edc6-44f5-a220-bc90a68d3276 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 200 len: 1308 microversion: 2.1 time: 0.251254 Jun 20 12:05:34.025902 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 984/1958] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:33 2022] GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 1308 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:34.033198 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b6c83816-e8e7-474c-b43a-ae5dd2282d54 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073fb7940>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:34.082982 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b6c83816-e8e7-474c-b43a-ae5dd2282d54 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba" status: 200 len: 1455 microversion: 2.1 time: 0.055627 Jun 20 12:05:34.083645 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 985/1959] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:34 2022] GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba => generated 1455 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:34.248351 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7e60d806-7cbe-4b44-b37e-25423dcd248d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:34.248982 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7e60d806-7cbe-4b44-b37e-25423dcd248d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:34.255783 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7e60d806-7cbe-4b44-b37e-25423dcd248d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:34.256252 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7e60d806-7cbe-4b44-b37e-25423dcd248d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:34.257051 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7e60d806-7cbe-4b44-b37e-25423dcd248d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:34.257495 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7e60d806-7cbe-4b44-b37e-25423dcd248d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:34.446530 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7e60d806-7cbe-4b44-b37e-25423dcd248d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:34.457804 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7e60d806-7cbe-4b44-b37e-25423dcd248d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1314 microversion: 2.1 time: 0.214452 Jun 20 12:05:34.459677 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 986/1960] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:34 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:34.579818 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bc4b03aa-c387-44fa-8bb2-92e5567b3151 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:34.581486 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bc4b03aa-c387-44fa-8bb2-92e5567b3151 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:34.589900 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc4b03aa-c387-44fa-8bb2-92e5567b3151 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:34.590580 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc4b03aa-c387-44fa-8bb2-92e5567b3151 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:34.591538 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc4b03aa-c387-44fa-8bb2-92e5567b3151 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:34.592031 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc4b03aa-c387-44fa-8bb2-92e5567b3151 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:34.640424 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc4b03aa-c387-44fa-8bb2-92e5567b3151 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:34.640892 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc4b03aa-c387-44fa-8bb2-92e5567b3151 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:34.641354 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-bc4b03aa-c387-44fa-8bb2-92e5567b3151 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lazy-loading 'fault' on Instance uuid ddbdd7f1-6b17-4f7a-9793-873b18c7a92f {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:05:34.695828 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bc4b03aa-c387-44fa-8bb2-92e5567b3151 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:34.722066 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bc4b03aa-c387-44fa-8bb2-92e5567b3151 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:34.723964 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bc4b03aa-c387-44fa-8bb2-92e5567b3151 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b429a092ac04479eb8644bc82972234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fdba36a70464a8e816944a7f29e47cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:34.725984 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bc4b03aa-c387-44fa-8bb2-92e5567b3151 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f" status: 200 len: 1351 microversion: 2.25 time: 0.155244 Jun 20 12:05:34.737040 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 987/1961] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:05:34 2022] GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f => generated 1351 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:05:35.043309 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9a697e64-25d9-4ddd-b574-d21e993d2028 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:35.044007 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9a697e64-25d9-4ddd-b574-d21e993d2028 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:35.050747 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:35.060064 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a697e64-25d9-4ddd-b574-d21e993d2028 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:35.060473 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a697e64-25d9-4ddd-b574-d21e993d2028 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:35.061601 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a697e64-25d9-4ddd-b574-d21e993d2028 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:35.062893 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a697e64-25d9-4ddd-b574-d21e993d2028 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:35.233777 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9a697e64-25d9-4ddd-b574-d21e993d2028 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:35.242493 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9a697e64-25d9-4ddd-b574-d21e993d2028 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 200 len: 1308 microversion: 2.1 time: 0.203458 Jun 20 12:05:35.252516 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 988/1962] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:35 2022] GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 1308 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:05:35.282505 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ad734d57-8fe8-4f7b-92f1-380d8aba019e tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073f78d30>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:35.360627 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ad734d57-8fe8-4f7b-92f1-380d8aba019e tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba" status: 200 len: 1455 microversion: 2.1 time: 0.105924 Jun 20 12:05:35.376550 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 989/1963] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:35 2022] GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba => generated 1455 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:35.477157 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-08ee269d-aca6-4630-a9ec-c6e0d0c9ea4e tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:35.477864 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-08ee269d-aca6-4630-a9ec-c6e0d0c9ea4e tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:35.486601 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-08ee269d-aca6-4630-a9ec-c6e0d0c9ea4e tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:35.487190 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-08ee269d-aca6-4630-a9ec-c6e0d0c9ea4e tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:35.488605 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-08ee269d-aca6-4630-a9ec-c6e0d0c9ea4e tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:35.489134 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-08ee269d-aca6-4630-a9ec-c6e0d0c9ea4e tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:35.690877 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-08ee269d-aca6-4630-a9ec-c6e0d0c9ea4e tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:35.703376 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d62a88da-1172-4b3a-b515-357364ce77f3 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777/action" status: 202 len: 0 microversion: 2.1 time: 2.317552 Jun 20 12:05:35.708152 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 975/1964] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:05:33 2022] POST /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777/action => generated 0 bytes in 2323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 12:05:35.708759 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-08ee269d-aca6-4630-a9ec-c6e0d0c9ea4e tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1314 microversion: 2.1 time: 0.235805 Jun 20 12:05:35.709517 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 990/1965] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:35 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:35.736773 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7812457a-2a5d-466b-913e-4e7cb4c05834 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:35.737829 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7812457a-2a5d-466b-913e-4e7cb4c05834 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:35.744225 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-629514f0-4159-4783-9671-f5a09cbcc6f6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:35.744913 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-629514f0-4159-4783-9671-f5a09cbcc6f6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] [instance: ddbdd7f1-6b17-4f7a-9793-873b18c7a92f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:35.751096 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7812457a-2a5d-466b-913e-4e7cb4c05834 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:35.751407 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-629514f0-4159-4783-9671-f5a09cbcc6f6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:35.751861 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-629514f0-4159-4783-9671-f5a09cbcc6f6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:35.752333 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7812457a-2a5d-466b-913e-4e7cb4c05834 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:35.753478 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7812457a-2a5d-466b-913e-4e7cb4c05834 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:35.754118 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7812457a-2a5d-466b-913e-4e7cb4c05834 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:35.757889 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-629514f0-4159-4783-9671-f5a09cbcc6f6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:35.758372 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-629514f0-4159-4783-9671-f5a09cbcc6f6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:35.786480 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-629514f0-4159-4783-9671-f5a09cbcc6f6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] HTTP exception thrown: Instance ddbdd7f1-6b17-4f7a-9793-873b18c7a92f could not be found. Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-629514f0-4159-4783-9671-f5a09cbcc6f6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Request method failure captured: Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f HTTP/1.1 Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGCBMY-AP50A_VodPQvWrCmK6cXM5FqVZ1Pch-fMzkO-vU11pLif_nsOE3Xirc2LdA-h5YH9YMy3iUoYQpFUAPIvhKDhJqQ51C-klgng5GbH2nJvx6tYGl1866FAd9Thfxo6R2nY1yufJdzq8zol8PXJyP8omaOMbimX0RhCXlsHuPY Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: X-Openstack-Nova-Api-Version: 2.25 Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 7fdba36a70464a8e816944a7f29e47cf Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1789359872 Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7fdba36a70464a8e816944a7f29e47cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7fdba36a70464a8e816944a7f29e47cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7fdba36a70464a8e816944a7f29e47cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7fdba36a70464a8e816944a7f29e47cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1789359872 Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 7fdba36a70464a8e816944a7f29e47cf Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1789359872 Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-LiveAutoBlockMigrationV225Test-1789359872-project Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: b429a092ac04479eb8644bc82972234e Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1789359872-project Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: exception: Instance ddbdd7f1-6b17-4f7a-9793-873b18c7a92f could not be found. Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'ddbdd7f1-6b17-4f7a-9793-873b18c7a92f'} Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddbdd7f1-6b17-4f7a-9793-873b18c7a92f could not be found. Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddbdd7f1-6b17-4f7a-9793-873b18c7a92f could not be found. Jun 20 12:05:35.788291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:05:35.794498 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:05:35.794498 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:05:35.794498 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:05:35.794498 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:05:35.794498 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:05:35.794498 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:05:35.794498 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:05:35.794498 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddbdd7f1-6b17-4f7a-9793-873b18c7a92f could not be found. Jun 20 12:05:35.794498 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:05:35.794498 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-629514f0-4159-4783-9671-f5a09cbcc6f6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] Returning 404 to user: Instance ddbdd7f1-6b17-4f7a-9793-873b18c7a92f could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:05:35.794498 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-629514f0-4159-4783-9671-f5a09cbcc6f6 tempest-LiveAutoBlockMigrationV225Test-1789359872 tempest-LiveAutoBlockMigrationV225Test-1789359872-project] 10.222.0.27 "GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f" status: 404 len: 111 microversion: 2.25 time: 0.050204 Jun 20 12:05:35.795201 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 991/1966] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:05:35 2022] GET /compute/v2.1/servers/ddbdd7f1-6b17-4f7a-9793-873b18c7a92f => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 20 12:05:35.996671 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7812457a-2a5d-466b-913e-4e7cb4c05834 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:36.013585 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7812457a-2a5d-466b-913e-4e7cb4c05834 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1716 microversion: 2.1 time: 0.304019 Jun 20 12:05:36.014638 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 976/1967] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:35 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1716 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:36.259917 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3e391fe6-4497-497a-92bc-f8f6b87471f2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:36.261288 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3e391fe6-4497-497a-92bc-f8f6b87471f2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:36.268866 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e391fe6-4497-497a-92bc-f8f6b87471f2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:36.269301 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e391fe6-4497-497a-92bc-f8f6b87471f2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:36.270109 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e391fe6-4497-497a-92bc-f8f6b87471f2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:36.270528 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e391fe6-4497-497a-92bc-f8f6b87471f2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:36.384722 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-20cedc64-a3ff-4a26-8341-64dfa614f107 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073aef160>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:36.433784 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-20cedc64-a3ff-4a26-8341-64dfa614f107 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba" status: 200 len: 1455 microversion: 2.1 time: 0.052933 Jun 20 12:05:36.434338 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 977/1968] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:36 2022] GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba => generated 1455 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:36.728315 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3cd66554-77de-433d-ba67-44e8ab75646f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:36.729847 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3cd66554-77de-433d-ba67-44e8ab75646f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:36.731553 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3e391fe6-4497-497a-92bc-f8f6b87471f2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:36.737148 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3cd66554-77de-433d-ba67-44e8ab75646f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:36.737925 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3cd66554-77de-433d-ba67-44e8ab75646f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:36.739153 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3cd66554-77de-433d-ba67-44e8ab75646f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:36.739785 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3cd66554-77de-433d-ba67-44e8ab75646f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:36.740607 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3e391fe6-4497-497a-92bc-f8f6b87471f2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 200 len: 1489 microversion: 2.1 time: 0.484586 Jun 20 12:05:36.755487 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 992/1969] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:36 2022] GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 1489 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:36.760886 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ce554a45-23db-403b-9b97-7bd009edcf1a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:05:36.770594 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ce554a45-23db-403b-9b97-7bd009edcf1a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:36.771981 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ce554a45-23db-403b-9b97-7bd009edcf1a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:36.854539 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ce554a45-23db-403b-9b97-7bd009edcf1a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Going to try to stop instance {{(pid=119127) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 20 12:05:36.924154 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ce554a45-23db-403b-9b97-7bd009edcf1a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "POST /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974/action" status: 202 len: 0 microversion: 2.1 time: 0.166398 Jun 20 12:05:36.925043 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 993/1970] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:05:36 2022] POST /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:05:36.940327 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-57736c13-bd21-4643-b189-dfafc1221ba5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:36.942291 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-57736c13-bd21-4643-b189-dfafc1221ba5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:36.951397 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3cd66554-77de-433d-ba67-44e8ab75646f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:36.957804 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57736c13-bd21-4643-b189-dfafc1221ba5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:36.958277 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57736c13-bd21-4643-b189-dfafc1221ba5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:36.961328 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57736c13-bd21-4643-b189-dfafc1221ba5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:36.961809 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57736c13-bd21-4643-b189-dfafc1221ba5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:36.962709 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3cd66554-77de-433d-ba67-44e8ab75646f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1314 microversion: 2.1 time: 0.239492 Jun 20 12:05:36.964257 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 978/1971] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:36 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:36.974197 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:37.032624 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ce052795-daac-49e4-bf52-b7d6eee49a94 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:37.033645 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ce052795-daac-49e4-bf52-b7d6eee49a94 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:37.040181 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce052795-daac-49e4-bf52-b7d6eee49a94 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:37.041530 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce052795-daac-49e4-bf52-b7d6eee49a94 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:37.043069 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce052795-daac-49e4-bf52-b7d6eee49a94 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:37.043687 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce052795-daac-49e4-bf52-b7d6eee49a94 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:37.324108 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ce052795-daac-49e4-bf52-b7d6eee49a94 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:37.337290 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ce052795-daac-49e4-bf52-b7d6eee49a94 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1716 microversion: 2.1 time: 0.309251 Jun 20 12:05:37.338798 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 979/1972] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:37 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1716 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:37.447441 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f61fa00b-f024-4c33-84ae-05f6d0d7dd16 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073f58310>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:37.498659 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f61fa00b-f024-4c33-84ae-05f6d0d7dd16 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba" status: 200 len: 1455 microversion: 2.1 time: 0.055279 Jun 20 12:05:37.499309 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 980/1973] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:37 2022] GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba => generated 1455 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:05:37.634195 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-57736c13-bd21-4643-b189-dfafc1221ba5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:37.643165 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-57736c13-bd21-4643-b189-dfafc1221ba5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 200 len: 1499 microversion: 2.1 time: 0.713701 Jun 20 12:05:37.643746 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 994/1974] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:36 2022] GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 1499 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:37.980450 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-54bd457c-a800-4a81-9e61-824a55687fc2 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:37.981778 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-54bd457c-a800-4a81-9e61-824a55687fc2 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:37.988766 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-54bd457c-a800-4a81-9e61-824a55687fc2 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:37.989410 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-54bd457c-a800-4a81-9e61-824a55687fc2 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:37.990735 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-54bd457c-a800-4a81-9e61-824a55687fc2 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:38.004044 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-54bd457c-a800-4a81-9e61-824a55687fc2 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:38.075690 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-be018e1c-6d6b-4ce7-b3e3-6c911cc8ecc9 req-d7f1feaf-3c1e-4e0e-a1b3-ffbb5d3a0323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9be8ed90-c9d0-4d98-b1b8-cc3395caffd1", "name": "network-vif-plugged", "status": "completed", "tag": "67d89a40-681d-4bfe-91dc-777e7d773c40"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:05:38.088351 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-be018e1c-6d6b-4ce7-b3e3-6c911cc8ecc9 req-d7f1feaf-3c1e-4e0e-a1b3-ffbb5d3a0323 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:38.092955 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-be018e1c-6d6b-4ce7-b3e3-6c911cc8ecc9 req-d7f1feaf-3c1e-4e0e-a1b3-ffbb5d3a0323 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:38.113378 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-be018e1c-6d6b-4ce7-b3e3-6c911cc8ecc9 req-d7f1feaf-3c1e-4e0e-a1b3-ffbb5d3a0323 service nova] Creating event network-vif-plugged:67d89a40-681d-4bfe-91dc-777e7d773c40 for instance 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 on n-h2-master-1 Jun 20 12:05:38.120671 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-be018e1c-6d6b-4ce7-b3e3-6c911cc8ecc9 req-d7f1feaf-3c1e-4e0e-a1b3-ffbb5d3a0323 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048533 Jun 20 12:05:38.121890 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 995/1975] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:05:38.357027 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c6e92010-782e-41a4-ba02-dd6fad2c2a93 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:38.358025 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c6e92010-782e-41a4-ba02-dd6fad2c2a93 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:38.374192 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6e92010-782e-41a4-ba02-dd6fad2c2a93 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:38.374887 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6e92010-782e-41a4-ba02-dd6fad2c2a93 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:38.375825 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6e92010-782e-41a4-ba02-dd6fad2c2a93 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:38.379417 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6e92010-782e-41a4-ba02-dd6fad2c2a93 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:38.694809 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c6e92010-782e-41a4-ba02-dd6fad2c2a93 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:38.706215 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c6e92010-782e-41a4-ba02-dd6fad2c2a93 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1716 microversion: 2.1 time: 0.354784 Jun 20 12:05:38.714964 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 996/1976] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:38 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1716 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:05:38.716310 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c1216238-34a1-451b-8778-aa7148031db9 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073a8e4c0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:38.774490 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c1216238-34a1-451b-8778-aa7148031db9 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba" status: 200 len: 1455 microversion: 2.1 time: 0.066102 Jun 20 12:05:38.775754 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 997/1977] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:38 2022] GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba => generated 1455 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:38.782938 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6d96c172-90ac-4ac7-932d-890079516123 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:38.783871 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6d96c172-90ac-4ac7-932d-890079516123 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:38.790944 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6d96c172-90ac-4ac7-932d-890079516123 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:38.792049 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6d96c172-90ac-4ac7-932d-890079516123 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:38.793257 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6d96c172-90ac-4ac7-932d-890079516123 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:38.793908 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6d96c172-90ac-4ac7-932d-890079516123 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:38.864011 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-54bd457c-a800-4a81-9e61-824a55687fc2 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:38.874268 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-54bd457c-a800-4a81-9e61-824a55687fc2 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1314 microversion: 2.1 time: 0.898136 Jun 20 12:05:38.875134 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 981/1978] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:37 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1314 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:39.041118 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6d96c172-90ac-4ac7-932d-890079516123 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:39.050838 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6d96c172-90ac-4ac7-932d-890079516123 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 200 len: 1499 microversion: 2.1 time: 0.273613 Jun 20 12:05:39.065101 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 998/1979] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:38 2022] GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 1499 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:39.723550 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-67c0332d-5a94-43c3-b4b5-aaaeeac725c9 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:39.724284 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-67c0332d-5a94-43c3-b4b5-aaaeeac725c9 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:39.737608 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-67c0332d-5a94-43c3-b4b5-aaaeeac725c9 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:39.741165 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-67c0332d-5a94-43c3-b4b5-aaaeeac725c9 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:39.742456 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-67c0332d-5a94-43c3-b4b5-aaaeeac725c9 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:39.743095 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-67c0332d-5a94-43c3-b4b5-aaaeeac725c9 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:39.788967 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2dcfbe40-6dad-4bfa-9dff-0bc192a80c2f tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073b17790>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:39.936873 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2dcfbe40-6dad-4bfa-9dff-0bc192a80c2f tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba" status: 200 len: 1455 microversion: 2.1 time: 0.151083 Jun 20 12:05:39.955526 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 999/1980] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:39 2022] GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba => generated 1455 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:39.962927 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6443ec3b-f1c9-4292-96b1-92382992f2d7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:39.964029 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6443ec3b-f1c9-4292-96b1-92382992f2d7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:39.973235 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6443ec3b-f1c9-4292-96b1-92382992f2d7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:39.974102 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6443ec3b-f1c9-4292-96b1-92382992f2d7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:39.975357 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6443ec3b-f1c9-4292-96b1-92382992f2d7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:39.976286 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6443ec3b-f1c9-4292-96b1-92382992f2d7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:40.173855 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-67c0332d-5a94-43c3-b4b5-aaaeeac725c9 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:40.188719 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-67c0332d-5a94-43c3-b4b5-aaaeeac725c9 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1716 microversion: 2.1 time: 0.464448 Jun 20 12:05:40.191022 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 982/1981] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:39 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1716 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:40.203562 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4cba03a2-41d9-4c61-b2ee-b1d86f5d0dd3 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:40.205851 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4cba03a2-41d9-4c61-b2ee-b1d86f5d0dd3 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:40.269257 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4cba03a2-41d9-4c61-b2ee-b1d86f5d0dd3 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:40.269742 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4cba03a2-41d9-4c61-b2ee-b1d86f5d0dd3 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:40.270521 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4cba03a2-41d9-4c61-b2ee-b1d86f5d0dd3 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:40.270955 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4cba03a2-41d9-4c61-b2ee-b1d86f5d0dd3 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:40.338990 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6443ec3b-f1c9-4292-96b1-92382992f2d7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:40.360142 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6443ec3b-f1c9-4292-96b1-92382992f2d7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1314 microversion: 2.1 time: 0.402977 Jun 20 12:05:40.366639 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1000/1982] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:39 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:40.391142 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-3d7a20e5-a658-4a47-be95-eee2572ba164 req-3782251e-c855-4a27-bdaf-34a8880b3fc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7d2499c-a9c8-4c2e-8445-667070737f1f", "name": "network-vif-plugged", "status": "completed", "tag": "4b377c25-4bc9-46b4-9743-511faa7773d1"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:05:40.417435 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-3d7a20e5-a658-4a47-be95-eee2572ba164 req-3782251e-c855-4a27-bdaf-34a8880b3fc3 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:40.418020 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-3d7a20e5-a658-4a47-be95-eee2572ba164 req-3782251e-c855-4a27-bdaf-34a8880b3fc3 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:40.434132 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-3d7a20e5-a658-4a47-be95-eee2572ba164 req-3782251e-c855-4a27-bdaf-34a8880b3fc3 service nova] Creating event network-vif-plugged:4b377c25-4bc9-46b4-9743-511faa7773d1 for instance f7d2499c-a9c8-4c2e-8445-667070737f1f on n-h2-master-1 Jun 20 12:05:40.445403 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-3d7a20e5-a658-4a47-be95-eee2572ba164 req-3782251e-c855-4a27-bdaf-34a8880b3fc3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064829 Jun 20 12:05:40.446146 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1001/1983] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:05:40.859394 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4cba03a2-41d9-4c61-b2ee-b1d86f5d0dd3 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:40.878438 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4cba03a2-41d9-4c61-b2ee-b1d86f5d0dd3 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 200 len: 1499 microversion: 2.1 time: 0.680094 Jun 20 12:05:40.879346 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 983/1984] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:40 2022] GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 1499 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:40.956563 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f7765ced-18c5-4c5e-bf8c-130935291e58 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073365d30>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:41.044166 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f7765ced-18c5-4c5e-bf8c-130935291e58 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba" status: 200 len: 1455 microversion: 2.1 time: 0.093740 Jun 20 12:05:41.045831 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1002/1985] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:40 2022] GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:41.218855 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d5993195-7c76-4efd-a96b-700354ec6409 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:41.221499 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d5993195-7c76-4efd-a96b-700354ec6409 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:41.246326 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d5993195-7c76-4efd-a96b-700354ec6409 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:41.246714 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d5993195-7c76-4efd-a96b-700354ec6409 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:41.250117 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d5993195-7c76-4efd-a96b-700354ec6409 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:41.250564 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d5993195-7c76-4efd-a96b-700354ec6409 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:41.387591 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c2447308-7c19-4be3-8609-f1827ae85a46 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:41.396585 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c2447308-7c19-4be3-8609-f1827ae85a46 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:41.407788 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c2447308-7c19-4be3-8609-f1827ae85a46 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:41.408448 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c2447308-7c19-4be3-8609-f1827ae85a46 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:41.409759 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c2447308-7c19-4be3-8609-f1827ae85a46 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:41.410344 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c2447308-7c19-4be3-8609-f1827ae85a46 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:41.602896 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d5993195-7c76-4efd-a96b-700354ec6409 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:41.614753 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d5993195-7c76-4efd-a96b-700354ec6409 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1716 microversion: 2.1 time: 0.403066 Jun 20 12:05:41.619459 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 984/1986] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:41 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1716 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:41.735786 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c2447308-7c19-4be3-8609-f1827ae85a46 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:41.744469 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c2447308-7c19-4be3-8609-f1827ae85a46 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1501 microversion: 2.1 time: 0.364068 Jun 20 12:05:41.745456 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1003/1987] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:41 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1501 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:41.770766 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2490e370-1fd2-4f7a-adcd-7dc54cab26a1 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:05:41.791942 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2490e370-1fd2-4f7a-adcd-7dc54cab26a1 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:41.793466 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2490e370-1fd2-4f7a-adcd-7dc54cab26a1 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:41.897215 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8160ab43-9b3a-4b30-87ce-7a91c7f195a5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:41.897831 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8160ab43-9b3a-4b30-87ce-7a91c7f195a5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:41.911410 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8160ab43-9b3a-4b30-87ce-7a91c7f195a5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:41.911865 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8160ab43-9b3a-4b30-87ce-7a91c7f195a5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:41.912688 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8160ab43-9b3a-4b30-87ce-7a91c7f195a5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:41.913127 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8160ab43-9b3a-4b30-87ce-7a91c7f195a5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:41.955920 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2490e370-1fd2-4f7a-adcd-7dc54cab26a1 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Going to try to stop instance {{(pid=119128) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 20 12:05:42.082775 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2490e370-1fd2-4f7a-adcd-7dc54cab26a1 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "POST /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1/action" status: 202 len: 0 microversion: 2.1 time: 0.325632 Jun 20 12:05:42.099712 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 985/1988] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:05:41 2022] POST /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:05:42.126275 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3f67be03-7f32-4ed5-83de-d1ea6a32c45a tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073b430d0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:42.227057 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3f67be03-7f32-4ed5-83de-d1ea6a32c45a tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba" status: 200 len: 1455 microversion: 2.1 time: 0.120352 Jun 20 12:05:42.227057 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 986/1989] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:42 2022] GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba => generated 1455 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:42.238258 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2caf1183-873b-4e9f-8482-5e08b435c5bb tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:42.242468 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2caf1183-873b-4e9f-8482-5e08b435c5bb tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:42.260193 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2caf1183-873b-4e9f-8482-5e08b435c5bb tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:42.260887 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2caf1183-873b-4e9f-8482-5e08b435c5bb tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:42.261823 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2caf1183-873b-4e9f-8482-5e08b435c5bb tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:42.262373 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2caf1183-873b-4e9f-8482-5e08b435c5bb tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:42.504224 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8160ab43-9b3a-4b30-87ce-7a91c7f195a5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:42.516334 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8160ab43-9b3a-4b30-87ce-7a91c7f195a5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 200 len: 1499 microversion: 2.1 time: 0.622997 Jun 20 12:05:42.528943 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1004/1990] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:41 2022] GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 1499 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:42.541114 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2caf1183-873b-4e9f-8482-5e08b435c5bb tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:42.552832 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2caf1183-873b-4e9f-8482-5e08b435c5bb tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1511 microversion: 2.1 time: 0.319097 Jun 20 12:05:42.553620 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 987/1991] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:42 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1511 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:42.635536 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6816b1cd-9db3-4d37-807d-6dd466b8ff51 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:42.636469 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6816b1cd-9db3-4d37-807d-6dd466b8ff51 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:42.649666 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6816b1cd-9db3-4d37-807d-6dd466b8ff51 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:42.650359 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6816b1cd-9db3-4d37-807d-6dd466b8ff51 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:42.651671 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6816b1cd-9db3-4d37-807d-6dd466b8ff51 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:42.652685 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6816b1cd-9db3-4d37-807d-6dd466b8ff51 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:43.033637 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6816b1cd-9db3-4d37-807d-6dd466b8ff51 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:43.049172 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6816b1cd-9db3-4d37-807d-6dd466b8ff51 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1716 microversion: 2.1 time: 0.417957 Jun 20 12:05:43.049791 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1005/1992] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:42 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1716 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:43.235646 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a4a9a5cf-f4a1-4f32-8343-1a28deed3a32 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073901c10>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:43.289517 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a4a9a5cf-f4a1-4f32-8343-1a28deed3a32 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba" status: 200 len: 1455 microversion: 2.1 time: 0.058202 Jun 20 12:05:43.290689 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 988/1993] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:43 2022] GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba => generated 1455 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:43.535420 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-985b47ca-6e07-4c37-85db-066a264bb9dc tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:43.535932 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-985b47ca-6e07-4c37-85db-066a264bb9dc tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:43.547689 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-985b47ca-6e07-4c37-85db-066a264bb9dc tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:43.547689 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-985b47ca-6e07-4c37-85db-066a264bb9dc tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:43.547876 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-985b47ca-6e07-4c37-85db-066a264bb9dc tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:43.548195 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-985b47ca-6e07-4c37-85db-066a264bb9dc tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:43.571596 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8394c336-c28c-40d3-a75c-56dc7767252d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:43.572705 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8394c336-c28c-40d3-a75c-56dc7767252d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:43.585369 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8394c336-c28c-40d3-a75c-56dc7767252d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:43.588283 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8394c336-c28c-40d3-a75c-56dc7767252d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:43.591671 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8394c336-c28c-40d3-a75c-56dc7767252d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:43.592490 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8394c336-c28c-40d3-a75c-56dc7767252d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:43.918876 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8394c336-c28c-40d3-a75c-56dc7767252d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:43.928526 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8394c336-c28c-40d3-a75c-56dc7767252d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1511 microversion: 2.1 time: 0.361562 Jun 20 12:05:43.935070 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 989/1994] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:43 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1511 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:05:43.970609 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-985b47ca-6e07-4c37-85db-066a264bb9dc tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:43.984120 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-985b47ca-6e07-4c37-85db-066a264bb9dc tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 200 len: 1499 microversion: 2.1 time: 0.452447 Jun 20 12:05:43.997157 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1006/1995] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:43 2022] GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 1499 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:44.066678 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a6ea5ecb-67da-45c6-ac49-fc145a1ff3f6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:44.067191 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a6ea5ecb-67da-45c6-ac49-fc145a1ff3f6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:44.076007 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6ea5ecb-67da-45c6-ac49-fc145a1ff3f6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:44.078818 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6ea5ecb-67da-45c6-ac49-fc145a1ff3f6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:44.079793 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6ea5ecb-67da-45c6-ac49-fc145a1ff3f6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:44.080271 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6ea5ecb-67da-45c6-ac49-fc145a1ff3f6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:44.303223 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e31b2af6-3c04-4b13-b528-46aba1142dc7 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073ebeaf0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:44.377561 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e31b2af6-3c04-4b13-b528-46aba1142dc7 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba" status: 200 len: 1455 microversion: 2.1 time: 0.078368 Jun 20 12:05:44.384587 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1007/1996] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:44 2022] GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba => generated 1455 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:05:44.530749 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a6ea5ecb-67da-45c6-ac49-fc145a1ff3f6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:44.546617 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a6ea5ecb-67da-45c6-ac49-fc145a1ff3f6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1716 microversion: 2.1 time: 0.484041 Jun 20 12:05:44.556218 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 990/1997] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:44 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1716 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:44.963159 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1f232ee2-bbe8-43bc-ae66-19ce247defa5 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:44.964085 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1f232ee2-bbe8-43bc-ae66-19ce247defa5 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:44.972977 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f232ee2-bbe8-43bc-ae66-19ce247defa5 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:44.973495 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f232ee2-bbe8-43bc-ae66-19ce247defa5 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:44.974287 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f232ee2-bbe8-43bc-ae66-19ce247defa5 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:44.975104 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f232ee2-bbe8-43bc-ae66-19ce247defa5 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:45.005378 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d3ff00e9-5198-4bfe-ad38-8f99914197db tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:45.005378 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d3ff00e9-5198-4bfe-ad38-8f99914197db tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:45.018433 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3ff00e9-5198-4bfe-ad38-8f99914197db tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:45.021856 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3ff00e9-5198-4bfe-ad38-8f99914197db tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:45.026229 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3ff00e9-5198-4bfe-ad38-8f99914197db tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:45.026829 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3ff00e9-5198-4bfe-ad38-8f99914197db tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:45.379655 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d3ff00e9-5198-4bfe-ad38-8f99914197db tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:45.386281 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:45.397222 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d3ff00e9-5198-4bfe-ad38-8f99914197db tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 200 len: 1499 microversion: 2.1 time: 0.397100 Jun 20 12:05:45.400096 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 991/1998] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:44 2022] GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 1499 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:05:45.424238 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d49b3800-7418-4686-a96b-1192b53ef3ca tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073a4cdc0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:45.501309 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d49b3800-7418-4686-a96b-1192b53ef3ca tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba" status: 200 len: 1455 microversion: 2.1 time: 0.097598 Jun 20 12:05:45.502831 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 992/1999] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:45 2022] GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba => generated 1455 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:45.563639 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9d640fee-ca39-4996-ac37-da3d949f30dd tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:45.564423 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9d640fee-ca39-4996-ac37-da3d949f30dd tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:45.580055 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d640fee-ca39-4996-ac37-da3d949f30dd tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:45.581692 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d640fee-ca39-4996-ac37-da3d949f30dd tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:45.583139 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d640fee-ca39-4996-ac37-da3d949f30dd tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:45.583967 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d640fee-ca39-4996-ac37-da3d949f30dd tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:45.596655 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1f232ee2-bbe8-43bc-ae66-19ce247defa5 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:45.607623 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1f232ee2-bbe8-43bc-ae66-19ce247defa5 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1511 microversion: 2.1 time: 0.647709 Jun 20 12:05:45.611087 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1008/2000] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:44 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1511 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:45.895018 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9d640fee-ca39-4996-ac37-da3d949f30dd tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:45.909483 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9d640fee-ca39-4996-ac37-da3d949f30dd tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1716 microversion: 2.1 time: 0.349686 Jun 20 12:05:45.913251 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 993/2001] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:45 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1716 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:05:46.417372 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d77a4b46-f5b0-45b4-953c-6b33806f4354 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:46.418189 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d77a4b46-f5b0-45b4-953c-6b33806f4354 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:46.430788 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d77a4b46-f5b0-45b4-953c-6b33806f4354 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:46.431528 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d77a4b46-f5b0-45b4-953c-6b33806f4354 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:46.433124 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d77a4b46-f5b0-45b4-953c-6b33806f4354 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:46.435756 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d77a4b46-f5b0-45b4-953c-6b33806f4354 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:46.515954 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fce390c4-6206-4376-9f7e-25d073014ecc tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073e93b80>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:46.640151 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fce390c4-6206-4376-9f7e-25d073014ecc tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba" status: 200 len: 1455 microversion: 2.1 time: 0.128716 Jun 20 12:05:46.641963 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 994/2002] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:46 2022] GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba => generated 1455 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:46.648244 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a16b8509-55db-469b-ae4f-169dfa7cee72 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:46.648898 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a16b8509-55db-469b-ae4f-169dfa7cee72 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:46.657955 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a16b8509-55db-469b-ae4f-169dfa7cee72 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:46.659104 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a16b8509-55db-469b-ae4f-169dfa7cee72 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:46.660084 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a16b8509-55db-469b-ae4f-169dfa7cee72 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:46.660733 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a16b8509-55db-469b-ae4f-169dfa7cee72 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:46.816311 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d77a4b46-f5b0-45b4-953c-6b33806f4354 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:46.829562 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d77a4b46-f5b0-45b4-953c-6b33806f4354 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 200 len: 1499 microversion: 2.1 time: 0.416105 Jun 20 12:05:46.831472 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1009/2003] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:46 2022] GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 1499 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:46.917625 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a16b8509-55db-469b-ae4f-169dfa7cee72 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:46.929813 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a601a04f-dafe-4fb2-9c09-d24055efbb22 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:46.930722 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a601a04f-dafe-4fb2-9c09-d24055efbb22 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:46.932991 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a16b8509-55db-469b-ae4f-169dfa7cee72 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1511 microversion: 2.1 time: 0.289612 Jun 20 12:05:46.939805 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 995/2004] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:46 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1511 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:46.941227 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a601a04f-dafe-4fb2-9c09-d24055efbb22 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:46.946370 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a601a04f-dafe-4fb2-9c09-d24055efbb22 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:46.947488 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a601a04f-dafe-4fb2-9c09-d24055efbb22 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:46.948079 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a601a04f-dafe-4fb2-9c09-d24055efbb22 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:47.219755 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a601a04f-dafe-4fb2-9c09-d24055efbb22 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:47.232416 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a601a04f-dafe-4fb2-9c09-d24055efbb22 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1716 microversion: 2.1 time: 0.306603 Jun 20 12:05:47.233342 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1010/2005] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:46 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1716 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:05:47.656285 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4bf0e531-1d13-4757-95b8-4bfec416e9df tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073e93b80>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:47.755428 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4bf0e531-1d13-4757-95b8-4bfec416e9df tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba" status: 200 len: 1455 microversion: 2.1 time: 0.103953 Jun 20 12:05:47.756018 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 996/2006] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:47 2022] GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba => generated 1455 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:47.848989 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-228ae480-6637-4198-94e9-b4ccf4ea76c8 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:47.849834 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-228ae480-6637-4198-94e9-b4ccf4ea76c8 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:47.864128 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-228ae480-6637-4198-94e9-b4ccf4ea76c8 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:47.864766 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-228ae480-6637-4198-94e9-b4ccf4ea76c8 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:47.872132 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-228ae480-6637-4198-94e9-b4ccf4ea76c8 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:47.872994 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-228ae480-6637-4198-94e9-b4ccf4ea76c8 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:47.951612 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-94f4f7b7-ece1-4739-b620-fde3c46bec28 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:47.952498 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-94f4f7b7-ece1-4739-b620-fde3c46bec28 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:47.962730 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94f4f7b7-ece1-4739-b620-fde3c46bec28 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:47.967504 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94f4f7b7-ece1-4739-b620-fde3c46bec28 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:47.968680 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94f4f7b7-ece1-4739-b620-fde3c46bec28 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:47.969321 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94f4f7b7-ece1-4739-b620-fde3c46bec28 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:48.303674 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-228ae480-6637-4198-94e9-b4ccf4ea76c8 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:48.335140 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-228ae480-6637-4198-94e9-b4ccf4ea76c8 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 200 len: 1499 microversion: 2.1 time: 0.487515 Jun 20 12:05:48.337571 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1011/2007] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:47 2022] GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 1499 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:48.354686 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ae7afe2f-5483-4967-82ac-55ab5d2c3bbc tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:48.355565 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ae7afe2f-5483-4967-82ac-55ab5d2c3bbc tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:48.372512 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ae7afe2f-5483-4967-82ac-55ab5d2c3bbc tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:48.376480 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ae7afe2f-5483-4967-82ac-55ab5d2c3bbc tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:48.377639 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ae7afe2f-5483-4967-82ac-55ab5d2c3bbc tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:48.378782 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ae7afe2f-5483-4967-82ac-55ab5d2c3bbc tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:48.449320 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-94f4f7b7-ece1-4739-b620-fde3c46bec28 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:48.477352 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-94f4f7b7-ece1-4739-b620-fde3c46bec28 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1511 microversion: 2.1 time: 0.530806 Jun 20 12:05:48.497984 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 997/2008] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:47 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1511 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:48.776735 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4cc52786-5a77-4c7a-927e-a328d2372efb tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073525430>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:48.884447 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4cc52786-5a77-4c7a-927e-a328d2372efb tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba" status: 200 len: 1455 microversion: 2.1 time: 0.115434 Jun 20 12:05:48.894221 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 998/2009] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:48 2022] GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba => generated 1455 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:49.282998 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ae7afe2f-5483-4967-82ac-55ab5d2c3bbc tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:49.296831 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ae7afe2f-5483-4967-82ac-55ab5d2c3bbc tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1716 microversion: 2.1 time: 0.953014 Jun 20 12:05:49.300986 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1012/2010] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:48 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1716 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:49.360087 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a6403480-c18d-4986-8722-77eace9cf1b7 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:49.361224 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a6403480-c18d-4986-8722-77eace9cf1b7 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:49.385181 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6403480-c18d-4986-8722-77eace9cf1b7 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:49.389092 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6403480-c18d-4986-8722-77eace9cf1b7 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:49.394625 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6403480-c18d-4986-8722-77eace9cf1b7 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:49.395659 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6403480-c18d-4986-8722-77eace9cf1b7 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:49.503195 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4d38c95b-4b66-4744-8715-e8ccaca57049 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:49.504106 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4d38c95b-4b66-4744-8715-e8ccaca57049 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:49.519034 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d38c95b-4b66-4744-8715-e8ccaca57049 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:49.521071 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d38c95b-4b66-4744-8715-e8ccaca57049 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:49.524794 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d38c95b-4b66-4744-8715-e8ccaca57049 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:49.525970 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d38c95b-4b66-4744-8715-e8ccaca57049 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:49.782305 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a6403480-c18d-4986-8722-77eace9cf1b7 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:49.813789 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a6403480-c18d-4986-8722-77eace9cf1b7 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 200 len: 1499 microversion: 2.1 time: 0.457071 Jun 20 12:05:49.836120 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 999/2011] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:49 2022] GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 1499 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:49.846093 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4d38c95b-4b66-4744-8715-e8ccaca57049 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:49.861711 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4d38c95b-4b66-4744-8715-e8ccaca57049 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1511 microversion: 2.1 time: 0.366091 Jun 20 12:05:49.868485 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1013/2012] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:49 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1511 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:49.906477 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d190e36d-458c-48b2-b359-1e6dee314642 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073c81dc0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:50.022716 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d190e36d-458c-48b2-b359-1e6dee314642 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba" status: 200 len: 1455 microversion: 2.1 time: 0.125611 Jun 20 12:05:50.023623 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1000/2013] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:49 2022] GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba => generated 1455 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:50.325232 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ef71e645-9d56-4160-b705-2208cddd919f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:50.325931 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ef71e645-9d56-4160-b705-2208cddd919f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:50.339945 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef71e645-9d56-4160-b705-2208cddd919f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:50.340949 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef71e645-9d56-4160-b705-2208cddd919f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:50.341847 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef71e645-9d56-4160-b705-2208cddd919f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:50.342385 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef71e645-9d56-4160-b705-2208cddd919f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:50.698763 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ef71e645-9d56-4160-b705-2208cddd919f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:50.707368 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ef71e645-9d56-4160-b705-2208cddd919f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1716 microversion: 2.1 time: 0.386691 Jun 20 12:05:50.714512 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1014/2014] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:50 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1716 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:50.835460 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-04cdab43-fae5-4506-b6e4-8f01ad2b2975 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:50.836078 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-04cdab43-fae5-4506-b6e4-8f01ad2b2975 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:50.853138 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-04cdab43-fae5-4506-b6e4-8f01ad2b2975 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:50.854699 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-04cdab43-fae5-4506-b6e4-8f01ad2b2975 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:50.855706 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-04cdab43-fae5-4506-b6e4-8f01ad2b2975 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:50.856225 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-04cdab43-fae5-4506-b6e4-8f01ad2b2975 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:50.884125 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e66bee72-aec7-4632-a284-c19aeb58d3b1 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:50.884862 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e66bee72-aec7-4632-a284-c19aeb58d3b1 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:50.900752 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e66bee72-aec7-4632-a284-c19aeb58d3b1 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:50.901501 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e66bee72-aec7-4632-a284-c19aeb58d3b1 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:50.902370 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e66bee72-aec7-4632-a284-c19aeb58d3b1 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:50.902810 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e66bee72-aec7-4632-a284-c19aeb58d3b1 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:51.247091 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-04cdab43-fae5-4506-b6e4-8f01ad2b2975 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:51.259514 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-04cdab43-fae5-4506-b6e4-8f01ad2b2975 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 200 len: 1499 microversion: 2.1 time: 0.428586 Jun 20 12:05:51.264225 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1001/2015] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:50 2022] GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 1499 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:51.288937 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-517d4de6-31d2-4f3e-a6c3-3bdaa4ab040b tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073c810d0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:51.352944 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e66bee72-aec7-4632-a284-c19aeb58d3b1 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:51.371577 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e66bee72-aec7-4632-a284-c19aeb58d3b1 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1511 microversion: 2.1 time: 0.492380 Jun 20 12:05:51.375102 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1015/2016] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:50 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1511 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:05:51.437398 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-517d4de6-31d2-4f3e-a6c3-3bdaa4ab040b tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba" status: 200 len: 1455 microversion: 2.1 time: 0.171579 Jun 20 12:05:51.438833 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1002/2017] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:51 2022] GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba => generated 1455 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:51.729007 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ac08041b-89e9-4e70-ab98-776012b64d69 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:51.729621 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ac08041b-89e9-4e70-ab98-776012b64d69 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:51.740327 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac08041b-89e9-4e70-ab98-776012b64d69 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:51.742907 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac08041b-89e9-4e70-ab98-776012b64d69 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:51.743911 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac08041b-89e9-4e70-ab98-776012b64d69 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:51.747645 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac08041b-89e9-4e70-ab98-776012b64d69 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:51.756363 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:52.016390 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ac08041b-89e9-4e70-ab98-776012b64d69 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:52.033777 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ac08041b-89e9-4e70-ab98-776012b64d69 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1716 microversion: 2.1 time: 0.308692 Jun 20 12:05:52.034531 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1016/2018] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:51 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1716 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:52.287972 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-14c41074-4953-499e-b7ac-e81001c9063f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:52.293588 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-14c41074-4953-499e-b7ac-e81001c9063f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:52.299006 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:52.324049 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-14c41074-4953-499e-b7ac-e81001c9063f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:52.327481 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-14c41074-4953-499e-b7ac-e81001c9063f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:52.329545 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-14c41074-4953-499e-b7ac-e81001c9063f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:52.345459 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-14c41074-4953-499e-b7ac-e81001c9063f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:52.391845 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0277bfa9-9eae-49f1-b56f-76b0d6c96c97 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:52.393086 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0277bfa9-9eae-49f1-b56f-76b0d6c96c97 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:52.407761 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0277bfa9-9eae-49f1-b56f-76b0d6c96c97 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:52.415231 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0277bfa9-9eae-49f1-b56f-76b0d6c96c97 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:52.420625 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0277bfa9-9eae-49f1-b56f-76b0d6c96c97 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:52.421087 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0277bfa9-9eae-49f1-b56f-76b0d6c96c97 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:52.821004 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0277bfa9-9eae-49f1-b56f-76b0d6c96c97 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:52.835606 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0277bfa9-9eae-49f1-b56f-76b0d6c96c97 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1511 microversion: 2.1 time: 0.448941 Jun 20 12:05:52.841000 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1017/2019] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:52 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1511 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:05:52.848715 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e317cdaf-bf8e-496b-8ac4-dae2ca1a82f6 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073a4b0d0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:52.925916 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e317cdaf-bf8e-496b-8ac4-dae2ca1a82f6 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba" status: 200 len: 1455 microversion: 2.1 time: 0.083496 Jun 20 12:05:52.926751 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1018/2020] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:52 2022] GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba => generated 1455 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:53.041576 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-14c41074-4953-499e-b7ac-e81001c9063f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:53.051143 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1150a9ce-0b4e-466e-8f76-7ab6dfc53b96 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:53.052002 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1150a9ce-0b4e-466e-8f76-7ab6dfc53b96 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:53.055254 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-14c41074-4953-499e-b7ac-e81001c9063f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 200 len: 1499 microversion: 2.1 time: 0.777729 Jun 20 12:05:53.055915 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1003/2021] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:52 2022] GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 1499 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:53.060410 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1150a9ce-0b4e-466e-8f76-7ab6dfc53b96 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:53.061214 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1150a9ce-0b4e-466e-8f76-7ab6dfc53b96 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:53.062191 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1150a9ce-0b4e-466e-8f76-7ab6dfc53b96 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:53.063523 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1150a9ce-0b4e-466e-8f76-7ab6dfc53b96 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:53.316805 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-1e5c96c2-20cf-45b7-af55-9ad83482b07e req-e0f7da6f-f93d-492e-884b-2137d75548a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31066575-9374-412f-9c63-ad5162254777", "name": "network-vif-unplugged", "status": "completed", "tag": "e914de0d-b9de-410a-8338-f6ffef3981c1"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:05:53.353736 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-1e5c96c2-20cf-45b7-af55-9ad83482b07e req-e0f7da6f-f93d-492e-884b-2137d75548a7 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:53.356083 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-1e5c96c2-20cf-45b7-af55-9ad83482b07e req-e0f7da6f-f93d-492e-884b-2137d75548a7 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:53.409302 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-1e5c96c2-20cf-45b7-af55-9ad83482b07e req-e0f7da6f-f93d-492e-884b-2137d75548a7 service nova] Creating event network-vif-unplugged:e914de0d-b9de-410a-8338-f6ffef3981c1 for instance 31066575-9374-412f-9c63-ad5162254777 on n-h1-master-1 Jun 20 12:05:53.429252 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-1e5c96c2-20cf-45b7-af55-9ad83482b07e req-e0f7da6f-f93d-492e-884b-2137d75548a7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114671 Jun 20 12:05:53.436217 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1004/2022] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:05:53.632697 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1150a9ce-0b4e-466e-8f76-7ab6dfc53b96 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:53.654132 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1150a9ce-0b4e-466e-8f76-7ab6dfc53b96 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1716 microversion: 2.1 time: 0.606668 Jun 20 12:05:53.655111 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1019/2023] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:53 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1716 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:53.862236 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b19c5720-b12f-4d37-b819-4f7bc245880a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:53.862969 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b19c5720-b12f-4d37-b819-4f7bc245880a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:53.874670 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b19c5720-b12f-4d37-b819-4f7bc245880a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:53.875140 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b19c5720-b12f-4d37-b819-4f7bc245880a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:53.875942 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b19c5720-b12f-4d37-b819-4f7bc245880a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:53.876421 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b19c5720-b12f-4d37-b819-4f7bc245880a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:53.941336 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-47eb1362-2876-4398-9c22-490e972524d6 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f60732bbdc0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:54.051460 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-47eb1362-2876-4398-9c22-490e972524d6 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba" status: 200 len: 1455 microversion: 2.1 time: 0.114453 Jun 20 12:05:54.052092 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1020/2024] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:53 2022] GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba => generated 1455 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:54.078207 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e338cb4d-5679-4221-ba7b-6c1cfc9ccf79 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:54.079088 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e338cb4d-5679-4221-ba7b-6c1cfc9ccf79 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:54.087527 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e338cb4d-5679-4221-ba7b-6c1cfc9ccf79 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:54.091654 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e338cb4d-5679-4221-ba7b-6c1cfc9ccf79 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:54.092756 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e338cb4d-5679-4221-ba7b-6c1cfc9ccf79 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:54.097015 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e338cb4d-5679-4221-ba7b-6c1cfc9ccf79 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:54.321753 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b19c5720-b12f-4d37-b819-4f7bc245880a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:54.341498 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b19c5720-b12f-4d37-b819-4f7bc245880a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1511 microversion: 2.1 time: 0.486023 Jun 20 12:05:54.342715 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1005/2025] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:53 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1511 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:54.588003 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-537cbe41-4bfa-430f-968a-e61167589b2e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1417515451", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:05:54.711439 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-537cbe41-4bfa-430f-968a-e61167589b2e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] validate_networks() for None {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:05:55.003285 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-537cbe41-4bfa-430f-968a-e61167589b2e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:05:55.004777 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-537cbe41-4bfa-430f-968a-e61167589b2e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:05:55.005488 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-537cbe41-4bfa-430f-968a-e61167589b2e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:05:55.006106 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-537cbe41-4bfa-430f-968a-e61167589b2e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:05:55.006762 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-537cbe41-4bfa-430f-968a-e61167589b2e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:05:55.024817 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-537cbe41-4bfa-430f-968a-e61167589b2e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:55.026186 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-537cbe41-4bfa-430f-968a-e61167589b2e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:55.027755 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-537cbe41-4bfa-430f-968a-e61167589b2e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:55.029070 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-537cbe41-4bfa-430f-968a-e61167589b2e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:55.062986 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-537cbe41-4bfa-430f-968a-e61167589b2e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Getting quotas for project 4440dc3e2f9c4134a54b08e2585f6c59. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:05:55.074331 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-537cbe41-4bfa-430f-968a-e61167589b2e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Getting quotas for user 3d35b7c824b641099a406175bccc5be3 and project 4440dc3e2f9c4134a54b08e2585f6c59. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:05:55.094246 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-537cbe41-4bfa-430f-968a-e61167589b2e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:05:55.097178 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-537cbe41-4bfa-430f-968a-e61167589b2e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:05:55.161539 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-537cbe41-4bfa-430f-968a-e61167589b2e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.817031 Jun 20 12:05:55.162412 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1006/2026] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:05:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:05:55.170263 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-11a42871-e0a5-46d6-8ab7-e3ff15589706 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:55.171192 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-11a42871-e0a5-46d6-8ab7-e3ff15589706 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:55.178467 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-11a42871-e0a5-46d6-8ab7-e3ff15589706 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:55.179063 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-11a42871-e0a5-46d6-8ab7-e3ff15589706 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:55.180843 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-11a42871-e0a5-46d6-8ab7-e3ff15589706 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:55.182793 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-11a42871-e0a5-46d6-8ab7-e3ff15589706 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:55.355647 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e338cb4d-5679-4221-ba7b-6c1cfc9ccf79 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:55.374817 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e338cb4d-5679-4221-ba7b-6c1cfc9ccf79 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 200 len: 1499 microversion: 2.1 time: 1.304051 Jun 20 12:05:55.391857 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1021/2027] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:54 2022] GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 1499 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:55.404254 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6f2e707e-5a67-4fbf-aa1a-c03597f993e8 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f60849e1790>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:55.553002 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6f2e707e-5a67-4fbf-aa1a-c03597f993e8 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba" status: 200 len: 1455 microversion: 2.1 time: 0.158738 Jun 20 12:05:55.557986 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1022/2028] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:55 2022] GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba => generated 1455 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:55.588284 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d1124d66-2772-46ff-a118-ea41089dd435 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:55.593084 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d1124d66-2772-46ff-a118-ea41089dd435 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:55.766921 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d1124d66-2772-46ff-a118-ea41089dd435 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:55.826951 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d1124d66-2772-46ff-a118-ea41089dd435 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c" status: 200 len: 1213 microversion: 2.1 time: 0.265118 Jun 20 12:05:55.828334 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1023/2029] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:55 2022] GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c => generated 1213 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:55.848133 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-700ce463-7eeb-42cb-a9e6-9be05884969b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:55.855026 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-700ce463-7eeb-42cb-a9e6-9be05884969b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:55.871761 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-700ce463-7eeb-42cb-a9e6-9be05884969b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:55.876460 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-700ce463-7eeb-42cb-a9e6-9be05884969b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:55.877645 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-700ce463-7eeb-42cb-a9e6-9be05884969b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:55.878292 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-700ce463-7eeb-42cb-a9e6-9be05884969b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:56.276305 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-700ce463-7eeb-42cb-a9e6-9be05884969b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:56.288974 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-700ce463-7eeb-42cb-a9e6-9be05884969b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1511 microversion: 2.1 time: 0.454822 Jun 20 12:05:56.289888 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1024/2030] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:55 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1511 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:56.300371 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-6c7bdead-a3c8-42dc-b64a-8cb24a4781a4 req-e78b0236-758b-4843-8e14-1cee9279aba8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31066575-9374-412f-9c63-ad5162254777", "tag": "e914de0d-b9de-410a-8338-f6ffef3981c1"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:05:56.322535 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-6c7bdead-a3c8-42dc-b64a-8cb24a4781a4 req-e78b0236-758b-4843-8e14-1cee9279aba8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:56.323292 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-6c7bdead-a3c8-42dc-b64a-8cb24a4781a4 req-e78b0236-758b-4843-8e14-1cee9279aba8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:56.351580 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-6c7bdead-a3c8-42dc-b64a-8cb24a4781a4 req-e78b0236-758b-4843-8e14-1cee9279aba8 service nova] Creating event network-changed:e914de0d-b9de-410a-8338-f6ffef3981c1 for instance 31066575-9374-412f-9c63-ad5162254777 on n-h1-master-1 Jun 20 12:05:56.368813 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-6c7bdead-a3c8-42dc-b64a-8cb24a4781a4 req-e78b0236-758b-4843-8e14-1cee9279aba8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077399 Jun 20 12:05:56.376987 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1025/2031] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:05:56.407523 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d9ed822a-2f3b-465b-b5fb-6118a90efd2a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:56.409029 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d9ed822a-2f3b-465b-b5fb-6118a90efd2a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:56.433356 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9ed822a-2f3b-465b-b5fb-6118a90efd2a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:56.433828 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9ed822a-2f3b-465b-b5fb-6118a90efd2a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:56.434650 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9ed822a-2f3b-465b-b5fb-6118a90efd2a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:56.435804 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9ed822a-2f3b-465b-b5fb-6118a90efd2a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:56.711115 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-11a42871-e0a5-46d6-8ab7-e3ff15589706 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:56.724101 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-11a42871-e0a5-46d6-8ab7-e3ff15589706 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1716 microversion: 2.1 time: 1.559793 Jun 20 12:05:56.726562 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1007/2032] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:55 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1716 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:56.735233 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-042d483f-f5dd-43b7-8eeb-eba3b50f70ea tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073aef040>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:56.824998 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-042d483f-f5dd-43b7-8eeb-eba3b50f70ea tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba" status: 200 len: 1455 microversion: 2.1 time: 0.096793 Jun 20 12:05:56.826155 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1008/2033] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:56 2022] GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba => generated 1455 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:56.850962 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0d05b1d4-4773-4b0b-944c-79ddf11566f4 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:56.852509 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0d05b1d4-4773-4b0b-944c-79ddf11566f4 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:56.878387 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d05b1d4-4773-4b0b-944c-79ddf11566f4 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:56.879251 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d05b1d4-4773-4b0b-944c-79ddf11566f4 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:56.880296 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d05b1d4-4773-4b0b-944c-79ddf11566f4 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:56.880967 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d05b1d4-4773-4b0b-944c-79ddf11566f4 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:56.944048 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d9ed822a-2f3b-465b-b5fb-6118a90efd2a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:56.957223 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d9ed822a-2f3b-465b-b5fb-6118a90efd2a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 200 len: 1499 microversion: 2.1 time: 0.554210 Jun 20 12:05:56.962429 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1026/2034] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:56 2022] GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 1499 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:57.013092 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0d05b1d4-4773-4b0b-944c-79ddf11566f4 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:57.022334 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0d05b1d4-4773-4b0b-944c-79ddf11566f4 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c" status: 200 len: 1265 microversion: 2.1 time: 0.177640 Jun 20 12:05:57.027284 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1009/2035] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:56 2022] GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:57.312330 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e12e7509-f56c-4584-978c-5be5452df754 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:57.312995 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e12e7509-f56c-4584-978c-5be5452df754 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:57.322655 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e12e7509-f56c-4584-978c-5be5452df754 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:57.323127 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e12e7509-f56c-4584-978c-5be5452df754 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:57.323910 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e12e7509-f56c-4584-978c-5be5452df754 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:57.325106 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e12e7509-f56c-4584-978c-5be5452df754 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:57.694495 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e12e7509-f56c-4584-978c-5be5452df754 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:57.710423 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e12e7509-f56c-4584-978c-5be5452df754 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1511 microversion: 2.1 time: 0.403209 Jun 20 12:05:57.711429 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1027/2036] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:57 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1511 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:57.772340 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9d6439b5-37f4-472d-88ef-f0a691412be1 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:57.773888 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9d6439b5-37f4-472d-88ef-f0a691412be1 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:57.787355 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d6439b5-37f4-472d-88ef-f0a691412be1 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:57.788572 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d6439b5-37f4-472d-88ef-f0a691412be1 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:57.790228 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d6439b5-37f4-472d-88ef-f0a691412be1 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:57.790956 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d6439b5-37f4-472d-88ef-f0a691412be1 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:57.840945 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a230ef54-569d-4a6e-a097-e2b00eb33105 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073ebe310>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:57.958090 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a230ef54-569d-4a6e-a097-e2b00eb33105 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba" status: 200 len: 1455 microversion: 2.1 time: 0.122827 Jun 20 12:05:57.958685 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1028/2037] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:57 2022] GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba => generated 1455 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:05:57.983014 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-90e4e3f1-49f4-4cce-a46f-078c3e659f5f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:57.983665 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-90e4e3f1-49f4-4cce-a46f-078c3e659f5f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:57.995328 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-90e4e3f1-49f4-4cce-a46f-078c3e659f5f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:57.995781 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-90e4e3f1-49f4-4cce-a46f-078c3e659f5f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:57.997055 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-90e4e3f1-49f4-4cce-a46f-078c3e659f5f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:57.997651 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-90e4e3f1-49f4-4cce-a46f-078c3e659f5f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:58.178829 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9d6439b5-37f4-472d-88ef-f0a691412be1 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:58.202808 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9d6439b5-37f4-472d-88ef-f0a691412be1 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1716 microversion: 2.1 time: 0.461720 Jun 20 12:05:58.203420 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1010/2038] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:57 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1716 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:58.217085 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-86ed12ea-89dd-4b3a-a425-c36454be86a1 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:58.218330 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-86ed12ea-89dd-4b3a-a425-c36454be86a1 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:58.234475 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-86ed12ea-89dd-4b3a-a425-c36454be86a1 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:58.234929 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-86ed12ea-89dd-4b3a-a425-c36454be86a1 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:58.235711 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-86ed12ea-89dd-4b3a-a425-c36454be86a1 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:58.236140 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-86ed12ea-89dd-4b3a-a425-c36454be86a1 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:58.373931 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-86ed12ea-89dd-4b3a-a425-c36454be86a1 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:58.382230 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-86ed12ea-89dd-4b3a-a425-c36454be86a1 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c" status: 200 len: 1271 microversion: 2.1 time: 0.175184 Jun 20 12:05:58.382812 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1011/2039] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:58 2022] GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c => generated 1271 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:58.493051 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-90e4e3f1-49f4-4cce-a46f-078c3e659f5f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:58.519596 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-90e4e3f1-49f4-4cce-a46f-078c3e659f5f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 200 len: 1499 microversion: 2.1 time: 0.541321 Jun 20 12:05:58.534595 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1029/2040] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:57 2022] GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 1499 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:58.731266 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-987cfc07-0111-46ea-a584-1163c347bc97 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:58.731925 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-987cfc07-0111-46ea-a584-1163c347bc97 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:58.745217 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-987cfc07-0111-46ea-a584-1163c347bc97 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:58.745685 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-987cfc07-0111-46ea-a584-1163c347bc97 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:58.746473 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-987cfc07-0111-46ea-a584-1163c347bc97 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:58.750074 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-987cfc07-0111-46ea-a584-1163c347bc97 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:58.985423 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4acbccba-11a2-420c-afac-db4663934f5a tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073a8e790>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:59.010619 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-987cfc07-0111-46ea-a584-1163c347bc97 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:59.029367 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-987cfc07-0111-46ea-a584-1163c347bc97 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1511 microversion: 2.1 time: 0.303019 Jun 20 12:05:59.030761 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1012/2041] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:58 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1511 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:05:59.066017 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4acbccba-11a2-420c-afac-db4663934f5a tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba" status: 200 len: 1455 microversion: 2.1 time: 0.098436 Jun 20 12:05:59.072246 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1030/2042] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:05:58 2022] GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba => generated 1455 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:59.226683 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b06ab22c-ed47-4bb9-83b8-c996720a4ee7 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:59.227419 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b06ab22c-ed47-4bb9-83b8-c996720a4ee7 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:59.248242 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b06ab22c-ed47-4bb9-83b8-c996720a4ee7 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:59.248737 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b06ab22c-ed47-4bb9-83b8-c996720a4ee7 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:59.249522 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b06ab22c-ed47-4bb9-83b8-c996720a4ee7 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:59.249966 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b06ab22c-ed47-4bb9-83b8-c996720a4ee7 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:59.406863 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-89046508-3e8c-47ed-a387-a01e4e23c451 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:59.407648 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-89046508-3e8c-47ed-a387-a01e4e23c451 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:59.422901 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-89046508-3e8c-47ed-a387-a01e4e23c451 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:59.429143 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-89046508-3e8c-47ed-a387-a01e4e23c451 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:59.430360 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-89046508-3e8c-47ed-a387-a01e4e23c451 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:59.431104 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-89046508-3e8c-47ed-a387-a01e4e23c451 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:59.711260 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b06ab22c-ed47-4bb9-83b8-c996720a4ee7 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:05:59.747341 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b06ab22c-ed47-4bb9-83b8-c996720a4ee7 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1716 microversion: 2.1 time: 0.504858 Jun 20 12:05:59.748814 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1013/2043] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:59 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1716 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:05:59.771621 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d51243c2-eae2-43a3-8aba-d71c58af888e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:05:59.775775 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d51243c2-eae2-43a3-8aba-d71c58af888e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:05:59.789082 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d51243c2-eae2-43a3-8aba-d71c58af888e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:59.791184 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d51243c2-eae2-43a3-8aba-d71c58af888e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:05:59.792269 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d51243c2-eae2-43a3-8aba-d71c58af888e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:05:59.793755 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d51243c2-eae2-43a3-8aba-d71c58af888e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:00.035073 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-89046508-3e8c-47ed-a387-a01e4e23c451 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:00.052070 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-89046508-3e8c-47ed-a387-a01e4e23c451 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c" status: 200 len: 1313 microversion: 2.1 time: 0.649433 Jun 20 12:06:00.060090 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1031/2044] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:59 2022] GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c => generated 1313 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:00.067527 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f8a2b916-3241-407d-aec8-6d8ffb55d56f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:00.068698 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f8a2b916-3241-407d-aec8-6d8ffb55d56f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:00.079692 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f8a2b916-3241-407d-aec8-6d8ffb55d56f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:00.080747 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f8a2b916-3241-407d-aec8-6d8ffb55d56f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:00.081795 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f8a2b916-3241-407d-aec8-6d8ffb55d56f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:00.082445 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f8a2b916-3241-407d-aec8-6d8ffb55d56f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:00.107645 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d51243c2-eae2-43a3-8aba-d71c58af888e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:00.130169 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d51243c2-eae2-43a3-8aba-d71c58af888e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 200 len: 1499 microversion: 2.1 time: 0.369713 Jun 20 12:06:00.140584 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1014/2045] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:05:59 2022] GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 1499 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:00.146674 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-eac477e1-08a7-4c77-9b55-c76c9d8ae478 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073c318b0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:00.214294 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-eac477e1-08a7-4c77-9b55-c76c9d8ae478 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba" status: 200 len: 1455 microversion: 2.1 time: 0.070302 Jun 20 12:06:00.215418 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1015/2046] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:06:00 2022] GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba => generated 1455 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:00.350990 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f8a2b916-3241-407d-aec8-6d8ffb55d56f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:00.364537 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f8a2b916-3241-407d-aec8-6d8ffb55d56f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1511 microversion: 2.1 time: 0.302525 Jun 20 12:06:00.374588 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1032/2047] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:00 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1511 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:00.599563 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-da8ed637-acdf-4a93-953a-a08a22b976a4 req-bbb57193-af9f-4318-b84d-25c20fbf6ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "169d4a6b-c7e8-4fb6-9230-0daccebb7c1c", "tag": "d2a8d75a-6185-40a8-a750-83b919830f6e"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:06:00.612262 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-da8ed637-acdf-4a93-953a-a08a22b976a4 req-bbb57193-af9f-4318-b84d-25c20fbf6ef6 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:00.613025 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-da8ed637-acdf-4a93-953a-a08a22b976a4 req-bbb57193-af9f-4318-b84d-25c20fbf6ef6 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:00.640641 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-da8ed637-acdf-4a93-953a-a08a22b976a4 req-bbb57193-af9f-4318-b84d-25c20fbf6ef6 service nova] Creating event network-changed:d2a8d75a-6185-40a8-a750-83b919830f6e for instance 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c on n-h1-master-1 Jun 20 12:06:00.649685 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-da8ed637-acdf-4a93-953a-a08a22b976a4 req-bbb57193-af9f-4318-b84d-25c20fbf6ef6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058177 Jun 20 12:06:00.653443 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1016/2048] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:06:00.766612 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-54b6d4a1-4804-427f-902c-6649c22929e1 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:00.767235 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-54b6d4a1-4804-427f-902c-6649c22929e1 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:00.777734 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-54b6d4a1-4804-427f-902c-6649c22929e1 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:00.778210 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-54b6d4a1-4804-427f-902c-6649c22929e1 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:00.779000 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-54b6d4a1-4804-427f-902c-6649c22929e1 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:00.782044 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-54b6d4a1-4804-427f-902c-6649c22929e1 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:01.038052 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-54b6d4a1-4804-427f-902c-6649c22929e1 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:01.051115 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-54b6d4a1-4804-427f-902c-6649c22929e1 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1716 microversion: 2.1 time: 0.288238 Jun 20 12:06:01.052535 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1033/2049] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:00 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1716 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:01.080903 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6dce3a38-1932-4004-bc6a-8666b47ccfbf tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:01.082208 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6dce3a38-1932-4004-bc6a-8666b47ccfbf tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:01.093916 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6dce3a38-1932-4004-bc6a-8666b47ccfbf tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:01.094280 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6dce3a38-1932-4004-bc6a-8666b47ccfbf tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:01.095390 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6dce3a38-1932-4004-bc6a-8666b47ccfbf tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:01.095830 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6dce3a38-1932-4004-bc6a-8666b47ccfbf tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:01.148916 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-55edec0b-6a6b-48d0-be2a-725309d85c8f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:01.149562 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-55edec0b-6a6b-48d0-be2a-725309d85c8f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:01.157460 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-55edec0b-6a6b-48d0-be2a-725309d85c8f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:01.158185 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-55edec0b-6a6b-48d0-be2a-725309d85c8f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:01.159139 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-55edec0b-6a6b-48d0-be2a-725309d85c8f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:01.159580 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-55edec0b-6a6b-48d0-be2a-725309d85c8f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:01.303877 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-55edec0b-6a6b-48d0-be2a-725309d85c8f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:01.313025 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-55edec0b-6a6b-48d0-be2a-725309d85c8f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 200 len: 1499 microversion: 2.1 time: 0.169217 Jun 20 12:06:01.313678 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1034/2050] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:01 2022] GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 1499 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:01.319482 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-28244678-faf3-4936-ab1d-842fe9d75230 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f60732bcd30>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:01.367411 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-28244678-faf3-4936-ab1d-842fe9d75230 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba" status: 200 len: 1464 microversion: 2.1 time: 0.051643 Jun 20 12:06:01.367994 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1035/2051] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:06:01 2022] GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba => generated 1464 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:01.381311 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c824925b-7831-4306-8d0d-2c961fbc898c tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f60849e1e50>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:01.416362 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6dce3a38-1932-4004-bc6a-8666b47ccfbf tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:01.425525 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6dce3a38-1932-4004-bc6a-8666b47ccfbf tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c" status: 200 len: 1313 microversion: 2.1 time: 0.350142 Jun 20 12:06:01.426592 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1017/2052] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:01 2022] GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c => generated 1313 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:01.434940 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c824925b-7831-4306-8d0d-2c961fbc898c tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba" status: 200 len: 1464 microversion: 2.1 time: 0.057451 Jun 20 12:06:01.435493 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1036/2053] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:06:01 2022] GET /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba => generated 1464 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:06:01.442065 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3800fe69-f05f-4b9f-b725-239b44800bb9 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:01.442065 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3800fe69-f05f-4b9f-b725-239b44800bb9 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:01.447720 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c7c853be-f5f0-4c9a-9756-f994f3cd462f tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:01.447908 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3800fe69-f05f-4b9f-b725-239b44800bb9 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:01.448545 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3800fe69-f05f-4b9f-b725-239b44800bb9 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:01.449017 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c7c853be-f5f0-4c9a-9756-f994f3cd462f tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: f7d2499c-a9c8-4c2e-8445-667070737f1f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:01.450388 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3800fe69-f05f-4b9f-b725-239b44800bb9 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:01.451021 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3800fe69-f05f-4b9f-b725-239b44800bb9 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:01.456352 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c7c853be-f5f0-4c9a-9756-f994f3cd462f tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:01.457103 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c7c853be-f5f0-4c9a-9756-f994f3cd462f tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:01.457892 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c7c853be-f5f0-4c9a-9756-f994f3cd462f tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:01.458478 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c7c853be-f5f0-4c9a-9756-f994f3cd462f tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:01.472496 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:06:01.605597 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c7c853be-f5f0-4c9a-9756-f994f3cd462f tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286e4b475bbc4d108ca00497ecd3e55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8c8766d4f143349b61f27d8f2566fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:01.613478 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c7c853be-f5f0-4c9a-9756-f994f3cd462f tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f" status: 200 len: 1481 microversion: 2.1 time: 0.169806 Jun 20 12:06:01.614070 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1037/2054] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:01 2022] GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f => generated 1481 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:01.681677 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3800fe69-f05f-4b9f-b725-239b44800bb9 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:01.690957 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3800fe69-f05f-4b9f-b725-239b44800bb9 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1511 microversion: 2.1 time: 0.262990 Jun 20 12:06:01.691557 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1018/2055] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:01 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1511 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:02.070413 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-172c3182-70a7-4529-874e-51f4e64b3520 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:02.071055 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-172c3182-70a7-4529-874e-51f4e64b3520 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:02.078778 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-172c3182-70a7-4529-874e-51f4e64b3520 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:02.079230 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-172c3182-70a7-4529-874e-51f4e64b3520 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:02.080000 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-172c3182-70a7-4529-874e-51f4e64b3520 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:02.080469 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-172c3182-70a7-4529-874e-51f4e64b3520 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:02.233875 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-172c3182-70a7-4529-874e-51f4e64b3520 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:02.242723 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-172c3182-70a7-4529-874e-51f4e64b3520 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1716 microversion: 2.1 time: 0.176353 Jun 20 12:06:02.243443 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1038/2056] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:02 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1716 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:02.331506 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-32c5dfdf-215d-45a0-b98a-00bd4b7a729b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:02.332220 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-32c5dfdf-215d-45a0-b98a-00bd4b7a729b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:02.341123 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-32c5dfdf-215d-45a0-b98a-00bd4b7a729b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:02.341573 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-32c5dfdf-215d-45a0-b98a-00bd4b7a729b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:02.342543 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-32c5dfdf-215d-45a0-b98a-00bd4b7a729b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:02.343127 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-32c5dfdf-215d-45a0-b98a-00bd4b7a729b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:02.443805 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ea092418-4197-43d9-af62-0d4515883b83 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:02.453949 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ea092418-4197-43d9-af62-0d4515883b83 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:02.469011 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea092418-4197-43d9-af62-0d4515883b83 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:02.469696 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea092418-4197-43d9-af62-0d4515883b83 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:02.470898 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea092418-4197-43d9-af62-0d4515883b83 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:02.471559 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea092418-4197-43d9-af62-0d4515883b83 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:02.666464 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ea092418-4197-43d9-af62-0d4515883b83 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:02.685064 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ea092418-4197-43d9-af62-0d4515883b83 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c" status: 200 len: 1313 microversion: 2.1 time: 0.244867 Jun 20 12:06:02.699197 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1039/2057] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:02 2022] GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:06:02.706599 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a0b7e1f2-f7ab-414a-a984-b7cb23716c0d tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:02.707512 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a0b7e1f2-f7ab-414a-a984-b7cb23716c0d tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: f7d2499c-a9c8-4c2e-8445-667070737f1f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:02.715595 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a0b7e1f2-f7ab-414a-a984-b7cb23716c0d tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:02.716342 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a0b7e1f2-f7ab-414a-a984-b7cb23716c0d tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:02.717455 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a0b7e1f2-f7ab-414a-a984-b7cb23716c0d tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:02.718229 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a0b7e1f2-f7ab-414a-a984-b7cb23716c0d tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:02.800910 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-32c5dfdf-215d-45a0-b98a-00bd4b7a729b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:02.812664 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-32c5dfdf-215d-45a0-b98a-00bd4b7a729b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 200 len: 1499 microversion: 2.1 time: 0.485037 Jun 20 12:06:02.813256 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1019/2058] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:02 2022] GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 1499 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:02.825569 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-750ba975-975f-45c2-af25-771e1b519ed0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:02.828606 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-750ba975-975f-45c2-af25-771e1b519ed0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:02.845225 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-750ba975-975f-45c2-af25-771e1b519ed0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:02.845943 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-750ba975-975f-45c2-af25-771e1b519ed0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:02.849218 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-750ba975-975f-45c2-af25-771e1b519ed0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:02.850027 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-750ba975-975f-45c2-af25-771e1b519ed0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:03.153266 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a0b7e1f2-f7ab-414a-a984-b7cb23716c0d tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286e4b475bbc4d108ca00497ecd3e55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8c8766d4f143349b61f27d8f2566fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:03.161762 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a0b7e1f2-f7ab-414a-a984-b7cb23716c0d tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f" status: 200 len: 1468 microversion: 2.1 time: 0.461070 Jun 20 12:06:03.165190 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1040/2059] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:02 2022] GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f => generated 1468 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:03.184951 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-25272d9b-8679-45ed-ad94-ba1986d7735c tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1925679968"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:06:03.186453 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-25272d9b-8679-45ed-ad94-ba1986d7735c tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: 838db96b-0c7a-4d7f-9807-44194bc73cff] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:03.198255 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-25272d9b-8679-45ed-ad94-ba1986d7735c tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:03.198805 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-25272d9b-8679-45ed-ad94-ba1986d7735c tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:03.201514 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-25272d9b-8679-45ed-ad94-ba1986d7735c tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:03.202029 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-25272d9b-8679-45ed-ad94-ba1986d7735c tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:03.205798 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-750ba975-975f-45c2-af25-771e1b519ed0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:03.219814 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-750ba975-975f-45c2-af25-771e1b519ed0 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1511 microversion: 2.1 time: 0.405050 Jun 20 12:06:03.234049 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1020/2060] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:02 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1511 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:03.261489 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5c7bdaa4-eab0-4dda-9ed3-64632fc03a07 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:03.262063 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5c7bdaa4-eab0-4dda-9ed3-64632fc03a07 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:03.262882 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:06:03.269652 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5c7bdaa4-eab0-4dda-9ed3-64632fc03a07 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:03.270112 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5c7bdaa4-eab0-4dda-9ed3-64632fc03a07 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:03.271183 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5c7bdaa4-eab0-4dda-9ed3-64632fc03a07 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:03.271475 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5c7bdaa4-eab0-4dda-9ed3-64632fc03a07 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:03.613410 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5c7bdaa4-eab0-4dda-9ed3-64632fc03a07 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:03.628286 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5c7bdaa4-eab0-4dda-9ed3-64632fc03a07 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1716 microversion: 2.1 time: 0.371091 Jun 20 12:06:03.629937 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1021/2061] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:03 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1716 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:03.679050 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-25272d9b-8679-45ed-ad94-ba1986d7735c tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "POST /compute/v2.1/servers/838db96b-0c7a-4d7f-9807-44194bc73cff/action" status: 202 len: 0 microversion: 2.1 time: 0.498636 Jun 20 12:06:03.686968 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1041/2062] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:06:03 2022] POST /compute/v2.1/servers/838db96b-0c7a-4d7f-9807-44194bc73cff/action => generated 0 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 20 12:06:03.692192 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e9a4e904-117e-4a2d-a8c7-cf1351f37f75 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073b5eee0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:03.723760 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1b323bc4-0eed-40fa-9f31-1ebb2b8c981e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:03.725143 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1b323bc4-0eed-40fa-9f31-1ebb2b8c981e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:03.740516 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1b323bc4-0eed-40fa-9f31-1ebb2b8c981e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:03.741115 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1b323bc4-0eed-40fa-9f31-1ebb2b8c981e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:03.742411 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1b323bc4-0eed-40fa-9f31-1ebb2b8c981e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:03.743172 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1b323bc4-0eed-40fa-9f31-1ebb2b8c981e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:03.769944 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e9a4e904-117e-4a2d-a8c7-cf1351f37f75 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/1a6b8e9e-1b6d-4b48-b4b0-ca9ccad9615e" status: 200 len: 1455 microversion: 2.1 time: 0.081614 Jun 20 12:06:03.772291 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1022/2063] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:06:03 2022] GET /compute/v2.1/images/1a6b8e9e-1b6d-4b48-b4b0-ca9ccad9615e => generated 1455 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:03.851216 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f2deff63-3c91-40d1-8876-f25411294d85 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:03.851854 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f2deff63-3c91-40d1-8876-f25411294d85 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:03.865800 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f2deff63-3c91-40d1-8876-f25411294d85 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:03.866582 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f2deff63-3c91-40d1-8876-f25411294d85 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:03.884033 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f2deff63-3c91-40d1-8876-f25411294d85 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:03.884820 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f2deff63-3c91-40d1-8876-f25411294d85 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:04.052233 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1b323bc4-0eed-40fa-9f31-1ebb2b8c981e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:04.063342 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1b323bc4-0eed-40fa-9f31-1ebb2b8c981e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c" status: 200 len: 1313 microversion: 2.1 time: 0.348286 Jun 20 12:06:04.064469 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1042/2064] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:03 2022] GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c => generated 1313 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:06:04.071705 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f2deff63-3c91-40d1-8876-f25411294d85 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:04.082223 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f2deff63-3c91-40d1-8876-f25411294d85 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 200 len: 1499 microversion: 2.1 time: 0.252995 Jun 20 12:06:04.083244 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1023/2065] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:03 2022] GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 1499 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:04.185313 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-8ab41360-46a9-4d73-b090-2538dd19e681 req-10b86b0c-c27d-488f-bfa3-e26b9e3ef604 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7d2499c-a9c8-4c2e-8445-667070737f1f", "name": "network-vif-unplugged", "status": "completed", "tag": "4b377c25-4bc9-46b4-9743-511faa7773d1"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:06:04.199126 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-8ab41360-46a9-4d73-b090-2538dd19e681 req-10b86b0c-c27d-488f-bfa3-e26b9e3ef604 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:04.200023 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-8ab41360-46a9-4d73-b090-2538dd19e681 req-10b86b0c-c27d-488f-bfa3-e26b9e3ef604 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:04.217894 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-8ab41360-46a9-4d73-b090-2538dd19e681 req-10b86b0c-c27d-488f-bfa3-e26b9e3ef604 service nova] Creating event network-vif-unplugged:4b377c25-4bc9-46b4-9743-511faa7773d1 for instance f7d2499c-a9c8-4c2e-8445-667070737f1f on n-h2-master-1 Jun 20 12:06:04.223793 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-8ab41360-46a9-4d73-b090-2538dd19e681 req-10b86b0c-c27d-488f-bfa3-e26b9e3ef604 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044369 Jun 20 12:06:04.224993 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1043/2066] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:06:04.241812 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-43285343-cf71-4bb6-8df4-9b6ec2ce294c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:04.242467 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-43285343-cf71-4bb6-8df4-9b6ec2ce294c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:04.249937 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-43285343-cf71-4bb6-8df4-9b6ec2ce294c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:04.250812 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-43285343-cf71-4bb6-8df4-9b6ec2ce294c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:04.251179 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-43285343-cf71-4bb6-8df4-9b6ec2ce294c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:04.251620 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-43285343-cf71-4bb6-8df4-9b6ec2ce294c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:04.413210 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-43285343-cf71-4bb6-8df4-9b6ec2ce294c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:04.422123 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-43285343-cf71-4bb6-8df4-9b6ec2ce294c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1511 microversion: 2.1 time: 0.184430 Jun 20 12:06:04.422725 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1024/2067] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:04 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1511 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:04.648380 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-636bd47d-282d-4771-a855-1311296ae9dc tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:04.649194 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-636bd47d-282d-4771-a855-1311296ae9dc tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:04.657604 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-636bd47d-282d-4771-a855-1311296ae9dc tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:04.658048 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-636bd47d-282d-4771-a855-1311296ae9dc tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:04.658913 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-636bd47d-282d-4771-a855-1311296ae9dc tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:04.659450 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-636bd47d-282d-4771-a855-1311296ae9dc tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:04.786181 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6962700b-c417-456c-9786-9a7cfb780dfa tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f60738bcd30>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:04.836047 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6962700b-c417-456c-9786-9a7cfb780dfa tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/1a6b8e9e-1b6d-4b48-b4b0-ca9ccad9615e" status: 200 len: 1455 microversion: 2.1 time: 0.053948 Jun 20 12:06:04.842415 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1025/2068] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:06:04 2022] GET /compute/v2.1/images/1a6b8e9e-1b6d-4b48-b4b0-ca9ccad9615e => generated 1455 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:05.015564 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-636bd47d-282d-4771-a855-1311296ae9dc tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:05.023838 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-636bd47d-282d-4771-a855-1311296ae9dc tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1716 microversion: 2.1 time: 0.379697 Jun 20 12:06:05.024480 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1044/2069] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:04 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1716 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:06:05.077250 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:06:05.081977 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dac05f62-2190-488d-a804-4f1b77f7f051 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:05.082954 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-dac05f62-2190-488d-a804-4f1b77f7f051 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:05.089169 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:06:05.091313 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dac05f62-2190-488d-a804-4f1b77f7f051 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:05.091846 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dac05f62-2190-488d-a804-4f1b77f7f051 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:05.092721 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dac05f62-2190-488d-a804-4f1b77f7f051 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:05.093163 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dac05f62-2190-488d-a804-4f1b77f7f051 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:05.103588 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d7d29b54-b4f6-4174-b724-ee595c7fae6e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:05.105331 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d7d29b54-b4f6-4174-b724-ee595c7fae6e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:05.114878 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=92 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:06:05.117672 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d7d29b54-b4f6-4174-b724-ee595c7fae6e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:05.118535 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d7d29b54-b4f6-4174-b724-ee595c7fae6e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:05.119525 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d7d29b54-b4f6-4174-b724-ee595c7fae6e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:05.120247 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d7d29b54-b4f6-4174-b724-ee595c7fae6e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:05.267469 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-dac05f62-2190-488d-a804-4f1b77f7f051 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:05.276367 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dac05f62-2190-488d-a804-4f1b77f7f051 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c" status: 200 len: 1313 microversion: 2.1 time: 0.199684 Jun 20 12:06:05.277198 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1026/2070] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:05 2022] GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:05.443178 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f87e11c8-de23-4faf-85c5-42e02e5b796f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:05.444325 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f87e11c8-de23-4faf-85c5-42e02e5b796f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:05.452418 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f87e11c8-de23-4faf-85c5-42e02e5b796f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:05.452877 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f87e11c8-de23-4faf-85c5-42e02e5b796f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:05.453661 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f87e11c8-de23-4faf-85c5-42e02e5b796f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:05.454095 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f87e11c8-de23-4faf-85c5-42e02e5b796f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:05.608965 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f87e11c8-de23-4faf-85c5-42e02e5b796f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:05.616996 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f87e11c8-de23-4faf-85c5-42e02e5b796f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1511 microversion: 2.1 time: 0.180670 Jun 20 12:06:05.617922 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1027/2071] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:05 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1511 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:05.654174 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d7d29b54-b4f6-4174-b724-ee595c7fae6e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:05.662244 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d7d29b54-b4f6-4174-b724-ee595c7fae6e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 200 len: 1499 microversion: 2.1 time: 0.566174 Jun 20 12:06:05.662931 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1045/2072] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:05 2022] GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 1499 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:06:05.852560 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-84100c52-d010-4a6e-8438-e153cf8a32f1 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073c81c10>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:05.912191 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-84100c52-d010-4a6e-8438-e153cf8a32f1 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/1a6b8e9e-1b6d-4b48-b4b0-ca9ccad9615e" status: 200 len: 1455 microversion: 2.1 time: 0.065822 Jun 20 12:06:05.912982 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1028/2073] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:06:05 2022] GET /compute/v2.1/images/1a6b8e9e-1b6d-4b48-b4b0-ca9ccad9615e => generated 1455 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:06.043197 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ef1320cf-a67b-4538-801f-2550786a9ad2 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:06.044068 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ef1320cf-a67b-4538-801f-2550786a9ad2 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:06.046199 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:06:06.051649 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef1320cf-a67b-4538-801f-2550786a9ad2 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:06.052461 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef1320cf-a67b-4538-801f-2550786a9ad2 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:06.053246 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef1320cf-a67b-4538-801f-2550786a9ad2 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:06.053681 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef1320cf-a67b-4538-801f-2550786a9ad2 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:06.246694 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-c6eb1e24-f34e-4605-b236-c88804b2a27d req-e82fcf6a-1457-4676-86ee-b1fbf5310b92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "169d4a6b-c7e8-4fb6-9230-0daccebb7c1c", "name": "network-vif-plugged", "status": "completed", "tag": "d2a8d75a-6185-40a8-a750-83b919830f6e"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:06:06.257992 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-c6eb1e24-f34e-4605-b236-c88804b2a27d req-e82fcf6a-1457-4676-86ee-b1fbf5310b92 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:06.258644 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-c6eb1e24-f34e-4605-b236-c88804b2a27d req-e82fcf6a-1457-4676-86ee-b1fbf5310b92 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:06.274713 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-c6eb1e24-f34e-4605-b236-c88804b2a27d req-e82fcf6a-1457-4676-86ee-b1fbf5310b92 service nova] Creating event network-vif-plugged:d2a8d75a-6185-40a8-a750-83b919830f6e for instance 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c on n-h1-master-1 Jun 20 12:06:06.281946 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-c6eb1e24-f34e-4605-b236-c88804b2a27d req-e82fcf6a-1457-4676-86ee-b1fbf5310b92 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040722 Jun 20 12:06:06.283764 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1029/2074] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:06:06.299872 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6c2df6fb-7c5a-414c-a21a-f22dcaffb9a2 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:06.301009 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6c2df6fb-7c5a-414c-a21a-f22dcaffb9a2 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:06.303722 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ef1320cf-a67b-4538-801f-2550786a9ad2 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:06.311191 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6c2df6fb-7c5a-414c-a21a-f22dcaffb9a2 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:06.312610 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6c2df6fb-7c5a-414c-a21a-f22dcaffb9a2 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:06.317235 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6c2df6fb-7c5a-414c-a21a-f22dcaffb9a2 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:06.317798 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6c2df6fb-7c5a-414c-a21a-f22dcaffb9a2 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:06.325130 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ef1320cf-a67b-4538-801f-2550786a9ad2 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1716 microversion: 2.1 time: 0.286303 Jun 20 12:06:06.328743 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1046/2075] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:06 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1716 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:06.555751 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6c2df6fb-7c5a-414c-a21a-f22dcaffb9a2 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:06.565576 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6c2df6fb-7c5a-414c-a21a-f22dcaffb9a2 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c" status: 200 len: 1313 microversion: 2.1 time: 0.271330 Jun 20 12:06:06.567863 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1030/2076] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:06 2022] GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c => generated 1313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:06.634681 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-de1d218e-bccc-4662-a8f9-1bde8a28ecfe tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:06.636032 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-de1d218e-bccc-4662-a8f9-1bde8a28ecfe tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:06.644323 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-de1d218e-bccc-4662-a8f9-1bde8a28ecfe tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:06.645312 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-de1d218e-bccc-4662-a8f9-1bde8a28ecfe tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:06.646337 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-de1d218e-bccc-4662-a8f9-1bde8a28ecfe tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:06.647044 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-de1d218e-bccc-4662-a8f9-1bde8a28ecfe tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:06.683695 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-475bde7b-e01c-4f72-8cfe-06d7adbd2f8e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:06.685175 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-475bde7b-e01c-4f72-8cfe-06d7adbd2f8e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:06.697706 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-475bde7b-e01c-4f72-8cfe-06d7adbd2f8e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:06.698686 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-475bde7b-e01c-4f72-8cfe-06d7adbd2f8e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:06.699767 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-475bde7b-e01c-4f72-8cfe-06d7adbd2f8e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:06.700467 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-475bde7b-e01c-4f72-8cfe-06d7adbd2f8e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:06.886467 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-475bde7b-e01c-4f72-8cfe-06d7adbd2f8e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:06.900626 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-475bde7b-e01c-4f72-8cfe-06d7adbd2f8e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 200 len: 1499 microversion: 2.1 time: 0.221268 Jun 20 12:06:06.910495 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1031/2077] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:06 2022] GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 1499 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:06:06.926446 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bb670486-7d4f-4748-b627-5305a3cf448a tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073e93b80>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:06.991360 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bb670486-7d4f-4748-b627-5305a3cf448a tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/1a6b8e9e-1b6d-4b48-b4b0-ca9ccad9615e" status: 200 len: 1455 microversion: 2.1 time: 0.068848 Jun 20 12:06:06.992521 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1032/2078] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:06:06 2022] GET /compute/v2.1/images/1a6b8e9e-1b6d-4b48-b4b0-ca9ccad9615e => generated 1455 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:06:07.089197 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-de1d218e-bccc-4662-a8f9-1bde8a28ecfe tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:07.099337 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-de1d218e-bccc-4662-a8f9-1bde8a28ecfe tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1511 microversion: 2.1 time: 0.468607 Jun 20 12:06:07.099937 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1047/2079] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:06 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1511 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:07.345178 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-de99e6ac-2ac3-436a-9f91-b19afdcc753b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:07.345882 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-de99e6ac-2ac3-436a-9f91-b19afdcc753b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:07.352547 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-de99e6ac-2ac3-436a-9f91-b19afdcc753b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:07.353002 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-de99e6ac-2ac3-436a-9f91-b19afdcc753b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:07.354371 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-de99e6ac-2ac3-436a-9f91-b19afdcc753b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:07.354801 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-de99e6ac-2ac3-436a-9f91-b19afdcc753b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:07.530947 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-de99e6ac-2ac3-436a-9f91-b19afdcc753b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:07.543116 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-de99e6ac-2ac3-436a-9f91-b19afdcc753b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1716 microversion: 2.1 time: 0.201697 Jun 20 12:06:07.555214 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1033/2080] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:07 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1716 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:07.584769 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3050e60d-4089-495c-9d10-0cf1b6e3a811 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:07.585513 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3050e60d-4089-495c-9d10-0cf1b6e3a811 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:07.593518 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3050e60d-4089-495c-9d10-0cf1b6e3a811 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:07.593979 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3050e60d-4089-495c-9d10-0cf1b6e3a811 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:07.594827 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3050e60d-4089-495c-9d10-0cf1b6e3a811 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:07.595327 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3050e60d-4089-495c-9d10-0cf1b6e3a811 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:07.843598 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3050e60d-4089-495c-9d10-0cf1b6e3a811 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:07.851897 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3050e60d-4089-495c-9d10-0cf1b6e3a811 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c" status: 200 len: 1313 microversion: 2.1 time: 0.272690 Jun 20 12:06:07.853120 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1048/2081] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:07 2022] GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:07.929890 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-83cbfdbc-39c6-41a6-8388-74b9db0a251d tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:07.930526 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-83cbfdbc-39c6-41a6-8388-74b9db0a251d tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:07.948558 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-83cbfdbc-39c6-41a6-8388-74b9db0a251d tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:07.948558 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-83cbfdbc-39c6-41a6-8388-74b9db0a251d tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:07.948558 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-83cbfdbc-39c6-41a6-8388-74b9db0a251d tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:07.948558 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-83cbfdbc-39c6-41a6-8388-74b9db0a251d tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:08.014342 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dd3355ca-55c4-441d-ba67-1505c91b2bda tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f60849d6ee0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:08.073294 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dd3355ca-55c4-441d-ba67-1505c91b2bda tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/1a6b8e9e-1b6d-4b48-b4b0-ca9ccad9615e" status: 200 len: 1455 microversion: 2.1 time: 0.067897 Jun 20 12:06:08.074179 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1049/2082] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:06:08 2022] GET /compute/v2.1/images/1a6b8e9e-1b6d-4b48-b4b0-ca9ccad9615e => generated 1455 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:08.129849 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2c8749d0-35e6-4c75-9be5-d68f5ddbd1fa tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:08.130869 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2c8749d0-35e6-4c75-9be5-d68f5ddbd1fa tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:08.151473 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2c8749d0-35e6-4c75-9be5-d68f5ddbd1fa tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:08.152878 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2c8749d0-35e6-4c75-9be5-d68f5ddbd1fa tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:08.154031 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2c8749d0-35e6-4c75-9be5-d68f5ddbd1fa tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:08.154932 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2c8749d0-35e6-4c75-9be5-d68f5ddbd1fa tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:08.244185 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-83cbfdbc-39c6-41a6-8388-74b9db0a251d tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:08.259853 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-83cbfdbc-39c6-41a6-8388-74b9db0a251d tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 200 len: 1476 microversion: 2.1 time: 0.335097 Jun 20 12:06:08.261333 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1034/2083] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:07 2022] GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 1476 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:08.292496 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a7a7e5fb-b92e-4e01-8636-016b9657f1da tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1402899120"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:06:08.295662 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a7a7e5fb-b92e-4e01-8636-016b9657f1da tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:08.304826 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a7a7e5fb-b92e-4e01-8636-016b9657f1da tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:08.305509 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a7a7e5fb-b92e-4e01-8636-016b9657f1da tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:08.306675 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a7a7e5fb-b92e-4e01-8636-016b9657f1da tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:08.308483 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a7a7e5fb-b92e-4e01-8636-016b9657f1da tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:08.520461 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2c8749d0-35e6-4c75-9be5-d68f5ddbd1fa tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:08.554322 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2c8749d0-35e6-4c75-9be5-d68f5ddbd1fa tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1511 microversion: 2.1 time: 0.436392 Jun 20 12:06:08.576944 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1050/2084] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:08 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1511 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:06:08.596600 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-3332b25a-d320-4a1f-8715-8917d7faf81e req-1537c206-dc78-49b5-a4ed-575efec5e027 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31066575-9374-412f-9c63-ad5162254777", "name": "network-vif-unplugged", "status": "completed", "tag": "e914de0d-b9de-410a-8338-f6ffef3981c1"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:06:08.623858 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-3332b25a-d320-4a1f-8715-8917d7faf81e req-1537c206-dc78-49b5-a4ed-575efec5e027 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:08.626137 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-3332b25a-d320-4a1f-8715-8917d7faf81e req-1537c206-dc78-49b5-a4ed-575efec5e027 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:08.654926 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-3332b25a-d320-4a1f-8715-8917d7faf81e req-1537c206-dc78-49b5-a4ed-575efec5e027 service nova] Creating event network-vif-unplugged:e914de0d-b9de-410a-8338-f6ffef3981c1 for instance 31066575-9374-412f-9c63-ad5162254777 on n-h1-master-1 Jun 20 12:06:08.660936 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-3332b25a-d320-4a1f-8715-8917d7faf81e req-1537c206-dc78-49b5-a4ed-575efec5e027 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079647 Jun 20 12:06:08.662536 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1051/2085] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:06:08.673263 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-758b487e-705b-4d6e-ab45-d754bb6e573e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:08.674241 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-758b487e-705b-4d6e-ab45-d754bb6e573e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:08.684393 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-758b487e-705b-4d6e-ab45-d754bb6e573e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:08.685190 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-758b487e-705b-4d6e-ab45-d754bb6e573e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:08.686110 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-758b487e-705b-4d6e-ab45-d754bb6e573e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:08.686568 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-758b487e-705b-4d6e-ab45-d754bb6e573e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:08.934447 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a7a7e5fb-b92e-4e01-8636-016b9657f1da tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "POST /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974/action" status: 202 len: 0 microversion: 2.1 time: 0.659523 Jun 20 12:06:08.940499 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1035/2086] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:06:08 2022] POST /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974/action => generated 0 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jun 20 12:06:08.984943 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b3b175e9-4f20-4a1c-a608-29605fb6bcca tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:08.986102 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b3b175e9-4f20-4a1c-a608-29605fb6bcca tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:09.052954 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b3b175e9-4f20-4a1c-a608-29605fb6bcca tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:09.054228 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b3b175e9-4f20-4a1c-a608-29605fb6bcca tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:09.064965 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b3b175e9-4f20-4a1c-a608-29605fb6bcca tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:09.066221 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b3b175e9-4f20-4a1c-a608-29605fb6bcca tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:09.283531 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-758b487e-705b-4d6e-ab45-d754bb6e573e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:09.316893 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-758b487e-705b-4d6e-ab45-d754bb6e573e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1716 microversion: 2.1 time: 0.648713 Jun 20 12:06:09.320476 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1052/2087] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:08 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1716 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:09.358534 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-23843f6b-dfa0-4fee-b596-66a7b56e8d61 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f60849ffdc0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:09.482091 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-23843f6b-dfa0-4fee-b596-66a7b56e8d61 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/34da3fb0-46ad-49d0-8de1-4fda4ca64f01" status: 200 len: 1412 microversion: 2.1 time: 0.159447 Jun 20 12:06:09.483119 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1053/2088] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:06:09 2022] GET /compute/v2.1/images/34da3fb0-46ad-49d0-8de1-4fda4ca64f01 => generated 1412 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:09.491490 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-27671228-e871-4d78-b130-57300de1a019 req-fd092213-2429-4822-ac45-83b67bbe5a9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "838db96b-0c7a-4d7f-9807-44194bc73cff", "name": "network-vif-plugged", "status": "completed", "tag": "1e4f16ac-a73c-4854-8d0f-a050fb989db4"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:06:09.507161 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-27671228-e871-4d78-b130-57300de1a019 req-fd092213-2429-4822-ac45-83b67bbe5a9d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:09.509931 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-27671228-e871-4d78-b130-57300de1a019 req-fd092213-2429-4822-ac45-83b67bbe5a9d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:09.534162 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-27671228-e871-4d78-b130-57300de1a019 req-fd092213-2429-4822-ac45-83b67bbe5a9d service nova] Creating event network-vif-plugged:1e4f16ac-a73c-4854-8d0f-a050fb989db4 for instance 838db96b-0c7a-4d7f-9807-44194bc73cff on n-h1-master-1 Jun 20 12:06:09.542837 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-27671228-e871-4d78-b130-57300de1a019 req-fd092213-2429-4822-ac45-83b67bbe5a9d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057596 Jun 20 12:06:09.544005 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1054/2089] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:06:09.550837 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a2716577-4408-44ab-936f-426b66d34299 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f60849ff700>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:09.615749 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a2716577-4408-44ab-936f-426b66d34299 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/1a6b8e9e-1b6d-4b48-b4b0-ca9ccad9615e" status: 200 len: 1455 microversion: 2.1 time: 0.070521 Jun 20 12:06:09.617500 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1055/2090] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:06:09 2022] GET /compute/v2.1/images/1a6b8e9e-1b6d-4b48-b4b0-ca9ccad9615e => generated 1455 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:09.619358 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b3b175e9-4f20-4a1c-a608-29605fb6bcca tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:09.623946 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-389c4b48-d3b1-4fb0-9a58-895c0f172ff5 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:09.624913 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-389c4b48-d3b1-4fb0-9a58-895c0f172ff5 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:09.630135 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b3b175e9-4f20-4a1c-a608-29605fb6bcca tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c" status: 200 len: 1463 microversion: 2.1 time: 0.669533 Jun 20 12:06:09.630737 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1036/2091] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:08 2022] GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c => generated 1463 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:09.639488 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-389c4b48-d3b1-4fb0-9a58-895c0f172ff5 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:09.640511 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-389c4b48-d3b1-4fb0-9a58-895c0f172ff5 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:09.641938 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-389c4b48-d3b1-4fb0-9a58-895c0f172ff5 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:09.643056 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-389c4b48-d3b1-4fb0-9a58-895c0f172ff5 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:09.774045 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f86c8b32-d266-41f5-af0e-41839ad09d6f tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:09.775214 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f86c8b32-d266-41f5-af0e-41839ad09d6f tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:09.784435 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f86c8b32-d266-41f5-af0e-41839ad09d6f tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:09.784995 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f86c8b32-d266-41f5-af0e-41839ad09d6f tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:09.786532 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f86c8b32-d266-41f5-af0e-41839ad09d6f tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:09.787191 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f86c8b32-d266-41f5-af0e-41839ad09d6f tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:09.997861 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-389c4b48-d3b1-4fb0-9a58-895c0f172ff5 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:10.018043 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-389c4b48-d3b1-4fb0-9a58-895c0f172ff5 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1511 microversion: 2.1 time: 0.396631 Jun 20 12:06:10.020113 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1056/2092] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:09 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1511 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:10.162974 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f86c8b32-d266-41f5-af0e-41839ad09d6f tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c" status: 200 len: 1614 microversion: 2.1 time: 0.518808 Jun 20 12:06:10.165032 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1037/2093] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:09 2022] GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c => generated 1614 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:10.180086 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-037c27d3-f7ed-4e67-adb5-5a3f012f3d7b tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:06:10.180703 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-037c27d3-f7ed-4e67-adb5-5a3f012f3d7b tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:10.190831 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-037c27d3-f7ed-4e67-adb5-5a3f012f3d7b tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:10.196864 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-037c27d3-f7ed-4e67-adb5-5a3f012f3d7b tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:10.198797 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-037c27d3-f7ed-4e67-adb5-5a3f012f3d7b tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:10.199505 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-037c27d3-f7ed-4e67-adb5-5a3f012f3d7b tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:10.333755 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-037c27d3-f7ed-4e67-adb5-5a3f012f3d7b tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'af812a9321804aff95e49d9e18684e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e410fd03e18846f8a6e0faf010cb275a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:10.335802 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-037c27d3-f7ed-4e67-adb5-5a3f012f3d7b tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] flavor_id is None. Assuming migration. {{(pid=119127) resize /opt/stack/nova/nova/compute/api.py:4142}} Jun 20 12:06:10.337032 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-037c27d3-f7ed-4e67-adb5-5a3f012f3d7b tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119127) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 20 12:06:10.340938 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c4c6d389-d8a4-4388-bcd9-b8b6b1622d6b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:10.341451 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c4c6d389-d8a4-4388-bcd9-b8b6b1622d6b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:10.360257 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4c6d389-d8a4-4388-bcd9-b8b6b1622d6b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:10.361155 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4c6d389-d8a4-4388-bcd9-b8b6b1622d6b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:10.362169 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4c6d389-d8a4-4388-bcd9-b8b6b1622d6b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:10.362853 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4c6d389-d8a4-4388-bcd9-b8b6b1622d6b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:10.405221 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:06:10.640307 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c4c6d389-d8a4-4388-bcd9-b8b6b1622d6b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:10.687781 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c4c6d389-d8a4-4388-bcd9-b8b6b1622d6b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1716 microversion: 2.1 time: 0.349821 Jun 20 12:06:10.688459 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1038/2094] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:10 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1716 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:10.720135 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0f9d7929-9580-4cf4-993d-b6d9753df210 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f6073c31670>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:10.865639 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0f9d7929-9580-4cf4-993d-b6d9753df210 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/34da3fb0-46ad-49d0-8de1-4fda4ca64f01" status: 200 len: 1412 microversion: 2.1 time: 0.176045 Jun 20 12:06:10.866535 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1039/2095] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:06:10 2022] GET /compute/v2.1/images/34da3fb0-46ad-49d0-8de1-4fda4ca64f01 => generated 1412 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:10.872114 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-637decbb-ee81-46ee-b051-588d219a870d tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073f443a0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:10.945893 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-637decbb-ee81-46ee-b051-588d219a870d tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/1a6b8e9e-1b6d-4b48-b4b0-ca9ccad9615e" status: 200 len: 1455 microversion: 2.1 time: 0.077876 Jun 20 12:06:10.946492 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1040/2096] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:06:10 2022] GET /compute/v2.1/images/1a6b8e9e-1b6d-4b48-b4b0-ca9ccad9615e => generated 1455 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:11.038066 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-36d4b056-20df-4743-b5b1-3da20e7ca6ea tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:11.039182 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-36d4b056-20df-4743-b5b1-3da20e7ca6ea tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:11.057671 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-36d4b056-20df-4743-b5b1-3da20e7ca6ea tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:11.079442 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-36d4b056-20df-4743-b5b1-3da20e7ca6ea tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:11.080956 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-36d4b056-20df-4743-b5b1-3da20e7ca6ea tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:11.081697 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-36d4b056-20df-4743-b5b1-3da20e7ca6ea tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:11.140736 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-037c27d3-f7ed-4e67-adb5-5a3f012f3d7b tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c/action" status: 202 len: 0 microversion: 2.1 time: 0.958562 Jun 20 12:06:11.149059 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1057/2097] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:06:10 2022] POST /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c/action => generated 0 bytes in 973 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:06:11.168628 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-957b8106-7663-4cbe-844d-b6631667af7a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:11.169270 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-957b8106-7663-4cbe-844d-b6631667af7a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:11.192324 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-957b8106-7663-4cbe-844d-b6631667af7a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:11.194441 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-957b8106-7663-4cbe-844d-b6631667af7a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:11.195429 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-957b8106-7663-4cbe-844d-b6631667af7a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:11.195986 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-957b8106-7663-4cbe-844d-b6631667af7a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:11.308226 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-36d4b056-20df-4743-b5b1-3da20e7ca6ea tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:11.347168 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-36d4b056-20df-4743-b5b1-3da20e7ca6ea tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1511 microversion: 2.1 time: 0.313085 Jun 20 12:06:11.357656 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1041/2098] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:11 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1511 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:11.550801 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-957b8106-7663-4cbe-844d-b6631667af7a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:11.578579 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-957b8106-7663-4cbe-844d-b6631667af7a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c" status: 200 len: 1472 microversion: 2.1 time: 0.417536 Jun 20 12:06:11.580803 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1058/2099] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:11 2022] GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c => generated 1472 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:11.706067 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b2f10965-01a0-4823-89d3-06c932015da1 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:11.707090 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b2f10965-01a0-4823-89d3-06c932015da1 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:11.722142 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2f10965-01a0-4823-89d3-06c932015da1 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:11.724256 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2f10965-01a0-4823-89d3-06c932015da1 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:11.735231 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2f10965-01a0-4823-89d3-06c932015da1 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:11.737547 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2f10965-01a0-4823-89d3-06c932015da1 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:11.886286 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-25992ffe-bc57-43c1-b74d-04d746c2b1d3 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f60849fe0d0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:11.967904 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b2f10965-01a0-4823-89d3-06c932015da1 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:11.980280 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b2f10965-01a0-4823-89d3-06c932015da1 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1716 microversion: 2.1 time: 0.277794 Jun 20 12:06:11.984292 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1042/2100] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:11 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1716 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:11.993487 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2a17f5b3-0526-4d95-afd7-745cbcc6d1ea tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073324820>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:12.340932 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-25992ffe-bc57-43c1-b74d-04d746c2b1d3 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/34da3fb0-46ad-49d0-8de1-4fda4ca64f01" status: 200 len: 1412 microversion: 2.1 time: 0.464610 Jun 20 12:06:12.342256 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1059/2101] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:06:11 2022] GET /compute/v2.1/images/34da3fb0-46ad-49d0-8de1-4fda4ca64f01 => generated 1412 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:12.365674 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1a3955ba-9151-474b-bb22-7a02e256f2b1 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:12.367014 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1a3955ba-9151-474b-bb22-7a02e256f2b1 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:12.379756 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2a17f5b3-0526-4d95-afd7-745cbcc6d1ea tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/1a6b8e9e-1b6d-4b48-b4b0-ca9ccad9615e" status: 200 len: 1455 microversion: 2.1 time: 0.393565 Jun 20 12:06:12.386681 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1043/2102] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:06:11 2022] GET /compute/v2.1/images/1a6b8e9e-1b6d-4b48-b4b0-ca9ccad9615e => generated 1455 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:12.387714 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a3955ba-9151-474b-bb22-7a02e256f2b1 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:12.390426 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a3955ba-9151-474b-bb22-7a02e256f2b1 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:12.392366 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a3955ba-9151-474b-bb22-7a02e256f2b1 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:12.392366 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a3955ba-9151-474b-bb22-7a02e256f2b1 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:12.599365 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d6f072d3-4132-4ebc-b311-719351514382 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:12.600405 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d6f072d3-4132-4ebc-b311-719351514382 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:12.608704 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6f072d3-4132-4ebc-b311-719351514382 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:12.627480 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6f072d3-4132-4ebc-b311-719351514382 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:12.628398 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6f072d3-4132-4ebc-b311-719351514382 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:12.638857 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6f072d3-4132-4ebc-b311-719351514382 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:12.734697 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1a3955ba-9151-474b-bb22-7a02e256f2b1 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:12.757610 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1a3955ba-9151-474b-bb22-7a02e256f2b1 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1511 microversion: 2.1 time: 0.387985 Jun 20 12:06:12.758308 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1060/2103] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:12 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1511 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:13.000587 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d6f072d3-4132-4ebc-b311-719351514382 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:13.015891 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-afba917b-d4e1-41a2-a9b5-89b3fa3ea3cd tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:13.016565 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-afba917b-d4e1-41a2-a9b5-89b3fa3ea3cd tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:13.059932 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d6f072d3-4132-4ebc-b311-719351514382 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c" status: 200 len: 1472 microversion: 2.1 time: 0.464490 Jun 20 12:06:13.063407 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-afba917b-d4e1-41a2-a9b5-89b3fa3ea3cd tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:13.063865 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-afba917b-d4e1-41a2-a9b5-89b3fa3ea3cd tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:13.064682 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-afba917b-d4e1-41a2-a9b5-89b3fa3ea3cd tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:13.065120 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-afba917b-d4e1-41a2-a9b5-89b3fa3ea3cd tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:13.068833 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1044/2104] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:12 2022] GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c => generated 1472 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:13.105613 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:06:13.370330 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-25bbab4e-2c12-4b26-8f67-9d3024f708d2 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:13.370971 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-25bbab4e-2c12-4b26-8f67-9d3024f708d2 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:13.378965 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-25bbab4e-2c12-4b26-8f67-9d3024f708d2 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:13.379724 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-25bbab4e-2c12-4b26-8f67-9d3024f708d2 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:13.380881 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-25bbab4e-2c12-4b26-8f67-9d3024f708d2 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:13.382008 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-25bbab4e-2c12-4b26-8f67-9d3024f708d2 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:13.456451 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-25bbab4e-2c12-4b26-8f67-9d3024f708d2 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:06:13.629348 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-25bbab4e-2c12-4b26-8f67-9d3024f708d2 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 204 len: 0 microversion: 2.42 time: 0.436786 Jun 20 12:06:13.634183 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1045/2105] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Jun 20 12:06:13 2022] DELETE /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 20 12:06:13.639790 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a3fc9c2e-6444-4062-808b-f2431946be08 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f6073c810d0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:13.695693 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a3fc9c2e-6444-4062-808b-f2431946be08 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/34da3fb0-46ad-49d0-8de1-4fda4ca64f01" status: 200 len: 1412 microversion: 2.1 time: 0.062530 Jun 20 12:06:13.704864 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1046/2106] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:06:13 2022] GET /compute/v2.1/images/34da3fb0-46ad-49d0-8de1-4fda4ca64f01 => generated 1412 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:13.712056 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-24f2ad72-7c25-4149-b7d4-36f92e225745 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073c81700>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:13.729193 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-afba917b-d4e1-41a2-a9b5-89b3fa3ea3cd tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:13.748028 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-afba917b-d4e1-41a2-a9b5-89b3fa3ea3cd tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1706 microversion: 2.1 time: 0.746764 Jun 20 12:06:13.761269 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1061/2107] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:12 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1706 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:06:13.766208 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3ac99fba-7755-435d-9cfe-60690946bccc tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:13.766822 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3ac99fba-7755-435d-9cfe-60690946bccc tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:13.778529 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3ac99fba-7755-435d-9cfe-60690946bccc tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:13.779284 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3ac99fba-7755-435d-9cfe-60690946bccc tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:13.780706 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3ac99fba-7755-435d-9cfe-60690946bccc tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:13.782435 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3ac99fba-7755-435d-9cfe-60690946bccc tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:13.909378 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-24f2ad72-7c25-4149-b7d4-36f92e225745 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/1a6b8e9e-1b6d-4b48-b4b0-ca9ccad9615e" status: 200 len: 1455 microversion: 2.1 time: 0.202505 Jun 20 12:06:13.909977 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1047/2108] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:06:13 2022] GET /compute/v2.1/images/1a6b8e9e-1b6d-4b48-b4b0-ca9ccad9615e => generated 1455 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:13.923003 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d283794b-db00-4535-b46a-8253b628ad64 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Calling method '.version_select at 0x7f607323a940>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:13.928432 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d283794b-db00-4535-b46a-8253b628ad64 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:13.928891 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d283794b-db00-4535-b46a-8253b628ad64 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:13.940008 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d283794b-db00-4535-b46a-8253b628ad64 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1563 microversion: 2.1 time: 0.020720 Jun 20 12:06:13.949403 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1048/2109] 10.222.0.27 () {58 vars in 1142 bytes} [Mon Jun 20 12:06:13 2022] GET /compute/v2.1/os-migrations => generated 1563 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:13.954816 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-657a62f9-ebdd-48e1-b345-86828a818deb tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:13.955590 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-657a62f9-ebdd-48e1-b345-86828a818deb tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:13.963494 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-657a62f9-ebdd-48e1-b345-86828a818deb tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:13.963927 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-657a62f9-ebdd-48e1-b345-86828a818deb tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:13.964762 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-657a62f9-ebdd-48e1-b345-86828a818deb tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:13.965208 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-657a62f9-ebdd-48e1-b345-86828a818deb tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:14.147042 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3ac99fba-7755-435d-9cfe-60690946bccc tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:14.167371 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3ac99fba-7755-435d-9cfe-60690946bccc tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:14.169840 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3ac99fba-7755-435d-9cfe-60690946bccc tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:14.172325 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3ac99fba-7755-435d-9cfe-60690946bccc tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 2960 microversion: 2.42 time: 0.409494 Jun 20 12:06:14.173552 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1062/2110] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:06:13 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 2960 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:06:14.181265 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-657a62f9-ebdd-48e1-b345-86828a818deb tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:14.190831 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-657a62f9-ebdd-48e1-b345-86828a818deb tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1488 microversion: 2.1 time: 0.239946 Jun 20 12:06:14.191485 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1049/2111] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:13 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1488 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:14.197469 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c682b90c-1694-482e-bf5e-e1d2bc4aaba2 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:14.198904 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c682b90c-1694-482e-bf5e-e1d2bc4aaba2 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:14.200174 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e133d2c2-ae29-4a90-a47e-481ba3e6feb5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:14.201432 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e133d2c2-ae29-4a90-a47e-481ba3e6feb5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:14.208570 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e133d2c2-ae29-4a90-a47e-481ba3e6feb5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:14.209233 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e133d2c2-ae29-4a90-a47e-481ba3e6feb5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:14.210189 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e133d2c2-ae29-4a90-a47e-481ba3e6feb5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:14.214591 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c682b90c-1694-482e-bf5e-e1d2bc4aaba2 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:14.215654 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c682b90c-1694-482e-bf5e-e1d2bc4aaba2 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:14.218144 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c682b90c-1694-482e-bf5e-e1d2bc4aaba2 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:14.219286 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c682b90c-1694-482e-bf5e-e1d2bc4aaba2 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:14.225206 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e133d2c2-ae29-4a90-a47e-481ba3e6feb5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:14.438398 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c682b90c-1694-482e-bf5e-e1d2bc4aaba2 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1857 microversion: 2.1 time: 0.262807 Jun 20 12:06:14.439421 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1063/2112] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:14 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1857 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:14.445469 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-57c59c4a-b508-401a-adfd-5e95ac20e4f3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:14.446445 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-57c59c4a-b508-401a-adfd-5e95ac20e4f3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:14.475642 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57c59c4a-b508-401a-adfd-5e95ac20e4f3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:14.476291 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57c59c4a-b508-401a-adfd-5e95ac20e4f3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:14.477329 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57c59c4a-b508-401a-adfd-5e95ac20e4f3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:14.477780 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57c59c4a-b508-401a-adfd-5e95ac20e4f3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:14.536309 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-57c59c4a-b508-401a-adfd-5e95ac20e4f3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:06:14.553642 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e133d2c2-ae29-4a90-a47e-481ba3e6feb5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:14.594311 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e133d2c2-ae29-4a90-a47e-481ba3e6feb5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c" status: 200 len: 1472 microversion: 2.1 time: 0.401513 Jun 20 12:06:14.595776 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1050/2113] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:14 2022] GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c => generated 1472 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:14.604644 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-b7d333f4-408a-46f7-a6dd-8b59ceecb28f req-db6d78b9-7f7f-4fd1-a41e-93cfbbac1eb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6a95c21-d3d4-4867-9ae6-7e9f3183f974", "name": "network-vif-plugged", "status": "completed", "tag": "8bda50e5-6e28-4aed-a096-d1e45e7df107"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:06:14.620131 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-b7d333f4-408a-46f7-a6dd-8b59ceecb28f req-db6d78b9-7f7f-4fd1-a41e-93cfbbac1eb3 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:14.621013 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-b7d333f4-408a-46f7-a6dd-8b59ceecb28f req-db6d78b9-7f7f-4fd1-a41e-93cfbbac1eb3 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:14.643744 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-b7d333f4-408a-46f7-a6dd-8b59ceecb28f req-db6d78b9-7f7f-4fd1-a41e-93cfbbac1eb3 service nova] Creating event network-vif-plugged:8bda50e5-6e28-4aed-a096-d1e45e7df107 for instance c6a95c21-d3d4-4867-9ae6-7e9f3183f974 on n-h2-master-1 Jun 20 12:06:14.654288 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-b7d333f4-408a-46f7-a6dd-8b59ceecb28f req-db6d78b9-7f7f-4fd1-a41e-93cfbbac1eb3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055445 Jun 20 12:06:14.655397 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1051/2114] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:06:14.665020 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-41b8bbba-66ed-4df0-8233-ed5e36a288b5 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:14.666458 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-41b8bbba-66ed-4df0-8233-ed5e36a288b5 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:14.677090 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-41b8bbba-66ed-4df0-8233-ed5e36a288b5 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:14.678009 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-41b8bbba-66ed-4df0-8233-ed5e36a288b5 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:14.679764 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-41b8bbba-66ed-4df0-8233-ed5e36a288b5 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:14.680461 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-41b8bbba-66ed-4df0-8233-ed5e36a288b5 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:14.686167 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-57c59c4a-b508-401a-adfd-5e95ac20e4f3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 204 len: 0 microversion: 2.1 time: 0.245238 Jun 20 12:06:14.687104 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1064/2115] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:06:14 2022] DELETE /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:06:14.698658 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-90d2814f-9f14-43dd-9ba0-001cdbd985fd tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:14.699631 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-90d2814f-9f14-43dd-9ba0-001cdbd985fd tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:14.710680 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-90d2814f-9f14-43dd-9ba0-001cdbd985fd tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:14.711380 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-90d2814f-9f14-43dd-9ba0-001cdbd985fd tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:14.713119 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-90d2814f-9f14-43dd-9ba0-001cdbd985fd tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:14.713779 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-90d2814f-9f14-43dd-9ba0-001cdbd985fd tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:14.998950 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-41b8bbba-66ed-4df0-8233-ed5e36a288b5 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1857 microversion: 2.1 time: 0.341589 Jun 20 12:06:15.001046 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1052/2116] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:14 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1857 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:15.008969 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-90d2814f-9f14-43dd-9ba0-001cdbd985fd tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:15.024469 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3f8328a8-d3a6-4728-97f6-2e4febaa216f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f6073b5e8b0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:15.034941 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-90d2814f-9f14-43dd-9ba0-001cdbd985fd tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1494 microversion: 2.1 time: 0.341655 Jun 20 12:06:15.044977 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1065/2117] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:14 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1494 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:06:15.059457 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8a25aec5-b6d2-4640-8eac-a11023eab344 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6084943700>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:15.110447 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3f8328a8-d3a6-4728-97f6-2e4febaa216f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/34da3fb0-46ad-49d0-8de1-4fda4ca64f01" status: 200 len: 1412 microversion: 2.1 time: 0.107146 Jun 20 12:06:15.114408 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1053/2118] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:06:15 2022] GET /compute/v2.1/images/34da3fb0-46ad-49d0-8de1-4fda4ca64f01 => generated 1412 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:15.165107 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bfa3a8de-284f-4997-8f29-9d9bf84011e5 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:15.165870 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bfa3a8de-284f-4997-8f29-9d9bf84011e5 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:15.176914 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bfa3a8de-284f-4997-8f29-9d9bf84011e5 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:15.178208 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bfa3a8de-284f-4997-8f29-9d9bf84011e5 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:15.179664 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bfa3a8de-284f-4997-8f29-9d9bf84011e5 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:15.181054 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bfa3a8de-284f-4997-8f29-9d9bf84011e5 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:15.184424 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8a25aec5-b6d2-4640-8eac-a11023eab344 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/1a6b8e9e-1b6d-4b48-b4b0-ca9ccad9615e" status: 200 len: 1455 microversion: 2.1 time: 0.141130 Jun 20 12:06:15.185203 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1066/2119] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:06:15 2022] GET /compute/v2.1/images/1a6b8e9e-1b6d-4b48-b4b0-ca9ccad9615e => generated 1455 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:15.207889 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-388a70d7-0f93-4e20-a6a5-8ecef7816e00 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:15.208814 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-388a70d7-0f93-4e20-a6a5-8ecef7816e00 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:15.223080 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-388a70d7-0f93-4e20-a6a5-8ecef7816e00 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:15.223885 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-388a70d7-0f93-4e20-a6a5-8ecef7816e00 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:15.225621 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-388a70d7-0f93-4e20-a6a5-8ecef7816e00 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:15.226080 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-388a70d7-0f93-4e20-a6a5-8ecef7816e00 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:15.327189 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-bfa3a8de-284f-4997-8f29-9d9bf84011e5 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lazy-loading 'services' on Instance uuid 31066575-9374-412f-9c63-ad5162254777 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:06:15.445054 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bfa3a8de-284f-4997-8f29-9d9bf84011e5 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "DELETE /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777/os-volume_attachments/bede6f21-4f14-4842-8290-34a322b9f1de" status: 202 len: 0 microversion: 2.1 time: 0.284297 Jun 20 12:06:15.446567 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1054/2120] 10.222.0.27 () {58 vars in 1415 bytes} [Mon Jun 20 12:06:15 2022] DELETE /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777/os-volume_attachments/bede6f21-4f14-4842-8290-34a322b9f1de => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:06:15.457355 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1dec92ba-7efc-4eaa-a6fa-3cca765142bb tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:15.458472 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1dec92ba-7efc-4eaa-a6fa-3cca765142bb tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:15.465248 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1dec92ba-7efc-4eaa-a6fa-3cca765142bb tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:15.465704 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1dec92ba-7efc-4eaa-a6fa-3cca765142bb tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:15.466489 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1dec92ba-7efc-4eaa-a6fa-3cca765142bb tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:15.466931 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1dec92ba-7efc-4eaa-a6fa-3cca765142bb tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:15.521309 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1dec92ba-7efc-4eaa-a6fa-3cca765142bb tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068290 Jun 20 12:06:15.522669 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1055/2121] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:06:15 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:06:15.614186 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c42dc35d-a543-46ad-a12e-a84d4bc8dd90 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:15.614788 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-388a70d7-0f93-4e20-a6a5-8ecef7816e00 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:15.615721 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c42dc35d-a543-46ad-a12e-a84d4bc8dd90 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:15.625701 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:06:15.627137 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-388a70d7-0f93-4e20-a6a5-8ecef7816e00 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:15.627897 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c42dc35d-a543-46ad-a12e-a84d4bc8dd90 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:15.628718 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c42dc35d-a543-46ad-a12e-a84d4bc8dd90 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:15.629716 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c42dc35d-a543-46ad-a12e-a84d4bc8dd90 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:15.630188 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c42dc35d-a543-46ad-a12e-a84d4bc8dd90 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:15.637675 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-388a70d7-0f93-4e20-a6a5-8ecef7816e00 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:15.639239 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-388a70d7-0f93-4e20-a6a5-8ecef7816e00 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 2960 microversion: 2.42 time: 0.435901 Jun 20 12:06:15.652984 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1067/2122] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:06:15 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 2960 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:06:16.053524 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e2f73f9f-b0f0-44fa-a404-1d37afecf1ab tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:16.054385 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e2f73f9f-b0f0-44fa-a404-1d37afecf1ab tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:16.070561 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2f73f9f-b0f0-44fa-a404-1d37afecf1ab tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:16.071392 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2f73f9f-b0f0-44fa-a404-1d37afecf1ab tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:16.073080 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2f73f9f-b0f0-44fa-a404-1d37afecf1ab tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:16.073762 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2f73f9f-b0f0-44fa-a404-1d37afecf1ab tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:16.288241 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e2f73f9f-b0f0-44fa-a404-1d37afecf1ab tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:16.298866 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e2f73f9f-b0f0-44fa-a404-1d37afecf1ab tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1494 microversion: 2.1 time: 0.249789 Jun 20 12:06:16.299848 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1068/2123] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:16 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1494 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:16.306002 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ae15e39c-e426-4bd3-a8ca-3d63f7652c6a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f60732bb700>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:16.364982 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ae15e39c-e426-4bd3-a8ca-3d63f7652c6a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/34da3fb0-46ad-49d0-8de1-4fda4ca64f01" status: 200 len: 1412 microversion: 2.1 time: 0.062967 Jun 20 12:06:16.366242 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1069/2124] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:06:16 2022] GET /compute/v2.1/images/34da3fb0-46ad-49d0-8de1-4fda4ca64f01 => generated 1412 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:16.373074 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7b8e1ebc-fcf7-4427-b08f-5779a93d83d5 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f60848f04c0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:16.433301 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7b8e1ebc-fcf7-4427-b08f-5779a93d83d5 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/1a6b8e9e-1b6d-4b48-b4b0-ca9ccad9615e" status: 200 len: 1455 microversion: 2.1 time: 0.065631 Jun 20 12:06:16.434353 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1070/2125] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:06:16 2022] GET /compute/v2.1/images/1a6b8e9e-1b6d-4b48-b4b0-ca9ccad9615e => generated 1455 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:16.534164 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ba2b6fb4-9b32-408a-8908-cef803780005 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:16.535383 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ba2b6fb4-9b32-408a-8908-cef803780005 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:16.545107 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ba2b6fb4-9b32-408a-8908-cef803780005 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:16.545567 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ba2b6fb4-9b32-408a-8908-cef803780005 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:16.546488 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ba2b6fb4-9b32-408a-8908-cef803780005 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:16.547006 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ba2b6fb4-9b32-408a-8908-cef803780005 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:16.553855 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c42dc35d-a543-46ad-a12e-a84d4bc8dd90 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:16.573650 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c42dc35d-a543-46ad-a12e-a84d4bc8dd90 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c" status: 200 len: 1472 microversion: 2.1 time: 0.963531 Jun 20 12:06:16.588761 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1056/2126] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:15 2022] GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c => generated 1472 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:16.596102 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ba2b6fb4-9b32-408a-8908-cef803780005 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066133 Jun 20 12:06:16.604316 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1071/2127] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:06:16 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:06:16.660241 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b45c4b40-7e2f-4fe5-9ffb-74787033a169 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:16.661921 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b45c4b40-7e2f-4fe5-9ffb-74787033a169 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:16.668923 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b45c4b40-7e2f-4fe5-9ffb-74787033a169 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:16.669682 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b45c4b40-7e2f-4fe5-9ffb-74787033a169 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:16.671211 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b45c4b40-7e2f-4fe5-9ffb-74787033a169 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:16.671808 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b45c4b40-7e2f-4fe5-9ffb-74787033a169 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:17.004457 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b45c4b40-7e2f-4fe5-9ffb-74787033a169 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:17.029252 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b45c4b40-7e2f-4fe5-9ffb-74787033a169 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:17.032132 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b45c4b40-7e2f-4fe5-9ffb-74787033a169 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:17.034277 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b45c4b40-7e2f-4fe5-9ffb-74787033a169 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 2960 microversion: 2.42 time: 0.377908 Jun 20 12:06:17.052784 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1057/2128] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:06:16 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 2960 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:06:17.258312 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c4d9c912-0857-473a-88bb-760dbf2f8d62 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:17.269716 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c4d9c912-0857-473a-88bb-760dbf2f8d62 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '47b13de70dd3481684ec50bef063d049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f7335fd515401090c1d0a1e91d0107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:17.271015 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c4d9c912-0857-473a-88bb-760dbf2f8d62 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Searching by: {'deleted': False, 'project_id': '15f7335fd515401090c1d0a1e91d0107'} {{(pid=119127) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:06:17.279747 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c4d9c912-0857-473a-88bb-760dbf2f8d62 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:17.280661 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c4d9c912-0857-473a-88bb-760dbf2f8d62 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:17.282010 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c4d9c912-0857-473a-88bb-760dbf2f8d62 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:17.282807 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c4d9c912-0857-473a-88bb-760dbf2f8d62 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:17.326065 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0d1579f9-53ba-4f98-8ecb-88c58059af45 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:17.326732 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0d1579f9-53ba-4f98-8ecb-88c58059af45 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:17.339345 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d1579f9-53ba-4f98-8ecb-88c58059af45 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:17.339841 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d1579f9-53ba-4f98-8ecb-88c58059af45 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:17.345162 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d1579f9-53ba-4f98-8ecb-88c58059af45 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:17.345959 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d1579f9-53ba-4f98-8ecb-88c58059af45 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:17.428726 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.multi_cell_list [None req-c4d9c912-0857-473a-88bb-760dbf2f8d62 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119127) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 12:06:17.571947 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c4d9c912-0857-473a-88bb-760dbf2f8d62 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.320489 Jun 20 12:06:17.573326 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1072/2129] 10.222.0.27 () {58 vars in 1124 bytes} [Mon Jun 20 12:06:17 2022] GET /compute/v2.1/servers => generated 340 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:06:17.580452 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-90ae501f-af11-49f8-88a5-38677181d869 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f60849d6ee0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:17.608893 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0d1579f9-53ba-4f98-8ecb-88c58059af45 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:17.618056 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0d1579f9-53ba-4f98-8ecb-88c58059af45 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1494 microversion: 2.1 time: 0.296763 Jun 20 12:06:17.632328 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1058/2130] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:17 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1494 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:17.643402 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-20890bbc-58b3-4e3c-8ff2-c2e1dd409867 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f607323af70>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:17.649342 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-90ae501f-af11-49f8-88a5-38677181d869 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/34da3fb0-46ad-49d0-8de1-4fda4ca64f01" status: 200 len: 1412 microversion: 2.1 time: 0.074174 Jun 20 12:06:17.650793 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1073/2131] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:06:17 2022] GET /compute/v2.1/images/34da3fb0-46ad-49d0-8de1-4fda4ca64f01 => generated 1412 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:17.660156 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-eb96984b-0072-42f2-9b42-d2f3bcb3ba56 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:17.672308 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-eb96984b-0072-42f2-9b42-d2f3bcb3ba56 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '47b13de70dd3481684ec50bef063d049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f7335fd515401090c1d0a1e91d0107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:17.675075 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-eb96984b-0072-42f2-9b42-d2f3bcb3ba56 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Searching by: {'deleted': False, 'project_id': '15f7335fd515401090c1d0a1e91d0107'} {{(pid=119127) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:06:17.693239 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb96984b-0072-42f2-9b42-d2f3bcb3ba56 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:17.701711 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb96984b-0072-42f2-9b42-d2f3bcb3ba56 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:17.709030 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb96984b-0072-42f2-9b42-d2f3bcb3ba56 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:17.710102 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb96984b-0072-42f2-9b42-d2f3bcb3ba56 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:17.759283 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-20890bbc-58b3-4e3c-8ff2-c2e1dd409867 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/1a6b8e9e-1b6d-4b48-b4b0-ca9ccad9615e" status: 200 len: 1455 microversion: 2.1 time: 0.123082 Jun 20 12:06:17.764514 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1059/2132] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:06:17 2022] GET /compute/v2.1/images/1a6b8e9e-1b6d-4b48-b4b0-ca9ccad9615e => generated 1455 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:17.777824 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-662aa803-ac9e-4d8a-97ce-596b30c0aa50 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:17.779911 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-662aa803-ac9e-4d8a-97ce-596b30c0aa50 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:17.788823 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-662aa803-ac9e-4d8a-97ce-596b30c0aa50 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:17.790151 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-662aa803-ac9e-4d8a-97ce-596b30c0aa50 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:17.791222 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-662aa803-ac9e-4d8a-97ce-596b30c0aa50 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:17.792337 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-662aa803-ac9e-4d8a-97ce-596b30c0aa50 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:17.906819 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.multi_cell_list [None req-eb96984b-0072-42f2-9b42-d2f3bcb3ba56 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119127) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 12:06:18.026245 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-eb96984b-0072-42f2-9b42-d2f3bcb3ba56 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b13de70dd3481684ec50bef063d049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f7335fd515401090c1d0a1e91d0107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:18.082023 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb96984b-0072-42f2-9b42-d2f3bcb3ba56 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:18.082336 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb96984b-0072-42f2-9b42-d2f3bcb3ba56 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:18.293580 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-662aa803-ac9e-4d8a-97ce-596b30c0aa50 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:18.337260 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-662aa803-ac9e-4d8a-97ce-596b30c0aa50 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c" status: 200 len: 1472 microversion: 2.1 time: 0.571013 Jun 20 12:06:18.341347 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1060/2133] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:17 2022] GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c => generated 1472 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:18.367034 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-45e6539b-6cc4-4898-af4f-0667a56a42c2 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:18.369961 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-45e6539b-6cc4-4898-af4f-0667a56a42c2 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:18.382106 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-45e6539b-6cc4-4898-af4f-0667a56a42c2 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:18.383088 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-45e6539b-6cc4-4898-af4f-0667a56a42c2 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:18.384892 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-45e6539b-6cc4-4898-af4f-0667a56a42c2 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:18.385695 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-45e6539b-6cc4-4898-af4f-0667a56a42c2 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:18.398221 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:06:18.439613 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-eb96984b-0072-42f2-9b42-d2f3bcb3ba56 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 0.786953 Jun 20 12:06:18.441348 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1074/2134] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 12:06:17 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:18.451445 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0f575315-0bac-465e-93cb-972ea2c5f3ea tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:18.452442 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0f575315-0bac-465e-93cb-972ea2c5f3ea tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:18.464413 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f575315-0bac-465e-93cb-972ea2c5f3ea tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:18.466027 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f575315-0bac-465e-93cb-972ea2c5f3ea tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:18.471799 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f575315-0bac-465e-93cb-972ea2c5f3ea tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:18.472374 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f575315-0bac-465e-93cb-972ea2c5f3ea tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:18.485464 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-45e6539b-6cc4-4898-af4f-0667a56a42c2 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126996 Jun 20 12:06:18.486376 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1061/2135] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:06:18 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:06:18.506806 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1e1e3b82-4914-42b4-8567-0e7335988a30 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:18.516442 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1e1e3b82-4914-42b4-8567-0e7335988a30 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028645 Jun 20 12:06:18.517822 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1062/2136] 10.222.0.27 () {58 vars in 1136 bytes} [Mon Jun 20 12:06:18 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:06:18.643532 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b5cc565f-8234-4fc2-aa32-4f09c0e2d190 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:18.651743 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b5cc565f-8234-4fc2-aa32-4f09c0e2d190 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:18.675883 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b5cc565f-8234-4fc2-aa32-4f09c0e2d190 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:18.676672 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b5cc565f-8234-4fc2-aa32-4f09c0e2d190 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:18.677959 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b5cc565f-8234-4fc2-aa32-4f09c0e2d190 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:18.679273 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b5cc565f-8234-4fc2-aa32-4f09c0e2d190 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:19.174154 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b5cc565f-8234-4fc2-aa32-4f09c0e2d190 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:19.184773 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b5cc565f-8234-4fc2-aa32-4f09c0e2d190 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1494 microversion: 2.1 time: 0.547943 Jun 20 12:06:19.189360 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1063/2137] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:18 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1494 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:19.197602 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cf9f28d2-4ea7-4617-9ad2-3950261cfea4 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f6073b5c8b0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:19.209610 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0f575315-0bac-465e-93cb-972ea2c5f3ea tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:19.230933 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0f575315-0bac-465e-93cb-972ea2c5f3ea tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:19.232497 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0f575315-0bac-465e-93cb-972ea2c5f3ea tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:19.233780 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0f575315-0bac-465e-93cb-972ea2c5f3ea tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 2960 microversion: 2.42 time: 0.790684 Jun 20 12:06:19.235364 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1075/2138] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:06:18 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 2960 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:06:19.246700 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f5509d0b-0910-4fad-8650-c5fe2db89d48 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f60848f0430>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:19.386389 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cf9f28d2-4ea7-4617-9ad2-3950261cfea4 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/34da3fb0-46ad-49d0-8de1-4fda4ca64f01" status: 200 len: 1412 microversion: 2.1 time: 0.191914 Jun 20 12:06:19.395105 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1064/2139] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:06:19 2022] GET /compute/v2.1/images/34da3fb0-46ad-49d0-8de1-4fda4ca64f01 => generated 1412 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:19.408129 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-be180549-c42e-4618-8da3-9be172ad1b06 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:19.409447 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-be180549-c42e-4618-8da3-9be172ad1b06 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] [instance: c9290d77-4370-4fb5-a6ef-f1c1b6872b90] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:19.415338 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f5509d0b-0910-4fad-8650-c5fe2db89d48 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/1a6b8e9e-1b6d-4b48-b4b0-ca9ccad9615e" status: 200 len: 1455 microversion: 2.1 time: 0.178845 Jun 20 12:06:19.417718 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1076/2140] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:06:19 2022] GET /compute/v2.1/images/1a6b8e9e-1b6d-4b48-b4b0-ca9ccad9615e => generated 1455 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:19.422572 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-be180549-c42e-4618-8da3-9be172ad1b06 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:19.423381 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-be180549-c42e-4618-8da3-9be172ad1b06 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:19.424578 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-be180549-c42e-4618-8da3-9be172ad1b06 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:19.425161 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-be180549-c42e-4618-8da3-9be172ad1b06 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:19.459847 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e19b2307-8758-4ce0-9bfe-c9c1136c70a8 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:19.461910 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e19b2307-8758-4ce0-9bfe-c9c1136c70a8 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:19.471647 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-be180549-c42e-4618-8da3-9be172ad1b06 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] [instance: c9290d77-4370-4fb5-a6ef-f1c1b6872b90] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:06:19.473101 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e19b2307-8758-4ce0-9bfe-c9c1136c70a8 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:19.477111 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e19b2307-8758-4ce0-9bfe-c9c1136c70a8 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:19.484107 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e19b2307-8758-4ce0-9bfe-c9c1136c70a8 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:19.484921 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e19b2307-8758-4ce0-9bfe-c9c1136c70a8 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:19.663370 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-be180549-c42e-4618-8da3-9be172ad1b06 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90" status: 204 len: 0 microversion: 2.1 time: 0.265658 Jun 20 12:06:19.664800 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1065/2141] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:06:19 2022] DELETE /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:06:19.684019 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7c6a860d-77e5-4b9b-94f0-a3cbcea12d99 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:19.684019 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7c6a860d-77e5-4b9b-94f0-a3cbcea12d99 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:19.720558 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7c6a860d-77e5-4b9b-94f0-a3cbcea12d99 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:19.721025 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7c6a860d-77e5-4b9b-94f0-a3cbcea12d99 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:19.722089 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7c6a860d-77e5-4b9b-94f0-a3cbcea12d99 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:19.722804 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7c6a860d-77e5-4b9b-94f0-a3cbcea12d99 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:19.790027 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7c6a860d-77e5-4b9b-94f0-a3cbcea12d99 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117656 Jun 20 12:06:19.791003 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1066/2142] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:06:19 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:06:19.799815 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-52e6d6b9-8488-4baf-9da0-7be812b02943 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:19.800716 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-52e6d6b9-8488-4baf-9da0-7be812b02943 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] [instance: c9290d77-4370-4fb5-a6ef-f1c1b6872b90] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:19.810471 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-52e6d6b9-8488-4baf-9da0-7be812b02943 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:19.811077 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-52e6d6b9-8488-4baf-9da0-7be812b02943 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:19.812193 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-52e6d6b9-8488-4baf-9da0-7be812b02943 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:19.813166 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-52e6d6b9-8488-4baf-9da0-7be812b02943 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:20.554665 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e19b2307-8758-4ce0-9bfe-c9c1136c70a8 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:20.579534 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e19b2307-8758-4ce0-9bfe-c9c1136c70a8 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c" status: 200 len: 1472 microversion: 2.1 time: 1.156920 Jun 20 12:06:20.588069 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1077/2143] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:19 2022] GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c => generated 1472 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:20.603495 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-091a47ca-9422-4b61-b69c-8bc4a1e10b69 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:20.607477 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-091a47ca-9422-4b61-b69c-8bc4a1e10b69 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:20.640309 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-091a47ca-9422-4b61-b69c-8bc4a1e10b69 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:20.646315 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-091a47ca-9422-4b61-b69c-8bc4a1e10b69 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:20.654276 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-091a47ca-9422-4b61-b69c-8bc4a1e10b69 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:20.654978 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-091a47ca-9422-4b61-b69c-8bc4a1e10b69 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:21.056084 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-091a47ca-9422-4b61-b69c-8bc4a1e10b69 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:21.072986 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-091a47ca-9422-4b61-b69c-8bc4a1e10b69 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 200 len: 1452 microversion: 2.1 time: 0.476960 Jun 20 12:06:21.073947 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1078/2144] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:20 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 1452 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:21.084873 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1a165f8d-c086-4853-97ed-bb0c16c8d349 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:21.090841 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1a165f8d-c086-4853-97ed-bb0c16c8d349 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:21.119253 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a165f8d-c086-4853-97ed-bb0c16c8d349 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:21.120092 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a165f8d-c086-4853-97ed-bb0c16c8d349 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:21.121829 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a165f8d-c086-4853-97ed-bb0c16c8d349 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:21.123751 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a165f8d-c086-4853-97ed-bb0c16c8d349 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:21.237343 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-52e6d6b9-8488-4baf-9da0-7be812b02943 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b13de70dd3481684ec50bef063d049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f7335fd515401090c1d0a1e91d0107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:21.280083 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-52e6d6b9-8488-4baf-9da0-7be812b02943 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] 10.222.0.27 "GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90" status: 200 len: 1715 microversion: 2.1 time: 1.476279 Jun 20 12:06:21.283123 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1067/2145] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:19 2022] GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90 => generated 1715 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:21.331645 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2984dd53-d358-4355-b81c-a8245ff0a62f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f60737c6f70>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:21.816153 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1a165f8d-c086-4853-97ed-bb0c16c8d349 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:21.908699 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1a165f8d-c086-4853-97ed-bb0c16c8d349 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:21.918481 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1a165f8d-c086-4853-97ed-bb0c16c8d349 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:21.924637 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1a165f8d-c086-4853-97ed-bb0c16c8d349 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 2960 microversion: 2.42 time: 0.844865 Jun 20 12:06:21.956675 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1079/2146] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:06:21 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 2960 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:06:21.976446 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-aa1049fe-cef8-4452-b598-8165f0d0447a tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6072d6a310>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:27.827897 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=4 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:06:27.998578 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:06:28.755229 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2984dd53-d358-4355-b81c-a8245ff0a62f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/34da3fb0-46ad-49d0-8de1-4fda4ca64f01" status: 200 len: 1412 microversion: 2.1 time: 7.467381 Jun 20 12:06:28.765562 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-aa1049fe-cef8-4452-b598-8165f0d0447a tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/1a6b8e9e-1b6d-4b48-b4b0-ca9ccad9615e" status: 200 len: 1464 microversion: 2.1 time: 6.806716 Jun 20 12:06:28.772876 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1080/2147] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:06:21 2022] GET /compute/v2.1/images/1a6b8e9e-1b6d-4b48-b4b0-ca9ccad9615e => generated 1464 bytes in 6815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:28.787808 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1068/2148] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:06:21 2022] GET /compute/v2.1/images/34da3fb0-46ad-49d0-8de1-4fda4ca64f01 => generated 1412 bytes in 7503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:28.789753 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-972f13ec-c37d-4a24-b3e3-8194c0437c01 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:28.793769 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-972f13ec-c37d-4a24-b3e3-8194c0437c01 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:28.810139 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-972f13ec-c37d-4a24-b3e3-8194c0437c01 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:28.811110 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-972f13ec-c37d-4a24-b3e3-8194c0437c01 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:28.814224 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-972f13ec-c37d-4a24-b3e3-8194c0437c01 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:28.815032 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-972f13ec-c37d-4a24-b3e3-8194c0437c01 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:28.833585 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-9c311278-8dcb-4bc9-9dab-6003553bdf54 req-ce6ff53f-d81e-4379-9085-f86188244c51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9be8ed90-c9d0-4d98-b1b8-cc3395caffd1", "name": "network-vif-deleted", "tag": "67d89a40-681d-4bfe-91dc-777e7d773c40"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:06:28.880740 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:06:28.918120 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-972f13ec-c37d-4a24-b3e3-8194c0437c01 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142115 Jun 20 12:06:28.926206 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1081/2149] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:06:28 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:06:28.933939 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dbf388ea-289d-43a8-89bb-9cb7fe20404c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:28.935661 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dbf388ea-289d-43a8-89bb-9cb7fe20404c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:28.942242 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9c311278-8dcb-4bc9-9dab-6003553bdf54 req-ce6ff53f-d81e-4379-9085-f86188244c51 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:28.943245 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9c311278-8dcb-4bc9-9dab-6003553bdf54 req-ce6ff53f-d81e-4379-9085-f86188244c51 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:28.946374 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dbf388ea-289d-43a8-89bb-9cb7fe20404c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:28.947174 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dbf388ea-289d-43a8-89bb-9cb7fe20404c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:28.948266 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dbf388ea-289d-43a8-89bb-9cb7fe20404c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:28.948953 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dbf388ea-289d-43a8-89bb-9cb7fe20404c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:29.033699 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-9c311278-8dcb-4bc9-9dab-6003553bdf54 req-ce6ff53f-d81e-4379-9085-f86188244c51 service nova] Creating event network-vif-deleted:67d89a40-681d-4bfe-91dc-777e7d773c40 for instance 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 on n-h2-master-1 Jun 20 12:06:29.048943 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-9c311278-8dcb-4bc9-9dab-6003553bdf54 req-ce6ff53f-d81e-4379-9085-f86188244c51 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.258913 Jun 20 12:06:29.053282 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1069/2150] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:06:29.066036 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8fef73cc-1ef2-498b-a589-28440a96c5c8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:29.067926 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8fef73cc-1ef2-498b-a589-28440a96c5c8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:29.101628 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8fef73cc-1ef2-498b-a589-28440a96c5c8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:29.103363 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8fef73cc-1ef2-498b-a589-28440a96c5c8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:29.105376 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8fef73cc-1ef2-498b-a589-28440a96c5c8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:29.107098 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8fef73cc-1ef2-498b-a589-28440a96c5c8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:29.156741 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-8fef73cc-1ef2-498b-a589-28440a96c5c8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] HTTP exception thrown: Instance 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 could not be found. Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8fef73cc-1ef2-498b-a589-28440a96c5c8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Request method failure captured: Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 HTTP/1.1 Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGGM0_Rgon_QXChHIK_Ikyu0N9hux8u1Ms08jFhXlxkRDQgHGZCrxeBLJGVow3P3B7-C_d1lwOFEoVq18fpBt5bYVFsDOyFchFBnf15eYmBoM5W3iquFzY2ZI2UJK0DkPKTj0Fv6tDqgY5whthvLS8glHLsBu0Y3_K5TIG0-QwQVU5w Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 3495d9dc8b714809b2f3f777cbabda29 Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 could not be found. Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '9be8ed90-c9d0-4d98-b1b8-cc3395caffd1'} Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 could not be found. Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 could not be found. Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:06:29.159108 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:06:29.166042 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:06:29.166042 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:06:29.166042 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:06:29.166042 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:06:29.166042 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:06:29.166042 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 could not be found. Jun 20 12:06:29.166042 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:06:29.166042 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8fef73cc-1ef2-498b-a589-28440a96c5c8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Returning 404 to user: Instance 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:06:29.166042 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8fef73cc-1ef2-498b-a589-28440a96c5c8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 404 len: 111 microversion: 2.1 time: 0.105852 Jun 20 12:06:29.195139 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1070/2151] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:29 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:06:29.210080 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-674891cc-90ad-43c4-b31f-88dda3df31a6 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:29.211165 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-674891cc-90ad-43c4-b31f-88dda3df31a6 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] [instance: c9290d77-4370-4fb5-a6ef-f1c1b6872b90] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:29.241004 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-674891cc-90ad-43c4-b31f-88dda3df31a6 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:29.241463 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-674891cc-90ad-43c4-b31f-88dda3df31a6 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:29.242263 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-674891cc-90ad-43c4-b31f-88dda3df31a6 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:29.242705 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-674891cc-90ad-43c4-b31f-88dda3df31a6 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:29.356270 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-674891cc-90ad-43c4-b31f-88dda3df31a6 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] HTTP exception thrown: Instance c9290d77-4370-4fb5-a6ef-f1c1b6872b90 could not be found. Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-674891cc-90ad-43c4-b31f-88dda3df31a6 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Request method failure captured: Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90 HTTP/1.1 Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGI4CQFtcBqZQfoOwmj9tDCjM0_RVwOYQp21mCK831eTR9IAnlduor0ZbsuOB_EnXAkDtWMZIuFp7Yj_IBk1FVQ-YPOgUMxWfIA7AsArFYgDvJc0BfyrUuybsbRzgD3C3skEXRoVvzIPrJ4Q9gtwgb015ksgwJ2qQ4DyAfCcOKPi1nk Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 15f7335fd515401090c1d0a1e91d0107 Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersTestManualDisk-979864883 Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/15f7335fd515401090c1d0a1e91d0107"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/15f7335fd515401090c1d0a1e91d0107"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/15f7335fd515401090c1d0a1e91d0107"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_15f7335fd515401090c1d0a1e91d0107"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersTestManualDisk-979864883 Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 15f7335fd515401090c1d0a1e91d0107 Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersTestManualDisk-979864883 Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersTestManualDisk-979864883-project Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 47b13de70dd3481684ec50bef063d049 Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersTestManualDisk-979864883-project Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: exception: Instance c9290d77-4370-4fb5-a6ef-f1c1b6872b90 could not be found. Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'c9290d77-4370-4fb5-a6ef-f1c1b6872b90'} Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9290d77-4370-4fb5-a6ef-f1c1b6872b90 could not be found. Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9290d77-4370-4fb5-a6ef-f1c1b6872b90 could not be found. Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:06:29.362483 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:06:29.376646 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:06:29.376646 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:06:29.376646 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:06:29.376646 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:06:29.376646 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:06:29.376646 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9290d77-4370-4fb5-a6ef-f1c1b6872b90 could not be found. Jun 20 12:06:29.376646 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:06:29.376646 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-674891cc-90ad-43c4-b31f-88dda3df31a6 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Returning 404 to user: Instance c9290d77-4370-4fb5-a6ef-f1c1b6872b90 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:06:29.376646 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-674891cc-90ad-43c4-b31f-88dda3df31a6 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] 10.222.0.27 "GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90" status: 404 len: 111 microversion: 2.1 time: 0.181864 Jun 20 12:06:29.379900 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1071/2152] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:29 2022] GET /compute/v2.1/servers/c9290d77-4370-4fb5-a6ef-f1c1b6872b90 => generated 111 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:06:29.419068 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-76f92c38-932a-4f17-82b5-55a61f8ed2be req-89932a5a-cdca-4d3e-ad95-78d5da174593 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f59e801d-2548-4edc-8283-af47c991d92a", "name": "network-vif-unplugged", "status": "completed", "tag": "32d33855-eec9-4f47-8a63-741b0283b523"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:06:29.447389 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-76f92c38-932a-4f17-82b5-55a61f8ed2be req-89932a5a-cdca-4d3e-ad95-78d5da174593 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:29.484607 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-76f92c38-932a-4f17-82b5-55a61f8ed2be req-89932a5a-cdca-4d3e-ad95-78d5da174593 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:29.546216 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-76f92c38-932a-4f17-82b5-55a61f8ed2be req-89932a5a-cdca-4d3e-ad95-78d5da174593 service nova] Creating event network-vif-unplugged:32d33855-eec9-4f47-8a63-741b0283b523 for instance f59e801d-2548-4edc-8283-af47c991d92a on n-h2-master-1 Jun 20 12:06:29.564663 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-76f92c38-932a-4f17-82b5-55a61f8ed2be req-89932a5a-cdca-4d3e-ad95-78d5da174593 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.182878 Jun 20 12:06:29.570071 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1072/2153] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:06:29.582010 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-16f081fc-5ac9-4dff-966d-0c6dd7a1da20 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:29.583196 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-16f081fc-5ac9-4dff-966d-0c6dd7a1da20 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:29.597078 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-16f081fc-5ac9-4dff-966d-0c6dd7a1da20 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:29.597914 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-16f081fc-5ac9-4dff-966d-0c6dd7a1da20 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:29.598947 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-16f081fc-5ac9-4dff-966d-0c6dd7a1da20 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:29.601004 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-16f081fc-5ac9-4dff-966d-0c6dd7a1da20 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:29.782677 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dbf388ea-289d-43a8-89bb-9cb7fe20404c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:29.817444 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dbf388ea-289d-43a8-89bb-9cb7fe20404c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c" status: 200 len: 1477 microversion: 2.1 time: 0.889430 Jun 20 12:06:29.818101 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1082/2154] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:28 2022] GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c => generated 1477 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:29.824034 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-015cb3c0-a290-40f4-81f9-2ba89b3e9135 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6072d6a310>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:29.943602 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-015cb3c0-a290-40f4-81f9-2ba89b3e9135 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/1a6b8e9e-1b6d-4b48-b4b0-ca9ccad9615e" status: 200 len: 1464 microversion: 2.1 time: 0.123794 Jun 20 12:06:29.958512 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1083/2155] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:06:29 2022] GET /compute/v2.1/images/1a6b8e9e-1b6d-4b48-b4b0-ca9ccad9615e => generated 1464 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:29.965842 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fa697956-94c7-4bbb-92e8-f45e57b853ce tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-52374933", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "25724adf-e301-4183-8c20-574ec029a516"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:06:30.094762 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-fa697956-94c7-4bbb-92e8-f45e57b853ce tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] validate_networks() for [('25724adf-e301-4183-8c20-574ec029a516', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:06:30.338580 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-16f081fc-5ac9-4dff-966d-0c6dd7a1da20 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:30.365406 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-16f081fc-5ac9-4dff-966d-0c6dd7a1da20 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:30.374465 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-16f081fc-5ac9-4dff-966d-0c6dd7a1da20 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:30.380102 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-16f081fc-5ac9-4dff-966d-0c6dd7a1da20 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 2871 microversion: 2.42 time: 0.808013 Jun 20 12:06:30.381086 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1073/2156] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:06:29 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 2871 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:06:30.408244 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1f669ebc-6731-428a-b3ae-fb566e4238f3 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] Calling method '.version_select at 0x7f6073c81a60>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:30.452053 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1f669ebc-6731-428a-b3ae-fb566e4238f3 tempest-ServersTestManualDisk-979864883 tempest-ServersTestManualDisk-979864883-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1445460862" status: 202 len: 0 microversion: 2.1 time: 0.048760 Jun 20 12:06:30.456302 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1074/2157] 10.222.0.27 () {58 vars in 1220 bytes} [Mon Jun 20 12:06:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1445460862 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:06:30.462861 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b5993ea0-cbc3-4155-b106-b285c7fff7c3 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f60731fbc10>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:30.619803 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b5993ea0-cbc3-4155-b106-b285c7fff7c3 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/34da3fb0-46ad-49d0-8de1-4fda4ca64f01" status: 200 len: 1412 microversion: 2.1 time: 0.155611 Jun 20 12:06:30.622667 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1075/2158] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:06:30 2022] GET /compute/v2.1/images/34da3fb0-46ad-49d0-8de1-4fda4ca64f01 => generated 1412 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:30.655252 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2439e548-c60a-4e5a-9bcd-8f6b0f14f291 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:30.679483 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2439e548-c60a-4e5a-9bcd-8f6b0f14f291 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:30.752438 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2439e548-c60a-4e5a-9bcd-8f6b0f14f291 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:30.752953 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2439e548-c60a-4e5a-9bcd-8f6b0f14f291 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:30.753869 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2439e548-c60a-4e5a-9bcd-8f6b0f14f291 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:30.758847 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2439e548-c60a-4e5a-9bcd-8f6b0f14f291 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:30.821318 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2439e548-c60a-4e5a-9bcd-8f6b0f14f291 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.192722 Jun 20 12:06:30.825920 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1076/2159] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:06:30 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777/os-volume_attachments => generated 197 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:06:30.841282 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-845dea0f-e5e2-47a0-afc7-cc9b1819f189 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:30.841734 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-845dea0f-e5e2-47a0-afc7-cc9b1819f189 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: 838db96b-0c7a-4d7f-9807-44194bc73cff] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:30.849968 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-845dea0f-e5e2-47a0-afc7-cc9b1819f189 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:30.849968 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-845dea0f-e5e2-47a0-afc7-cc9b1819f189 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:30.850393 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-845dea0f-e5e2-47a0-afc7-cc9b1819f189 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:30.850979 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-845dea0f-e5e2-47a0-afc7-cc9b1819f189 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:31.569212 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-845dea0f-e5e2-47a0-afc7-cc9b1819f189 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286e4b475bbc4d108ca00497ecd3e55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8c8766d4f143349b61f27d8f2566fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:31.593719 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-845dea0f-e5e2-47a0-afc7-cc9b1819f189 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/servers/838db96b-0c7a-4d7f-9807-44194bc73cff" status: 200 len: 1468 microversion: 2.1 time: 0.766432 Jun 20 12:06:31.597463 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1077/2160] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:30 2022] GET /compute/v2.1/servers/838db96b-0c7a-4d7f-9807-44194bc73cff => generated 1468 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:31.801962 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-462de712-8520-49c3-b4a6-5056781145b0 req-11584e75-4c1a-480e-9a43-7494ee72acf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f59e801d-2548-4edc-8283-af47c991d92a", "name": "network-vif-deleted", "tag": "32d33855-eec9-4f47-8a63-741b0283b523"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:06:31.833531 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-462de712-8520-49c3-b4a6-5056781145b0 req-11584e75-4c1a-480e-9a43-7494ee72acf4 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:31.834148 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-462de712-8520-49c3-b4a6-5056781145b0 req-11584e75-4c1a-480e-9a43-7494ee72acf4 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:31.859945 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-462de712-8520-49c3-b4a6-5056781145b0 req-11584e75-4c1a-480e-9a43-7494ee72acf4 service nova] Creating event network-vif-deleted:32d33855-eec9-4f47-8a63-741b0283b523 for instance f59e801d-2548-4edc-8283-af47c991d92a on n-h2-master-1 Jun 20 12:06:31.865705 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-462de712-8520-49c3-b4a6-5056781145b0 req-11584e75-4c1a-480e-9a43-7494ee72acf4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.266473 Jun 20 12:06:31.866830 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1078/2161] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:06:31.875096 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ccd665ec-6d62-4aae-9986-18d8c68b3a9f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:31.875096 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ccd665ec-6d62-4aae-9986-18d8c68b3a9f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:31.891005 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ccd665ec-6d62-4aae-9986-18d8c68b3a9f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:31.891727 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ccd665ec-6d62-4aae-9986-18d8c68b3a9f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:31.893210 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ccd665ec-6d62-4aae-9986-18d8c68b3a9f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:31.894021 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ccd665ec-6d62-4aae-9986-18d8c68b3a9f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:32.159822 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-fa697956-94c7-4bbb-92e8-f45e57b853ce tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:06:32.160299 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-fa697956-94c7-4bbb-92e8-f45e57b853ce tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:06:32.160762 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-fa697956-94c7-4bbb-92e8-f45e57b853ce tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:06:32.161181 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-fa697956-94c7-4bbb-92e8-f45e57b853ce tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:06:32.161602 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-fa697956-94c7-4bbb-92e8-f45e57b853ce tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:06:32.180710 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fa697956-94c7-4bbb-92e8-f45e57b853ce tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:32.181375 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fa697956-94c7-4bbb-92e8-f45e57b853ce tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:32.182480 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fa697956-94c7-4bbb-92e8-f45e57b853ce tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:32.182992 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fa697956-94c7-4bbb-92e8-f45e57b853ce tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:32.263021 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-fa697956-94c7-4bbb-92e8-f45e57b853ce tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Getting quotas for project 7dbe3d6c4b7a41fa8181a805a992c173. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:06:32.279205 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-fa697956-94c7-4bbb-92e8-f45e57b853ce tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Getting quotas for user 3495d9dc8b714809b2f3f777cbabda29 and project 7dbe3d6c4b7a41fa8181a805a992c173. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:06:32.338510 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fa697956-94c7-4bbb-92e8-f45e57b853ce tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:06:32.342907 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fa697956-94c7-4bbb-92e8-f45e57b853ce tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 591d670e-ac99-40a4-9e67-0a7923a203b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:06:32.450893 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fa697956-94c7-4bbb-92e8-f45e57b853ce tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.490714 Jun 20 12:06:32.455800 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1084/2162] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:06:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:06:32.464181 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-26b3897a-738b-40d6-b5c1-3671b3e63469 req-a98cfda3-14a6-486a-af7a-d82f9f5b5e14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9290d77-4370-4fb5-a6ef-f1c1b6872b90", "name": "network-vif-deleted", "tag": "df0d5349-d128-45d1-bb70-d0936101a5ee"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:06:32.537319 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-26b3897a-738b-40d6-b5c1-3671b3e63469 req-a98cfda3-14a6-486a-af7a-d82f9f5b5e14 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:32.543445 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-26b3897a-738b-40d6-b5c1-3671b3e63469 req-a98cfda3-14a6-486a-af7a-d82f9f5b5e14 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:32.583839 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-26b3897a-738b-40d6-b5c1-3671b3e63469 req-a98cfda3-14a6-486a-af7a-d82f9f5b5e14 service nova] Creating event network-vif-deleted:df0d5349-d128-45d1-bb70-d0936101a5ee for instance c9290d77-4370-4fb5-a6ef-f1c1b6872b90 on n-h2-master-1 Jun 20 12:06:32.605709 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-26b3897a-738b-40d6-b5c1-3671b3e63469 req-a98cfda3-14a6-486a-af7a-d82f9f5b5e14 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148133 Jun 20 12:06:32.606423 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1085/2163] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:06:32.643341 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f1a14a5b-981d-424f-8810-b33aaf81bd17 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:32.644236 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f1a14a5b-981d-424f-8810-b33aaf81bd17 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:32.672160 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f1a14a5b-981d-424f-8810-b33aaf81bd17 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:32.677661 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f1a14a5b-981d-424f-8810-b33aaf81bd17 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:32.682817 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f1a14a5b-981d-424f-8810-b33aaf81bd17 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:32.685965 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f1a14a5b-981d-424f-8810-b33aaf81bd17 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:33.115633 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ccd665ec-6d62-4aae-9986-18d8c68b3a9f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:33.137554 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ccd665ec-6d62-4aae-9986-18d8c68b3a9f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c" status: 200 len: 1477 microversion: 2.1 time: 1.269309 Jun 20 12:06:33.139340 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1079/2164] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:31 2022] GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c => generated 1477 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:33.146000 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-e3bfddbc-19f2-40eb-b1a3-6ab55f8ac4ce req-4a2ac036-c25a-4843-8b57-08d2189a41b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f59e801d-2548-4edc-8283-af47c991d92a", "name": "network-vif-unplugged", "status": "completed", "tag": "f8436f92-9119-4a95-9ea8-7e547b5c7945"}, {"server_uuid": "f59e801d-2548-4edc-8283-af47c991d92a", "name": "network-vif-unplugged", "status": "completed", "tag": "60eddb1c-4042-4f66-9e7b-bb3e6459de20"}, {"server_uuid": "f59e801d-2548-4edc-8283-af47c991d92a", "name": "network-vif-unplugged", "status": "completed", "tag": "24d1960a-4d01-49b2-80a0-84252c3d23d4"}, {"server_uuid": "f59e801d-2548-4edc-8283-af47c991d92a", "name": "network-vif-unplugged", "status": "completed", "tag": "b010dc80-2c35-44a9-a8d1-6aa254f13aa2"}, {"server_uuid": "f59e801d-2548-4edc-8283-af47c991d92a", "name": "network-vif-unplugged", "status": "completed", "tag": "094c45ad-d8c1-4802-908a-41730c77c870"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:06:33.159601 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e3bfddbc-19f2-40eb-b1a3-6ab55f8ac4ce req-4a2ac036-c25a-4843-8b57-08d2189a41b9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:33.160539 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e3bfddbc-19f2-40eb-b1a3-6ab55f8ac4ce req-4a2ac036-c25a-4843-8b57-08d2189a41b9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:33.179785 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-e3bfddbc-19f2-40eb-b1a3-6ab55f8ac4ce req-4a2ac036-c25a-4843-8b57-08d2189a41b9 service nova] Creating event network-vif-unplugged:f8436f92-9119-4a95-9ea8-7e547b5c7945 for instance f59e801d-2548-4edc-8283-af47c991d92a on n-h2-master-1 Jun 20 12:06:33.180668 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-e3bfddbc-19f2-40eb-b1a3-6ab55f8ac4ce req-4a2ac036-c25a-4843-8b57-08d2189a41b9 service nova] Creating event network-vif-unplugged:60eddb1c-4042-4f66-9e7b-bb3e6459de20 for instance f59e801d-2548-4edc-8283-af47c991d92a on n-h2-master-1 Jun 20 12:06:33.181448 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-e3bfddbc-19f2-40eb-b1a3-6ab55f8ac4ce req-4a2ac036-c25a-4843-8b57-08d2189a41b9 service nova] Creating event network-vif-unplugged:24d1960a-4d01-49b2-80a0-84252c3d23d4 for instance f59e801d-2548-4edc-8283-af47c991d92a on n-h2-master-1 Jun 20 12:06:33.182507 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-e3bfddbc-19f2-40eb-b1a3-6ab55f8ac4ce req-4a2ac036-c25a-4843-8b57-08d2189a41b9 service nova] Creating event network-vif-unplugged:b010dc80-2c35-44a9-a8d1-6aa254f13aa2 for instance f59e801d-2548-4edc-8283-af47c991d92a on n-h2-master-1 Jun 20 12:06:33.183235 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-e3bfddbc-19f2-40eb-b1a3-6ab55f8ac4ce req-4a2ac036-c25a-4843-8b57-08d2189a41b9 service nova] Creating event network-vif-unplugged:094c45ad-d8c1-4802-908a-41730c77c870 for instance f59e801d-2548-4edc-8283-af47c991d92a on n-h2-master-1 Jun 20 12:06:33.189938 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-e3bfddbc-19f2-40eb-b1a3-6ab55f8ac4ce req-4a2ac036-c25a-4843-8b57-08d2189a41b9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.049090 Jun 20 12:06:33.191360 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1080/2165] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:06:33.199279 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3e4c6ca4-9bde-4993-a848-21412561b142 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f60731fbdc0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:33.381393 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3e4c6ca4-9bde-4993-a848-21412561b142 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images?changes-since=2022-06-20T12%3A04%3A18Z" status: 200 len: 1904 microversion: 2.1 time: 0.188010 Jun 20 12:06:33.382600 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1081/2166] 10.222.0.27 () {58 vars in 1198 bytes} [Mon Jun 20 12:06:33 2022] GET /compute/v2.1/images?changes-since=2022-06-20T12%3A04%3A18Z => generated 1904 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:33.387838 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9c32f919-575c-4ff6-b93a-af2b03dde293 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f6073901040>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:33.440569 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9c32f919-575c-4ff6-b93a-af2b03dde293 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/34da3fb0-46ad-49d0-8de1-4fda4ca64f01" status: 200 len: 1412 microversion: 2.1 time: 0.056545 Jun 20 12:06:33.442044 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1082/2167] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:06:33 2022] GET /compute/v2.1/images/34da3fb0-46ad-49d0-8de1-4fda4ca64f01 => generated 1412 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:33.448134 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-223a0675-25e2-4938-a42c-e17e6b781b0c tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:33.449666 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-223a0675-25e2-4938-a42c-e17e6b781b0c tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:33.458214 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-223a0675-25e2-4938-a42c-e17e6b781b0c tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:33.459158 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-223a0675-25e2-4938-a42c-e17e6b781b0c tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:33.460334 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-223a0675-25e2-4938-a42c-e17e6b781b0c tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:33.461081 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-223a0675-25e2-4938-a42c-e17e6b781b0c tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:33.542059 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-223a0675-25e2-4938-a42c-e17e6b781b0c tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.096766 Jun 20 12:06:33.543036 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1083/2168] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:06:33 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:06:33.556641 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-230fe321-c51d-4ad3-be2b-f38ebfc2ffe8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:33.557632 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-230fe321-c51d-4ad3-be2b-f38ebfc2ffe8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 591d670e-ac99-40a4-9e67-0a7923a203b6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:33.766368 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-230fe321-c51d-4ad3-be2b-f38ebfc2ffe8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:33.778875 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-230fe321-c51d-4ad3-be2b-f38ebfc2ffe8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/591d670e-ac99-40a4-9e67-0a7923a203b6" status: 200 len: 1213 microversion: 2.1 time: 0.231707 Jun 20 12:06:33.779473 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1084/2169] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:33 2022] GET /compute/v2.1/servers/591d670e-ac99-40a4-9e67-0a7923a203b6 => generated 1213 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:33.792114 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ed039d30-601c-442b-b4af-26bae657ee1b tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f607384c940>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:33.939696 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ed039d30-601c-442b-b4af-26bae657ee1b tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-436678309" status: 200 len: 484 microversion: 2.1 time: 0.157224 Jun 20 12:06:33.940729 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1085/2170] 10.222.0.27 () {58 vars in 1228 bytes} [Mon Jun 20 12:06:33 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-436678309 => generated 484 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:06:33.946970 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-6b971df9-402a-4069-ae7a-d61953831503 req-4f4306bb-c60a-43da-bdcc-398db67fe0a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f59e801d-2548-4edc-8283-af47c991d92a", "name": "network-vif-deleted", "tag": "60eddb1c-4042-4f66-9e7b-bb3e6459de20"}, {"server_uuid": "f59e801d-2548-4edc-8283-af47c991d92a", "name": "network-vif-deleted", "tag": "24d1960a-4d01-49b2-80a0-84252c3d23d4"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:06:33.980785 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-6b971df9-402a-4069-ae7a-d61953831503 req-4f4306bb-c60a-43da-bdcc-398db67fe0a9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:33.981239 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-6b971df9-402a-4069-ae7a-d61953831503 req-4f4306bb-c60a-43da-bdcc-398db67fe0a9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:34.021736 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-6b971df9-402a-4069-ae7a-d61953831503 req-4f4306bb-c60a-43da-bdcc-398db67fe0a9 service nova] Creating event network-vif-deleted:60eddb1c-4042-4f66-9e7b-bb3e6459de20 for instance f59e801d-2548-4edc-8283-af47c991d92a on n-h2-master-1 Jun 20 12:06:34.029494 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-6b971df9-402a-4069-ae7a-d61953831503 req-4f4306bb-c60a-43da-bdcc-398db67fe0a9 service nova] Creating event network-vif-deleted:24d1960a-4d01-49b2-80a0-84252c3d23d4 for instance f59e801d-2548-4edc-8283-af47c991d92a on n-h2-master-1 Jun 20 12:06:34.043342 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-6b971df9-402a-4069-ae7a-d61953831503 req-4f4306bb-c60a-43da-bdcc-398db67fe0a9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.101024 Jun 20 12:06:34.044513 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1086/2171] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:06:34.055206 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b0cb6dfa-0c7a-47ff-a663-24aa991cf98c tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f608004b700>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:34.158189 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f1a14a5b-981d-424f-8810-b33aaf81bd17 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:34.171788 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f1a14a5b-981d-424f-8810-b33aaf81bd17 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:34.185381 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f1a14a5b-981d-424f-8810-b33aaf81bd17 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:34.189964 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f1a14a5b-981d-424f-8810-b33aaf81bd17 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 2487 microversion: 2.42 time: 1.571640 Jun 20 12:06:34.194309 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1086/2172] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:06:32 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 2487 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:06:34.215500 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8a3e9fcd-6fd3-4c80-b07b-5397abff0579 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:34.226460 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8a3e9fcd-6fd3-4c80-b07b-5397abff0579 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:34.252974 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a3e9fcd-6fd3-4c80-b07b-5397abff0579 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:34.253652 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a3e9fcd-6fd3-4c80-b07b-5397abff0579 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:34.254756 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a3e9fcd-6fd3-4c80-b07b-5397abff0579 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:34.262131 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a3e9fcd-6fd3-4c80-b07b-5397abff0579 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:34.379608 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b0cb6dfa-0c7a-47ff-a663-24aa991cf98c tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images?server=838db96b-0c7a-4d7f-9807-44194bc73cff" status: 200 len: 958 microversion: 2.1 time: 0.333650 Jun 20 12:06:34.390262 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1087/2173] 10.222.0.27 () {58 vars in 1208 bytes} [Mon Jun 20 12:06:34 2022] GET /compute/v2.1/images?server=838db96b-0c7a-4d7f-9807-44194bc73cff => generated 958 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:06:34.407730 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3a64119a-a734-42bb-9dcd-0a33f41caaa8 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073901040>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:34.485827 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3a64119a-a734-42bb-9dcd-0a33f41caaa8 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2Ff7d2499c-a9c8-4c2e-8445-667070737f1f" status: 200 len: 485 microversion: 2.1 time: 0.093806 Jun 20 12:06:34.490987 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1088/2174] 10.222.0.27 () {58 vars in 1316 bytes} [Mon Jun 20 12:06:34 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2Ff7d2499c-a9c8-4c2e-8445-667070737f1f => generated 485 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:06:34.498874 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c0056d42-6e10-46eb-a6ea-976fe21b15e3 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f60731fbaf0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:34.578728 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c0056d42-6e10-46eb-a6ea-976fe21b15e3 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/34da3fb0-46ad-49d0-8de1-4fda4ca64f01" status: 200 len: 1412 microversion: 2.1 time: 0.086345 Jun 20 12:06:34.579793 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1089/2175] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:06:34 2022] GET /compute/v2.1/images/34da3fb0-46ad-49d0-8de1-4fda4ca64f01 => generated 1412 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:34.611415 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1347372e-7f81-4461-938d-43286f5ae99f tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f607323a790>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:34.751645 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1347372e-7f81-4461-938d-43286f5ae99f tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2Ff7d2499c-a9c8-4c2e-8445-667070737f1f" status: 200 len: 485 microversion: 2.1 time: 0.168322 Jun 20 12:06:34.753000 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1090/2176] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Jun 20 12:06:34 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2Ff7d2499c-a9c8-4c2e-8445-667070737f1f => generated 485 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:06:34.782669 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-82dc1e27-fcf2-4aef-b7c4-4ab09f768357 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073533dc0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:35.208499 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-82dc1e27-fcf2-4aef-b7c4-4ab09f768357 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.441751 Jun 20 12:06:35.215872 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1091/2177] 10.222.0.27 () {58 vars in 1148 bytes} [Mon Jun 20 12:06:34 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:35.232298 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-71beebd4-f850-4fe9-b433-8eca9a4d1355 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:35.235835 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-71beebd4-f850-4fe9-b433-8eca9a4d1355 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 591d670e-ac99-40a4-9e67-0a7923a203b6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:35.254140 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-71beebd4-f850-4fe9-b433-8eca9a4d1355 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:35.254598 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-71beebd4-f850-4fe9-b433-8eca9a4d1355 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:35.255424 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-71beebd4-f850-4fe9-b433-8eca9a4d1355 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:35.255887 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-71beebd4-f850-4fe9-b433-8eca9a4d1355 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:35.411473 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8a3e9fcd-6fd3-4c80-b07b-5397abff0579 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:35.421500 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8a3e9fcd-6fd3-4c80-b07b-5397abff0579 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c" status: 200 len: 1477 microversion: 2.1 time: 1.215677 Jun 20 12:06:35.434866 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1087/2178] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:34 2022] GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c => generated 1477 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:35.447011 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-43c79e2c-9a8c-45f4-b440-53a41d35c641 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:35.449102 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-43c79e2c-9a8c-45f4-b440-53a41d35c641 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:35.456280 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:06:35.458207 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-43c79e2c-9a8c-45f4-b440-53a41d35c641 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:35.458943 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-43c79e2c-9a8c-45f4-b440-53a41d35c641 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:35.459988 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-43c79e2c-9a8c-45f4-b440-53a41d35c641 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:35.460992 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-43c79e2c-9a8c-45f4-b440-53a41d35c641 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:35.562331 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-71beebd4-f850-4fe9-b433-8eca9a4d1355 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:35.579888 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-71beebd4-f850-4fe9-b433-8eca9a4d1355 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/591d670e-ac99-40a4-9e67-0a7923a203b6" status: 200 len: 1271 microversion: 2.1 time: 0.361986 Jun 20 12:06:35.584528 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1092/2179] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:35 2022] GET /compute/v2.1/servers/591d670e-ac99-40a4-9e67-0a7923a203b6 => generated 1271 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:35.606548 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c6d0a8f7-4f10-4ca9-b561-b34d6e66183d tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073b5c8b0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:35.848715 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c6d0a8f7-4f10-4ca9-b561-b34d6e66183d tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1431 microversion: 2.1 time: 0.262477 Jun 20 12:06:35.867493 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1093/2180] 10.222.0.27 () {58 vars in 1148 bytes} [Mon Jun 20 12:06:35 2022] GET /compute/v2.1/images?type=snapshot => generated 1431 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:35.911773 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-43c79e2c-9a8c-45f4-b440-53a41d35c641 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:35.922423 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-43c79e2c-9a8c-45f4-b440-53a41d35c641 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:35.936706 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-43c79e2c-9a8c-45f4-b440-53a41d35c641 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:35.938101 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-43c79e2c-9a8c-45f4-b440-53a41d35c641 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 2145 microversion: 2.42 time: 0.501830 Jun 20 12:06:35.945733 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1088/2181] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:06:35 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 2145 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:06:35.950861 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c518b839-76f7-4919-85ca-b1d7f7e9c3c3 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f6084943820>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:36.051125 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-20516aba-563e-4b01-9d45-7b09e0630696 req-6e327261-a495-4719-8eda-44ffad7e7dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "838db96b-0c7a-4d7f-9807-44194bc73cff", "name": "network-vif-unplugged", "status": "completed", "tag": "1e4f16ac-a73c-4854-8d0f-a050fb989db4"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:06:36.054463 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c518b839-76f7-4919-85ca-b1d7f7e9c3c3 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/34da3fb0-46ad-49d0-8de1-4fda4ca64f01" status: 200 len: 1412 microversion: 2.1 time: 0.106376 Jun 20 12:06:36.063596 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1089/2182] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:06:35 2022] GET /compute/v2.1/images/34da3fb0-46ad-49d0-8de1-4fda4ca64f01 => generated 1412 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:36.068646 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1716c9c3-f6d4-4191-b8fb-f9e8edd92799 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6072d44dc0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:36.085873 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-20516aba-563e-4b01-9d45-7b09e0630696 req-6e327261-a495-4719-8eda-44ffad7e7dc8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:36.086468 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-20516aba-563e-4b01-9d45-7b09e0630696 req-6e327261-a495-4719-8eda-44ffad7e7dc8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:36.143352 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-20516aba-563e-4b01-9d45-7b09e0630696 req-6e327261-a495-4719-8eda-44ffad7e7dc8 service nova] Creating event network-vif-unplugged:1e4f16ac-a73c-4854-8d0f-a050fb989db4 for instance 838db96b-0c7a-4d7f-9807-44194bc73cff on n-h1-master-1 Jun 20 12:06:36.171799 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-20516aba-563e-4b01-9d45-7b09e0630696 req-6e327261-a495-4719-8eda-44ffad7e7dc8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.302160 Jun 20 12:06:36.172461 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1094/2183] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:06:36.188230 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-3e2433b0-bf7b-4548-8a86-98b6688144eb req-94d0cf4b-dcb7-4b3a-8332-cd3cae38d508 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f59e801d-2548-4edc-8283-af47c991d92a", "name": "network-vif-deleted", "tag": "094c45ad-d8c1-4802-908a-41730c77c870"}, {"server_uuid": "f59e801d-2548-4edc-8283-af47c991d92a", "name": "network-vif-deleted", "tag": "b010dc80-2c35-44a9-a8d1-6aa254f13aa2"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:06:36.219151 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-3e2433b0-bf7b-4548-8a86-98b6688144eb req-94d0cf4b-dcb7-4b3a-8332-cd3cae38d508 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:36.220013 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-3e2433b0-bf7b-4548-8a86-98b6688144eb req-94d0cf4b-dcb7-4b3a-8332-cd3cae38d508 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:36.268565 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-3e2433b0-bf7b-4548-8a86-98b6688144eb req-94d0cf4b-dcb7-4b3a-8332-cd3cae38d508 service nova] Creating event network-vif-deleted:094c45ad-d8c1-4802-908a-41730c77c870 for instance f59e801d-2548-4edc-8283-af47c991d92a on n-h2-master-1 Jun 20 12:06:36.269978 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-3e2433b0-bf7b-4548-8a86-98b6688144eb req-94d0cf4b-dcb7-4b3a-8332-cd3cae38d508 service nova] Creating event network-vif-deleted:b010dc80-2c35-44a9-a8d1-6aa254f13aa2 for instance f59e801d-2548-4edc-8283-af47c991d92a on n-h2-master-1 Jun 20 12:06:36.302287 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-3e2433b0-bf7b-4548-8a86-98b6688144eb req-94d0cf4b-dcb7-4b3a-8332-cd3cae38d508 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.127906 Jun 20 12:06:36.313997 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1095/2184] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:06:36.439757 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f7675bc3-81e8-4595-889a-c7eec84636cb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:36.440772 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f7675bc3-81e8-4595-889a-c7eec84636cb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:36.466915 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7675bc3-81e8-4595-889a-c7eec84636cb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:36.469057 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7675bc3-81e8-4595-889a-c7eec84636cb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:36.472300 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7675bc3-81e8-4595-889a-c7eec84636cb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:36.476935 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7675bc3-81e8-4595-889a-c7eec84636cb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:36.851434 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f7675bc3-81e8-4595-889a-c7eec84636cb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:36.878979 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f7675bc3-81e8-4595-889a-c7eec84636cb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c" status: 200 len: 1477 microversion: 2.1 time: 0.439324 Jun 20 12:06:36.879694 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1096/2185] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:36 2022] GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c => generated 1477 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:36.898502 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9d16a8e2-8d44-42de-a79b-6715ac10de13 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:36.901366 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9d16a8e2-8d44-42de-a79b-6715ac10de13 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 591d670e-ac99-40a4-9e67-0a7923a203b6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:36.917183 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d16a8e2-8d44-42de-a79b-6715ac10de13 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:36.917680 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d16a8e2-8d44-42de-a79b-6715ac10de13 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:36.919065 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d16a8e2-8d44-42de-a79b-6715ac10de13 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:36.919513 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d16a8e2-8d44-42de-a79b-6715ac10de13 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:36.925048 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:06:37.046295 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9d16a8e2-8d44-42de-a79b-6715ac10de13 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:37.064399 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9d16a8e2-8d44-42de-a79b-6715ac10de13 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/591d670e-ac99-40a4-9e67-0a7923a203b6" status: 200 len: 1271 microversion: 2.1 time: 0.179574 Jun 20 12:06:37.065717 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1097/2186] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:36 2022] GET /compute/v2.1/servers/591d670e-ac99-40a4-9e67-0a7923a203b6 => generated 1271 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:37.080724 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-235ad632-fe90-4150-a5c3-1ce9fdc7b479 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:37.081264 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-235ad632-fe90-4150-a5c3-1ce9fdc7b479 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:37.088413 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-235ad632-fe90-4150-a5c3-1ce9fdc7b479 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:37.088913 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-235ad632-fe90-4150-a5c3-1ce9fdc7b479 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:37.089721 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-235ad632-fe90-4150-a5c3-1ce9fdc7b479 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:37.090157 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-235ad632-fe90-4150-a5c3-1ce9fdc7b479 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:37.213051 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-235ad632-fe90-4150-a5c3-1ce9fdc7b479 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:37.229040 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-235ad632-fe90-4150-a5c3-1ce9fdc7b479 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:37.231811 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-235ad632-fe90-4150-a5c3-1ce9fdc7b479 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:37.235876 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-235ad632-fe90-4150-a5c3-1ce9fdc7b479 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 2662 microversion: 2.42 time: 0.158633 Jun 20 12:06:37.236889 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1098/2187] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:06:37 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 2662 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:06:37.259631 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-56990693-f329-42cb-89ff-5d451840d47b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f6073c81670>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:42.222990 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:06:42.317487 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:06:43.778787 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:06:45.514838 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:06:45.921580 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=33 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:06:47.088831 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:06:47.243934 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=10 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:06:49.317550 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1716c9c3-f6d4-4191-b8fb-f9e8edd92799 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 13.244761 Jun 20 12:06:49.321528 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1090/2188] 10.222.0.27 () {58 vars in 1136 bytes} [Mon Jun 20 12:06:36 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 13257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:06:49.369006 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f4e9f019-76f6-4a41-96ba-96ce79531813 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:49.371363 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f4e9f019-76f6-4a41-96ba-96ce79531813 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:49.388700 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f4e9f019-76f6-4a41-96ba-96ce79531813 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:49.390562 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f4e9f019-76f6-4a41-96ba-96ce79531813 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:49.392524 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f4e9f019-76f6-4a41-96ba-96ce79531813 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:49.393588 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f4e9f019-76f6-4a41-96ba-96ce79531813 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:49.446371 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-56990693-f329-42cb-89ff-5d451840d47b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/34da3fb0-46ad-49d0-8de1-4fda4ca64f01" status: 200 len: 1421 microversion: 2.1 time: 12.197694 Jun 20 12:06:49.448536 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1099/2189] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:06:37 2022] GET /compute/v2.1/images/34da3fb0-46ad-49d0-8de1-4fda4ca64f01 => generated 1421 bytes in 12211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:49.463516 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-61e7e029-959d-49b2-8b03-62f672601374 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:49.468759 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-61e7e029-959d-49b2-8b03-62f672601374 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 591d670e-ac99-40a4-9e67-0a7923a203b6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:49.505842 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-61e7e029-959d-49b2-8b03-62f672601374 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:49.508032 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-61e7e029-959d-49b2-8b03-62f672601374 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:49.517942 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-61e7e029-959d-49b2-8b03-62f672601374 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:49.520334 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-61e7e029-959d-49b2-8b03-62f672601374 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:50.193891 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-61e7e029-959d-49b2-8b03-62f672601374 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:50.210836 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-61e7e029-959d-49b2-8b03-62f672601374 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/591d670e-ac99-40a4-9e67-0a7923a203b6" status: 200 len: 1313 microversion: 2.1 time: 0.758982 Jun 20 12:06:50.214258 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1100/2190] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:49 2022] GET /compute/v2.1/servers/591d670e-ac99-40a4-9e67-0a7923a203b6 => generated 1313 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:50.235372 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d485d287-6847-45a5-b731-310f30825dd9 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:50.237851 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d485d287-6847-45a5-b731-310f30825dd9 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:50.249356 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d485d287-6847-45a5-b731-310f30825dd9 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:50.250224 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d485d287-6847-45a5-b731-310f30825dd9 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:50.251776 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d485d287-6847-45a5-b731-310f30825dd9 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:50.252579 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d485d287-6847-45a5-b731-310f30825dd9 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:50.418810 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d485d287-6847-45a5-b731-310f30825dd9 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:50.455964 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d485d287-6847-45a5-b731-310f30825dd9 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:50.459479 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d485d287-6847-45a5-b731-310f30825dd9 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:50.465156 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d485d287-6847-45a5-b731-310f30825dd9 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 2662 microversion: 2.42 time: 0.248800 Jun 20 12:06:50.468261 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1101/2191] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:06:50 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 2662 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:06:50.476857 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-096becc9-c0ae-4ec7-9ba8-d35ea5ce77a9 req-6c5d183f-1b2e-42fe-9038-2e8e37f23ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "169d4a6b-c7e8-4fb6-9230-0daccebb7c1c", "name": "network-vif-unplugged", "status": "completed", "tag": "d2a8d75a-6185-40a8-a750-83b919830f6e"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:06:50.495686 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-096becc9-c0ae-4ec7-9ba8-d35ea5ce77a9 req-6c5d183f-1b2e-42fe-9038-2e8e37f23ad2 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:50.496364 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-096becc9-c0ae-4ec7-9ba8-d35ea5ce77a9 req-6c5d183f-1b2e-42fe-9038-2e8e37f23ad2 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:50.545524 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-096becc9-c0ae-4ec7-9ba8-d35ea5ce77a9 req-6c5d183f-1b2e-42fe-9038-2e8e37f23ad2 service nova] Creating event network-vif-unplugged:d2a8d75a-6185-40a8-a750-83b919830f6e for instance 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c on n-h2-master-1 Jun 20 12:06:50.561510 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f4e9f019-76f6-4a41-96ba-96ce79531813 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:50.568852 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [req-096becc9-c0ae-4ec7-9ba8-d35ea5ce77a9 req-6c5d183f-1b2e-42fe-9038-2e8e37f23ad2 service nova] Instance 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:06:50.584026 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f4e9f019-76f6-4a41-96ba-96ce79531813 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c" status: 200 len: 1474 microversion: 2.1 time: 1.256829 Jun 20 12:06:50.586205 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1091/2192] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:49 2022] GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c => generated 1474 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:50.592224 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-65805739-3d14-491f-8efd-d97798aca09c tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6072d0e700>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:50.599497 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-096becc9-c0ae-4ec7-9ba8-d35ea5ce77a9 req-6c5d183f-1b2e-42fe-9038-2e8e37f23ad2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.129390 Jun 20 12:06:50.601029 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1102/2193] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:06:50.610800 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2a4bf216-a776-479f-bb01-b3df346a16a8 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f60731878b0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:50.911055 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2a4bf216-a776-479f-bb01-b3df346a16a8 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/34da3fb0-46ad-49d0-8de1-4fda4ca64f01" status: 200 len: 1421 microversion: 2.1 time: 0.308245 Jun 20 12:06:50.912372 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1103/2194] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:06:50 2022] GET /compute/v2.1/images/34da3fb0-46ad-49d0-8de1-4fda4ca64f01 => generated 1421 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:50.927547 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ffe9dab9-a902-41eb-8d45-e115aba77927 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f6073189ca0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:50.941559 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-65805739-3d14-491f-8efd-d97798aca09c tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/detail?changes-since=2022-06-20T12%3A04%3A13Z" status: 200 len: 6333 microversion: 2.1 time: 0.353234 Jun 20 12:06:50.959705 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1092/2195] 10.222.0.27 () {58 vars in 1219 bytes} [Mon Jun 20 12:06:50 2022] GET /compute/v2.1/images/detail?changes-since=2022-06-20T12%3A04%3A13Z => generated 6333 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:50.994697 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9ba2d7a1-deab-4574-b7b7-4a6d63db73b2 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6072d44790>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:52.577471 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ffe9dab9-a902-41eb-8d45-e115aba77927 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "DELETE /compute/v2.1/images/34da3fb0-46ad-49d0-8de1-4fda4ca64f01" status: 204 len: 0 microversion: 2.1 time: 1.657071 Jun 20 12:06:52.583160 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1104/2196] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:50 2022] DELETE /compute/v2.1/images/34da3fb0-46ad-49d0-8de1-4fda4ca64f01 => generated 0 bytes in 1659 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 12:06:52.601296 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-23603288-366e-471b-80fa-12e2ca31b4fa tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:52.608782 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-23603288-366e-471b-80fa-12e2ca31b4fa tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 591d670e-ac99-40a4-9e67-0a7923a203b6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:52.629406 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23603288-366e-471b-80fa-12e2ca31b4fa tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:52.635212 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23603288-366e-471b-80fa-12e2ca31b4fa tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:52.637072 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23603288-366e-471b-80fa-12e2ca31b4fa tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:52.637969 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23603288-366e-471b-80fa-12e2ca31b4fa tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:52.818604 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9ba2d7a1-deab-4574-b7b7-4a6d63db73b2 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-436678309" status: 200 len: 664 microversion: 2.1 time: 1.839020 Jun 20 12:06:52.819479 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1093/2197] 10.222.0.27 () {58 vars in 1249 bytes} [Mon Jun 20 12:06:50 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-436678309 => generated 664 bytes in 1846 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:06:52.838131 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6d2f9a7b-dcae-4b39-bc51-1dbb26563527 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:52.845938 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6d2f9a7b-dcae-4b39-bc51-1dbb26563527 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:52.865270 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6d2f9a7b-dcae-4b39-bc51-1dbb26563527 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:52.865908 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6d2f9a7b-dcae-4b39-bc51-1dbb26563527 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:52.870732 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6d2f9a7b-dcae-4b39-bc51-1dbb26563527 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:52.871367 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6d2f9a7b-dcae-4b39-bc51-1dbb26563527 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:53.132717 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6d2f9a7b-dcae-4b39-bc51-1dbb26563527 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:53.153429 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6d2f9a7b-dcae-4b39-bc51-1dbb26563527 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:53.161712 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6d2f9a7b-dcae-4b39-bc51-1dbb26563527 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:53.173056 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6d2f9a7b-dcae-4b39-bc51-1dbb26563527 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 2662 microversion: 2.42 time: 0.342706 Jun 20 12:06:53.174617 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1094/2198] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:06:52 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 2662 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:06:53.216002 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2dd95d90-ed3e-48a0-be6f-7c626d041d49 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:53.216728 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2dd95d90-ed3e-48a0-be6f-7c626d041d49 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:53.244589 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2dd95d90-ed3e-48a0-be6f-7c626d041d49 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:53.245355 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2dd95d90-ed3e-48a0-be6f-7c626d041d49 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:53.246371 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2dd95d90-ed3e-48a0-be6f-7c626d041d49 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:53.246852 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2dd95d90-ed3e-48a0-be6f-7c626d041d49 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:53.465665 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-23603288-366e-471b-80fa-12e2ca31b4fa tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:53.498633 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-23603288-366e-471b-80fa-12e2ca31b4fa tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/591d670e-ac99-40a4-9e67-0a7923a203b6" status: 200 len: 1313 microversion: 2.1 time: 0.913047 Jun 20 12:06:53.503478 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1105/2199] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:52 2022] GET /compute/v2.1/servers/591d670e-ac99-40a4-9e67-0a7923a203b6 => generated 1313 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:53.523384 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6fd5f27b-42b5-4340-bc80-1132ac27cd6b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:53.526369 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6fd5f27b-42b5-4340-bc80-1132ac27cd6b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:53.546618 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6fd5f27b-42b5-4340-bc80-1132ac27cd6b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:53.547345 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6fd5f27b-42b5-4340-bc80-1132ac27cd6b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:53.548351 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6fd5f27b-42b5-4340-bc80-1132ac27cd6b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:53.549696 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6fd5f27b-42b5-4340-bc80-1132ac27cd6b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:53.602742 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2dd95d90-ed3e-48a0-be6f-7c626d041d49 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:53.629112 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2dd95d90-ed3e-48a0-be6f-7c626d041d49 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c" status: 200 len: 1471 microversion: 2.1 time: 0.437500 Jun 20 12:06:53.632862 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1095/2200] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:53 2022] GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c => generated 1471 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:53.670133 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-7b545236-1ac5-4b97-95db-7047542602c8 req-44d38d93-f36e-4dfb-b7fa-58c5b9fec446 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "591d670e-ac99-40a4-9e67-0a7923a203b6", "tag": "2b785317-6e49-46cd-a9a2-f18a6dfc62b1"}, {"name": "network-changed", "server_uuid": "169d4a6b-c7e8-4fb6-9230-0daccebb7c1c", "tag": "d2a8d75a-6185-40a8-a750-83b919830f6e"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:06:53.687583 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6fd5f27b-42b5-4340-bc80-1132ac27cd6b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:06:53.697988 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-7b545236-1ac5-4b97-95db-7047542602c8 req-44d38d93-f36e-4dfb-b7fa-58c5b9fec446 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:53.698810 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-7b545236-1ac5-4b97-95db-7047542602c8 req-44d38d93-f36e-4dfb-b7fa-58c5b9fec446 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:53.744123 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-7b545236-1ac5-4b97-95db-7047542602c8 req-44d38d93-f36e-4dfb-b7fa-58c5b9fec446 service nova] Creating event network-changed:2b785317-6e49-46cd-a9a2-f18a6dfc62b1 for instance 591d670e-ac99-40a4-9e67-0a7923a203b6 on n-h2-master-1 Jun 20 12:06:53.745216 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-7b545236-1ac5-4b97-95db-7047542602c8 req-44d38d93-f36e-4dfb-b7fa-58c5b9fec446 service nova] Creating event network-changed:d2a8d75a-6185-40a8-a750-83b919830f6e for instance 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c on n-h2-master-1 Jun 20 12:06:53.773734 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [req-7b545236-1ac5-4b97-95db-7047542602c8 req-44d38d93-f36e-4dfb-b7fa-58c5b9fec446 service nova] Instance 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119127) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:06:53.858765 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-7b545236-1ac5-4b97-95db-7047542602c8 req-44d38d93-f36e-4dfb-b7fa-58c5b9fec446 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.184657 Jun 20 12:06:53.866869 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1096/2201] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:06:53.912680 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-677c2328-85a8-4c7a-a5b0-868d241a6f62 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f608493d160>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:53.959371 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6fd5f27b-42b5-4340-bc80-1132ac27cd6b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 204 len: 0 microversion: 2.1 time: 0.453378 Jun 20 12:06:53.960488 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1106/2202] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:06:53 2022] DELETE /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:06:54.020802 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-9cb7c9bd-1593-4858-878b-715d846d65bc req-a20c6e10-8250-4892-bc44-60c8c98aa616 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "591d670e-ac99-40a4-9e67-0a7923a203b6", "name": "network-vif-plugged", "status": "completed", "tag": "2b785317-6e49-46cd-a9a2-f18a6dfc62b1"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:06:54.066375 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9cb7c9bd-1593-4858-878b-715d846d65bc req-a20c6e10-8250-4892-bc44-60c8c98aa616 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:54.069903 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9cb7c9bd-1593-4858-878b-715d846d65bc req-a20c6e10-8250-4892-bc44-60c8c98aa616 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:54.102292 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-9cb7c9bd-1593-4858-878b-715d846d65bc req-a20c6e10-8250-4892-bc44-60c8c98aa616 service nova] Creating event network-vif-plugged:2b785317-6e49-46cd-a9a2-f18a6dfc62b1 for instance 591d670e-ac99-40a4-9e67-0a7923a203b6 on n-h2-master-1 Jun 20 12:06:54.117354 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-9cb7c9bd-1593-4858-878b-715d846d65bc req-a20c6e10-8250-4892-bc44-60c8c98aa616 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154230 Jun 20 12:06:54.122939 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1107/2203] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:06:54.136384 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-adda5837-bdba-403d-bafc-7fc461bfeae6 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:06:54.140672 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-adda5837-bdba-403d-bafc-7fc461bfeae6 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:54.157802 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-adda5837-bdba-403d-bafc-7fc461bfeae6 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:54.164604 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-adda5837-bdba-403d-bafc-7fc461bfeae6 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:54.172885 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-adda5837-bdba-403d-bafc-7fc461bfeae6 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:54.174605 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-adda5837-bdba-403d-bafc-7fc461bfeae6 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:54.234914 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-677c2328-85a8-4c7a-a5b0-868d241a6f62 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2Ff7d2499c-a9c8-4c2e-8445-667070737f1f" status: 200 len: 1467 microversion: 2.1 time: 0.362702 Jun 20 12:06:54.237591 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1097/2204] 10.222.0.27 () {58 vars in 1337 bytes} [Mon Jun 20 12:06:53 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2Ff7d2499c-a9c8-4c2e-8445-667070737f1f => generated 1467 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:54.252262 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a84638ea-10c7-4b31-b4be-3c63062334e0 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1449860506", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "ab5a97aa-06fd-4e21-892e-d2f2bb854bdb"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:06:54.304085 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-adda5837-bdba-403d-bafc-7fc461bfeae6 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "POST /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c/action" status: 204 len: 0 microversion: 2.1 time: 0.177016 Jun 20 12:06:54.326974 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1108/2205] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:06:54 2022] POST /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c/action => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:06:54.343734 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-37ec5326-d2ea-4301-914c-f882303adce5 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:54.344547 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-37ec5326-d2ea-4301-914c-f882303adce5 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:54.350821 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-a84638ea-10c7-4b31-b4be-3c63062334e0 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] validate_networks() for [('ab5a97aa-06fd-4e21-892e-d2f2bb854bdb', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:06:54.354533 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-37ec5326-d2ea-4301-914c-f882303adce5 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:54.355222 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-37ec5326-d2ea-4301-914c-f882303adce5 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:54.356823 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-37ec5326-d2ea-4301-914c-f882303adce5 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:54.357607 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-37ec5326-d2ea-4301-914c-f882303adce5 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:54.833327 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-37ec5326-d2ea-4301-914c-f882303adce5 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:54.855853 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-37ec5326-d2ea-4301-914c-f882303adce5 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:54.864705 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-37ec5326-d2ea-4301-914c-f882303adce5 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:54.869727 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-37ec5326-d2ea-4301-914c-f882303adce5 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 2662 microversion: 2.42 time: 0.537824 Jun 20 12:06:54.871097 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1109/2206] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:06:54 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 2662 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:06:54.879251 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-333b5b67-27c8-4378-a9b7-96431cca63e6 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f607318e820>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:54.968805 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-333b5b67-27c8-4378-a9b7-96431cca63e6 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2Ff7d2499c-a9c8-4c2e-8445-667070737f1f" status: 200 len: 1467 microversion: 2.1 time: 0.096409 Jun 20 12:06:54.969932 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1110/2207] 10.222.0.27 () {58 vars in 1323 bytes} [Mon Jun 20 12:06:54 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2Ff7d2499c-a9c8-4c2e-8445-667070737f1f => generated 1467 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:54.976153 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f25df2d9-c4d9-47f1-a266-588ef7bd5ea6 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:54.977086 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f25df2d9-c4d9-47f1-a266-588ef7bd5ea6 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:54.997551 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f25df2d9-c4d9-47f1-a266-588ef7bd5ea6 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:54.997999 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f25df2d9-c4d9-47f1-a266-588ef7bd5ea6 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:55.012306 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f25df2d9-c4d9-47f1-a266-588ef7bd5ea6 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:55.012306 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f25df2d9-c4d9-47f1-a266-588ef7bd5ea6 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:55.521636 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f25df2d9-c4d9-47f1-a266-588ef7bd5ea6 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:55.532247 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f25df2d9-c4d9-47f1-a266-588ef7bd5ea6 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c" status: 200 len: 1471 microversion: 2.1 time: 0.560802 Jun 20 12:06:55.532526 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1111/2208] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:54 2022] GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c => generated 1471 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:55.547314 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9e05d35d-4b8f-4ad4-9452-4c24f2635c90 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:55.548797 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9e05d35d-4b8f-4ad4-9452-4c24f2635c90 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 591d670e-ac99-40a4-9e67-0a7923a203b6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:55.565449 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9e05d35d-4b8f-4ad4-9452-4c24f2635c90 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:55.567185 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9e05d35d-4b8f-4ad4-9452-4c24f2635c90 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:55.569561 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9e05d35d-4b8f-4ad4-9452-4c24f2635c90 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:55.570016 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9e05d35d-4b8f-4ad4-9452-4c24f2635c90 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:55.611579 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-a84638ea-10c7-4b31-b4be-3c63062334e0 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:06:55.614285 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-a84638ea-10c7-4b31-b4be-3c63062334e0 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:06:55.615581 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-a84638ea-10c7-4b31-b4be-3c63062334e0 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:06:55.617254 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-a84638ea-10c7-4b31-b4be-3c63062334e0 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:06:55.618650 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-a84638ea-10c7-4b31-b4be-3c63062334e0 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:06:55.652873 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a84638ea-10c7-4b31-b4be-3c63062334e0 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:55.654178 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a84638ea-10c7-4b31-b4be-3c63062334e0 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:55.665203 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a84638ea-10c7-4b31-b4be-3c63062334e0 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:55.666209 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a84638ea-10c7-4b31-b4be-3c63062334e0 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:55.717792 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-a84638ea-10c7-4b31-b4be-3c63062334e0 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Getting quotas for project 615573a78a9d4e75a36ada9bd9de7e15. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:06:55.744391 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-a84638ea-10c7-4b31-b4be-3c63062334e0 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Getting quotas for user 8b2304d9c7dd493983542a54b6799989 and project 615573a78a9d4e75a36ada9bd9de7e15. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:06:55.802232 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a84638ea-10c7-4b31-b4be-3c63062334e0 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:06:55.811193 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a84638ea-10c7-4b31-b4be-3c63062334e0 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: ed397d7b-8f66-46c9-b225-1cec5c844672] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:06:55.963227 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a84638ea-10c7-4b31-b4be-3c63062334e0 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.723206 Jun 20 12:06:55.967305 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1098/2209] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:06:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:06:55.979835 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-15cac5d1-7944-439c-9677-c954bd9374df tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f608493df70>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:56.252869 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-15cac5d1-7944-439c-9677-c954bd9374df tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7108 microversion: 2.1 time: 0.284460 Jun 20 12:06:56.253804 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1099/2210] 10.222.0.27 () {58 vars in 1169 bytes} [Mon Jun 20 12:06:55 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7108 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:56.260182 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bc8a29d1-3778-4a8b-afc1-b0c83f337493 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:56.260832 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bc8a29d1-3778-4a8b-afc1-b0c83f337493 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:56.269734 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc8a29d1-3778-4a8b-afc1-b0c83f337493 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:56.270265 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc8a29d1-3778-4a8b-afc1-b0c83f337493 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:56.271085 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc8a29d1-3778-4a8b-afc1-b0c83f337493 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:56.271544 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc8a29d1-3778-4a8b-afc1-b0c83f337493 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:56.506495 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bc8a29d1-3778-4a8b-afc1-b0c83f337493 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:56.521933 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bc8a29d1-3778-4a8b-afc1-b0c83f337493 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:56.523432 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bc8a29d1-3778-4a8b-afc1-b0c83f337493 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:56.535785 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bc8a29d1-3778-4a8b-afc1-b0c83f337493 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 2662 microversion: 2.42 time: 0.279891 Jun 20 12:06:56.536750 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1100/2211] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:06:56 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 2662 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:06:56.551053 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-eb051531-e01d-46a4-b91f-243604e66961 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:56.551749 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-eb051531-e01d-46a4-b91f-243604e66961 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: ed397d7b-8f66-46c9-b225-1cec5c844672] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:56.740689 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-eb051531-e01d-46a4-b91f-243604e66961 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:56.766014 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-eb051531-e01d-46a4-b91f-243604e66961 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672" status: 200 len: 1208 microversion: 2.1 time: 0.228122 Jun 20 12:06:56.778602 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1101/2212] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:56 2022] GET /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672 => generated 1208 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:56.790668 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-281948a2-0b90-4e95-bc08-236f5395d3eb tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f60732bc160>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:56.943234 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-281948a2-0b90-4e95-bc08-236f5395d3eb tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4377 microversion: 2.1 time: 0.152000 Jun 20 12:06:56.953377 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1102/2213] 10.222.0.27 () {58 vars in 1169 bytes} [Mon Jun 20 12:06:56 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4377 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:56.968005 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6fd82c6b-1f53-468b-b347-fe65a8b6cb5d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:56.969092 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6fd82c6b-1f53-468b-b347-fe65a8b6cb5d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:56.982108 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6fd82c6b-1f53-468b-b347-fe65a8b6cb5d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:56.982572 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6fd82c6b-1f53-468b-b347-fe65a8b6cb5d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:56.983369 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6fd82c6b-1f53-468b-b347-fe65a8b6cb5d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:56.983805 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6fd82c6b-1f53-468b-b347-fe65a8b6cb5d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:57.136055 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9e05d35d-4b8f-4ad4-9452-4c24f2635c90 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:57.163225 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9e05d35d-4b8f-4ad4-9452-4c24f2635c90 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/591d670e-ac99-40a4-9e67-0a7923a203b6" status: 200 len: 1313 microversion: 2.1 time: 1.626628 Jun 20 12:06:57.164158 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1112/2214] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:55 2022] GET /compute/v2.1/servers/591d670e-ac99-40a4-9e67-0a7923a203b6 => generated 1313 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:57.170567 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-07097fee-5a4b-45d2-9570-35f3795730ed req-ebcc4b0c-6d90-4f23-b03a-0547bfc55d62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "169d4a6b-c7e8-4fb6-9230-0daccebb7c1c", "name": "network-vif-plugged", "status": "completed", "tag": "d2a8d75a-6185-40a8-a750-83b919830f6e"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:06:57.190939 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-07097fee-5a4b-45d2-9570-35f3795730ed req-ebcc4b0c-6d90-4f23-b03a-0547bfc55d62 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:57.191489 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-07097fee-5a4b-45d2-9570-35f3795730ed req-ebcc4b0c-6d90-4f23-b03a-0547bfc55d62 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:57.223602 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-07097fee-5a4b-45d2-9570-35f3795730ed req-ebcc4b0c-6d90-4f23-b03a-0547bfc55d62 service nova] Creating event network-vif-plugged:d2a8d75a-6185-40a8-a750-83b919830f6e for instance 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c on n-h2-master-1 Jun 20 12:06:57.238802 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [req-07097fee-5a4b-45d2-9570-35f3795730ed req-ebcc4b0c-6d90-4f23-b03a-0547bfc55d62 service nova] Instance 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:06:57.267369 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-07097fee-5a4b-45d2-9570-35f3795730ed req-ebcc4b0c-6d90-4f23-b03a-0547bfc55d62 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101647 Jun 20 12:06:57.268740 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1113/2215] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:06:57.287777 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9b8e3e12-cb71-4de7-8435-d03ecdee16b0 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073189280>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:57.464498 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9b8e3e12-cb71-4de7-8435-d03ecdee16b0 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/f16836cc-4e18-4bd0-b261-3865adf8cb83" status: 200 len: 784 microversion: 2.1 time: 0.194283 Jun 20 12:06:57.465102 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1114/2216] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:06:57 2022] GET /compute/v2.1/images/f16836cc-4e18-4bd0-b261-3865adf8cb83 => generated 784 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:06:57.495327 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6fd82c6b-1f53-468b-b347-fe65a8b6cb5d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:57.518028 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6fd82c6b-1f53-468b-b347-fe65a8b6cb5d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c" status: 200 len: 1471 microversion: 2.1 time: 0.560493 Jun 20 12:06:57.519282 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1103/2217] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:56 2022] GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c => generated 1471 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:57.530089 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-47d82fa5-cb60-4777-9368-b7613dee0230 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f607323a5e0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:57.564235 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4903aeae-a764-40bb-aa0b-b0e8db06e2a8 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:57.565957 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4903aeae-a764-40bb-aa0b-b0e8db06e2a8 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:57.587331 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4903aeae-a764-40bb-aa0b-b0e8db06e2a8 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:57.590916 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4903aeae-a764-40bb-aa0b-b0e8db06e2a8 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:57.594952 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4903aeae-a764-40bb-aa0b-b0e8db06e2a8 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:57.595582 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4903aeae-a764-40bb-aa0b-b0e8db06e2a8 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:57.845225 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-47d82fa5-cb60-4777-9368-b7613dee0230 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.331995 Jun 20 12:06:57.855446 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1115/2218] 10.222.0.27 () {58 vars in 1157 bytes} [Mon Jun 20 12:06:57 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:57.869003 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f86c555d-0534-41d6-98a6-05a575fa16bd tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:57.873882 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f86c555d-0534-41d6-98a6-05a575fa16bd tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: ed397d7b-8f66-46c9-b225-1cec5c844672] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:57.893288 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f86c555d-0534-41d6-98a6-05a575fa16bd tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:57.905994 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f86c555d-0534-41d6-98a6-05a575fa16bd tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:57.910045 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f86c555d-0534-41d6-98a6-05a575fa16bd tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:57.911746 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f86c555d-0534-41d6-98a6-05a575fa16bd tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:57.997742 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4903aeae-a764-40bb-aa0b-b0e8db06e2a8 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:58.035853 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4903aeae-a764-40bb-aa0b-b0e8db06e2a8 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:58.061213 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4903aeae-a764-40bb-aa0b-b0e8db06e2a8 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:58.070760 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4903aeae-a764-40bb-aa0b-b0e8db06e2a8 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 2662 microversion: 2.42 time: 0.513140 Jun 20 12:06:58.077694 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1104/2219] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:06:57 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 2662 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:06:58.085814 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-79bd42d6-d8f0-41e1-86ef-2beadeff0106 req-d26b09e4-2cce-4dad-b801-68797d10888a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6a95c21-d3d4-4867-9ae6-7e9f3183f974", "name": "network-vif-deleted", "tag": "8bda50e5-6e28-4aed-a096-d1e45e7df107"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:06:58.123872 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-79bd42d6-d8f0-41e1-86ef-2beadeff0106 req-d26b09e4-2cce-4dad-b801-68797d10888a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:58.137097 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-79bd42d6-d8f0-41e1-86ef-2beadeff0106 req-d26b09e4-2cce-4dad-b801-68797d10888a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:58.144616 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f86c555d-0534-41d6-98a6-05a575fa16bd tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:58.151061 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-79bd42d6-d8f0-41e1-86ef-2beadeff0106 req-d26b09e4-2cce-4dad-b801-68797d10888a service nova] Creating event network-vif-deleted:8bda50e5-6e28-4aed-a096-d1e45e7df107 for instance c6a95c21-d3d4-4867-9ae6-7e9f3183f974 on n-h2-master-1 Jun 20 12:06:58.153135 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f86c555d-0534-41d6-98a6-05a575fa16bd tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672" status: 200 len: 1204 microversion: 2.1 time: 0.294874 Jun 20 12:06:58.156575 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1116/2220] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:57 2022] GET /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672 => generated 1204 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:58.165931 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-79bd42d6-d8f0-41e1-86ef-2beadeff0106 req-d26b09e4-2cce-4dad-b801-68797d10888a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086099 Jun 20 12:06:58.167273 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1105/2221] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:06:58.173147 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c013f7c4-fa84-42c6-9da1-f66923d0c284 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6073c81670>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:58.191390 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b12bcef2-3180-4fec-8f1b-98ef6b4b773e tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:58.193976 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b12bcef2-3180-4fec-8f1b-98ef6b4b773e tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 591d670e-ac99-40a4-9e67-0a7923a203b6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:58.211437 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b12bcef2-3180-4fec-8f1b-98ef6b4b773e tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:58.211946 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b12bcef2-3180-4fec-8f1b-98ef6b4b773e tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:58.212839 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b12bcef2-3180-4fec-8f1b-98ef6b4b773e tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:58.213342 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b12bcef2-3180-4fec-8f1b-98ef6b4b773e tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:59.423451 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c013f7c4-fa84-42c6-9da1-f66923d0c284 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "DELETE /compute/v2.1/images/1a6b8e9e-1b6d-4b48-b4b0-ca9ccad9615e" status: 204 len: 0 microversion: 2.1 time: 1.263253 Jun 20 12:06:59.424640 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1117/2222] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:58 2022] DELETE /compute/v2.1/images/1a6b8e9e-1b6d-4b48-b4b0-ca9ccad9615e => generated 0 bytes in 1267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:06:59.435394 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-40765ffd-7999-47af-8740-b72f7b32d711 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:59.443660 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-40765ffd-7999-47af-8740-b72f7b32d711 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:59.505434 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-40765ffd-7999-47af-8740-b72f7b32d711 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:59.512877 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-40765ffd-7999-47af-8740-b72f7b32d711 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:59.515895 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-40765ffd-7999-47af-8740-b72f7b32d711 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:59.521826 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-40765ffd-7999-47af-8740-b72f7b32d711 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:59.668983 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b12bcef2-3180-4fec-8f1b-98ef6b4b773e tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:06:59.688904 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b12bcef2-3180-4fec-8f1b-98ef6b4b773e tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/591d670e-ac99-40a4-9e67-0a7923a203b6" status: 200 len: 1501 microversion: 2.1 time: 1.509422 Jun 20 12:06:59.695329 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1106/2223] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:58 2022] GET /compute/v2.1/servers/591d670e-ac99-40a4-9e67-0a7923a203b6 => generated 1501 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:06:59.706626 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-730c99a2-eaaa-46c1-a383-688039336d5c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:06:59.707740 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-730c99a2-eaaa-46c1-a383-688039336d5c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:06:59.729177 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-730c99a2-eaaa-46c1-a383-688039336d5c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:59.736044 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-730c99a2-eaaa-46c1-a383-688039336d5c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:06:59.737010 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-730c99a2-eaaa-46c1-a383-688039336d5c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:06:59.737466 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-730c99a2-eaaa-46c1-a383-688039336d5c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:00.068982 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-730c99a2-eaaa-46c1-a383-688039336d5c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:00.087726 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-730c99a2-eaaa-46c1-a383-688039336d5c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:00.096740 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-730c99a2-eaaa-46c1-a383-688039336d5c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:00.106434 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-730c99a2-eaaa-46c1-a383-688039336d5c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 2662 microversion: 2.42 time: 0.406957 Jun 20 12:07:00.125102 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1107/2224] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:06:59 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 2662 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:07:00.132077 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3191eabb-0c73-4b9d-9cfd-244bbc2344e5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:00.134004 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3191eabb-0c73-4b9d-9cfd-244bbc2344e5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: ed397d7b-8f66-46c9-b225-1cec5c844672] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:00.141234 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3191eabb-0c73-4b9d-9cfd-244bbc2344e5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:00.141899 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3191eabb-0c73-4b9d-9cfd-244bbc2344e5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:00.143084 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3191eabb-0c73-4b9d-9cfd-244bbc2344e5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:00.143695 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3191eabb-0c73-4b9d-9cfd-244bbc2344e5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:00.310857 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3191eabb-0c73-4b9d-9cfd-244bbc2344e5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:00.337304 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3191eabb-0c73-4b9d-9cfd-244bbc2344e5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672" status: 200 len: 1266 microversion: 2.1 time: 0.210595 Jun 20 12:07:00.338050 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1108/2225] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:00 2022] GET /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:00.354944 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-40765ffd-7999-47af-8740-b72f7b32d711 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:00.377366 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1e0e3bb0-ab14-4b43-ab05-7698e170d83d tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6072d0e550>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:00.378240 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-40765ffd-7999-47af-8740-b72f7b32d711 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c" status: 200 len: 1471 microversion: 2.1 time: 0.950101 Jun 20 12:07:00.381033 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1118/2226] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:06:59 2022] GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c => generated 1471 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:00.394264 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-96e1eac3-3f78-40be-b8dd-9583b04aa98b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:07:00.396085 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-96e1eac3-3f78-40be-b8dd-9583b04aa98b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 591d670e-ac99-40a4-9e67-0a7923a203b6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:00.411138 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-96e1eac3-3f78-40be-b8dd-9583b04aa98b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:00.412161 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-96e1eac3-3f78-40be-b8dd-9583b04aa98b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:00.413249 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-96e1eac3-3f78-40be-b8dd-9583b04aa98b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:00.414171 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-96e1eac3-3f78-40be-b8dd-9583b04aa98b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:00.488627 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-96e1eac3-3f78-40be-b8dd-9583b04aa98b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lazy-loading 'flavor' on Instance uuid 591d670e-ac99-40a4-9e67-0a7923a203b6 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:07:00.599006 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:00.638067 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-96e1eac3-3f78-40be-b8dd-9583b04aa98b tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "POST /compute/v2.1/servers/591d670e-ac99-40a4-9e67-0a7923a203b6/action" status: 202 len: 0 microversion: 2.1 time: 0.255443 Jun 20 12:07:00.638720 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1119/2227] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:07:00 2022] POST /compute/v2.1/servers/591d670e-ac99-40a4-9e67-0a7923a203b6/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:07:00.653950 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-552431fe-30a1-492c-9c64-c92de1279e24 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:00.654902 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-552431fe-30a1-492c-9c64-c92de1279e24 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 591d670e-ac99-40a4-9e67-0a7923a203b6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:00.672770 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-552431fe-30a1-492c-9c64-c92de1279e24 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:00.673516 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-552431fe-30a1-492c-9c64-c92de1279e24 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:00.674480 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-552431fe-30a1-492c-9c64-c92de1279e24 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:00.675073 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-552431fe-30a1-492c-9c64-c92de1279e24 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:01.084078 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-552431fe-30a1-492c-9c64-c92de1279e24 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:01.121965 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-552431fe-30a1-492c-9c64-c92de1279e24 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/591d670e-ac99-40a4-9e67-0a7923a203b6" status: 200 len: 1509 microversion: 2.1 time: 0.466199 Jun 20 12:07:01.143664 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1120/2228] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:00 2022] GET /compute/v2.1/servers/591d670e-ac99-40a4-9e67-0a7923a203b6 => generated 1509 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:01.166304 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-02e3733f-382d-46c4-93f3-ba7996df6bed tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:01.166979 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-02e3733f-382d-46c4-93f3-ba7996df6bed tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:01.188122 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-02e3733f-382d-46c4-93f3-ba7996df6bed tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:01.189139 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-02e3733f-382d-46c4-93f3-ba7996df6bed tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:01.191316 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-02e3733f-382d-46c4-93f3-ba7996df6bed tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:01.191926 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-02e3733f-382d-46c4-93f3-ba7996df6bed tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:01.328954 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1e0e3bb0-ab14-4b43-ab05-7698e170d83d tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "DELETE /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba" status: 204 len: 0 microversion: 2.1 time: 0.976919 Jun 20 12:07:01.330875 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1109/2229] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:00 2022] DELETE /compute/v2.1/images/13038f62-149c-4aad-be0c-d5d1708a8fba => generated 0 bytes in 992 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:07:01.341122 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-85005116-39e5-416a-aefe-eab363b3b398 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f6072d12d30>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:01.481322 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-02e3733f-382d-46c4-93f3-ba7996df6bed tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:01.513474 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-02e3733f-382d-46c4-93f3-ba7996df6bed tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:01.529760 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-02e3733f-382d-46c4-93f3-ba7996df6bed tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:01.531318 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-02e3733f-382d-46c4-93f3-ba7996df6bed tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 2662 microversion: 2.42 time: 0.384326 Jun 20 12:07:01.537625 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1121/2230] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:07:01 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 2662 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:07:01.553587 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d51fe68a-3c05-4394-bbff-bdc69c8a6e16 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:01.557446 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d51fe68a-3c05-4394-bbff-bdc69c8a6e16 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: ed397d7b-8f66-46c9-b225-1cec5c844672] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:01.597460 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d51fe68a-3c05-4394-bbff-bdc69c8a6e16 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:01.597904 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d51fe68a-3c05-4394-bbff-bdc69c8a6e16 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:01.606774 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d51fe68a-3c05-4394-bbff-bdc69c8a6e16 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:01.607367 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d51fe68a-3c05-4394-bbff-bdc69c8a6e16 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:02.237560 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-85005116-39e5-416a-aefe-eab363b3b398 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "DELETE /compute/v2.1/images/320c8800-5d83-4fef-b8fc-e287df641bad" status: 204 len: 0 microversion: 2.1 time: 0.901015 Jun 20 12:07:02.241996 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1110/2231] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:01 2022] DELETE /compute/v2.1/images/320c8800-5d83-4fef-b8fc-e287df641bad => generated 0 bytes in 903 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:07:02.263536 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-be073e6e-4ff5-4c4c-98ea-eb8e9c9c885c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:02.264552 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-be073e6e-4ff5-4c4c-98ea-eb8e9c9c885c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:02.300620 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d51fe68a-3c05-4394-bbff-bdc69c8a6e16 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:02.305929 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-be073e6e-4ff5-4c4c-98ea-eb8e9c9c885c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:02.306389 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-be073e6e-4ff5-4c4c-98ea-eb8e9c9c885c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:02.307505 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-be073e6e-4ff5-4c4c-98ea-eb8e9c9c885c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:02.307946 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-be073e6e-4ff5-4c4c-98ea-eb8e9c9c885c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:02.326121 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d51fe68a-3c05-4394-bbff-bdc69c8a6e16 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672" status: 200 len: 1266 microversion: 2.1 time: 0.773678 Jun 20 12:07:02.335954 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1122/2232] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:01 2022] GET /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672 => generated 1266 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:02.348570 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6ac93779-d61c-4df7-a4e5-64d4f077368f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:02.349541 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6ac93779-d61c-4df7-a4e5-64d4f077368f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 591d670e-ac99-40a4-9e67-0a7923a203b6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:02.365056 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ac93779-d61c-4df7-a4e5-64d4f077368f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:02.365846 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ac93779-d61c-4df7-a4e5-64d4f077368f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:02.367185 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ac93779-d61c-4df7-a4e5-64d4f077368f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:02.370496 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ac93779-d61c-4df7-a4e5-64d4f077368f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:03.351722 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6ac93779-d61c-4df7-a4e5-64d4f077368f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:03.367977 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6ac93779-d61c-4df7-a4e5-64d4f077368f tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/591d670e-ac99-40a4-9e67-0a7923a203b6" status: 200 len: 1492 microversion: 2.1 time: 1.025888 Jun 20 12:07:03.371677 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1123/2233] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:02 2022] GET /compute/v2.1/servers/591d670e-ac99-40a4-9e67-0a7923a203b6 => generated 1492 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:03.382405 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c66b6d30-71b5-4321-b7e5-0ef35e3fedfc tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:03.386486 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c66b6d30-71b5-4321-b7e5-0ef35e3fedfc tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: f7d2499c-a9c8-4c2e-8445-667070737f1f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:03.422186 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c66b6d30-71b5-4321-b7e5-0ef35e3fedfc tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:03.425235 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c66b6d30-71b5-4321-b7e5-0ef35e3fedfc tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:03.427351 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c66b6d30-71b5-4321-b7e5-0ef35e3fedfc tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:03.428102 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c66b6d30-71b5-4321-b7e5-0ef35e3fedfc tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:03.484977 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-be073e6e-4ff5-4c4c-98ea-eb8e9c9c885c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:03.499620 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c66b6d30-71b5-4321-b7e5-0ef35e3fedfc tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: f7d2499c-a9c8-4c2e-8445-667070737f1f] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:07:03.513603 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-be073e6e-4ff5-4c4c-98ea-eb8e9c9c885c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c" status: 200 len: 1463 microversion: 2.1 time: 1.269511 Jun 20 12:07:03.515033 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1111/2234] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:02 2022] GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c => generated 1463 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:03.551776 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-03d8bc79-0084-42d0-9649-33d1d55d880c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:03.553483 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-03d8bc79-0084-42d0-9649-33d1d55d880c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:03.587418 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-03d8bc79-0084-42d0-9649-33d1d55d880c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:03.590604 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-03d8bc79-0084-42d0-9649-33d1d55d880c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:03.595681 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-03d8bc79-0084-42d0-9649-33d1d55d880c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:03.597662 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-03d8bc79-0084-42d0-9649-33d1d55d880c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:03.650576 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c66b6d30-71b5-4321-b7e5-0ef35e3fedfc tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f" status: 204 len: 0 microversion: 2.1 time: 0.273663 Jun 20 12:07:03.653237 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1124/2235] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:07:03 2022] DELETE /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:07:03.672967 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b50daf64-a58d-4eed-a76a-d638cbb19984 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:03.674739 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b50daf64-a58d-4eed-a76a-d638cbb19984 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: ed397d7b-8f66-46c9-b225-1cec5c844672] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:03.694293 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b50daf64-a58d-4eed-a76a-d638cbb19984 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:03.694739 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b50daf64-a58d-4eed-a76a-d638cbb19984 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:03.701413 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b50daf64-a58d-4eed-a76a-d638cbb19984 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:03.702243 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b50daf64-a58d-4eed-a76a-d638cbb19984 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:03.932997 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-03d8bc79-0084-42d0-9649-33d1d55d880c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:03.948890 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-03d8bc79-0084-42d0-9649-33d1d55d880c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:03.951824 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-03d8bc79-0084-42d0-9649-33d1d55d880c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:03.962753 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-03d8bc79-0084-42d0-9649-33d1d55d880c tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 2662 microversion: 2.42 time: 0.445822 Jun 20 12:07:03.975389 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1112/2236] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:07:03 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 2662 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:07:03.981197 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-320f83da-cf59-4f6f-97ca-a92d90994ef5 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:03.989339 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-320f83da-cf59-4f6f-97ca-a92d90994ef5 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 591d670e-ac99-40a4-9e67-0a7923a203b6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:03.996909 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-320f83da-cf59-4f6f-97ca-a92d90994ef5 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:04.013089 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-320f83da-cf59-4f6f-97ca-a92d90994ef5 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:04.014377 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-320f83da-cf59-4f6f-97ca-a92d90994ef5 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:04.015029 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-320f83da-cf59-4f6f-97ca-a92d90994ef5 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:04.073900 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-320f83da-cf59-4f6f-97ca-a92d90994ef5 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 591d670e-ac99-40a4-9e67-0a7923a203b6] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:07:04.233352 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-320f83da-cf59-4f6f-97ca-a92d90994ef5 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "DELETE /compute/v2.1/servers/591d670e-ac99-40a4-9e67-0a7923a203b6" status: 204 len: 0 microversion: 2.1 time: 0.255929 Jun 20 12:07:04.238132 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1113/2237] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:07:03 2022] DELETE /compute/v2.1/servers/591d670e-ac99-40a4-9e67-0a7923a203b6 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:07:04.245374 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a772157c-0f93-4999-a9db-fa95ea72c3f4 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:04.246543 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a772157c-0f93-4999-a9db-fa95ea72c3f4 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:04.255689 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a772157c-0f93-4999-a9db-fa95ea72c3f4 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:04.256845 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a772157c-0f93-4999-a9db-fa95ea72c3f4 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:04.257910 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a772157c-0f93-4999-a9db-fa95ea72c3f4 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:04.259387 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a772157c-0f93-4999-a9db-fa95ea72c3f4 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:04.375072 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b50daf64-a58d-4eed-a76a-d638cbb19984 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:04.386390 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b50daf64-a58d-4eed-a76a-d638cbb19984 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672" status: 200 len: 1308 microversion: 2.1 time: 0.731175 Jun 20 12:07:04.387065 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1125/2238] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:03 2022] GET /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672 => generated 1308 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:04.408094 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b5e03fa1-ab45-4be7-9557-a04d1c490655 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:04.408820 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b5e03fa1-ab45-4be7-9557-a04d1c490655 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: f7d2499c-a9c8-4c2e-8445-667070737f1f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:04.424257 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b5e03fa1-ab45-4be7-9557-a04d1c490655 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:04.426821 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b5e03fa1-ab45-4be7-9557-a04d1c490655 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:04.427723 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b5e03fa1-ab45-4be7-9557-a04d1c490655 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:04.428175 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b5e03fa1-ab45-4be7-9557-a04d1c490655 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:04.729429 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b5e03fa1-ab45-4be7-9557-a04d1c490655 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286e4b475bbc4d108ca00497ecd3e55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8c8766d4f143349b61f27d8f2566fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:04.741518 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b5e03fa1-ab45-4be7-9557-a04d1c490655 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f" status: 200 len: 1474 microversion: 2.1 time: 0.349888 Jun 20 12:07:04.744875 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1126/2239] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:04 2022] GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f => generated 1474 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:04.754252 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-db089fe4-eb4c-4f1e-9bfc-e31d111d62d4 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:04.754887 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-db089fe4-eb4c-4f1e-9bfc-e31d111d62d4 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 591d670e-ac99-40a4-9e67-0a7923a203b6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:04.769937 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-db089fe4-eb4c-4f1e-9bfc-e31d111d62d4 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:04.770401 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-db089fe4-eb4c-4f1e-9bfc-e31d111d62d4 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:04.774316 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-db089fe4-eb4c-4f1e-9bfc-e31d111d62d4 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:04.775161 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-db089fe4-eb4c-4f1e-9bfc-e31d111d62d4 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:04.790697 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a772157c-0f93-4999-a9db-fa95ea72c3f4 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c" status: 200 len: 1614 microversion: 2.1 time: 0.550455 Jun 20 12:07:04.806091 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1114/2240] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:04 2022] GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c => generated 1614 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:04.841701 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-39fe13d8-84a6-49a5-9279-cb59ee9ac582 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Calling method '.version_select at 0x7f6072d0e820>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:04.847199 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-39fe13d8-84a6-49a5-9279-cb59ee9ac582 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:04.848239 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-39fe13d8-84a6-49a5-9279-cb59ee9ac582 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:04.884823 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-39fe13d8-84a6-49a5-9279-cb59ee9ac582 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1561 microversion: 2.1 time: 0.049540 Jun 20 12:07:04.893373 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1115/2241] 10.222.0.27 () {58 vars in 1142 bytes} [Mon Jun 20 12:07:04 2022] GET /compute/v2.1/os-migrations => generated 1561 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:04.984876 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4aac40d1-899d-479e-bd6d-5da5162a4618 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:04.985506 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4aac40d1-899d-479e-bd6d-5da5162a4618 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:05.014692 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4aac40d1-899d-479e-bd6d-5da5162a4618 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:05.015145 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4aac40d1-899d-479e-bd6d-5da5162a4618 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:05.015936 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4aac40d1-899d-479e-bd6d-5da5162a4618 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:05.016411 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4aac40d1-899d-479e-bd6d-5da5162a4618 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:05.021355 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:05.138090 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-db089fe4-eb4c-4f1e-9bfc-e31d111d62d4 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:05.160288 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-db089fe4-eb4c-4f1e-9bfc-e31d111d62d4 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/591d670e-ac99-40a4-9e67-0a7923a203b6" status: 200 len: 1498 microversion: 2.1 time: 0.414236 Jun 20 12:07:05.177406 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1127/2242] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:04 2022] GET /compute/v2.1/servers/591d670e-ac99-40a4-9e67-0a7923a203b6 => generated 1498 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:05.199997 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0e1f5bc1-d33a-42ba-9a5c-0ec4d58e7c6c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1571475110", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:07:05.332008 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-0e1f5bc1-d33a-42ba-9a5c-0ec4d58e7c6c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] validate_networks() for None {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:07:05.403677 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4aac40d1-899d-479e-bd6d-5da5162a4618 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:05.426287 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4aac40d1-899d-479e-bd6d-5da5162a4618 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:05.432862 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4aac40d1-899d-479e-bd6d-5da5162a4618 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:05.434527 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4aac40d1-899d-479e-bd6d-5da5162a4618 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 2662 microversion: 2.42 time: 0.455421 Jun 20 12:07:05.443037 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1116/2243] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:07:04 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 2662 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:07:05.452036 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a8382de3-8284-408b-893c-1da7890d1c54 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:05.453097 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a8382de3-8284-408b-893c-1da7890d1c54 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: ed397d7b-8f66-46c9-b225-1cec5c844672] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:05.462114 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a8382de3-8284-408b-893c-1da7890d1c54 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:05.463091 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a8382de3-8284-408b-893c-1da7890d1c54 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:05.464429 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a8382de3-8284-408b-893c-1da7890d1c54 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:05.465121 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a8382de3-8284-408b-893c-1da7890d1c54 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:05.682836 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:06.080094 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-0e1f5bc1-d33a-42ba-9a5c-0ec4d58e7c6c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:07:06.081233 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-0e1f5bc1-d33a-42ba-9a5c-0ec4d58e7c6c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:07:06.082361 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-0e1f5bc1-d33a-42ba-9a5c-0ec4d58e7c6c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:07:06.082993 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-0e1f5bc1-d33a-42ba-9a5c-0ec4d58e7c6c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:07:06.083827 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-0e1f5bc1-d33a-42ba-9a5c-0ec4d58e7c6c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:07:06.100553 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0e1f5bc1-d33a-42ba-9a5c-0ec4d58e7c6c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:06.101534 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0e1f5bc1-d33a-42ba-9a5c-0ec4d58e7c6c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:06.103714 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0e1f5bc1-d33a-42ba-9a5c-0ec4d58e7c6c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:06.104369 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0e1f5bc1-d33a-42ba-9a5c-0ec4d58e7c6c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:06.163024 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-0e1f5bc1-d33a-42ba-9a5c-0ec4d58e7c6c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Getting quotas for project 4440dc3e2f9c4134a54b08e2585f6c59. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:07:06.169816 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a8382de3-8284-408b-893c-1da7890d1c54 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:06.170969 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-0e1f5bc1-d33a-42ba-9a5c-0ec4d58e7c6c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Getting quotas for user 3d35b7c824b641099a406175bccc5be3 and project 4440dc3e2f9c4134a54b08e2585f6c59. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:07:06.185524 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a8382de3-8284-408b-893c-1da7890d1c54 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672" status: 200 len: 1308 microversion: 2.1 time: 0.737498 Jun 20 12:07:06.189560 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1117/2244] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:05 2022] GET /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672 => generated 1308 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:06.194712 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0e1f5bc1-d33a-42ba-9a5c-0ec4d58e7c6c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:07:06.197574 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0e1f5bc1-d33a-42ba-9a5c-0ec4d58e7c6c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:07:06.200062 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-921c9d8b-505c-4d5e-926b-e4a9ebb76a4c tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:06.200887 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-921c9d8b-505c-4d5e-926b-e4a9ebb76a4c tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: f7d2499c-a9c8-4c2e-8445-667070737f1f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:06.237953 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-921c9d8b-505c-4d5e-926b-e4a9ebb76a4c tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:06.241472 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-921c9d8b-505c-4d5e-926b-e4a9ebb76a4c tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:06.243050 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-921c9d8b-505c-4d5e-926b-e4a9ebb76a4c tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:06.246299 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-921c9d8b-505c-4d5e-926b-e4a9ebb76a4c tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:06.265713 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0e1f5bc1-d33a-42ba-9a5c-0ec4d58e7c6c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.070203 Jun 20 12:07:06.267233 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1128/2245] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:07:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:07:06.301708 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8d438b93-cae0-47c1-a312-7a58fd8a7767 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:06.302549 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8d438b93-cae0-47c1-a312-7a58fd8a7767 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 591d670e-ac99-40a4-9e67-0a7923a203b6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:06.329149 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8d438b93-cae0-47c1-a312-7a58fd8a7767 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:06.329648 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8d438b93-cae0-47c1-a312-7a58fd8a7767 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:06.330516 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8d438b93-cae0-47c1-a312-7a58fd8a7767 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:06.331524 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8d438b93-cae0-47c1-a312-7a58fd8a7767 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:06.741526 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-921c9d8b-505c-4d5e-926b-e4a9ebb76a4c tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286e4b475bbc4d108ca00497ecd3e55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8c8766d4f143349b61f27d8f2566fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:06.754943 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=8 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:06.762275 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-921c9d8b-505c-4d5e-926b-e4a9ebb76a4c tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f" status: 200 len: 1474 microversion: 2.1 time: 0.571467 Jun 20 12:07:06.766821 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1118/2246] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:06 2022] GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f => generated 1474 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:06.799755 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b5986cf5-9eac-47d4-9169-7ef10041701f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:06.805263 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b5986cf5-9eac-47d4-9169-7ef10041701f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:06.968670 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8d438b93-cae0-47c1-a312-7a58fd8a7767 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:07.001412 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8d438b93-cae0-47c1-a312-7a58fd8a7767 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/591d670e-ac99-40a4-9e67-0a7923a203b6" status: 200 len: 1498 microversion: 2.1 time: 0.715892 Jun 20 12:07:07.002605 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1129/2247] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:06 2022] GET /compute/v2.1/servers/591d670e-ac99-40a4-9e67-0a7923a203b6 => generated 1498 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:07.018466 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2dd2c38b-637b-406a-8f93-6e6712fe801b tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:07.019981 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2dd2c38b-637b-406a-8f93-6e6712fe801b tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:07.037742 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2dd2c38b-637b-406a-8f93-6e6712fe801b tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:07.038205 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2dd2c38b-637b-406a-8f93-6e6712fe801b tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:07.041129 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2dd2c38b-637b-406a-8f93-6e6712fe801b tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:07.042179 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2dd2c38b-637b-406a-8f93-6e6712fe801b tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:07.205648 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2dd2c38b-637b-406a-8f93-6e6712fe801b tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:07.208146 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2dd2c38b-637b-406a-8f93-6e6712fe801b tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:07.209155 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-2dd2c38b-637b-406a-8f93-6e6712fe801b tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lazy-loading 'fault' on Instance uuid f59e801d-2548-4edc-8283-af47c991d92a {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:07:07.522294 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2dd2c38b-637b-406a-8f93-6e6712fe801b tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:07.541758 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2dd2c38b-637b-406a-8f93-6e6712fe801b tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:07.545825 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2dd2c38b-637b-406a-8f93-6e6712fe801b tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e233a90ea23c44468b93a9316739f642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f00ab2137741e781c812172c3642b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:07.555943 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2dd2c38b-637b-406a-8f93-6e6712fe801b tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 200 len: 2667 microversion: 2.42 time: 0.551373 Jun 20 12:07:07.559833 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1130/2248] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:07:07 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 2667 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:07:07.585055 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fff8e192-1b05-47e0-b1cf-20fb0e83a51e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:07.589282 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fff8e192-1b05-47e0-b1cf-20fb0e83a51e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: ed397d7b-8f66-46c9-b225-1cec5c844672] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:07.596709 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fff8e192-1b05-47e0-b1cf-20fb0e83a51e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:07.597413 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fff8e192-1b05-47e0-b1cf-20fb0e83a51e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:07.598359 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fff8e192-1b05-47e0-b1cf-20fb0e83a51e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:07.599653 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fff8e192-1b05-47e0-b1cf-20fb0e83a51e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:07.775414 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b5986cf5-9eac-47d4-9169-7ef10041701f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:07.789848 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b5986cf5-9eac-47d4-9169-7ef10041701f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 200 len: 1213 microversion: 2.1 time: 1.019547 Jun 20 12:07:07.817563 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1119/2249] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:06 2022] GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 1213 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:07.835870 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-ed6186e9-d570-4fc2-b467-47328e254806 req-21a379f2-91fd-4c84-a74d-68ea9d31bda2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed397d7b-8f66-46c9-b225-1cec5c844672", "tag": "5c664946-8cfb-453b-81bf-a572f5c306af"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:07:07.876294 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ed6186e9-d570-4fc2-b467-47328e254806 req-21a379f2-91fd-4c84-a74d-68ea9d31bda2 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:07.877229 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ed6186e9-d570-4fc2-b467-47328e254806 req-21a379f2-91fd-4c84-a74d-68ea9d31bda2 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:07.905123 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-ed6186e9-d570-4fc2-b467-47328e254806 req-21a379f2-91fd-4c84-a74d-68ea9d31bda2 service nova] Creating event network-changed:5c664946-8cfb-453b-81bf-a572f5c306af for instance ed397d7b-8f66-46c9-b225-1cec5c844672 on n-h1-master-1 Jun 20 12:07:07.924544 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-ed6186e9-d570-4fc2-b467-47328e254806 req-21a379f2-91fd-4c84-a74d-68ea9d31bda2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100922 Jun 20 12:07:07.925722 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1120/2250] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:07:07.946024 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-57ccca2d-39e7-4cbd-a1f1-284acab22f95 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:07.950010 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-57ccca2d-39e7-4cbd-a1f1-284acab22f95 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: f7d2499c-a9c8-4c2e-8445-667070737f1f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:07.968660 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57ccca2d-39e7-4cbd-a1f1-284acab22f95 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:07.969385 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57ccca2d-39e7-4cbd-a1f1-284acab22f95 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:07.970731 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57ccca2d-39e7-4cbd-a1f1-284acab22f95 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:07.971636 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57ccca2d-39e7-4cbd-a1f1-284acab22f95 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:08.105125 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fff8e192-1b05-47e0-b1cf-20fb0e83a51e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:08.114999 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fff8e192-1b05-47e0-b1cf-20fb0e83a51e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672" status: 200 len: 1308 microversion: 2.1 time: 0.553725 Jun 20 12:07:08.121836 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1131/2251] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:07 2022] GET /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672 => generated 1308 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:08.139649 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-20e3cf03-14f3-466e-943d-84975f00bf48 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:08.160505 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-20e3cf03-14f3-466e-943d-84975f00bf48 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 591d670e-ac99-40a4-9e67-0a7923a203b6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:08.170156 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-20e3cf03-14f3-466e-943d-84975f00bf48 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:08.180327 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-20e3cf03-14f3-466e-943d-84975f00bf48 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:08.181612 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-20e3cf03-14f3-466e-943d-84975f00bf48 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:08.183776 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-20e3cf03-14f3-466e-943d-84975f00bf48 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:09.150188 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-20e3cf03-14f3-466e-943d-84975f00bf48 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:09.164673 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-20e3cf03-14f3-466e-943d-84975f00bf48 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/591d670e-ac99-40a4-9e67-0a7923a203b6" status: 200 len: 1456 microversion: 2.1 time: 1.029033 Jun 20 12:07:09.176165 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1132/2252] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:08 2022] GET /compute/v2.1/servers/591d670e-ac99-40a4-9e67-0a7923a203b6 => generated 1456 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:09.191773 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e152b39b-1cdd-476d-a636-ab00b5d351ba tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:09.207425 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e152b39b-1cdd-476d-a636-ab00b5d351ba tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:09.229769 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e152b39b-1cdd-476d-a636-ab00b5d351ba tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:09.230424 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e152b39b-1cdd-476d-a636-ab00b5d351ba tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:09.231805 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e152b39b-1cdd-476d-a636-ab00b5d351ba tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:09.232608 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e152b39b-1cdd-476d-a636-ab00b5d351ba tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:09.319420 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-e152b39b-1cdd-476d-a636-ab00b5d351ba tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] HTTP exception thrown: Instance f59e801d-2548-4edc-8283-af47c991d92a could not be found. Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e152b39b-1cdd-476d-a636-ab00b5d351ba tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Request method failure captured: Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a HTTP/1.1 Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGE6zFYTiZT5lv0Twz6C9utmbrcmbHIzdc1k979dfXCUqj0kaCyMbQ0xHPTdx3mKxMNiS16Zzi_zksOx_jMJP-amCpWPBFqu_V4TayC7sCfVvfrqvYJuKkj5I3iuUNy-dHrHNQ6Hc5lbJMe_yZb4uueecwdWsdl3AuMjUXTI8b8kRhE Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: X-Openstack-Nova-Api-Version: 2.42 Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: d0f00ab2137741e781c812172c3642b3 Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-749766312 Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0f00ab2137741e781c812172c3642b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0f00ab2137741e781c812172c3642b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d0f00ab2137741e781c812172c3642b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d0f00ab2137741e781c812172c3642b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-TaggedBootDevicesTest_v242-749766312 Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: d0f00ab2137741e781c812172c3642b3 Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-749766312 Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-TaggedBootDevicesTest_v242-749766312-project Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: e233a90ea23c44468b93a9316739f642 Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-TaggedBootDevicesTest_v242-749766312-project Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: exception: Instance f59e801d-2548-4edc-8283-af47c991d92a could not be found. Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'f59e801d-2548-4edc-8283-af47c991d92a'} Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f59e801d-2548-4edc-8283-af47c991d92a could not be found. Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f59e801d-2548-4edc-8283-af47c991d92a could not be found. Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:09.322649 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:07:09.329198 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:09.329198 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:09.329198 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:07:09.329198 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:07:09.329198 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:07:09.329198 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:07:09.329198 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f59e801d-2548-4edc-8283-af47c991d92a could not be found. Jun 20 12:07:09.329198 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:09.329198 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e152b39b-1cdd-476d-a636-ab00b5d351ba tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Returning 404 to user: Instance f59e801d-2548-4edc-8283-af47c991d92a could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:07:09.329198 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e152b39b-1cdd-476d-a636-ab00b5d351ba tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 404 len: 111 microversion: 2.42 time: 0.146611 Jun 20 12:07:09.343944 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1133/2253] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:07:09 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:07:09.366535 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-21408c83-ef7e-4ecd-87e6-b5e7ebf40c5e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:09.367359 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-21408c83-ef7e-4ecd-87e6-b5e7ebf40c5e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:09.385005 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-21408c83-ef7e-4ecd-87e6-b5e7ebf40c5e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:09.385474 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-21408c83-ef7e-4ecd-87e6-b5e7ebf40c5e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:09.386286 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-21408c83-ef7e-4ecd-87e6-b5e7ebf40c5e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:09.393381 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-21408c83-ef7e-4ecd-87e6-b5e7ebf40c5e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:09.529921 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-57ccca2d-39e7-4cbd-a1f1-284acab22f95 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286e4b475bbc4d108ca00497ecd3e55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8c8766d4f143349b61f27d8f2566fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:09.547016 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-57ccca2d-39e7-4cbd-a1f1-284acab22f95 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f" status: 200 len: 1474 microversion: 2.1 time: 1.619853 Jun 20 12:07:09.553123 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1121/2254] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:07 2022] GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f => generated 1474 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:09.559520 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dd4e030d-9f1f-4d56-b617-1cb384964b02 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:09.562586 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dd4e030d-9f1f-4d56-b617-1cb384964b02 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: ed397d7b-8f66-46c9-b225-1cec5c844672] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:09.583159 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd4e030d-9f1f-4d56-b617-1cb384964b02 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:09.583621 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd4e030d-9f1f-4d56-b617-1cb384964b02 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:09.592418 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd4e030d-9f1f-4d56-b617-1cb384964b02 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:09.600177 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd4e030d-9f1f-4d56-b617-1cb384964b02 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:10.252544 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-21408c83-ef7e-4ecd-87e6-b5e7ebf40c5e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:10.269253 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-21408c83-ef7e-4ecd-87e6-b5e7ebf40c5e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 200 len: 1271 microversion: 2.1 time: 0.922537 Jun 20 12:07:10.274103 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1134/2255] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:09 2022] GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 1271 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:10.279390 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dd4e030d-9f1f-4d56-b617-1cb384964b02 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:10.288388 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cca9cc89-468d-4e1a-bbb3-43a6ec4df772 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '.version_select at 0x7f6073189e50>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:10.298617 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dd4e030d-9f1f-4d56-b617-1cb384964b02 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672" status: 200 len: 1308 microversion: 2.1 time: 0.741255 Jun 20 12:07:10.312672 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1122/2256] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:09 2022] GET /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672 => generated 1308 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:10.317880 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-ba43f5ce-1770-45c2-afd0-05651f8c5cd5 req-ad1858e6-020b-4f65-8e9b-56e45879b3be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "591d670e-ac99-40a4-9e67-0a7923a203b6", "name": "network-vif-deleted", "tag": "2b785317-6e49-46cd-a9a2-f18a6dfc62b1"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:07:10.337456 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cca9cc89-468d-4e1a-bbb3-43a6ec4df772 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1945698217" status: 204 len: 0 microversion: 2.42 time: 0.057962 Jun 20 12:07:10.338151 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1135/2257] 10.222.0.27 () {60 vars in 1261 bytes} [Mon Jun 20 12:07:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1945698217 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 12:07:10.345864 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ea5a446b-db53-4a5b-b87e-05aeb072761c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:10.347689 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ba43f5ce-1770-45c2-afd0-05651f8c5cd5 req-ad1858e6-020b-4f65-8e9b-56e45879b3be service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:10.348411 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ba43f5ce-1770-45c2-afd0-05651f8c5cd5 req-ad1858e6-020b-4f65-8e9b-56e45879b3be service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:10.350570 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ea5a446b-db53-4a5b-b87e-05aeb072761c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 591d670e-ac99-40a4-9e67-0a7923a203b6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:10.366381 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-ba43f5ce-1770-45c2-afd0-05651f8c5cd5 req-ad1858e6-020b-4f65-8e9b-56e45879b3be service nova] Creating event network-vif-deleted:2b785317-6e49-46cd-a9a2-f18a6dfc62b1 for instance 591d670e-ac99-40a4-9e67-0a7923a203b6 on n-h2-master-1 Jun 20 12:07:10.374423 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-ba43f5ce-1770-45c2-afd0-05651f8c5cd5 req-ad1858e6-020b-4f65-8e9b-56e45879b3be service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060103 Jun 20 12:07:10.375644 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1123/2258] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:07:10.385431 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ea5a446b-db53-4a5b-b87e-05aeb072761c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:10.385886 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ea5a446b-db53-4a5b-b87e-05aeb072761c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:10.386694 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ea5a446b-db53-4a5b-b87e-05aeb072761c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:10.387232 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ea5a446b-db53-4a5b-b87e-05aeb072761c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:10.466565 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:10.490988 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ea5a446b-db53-4a5b-b87e-05aeb072761c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:10.491988 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ea5a446b-db53-4a5b-b87e-05aeb072761c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:10.492831 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-ea5a446b-db53-4a5b-b87e-05aeb072761c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lazy-loading 'fault' on Instance uuid 591d670e-ac99-40a4-9e67-0a7923a203b6 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:07:10.572890 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2c9f33ee-f7d8-4a9a-9b5a-5246a6df79dc tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:10.575372 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2c9f33ee-f7d8-4a9a-9b5a-5246a6df79dc tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: f7d2499c-a9c8-4c2e-8445-667070737f1f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:10.593129 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2c9f33ee-f7d8-4a9a-9b5a-5246a6df79dc tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:10.595464 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2c9f33ee-f7d8-4a9a-9b5a-5246a6df79dc tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:10.601069 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2c9f33ee-f7d8-4a9a-9b5a-5246a6df79dc tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:10.602059 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2c9f33ee-f7d8-4a9a-9b5a-5246a6df79dc tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:10.998849 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ea5a446b-db53-4a5b-b87e-05aeb072761c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3495d9dc8b714809b2f3f777cbabda29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe3d6c4b7a41fa8181a805a992c173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:11.022598 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ea5a446b-db53-4a5b-b87e-05aeb072761c tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/591d670e-ac99-40a4-9e67-0a7923a203b6" status: 200 len: 1303 microversion: 2.1 time: 0.681009 Jun 20 12:07:11.025031 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1136/2259] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:10 2022] GET /compute/v2.1/servers/591d670e-ac99-40a4-9e67-0a7923a203b6 => generated 1303 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:11.212312 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2c9f33ee-f7d8-4a9a-9b5a-5246a6df79dc tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286e4b475bbc4d108ca00497ecd3e55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8c8766d4f143349b61f27d8f2566fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:11.240529 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2c9f33ee-f7d8-4a9a-9b5a-5246a6df79dc tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f" status: 200 len: 1432 microversion: 2.1 time: 0.667194 Jun 20 12:07:11.241693 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1124/2260] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:10 2022] GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f => generated 1432 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:11.297106 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7c97ccfd-1a79-4b98-aa5a-947d0379b162 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:11.301477 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7c97ccfd-1a79-4b98-aa5a-947d0379b162 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:11.347696 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c97ccfd-1a79-4b98-aa5a-947d0379b162 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:11.349594 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c97ccfd-1a79-4b98-aa5a-947d0379b162 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:11.356290 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c97ccfd-1a79-4b98-aa5a-947d0379b162 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:11.357482 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c97ccfd-1a79-4b98-aa5a-947d0379b162 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:11.485614 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-9a34777c-7b77-4bbf-8a7b-ae34400748d2 req-6ef42778-8dc1-4630-b20e-ec5e2e75f9b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7d2499c-a9c8-4c2e-8445-667070737f1f", "name": "network-vif-deleted", "tag": "4b377c25-4bc9-46b4-9743-511faa7773d1"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:07:11.515506 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9a34777c-7b77-4bbf-8a7b-ae34400748d2 req-6ef42778-8dc1-4630-b20e-ec5e2e75f9b3 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:11.529606 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9a34777c-7b77-4bbf-8a7b-ae34400748d2 req-6ef42778-8dc1-4630-b20e-ec5e2e75f9b3 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:11.564002 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-9a34777c-7b77-4bbf-8a7b-ae34400748d2 req-6ef42778-8dc1-4630-b20e-ec5e2e75f9b3 service nova] Creating event network-vif-deleted:4b377c25-4bc9-46b4-9743-511faa7773d1 for instance f7d2499c-a9c8-4c2e-8445-667070737f1f on n-h2-master-1 Jun 20 12:07:11.586159 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-9a34777c-7b77-4bbf-8a7b-ae34400748d2 req-6ef42778-8dc1-4630-b20e-ec5e2e75f9b3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.557940 Jun 20 12:07:11.587823 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1137/2261] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:07:11.605548 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d3426ddc-3e65-40c4-8a11-9ea6498761a1 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:11.607657 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d3426ddc-3e65-40c4-8a11-9ea6498761a1 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: ed397d7b-8f66-46c9-b225-1cec5c844672] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:11.630398 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3426ddc-3e65-40c4-8a11-9ea6498761a1 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:11.634090 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3426ddc-3e65-40c4-8a11-9ea6498761a1 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:11.638366 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3426ddc-3e65-40c4-8a11-9ea6498761a1 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:11.640121 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3426ddc-3e65-40c4-8a11-9ea6498761a1 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:12.035815 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7c97ccfd-1a79-4b98-aa5a-947d0379b162 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:12.051235 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7c97ccfd-1a79-4b98-aa5a-947d0379b162 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 200 len: 1271 microversion: 2.1 time: 0.763038 Jun 20 12:07:12.051857 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1125/2262] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:11 2022] GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 1271 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:12.057785 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-91da1845-febf-46f3-b959-f40108b625d3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:12.058435 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-91da1845-febf-46f3-b959-f40108b625d3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 591d670e-ac99-40a4-9e67-0a7923a203b6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:12.090445 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91da1845-febf-46f3-b959-f40108b625d3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:12.091258 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91da1845-febf-46f3-b959-f40108b625d3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:12.092122 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91da1845-febf-46f3-b959-f40108b625d3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:12.092976 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91da1845-febf-46f3-b959-f40108b625d3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:12.137746 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-91da1845-febf-46f3-b959-f40108b625d3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] HTTP exception thrown: Instance 591d670e-ac99-40a4-9e67-0a7923a203b6 could not be found. Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-91da1845-febf-46f3-b959-f40108b625d3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Request method failure captured: Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/591d670e-ac99-40a4-9e67-0a7923a203b6 HTTP/1.1 Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGGM0_Rgon_QXChHIK_Ikyu0N9hux8u1Ms08jFhXlxkRDQgHGZCrxeBLJGVow3P3B7-C_d1lwOFEoVq18fpBt5bYVFsDOyFchFBnf15eYmBoM5W3iquFzY2ZI2UJK0DkPKTj0Fv6tDqgY5whthvLS8glHLsBu0Y3_K5TIG0-QwQVU5w Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 3495d9dc8b714809b2f3f777cbabda29 Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 591d670e-ac99-40a4-9e67-0a7923a203b6 could not be found. Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '591d670e-ac99-40a4-9e67-0a7923a203b6'} Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 591d670e-ac99-40a4-9e67-0a7923a203b6 could not be found. Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 591d670e-ac99-40a4-9e67-0a7923a203b6 could not be found. Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:07:12.139605 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:12.148596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:12.148596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:07:12.148596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:07:12.148596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:07:12.148596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:07:12.148596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 591d670e-ac99-40a4-9e67-0a7923a203b6 could not be found. Jun 20 12:07:12.148596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:12.148596 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-91da1845-febf-46f3-b959-f40108b625d3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Returning 404 to user: Instance 591d670e-ac99-40a4-9e67-0a7923a203b6 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:07:12.148596 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-91da1845-febf-46f3-b959-f40108b625d3 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/591d670e-ac99-40a4-9e67-0a7923a203b6" status: 404 len: 111 microversion: 2.1 time: 0.088710 Jun 20 12:07:12.148596 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1126/2263] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:12 2022] GET /compute/v2.1/servers/591d670e-ac99-40a4-9e67-0a7923a203b6 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:07:12.152616 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d712506b-6b01-403f-b8cc-090fc5628599 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:12.153115 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d712506b-6b01-403f-b8cc-090fc5628599 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 591d670e-ac99-40a4-9e67-0a7923a203b6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:12.177972 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d712506b-6b01-403f-b8cc-090fc5628599 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:12.178437 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d712506b-6b01-403f-b8cc-090fc5628599 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:12.179253 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d712506b-6b01-403f-b8cc-090fc5628599 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:12.179699 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d712506b-6b01-403f-b8cc-090fc5628599 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:12.213658 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-d712506b-6b01-403f-b8cc-090fc5628599 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] HTTP exception thrown: Instance 591d670e-ac99-40a4-9e67-0a7923a203b6 could not be found. Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d712506b-6b01-403f-b8cc-090fc5628599 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Request method failure captured: Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/591d670e-ac99-40a4-9e67-0a7923a203b6 HTTP/1.1 Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGGM0_Rgon_QXChHIK_Ikyu0N9hux8u1Ms08jFhXlxkRDQgHGZCrxeBLJGVow3P3B7-C_d1lwOFEoVq18fpBt5bYVFsDOyFchFBnf15eYmBoM5W3iquFzY2ZI2UJK0DkPKTj0Fv6tDqgY5whthvLS8glHLsBu0Y3_K5TIG0-QwQVU5w Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 3495d9dc8b714809b2f3f777cbabda29 Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 591d670e-ac99-40a4-9e67-0a7923a203b6 could not be found. Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '591d670e-ac99-40a4-9e67-0a7923a203b6'} Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 591d670e-ac99-40a4-9e67-0a7923a203b6 could not be found. Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:07:12.215282 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:07:12.225163 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 591d670e-ac99-40a4-9e67-0a7923a203b6 could not be found. Jun 20 12:07:12.225163 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:12.225163 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:07:12.225163 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:12.225163 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:12.225163 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:07:12.225163 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:07:12.225163 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:07:12.225163 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:07:12.225163 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 591d670e-ac99-40a4-9e67-0a7923a203b6 could not be found. Jun 20 12:07:12.225163 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:12.225163 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d712506b-6b01-403f-b8cc-090fc5628599 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Returning 404 to user: Instance 591d670e-ac99-40a4-9e67-0a7923a203b6 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:07:12.225163 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d712506b-6b01-403f-b8cc-090fc5628599 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "DELETE /compute/v2.1/servers/591d670e-ac99-40a4-9e67-0a7923a203b6" status: 404 len: 111 microversion: 2.1 time: 0.068424 Jun 20 12:07:12.228021 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1127/2264] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:07:12 2022] DELETE /compute/v2.1/servers/591d670e-ac99-40a4-9e67-0a7923a203b6 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:07:12.234103 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0170c432-2d48-4b70-9dd1-db0031460b4d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:12.234733 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0170c432-2d48-4b70-9dd1-db0031460b4d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 591d670e-ac99-40a4-9e67-0a7923a203b6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:12.256607 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0170c432-2d48-4b70-9dd1-db0031460b4d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:12.257185 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0170c432-2d48-4b70-9dd1-db0031460b4d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:12.258041 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0170c432-2d48-4b70-9dd1-db0031460b4d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:12.258812 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0170c432-2d48-4b70-9dd1-db0031460b4d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:12.282272 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-0170c432-2d48-4b70-9dd1-db0031460b4d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] HTTP exception thrown: Instance 591d670e-ac99-40a4-9e67-0a7923a203b6 could not be found. Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0170c432-2d48-4b70-9dd1-db0031460b4d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Request method failure captured: Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/591d670e-ac99-40a4-9e67-0a7923a203b6 HTTP/1.1 Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGGM0_Rgon_QXChHIK_Ikyu0N9hux8u1Ms08jFhXlxkRDQgHGZCrxeBLJGVow3P3B7-C_d1lwOFEoVq18fpBt5bYVFsDOyFchFBnf15eYmBoM5W3iquFzY2ZI2UJK0DkPKTj0Fv6tDqgY5whthvLS8glHLsBu0Y3_K5TIG0-QwQVU5w Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 3495d9dc8b714809b2f3f777cbabda29 Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 591d670e-ac99-40a4-9e67-0a7923a203b6 could not be found. Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '591d670e-ac99-40a4-9e67-0a7923a203b6'} Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 591d670e-ac99-40a4-9e67-0a7923a203b6 could not be found. Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 591d670e-ac99-40a4-9e67-0a7923a203b6 could not be found. Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:07:12.284063 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:12.288184 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:12.288184 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:07:12.288184 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:07:12.288184 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:07:12.288184 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:07:12.288184 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 591d670e-ac99-40a4-9e67-0a7923a203b6 could not be found. Jun 20 12:07:12.288184 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:12.293487 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0170c432-2d48-4b70-9dd1-db0031460b4d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Returning 404 to user: Instance 591d670e-ac99-40a4-9e67-0a7923a203b6 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:07:12.294629 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0170c432-2d48-4b70-9dd1-db0031460b4d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/591d670e-ac99-40a4-9e67-0a7923a203b6" status: 404 len: 111 microversion: 2.1 time: 0.065315 Jun 20 12:07:12.298623 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1128/2265] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:12 2022] GET /compute/v2.1/servers/591d670e-ac99-40a4-9e67-0a7923a203b6 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:07:12.311176 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-11e3b006-6921-424c-a02a-d5bc1b33b125 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:12.311859 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-11e3b006-6921-424c-a02a-d5bc1b33b125 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: f7d2499c-a9c8-4c2e-8445-667070737f1f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:12.336815 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11e3b006-6921-424c-a02a-d5bc1b33b125 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:12.337692 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11e3b006-6921-424c-a02a-d5bc1b33b125 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:12.338614 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11e3b006-6921-424c-a02a-d5bc1b33b125 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:12.339071 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11e3b006-6921-424c-a02a-d5bc1b33b125 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:12.372414 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-11e3b006-6921-424c-a02a-d5bc1b33b125 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] HTTP exception thrown: Instance f7d2499c-a9c8-4c2e-8445-667070737f1f could not be found. Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-11e3b006-6921-424c-a02a-d5bc1b33b125 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Request method failure captured: Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f HTTP/1.1 Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGI82dQCP_-l4p0MZjFr3RKwtkf63DJkGMRUoE9xEAk8gTkhK7ASEtOs6NVKUT9uJyGFnHy4eISNF5xj96q9-KhKLDlipNigAwbqc_XZEEOY3yR0CwY_8h7jcRZBuyr3VmwWQHZK2mzvhKrwAYs6fc7OfSQXm3KZkC9QYQQiBHphUp8 Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 3a8c8766d4f143349b61f27d8f2566fb Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ListImageFiltersTestJSON-1612527290 Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3a8c8766d4f143349b61f27d8f2566fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3a8c8766d4f143349b61f27d8f2566fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3a8c8766d4f143349b61f27d8f2566fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3a8c8766d4f143349b61f27d8f2566fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ListImageFiltersTestJSON-1612527290 Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 3a8c8766d4f143349b61f27d8f2566fb Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1612527290 Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ListImageFiltersTestJSON-1612527290-project Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 286e4b475bbc4d108ca00497ecd3e55a Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ListImageFiltersTestJSON-1612527290-project Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: exception: Instance f7d2499c-a9c8-4c2e-8445-667070737f1f could not be found. Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'f7d2499c-a9c8-4c2e-8445-667070737f1f'} Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7d2499c-a9c8-4c2e-8445-667070737f1f could not be found. Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7d2499c-a9c8-4c2e-8445-667070737f1f could not be found. Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:07:12.374128 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:12.377731 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:12.377731 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:07:12.377731 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:07:12.377731 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:07:12.377731 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:07:12.377731 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7d2499c-a9c8-4c2e-8445-667070737f1f could not be found. Jun 20 12:07:12.377731 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:12.377731 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-11e3b006-6921-424c-a02a-d5bc1b33b125 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Returning 404 to user: Instance f7d2499c-a9c8-4c2e-8445-667070737f1f could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:07:12.377731 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-11e3b006-6921-424c-a02a-d5bc1b33b125 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f" status: 404 len: 111 microversion: 2.1 time: 0.075845 Jun 20 12:07:12.388581 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1129/2266] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:12 2022] GET /compute/v2.1/servers/f7d2499c-a9c8-4c2e-8445-667070737f1f => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:07:12.395238 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bc44220a-3a6c-4b86-a647-08f0489681e7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:12.396034 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bc44220a-3a6c-4b86-a647-08f0489681e7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:12.413008 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc44220a-3a6c-4b86-a647-08f0489681e7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:12.415350 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc44220a-3a6c-4b86-a647-08f0489681e7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:12.418880 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc44220a-3a6c-4b86-a647-08f0489681e7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:12.426061 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc44220a-3a6c-4b86-a647-08f0489681e7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:12.473282 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-bc44220a-3a6c-4b86-a647-08f0489681e7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] HTTP exception thrown: Instance 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 could not be found. Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bc44220a-3a6c-4b86-a647-08f0489681e7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Request method failure captured: Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 HTTP/1.1 Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGGM0_Rgon_QXChHIK_Ikyu0N9hux8u1Ms08jFhXlxkRDQgHGZCrxeBLJGVow3P3B7-C_d1lwOFEoVq18fpBt5bYVFsDOyFchFBnf15eYmBoM5W3iquFzY2ZI2UJK0DkPKTj0Fv6tDqgY5whthvLS8glHLsBu0Y3_K5TIG0-QwQVU5w Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 3495d9dc8b714809b2f3f777cbabda29 Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 could not be found. Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '9be8ed90-c9d0-4d98-b1b8-cc3395caffd1'} Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 could not be found. Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:07:12.488555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:07:12.492019 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 could not be found. Jun 20 12:07:12.492019 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:12.492019 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:07:12.492019 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:12.492019 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:12.492019 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:07:12.492019 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:07:12.492019 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:07:12.492019 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:07:12.492019 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 could not be found. Jun 20 12:07:12.492019 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:12.500445 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bc44220a-3a6c-4b86-a647-08f0489681e7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Returning 404 to user: Instance 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:07:12.501980 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bc44220a-3a6c-4b86-a647-08f0489681e7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 404 len: 111 microversion: 2.1 time: 0.111883 Jun 20 12:07:12.505132 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1130/2267] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:07:12 2022] DELETE /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:07:12.519562 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3751b136-b687-4c8f-86b4-6346a4700006 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:12.520507 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3751b136-b687-4c8f-86b4-6346a4700006 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: 838db96b-0c7a-4d7f-9807-44194bc73cff] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:12.527547 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3751b136-b687-4c8f-86b4-6346a4700006 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:12.528336 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3751b136-b687-4c8f-86b4-6346a4700006 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:12.529311 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3751b136-b687-4c8f-86b4-6346a4700006 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:12.529963 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3751b136-b687-4c8f-86b4-6346a4700006 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:12.571964 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3751b136-b687-4c8f-86b4-6346a4700006 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: 838db96b-0c7a-4d7f-9807-44194bc73cff] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:07:12.729603 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3751b136-b687-4c8f-86b4-6346a4700006 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "DELETE /compute/v2.1/servers/838db96b-0c7a-4d7f-9807-44194bc73cff" status: 204 len: 0 microversion: 2.1 time: 0.222731 Jun 20 12:07:12.730664 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1131/2268] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:07:12 2022] DELETE /compute/v2.1/servers/838db96b-0c7a-4d7f-9807-44194bc73cff => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:07:12.741965 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d4dc5204-43c9-403d-9086-b675cb0755df tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:12.745445 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d4dc5204-43c9-403d-9086-b675cb0755df tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:12.770324 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d4dc5204-43c9-403d-9086-b675cb0755df tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:12.771041 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d4dc5204-43c9-403d-9086-b675cb0755df tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:12.772334 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d4dc5204-43c9-403d-9086-b675cb0755df tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:12.772996 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d4dc5204-43c9-403d-9086-b675cb0755df tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:12.799254 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-d4dc5204-43c9-403d-9086-b675cb0755df tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] HTTP exception thrown: Instance 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 could not be found. Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d4dc5204-43c9-403d-9086-b675cb0755df tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Request method failure captured: Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 HTTP/1.1 Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGGM0_Rgon_QXChHIK_Ikyu0N9hux8u1Ms08jFhXlxkRDQgHGZCrxeBLJGVow3P3B7-C_d1lwOFEoVq18fpBt5bYVFsDOyFchFBnf15eYmBoM5W3iquFzY2ZI2UJK0DkPKTj0Fv6tDqgY5whthvLS8glHLsBu0Y3_K5TIG0-QwQVU5w Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 3495d9dc8b714809b2f3f777cbabda29 Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 could not be found. Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '9be8ed90-c9d0-4d98-b1b8-cc3395caffd1'} Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 could not be found. Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 could not be found. Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:07:12.801254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:12.804870 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:12.804870 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:07:12.804870 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:07:12.804870 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:07:12.804870 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:07:12.804870 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 could not be found. Jun 20 12:07:12.804870 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:12.818114 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d4dc5204-43c9-403d-9086-b675cb0755df tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Returning 404 to user: Instance 9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:07:12.821487 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d4dc5204-43c9-403d-9086-b675cb0755df tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1" status: 404 len: 111 microversion: 2.1 time: 0.086996 Jun 20 12:07:12.822456 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1132/2269] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:12 2022] GET /compute/v2.1/servers/9be8ed90-c9d0-4d98-b1b8-cc3395caffd1 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:07:12.825092 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d3426ddc-3e65-40c4-8a11-9ea6498761a1 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:12.835603 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b683772a-9c2c-4936-9617-574d405f8551 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:12.836943 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d3426ddc-3e65-40c4-8a11-9ea6498761a1 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672" status: 200 len: 1308 microversion: 2.1 time: 1.247190 Jun 20 12:07:12.837435 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b683772a-9c2c-4936-9617-574d405f8551 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: 838db96b-0c7a-4d7f-9807-44194bc73cff] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:12.840306 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1138/2270] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:11 2022] GET /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672 => generated 1308 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:12.848439 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:12.857754 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b683772a-9c2c-4936-9617-574d405f8551 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:12.863107 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dcfc2956-9f3f-4ba7-b3f3-ac2ceb64bed7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:12.863682 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-dcfc2956-9f3f-4ba7-b3f3-ac2ceb64bed7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:12.864342 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b683772a-9c2c-4936-9617-574d405f8551 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:12.865417 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b683772a-9c2c-4936-9617-574d405f8551 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:12.866081 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b683772a-9c2c-4936-9617-574d405f8551 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:12.867527 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:12.879581 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dcfc2956-9f3f-4ba7-b3f3-ac2ceb64bed7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:12.880085 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dcfc2956-9f3f-4ba7-b3f3-ac2ceb64bed7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:12.880916 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dcfc2956-9f3f-4ba7-b3f3-ac2ceb64bed7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:12.881354 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dcfc2956-9f3f-4ba7-b3f3-ac2ceb64bed7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:12.929017 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-dcfc2956-9f3f-4ba7-b3f3-ac2ceb64bed7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] HTTP exception thrown: Instance b52985a9-6859-4d8b-b248-d4d2289f7da1 could not be found. Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dcfc2956-9f3f-4ba7-b3f3-ac2ceb64bed7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Request method failure captured: Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 HTTP/1.1 Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGGM0_Rgon_QXChHIK_Ikyu0N9hux8u1Ms08jFhXlxkRDQgHGZCrxeBLJGVow3P3B7-C_d1lwOFEoVq18fpBt5bYVFsDOyFchFBnf15eYmBoM5W3iquFzY2ZI2UJK0DkPKTj0Fv6tDqgY5whthvLS8glHLsBu0Y3_K5TIG0-QwQVU5w Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 3495d9dc8b714809b2f3f777cbabda29 Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: exception: Instance b52985a9-6859-4d8b-b248-d4d2289f7da1 could not be found. Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'b52985a9-6859-4d8b-b248-d4d2289f7da1'} Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b52985a9-6859-4d8b-b248-d4d2289f7da1 could not be found. Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:07:12.938314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:07:12.942524 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b52985a9-6859-4d8b-b248-d4d2289f7da1 could not be found. Jun 20 12:07:12.942524 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:12.942524 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:07:12.942524 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:12.942524 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:12.942524 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:07:12.942524 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:07:12.942524 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:07:12.942524 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:07:12.942524 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b52985a9-6859-4d8b-b248-d4d2289f7da1 could not be found. Jun 20 12:07:12.942524 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:12.946387 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dcfc2956-9f3f-4ba7-b3f3-ac2ceb64bed7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Returning 404 to user: Instance b52985a9-6859-4d8b-b248-d4d2289f7da1 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:07:12.947171 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dcfc2956-9f3f-4ba7-b3f3-ac2ceb64bed7 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 404 len: 111 microversion: 2.1 time: 0.104697 Jun 20 12:07:12.953992 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1139/2271] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:07:12 2022] DELETE /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:07:12.974282 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-379cd805-d1da-4a0e-9ef3-be23a7fe68d8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:12.976692 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-379cd805-d1da-4a0e-9ef3-be23a7fe68d8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: b52985a9-6859-4d8b-b248-d4d2289f7da1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:13.000230 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-379cd805-d1da-4a0e-9ef3-be23a7fe68d8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:13.000691 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-379cd805-d1da-4a0e-9ef3-be23a7fe68d8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:13.001663 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-379cd805-d1da-4a0e-9ef3-be23a7fe68d8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:13.002250 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-379cd805-d1da-4a0e-9ef3-be23a7fe68d8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:13.033238 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-379cd805-d1da-4a0e-9ef3-be23a7fe68d8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] HTTP exception thrown: Instance b52985a9-6859-4d8b-b248-d4d2289f7da1 could not be found. Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-379cd805-d1da-4a0e-9ef3-be23a7fe68d8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Request method failure captured: Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 HTTP/1.1 Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGGM0_Rgon_QXChHIK_Ikyu0N9hux8u1Ms08jFhXlxkRDQgHGZCrxeBLJGVow3P3B7-C_d1lwOFEoVq18fpBt5bYVFsDOyFchFBnf15eYmBoM5W3iquFzY2ZI2UJK0DkPKTj0Fv6tDqgY5whthvLS8glHLsBu0Y3_K5TIG0-QwQVU5w Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 3495d9dc8b714809b2f3f777cbabda29 Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: exception: Instance b52985a9-6859-4d8b-b248-d4d2289f7da1 could not be found. Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'b52985a9-6859-4d8b-b248-d4d2289f7da1'} Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b52985a9-6859-4d8b-b248-d4d2289f7da1 could not be found. Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b52985a9-6859-4d8b-b248-d4d2289f7da1 could not be found. Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:07:13.035067 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:13.040866 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:13.040866 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:07:13.040866 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:07:13.040866 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:07:13.040866 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:07:13.040866 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b52985a9-6859-4d8b-b248-d4d2289f7da1 could not be found. Jun 20 12:07:13.040866 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:13.051375 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-379cd805-d1da-4a0e-9ef3-be23a7fe68d8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Returning 404 to user: Instance b52985a9-6859-4d8b-b248-d4d2289f7da1 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:07:13.052611 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-379cd805-d1da-4a0e-9ef3-be23a7fe68d8 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1" status: 404 len: 111 microversion: 2.1 time: 0.097325 Jun 20 12:07:13.053647 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1140/2272] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:12 2022] GET /compute/v2.1/servers/b52985a9-6859-4d8b-b248-d4d2289f7da1 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:07:13.062143 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d13176ef-72e6-4495-af24-b5c77100aa3a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:13.063004 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d13176ef-72e6-4495-af24-b5c77100aa3a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 7cff5b7f-6801-45ae-b6bd-5e062ce73b18] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:13.077300 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d13176ef-72e6-4495-af24-b5c77100aa3a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:13.077752 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d13176ef-72e6-4495-af24-b5c77100aa3a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:13.082572 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d13176ef-72e6-4495-af24-b5c77100aa3a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:13.083427 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d13176ef-72e6-4495-af24-b5c77100aa3a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:13.126835 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-d13176ef-72e6-4495-af24-b5c77100aa3a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] HTTP exception thrown: Instance 7cff5b7f-6801-45ae-b6bd-5e062ce73b18 could not be found. Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d13176ef-72e6-4495-af24-b5c77100aa3a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Request method failure captured: Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18 HTTP/1.1 Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGGM0_Rgon_QXChHIK_Ikyu0N9hux8u1Ms08jFhXlxkRDQgHGZCrxeBLJGVow3P3B7-C_d1lwOFEoVq18fpBt5bYVFsDOyFchFBnf15eYmBoM5W3iquFzY2ZI2UJK0DkPKTj0Fv6tDqgY5whthvLS8glHLsBu0Y3_K5TIG0-QwQVU5w Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 3495d9dc8b714809b2f3f777cbabda29 Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 7cff5b7f-6801-45ae-b6bd-5e062ce73b18 could not be found. Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '7cff5b7f-6801-45ae-b6bd-5e062ce73b18'} Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cff5b7f-6801-45ae-b6bd-5e062ce73b18 could not be found. Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:07:13.128758 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:07:13.135909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cff5b7f-6801-45ae-b6bd-5e062ce73b18 could not be found. Jun 20 12:07:13.135909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:13.135909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:07:13.135909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:13.135909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:13.135909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:07:13.135909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:07:13.135909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:07:13.135909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:07:13.135909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cff5b7f-6801-45ae-b6bd-5e062ce73b18 could not be found. Jun 20 12:07:13.135909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:13.135909 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d13176ef-72e6-4495-af24-b5c77100aa3a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Returning 404 to user: Instance 7cff5b7f-6801-45ae-b6bd-5e062ce73b18 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:07:13.135909 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d13176ef-72e6-4495-af24-b5c77100aa3a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18" status: 404 len: 111 microversion: 2.1 time: 0.072545 Jun 20 12:07:13.135909 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1141/2273] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:07:13 2022] DELETE /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:07:13.150448 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b3a8a662-e0e2-41d8-80ed-690fe829c52b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:13.151116 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b3a8a662-e0e2-41d8-80ed-690fe829c52b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:13.162869 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b3a8a662-e0e2-41d8-80ed-690fe829c52b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:13.163315 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b3a8a662-e0e2-41d8-80ed-690fe829c52b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:13.164377 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b3a8a662-e0e2-41d8-80ed-690fe829c52b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:13.164959 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b3a8a662-e0e2-41d8-80ed-690fe829c52b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:13.577784 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b3a8a662-e0e2-41d8-80ed-690fe829c52b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:13.589542 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b3a8a662-e0e2-41d8-80ed-690fe829c52b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 200 len: 1313 microversion: 2.1 time: 0.452325 Jun 20 12:07:13.590777 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1142/2274] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:13 2022] GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 1313 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:13.595597 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cef4d211-6beb-4f02-82a8-dc3a21c55713 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:13.596406 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cef4d211-6beb-4f02-82a8-dc3a21c55713 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 7cff5b7f-6801-45ae-b6bd-5e062ce73b18] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:13.603532 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cef4d211-6beb-4f02-82a8-dc3a21c55713 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:13.603982 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cef4d211-6beb-4f02-82a8-dc3a21c55713 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:13.604808 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cef4d211-6beb-4f02-82a8-dc3a21c55713 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:13.605246 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cef4d211-6beb-4f02-82a8-dc3a21c55713 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:13.623186 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-cef4d211-6beb-4f02-82a8-dc3a21c55713 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] HTTP exception thrown: Instance 7cff5b7f-6801-45ae-b6bd-5e062ce73b18 could not be found. Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cef4d211-6beb-4f02-82a8-dc3a21c55713 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Request method failure captured: Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18 HTTP/1.1 Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGGM0_Rgon_QXChHIK_Ikyu0N9hux8u1Ms08jFhXlxkRDQgHGZCrxeBLJGVow3P3B7-C_d1lwOFEoVq18fpBt5bYVFsDOyFchFBnf15eYmBoM5W3iquFzY2ZI2UJK0DkPKTj0Fv6tDqgY5whthvLS8glHLsBu0Y3_K5TIG0-QwQVU5w Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 3495d9dc8b714809b2f3f777cbabda29 Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 7cff5b7f-6801-45ae-b6bd-5e062ce73b18 could not be found. Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '7cff5b7f-6801-45ae-b6bd-5e062ce73b18'} Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cff5b7f-6801-45ae-b6bd-5e062ce73b18 could not be found. Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cff5b7f-6801-45ae-b6bd-5e062ce73b18 could not be found. Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:07:13.625165 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:13.629803 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:13.629803 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:07:13.629803 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:07:13.629803 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:07:13.629803 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:07:13.629803 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cff5b7f-6801-45ae-b6bd-5e062ce73b18 could not be found. Jun 20 12:07:13.629803 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:13.632129 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cef4d211-6beb-4f02-82a8-dc3a21c55713 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Returning 404 to user: Instance 7cff5b7f-6801-45ae-b6bd-5e062ce73b18 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:07:13.640066 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cef4d211-6beb-4f02-82a8-dc3a21c55713 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18" status: 404 len: 111 microversion: 2.1 time: 0.043745 Jun 20 12:07:13.640994 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1143/2275] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:13 2022] GET /compute/v2.1/servers/7cff5b7f-6801-45ae-b6bd-5e062ce73b18 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:07:13.650627 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7fd0c7b9-d149-482e-8231-84f68fd3817d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:13.651162 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7fd0c7b9-d149-482e-8231-84f68fd3817d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: e630e2d9-52e2-4127-b6b5-9716df8f9a9c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:13.658805 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7fd0c7b9-d149-482e-8231-84f68fd3817d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:13.659262 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7fd0c7b9-d149-482e-8231-84f68fd3817d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:13.660192 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7fd0c7b9-d149-482e-8231-84f68fd3817d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:13.660687 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7fd0c7b9-d149-482e-8231-84f68fd3817d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:13.679667 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-7fd0c7b9-d149-482e-8231-84f68fd3817d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] HTTP exception thrown: Instance e630e2d9-52e2-4127-b6b5-9716df8f9a9c could not be found. Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7fd0c7b9-d149-482e-8231-84f68fd3817d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Request method failure captured: Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/servers/e630e2d9-52e2-4127-b6b5-9716df8f9a9c HTTP/1.1 Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGGM0_Rgon_QXChHIK_Ikyu0N9hux8u1Ms08jFhXlxkRDQgHGZCrxeBLJGVow3P3B7-C_d1lwOFEoVq18fpBt5bYVFsDOyFchFBnf15eYmBoM5W3iquFzY2ZI2UJK0DkPKTj0Fv6tDqgY5whthvLS8glHLsBu0Y3_K5TIG0-QwQVU5w Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 3495d9dc8b714809b2f3f777cbabda29 Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: exception: Instance e630e2d9-52e2-4127-b6b5-9716df8f9a9c could not be found. Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'e630e2d9-52e2-4127-b6b5-9716df8f9a9c'} Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e630e2d9-52e2-4127-b6b5-9716df8f9a9c could not be found. Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:07:13.681846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:07:13.686579 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e630e2d9-52e2-4127-b6b5-9716df8f9a9c could not be found. Jun 20 12:07:13.686579 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:13.686579 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:07:13.686579 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:13.686579 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:13.686579 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:07:13.686579 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:07:13.686579 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:07:13.686579 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:07:13.686579 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e630e2d9-52e2-4127-b6b5-9716df8f9a9c could not be found. Jun 20 12:07:13.686579 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:13.689803 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7fd0c7b9-d149-482e-8231-84f68fd3817d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Returning 404 to user: Instance e630e2d9-52e2-4127-b6b5-9716df8f9a9c could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:07:13.690851 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7fd0c7b9-d149-482e-8231-84f68fd3817d tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e630e2d9-52e2-4127-b6b5-9716df8f9a9c" status: 404 len: 111 microversion: 2.1 time: 0.045257 Jun 20 12:07:13.694753 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1144/2276] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:07:13 2022] DELETE /compute/v2.1/servers/e630e2d9-52e2-4127-b6b5-9716df8f9a9c => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:07:13.701464 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-76e62ac5-2208-4310-91ee-3afd869e0afe tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:13.702351 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-76e62ac5-2208-4310-91ee-3afd869e0afe tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: e630e2d9-52e2-4127-b6b5-9716df8f9a9c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:13.712323 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-76e62ac5-2208-4310-91ee-3afd869e0afe tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:13.712967 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-76e62ac5-2208-4310-91ee-3afd869e0afe tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:13.713957 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-76e62ac5-2208-4310-91ee-3afd869e0afe tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:13.714577 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-76e62ac5-2208-4310-91ee-3afd869e0afe tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:13.735689 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-76e62ac5-2208-4310-91ee-3afd869e0afe tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] HTTP exception thrown: Instance e630e2d9-52e2-4127-b6b5-9716df8f9a9c could not be found. Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-76e62ac5-2208-4310-91ee-3afd869e0afe tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Request method failure captured: Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/e630e2d9-52e2-4127-b6b5-9716df8f9a9c HTTP/1.1 Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGGM0_Rgon_QXChHIK_Ikyu0N9hux8u1Ms08jFhXlxkRDQgHGZCrxeBLJGVow3P3B7-C_d1lwOFEoVq18fpBt5bYVFsDOyFchFBnf15eYmBoM5W3iquFzY2ZI2UJK0DkPKTj0Fv6tDqgY5whthvLS8glHLsBu0Y3_K5TIG0-QwQVU5w Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 3495d9dc8b714809b2f3f777cbabda29 Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: exception: Instance e630e2d9-52e2-4127-b6b5-9716df8f9a9c could not be found. Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'e630e2d9-52e2-4127-b6b5-9716df8f9a9c'} Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e630e2d9-52e2-4127-b6b5-9716df8f9a9c could not be found. Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e630e2d9-52e2-4127-b6b5-9716df8f9a9c could not be found. Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:07:13.737290 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:13.742619 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:13.742619 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:07:13.742619 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:07:13.742619 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:07:13.742619 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:07:13.742619 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e630e2d9-52e2-4127-b6b5-9716df8f9a9c could not be found. Jun 20 12:07:13.742619 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:13.742619 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-76e62ac5-2208-4310-91ee-3afd869e0afe tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Returning 404 to user: Instance e630e2d9-52e2-4127-b6b5-9716df8f9a9c could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:07:13.742619 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-76e62ac5-2208-4310-91ee-3afd869e0afe tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/e630e2d9-52e2-4127-b6b5-9716df8f9a9c" status: 404 len: 111 microversion: 2.1 time: 0.042722 Jun 20 12:07:13.753784 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1145/2277] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:13 2022] GET /compute/v2.1/servers/e630e2d9-52e2-4127-b6b5-9716df8f9a9c => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:07:13.862607 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-75e2869d-f537-4b1a-81e5-3dc258fd44bf tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:13.870663 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-75e2869d-f537-4b1a-81e5-3dc258fd44bf tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: ed397d7b-8f66-46c9-b225-1cec5c844672] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:13.898161 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-75e2869d-f537-4b1a-81e5-3dc258fd44bf tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:13.899670 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-75e2869d-f537-4b1a-81e5-3dc258fd44bf tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:13.900598 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-75e2869d-f537-4b1a-81e5-3dc258fd44bf tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:13.901223 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-75e2869d-f537-4b1a-81e5-3dc258fd44bf tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:14.061252 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b683772a-9c2c-4936-9617-574d405f8551 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286e4b475bbc4d108ca00497ecd3e55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8c8766d4f143349b61f27d8f2566fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:14.071979 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b683772a-9c2c-4936-9617-574d405f8551 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/servers/838db96b-0c7a-4d7f-9807-44194bc73cff" status: 200 len: 1474 microversion: 2.1 time: 1.243944 Jun 20 12:07:14.074880 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1133/2278] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:12 2022] GET /compute/v2.1/servers/838db96b-0c7a-4d7f-9807-44194bc73cff => generated 1474 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:14.391580 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-75e2869d-f537-4b1a-81e5-3dc258fd44bf tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:14.448877 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-75e2869d-f537-4b1a-81e5-3dc258fd44bf tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672" status: 200 len: 1308 microversion: 2.1 time: 0.595794 Jun 20 12:07:14.451435 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1146/2279] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:13 2022] GET /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672 => generated 1308 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:14.614053 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1f822671-a750-490c-840c-38b38c212a9f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:14.625596 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1f822671-a750-490c-840c-38b38c212a9f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:14.657415 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f822671-a750-490c-840c-38b38c212a9f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:14.658060 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f822671-a750-490c-840c-38b38c212a9f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:14.661335 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f822671-a750-490c-840c-38b38c212a9f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:14.661999 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f822671-a750-490c-840c-38b38c212a9f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:15.105704 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-73b7c9ce-b15c-4575-9612-39eed784f616 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:15.106497 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-73b7c9ce-b15c-4575-9612-39eed784f616 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: 838db96b-0c7a-4d7f-9807-44194bc73cff] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:15.119134 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-73b7c9ce-b15c-4575-9612-39eed784f616 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:15.120153 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-73b7c9ce-b15c-4575-9612-39eed784f616 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:15.122278 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-73b7c9ce-b15c-4575-9612-39eed784f616 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:15.123165 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-73b7c9ce-b15c-4575-9612-39eed784f616 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:15.170899 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1f822671-a750-490c-840c-38b38c212a9f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:15.183382 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1f822671-a750-490c-840c-38b38c212a9f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 200 len: 1313 microversion: 2.1 time: 0.574532 Jun 20 12:07:15.184420 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1134/2280] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:14 2022] GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 1313 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:15.329643 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-19fc9276-73ab-493d-85b2-43bda55b90a3 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-413897227", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "c2bcaf29-2650-4e29-8ebc-39da1df0e1bf"}], "block_device_mapping_v2": [{"uuid": "87fc4f27-182b-4033-83ce-9385c6fe9c2d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:07:15.494547 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-19fc9276-73ab-493d-85b2-43bda55b90a3 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] validate_networks() for [('c2bcaf29-2650-4e29-8ebc-39da1df0e1bf', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:07:15.530087 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-73b7c9ce-b15c-4575-9612-39eed784f616 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286e4b475bbc4d108ca00497ecd3e55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8c8766d4f143349b61f27d8f2566fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:15.541965 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-73b7c9ce-b15c-4575-9612-39eed784f616 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/servers/838db96b-0c7a-4d7f-9807-44194bc73cff" status: 200 len: 1474 microversion: 2.1 time: 0.454190 Jun 20 12:07:15.543692 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1147/2281] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:15 2022] GET /compute/v2.1/servers/838db96b-0c7a-4d7f-9807-44194bc73cff => generated 1474 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:15.549332 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-2620ee21-2a3a-4142-b1c3-e9426e57d53b req-24f88581-a152-44d1-a303-2bc12b896556 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed397d7b-8f66-46c9-b225-1cec5c844672", "name": "network-vif-plugged", "status": "completed", "tag": "5c664946-8cfb-453b-81bf-a572f5c306af"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:07:15.559714 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-2620ee21-2a3a-4142-b1c3-e9426e57d53b req-24f88581-a152-44d1-a303-2bc12b896556 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:15.560629 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-2620ee21-2a3a-4142-b1c3-e9426e57d53b req-24f88581-a152-44d1-a303-2bc12b896556 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:15.576170 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-2620ee21-2a3a-4142-b1c3-e9426e57d53b req-24f88581-a152-44d1-a303-2bc12b896556 service nova] Creating event network-vif-plugged:5c664946-8cfb-453b-81bf-a572f5c306af for instance ed397d7b-8f66-46c9-b225-1cec5c844672 on n-h1-master-1 Jun 20 12:07:15.581656 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-2620ee21-2a3a-4142-b1c3-e9426e57d53b req-24f88581-a152-44d1-a303-2bc12b896556 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036342 Jun 20 12:07:15.582604 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1148/2282] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:07:15.590666 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0a3c205e-31cc-4182-82b8-9cfc5bc8c807 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:15.591673 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0a3c205e-31cc-4182-82b8-9cfc5bc8c807 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: ed397d7b-8f66-46c9-b225-1cec5c844672] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:15.600470 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a3c205e-31cc-4182-82b8-9cfc5bc8c807 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:15.601247 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a3c205e-31cc-4182-82b8-9cfc5bc8c807 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:15.603785 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a3c205e-31cc-4182-82b8-9cfc5bc8c807 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:15.604536 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a3c205e-31cc-4182-82b8-9cfc5bc8c807 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:15.999200 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0a3c205e-31cc-4182-82b8-9cfc5bc8c807 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:16.010866 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0a3c205e-31cc-4182-82b8-9cfc5bc8c807 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672" status: 200 len: 1308 microversion: 2.1 time: 0.426766 Jun 20 12:07:16.011728 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1149/2283] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:15 2022] GET /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672 => generated 1308 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:16.054352 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-cf91e21b-ccf9-4ddf-b419-29bc92f81f28 req-3c653110-e6d9-4908-8304-8c4a5e12b3a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "838db96b-0c7a-4d7f-9807-44194bc73cff", "name": "network-vif-deleted", "tag": "1e4f16ac-a73c-4854-8d0f-a050fb989db4"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:07:16.073787 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-cf91e21b-ccf9-4ddf-b419-29bc92f81f28 req-3c653110-e6d9-4908-8304-8c4a5e12b3a1 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:16.074149 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-cf91e21b-ccf9-4ddf-b419-29bc92f81f28 req-3c653110-e6d9-4908-8304-8c4a5e12b3a1 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:16.105718 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-cf91e21b-ccf9-4ddf-b419-29bc92f81f28 req-3c653110-e6d9-4908-8304-8c4a5e12b3a1 service nova] Creating event network-vif-deleted:1e4f16ac-a73c-4854-8d0f-a050fb989db4 for instance 838db96b-0c7a-4d7f-9807-44194bc73cff on n-h1-master-1 Jun 20 12:07:16.121499 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-cf91e21b-ccf9-4ddf-b419-29bc92f81f28 req-3c653110-e6d9-4908-8304-8c4a5e12b3a1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070827 Jun 20 12:07:16.122792 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1150/2284] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:07:16.210814 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-75711e3c-3e27-4cba-a75d-916aeff06811 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:16.211633 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-75711e3c-3e27-4cba-a75d-916aeff06811 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:16.221332 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:16.222915 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:16.226375 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-75711e3c-3e27-4cba-a75d-916aeff06811 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:16.229036 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-75711e3c-3e27-4cba-a75d-916aeff06811 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:16.230552 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-75711e3c-3e27-4cba-a75d-916aeff06811 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:16.231171 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-75711e3c-3e27-4cba-a75d-916aeff06811 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:16.578709 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-75711e3c-3e27-4cba-a75d-916aeff06811 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:16.588709 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-75711e3c-3e27-4cba-a75d-916aeff06811 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 200 len: 1313 microversion: 2.1 time: 0.382108 Jun 20 12:07:16.611577 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1151/2285] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:16 2022] GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 1313 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:07:16.623597 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a546f47c-32e1-4d46-9ab2-2658fc4f8704 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:16.624435 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a546f47c-32e1-4d46-9ab2-2658fc4f8704 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: 838db96b-0c7a-4d7f-9807-44194bc73cff] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:16.637624 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a546f47c-32e1-4d46-9ab2-2658fc4f8704 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:16.638075 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a546f47c-32e1-4d46-9ab2-2658fc4f8704 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:16.639329 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a546f47c-32e1-4d46-9ab2-2658fc4f8704 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:16.640098 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a546f47c-32e1-4d46-9ab2-2658fc4f8704 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:16.702493 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a546f47c-32e1-4d46-9ab2-2658fc4f8704 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:16.704356 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a546f47c-32e1-4d46-9ab2-2658fc4f8704 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:16.705392 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-a546f47c-32e1-4d46-9ab2-2658fc4f8704 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lazy-loading 'fault' on Instance uuid 838db96b-0c7a-4d7f-9807-44194bc73cff {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:07:16.757610 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a546f47c-32e1-4d46-9ab2-2658fc4f8704 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286e4b475bbc4d108ca00497ecd3e55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8c8766d4f143349b61f27d8f2566fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:16.775501 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a546f47c-32e1-4d46-9ab2-2658fc4f8704 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/servers/838db96b-0c7a-4d7f-9807-44194bc73cff" status: 200 len: 1308 microversion: 2.1 time: 0.162400 Jun 20 12:07:16.776805 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1152/2286] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:16 2022] GET /compute/v2.1/servers/838db96b-0c7a-4d7f-9807-44194bc73cff => generated 1308 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:17.029320 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-34508501-4a1d-4a91-ad1b-8085af4cdced tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:17.030714 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-34508501-4a1d-4a91-ad1b-8085af4cdced tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: ed397d7b-8f66-46c9-b225-1cec5c844672] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:17.049313 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-34508501-4a1d-4a91-ad1b-8085af4cdced tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:17.049805 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-34508501-4a1d-4a91-ad1b-8085af4cdced tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:17.050573 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-34508501-4a1d-4a91-ad1b-8085af4cdced tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:17.055928 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-34508501-4a1d-4a91-ad1b-8085af4cdced tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:17.601599 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-34508501-4a1d-4a91-ad1b-8085af4cdced tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:17.613556 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-34508501-4a1d-4a91-ad1b-8085af4cdced tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672" status: 200 len: 1308 microversion: 2.1 time: 0.589215 Jun 20 12:07:17.617053 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1153/2287] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:17 2022] GET /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672 => generated 1308 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:17.622340 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4746bd38-f7d0-4a3a-ba71-904792f34d56 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:17.628492 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4746bd38-f7d0-4a3a-ba71-904792f34d56 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:17.644688 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4746bd38-f7d0-4a3a-ba71-904792f34d56 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:17.645241 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4746bd38-f7d0-4a3a-ba71-904792f34d56 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:17.651700 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4746bd38-f7d0-4a3a-ba71-904792f34d56 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:17.652042 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4746bd38-f7d0-4a3a-ba71-904792f34d56 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:17.784181 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:17.988923 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4746bd38-f7d0-4a3a-ba71-904792f34d56 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:18.003794 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4746bd38-f7d0-4a3a-ba71-904792f34d56 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 200 len: 1313 microversion: 2.1 time: 0.381041 Jun 20 12:07:18.004522 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1154/2288] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:17 2022] GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:18.015509 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c83f811b-43e3-40ef-a317-68f511c1a6e1 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:18.016056 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c83f811b-43e3-40ef-a317-68f511c1a6e1 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] [instance: 838db96b-0c7a-4d7f-9807-44194bc73cff] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:18.030747 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c83f811b-43e3-40ef-a317-68f511c1a6e1 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:18.037151 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c83f811b-43e3-40ef-a317-68f511c1a6e1 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:18.038135 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c83f811b-43e3-40ef-a317-68f511c1a6e1 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:18.038591 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c83f811b-43e3-40ef-a317-68f511c1a6e1 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:18.080007 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-c83f811b-43e3-40ef-a317-68f511c1a6e1 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] HTTP exception thrown: Instance 838db96b-0c7a-4d7f-9807-44194bc73cff could not be found. Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c83f811b-43e3-40ef-a317-68f511c1a6e1 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Request method failure captured: Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/838db96b-0c7a-4d7f-9807-44194bc73cff HTTP/1.1 Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGI82dQCP_-l4p0MZjFr3RKwtkf63DJkGMRUoE9xEAk8gTkhK7ASEtOs6NVKUT9uJyGFnHy4eISNF5xj96q9-KhKLDlipNigAwbqc_XZEEOY3yR0CwY_8h7jcRZBuyr3VmwWQHZK2mzvhKrwAYs6fc7OfSQXm3KZkC9QYQQiBHphUp8 Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 3a8c8766d4f143349b61f27d8f2566fb Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ListImageFiltersTestJSON-1612527290 Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3a8c8766d4f143349b61f27d8f2566fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3a8c8766d4f143349b61f27d8f2566fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3a8c8766d4f143349b61f27d8f2566fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3a8c8766d4f143349b61f27d8f2566fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ListImageFiltersTestJSON-1612527290 Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 3a8c8766d4f143349b61f27d8f2566fb Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1612527290 Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ListImageFiltersTestJSON-1612527290-project Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 286e4b475bbc4d108ca00497ecd3e55a Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ListImageFiltersTestJSON-1612527290-project Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 838db96b-0c7a-4d7f-9807-44194bc73cff could not be found. Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '838db96b-0c7a-4d7f-9807-44194bc73cff'} Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 838db96b-0c7a-4d7f-9807-44194bc73cff could not be found. Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 838db96b-0c7a-4d7f-9807-44194bc73cff could not be found. Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:07:18.084255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:18.088805 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:18.088805 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:07:18.088805 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:07:18.088805 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:07:18.088805 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:07:18.088805 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 838db96b-0c7a-4d7f-9807-44194bc73cff could not be found. Jun 20 12:07:18.088805 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:18.088805 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c83f811b-43e3-40ef-a317-68f511c1a6e1 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Returning 404 to user: Instance 838db96b-0c7a-4d7f-9807-44194bc73cff could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:07:18.088805 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c83f811b-43e3-40ef-a317-68f511c1a6e1 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "GET /compute/v2.1/servers/838db96b-0c7a-4d7f-9807-44194bc73cff" status: 404 len: 111 microversion: 2.1 time: 0.080399 Jun 20 12:07:18.088805 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1155/2289] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:18 2022] GET /compute/v2.1/servers/838db96b-0c7a-4d7f-9807-44194bc73cff => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:07:18.114939 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-62c2a89f-8731-4abe-ab51-c6afecad8296 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f607318e5e0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:18.523437 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-19fc9276-73ab-493d-85b2-43bda55b90a3 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:07:18.525462 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-19fc9276-73ab-493d-85b2-43bda55b90a3 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:07:18.526178 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-19fc9276-73ab-493d-85b2-43bda55b90a3 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:07:18.526763 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-19fc9276-73ab-493d-85b2-43bda55b90a3 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:07:18.527359 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-19fc9276-73ab-493d-85b2-43bda55b90a3 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:07:18.548702 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-19fc9276-73ab-493d-85b2-43bda55b90a3 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:18.550013 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-19fc9276-73ab-493d-85b2-43bda55b90a3 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:18.552243 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-19fc9276-73ab-493d-85b2-43bda55b90a3 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:18.553606 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-19fc9276-73ab-493d-85b2-43bda55b90a3 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:18.581515 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-62c2a89f-8731-4abe-ab51-c6afecad8296 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "DELETE /compute/v2.1/images/0f92dbd3-7b57-4ed1-bae6-da74b57b9ce7" status: 204 len: 0 microversion: 2.1 time: 0.486015 Jun 20 12:07:18.585511 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1156/2290] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:18 2022] DELETE /compute/v2.1/images/0f92dbd3-7b57-4ed1-bae6-da74b57b9ce7 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:07:18.591300 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-65c9b59b-4c6d-4183-97d6-d649539b9337 req-2299978b-1126-4140-9230-973123c48e93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f55b114d-9a13-46f1-ac8c-c8279476cd3d", "tag": "70821ef2-9856-4c6f-b5f5-69d62c36c8b7"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:07:18.597812 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-19fc9276-73ab-493d-85b2-43bda55b90a3 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Getting quotas for project 5cf9c3f1d5c64a75b49099a15fe087ee. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:07:18.609536 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-19fc9276-73ab-493d-85b2-43bda55b90a3 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Getting quotas for user 3f16b216588946a790b42450b795ee00 and project 5cf9c3f1d5c64a75b49099a15fe087ee. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:07:18.628936 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-65c9b59b-4c6d-4183-97d6-d649539b9337 req-2299978b-1126-4140-9230-973123c48e93 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:18.630028 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-65c9b59b-4c6d-4183-97d6-d649539b9337 req-2299978b-1126-4140-9230-973123c48e93 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:18.662822 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-65c9b59b-4c6d-4183-97d6-d649539b9337 req-2299978b-1126-4140-9230-973123c48e93 service nova] Creating event network-changed:70821ef2-9856-4c6f-b5f5-69d62c36c8b7 for instance f55b114d-9a13-46f1-ac8c-c8279476cd3d on n-h1-master-1 Jun 20 12:07:18.685145 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-65c9b59b-4c6d-4183-97d6-d649539b9337 req-2299978b-1126-4140-9230-973123c48e93 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098292 Jun 20 12:07:18.690208 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1157/2291] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:07:18.702873 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5006bb53-0989-40c0-acc3-0ca8325a8b03 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f607318e550>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:19.319236 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5006bb53-0989-40c0-acc3-0ca8325a8b03 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "DELETE /compute/v2.1/images/eca6174d-0dbb-4733-b8da-463bc2da35a4" status: 204 len: 0 microversion: 2.1 time: 0.627789 Jun 20 12:07:19.319828 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1158/2292] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:18 2022] DELETE /compute/v2.1/images/eca6174d-0dbb-4733-b8da-463bc2da35a4 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:07:19.330159 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5f13cdbf-dffe-43de-9196-8fe915f4755c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:19.331258 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5f13cdbf-dffe-43de-9196-8fe915f4755c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: ed397d7b-8f66-46c9-b225-1cec5c844672] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:19.340532 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5f13cdbf-dffe-43de-9196-8fe915f4755c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:19.341405 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5f13cdbf-dffe-43de-9196-8fe915f4755c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:19.342949 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5f13cdbf-dffe-43de-9196-8fe915f4755c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:19.343859 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5f13cdbf-dffe-43de-9196-8fe915f4755c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:19.391308 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-19fc9276-73ab-493d-85b2-43bda55b90a3 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:07:19.394004 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-19fc9276-73ab-493d-85b2-43bda55b90a3 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='87fc4f27-182b-4033-83ce-9385c6fe9c2d',volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:07:19.833350 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-19fc9276-73ab-493d-85b2-43bda55b90a3 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.508616 Jun 20 12:07:19.837091 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1135/2293] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:07:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 4513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 12:07:20.001222 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3e355d45-2118-47ff-af70-6e70139839aa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2063178362", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "dadde73c-e8f7-441b-8503-8f17caea8651"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:07:20.127957 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-3e355d45-2118-47ff-af70-6e70139839aa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] validate_networks() for [('dadde73c-e8f7-441b-8503-8f17caea8651', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:07:20.509534 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5f13cdbf-dffe-43de-9196-8fe915f4755c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:20.523282 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5f13cdbf-dffe-43de-9196-8fe915f4755c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672" status: 200 len: 1488 microversion: 2.1 time: 1.199309 Jun 20 12:07:20.525553 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1159/2294] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:19 2022] GET /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672 => generated 1488 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:20.536914 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3572fd13-33ca-4c88-b382-6d3bea5dad1e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:20.541031 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3572fd13-33ca-4c88-b382-6d3bea5dad1e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:20.560128 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3572fd13-33ca-4c88-b382-6d3bea5dad1e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:20.561396 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3572fd13-33ca-4c88-b382-6d3bea5dad1e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:20.566349 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3572fd13-33ca-4c88-b382-6d3bea5dad1e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:20.569739 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3572fd13-33ca-4c88-b382-6d3bea5dad1e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:21.085505 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3572fd13-33ca-4c88-b382-6d3bea5dad1e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:21.152264 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3572fd13-33ca-4c88-b382-6d3bea5dad1e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 200 len: 1313 microversion: 2.1 time: 0.615721 Jun 20 12:07:21.162752 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1160/2295] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:20 2022] GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 1313 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:21.190132 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0e5f53d0-35a5-4aa7-b761-4103499e19a9 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] Calling method '.version_select at 0x7f60731b39d0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:21.520264 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-3e355d45-2118-47ff-af70-6e70139839aa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:07:21.520733 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-3e355d45-2118-47ff-af70-6e70139839aa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:07:21.521103 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-3e355d45-2118-47ff-af70-6e70139839aa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:07:21.521511 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-3e355d45-2118-47ff-af70-6e70139839aa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:07:21.522042 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-3e355d45-2118-47ff-af70-6e70139839aa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:07:21.543974 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e355d45-2118-47ff-af70-6e70139839aa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:21.544516 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e355d45-2118-47ff-af70-6e70139839aa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:21.545511 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e355d45-2118-47ff-af70-6e70139839aa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:21.546130 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e355d45-2118-47ff-af70-6e70139839aa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:21.598910 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-3e355d45-2118-47ff-af70-6e70139839aa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Getting quotas for project a68f0f3fd0f8415eae2b397f27fe12f7. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:07:21.611972 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-3e355d45-2118-47ff-af70-6e70139839aa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Getting quotas for user 719eacccdc9f4daea56644de31876572 and project a68f0f3fd0f8415eae2b397f27fe12f7. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:07:21.644343 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3e355d45-2118-47ff-af70-6e70139839aa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:07:21.646761 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3e355d45-2118-47ff-af70-6e70139839aa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:07:21.676073 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0e5f53d0-35a5-4aa7-b761-4103499e19a9 tempest-ListImageFiltersTestJSON-1612527290 tempest-ListImageFiltersTestJSON-1612527290-project] 10.222.0.27 "DELETE /compute/v2.1/images/c43fda91-93d0-46b5-910b-de0926d5caf1" status: 204 len: 0 microversion: 2.1 time: 0.516904 Jun 20 12:07:21.677265 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1161/2296] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:21 2022] DELETE /compute/v2.1/images/c43fda91-93d0-46b5-910b-de0926d5caf1 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:07:21.691434 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f70e2a84-b5af-4697-8bb6-2e53796051d9 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:21.700527 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f70e2a84-b5af-4697-8bb6-2e53796051d9 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: f678dc35-c774-4c0a-9ebb-579688adecb0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:21.740873 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f70e2a84-b5af-4697-8bb6-2e53796051d9 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:21.746119 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f70e2a84-b5af-4697-8bb6-2e53796051d9 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:21.748885 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f70e2a84-b5af-4697-8bb6-2e53796051d9 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:21.753220 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f70e2a84-b5af-4697-8bb6-2e53796051d9 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:21.826104 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-f70e2a84-b5af-4697-8bb6-2e53796051d9 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] HTTP exception thrown: Instance f678dc35-c774-4c0a-9ebb-579688adecb0 could not be found. Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f70e2a84-b5af-4697-8bb6-2e53796051d9 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Request method failure captured: Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0 HTTP/1.1 Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGGM0_Rgon_QXChHIK_Ikyu0N9hux8u1Ms08jFhXlxkRDQgHGZCrxeBLJGVow3P3B7-C_d1lwOFEoVq18fpBt5bYVFsDOyFchFBnf15eYmBoM5W3iquFzY2ZI2UJK0DkPKTj0Fv6tDqgY5whthvLS8glHLsBu0Y3_K5TIG0-QwQVU5w Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 3495d9dc8b714809b2f3f777cbabda29 Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: exception: Instance f678dc35-c774-4c0a-9ebb-579688adecb0 could not be found. Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'f678dc35-c774-4c0a-9ebb-579688adecb0'} Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f678dc35-c774-4c0a-9ebb-579688adecb0 could not be found. Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:07:21.838506 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:07:21.842065 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f678dc35-c774-4c0a-9ebb-579688adecb0 could not be found. Jun 20 12:07:21.842065 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:21.842065 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:07:21.842065 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:21.842065 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:21.842065 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:07:21.842065 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:07:21.842065 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:07:21.842065 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:07:21.842065 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f678dc35-c774-4c0a-9ebb-579688adecb0 could not be found. Jun 20 12:07:21.842065 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:21.845308 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f70e2a84-b5af-4697-8bb6-2e53796051d9 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Returning 404 to user: Instance f678dc35-c774-4c0a-9ebb-579688adecb0 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:07:21.845308 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f70e2a84-b5af-4697-8bb6-2e53796051d9 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0" status: 404 len: 111 microversion: 2.1 time: 0.165555 Jun 20 12:07:21.849966 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3e355d45-2118-47ff-af70-6e70139839aa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.011275 Jun 20 12:07:21.851085 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1162/2297] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:07:21 2022] DELETE /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0 => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:07:21.859506 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1136/2298] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:07:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2021 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:07:21.867598 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2c7b998f-8564-4c78-96f3-67fc5382efdf tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:21.868316 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2c7b998f-8564-4c78-96f3-67fc5382efdf tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:21.877559 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e3e0a2b1-1006-4145-8920-b76b8f662df2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:07:21.878123 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e3e0a2b1-1006-4145-8920-b76b8f662df2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: ed397d7b-8f66-46c9-b225-1cec5c844672] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:21.900333 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2c7b998f-8564-4c78-96f3-67fc5382efdf tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:21.911568 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e3e0a2b1-1006-4145-8920-b76b8f662df2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:21.912679 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e3e0a2b1-1006-4145-8920-b76b8f662df2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:21.913718 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e3e0a2b1-1006-4145-8920-b76b8f662df2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:21.914004 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e3e0a2b1-1006-4145-8920-b76b8f662df2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:21.918402 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2c7b998f-8564-4c78-96f3-67fc5382efdf tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:21.920052 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2c7b998f-8564-4c78-96f3-67fc5382efdf tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:21.925517 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2c7b998f-8564-4c78-96f3-67fc5382efdf tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:21.995048 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:22.113517 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-e3e0a2b1-1006-4145-8920-b76b8f662df2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lazy-loading 'flavor' on Instance uuid ed397d7b-8f66-46c9-b225-1cec5c844672 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:07:22.269279 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:22.322864 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e3e0a2b1-1006-4145-8920-b76b8f662df2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "POST /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672/action" status: 202 len: 0 microversion: 2.1 time: 0.456122 Jun 20 12:07:22.324434 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1137/2299] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:07:21 2022] POST /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672/action => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:07:22.338520 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e2703d02-9269-4fe4-86ca-609539b97948 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:22.341677 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e2703d02-9269-4fe4-86ca-609539b97948 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: f678dc35-c774-4c0a-9ebb-579688adecb0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:22.359332 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2703d02-9269-4fe4-86ca-609539b97948 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:22.360990 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2703d02-9269-4fe4-86ca-609539b97948 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:22.363114 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2703d02-9269-4fe4-86ca-609539b97948 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:22.364166 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2703d02-9269-4fe4-86ca-609539b97948 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:22.431156 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-e2703d02-9269-4fe4-86ca-609539b97948 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] HTTP exception thrown: Instance f678dc35-c774-4c0a-9ebb-579688adecb0 could not be found. Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e2703d02-9269-4fe4-86ca-609539b97948 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Request method failure captured: Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0 HTTP/1.1 Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGGM0_Rgon_QXChHIK_Ikyu0N9hux8u1Ms08jFhXlxkRDQgHGZCrxeBLJGVow3P3B7-C_d1lwOFEoVq18fpBt5bYVFsDOyFchFBnf15eYmBoM5W3iquFzY2ZI2UJK0DkPKTj0Fv6tDqgY5whthvLS8glHLsBu0Y3_K5TIG0-QwQVU5w Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 3495d9dc8b714809b2f3f777cbabda29 Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: exception: Instance f678dc35-c774-4c0a-9ebb-579688adecb0 could not be found. Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'f678dc35-c774-4c0a-9ebb-579688adecb0'} Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f678dc35-c774-4c0a-9ebb-579688adecb0 could not be found. Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f678dc35-c774-4c0a-9ebb-579688adecb0 could not be found. Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:07:22.434826 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:22.442669 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:22.442669 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:07:22.442669 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:07:22.442669 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:07:22.442669 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:07:22.442669 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f678dc35-c774-4c0a-9ebb-579688adecb0 could not be found. Jun 20 12:07:22.442669 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:22.449910 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e2703d02-9269-4fe4-86ca-609539b97948 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Returning 404 to user: Instance f678dc35-c774-4c0a-9ebb-579688adecb0 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:07:22.451819 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e2703d02-9269-4fe4-86ca-609539b97948 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0" status: 404 len: 111 microversion: 2.1 time: 0.123863 Jun 20 12:07:22.455749 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1138/2300] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:22 2022] GET /compute/v2.1/servers/f678dc35-c774-4c0a-9ebb-579688adecb0 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:07:22.487254 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-eac25449-deae-4f5b-802c-27b3457f232f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:22.490202 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-eac25449-deae-4f5b-802c-27b3457f232f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:22.578431 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2c7b998f-8564-4c78-96f3-67fc5382efdf tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:22.592822 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2c7b998f-8564-4c78-96f3-67fc5382efdf tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1158 microversion: 2.1 time: 0.740147 Jun 20 12:07:22.608453 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1163/2301] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:21 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1158 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:22.610826 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8aaf89d7-9757-4907-a4cd-14fe19aa6bc8 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:22.616921 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8aaf89d7-9757-4907-a4cd-14fe19aa6bc8 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:22.657390 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8aaf89d7-9757-4907-a4cd-14fe19aa6bc8 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:22.661982 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8aaf89d7-9757-4907-a4cd-14fe19aa6bc8 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:22.669010 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8aaf89d7-9757-4907-a4cd-14fe19aa6bc8 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:22.670123 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8aaf89d7-9757-4907-a4cd-14fe19aa6bc8 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:22.830890 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-eac25449-deae-4f5b-802c-27b3457f232f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:22.846973 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-eac25449-deae-4f5b-802c-27b3457f232f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1217 microversion: 2.1 time: 0.386953 Jun 20 12:07:22.852021 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1139/2302] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:22 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1217 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:22.857371 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c1a3374d-f5ff-42ed-baff-92a8eaf8b55d tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:22.859142 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c1a3374d-f5ff-42ed-baff-92a8eaf8b55d tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: ed397d7b-8f66-46c9-b225-1cec5c844672] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:22.865946 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c1a3374d-f5ff-42ed-baff-92a8eaf8b55d tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:22.866910 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c1a3374d-f5ff-42ed-baff-92a8eaf8b55d tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:22.868230 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c1a3374d-f5ff-42ed-baff-92a8eaf8b55d tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:22.870039 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c1a3374d-f5ff-42ed-baff-92a8eaf8b55d tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:23.422731 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c1a3374d-f5ff-42ed-baff-92a8eaf8b55d tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:23.439591 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c1a3374d-f5ff-42ed-baff-92a8eaf8b55d tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672" status: 200 len: 1496 microversion: 2.1 time: 0.585961 Jun 20 12:07:23.440662 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1140/2303] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:22 2022] GET /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672 => generated 1496 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:23.451194 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e1f99656-c799-48dd-bb50-7751ad885d96 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:23.451707 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e1f99656-c799-48dd-bb50-7751ad885d96 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 0c2f393e-08cc-4112-a898-0ef1830570d9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:23.472307 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1f99656-c799-48dd-bb50-7751ad885d96 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:23.473165 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1f99656-c799-48dd-bb50-7751ad885d96 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:23.474182 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1f99656-c799-48dd-bb50-7751ad885d96 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:23.474775 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1f99656-c799-48dd-bb50-7751ad885d96 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:23.539140 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-e1f99656-c799-48dd-bb50-7751ad885d96 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] HTTP exception thrown: Instance 0c2f393e-08cc-4112-a898-0ef1830570d9 could not be found. Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e1f99656-c799-48dd-bb50-7751ad885d96 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Request method failure captured: Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9 HTTP/1.1 Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGGM0_Rgon_QXChHIK_Ikyu0N9hux8u1Ms08jFhXlxkRDQgHGZCrxeBLJGVow3P3B7-C_d1lwOFEoVq18fpBt5bYVFsDOyFchFBnf15eYmBoM5W3iquFzY2ZI2UJK0DkPKTj0Fv6tDqgY5whthvLS8glHLsBu0Y3_K5TIG0-QwQVU5w Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 3495d9dc8b714809b2f3f777cbabda29 Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 0c2f393e-08cc-4112-a898-0ef1830570d9 could not be found. Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '0c2f393e-08cc-4112-a898-0ef1830570d9'} Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c2f393e-08cc-4112-a898-0ef1830570d9 could not be found. Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:07:23.541927 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:07:23.550175 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c2f393e-08cc-4112-a898-0ef1830570d9 could not be found. Jun 20 12:07:23.550175 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:23.550175 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:07:23.550175 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:23.550175 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:23.550175 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:07:23.550175 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:07:23.550175 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:07:23.550175 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:07:23.550175 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c2f393e-08cc-4112-a898-0ef1830570d9 could not be found. Jun 20 12:07:23.550175 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:23.550175 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e1f99656-c799-48dd-bb50-7751ad885d96 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Returning 404 to user: Instance 0c2f393e-08cc-4112-a898-0ef1830570d9 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:07:23.561108 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e1f99656-c799-48dd-bb50-7751ad885d96 tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9" status: 404 len: 111 microversion: 2.1 time: 0.102644 Jun 20 12:07:23.562166 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1141/2304] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:07:23 2022] DELETE /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:07:23.584741 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e1b80892-471d-43e0-b497-fb33ca0e288a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:23.588540 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e1b80892-471d-43e0-b497-fb33ca0e288a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] [instance: 0c2f393e-08cc-4112-a898-0ef1830570d9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:23.604984 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1b80892-471d-43e0-b497-fb33ca0e288a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:23.605615 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1b80892-471d-43e0-b497-fb33ca0e288a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:23.607209 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1b80892-471d-43e0-b497-fb33ca0e288a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:23.608968 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1b80892-471d-43e0-b497-fb33ca0e288a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:23.626550 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8aaf89d7-9757-4907-a4cd-14fe19aa6bc8 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:23.645406 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8aaf89d7-9757-4907-a4cd-14fe19aa6bc8 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 200 len: 1313 microversion: 2.1 time: 1.038523 Jun 20 12:07:23.648860 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1164/2305] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:22 2022] GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 1313 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:23.674117 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ab282d7a-16da-45bc-92f9-f9358d467321 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:23.676553 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ab282d7a-16da-45bc-92f9-f9358d467321 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:23.696167 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ab282d7a-16da-45bc-92f9-f9358d467321 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:23.696790 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ab282d7a-16da-45bc-92f9-f9358d467321 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:23.698315 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-e1b80892-471d-43e0-b497-fb33ca0e288a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] HTTP exception thrown: Instance 0c2f393e-08cc-4112-a898-0ef1830570d9 could not be found. Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e1b80892-471d-43e0-b497-fb33ca0e288a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Request method failure captured: Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9 HTTP/1.1 Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGGM0_Rgon_QXChHIK_Ikyu0N9hux8u1Ms08jFhXlxkRDQgHGZCrxeBLJGVow3P3B7-C_d1lwOFEoVq18fpBt5bYVFsDOyFchFBnf15eYmBoM5W3iquFzY2ZI2UJK0DkPKTj0Fv6tDqgY5whthvLS8glHLsBu0Y3_K5TIG0-QwQVU5w Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7dbe3d6c4b7a41fa8181a805a992c173"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 7dbe3d6c4b7a41fa8181a805a992c173 Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-DeleteServersTestJSON-1452664016 Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 3495d9dc8b714809b2f3f777cbabda29 Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-DeleteServersTestJSON-1452664016-project Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 0c2f393e-08cc-4112-a898-0ef1830570d9 could not be found. Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '0c2f393e-08cc-4112-a898-0ef1830570d9'} Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c2f393e-08cc-4112-a898-0ef1830570d9 could not be found. Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c2f393e-08cc-4112-a898-0ef1830570d9 could not be found. Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:07:23.700130 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:23.705530 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:23.705530 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:07:23.705530 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:07:23.705530 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:07:23.705530 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:07:23.705530 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c2f393e-08cc-4112-a898-0ef1830570d9 could not be found. Jun 20 12:07:23.705530 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:23.706125 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ab282d7a-16da-45bc-92f9-f9358d467321 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:23.706125 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ab282d7a-16da-45bc-92f9-f9358d467321 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:23.706302 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e1b80892-471d-43e0-b497-fb33ca0e288a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] Returning 404 to user: Instance 0c2f393e-08cc-4112-a898-0ef1830570d9 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:07:23.706302 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e1b80892-471d-43e0-b497-fb33ca0e288a tempest-DeleteServersTestJSON-1452664016 tempest-DeleteServersTestJSON-1452664016-project] 10.222.0.27 "GET /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9" status: 404 len: 111 microversion: 2.1 time: 0.131643 Jun 20 12:07:23.707442 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1142/2306] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:23 2022] GET /compute/v2.1/servers/0c2f393e-08cc-4112-a898-0ef1830570d9 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:07:23.821448 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ab282d7a-16da-45bc-92f9-f9358d467321 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:23.838127 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ab282d7a-16da-45bc-92f9-f9358d467321 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1168 microversion: 2.1 time: 0.185108 Jun 20 12:07:23.850561 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1165/2307] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:23 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1168 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:23.890916 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2b9a3244-5db7-4453-9830-08db7e3400cd tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:23.895292 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2b9a3244-5db7-4453-9830-08db7e3400cd tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:23.925095 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2b9a3244-5db7-4453-9830-08db7e3400cd tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:23.928544 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2b9a3244-5db7-4453-9830-08db7e3400cd tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:23.929959 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2b9a3244-5db7-4453-9830-08db7e3400cd tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:23.933733 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2b9a3244-5db7-4453-9830-08db7e3400cd tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:24.365074 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2b9a3244-5db7-4453-9830-08db7e3400cd tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:24.384436 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2b9a3244-5db7-4453-9830-08db7e3400cd tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1269 microversion: 2.1 time: 0.521510 Jun 20 12:07:24.385294 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1143/2308] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:23 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1269 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:24.457608 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-99d277e5-8b97-4f47-b777-97486b7e19ee tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:24.458595 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-99d277e5-8b97-4f47-b777-97486b7e19ee tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: ed397d7b-8f66-46c9-b225-1cec5c844672] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:24.468503 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-99d277e5-8b97-4f47-b777-97486b7e19ee tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:24.469347 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-99d277e5-8b97-4f47-b777-97486b7e19ee tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:24.470915 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-99d277e5-8b97-4f47-b777-97486b7e19ee tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:24.473022 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-99d277e5-8b97-4f47-b777-97486b7e19ee tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:24.664875 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-985584ee-d429-435c-bee5-da4aa324bc6b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:24.666250 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-985584ee-d429-435c-bee5-da4aa324bc6b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:24.683322 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-985584ee-d429-435c-bee5-da4aa324bc6b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:24.684071 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-985584ee-d429-435c-bee5-da4aa324bc6b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:24.685139 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-985584ee-d429-435c-bee5-da4aa324bc6b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:24.685791 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-985584ee-d429-435c-bee5-da4aa324bc6b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:25.208087 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-99d277e5-8b97-4f47-b777-97486b7e19ee tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:25.225915 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-99d277e5-8b97-4f47-b777-97486b7e19ee tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672" status: 200 len: 1479 microversion: 2.1 time: 0.770243 Jun 20 12:07:25.236998 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1166/2309] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:24 2022] GET /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672 => generated 1479 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:25.253530 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c24698c8-53c9-4ee0-bb14-dee9baee717f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:25.254538 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c24698c8-53c9-4ee0-bb14-dee9baee717f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:25.272478 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c24698c8-53c9-4ee0-bb14-dee9baee717f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:25.273000 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c24698c8-53c9-4ee0-bb14-dee9baee717f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:25.275603 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c24698c8-53c9-4ee0-bb14-dee9baee717f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:25.278282 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c24698c8-53c9-4ee0-bb14-dee9baee717f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:25.971354 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-985584ee-d429-435c-bee5-da4aa324bc6b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:25.981618 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-985584ee-d429-435c-bee5-da4aa324bc6b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 200 len: 1313 microversion: 2.1 time: 1.320794 Jun 20 12:07:25.982224 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1144/2310] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:24 2022] GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 1313 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:07:25.990397 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d45ecc52-b84e-4286-8dda-8af7ec4c00b6 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-451998457"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:07:26.010755 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d45ecc52-b84e-4286-8dda-8af7ec4c00b6 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: ed397d7b-8f66-46c9-b225-1cec5c844672] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:26.028566 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d45ecc52-b84e-4286-8dda-8af7ec4c00b6 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:26.029030 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d45ecc52-b84e-4286-8dda-8af7ec4c00b6 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:26.029832 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d45ecc52-b84e-4286-8dda-8af7ec4c00b6 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:26.030276 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d45ecc52-b84e-4286-8dda-8af7ec4c00b6 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:26.240571 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c24698c8-53c9-4ee0-bb14-dee9baee717f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:26.253650 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c24698c8-53c9-4ee0-bb14-dee9baee717f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1210 microversion: 2.1 time: 1.015092 Jun 20 12:07:26.273455 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1167/2311] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:25 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1210 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:26.290496 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-60508d37-91fd-4fe8-8cdc-63d88169875e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:26.296408 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-60508d37-91fd-4fe8-8cdc-63d88169875e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:26.324431 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-60508d37-91fd-4fe8-8cdc-63d88169875e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:26.327138 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-60508d37-91fd-4fe8-8cdc-63d88169875e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:26.328640 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-60508d37-91fd-4fe8-8cdc-63d88169875e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:26.329330 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-60508d37-91fd-4fe8-8cdc-63d88169875e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:26.848400 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d45ecc52-b84e-4286-8dda-8af7ec4c00b6 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "POST /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672/action" status: 202 len: 0 microversion: 2.1 time: 0.859660 Jun 20 12:07:26.849703 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1145/2312] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:07:25 2022] POST /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672/action => generated 0 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 20 12:07:26.899084 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-60508d37-91fd-4fe8-8cdc-63d88169875e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:26.913708 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-60508d37-91fd-4fe8-8cdc-63d88169875e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1317 microversion: 2.1 time: 0.636806 Jun 20 12:07:26.915330 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1168/2313] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:26 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1317 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:26.927824 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e65afef4-32b7-4402-b6f3-be8c5d7a2c18 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f6073bc8f70>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:27.078544 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e65afef4-32b7-4402-b6f3-be8c5d7a2c18 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891" status: 200 len: 1437 microversion: 2.1 time: 0.158185 Jun 20 12:07:27.083711 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1169/2314] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:07:26 2022] GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891 => generated 1437 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:27.100277 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-37443796-92d4-4f59-b75f-dda3e2fe504e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:27.105985 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-37443796-92d4-4f59-b75f-dda3e2fe504e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:27.131789 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-37443796-92d4-4f59-b75f-dda3e2fe504e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:27.137965 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-37443796-92d4-4f59-b75f-dda3e2fe504e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:27.140833 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-37443796-92d4-4f59-b75f-dda3e2fe504e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:27.141303 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-37443796-92d4-4f59-b75f-dda3e2fe504e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:27.254965 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cab7fb7f-f9f5-4b0a-9810-c89ab4822942 tempest-ListImagesTestJSON-577943442 tempest-ListImagesTestJSON-577943442-project] Calling method '.version_select at 0x7f6073bc2280>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:27.329844 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cab7fb7f-f9f5-4b0a-9810-c89ab4822942 tempest-ListImagesTestJSON-577943442 tempest-ListImagesTestJSON-577943442-project] 10.222.0.27 "GET /compute/v2.1/images/f16836cc-4e18-4bd0-b261-3865adf8cb83" status: 200 len: 784 microversion: 2.1 time: 0.476337 Jun 20 12:07:27.339905 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1146/2315] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:07:26 2022] GET /compute/v2.1/images/f16836cc-4e18-4bd0-b261-3865adf8cb83 => generated 784 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:07:27.354600 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b5587053-8897-40a9-823c-b9e3989a45c2 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:27.355682 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b5587053-8897-40a9-823c-b9e3989a45c2 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:27.376724 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5587053-8897-40a9-823c-b9e3989a45c2 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:27.378905 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5587053-8897-40a9-823c-b9e3989a45c2 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:27.380344 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5587053-8897-40a9-823c-b9e3989a45c2 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:27.380826 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5587053-8897-40a9-823c-b9e3989a45c2 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:27.413492 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-b5587053-8897-40a9-823c-b9e3989a45c2 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] HTTP exception thrown: Instance f59e801d-2548-4edc-8283-af47c991d92a could not be found. Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b5587053-8897-40a9-823c-b9e3989a45c2 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Request method failure captured: Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a HTTP/1.1 Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGE6zFYTiZT5lv0Twz6C9utmbrcmbHIzdc1k979dfXCUqj0kaCyMbQ0xHPTdx3mKxMNiS16Zzi_zksOx_jMJP-amCpWPBFqu_V4TayC7sCfVvfrqvYJuKkj5I3iuUNy-dHrHNQ6Hc5lbJMe_yZb4uueecwdWsdl3AuMjUXTI8b8kRhE Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: X-Openstack-Nova-Api-Version: 2.42 Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: d0f00ab2137741e781c812172c3642b3 Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-749766312 Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0f00ab2137741e781c812172c3642b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0f00ab2137741e781c812172c3642b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d0f00ab2137741e781c812172c3642b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d0f00ab2137741e781c812172c3642b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-TaggedBootDevicesTest_v242-749766312 Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: d0f00ab2137741e781c812172c3642b3 Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-749766312 Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-TaggedBootDevicesTest_v242-749766312-project Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: e233a90ea23c44468b93a9316739f642 Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-TaggedBootDevicesTest_v242-749766312-project Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: exception: Instance f59e801d-2548-4edc-8283-af47c991d92a could not be found. Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'f59e801d-2548-4edc-8283-af47c991d92a'} Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f59e801d-2548-4edc-8283-af47c991d92a could not be found. Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:07:27.417820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:07:27.425164 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f59e801d-2548-4edc-8283-af47c991d92a could not be found. Jun 20 12:07:27.425164 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:27.425164 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:07:27.425164 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:27.425164 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:27.425164 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:07:27.425164 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:07:27.425164 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:07:27.425164 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:07:27.425164 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f59e801d-2548-4edc-8283-af47c991d92a could not be found. Jun 20 12:07:27.425164 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:07:27.425164 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b5587053-8897-40a9-823c-b9e3989a45c2 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Returning 404 to user: Instance f59e801d-2548-4edc-8283-af47c991d92a could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:07:27.425164 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b5587053-8897-40a9-823c-b9e3989a45c2 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 404 len: 111 microversion: 2.42 time: 0.079567 Jun 20 12:07:27.425164 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1147/2316] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Jun 20 12:07:27 2022] DELETE /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:07:27.433632 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fa542535-1807-4cc9-bbfd-a06c76a22f8f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:27.434278 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fa542535-1807-4cc9-bbfd-a06c76a22f8f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:27.457797 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fa542535-1807-4cc9-bbfd-a06c76a22f8f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:27.458273 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fa542535-1807-4cc9-bbfd-a06c76a22f8f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:27.459091 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fa542535-1807-4cc9-bbfd-a06c76a22f8f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:27.459538 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fa542535-1807-4cc9-bbfd-a06c76a22f8f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:27.785838 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-37443796-92d4-4f59-b75f-dda3e2fe504e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:27.802914 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-37443796-92d4-4f59-b75f-dda3e2fe504e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 200 len: 1313 microversion: 2.1 time: 0.717499 Jun 20 12:07:27.803539 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1170/2317] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:27 2022] GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 1313 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:27.833834 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-304d20e4-787f-48d3-9c26-1f6bc80a43c0 tempest-ListImagesTestJSON-577943442 tempest-ListImagesTestJSON-577943442-project] Calling method '.version_select at 0x7f60731fbaf0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:27.939917 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-304d20e4-787f-48d3-9c26-1f6bc80a43c0 tempest-ListImagesTestJSON-577943442 tempest-ListImagesTestJSON-577943442-project] 10.222.0.27 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.118002 Jun 20 12:07:27.950032 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1171/2318] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jun 20 12:07:27 2022] GET /compute/v2.1/images => generated 445 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:07:27.956149 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-46bdc162-ae4d-4ad5-8e9c-665935413993 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:27.956997 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-46bdc162-ae4d-4ad5-8e9c-665935413993 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] [instance: f59e801d-2548-4edc-8283-af47c991d92a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:27.978562 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-46bdc162-ae4d-4ad5-8e9c-665935413993 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:27.979728 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-46bdc162-ae4d-4ad5-8e9c-665935413993 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:27.982502 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-46bdc162-ae4d-4ad5-8e9c-665935413993 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:27.984363 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-46bdc162-ae4d-4ad5-8e9c-665935413993 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:28.024822 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-46bdc162-ae4d-4ad5-8e9c-665935413993 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] HTTP exception thrown: Instance f59e801d-2548-4edc-8283-af47c991d92a could not be found. Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-46bdc162-ae4d-4ad5-8e9c-665935413993 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Request method failure captured: Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a HTTP/1.1 Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGE6zFYTiZT5lv0Twz6C9utmbrcmbHIzdc1k979dfXCUqj0kaCyMbQ0xHPTdx3mKxMNiS16Zzi_zksOx_jMJP-amCpWPBFqu_V4TayC7sCfVvfrqvYJuKkj5I3iuUNy-dHrHNQ6Hc5lbJMe_yZb4uueecwdWsdl3AuMjUXTI8b8kRhE Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: X-Openstack-Nova-Api-Version: 2.42 Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: d0f00ab2137741e781c812172c3642b3 Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-749766312 Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0f00ab2137741e781c812172c3642b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0f00ab2137741e781c812172c3642b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d0f00ab2137741e781c812172c3642b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d0f00ab2137741e781c812172c3642b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-TaggedBootDevicesTest_v242-749766312 Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: d0f00ab2137741e781c812172c3642b3 Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-749766312 Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-TaggedBootDevicesTest_v242-749766312-project Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: e233a90ea23c44468b93a9316739f642 Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-TaggedBootDevicesTest_v242-749766312-project Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: exception: Instance f59e801d-2548-4edc-8283-af47c991d92a could not be found. Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'f59e801d-2548-4edc-8283-af47c991d92a'} Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f59e801d-2548-4edc-8283-af47c991d92a could not be found. Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f59e801d-2548-4edc-8283-af47c991d92a could not be found. Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:28.026960 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:07:28.034950 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:28.034950 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:07:28.034950 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:07:28.034950 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:07:28.034950 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:07:28.034950 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:07:28.034950 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f59e801d-2548-4edc-8283-af47c991d92a could not be found. Jun 20 12:07:28.034950 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:07:28.037599 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-46bdc162-ae4d-4ad5-8e9c-665935413993 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] Returning 404 to user: Instance f59e801d-2548-4edc-8283-af47c991d92a could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:07:28.041100 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-46bdc162-ae4d-4ad5-8e9c-665935413993 tempest-TaggedBootDevicesTest_v242-749766312 tempest-TaggedBootDevicesTest_v242-749766312-project] 10.222.0.27 "GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a" status: 404 len: 111 microversion: 2.42 time: 0.087652 Jun 20 12:07:28.043063 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1172/2319] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:07:27 2022] GET /compute/v2.1/servers/f59e801d-2548-4edc-8283-af47c991d92a => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:07:28.066072 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-80668919-4393-49b0-bcb3-714b6a517d13 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:28.066807 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-80668919-4393-49b0-bcb3-714b6a517d13 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:28.087350 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80668919-4393-49b0-bcb3-714b6a517d13 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:28.087350 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80668919-4393-49b0-bcb3-714b6a517d13 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:28.087350 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80668919-4393-49b0-bcb3-714b6a517d13 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:28.089813 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80668919-4393-49b0-bcb3-714b6a517d13 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:28.593929 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-80668919-4393-49b0-bcb3-714b6a517d13 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:28.606422 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-80668919-4393-49b0-bcb3-714b6a517d13 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1317 microversion: 2.1 time: 0.554997 Jun 20 12:07:28.607407 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1173/2320] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:28 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1317 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:28.614884 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-614ef979-a4c7-4570-9ad9-499ea732bdfa tempest-ListImagesTestJSON-577943442 tempest-ListImagesTestJSON-577943442-project] Calling method '.version_select at 0x7f60849cff70>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:28.691424 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-614ef979-a4c7-4570-9ad9-499ea732bdfa tempest-ListImagesTestJSON-577943442 tempest-ListImagesTestJSON-577943442-project] 10.222.0.27 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.082699 Jun 20 12:07:28.692172 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1174/2321] 10.222.0.27 () {58 vars in 1142 bytes} [Mon Jun 20 12:07:28 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:07:28.705255 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fa542535-1807-4cc9-bbfd-a06c76a22f8f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:28.708496 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8413f1e8-a4e4-4e41-8cc9-39366ed04bfd tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f6073193550>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:28.733193 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fa542535-1807-4cc9-bbfd-a06c76a22f8f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1210 microversion: 2.1 time: 1.307299 Jun 20 12:07:28.737081 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1148/2322] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:27 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1210 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:28.753766 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-15bb4582-d307-444b-bd18-f5394270f50d req-043cd08e-7cbd-46bd-bc12-19d4542e9057 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f55b114d-9a13-46f1-ac8c-c8279476cd3d", "name": "network-vif-plugged", "status": "completed", "tag": "70821ef2-9856-4c6f-b5f5-69d62c36c8b7"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:07:28.780530 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-15bb4582-d307-444b-bd18-f5394270f50d req-043cd08e-7cbd-46bd-bc12-19d4542e9057 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:28.781385 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-15bb4582-d307-444b-bd18-f5394270f50d req-043cd08e-7cbd-46bd-bc12-19d4542e9057 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:28.788537 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8413f1e8-a4e4-4e41-8cc9-39366ed04bfd tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891" status: 200 len: 1437 microversion: 2.1 time: 0.095036 Jun 20 12:07:28.789209 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1175/2323] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:07:28 2022] GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891 => generated 1437 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:28.819592 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-15bb4582-d307-444b-bd18-f5394270f50d req-043cd08e-7cbd-46bd-bc12-19d4542e9057 service nova] Creating event network-vif-plugged:70821ef2-9856-4c6f-b5f5-69d62c36c8b7 for instance f55b114d-9a13-46f1-ac8c-c8279476cd3d on n-h1-master-1 Jun 20 12:07:28.825998 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-691e71a9-5f8f-4e7e-8e2b-8f947a7f4b1e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:28.826796 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-691e71a9-5f8f-4e7e-8e2b-8f947a7f4b1e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:28.834282 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-15bb4582-d307-444b-bd18-f5394270f50d req-043cd08e-7cbd-46bd-bc12-19d4542e9057 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093017 Jun 20 12:07:28.835209 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1149/2324] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:07:28.838109 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-691e71a9-5f8f-4e7e-8e2b-8f947a7f4b1e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:28.846251 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-691e71a9-5f8f-4e7e-8e2b-8f947a7f4b1e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:28.847826 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-691e71a9-5f8f-4e7e-8e2b-8f947a7f4b1e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:28.848571 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-691e71a9-5f8f-4e7e-8e2b-8f947a7f4b1e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:29.242264 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-bbd0363f-e04e-4d41-be0a-954d2de677f7 req-bb242032-e259-47cb-ae6a-288a6cde7b81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "593cda12-6491-4a27-8fc7-42c05e0291c3", "tag": "2a9eb762-96f9-45b2-8446-311d784377f5"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:07:29.264141 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-bbd0363f-e04e-4d41-be0a-954d2de677f7 req-bb242032-e259-47cb-ae6a-288a6cde7b81 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:29.265946 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-bbd0363f-e04e-4d41-be0a-954d2de677f7 req-bb242032-e259-47cb-ae6a-288a6cde7b81 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:29.310252 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-bbd0363f-e04e-4d41-be0a-954d2de677f7 req-bb242032-e259-47cb-ae6a-288a6cde7b81 service nova] Creating event network-changed:2a9eb762-96f9-45b2-8446-311d784377f5 for instance 593cda12-6491-4a27-8fc7-42c05e0291c3 on n-h2-master-1 Jun 20 12:07:29.336060 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-bbd0363f-e04e-4d41-be0a-954d2de677f7 req-bb242032-e259-47cb-ae6a-288a6cde7b81 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112912 Jun 20 12:07:29.341338 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1150/2325] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:07:29.468059 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-691e71a9-5f8f-4e7e-8e2b-8f947a7f4b1e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:29.489099 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-691e71a9-5f8f-4e7e-8e2b-8f947a7f4b1e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 200 len: 1313 microversion: 2.1 time: 0.667010 Jun 20 12:07:29.501968 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1176/2326] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:28 2022] GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 1313 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:07:29.636913 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-da12baa3-fb84-4ccd-aca4-2a53e1b053f6 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:29.642086 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-da12baa3-fb84-4ccd-aca4-2a53e1b053f6 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:29.652162 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da12baa3-fb84-4ccd-aca4-2a53e1b053f6 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:29.652882 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da12baa3-fb84-4ccd-aca4-2a53e1b053f6 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:29.653880 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da12baa3-fb84-4ccd-aca4-2a53e1b053f6 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:29.654488 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da12baa3-fb84-4ccd-aca4-2a53e1b053f6 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:29.759200 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-11bca59d-8ed0-4060-80c1-e0a053928481 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:29.760338 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-11bca59d-8ed0-4060-80c1-e0a053928481 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:29.781899 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-11bca59d-8ed0-4060-80c1-e0a053928481 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:29.785526 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-11bca59d-8ed0-4060-80c1-e0a053928481 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:29.791893 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-11bca59d-8ed0-4060-80c1-e0a053928481 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:29.794077 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-11bca59d-8ed0-4060-80c1-e0a053928481 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:30.361277 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-da12baa3-fb84-4ccd-aca4-2a53e1b053f6 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:30.376543 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-da12baa3-fb84-4ccd-aca4-2a53e1b053f6 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1317 microversion: 2.1 time: 0.754665 Jun 20 12:07:30.391498 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1151/2327] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:29 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1317 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:30.397306 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5e2bf039-769f-47ca-9d55-d9f267b0e9b0 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f60732bc940>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:30.497207 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-11bca59d-8ed0-4060-80c1-e0a053928481 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:30.528710 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-11bca59d-8ed0-4060-80c1-e0a053928481 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1210 microversion: 2.1 time: 0.777247 Jun 20 12:07:30.536619 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1177/2328] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:29 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1210 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:30.545025 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-907321bf-c1cd-4a23-b873-2494279f466d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:30.546334 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-907321bf-c1cd-4a23-b873-2494279f466d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:30.567042 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-907321bf-c1cd-4a23-b873-2494279f466d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:30.571692 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-907321bf-c1cd-4a23-b873-2494279f466d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:30.576960 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5e2bf039-769f-47ca-9d55-d9f267b0e9b0 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891" status: 200 len: 1437 microversion: 2.1 time: 0.183184 Jun 20 12:07:30.578096 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-907321bf-c1cd-4a23-b873-2494279f466d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:30.579694 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1152/2329] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:07:30 2022] GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891 => generated 1437 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:30.581177 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-907321bf-c1cd-4a23-b873-2494279f466d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:30.919391 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-06f54782-4a7d-48e3-9fde-df75f7d654ef req-e19712ae-0ac6-4099-8555-3564baad768f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de7fc47c-e28f-4697-bbf9-df8390dfd998", "tag": "5925f2d5-cbe4-4efe-9aa1-8f5c5ba93a44"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:07:30.981597 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-06f54782-4a7d-48e3-9fde-df75f7d654ef req-e19712ae-0ac6-4099-8555-3564baad768f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:30.982786 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-06f54782-4a7d-48e3-9fde-df75f7d654ef req-e19712ae-0ac6-4099-8555-3564baad768f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:31.030634 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-06f54782-4a7d-48e3-9fde-df75f7d654ef req-e19712ae-0ac6-4099-8555-3564baad768f service nova] Creating event network-changed:5925f2d5-cbe4-4efe-9aa1-8f5c5ba93a44 for instance de7fc47c-e28f-4697-bbf9-df8390dfd998 on n-h2-master-1 Jun 20 12:07:31.042190 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-06f54782-4a7d-48e3-9fde-df75f7d654ef req-e19712ae-0ac6-4099-8555-3564baad768f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138802 Jun 20 12:07:31.043382 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1153/2330] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:07:31.380551 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-907321bf-c1cd-4a23-b873-2494279f466d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:31.400910 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8cfc1870-c28e-4916-ac1f-3212e8e2b663 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:31.401678 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8cfc1870-c28e-4916-ac1f-3212e8e2b663 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:31.419678 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-907321bf-c1cd-4a23-b873-2494279f466d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 200 len: 1313 microversion: 2.1 time: 0.881508 Jun 20 12:07:31.426121 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1178/2331] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:30 2022] GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 1313 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:31.458316 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8cfc1870-c28e-4916-ac1f-3212e8e2b663 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:31.467235 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8cfc1870-c28e-4916-ac1f-3212e8e2b663 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:31.470743 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8cfc1870-c28e-4916-ac1f-3212e8e2b663 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:31.471339 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8cfc1870-c28e-4916-ac1f-3212e8e2b663 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:31.558400 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5acbbc38-55bd-4503-9810-11168a16d88b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:31.559288 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5acbbc38-55bd-4503-9810-11168a16d88b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:31.565036 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=4 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:31.585559 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5acbbc38-55bd-4503-9810-11168a16d88b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:31.586141 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5acbbc38-55bd-4503-9810-11168a16d88b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:31.587081 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5acbbc38-55bd-4503-9810-11168a16d88b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:31.587535 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5acbbc38-55bd-4503-9810-11168a16d88b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:32.060726 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5acbbc38-55bd-4503-9810-11168a16d88b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:32.071887 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5acbbc38-55bd-4503-9810-11168a16d88b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1210 microversion: 2.1 time: 0.520900 Jun 20 12:07:32.073000 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1179/2332] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:31 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1210 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:32.077775 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3bc62d9b-1951-4d05-9dbe-91a4ae6024fb tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f60731845e0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:32.136900 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8cfc1870-c28e-4916-ac1f-3212e8e2b663 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:32.150270 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8cfc1870-c28e-4916-ac1f-3212e8e2b663 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1317 microversion: 2.1 time: 0.754996 Jun 20 12:07:32.152650 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1154/2333] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:31 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1317 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:07:32.184815 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3bc62d9b-1951-4d05-9dbe-91a4ae6024fb tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891" status: 200 len: 1437 microversion: 2.1 time: 0.110523 Jun 20 12:07:32.185586 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1180/2334] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:07:32 2022] GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891 => generated 1437 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:32.439514 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d72c96d8-0e58-4022-8998-72bc11dcf0c5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:32.442196 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d72c96d8-0e58-4022-8998-72bc11dcf0c5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:32.472561 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d72c96d8-0e58-4022-8998-72bc11dcf0c5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:32.474189 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d72c96d8-0e58-4022-8998-72bc11dcf0c5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:32.475310 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d72c96d8-0e58-4022-8998-72bc11dcf0c5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:32.482114 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d72c96d8-0e58-4022-8998-72bc11dcf0c5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:32.694310 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-dd442ba9-455a-4b57-9dcc-d0166810039d req-8d517669-f85c-4667-850a-9d75038ffc64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed397d7b-8f66-46c9-b225-1cec5c844672", "name": "network-vif-plugged", "status": "completed", "tag": "5c664946-8cfb-453b-81bf-a572f5c306af"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:07:32.739204 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-dd442ba9-455a-4b57-9dcc-d0166810039d req-8d517669-f85c-4667-850a-9d75038ffc64 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:32.742581 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-dd442ba9-455a-4b57-9dcc-d0166810039d req-8d517669-f85c-4667-850a-9d75038ffc64 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:32.788996 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-dd442ba9-455a-4b57-9dcc-d0166810039d req-8d517669-f85c-4667-850a-9d75038ffc64 service nova] Creating event network-vif-plugged:5c664946-8cfb-453b-81bf-a572f5c306af for instance ed397d7b-8f66-46c9-b225-1cec5c844672 on n-h1-master-1 Jun 20 12:07:32.801469 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-dd442ba9-455a-4b57-9dcc-d0166810039d req-8d517669-f85c-4667-850a-9d75038ffc64 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115487 Jun 20 12:07:32.805854 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1181/2335] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:07:32.836675 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=14 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:33.091810 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d7928c9a-1d85-4a24-aed1-0154584b72b4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:33.092960 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d7928c9a-1d85-4a24-aed1-0154584b72b4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:33.106447 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d7928c9a-1d85-4a24-aed1-0154584b72b4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:33.113440 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d7928c9a-1d85-4a24-aed1-0154584b72b4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:33.118838 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d7928c9a-1d85-4a24-aed1-0154584b72b4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:33.123015 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d7928c9a-1d85-4a24-aed1-0154584b72b4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:33.405644 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d72c96d8-0e58-4022-8998-72bc11dcf0c5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:33.419668 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d72c96d8-0e58-4022-8998-72bc11dcf0c5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 200 len: 1463 microversion: 2.1 time: 0.984365 Jun 20 12:07:33.448935 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1155/2336] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:32 2022] GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 1463 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:33.473070 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7135ea72-6f94-4965-b996-f7ef8644c248 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:33.476093 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7135ea72-6f94-4965-b996-f7ef8644c248 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:33.498215 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7135ea72-6f94-4965-b996-f7ef8644c248 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:33.498675 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7135ea72-6f94-4965-b996-f7ef8644c248 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:33.505114 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7135ea72-6f94-4965-b996-f7ef8644c248 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:33.505579 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7135ea72-6f94-4965-b996-f7ef8644c248 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:34.132164 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d7928c9a-1d85-4a24-aed1-0154584b72b4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:34.157064 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d7928c9a-1d85-4a24-aed1-0154584b72b4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1210 microversion: 2.1 time: 1.071414 Jun 20 12:07:34.158370 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1182/2337] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:33 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1210 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:34.163267 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-298db3aa-1171-40d3-b531-b3489bdf5190 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f60731baee0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:34.285628 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-298db3aa-1171-40d3-b531-b3489bdf5190 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891" status: 200 len: 1437 microversion: 2.1 time: 0.122826 Jun 20 12:07:34.286589 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1183/2338] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:07:34 2022] GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891 => generated 1437 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:34.305030 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bed48b69-5c1d-4c00-a99b-6b3b41d7b3cb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:07:34.316810 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bed48b69-5c1d-4c00-a99b-6b3b41d7b3cb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:34.372449 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bed48b69-5c1d-4c00-a99b-6b3b41d7b3cb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:34.377409 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bed48b69-5c1d-4c00-a99b-6b3b41d7b3cb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:34.383980 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bed48b69-5c1d-4c00-a99b-6b3b41d7b3cb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:34.388951 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bed48b69-5c1d-4c00-a99b-6b3b41d7b3cb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:34.756239 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-bed48b69-5c1d-4c00-a99b-6b3b41d7b3cb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:34.763706 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bed48b69-5c1d-4c00-a99b-6b3b41d7b3cb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Old instance type m1.heat2, new instance type m1.heat {{(pid=119128) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 20 12:07:34.780378 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-bed48b69-5c1d-4c00-a99b-6b3b41d7b3cb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:07:34.783560 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-bed48b69-5c1d-4c00-a99b-6b3b41d7b3cb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:07:34.784521 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-bed48b69-5c1d-4c00-a99b-6b3b41d7b3cb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:07:34.785791 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-bed48b69-5c1d-4c00-a99b-6b3b41d7b3cb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:07:34.786396 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-bed48b69-5c1d-4c00-a99b-6b3b41d7b3cb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:07:34.937566 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7135ea72-6f94-4965-b996-f7ef8644c248 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:34.951116 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7135ea72-6f94-4965-b996-f7ef8644c248 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1317 microversion: 2.1 time: 1.493237 Jun 20 12:07:34.952269 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1156/2339] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:33 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1317 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:35.114826 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bed48b69-5c1d-4c00-a99b-6b3b41d7b3cb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "POST /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d/action" status: 202 len: 0 microversion: 2.1 time: 0.826450 Jun 20 12:07:35.121794 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1184/2340] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:07:34 2022] POST /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d/action => generated 0 bytes in 834 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:07:35.126688 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fa310fd6-6173-4407-a5a9-31adc3a27738 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:35.128548 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fa310fd6-6173-4407-a5a9-31adc3a27738 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:35.162088 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fa310fd6-6173-4407-a5a9-31adc3a27738 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:35.169960 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fa310fd6-6173-4407-a5a9-31adc3a27738 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:35.174838 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fa310fd6-6173-4407-a5a9-31adc3a27738 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:35.175312 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a6bda863-98e7-4ebb-9a6c-6d5f222c919d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:35.175983 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a6bda863-98e7-4ebb-9a6c-6d5f222c919d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:35.181461 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fa310fd6-6173-4407-a5a9-31adc3a27738 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:35.200961 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6bda863-98e7-4ebb-9a6c-6d5f222c919d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:35.201410 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6bda863-98e7-4ebb-9a6c-6d5f222c919d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:35.202265 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6bda863-98e7-4ebb-9a6c-6d5f222c919d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:35.202700 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6bda863-98e7-4ebb-9a6c-6d5f222c919d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:36.074134 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a6bda863-98e7-4ebb-9a6c-6d5f222c919d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:36.084898 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a6bda863-98e7-4ebb-9a6c-6d5f222c919d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1210 microversion: 2.1 time: 0.913809 Jun 20 12:07:36.087727 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1185/2341] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:35 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1210 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:07:36.105031 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c8c5d9c5-b71c-4aa0-a719-0531bc149d14 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f60731ba550>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:36.208349 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c8c5d9c5-b71c-4aa0-a719-0531bc149d14 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891" status: 200 len: 1437 microversion: 2.1 time: 0.118693 Jun 20 12:07:36.210140 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1186/2342] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:07:36 2022] GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891 => generated 1437 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:36.215891 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8d08c690-8215-4282-870f-514467243aff tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:36.216802 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8d08c690-8215-4282-870f-514467243aff tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:36.229602 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8d08c690-8215-4282-870f-514467243aff tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:36.233504 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8d08c690-8215-4282-870f-514467243aff tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:36.234764 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8d08c690-8215-4282-870f-514467243aff tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:36.235366 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8d08c690-8215-4282-870f-514467243aff tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:36.238807 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:36.619124 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fa310fd6-6173-4407-a5a9-31adc3a27738 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:36.647256 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fa310fd6-6173-4407-a5a9-31adc3a27738 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 200 len: 1472 microversion: 2.1 time: 1.526784 Jun 20 12:07:36.661638 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1157/2343] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:35 2022] GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 1472 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:07:36.738806 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8d08c690-8215-4282-870f-514467243aff tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:36.750796 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8d08c690-8215-4282-870f-514467243aff tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1317 microversion: 2.1 time: 0.539299 Jun 20 12:07:36.755963 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1187/2344] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:36 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1317 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:37.105870 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d9286fcb-9dcb-4241-8c30-508f9e139cdf tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:37.107421 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d9286fcb-9dcb-4241-8c30-508f9e139cdf tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:37.125759 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9286fcb-9dcb-4241-8c30-508f9e139cdf tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:37.129163 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9286fcb-9dcb-4241-8c30-508f9e139cdf tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:37.130033 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9286fcb-9dcb-4241-8c30-508f9e139cdf tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:37.130491 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9286fcb-9dcb-4241-8c30-508f9e139cdf tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:37.224158 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-561f16fd-84ce-46f2-b9e2-7a6da3491622 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f60731b3e50>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:37.308386 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-561f16fd-84ce-46f2-b9e2-7a6da3491622 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891" status: 200 len: 1437 microversion: 2.1 time: 0.088621 Jun 20 12:07:37.310028 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1188/2345] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:07:37 2022] GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891 => generated 1437 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:37.733225 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4532b320-cecb-4683-a6c4-0756e2371c3f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:37.733860 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4532b320-cecb-4683-a6c4-0756e2371c3f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:37.774141 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4532b320-cecb-4683-a6c4-0756e2371c3f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:37.774860 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4532b320-cecb-4683-a6c4-0756e2371c3f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:37.775930 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4532b320-cecb-4683-a6c4-0756e2371c3f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:37.784774 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4532b320-cecb-4683-a6c4-0756e2371c3f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:38.446066 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d9286fcb-9dcb-4241-8c30-508f9e139cdf tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:38.463201 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d9286fcb-9dcb-4241-8c30-508f9e139cdf tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1198 microversion: 2.1 time: 1.361815 Jun 20 12:07:38.479722 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1158/2346] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:37 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1198 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:07:38.502181 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-aa523799-6642-41e5-a2ca-12e90e888b47 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:38.503629 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-aa523799-6642-41e5-a2ca-12e90e888b47 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:38.516625 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa523799-6642-41e5-a2ca-12e90e888b47 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:38.517617 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa523799-6642-41e5-a2ca-12e90e888b47 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:38.519594 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa523799-6642-41e5-a2ca-12e90e888b47 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:38.520409 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa523799-6642-41e5-a2ca-12e90e888b47 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:38.603421 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4532b320-cecb-4683-a6c4-0756e2371c3f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:38.632570 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4532b320-cecb-4683-a6c4-0756e2371c3f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 200 len: 1472 microversion: 2.1 time: 0.907555 Jun 20 12:07:38.641922 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1189/2347] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:37 2022] GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 1472 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:07:38.689407 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f0d3490f-ea4f-4a6c-9f68-3118a555f410 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f6073901280>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:38.837876 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f0d3490f-ea4f-4a6c-9f68-3118a555f410 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891" status: 200 len: 1437 microversion: 2.1 time: 0.193416 Jun 20 12:07:38.845357 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1190/2348] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:07:38 2022] GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891 => generated 1437 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:39.365807 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-c06303c8-c41e-4be0-9ba4-4d2a9b59dfd5 req-0121597f-820f-48b5-a932-dcd2e2b57787 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "593cda12-6491-4a27-8fc7-42c05e0291c3", "name": "network-vif-plugged", "status": "completed", "tag": "2a9eb762-96f9-45b2-8446-311d784377f5"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:07:39.437790 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-c06303c8-c41e-4be0-9ba4-4d2a9b59dfd5 req-0121597f-820f-48b5-a932-dcd2e2b57787 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:39.444145 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-c06303c8-c41e-4be0-9ba4-4d2a9b59dfd5 req-0121597f-820f-48b5-a932-dcd2e2b57787 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:39.500687 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-c06303c8-c41e-4be0-9ba4-4d2a9b59dfd5 req-0121597f-820f-48b5-a932-dcd2e2b57787 service nova] Creating event network-vif-plugged:2a9eb762-96f9-45b2-8446-311d784377f5 for instance 593cda12-6491-4a27-8fc7-42c05e0291c3 on n-h2-master-1 Jun 20 12:07:39.525782 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-c06303c8-c41e-4be0-9ba4-4d2a9b59dfd5 req-0121597f-820f-48b5-a932-dcd2e2b57787 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164625 Jun 20 12:07:39.527644 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1191/2349] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:07:39.539481 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4dd0f136-d038-430a-8600-2192521c420a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:39.541000 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4dd0f136-d038-430a-8600-2192521c420a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:39.554053 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4dd0f136-d038-430a-8600-2192521c420a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:39.580982 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4dd0f136-d038-430a-8600-2192521c420a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:39.587058 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4dd0f136-d038-430a-8600-2192521c420a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:39.589258 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4dd0f136-d038-430a-8600-2192521c420a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:40.443159 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-aa523799-6642-41e5-a2ca-12e90e888b47 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:40.457431 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-aa523799-6642-41e5-a2ca-12e90e888b47 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1317 microversion: 2.1 time: 1.973606 Jun 20 12:07:40.458332 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1159/2350] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:38 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1317 bytes in 1978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:40.466685 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-13ce6a96-0ae5-48df-a8e5-66e83047d25c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:40.475150 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-13ce6a96-0ae5-48df-a8e5-66e83047d25c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:40.489893 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-13ce6a96-0ae5-48df-a8e5-66e83047d25c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:40.492359 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-13ce6a96-0ae5-48df-a8e5-66e83047d25c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:40.495042 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-13ce6a96-0ae5-48df-a8e5-66e83047d25c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:40.495618 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-13ce6a96-0ae5-48df-a8e5-66e83047d25c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:40.515213 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:40.935187 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-13ce6a96-0ae5-48df-a8e5-66e83047d25c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:40.950466 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-13ce6a96-0ae5-48df-a8e5-66e83047d25c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 200 len: 1472 microversion: 2.1 time: 0.490772 Jun 20 12:07:40.953512 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1160/2351] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:40 2022] GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 1472 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:40.975219 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-32e66707-f796-433a-9699-9090f3abda1d tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f6073f78af0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:41.078465 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-32e66707-f796-433a-9699-9090f3abda1d tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891" status: 200 len: 1437 microversion: 2.1 time: 0.118998 Jun 20 12:07:41.082508 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1161/2352] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:07:40 2022] GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891 => generated 1437 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:41.329281 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4dd0f136-d038-430a-8600-2192521c420a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:41.341196 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4dd0f136-d038-430a-8600-2192521c420a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1198 microversion: 2.1 time: 1.810432 Jun 20 12:07:41.350319 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1192/2353] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:39 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1198 bytes in 1813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:41.486131 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f5373e0b-61fe-42c4-9757-15cfd9a2ab3c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:41.487500 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f5373e0b-61fe-42c4-9757-15cfd9a2ab3c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:41.510526 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5373e0b-61fe-42c4-9757-15cfd9a2ab3c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:41.511346 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5373e0b-61fe-42c4-9757-15cfd9a2ab3c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:41.512404 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5373e0b-61fe-42c4-9757-15cfd9a2ab3c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:41.516910 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5373e0b-61fe-42c4-9757-15cfd9a2ab3c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:41.965882 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f5373e0b-61fe-42c4-9757-15cfd9a2ab3c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:41.971101 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-13092cc6-f8bd-4d63-81d8-755f3a9d4ae3 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:41.972356 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-13092cc6-f8bd-4d63-81d8-755f3a9d4ae3 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:41.980884 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13092cc6-f8bd-4d63-81d8-755f3a9d4ae3 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:41.981883 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13092cc6-f8bd-4d63-81d8-755f3a9d4ae3 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:41.983321 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13092cc6-f8bd-4d63-81d8-755f3a9d4ae3 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:41.984247 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13092cc6-f8bd-4d63-81d8-755f3a9d4ae3 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:41.985018 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f5373e0b-61fe-42c4-9757-15cfd9a2ab3c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1317 microversion: 2.1 time: 0.505816 Jun 20 12:07:41.995387 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1162/2354] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:41 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1317 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:42.094280 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-32ac27b9-9f6c-46d2-add9-c1916a8223f6 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f6073f78d30>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:42.168049 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-32ac27b9-9f6c-46d2-add9-c1916a8223f6 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891" status: 200 len: 1437 microversion: 2.1 time: 0.077816 Jun 20 12:07:42.176092 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1163/2355] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:07:42 2022] GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891 => generated 1437 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:42.359129 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-46813079-4997-491e-beee-bbd9b332fd3b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:42.359763 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-46813079-4997-491e-beee-bbd9b332fd3b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:42.371128 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-46813079-4997-491e-beee-bbd9b332fd3b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:42.371593 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-46813079-4997-491e-beee-bbd9b332fd3b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:42.372431 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-46813079-4997-491e-beee-bbd9b332fd3b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:42.372918 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-46813079-4997-491e-beee-bbd9b332fd3b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:43.205672 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-13092cc6-f8bd-4d63-81d8-755f3a9d4ae3 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:43.222165 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-13092cc6-f8bd-4d63-81d8-755f3a9d4ae3 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 200 len: 1472 microversion: 2.1 time: 1.253438 Jun 20 12:07:43.223682 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1193/2356] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:41 2022] GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 1472 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:43.237045 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7ee7900e-02ae-4734-8df4-a26a3efcb3e9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:43.239991 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7ee7900e-02ae-4734-8df4-a26a3efcb3e9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:43.252102 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=91 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:43.256119 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ee7900e-02ae-4734-8df4-a26a3efcb3e9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:43.260099 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ee7900e-02ae-4734-8df4-a26a3efcb3e9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:43.264834 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ee7900e-02ae-4734-8df4-a26a3efcb3e9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:43.265884 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ee7900e-02ae-4734-8df4-a26a3efcb3e9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:43.543352 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-46813079-4997-491e-beee-bbd9b332fd3b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:43.632869 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-46813079-4997-491e-beee-bbd9b332fd3b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1198 microversion: 2.1 time: 1.277439 Jun 20 12:07:43.645407 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1164/2357] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:42 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1198 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:43.655582 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-466a2142-55b2-4595-91ba-5e749b97a84e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f6072d124c0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:43.751251 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-466a2142-55b2-4595-91ba-5e749b97a84e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891" status: 200 len: 1437 microversion: 2.1 time: 0.104226 Jun 20 12:07:43.752647 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1165/2358] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:07:43 2022] GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891 => generated 1437 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:43.950627 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7ee7900e-02ae-4734-8df4-a26a3efcb3e9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:43.959598 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7ee7900e-02ae-4734-8df4-a26a3efcb3e9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.734203 Jun 20 12:07:43.962610 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1194/2359] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:43 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:44.243843 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3ee1f2f8-ef4d-4f07-92f7-66ab417b869d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:44.244933 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3ee1f2f8-ef4d-4f07-92f7-66ab417b869d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:44.247901 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:44.270994 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c94df2ee-be1d-4f23-acaf-585646a33834 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1965463980", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "dadde73c-e8f7-441b-8503-8f17caea8651"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:07:44.271641 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3ee1f2f8-ef4d-4f07-92f7-66ab417b869d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:44.272191 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3ee1f2f8-ef4d-4f07-92f7-66ab417b869d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:44.273488 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3ee1f2f8-ef4d-4f07-92f7-66ab417b869d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:44.273924 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3ee1f2f8-ef4d-4f07-92f7-66ab417b869d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:44.435846 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-c94df2ee-be1d-4f23-acaf-585646a33834 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] validate_networks() for [('dadde73c-e8f7-441b-8503-8f17caea8651', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:07:45.114877 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3ee1f2f8-ef4d-4f07-92f7-66ab417b869d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:45.129931 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3ee1f2f8-ef4d-4f07-92f7-66ab417b869d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 200 len: 1477 microversion: 2.1 time: 0.888126 Jun 20 12:07:45.139788 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1166/2360] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:44 2022] GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 1477 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:45.151328 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-885e63f2-b4ee-4cd2-b53d-c0d85f6d7380 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:45.152868 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-885e63f2-b4ee-4cd2-b53d-c0d85f6d7380 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:45.169961 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-885e63f2-b4ee-4cd2-b53d-c0d85f6d7380 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:45.172114 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-885e63f2-b4ee-4cd2-b53d-c0d85f6d7380 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:45.174093 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-885e63f2-b4ee-4cd2-b53d-c0d85f6d7380 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:45.174967 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-885e63f2-b4ee-4cd2-b53d-c0d85f6d7380 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:45.864784 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-885e63f2-b4ee-4cd2-b53d-c0d85f6d7380 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:45.878881 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-885e63f2-b4ee-4cd2-b53d-c0d85f6d7380 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1198 microversion: 2.1 time: 0.737205 Jun 20 12:07:45.888821 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1167/2361] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:45 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1198 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:45.906837 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bb0c4e50-04c7-49fc-a3f6-c6bfa55a0477 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f6073be9d30>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:46.086262 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bb0c4e50-04c7-49fc-a3f6-c6bfa55a0477 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891" status: 200 len: 1437 microversion: 2.1 time: 0.192812 Jun 20 12:07:46.097476 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1168/2362] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:07:45 2022] GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891 => generated 1437 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:46.148887 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-889e9008-2524-4715-99b4-f954f2056a4f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:46.151413 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-889e9008-2524-4715-99b4-f954f2056a4f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:46.173161 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-889e9008-2524-4715-99b4-f954f2056a4f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:46.185223 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-889e9008-2524-4715-99b4-f954f2056a4f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:46.186997 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-889e9008-2524-4715-99b4-f954f2056a4f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:46.191663 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-889e9008-2524-4715-99b4-f954f2056a4f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:46.798992 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-c94df2ee-be1d-4f23-acaf-585646a33834 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:07:46.799664 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-c94df2ee-be1d-4f23-acaf-585646a33834 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:07:46.800322 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-c94df2ee-be1d-4f23-acaf-585646a33834 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:07:46.801218 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-c94df2ee-be1d-4f23-acaf-585646a33834 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:07:46.801776 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-c94df2ee-be1d-4f23-acaf-585646a33834 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:07:46.830912 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c94df2ee-be1d-4f23-acaf-585646a33834 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:46.831484 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c94df2ee-be1d-4f23-acaf-585646a33834 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:46.838075 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c94df2ee-be1d-4f23-acaf-585646a33834 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:46.842052 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c94df2ee-be1d-4f23-acaf-585646a33834 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:46.921010 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-c94df2ee-be1d-4f23-acaf-585646a33834 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Getting quotas for project a68f0f3fd0f8415eae2b397f27fe12f7. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:07:46.942189 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-c94df2ee-be1d-4f23-acaf-585646a33834 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Getting quotas for user 719eacccdc9f4daea56644de31876572 and project a68f0f3fd0f8415eae2b397f27fe12f7. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:07:46.984472 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c94df2ee-be1d-4f23-acaf-585646a33834 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:07:46.996410 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c94df2ee-be1d-4f23-acaf-585646a33834 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:07:47.013518 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-889e9008-2524-4715-99b4-f954f2056a4f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:47.030282 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-889e9008-2524-4715-99b4-f954f2056a4f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 200 len: 1477 microversion: 2.1 time: 0.886781 Jun 20 12:07:47.032429 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1169/2363] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:46 2022] GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 1477 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:47.042751 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8dab2fa5-4c3b-4a67-9301-4439ed5931cf tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:47.046856 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8dab2fa5-4c3b-4a67-9301-4439ed5931cf tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:47.062682 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8dab2fa5-4c3b-4a67-9301-4439ed5931cf tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:47.064889 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8dab2fa5-4c3b-4a67-9301-4439ed5931cf tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:47.067124 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8dab2fa5-4c3b-4a67-9301-4439ed5931cf tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:47.068230 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8dab2fa5-4c3b-4a67-9301-4439ed5931cf tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:47.142443 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c94df2ee-be1d-4f23-acaf-585646a33834 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.875376 Jun 20 12:07:47.153919 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1195/2364] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:07:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:07:47.161713 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5987d1ff-84c4-4296-8cf5-e986cee7e3bd tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f60849cfd30>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:47.361088 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5987d1ff-84c4-4296-8cf5-e986cee7e3bd tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891" status: 200 len: 1437 microversion: 2.1 time: 0.205589 Jun 20 12:07:47.363581 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1196/2365] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:07:47 2022] GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891 => generated 1437 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:47.376781 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-87347e33-8059-406f-ae9e-dc7f3aad0865 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:47.383932 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-87347e33-8059-406f-ae9e-dc7f3aad0865 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:47.583008 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-87347e33-8059-406f-ae9e-dc7f3aad0865 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:47.606324 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-87347e33-8059-406f-ae9e-dc7f3aad0865 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6" status: 200 len: 1217 microversion: 2.1 time: 0.236870 Jun 20 12:07:47.607247 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1197/2366] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:47 2022] GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 => generated 1217 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:48.048767 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-07bbd067-3d55-4df7-9366-3436b4e6f2ad tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:48.050714 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-07bbd067-3d55-4df7-9366-3436b4e6f2ad tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:48.063751 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-07bbd067-3d55-4df7-9366-3436b4e6f2ad tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:48.073132 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-07bbd067-3d55-4df7-9366-3436b4e6f2ad tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:48.074303 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-07bbd067-3d55-4df7-9366-3436b4e6f2ad tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:48.074936 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-07bbd067-3d55-4df7-9366-3436b4e6f2ad tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:48.099125 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8dab2fa5-4c3b-4a67-9301-4439ed5931cf tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:48.112610 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8dab2fa5-4c3b-4a67-9301-4439ed5931cf tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1198 microversion: 2.1 time: 1.078809 Jun 20 12:07:48.121282 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1170/2367] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:47 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1198 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:48.381153 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-73ea38b3-6c17-4880-9fa4-9d6a8b4f3498 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f60732abaf0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:48.529620 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-73ea38b3-6c17-4880-9fa4-9d6a8b4f3498 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891" status: 200 len: 1437 microversion: 2.1 time: 0.149513 Jun 20 12:07:48.538253 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1171/2368] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:07:48 2022] GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891 => generated 1437 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:48.628932 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-92477b84-8c22-414c-b0d0-15afcc701afb tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:48.630419 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-92477b84-8c22-414c-b0d0-15afcc701afb tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:48.657205 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-92477b84-8c22-414c-b0d0-15afcc701afb tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:48.658329 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-92477b84-8c22-414c-b0d0-15afcc701afb tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:48.661692 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-92477b84-8c22-414c-b0d0-15afcc701afb tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:48.664809 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-92477b84-8c22-414c-b0d0-15afcc701afb tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:48.974058 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-07bbd067-3d55-4df7-9366-3436b4e6f2ad tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:48.989998 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-07bbd067-3d55-4df7-9366-3436b4e6f2ad tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 200 len: 1477 microversion: 2.1 time: 0.944387 Jun 20 12:07:48.991233 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1198/2369] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:48 2022] GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 1477 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:49.081595 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-92477b84-8c22-414c-b0d0-15afcc701afb tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:49.119167 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-92477b84-8c22-414c-b0d0-15afcc701afb tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6" status: 200 len: 1221 microversion: 2.1 time: 0.498039 Jun 20 12:07:49.131060 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1172/2370] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:48 2022] GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 => generated 1221 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:49.137383 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ab88aa33-64bf-4df5-acf8-c3edce3a845f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:49.138027 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ab88aa33-64bf-4df5-acf8-c3edce3a845f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:49.151448 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ab88aa33-64bf-4df5-acf8-c3edce3a845f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:49.151912 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ab88aa33-64bf-4df5-acf8-c3edce3a845f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:49.152773 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ab88aa33-64bf-4df5-acf8-c3edce3a845f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:49.153221 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ab88aa33-64bf-4df5-acf8-c3edce3a845f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:49.552405 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-01972986-361a-459f-9aec-505166c51897 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f6073b6bd30>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:49.720969 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-01972986-361a-459f-9aec-505166c51897 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891" status: 200 len: 1437 microversion: 2.1 time: 0.172292 Jun 20 12:07:49.724032 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1173/2371] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:07:49 2022] GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891 => generated 1437 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:50.029511 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ac8318a4-2430-4506-abf7-501323b2df23 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:50.034523 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ac8318a4-2430-4506-abf7-501323b2df23 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:50.051083 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac8318a4-2430-4506-abf7-501323b2df23 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:50.051614 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac8318a4-2430-4506-abf7-501323b2df23 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:50.052462 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac8318a4-2430-4506-abf7-501323b2df23 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:50.055274 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac8318a4-2430-4506-abf7-501323b2df23 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:50.321852 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ac8318a4-2430-4506-abf7-501323b2df23 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:50.326717 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ab88aa33-64bf-4df5-acf8-c3edce3a845f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:50.330260 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ac8318a4-2430-4506-abf7-501323b2df23 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 200 len: 1477 microversion: 2.1 time: 0.323803 Jun 20 12:07:50.333648 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1174/2372] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:50 2022] GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 1477 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:50.345340 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-730fb072-1693-49c5-b8e8-64713a36c42a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:50.345982 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-730fb072-1693-49c5-b8e8-64713a36c42a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:50.359208 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-730fb072-1693-49c5-b8e8-64713a36c42a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:50.359777 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-730fb072-1693-49c5-b8e8-64713a36c42a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:50.360704 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-730fb072-1693-49c5-b8e8-64713a36c42a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:50.361021 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-730fb072-1693-49c5-b8e8-64713a36c42a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:50.372937 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ab88aa33-64bf-4df5-acf8-c3edce3a845f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1198 microversion: 2.1 time: 1.240617 Jun 20 12:07:50.384550 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1199/2373] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:49 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1198 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:50.688475 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-730fb072-1693-49c5-b8e8-64713a36c42a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:50.702497 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-730fb072-1693-49c5-b8e8-64713a36c42a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6" status: 200 len: 1275 microversion: 2.1 time: 0.367671 Jun 20 12:07:50.703350 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1175/2374] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:50 2022] GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 => generated 1275 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:50.753072 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cd84a4a9-31cd-4b44-bf26-638f64beecbc tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f60849f7700>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:50.885849 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cd84a4a9-31cd-4b44-bf26-638f64beecbc tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891" status: 200 len: 1437 microversion: 2.1 time: 0.152979 Jun 20 12:07:50.892307 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1200/2375] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:07:50 2022] GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891 => generated 1437 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:51.355932 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-492cc588-aebd-4f65-8030-ec0cc6ebd36c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:51.356600 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-492cc588-aebd-4f65-8030-ec0cc6ebd36c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:51.368287 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-492cc588-aebd-4f65-8030-ec0cc6ebd36c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:51.375186 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-492cc588-aebd-4f65-8030-ec0cc6ebd36c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:51.376376 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-492cc588-aebd-4f65-8030-ec0cc6ebd36c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:51.376985 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-492cc588-aebd-4f65-8030-ec0cc6ebd36c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:51.391913 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5188ca25-4569-4e87-87f0-8041281ece3a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:51.392582 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5188ca25-4569-4e87-87f0-8041281ece3a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:51.418307 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5188ca25-4569-4e87-87f0-8041281ece3a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:51.419255 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5188ca25-4569-4e87-87f0-8041281ece3a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:51.428647 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5188ca25-4569-4e87-87f0-8041281ece3a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:51.429427 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5188ca25-4569-4e87-87f0-8041281ece3a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:52.180700 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-492cc588-aebd-4f65-8030-ec0cc6ebd36c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:52.198279 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-492cc588-aebd-4f65-8030-ec0cc6ebd36c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 200 len: 1477 microversion: 2.1 time: 0.847519 Jun 20 12:07:52.205173 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1176/2376] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:51 2022] GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 1477 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:52.216089 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a3c307bb-bd94-4184-a49c-897bf82e87e0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:52.217098 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a3c307bb-bd94-4184-a49c-897bf82e87e0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:52.239868 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a3c307bb-bd94-4184-a49c-897bf82e87e0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:52.240776 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a3c307bb-bd94-4184-a49c-897bf82e87e0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:52.241846 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a3c307bb-bd94-4184-a49c-897bf82e87e0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:52.244944 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a3c307bb-bd94-4184-a49c-897bf82e87e0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:52.400954 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a3c307bb-bd94-4184-a49c-897bf82e87e0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:52.414531 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a3c307bb-bd94-4184-a49c-897bf82e87e0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6" status: 200 len: 1275 microversion: 2.1 time: 0.207374 Jun 20 12:07:52.429322 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1177/2377] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:52 2022] GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 => generated 1275 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:52.435224 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e326ff9a-a0ec-499b-b0b6-7c6bfcbdce51 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f6073ca4160>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:52.673189 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e326ff9a-a0ec-499b-b0b6-7c6bfcbdce51 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891" status: 200 len: 1437 microversion: 2.1 time: 0.242630 Jun 20 12:07:52.678795 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1178/2378] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:07:52 2022] GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891 => generated 1437 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:53.108464 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5188ca25-4569-4e87-87f0-8041281ece3a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:53.129136 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5188ca25-4569-4e87-87f0-8041281ece3a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1198 microversion: 2.1 time: 1.740992 Jun 20 12:07:53.140228 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1201/2379] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:51 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1198 bytes in 1743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:07:53.225117 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-66a329df-19ef-4e25-92df-6b965c718291 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:53.226187 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-66a329df-19ef-4e25-92df-6b965c718291 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:53.251746 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66a329df-19ef-4e25-92df-6b965c718291 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:53.252794 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66a329df-19ef-4e25-92df-6b965c718291 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:53.254400 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66a329df-19ef-4e25-92df-6b965c718291 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:53.255354 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66a329df-19ef-4e25-92df-6b965c718291 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:53.459537 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d3d4f8c8-e52a-4a90-af82-19cdacbf8cf4 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:53.460641 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d3d4f8c8-e52a-4a90-af82-19cdacbf8cf4 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:53.478930 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3d4f8c8-e52a-4a90-af82-19cdacbf8cf4 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:53.479822 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3d4f8c8-e52a-4a90-af82-19cdacbf8cf4 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:53.481068 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3d4f8c8-e52a-4a90-af82-19cdacbf8cf4 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:53.481841 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3d4f8c8-e52a-4a90-af82-19cdacbf8cf4 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:53.671462 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d3d4f8c8-e52a-4a90-af82-19cdacbf8cf4 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:53.688925 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d3d4f8c8-e52a-4a90-af82-19cdacbf8cf4 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6" status: 200 len: 1275 microversion: 2.1 time: 0.233578 Jun 20 12:07:53.694768 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1202/2380] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:53 2022] GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 => generated 1275 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:53.714147 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-57a9c35b-39e5-4151-8b3b-462b255de664 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f6084928790>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:53.815958 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-57a9c35b-39e5-4151-8b3b-462b255de664 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891" status: 200 len: 1437 microversion: 2.1 time: 0.113717 Jun 20 12:07:53.817240 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1203/2381] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:07:53 2022] GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891 => generated 1437 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:53.936969 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-66a329df-19ef-4e25-92df-6b965c718291 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:53.955541 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-66a329df-19ef-4e25-92df-6b965c718291 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 200 len: 1477 microversion: 2.1 time: 0.734608 Jun 20 12:07:53.958199 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1179/2382] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:53 2022] GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 1477 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:54.151316 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cd3314be-3f54-4b87-be69-66da0f9168ad tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:54.152154 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cd3314be-3f54-4b87-be69-66da0f9168ad tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:54.165795 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cd3314be-3f54-4b87-be69-66da0f9168ad tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:54.166268 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cd3314be-3f54-4b87-be69-66da0f9168ad tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:54.167126 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cd3314be-3f54-4b87-be69-66da0f9168ad tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:54.167579 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cd3314be-3f54-4b87-be69-66da0f9168ad tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:54.711818 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b14e1dd9-df07-4203-9afe-fa5f473e7063 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:54.712850 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b14e1dd9-df07-4203-9afe-fa5f473e7063 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:54.736753 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b14e1dd9-df07-4203-9afe-fa5f473e7063 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:54.742420 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b14e1dd9-df07-4203-9afe-fa5f473e7063 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:54.745174 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b14e1dd9-df07-4203-9afe-fa5f473e7063 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:54.749238 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b14e1dd9-df07-4203-9afe-fa5f473e7063 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:55.046908 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b14e1dd9-df07-4203-9afe-fa5f473e7063 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:55.067974 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b14e1dd9-df07-4203-9afe-fa5f473e7063 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6" status: 200 len: 1275 microversion: 2.1 time: 0.359992 Jun 20 12:07:55.072973 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1180/2383] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:54 2022] GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 => generated 1275 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:55.089439 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-06e39f93-1369-4aa9-89e7-061f4a58c1ba tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f6084995af0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:55.232164 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-06e39f93-1369-4aa9-89e7-061f4a58c1ba tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891" status: 200 len: 1437 microversion: 2.1 time: 0.154450 Jun 20 12:07:55.233004 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1181/2384] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:07:55 2022] GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891 => generated 1437 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:55.260540 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-964987bf-1877-49a4-8908-3ebf9c717dda tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:55.262837 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-964987bf-1877-49a4-8908-3ebf9c717dda tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:55.292335 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-964987bf-1877-49a4-8908-3ebf9c717dda tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:55.297909 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-964987bf-1877-49a4-8908-3ebf9c717dda tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:55.300848 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-964987bf-1877-49a4-8908-3ebf9c717dda tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:55.314182 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-964987bf-1877-49a4-8908-3ebf9c717dda tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:55.815030 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-cd3314be-3f54-4b87-be69-66da0f9168ad tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:55.841499 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cd3314be-3f54-4b87-be69-66da0f9168ad tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1198 microversion: 2.1 time: 1.680317 Jun 20 12:07:55.842555 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1204/2385] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:54 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1198 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:07:56.091440 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-aaec6389-aaf8-4d9a-bb7e-4ef594102c89 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:56.092568 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-aaec6389-aaf8-4d9a-bb7e-4ef594102c89 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:56.128174 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aaec6389-aaf8-4d9a-bb7e-4ef594102c89 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:56.128693 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aaec6389-aaf8-4d9a-bb7e-4ef594102c89 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:56.129519 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aaec6389-aaf8-4d9a-bb7e-4ef594102c89 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:56.129975 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aaec6389-aaf8-4d9a-bb7e-4ef594102c89 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:56.880239 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:57.133472 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-964987bf-1877-49a4-8908-3ebf9c717dda tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:57.175015 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-964987bf-1877-49a4-8908-3ebf9c717dda tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 200 len: 1477 microversion: 2.1 time: 1.934280 Jun 20 12:07:57.180323 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1182/2386] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:55 2022] GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 1477 bytes in 1946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:57.253860 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-6064e8f8-918f-4de9-9aab-da3c78f7de18 req-204be145-0d87-4015-a7a5-f82e5e91c36a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de7fc47c-e28f-4697-bbf9-df8390dfd998", "name": "network-vif-plugged", "status": "completed", "tag": "5925f2d5-cbe4-4efe-9aa1-8f5c5ba93a44"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:07:57.283887 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-6064e8f8-918f-4de9-9aab-da3c78f7de18 req-204be145-0d87-4015-a7a5-f82e5e91c36a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:57.285434 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-6064e8f8-918f-4de9-9aab-da3c78f7de18 req-204be145-0d87-4015-a7a5-f82e5e91c36a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:57.316876 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-6064e8f8-918f-4de9-9aab-da3c78f7de18 req-204be145-0d87-4015-a7a5-f82e5e91c36a service nova] Creating event network-vif-plugged:5925f2d5-cbe4-4efe-9aa1-8f5c5ba93a44 for instance de7fc47c-e28f-4697-bbf9-df8390dfd998 on n-h2-master-1 Jun 20 12:07:57.335266 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-6064e8f8-918f-4de9-9aab-da3c78f7de18 req-204be145-0d87-4015-a7a5-f82e5e91c36a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149076 Jun 20 12:07:57.339203 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1183/2387] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:07:57.353987 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-14a61d60-a255-4bf0-91a2-68e807f2dbe7 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f6073a1a1f0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:57.506579 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-14a61d60-a255-4bf0-91a2-68e807f2dbe7 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891" status: 200 len: 1437 microversion: 2.1 time: 0.165365 Jun 20 12:07:57.507884 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1184/2388] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:07:57 2022] GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891 => generated 1437 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:57.523210 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8794fecc-2a9a-438a-a85a-d8d9514db3a3 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:57.524940 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8794fecc-2a9a-438a-a85a-d8d9514db3a3 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:57.558603 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8794fecc-2a9a-438a-a85a-d8d9514db3a3 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:57.559547 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8794fecc-2a9a-438a-a85a-d8d9514db3a3 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:57.560862 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8794fecc-2a9a-438a-a85a-d8d9514db3a3 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:57.561461 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8794fecc-2a9a-438a-a85a-d8d9514db3a3 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:57.602788 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=8 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:58.215892 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-aaec6389-aaf8-4d9a-bb7e-4ef594102c89 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:58.225100 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-aaec6389-aaf8-4d9a-bb7e-4ef594102c89 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6" status: 200 len: 1317 microversion: 2.1 time: 2.141420 Jun 20 12:07:58.234547 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1205/2389] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:56 2022] GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 => generated 1317 bytes in 2152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:07:58.584639 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-900258ee-5746-46b5-b0f4-5f0e9c803a56 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-237786582", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "195b041c-fb12-48fb-840f-690ea80e8aa7"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:07:58.731421 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-900258ee-5746-46b5-b0f4-5f0e9c803a56 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] validate_networks() for [('195b041c-fb12-48fb-840f-690ea80e8aa7', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:07:58.779860 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8794fecc-2a9a-438a-a85a-d8d9514db3a3 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:07:58.806368 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8794fecc-2a9a-438a-a85a-d8d9514db3a3 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1198 microversion: 2.1 time: 1.297005 Jun 20 12:07:58.807798 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1185/2390] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:57 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1198 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:07:58.822998 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4676e889-30a2-4c78-b76a-a039ed8a7c21 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:07:58.824046 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4676e889-30a2-4c78-b76a-a039ed8a7c21 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:07:58.832122 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4676e889-30a2-4c78-b76a-a039ed8a7c21 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:58.833076 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4676e889-30a2-4c78-b76a-a039ed8a7c21 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:58.834257 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4676e889-30a2-4c78-b76a-a039ed8a7c21 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:07:58.835415 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4676e889-30a2-4c78-b76a-a039ed8a7c21 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:07:58.883682 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:00.081309 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4676e889-30a2-4c78-b76a-a039ed8a7c21 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:00.095829 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4676e889-30a2-4c78-b76a-a039ed8a7c21 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 200 len: 1477 microversion: 2.1 time: 1.277680 Jun 20 12:08:00.096492 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1186/2391] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:07:58 2022] GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 1477 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:00.123671 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b30c8832-2ef4-4a31-8da7-df7938fa5f1b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f60849fe790>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:00.249704 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b30c8832-2ef4-4a31-8da7-df7938fa5f1b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891" status: 200 len: 1437 microversion: 2.1 time: 0.135083 Jun 20 12:08:00.257305 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1187/2392] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:08:00 2022] GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891 => generated 1437 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:00.265719 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8f62df96-27ea-4232-b1ad-c478a0d8e937 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:00.267266 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8f62df96-27ea-4232-b1ad-c478a0d8e937 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:00.274453 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8f62df96-27ea-4232-b1ad-c478a0d8e937 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:00.275211 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8f62df96-27ea-4232-b1ad-c478a0d8e937 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:00.276192 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8f62df96-27ea-4232-b1ad-c478a0d8e937 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:00.277479 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8f62df96-27ea-4232-b1ad-c478a0d8e937 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:00.612690 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8f62df96-27ea-4232-b1ad-c478a0d8e937 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:00.624182 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8f62df96-27ea-4232-b1ad-c478a0d8e937 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6" status: 200 len: 1317 microversion: 2.1 time: 0.365376 Jun 20 12:08:00.636257 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1188/2393] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:00 2022] GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 => generated 1317 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:00.640887 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4a58d5ff-c11f-4010-9985-766316ef29f3 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:00.641520 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4a58d5ff-c11f-4010-9985-766316ef29f3 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:00.664380 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4a58d5ff-c11f-4010-9985-766316ef29f3 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:00.664859 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4a58d5ff-c11f-4010-9985-766316ef29f3 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:00.665653 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4a58d5ff-c11f-4010-9985-766316ef29f3 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:00.668901 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4a58d5ff-c11f-4010-9985-766316ef29f3 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:00.984665 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4a58d5ff-c11f-4010-9985-766316ef29f3 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:00.998118 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4a58d5ff-c11f-4010-9985-766316ef29f3 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1379 microversion: 2.1 time: 0.365501 Jun 20 12:08:01.010549 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1189/2394] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:00 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1379 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:01.335312 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-19b395f8-0bae-47ec-b305-8ca08a7024d5 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:01.336970 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-19b395f8-0bae-47ec-b305-8ca08a7024d5 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:01.351069 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-19b395f8-0bae-47ec-b305-8ca08a7024d5 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:01.354639 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-19b395f8-0bae-47ec-b305-8ca08a7024d5 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:01.360777 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-19b395f8-0bae-47ec-b305-8ca08a7024d5 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:01.361442 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-19b395f8-0bae-47ec-b305-8ca08a7024d5 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:01.973687 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-19b395f8-0bae-47ec-b305-8ca08a7024d5 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1530 microversion: 2.1 time: 0.961641 Jun 20 12:08:01.989139 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1190/2395] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:01 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1530 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:02.068159 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d6e4d5c1-5acf-4af7-ab90-79f144c533fd tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:02.070992 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d6e4d5c1-5acf-4af7-ab90-79f144c533fd tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:02.099924 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d6e4d5c1-5acf-4af7-ab90-79f144c533fd tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:02.103071 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d6e4d5c1-5acf-4af7-ab90-79f144c533fd tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:02.105251 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d6e4d5c1-5acf-4af7-ab90-79f144c533fd tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:02.116630 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d6e4d5c1-5acf-4af7-ab90-79f144c533fd tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:02.872223 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d6e4d5c1-5acf-4af7-ab90-79f144c533fd tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:02.889642 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d6e4d5c1-5acf-4af7-ab90-79f144c533fd tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 200 len: 1477 microversion: 2.1 time: 0.895753 Jun 20 12:08:02.890489 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1191/2396] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:01 2022] GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 1477 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:02.901180 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-778f2b18-abc7-4bd6-9ff7-1d732787d34a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f6073b6b4c0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:03.007681 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-778f2b18-abc7-4bd6-9ff7-1d732787d34a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891" status: 200 len: 1437 microversion: 2.1 time: 0.116059 Jun 20 12:08:03.009003 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1192/2397] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:08:02 2022] GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891 => generated 1437 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:03.024716 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7fed05eb-efbd-4baa-bbe9-28b0ecd55cf8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:03.028865 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7fed05eb-efbd-4baa-bbe9-28b0ecd55cf8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:03.049262 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7fed05eb-efbd-4baa-bbe9-28b0ecd55cf8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:03.051884 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7fed05eb-efbd-4baa-bbe9-28b0ecd55cf8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:03.052937 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7fed05eb-efbd-4baa-bbe9-28b0ecd55cf8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:03.055183 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7fed05eb-efbd-4baa-bbe9-28b0ecd55cf8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:03.184359 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-900258ee-5746-46b5-b0f4-5f0e9c803a56 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:08:03.184898 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-900258ee-5746-46b5-b0f4-5f0e9c803a56 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:08:03.185238 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-900258ee-5746-46b5-b0f4-5f0e9c803a56 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:08:03.185643 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-900258ee-5746-46b5-b0f4-5f0e9c803a56 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:08:03.186049 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-900258ee-5746-46b5-b0f4-5f0e9c803a56 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:08:03.205658 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-900258ee-5746-46b5-b0f4-5f0e9c803a56 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:03.207460 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-900258ee-5746-46b5-b0f4-5f0e9c803a56 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:03.208362 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-900258ee-5746-46b5-b0f4-5f0e9c803a56 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:03.208807 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-900258ee-5746-46b5-b0f4-5f0e9c803a56 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:03.255532 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-900258ee-5746-46b5-b0f4-5f0e9c803a56 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Getting quotas for project 10736c37317b4806b9ff323ad4c867b8. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:08:03.272237 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-900258ee-5746-46b5-b0f4-5f0e9c803a56 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Getting quotas for user cf9af66464b24c7d94da13df37b3fe33 and project 10736c37317b4806b9ff323ad4c867b8. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:08:03.303644 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-900258ee-5746-46b5-b0f4-5f0e9c803a56 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:08:03.306358 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-900258ee-5746-46b5-b0f4-5f0e9c803a56 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] [instance: b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:08:03.430105 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-900258ee-5746-46b5-b0f4-5f0e9c803a56 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.194247 Jun 20 12:08:03.441502 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1206/2398] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:07:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 5206 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:08:03.458994 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-37c5f129-df6f-4e44-8e0c-0a51a4359805 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:03.464676 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-37c5f129-df6f-4e44-8e0c-0a51a4359805 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:03.488382 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-37c5f129-df6f-4e44-8e0c-0a51a4359805 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:03.491697 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-37c5f129-df6f-4e44-8e0c-0a51a4359805 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:03.493081 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-37c5f129-df6f-4e44-8e0c-0a51a4359805 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:03.496596 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-37c5f129-df6f-4e44-8e0c-0a51a4359805 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:03.552162 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7fed05eb-efbd-4baa-bbe9-28b0ecd55cf8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:03.570783 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7fed05eb-efbd-4baa-bbe9-28b0ecd55cf8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6" status: 200 len: 1317 microversion: 2.1 time: 0.560474 Jun 20 12:08:03.585166 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1193/2399] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:03 2022] GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 => generated 1317 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:03.585166 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cc3b13b9-16f9-45df-889f-b79090fcdef2 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:03.585166 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cc3b13b9-16f9-45df-889f-b79090fcdef2 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] [instance: b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:03.824854 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cc3b13b9-16f9-45df-889f-b79090fcdef2 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9af66464b24c7d94da13df37b3fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10736c37317b4806b9ff323ad4c867b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:03.839174 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cc3b13b9-16f9-45df-889f-b79090fcdef2 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] 10.222.0.27 "GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee" status: 200 len: 1224 microversion: 2.1 time: 0.262318 Jun 20 12:08:03.841589 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1194/2400] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:03 2022] GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee => generated 1224 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:03.907213 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-333c1388-8c79-4c9f-a366-45305c81874f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:03.907821 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-333c1388-8c79-4c9f-a366-45305c81874f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:03.925422 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-333c1388-8c79-4c9f-a366-45305c81874f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:03.925888 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-333c1388-8c79-4c9f-a366-45305c81874f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:03.926692 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-333c1388-8c79-4c9f-a366-45305c81874f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:03.927220 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-333c1388-8c79-4c9f-a366-45305c81874f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:04.704026 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-333c1388-8c79-4c9f-a366-45305c81874f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:04.726291 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-333c1388-8c79-4c9f-a366-45305c81874f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 200 len: 1476 microversion: 2.1 time: 0.822581 Jun 20 12:08:04.727381 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1195/2401] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:03 2022] GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 1476 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:08:04.760896 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9a70aa72-6d94-4b7e-bfc8-e18af856e305 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f6073b6b1f0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:04.865693 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-37c5f129-df6f-4e44-8e0c-0a51a4359805 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1530 microversion: 2.1 time: 1.422689 Jun 20 12:08:04.866355 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1207/2402] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:03 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1530 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:04.872332 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9a70aa72-6d94-4b7e-bfc8-e18af856e305 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891" status: 200 len: 1446 microversion: 2.1 time: 0.123043 Jun 20 12:08:04.874015 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1196/2403] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:08:04 2022] GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891 => generated 1446 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:04.892159 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f553de2e-c0e2-46a3-b557-ab87acfe3a2b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:04.898429 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f553de2e-c0e2-46a3-b557-ab87acfe3a2b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:04.898752 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b0a8e363-4b57-4fa3-a0fa-e8adf4537fe1 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:04.899652 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b0a8e363-4b57-4fa3-a0fa-e8adf4537fe1 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] [instance: b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:04.923970 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f553de2e-c0e2-46a3-b557-ab87acfe3a2b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:04.927655 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f553de2e-c0e2-46a3-b557-ab87acfe3a2b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:04.930802 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f553de2e-c0e2-46a3-b557-ab87acfe3a2b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:04.933201 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f553de2e-c0e2-46a3-b557-ab87acfe3a2b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:04.954794 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b0a8e363-4b57-4fa3-a0fa-e8adf4537fe1 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:04.955343 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b0a8e363-4b57-4fa3-a0fa-e8adf4537fe1 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:04.956335 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b0a8e363-4b57-4fa3-a0fa-e8adf4537fe1 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:04.956654 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b0a8e363-4b57-4fa3-a0fa-e8adf4537fe1 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:05.247571 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b0a8e363-4b57-4fa3-a0fa-e8adf4537fe1 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9af66464b24c7d94da13df37b3fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10736c37317b4806b9ff323ad4c867b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:05.270288 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b0a8e363-4b57-4fa3-a0fa-e8adf4537fe1 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] 10.222.0.27 "GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee" status: 200 len: 1220 microversion: 2.1 time: 0.388110 Jun 20 12:08:05.271881 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1208/2404] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:04 2022] GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee => generated 1220 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:05.279233 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-93f10c3b-1bff-40bc-89c1-d9d75a047ea3 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:05.281758 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:08:05.281758 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 12:08:05.294679 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-93f10c3b-1bff-40bc-89c1-d9d75a047ea3 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:05.295837 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-93f10c3b-1bff-40bc-89c1-d9d75a047ea3 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:05.297012 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-93f10c3b-1bff-40bc-89c1-d9d75a047ea3 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:05.298726 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-93f10c3b-1bff-40bc-89c1-d9d75a047ea3 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:05.351021 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-93f10c3b-1bff-40bc-89c1-d9d75a047ea3 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.077153 Jun 20 12:08:05.352426 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1209/2405] 10.222.0.27 () {58 vars in 1175 bytes} [Mon Jun 20 12:08:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:08:05.368745 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-577403df-8612-42e2-8c6d-3bae43e68e4a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f6073189dc0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:05.433480 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f553de2e-c0e2-46a3-b557-ab87acfe3a2b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:05.437280 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-577403df-8612-42e2-8c6d-3bae43e68e4a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891" status: 200 len: 1446 microversion: 2.1 time: 0.083379 Jun 20 12:08:05.442613 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f553de2e-c0e2-46a3-b557-ab87acfe3a2b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6" status: 200 len: 1317 microversion: 2.1 time: 0.566906 Jun 20 12:08:05.445216 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1210/2406] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:08:05 2022] GET /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891 => generated 1446 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:05.448631 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1197/2407] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:04 2022] GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 => generated 1317 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:05.457972 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4d9c3dad-1602-4a1e-b5d9-991eac2c173a tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:08:05.457972 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4d9c3dad-1602-4a1e-b5d9-991eac2c173a tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:05.458683 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c8226163-27de-46cb-960f-d482dce896d9 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f6073b6ba60>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:05.472913 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4d9c3dad-1602-4a1e-b5d9-991eac2c173a tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:05.473354 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4d9c3dad-1602-4a1e-b5d9-991eac2c173a tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:05.479304 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4d9c3dad-1602-4a1e-b5d9-991eac2c173a tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:05.479786 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4d9c3dad-1602-4a1e-b5d9-991eac2c173a tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:05.908218 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-4d9c3dad-1602-4a1e-b5d9-991eac2c173a tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lazy-loading 'flavor' on Instance uuid de7fc47c-e28f-4697-bbf9-df8390dfd998 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:08:05.966091 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4d9c3dad-1602-4a1e-b5d9-991eac2c173a tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Going to try to live migrate instance to n-h1-master-1 {{(pid=119128) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 20 12:08:06.118787 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:06.757865 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c8226163-27de-46cb-960f-d482dce896d9 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "DELETE /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891" status: 204 len: 0 microversion: 2.1 time: 1.308049 Jun 20 12:08:06.759754 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1198/2408] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:05 2022] DELETE /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891 => generated 0 bytes in 1310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:06.765562 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c0523c16-f8a8-4e0d-966e-ad0bb45f8219 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:06.766441 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c0523c16-f8a8-4e0d-966e-ad0bb45f8219 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:06.783690 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c0523c16-f8a8-4e0d-966e-ad0bb45f8219 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:06.784573 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c0523c16-f8a8-4e0d-966e-ad0bb45f8219 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:06.790553 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c0523c16-f8a8-4e0d-966e-ad0bb45f8219 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:06.791173 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c0523c16-f8a8-4e0d-966e-ad0bb45f8219 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:07.538881 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c0523c16-f8a8-4e0d-966e-ad0bb45f8219 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:07.554261 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c0523c16-f8a8-4e0d-966e-ad0bb45f8219 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 200 len: 1476 microversion: 2.1 time: 0.792285 Jun 20 12:08:07.557237 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1199/2409] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:06 2022] GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 1476 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:07.574094 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-0b0cdcae-d264-4ea2-b7b5-b02d55489ee0 req-562faae2-45f7-4b17-86fe-a0291b6493d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f55b114d-9a13-46f1-ac8c-c8279476cd3d", "name": "network-vif-unplugged", "status": "completed", "tag": "70821ef2-9856-4c6f-b5f5-69d62c36c8b7"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:08:07.596876 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-0b0cdcae-d264-4ea2-b7b5-b02d55489ee0 req-562faae2-45f7-4b17-86fe-a0291b6493d5 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:07.597966 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-0b0cdcae-d264-4ea2-b7b5-b02d55489ee0 req-562faae2-45f7-4b17-86fe-a0291b6493d5 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:07.648871 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-0b0cdcae-d264-4ea2-b7b5-b02d55489ee0 req-562faae2-45f7-4b17-86fe-a0291b6493d5 service nova] Creating event network-vif-unplugged:70821ef2-9856-4c6f-b5f5-69d62c36c8b7 for instance f55b114d-9a13-46f1-ac8c-c8279476cd3d on n-h2-master-1 Jun 20 12:08:07.660285 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [req-0b0cdcae-d264-4ea2-b7b5-b02d55489ee0 req-562faae2-45f7-4b17-86fe-a0291b6493d5 service nova] Instance f55b114d-9a13-46f1-ac8c-c8279476cd3d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119127) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:08:07.676058 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-0b0cdcae-d264-4ea2-b7b5-b02d55489ee0 req-562faae2-45f7-4b17-86fe-a0291b6493d5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116832 Jun 20 12:08:07.677803 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1200/2410] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:08:07.686317 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fff75b18-e985-4a64-8f17-67a384becd1e tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:07.687679 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fff75b18-e985-4a64-8f17-67a384becd1e tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] [instance: b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:07.705587 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fff75b18-e985-4a64-8f17-67a384becd1e tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:07.707772 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fff75b18-e985-4a64-8f17-67a384becd1e tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:07.709159 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fff75b18-e985-4a64-8f17-67a384becd1e tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:07.711880 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fff75b18-e985-4a64-8f17-67a384becd1e tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:07.870055 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fff75b18-e985-4a64-8f17-67a384becd1e tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9af66464b24c7d94da13df37b3fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10736c37317b4806b9ff323ad4c867b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:07.881143 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fff75b18-e985-4a64-8f17-67a384becd1e tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] 10.222.0.27 "GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee" status: 200 len: 1282 microversion: 2.1 time: 0.200847 Jun 20 12:08:07.899078 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1201/2411] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:07 2022] GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee => generated 1282 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:07.906696 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bf5afbde-9374-4563-8aa1-c80ea61ecde5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:07.910780 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bf5afbde-9374-4563-8aa1-c80ea61ecde5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:07.918460 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf5afbde-9374-4563-8aa1-c80ea61ecde5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:07.919416 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf5afbde-9374-4563-8aa1-c80ea61ecde5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:07.920447 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf5afbde-9374-4563-8aa1-c80ea61ecde5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:07.921090 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf5afbde-9374-4563-8aa1-c80ea61ecde5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:08.275163 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bf5afbde-9374-4563-8aa1-c80ea61ecde5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:08.285972 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bf5afbde-9374-4563-8aa1-c80ea61ecde5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6" status: 200 len: 1317 microversion: 2.1 time: 0.384575 Jun 20 12:08:08.293118 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1202/2412] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:07 2022] GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 => generated 1317 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:08.298325 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8720897c-1bc4-4bb8-8c14-de506e9f061b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:08.303438 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8720897c-1bc4-4bb8-8c14-de506e9f061b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: ed397d7b-8f66-46c9-b225-1cec5c844672] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:08.317753 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8720897c-1bc4-4bb8-8c14-de506e9f061b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:08.318215 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8720897c-1bc4-4bb8-8c14-de506e9f061b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:08.319217 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8720897c-1bc4-4bb8-8c14-de506e9f061b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:08.322203 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8720897c-1bc4-4bb8-8c14-de506e9f061b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:08.362048 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8720897c-1bc4-4bb8-8c14-de506e9f061b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: ed397d7b-8f66-46c9-b225-1cec5c844672] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:08:08.469192 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8720897c-1bc4-4bb8-8c14-de506e9f061b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672" status: 204 len: 0 microversion: 2.1 time: 0.174344 Jun 20 12:08:08.469938 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1203/2413] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:08:08 2022] DELETE /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:08.485493 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-ff44accf-a490-4da3-8b46-26e2a5cd1410 req-bdbae48f-e3c1-449c-af9f-376bd5fa5e11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6", "tag": "ff016fe7-8d08-4738-af2e-92d27304ced2"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:08:08.496778 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ff44accf-a490-4da3-8b46-26e2a5cd1410 req-bdbae48f-e3c1-449c-af9f-376bd5fa5e11 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:08.497469 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ff44accf-a490-4da3-8b46-26e2a5cd1410 req-bdbae48f-e3c1-449c-af9f-376bd5fa5e11 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:08.502008 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4d9c3dad-1602-4a1e-b5d9-991eac2c173a tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998/action" status: 202 len: 0 microversion: 2.1 time: 3.055552 Jun 20 12:08:08.503378 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1211/2414] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:08:05 2022] POST /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998/action => generated 0 bytes in 3057 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:08:08.518971 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-ff44accf-a490-4da3-8b46-26e2a5cd1410 req-bdbae48f-e3c1-449c-af9f-376bd5fa5e11 service nova] Creating event network-changed:ff016fe7-8d08-4738-af2e-92d27304ced2 for instance 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 on n-h1-master-1 Jun 20 12:08:08.524846 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-ff44accf-a490-4da3-8b46-26e2a5cd1410 req-bdbae48f-e3c1-449c-af9f-376bd5fa5e11 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053428 Jun 20 12:08:08.525944 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1204/2415] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:08:08.537677 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0796506f-bf1d-433e-92c1-3884216732d8 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:08.539640 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-48932cd1-4879-45ac-81c7-638059fad01d req-30f1b6fb-e172-42f1-baa5-219ae591bc1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed397d7b-8f66-46c9-b225-1cec5c844672", "name": "network-vif-unplugged", "status": "completed", "tag": "5c664946-8cfb-453b-81bf-a572f5c306af"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:08:08.540797 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0796506f-bf1d-433e-92c1-3884216732d8 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:08.550693 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0796506f-bf1d-433e-92c1-3884216732d8 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:08.551560 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0796506f-bf1d-433e-92c1-3884216732d8 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:08.554307 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0796506f-bf1d-433e-92c1-3884216732d8 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:08.555022 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0796506f-bf1d-433e-92c1-3884216732d8 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:08.586462 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-48932cd1-4879-45ac-81c7-638059fad01d req-30f1b6fb-e172-42f1-baa5-219ae591bc1d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:08.592337 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-48932cd1-4879-45ac-81c7-638059fad01d req-30f1b6fb-e172-42f1-baa5-219ae591bc1d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:08.637578 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-48932cd1-4879-45ac-81c7-638059fad01d req-30f1b6fb-e172-42f1-baa5-219ae591bc1d service nova] Creating event network-vif-unplugged:5c664946-8cfb-453b-81bf-a572f5c306af for instance ed397d7b-8f66-46c9-b225-1cec5c844672 on n-h1-master-1 Jun 20 12:08:08.657695 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-48932cd1-4879-45ac-81c7-638059fad01d req-30f1b6fb-e172-42f1-baa5-219ae591bc1d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.151854 Jun 20 12:08:08.661519 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1212/2416] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:08:08.679701 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ece6b0b8-b81d-4c4d-9a80-4961b142fcbe tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:08.684819 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ece6b0b8-b81d-4c4d-9a80-4961b142fcbe tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:08.696707 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ece6b0b8-b81d-4c4d-9a80-4961b142fcbe tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:08.699651 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ece6b0b8-b81d-4c4d-9a80-4961b142fcbe tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:08.702243 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ece6b0b8-b81d-4c4d-9a80-4961b142fcbe tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:08.703710 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ece6b0b8-b81d-4c4d-9a80-4961b142fcbe tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:08.957435 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0796506f-bf1d-433e-92c1-3884216732d8 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:08.969994 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0796506f-bf1d-433e-92c1-3884216732d8 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1389 microversion: 2.1 time: 0.442657 Jun 20 12:08:08.970760 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1205/2417] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:08 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1389 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:08.980381 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4029ae0f-bf0f-49ac-85b9-ff8a9509f3d2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1598536923", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "ab5a97aa-06fd-4e21-892e-d2f2bb854bdb"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:08:09.059753 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-4029ae0f-bf0f-49ac-85b9-ff8a9509f3d2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] validate_networks() for [('ab5a97aa-06fd-4e21-892e-d2f2bb854bdb', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:08:09.351792 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ece6b0b8-b81d-4c4d-9a80-4961b142fcbe tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:09.361827 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ece6b0b8-b81d-4c4d-9a80-4961b142fcbe tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 200 len: 1474 microversion: 2.1 time: 0.697280 Jun 20 12:08:09.363419 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1213/2418] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:08 2022] GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 1474 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:09.373405 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b15c6931-f647-4fc1-bcdc-58b5fa8a557e tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:09.374089 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b15c6931-f647-4fc1-bcdc-58b5fa8a557e tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] [instance: b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:09.389519 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b15c6931-f647-4fc1-bcdc-58b5fa8a557e tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:09.390727 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b15c6931-f647-4fc1-bcdc-58b5fa8a557e tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:09.391968 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b15c6931-f647-4fc1-bcdc-58b5fa8a557e tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:09.392677 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b15c6931-f647-4fc1-bcdc-58b5fa8a557e tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:09.892152 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b15c6931-f647-4fc1-bcdc-58b5fa8a557e tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9af66464b24c7d94da13df37b3fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10736c37317b4806b9ff323ad4c867b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:09.906989 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b15c6931-f647-4fc1-bcdc-58b5fa8a557e tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] 10.222.0.27 "GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee" status: 200 len: 1324 microversion: 2.1 time: 0.540791 Jun 20 12:08:09.909086 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1214/2419] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:09 2022] GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee => generated 1324 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:09.934557 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f4accb7d-b327-46ba-ae11-bf103e4756b0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:09.935195 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f4accb7d-b327-46ba-ae11-bf103e4756b0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:09.950021 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f4accb7d-b327-46ba-ae11-bf103e4756b0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:09.950480 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f4accb7d-b327-46ba-ae11-bf103e4756b0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:09.951269 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f4accb7d-b327-46ba-ae11-bf103e4756b0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:09.951703 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f4accb7d-b327-46ba-ae11-bf103e4756b0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:10.365579 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f4accb7d-b327-46ba-ae11-bf103e4756b0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:10.386350 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f4accb7d-b327-46ba-ae11-bf103e4756b0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6" status: 200 len: 1317 microversion: 2.1 time: 0.455954 Jun 20 12:08:10.394433 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1215/2420] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:09 2022] GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 => generated 1317 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:10.409935 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-f952ed1f-acc5-4b5e-a4bc-28ca1295fc2b req-6b33ec66-2717-4986-9725-57d586ff68e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f55b114d-9a13-46f1-ac8c-c8279476cd3d", "tag": "70821ef2-9856-4c6f-b5f5-69d62c36c8b7"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:08:10.434698 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-f952ed1f-acc5-4b5e-a4bc-28ca1295fc2b req-6b33ec66-2717-4986-9725-57d586ff68e3 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:10.437209 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-f952ed1f-acc5-4b5e-a4bc-28ca1295fc2b req-6b33ec66-2717-4986-9725-57d586ff68e3 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:10.468574 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-f952ed1f-acc5-4b5e-a4bc-28ca1295fc2b req-6b33ec66-2717-4986-9725-57d586ff68e3 service nova] Creating event network-changed:70821ef2-9856-4c6f-b5f5-69d62c36c8b7 for instance f55b114d-9a13-46f1-ac8c-c8279476cd3d on n-h2-master-1 Jun 20 12:08:10.477047 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [req-f952ed1f-acc5-4b5e-a4bc-28ca1295fc2b req-6b33ec66-2717-4986-9725-57d586ff68e3 service nova] Instance f55b114d-9a13-46f1-ac8c-c8279476cd3d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:08:10.492379 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-f952ed1f-acc5-4b5e-a4bc-28ca1295fc2b req-6b33ec66-2717-4986-9725-57d586ff68e3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086366 Jun 20 12:08:10.493707 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1216/2421] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:08:10.503018 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-aec57d2b-bae3-490c-b45b-82b89d7f3a82 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:10.504854 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-aec57d2b-bae3-490c-b45b-82b89d7f3a82 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:10.513363 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aec57d2b-bae3-490c-b45b-82b89d7f3a82 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:10.514196 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aec57d2b-bae3-490c-b45b-82b89d7f3a82 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:10.515316 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aec57d2b-bae3-490c-b45b-82b89d7f3a82 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:10.515951 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aec57d2b-bae3-490c-b45b-82b89d7f3a82 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:10.810045 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-aec57d2b-bae3-490c-b45b-82b89d7f3a82 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:10.823301 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-aec57d2b-bae3-490c-b45b-82b89d7f3a82 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1389 microversion: 2.1 time: 0.327391 Jun 20 12:08:10.824550 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1217/2422] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:10 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1389 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:10.830490 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-572657c5-df95-4211-b727-00bf90d5845b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:10.831096 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-572657c5-df95-4211-b727-00bf90d5845b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:10.840188 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-572657c5-df95-4211-b727-00bf90d5845b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:10.840704 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-572657c5-df95-4211-b727-00bf90d5845b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:10.841817 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-572657c5-df95-4211-b727-00bf90d5845b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:10.842386 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-572657c5-df95-4211-b727-00bf90d5845b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:11.061572 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-4029ae0f-bf0f-49ac-85b9-ff8a9509f3d2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:08:11.067512 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-4029ae0f-bf0f-49ac-85b9-ff8a9509f3d2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:08:11.071015 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-4029ae0f-bf0f-49ac-85b9-ff8a9509f3d2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:08:11.072771 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-4029ae0f-bf0f-49ac-85b9-ff8a9509f3d2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:08:11.073535 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-4029ae0f-bf0f-49ac-85b9-ff8a9509f3d2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:08:11.084966 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4029ae0f-bf0f-49ac-85b9-ff8a9509f3d2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:11.085846 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4029ae0f-bf0f-49ac-85b9-ff8a9509f3d2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:11.086801 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4029ae0f-bf0f-49ac-85b9-ff8a9509f3d2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:11.088037 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4029ae0f-bf0f-49ac-85b9-ff8a9509f3d2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:11.116822 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-4029ae0f-bf0f-49ac-85b9-ff8a9509f3d2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Getting quotas for project 615573a78a9d4e75a36ada9bd9de7e15. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:08:11.124258 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-4029ae0f-bf0f-49ac-85b9-ff8a9509f3d2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Getting quotas for user 8b2304d9c7dd493983542a54b6799989 and project 615573a78a9d4e75a36ada9bd9de7e15. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:08:11.144600 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4029ae0f-bf0f-49ac-85b9-ff8a9509f3d2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:08:11.147428 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4029ae0f-bf0f-49ac-85b9-ff8a9509f3d2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 04d7e9f8-3f73-460e-8dec-c50c7f277874] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:08:11.214510 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4029ae0f-bf0f-49ac-85b9-ff8a9509f3d2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.241184 Jun 20 12:08:11.215209 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1206/2423] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:08:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2244 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:08:11.223409 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-71cc014e-051b-49eb-8f89-f59743cae4f0 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:11.224298 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-71cc014e-051b-49eb-8f89-f59743cae4f0 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] [instance: b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:11.234434 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-71cc014e-051b-49eb-8f89-f59743cae4f0 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:11.235222 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-71cc014e-051b-49eb-8f89-f59743cae4f0 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:11.237100 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-71cc014e-051b-49eb-8f89-f59743cae4f0 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:11.237871 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-71cc014e-051b-49eb-8f89-f59743cae4f0 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:12.115917 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-572657c5-df95-4211-b727-00bf90d5845b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:12.135374 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-572657c5-df95-4211-b727-00bf90d5845b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 200 len: 1474 microversion: 2.1 time: 1.307221 Jun 20 12:08:12.138960 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1218/2424] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:10 2022] GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 1474 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:12.153205 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b73153c1-aef2-440b-93b7-12d802b702e0 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:12.153598 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b73153c1-aef2-440b-93b7-12d802b702e0 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 04d7e9f8-3f73-460e-8dec-c50c7f277874] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:12.174374 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b73153c1-aef2-440b-93b7-12d802b702e0 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:12.174831 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b73153c1-aef2-440b-93b7-12d802b702e0 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:12.175709 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b73153c1-aef2-440b-93b7-12d802b702e0 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:12.184954 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b73153c1-aef2-440b-93b7-12d802b702e0 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:12.313372 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-71cc014e-051b-49eb-8f89-f59743cae4f0 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9af66464b24c7d94da13df37b3fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10736c37317b4806b9ff323ad4c867b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:12.324269 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-71cc014e-051b-49eb-8f89-f59743cae4f0 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] 10.222.0.27 "GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee" status: 200 len: 1324 microversion: 2.1 time: 1.105998 Jun 20 12:08:12.325784 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1207/2425] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:11 2022] GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee => generated 1324 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:12.339136 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fc77fdba-4ab7-42f0-9be9-7abaafdf01cb tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:12.339766 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fc77fdba-4ab7-42f0-9be9-7abaafdf01cb tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:12.348814 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fc77fdba-4ab7-42f0-9be9-7abaafdf01cb tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:12.349776 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fc77fdba-4ab7-42f0-9be9-7abaafdf01cb tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:12.352648 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fc77fdba-4ab7-42f0-9be9-7abaafdf01cb tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:12.354071 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fc77fdba-4ab7-42f0-9be9-7abaafdf01cb tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:12.362343 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:12.574333 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b73153c1-aef2-440b-93b7-12d802b702e0 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:12.597709 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b73153c1-aef2-440b-93b7-12d802b702e0 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/04d7e9f8-3f73-460e-8dec-c50c7f277874" status: 200 len: 1204 microversion: 2.1 time: 0.455544 Jun 20 12:08:12.611912 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1219/2426] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:12 2022] GET /compute/v2.1/servers/04d7e9f8-3f73-460e-8dec-c50c7f277874 => generated 1204 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:12.622211 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-59e228e1-116d-4ec3-ab2e-75da5e39a199 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:12.623520 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-59e228e1-116d-4ec3-ab2e-75da5e39a199 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:12.635317 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-59e228e1-116d-4ec3-ab2e-75da5e39a199 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:12.636302 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-59e228e1-116d-4ec3-ab2e-75da5e39a199 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:12.638607 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-59e228e1-116d-4ec3-ab2e-75da5e39a199 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:12.639449 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-59e228e1-116d-4ec3-ab2e-75da5e39a199 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:13.292890 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:13.516428 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fc77fdba-4ab7-42f0-9be9-7abaafdf01cb tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:13.538050 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fc77fdba-4ab7-42f0-9be9-7abaafdf01cb tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6" status: 200 len: 1317 microversion: 2.1 time: 1.211468 Jun 20 12:08:13.539178 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1208/2427] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:12 2022] GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 => generated 1317 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:13.558631 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9e077005-6a9e-4b85-a72a-291bf63c8e99 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:13.559275 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9e077005-6a9e-4b85-a72a-291bf63c8e99 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:13.577950 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9e077005-6a9e-4b85-a72a-291bf63c8e99 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:13.578603 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9e077005-6a9e-4b85-a72a-291bf63c8e99 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:13.579764 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9e077005-6a9e-4b85-a72a-291bf63c8e99 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:13.580544 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9e077005-6a9e-4b85-a72a-291bf63c8e99 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:13.729208 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-59e228e1-116d-4ec3-ab2e-75da5e39a199 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:13.747963 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-59e228e1-116d-4ec3-ab2e-75da5e39a199 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1389 microversion: 2.1 time: 1.134264 Jun 20 12:08:13.755253 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1220/2428] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:12 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1389 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:13.772103 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dbd75cbd-8ae8-4f89-9db9-9536d55e069c tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:13.785480 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-dbd75cbd-8ae8-4f89-9db9-9536d55e069c tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] [instance: b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:13.809628 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:13.827073 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dbd75cbd-8ae8-4f89-9db9-9536d55e069c tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:13.830796 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dbd75cbd-8ae8-4f89-9db9-9536d55e069c tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:13.839018 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dbd75cbd-8ae8-4f89-9db9-9536d55e069c tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:13.841161 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dbd75cbd-8ae8-4f89-9db9-9536d55e069c tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:14.117133 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9e077005-6a9e-4b85-a72a-291bf63c8e99 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:14.137365 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9e077005-6a9e-4b85-a72a-291bf63c8e99 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 200 len: 1471 microversion: 2.1 time: 0.579062 Jun 20 12:08:14.139595 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1209/2429] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:13 2022] GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 1471 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:14.153656 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ed696f76-4ea7-4f1a-8967-0f1694321f9a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:14.154518 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ed696f76-4ea7-4f1a-8967-0f1694321f9a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 04d7e9f8-3f73-460e-8dec-c50c7f277874] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:14.171358 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ed696f76-4ea7-4f1a-8967-0f1694321f9a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:14.172139 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ed696f76-4ea7-4f1a-8967-0f1694321f9a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:14.176248 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ed696f76-4ea7-4f1a-8967-0f1694321f9a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:14.177122 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ed696f76-4ea7-4f1a-8967-0f1694321f9a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:14.449269 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ed696f76-4ea7-4f1a-8967-0f1694321f9a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:14.466153 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ed696f76-4ea7-4f1a-8967-0f1694321f9a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/04d7e9f8-3f73-460e-8dec-c50c7f277874" status: 200 len: 1266 microversion: 2.1 time: 0.324241 Jun 20 12:08:14.469616 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1210/2430] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:14 2022] GET /compute/v2.1/servers/04d7e9f8-3f73-460e-8dec-c50c7f277874 => generated 1266 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:14.486098 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6725b282-4fc7-4094-aa2c-6811861a857a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:08:14.489712 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6725b282-4fc7-4094-aa2c-6811861a857a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:14.492408 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:14.530729 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6725b282-4fc7-4094-aa2c-6811861a857a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:14.532316 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6725b282-4fc7-4094-aa2c-6811861a857a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:14.533402 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6725b282-4fc7-4094-aa2c-6811861a857a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:14.534080 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6725b282-4fc7-4094-aa2c-6811861a857a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:14.646366 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6725b282-4fc7-4094-aa2c-6811861a857a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "POST /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d/action" status: 204 len: 0 microversion: 2.1 time: 0.173854 Jun 20 12:08:14.659875 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1211/2431] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:08:14 2022] POST /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d/action => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:14.697604 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e71812d8-19ba-4ce9-b381-ec963be1aefa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:14.700808 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e71812d8-19ba-4ce9-b381-ec963be1aefa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:14.715319 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e71812d8-19ba-4ce9-b381-ec963be1aefa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:14.716347 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e71812d8-19ba-4ce9-b381-ec963be1aefa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:14.717409 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e71812d8-19ba-4ce9-b381-ec963be1aefa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:14.718082 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e71812d8-19ba-4ce9-b381-ec963be1aefa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:15.133027 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-dbd75cbd-8ae8-4f89-9db9-9536d55e069c tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9af66464b24c7d94da13df37b3fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10736c37317b4806b9ff323ad4c867b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:15.158606 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dbd75cbd-8ae8-4f89-9db9-9536d55e069c tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] 10.222.0.27 "GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee" status: 200 len: 1324 microversion: 2.1 time: 1.400838 Jun 20 12:08:15.160604 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1221/2432] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:13 2022] GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee => generated 1324 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:15.173246 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-db3702ed-731f-40bb-a134-602d8f73bbbf tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:15.174415 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-db3702ed-731f-40bb-a134-602d8f73bbbf tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:15.185114 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-db3702ed-731f-40bb-a134-602d8f73bbbf tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:15.185996 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-db3702ed-731f-40bb-a134-602d8f73bbbf tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:15.195832 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-db3702ed-731f-40bb-a134-602d8f73bbbf tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:15.196482 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-db3702ed-731f-40bb-a134-602d8f73bbbf tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:15.324447 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=4 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:16.049847 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e71812d8-19ba-4ce9-b381-ec963be1aefa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:16.060714 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e71812d8-19ba-4ce9-b381-ec963be1aefa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6" status: 200 len: 1317 microversion: 2.1 time: 1.386620 Jun 20 12:08:16.065870 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1212/2433] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:14 2022] GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 => generated 1317 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:16.078165 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3ad32b8a-e66b-4e89-9673-fbe084acb867 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:16.079333 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3ad32b8a-e66b-4e89-9673-fbe084acb867 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:16.092257 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3ad32b8a-e66b-4e89-9673-fbe084acb867 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:16.093183 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3ad32b8a-e66b-4e89-9673-fbe084acb867 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:16.094582 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3ad32b8a-e66b-4e89-9673-fbe084acb867 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:16.096097 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3ad32b8a-e66b-4e89-9673-fbe084acb867 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:16.160982 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-db3702ed-731f-40bb-a134-602d8f73bbbf tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:16.173719 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-db3702ed-731f-40bb-a134-602d8f73bbbf tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 200 len: 1471 microversion: 2.1 time: 1.011735 Jun 20 12:08:16.174426 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1222/2434] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:15 2022] GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 1471 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:16.188670 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b86040af-c57d-4cb9-8c9f-d6846aa36157 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:16.189562 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b86040af-c57d-4cb9-8c9f-d6846aa36157 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 04d7e9f8-3f73-460e-8dec-c50c7f277874] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:16.200807 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b86040af-c57d-4cb9-8c9f-d6846aa36157 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:16.202045 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b86040af-c57d-4cb9-8c9f-d6846aa36157 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:16.203294 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b86040af-c57d-4cb9-8c9f-d6846aa36157 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:16.203909 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b86040af-c57d-4cb9-8c9f-d6846aa36157 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:16.499454 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b86040af-c57d-4cb9-8c9f-d6846aa36157 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:16.519332 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b86040af-c57d-4cb9-8c9f-d6846aa36157 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/04d7e9f8-3f73-460e-8dec-c50c7f277874" status: 200 len: 1266 microversion: 2.1 time: 0.342569 Jun 20 12:08:16.520448 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1223/2435] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:16 2022] GET /compute/v2.1/servers/04d7e9f8-3f73-460e-8dec-c50c7f277874 => generated 1266 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:16.547989 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ab684a5b-e067-4dd9-96aa-4a687e72a7da tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:16.548848 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ab684a5b-e067-4dd9-96aa-4a687e72a7da tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] [instance: b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:16.568181 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ab684a5b-e067-4dd9-96aa-4a687e72a7da tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:16.568659 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ab684a5b-e067-4dd9-96aa-4a687e72a7da tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:16.569520 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ab684a5b-e067-4dd9-96aa-4a687e72a7da tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:16.570082 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ab684a5b-e067-4dd9-96aa-4a687e72a7da tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:17.121898 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3ad32b8a-e66b-4e89-9673-fbe084acb867 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:17.135652 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3ad32b8a-e66b-4e89-9673-fbe084acb867 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1389 microversion: 2.1 time: 1.068206 Jun 20 12:08:17.144570 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1213/2436] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:16 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1389 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:17.163446 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-8593162e-6de6-47a6-a6d2-818c6c398e69 req-3afd60df-4c9f-4856-a662-dda2c6f83c47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed397d7b-8f66-46c9-b225-1cec5c844672", "name": "network-vif-deleted", "tag": "5c664946-8cfb-453b-81bf-a572f5c306af"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:08:17.187906 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-8593162e-6de6-47a6-a6d2-818c6c398e69 req-3afd60df-4c9f-4856-a662-dda2c6f83c47 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:17.190182 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-8593162e-6de6-47a6-a6d2-818c6c398e69 req-3afd60df-4c9f-4856-a662-dda2c6f83c47 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:17.214088 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-8593162e-6de6-47a6-a6d2-818c6c398e69 req-3afd60df-4c9f-4856-a662-dda2c6f83c47 service nova] Creating event network-vif-deleted:5c664946-8cfb-453b-81bf-a572f5c306af for instance ed397d7b-8f66-46c9-b225-1cec5c844672 on n-h1-master-1 Jun 20 12:08:17.230135 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-8593162e-6de6-47a6-a6d2-818c6c398e69 req-3afd60df-4c9f-4856-a662-dda2c6f83c47 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083381 Jun 20 12:08:17.231134 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1214/2437] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:08:17.243876 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4d10315b-7843-4161-b0f2-dd6eccc8067e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:17.244906 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4d10315b-7843-4161-b0f2-dd6eccc8067e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:17.256167 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d10315b-7843-4161-b0f2-dd6eccc8067e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:17.256806 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d10315b-7843-4161-b0f2-dd6eccc8067e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:17.257668 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d10315b-7843-4161-b0f2-dd6eccc8067e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:17.258106 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d10315b-7843-4161-b0f2-dd6eccc8067e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:17.836959 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ab684a5b-e067-4dd9-96aa-4a687e72a7da tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9af66464b24c7d94da13df37b3fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10736c37317b4806b9ff323ad4c867b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:17.852549 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ab684a5b-e067-4dd9-96aa-4a687e72a7da tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] 10.222.0.27 "GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee" status: 200 len: 1324 microversion: 2.1 time: 1.318834 Jun 20 12:08:17.854224 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1224/2438] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:16 2022] GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee => generated 1324 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:17.864683 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bada2f02-8a23-43cb-b543-29af2f6a962d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:17.870624 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bada2f02-8a23-43cb-b543-29af2f6a962d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:17.885805 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bada2f02-8a23-43cb-b543-29af2f6a962d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:17.886579 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bada2f02-8a23-43cb-b543-29af2f6a962d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:17.889115 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bada2f02-8a23-43cb-b543-29af2f6a962d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:17.892303 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bada2f02-8a23-43cb-b543-29af2f6a962d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:18.596075 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-bada2f02-8a23-43cb-b543-29af2f6a962d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:18.612699 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bada2f02-8a23-43cb-b543-29af2f6a962d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 200 len: 1471 microversion: 2.1 time: 0.754617 Jun 20 12:08:18.613427 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1225/2439] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:17 2022] GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 1471 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:18.635489 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c554d622-3343-4ddd-af70-72fc48fa562b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:18.636370 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c554d622-3343-4ddd-af70-72fc48fa562b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 04d7e9f8-3f73-460e-8dec-c50c7f277874] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:18.655458 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c554d622-3343-4ddd-af70-72fc48fa562b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:18.656062 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c554d622-3343-4ddd-af70-72fc48fa562b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:18.660031 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c554d622-3343-4ddd-af70-72fc48fa562b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:18.660813 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c554d622-3343-4ddd-af70-72fc48fa562b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:19.419289 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4d10315b-7843-4161-b0f2-dd6eccc8067e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:19.434482 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4d10315b-7843-4161-b0f2-dd6eccc8067e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6" status: 200 len: 1317 microversion: 2.1 time: 2.202043 Jun 20 12:08:19.442121 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1215/2440] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:17 2022] GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 => generated 1317 bytes in 2210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:19.448036 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-28b8eff2-6487-4bc2-b9a9-c03ed735a18a req-c176547a-be5f-47e3-980a-5f36700b9633 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f55b114d-9a13-46f1-ac8c-c8279476cd3d", "name": "network-vif-plugged", "status": "completed", "tag": "70821ef2-9856-4c6f-b5f5-69d62c36c8b7"}, {"server_uuid": "0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6", "name": "network-vif-plugged", "status": "completed", "tag": "ff016fe7-8d08-4738-af2e-92d27304ced2"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:08:19.469832 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-28b8eff2-6487-4bc2-b9a9-c03ed735a18a req-c176547a-be5f-47e3-980a-5f36700b9633 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:19.470287 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-28b8eff2-6487-4bc2-b9a9-c03ed735a18a req-c176547a-be5f-47e3-980a-5f36700b9633 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:19.501986 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-28b8eff2-6487-4bc2-b9a9-c03ed735a18a req-c176547a-be5f-47e3-980a-5f36700b9633 service nova] Creating event network-vif-plugged:70821ef2-9856-4c6f-b5f5-69d62c36c8b7 for instance f55b114d-9a13-46f1-ac8c-c8279476cd3d on n-h2-master-1 Jun 20 12:08:19.502796 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-28b8eff2-6487-4bc2-b9a9-c03ed735a18a req-c176547a-be5f-47e3-980a-5f36700b9633 service nova] Creating event network-vif-plugged:ff016fe7-8d08-4738-af2e-92d27304ced2 for instance 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 on n-h1-master-1 Jun 20 12:08:19.521247 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-28b8eff2-6487-4bc2-b9a9-c03ed735a18a req-c176547a-be5f-47e3-980a-5f36700b9633 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.076724 Jun 20 12:08:19.525012 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1216/2441] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:08:19.545918 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b0b5d05f-3676-4e3d-8e2b-1cb03bf78eb0 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:19.547301 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b0b5d05f-3676-4e3d-8e2b-1cb03bf78eb0 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:19.577601 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b0b5d05f-3676-4e3d-8e2b-1cb03bf78eb0 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:19.578379 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b0b5d05f-3676-4e3d-8e2b-1cb03bf78eb0 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:19.595639 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b0b5d05f-3676-4e3d-8e2b-1cb03bf78eb0 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:19.596505 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b0b5d05f-3676-4e3d-8e2b-1cb03bf78eb0 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:20.116012 n-d-master-1 devstack@n-api.service[119127]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 12:08:20.116697 n-d-master-1 devstack@n-api.service[119127]: Mon Jun 20 12:08:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 (ip 10.222.0.27) !!! Jun 20 12:08:20.252436 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b0b5d05f-3676-4e3d-8e2b-1cb03bf78eb0 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:20.262433 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b0b5d05f-3676-4e3d-8e2b-1cb03bf78eb0 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1389 microversion: 2.1 time: 0.735536 Jun 20 12:08:20.263787 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1217/2442] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:19 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1389 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:20.268714 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-64d68dcf-65a6-4b12-b651-7ab8d34f0a38 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:20.274067 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-64d68dcf-65a6-4b12-b651-7ab8d34f0a38 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] [instance: b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:20.303607 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-64d68dcf-65a6-4b12-b651-7ab8d34f0a38 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:20.304656 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-64d68dcf-65a6-4b12-b651-7ab8d34f0a38 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:20.305805 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-64d68dcf-65a6-4b12-b651-7ab8d34f0a38 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:20.306490 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-64d68dcf-65a6-4b12-b651-7ab8d34f0a38 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:20.648274 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c554d622-3343-4ddd-af70-72fc48fa562b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:20.665284 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c554d622-3343-4ddd-af70-72fc48fa562b tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/04d7e9f8-3f73-460e-8dec-c50c7f277874" status: 200 len: 1308 microversion: 2.1 time: 2.047748 Jun 20 12:08:20.666625 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1226/2443] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:18 2022] GET /compute/v2.1/servers/04d7e9f8-3f73-460e-8dec-c50c7f277874 => generated 1308 bytes in 2052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:20.680599 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ac260300-ccaf-473f-a6e2-cd348f058458 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:20.691200 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ac260300-ccaf-473f-a6e2-cd348f058458 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:20.736110 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ac260300-ccaf-473f-a6e2-cd348f058458 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:20.745216 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ac260300-ccaf-473f-a6e2-cd348f058458 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:20.746846 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ac260300-ccaf-473f-a6e2-cd348f058458 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:20.747826 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ac260300-ccaf-473f-a6e2-cd348f058458 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:20.888084 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-64d68dcf-65a6-4b12-b651-7ab8d34f0a38 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9af66464b24c7d94da13df37b3fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10736c37317b4806b9ff323ad4c867b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:20.897199 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-64d68dcf-65a6-4b12-b651-7ab8d34f0a38 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] 10.222.0.27 "GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee" status: 200 len: 1324 microversion: 2.1 time: 0.631965 Jun 20 12:08:20.917696 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1218/2444] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:20 2022] GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee => generated 1324 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:20.924648 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-2769914f-b6f9-4f0a-a6ab-f485ce8afe63 req-6675940b-e371-4df7-a3a8-dd2c84f63148 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee", "tag": "b3967d6d-0dc9-4f2e-b91b-570238dc31d4"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:08:20.934980 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-2769914f-b6f9-4f0a-a6ab-f485ce8afe63 req-6675940b-e371-4df7-a3a8-dd2c84f63148 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:20.935799 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-2769914f-b6f9-4f0a-a6ab-f485ce8afe63 req-6675940b-e371-4df7-a3a8-dd2c84f63148 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:20.961381 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-2769914f-b6f9-4f0a-a6ab-f485ce8afe63 req-6675940b-e371-4df7-a3a8-dd2c84f63148 service nova] Creating event network-changed:b3967d6d-0dc9-4f2e-b91b-570238dc31d4 for instance b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee on n-h2-master-1 Jun 20 12:08:20.967757 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-2769914f-b6f9-4f0a-a6ab-f485ce8afe63 req-6675940b-e371-4df7-a3a8-dd2c84f63148 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048124 Jun 20 12:08:20.969130 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1219/2445] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:08:20.974650 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dc02af25-970d-4861-87be-9bf900cd93a5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:20.976114 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dc02af25-970d-4861-87be-9bf900cd93a5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:20.985492 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc02af25-970d-4861-87be-9bf900cd93a5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:20.986525 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc02af25-970d-4861-87be-9bf900cd93a5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:20.987586 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc02af25-970d-4861-87be-9bf900cd93a5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:20.988725 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc02af25-970d-4861-87be-9bf900cd93a5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:21.107778 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:21.139854 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=8 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:21.182218 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dc02af25-970d-4861-87be-9bf900cd93a5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:21.198522 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dc02af25-970d-4861-87be-9bf900cd93a5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6" status: 200 len: 1317 microversion: 2.1 time: 0.227589 Jun 20 12:08:21.200499 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1220/2446] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:20 2022] GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:21.282223 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b41d1632-2569-43af-98c5-a9aea3568c75 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:21.284410 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b41d1632-2569-43af-98c5-a9aea3568c75 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:21.299073 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b41d1632-2569-43af-98c5-a9aea3568c75 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:21.299931 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b41d1632-2569-43af-98c5-a9aea3568c75 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:21.301003 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b41d1632-2569-43af-98c5-a9aea3568c75 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:21.301679 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b41d1632-2569-43af-98c5-a9aea3568c75 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:21.463621 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ac260300-ccaf-473f-a6e2-cd348f058458 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:21.474454 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ac260300-ccaf-473f-a6e2-cd348f058458 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 200 len: 1463 microversion: 2.1 time: 0.806353 Jun 20 12:08:21.481664 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1227/2447] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:20 2022] GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 1463 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:21.509585 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-02cbc811-14db-4266-bf2e-9090093949fd tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:21.510573 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-02cbc811-14db-4266-bf2e-9090093949fd tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:21.528986 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-02cbc811-14db-4266-bf2e-9090093949fd tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:21.529562 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-02cbc811-14db-4266-bf2e-9090093949fd tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:21.530443 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-02cbc811-14db-4266-bf2e-9090093949fd tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:21.530881 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-02cbc811-14db-4266-bf2e-9090093949fd tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:21.784867 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b41d1632-2569-43af-98c5-a9aea3568c75 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:21.818148 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b41d1632-2569-43af-98c5-a9aea3568c75 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1389 microversion: 2.1 time: 0.531678 Jun 20 12:08:21.818913 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1221/2448] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:21 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1389 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:21.831199 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dbc8528a-fda1-4c10-8d0c-d1641f5af3c2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:21.832633 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dbc8528a-fda1-4c10-8d0c-d1641f5af3c2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 04d7e9f8-3f73-460e-8dec-c50c7f277874] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:21.842799 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dbc8528a-fda1-4c10-8d0c-d1641f5af3c2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:21.843550 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dbc8528a-fda1-4c10-8d0c-d1641f5af3c2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:21.845374 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dbc8528a-fda1-4c10-8d0c-d1641f5af3c2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:21.848083 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dbc8528a-fda1-4c10-8d0c-d1641f5af3c2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:22.285361 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-02cbc811-14db-4266-bf2e-9090093949fd tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:22.303083 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-02cbc811-14db-4266-bf2e-9090093949fd tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 200 len: 1463 microversion: 2.1 time: 0.806801 Jun 20 12:08:22.319759 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1228/2449] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:21 2022] GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 1463 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:22.319759 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b5079ff5-8da5-4658-a2ba-a99fa6949c8e tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:22.319759 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b5079ff5-8da5-4658-a2ba-a99fa6949c8e tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] [instance: b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:22.346651 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b5079ff5-8da5-4658-a2ba-a99fa6949c8e tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:22.347103 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b5079ff5-8da5-4658-a2ba-a99fa6949c8e tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:22.347887 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b5079ff5-8da5-4658-a2ba-a99fa6949c8e tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:22.348351 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b5079ff5-8da5-4658-a2ba-a99fa6949c8e tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:22.432557 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:22.485674 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dbc8528a-fda1-4c10-8d0c-d1641f5af3c2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:22.512857 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dbc8528a-fda1-4c10-8d0c-d1641f5af3c2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/04d7e9f8-3f73-460e-8dec-c50c7f277874" status: 200 len: 1308 microversion: 2.1 time: 0.688581 Jun 20 12:08:22.528174 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1222/2450] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:21 2022] GET /compute/v2.1/servers/04d7e9f8-3f73-460e-8dec-c50c7f277874 => generated 1308 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:22.533782 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-01d256ad-d0df-4234-8c85-3d7aeaa6f02c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:22.545163 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-01d256ad-d0df-4234-8c85-3d7aeaa6f02c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:22.567568 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01d256ad-d0df-4234-8c85-3d7aeaa6f02c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:22.572380 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01d256ad-d0df-4234-8c85-3d7aeaa6f02c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:22.574929 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01d256ad-d0df-4234-8c85-3d7aeaa6f02c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:22.578700 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01d256ad-d0df-4234-8c85-3d7aeaa6f02c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:22.944282 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b5079ff5-8da5-4658-a2ba-a99fa6949c8e tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9af66464b24c7d94da13df37b3fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10736c37317b4806b9ff323ad4c867b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:22.985928 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b5079ff5-8da5-4658-a2ba-a99fa6949c8e tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] 10.222.0.27 "GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee" status: 200 len: 1324 microversion: 2.1 time: 0.674597 Jun 20 12:08:22.995038 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1229/2451] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:22 2022] GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee => generated 1324 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:23.012321 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-24c7cae4-083c-4b39-8b9b-9efe012c91db tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Action: 'create', calling method: .version_select at 0x7f6073901c10>, body: {"keypair": {"name": "tempest-keypair-425251801", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMH9S8II5HDkPFMBwZqHKQMX4w/SmSyhyT/j1P4vYTA6QBTlghkJvOwYS2c5/3IYiRkT90KARSBGsFba2Vgi6QNmAd9cozROXjPnIapdKZgoxako3Ztr6lb/PoekmmOdQ=="}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:08:23.056476 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-24c7cae4-083c-4b39-8b9b-9efe012c91db tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Getting quotas for project 4440dc3e2f9c4134a54b08e2585f6c59. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:08:23.064699 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-24c7cae4-083c-4b39-8b9b-9efe012c91db tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Getting quotas for user 3d35b7c824b641099a406175bccc5be3 and project 4440dc3e2f9c4134a54b08e2585f6c59. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:08:23.105942 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-24c7cae4-083c-4b39-8b9b-9efe012c91db tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.104677 Jun 20 12:08:23.107162 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1230/2452] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 12:08:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:08:23.131870 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-73a553a8-ff20-4a70-b08b-6ee0549b2600 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:23.133033 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-73a553a8-ff20-4a70-b08b-6ee0549b2600 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:23.164122 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-73a553a8-ff20-4a70-b08b-6ee0549b2600 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:23.164974 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-73a553a8-ff20-4a70-b08b-6ee0549b2600 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:23.166884 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-73a553a8-ff20-4a70-b08b-6ee0549b2600 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:23.168667 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-73a553a8-ff20-4a70-b08b-6ee0549b2600 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:23.384498 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-01d256ad-d0df-4234-8c85-3d7aeaa6f02c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:23.407927 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-01d256ad-d0df-4234-8c85-3d7aeaa6f02c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6" status: 200 len: 1507 microversion: 2.1 time: 0.877449 Jun 20 12:08:23.425028 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1223/2453] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:22 2022] GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 => generated 1507 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:23.443270 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-23771fd9-7df8-4a6b-87b6-56469f1d0570 req-89e16e92-7ce3-44f0-b5fa-d45fa836521b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04d7e9f8-3f73-460e-8dec-c50c7f277874", "tag": "a127a63d-0773-4978-8627-004c7446b307"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:08:23.471850 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-23771fd9-7df8-4a6b-87b6-56469f1d0570 req-89e16e92-7ce3-44f0-b5fa-d45fa836521b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:23.472627 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-23771fd9-7df8-4a6b-87b6-56469f1d0570 req-89e16e92-7ce3-44f0-b5fa-d45fa836521b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:23.496778 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-23771fd9-7df8-4a6b-87b6-56469f1d0570 req-89e16e92-7ce3-44f0-b5fa-d45fa836521b service nova] Creating event network-changed:a127a63d-0773-4978-8627-004c7446b307 for instance 04d7e9f8-3f73-460e-8dec-c50c7f277874 on n-h1-master-1 Jun 20 12:08:23.503186 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-23771fd9-7df8-4a6b-87b6-56469f1d0570 req-89e16e92-7ce3-44f0-b5fa-d45fa836521b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076219 Jun 20 12:08:23.505726 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1224/2454] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:08:23.512505 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f5a764bf-8d10-4768-9d13-65b647e82bf8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:23.513865 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f5a764bf-8d10-4768-9d13-65b647e82bf8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:23.522895 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5a764bf-8d10-4768-9d13-65b647e82bf8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:23.524130 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5a764bf-8d10-4768-9d13-65b647e82bf8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:23.525896 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5a764bf-8d10-4768-9d13-65b647e82bf8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:23.526589 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5a764bf-8d10-4768-9d13-65b647e82bf8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:23.567379 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f5a764bf-8d10-4768-9d13-65b647e82bf8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:08:23.612804 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:23.745089 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f5a764bf-8d10-4768-9d13-65b647e82bf8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6" status: 204 len: 0 microversion: 2.1 time: 0.234766 Jun 20 12:08:23.747691 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1225/2455] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:08:23 2022] DELETE /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:23.763315 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-28763a4a-2c15-4e58-a026-81fac8f90cab tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:23.767191 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-28763a4a-2c15-4e58-a026-81fac8f90cab tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 04d7e9f8-3f73-460e-8dec-c50c7f277874] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:23.781832 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28763a4a-2c15-4e58-a026-81fac8f90cab tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:23.782365 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28763a4a-2c15-4e58-a026-81fac8f90cab tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:23.783283 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28763a4a-2c15-4e58-a026-81fac8f90cab tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:23.783784 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28763a4a-2c15-4e58-a026-81fac8f90cab tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:23.786501 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-73a553a8-ff20-4a70-b08b-6ee0549b2600 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:23.802624 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-73a553a8-ff20-4a70-b08b-6ee0549b2600 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1389 microversion: 2.1 time: 0.690910 Jun 20 12:08:23.804840 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1231/2456] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:23 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1389 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:23.819279 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-55620c46-5f98-4617-ad84-d73911967934 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:23.822967 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-55620c46-5f98-4617-ad84-d73911967934 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:23.845369 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-55620c46-5f98-4617-ad84-d73911967934 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:23.845369 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-55620c46-5f98-4617-ad84-d73911967934 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:23.846807 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-55620c46-5f98-4617-ad84-d73911967934 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:23.847603 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-55620c46-5f98-4617-ad84-d73911967934 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:24.577539 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-55620c46-5f98-4617-ad84-d73911967934 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:24.614507 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-55620c46-5f98-4617-ad84-d73911967934 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6" status: 200 len: 1513 microversion: 2.1 time: 0.807997 Jun 20 12:08:24.614909 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1232/2457] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:23 2022] GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 => generated 1513 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:24.625835 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e3346f27-6b60-498a-a86c-37e377868f2b tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:24.626344 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e3346f27-6b60-498a-a86c-37e377868f2b tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] [instance: b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:24.646136 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e3346f27-6b60-498a-a86c-37e377868f2b tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:24.646592 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e3346f27-6b60-498a-a86c-37e377868f2b tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:24.647568 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e3346f27-6b60-498a-a86c-37e377868f2b tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:24.648046 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e3346f27-6b60-498a-a86c-37e377868f2b tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:24.788671 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-28763a4a-2c15-4e58-a026-81fac8f90cab tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:24.817019 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-28763a4a-2c15-4e58-a026-81fac8f90cab tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/04d7e9f8-3f73-460e-8dec-c50c7f277874" status: 200 len: 1308 microversion: 2.1 time: 1.065274 Jun 20 12:08:24.821562 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1226/2458] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:23 2022] GET /compute/v2.1/servers/04d7e9f8-3f73-460e-8dec-c50c7f277874 => generated 1308 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:24.839182 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-90968606-d676-4b53-8ab8-bc2ca1641581 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:24.840606 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-90968606-d676-4b53-8ab8-bc2ca1641581 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:24.853130 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-90968606-d676-4b53-8ab8-bc2ca1641581 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:24.854088 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-90968606-d676-4b53-8ab8-bc2ca1641581 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:24.855644 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-90968606-d676-4b53-8ab8-bc2ca1641581 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:24.865492 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-90968606-d676-4b53-8ab8-bc2ca1641581 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:25.196679 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e3346f27-6b60-498a-a86c-37e377868f2b tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9af66464b24c7d94da13df37b3fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10736c37317b4806b9ff323ad4c867b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:25.209808 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e3346f27-6b60-498a-a86c-37e377868f2b tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] 10.222.0.27 "GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee" status: 200 len: 1324 microversion: 2.1 time: 0.593387 Jun 20 12:08:25.211641 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1233/2459] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:24 2022] GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee => generated 1324 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:25.635025 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4e992039-324b-4124-b229-43989a60153e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:25.635656 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4e992039-324b-4124-b229-43989a60153e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:25.655282 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4e992039-324b-4124-b229-43989a60153e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:25.655648 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4e992039-324b-4124-b229-43989a60153e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:25.656472 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4e992039-324b-4124-b229-43989a60153e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:25.656912 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4e992039-324b-4124-b229-43989a60153e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:26.205394 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-90968606-d676-4b53-8ab8-bc2ca1641581 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:26.226150 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-90968606-d676-4b53-8ab8-bc2ca1641581 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1389 microversion: 2.1 time: 1.392092 Jun 20 12:08:26.227127 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1227/2460] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:24 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1389 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:26.236239 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-065eef9f-15df-4271-9f1f-611d11b86ddb tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:26.237295 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-065eef9f-15df-4271-9f1f-611d11b86ddb tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 04d7e9f8-3f73-460e-8dec-c50c7f277874] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:26.253210 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-065eef9f-15df-4271-9f1f-611d11b86ddb tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:26.254029 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-065eef9f-15df-4271-9f1f-611d11b86ddb tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:26.255655 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-065eef9f-15df-4271-9f1f-611d11b86ddb tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:26.257297 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4e992039-324b-4124-b229-43989a60153e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:26.264146 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-065eef9f-15df-4271-9f1f-611d11b86ddb tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:26.278575 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4e992039-324b-4124-b229-43989a60153e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6" status: 200 len: 1513 microversion: 2.1 time: 0.648045 Jun 20 12:08:26.285420 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1234/2461] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:25 2022] GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 => generated 1513 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:26.299076 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3bdb4109-f06c-48da-87a6-5791827e4ddc tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:26.304170 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3bdb4109-f06c-48da-87a6-5791827e4ddc tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] [instance: b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:26.320258 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3bdb4109-f06c-48da-87a6-5791827e4ddc tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:26.321464 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3bdb4109-f06c-48da-87a6-5791827e4ddc tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:26.322597 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3bdb4109-f06c-48da-87a6-5791827e4ddc tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:26.325781 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3bdb4109-f06c-48da-87a6-5791827e4ddc tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:27.035676 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3bdb4109-f06c-48da-87a6-5791827e4ddc tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9af66464b24c7d94da13df37b3fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10736c37317b4806b9ff323ad4c867b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:27.060450 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3bdb4109-f06c-48da-87a6-5791827e4ddc tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] 10.222.0.27 "GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee" status: 200 len: 1324 microversion: 2.1 time: 0.772248 Jun 20 12:08:27.067386 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1235/2462] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:26 2022] GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee => generated 1324 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:27.085949 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-6df62668-42c1-480d-bd5f-612f4b7ae952 req-2217df9f-f838-42bb-bf51-3662c9aa35eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6", "name": "network-vif-deleted", "tag": "ff016fe7-8d08-4738-af2e-92d27304ced2"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:08:27.110205 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-6df62668-42c1-480d-bd5f-612f4b7ae952 req-2217df9f-f838-42bb-bf51-3662c9aa35eb service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:27.110658 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-6df62668-42c1-480d-bd5f-612f4b7ae952 req-2217df9f-f838-42bb-bf51-3662c9aa35eb service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:27.154287 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-6df62668-42c1-480d-bd5f-612f4b7ae952 req-2217df9f-f838-42bb-bf51-3662c9aa35eb service nova] Creating event network-vif-deleted:ff016fe7-8d08-4738-af2e-92d27304ced2 for instance 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 on n-h1-master-1 Jun 20 12:08:27.173301 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-6df62668-42c1-480d-bd5f-612f4b7ae952 req-2217df9f-f838-42bb-bf51-3662c9aa35eb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103103 Jun 20 12:08:27.174530 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1236/2463] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:08:27.247915 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a0044d6c-c721-4976-9e2c-b11bef2775e7 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:27.249930 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a0044d6c-c721-4976-9e2c-b11bef2775e7 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:27.269914 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a0044d6c-c721-4976-9e2c-b11bef2775e7 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:27.275910 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a0044d6c-c721-4976-9e2c-b11bef2775e7 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:27.277922 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a0044d6c-c721-4976-9e2c-b11bef2775e7 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:27.287106 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a0044d6c-c721-4976-9e2c-b11bef2775e7 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:27.496368 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-065eef9f-15df-4271-9f1f-611d11b86ddb tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:27.508662 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-065eef9f-15df-4271-9f1f-611d11b86ddb tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/04d7e9f8-3f73-460e-8dec-c50c7f277874" status: 200 len: 1308 microversion: 2.1 time: 1.280304 Jun 20 12:08:27.515348 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1228/2464] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:26 2022] GET /compute/v2.1/servers/04d7e9f8-3f73-460e-8dec-c50c7f277874 => generated 1308 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:27.520822 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e3b828d7-da71-4747-850f-80a0377f5b14 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:27.528572 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e3b828d7-da71-4747-850f-80a0377f5b14 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:27.554659 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e3b828d7-da71-4747-850f-80a0377f5b14 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:27.555537 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e3b828d7-da71-4747-850f-80a0377f5b14 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:27.556720 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e3b828d7-da71-4747-850f-80a0377f5b14 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:27.559546 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e3b828d7-da71-4747-850f-80a0377f5b14 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:27.605939 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-e3b828d7-da71-4747-850f-80a0377f5b14 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] HTTP exception thrown: Instance 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 could not be found. Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e3b828d7-da71-4747-850f-80a0377f5b14 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 HTTP/1.1 Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 could not be found. Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6'} Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 could not be found. Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 could not be found. Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:27.608321 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:27.613204 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:27.613204 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:27.613204 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:27.613204 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:08:27.613204 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:08:27.613204 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 could not be found. Jun 20 12:08:27.613204 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:27.622541 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e3b828d7-da71-4747-850f-80a0377f5b14 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 404 to user: Instance 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:08:27.623730 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e3b828d7-da71-4747-850f-80a0377f5b14 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6" status: 404 len: 111 microversion: 2.1 time: 0.107029 Jun 20 12:08:27.624864 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1229/2465] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:27 2022] GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:08:27.634556 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-425917bc-843c-4ae7-baa4-f68eb53a57f6 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:27.635687 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-425917bc-843c-4ae7-baa4-f68eb53a57f6 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:27.642841 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-425917bc-843c-4ae7-baa4-f68eb53a57f6 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:27.643614 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-425917bc-843c-4ae7-baa4-f68eb53a57f6 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:27.644616 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-425917bc-843c-4ae7-baa4-f68eb53a57f6 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:27.645924 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-425917bc-843c-4ae7-baa4-f68eb53a57f6 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:28.054643 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-425917bc-843c-4ae7-baa4-f68eb53a57f6 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:28.066941 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-425917bc-843c-4ae7-baa4-f68eb53a57f6 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.436414 Jun 20 12:08:28.068249 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1230/2466] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:27 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:08:28.083930 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d94b69fd-5850-4611-9755-a5b88c0500b9 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:28.087161 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d94b69fd-5850-4611-9755-a5b88c0500b9 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] [instance: b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:28.110962 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a0044d6c-c721-4976-9e2c-b11bef2775e7 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:28.143711 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a0044d6c-c721-4976-9e2c-b11bef2775e7 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1389 microversion: 2.1 time: 0.901456 Jun 20 12:08:28.147259 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1237/2467] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:27 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1389 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:28.158785 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d94b69fd-5850-4611-9755-a5b88c0500b9 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:28.162349 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d94b69fd-5850-4611-9755-a5b88c0500b9 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:28.169674 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d94b69fd-5850-4611-9755-a5b88c0500b9 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:28.170409 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d94b69fd-5850-4611-9755-a5b88c0500b9 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:28.254702 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-69c0d01d-0170-4ab5-a5a2-6def187216c9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "dadde73c-e8f7-441b-8503-8f17caea8651"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-69c0d01d-0170-4ab5-a5a2-6def187216c9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 163 Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: {"server": {"name": 12345, "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "dadde73c-e8f7-441b-8503-8f17caea8651"}]}} Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'f16836cc-4e18-4bd0-b261-3865adf8cb83', 'flavorRef': '452', 'networks': [{'uuid': 'dadde73c-e8f7-441b-8503-8f17caea8651'}]}}} Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise error Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 12345 Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 12:08:28.257600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 12:08:28.262244 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 12:08:28.262244 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jun 20 12:08:28.262244 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:28.262244 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:28.262244 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:28.262244 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:28.262244 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:28.262244 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:28.262244 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 12:08:28.262244 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 12:08:28.262244 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jun 20 12:08:28.262244 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:28.264384 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-69c0d01d-0170-4ab5-a5a2-6def187216c9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:08:28.268595 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-69c0d01d-0170-4ab5-a5a2-6def187216c9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.015155 Jun 20 12:08:28.275751 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1238/2468] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:08:28 2022] POST /compute/v2.1/servers => generated 127 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 20 12:08:28.284019 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-25934805-d916-46e7-82f2-d9e9d96d2fd0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:28.285538 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-25934805-d916-46e7-82f2-d9e9d96d2fd0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:28.339114 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-25934805-d916-46e7-82f2-d9e9d96d2fd0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:28.339584 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-25934805-d916-46e7-82f2-d9e9d96d2fd0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:28.340866 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-25934805-d916-46e7-82f2-d9e9d96d2fd0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:28.341166 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-25934805-d916-46e7-82f2-d9e9d96d2fd0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:28.613757 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d94b69fd-5850-4611-9755-a5b88c0500b9 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9af66464b24c7d94da13df37b3fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10736c37317b4806b9ff323ad4c867b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:28.627244 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d94b69fd-5850-4611-9755-a5b88c0500b9 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] 10.222.0.27 "GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee" status: 200 len: 1324 microversion: 2.1 time: 0.547438 Jun 20 12:08:28.627864 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1231/2469] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:28 2022] GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee => generated 1324 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:28.632945 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-604d7a06-d86f-4189-8c9e-68d122c19cf4 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:28.633568 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-604d7a06-d86f-4189-8c9e-68d122c19cf4 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 04d7e9f8-3f73-460e-8dec-c50c7f277874] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:28.660177 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-604d7a06-d86f-4189-8c9e-68d122c19cf4 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:28.662115 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-604d7a06-d86f-4189-8c9e-68d122c19cf4 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:28.663351 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-604d7a06-d86f-4189-8c9e-68d122c19cf4 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:28.665082 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-604d7a06-d86f-4189-8c9e-68d122c19cf4 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:28.756059 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-25934805-d916-46e7-82f2-d9e9d96d2fd0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:28.775351 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-25934805-d916-46e7-82f2-d9e9d96d2fd0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.497155 Jun 20 12:08:28.780267 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1239/2470] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:28 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:28.813059 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d07bf3a4-bda1-4457-a195-bdccc1b72c4a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:28.813925 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d07bf3a4-bda1-4457-a195-bdccc1b72c4a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:28.822108 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d07bf3a4-bda1-4457-a195-bdccc1b72c4a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:28.822809 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d07bf3a4-bda1-4457-a195-bdccc1b72c4a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:28.824514 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d07bf3a4-bda1-4457-a195-bdccc1b72c4a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:28.825089 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d07bf3a4-bda1-4457-a195-bdccc1b72c4a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:29.136962 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-604d7a06-d86f-4189-8c9e-68d122c19cf4 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:29.160993 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-604d7a06-d86f-4189-8c9e-68d122c19cf4 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/04d7e9f8-3f73-460e-8dec-c50c7f277874" status: 200 len: 1308 microversion: 2.1 time: 0.528369 Jun 20 12:08:29.163059 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1232/2471] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:28 2022] GET /compute/v2.1/servers/04d7e9f8-3f73-460e-8dec-c50c7f277874 => generated 1308 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:29.184994 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bda52ec4-cfc6-49e7-9537-b25875001220 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:29.186777 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bda52ec4-cfc6-49e7-9537-b25875001220 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:29.208490 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bda52ec4-cfc6-49e7-9537-b25875001220 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:29.209356 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bda52ec4-cfc6-49e7-9537-b25875001220 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:29.211781 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bda52ec4-cfc6-49e7-9537-b25875001220 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:29.212539 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bda52ec4-cfc6-49e7-9537-b25875001220 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:29.414499 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d07bf3a4-bda1-4457-a195-bdccc1b72c4a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:29.426011 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d07bf3a4-bda1-4457-a195-bdccc1b72c4a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.616719 Jun 20 12:08:29.427135 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1240/2472] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:28 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:29.550120 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bda52ec4-cfc6-49e7-9537-b25875001220 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:29.564054 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bda52ec4-cfc6-49e7-9537-b25875001220 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1389 microversion: 2.1 time: 0.399090 Jun 20 12:08:29.565275 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1233/2473] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:29 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1389 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:29.646523 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ecddbbf9-3149-4203-856c-390dfc58c377 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:29.647500 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ecddbbf9-3149-4203-856c-390dfc58c377 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] [instance: b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:29.662345 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ecddbbf9-3149-4203-856c-390dfc58c377 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:29.666857 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ecddbbf9-3149-4203-856c-390dfc58c377 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:29.668024 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ecddbbf9-3149-4203-856c-390dfc58c377 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:29.669117 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ecddbbf9-3149-4203-856c-390dfc58c377 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:30.185000 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5063c94c-b8e5-427d-be93-3a8fcc2a12bc tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:30.185652 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5063c94c-b8e5-427d-be93-3a8fcc2a12bc tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 04d7e9f8-3f73-460e-8dec-c50c7f277874] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:30.201124 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5063c94c-b8e5-427d-be93-3a8fcc2a12bc tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:30.201648 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5063c94c-b8e5-427d-be93-3a8fcc2a12bc tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:30.202654 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5063c94c-b8e5-427d-be93-3a8fcc2a12bc tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:30.203204 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5063c94c-b8e5-427d-be93-3a8fcc2a12bc tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:30.214489 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ecddbbf9-3149-4203-856c-390dfc58c377 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9af66464b24c7d94da13df37b3fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10736c37317b4806b9ff323ad4c867b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:30.231123 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ecddbbf9-3149-4203-856c-390dfc58c377 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] 10.222.0.27 "GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee" status: 200 len: 1324 microversion: 2.1 time: 0.588422 Jun 20 12:08:30.233047 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1241/2474] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:29 2022] GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee => generated 1324 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:30.590043 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4e08d88a-b500-4d27-ade3-4e0e0278357e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:30.592480 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4e08d88a-b500-4d27-ade3-4e0e0278357e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:30.606977 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4e08d88a-b500-4d27-ade3-4e0e0278357e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:30.607829 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4e08d88a-b500-4d27-ade3-4e0e0278357e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:30.610237 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4e08d88a-b500-4d27-ade3-4e0e0278357e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:30.612334 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4e08d88a-b500-4d27-ade3-4e0e0278357e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:30.919787 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4e08d88a-b500-4d27-ade3-4e0e0278357e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:30.932263 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4e08d88a-b500-4d27-ade3-4e0e0278357e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1389 microversion: 2.1 time: 0.352143 Jun 20 12:08:30.935190 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1242/2475] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:30 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1389 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:30.954948 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-a0b91491-fada-486d-99e5-40a5c7a88174 req-a9b8580e-81a7-43aa-9286-9f815e6db577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee", "name": "network-vif-plugged", "status": "completed", "tag": "b3967d6d-0dc9-4f2e-b91b-570238dc31d4"}, {"server_uuid": "04d7e9f8-3f73-460e-8dec-c50c7f277874", "name": "network-vif-plugged", "status": "completed", "tag": "a127a63d-0773-4978-8627-004c7446b307"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:08:30.976624 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-a0b91491-fada-486d-99e5-40a5c7a88174 req-a9b8580e-81a7-43aa-9286-9f815e6db577 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:30.979717 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-a0b91491-fada-486d-99e5-40a5c7a88174 req-a9b8580e-81a7-43aa-9286-9f815e6db577 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:31.020043 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-a0b91491-fada-486d-99e5-40a5c7a88174 req-a9b8580e-81a7-43aa-9286-9f815e6db577 service nova] Creating event network-vif-plugged:b3967d6d-0dc9-4f2e-b91b-570238dc31d4 for instance b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee on n-h2-master-1 Jun 20 12:08:31.021887 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-a0b91491-fada-486d-99e5-40a5c7a88174 req-a9b8580e-81a7-43aa-9286-9f815e6db577 service nova] Creating event network-vif-plugged:a127a63d-0773-4978-8627-004c7446b307 for instance 04d7e9f8-3f73-460e-8dec-c50c7f277874 on n-h1-master-1 Jun 20 12:08:31.042651 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-a0b91491-fada-486d-99e5-40a5c7a88174 req-a9b8580e-81a7-43aa-9286-9f815e6db577 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.096720 Jun 20 12:08:31.044329 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1243/2476] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:08:31.266418 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-15fa1f95-4999-4745-9fac-6e52f7019959 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:31.269166 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-15fa1f95-4999-4745-9fac-6e52f7019959 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] [instance: b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:31.286390 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-15fa1f95-4999-4745-9fac-6e52f7019959 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:31.287535 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-15fa1f95-4999-4745-9fac-6e52f7019959 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:31.289401 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-15fa1f95-4999-4745-9fac-6e52f7019959 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:31.290472 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-15fa1f95-4999-4745-9fac-6e52f7019959 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:31.655895 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5063c94c-b8e5-427d-be93-3a8fcc2a12bc tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:31.672510 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5063c94c-b8e5-427d-be93-3a8fcc2a12bc tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/04d7e9f8-3f73-460e-8dec-c50c7f277874" status: 200 len: 1308 microversion: 2.1 time: 1.493713 Jun 20 12:08:31.676150 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1234/2477] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:30 2022] GET /compute/v2.1/servers/04d7e9f8-3f73-460e-8dec-c50c7f277874 => generated 1308 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:31.828046 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-41f49c23-4bf4-42ff-b5c3-bcfffee2e6b1 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Calling method '.version_select at 0x7f6073977280>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:31.830527 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-41f49c23-4bf4-42ff-b5c3-bcfffee2e6b1 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:31.830983 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-41f49c23-4bf4-42ff-b5c3-bcfffee2e6b1 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:31.850728 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-15fa1f95-4999-4745-9fac-6e52f7019959 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9af66464b24c7d94da13df37b3fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10736c37317b4806b9ff323ad4c867b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:31.892719 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-15fa1f95-4999-4745-9fac-6e52f7019959 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] 10.222.0.27 "GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee" status: 200 len: 1324 microversion: 2.1 time: 0.640907 Jun 20 12:08:31.908093 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1244/2478] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:31 2022] GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee => generated 1324 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:31.909138 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-41f49c23-4bf4-42ff-b5c3-bcfffee2e6b1 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 2339 microversion: 2.1 time: 0.083972 Jun 20 12:08:31.911230 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1235/2479] 10.222.0.27 () {58 vars in 1142 bytes} [Mon Jun 20 12:08:31 2022] GET /compute/v2.1/os-migrations => generated 2339 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:08:31.972049 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e4a045d0-97f1-49c4-9a2d-99839e5630cb tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:31.978176 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e4a045d0-97f1-49c4-9a2d-99839e5630cb tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:31.982968 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fff198e7-8f88-4735-a382-180234003089 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:32.002033 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e4a045d0-97f1-49c4-9a2d-99839e5630cb tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:32.002476 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e4a045d0-97f1-49c4-9a2d-99839e5630cb tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:32.020044 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e4a045d0-97f1-49c4-9a2d-99839e5630cb tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:32.022152 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e4a045d0-97f1-49c4-9a2d-99839e5630cb tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:32.026310 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fff198e7-8f88-4735-a382-180234003089 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.071214 Jun 20 12:08:32.044622 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1245/2480] 10.222.0.27 () {58 vars in 1136 bytes} [Mon Jun 20 12:08:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:08:32.067056 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f37b372e-28be-4456-b5e5-a6566df74dd8 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-730732697", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:08:32.070541 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:08:32.070541 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 12:08:32.110213 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f37b372e-28be-4456-b5e5-a6566df74dd8 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.059149 Jun 20 12:08:32.127510 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1246/2481] 10.222.0.27 () {60 vars in 1145 bytes} [Mon Jun 20 12:08:32 2022] POST /compute/v2.1/flavors => generated 498 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:08:32.160658 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dfb86821-afe1-4a8e-91ec-7cc9fc22208e tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:32.191968 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dfb86821-afe1-4a8e-91ec-7cc9fc22208e tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.049604 Jun 20 12:08:32.195365 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1247/2482] 10.222.0.27 () {58 vars in 1181 bytes} [Mon Jun 20 12:08:32 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:08:32.456007 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3d09cdfd-55ae-4a21-af60-b4f4c832b55b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-319530193", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "0173425c-7c4a-4fc6-9720-5054f46e787a"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:08:32.539121 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-3d09cdfd-55ae-4a21-af60-b4f4c832b55b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] validate_networks() for None {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:08:32.645751 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e4a045d0-97f1-49c4-9a2d-99839e5630cb tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:32.658936 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e4a045d0-97f1-49c4-9a2d-99839e5630cb tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1389 microversion: 2.1 time: 0.697419 Jun 20 12:08:32.660314 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1236/2483] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:31 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1389 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:08:32.673816 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-14f5cc71-fc8d-4cc0-911a-62fd55865db1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-38167441", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "ac5a9373-f99d-422b-98ea-6da2b374f1ff", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "dadde73c-e8f7-441b-8503-8f17caea8651"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:08:32.812108 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-14f5cc71-fc8d-4cc0-911a-62fd55865db1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] HTTP exception thrown: Block Device ac5a9373-f99d-422b-98ea-6da2b374f1ff is not bootable. Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-14f5cc71-fc8d-4cc0-911a-62fd55865db1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 356 Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-38167441", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "ac5a9373-f99d-422b-98ea-6da2b374f1ff", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "dadde73c-e8f7-441b-8503-8f17caea8651"}]}} Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: exception: Block Device ac5a9373-f99d-422b-98ea-6da2b374f1ff is not bootable. Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-38167441', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'ac5a9373-f99d-422b-98ea-6da2b374f1ff'}], 'networks': [{'uuid': 'dadde73c-e8f7-441b-8503-8f17caea8651'}]}}} Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1622, in _create_instance Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device ac5a9373-f99d-422b-98ea-6da2b374f1ff is not bootable. Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:08:32.822465 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:08:32.828151 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:08:32.828151 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:08:32.828151 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:08:32.828151 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 20 12:08:32.828151 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jun 20 12:08:32.828151 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jun 20 12:08:32.828151 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device ac5a9373-f99d-422b-98ea-6da2b374f1ff is not bootable. Jun 20 12:08:32.828151 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:32.828151 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:32.828151 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:32.828151 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:32.828151 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:32.828151 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:32.828151 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:08:32.828151 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:08:32.828151 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device ac5a9373-f99d-422b-98ea-6da2b374f1ff is not bootable. Jun 20 12:08:32.828151 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:32.830545 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-14f5cc71-fc8d-4cc0-911a-62fd55865db1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 400 to user: Block Device ac5a9373-f99d-422b-98ea-6da2b374f1ff is not bootable. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:08:32.832147 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-14f5cc71-fc8d-4cc0-911a-62fd55865db1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.170335 Jun 20 12:08:32.833507 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1237/2484] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:08:32 2022] POST /compute/v2.1/servers => generated 110 bytes in 172 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:08:32.842679 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-10117c5e-e4eb-4eb1-ab58-740aebb62c0e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:32.843912 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-10117c5e-e4eb-4eb1-ab58-740aebb62c0e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 04d7e9f8-3f73-460e-8dec-c50c7f277874] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:32.858004 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-10117c5e-e4eb-4eb1-ab58-740aebb62c0e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:32.858792 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-10117c5e-e4eb-4eb1-ab58-740aebb62c0e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:32.860522 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-10117c5e-e4eb-4eb1-ab58-740aebb62c0e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:32.861589 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-10117c5e-e4eb-4eb1-ab58-740aebb62c0e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:33.076530 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=4 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:33.264385 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-3d09cdfd-55ae-4a21-af60-b4f4c832b55b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:08:33.264875 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-3d09cdfd-55ae-4a21-af60-b4f4c832b55b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:08:33.266659 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-3d09cdfd-55ae-4a21-af60-b4f4c832b55b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:08:33.267300 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-3d09cdfd-55ae-4a21-af60-b4f4c832b55b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:08:33.268298 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-3d09cdfd-55ae-4a21-af60-b4f4c832b55b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:08:33.281089 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3d09cdfd-55ae-4a21-af60-b4f4c832b55b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:33.282593 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3d09cdfd-55ae-4a21-af60-b4f4c832b55b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:33.284030 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3d09cdfd-55ae-4a21-af60-b4f4c832b55b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:33.284813 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3d09cdfd-55ae-4a21-af60-b4f4c832b55b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:33.347829 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-10117c5e-e4eb-4eb1-ab58-740aebb62c0e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:33.367771 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-3d09cdfd-55ae-4a21-af60-b4f4c832b55b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Getting quotas for project 4440dc3e2f9c4134a54b08e2585f6c59. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:08:33.372534 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-10117c5e-e4eb-4eb1-ab58-740aebb62c0e tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/04d7e9f8-3f73-460e-8dec-c50c7f277874" status: 200 len: 1308 microversion: 2.1 time: 0.537068 Jun 20 12:08:33.379233 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1238/2485] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:32 2022] GET /compute/v2.1/servers/04d7e9f8-3f73-460e-8dec-c50c7f277874 => generated 1308 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:33.394242 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-3d09cdfd-55ae-4a21-af60-b4f4c832b55b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Getting quotas for user 3d35b7c824b641099a406175bccc5be3 and project 4440dc3e2f9c4134a54b08e2585f6c59. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:08:33.402563 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-aec236e7-ab35-4551-9917-233cc0fdd7fe tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:33.403803 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-aec236e7-ab35-4551-9917-233cc0fdd7fe tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:33.423489 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aec236e7-ab35-4551-9917-233cc0fdd7fe tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:33.426236 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aec236e7-ab35-4551-9917-233cc0fdd7fe tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:33.427642 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aec236e7-ab35-4551-9917-233cc0fdd7fe tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:33.429180 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aec236e7-ab35-4551-9917-233cc0fdd7fe tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:33.444070 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3d09cdfd-55ae-4a21-af60-b4f4c832b55b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:08:33.452185 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3d09cdfd-55ae-4a21-af60-b4f4c832b55b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:08:33.548531 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3d09cdfd-55ae-4a21-af60-b4f4c832b55b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.096197 Jun 20 12:08:33.556573 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1248/2486] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:08:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1105 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 12:08:33.563368 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c034b2e9-63af-42da-9877-e8cc11a36659 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:33.564501 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c034b2e9-63af-42da-9877-e8cc11a36659 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] [instance: b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:33.583259 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c034b2e9-63af-42da-9877-e8cc11a36659 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:33.584346 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c034b2e9-63af-42da-9877-e8cc11a36659 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:33.586010 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c034b2e9-63af-42da-9877-e8cc11a36659 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:33.586835 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c034b2e9-63af-42da-9877-e8cc11a36659 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:33.774353 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-aec236e7-ab35-4551-9917-233cc0fdd7fe tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:33.796417 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-aec236e7-ab35-4551-9917-233cc0fdd7fe tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.415145 Jun 20 12:08:33.805474 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1239/2487] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:33 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:33.815185 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ed55dee0-d575-44c6-a735-504c2ad5e04c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:33.815820 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ed55dee0-d575-44c6-a735-504c2ad5e04c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:34.101656 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ed55dee0-d575-44c6-a735-504c2ad5e04c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:34.120962 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ed55dee0-d575-44c6-a735-504c2ad5e04c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1278 microversion: 2.1 time: 0.314128 Jun 20 12:08:34.121586 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1240/2488] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:33 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1278 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:34.148557 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-32b1d690-4884-456c-a0de-d3a8f0c53798 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:34.162399 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-32b1d690-4884-456c-a0de-d3a8f0c53798 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:34.182553 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-32b1d690-4884-456c-a0de-d3a8f0c53798 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:34.183285 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-32b1d690-4884-456c-a0de-d3a8f0c53798 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:34.184309 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-32b1d690-4884-456c-a0de-d3a8f0c53798 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:34.184940 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-32b1d690-4884-456c-a0de-d3a8f0c53798 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:34.570112 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c034b2e9-63af-42da-9877-e8cc11a36659 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9af66464b24c7d94da13df37b3fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10736c37317b4806b9ff323ad4c867b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:34.581735 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c034b2e9-63af-42da-9877-e8cc11a36659 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] 10.222.0.27 "GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee" status: 200 len: 1324 microversion: 2.1 time: 1.023060 Jun 20 12:08:34.584366 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1249/2489] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:33 2022] GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee => generated 1324 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:34.601839 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-164b3e6f-09f6-4daa-9fd3-37dea550885b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:34.603655 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-164b3e6f-09f6-4daa-9fd3-37dea550885b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:34.623970 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-164b3e6f-09f6-4daa-9fd3-37dea550885b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:34.626040 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-164b3e6f-09f6-4daa-9fd3-37dea550885b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:34.629520 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-164b3e6f-09f6-4daa-9fd3-37dea550885b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:34.630056 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-164b3e6f-09f6-4daa-9fd3-37dea550885b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:34.783193 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-32b1d690-4884-456c-a0de-d3a8f0c53798 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:34.799883 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-32b1d690-4884-456c-a0de-d3a8f0c53798 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1389 microversion: 2.1 time: 0.677006 Jun 20 12:08:34.809710 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1241/2490] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:34 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1389 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:34.821566 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d3ccab19-4860-4138-b715-e361da22139a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:34.825155 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d3ccab19-4860-4138-b715-e361da22139a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 04d7e9f8-3f73-460e-8dec-c50c7f277874] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:34.863842 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d3ccab19-4860-4138-b715-e361da22139a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:34.864507 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d3ccab19-4860-4138-b715-e361da22139a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:34.868593 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d3ccab19-4860-4138-b715-e361da22139a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:34.869609 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d3ccab19-4860-4138-b715-e361da22139a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:35.054415 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-164b3e6f-09f6-4daa-9fd3-37dea550885b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:35.075737 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-164b3e6f-09f6-4daa-9fd3-37dea550885b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.485946 Jun 20 12:08:35.092244 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1250/2491] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:34 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:35.148228 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-27298aff-5b1f-4118-b34f-b64dbcbd6b5e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:35.150767 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-27298aff-5b1f-4118-b34f-b64dbcbd6b5e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:35.193752 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-27298aff-5b1f-4118-b34f-b64dbcbd6b5e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:35.194913 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-27298aff-5b1f-4118-b34f-b64dbcbd6b5e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:35.198241 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-27298aff-5b1f-4118-b34f-b64dbcbd6b5e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:35.198894 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-27298aff-5b1f-4118-b34f-b64dbcbd6b5e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:35.389455 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-27298aff-5b1f-4118-b34f-b64dbcbd6b5e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:35.409871 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-27298aff-5b1f-4118-b34f-b64dbcbd6b5e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1330 microversion: 2.1 time: 0.266782 Jun 20 12:08:35.424375 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1251/2492] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:35 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1330 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:35.473834 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-0a27f95a-a021-4981-81a8-a7466a59f3c1 req-72b8d8e4-dc67-4d54-88ed-d0547f9c126d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de7fc47c-e28f-4697-bbf9-df8390dfd998", "name": "network-vif-unplugged", "status": "completed", "tag": "5925f2d5-cbe4-4efe-9aa1-8f5c5ba93a44"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:08:35.521506 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-0a27f95a-a021-4981-81a8-a7466a59f3c1 req-72b8d8e4-dc67-4d54-88ed-d0547f9c126d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:35.522522 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-0a27f95a-a021-4981-81a8-a7466a59f3c1 req-72b8d8e4-dc67-4d54-88ed-d0547f9c126d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:35.552751 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-0a27f95a-a021-4981-81a8-a7466a59f3c1 req-72b8d8e4-dc67-4d54-88ed-d0547f9c126d service nova] Creating event network-vif-unplugged:5925f2d5-cbe4-4efe-9aa1-8f5c5ba93a44 for instance de7fc47c-e28f-4697-bbf9-df8390dfd998 on n-h2-master-1 Jun 20 12:08:35.570441 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-0a27f95a-a021-4981-81a8-a7466a59f3c1 req-72b8d8e4-dc67-4d54-88ed-d0547f9c126d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.143148 Jun 20 12:08:35.582115 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1252/2493] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:08:35.633222 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-53c93955-0a1c-43de-8c8d-4796681c0223 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:35.645036 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-53c93955-0a1c-43de-8c8d-4796681c0223 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] [instance: b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:35.682539 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-53c93955-0a1c-43de-8c8d-4796681c0223 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:35.684305 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-53c93955-0a1c-43de-8c8d-4796681c0223 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:35.688381 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-53c93955-0a1c-43de-8c8d-4796681c0223 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:35.690443 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-53c93955-0a1c-43de-8c8d-4796681c0223 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:35.827599 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:36.021006 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d3ccab19-4860-4138-b715-e361da22139a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:36.036966 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d3ccab19-4860-4138-b715-e361da22139a tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/04d7e9f8-3f73-460e-8dec-c50c7f277874" status: 200 len: 1488 microversion: 2.1 time: 1.219878 Jun 20 12:08:36.037755 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1242/2494] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:34 2022] GET /compute/v2.1/servers/04d7e9f8-3f73-460e-8dec-c50c7f277874 => generated 1488 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:36.057961 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9d3d2f57-e0b6-468a-b815-1ddaa3a3330c tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:36.058604 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9d3d2f57-e0b6-468a-b815-1ddaa3a3330c tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:36.093988 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9d3d2f57-e0b6-468a-b815-1ddaa3a3330c tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:36.094540 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9d3d2f57-e0b6-468a-b815-1ddaa3a3330c tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:36.101263 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9d3d2f57-e0b6-468a-b815-1ddaa3a3330c tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:36.102006 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9d3d2f57-e0b6-468a-b815-1ddaa3a3330c tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:36.489108 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-53c93955-0a1c-43de-8c8d-4796681c0223 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9af66464b24c7d94da13df37b3fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10736c37317b4806b9ff323ad4c867b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:36.504433 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-53c93955-0a1c-43de-8c8d-4796681c0223 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] 10.222.0.27 "GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee" status: 200 len: 1520 microversion: 2.1 time: 0.906046 Jun 20 12:08:36.505900 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1253/2495] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:35 2022] GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee => generated 1520 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:36.560145 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0bb7b5d5-3c4a-4d0a-98e1-d063a2c94629 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1450793857"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:08:36.570738 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0bb7b5d5-3c4a-4d0a-98e1-d063a2c94629 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 04d7e9f8-3f73-460e-8dec-c50c7f277874] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:36.590172 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0bb7b5d5-3c4a-4d0a-98e1-d063a2c94629 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:36.591329 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0bb7b5d5-3c4a-4d0a-98e1-d063a2c94629 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:36.599060 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0bb7b5d5-3c4a-4d0a-98e1-d063a2c94629 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:36.600082 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0bb7b5d5-3c4a-4d0a-98e1-d063a2c94629 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:37.205853 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0bb7b5d5-3c4a-4d0a-98e1-d063a2c94629 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "POST /compute/v2.1/servers/04d7e9f8-3f73-460e-8dec-c50c7f277874/action" status: 202 len: 0 microversion: 2.1 time: 0.651169 Jun 20 12:08:37.206539 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1254/2496] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:08:36 2022] POST /compute/v2.1/servers/04d7e9f8-3f73-460e-8dec-c50c7f277874/action => generated 0 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 20 12:08:37.233195 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-13fd05b9-8975-4127-ab46-d9614ef25f14 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:37.234162 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-13fd05b9-8975-4127-ab46-d9614ef25f14 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:37.251419 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13fd05b9-8975-4127-ab46-d9614ef25f14 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:37.252440 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13fd05b9-8975-4127-ab46-d9614ef25f14 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:37.253693 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13fd05b9-8975-4127-ab46-d9614ef25f14 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:37.254112 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13fd05b9-8975-4127-ab46-d9614ef25f14 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:37.397209 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-13fd05b9-8975-4127-ab46-d9614ef25f14 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:37.407356 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-13fd05b9-8975-4127-ab46-d9614ef25f14 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1336 microversion: 2.1 time: 0.181212 Jun 20 12:08:37.409118 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1255/2497] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:37 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1336 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:37.415482 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-be3e3497-1b24-48df-9248-f79c16e80d77 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:37.416340 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-be3e3497-1b24-48df-9248-f79c16e80d77 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] [instance: b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:37.437081 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-be3e3497-1b24-48df-9248-f79c16e80d77 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:37.437804 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-be3e3497-1b24-48df-9248-f79c16e80d77 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:37.438714 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-be3e3497-1b24-48df-9248-f79c16e80d77 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:37.439190 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-be3e3497-1b24-48df-9248-f79c16e80d77 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:37.511192 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-be3e3497-1b24-48df-9248-f79c16e80d77 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] HTTP exception thrown: Action 999 not found Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-be3e3497-1b24-48df-9248-f79c16e80d77 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Request method failure captured: Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee/os-instance-actions/999 HTTP/1.1 Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGMdQyklQnsTCYV8-4T5-ljOwaQws5enM0XYrkhe3OeLXkz5cZFGyRNEfDu7PFiBUSTK1XqiLbn4khOqb1a4mMxq47g4MKGeDsOLa9AJjF0bgRMMzwi2nmOsb-pl6qzM4uodxnkLghJ1AFluqvnHKYAymXpHjyRoHiRyI_2a-fNG6gE Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 10736c37317b4806b9ff323ad4c867b8 Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1794733752 Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10736c37317b4806b9ff323ad4c867b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10736c37317b4806b9ff323ad4c867b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/10736c37317b4806b9ff323ad4c867b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_10736c37317b4806b9ff323ad4c867b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1794733752 Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 10736c37317b4806b9ff323ad4c867b8 Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1794733752 Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-InstanceActionsNegativeTestJSON-1794733752-project Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: cf9af66464b24c7d94da13df37b3fe33 Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1794733752-project Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: exception: Action 999 not found Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: action_args: {'server_id': 'b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee', 'id': '999'} Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Jun 20 12:08:37.519978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:37.530620 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-be3e3497-1b24-48df-9248-f79c16e80d77 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Returning 404 to user: Action 999 not found {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:08:37.530620 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-be3e3497-1b24-48df-9248-f79c16e80d77 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] 10.222.0.27 "GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.111519 Jun 20 12:08:37.530620 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1256/2498] 10.222.0.27 () {58 vars in 1307 bytes} [Mon Jun 20 12:08:37 2022] GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee/os-instance-actions/999 => generated 66 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:08:37.536983 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5be46446-126c-4c42-9a28-ccc72b22d8c2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f60848db4c0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:37.674314 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5be46446-126c-4c42-9a28-ccc72b22d8c2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/c319e65c-ddda-4578-aaa4-cbd3d07b3834" status: 200 len: 1412 microversion: 2.1 time: 0.144163 Jun 20 12:08:37.675334 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1257/2499] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:08:37 2022] GET /compute/v2.1/images/c319e65c-ddda-4578-aaa4-cbd3d07b3834 => generated 1412 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:37.696528 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-69653c53-561b-4eeb-b78f-c3bb0e9cd829 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Calling method '.version_select at 0x7f60731845e0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:37.699083 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-69653c53-561b-4eeb-b78f-c3bb0e9cd829 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] [instance: 449caa8b-b027-4528-a415-b0a419f16629] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:37.719297 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-69653c53-561b-4eeb-b78f-c3bb0e9cd829 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] HTTP exception thrown: Instance 449caa8b-b027-4528-a415-b0a419f16629 could not be found. Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-69653c53-561b-4eeb-b78f-c3bb0e9cd829 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Request method failure captured: Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/449caa8b-b027-4528-a415-b0a419f16629/os-instance-actions HTTP/1.1 Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGMdQyklQnsTCYV8-4T5-ljOwaQws5enM0XYrkhe3OeLXkz5cZFGyRNEfDu7PFiBUSTK1XqiLbn4khOqb1a4mMxq47g4MKGeDsOLa9AJjF0bgRMMzwi2nmOsb-pl6qzM4uodxnkLghJ1AFluqvnHKYAymXpHjyRoHiRyI_2a-fNG6gE Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 10736c37317b4806b9ff323ad4c867b8 Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1794733752 Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10736c37317b4806b9ff323ad4c867b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10736c37317b4806b9ff323ad4c867b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/10736c37317b4806b9ff323ad4c867b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_10736c37317b4806b9ff323ad4c867b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1794733752 Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 10736c37317b4806b9ff323ad4c867b8 Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1794733752 Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-InstanceActionsNegativeTestJSON-1794733752-project Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: cf9af66464b24c7d94da13df37b3fe33 Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1794733752-project Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 449caa8b-b027-4528-a415-b0a419f16629 could not be found. Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: action_args: {'server_id': '449caa8b-b027-4528-a415-b0a419f16629'} Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 449caa8b-b027-4528-a415-b0a419f16629 could not be found. Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:08:37.722885 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:08:37.729356 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 449caa8b-b027-4528-a415-b0a419f16629 could not be found. Jun 20 12:08:37.729356 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:37.729356 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:37.729356 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:37.729356 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:37.729356 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:37.729356 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:37.729356 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:08:37.729356 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:08:37.729356 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 449caa8b-b027-4528-a415-b0a419f16629 could not be found. Jun 20 12:08:37.729356 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:37.729356 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-69653c53-561b-4eeb-b78f-c3bb0e9cd829 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Returning 404 to user: Instance 449caa8b-b027-4528-a415-b0a419f16629 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:08:37.729356 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-69653c53-561b-4eeb-b78f-c3bb0e9cd829 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] 10.222.0.27 "GET /compute/v2.1/servers/449caa8b-b027-4528-a415-b0a419f16629/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.051579 Jun 20 12:08:37.729356 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1258/2500] 10.222.0.27 () {58 vars in 1295 bytes} [Mon Jun 20 12:08:37 2022] GET /compute/v2.1/servers/449caa8b-b027-4528-a415-b0a419f16629/os-instance-actions => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:08:37.736540 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-00c3e526-4f59-4628-9a83-5d0f0cd5d818 req-651eb0fb-bdee-408c-95de-0a445d6d3107 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de7fc47c-e28f-4697-bbf9-df8390dfd998", "tag": "5925f2d5-cbe4-4efe-9aa1-8f5c5ba93a44"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:08:38.157450 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-00c3e526-4f59-4628-9a83-5d0f0cd5d818 req-651eb0fb-bdee-408c-95de-0a445d6d3107 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:38.157770 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-00c3e526-4f59-4628-9a83-5d0f0cd5d818 req-651eb0fb-bdee-408c-95de-0a445d6d3107 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:38.171614 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-00c3e526-4f59-4628-9a83-5d0f0cd5d818 req-651eb0fb-bdee-408c-95de-0a445d6d3107 service nova] Creating event network-changed:5925f2d5-cbe4-4efe-9aa1-8f5c5ba93a44 for instance de7fc47c-e28f-4697-bbf9-df8390dfd998 on n-h2-master-1 Jun 20 12:08:38.196495 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-00c3e526-4f59-4628-9a83-5d0f0cd5d818 req-651eb0fb-bdee-408c-95de-0a445d6d3107 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.466133 Jun 20 12:08:38.200850 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1259/2501] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:08:38.206923 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2325b1f5-7509-4844-ae91-58f5283fd11d tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f60849f7550>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:38.355233 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2325b1f5-7509-4844-ae91-58f5283fd11d tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/c319e65c-ddda-4578-aaa4-cbd3d07b3834" status: 200 len: 1412 microversion: 2.1 time: 0.152936 Jun 20 12:08:38.359589 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1260/2502] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:08:38 2022] GET /compute/v2.1/images/c319e65c-ddda-4578-aaa4-cbd3d07b3834 => generated 1412 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:38.364614 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6d52410a-9db0-45b9-ac6e-c69e7c989c88 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:38.365064 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6d52410a-9db0-45b9-ac6e-c69e7c989c88 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] [instance: b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:38.367565 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:38.379806 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6d52410a-9db0-45b9-ac6e-c69e7c989c88 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:38.380739 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6d52410a-9db0-45b9-ac6e-c69e7c989c88 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:38.381804 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6d52410a-9db0-45b9-ac6e-c69e7c989c88 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:38.383238 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6d52410a-9db0-45b9-ac6e-c69e7c989c88 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:38.448654 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6d52410a-9db0-45b9-ac6e-c69e7c989c88 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] [instance: b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:08:38.547045 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9d3d2f57-e0b6-468a-b815-1ddaa3a3330c tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:38.580164 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9d3d2f57-e0b6-468a-b815-1ddaa3a3330c tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1389 microversion: 2.1 time: 2.538001 Jun 20 12:08:38.582230 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1243/2503] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:36 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1389 bytes in 2544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:38.603627 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6aecfcdc-6fac-4d29-96b6-c46dfc3757dc tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f6073b97b80>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:38.631884 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6d52410a-9db0-45b9-ac6e-c69e7c989c88 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee" status: 204 len: 0 microversion: 2.1 time: 0.270921 Jun 20 12:08:38.638980 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1261/2504] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:08:38 2022] DELETE /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:38.645231 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8602ad74-6d42-446a-8c3d-988a26d80b14 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:38.646203 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8602ad74-6d42-446a-8c3d-988a26d80b14 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:38.654509 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8602ad74-6d42-446a-8c3d-988a26d80b14 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:38.655237 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8602ad74-6d42-446a-8c3d-988a26d80b14 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:38.656229 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8602ad74-6d42-446a-8c3d-988a26d80b14 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:38.656839 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8602ad74-6d42-446a-8c3d-988a26d80b14 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:38.741933 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8602ad74-6d42-446a-8c3d-988a26d80b14 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:38.760417 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8602ad74-6d42-446a-8c3d-988a26d80b14 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1336 microversion: 2.1 time: 0.118987 Jun 20 12:08:38.763747 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1262/2505] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:38 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1336 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:38.776866 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-237ac0c4-7470-440f-a831-a5ee573a8f44 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:38.779776 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-237ac0c4-7470-440f-a831-a5ee573a8f44 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] [instance: b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:38.796268 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-237ac0c4-7470-440f-a831-a5ee573a8f44 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:38.797377 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-237ac0c4-7470-440f-a831-a5ee573a8f44 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:38.798258 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-237ac0c4-7470-440f-a831-a5ee573a8f44 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:38.798884 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-237ac0c4-7470-440f-a831-a5ee573a8f44 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:38.983139 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6aecfcdc-6fac-4d29-96b6-c46dfc3757dc tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "DELETE /compute/v2.1/images/c319e65c-ddda-4578-aaa4-cbd3d07b3834" status: 204 len: 0 microversion: 2.1 time: 0.397267 Jun 20 12:08:38.993554 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1244/2506] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:38 2022] DELETE /compute/v2.1/images/c319e65c-ddda-4578-aaa4-cbd3d07b3834 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:38.999271 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-65575cf3-c69b-4c63-9043-dec304a26162 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f607397e9d0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:39.044004 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-65575cf3-c69b-4c63-9043-dec304a26162 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] HTTP exception thrown: Image not found. Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-65575cf3-c69b-4c63-9043-dec304a26162 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Request method failure captured: Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/images/c319e65c-ddda-4578-aaa4-cbd3d07b3834 HTTP/1.1 Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGJABbdo0PoMIi75hcYbY9WA3Baq_MO9Sbca_A0Agd8YAMBr9yt3HAvqhrzhVUa0FMb1sIiaDSfZcsGmkaN3nokQlPU20Me8U9GFyQZ2-ZTqUlk85vSWSv04TiWGla5J-N_p83pEsnalaKgpo36-a4Ty-ItE0gLNT8ngT198Ris7cIE Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 615573a78a9d4e75a36ada9bd9de7e15 Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ImagesTestJSON-665973449 Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ImagesTestJSON-665973449 Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 615573a78a9d4e75a36ada9bd9de7e15 Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ImagesTestJSON-665973449 Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ImagesTestJSON-665973449-project Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 8b2304d9c7dd493983542a54b6799989 Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ImagesTestJSON-665973449-project Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: exception: Image not found. Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'c319e65c-ddda-4578-aaa4-cbd3d07b3834'} Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c319e65c-ddda-4578-aaa4-cbd3d07b3834 Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 20 12:08:39.046442 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c319e65c-ddda-4578-aaa4-cbd3d07b3834 could not be found. Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:39.051118 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-65575cf3-c69b-4c63-9043-dec304a26162 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Returning 404 to user: Image not found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:08:39.054560 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-65575cf3-c69b-4c63-9043-dec304a26162 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/images/c319e65c-ddda-4578-aaa4-cbd3d07b3834" status: 404 len: 62 microversion: 2.1 time: 0.057322 Jun 20 12:08:39.055804 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1245/2507] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:08:38 2022] GET /compute/v2.1/images/c319e65c-ddda-4578-aaa4-cbd3d07b3834 => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:08:39.073475 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e0818dbb-ddc6-47f2-8593-a5d93d3d9dd2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:39.074186 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e0818dbb-ddc6-47f2-8593-a5d93d3d9dd2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 04d7e9f8-3f73-460e-8dec-c50c7f277874] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:39.085707 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e0818dbb-ddc6-47f2-8593-a5d93d3d9dd2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:39.086367 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e0818dbb-ddc6-47f2-8593-a5d93d3d9dd2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:39.087623 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e0818dbb-ddc6-47f2-8593-a5d93d3d9dd2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:39.090694 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e0818dbb-ddc6-47f2-8593-a5d93d3d9dd2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:39.114998 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-237ac0c4-7470-440f-a831-a5ee573a8f44 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9af66464b24c7d94da13df37b3fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10736c37317b4806b9ff323ad4c867b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:39.134508 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-237ac0c4-7470-440f-a831-a5ee573a8f44 tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] 10.222.0.27 "GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee" status: 200 len: 1526 microversion: 2.1 time: 0.364628 Jun 20 12:08:39.135824 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1263/2508] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:38 2022] GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee => generated 1526 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:39.603062 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4d20e1e2-f11a-4e99-a556-5e2e2e11a53d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:39.604531 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4d20e1e2-f11a-4e99-a556-5e2e2e11a53d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:39.615260 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4d20e1e2-f11a-4e99-a556-5e2e2e11a53d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:39.616536 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4d20e1e2-f11a-4e99-a556-5e2e2e11a53d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:39.618133 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4d20e1e2-f11a-4e99-a556-5e2e2e11a53d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:39.621425 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4d20e1e2-f11a-4e99-a556-5e2e2e11a53d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:40.005177 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e0818dbb-ddc6-47f2-8593-a5d93d3d9dd2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:40.009053 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:40.034807 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e0818dbb-ddc6-47f2-8593-a5d93d3d9dd2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/04d7e9f8-3f73-460e-8dec-c50c7f277874" status: 200 len: 1506 microversion: 2.1 time: 0.964477 Jun 20 12:08:40.041195 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1246/2509] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:39 2022] GET /compute/v2.1/servers/04d7e9f8-3f73-460e-8dec-c50c7f277874 => generated 1506 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:40.058390 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-56afd9ca-c313-49b4-8f02-420726df7a3f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1836679460", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "destination_type": "local"}, {"source_type": "volume", "uuid": "568566f8-ed17-4924-9ef6-672e7c2ef0c7", "destination_type": "invalid"}], "networks": [{"uuid": "dadde73c-e8f7-441b-8503-8f17caea8651"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-56afd9ca-c313-49b4-8f02-420726df7a3f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 495 Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1836679460", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "destination_type": "local"}, {"source_type": "volume", "uuid": "568566f8-ed17-4924-9ef6-672e7c2ef0c7", "destination_type": "invalid"}], "networks": [{"uuid": "dadde73c-e8f7-441b-8503-8f17caea8651"}]}} Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1836679460', 'imageRef': 'f16836cc-4e18-4bd0-b261-3865adf8cb83', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'f16836cc-4e18-4bd0-b261-3865adf8cb83', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '568566f8-ed17-4924-9ef6-672e7c2ef0c7', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'dadde73c-e8f7-441b-8503-8f17caea8651'}]}}} Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise error Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi 'invalid' Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:08:40.067156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:08:40.073342 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:08:40.073342 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:08:40.073342 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 12:08:40.073342 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 12:08:40.073342 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 12:08:40.073342 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 12:08:40.073342 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 12:08:40.073342 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 12:08:40.073342 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jun 20 12:08:40.073342 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:40.073342 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:40.073342 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:40.073342 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:40.073342 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:40.073342 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:40.073342 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 12:08:40.073342 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 12:08:40.073342 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jun 20 12:08:40.073342 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:40.078246 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-56afd9ca-c313-49b4-8f02-420726df7a3f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:08:40.079404 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-56afd9ca-c313-49b4-8f02-420726df7a3f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.035925 Jun 20 12:08:40.080640 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1247/2510] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:08:40 2022] POST /compute/v2.1/servers => generated 155 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:08:40.088568 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-df816f88-6d84-4cd2-b0c2-c18a5ad91ca6 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:40.089576 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-df816f88-6d84-4cd2-b0c2-c18a5ad91ca6 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:40.099559 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df816f88-6d84-4cd2-b0c2-c18a5ad91ca6 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:40.101323 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df816f88-6d84-4cd2-b0c2-c18a5ad91ca6 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:40.102390 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df816f88-6d84-4cd2-b0c2-c18a5ad91ca6 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:40.103208 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df816f88-6d84-4cd2-b0c2-c18a5ad91ca6 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:40.254078 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4d20e1e2-f11a-4e99-a556-5e2e2e11a53d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:40.276152 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4d20e1e2-f11a-4e99-a556-5e2e2e11a53d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1389 microversion: 2.1 time: 0.672529 Jun 20 12:08:40.281297 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1264/2511] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:39 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1389 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:40.288017 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3bf4d10b-95a7-4443-9adf-127547e00192 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:40.289926 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3bf4d10b-95a7-4443-9adf-127547e00192 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:40.300340 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3bf4d10b-95a7-4443-9adf-127547e00192 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:40.301265 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3bf4d10b-95a7-4443-9adf-127547e00192 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:40.302337 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3bf4d10b-95a7-4443-9adf-127547e00192 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:40.303036 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3bf4d10b-95a7-4443-9adf-127547e00192 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:40.490342 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-df816f88-6d84-4cd2-b0c2-c18a5ad91ca6 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:40.501282 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-df816f88-6d84-4cd2-b0c2-c18a5ad91ca6 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1378 microversion: 2.1 time: 0.419214 Jun 20 12:08:40.517124 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1248/2512] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:40 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1378 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:40.531799 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-db3b8d2a-c3d4-4d59-a1da-74fc520f11ec tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:40.534099 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-db3b8d2a-c3d4-4d59-a1da-74fc520f11ec tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] [instance: b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:40.551656 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-db3b8d2a-c3d4-4d59-a1da-74fc520f11ec tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:40.552569 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-db3b8d2a-c3d4-4d59-a1da-74fc520f11ec tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:40.554235 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-db3b8d2a-c3d4-4d59-a1da-74fc520f11ec tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:40.557217 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-db3b8d2a-c3d4-4d59-a1da-74fc520f11ec tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:40.964097 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3bf4d10b-95a7-4443-9adf-127547e00192 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:40.982586 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3bf4d10b-95a7-4443-9adf-127547e00192 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.691132 Jun 20 12:08:40.985733 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1265/2513] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:40 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:41.016883 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3c343a5b-5c2d-44d8-9af3-7eaa7d9b2d74 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:41.018121 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3c343a5b-5c2d-44d8-9af3-7eaa7d9b2d74 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:41.046436 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3c343a5b-5c2d-44d8-9af3-7eaa7d9b2d74 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:41.052642 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3c343a5b-5c2d-44d8-9af3-7eaa7d9b2d74 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:41.057336 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3c343a5b-5c2d-44d8-9af3-7eaa7d9b2d74 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:41.059159 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3c343a5b-5c2d-44d8-9af3-7eaa7d9b2d74 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:41.420972 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-db3b8d2a-c3d4-4d59-a1da-74fc520f11ec tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9af66464b24c7d94da13df37b3fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10736c37317b4806b9ff323ad4c867b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:41.437757 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-db3b8d2a-c3d4-4d59-a1da-74fc520f11ec tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] 10.222.0.27 "GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee" status: 200 len: 1526 microversion: 2.1 time: 0.918086 Jun 20 12:08:41.452600 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1249/2514] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:40 2022] GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee => generated 1526 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:41.467161 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c1b16886-1e4a-4851-b300-31f28399a7c1 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:41.468083 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c1b16886-1e4a-4851-b300-31f28399a7c1 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 04d7e9f8-3f73-460e-8dec-c50c7f277874] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:41.484869 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c1b16886-1e4a-4851-b300-31f28399a7c1 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:41.486858 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c1b16886-1e4a-4851-b300-31f28399a7c1 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:41.491587 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c1b16886-1e4a-4851-b300-31f28399a7c1 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:41.492550 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c1b16886-1e4a-4851-b300-31f28399a7c1 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:42.060771 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3c343a5b-5c2d-44d8-9af3-7eaa7d9b2d74 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:42.073411 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3c343a5b-5c2d-44d8-9af3-7eaa7d9b2d74 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 1.070615 Jun 20 12:08:42.084791 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1266/2515] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:41 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:08:42.100865 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a1cdf899-c253-4437-aaa2-081ac72ef7f6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:42.103445 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a1cdf899-c253-4437-aaa2-081ac72ef7f6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:42.118737 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a1cdf899-c253-4437-aaa2-081ac72ef7f6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:42.121615 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a1cdf899-c253-4437-aaa2-081ac72ef7f6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:42.124839 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a1cdf899-c253-4437-aaa2-081ac72ef7f6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:42.125427 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a1cdf899-c253-4437-aaa2-081ac72ef7f6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:42.532274 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a1cdf899-c253-4437-aaa2-081ac72ef7f6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:42.544299 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a1cdf899-c253-4437-aaa2-081ac72ef7f6 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1389 microversion: 2.1 time: 0.456981 Jun 20 12:08:42.545114 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1267/2516] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:42 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1389 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:42.583693 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1281652f-7fa9-439d-80cd-4615bfdfbb5f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:42.589738 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1281652f-7fa9-439d-80cd-4615bfdfbb5f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:42.609813 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1281652f-7fa9-439d-80cd-4615bfdfbb5f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:42.612797 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1281652f-7fa9-439d-80cd-4615bfdfbb5f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:42.613962 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1281652f-7fa9-439d-80cd-4615bfdfbb5f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:42.614118 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1281652f-7fa9-439d-80cd-4615bfdfbb5f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:43.124669 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c1b16886-1e4a-4851-b300-31f28399a7c1 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:43.136176 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c1b16886-1e4a-4851-b300-31f28399a7c1 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/04d7e9f8-3f73-460e-8dec-c50c7f277874" status: 200 len: 1488 microversion: 2.1 time: 1.681354 Jun 20 12:08:43.141428 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1250/2517] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:41 2022] GET /compute/v2.1/servers/04d7e9f8-3f73-460e-8dec-c50c7f277874 => generated 1488 bytes in 1688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:43.153519 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-72ea9964-e05d-4f7b-a4c8-f31b6cfcd152 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1290606107", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "dadde73c-e8f7-441b-8503-8f17caea8651"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-72ea9964-e05d-4f7b-a4c8-f31b6cfcd152 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 492 Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1290606107", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "dadde73c-e8f7-441b-8503-8f17caea8651"}]}} Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1290606107', 'imageRef': 'f16836cc-4e18-4bd0-b261-3865adf8cb83', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'dadde73c-e8f7-441b-8503-8f17caea8651'}]}}} Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise error Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Jun 20 12:08:43.165190 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Jun 20 12:08:43.168509 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:43.168509 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:43.168509 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:43.168509 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:43.168509 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:43.168509 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:43.168509 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:08:43.168509 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:08:43.168509 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:08:43.168509 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:08:43.168509 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:08:43.168509 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:08:43.168509 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 12:08:43.168509 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 12:08:43.168509 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 12:08:43.168509 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 12:08:43.168509 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 12:08:43.168509 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 12:08:43.168509 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jun 20 12:08:43.168509 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:43.168509 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:43.168509 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:43.168509 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:43.168509 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:43.168509 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:43.168509 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 12:08:43.168509 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 12:08:43.168509 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jun 20 12:08:43.168509 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:43.178116 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-72ea9964-e05d-4f7b-a4c8-f31b6cfcd152 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:08:43.187610 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-72ea9964-e05d-4f7b-a4c8-f31b6cfcd152 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.038166 Jun 20 12:08:43.200142 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1251/2518] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:08:43 2022] POST /compute/v2.1/servers => generated 624 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:08:43.213766 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-143808d8-7c80-4286-99da-5f4eb1ca5a9f tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:43.214421 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-143808d8-7c80-4286-99da-5f4eb1ca5a9f tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] [instance: b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:43.257132 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-143808d8-7c80-4286-99da-5f4eb1ca5a9f tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:43.259479 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-143808d8-7c80-4286-99da-5f4eb1ca5a9f tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:43.260803 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-143808d8-7c80-4286-99da-5f4eb1ca5a9f tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:43.271673 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-143808d8-7c80-4286-99da-5f4eb1ca5a9f tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:43.328715 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:43.424465 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:43.626536 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-143808d8-7c80-4286-99da-5f4eb1ca5a9f tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9af66464b24c7d94da13df37b3fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10736c37317b4806b9ff323ad4c867b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:43.637740 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-143808d8-7c80-4286-99da-5f4eb1ca5a9f tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] 10.222.0.27 "GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee" status: 200 len: 1309 microversion: 2.1 time: 0.436297 Jun 20 12:08:43.648763 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1252/2519] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:43 2022] GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee => generated 1309 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:43.659751 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a6cff71d-fc30-4844-acb5-b974a7c646e5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:43.671158 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a6cff71d-fc30-4844-acb5-b974a7c646e5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 04d7e9f8-3f73-460e-8dec-c50c7f277874] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:43.697435 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a6cff71d-fc30-4844-acb5-b974a7c646e5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:43.705329 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a6cff71d-fc30-4844-acb5-b974a7c646e5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:43.707273 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a6cff71d-fc30-4844-acb5-b974a7c646e5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:43.709818 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a6cff71d-fc30-4844-acb5-b974a7c646e5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:43.796078 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a6cff71d-fc30-4844-acb5-b974a7c646e5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 04d7e9f8-3f73-460e-8dec-c50c7f277874] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:08:44.121712 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:44.224178 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a6cff71d-fc30-4844-acb5-b974a7c646e5 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "DELETE /compute/v2.1/servers/04d7e9f8-3f73-460e-8dec-c50c7f277874" status: 204 len: 0 microversion: 2.1 time: 0.573583 Jun 20 12:08:44.228714 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1253/2520] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:08:43 2022] DELETE /compute/v2.1/servers/04d7e9f8-3f73-460e-8dec-c50c7f277874 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:44.246870 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-8f16b21f-c93d-47e2-b851-c2ca07eb19f6 req-92f24d49-33e5-4f30-b2ec-683030309a69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee", "name": "network-vif-deleted", "tag": "b3967d6d-0dc9-4f2e-b91b-570238dc31d4"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:08:44.312938 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-8f16b21f-c93d-47e2-b851-c2ca07eb19f6 req-92f24d49-33e5-4f30-b2ec-683030309a69 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:44.321837 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-8f16b21f-c93d-47e2-b851-c2ca07eb19f6 req-92f24d49-33e5-4f30-b2ec-683030309a69 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:44.393242 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-8f16b21f-c93d-47e2-b851-c2ca07eb19f6 req-92f24d49-33e5-4f30-b2ec-683030309a69 service nova] Creating event network-vif-deleted:b3967d6d-0dc9-4f2e-b91b-570238dc31d4 for instance b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee on n-h2-master-1 Jun 20 12:08:44.417563 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-8f16b21f-c93d-47e2-b851-c2ca07eb19f6 req-92f24d49-33e5-4f30-b2ec-683030309a69 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184949 Jun 20 12:08:44.434702 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1254/2521] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:08:44.442329 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7ea62ca9-864f-4f6f-aadc-2faa124e190d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:44.453386 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7ea62ca9-864f-4f6f-aadc-2faa124e190d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:44.478241 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ea62ca9-864f-4f6f-aadc-2faa124e190d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:44.478986 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ea62ca9-864f-4f6f-aadc-2faa124e190d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:44.480015 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ea62ca9-864f-4f6f-aadc-2faa124e190d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:44.480737 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ea62ca9-864f-4f6f-aadc-2faa124e190d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:44.732382 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1281652f-7fa9-439d-80cd-4615bfdfbb5f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:44.743066 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1281652f-7fa9-439d-80cd-4615bfdfbb5f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1378 microversion: 2.1 time: 2.172695 Jun 20 12:08:44.766282 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1268/2522] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:42 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1378 bytes in 2196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:44.773185 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d77b8b18-2f04-4943-97ca-d44a1992a82f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:44.774213 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d77b8b18-2f04-4943-97ca-d44a1992a82f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:44.792586 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d77b8b18-2f04-4943-97ca-d44a1992a82f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:44.793536 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d77b8b18-2f04-4943-97ca-d44a1992a82f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:44.794774 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d77b8b18-2f04-4943-97ca-d44a1992a82f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:44.796838 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d77b8b18-2f04-4943-97ca-d44a1992a82f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:45.225723 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7ea62ca9-864f-4f6f-aadc-2faa124e190d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:45.235702 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7ea62ca9-864f-4f6f-aadc-2faa124e190d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.799161 Jun 20 12:08:45.247512 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1255/2523] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:44 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:45.266131 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-7ef5a351-1a73-46c9-8f23-dcf134de2b0e req-e8121b9a-68b5-4406-9aa2-d3e9d225b55e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de7fc47c-e28f-4697-bbf9-df8390dfd998", "name": "network-vif-unplugged", "status": "completed", "tag": "5925f2d5-cbe4-4efe-9aa1-8f5c5ba93a44"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:08:45.288650 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:45.295120 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-7ef5a351-1a73-46c9-8f23-dcf134de2b0e req-e8121b9a-68b5-4406-9aa2-d3e9d225b55e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:45.295617 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-7ef5a351-1a73-46c9-8f23-dcf134de2b0e req-e8121b9a-68b5-4406-9aa2-d3e9d225b55e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:45.339556 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-7ef5a351-1a73-46c9-8f23-dcf134de2b0e req-e8121b9a-68b5-4406-9aa2-d3e9d225b55e service nova] Creating event network-vif-unplugged:5925f2d5-cbe4-4efe-9aa1-8f5c5ba93a44 for instance de7fc47c-e28f-4697-bbf9-df8390dfd998 on n-h2-master-1 Jun 20 12:08:45.363969 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-7ef5a351-1a73-46c9-8f23-dcf134de2b0e req-e8121b9a-68b5-4406-9aa2-d3e9d225b55e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110819 Jun 20 12:08:45.367899 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1256/2524] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:08:45.385911 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-55ea0b01-bd25-4ba7-8038-1692b894183d tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f6073bfe4c0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:45.438474 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-55ea0b01-bd25-4ba7-8038-1692b894183d tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] HTTP exception thrown: Image not found. Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-55ea0b01-bd25-4ba7-8038-1692b894183d tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Request method failure captured: Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/images/c319e65c-ddda-4578-aaa4-cbd3d07b3834 HTTP/1.1 Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGJABbdo0PoMIi75hcYbY9WA3Baq_MO9Sbca_A0Agd8YAMBr9yt3HAvqhrzhVUa0FMb1sIiaDSfZcsGmkaN3nokQlPU20Me8U9GFyQZ2-ZTqUlk85vSWSv04TiWGla5J-N_p83pEsnalaKgpo36-a4Ty-ItE0gLNT8ngT198Ris7cIE Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 615573a78a9d4e75a36ada9bd9de7e15 Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ImagesTestJSON-665973449 Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ImagesTestJSON-665973449 Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 615573a78a9d4e75a36ada9bd9de7e15 Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ImagesTestJSON-665973449 Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ImagesTestJSON-665973449-project Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 8b2304d9c7dd493983542a54b6799989 Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ImagesTestJSON-665973449-project Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: exception: Image not found. Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'c319e65c-ddda-4578-aaa4-cbd3d07b3834'} Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c319e65c-ddda-4578-aaa4-cbd3d07b3834 to delete Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c319e65c-ddda-4578-aaa4-cbd3d07b3834 could not be found. Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:45.441293 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:45.446001 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:45.446001 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:45.446001 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:08:45.446001 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:08:45.446001 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:08:45.446001 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:08:45.446001 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:08:45.446001 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:08:45.446001 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 20 12:08:45.446001 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 20 12:08:45.446001 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 20 12:08:45.446001 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:45.446001 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:45.446001 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:45.446001 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:45.446001 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:45.446001 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:45.446001 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:08:45.446001 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:08:45.446001 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 20 12:08:45.446001 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:45.447879 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-55ea0b01-bd25-4ba7-8038-1692b894183d tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Returning 404 to user: Image not found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:08:45.448333 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-55ea0b01-bd25-4ba7-8038-1692b894183d tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "DELETE /compute/v2.1/images/c319e65c-ddda-4578-aaa4-cbd3d07b3834" status: 404 len: 62 microversion: 2.1 time: 0.076864 Jun 20 12:08:45.449127 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1257/2525] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:45 2022] DELETE /compute/v2.1/images/c319e65c-ddda-4578-aaa4-cbd3d07b3834 => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:08:45.459089 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7387b5f7-046c-48c3-a4fb-a76e2dd2c12d tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:45.464940 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7387b5f7-046c-48c3-a4fb-a76e2dd2c12d tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] [instance: b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:45.493311 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7387b5f7-046c-48c3-a4fb-a76e2dd2c12d tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:45.494938 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7387b5f7-046c-48c3-a4fb-a76e2dd2c12d tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:45.497672 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7387b5f7-046c-48c3-a4fb-a76e2dd2c12d tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:45.500029 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7387b5f7-046c-48c3-a4fb-a76e2dd2c12d tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:45.550759 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-7387b5f7-046c-48c3-a4fb-a76e2dd2c12d tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] HTTP exception thrown: Instance b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee could not be found. Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7387b5f7-046c-48c3-a4fb-a76e2dd2c12d tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Request method failure captured: Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee HTTP/1.1 Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGMdQyklQnsTCYV8-4T5-ljOwaQws5enM0XYrkhe3OeLXkz5cZFGyRNEfDu7PFiBUSTK1XqiLbn4khOqb1a4mMxq47g4MKGeDsOLa9AJjF0bgRMMzwi2nmOsb-pl6qzM4uodxnkLghJ1AFluqvnHKYAymXpHjyRoHiRyI_2a-fNG6gE Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 10736c37317b4806b9ff323ad4c867b8 Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1794733752 Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10736c37317b4806b9ff323ad4c867b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/10736c37317b4806b9ff323ad4c867b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/10736c37317b4806b9ff323ad4c867b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_10736c37317b4806b9ff323ad4c867b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1794733752 Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 10736c37317b4806b9ff323ad4c867b8 Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1794733752 Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-InstanceActionsNegativeTestJSON-1794733752-project Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: cf9af66464b24c7d94da13df37b3fe33 Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1794733752-project Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: exception: Instance b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee could not be found. Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee'} Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee could not be found. Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee could not be found. Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:45.552449 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:45.557353 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:45.557353 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:45.557353 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:45.557353 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:45.557353 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:08:45.557353 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:08:45.557353 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee could not be found. Jun 20 12:08:45.557353 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:45.557353 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7387b5f7-046c-48c3-a4fb-a76e2dd2c12d tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] Returning 404 to user: Instance b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:08:45.557353 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7387b5f7-046c-48c3-a4fb-a76e2dd2c12d tempest-InstanceActionsNegativeTestJSON-1794733752 tempest-InstanceActionsNegativeTestJSON-1794733752-project] 10.222.0.27 "GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee" status: 404 len: 111 microversion: 2.1 time: 0.103467 Jun 20 12:08:45.564233 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1258/2526] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:45 2022] GET /compute/v2.1/servers/b1eeb6ce-ec49-4d16-98d1-b872c5ddbaee => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:08:45.577536 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-99a5ac48-c7c2-4e60-b6e6-533b7bf03b89 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:45.580142 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-99a5ac48-c7c2-4e60-b6e6-533b7bf03b89 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:45.619821 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-99a5ac48-c7c2-4e60-b6e6-533b7bf03b89 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:45.620324 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-99a5ac48-c7c2-4e60-b6e6-533b7bf03b89 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:45.625345 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-99a5ac48-c7c2-4e60-b6e6-533b7bf03b89 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:45.626116 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-99a5ac48-c7c2-4e60-b6e6-533b7bf03b89 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:46.013688 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-99a5ac48-c7c2-4e60-b6e6-533b7bf03b89 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:46.027023 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-99a5ac48-c7c2-4e60-b6e6-533b7bf03b89 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.456132 Jun 20 12:08:46.040262 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1259/2527] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:45 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:46.044446 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3d6bda3d-635f-42e5-b8cd-06226f4a21de tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:46.045126 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3d6bda3d-635f-42e5-b8cd-06226f4a21de tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 04d7e9f8-3f73-460e-8dec-c50c7f277874] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:46.065050 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d77b8b18-2f04-4943-97ca-d44a1992a82f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:46.068320 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3d6bda3d-635f-42e5-b8cd-06226f4a21de tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:46.069746 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3d6bda3d-635f-42e5-b8cd-06226f4a21de tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:46.070921 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3d6bda3d-635f-42e5-b8cd-06226f4a21de tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:46.075151 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3d6bda3d-635f-42e5-b8cd-06226f4a21de tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:46.079991 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d77b8b18-2f04-4943-97ca-d44a1992a82f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1389 microversion: 2.1 time: 1.307668 Jun 20 12:08:46.082613 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1269/2528] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:44 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1389 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:46.096940 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-74a3e424-d26b-4c65-99e3-e92f7f68c00a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:46.099757 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-74a3e424-d26b-4c65-99e3-e92f7f68c00a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:46.117594 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-74a3e424-d26b-4c65-99e3-e92f7f68c00a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:46.122025 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-74a3e424-d26b-4c65-99e3-e92f7f68c00a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:46.124492 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-74a3e424-d26b-4c65-99e3-e92f7f68c00a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:46.126672 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-74a3e424-d26b-4c65-99e3-e92f7f68c00a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:46.169029 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3d6bda3d-635f-42e5-b8cd-06226f4a21de tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 04d7e9f8-3f73-460e-8dec-c50c7f277874] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:08:46.346721 n-d-master-1 devstack@n-api.service[119127]: INFO nova.compute.api [None req-3d6bda3d-635f-42e5-b8cd-06226f4a21de tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 04d7e9f8-3f73-460e-8dec-c50c7f277874] Instance is already in deleting state, ignoring this request Jun 20 12:08:46.348511 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3d6bda3d-635f-42e5-b8cd-06226f4a21de tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "DELETE /compute/v2.1/servers/04d7e9f8-3f73-460e-8dec-c50c7f277874" status: 204 len: 0 microversion: 2.1 time: 0.316941 Jun 20 12:08:46.349461 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1260/2529] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:08:46 2022] DELETE /compute/v2.1/servers/04d7e9f8-3f73-460e-8dec-c50c7f277874 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:08:46.362365 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-07b88805-b10c-4b1d-b5de-5ee32faacad9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "dadde73c-e8f7-441b-8503-8f17caea8651"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-07b88805-b10c-4b1d-b5de-5ee32faacad9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 416 Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "dadde73c-e8f7-441b-8503-8f17caea8651"}]}} Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'f16836cc-4e18-4bd0-b261-3865adf8cb83', 'flavorRef': '452', 'networks': [{'uuid': 'dadde73c-e8f7-441b-8503-8f17caea8651'}]}}} Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise error Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:46.364745 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:46.371852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:46.371852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:46.371852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:46.371852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:08:46.371852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:08:46.371852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:08:46.371852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:08:46.371852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:08:46.371852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:08:46.371852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 12:08:46.371852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 12:08:46.371852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 12:08:46.371852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 12:08:46.371852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 12:08:46.371852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 12:08:46.371852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 20 12:08:46.371852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:46.371852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:46.371852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:46.371852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:46.371852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:46.371852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:46.371852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 12:08:46.371852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 12:08:46.371852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 20 12:08:46.371852 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:46.371852 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-07b88805-b10c-4b1d-b5de-5ee32faacad9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:08:46.371852 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-07b88805-b10c-4b1d-b5de-5ee32faacad9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.011434 Jun 20 12:08:46.371852 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1261/2530] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:08:46 2022] POST /compute/v2.1/servers => generated 619 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:08:46.373988 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7666cf89-cedb-484f-89c0-178fa8b6080c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:46.373988 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7666cf89-cedb-484f-89c0-178fa8b6080c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 04d7e9f8-3f73-460e-8dec-c50c7f277874] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:46.389946 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7666cf89-cedb-484f-89c0-178fa8b6080c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:46.391246 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7666cf89-cedb-484f-89c0-178fa8b6080c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:46.392377 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7666cf89-cedb-484f-89c0-178fa8b6080c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:46.392944 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7666cf89-cedb-484f-89c0-178fa8b6080c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:47.029613 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7666cf89-cedb-484f-89c0-178fa8b6080c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:47.046532 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7666cf89-cedb-484f-89c0-178fa8b6080c tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/04d7e9f8-3f73-460e-8dec-c50c7f277874" status: 200 len: 1494 microversion: 2.1 time: 0.673413 Jun 20 12:08:47.047632 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1262/2531] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:46 2022] GET /compute/v2.1/servers/04d7e9f8-3f73-460e-8dec-c50c7f277874 => generated 1494 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:47.052712 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0ba90ad2-49e5-4e77-8122-d3e7113a4bd3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:47.058456 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0ba90ad2-49e5-4e77-8122-d3e7113a4bd3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:47.078742 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0ba90ad2-49e5-4e77-8122-d3e7113a4bd3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:47.079452 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0ba90ad2-49e5-4e77-8122-d3e7113a4bd3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:47.080451 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0ba90ad2-49e5-4e77-8122-d3e7113a4bd3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:47.081059 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0ba90ad2-49e5-4e77-8122-d3e7113a4bd3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:47.229621 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-74a3e424-d26b-4c65-99e3-e92f7f68c00a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:47.264427 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:47.294582 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-74a3e424-d26b-4c65-99e3-e92f7f68c00a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1378 microversion: 2.1 time: 1.210471 Jun 20 12:08:47.302605 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1270/2532] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:46 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1378 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:47.313153 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-a415bb8a-cbd6-4978-847a-0c1f611eed60 req-67e7ce8f-9c70-42fb-b837-471b394f80dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8b3d285-0f08-4deb-859e-babab7f3b656", "tag": "e23efb88-f8d5-4db8-8321-1c16dca584be"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:08:47.343174 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-a415bb8a-cbd6-4978-847a-0c1f611eed60 req-67e7ce8f-9c70-42fb-b837-471b394f80dc service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:47.344554 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-a415bb8a-cbd6-4978-847a-0c1f611eed60 req-67e7ce8f-9c70-42fb-b837-471b394f80dc service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:47.379214 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-a415bb8a-cbd6-4978-847a-0c1f611eed60 req-67e7ce8f-9c70-42fb-b837-471b394f80dc service nova] Creating event network-changed:e23efb88-f8d5-4db8-8321-1c16dca584be for instance f8b3d285-0f08-4deb-859e-babab7f3b656 on n-h2-master-1 Jun 20 12:08:47.390448 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-a415bb8a-cbd6-4978-847a-0c1f611eed60 req-67e7ce8f-9c70-42fb-b837-471b394f80dc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085156 Jun 20 12:08:47.394557 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1271/2533] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:08:47.408960 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-148b5189-06d3-4ca9-8283-9f770822dab8 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:47.410102 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-148b5189-06d3-4ca9-8283-9f770822dab8 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:47.432797 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-148b5189-06d3-4ca9-8283-9f770822dab8 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:47.435515 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-148b5189-06d3-4ca9-8283-9f770822dab8 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:47.441770 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-148b5189-06d3-4ca9-8283-9f770822dab8 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:47.442820 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-148b5189-06d3-4ca9-8283-9f770822dab8 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:47.570685 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0ba90ad2-49e5-4e77-8122-d3e7113a4bd3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:47.582887 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0ba90ad2-49e5-4e77-8122-d3e7113a4bd3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.533936 Jun 20 12:08:47.597393 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1263/2534] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:47 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:47.597393 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-1ce36f0b-f3d7-460e-9b1b-f967523d290c req-1696e829-2708-479a-904b-c9df1baf575d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04d7e9f8-3f73-460e-8dec-c50c7f277874", "name": "network-vif-plugged", "status": "completed", "tag": "a127a63d-0773-4978-8627-004c7446b307"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:08:47.609208 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-1ce36f0b-f3d7-460e-9b1b-f967523d290c req-1696e829-2708-479a-904b-c9df1baf575d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:47.610165 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-1ce36f0b-f3d7-460e-9b1b-f967523d290c req-1696e829-2708-479a-904b-c9df1baf575d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:47.632269 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-1ce36f0b-f3d7-460e-9b1b-f967523d290c req-1696e829-2708-479a-904b-c9df1baf575d service nova] Creating event network-vif-plugged:a127a63d-0773-4978-8627-004c7446b307 for instance 04d7e9f8-3f73-460e-8dec-c50c7f277874 on n-h1-master-1 Jun 20 12:08:47.639925 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-1ce36f0b-f3d7-460e-9b1b-f967523d290c req-1696e829-2708-479a-904b-c9df1baf575d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051319 Jun 20 12:08:47.639925 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1264/2535] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:08:47.649229 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-308f8d6e-9791-4560-88b9-0220e1f1071f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:47.649955 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-308f8d6e-9791-4560-88b9-0220e1f1071f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:47.657864 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-308f8d6e-9791-4560-88b9-0220e1f1071f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:47.658327 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-308f8d6e-9791-4560-88b9-0220e1f1071f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:47.659249 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-308f8d6e-9791-4560-88b9-0220e1f1071f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:47.659570 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-308f8d6e-9791-4560-88b9-0220e1f1071f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:47.980604 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-148b5189-06d3-4ca9-8283-9f770822dab8 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:47.996843 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-148b5189-06d3-4ca9-8283-9f770822dab8 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1389 microversion: 2.1 time: 0.600554 Jun 20 12:08:48.019999 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1272/2536] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:47 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1389 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:48.069898 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3a86198c-5b0d-4b53-acb2-ad6c098e27b6 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:48.070602 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3a86198c-5b0d-4b53-acb2-ad6c098e27b6 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 04d7e9f8-3f73-460e-8dec-c50c7f277874] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:48.083238 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3a86198c-5b0d-4b53-acb2-ad6c098e27b6 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:48.083700 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3a86198c-5b0d-4b53-acb2-ad6c098e27b6 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:48.085583 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3a86198c-5b0d-4b53-acb2-ad6c098e27b6 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:48.086040 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3a86198c-5b0d-4b53-acb2-ad6c098e27b6 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:48.315740 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3a86198c-5b0d-4b53-acb2-ad6c098e27b6 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2304d9c7dd493983542a54b6799989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615573a78a9d4e75a36ada9bd9de7e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:48.327342 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3a86198c-5b0d-4b53-acb2-ad6c098e27b6 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/04d7e9f8-3f73-460e-8dec-c50c7f277874" status: 200 len: 1452 microversion: 2.1 time: 0.263771 Jun 20 12:08:48.340995 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1273/2537] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:48 2022] GET /compute/v2.1/servers/04d7e9f8-3f73-460e-8dec-c50c7f277874 => generated 1452 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:48.354282 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-a528048b-0d18-4b4b-8178-54dfd1a7bcdc req-f9389d78-476d-4844-aaba-c1cb7b4ddcd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04d7e9f8-3f73-460e-8dec-c50c7f277874", "name": "network-vif-deleted", "tag": "a127a63d-0773-4978-8627-004c7446b307"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:08:48.381223 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-a528048b-0d18-4b4b-8178-54dfd1a7bcdc req-f9389d78-476d-4844-aaba-c1cb7b4ddcd5 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:48.383166 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-a528048b-0d18-4b4b-8178-54dfd1a7bcdc req-f9389d78-476d-4844-aaba-c1cb7b4ddcd5 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:48.469639 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-a528048b-0d18-4b4b-8178-54dfd1a7bcdc req-f9389d78-476d-4844-aaba-c1cb7b4ddcd5 service nova] Creating event network-vif-deleted:a127a63d-0773-4978-8627-004c7446b307 for instance 04d7e9f8-3f73-460e-8dec-c50c7f277874 on n-h1-master-1 Jun 20 12:08:48.494296 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-a528048b-0d18-4b4b-8178-54dfd1a7bcdc req-f9389d78-476d-4844-aaba-c1cb7b4ddcd5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150971 Jun 20 12:08:48.506241 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1274/2538] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:08:48.523783 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9c4a0bb9-b4a2-4cfb-9b74-2a0b9c8265b0 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:48.524544 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9c4a0bb9-b4a2-4cfb-9b74-2a0b9c8265b0 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:48.532450 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-308f8d6e-9791-4560-88b9-0220e1f1071f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:48.544550 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-308f8d6e-9791-4560-88b9-0220e1f1071f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.900916 Jun 20 12:08:48.566867 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c4a0bb9-b4a2-4cfb-9b74-2a0b9c8265b0 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:48.568038 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c4a0bb9-b4a2-4cfb-9b74-2a0b9c8265b0 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:48.568599 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c4a0bb9-b4a2-4cfb-9b74-2a0b9c8265b0 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:48.570660 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c4a0bb9-b4a2-4cfb-9b74-2a0b9c8265b0 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:48.574912 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1265/2539] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:47 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:48.668567 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a1a22152-1e3a-47c5-a8ab-c871514ff601 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-380480548", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": -1, "networks": [{"uuid": "dadde73c-e8f7-441b-8503-8f17caea8651"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:08:48.689700 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-a1a22152-1e3a-47c5-a8ab-c871514ff601 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] HTTP exception thrown: Flavor -1 could not be found. Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a1a22152-1e3a-47c5-a8ab-c871514ff601 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 205 Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-380480548", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": -1, "networks": [{"uuid": "dadde73c-e8f7-441b-8503-8f17caea8651"}]}} Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: exception: Flavor -1 could not be found. Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-380480548', 'imageRef': 'f16836cc-4e18-4bd0-b261-3865adf8cb83', 'flavorRef': -1, 'networks': [{'uuid': 'dadde73c-e8f7-441b-8503-8f17caea8651'}]}}} Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:08:48.692264 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:08:48.696879 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:08:48.696879 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:08:48.696879 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:08:48.696879 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:08:48.696879 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 20 12:08:48.696879 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jun 20 12:08:48.696879 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jun 20 12:08:48.696879 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Jun 20 12:08:48.696879 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:48.696879 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:48.696879 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:48.696879 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:48.696879 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:48.696879 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:48.696879 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:08:48.696879 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:08:48.696879 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Jun 20 12:08:48.696879 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:48.699639 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a1a22152-1e3a-47c5-a8ab-c871514ff601 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:08:48.700985 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a1a22152-1e3a-47c5-a8ab-c871514ff601 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.039406 Jun 20 12:08:48.702057 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1266/2540] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:08:48 2022] POST /compute/v2.1/servers => generated 73 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jun 20 12:08:48.714275 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7f83169d-d246-46c6-b132-d9e6ca73c67d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:48.716741 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7f83169d-d246-46c6-b132-d9e6ca73c67d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:48.734157 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7f83169d-d246-46c6-b132-d9e6ca73c67d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:48.735532 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7f83169d-d246-46c6-b132-d9e6ca73c67d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:48.737171 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7f83169d-d246-46c6-b132-d9e6ca73c67d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:48.738461 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7f83169d-d246-46c6-b132-d9e6ca73c67d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:49.501847 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7f83169d-d246-46c6-b132-d9e6ca73c67d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:49.510068 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7f83169d-d246-46c6-b132-d9e6ca73c67d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.803976 Jun 20 12:08:49.530667 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1267/2541] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:48 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:08:49.549597 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-144d2f47-58aa-48b8-b1e4-f3082a89afd0 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:49.550232 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-144d2f47-58aa-48b8-b1e4-f3082a89afd0 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:49.570079 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-144d2f47-58aa-48b8-b1e4-f3082a89afd0 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:49.582598 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-144d2f47-58aa-48b8-b1e4-f3082a89afd0 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:49.584352 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-144d2f47-58aa-48b8-b1e4-f3082a89afd0 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:49.585041 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-144d2f47-58aa-48b8-b1e4-f3082a89afd0 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:49.588705 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:08:49.848812 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9c4a0bb9-b4a2-4cfb-9b74-2a0b9c8265b0 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:49.859647 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9c4a0bb9-b4a2-4cfb-9b74-2a0b9c8265b0 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1378 microversion: 2.1 time: 1.350007 Jun 20 12:08:49.869456 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1275/2542] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:48 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1378 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:49.875151 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-35f68717-228b-4ea8-bc5b-f35294959155 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:49.876089 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-35f68717-228b-4ea8-bc5b-f35294959155 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 04d7e9f8-3f73-460e-8dec-c50c7f277874] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:49.898402 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-35f68717-228b-4ea8-bc5b-f35294959155 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:49.905042 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-35f68717-228b-4ea8-bc5b-f35294959155 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:49.911117 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-35f68717-228b-4ea8-bc5b-f35294959155 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:49.911597 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-35f68717-228b-4ea8-bc5b-f35294959155 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:49.946525 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-35f68717-228b-4ea8-bc5b-f35294959155 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] HTTP exception thrown: Instance 04d7e9f8-3f73-460e-8dec-c50c7f277874 could not be found. Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-35f68717-228b-4ea8-bc5b-f35294959155 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Request method failure captured: Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/04d7e9f8-3f73-460e-8dec-c50c7f277874 HTTP/1.1 Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGJABbdo0PoMIi75hcYbY9WA3Baq_MO9Sbca_A0Agd8YAMBr9yt3HAvqhrzhVUa0FMb1sIiaDSfZcsGmkaN3nokQlPU20Me8U9GFyQZ2-ZTqUlk85vSWSv04TiWGla5J-N_p83pEsnalaKgpo36-a4Ty-ItE0gLNT8ngT198Ris7cIE Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 615573a78a9d4e75a36ada9bd9de7e15 Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ImagesTestJSON-665973449 Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ImagesTestJSON-665973449 Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 615573a78a9d4e75a36ada9bd9de7e15 Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ImagesTestJSON-665973449 Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ImagesTestJSON-665973449-project Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 8b2304d9c7dd493983542a54b6799989 Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ImagesTestJSON-665973449-project Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 04d7e9f8-3f73-460e-8dec-c50c7f277874 could not be found. Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '04d7e9f8-3f73-460e-8dec-c50c7f277874'} Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04d7e9f8-3f73-460e-8dec-c50c7f277874 could not be found. Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04d7e9f8-3f73-460e-8dec-c50c7f277874 could not be found. Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:49.948904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:49.952906 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:49.952906 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:49.952906 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:08:49.952906 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:08:49.952906 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04d7e9f8-3f73-460e-8dec-c50c7f277874 could not be found. Jun 20 12:08:49.952906 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:49.959563 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-35f68717-228b-4ea8-bc5b-f35294959155 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Returning 404 to user: Instance 04d7e9f8-3f73-460e-8dec-c50c7f277874 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:08:49.961835 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-35f68717-228b-4ea8-bc5b-f35294959155 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/04d7e9f8-3f73-460e-8dec-c50c7f277874" status: 404 len: 111 microversion: 2.1 time: 0.090026 Jun 20 12:08:49.963724 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1276/2543] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:49 2022] GET /compute/v2.1/servers/04d7e9f8-3f73-460e-8dec-c50c7f277874 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:08:49.974284 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c264a86e-36c5-45c4-b25b-24da45c6cf3e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:49.976189 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c264a86e-36c5-45c4-b25b-24da45c6cf3e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:49.985829 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c264a86e-36c5-45c4-b25b-24da45c6cf3e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:49.987002 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c264a86e-36c5-45c4-b25b-24da45c6cf3e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:49.988850 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c264a86e-36c5-45c4-b25b-24da45c6cf3e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:49.989495 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c264a86e-36c5-45c4-b25b-24da45c6cf3e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:50.241482 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-144d2f47-58aa-48b8-b1e4-f3082a89afd0 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:50.252049 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-144d2f47-58aa-48b8-b1e4-f3082a89afd0 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1389 microversion: 2.1 time: 0.719917 Jun 20 12:08:50.264728 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1268/2544] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:49 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1389 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:50.272955 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c1daa7cb-b2b0-408e-bd30-e7b80506cb40 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f6073b765e0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:50.315157 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-c1daa7cb-b2b0-408e-bd30-e7b80506cb40 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] HTTP exception thrown: Image not found. Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c1daa7cb-b2b0-408e-bd30-e7b80506cb40 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Request method failure captured: Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891 HTTP/1.1 Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGJABbdo0PoMIi75hcYbY9WA3Baq_MO9Sbca_A0Agd8YAMBr9yt3HAvqhrzhVUa0FMb1sIiaDSfZcsGmkaN3nokQlPU20Me8U9GFyQZ2-ZTqUlk85vSWSv04TiWGla5J-N_p83pEsnalaKgpo36-a4Ty-ItE0gLNT8ngT198Ris7cIE Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 615573a78a9d4e75a36ada9bd9de7e15 Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ImagesTestJSON-665973449 Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ImagesTestJSON-665973449 Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 615573a78a9d4e75a36ada9bd9de7e15 Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ImagesTestJSON-665973449 Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ImagesTestJSON-665973449-project Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 8b2304d9c7dd493983542a54b6799989 Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ImagesTestJSON-665973449-project Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: exception: Image not found. Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '6323abb2-2402-4077-8f04-5eb58d69b891'} Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6323abb2-2402-4077-8f04-5eb58d69b891 to delete Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6323abb2-2402-4077-8f04-5eb58d69b891 could not be found. Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.319071 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:50.323146 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:50.323146 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:50.323146 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:08:50.323146 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:08:50.323146 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:08:50.323146 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:08:50.323146 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:08:50.323146 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:08:50.323146 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 20 12:08:50.323146 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 20 12:08:50.323146 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 20 12:08:50.323146 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.323146 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:50.323146 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.323146 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:50.323146 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:50.323146 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:50.323146 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:08:50.323146 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:08:50.323146 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 20 12:08:50.323146 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.323146 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c1daa7cb-b2b0-408e-bd30-e7b80506cb40 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Returning 404 to user: Image not found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:08:50.323146 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c1daa7cb-b2b0-408e-bd30-e7b80506cb40 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "DELETE /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891" status: 404 len: 62 microversion: 2.1 time: 0.055521 Jun 20 12:08:50.325798 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1269/2545] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:50 2022] DELETE /compute/v2.1/images/6323abb2-2402-4077-8f04-5eb58d69b891 => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:08:50.340447 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c264a86e-36c5-45c4-b25b-24da45c6cf3e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:50.341555 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-193591c1-c65f-4f0b-afcc-663134c94402 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:50.342055 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-193591c1-c65f-4f0b-afcc-663134c94402 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: ed397d7b-8f66-46c9-b225-1cec5c844672] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:50.353200 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-193591c1-c65f-4f0b-afcc-663134c94402 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:50.353926 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-193591c1-c65f-4f0b-afcc-663134c94402 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:50.354044 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c264a86e-36c5-45c4-b25b-24da45c6cf3e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.388273 Jun 20 12:08:50.355023 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-193591c1-c65f-4f0b-afcc-663134c94402 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:50.355928 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-193591c1-c65f-4f0b-afcc-663134c94402 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:50.357359 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1277/2546] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:49 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:50.372080 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-193591c1-c65f-4f0b-afcc-663134c94402 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] HTTP exception thrown: Instance ed397d7b-8f66-46c9-b225-1cec5c844672 could not be found. Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-193591c1-c65f-4f0b-afcc-663134c94402 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Request method failure captured: Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672 HTTP/1.1 Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGJABbdo0PoMIi75hcYbY9WA3Baq_MO9Sbca_A0Agd8YAMBr9yt3HAvqhrzhVUa0FMb1sIiaDSfZcsGmkaN3nokQlPU20Me8U9GFyQZ2-ZTqUlk85vSWSv04TiWGla5J-N_p83pEsnalaKgpo36-a4Ty-ItE0gLNT8ngT198Ris7cIE Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 615573a78a9d4e75a36ada9bd9de7e15 Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ImagesTestJSON-665973449 Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ImagesTestJSON-665973449 Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 615573a78a9d4e75a36ada9bd9de7e15 Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ImagesTestJSON-665973449 Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ImagesTestJSON-665973449-project Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 8b2304d9c7dd493983542a54b6799989 Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ImagesTestJSON-665973449-project Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: exception: Instance ed397d7b-8f66-46c9-b225-1cec5c844672 could not be found. Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'ed397d7b-8f66-46c9-b225-1cec5c844672'} Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed397d7b-8f66-46c9-b225-1cec5c844672 could not be found. Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:08:50.374372 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed397d7b-8f66-46c9-b225-1cec5c844672 could not be found. Jun 20 12:08:50.378845 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.378845 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:50.378845 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.378845 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:50.378845 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:50.378845 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:50.378845 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:08:50.378845 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:08:50.378845 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed397d7b-8f66-46c9-b225-1cec5c844672 could not be found. Jun 20 12:08:50.378845 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.381004 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-193591c1-c65f-4f0b-afcc-663134c94402 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Returning 404 to user: Instance ed397d7b-8f66-46c9-b225-1cec5c844672 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:08:50.382174 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-193591c1-c65f-4f0b-afcc-663134c94402 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672" status: 404 len: 111 microversion: 2.1 time: 0.050004 Jun 20 12:08:50.383221 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1270/2547] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:08:50 2022] DELETE /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:08:50.403745 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-777188d4-9e21-49ac-b68a-4055c27b43f7 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:50.405352 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-777188d4-9e21-49ac-b68a-4055c27b43f7 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: ed397d7b-8f66-46c9-b225-1cec5c844672] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:50.423408 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-48b14c22-9359-4e2e-b198-f014e7bd7ff4 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-570896375", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "dadde73c-e8f7-441b-8503-8f17caea8651"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-48b14c22-9359-4e2e-b198-f014e7bd7ff4 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 172 Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-570896375", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "dadde73c-e8f7-441b-8503-8f17caea8651"}]}} Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-570896375', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'dadde73c-e8f7-441b-8503-8f17caea8651'}]}}} Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise error Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi -1 Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 12:08:50.426836 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 12:08:50.433788 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 12:08:50.433788 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 12:08:50.433788 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jun 20 12:08:50.433788 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.433788 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:50.433788 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.433788 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:50.433788 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:50.433788 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:50.433788 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 12:08:50.433788 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 12:08:50.433788 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jun 20 12:08:50.433788 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.433788 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-48b14c22-9359-4e2e-b198-f014e7bd7ff4 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:08:50.437055 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-48b14c22-9359-4e2e-b198-f014e7bd7ff4 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.012431 Jun 20 12:08:50.437697 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1271/2548] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:08:50 2022] POST /compute/v2.1/servers => generated 145 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 20 12:08:50.443591 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-777188d4-9e21-49ac-b68a-4055c27b43f7 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:50.445021 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-777188d4-9e21-49ac-b68a-4055c27b43f7 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:50.447548 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-777188d4-9e21-49ac-b68a-4055c27b43f7 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:50.450108 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-777188d4-9e21-49ac-b68a-4055c27b43f7 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:50.453195 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8e7d6a1b-f6c3-4fd4-a5ab-595a32ad0a36 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:50.453822 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8e7d6a1b-f6c3-4fd4-a5ab-595a32ad0a36 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:50.470180 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8e7d6a1b-f6c3-4fd4-a5ab-595a32ad0a36 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:50.470630 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8e7d6a1b-f6c3-4fd4-a5ab-595a32ad0a36 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:50.474053 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8e7d6a1b-f6c3-4fd4-a5ab-595a32ad0a36 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:50.474624 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8e7d6a1b-f6c3-4fd4-a5ab-595a32ad0a36 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:50.487865 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-777188d4-9e21-49ac-b68a-4055c27b43f7 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] HTTP exception thrown: Instance ed397d7b-8f66-46c9-b225-1cec5c844672 could not be found. Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-777188d4-9e21-49ac-b68a-4055c27b43f7 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Request method failure captured: Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672 HTTP/1.1 Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGJABbdo0PoMIi75hcYbY9WA3Baq_MO9Sbca_A0Agd8YAMBr9yt3HAvqhrzhVUa0FMb1sIiaDSfZcsGmkaN3nokQlPU20Me8U9GFyQZ2-ZTqUlk85vSWSv04TiWGla5J-N_p83pEsnalaKgpo36-a4Ty-ItE0gLNT8ngT198Ris7cIE Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 615573a78a9d4e75a36ada9bd9de7e15 Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ImagesTestJSON-665973449 Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ImagesTestJSON-665973449 Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 615573a78a9d4e75a36ada9bd9de7e15 Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ImagesTestJSON-665973449 Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ImagesTestJSON-665973449-project Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 8b2304d9c7dd493983542a54b6799989 Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ImagesTestJSON-665973449-project Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: exception: Instance ed397d7b-8f66-46c9-b225-1cec5c844672 could not be found. Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'ed397d7b-8f66-46c9-b225-1cec5c844672'} Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed397d7b-8f66-46c9-b225-1cec5c844672 could not be found. Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed397d7b-8f66-46c9-b225-1cec5c844672 could not be found. Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.490227 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:50.494245 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:50.494245 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:50.494245 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:08:50.494245 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:08:50.494245 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed397d7b-8f66-46c9-b225-1cec5c844672 could not be found. Jun 20 12:08:50.494245 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.494245 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-777188d4-9e21-49ac-b68a-4055c27b43f7 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Returning 404 to user: Instance ed397d7b-8f66-46c9-b225-1cec5c844672 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:08:50.494245 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-777188d4-9e21-49ac-b68a-4055c27b43f7 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672" status: 404 len: 111 microversion: 2.1 time: 0.106815 Jun 20 12:08:50.497628 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1278/2549] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:50 2022] GET /compute/v2.1/servers/ed397d7b-8f66-46c9-b225-1cec5c844672 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:08:50.506347 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9fdb6c76-eb3a-4bd8-980c-41a8a7e0cdce tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f607384c550>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:50.550131 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-9fdb6c76-eb3a-4bd8-980c-41a8a7e0cdce tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] HTTP exception thrown: Image not found. Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9fdb6c76-eb3a-4bd8-980c-41a8a7e0cdce tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Request method failure captured: Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/images/34da3fb0-46ad-49d0-8de1-4fda4ca64f01 HTTP/1.1 Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGJABbdo0PoMIi75hcYbY9WA3Baq_MO9Sbca_A0Agd8YAMBr9yt3HAvqhrzhVUa0FMb1sIiaDSfZcsGmkaN3nokQlPU20Me8U9GFyQZ2-ZTqUlk85vSWSv04TiWGla5J-N_p83pEsnalaKgpo36-a4Ty-ItE0gLNT8ngT198Ris7cIE Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 615573a78a9d4e75a36ada9bd9de7e15 Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ImagesTestJSON-665973449 Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ImagesTestJSON-665973449 Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 615573a78a9d4e75a36ada9bd9de7e15 Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ImagesTestJSON-665973449 Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ImagesTestJSON-665973449-project Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 8b2304d9c7dd493983542a54b6799989 Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ImagesTestJSON-665973449-project Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: exception: Image not found. Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '34da3fb0-46ad-49d0-8de1-4fda4ca64f01'} Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 34da3fb0-46ad-49d0-8de1-4fda4ca64f01 to delete Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 34da3fb0-46ad-49d0-8de1-4fda4ca64f01 could not be found. Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.554124 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:50.558327 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:50.558327 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:50.558327 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:08:50.558327 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:08:50.558327 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:08:50.558327 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:08:50.558327 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:08:50.558327 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:08:50.558327 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 20 12:08:50.558327 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 20 12:08:50.558327 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 20 12:08:50.558327 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.558327 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:50.558327 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.558327 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:50.558327 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:50.558327 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:50.558327 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:08:50.558327 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:08:50.558327 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 20 12:08:50.558327 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.558327 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9fdb6c76-eb3a-4bd8-980c-41a8a7e0cdce tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Returning 404 to user: Image not found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:08:50.558327 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9fdb6c76-eb3a-4bd8-980c-41a8a7e0cdce tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "DELETE /compute/v2.1/images/34da3fb0-46ad-49d0-8de1-4fda4ca64f01" status: 404 len: 62 microversion: 2.1 time: 0.057004 Jun 20 12:08:50.558327 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1279/2550] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:50 2022] DELETE /compute/v2.1/images/34da3fb0-46ad-49d0-8de1-4fda4ca64f01 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:08:50.568286 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bb91d21b-636a-44fd-890c-937a22d3b68f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:50.569979 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bb91d21b-636a-44fd-890c-937a22d3b68f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:50.582614 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bb91d21b-636a-44fd-890c-937a22d3b68f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:50.583217 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bb91d21b-636a-44fd-890c-937a22d3b68f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:50.584437 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bb91d21b-636a-44fd-890c-937a22d3b68f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:50.585124 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bb91d21b-636a-44fd-890c-937a22d3b68f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:50.607808 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-bb91d21b-636a-44fd-890c-937a22d3b68f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] HTTP exception thrown: Instance c6a95c21-d3d4-4867-9ae6-7e9f3183f974 could not be found. Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bb91d21b-636a-44fd-890c-937a22d3b68f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Request method failure captured: Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 HTTP/1.1 Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGJABbdo0PoMIi75hcYbY9WA3Baq_MO9Sbca_A0Agd8YAMBr9yt3HAvqhrzhVUa0FMb1sIiaDSfZcsGmkaN3nokQlPU20Me8U9GFyQZ2-ZTqUlk85vSWSv04TiWGla5J-N_p83pEsnalaKgpo36-a4Ty-ItE0gLNT8ngT198Ris7cIE Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 615573a78a9d4e75a36ada9bd9de7e15 Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ImagesTestJSON-665973449 Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ImagesTestJSON-665973449 Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 615573a78a9d4e75a36ada9bd9de7e15 Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ImagesTestJSON-665973449 Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ImagesTestJSON-665973449-project Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 8b2304d9c7dd493983542a54b6799989 Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ImagesTestJSON-665973449-project Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: exception: Instance c6a95c21-d3d4-4867-9ae6-7e9f3183f974 could not be found. Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'c6a95c21-d3d4-4867-9ae6-7e9f3183f974'} Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6a95c21-d3d4-4867-9ae6-7e9f3183f974 could not be found. Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:08:50.609581 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6a95c21-d3d4-4867-9ae6-7e9f3183f974 could not be found. Jun 20 12:08:50.616723 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.616723 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:50.616723 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.616723 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:50.616723 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:50.616723 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:50.616723 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:08:50.616723 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:08:50.616723 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6a95c21-d3d4-4867-9ae6-7e9f3183f974 could not be found. Jun 20 12:08:50.616723 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.616723 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bb91d21b-636a-44fd-890c-937a22d3b68f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Returning 404 to user: Instance c6a95c21-d3d4-4867-9ae6-7e9f3183f974 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:08:50.616723 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bb91d21b-636a-44fd-890c-937a22d3b68f tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 404 len: 111 microversion: 2.1 time: 0.046594 Jun 20 12:08:50.616723 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1280/2551] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:08:50 2022] DELETE /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:08:50.622312 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7772a10f-57cb-47f2-b48e-c975909ebe25 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:50.624784 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7772a10f-57cb-47f2-b48e-c975909ebe25 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: c6a95c21-d3d4-4867-9ae6-7e9f3183f974] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:50.632868 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7772a10f-57cb-47f2-b48e-c975909ebe25 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:50.634673 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7772a10f-57cb-47f2-b48e-c975909ebe25 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:50.635707 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7772a10f-57cb-47f2-b48e-c975909ebe25 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:50.636409 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7772a10f-57cb-47f2-b48e-c975909ebe25 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:50.692177 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-7772a10f-57cb-47f2-b48e-c975909ebe25 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] HTTP exception thrown: Instance c6a95c21-d3d4-4867-9ae6-7e9f3183f974 could not be found. Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7772a10f-57cb-47f2-b48e-c975909ebe25 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Request method failure captured: Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 HTTP/1.1 Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGJABbdo0PoMIi75hcYbY9WA3Baq_MO9Sbca_A0Agd8YAMBr9yt3HAvqhrzhVUa0FMb1sIiaDSfZcsGmkaN3nokQlPU20Me8U9GFyQZ2-ZTqUlk85vSWSv04TiWGla5J-N_p83pEsnalaKgpo36-a4Ty-ItE0gLNT8ngT198Ris7cIE Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 615573a78a9d4e75a36ada9bd9de7e15 Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ImagesTestJSON-665973449 Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ImagesTestJSON-665973449 Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 615573a78a9d4e75a36ada9bd9de7e15 Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ImagesTestJSON-665973449 Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ImagesTestJSON-665973449-project Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 8b2304d9c7dd493983542a54b6799989 Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ImagesTestJSON-665973449-project Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: exception: Instance c6a95c21-d3d4-4867-9ae6-7e9f3183f974 could not be found. Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'c6a95c21-d3d4-4867-9ae6-7e9f3183f974'} Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6a95c21-d3d4-4867-9ae6-7e9f3183f974 could not be found. Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6a95c21-d3d4-4867-9ae6-7e9f3183f974 could not be found. Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.695036 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:50.699465 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:50.699465 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:50.699465 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:08:50.699465 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:08:50.699465 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6a95c21-d3d4-4867-9ae6-7e9f3183f974 could not be found. Jun 20 12:08:50.699465 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.699465 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7772a10f-57cb-47f2-b48e-c975909ebe25 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Returning 404 to user: Instance c6a95c21-d3d4-4867-9ae6-7e9f3183f974 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:08:50.699465 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7772a10f-57cb-47f2-b48e-c975909ebe25 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974" status: 404 len: 111 microversion: 2.1 time: 0.079681 Jun 20 12:08:50.699465 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1281/2552] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:50 2022] GET /compute/v2.1/servers/c6a95c21-d3d4-4867-9ae6-7e9f3183f974 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:08:50.715117 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e3540a44-e80f-43a3-b132-8b8bb9b2889d tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '.version_select at 0x7f6073193820>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:50.756997 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-e3540a44-e80f-43a3-b132-8b8bb9b2889d tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] HTTP exception thrown: Image not found. Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e3540a44-e80f-43a3-b132-8b8bb9b2889d tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Request method failure captured: Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/images/79ed6967-cc63-4288-a465-d14d880ced9f HTTP/1.1 Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGJABbdo0PoMIi75hcYbY9WA3Baq_MO9Sbca_A0Agd8YAMBr9yt3HAvqhrzhVUa0FMb1sIiaDSfZcsGmkaN3nokQlPU20Me8U9GFyQZ2-ZTqUlk85vSWSv04TiWGla5J-N_p83pEsnalaKgpo36-a4Ty-ItE0gLNT8ngT198Ris7cIE Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 615573a78a9d4e75a36ada9bd9de7e15 Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ImagesTestJSON-665973449 Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ImagesTestJSON-665973449 Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 615573a78a9d4e75a36ada9bd9de7e15 Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ImagesTestJSON-665973449 Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ImagesTestJSON-665973449-project Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 8b2304d9c7dd493983542a54b6799989 Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ImagesTestJSON-665973449-project Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: exception: Image not found. Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '79ed6967-cc63-4288-a465-d14d880ced9f'} Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 79ed6967-cc63-4288-a465-d14d880ced9f to delete Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 79ed6967-cc63-4288-a465-d14d880ced9f could not be found. Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.758802 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:50.763239 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:50.763239 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:50.763239 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:08:50.763239 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:08:50.763239 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:08:50.763239 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:08:50.763239 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:08:50.763239 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:08:50.763239 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 20 12:08:50.763239 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 20 12:08:50.763239 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 20 12:08:50.763239 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.763239 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:50.763239 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.763239 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:50.763239 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:50.763239 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:50.763239 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:08:50.763239 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:08:50.763239 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 20 12:08:50.763239 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.763239 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e3540a44-e80f-43a3-b132-8b8bb9b2889d tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Returning 404 to user: Image not found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:08:50.763239 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e3540a44-e80f-43a3-b132-8b8bb9b2889d tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "DELETE /compute/v2.1/images/79ed6967-cc63-4288-a465-d14d880ced9f" status: 404 len: 62 microversion: 2.1 time: 0.056855 Jun 20 12:08:50.763239 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1282/2553] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:50 2022] DELETE /compute/v2.1/images/79ed6967-cc63-4288-a465-d14d880ced9f => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:08:50.769987 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-95b996bf-a2f7-4320-ad0f-2be2ca7f7c59 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:50.771479 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-95b996bf-a2f7-4320-ad0f-2be2ca7f7c59 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:50.792998 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95b996bf-a2f7-4320-ad0f-2be2ca7f7c59 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:50.797134 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95b996bf-a2f7-4320-ad0f-2be2ca7f7c59 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:50.798009 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95b996bf-a2f7-4320-ad0f-2be2ca7f7c59 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:50.801488 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95b996bf-a2f7-4320-ad0f-2be2ca7f7c59 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:50.825760 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-95b996bf-a2f7-4320-ad0f-2be2ca7f7c59 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] HTTP exception thrown: Instance 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a could not be found. Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-95b996bf-a2f7-4320-ad0f-2be2ca7f7c59 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Request method failure captured: Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a HTTP/1.1 Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGJABbdo0PoMIi75hcYbY9WA3Baq_MO9Sbca_A0Agd8YAMBr9yt3HAvqhrzhVUa0FMb1sIiaDSfZcsGmkaN3nokQlPU20Me8U9GFyQZ2-ZTqUlk85vSWSv04TiWGla5J-N_p83pEsnalaKgpo36-a4Ty-ItE0gLNT8ngT198Ris7cIE Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 615573a78a9d4e75a36ada9bd9de7e15 Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ImagesTestJSON-665973449 Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ImagesTestJSON-665973449 Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 615573a78a9d4e75a36ada9bd9de7e15 Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ImagesTestJSON-665973449 Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ImagesTestJSON-665973449-project Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 8b2304d9c7dd493983542a54b6799989 Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ImagesTestJSON-665973449-project Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a could not be found. Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '4b9e1026-a6f6-47f2-8734-4b05eeff8b9a'} Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a could not be found. Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:08:50.827527 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a could not be found. Jun 20 12:08:50.831742 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.831742 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:50.831742 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.831742 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:50.831742 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:50.831742 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:50.831742 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:08:50.831742 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:08:50.831742 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a could not be found. Jun 20 12:08:50.831742 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.831742 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-95b996bf-a2f7-4320-ad0f-2be2ca7f7c59 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Returning 404 to user: Instance 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:08:50.831742 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-95b996bf-a2f7-4320-ad0f-2be2ca7f7c59 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a" status: 404 len: 111 microversion: 2.1 time: 0.062977 Jun 20 12:08:50.831742 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1283/2554] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:08:50 2022] DELETE /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:08:50.839235 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-318a97fe-ec13-4ed4-bba0-9452011bb7a2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:50.845266 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-318a97fe-ec13-4ed4-bba0-9452011bb7a2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] [instance: 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:50.853712 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-318a97fe-ec13-4ed4-bba0-9452011bb7a2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:50.855040 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-318a97fe-ec13-4ed4-bba0-9452011bb7a2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:50.855989 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-318a97fe-ec13-4ed4-bba0-9452011bb7a2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:50.856856 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-318a97fe-ec13-4ed4-bba0-9452011bb7a2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:50.885698 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-318a97fe-ec13-4ed4-bba0-9452011bb7a2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] HTTP exception thrown: Instance 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a could not be found. Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-318a97fe-ec13-4ed4-bba0-9452011bb7a2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Request method failure captured: Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a HTTP/1.1 Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGJABbdo0PoMIi75hcYbY9WA3Baq_MO9Sbca_A0Agd8YAMBr9yt3HAvqhrzhVUa0FMb1sIiaDSfZcsGmkaN3nokQlPU20Me8U9GFyQZ2-ZTqUlk85vSWSv04TiWGla5J-N_p83pEsnalaKgpo36-a4Ty-ItE0gLNT8ngT198Ris7cIE Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 615573a78a9d4e75a36ada9bd9de7e15 Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ImagesTestJSON-665973449 Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_615573a78a9d4e75a36ada9bd9de7e15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ImagesTestJSON-665973449 Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 615573a78a9d4e75a36ada9bd9de7e15 Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ImagesTestJSON-665973449 Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ImagesTestJSON-665973449-project Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 8b2304d9c7dd493983542a54b6799989 Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ImagesTestJSON-665973449-project Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a could not be found. Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '4b9e1026-a6f6-47f2-8734-4b05eeff8b9a'} Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a could not be found. Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a could not be found. Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.892893 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:50.898310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:50.898310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:50.898310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:08:50.898310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:08:50.898310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a could not be found. Jun 20 12:08:50.898310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:50.898310 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-318a97fe-ec13-4ed4-bba0-9452011bb7a2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] Returning 404 to user: Instance 4b9e1026-a6f6-47f2-8734-4b05eeff8b9a could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:08:50.898310 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-318a97fe-ec13-4ed4-bba0-9452011bb7a2 tempest-ImagesTestJSON-665973449 tempest-ImagesTestJSON-665973449-project] 10.222.0.27 "GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a" status: 404 len: 111 microversion: 2.1 time: 0.059944 Jun 20 12:08:50.901895 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1284/2555] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:50 2022] GET /compute/v2.1/servers/4b9e1026-a6f6-47f2-8734-4b05eeff8b9a => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:08:50.918016 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6bec3579-ad21-4049-b18b-a19351d25a22 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:50.919987 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6bec3579-ad21-4049-b18b-a19351d25a22 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:50.935692 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6bec3579-ad21-4049-b18b-a19351d25a22 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:50.936553 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6bec3579-ad21-4049-b18b-a19351d25a22 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:50.939308 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6bec3579-ad21-4049-b18b-a19351d25a22 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:50.940025 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6bec3579-ad21-4049-b18b-a19351d25a22 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:51.218928 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6bec3579-ad21-4049-b18b-a19351d25a22 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:51.233213 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6bec3579-ad21-4049-b18b-a19351d25a22 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1378 microversion: 2.1 time: 0.330083 Jun 20 12:08:51.247149 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1285/2556] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:50 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1378 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:51.273103 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ca996fdc-d093-4367-9c66-5c0240f538ce tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:51.274038 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ca996fdc-d093-4367-9c66-5c0240f538ce tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:51.293055 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ca996fdc-d093-4367-9c66-5c0240f538ce tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:51.293519 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ca996fdc-d093-4367-9c66-5c0240f538ce tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:51.294398 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ca996fdc-d093-4367-9c66-5c0240f538ce tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:51.294849 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ca996fdc-d093-4367-9c66-5c0240f538ce tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:51.485542 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8e7d6a1b-f6c3-4fd4-a5ab-595a32ad0a36 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:51.497155 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8e7d6a1b-f6c3-4fd4-a5ab-595a32ad0a36 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 1.052652 Jun 20 12:08:51.500669 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1272/2557] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:50 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:08:51.517568 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c796c8fe-6925-47cb-becf-af9e47f59974 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:51.518488 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c796c8fe-6925-47cb-becf-af9e47f59974 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:51.536643 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c796c8fe-6925-47cb-becf-af9e47f59974 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:51.541695 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c796c8fe-6925-47cb-becf-af9e47f59974 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:51.549451 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c796c8fe-6925-47cb-becf-af9e47f59974 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:51.550278 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c796c8fe-6925-47cb-becf-af9e47f59974 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:52.395528 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ca996fdc-d093-4367-9c66-5c0240f538ce tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:52.411740 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ca996fdc-d093-4367-9c66-5c0240f538ce tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1389 microversion: 2.1 time: 1.144842 Jun 20 12:08:52.423680 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1286/2558] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:51 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1389 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:08:52.429859 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6ee44f0f-dbe5-4d76-a47f-da35a956dba7 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:52.430686 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6ee44f0f-dbe5-4d76-a47f-da35a956dba7 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:52.441285 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ee44f0f-dbe5-4d76-a47f-da35a956dba7 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:52.442059 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ee44f0f-dbe5-4d76-a47f-da35a956dba7 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:52.443116 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ee44f0f-dbe5-4d76-a47f-da35a956dba7 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:52.443917 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ee44f0f-dbe5-4d76-a47f-da35a956dba7 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:52.670262 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c796c8fe-6925-47cb-becf-af9e47f59974 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:52.684912 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c796c8fe-6925-47cb-becf-af9e47f59974 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 1.171712 Jun 20 12:08:52.689039 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1273/2559] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:51 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:52.750607 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-844faabe-8600-4bae-a091-42d2089773bc tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1241318236", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:08:52.759589 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-844faabe-8600-4bae-a091-42d2089773bc tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-844faabe-8600-4bae-a091-42d2089773bc tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 216 Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1241318236", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1241318236', 'imageRef': 'f16836cc-4e18-4bd0-b261-3865adf8cb83', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._validate_network_id( Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:52.761294 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:52.768634 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:52.768634 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:52.768634 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:52.768634 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:08:52.768634 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:08:52.768634 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jun 20 12:08:52.768634 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:08:52.768634 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-844faabe-8600-4bae-a091-42d2089773bc tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:08:52.768634 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-844faabe-8600-4bae-a091-42d2089773bc tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.016186 Jun 20 12:08:52.768634 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1274/2560] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:08:52 2022] POST /compute/v2.1/servers => generated 123 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:08:52.786810 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8bed64e0-abd7-4ffb-afea-a077210a2a9e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:52.791360 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8bed64e0-abd7-4ffb-afea-a077210a2a9e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:52.810266 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bed64e0-abd7-4ffb-afea-a077210a2a9e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:52.811020 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bed64e0-abd7-4ffb-afea-a077210a2a9e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:52.814555 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bed64e0-abd7-4ffb-afea-a077210a2a9e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:52.815279 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bed64e0-abd7-4ffb-afea-a077210a2a9e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:53.211037 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6ee44f0f-dbe5-4d76-a47f-da35a956dba7 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:53.231061 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6ee44f0f-dbe5-4d76-a47f-da35a956dba7 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1378 microversion: 2.1 time: 0.801140 Jun 20 12:08:53.245620 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1287/2561] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:52 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1378 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:53.350691 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8bed64e0-abd7-4ffb-afea-a077210a2a9e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:53.358593 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8bed64e0-abd7-4ffb-afea-a077210a2a9e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.581472 Jun 20 12:08:53.363639 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1275/2562] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:52 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:53.378963 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4b550687-f252-426d-9cf3-5b5b6f620394 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:53.379609 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4b550687-f252-426d-9cf3-5b5b6f620394 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:53.390508 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4b550687-f252-426d-9cf3-5b5b6f620394 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:53.391219 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4b550687-f252-426d-9cf3-5b5b6f620394 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:53.393687 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4b550687-f252-426d-9cf3-5b5b6f620394 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:53.394643 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4b550687-f252-426d-9cf3-5b5b6f620394 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:53.430314 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-226c7cec-471f-404e-be5e-eb4662f38b45 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:53.434015 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-226c7cec-471f-404e-be5e-eb4662f38b45 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:53.448521 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-226c7cec-471f-404e-be5e-eb4662f38b45 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:53.452012 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-226c7cec-471f-404e-be5e-eb4662f38b45 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:53.453794 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-226c7cec-471f-404e-be5e-eb4662f38b45 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:53.454246 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-226c7cec-471f-404e-be5e-eb4662f38b45 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:53.808338 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-226c7cec-471f-404e-be5e-eb4662f38b45 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:53.818281 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-226c7cec-471f-404e-be5e-eb4662f38b45 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1389 microversion: 2.1 time: 0.392509 Jun 20 12:08:53.821424 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1276/2563] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:53 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1389 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:54.249098 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-06cf3a65-1604-4d0c-a057-ac440272810b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:54.250081 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-06cf3a65-1604-4d0c-a057-ac440272810b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:54.258139 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06cf3a65-1604-4d0c-a057-ac440272810b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:54.259108 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06cf3a65-1604-4d0c-a057-ac440272810b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:54.260262 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06cf3a65-1604-4d0c-a057-ac440272810b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:54.261214 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06cf3a65-1604-4d0c-a057-ac440272810b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:54.577947 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-06cf3a65-1604-4d0c-a057-ac440272810b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:54.594805 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-06cf3a65-1604-4d0c-a057-ac440272810b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1378 microversion: 2.1 time: 0.349494 Jun 20 12:08:54.596193 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1277/2564] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:54 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1378 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:08:54.811943 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-e8bebd28-35dc-4b88-b284-3fd9a45c0916 req-34253399-4c6e-4685-a353-3033cdfe1d6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8b3d285-0f08-4deb-859e-babab7f3b656", "name": "network-vif-plugged", "status": "completed", "tag": "e23efb88-f8d5-4db8-8321-1c16dca584be"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:08:54.886720 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-e8bebd28-35dc-4b88-b284-3fd9a45c0916 req-34253399-4c6e-4685-a353-3033cdfe1d6c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:54.900581 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-e8bebd28-35dc-4b88-b284-3fd9a45c0916 req-34253399-4c6e-4685-a353-3033cdfe1d6c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:54.940730 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-e8bebd28-35dc-4b88-b284-3fd9a45c0916 req-34253399-4c6e-4685-a353-3033cdfe1d6c service nova] Creating event network-vif-plugged:e23efb88-f8d5-4db8-8321-1c16dca584be for instance f8b3d285-0f08-4deb-859e-babab7f3b656 on n-h2-master-1 Jun 20 12:08:54.956665 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-e8bebd28-35dc-4b88-b284-3fd9a45c0916 req-34253399-4c6e-4685-a353-3033cdfe1d6c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160295 Jun 20 12:08:54.957897 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1278/2565] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:08:54.966921 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-782717b1-b858-41a6-862b-8f01dc36837a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:54.967917 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-782717b1-b858-41a6-862b-8f01dc36837a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:54.977881 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-782717b1-b858-41a6-862b-8f01dc36837a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:54.978281 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-782717b1-b858-41a6-862b-8f01dc36837a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:54.979325 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-782717b1-b858-41a6-862b-8f01dc36837a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:54.979938 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-782717b1-b858-41a6-862b-8f01dc36837a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:55.245428 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4b550687-f252-426d-9cf3-5b5b6f620394 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:55.254103 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4b550687-f252-426d-9cf3-5b5b6f620394 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 1.880487 Jun 20 12:08:55.254668 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1288/2566] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:53 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 1882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:55.327538 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c27884b9-cca3-40ca-ab72-15a3722b5d6c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-587683359", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "key_name": "tempest-key-1157283008", "networks": [{"uuid": "dadde73c-e8f7-441b-8503-8f17caea8651"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:08:55.370827 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-782717b1-b858-41a6-862b-8f01dc36837a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:55.381427 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-782717b1-b858-41a6-862b-8f01dc36837a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1389 microversion: 2.1 time: 0.419733 Jun 20 12:08:55.384292 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1279/2567] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:54 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1389 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:55.416261 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-c27884b9-cca3-40ca-ab72-15a3722b5d6c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] validate_networks() for [('dadde73c-e8f7-441b-8503-8f17caea8651', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:08:55.616507 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-36f0f5cc-386d-4554-854a-6ebedb945531 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:55.618523 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-36f0f5cc-386d-4554-854a-6ebedb945531 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:55.640160 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36f0f5cc-386d-4554-854a-6ebedb945531 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:55.642074 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36f0f5cc-386d-4554-854a-6ebedb945531 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:55.644048 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36f0f5cc-386d-4554-854a-6ebedb945531 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:55.645083 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36f0f5cc-386d-4554-854a-6ebedb945531 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:55.930091 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-36f0f5cc-386d-4554-854a-6ebedb945531 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:55.949357 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-36f0f5cc-386d-4554-854a-6ebedb945531 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1378 microversion: 2.1 time: 0.331450 Jun 20 12:08:55.950817 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1280/2568] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:55 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1378 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:56.404337 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e267fc28-6346-47e3-b280-e9c7bdaff549 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:56.405247 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e267fc28-6346-47e3-b280-e9c7bdaff549 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:56.419684 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e267fc28-6346-47e3-b280-e9c7bdaff549 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:56.425014 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e267fc28-6346-47e3-b280-e9c7bdaff549 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:56.426372 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e267fc28-6346-47e3-b280-e9c7bdaff549 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:56.428372 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e267fc28-6346-47e3-b280-e9c7bdaff549 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:56.927067 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e267fc28-6346-47e3-b280-e9c7bdaff549 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:56.951396 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e267fc28-6346-47e3-b280-e9c7bdaff549 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1389 microversion: 2.1 time: 0.543790 Jun 20 12:08:56.953651 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1281/2569] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:56 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1389 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:08:56.972506 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ab5926aa-5b14-495b-b5ad-82b59bde3dda tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:56.979383 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ab5926aa-5b14-495b-b5ad-82b59bde3dda tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:56.997318 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ab5926aa-5b14-495b-b5ad-82b59bde3dda tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:56.998697 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ab5926aa-5b14-495b-b5ad-82b59bde3dda tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:56.999749 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ab5926aa-5b14-495b-b5ad-82b59bde3dda tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:57.003356 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ab5926aa-5b14-495b-b5ad-82b59bde3dda tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:57.045906 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-c27884b9-cca3-40ca-ab72-15a3722b5d6c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] HTTP exception thrown: Invalid key_name provided. Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c27884b9-cca3-40ca-ab72-15a3722b5d6c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 246 Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-587683359", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "key_name": "tempest-key-1157283008", "networks": [{"uuid": "dadde73c-e8f7-441b-8503-8f17caea8651"}]}} Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: exception: Invalid key_name provided. Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-587683359', 'imageRef': 'f16836cc-4e18-4bd0-b261-3865adf8cb83', 'flavorRef': '452', 'key_name': 'tempest-key-1157283008', 'networks': [{'uuid': 'dadde73c-e8f7-441b-8503-8f17caea8651'}]}}} Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1075, in _validate_and_build_base_options Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1157283008 not found for user 719eacccdc9f4daea56644de31876572 Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:57.049440 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:57.053678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:57.053678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:08:57.053678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:08:57.053678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:08:57.053678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:08:57.053678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:08:57.053678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:08:57.053678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:08:57.053678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:08:57.053678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:08:57.053678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:08:57.053678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 20 12:08:57.053678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Jun 20 12:08:57.053678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jun 20 12:08:57.053678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Jun 20 12:08:57.053678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:57.053678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:08:57.053678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:57.053678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:08:57.053678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:08:57.053678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:08:57.053678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:08:57.053678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:08:57.053678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Jun 20 12:08:57.053678 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:08:57.057380 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c27884b9-cca3-40ca-ab72-15a3722b5d6c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 400 to user: Invalid key_name provided. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:08:57.060717 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c27884b9-cca3-40ca-ab72-15a3722b5d6c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.737095 Jun 20 12:08:57.069639 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1289/2570] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:08:55 2022] POST /compute/v2.1/servers => generated 70 bytes in 1747 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jun 20 12:08:57.083626 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ab0f40a1-85b9-4a7a-bf5e-8a26384a4323 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:57.084751 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ab0f40a1-85b9-4a7a-bf5e-8a26384a4323 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:57.106232 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ab0f40a1-85b9-4a7a-bf5e-8a26384a4323 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:57.107290 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ab0f40a1-85b9-4a7a-bf5e-8a26384a4323 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:57.120625 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ab0f40a1-85b9-4a7a-bf5e-8a26384a4323 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:57.121098 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ab0f40a1-85b9-4a7a-bf5e-8a26384a4323 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:57.591716 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ab5926aa-5b14-495b-b5ad-82b59bde3dda tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:57.605673 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ab5926aa-5b14-495b-b5ad-82b59bde3dda tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1378 microversion: 2.1 time: 0.641919 Jun 20 12:08:57.607535 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1282/2571] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:56 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1378 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:08:57.970128 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-019e840e-aeb2-4754-9386-5b023e242ea7 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:57.971541 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-019e840e-aeb2-4754-9386-5b023e242ea7 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:58.021287 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-019e840e-aeb2-4754-9386-5b023e242ea7 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:58.022929 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-019e840e-aeb2-4754-9386-5b023e242ea7 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:58.024271 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-019e840e-aeb2-4754-9386-5b023e242ea7 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:58.024756 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-019e840e-aeb2-4754-9386-5b023e242ea7 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:58.319055 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ab0f40a1-85b9-4a7a-bf5e-8a26384a4323 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:58.328967 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ab0f40a1-85b9-4a7a-bf5e-8a26384a4323 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 1.257646 Jun 20 12:08:58.329835 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1290/2572] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:57 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:58.789623 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2f36fc35-38ec-496e-af9c-0914a072c0c8 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-255054173", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "63e98b43-e754-4964-976c-5396a9294741"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:08:58.951345 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-2f36fc35-38ec-496e-af9c-0914a072c0c8 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] validate_networks() for [('63e98b43-e754-4964-976c-5396a9294741', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:08:59.216842 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-019e840e-aeb2-4754-9386-5b023e242ea7 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:08:59.229119 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-019e840e-aeb2-4754-9386-5b023e242ea7 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1389 microversion: 2.1 time: 1.263696 Jun 20 12:08:59.234045 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1283/2573] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:57 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1389 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:08:59.244910 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1f05b7c3-13fe-46a0-b45e-51458013e2b5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:08:59.245848 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1f05b7c3-13fe-46a0-b45e-51458013e2b5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:08:59.262375 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f05b7c3-13fe-46a0-b45e-51458013e2b5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:59.263137 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f05b7c3-13fe-46a0-b45e-51458013e2b5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:08:59.264125 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f05b7c3-13fe-46a0-b45e-51458013e2b5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:08:59.265209 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f05b7c3-13fe-46a0-b45e-51458013e2b5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:00.022154 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1f05b7c3-13fe-46a0-b45e-51458013e2b5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:00.039808 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1f05b7c3-13fe-46a0-b45e-51458013e2b5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.804098 Jun 20 12:09:00.045967 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1284/2574] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:08:59 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:00.058523 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-869fc754-3134-4fb4-bce1-6b57ed6bdd57 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:00.073192 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-869fc754-3134-4fb4-bce1-6b57ed6bdd57 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:00.094187 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-869fc754-3134-4fb4-bce1-6b57ed6bdd57 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:00.095293 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-869fc754-3134-4fb4-bce1-6b57ed6bdd57 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:00.097212 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-869fc754-3134-4fb4-bce1-6b57ed6bdd57 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:00.098057 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-869fc754-3134-4fb4-bce1-6b57ed6bdd57 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:00.536377 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-2f36fc35-38ec-496e-af9c-0914a072c0c8 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:09:00.538016 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-2f36fc35-38ec-496e-af9c-0914a072c0c8 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:09:00.538726 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-2f36fc35-38ec-496e-af9c-0914a072c0c8 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:09:00.539618 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-2f36fc35-38ec-496e-af9c-0914a072c0c8 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:09:00.540523 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-2f36fc35-38ec-496e-af9c-0914a072c0c8 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:09:00.568796 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2f36fc35-38ec-496e-af9c-0914a072c0c8 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:00.572192 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2f36fc35-38ec-496e-af9c-0914a072c0c8 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:00.575406 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2f36fc35-38ec-496e-af9c-0914a072c0c8 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:00.590425 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2f36fc35-38ec-496e-af9c-0914a072c0c8 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:00.669355 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-2f36fc35-38ec-496e-af9c-0914a072c0c8 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Getting quotas for project f62c06c318b54505b639ad49a10dc9e5. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:09:00.701650 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-2f36fc35-38ec-496e-af9c-0914a072c0c8 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Getting quotas for user f9d39a7ff9af475b88d8ca1f1536fdf2 and project f62c06c318b54505b639ad49a10dc9e5. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:09:00.733513 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2f36fc35-38ec-496e-af9c-0914a072c0c8 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:09:00.761425 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2f36fc35-38ec-496e-af9c-0914a072c0c8 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:09:00.938248 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2f36fc35-38ec-496e-af9c-0914a072c0c8 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.603584 Jun 20 12:09:00.941916 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1291/2575] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:08:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:09:00.954310 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-41445a40-2265-493a-b01e-5e90207bea86 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1001122828", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "dadde73c-e8f7-441b-8503-8f17caea8651"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:01.426973 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.security_group_api [None req-41445a40-2265-493a-b01e-5e90207bea86 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Neutron security group does_not_exist not found {{(pid=119128) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Jun 20 12:09:01.433678 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-41445a40-2265-493a-b01e-5e90207bea86 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-41445a40-2265-493a-b01e-5e90207bea86 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 258 Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1001122828", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "dadde73c-e8f7-441b-8503-8f17caea8651"}]}} Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: exception: Unable to find security_group with name or id 'does_not_exist' Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1001122828', 'imageRef': 'f16836cc-4e18-4bd0-b261-3865adf8cb83', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'dadde73c-e8f7-441b-8503-8f17caea8651'}]}}} Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Jun 20 12:09:01.530846 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1060, in _validate_and_build_base_options Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 507, in _check_requested_secgroups Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Jun 20 12:09:01.536343 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:01.547269 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-41445a40-2265-493a-b01e-5e90207bea86 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:09:01.562460 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-41445a40-2265-493a-b01e-5e90207bea86 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.618631 Jun 20 12:09:01.571578 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1292/2576] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:09:00 2022] POST /compute/v2.1/servers => generated 106 bytes in 629 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:09:01.585140 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1ac9a17d-060a-45d0-b6d2-c52e625c323f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:01.587120 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1ac9a17d-060a-45d0-b6d2-c52e625c323f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:01.599942 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1ac9a17d-060a-45d0-b6d2-c52e625c323f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:01.601039 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1ac9a17d-060a-45d0-b6d2-c52e625c323f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:01.604139 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1ac9a17d-060a-45d0-b6d2-c52e625c323f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:01.608041 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1ac9a17d-060a-45d0-b6d2-c52e625c323f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:02.068217 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-869fc754-3134-4fb4-bce1-6b57ed6bdd57 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:02.115307 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-869fc754-3134-4fb4-bce1-6b57ed6bdd57 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1528 microversion: 2.1 time: 2.067912 Jun 20 12:09:02.131207 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1285/2577] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:00 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1528 bytes in 2084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:02.141462 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-06d8e27b-a275-4886-8b57-84d20a6ca7ff tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:02.142346 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-06d8e27b-a275-4886-8b57-84d20a6ca7ff tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:02.151569 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06d8e27b-a275-4886-8b57-84d20a6ca7ff tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:02.152990 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06d8e27b-a275-4886-8b57-84d20a6ca7ff tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:02.153940 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06d8e27b-a275-4886-8b57-84d20a6ca7ff tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:02.154445 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06d8e27b-a275-4886-8b57-84d20a6ca7ff tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:02.368535 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-06d8e27b-a275-4886-8b57-84d20a6ca7ff tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:02.382617 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-06d8e27b-a275-4886-8b57-84d20a6ca7ff tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41" status: 200 len: 1221 microversion: 2.1 time: 0.249978 Jun 20 12:09:02.384791 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1286/2578] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:02 2022] GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 => generated 1221 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:02.392035 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-714220d3-bc7f-44c9-a0ed-e2f923efc34b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:02.392872 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-714220d3-bc7f-44c9-a0ed-e2f923efc34b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:02.425357 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-714220d3-bc7f-44c9-a0ed-e2f923efc34b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:02.425807 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-714220d3-bc7f-44c9-a0ed-e2f923efc34b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:02.429837 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-714220d3-bc7f-44c9-a0ed-e2f923efc34b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:02.434632 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-714220d3-bc7f-44c9-a0ed-e2f923efc34b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:02.518144 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1ac9a17d-060a-45d0-b6d2-c52e625c323f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:02.532451 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1ac9a17d-060a-45d0-b6d2-c52e625c323f tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1379 microversion: 2.1 time: 0.957285 Jun 20 12:09:02.535578 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1293/2579] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:01 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1379 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:02.550148 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-49028736-538c-42da-b9ef-a3af2b39aea1 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:02.550834 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-49028736-538c-42da-b9ef-a3af2b39aea1 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:02.567914 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-49028736-538c-42da-b9ef-a3af2b39aea1 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:02.568572 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-49028736-538c-42da-b9ef-a3af2b39aea1 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:02.572607 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-49028736-538c-42da-b9ef-a3af2b39aea1 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:02.573426 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-49028736-538c-42da-b9ef-a3af2b39aea1 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:02.940992 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-714220d3-bc7f-44c9-a0ed-e2f923efc34b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:02.950425 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-714220d3-bc7f-44c9-a0ed-e2f923efc34b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.564025 Jun 20 12:09:02.965561 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1287/2580] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:02 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:02.980591 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-78983065-ffff-4578-800b-2ce9a9dbc387 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Calling method '.version_select at 0x7f6073977670>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:02.988539 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-78983065-ffff-4578-800b-2ce9a9dbc387 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:02.993923 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-78983065-ffff-4578-800b-2ce9a9dbc387 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:02.997336 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-49028736-538c-42da-b9ef-a3af2b39aea1 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:03.021686 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-49028736-538c-42da-b9ef-a3af2b39aea1 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1528 microversion: 2.1 time: 0.483538 Jun 20 12:09:03.024948 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1294/2581] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:02 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1528 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:03.047130 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-78983065-ffff-4578-800b-2ce9a9dbc387 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 2339 microversion: 2.1 time: 0.077065 Jun 20 12:09:03.050579 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1288/2582] 10.222.0.27 () {58 vars in 1142 bytes} [Mon Jun 20 12:09:02 2022] GET /compute/v2.1/os-migrations => generated 2339 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:03.051280 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-42179628-870b-4910-ad2c-381d411b6be4 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:03.053144 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-42179628-870b-4910-ad2c-381d411b6be4 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:03.063464 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-152dc66c-ddfe-4593-9aeb-f8300f803684 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:03.071925 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:09:03.071925 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 12:09:03.074485 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-42179628-870b-4910-ad2c-381d411b6be4 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:03.076805 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-42179628-870b-4910-ad2c-381d411b6be4 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:03.077820 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-42179628-870b-4910-ad2c-381d411b6be4 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:03.080428 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-42179628-870b-4910-ad2c-381d411b6be4 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:03.134927 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-152dc66c-ddfe-4593-9aeb-f8300f803684 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/0173425c-7c4a-4fc6-9720-5054f46e787a" status: 202 len: 0 microversion: 2.1 time: 0.081643 Jun 20 12:09:03.135852 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1289/2583] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:09:03 2022] DELETE /compute/v2.1/flavors/0173425c-7c4a-4fc6-9720-5054f46e787a => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:09:03.143253 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-921e7db7-7dbb-4b58-a65b-a14d51531078 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:03.146687 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-921e7db7-7dbb-4b58-a65b-a14d51531078 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:03.160778 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-921e7db7-7dbb-4b58-a65b-a14d51531078 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:03.164657 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-921e7db7-7dbb-4b58-a65b-a14d51531078 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:03.165975 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-921e7db7-7dbb-4b58-a65b-a14d51531078 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:03.166582 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-921e7db7-7dbb-4b58-a65b-a14d51531078 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:03.443524 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:03.469688 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-921e7db7-7dbb-4b58-a65b-a14d51531078 tempest-LiveMigrationTest-944680544 tempest-LiveMigrationTest-944680544-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1530 microversion: 2.1 time: 0.327937 Jun 20 12:09:03.471050 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1290/2584] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:03 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1530 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:03.490464 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3d5ff82f-8f90-4a88-869d-d052b3017dc0 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:03.532231 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3d5ff82f-8f90-4a88-869d-d052b3017dc0 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059829 Jun 20 12:09:03.533789 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1291/2585] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 12:09:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:03.547928 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8d6844b8-d258-46bf-9087-ca7cf5763dbf tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:03.552213 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8d6844b8-d258-46bf-9087-ca7cf5763dbf tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:03.567197 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8d6844b8-d258-46bf-9087-ca7cf5763dbf tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:03.569170 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8d6844b8-d258-46bf-9087-ca7cf5763dbf tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:03.570587 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8d6844b8-d258-46bf-9087-ca7cf5763dbf tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:03.571636 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8d6844b8-d258-46bf-9087-ca7cf5763dbf tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:03.800041 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8d6844b8-d258-46bf-9087-ca7cf5763dbf tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:03.813363 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8d6844b8-d258-46bf-9087-ca7cf5763dbf tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41" status: 200 len: 1275 microversion: 2.1 time: 0.278118 Jun 20 12:09:03.818718 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1292/2586] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:03 2022] GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 => generated 1275 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:03.829326 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3c16012f-3105-4082-adaa-ffd6f20dd457 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:03.832863 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3c16012f-3105-4082-adaa-ffd6f20dd457 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:03.848166 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c16012f-3105-4082-adaa-ffd6f20dd457 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:03.852005 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c16012f-3105-4082-adaa-ffd6f20dd457 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:03.853849 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c16012f-3105-4082-adaa-ffd6f20dd457 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:03.854942 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c16012f-3105-4082-adaa-ffd6f20dd457 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:03.919704 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3c16012f-3105-4082-adaa-ffd6f20dd457 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:09:04.074669 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-42179628-870b-4910-ad2c-381d411b6be4 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:04.097089 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-42179628-870b-4910-ad2c-381d411b6be4 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 1.070431 Jun 20 12:09:04.119871 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1295/2587] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:03 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:04.131761 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3c16012f-3105-4082-adaa-ffd6f20dd457 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "DELETE /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 204 len: 0 microversion: 2.1 time: 0.311419 Jun 20 12:09:04.133213 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1293/2588] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:09:03 2022] DELETE /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:09:04.147885 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0ab014cc-f4fc-4337-83df-054ac5de1e43 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:04.150689 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-591e098b-e845-4253-ac34-7d717c93c323 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:04.154471 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-591e098b-e845-4253-ac34-7d717c93c323 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:04.154614 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0ab014cc-f4fc-4337-83df-054ac5de1e43 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 8cc2d923-0b5e-4480-996b-ecd45518f450] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:04.171209 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-591e098b-e845-4253-ac34-7d717c93c323 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:04.171964 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-591e098b-e845-4253-ac34-7d717c93c323 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:04.174814 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-591e098b-e845-4253-ac34-7d717c93c323 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:04.175829 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-591e098b-e845-4253-ac34-7d717c93c323 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:04.179215 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-0ab014cc-f4fc-4337-83df-054ac5de1e43 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] HTTP exception thrown: Instance 8cc2d923-0b5e-4480-996b-ecd45518f450 could not be found. Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0ab014cc-f4fc-4337-83df-054ac5de1e43 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/8cc2d923-0b5e-4480-996b-ecd45518f450 HTTP/1.1 Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 8cc2d923-0b5e-4480-996b-ecd45518f450 could not be found. Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '8cc2d923-0b5e-4480-996b-ecd45518f450'} Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cc2d923-0b5e-4480-996b-ecd45518f450 could not be found. Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cc2d923-0b5e-4480-996b-ecd45518f450 could not be found. Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:04.181075 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:04.186318 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:04.186318 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:04.186318 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:04.186318 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:09:04.186318 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:09:04.186318 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cc2d923-0b5e-4480-996b-ecd45518f450 could not be found. Jun 20 12:09:04.186318 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:04.186318 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0ab014cc-f4fc-4337-83df-054ac5de1e43 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 404 to user: Instance 8cc2d923-0b5e-4480-996b-ecd45518f450 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:09:04.187453 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0ab014cc-f4fc-4337-83df-054ac5de1e43 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8cc2d923-0b5e-4480-996b-ecd45518f450" status: 404 len: 111 microversion: 2.1 time: 0.051621 Jun 20 12:09:04.189838 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1294/2589] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:09:04 2022] DELETE /compute/v2.1/servers/8cc2d923-0b5e-4480-996b-ecd45518f450 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:09:04.204787 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-74f801c4-fa76-4e6c-ad1f-c53d8b8d68b9 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:04.205602 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-74f801c4-fa76-4e6c-ad1f-c53d8b8d68b9 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:04.215964 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-74f801c4-fa76-4e6c-ad1f-c53d8b8d68b9 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:04.217034 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-74f801c4-fa76-4e6c-ad1f-c53d8b8d68b9 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:04.218459 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-74f801c4-fa76-4e6c-ad1f-c53d8b8d68b9 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:04.219167 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-74f801c4-fa76-4e6c-ad1f-c53d8b8d68b9 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:04.243404 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-591e098b-e845-4253-ac34-7d717c93c323 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:04.261885 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-591e098b-e845-4253-ac34-7d717c93c323 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Old instance type tempest-test_resize_flavor_-730732697, new instance type m1.heat {{(pid=119128) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 20 12:09:04.278877 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-591e098b-e845-4253-ac34-7d717c93c323 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:09:04.279306 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-591e098b-e845-4253-ac34-7d717c93c323 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:09:04.281664 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-591e098b-e845-4253-ac34-7d717c93c323 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:09:04.282284 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-591e098b-e845-4253-ac34-7d717c93c323 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:09:04.284947 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-591e098b-e845-4253-ac34-7d717c93c323 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:09:04.439035 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:04.516461 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-591e098b-e845-4253-ac34-7d717c93c323 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "POST /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656/action" status: 202 len: 0 microversion: 2.1 time: 0.393298 Jun 20 12:09:04.520827 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1296/2590] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:09:04 2022] POST /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656/action => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:09:04.528668 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f76ecbc8-685e-4f0c-9363-4c309d402042 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:04.529985 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f76ecbc8-685e-4f0c-9363-4c309d402042 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:04.538799 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f76ecbc8-685e-4f0c-9363-4c309d402042 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:04.539432 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f76ecbc8-685e-4f0c-9363-4c309d402042 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:04.540493 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f76ecbc8-685e-4f0c-9363-4c309d402042 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:04.541082 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f76ecbc8-685e-4f0c-9363-4c309d402042 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:04.578548 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-74f801c4-fa76-4e6c-ad1f-c53d8b8d68b9 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:04.600889 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-74f801c4-fa76-4e6c-ad1f-c53d8b8d68b9 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1385 microversion: 2.1 time: 0.409287 Jun 20 12:09:04.602244 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1295/2591] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:04 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1385 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:04.655440 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7bd683a5-8048-4a6b-8ad2-42520f717979 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:04.657595 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7bd683a5-8048-4a6b-8ad2-42520f717979 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:04.670798 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7bd683a5-8048-4a6b-8ad2-42520f717979 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:04.677822 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7bd683a5-8048-4a6b-8ad2-42520f717979 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:04.679292 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7bd683a5-8048-4a6b-8ad2-42520f717979 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:04.681522 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7bd683a5-8048-4a6b-8ad2-42520f717979 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:05.126988 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7bd683a5-8048-4a6b-8ad2-42520f717979 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:05.138206 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7bd683a5-8048-4a6b-8ad2-42520f717979 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1537 microversion: 2.1 time: 0.520805 Jun 20 12:09:05.158897 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1296/2592] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:04 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1537 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:05.186466 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1afeb4a7-7d7b-42b8-9db1-f114bdefaebc tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:05.190335 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1afeb4a7-7d7b-42b8-9db1-f114bdefaebc tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:05.212452 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1afeb4a7-7d7b-42b8-9db1-f114bdefaebc tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:05.216570 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1afeb4a7-7d7b-42b8-9db1-f114bdefaebc tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:05.221128 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1afeb4a7-7d7b-42b8-9db1-f114bdefaebc tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:05.221832 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1afeb4a7-7d7b-42b8-9db1-f114bdefaebc tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:05.367093 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1afeb4a7-7d7b-42b8-9db1-f114bdefaebc tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:05.379439 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1afeb4a7-7d7b-42b8-9db1-f114bdefaebc tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41" status: 200 len: 1275 microversion: 2.1 time: 0.215561 Jun 20 12:09:05.381805 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1297/2593] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:05 2022] GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 => generated 1275 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:05.501044 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f76ecbc8-685e-4f0c-9363-4c309d402042 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:05.517250 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f76ecbc8-685e-4f0c-9363-4c309d402042 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.994336 Jun 20 12:09:05.519429 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1297/2594] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:04 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:05.541282 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2ba26342-3562-46de-aa7b-a3c1a2d661eb tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:05.542732 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2ba26342-3562-46de-aa7b-a3c1a2d661eb tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:05.571121 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2ba26342-3562-46de-aa7b-a3c1a2d661eb tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:05.572905 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2ba26342-3562-46de-aa7b-a3c1a2d661eb tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:05.575364 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2ba26342-3562-46de-aa7b-a3c1a2d661eb tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:05.575981 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2ba26342-3562-46de-aa7b-a3c1a2d661eb tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:05.932843 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4d3c6586-7731-4165-80b2-b3155b74be7a tempest-MultipleCreateNegativeTestJSON-1187149990 tempest-MultipleCreateNegativeTestJSON-1187149990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-991542238", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:05.936559 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-4d3c6586-7731-4165-80b2-b3155b74be7a tempest-MultipleCreateNegativeTestJSON-1187149990 tempest-MultipleCreateNegativeTestJSON-1187149990-project] HTTP exception thrown: min_count must be <= max_count Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4d3c6586-7731-4165-80b2-b3155b74be7a tempest-MultipleCreateNegativeTestJSON-1187149990 tempest-MultipleCreateNegativeTestJSON-1187149990-project] Request method failure captured: Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 183 Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGNgxrF4iIaehG4n4T8ze4AKrXQ_bReItOaFA7Kqa28B_JO0h5y5D51_gUG2QnOQUOaEjKr7pqMJviaCLBV97dI7Vo6iaqn48TrsKiEaCpzsTUi3alP99wOtPgE4uJN0C3F72SLP-zFa7rgpI8ymYbwUstgh7srgDTNgy7qwsMLZn04 Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: c9337c644cbb47a0b6b4d585dc0290dc Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1187149990 Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9337c644cbb47a0b6b4d585dc0290dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9337c644cbb47a0b6b4d585dc0290dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c9337c644cbb47a0b6b4d585dc0290dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c9337c644cbb47a0b6b4d585dc0290dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1187149990 Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: c9337c644cbb47a0b6b4d585dc0290dc Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1187149990 Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-MultipleCreateNegativeTestJSON-1187149990-project Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 39698c64e1d746698d7abace68d25c5b Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1187149990-project Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-991542238", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "min_count": 3, "max_count": 2}} Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: exception: min_count must be <= max_count Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-991542238', 'imageRef': 'f16836cc-4e18-4bd0-b261-3865adf8cb83', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Jun 20 12:09:05.938366 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:05.956778 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4d3c6586-7731-4165-80b2-b3155b74be7a tempest-MultipleCreateNegativeTestJSON-1187149990 tempest-MultipleCreateNegativeTestJSON-1187149990-project] Returning 400 to user: min_count must be <= max_count {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:09:05.958063 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4d3c6586-7731-4165-80b2-b3155b74be7a tempest-MultipleCreateNegativeTestJSON-1187149990 tempest-MultipleCreateNegativeTestJSON-1187149990-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.574082 Jun 20 12:09:05.961651 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1298/2595] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:09:05 2022] POST /compute/v2.1/servers => generated 74 bytes in 579 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 20 12:09:05.988335 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0d85c4e7-432e-4ec1-90e5-fff4bb629344 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:05.988978 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0d85c4e7-432e-4ec1-90e5-fff4bb629344 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:06.031241 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0d85c4e7-432e-4ec1-90e5-fff4bb629344 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:06.031950 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0d85c4e7-432e-4ec1-90e5-fff4bb629344 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:06.034771 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0d85c4e7-432e-4ec1-90e5-fff4bb629344 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:06.037293 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0d85c4e7-432e-4ec1-90e5-fff4bb629344 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:06.361860 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0d85c4e7-432e-4ec1-90e5-fff4bb629344 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:06.375255 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0d85c4e7-432e-4ec1-90e5-fff4bb629344 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1385 microversion: 2.1 time: 0.412148 Jun 20 12:09:06.376078 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1299/2596] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:05 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1385 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:06.394472 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-18fe8afa-9d1a-40e4-89d8-e3f198228290 tempest-MultipleCreateNegativeTestJSON-1187149990 tempest-MultipleCreateNegativeTestJSON-1187149990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-487465841", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "max_count": 0}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-18fe8afa-9d1a-40e4-89d8-e3f198228290 tempest-MultipleCreateNegativeTestJSON-1187149990 tempest-MultipleCreateNegativeTestJSON-1187149990-project] Request method failure captured: Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 167 Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGNgxrF4iIaehG4n4T8ze4AKrXQ_bReItOaFA7Kqa28B_JO0h5y5D51_gUG2QnOQUOaEjKr7pqMJviaCLBV97dI7Vo6iaqn48TrsKiEaCpzsTUi3alP99wOtPgE4uJN0C3F72SLP-zFa7rgpI8ymYbwUstgh7srgDTNgy7qwsMLZn04 Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: c9337c644cbb47a0b6b4d585dc0290dc Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1187149990 Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9337c644cbb47a0b6b4d585dc0290dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9337c644cbb47a0b6b4d585dc0290dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c9337c644cbb47a0b6b4d585dc0290dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c9337c644cbb47a0b6b4d585dc0290dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1187149990 Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: c9337c644cbb47a0b6b4d585dc0290dc Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1187149990 Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-MultipleCreateNegativeTestJSON-1187149990-project Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 39698c64e1d746698d7abace68d25c5b Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1187149990-project Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-487465841", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "max_count": 0}} Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-487465841', 'imageRef': 'f16836cc-4e18-4bd0-b261-3865adf8cb83', 'flavorRef': '452', 'max_count': 0}}} Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise error Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi 0 Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 12:09:06.397851 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 12:09:06.402872 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 12:09:06.402872 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 12:09:06.402872 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 12:09:06.402872 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jun 20 12:09:06.402872 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:06.402872 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:06.402872 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:06.402872 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:06.402872 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:06.402872 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:06.402872 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 12:09:06.402872 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 12:09:06.402872 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jun 20 12:09:06.402872 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:06.413125 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-18fe8afa-9d1a-40e4-89d8-e3f198228290 tempest-MultipleCreateNegativeTestJSON-1187149990 tempest-MultipleCreateNegativeTestJSON-1187149990-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:09:06.416992 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-18fe8afa-9d1a-40e4-89d8-e3f198228290 tempest-MultipleCreateNegativeTestJSON-1187149990 tempest-MultipleCreateNegativeTestJSON-1187149990-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.030639 Jun 20 12:09:06.421329 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1300/2597] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:09:06 2022] POST /compute/v2.1/servers => generated 130 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:09:06.434475 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ee791fa2-35cf-4544-b8ed-1be87aa4053c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:06.438790 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ee791fa2-35cf-4544-b8ed-1be87aa4053c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:06.454254 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee791fa2-35cf-4544-b8ed-1be87aa4053c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:06.455843 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee791fa2-35cf-4544-b8ed-1be87aa4053c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:06.457431 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee791fa2-35cf-4544-b8ed-1be87aa4053c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:06.458049 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee791fa2-35cf-4544-b8ed-1be87aa4053c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:06.815976 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ee791fa2-35cf-4544-b8ed-1be87aa4053c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:06.831398 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ee791fa2-35cf-4544-b8ed-1be87aa4053c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1537 microversion: 2.1 time: 0.408140 Jun 20 12:09:06.835161 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1301/2598] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:06 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1537 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:06.854537 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2b034efb-bf1c-4af8-a652-60d9ac93eb00 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:06.856832 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2b034efb-bf1c-4af8-a652-60d9ac93eb00 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:06.879805 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2b034efb-bf1c-4af8-a652-60d9ac93eb00 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:06.882683 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2b034efb-bf1c-4af8-a652-60d9ac93eb00 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:06.883533 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2b034efb-bf1c-4af8-a652-60d9ac93eb00 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:06.883981 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2b034efb-bf1c-4af8-a652-60d9ac93eb00 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:07.130840 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2ba26342-3562-46de-aa7b-a3c1a2d661eb tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:07.144153 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2ba26342-3562-46de-aa7b-a3c1a2d661eb tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 1.611791 Jun 20 12:09:07.152265 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1298/2599] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:05 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:09:07.169138 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6677ecf9-98c3-4b65-bc3b-9f5bd651fb1d tempest-MultipleCreateNegativeTestJSON-1187149990 tempest-MultipleCreateNegativeTestJSON-1187149990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1892659596", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "max_count": 2.5}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6677ecf9-98c3-4b65-bc3b-9f5bd651fb1d tempest-MultipleCreateNegativeTestJSON-1187149990 tempest-MultipleCreateNegativeTestJSON-1187149990-project] Request method failure captured: Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 170 Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGNgxrF4iIaehG4n4T8ze4AKrXQ_bReItOaFA7Kqa28B_JO0h5y5D51_gUG2QnOQUOaEjKr7pqMJviaCLBV97dI7Vo6iaqn48TrsKiEaCpzsTUi3alP99wOtPgE4uJN0C3F72SLP-zFa7rgpI8ymYbwUstgh7srgDTNgy7qwsMLZn04 Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: c9337c644cbb47a0b6b4d585dc0290dc Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1187149990 Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9337c644cbb47a0b6b4d585dc0290dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9337c644cbb47a0b6b4d585dc0290dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c9337c644cbb47a0b6b4d585dc0290dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c9337c644cbb47a0b6b4d585dc0290dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1187149990 Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: c9337c644cbb47a0b6b4d585dc0290dc Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1187149990 Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-MultipleCreateNegativeTestJSON-1187149990-project Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 39698c64e1d746698d7abace68d25c5b Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1187149990-project Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1892659596", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "max_count": 2.5}} Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1892659596', 'imageRef': 'f16836cc-4e18-4bd0-b261-3865adf8cb83', 'flavorRef': '452', 'max_count': 2.5}}} Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise error Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 2.5 Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 12:09:07.181484 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 12:09:07.187373 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 12:09:07.187373 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 12:09:07.187373 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 12:09:07.187373 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 12:09:07.187373 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 20 12:09:07.187373 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:07.187373 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:07.187373 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:07.187373 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:07.187373 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:07.187373 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:07.187373 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 12:09:07.187373 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 12:09:07.187373 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 20 12:09:07.187373 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:07.192642 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6677ecf9-98c3-4b65-bc3b-9f5bd651fb1d tempest-MultipleCreateNegativeTestJSON-1187149990 tempest-MultipleCreateNegativeTestJSON-1187149990-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:09:07.192642 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6677ecf9-98c3-4b65-bc3b-9f5bd651fb1d tempest-MultipleCreateNegativeTestJSON-1187149990 tempest-MultipleCreateNegativeTestJSON-1187149990-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.037058 Jun 20 12:09:07.192642 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1299/2600] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:09:07 2022] POST /compute/v2.1/servers => generated 139 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:09:07.196290 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2b034efb-bf1c-4af8-a652-60d9ac93eb00 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:07.239101 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2b034efb-bf1c-4af8-a652-60d9ac93eb00 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41" status: 200 len: 1275 microversion: 2.1 time: 0.396820 Jun 20 12:09:07.242047 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1302/2601] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:06 2022] GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 => generated 1275 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:07.250335 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-7bc14bfa-ba1c-4dc5-bf84-86480079faa1 req-5a669554-1aeb-4b0d-8842-9f3fce4c8c38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de7fc47c-e28f-4697-bbf9-df8390dfd998", "name": "network-vif-deleted", "tag": "5925f2d5-cbe4-4efe-9aa1-8f5c5ba93a44"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:07.255750 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b5f38bb2-bdcf-41a7-8eb6-1ebffe4b56e6 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:07.264965 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b5f38bb2-bdcf-41a7-8eb6-1ebffe4b56e6 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Failed to fetch instance by id 9223372036854775808 {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 20 12:09:07.267644 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-b5f38bb2-bdcf-41a7-8eb6-1ebffe4b56e6 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b5f38bb2-bdcf-41a7-8eb6-1ebffe4b56e6 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 9223372036854775808 could not be found. Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '9223372036854775808'} Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:07.272632 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:07.278235 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:07.278235 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:09:07.278235 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:09:07.278235 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Jun 20 12:09:07.278235 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:07.287831 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b5f38bb2-bdcf-41a7-8eb6-1ebffe4b56e6 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:09:07.289592 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-7bc14bfa-ba1c-4dc5-bf84-86480079faa1 req-5a669554-1aeb-4b0d-8842-9f3fce4c8c38 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:07.290066 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-7bc14bfa-ba1c-4dc5-bf84-86480079faa1 req-5a669554-1aeb-4b0d-8842-9f3fce4c8c38 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:07.293387 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b5f38bb2-bdcf-41a7-8eb6-1ebffe4b56e6 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.049890 Jun 20 12:09:07.302359 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1303/2602] 10.222.0.27 () {58 vars in 1187 bytes} [Mon Jun 20 12:09:07 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:09:07.323092 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4ea6da0b-5040-4242-ba17-b2fb1f0911b8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:07.324670 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4ea6da0b-5040-4242-ba17-b2fb1f0911b8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:07.333591 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-7bc14bfa-ba1c-4dc5-bf84-86480079faa1 req-5a669554-1aeb-4b0d-8842-9f3fce4c8c38 service nova] Creating event network-vif-deleted:5925f2d5-cbe4-4efe-9aa1-8f5c5ba93a44 for instance de7fc47c-e28f-4697-bbf9-df8390dfd998 on n-h1-master-1 Jun 20 12:09:07.351701 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-7bc14bfa-ba1c-4dc5-bf84-86480079faa1 req-5a669554-1aeb-4b0d-8842-9f3fce4c8c38 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158975 Jun 20 12:09:07.354432 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1300/2603] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:09:07.366611 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4ea6da0b-5040-4242-ba17-b2fb1f0911b8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:07.368652 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4ea6da0b-5040-4242-ba17-b2fb1f0911b8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:07.370555 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4ea6da0b-5040-4242-ba17-b2fb1f0911b8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:07.375248 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4ea6da0b-5040-4242-ba17-b2fb1f0911b8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:07.395372 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-165ef4c5-4044-4b11-ad54-41cd529edf5a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:07.396464 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-165ef4c5-4044-4b11-ad54-41cd529edf5a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:07.399682 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:07.409873 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-165ef4c5-4044-4b11-ad54-41cd529edf5a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:07.413457 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-165ef4c5-4044-4b11-ad54-41cd529edf5a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:07.414344 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-165ef4c5-4044-4b11-ad54-41cd529edf5a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:07.414814 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-165ef4c5-4044-4b11-ad54-41cd529edf5a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:07.631643 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-165ef4c5-4044-4b11-ad54-41cd529edf5a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:07.643380 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-165ef4c5-4044-4b11-ad54-41cd529edf5a tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1183 microversion: 2.1 time: 0.253577 Jun 20 12:09:07.654023 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1301/2604] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:07 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1183 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:09:07.665846 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d546c7e9-d2f6-4f38-9a61-1b7734fe7795 tempest-MultipleCreateNegativeTestJSON-1187149990 tempest-MultipleCreateNegativeTestJSON-1187149990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-368313365", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "min_count": 0}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d546c7e9-d2f6-4f38-9a61-1b7734fe7795 tempest-MultipleCreateNegativeTestJSON-1187149990 tempest-MultipleCreateNegativeTestJSON-1187149990-project] Request method failure captured: Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 167 Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGNgxrF4iIaehG4n4T8ze4AKrXQ_bReItOaFA7Kqa28B_JO0h5y5D51_gUG2QnOQUOaEjKr7pqMJviaCLBV97dI7Vo6iaqn48TrsKiEaCpzsTUi3alP99wOtPgE4uJN0C3F72SLP-zFa7rgpI8ymYbwUstgh7srgDTNgy7qwsMLZn04 Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: c9337c644cbb47a0b6b4d585dc0290dc Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1187149990 Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9337c644cbb47a0b6b4d585dc0290dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9337c644cbb47a0b6b4d585dc0290dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c9337c644cbb47a0b6b4d585dc0290dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c9337c644cbb47a0b6b4d585dc0290dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1187149990 Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: c9337c644cbb47a0b6b4d585dc0290dc Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1187149990 Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-MultipleCreateNegativeTestJSON-1187149990-project Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 39698c64e1d746698d7abace68d25c5b Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1187149990-project Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-368313365", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "min_count": 0}} Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-368313365', 'imageRef': 'f16836cc-4e18-4bd0-b261-3865adf8cb83', 'flavorRef': '452', 'min_count': 0}}} Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise error Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 0 Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 12:09:07.673755 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 12:09:07.678105 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 12:09:07.678105 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 12:09:07.678105 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 12:09:07.678105 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jun 20 12:09:07.678105 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:07.678105 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:07.678105 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:07.678105 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:07.678105 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:07.678105 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:07.678105 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 12:09:07.678105 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 12:09:07.678105 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jun 20 12:09:07.678105 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:07.680620 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d546c7e9-d2f6-4f38-9a61-1b7734fe7795 tempest-MultipleCreateNegativeTestJSON-1187149990 tempest-MultipleCreateNegativeTestJSON-1187149990-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:09:07.683432 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d546c7e9-d2f6-4f38-9a61-1b7734fe7795 tempest-MultipleCreateNegativeTestJSON-1187149990 tempest-MultipleCreateNegativeTestJSON-1187149990-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.026979 Jun 20 12:09:07.685367 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1302/2605] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:09:07 2022] POST /compute/v2.1/servers => generated 130 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:09:07.744341 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4302ad28-2d2c-44b8-8c1c-43b1aa44c393 tempest-MultipleCreateNegativeTestJSON-1187149990 tempest-MultipleCreateNegativeTestJSON-1187149990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-906147151", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "min_count": 2.5}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4302ad28-2d2c-44b8-8c1c-43b1aa44c393 tempest-MultipleCreateNegativeTestJSON-1187149990 tempest-MultipleCreateNegativeTestJSON-1187149990-project] Request method failure captured: Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 169 Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGNgxrF4iIaehG4n4T8ze4AKrXQ_bReItOaFA7Kqa28B_JO0h5y5D51_gUG2QnOQUOaEjKr7pqMJviaCLBV97dI7Vo6iaqn48TrsKiEaCpzsTUi3alP99wOtPgE4uJN0C3F72SLP-zFa7rgpI8ymYbwUstgh7srgDTNgy7qwsMLZn04 Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: c9337c644cbb47a0b6b4d585dc0290dc Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1187149990 Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9337c644cbb47a0b6b4d585dc0290dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9337c644cbb47a0b6b4d585dc0290dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c9337c644cbb47a0b6b4d585dc0290dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c9337c644cbb47a0b6b4d585dc0290dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1187149990 Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: c9337c644cbb47a0b6b4d585dc0290dc Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1187149990 Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-MultipleCreateNegativeTestJSON-1187149990-project Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 39698c64e1d746698d7abace68d25c5b Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1187149990-project Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-906147151", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "min_count": 2.5}} Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-906147151', 'imageRef': 'f16836cc-4e18-4bd0-b261-3865adf8cb83', 'flavorRef': '452', 'min_count': 2.5}}} Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise error Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 2.5 Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 12:09:07.748565 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 12:09:07.753170 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 12:09:07.753170 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 12:09:07.753170 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 12:09:07.753170 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 12:09:07.753170 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 20 12:09:07.753170 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:07.753170 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:07.753170 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:07.753170 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:07.753170 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:07.753170 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:07.753170 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 12:09:07.753170 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 12:09:07.753170 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 20 12:09:07.753170 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:07.774872 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4302ad28-2d2c-44b8-8c1c-43b1aa44c393 tempest-MultipleCreateNegativeTestJSON-1187149990 tempest-MultipleCreateNegativeTestJSON-1187149990-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:09:07.775985 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4302ad28-2d2c-44b8-8c1c-43b1aa44c393 tempest-MultipleCreateNegativeTestJSON-1187149990 tempest-MultipleCreateNegativeTestJSON-1187149990-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.036826 Jun 20 12:09:07.776604 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1303/2606] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:09:07 2022] POST /compute/v2.1/servers => generated 139 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 20 12:09:07.855996 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-77e35d0a-331e-4071-8be0-d1266e66201d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:07.856677 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-77e35d0a-331e-4071-8be0-d1266e66201d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:07.875426 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-77e35d0a-331e-4071-8be0-d1266e66201d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:07.876122 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-77e35d0a-331e-4071-8be0-d1266e66201d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:07.877104 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-77e35d0a-331e-4071-8be0-d1266e66201d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:07.880472 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-77e35d0a-331e-4071-8be0-d1266e66201d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:08.181255 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4ea6da0b-5040-4242-ba17-b2fb1f0911b8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:08.196692 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4ea6da0b-5040-4242-ba17-b2fb1f0911b8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.892626 Jun 20 12:09:08.201093 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1304/2607] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:07 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:08.219693 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8fac00a6-a943-45fb-b505-3bd27f28ac40 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:08.220635 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8fac00a6-a943-45fb-b505-3bd27f28ac40 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:08.237373 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8fac00a6-a943-45fb-b505-3bd27f28ac40 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:08.252286 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8fac00a6-a943-45fb-b505-3bd27f28ac40 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:08.253387 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8fac00a6-a943-45fb-b505-3bd27f28ac40 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:08.253979 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8fac00a6-a943-45fb-b505-3bd27f28ac40 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:08.520010 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-77e35d0a-331e-4071-8be0-d1266e66201d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:08.528961 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-77e35d0a-331e-4071-8be0-d1266e66201d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1537 microversion: 2.1 time: 0.681664 Jun 20 12:09:08.533775 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1304/2608] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:07 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1537 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:08.544221 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-88228824-a0a5-48b3-8f78-5f36506b11a2 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:08.548826 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-88228824-a0a5-48b3-8f78-5f36506b11a2 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:08.570415 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88228824-a0a5-48b3-8f78-5f36506b11a2 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:08.573976 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88228824-a0a5-48b3-8f78-5f36506b11a2 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:08.575418 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88228824-a0a5-48b3-8f78-5f36506b11a2 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:08.575418 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88228824-a0a5-48b3-8f78-5f36506b11a2 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:08.970722 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-88228824-a0a5-48b3-8f78-5f36506b11a2 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:08.984081 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-88228824-a0a5-48b3-8f78-5f36506b11a2 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41" status: 200 len: 1317 microversion: 2.1 time: 0.448864 Jun 20 12:09:08.984904 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1305/2609] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:08 2022] GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 => generated 1317 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:08.994465 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-75c47289-1aaa-4e71-8f4b-a6e8a75dde05 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:08.995106 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-75c47289-1aaa-4e71-8f4b-a6e8a75dde05 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:09.002833 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-75c47289-1aaa-4e71-8f4b-a6e8a75dde05 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:09.003741 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-75c47289-1aaa-4e71-8f4b-a6e8a75dde05 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:09.004768 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-75c47289-1aaa-4e71-8f4b-a6e8a75dde05 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:09.005445 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-75c47289-1aaa-4e71-8f4b-a6e8a75dde05 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:09.007535 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8fac00a6-a943-45fb-b505-3bd27f28ac40 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:09.020532 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8fac00a6-a943-45fb-b505-3bd27f28ac40 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.806229 Jun 20 12:09:09.022447 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1305/2610] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:08 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:09:09.039497 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-53dc163e-fad4-475d-a738-383c77bdb0d7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:09.040548 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-53dc163e-fad4-475d-a738-383c77bdb0d7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Failed to fetch instance by id -1 {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 20 12:09:09.041281 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-53dc163e-fad4-475d-a738-383c77bdb0d7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] HTTP exception thrown: Instance -1 could not be found. Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-53dc163e-fad4-475d-a738-383c77bdb0d7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: exception: Instance -1 could not be found. Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '-1'} Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:09.044156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:09.048631 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:09:09.048631 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:09:09.048631 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Jun 20 12:09:09.048631 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:09.056395 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-53dc163e-fad4-475d-a738-383c77bdb0d7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 404 to user: Instance -1 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:09:09.058583 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-53dc163e-fad4-475d-a738-383c77bdb0d7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.024110 Jun 20 12:09:09.059848 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1306/2611] 10.222.0.27 () {58 vars in 1136 bytes} [Mon Jun 20 12:09:09 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 20 12:09:09.071253 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6776c69a-c825-423b-9ea1-557947157a81 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:09.078973 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6776c69a-c825-423b-9ea1-557947157a81 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:09.088182 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6776c69a-c825-423b-9ea1-557947157a81 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:09.091687 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6776c69a-c825-423b-9ea1-557947157a81 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:09.092789 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6776c69a-c825-423b-9ea1-557947157a81 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:09.095493 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6776c69a-c825-423b-9ea1-557947157a81 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:09.441840 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-75c47289-1aaa-4e71-8f4b-a6e8a75dde05 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:09.456392 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-75c47289-1aaa-4e71-8f4b-a6e8a75dde05 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1183 microversion: 2.1 time: 0.468055 Jun 20 12:09:09.457204 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1306/2612] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:08 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1183 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:09.550489 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8ddf088e-c296-465f-ba1b-507d8eb69525 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:09.551144 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8ddf088e-c296-465f-ba1b-507d8eb69525 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:09.562922 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ddf088e-c296-465f-ba1b-507d8eb69525 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:09.563674 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ddf088e-c296-465f-ba1b-507d8eb69525 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:09.564674 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ddf088e-c296-465f-ba1b-507d8eb69525 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:09.567148 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ddf088e-c296-465f-ba1b-507d8eb69525 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:09.821966 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8ddf088e-c296-465f-ba1b-507d8eb69525 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:09.835012 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8ddf088e-c296-465f-ba1b-507d8eb69525 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1537 microversion: 2.1 time: 0.288818 Jun 20 12:09:09.835619 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1307/2613] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:09 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1537 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:09:09.997878 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-fd740a96-c659-459c-8338-8b968fe88ac9 req-feece61f-0c60-4296-be10-334f8e497d45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c9e8490-b371-4215-af47-09ebe2b7cd41", "tag": "9589165b-8125-4dbe-9ce0-546dbf131a7a"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:10.017666 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-fd740a96-c659-459c-8338-8b968fe88ac9 req-feece61f-0c60-4296-be10-334f8e497d45 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:10.019251 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-fd740a96-c659-459c-8338-8b968fe88ac9 req-feece61f-0c60-4296-be10-334f8e497d45 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:10.048640 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-fd740a96-c659-459c-8338-8b968fe88ac9 req-feece61f-0c60-4296-be10-334f8e497d45 service nova] Creating event network-changed:9589165b-8125-4dbe-9ce0-546dbf131a7a for instance 0c9e8490-b371-4215-af47-09ebe2b7cd41 on n-h1-master-1 Jun 20 12:09:10.062684 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-fd740a96-c659-459c-8338-8b968fe88ac9 req-feece61f-0c60-4296-be10-334f8e497d45 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069595 Jun 20 12:09:10.067247 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1308/2614] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:09:10.077065 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9a742675-5897-4da6-999b-5d70e3217d34 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:10.078045 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9a742675-5897-4da6-999b-5d70e3217d34 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:10.090498 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9a742675-5897-4da6-999b-5d70e3217d34 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:10.093746 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9a742675-5897-4da6-999b-5d70e3217d34 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:10.094972 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9a742675-5897-4da6-999b-5d70e3217d34 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:10.095690 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9a742675-5897-4da6-999b-5d70e3217d34 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:10.166837 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6776c69a-c825-423b-9ea1-557947157a81 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:10.187954 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6776c69a-c825-423b-9ea1-557947157a81 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 1.123949 Jun 20 12:09:10.208883 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1307/2615] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:09 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:09:10.219221 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-47118269-4058-4eee-baf9-23241b6cf661 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:10.219841 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-47118269-4058-4eee-baf9-23241b6cf661 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:10.247999 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-47118269-4058-4eee-baf9-23241b6cf661 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:10.248936 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-47118269-4058-4eee-baf9-23241b6cf661 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:10.250066 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-47118269-4058-4eee-baf9-23241b6cf661 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:10.250669 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-47118269-4058-4eee-baf9-23241b6cf661 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:10.639848 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:10.713255 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:11.092258 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9a742675-5897-4da6-999b-5d70e3217d34 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:11.106947 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9a742675-5897-4da6-999b-5d70e3217d34 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41" status: 200 len: 1317 microversion: 2.1 time: 1.033355 Jun 20 12:09:11.108097 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1309/2616] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:10 2022] GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 => generated 1317 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:11.122425 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f7ea4955-0ca0-46db-b8b6-d124c98684c8 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:11.125185 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f7ea4955-0ca0-46db-b8b6-d124c98684c8 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:11.140982 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7ea4955-0ca0-46db-b8b6-d124c98684c8 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:11.141446 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7ea4955-0ca0-46db-b8b6-d124c98684c8 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:11.142245 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7ea4955-0ca0-46db-b8b6-d124c98684c8 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:11.142740 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7ea4955-0ca0-46db-b8b6-d124c98684c8 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:11.163913 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-47118269-4058-4eee-baf9-23241b6cf661 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:11.173791 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-47118269-4058-4eee-baf9-23241b6cf661 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.958380 Jun 20 12:09:11.182583 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1308/2617] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:10 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:11.192299 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-17f90ab7-e72e-4f35-8cf5-ded25aecf434 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:11.194266 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-17f90ab7-e72e-4f35-8cf5-ded25aecf434 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:11.201747 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17f90ab7-e72e-4f35-8cf5-ded25aecf434 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:11.202484 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17f90ab7-e72e-4f35-8cf5-ded25aecf434 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:11.203983 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17f90ab7-e72e-4f35-8cf5-ded25aecf434 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:11.204648 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17f90ab7-e72e-4f35-8cf5-ded25aecf434 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:11.319442 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f7ea4955-0ca0-46db-b8b6-d124c98684c8 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:11.354683 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f7ea4955-0ca0-46db-b8b6-d124c98684c8 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1183 microversion: 2.1 time: 0.222345 Jun 20 12:09:11.365089 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1310/2618] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:11 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1183 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:11.375623 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b8d86005-9df1-46da-a099-5066dd082973 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:11.376950 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b8d86005-9df1-46da-a099-5066dd082973 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: f4b5a914-e52b-4177-b94e-fd346869b309] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:11.383889 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-b8d86005-9df1-46da-a099-5066dd082973 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] HTTP exception thrown: Instance f4b5a914-e52b-4177-b94e-fd346869b309 could not be found. Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b8d86005-9df1-46da-a099-5066dd082973 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/servers/f4b5a914-e52b-4177-b94e-fd346869b309/action HTTP/1.1 Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 19 Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: {"forceDelete": {}} Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: exception: Instance f4b5a914-e52b-4177-b94e-fd346869b309 could not be found. Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'f4b5a914-e52b-4177-b94e-fd346869b309', 'body': {'forceDelete': {}}} Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4b5a914-e52b-4177-b94e-fd346869b309 could not be found. Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4b5a914-e52b-4177-b94e-fd346869b309 could not be found. Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:11.387815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:11.392571 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:09:11.392571 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:09:11.392571 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4b5a914-e52b-4177-b94e-fd346869b309 could not be found. Jun 20 12:09:11.392571 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:11.393389 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b8d86005-9df1-46da-a099-5066dd082973 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 404 to user: Instance f4b5a914-e52b-4177-b94e-fd346869b309 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:09:11.394627 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b8d86005-9df1-46da-a099-5066dd082973 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers/f4b5a914-e52b-4177-b94e-fd346869b309/action" status: 404 len: 111 microversion: 2.1 time: 0.036359 Jun 20 12:09:11.400094 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1311/2619] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:09:11 2022] POST /compute/v2.1/servers/f4b5a914-e52b-4177-b94e-fd346869b309/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:09:11.418694 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bad99705-7778-4a29-98ed-b8e1fd450622 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:11.419485 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bad99705-7778-4a29-98ed-b8e1fd450622 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:11.429875 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bad99705-7778-4a29-98ed-b8e1fd450622 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:11.430699 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bad99705-7778-4a29-98ed-b8e1fd450622 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:11.432303 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bad99705-7778-4a29-98ed-b8e1fd450622 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:11.432784 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bad99705-7778-4a29-98ed-b8e1fd450622 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:11.584349 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-17f90ab7-e72e-4f35-8cf5-ded25aecf434 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:11.598569 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-17f90ab7-e72e-4f35-8cf5-ded25aecf434 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1537 microversion: 2.1 time: 0.413259 Jun 20 12:09:11.599236 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1309/2620] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:11 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1537 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:11.894398 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-bad99705-7778-4a29-98ed-b8e1fd450622 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:11.903664 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bad99705-7778-4a29-98ed-b8e1fd450622 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.495032 Jun 20 12:09:11.907919 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1312/2621] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:11 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:09:11.934558 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-15cae28b-dbeb-4342-85a0-a5a3160e88d3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:11.935594 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-15cae28b-dbeb-4342-85a0-a5a3160e88d3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:11.947864 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:11.957204 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-15cae28b-dbeb-4342-85a0-a5a3160e88d3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:11.959043 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-15cae28b-dbeb-4342-85a0-a5a3160e88d3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:11.961394 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-15cae28b-dbeb-4342-85a0-a5a3160e88d3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:11.963039 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-15cae28b-dbeb-4342-85a0-a5a3160e88d3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:12.130509 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a5ae1135-2f57-42e4-b956-4f56ef785210 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:12.131645 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a5ae1135-2f57-42e4-b956-4f56ef785210 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:12.174269 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a5ae1135-2f57-42e4-b956-4f56ef785210 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:12.181106 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a5ae1135-2f57-42e4-b956-4f56ef785210 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:12.188860 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a5ae1135-2f57-42e4-b956-4f56ef785210 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:12.190645 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a5ae1135-2f57-42e4-b956-4f56ef785210 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:12.811235 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-15cae28b-dbeb-4342-85a0-a5a3160e88d3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:12.820280 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-15cae28b-dbeb-4342-85a0-a5a3160e88d3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.890007 Jun 20 12:09:12.821089 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1310/2622] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:11 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:12.837364 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e0210248-9cae-4d5d-99b7-e7367762f830 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:12.837997 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e0210248-9cae-4d5d-99b7-e7367762f830 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:12.851436 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e0210248-9cae-4d5d-99b7-e7367762f830 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:12.858135 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e0210248-9cae-4d5d-99b7-e7367762f830 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:12.859193 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e0210248-9cae-4d5d-99b7-e7367762f830 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:12.859834 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e0210248-9cae-4d5d-99b7-e7367762f830 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:12.892699 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a5ae1135-2f57-42e4-b956-4f56ef785210 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:12.906173 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a5ae1135-2f57-42e4-b956-4f56ef785210 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41" status: 200 len: 1317 microversion: 2.1 time: 0.784033 Jun 20 12:09:12.910257 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1313/2623] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:12 2022] GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 => generated 1317 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:09:12.921155 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c1fd0c09-919c-4418-942f-af72c11fdc48 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:12.922167 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c1fd0c09-919c-4418-942f-af72c11fdc48 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:12.939448 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c1fd0c09-919c-4418-942f-af72c11fdc48 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:12.952024 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c1fd0c09-919c-4418-942f-af72c11fdc48 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:12.952928 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c1fd0c09-919c-4418-942f-af72c11fdc48 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:12.953745 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c1fd0c09-919c-4418-942f-af72c11fdc48 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:13.001681 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e0210248-9cae-4d5d-99b7-e7367762f830 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:13.004445 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:13.018848 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e0210248-9cae-4d5d-99b7-e7367762f830 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1183 microversion: 2.1 time: 0.195326 Jun 20 12:09:13.020871 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1311/2624] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:12 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:13.055209 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-640eba23-f219-4f92-af5d-6a60b3e5c23a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:13.060944 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-640eba23-f219-4f92-af5d-6a60b3e5c23a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 0f4e9f56-0017-4306-80f7-2dfb4c5213db] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:13.098017 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-640eba23-f219-4f92-af5d-6a60b3e5c23a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] HTTP exception thrown: Instance 0f4e9f56-0017-4306-80f7-2dfb4c5213db could not be found. Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-640eba23-f219-4f92-af5d-6a60b3e5c23a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers/0f4e9f56-0017-4306-80f7-2dfb4c5213db/action HTTP/1.1 Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 39 Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: {"os-getConsoleOutput": {"length": 10}} Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 0f4e9f56-0017-4306-80f7-2dfb4c5213db could not be found. Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '0f4e9f56-0017-4306-80f7-2dfb4c5213db', 'body': {'os-getConsoleOutput': {'length': 10}}} Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f4e9f56-0017-4306-80f7-2dfb4c5213db could not be found. Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f4e9f56-0017-4306-80f7-2dfb4c5213db could not be found. Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:13.119232 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:13.124142 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:13.124142 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:13.124142 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:09:13.124142 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:09:13.124142 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f4e9f56-0017-4306-80f7-2dfb4c5213db could not be found. Jun 20 12:09:13.124142 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:13.125890 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-640eba23-f219-4f92-af5d-6a60b3e5c23a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 404 to user: Instance 0f4e9f56-0017-4306-80f7-2dfb4c5213db could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:09:13.127044 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-640eba23-f219-4f92-af5d-6a60b3e5c23a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers/0f4e9f56-0017-4306-80f7-2dfb4c5213db/action" status: 404 len: 111 microversion: 2.1 time: 0.103186 Jun 20 12:09:13.127938 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1312/2625] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:09:13 2022] POST /compute/v2.1/servers/0f4e9f56-0017-4306-80f7-2dfb4c5213db/action => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:09:13.139628 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3eaf832a-2960-4a19-978d-c08340629e87 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:13.140592 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3eaf832a-2960-4a19-978d-c08340629e87 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:13.158715 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3eaf832a-2960-4a19-978d-c08340629e87 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:13.159497 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3eaf832a-2960-4a19-978d-c08340629e87 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:13.160912 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3eaf832a-2960-4a19-978d-c08340629e87 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:13.162534 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3eaf832a-2960-4a19-978d-c08340629e87 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:13.485000 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3eaf832a-2960-4a19-978d-c08340629e87 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:13.506994 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3eaf832a-2960-4a19-978d-c08340629e87 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.371320 Jun 20 12:09:13.508725 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1313/2626] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:13 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:13.530911 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a5dba4bc-0987-44c3-bc13-eb0e80eed237 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:13.531865 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a5dba4bc-0987-44c3-bc13-eb0e80eed237 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:13.539676 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5dba4bc-0987-44c3-bc13-eb0e80eed237 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:13.541151 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5dba4bc-0987-44c3-bc13-eb0e80eed237 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:13.542677 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5dba4bc-0987-44c3-bc13-eb0e80eed237 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:13.543425 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5dba4bc-0987-44c3-bc13-eb0e80eed237 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:13.599992 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c1fd0c09-919c-4418-942f-af72c11fdc48 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:13.625096 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c1fd0c09-919c-4418-942f-af72c11fdc48 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1542 microversion: 2.1 time: 0.713356 Jun 20 12:09:13.628634 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1314/2627] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:12 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1542 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:13.930004 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-224498d1-c425-4a32-ac04-cf35d0a92591 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:13.931351 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-224498d1-c425-4a32-ac04-cf35d0a92591 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:13.938637 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-224498d1-c425-4a32-ac04-cf35d0a92591 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:13.939366 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-224498d1-c425-4a32-ac04-cf35d0a92591 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:13.940358 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-224498d1-c425-4a32-ac04-cf35d0a92591 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:13.940985 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-224498d1-c425-4a32-ac04-cf35d0a92591 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:14.413986 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a5dba4bc-0987-44c3-bc13-eb0e80eed237 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:14.425339 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a5dba4bc-0987-44c3-bc13-eb0e80eed237 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.899317 Jun 20 12:09:14.438467 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1314/2628] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:13 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:14.446733 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9d1a155c-1f89-44e5-b45d-3238e52e3591 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:14.447477 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9d1a155c-1f89-44e5-b45d-3238e52e3591 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:14.456966 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9d1a155c-1f89-44e5-b45d-3238e52e3591 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:14.461507 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9d1a155c-1f89-44e5-b45d-3238e52e3591 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:14.462536 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9d1a155c-1f89-44e5-b45d-3238e52e3591 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:14.463063 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9d1a155c-1f89-44e5-b45d-3238e52e3591 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:14.824789 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9d1a155c-1f89-44e5-b45d-3238e52e3591 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:14.843752 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9d1a155c-1f89-44e5-b45d-3238e52e3591 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 200 len: 1183 microversion: 2.1 time: 0.406699 Jun 20 12:09:14.844844 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1315/2629] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:14 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 1183 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:14.867417 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f589414d-4c41-457e-867a-f51030575c8a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:14.872491 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f589414d-4c41-457e-867a-f51030575c8a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 1a3c8266-de67-4591-8c42-0f32edae5d8d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:14.893058 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-f589414d-4c41-457e-867a-f51030575c8a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] HTTP exception thrown: Instance 1a3c8266-de67-4591-8c42-0f32edae5d8d could not be found. Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f589414d-4c41-457e-867a-f51030575c8a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/1a3c8266-de67-4591-8c42-0f32edae5d8d HTTP/1.1 Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 1a3c8266-de67-4591-8c42-0f32edae5d8d could not be found. Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '1a3c8266-de67-4591-8c42-0f32edae5d8d'} Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a3c8266-de67-4591-8c42-0f32edae5d8d could not be found. Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a3c8266-de67-4591-8c42-0f32edae5d8d could not be found. Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:14.901405 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:14.908300 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:14.908300 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:09:14.908300 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:09:14.908300 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a3c8266-de67-4591-8c42-0f32edae5d8d could not be found. Jun 20 12:09:14.908300 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:14.908850 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f589414d-4c41-457e-867a-f51030575c8a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 404 to user: Instance 1a3c8266-de67-4591-8c42-0f32edae5d8d could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:09:14.910000 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f589414d-4c41-457e-867a-f51030575c8a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/1a3c8266-de67-4591-8c42-0f32edae5d8d" status: 404 len: 111 microversion: 2.1 time: 0.063705 Jun 20 12:09:14.917342 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1316/2630] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:14 2022] GET /compute/v2.1/servers/1a3c8266-de67-4591-8c42-0f32edae5d8d => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:09:14.934448 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-327d5d02-a94a-4110-81c7-3b50e3108a8a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:14.936864 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-327d5d02-a94a-4110-81c7-3b50e3108a8a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:14.968184 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-327d5d02-a94a-4110-81c7-3b50e3108a8a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:14.972191 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-327d5d02-a94a-4110-81c7-3b50e3108a8a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:14.974681 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-327d5d02-a94a-4110-81c7-3b50e3108a8a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:14.981354 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-327d5d02-a94a-4110-81c7-3b50e3108a8a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:15.629206 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-224498d1-c425-4a32-ac04-cf35d0a92591 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:15.641102 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-327d5d02-a94a-4110-81c7-3b50e3108a8a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:15.646748 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-224498d1-c425-4a32-ac04-cf35d0a92591 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41" status: 200 len: 1317 microversion: 2.1 time: 1.721388 Jun 20 12:09:15.649156 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1315/2631] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:13 2022] GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 => generated 1317 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:09:15.660497 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-327d5d02-a94a-4110-81c7-3b50e3108a8a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1542 microversion: 2.1 time: 0.740061 Jun 20 12:09:15.662615 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d0b38805-dbca-45e4-b79e-eec5b2fd1426 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:15.665132 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d0b38805-dbca-45e4-b79e-eec5b2fd1426 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:15.667573 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1317/2632] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:14 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1542 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:15.682440 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d0b38805-dbca-45e4-b79e-eec5b2fd1426 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:15.684813 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d0b38805-dbca-45e4-b79e-eec5b2fd1426 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:15.686467 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d0b38805-dbca-45e4-b79e-eec5b2fd1426 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:15.688335 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d0b38805-dbca-45e4-b79e-eec5b2fd1426 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:15.863622 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6c3c5024-e165-472e-97d4-a684e524c098 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:15.864130 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6c3c5024-e165-472e-97d4-a684e524c098 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: de7fc47c-e28f-4697-bbf9-df8390dfd998] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:15.885322 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c3c5024-e165-472e-97d4-a684e524c098 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:15.888388 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c3c5024-e165-472e-97d4-a684e524c098 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:15.889357 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c3c5024-e165-472e-97d4-a684e524c098 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:15.894896 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c3c5024-e165-472e-97d4-a684e524c098 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:15.945634 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-6c3c5024-e165-472e-97d4-a684e524c098 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] HTTP exception thrown: Instance de7fc47c-e28f-4697-bbf9-df8390dfd998 could not be found. Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6c3c5024-e165-472e-97d4-a684e524c098 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Request method failure captured: Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 HTTP/1.1 Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGGzCfL3w9tcOc55Z9r7EAcHfRRDk3bQtKtjdiI4-k6OZuJCYCgky5sbUbqDZyZL8PkMcjpkShji-aUUeYfT0SA-paoO5QqkaTFkjb1PA6i-RS0Rbrk81uT7XEx2EIIrvJsmj0tkkpgaIWirbQfGY_cm3GD4V1mQEGUSMZ1-Z-TaEuM Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 5cf9c3f1d5c64a75b49099a15fe087ee Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-LiveMigrationTest-1776374292 Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5cf9c3f1d5c64a75b49099a15fe087ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5cf9c3f1d5c64a75b49099a15fe087ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5cf9c3f1d5c64a75b49099a15fe087ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5cf9c3f1d5c64a75b49099a15fe087ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-LiveMigrationTest-1776374292 Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 5cf9c3f1d5c64a75b49099a15fe087ee Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-LiveMigrationTest-1776374292 Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-LiveMigrationTest-1776374292-project Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 3f16b216588946a790b42450b795ee00 Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-LiveMigrationTest-1776374292-project Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: exception: Instance de7fc47c-e28f-4697-bbf9-df8390dfd998 could not be found. Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'de7fc47c-e28f-4697-bbf9-df8390dfd998'} Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de7fc47c-e28f-4697-bbf9-df8390dfd998 could not be found. Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de7fc47c-e28f-4697-bbf9-df8390dfd998 could not be found. Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:15.947262 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:15.951270 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:15.951270 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:15.951270 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:15.951270 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:09:15.951270 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:09:15.951270 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de7fc47c-e28f-4697-bbf9-df8390dfd998 could not be found. Jun 20 12:09:15.951270 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:15.951270 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6c3c5024-e165-472e-97d4-a684e524c098 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Returning 404 to user: Instance de7fc47c-e28f-4697-bbf9-df8390dfd998 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:09:15.953878 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6c3c5024-e165-472e-97d4-a684e524c098 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998" status: 404 len: 111 microversion: 2.1 time: 0.090118 Jun 20 12:09:15.954556 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1318/2633] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:15 2022] GET /compute/v2.1/servers/de7fc47c-e28f-4697-bbf9-df8390dfd998 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:09:16.021105 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d0b38805-dbca-45e4-b79e-eec5b2fd1426 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:16.038728 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d0b38805-dbca-45e4-b79e-eec5b2fd1426 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.383285 Jun 20 12:09:16.043855 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1316/2634] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:15 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:16.070113 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e1474588-0c59-4fed-ba85-f16eb3b2efd0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:16.071048 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e1474588-0c59-4fed-ba85-f16eb3b2efd0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:16.086968 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1474588-0c59-4fed-ba85-f16eb3b2efd0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:16.088373 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1474588-0c59-4fed-ba85-f16eb3b2efd0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:16.090917 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1474588-0c59-4fed-ba85-f16eb3b2efd0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:16.092830 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1474588-0c59-4fed-ba85-f16eb3b2efd0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:16.612738 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e1474588-0c59-4fed-ba85-f16eb3b2efd0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:16.621928 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e1474588-0c59-4fed-ba85-f16eb3b2efd0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.558492 Jun 20 12:09:16.643546 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1319/2635] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:16 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:16.668248 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c4eb6e25-f6c2-461d-8167-b83dddcaf4bc tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:16.669267 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c4eb6e25-f6c2-461d-8167-b83dddcaf4bc tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:16.685546 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3250d2cd-bcec-41de-8027-c442e0a5f9d6 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:16.686250 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3250d2cd-bcec-41de-8027-c442e0a5f9d6 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:16.687059 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4eb6e25-f6c2-461d-8167-b83dddcaf4bc tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:16.687875 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4eb6e25-f6c2-461d-8167-b83dddcaf4bc tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:16.690052 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4eb6e25-f6c2-461d-8167-b83dddcaf4bc tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:16.691945 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4eb6e25-f6c2-461d-8167-b83dddcaf4bc tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:16.696532 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3250d2cd-bcec-41de-8027-c442e0a5f9d6 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:16.696991 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3250d2cd-bcec-41de-8027-c442e0a5f9d6 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:16.697823 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3250d2cd-bcec-41de-8027-c442e0a5f9d6 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:16.698263 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3250d2cd-bcec-41de-8027-c442e0a5f9d6 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:17.022004 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3250d2cd-bcec-41de-8027-c442e0a5f9d6 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:17.031183 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3250d2cd-bcec-41de-8027-c442e0a5f9d6 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1542 microversion: 2.1 time: 0.350292 Jun 20 12:09:17.045431 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1320/2636] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:16 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1542 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:09:17.050734 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0adfa8c1-9715-4440-bef7-67bd48c63b77 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2020632810", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "dadde73c-e8f7-441b-8503-8f17caea8651"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0adfa8c1-9715-4440-bef7-67bd48c63b77 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 238 Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2020632810", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "dadde73c-e8f7-441b-8503-8f17caea8651"}]}} Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2020632810', 'imageRef': 'f16836cc-4e18-4bd0-b261-3865adf8cb83', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'dadde73c-e8f7-441b-8503-8f17caea8651'}]}}} Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise error Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 12:09:17.053819 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 12:09:17.058017 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 12:09:17.058017 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 12:09:17.058017 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jun 20 12:09:17.058017 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:17.058017 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:17.058017 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:17.058017 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:17.058017 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:17.058017 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:17.058017 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 12:09:17.058017 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 12:09:17.058017 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jun 20 12:09:17.058017 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:17.060391 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0adfa8c1-9715-4440-bef7-67bd48c63b77 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:09:17.061520 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0adfa8c1-9715-4440-bef7-67bd48c63b77 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.014687 Jun 20 12:09:17.062351 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1321/2637] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:09:17 2022] POST /compute/v2.1/servers => generated 139 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:09:17.076402 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b9b30bb6-8dfe-4cef-928f-95691555e0f8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:17.077289 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b9b30bb6-8dfe-4cef-928f-95691555e0f8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:17.092782 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b9b30bb6-8dfe-4cef-928f-95691555e0f8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:17.095718 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b9b30bb6-8dfe-4cef-928f-95691555e0f8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:17.096810 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b9b30bb6-8dfe-4cef-928f-95691555e0f8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:17.099154 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b9b30bb6-8dfe-4cef-928f-95691555e0f8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:17.520850 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b9b30bb6-8dfe-4cef-928f-95691555e0f8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:17.534426 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b9b30bb6-8dfe-4cef-928f-95691555e0f8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.466676 Jun 20 12:09:17.548378 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1322/2638] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:17 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:17.555649 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f0e579dc-66a0-4adc-bc2a-b7c1b7563612 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:17.556495 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f0e579dc-66a0-4adc-bc2a-b7c1b7563612 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:17.575503 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f0e579dc-66a0-4adc-bc2a-b7c1b7563612 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:17.575963 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f0e579dc-66a0-4adc-bc2a-b7c1b7563612 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:17.577290 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f0e579dc-66a0-4adc-bc2a-b7c1b7563612 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:17.577742 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f0e579dc-66a0-4adc-bc2a-b7c1b7563612 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:17.669451 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c4eb6e25-f6c2-461d-8167-b83dddcaf4bc tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:17.679626 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c4eb6e25-f6c2-461d-8167-b83dddcaf4bc tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41" status: 200 len: 1317 microversion: 2.1 time: 1.015867 Jun 20 12:09:17.680256 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1317/2639] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:16 2022] GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 => generated 1317 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:18.013279 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f0e579dc-66a0-4adc-bc2a-b7c1b7563612 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:18.045356 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f0e579dc-66a0-4adc-bc2a-b7c1b7563612 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.495368 Jun 20 12:09:18.063547 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3756b8bd-3ed6-4365-80c4-0595e5f8dd68 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:18.064190 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3756b8bd-3ed6-4365-80c4-0595e5f8dd68 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:18.069031 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1323/2640] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:17 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:18.083181 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3756b8bd-3ed6-4365-80c4-0595e5f8dd68 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:18.089013 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3756b8bd-3ed6-4365-80c4-0595e5f8dd68 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:18.090457 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3756b8bd-3ed6-4365-80c4-0595e5f8dd68 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:18.091214 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3756b8bd-3ed6-4365-80c4-0595e5f8dd68 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:18.120168 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:18.146989 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-38908dbd-0293-446c-b228-853cc2ddc91a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-851999593", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "dadde73c-e8f7-441b-8503-8f17caea8651"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-38908dbd-0293-446c-b228-853cc2ddc91a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 234 Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-851999593", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "dadde73c-e8f7-441b-8503-8f17caea8651"}]}} Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-851999593', 'imageRef': 'f16836cc-4e18-4bd0-b261-3865adf8cb83', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'dadde73c-e8f7-441b-8503-8f17caea8651'}]}}} Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = func(instance) Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/_format.py", line 210, in is_ipv6 Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return socket.inet_pton(socket.AF_INET6, instance) Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi OSError: illegal IP address string passed to inet_pton Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise error Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi 'notvalid' Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:09:18.157456 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:09:18.161763 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:09:18.161763 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:09:18.161763 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:09:18.161763 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:09:18.161763 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 12:09:18.161763 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 12:09:18.161763 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 12:09:18.161763 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 12:09:18.161763 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 12:09:18.161763 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 12:09:18.161763 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jun 20 12:09:18.161763 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:18.161763 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:18.161763 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:18.161763 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:18.161763 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:18.161763 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:18.161763 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 12:09:18.161763 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 12:09:18.161763 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jun 20 12:09:18.161763 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:18.165051 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-38908dbd-0293-446c-b228-853cc2ddc91a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:09:18.166396 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-38908dbd-0293-446c-b228-853cc2ddc91a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.023844 Jun 20 12:09:18.167768 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1324/2641] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:09:18 2022] POST /compute/v2.1/servers => generated 133 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:09:18.180322 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e3c6ac7a-4952-405b-8714-0fba7b678eb7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:18.182610 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e3c6ac7a-4952-405b-8714-0fba7b678eb7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:18.191786 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e3c6ac7a-4952-405b-8714-0fba7b678eb7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:18.192711 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e3c6ac7a-4952-405b-8714-0fba7b678eb7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:18.194667 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e3c6ac7a-4952-405b-8714-0fba7b678eb7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:18.197904 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e3c6ac7a-4952-405b-8714-0fba7b678eb7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:18.522195 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e3c6ac7a-4952-405b-8714-0fba7b678eb7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:18.533427 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e3c6ac7a-4952-405b-8714-0fba7b678eb7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.361130 Jun 20 12:09:18.544617 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1325/2642] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:18 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:18.564873 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ca471247-f5fb-4f02-8839-be35d56faaf9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:18.565706 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ca471247-f5fb-4f02-8839-be35d56faaf9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:18.596682 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ca471247-f5fb-4f02-8839-be35d56faaf9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:18.598013 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ca471247-f5fb-4f02-8839-be35d56faaf9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:18.599978 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ca471247-f5fb-4f02-8839-be35d56faaf9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:18.600479 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ca471247-f5fb-4f02-8839-be35d56faaf9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:18.930154 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ca471247-f5fb-4f02-8839-be35d56faaf9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:18.938801 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ca471247-f5fb-4f02-8839-be35d56faaf9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.389696 Jun 20 12:09:18.955207 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1326/2643] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:18 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:18.971816 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-67cf09bb-8414-4a1e-afbf-9b2f5009bb41 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:18.975333 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-67cf09bb-8414-4a1e-afbf-9b2f5009bb41 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:18.994733 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-67cf09bb-8414-4a1e-afbf-9b2f5009bb41 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:18.996569 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-67cf09bb-8414-4a1e-afbf-9b2f5009bb41 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:18.999173 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-67cf09bb-8414-4a1e-afbf-9b2f5009bb41 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:19.010758 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-67cf09bb-8414-4a1e-afbf-9b2f5009bb41 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:19.407953 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-67cf09bb-8414-4a1e-afbf-9b2f5009bb41 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:19.417416 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-67cf09bb-8414-4a1e-afbf-9b2f5009bb41 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41" status: 200 len: 1317 microversion: 2.1 time: 0.460719 Jun 20 12:09:19.419971 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1327/2644] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:18 2022] GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 => generated 1317 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:19.425475 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8927ec12-2dfa-4038-93c5-9599ce101c37 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:19.426429 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8927ec12-2dfa-4038-93c5-9599ce101c37 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: f0cd8deb-fc2f-4335-b93d-9dde69361666] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:19.435833 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-8927ec12-2dfa-4038-93c5-9599ce101c37 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] HTTP exception thrown: Instance f0cd8deb-fc2f-4335-b93d-9dde69361666 could not be found. Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8927ec12-2dfa-4038-93c5-9599ce101c37 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers/f0cd8deb-fc2f-4335-b93d-9dde69361666/action HTTP/1.1 Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 13 Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: {"pause": {}} Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: exception: Instance f0cd8deb-fc2f-4335-b93d-9dde69361666 could not be found. Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'f0cd8deb-fc2f-4335-b93d-9dde69361666', 'body': {'pause': {}}} Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0cd8deb-fc2f-4335-b93d-9dde69361666 could not be found. Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0cd8deb-fc2f-4335-b93d-9dde69361666 could not be found. Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:19.452855 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:19.459021 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:09:19.459021 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:09:19.459021 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0cd8deb-fc2f-4335-b93d-9dde69361666 could not be found. Jun 20 12:09:19.459021 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:19.467217 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8927ec12-2dfa-4038-93c5-9599ce101c37 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 404 to user: Instance f0cd8deb-fc2f-4335-b93d-9dde69361666 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:09:19.470710 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8927ec12-2dfa-4038-93c5-9599ce101c37 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers/f0cd8deb-fc2f-4335-b93d-9dde69361666/action" status: 404 len: 111 microversion: 2.1 time: 0.049190 Jun 20 12:09:19.473635 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1328/2645] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:09:19 2022] POST /compute/v2.1/servers/f0cd8deb-fc2f-4335-b93d-9dde69361666/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:09:19.489638 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b3aca1fc-662b-4052-acaf-28e8af102b57 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:19.506405 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b3aca1fc-662b-4052-acaf-28e8af102b57 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:19.540678 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3aca1fc-662b-4052-acaf-28e8af102b57 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:19.541316 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3aca1fc-662b-4052-acaf-28e8af102b57 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:19.545382 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3aca1fc-662b-4052-acaf-28e8af102b57 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:19.546345 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3aca1fc-662b-4052-acaf-28e8af102b57 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:19.709102 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3756b8bd-3ed6-4365-80c4-0595e5f8dd68 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:19.736367 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3756b8bd-3ed6-4365-80c4-0595e5f8dd68 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1542 microversion: 2.1 time: 1.676847 Jun 20 12:09:19.737261 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1318/2646] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:18 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1542 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:09:20.036589 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b3aca1fc-662b-4052-acaf-28e8af102b57 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:20.063010 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b3aca1fc-662b-4052-acaf-28e8af102b57 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.579809 Jun 20 12:09:20.064382 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1329/2647] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:19 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:20.084768 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6d4a6ee1-501d-45b3-8335-694609a6643b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:20.085562 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6d4a6ee1-501d-45b3-8335-694609a6643b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:20.112356 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6d4a6ee1-501d-45b3-8335-694609a6643b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:20.112827 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6d4a6ee1-501d-45b3-8335-694609a6643b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:20.127281 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6d4a6ee1-501d-45b3-8335-694609a6643b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:20.127699 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6d4a6ee1-501d-45b3-8335-694609a6643b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:20.344933 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-f3f56348-520e-4902-86c1-65ebdab897a8 req-7e3b8cd5-9174-458c-b397-6ea6a75cfdde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c9e8490-b371-4215-af47-09ebe2b7cd41", "name": "network-vif-plugged", "status": "completed", "tag": "9589165b-8125-4dbe-9ce0-546dbf131a7a"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:20.362852 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-f3f56348-520e-4902-86c1-65ebdab897a8 req-7e3b8cd5-9174-458c-b397-6ea6a75cfdde service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:20.368087 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-f3f56348-520e-4902-86c1-65ebdab897a8 req-7e3b8cd5-9174-458c-b397-6ea6a75cfdde service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:20.391923 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-f3f56348-520e-4902-86c1-65ebdab897a8 req-7e3b8cd5-9174-458c-b397-6ea6a75cfdde service nova] Creating event network-vif-plugged:9589165b-8125-4dbe-9ce0-546dbf131a7a for instance 0c9e8490-b371-4215-af47-09ebe2b7cd41 on n-h1-master-1 Jun 20 12:09:20.399715 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-f3f56348-520e-4902-86c1-65ebdab897a8 req-7e3b8cd5-9174-458c-b397-6ea6a75cfdde service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060136 Jun 20 12:09:20.401218 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1330/2648] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:09:20.438847 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-94a44f5b-59ea-44b1-a1aa-ba84671bc22e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:20.440367 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-94a44f5b-59ea-44b1-a1aa-ba84671bc22e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:20.449161 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-94a44f5b-59ea-44b1-a1aa-ba84671bc22e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:20.450113 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-94a44f5b-59ea-44b1-a1aa-ba84671bc22e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:20.451128 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-94a44f5b-59ea-44b1-a1aa-ba84671bc22e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:20.451949 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-94a44f5b-59ea-44b1-a1aa-ba84671bc22e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:20.562184 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6d4a6ee1-501d-45b3-8335-694609a6643b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:20.585042 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6d4a6ee1-501d-45b3-8335-694609a6643b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.503292 Jun 20 12:09:20.586342 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1319/2649] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:20 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:09:20.604075 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-aaf96bf9-8fd6-480e-8236-f254bf81fecf tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:20.605032 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-aaf96bf9-8fd6-480e-8236-f254bf81fecf tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:20.635715 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aaf96bf9-8fd6-480e-8236-f254bf81fecf tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:20.643437 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aaf96bf9-8fd6-480e-8236-f254bf81fecf tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:20.647768 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aaf96bf9-8fd6-480e-8236-f254bf81fecf tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:20.649006 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aaf96bf9-8fd6-480e-8236-f254bf81fecf tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:20.664307 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-94a44f5b-59ea-44b1-a1aa-ba84671bc22e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:20.698183 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-94a44f5b-59ea-44b1-a1aa-ba84671bc22e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41" status: 200 len: 1317 microversion: 2.1 time: 0.264646 Jun 20 12:09:20.699399 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1331/2650] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:20 2022] GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:09:20.759282 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-01c64c28-e23c-4c19-a729-f7ba1028b0bf tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:20.760019 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-01c64c28-e23c-4c19-a729-f7ba1028b0bf tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:20.775020 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01c64c28-e23c-4c19-a729-f7ba1028b0bf tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:20.780828 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01c64c28-e23c-4c19-a729-f7ba1028b0bf tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:20.781813 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01c64c28-e23c-4c19-a729-f7ba1028b0bf tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:20.782486 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01c64c28-e23c-4c19-a729-f7ba1028b0bf tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:20.819537 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-aaf96bf9-8fd6-480e-8236-f254bf81fecf tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3/action" status: 202 len: 0 microversion: 2.1 time: 0.220684 Jun 20 12:09:20.823795 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1320/2651] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:09:20 2022] POST /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:09:20.840784 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-85a9badf-280d-4db6-8d38-ef797b5bd668 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:20.843295 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-85a9badf-280d-4db6-8d38-ef797b5bd668 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:20.859756 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-85a9badf-280d-4db6-8d38-ef797b5bd668 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:20.860163 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-85a9badf-280d-4db6-8d38-ef797b5bd668 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:20.861647 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-85a9badf-280d-4db6-8d38-ef797b5bd668 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:20.862394 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-85a9badf-280d-4db6-8d38-ef797b5bd668 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:21.069170 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-01c64c28-e23c-4c19-a729-f7ba1028b0bf tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:21.078134 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-01c64c28-e23c-4c19-a729-f7ba1028b0bf tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1542 microversion: 2.1 time: 0.323107 Jun 20 12:09:21.082738 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1332/2652] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:20 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1542 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:21.717074 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9053854e-a398-4142-a90a-8fb600c0bfeb tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:21.718363 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9053854e-a398-4142-a90a-8fb600c0bfeb tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:21.753372 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9053854e-a398-4142-a90a-8fb600c0bfeb tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:21.754652 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9053854e-a398-4142-a90a-8fb600c0bfeb tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:21.761391 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9053854e-a398-4142-a90a-8fb600c0bfeb tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:21.765650 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9053854e-a398-4142-a90a-8fb600c0bfeb tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:21.867648 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-85a9badf-280d-4db6-8d38-ef797b5bd668 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:21.877123 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-85a9badf-280d-4db6-8d38-ef797b5bd668 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1511 microversion: 2.1 time: 1.049459 Jun 20 12:09:21.899357 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1321/2653] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:20 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1511 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:22.101960 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4b9d7ee7-8c08-4ebe-826d-00e64dea42c2 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:22.106498 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4b9d7ee7-8c08-4ebe-826d-00e64dea42c2 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:22.118903 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4b9d7ee7-8c08-4ebe-826d-00e64dea42c2 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:22.119639 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4b9d7ee7-8c08-4ebe-826d-00e64dea42c2 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:22.124248 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4b9d7ee7-8c08-4ebe-826d-00e64dea42c2 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:22.124905 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4b9d7ee7-8c08-4ebe-826d-00e64dea42c2 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:22.350281 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9053854e-a398-4142-a90a-8fb600c0bfeb tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:22.364537 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9053854e-a398-4142-a90a-8fb600c0bfeb tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41" status: 200 len: 1317 microversion: 2.1 time: 0.652567 Jun 20 12:09:22.368311 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1333/2654] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:21 2022] GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 => generated 1317 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:22.896187 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7628bf86-67d3-411b-9da7-cacb7c07cf0b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:22.897344 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7628bf86-67d3-411b-9da7-cacb7c07cf0b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:22.920236 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7628bf86-67d3-411b-9da7-cacb7c07cf0b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:22.923174 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7628bf86-67d3-411b-9da7-cacb7c07cf0b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:22.925655 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7628bf86-67d3-411b-9da7-cacb7c07cf0b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:22.928956 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7628bf86-67d3-411b-9da7-cacb7c07cf0b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:23.354008 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7628bf86-67d3-411b-9da7-cacb7c07cf0b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:23.356865 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:23.373721 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7628bf86-67d3-411b-9da7-cacb7c07cf0b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1491 microversion: 2.1 time: 0.478591 Jun 20 12:09:23.376991 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1334/2655] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:22 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1491 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:23.397216 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-16d453f2-579b-4ad6-ab36-9f3d1da1ebc6 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:23.399915 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-16d453f2-579b-4ad6-ab36-9f3d1da1ebc6 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:23.416508 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-16d453f2-579b-4ad6-ab36-9f3d1da1ebc6 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:23.416973 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-16d453f2-579b-4ad6-ab36-9f3d1da1ebc6 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:23.417853 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-16d453f2-579b-4ad6-ab36-9f3d1da1ebc6 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:23.418213 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-16d453f2-579b-4ad6-ab36-9f3d1da1ebc6 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:23.917552 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-16d453f2-579b-4ad6-ab36-9f3d1da1ebc6 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:23.945513 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-16d453f2-579b-4ad6-ab36-9f3d1da1ebc6 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41" status: 200 len: 1507 microversion: 2.1 time: 0.564015 Jun 20 12:09:23.971391 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1335/2656] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:23 2022] GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 => generated 1507 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:23.982534 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-428fca78-85f1-4133-bff4-b0ba22a26674 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:23.984143 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-428fca78-85f1-4133-bff4-b0ba22a26674 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:23.997492 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-428fca78-85f1-4133-bff4-b0ba22a26674 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:23.998715 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-428fca78-85f1-4133-bff4-b0ba22a26674 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:24.002444 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-428fca78-85f1-4133-bff4-b0ba22a26674 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:24.003780 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-428fca78-85f1-4133-bff4-b0ba22a26674 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:24.088862 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-428fca78-85f1-4133-bff4-b0ba22a26674 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] HTTP exception thrown: Cannot 'pause' instance 593cda12-6491-4a27-8fc7-42c05e0291c3 while it is in vm_state paused Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-428fca78-85f1-4133-bff4-b0ba22a26674 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3/action HTTP/1.1 Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 13 Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: {"pause": {}} Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: exception: Cannot 'pause' instance 593cda12-6491-4a27-8fc7-42c05e0291c3 while it is in vm_state paused Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '593cda12-6491-4a27-8fc7-42c05e0291c3', 'body': {'pause': {}}} Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 593cda12-6491-4a27-8fc7-42c05e0291c3 in vm_state paused. Cannot pause while the instance is in this state. Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 593cda12-6491-4a27-8fc7-42c05e0291c3 while it is in vm_state paused Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:24.094833 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:24.103174 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:24.103174 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:09:24.103174 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:09:24.103174 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 593cda12-6491-4a27-8fc7-42c05e0291c3 while it is in vm_state paused Jun 20 12:09:24.103174 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:24.103174 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-428fca78-85f1-4133-bff4-b0ba22a26674 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 409 to user: Cannot 'pause' instance 593cda12-6491-4a27-8fc7-42c05e0291c3 while it is in vm_state paused {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:09:24.103174 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-428fca78-85f1-4133-bff4-b0ba22a26674 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3/action" status: 409 len: 143 microversion: 2.1 time: 0.124753 Jun 20 12:09:24.105487 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1336/2657] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:09:23 2022] POST /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3/action => generated 143 bytes in 132 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:09:24.113143 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4b9d7ee7-8c08-4ebe-826d-00e64dea42c2 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:24.114825 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-10fc80ba-170d-44a4-bea7-7ffd438dcaad tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:24.118240 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-10fc80ba-170d-44a4-bea7-7ffd438dcaad tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:24.132778 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4b9d7ee7-8c08-4ebe-826d-00e64dea42c2 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1542 microversion: 2.1 time: 2.036906 Jun 20 12:09:24.137763 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-10fc80ba-170d-44a4-bea7-7ffd438dcaad tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:24.138256 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-10fc80ba-170d-44a4-bea7-7ffd438dcaad tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:24.139209 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-10fc80ba-170d-44a4-bea7-7ffd438dcaad tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:24.140950 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-10fc80ba-170d-44a4-bea7-7ffd438dcaad tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:24.149287 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1322/2658] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:22 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1542 bytes in 2053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:24.164331 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0ba85127-2709-434a-9a5b-73831760ccbd tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:24.164886 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0ba85127-2709-434a-9a5b-73831760ccbd tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:24.195183 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0ba85127-2709-434a-9a5b-73831760ccbd tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:24.195646 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0ba85127-2709-434a-9a5b-73831760ccbd tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:24.196524 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0ba85127-2709-434a-9a5b-73831760ccbd tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:24.196972 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0ba85127-2709-434a-9a5b-73831760ccbd tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:24.371751 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0ba85127-2709-434a-9a5b-73831760ccbd tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3/action" status: 202 len: 0 microversion: 2.1 time: 0.221268 Jun 20 12:09:24.377348 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1323/2659] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:09:24 2022] POST /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:09:24.383971 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f5d77e60-4b71-4d0c-acea-21efe98f0234 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:24.384994 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f5d77e60-4b71-4d0c-acea-21efe98f0234 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:24.392700 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f5d77e60-4b71-4d0c-acea-21efe98f0234 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:24.393436 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f5d77e60-4b71-4d0c-acea-21efe98f0234 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:24.394803 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f5d77e60-4b71-4d0c-acea-21efe98f0234 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:24.395605 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f5d77e60-4b71-4d0c-acea-21efe98f0234 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:24.430139 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f5d77e60-4b71-4d0c-acea-21efe98f0234 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:09:24.583633 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f5d77e60-4b71-4d0c-acea-21efe98f0234 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "DELETE /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 204 len: 0 microversion: 2.1 time: 0.204283 Jun 20 12:09:24.591088 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1324/2660] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:09:24 2022] DELETE /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:09:24.591088 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e755b1f6-9e4f-4da3-bf52-9fc3332ae659 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:24.591088 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e755b1f6-9e4f-4da3-bf52-9fc3332ae659 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:24.610962 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e755b1f6-9e4f-4da3-bf52-9fc3332ae659 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:24.611422 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e755b1f6-9e4f-4da3-bf52-9fc3332ae659 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:24.612243 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e755b1f6-9e4f-4da3-bf52-9fc3332ae659 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:24.612698 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e755b1f6-9e4f-4da3-bf52-9fc3332ae659 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:24.788144 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-10fc80ba-170d-44a4-bea7-7ffd438dcaad tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:24.804887 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-10fc80ba-170d-44a4-bea7-7ffd438dcaad tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41" status: 200 len: 1507 microversion: 2.1 time: 0.699272 Jun 20 12:09:24.805859 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1337/2661] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:24 2022] GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 => generated 1507 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:24.822230 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c5ede778-9acb-4676-9ae3-cbcb9ccb681d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:24.824520 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c5ede778-9acb-4676-9ae3-cbcb9ccb681d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:24.846217 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c5ede778-9acb-4676-9ae3-cbcb9ccb681d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:24.846682 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c5ede778-9acb-4676-9ae3-cbcb9ccb681d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:24.847483 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c5ede778-9acb-4676-9ae3-cbcb9ccb681d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:24.851324 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c5ede778-9acb-4676-9ae3-cbcb9ccb681d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:25.686609 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e755b1f6-9e4f-4da3-bf52-9fc3332ae659 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:25.704173 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e755b1f6-9e4f-4da3-bf52-9fc3332ae659 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1498 microversion: 2.1 time: 1.114067 Jun 20 12:09:25.717392 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1325/2662] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:24 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1498 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:25.732535 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-456b5626-f5e0-44e9-9130-3fe26d81abfe tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:25.734963 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-456b5626-f5e0-44e9-9130-3fe26d81abfe tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:25.764595 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-456b5626-f5e0-44e9-9130-3fe26d81abfe tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:25.766807 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-456b5626-f5e0-44e9-9130-3fe26d81abfe tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:25.771181 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-456b5626-f5e0-44e9-9130-3fe26d81abfe tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:25.772119 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-456b5626-f5e0-44e9-9130-3fe26d81abfe tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:26.054884 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-456b5626-f5e0-44e9-9130-3fe26d81abfe tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:09:26.055518 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-456b5626-f5e0-44e9-9130-3fe26d81abfe tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:09:26.056288 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-456b5626-f5e0-44e9-9130-3fe26d81abfe tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:09:26.057201 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-456b5626-f5e0-44e9-9130-3fe26d81abfe tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:09:26.057771 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-456b5626-f5e0-44e9-9130-3fe26d81abfe tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:09:26.292951 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-456b5626-f5e0-44e9-9130-3fe26d81abfe tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:26.317454 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-456b5626-f5e0-44e9-9130-3fe26d81abfe tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:26.317977 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-456b5626-f5e0-44e9-9130-3fe26d81abfe tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:26.318798 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-456b5626-f5e0-44e9-9130-3fe26d81abfe tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:26.325567 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-456b5626-f5e0-44e9-9130-3fe26d81abfe tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:26.401839 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-456b5626-f5e0-44e9-9130-3fe26d81abfe tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "POST /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41/action" status: 202 len: 1109 microversion: 2.1 time: 0.682808 Jun 20 12:09:26.420743 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1326/2663] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:09:25 2022] POST /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41/action => generated 1109 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jun 20 12:09:26.434895 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ea3f056f-eb8e-453c-abba-1df9e66c49cf tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:26.435788 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ea3f056f-eb8e-453c-abba-1df9e66c49cf tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:26.453209 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ea3f056f-eb8e-453c-abba-1df9e66c49cf tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:26.462384 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ea3f056f-eb8e-453c-abba-1df9e66c49cf tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:26.463410 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ea3f056f-eb8e-453c-abba-1df9e66c49cf tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:26.464011 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ea3f056f-eb8e-453c-abba-1df9e66c49cf tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:26.531620 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c5ede778-9acb-4676-9ae3-cbcb9ccb681d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:26.543787 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c5ede778-9acb-4676-9ae3-cbcb9ccb681d tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1666 microversion: 2.1 time: 1.736496 Jun 20 12:09:26.545147 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1338/2664] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:24 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1666 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:26.553119 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4e1a88c3-a12d-4cb3-a7b5-604ce625b195 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:26.555932 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4e1a88c3-a12d-4cb3-a7b5-604ce625b195 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:26.564964 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4e1a88c3-a12d-4cb3-a7b5-604ce625b195 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:26.565976 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4e1a88c3-a12d-4cb3-a7b5-604ce625b195 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:26.567381 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4e1a88c3-a12d-4cb3-a7b5-604ce625b195 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:26.569143 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4e1a88c3-a12d-4cb3-a7b5-604ce625b195 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:26.852110 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ea3f056f-eb8e-453c-abba-1df9e66c49cf tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:26.883523 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ea3f056f-eb8e-453c-abba-1df9e66c49cf tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1542 microversion: 2.1 time: 0.461512 Jun 20 12:09:26.897736 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1327/2665] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:26 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1542 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:26.905741 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6e93480f-1397-4877-8286-d14f02c0fe68 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:26.910214 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6e93480f-1397-4877-8286-d14f02c0fe68 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:26.937905 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6e93480f-1397-4877-8286-d14f02c0fe68 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:26.948339 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6e93480f-1397-4877-8286-d14f02c0fe68 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:26.948636 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6e93480f-1397-4877-8286-d14f02c0fe68 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:26.949002 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6e93480f-1397-4877-8286-d14f02c0fe68 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:27.137600 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4e1a88c3-a12d-4cb3-a7b5-604ce625b195 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:27.169119 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4e1a88c3-a12d-4cb3-a7b5-604ce625b195 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41" status: 200 len: 1514 microversion: 2.1 time: 0.622179 Jun 20 12:09:27.171587 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1339/2666] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:26 2022] GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 => generated 1514 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:27.566630 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ebb45d65-0042-434c-80a4-50aebe83d3d8 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:27.568356 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ebb45d65-0042-434c-80a4-50aebe83d3d8 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:27.576508 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebb45d65-0042-434c-80a4-50aebe83d3d8 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:27.576966 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebb45d65-0042-434c-80a4-50aebe83d3d8 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:27.577771 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebb45d65-0042-434c-80a4-50aebe83d3d8 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:27.578214 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebb45d65-0042-434c-80a4-50aebe83d3d8 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:28.327088 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ebb45d65-0042-434c-80a4-50aebe83d3d8 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:28.341648 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ebb45d65-0042-434c-80a4-50aebe83d3d8 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1666 microversion: 2.1 time: 0.782382 Jun 20 12:09:28.344246 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1340/2667] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:27 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1666 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:28.347016 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6e93480f-1397-4877-8286-d14f02c0fe68 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:28.354600 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3e5f0025-4592-4e2b-8b18-967c3d05dcfd tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:28.356786 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3e5f0025-4592-4e2b-8b18-967c3d05dcfd tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:28.361681 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6e93480f-1397-4877-8286-d14f02c0fe68 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 1.462183 Jun 20 12:09:28.362934 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1328/2668] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:26 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:28.381695 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dcea4957-fdbb-4339-b136-a77089a4fe89 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:28.382436 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-dcea4957-fdbb-4339-b136-a77089a4fe89 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:28.386211 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e5f0025-4592-4e2b-8b18-967c3d05dcfd tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:28.387296 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e5f0025-4592-4e2b-8b18-967c3d05dcfd tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:28.392928 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e5f0025-4592-4e2b-8b18-967c3d05dcfd tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:28.394609 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e5f0025-4592-4e2b-8b18-967c3d05dcfd tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:28.415994 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dcea4957-fdbb-4339-b136-a77089a4fe89 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:28.420911 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dcea4957-fdbb-4339-b136-a77089a4fe89 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:28.421830 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dcea4957-fdbb-4339-b136-a77089a4fe89 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:28.422295 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dcea4957-fdbb-4339-b136-a77089a4fe89 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:28.430864 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:28.970143 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3e5f0025-4592-4e2b-8b18-967c3d05dcfd tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:28.979962 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3e5f0025-4592-4e2b-8b18-967c3d05dcfd tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1542 microversion: 2.1 time: 0.633852 Jun 20 12:09:28.989907 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1341/2669] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:28 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1542 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:28.989907 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4ac77888-110c-4784-90f8-829ad918fe9c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:28.989907 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4ac77888-110c-4784-90f8-829ad918fe9c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:28.994673 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4ac77888-110c-4784-90f8-829ad918fe9c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:28.995458 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4ac77888-110c-4784-90f8-829ad918fe9c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:28.996450 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4ac77888-110c-4784-90f8-829ad918fe9c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:28.997078 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4ac77888-110c-4784-90f8-829ad918fe9c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:29.171947 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-dcea4957-fdbb-4339-b136-a77089a4fe89 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:29.182684 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dcea4957-fdbb-4339-b136-a77089a4fe89 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41" status: 200 len: 1514 microversion: 2.1 time: 0.818398 Jun 20 12:09:29.183286 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1329/2670] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:28 2022] GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 => generated 1514 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:29.203619 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-41ceb61b-64c5-430f-b2fa-9e0da90a9e74 req-521b5c43-8f7a-45e9-9123-a7b2bdff9f9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31066575-9374-412f-9c63-ad5162254777", "name": "network-vif-deleted", "tag": "e914de0d-b9de-410a-8338-f6ffef3981c1"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:29.244508 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-41ceb61b-64c5-430f-b2fa-9e0da90a9e74 req-521b5c43-8f7a-45e9-9123-a7b2bdff9f9f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:29.247787 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-41ceb61b-64c5-430f-b2fa-9e0da90a9e74 req-521b5c43-8f7a-45e9-9123-a7b2bdff9f9f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:29.300334 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-41ceb61b-64c5-430f-b2fa-9e0da90a9e74 req-521b5c43-8f7a-45e9-9123-a7b2bdff9f9f service nova] Creating event network-vif-deleted:e914de0d-b9de-410a-8338-f6ffef3981c1 for instance 31066575-9374-412f-9c63-ad5162254777 on n-h2-master-1 Jun 20 12:09:29.342077 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-41ceb61b-64c5-430f-b2fa-9e0da90a9e74 req-521b5c43-8f7a-45e9-9123-a7b2bdff9f9f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153915 Jun 20 12:09:29.343269 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1330/2671] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:09:29.344949 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4ac77888-110c-4784-90f8-829ad918fe9c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:29.367344 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4ac77888-110c-4784-90f8-829ad918fe9c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.383599 Jun 20 12:09:29.382552 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1342/2672] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:28 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:29.394000 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-281207b2-efb6-47ce-a6d8-429b3e9f1669 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:29.396512 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-281207b2-efb6-47ce-a6d8-429b3e9f1669 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:29.408437 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-281207b2-efb6-47ce-a6d8-429b3e9f1669 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:29.409375 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-281207b2-efb6-47ce-a6d8-429b3e9f1669 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:29.413217 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-281207b2-efb6-47ce-a6d8-429b3e9f1669 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:29.414805 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-281207b2-efb6-47ce-a6d8-429b3e9f1669 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:29.537639 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-281207b2-efb6-47ce-a6d8-429b3e9f1669 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:29.538098 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-281207b2-efb6-47ce-a6d8-429b3e9f1669 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:29.538569 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-281207b2-efb6-47ce-a6d8-429b3e9f1669 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lazy-loading 'fault' on Instance uuid 31066575-9374-412f-9c63-ad5162254777 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:09:29.678857 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-281207b2-efb6-47ce-a6d8-429b3e9f1669 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:29.697568 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-39104cbe-9993-4b1d-9497-d60ca819575c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1765590200", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "9bb4b974-67e4-46e5-95b7-e1615d1df6f7"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:29.745007 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-281207b2-efb6-47ce-a6d8-429b3e9f1669 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 200 len: 1323 microversion: 2.1 time: 0.360655 Jun 20 12:09:29.748670 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1343/2673] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:29 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 1323 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:29.760647 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-43773650-53ea-4943-8f4a-a1296af852aa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:29.761954 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-43773650-53ea-4943-8f4a-a1296af852aa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:29.774204 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-43773650-53ea-4943-8f4a-a1296af852aa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:29.774668 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-43773650-53ea-4943-8f4a-a1296af852aa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:29.781127 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-39104cbe-9993-4b1d-9497-d60ca819575c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] validate_networks() for [('9bb4b974-67e4-46e5-95b7-e1615d1df6f7', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:09:29.786416 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-43773650-53ea-4943-8f4a-a1296af852aa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:29.786938 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-43773650-53ea-4943-8f4a-a1296af852aa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:29.814486 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-43773650-53ea-4943-8f4a-a1296af852aa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] HTTP exception thrown: Instance 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 could not be found. Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-43773650-53ea-4943-8f4a-a1296af852aa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6/action HTTP/1.1 Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 28 Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: {"reboot": {"type": "SOFT"}} Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 could not be found. Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6', 'body': {'reboot': {'type': 'SOFT'}}} Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 could not be found. Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:09:29.816186 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:09:29.821024 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 could not be found. Jun 20 12:09:29.821024 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:29.821024 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:29.821024 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:29.821024 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:29.821024 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:29.821024 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:29.821024 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:09:29.821024 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:09:29.821024 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 could not be found. Jun 20 12:09:29.821024 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:29.821024 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-43773650-53ea-4943-8f4a-a1296af852aa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 404 to user: Instance 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:09:29.821024 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-43773650-53ea-4943-8f4a-a1296af852aa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6/action" status: 404 len: 111 microversion: 2.1 time: 0.067718 Jun 20 12:09:29.821024 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1344/2674] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:09:29 2022] POST /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6/action => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:09:29.847091 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d53afa9c-57b6-4eb3-9552-5ac2ba8a4d62 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:29.847637 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d53afa9c-57b6-4eb3-9552-5ac2ba8a4d62 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:29.858805 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d53afa9c-57b6-4eb3-9552-5ac2ba8a4d62 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:29.859284 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d53afa9c-57b6-4eb3-9552-5ac2ba8a4d62 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:29.860083 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d53afa9c-57b6-4eb3-9552-5ac2ba8a4d62 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:29.860750 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d53afa9c-57b6-4eb3-9552-5ac2ba8a4d62 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:30.105532 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d53afa9c-57b6-4eb3-9552-5ac2ba8a4d62 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:30.116626 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d53afa9c-57b6-4eb3-9552-5ac2ba8a4d62 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.286095 Jun 20 12:09:30.131488 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1345/2675] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:29 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:30.136556 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9b7a3d44-e0f7-4316-8847-89b9b15eb448 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:30.137373 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9b7a3d44-e0f7-4316-8847-89b9b15eb448 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:30.145660 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b7a3d44-e0f7-4316-8847-89b9b15eb448 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:30.146649 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b7a3d44-e0f7-4316-8847-89b9b15eb448 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:30.148435 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b7a3d44-e0f7-4316-8847-89b9b15eb448 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:30.150444 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b7a3d44-e0f7-4316-8847-89b9b15eb448 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:30.566264 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9b7a3d44-e0f7-4316-8847-89b9b15eb448 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:30.579290 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9b7a3d44-e0f7-4316-8847-89b9b15eb448 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1542 microversion: 2.1 time: 0.446512 Jun 20 12:09:30.580374 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1346/2676] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:30 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1542 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:30.596870 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-992c6baf-1ff6-42ab-85f9-89258dc93f76 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:30.603932 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-992c6baf-1ff6-42ab-85f9-89258dc93f76 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:30.617792 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-992c6baf-1ff6-42ab-85f9-89258dc93f76 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:30.623580 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-992c6baf-1ff6-42ab-85f9-89258dc93f76 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:30.624954 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-992c6baf-1ff6-42ab-85f9-89258dc93f76 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:30.625656 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-992c6baf-1ff6-42ab-85f9-89258dc93f76 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:30.881569 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-992c6baf-1ff6-42ab-85f9-89258dc93f76 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:30.891680 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-992c6baf-1ff6-42ab-85f9-89258dc93f76 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.304053 Jun 20 12:09:30.893552 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1347/2677] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:30 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:30.909478 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4d6c7a5d-e431-43c1-9673-cb2902ff9d7c tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:30.913897 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4d6c7a5d-e431-43c1-9673-cb2902ff9d7c tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:30.932170 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d6c7a5d-e431-43c1-9673-cb2902ff9d7c tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:30.932965 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d6c7a5d-e431-43c1-9673-cb2902ff9d7c tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:30.934017 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d6c7a5d-e431-43c1-9673-cb2902ff9d7c tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:30.934719 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d6c7a5d-e431-43c1-9673-cb2902ff9d7c tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:31.256250 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4d6c7a5d-e431-43c1-9673-cb2902ff9d7c tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:31.265758 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4d6c7a5d-e431-43c1-9673-cb2902ff9d7c tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41" status: 200 len: 1514 microversion: 2.1 time: 0.360080 Jun 20 12:09:31.277575 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1348/2678] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:30 2022] GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 => generated 1514 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:31.279773 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e34ee6a3-de57-4f71-bc7c-980e82114211 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:31.282600 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e34ee6a3-de57-4f71-bc7c-980e82114211 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 31066575-9374-412f-9c63-ad5162254777] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:31.293593 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e34ee6a3-de57-4f71-bc7c-980e82114211 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:31.298564 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e34ee6a3-de57-4f71-bc7c-980e82114211 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:31.299573 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e34ee6a3-de57-4f71-bc7c-980e82114211 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:31.304922 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e34ee6a3-de57-4f71-bc7c-980e82114211 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:31.333734 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-e34ee6a3-de57-4f71-bc7c-980e82114211 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] HTTP exception thrown: Instance 31066575-9374-412f-9c63-ad5162254777 could not be found. Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e34ee6a3-de57-4f71-bc7c-980e82114211 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Request method failure captured: Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 HTTP/1.1 Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGGzCfL3w9tcOc55Z9r7EAcHfRRDk3bQtKtjdiI4-k6OZuJCYCgky5sbUbqDZyZL8PkMcjpkShji-aUUeYfT0SA-paoO5QqkaTFkjb1PA6i-RS0Rbrk81uT7XEx2EIIrvJsmj0tkkpgaIWirbQfGY_cm3GD4V1mQEGUSMZ1-Z-TaEuM Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 5cf9c3f1d5c64a75b49099a15fe087ee Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-LiveMigrationTest-1776374292 Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5cf9c3f1d5c64a75b49099a15fe087ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5cf9c3f1d5c64a75b49099a15fe087ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5cf9c3f1d5c64a75b49099a15fe087ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5cf9c3f1d5c64a75b49099a15fe087ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-LiveMigrationTest-1776374292 Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 5cf9c3f1d5c64a75b49099a15fe087ee Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-LiveMigrationTest-1776374292 Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-LiveMigrationTest-1776374292-project Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 3f16b216588946a790b42450b795ee00 Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-LiveMigrationTest-1776374292-project Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 31066575-9374-412f-9c63-ad5162254777 could not be found. Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '31066575-9374-412f-9c63-ad5162254777'} Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31066575-9374-412f-9c63-ad5162254777 could not be found. Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31066575-9374-412f-9c63-ad5162254777 could not be found. Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:31.336961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:31.341197 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:31.341197 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:31.341197 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:31.341197 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:09:31.341197 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:09:31.341197 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31066575-9374-412f-9c63-ad5162254777 could not be found. Jun 20 12:09:31.341197 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:31.341197 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e34ee6a3-de57-4f71-bc7c-980e82114211 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Returning 404 to user: Instance 31066575-9374-412f-9c63-ad5162254777 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:09:31.341197 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e34ee6a3-de57-4f71-bc7c-980e82114211 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777" status: 404 len: 111 microversion: 2.1 time: 0.068631 Jun 20 12:09:31.345831 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1349/2679] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:31 2022] GET /compute/v2.1/servers/31066575-9374-412f-9c63-ad5162254777 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:09:31.356844 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-eaffca8f-fc36-4885-82e9-9c3d3c3ed0d8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:31.359745 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-eaffca8f-fc36-4885-82e9-9c3d3c3ed0d8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: a9c34f5d-358a-4724-9bc6-73dc9c71951b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:31.371585 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-eaffca8f-fc36-4885-82e9-9c3d3c3ed0d8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] HTTP exception thrown: Instance a9c34f5d-358a-4724-9bc6-73dc9c71951b could not be found. Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-eaffca8f-fc36-4885-82e9-9c3d3c3ed0d8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers/a9c34f5d-358a-4724-9bc6-73dc9c71951b/action HTTP/1.1 Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 28 Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: {"reboot": {"type": "SOFT"}} Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: exception: Instance a9c34f5d-358a-4724-9bc6-73dc9c71951b could not be found. Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'a9c34f5d-358a-4724-9bc6-73dc9c71951b', 'body': {'reboot': {'type': 'SOFT'}}} Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9c34f5d-358a-4724-9bc6-73dc9c71951b could not be found. Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9c34f5d-358a-4724-9bc6-73dc9c71951b could not be found. Jun 20 12:09:31.373606 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:31.378500 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:31.378500 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:31.378500 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:31.378500 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:31.378500 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:31.378500 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:09:31.378500 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:09:31.378500 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9c34f5d-358a-4724-9bc6-73dc9c71951b could not be found. Jun 20 12:09:31.378500 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:31.380935 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-eaffca8f-fc36-4885-82e9-9c3d3c3ed0d8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 404 to user: Instance a9c34f5d-358a-4724-9bc6-73dc9c71951b could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:09:31.383651 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-eaffca8f-fc36-4885-82e9-9c3d3c3ed0d8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers/a9c34f5d-358a-4724-9bc6-73dc9c71951b/action" status: 404 len: 111 microversion: 2.1 time: 0.035199 Jun 20 12:09:31.387827 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1350/2680] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:09:31 2022] POST /compute/v2.1/servers/a9c34f5d-358a-4724-9bc6-73dc9c71951b/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:09:31.390615 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-39104cbe-9993-4b1d-9497-d60ca819575c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:09:31.391438 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-39104cbe-9993-4b1d-9497-d60ca819575c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:09:31.391981 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-39104cbe-9993-4b1d-9497-d60ca819575c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:09:31.392427 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-39104cbe-9993-4b1d-9497-d60ca819575c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:09:31.392887 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-39104cbe-9993-4b1d-9497-d60ca819575c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:09:31.394754 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ed0043bb-fadf-46b1-8853-7a1972fa391e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '.version_select at 0x7f60736f3700>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:31.415398 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-39104cbe-9993-4b1d-9497-d60ca819575c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:31.417728 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-39104cbe-9993-4b1d-9497-d60ca819575c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:31.421280 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-39104cbe-9993-4b1d-9497-d60ca819575c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:31.423223 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-39104cbe-9993-4b1d-9497-d60ca819575c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:31.428377 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ed0043bb-fadf-46b1-8853-7a1972fa391e tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-483441270" status: 202 len: 0 microversion: 2.1 time: 0.038995 Jun 20 12:09:31.429597 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1351/2681] 10.222.0.27 () {58 vars in 1217 bytes} [Mon Jun 20 12:09:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-483441270 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:09:31.443859 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-42f7a520-7f8c-4322-9f17-e86b7413b459 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:31.447454 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-42f7a520-7f8c-4322-9f17-e86b7413b459 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:31.463339 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-42f7a520-7f8c-4322-9f17-e86b7413b459 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:31.464107 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-42f7a520-7f8c-4322-9f17-e86b7413b459 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:31.465145 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-42f7a520-7f8c-4322-9f17-e86b7413b459 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:31.465756 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-42f7a520-7f8c-4322-9f17-e86b7413b459 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:31.495053 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-39104cbe-9993-4b1d-9497-d60ca819575c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Getting quotas for project 4880e508de374c748670ce9ff5963336. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:09:31.505619 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-39104cbe-9993-4b1d-9497-d60ca819575c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Getting quotas for user 16367ef663a74bd49162b82a7e661d1e and project 4880e508de374c748670ce9ff5963336. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:09:31.550482 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-39104cbe-9993-4b1d-9497-d60ca819575c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:09:31.556058 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-39104cbe-9993-4b1d-9497-d60ca819575c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: f6bb3154-9ddf-428c-82cd-74ab476e5a0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:09:31.673247 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-39104cbe-9993-4b1d-9497-d60ca819575c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.326937 Jun 20 12:09:31.674327 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1331/2682] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:09:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2331 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:09:31.716997 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9e647df4-7c49-4d64-b46e-fd8808a3eda5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:31.720187 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9e647df4-7c49-4d64-b46e-fd8808a3eda5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:31.725638 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-42f7a520-7f8c-4322-9f17-e86b7413b459 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:31.747086 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-42f7a520-7f8c-4322-9f17-e86b7413b459 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.315521 Jun 20 12:09:31.751345 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1352/2683] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:31 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:31.774380 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9e647df4-7c49-4d64-b46e-fd8808a3eda5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:31.774941 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9e647df4-7c49-4d64-b46e-fd8808a3eda5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:31.776773 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9e647df4-7c49-4d64-b46e-fd8808a3eda5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:31.777396 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b3fb95de-e940-4fea-8cc4-7c1c8f863aab tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:31.778813 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9e647df4-7c49-4d64-b46e-fd8808a3eda5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:31.779759 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b3fb95de-e940-4fea-8cc4-7c1c8f863aab tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: f6bb3154-9ddf-428c-82cd-74ab476e5a0a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:31.974043 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b3fb95de-e940-4fea-8cc4-7c1c8f863aab tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:31.999162 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b3fb95de-e940-4fea-8cc4-7c1c8f863aab tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a" status: 200 len: 1225 microversion: 2.1 time: 0.245880 Jun 20 12:09:32.017991 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1353/2684] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:31 2022] GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a => generated 1225 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:32.027472 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-eb97351a-a12d-4ea2-bc1d-5196633fcb6d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:32.044406 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-eb97351a-a12d-4ea2-bc1d-5196633fcb6d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:32.072808 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb97351a-a12d-4ea2-bc1d-5196633fcb6d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:32.078510 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb97351a-a12d-4ea2-bc1d-5196633fcb6d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:32.078510 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb97351a-a12d-4ea2-bc1d-5196633fcb6d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:32.087740 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb97351a-a12d-4ea2-bc1d-5196633fcb6d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:32.665009 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9e647df4-7c49-4d64-b46e-fd8808a3eda5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:32.679174 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9e647df4-7c49-4d64-b46e-fd8808a3eda5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1542 microversion: 2.1 time: 1.001340 Jun 20 12:09:32.681187 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1332/2685] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:31 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1542 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:32.699650 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-eb97351a-a12d-4ea2-bc1d-5196633fcb6d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:32.700320 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2aaedd96-74d0-4b8a-852f-8d984f40e61b tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:32.701185 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2aaedd96-74d0-4b8a-852f-8d984f40e61b tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:32.714079 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-eb97351a-a12d-4ea2-bc1d-5196633fcb6d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.693669 Jun 20 12:09:32.718095 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2aaedd96-74d0-4b8a-852f-8d984f40e61b tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:32.718398 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2aaedd96-74d0-4b8a-852f-8d984f40e61b tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:32.719373 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1354/2686] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:32 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:32.720403 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2aaedd96-74d0-4b8a-852f-8d984f40e61b tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:32.721200 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2aaedd96-74d0-4b8a-852f-8d984f40e61b tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:32.738089 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0627e06c-69fb-4afb-ac33-5ce45eef1521 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:32.745098 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0627e06c-69fb-4afb-ac33-5ce45eef1521 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:32.757713 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0627e06c-69fb-4afb-ac33-5ce45eef1521 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:32.758411 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0627e06c-69fb-4afb-ac33-5ce45eef1521 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:32.759448 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0627e06c-69fb-4afb-ac33-5ce45eef1521 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:32.760723 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0627e06c-69fb-4afb-ac33-5ce45eef1521 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:32.799959 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-0627e06c-69fb-4afb-ac33-5ce45eef1521 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] HTTP exception thrown: Instance 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 could not be found. Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0627e06c-69fb-4afb-ac33-5ce45eef1521 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6/action HTTP/1.1 Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 65 Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: {"rebuild": {"imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83"}} Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 could not be found. Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6', 'body': {'rebuild': {'imageRef': 'f16836cc-4e18-4bd0-b261-3865adf8cb83'}}} Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 could not be found. Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jun 20 12:09:32.805971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jun 20 12:09:32.811003 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 20 12:09:32.811003 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:09:32.811003 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:09:32.811003 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:09:32.811003 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:09:32.811003 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 could not be found. Jun 20 12:09:32.811003 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:32.811003 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:32.811003 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:32.811003 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:32.811003 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:32.811003 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:32.811003 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:09:32.811003 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:09:32.811003 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 could not be found. Jun 20 12:09:32.811003 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:32.811003 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0627e06c-69fb-4afb-ac33-5ce45eef1521 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 404 to user: Instance 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:09:32.812092 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0627e06c-69fb-4afb-ac33-5ce45eef1521 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6/action" status: 404 len: 111 microversion: 2.1 time: 0.080050 Jun 20 12:09:32.815594 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1355/2687] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:09:32 2022] POST /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6/action => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:09:32.827063 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7d060e06-7e99-433b-9d12-df0a1e01b6ea tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:32.835362 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7d060e06-7e99-433b-9d12-df0a1e01b6ea tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:32.842022 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7d060e06-7e99-433b-9d12-df0a1e01b6ea tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:32.845243 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7d060e06-7e99-433b-9d12-df0a1e01b6ea tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:32.846520 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7d060e06-7e99-433b-9d12-df0a1e01b6ea tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:32.847032 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7d060e06-7e99-433b-9d12-df0a1e01b6ea tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:32.873722 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:33.342177 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7d060e06-7e99-433b-9d12-df0a1e01b6ea tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:33.355639 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7d060e06-7e99-433b-9d12-df0a1e01b6ea tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.537240 Jun 20 12:09:33.358682 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1356/2688] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:32 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:33.390552 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-82e8e7a7-8473-4ee7-8988-bd4fe239f831 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:33.391683 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-82e8e7a7-8473-4ee7-8988-bd4fe239f831 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: f6bb3154-9ddf-428c-82cd-74ab476e5a0a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:33.410034 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-82e8e7a7-8473-4ee7-8988-bd4fe239f831 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:33.413399 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-82e8e7a7-8473-4ee7-8988-bd4fe239f831 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:33.417198 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-82e8e7a7-8473-4ee7-8988-bd4fe239f831 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:33.417865 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-82e8e7a7-8473-4ee7-8988-bd4fe239f831 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:34.201747 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2aaedd96-74d0-4b8a-852f-8d984f40e61b tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:34.211723 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2aaedd96-74d0-4b8a-852f-8d984f40e61b tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41" status: 200 len: 1514 microversion: 2.1 time: 1.526271 Jun 20 12:09:34.216399 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1333/2689] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:32 2022] GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 => generated 1514 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:34.221533 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-31f35b48-71c5-4ad4-a422-9fb435a51c9d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:34.222167 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-31f35b48-71c5-4ad4-a422-9fb435a51c9d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:34.250357 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-31f35b48-71c5-4ad4-a422-9fb435a51c9d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:34.250959 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-31f35b48-71c5-4ad4-a422-9fb435a51c9d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:34.251858 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-31f35b48-71c5-4ad4-a422-9fb435a51c9d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:34.252462 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-31f35b48-71c5-4ad4-a422-9fb435a51c9d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:34.369814 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-82e8e7a7-8473-4ee7-8988-bd4fe239f831 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:34.379252 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-82e8e7a7-8473-4ee7-8988-bd4fe239f831 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a" status: 200 len: 1285 microversion: 2.1 time: 1.018598 Jun 20 12:09:34.380659 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1357/2690] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:33 2022] GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a => generated 1285 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:34.409317 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-86afc13b-df51-4996-8579-1237c057b8e5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:34.410110 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-86afc13b-df51-4996-8579-1237c057b8e5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:34.424523 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86afc13b-df51-4996-8579-1237c057b8e5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:34.428936 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86afc13b-df51-4996-8579-1237c057b8e5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:34.429895 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86afc13b-df51-4996-8579-1237c057b8e5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:34.436574 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86afc13b-df51-4996-8579-1237c057b8e5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:34.870707 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-31f35b48-71c5-4ad4-a422-9fb435a51c9d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:34.884046 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-31f35b48-71c5-4ad4-a422-9fb435a51c9d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.666311 Jun 20 12:09:34.885119 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1334/2691] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:34 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:34.899956 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-86afc13b-df51-4996-8579-1237c057b8e5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:34.911162 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-86afc13b-df51-4996-8579-1237c057b8e5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1542 microversion: 2.1 time: 0.528563 Jun 20 12:09:34.917180 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1358/2692] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:34 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1542 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:34.933048 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e2b96f0a-56f9-424c-98cb-98de27df375b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:34.933482 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e2b96f0a-56f9-424c-98cb-98de27df375b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: d348abab-aae7-4b81-84db-f856c9cf4907] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:34.959668 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:34.966172 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2b96f0a-56f9-424c-98cb-98de27df375b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:34.966627 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2b96f0a-56f9-424c-98cb-98de27df375b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:34.969445 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2b96f0a-56f9-424c-98cb-98de27df375b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:34.974455 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2b96f0a-56f9-424c-98cb-98de27df375b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:34.985291 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-61b9c8df-eee4-4521-b609-5fea5121ac31 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-368373975", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "83932c23-e75a-4658-90bb-e1c86611b7d3"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:35.026905 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e2b96f0a-56f9-424c-98cb-98de27df375b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: d348abab-aae7-4b81-84db-f856c9cf4907] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:09:35.102384 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-61b9c8df-eee4-4521-b609-5fea5121ac31 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] validate_networks() for [('83932c23-e75a-4658-90bb-e1c86611b7d3', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:09:35.245295 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e2b96f0a-56f9-424c-98cb-98de27df375b tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907" status: 204 len: 0 microversion: 2.1 time: 0.319360 Jun 20 12:09:35.246696 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1359/2693] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:09:34 2022] DELETE /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:09:35.255685 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8304657c-e6e4-4bc8-8088-70c2fe355f0e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:35.258078 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8304657c-e6e4-4bc8-8088-70c2fe355f0e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: c5801208-14d0-4189-9110-25683853ee55] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:35.265429 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-8304657c-e6e4-4bc8-8088-70c2fe355f0e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] HTTP exception thrown: Instance c5801208-14d0-4189-9110-25683853ee55 could not be found. Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8304657c-e6e4-4bc8-8088-70c2fe355f0e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers/c5801208-14d0-4189-9110-25683853ee55/action HTTP/1.1 Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 65 Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: {"rebuild": {"imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83"}} Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: exception: Instance c5801208-14d0-4189-9110-25683853ee55 could not be found. Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'c5801208-14d0-4189-9110-25683853ee55', 'body': {'rebuild': {'imageRef': 'f16836cc-4e18-4bd0-b261-3865adf8cb83'}}} Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5801208-14d0-4189-9110-25683853ee55 could not be found. Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 20 12:09:35.270468 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:09:35.276888 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:09:35.276888 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:09:35.276888 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:09:35.276888 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5801208-14d0-4189-9110-25683853ee55 could not be found. Jun 20 12:09:35.276888 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:35.276888 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:35.276888 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:35.276888 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:35.276888 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:35.276888 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:35.276888 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:09:35.276888 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:09:35.276888 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5801208-14d0-4189-9110-25683853ee55 could not be found. Jun 20 12:09:35.276888 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:35.279299 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8304657c-e6e4-4bc8-8088-70c2fe355f0e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 404 to user: Instance c5801208-14d0-4189-9110-25683853ee55 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:09:35.280828 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8304657c-e6e4-4bc8-8088-70c2fe355f0e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers/c5801208-14d0-4189-9110-25683853ee55/action" status: 404 len: 111 microversion: 2.1 time: 0.032167 Jun 20 12:09:35.282276 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1360/2694] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:09:35 2022] POST /compute/v2.1/servers/c5801208-14d0-4189-9110-25683853ee55/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:09:35.290120 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e577f58a-0055-43b5-a03d-c3fc5d402a8e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:35.292967 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e577f58a-0055-43b5-a03d-c3fc5d402a8e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:35.309996 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e577f58a-0055-43b5-a03d-c3fc5d402a8e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:35.311614 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e577f58a-0055-43b5-a03d-c3fc5d402a8e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:35.316079 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e577f58a-0055-43b5-a03d-c3fc5d402a8e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:35.317013 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e577f58a-0055-43b5-a03d-c3fc5d402a8e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:35.855657 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e577f58a-0055-43b5-a03d-c3fc5d402a8e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:35.863952 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e577f58a-0055-43b5-a03d-c3fc5d402a8e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41" status: 200 len: 1514 microversion: 2.1 time: 0.580230 Jun 20 12:09:35.875653 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1361/2695] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:35 2022] GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 => generated 1514 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:35.882153 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e11a33db-1800-47d9-afa5-6ff2858b76ea tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:35.883092 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e11a33db-1800-47d9-afa5-6ff2858b76ea tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: d348abab-aae7-4b81-84db-f856c9cf4907] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:35.891253 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e11a33db-1800-47d9-afa5-6ff2858b76ea tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:35.891967 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e11a33db-1800-47d9-afa5-6ff2858b76ea tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:35.893016 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e11a33db-1800-47d9-afa5-6ff2858b76ea tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:35.893667 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e11a33db-1800-47d9-afa5-6ff2858b76ea tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:36.123335 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-61b9c8df-eee4-4521-b609-5fea5121ac31 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:09:36.125164 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-61b9c8df-eee4-4521-b609-5fea5121ac31 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:09:36.125940 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-61b9c8df-eee4-4521-b609-5fea5121ac31 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:09:36.126501 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-61b9c8df-eee4-4521-b609-5fea5121ac31 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:09:36.127297 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-61b9c8df-eee4-4521-b609-5fea5121ac31 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:09:36.158066 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-61b9c8df-eee4-4521-b609-5fea5121ac31 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:36.158948 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-61b9c8df-eee4-4521-b609-5fea5121ac31 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:36.167222 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-61b9c8df-eee4-4521-b609-5fea5121ac31 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:36.168829 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-61b9c8df-eee4-4521-b609-5fea5121ac31 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:36.238945 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-61b9c8df-eee4-4521-b609-5fea5121ac31 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Getting quotas for project 02e01ab560b24342983dc342c5235c03. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:09:36.253469 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-61b9c8df-eee4-4521-b609-5fea5121ac31 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Getting quotas for user 815408121fd94cc8897776382656d198 and project 02e01ab560b24342983dc342c5235c03. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:09:36.288062 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-61b9c8df-eee4-4521-b609-5fea5121ac31 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:09:36.290712 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-61b9c8df-eee4-4521-b609-5fea5121ac31 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] [instance: 85c5ef58-2d37-49d6-8bf8-dded3d45965a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:09:36.353809 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:36.392524 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-61b9c8df-eee4-4521-b609-5fea5121ac31 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.505286 Jun 20 12:09:36.393982 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1335/2696] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:09:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:09:36.400243 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-104dd043-b5b6-46da-a117-480ce50883da tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:36.401286 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-104dd043-b5b6-46da-a117-480ce50883da tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:36.411825 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-104dd043-b5b6-46da-a117-480ce50883da tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:36.414667 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-104dd043-b5b6-46da-a117-480ce50883da tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:36.417483 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-104dd043-b5b6-46da-a117-480ce50883da tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:36.418787 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-104dd043-b5b6-46da-a117-480ce50883da tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:37.355027 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-104dd043-b5b6-46da-a117-480ce50883da tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:37.378434 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-104dd043-b5b6-46da-a117-480ce50883da tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.974634 Jun 20 12:09:37.384880 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1336/2697] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:36 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:37.400539 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4ddcd0ba-3827-415e-9a78-bef6a9edc25f tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:37.405002 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4ddcd0ba-3827-415e-9a78-bef6a9edc25f tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: f6bb3154-9ddf-428c-82cd-74ab476e5a0a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:37.427057 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ddcd0ba-3827-415e-9a78-bef6a9edc25f tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:37.434228 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ddcd0ba-3827-415e-9a78-bef6a9edc25f tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:37.436476 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ddcd0ba-3827-415e-9a78-bef6a9edc25f tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:37.439749 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e11a33db-1800-47d9-afa5-6ff2858b76ea tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:37.440469 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ddcd0ba-3827-415e-9a78-bef6a9edc25f tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:37.454212 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e11a33db-1800-47d9-afa5-6ff2858b76ea tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907" status: 200 len: 1483 microversion: 2.1 time: 1.574661 Jun 20 12:09:37.456657 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1362/2698] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:35 2022] GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907 => generated 1483 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:37.483350 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ca50d408-6d21-43ed-9442-30219bd33d09 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:37.486245 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ca50d408-6d21-43ed-9442-30219bd33d09 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:37.502425 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ca50d408-6d21-43ed-9442-30219bd33d09 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:37.503196 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ca50d408-6d21-43ed-9442-30219bd33d09 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:37.504153 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ca50d408-6d21-43ed-9442-30219bd33d09 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:37.504926 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ca50d408-6d21-43ed-9442-30219bd33d09 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:38.139627 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ca50d408-6d21-43ed-9442-30219bd33d09 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:38.151958 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ca50d408-6d21-43ed-9442-30219bd33d09 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1541 microversion: 2.1 time: 0.691011 Jun 20 12:09:38.152933 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1363/2699] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:37 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1541 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:38.167832 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b79600a5-f133-4834-a656-d48fccc9667d tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:38.168924 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b79600a5-f133-4834-a656-d48fccc9667d tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] [instance: 85c5ef58-2d37-49d6-8bf8-dded3d45965a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:38.187585 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b79600a5-f133-4834-a656-d48fccc9667d tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:38.188450 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b79600a5-f133-4834-a656-d48fccc9667d tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:38.189512 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b79600a5-f133-4834-a656-d48fccc9667d tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:38.190186 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b79600a5-f133-4834-a656-d48fccc9667d tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:38.451890 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4ddcd0ba-3827-415e-9a78-bef6a9edc25f tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:38.466885 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4ddcd0ba-3827-415e-9a78-bef6a9edc25f tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a" status: 200 len: 1325 microversion: 2.1 time: 1.080442 Jun 20 12:09:38.484949 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1337/2700] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:37 2022] GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a => generated 1325 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:38.508260 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a1983c20-74dc-41e3-909a-38349aaeb354 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:38.514419 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a1983c20-74dc-41e3-909a-38349aaeb354 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:38.531318 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a1983c20-74dc-41e3-909a-38349aaeb354 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:38.532744 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a1983c20-74dc-41e3-909a-38349aaeb354 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:38.537608 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a1983c20-74dc-41e3-909a-38349aaeb354 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:38.540900 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a1983c20-74dc-41e3-909a-38349aaeb354 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:38.617062 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b79600a5-f133-4834-a656-d48fccc9667d tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815408121fd94cc8897776382656d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e01ab560b24342983dc342c5235c03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:38.634117 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b79600a5-f133-4834-a656-d48fccc9667d tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] 10.222.0.27 "GET /compute/v2.1/servers/85c5ef58-2d37-49d6-8bf8-dded3d45965a" status: 200 len: 1276 microversion: 2.1 time: 0.479555 Jun 20 12:09:38.638150 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1364/2701] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:38 2022] GET /compute/v2.1/servers/85c5ef58-2d37-49d6-8bf8-dded3d45965a => generated 1276 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:38.643641 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c724cfad-d39e-4a34-b191-f7165930248e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:38.655518 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c724cfad-d39e-4a34-b191-f7165930248e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:38.674468 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c724cfad-d39e-4a34-b191-f7165930248e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:38.675113 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c724cfad-d39e-4a34-b191-f7165930248e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:38.683509 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c724cfad-d39e-4a34-b191-f7165930248e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:38.683969 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c724cfad-d39e-4a34-b191-f7165930248e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:39.009667 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a1983c20-74dc-41e3-909a-38349aaeb354 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:39.030162 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a1983c20-74dc-41e3-909a-38349aaeb354 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41" status: 200 len: 1514 microversion: 2.1 time: 0.543705 Jun 20 12:09:39.031869 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1338/2702] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:38 2022] GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 => generated 1514 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:39.051962 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-95d29e5c-4dce-4f92-a073-0293d3b57c2a req-c8c18ed3-8afb-4896-a845-925c12395a67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8b3d285-0f08-4deb-859e-babab7f3b656", "name": "network-vif-unplugged", "status": "completed", "tag": "e23efb88-f8d5-4db8-8321-1c16dca584be"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:39.073590 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-95d29e5c-4dce-4f92-a073-0293d3b57c2a req-c8c18ed3-8afb-4896-a845-925c12395a67 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:39.075772 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-95d29e5c-4dce-4f92-a073-0293d3b57c2a req-c8c18ed3-8afb-4896-a845-925c12395a67 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:39.100600 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c724cfad-d39e-4a34-b191-f7165930248e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:39.107257 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-95d29e5c-4dce-4f92-a073-0293d3b57c2a req-c8c18ed3-8afb-4896-a845-925c12395a67 service nova] Creating event network-vif-unplugged:e23efb88-f8d5-4db8-8321-1c16dca584be for instance f8b3d285-0f08-4deb-859e-babab7f3b656 on n-h2-master-1 Jun 20 12:09:39.115601 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c724cfad-d39e-4a34-b191-f7165930248e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.471036 Jun 20 12:09:39.116637 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1365/2703] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:38 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:39.127554 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [req-95d29e5c-4dce-4f92-a073-0293d3b57c2a req-c8c18ed3-8afb-4896-a845-925c12395a67 service nova] Instance f8b3d285-0f08-4deb-859e-babab7f3b656 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1'} {{(pid=119128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:09:39.142137 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-68196f6e-a287-42bf-ab3e-e9cde4817e3b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Action: 'create', calling method: .version_select at 0x7f60733ba9d0>, body: {"keypair": {"name": "tempest-keypair-1188036854", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8se1W2mr/QEa7zZqUhQwy72Iuky2rIX1vnZN4butCCD4GcWH6wZ0RTRqpO1ntB5AGXqMe8atb4HBK4dDT9WbZ8opwfpfEIxNuLseTti9g90j3+F7Ch/hIBc9+gYl7wDQ=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:39.148133 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-95d29e5c-4dce-4f92-a073-0293d3b57c2a req-c8c18ed3-8afb-4896-a845-925c12395a67 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113638 Jun 20 12:09:39.150124 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1339/2704] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:09:39.166457 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-ae97e3c5-8462-42b5-a198-75d6fa468ef4 req-efb3d918-be94-40c5-ab18-d1d89f3fac6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d348abab-aae7-4b81-84db-f856c9cf4907", "name": "network-vif-deleted", "tag": "adf99a3e-442f-4468-a4d4-3b83b4155c6c"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:39.181940 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-68196f6e-a287-42bf-ab3e-e9cde4817e3b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Getting quotas for project 82fb9d01363f47cb9b0e019ad014de68. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:09:39.190959 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-ae97e3c5-8462-42b5-a198-75d6fa468ef4 req-efb3d918-be94-40c5-ab18-d1d89f3fac6a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:39.192164 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-ae97e3c5-8462-42b5-a198-75d6fa468ef4 req-efb3d918-be94-40c5-ab18-d1d89f3fac6a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:39.193225 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-68196f6e-a287-42bf-ab3e-e9cde4817e3b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Getting quotas for user 76416b44294f4adb8320be6c3032cf35 and project 82fb9d01363f47cb9b0e019ad014de68. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:09:39.225311 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-ae97e3c5-8462-42b5-a198-75d6fa468ef4 req-efb3d918-be94-40c5-ab18-d1d89f3fac6a service nova] Creating event network-vif-deleted:adf99a3e-442f-4468-a4d4-3b83b4155c6c for instance d348abab-aae7-4b81-84db-f856c9cf4907 on n-h1-master-1 Jun 20 12:09:39.238550 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-ae97e3c5-8462-42b5-a198-75d6fa468ef4 req-efb3d918-be94-40c5-ab18-d1d89f3fac6a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084927 Jun 20 12:09:39.243868 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1340/2705] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:09:39.254424 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-01eb0a1e-c4d7-482a-aa6f-6b9d134b18ed tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:39.265473 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-01eb0a1e-c4d7-482a-aa6f-6b9d134b18ed tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: d348abab-aae7-4b81-84db-f856c9cf4907] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:39.278006 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-68196f6e-a287-42bf-ab3e-e9cde4817e3b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.148360 Jun 20 12:09:39.283902 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1366/2706] 10.222.0.27 () {62 vars in 1199 bytes} [Mon Jun 20 12:09:39 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 150 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 20 12:09:39.293025 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-85c1af22-e977-4736-9ab9-2ff9cf1c3b25 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:39.293590 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-85c1af22-e977-4736-9ab9-2ff9cf1c3b25 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 0de3f1a8-2ce7-4a69-b05b-6c605878330a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:39.294637 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-01eb0a1e-c4d7-482a-aa6f-6b9d134b18ed tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:39.296555 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-01eb0a1e-c4d7-482a-aa6f-6b9d134b18ed tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:39.297545 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-01eb0a1e-c4d7-482a-aa6f-6b9d134b18ed tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:39.298987 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-01eb0a1e-c4d7-482a-aa6f-6b9d134b18ed tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:39.310364 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-85c1af22-e977-4736-9ab9-2ff9cf1c3b25 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] HTTP exception thrown: Instance 0de3f1a8-2ce7-4a69-b05b-6c605878330a could not be found. Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-85c1af22-e977-4736-9ab9-2ff9cf1c3b25 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers/0de3f1a8-2ce7-4a69-b05b-6c605878330a/action HTTP/1.1 Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 15 Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: {"restore": {}} Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 0de3f1a8-2ce7-4a69-b05b-6c605878330a could not be found. Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '0de3f1a8-2ce7-4a69-b05b-6c605878330a', 'body': {'restore': {}}} Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0de3f1a8-2ce7-4a69-b05b-6c605878330a could not be found. Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0de3f1a8-2ce7-4a69-b05b-6c605878330a could not be found. Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:39.319926 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:39.326346 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:09:39.326346 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:09:39.326346 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0de3f1a8-2ce7-4a69-b05b-6c605878330a could not be found. Jun 20 12:09:39.326346 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:39.332119 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-85c1af22-e977-4736-9ab9-2ff9cf1c3b25 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 404 to user: Instance 0de3f1a8-2ce7-4a69-b05b-6c605878330a could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:09:39.333867 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-85c1af22-e977-4736-9ab9-2ff9cf1c3b25 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers/0de3f1a8-2ce7-4a69-b05b-6c605878330a/action" status: 404 len: 111 microversion: 2.1 time: 0.053570 Jun 20 12:09:39.334682 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1367/2707] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:09:39 2022] POST /compute/v2.1/servers/0de3f1a8-2ce7-4a69-b05b-6c605878330a/action => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:09:39.353881 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-66c21ab0-fb08-45d8-aece-0affdc1a2470 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:39.355536 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-66c21ab0-fb08-45d8-aece-0affdc1a2470 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:39.373977 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66c21ab0-fb08-45d8-aece-0affdc1a2470 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:39.374885 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-01eb0a1e-c4d7-482a-aa6f-6b9d134b18ed tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] HTTP exception thrown: Instance d348abab-aae7-4b81-84db-f856c9cf4907 could not be found. Jun 20 12:09:39.375105 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66c21ab0-fb08-45d8-aece-0affdc1a2470 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:39.376095 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66c21ab0-fb08-45d8-aece-0affdc1a2470 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:39.376725 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66c21ab0-fb08-45d8-aece-0affdc1a2470 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-01eb0a1e-c4d7-482a-aa6f-6b9d134b18ed tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Request method failure captured: Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907 HTTP/1.1 Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGGzCfL3w9tcOc55Z9r7EAcHfRRDk3bQtKtjdiI4-k6OZuJCYCgky5sbUbqDZyZL8PkMcjpkShji-aUUeYfT0SA-paoO5QqkaTFkjb1PA6i-RS0Rbrk81uT7XEx2EIIrvJsmj0tkkpgaIWirbQfGY_cm3GD4V1mQEGUSMZ1-Z-TaEuM Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 5cf9c3f1d5c64a75b49099a15fe087ee Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-LiveMigrationTest-1776374292 Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5cf9c3f1d5c64a75b49099a15fe087ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5cf9c3f1d5c64a75b49099a15fe087ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5cf9c3f1d5c64a75b49099a15fe087ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5cf9c3f1d5c64a75b49099a15fe087ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-LiveMigrationTest-1776374292 Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 5cf9c3f1d5c64a75b49099a15fe087ee Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-LiveMigrationTest-1776374292 Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-LiveMigrationTest-1776374292-project Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 3f16b216588946a790b42450b795ee00 Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-LiveMigrationTest-1776374292-project Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: exception: Instance d348abab-aae7-4b81-84db-f856c9cf4907 could not be found. Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'd348abab-aae7-4b81-84db-f856c9cf4907'} Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d348abab-aae7-4b81-84db-f856c9cf4907 could not be found. Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d348abab-aae7-4b81-84db-f856c9cf4907 could not be found. Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:39.381159 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:39.386185 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:39.386185 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:39.386185 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:39.386185 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:09:39.386185 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:09:39.386185 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d348abab-aae7-4b81-84db-f856c9cf4907 could not be found. Jun 20 12:09:39.386185 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:39.391172 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-01eb0a1e-c4d7-482a-aa6f-6b9d134b18ed tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Returning 404 to user: Instance d348abab-aae7-4b81-84db-f856c9cf4907 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:09:39.399616 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-01eb0a1e-c4d7-482a-aa6f-6b9d134b18ed tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907" status: 404 len: 111 microversion: 2.1 time: 0.151441 Jun 20 12:09:39.408761 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1341/2708] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:39 2022] GET /compute/v2.1/servers/d348abab-aae7-4b81-84db-f856c9cf4907 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:09:39.422294 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-71faf5f2-2628-47c4-9f99-809f9b52eaee tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:39.423049 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-71faf5f2-2628-47c4-9f99-809f9b52eaee tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:39.444225 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-71faf5f2-2628-47c4-9f99-809f9b52eaee tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:39.445094 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-71faf5f2-2628-47c4-9f99-809f9b52eaee tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:39.448147 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-71faf5f2-2628-47c4-9f99-809f9b52eaee tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:39.449424 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-71faf5f2-2628-47c4-9f99-809f9b52eaee tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:39.761425 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-71faf5f2-2628-47c4-9f99-809f9b52eaee tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:39.770400 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-71faf5f2-2628-47c4-9f99-809f9b52eaee tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.360185 Jun 20 12:09:39.771386 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1342/2709] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:39 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:39.776587 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7e44abb8-8a6b-4f8d-9bfa-cc4c6f822326 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:39.777386 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7e44abb8-8a6b-4f8d-9bfa-cc4c6f822326 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:39.786335 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7e44abb8-8a6b-4f8d-9bfa-cc4c6f822326 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:39.787192 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7e44abb8-8a6b-4f8d-9bfa-cc4c6f822326 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:39.788230 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7e44abb8-8a6b-4f8d-9bfa-cc4c6f822326 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:39.788900 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7e44abb8-8a6b-4f8d-9bfa-cc4c6f822326 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:39.820363 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7e44abb8-8a6b-4f8d-9bfa-cc4c6f822326 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 49a35510-1821-49de-8e39-d45901095c80] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:09:39.930495 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7e44abb8-8a6b-4f8d-9bfa-cc4c6f822326 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "DELETE /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80" status: 204 len: 0 microversion: 2.1 time: 0.157199 Jun 20 12:09:39.934383 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1343/2710] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:09:39 2022] DELETE /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:09:39.944169 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-aaeb508a-44a6-437d-8fd5-af33945b3592 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:39.944808 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-aaeb508a-44a6-437d-8fd5-af33945b3592 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: f6bb3154-9ddf-428c-82cd-74ab476e5a0a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:39.951693 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-66c21ab0-fb08-45d8-aece-0affdc1a2470 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:39.956298 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aaeb508a-44a6-437d-8fd5-af33945b3592 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:39.956886 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aaeb508a-44a6-437d-8fd5-af33945b3592 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:39.957961 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aaeb508a-44a6-437d-8fd5-af33945b3592 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:39.958703 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aaeb508a-44a6-437d-8fd5-af33945b3592 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:39.969407 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-66c21ab0-fb08-45d8-aece-0affdc1a2470 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1473 microversion: 2.1 time: 0.630165 Jun 20 12:09:39.970340 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1368/2711] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:39 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1473 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:39.976897 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-afa6a359-8731-4b8a-917c-19532bc7a701 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:39.977736 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-afa6a359-8731-4b8a-917c-19532bc7a701 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] [instance: 85c5ef58-2d37-49d6-8bf8-dded3d45965a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:40.000291 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-afa6a359-8731-4b8a-917c-19532bc7a701 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:40.000747 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-afa6a359-8731-4b8a-917c-19532bc7a701 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:40.001945 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-afa6a359-8731-4b8a-917c-19532bc7a701 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:40.002556 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-afa6a359-8731-4b8a-917c-19532bc7a701 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:40.449116 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-aaeb508a-44a6-437d-8fd5-af33945b3592 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:40.468707 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-aaeb508a-44a6-437d-8fd5-af33945b3592 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a" status: 200 len: 1325 microversion: 2.1 time: 0.530169 Jun 20 12:09:40.472521 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1344/2712] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:39 2022] GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a => generated 1325 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:40.489688 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a503dd60-1f71-450a-b49e-425b9dd5770f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:40.499110 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a503dd60-1f71-450a-b49e-425b9dd5770f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:40.509779 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a503dd60-1f71-450a-b49e-425b9dd5770f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:40.513044 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a503dd60-1f71-450a-b49e-425b9dd5770f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:40.514528 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a503dd60-1f71-450a-b49e-425b9dd5770f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:40.515649 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a503dd60-1f71-450a-b49e-425b9dd5770f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:40.739094 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-afa6a359-8731-4b8a-917c-19532bc7a701 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815408121fd94cc8897776382656d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e01ab560b24342983dc342c5235c03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:40.753706 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-afa6a359-8731-4b8a-917c-19532bc7a701 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] 10.222.0.27 "GET /compute/v2.1/servers/85c5ef58-2d37-49d6-8bf8-dded3d45965a" status: 200 len: 1324 microversion: 2.1 time: 0.781722 Jun 20 12:09:40.754804 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1369/2713] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:39 2022] GET /compute/v2.1/servers/85c5ef58-2d37-49d6-8bf8-dded3d45965a => generated 1324 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:40.760135 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d5f674f7-62e8-4931-bb3c-4e149b011e81 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:40.771689 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d5f674f7-62e8-4931-bb3c-4e149b011e81 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:40.784571 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d5f674f7-62e8-4931-bb3c-4e149b011e81 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:40.784992 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d5f674f7-62e8-4931-bb3c-4e149b011e81 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:40.785878 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d5f674f7-62e8-4931-bb3c-4e149b011e81 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:40.786331 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d5f674f7-62e8-4931-bb3c-4e149b011e81 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:40.786716 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a503dd60-1f71-450a-b49e-425b9dd5770f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:40.795451 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a503dd60-1f71-450a-b49e-425b9dd5770f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.320743 Jun 20 12:09:40.803748 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1345/2714] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:40 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:40.813035 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b9280bb6-96f7-4f97-82c3-8c370ee1f193 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:40.815606 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b9280bb6-96f7-4f97-82c3-8c370ee1f193 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:40.830727 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b9280bb6-96f7-4f97-82c3-8c370ee1f193 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:40.840077 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b9280bb6-96f7-4f97-82c3-8c370ee1f193 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:40.840958 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b9280bb6-96f7-4f97-82c3-8c370ee1f193 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:40.841402 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b9280bb6-96f7-4f97-82c3-8c370ee1f193 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:41.132915 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b9280bb6-96f7-4f97-82c3-8c370ee1f193 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:41.153117 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d5f674f7-62e8-4931-bb3c-4e149b011e81 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:41.161645 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b9280bb6-96f7-4f97-82c3-8c370ee1f193 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41" status: 200 len: 1514 microversion: 2.1 time: 0.350196 Jun 20 12:09:41.169210 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d5f674f7-62e8-4931-bb3c-4e149b011e81 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80" status: 200 len: 1498 microversion: 2.1 time: 0.413187 Jun 20 12:09:41.169394 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1346/2715] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:40 2022] GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 => generated 1514 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:41.170641 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1370/2716] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:40 2022] GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 => generated 1498 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:41.176315 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fc9aa88a-2f18-4227-a0ea-44f3abb7717b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:41.184249 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fc9aa88a-2f18-4227-a0ea-44f3abb7717b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:41.194671 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e3228d9e-5cec-4969-b0b5-40452b1446d1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:41.195409 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e3228d9e-5cec-4969-b0b5-40452b1446d1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:41.201104 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fc9aa88a-2f18-4227-a0ea-44f3abb7717b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:41.204439 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fc9aa88a-2f18-4227-a0ea-44f3abb7717b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:41.205329 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fc9aa88a-2f18-4227-a0ea-44f3abb7717b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:41.208177 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fc9aa88a-2f18-4227-a0ea-44f3abb7717b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:41.232911 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e3228d9e-5cec-4969-b0b5-40452b1446d1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:41.233415 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e3228d9e-5cec-4969-b0b5-40452b1446d1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:41.234307 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e3228d9e-5cec-4969-b0b5-40452b1446d1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:41.234761 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e3228d9e-5cec-4969-b0b5-40452b1446d1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:41.304869 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-e3228d9e-5cec-4969-b0b5-40452b1446d1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] HTTP exception thrown: Cannot 'restore' instance 593cda12-6491-4a27-8fc7-42c05e0291c3 while it is in vm_state active Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e3228d9e-5cec-4969-b0b5-40452b1446d1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3/action HTTP/1.1 Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 15 Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: {"restore": {}} Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: exception: Cannot 'restore' instance 593cda12-6491-4a27-8fc7-42c05e0291c3 while it is in vm_state active Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '593cda12-6491-4a27-8fc7-42c05e0291c3', 'body': {'restore': {}}} Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 593cda12-6491-4a27-8fc7-42c05e0291c3 in vm_state active. Cannot restore while the instance is in this state. Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 593cda12-6491-4a27-8fc7-42c05e0291c3 while it is in vm_state active Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:41.307164 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:41.312579 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:41.312579 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:09:41.312579 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:09:41.312579 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 593cda12-6491-4a27-8fc7-42c05e0291c3 while it is in vm_state active Jun 20 12:09:41.312579 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:41.314067 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e3228d9e-5cec-4969-b0b5-40452b1446d1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 409 to user: Cannot 'restore' instance 593cda12-6491-4a27-8fc7-42c05e0291c3 while it is in vm_state active {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:09:41.315260 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e3228d9e-5cec-4969-b0b5-40452b1446d1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3/action" status: 409 len: 145 microversion: 2.1 time: 0.133836 Jun 20 12:09:41.316570 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1347/2717] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:09:41 2022] POST /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3/action => generated 145 bytes in 146 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:09:41.322361 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-564f9b33-14db-44bd-9c38-61007451aae2 req-2e0b8024-c493-432f-b0c5-019784158bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6bb3154-9ddf-428c-82cd-74ab476e5a0a", "tag": "70588baf-f83f-4160-862a-9baa231528c7"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:41.333175 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-564f9b33-14db-44bd-9c38-61007451aae2 req-2e0b8024-c493-432f-b0c5-019784158bf0 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:41.334368 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-564f9b33-14db-44bd-9c38-61007451aae2 req-2e0b8024-c493-432f-b0c5-019784158bf0 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:41.340897 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:41.351870 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-564f9b33-14db-44bd-9c38-61007451aae2 req-2e0b8024-c493-432f-b0c5-019784158bf0 service nova] Creating event network-changed:70588baf-f83f-4160-862a-9baa231528c7 for instance f6bb3154-9ddf-428c-82cd-74ab476e5a0a on n-h1-master-1 Jun 20 12:09:41.358154 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-564f9b33-14db-44bd-9c38-61007451aae2 req-2e0b8024-c493-432f-b0c5-019784158bf0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039642 Jun 20 12:09:41.359212 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1348/2718] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:09:41.367846 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-710c6209-fed0-4b84-91a8-fafcee4d40c9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:41.368635 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-710c6209-fed0-4b84-91a8-fafcee4d40c9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:41.380849 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-710c6209-fed0-4b84-91a8-fafcee4d40c9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:41.381298 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-710c6209-fed0-4b84-91a8-fafcee4d40c9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:41.382380 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-710c6209-fed0-4b84-91a8-fafcee4d40c9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:41.382978 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-710c6209-fed0-4b84-91a8-fafcee4d40c9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:41.972559 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-710c6209-fed0-4b84-91a8-fafcee4d40c9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:41.985942 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-710c6209-fed0-4b84-91a8-fafcee4d40c9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.625198 Jun 20 12:09:41.987296 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1349/2719] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:41 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:41.997650 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b79cbe92-5ce4-4336-86f5-4ba64e68afd4 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:41.999312 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b79cbe92-5ce4-4336-86f5-4ba64e68afd4 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: f6bb3154-9ddf-428c-82cd-74ab476e5a0a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:42.007474 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b79cbe92-5ce4-4336-86f5-4ba64e68afd4 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:42.008035 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b79cbe92-5ce4-4336-86f5-4ba64e68afd4 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:42.008938 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b79cbe92-5ce4-4336-86f5-4ba64e68afd4 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:42.009439 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b79cbe92-5ce4-4336-86f5-4ba64e68afd4 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:42.048492 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fc9aa88a-2f18-4227-a0ea-44f3abb7717b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:42.072019 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fc9aa88a-2f18-4227-a0ea-44f3abb7717b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1473 microversion: 2.1 time: 0.890390 Jun 20 12:09:42.073426 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1371/2720] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:41 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1473 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:42.081791 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6c6446da-739a-46fa-870d-506f030a0e29 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:42.082845 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6c6446da-739a-46fa-870d-506f030a0e29 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] [instance: 85c5ef58-2d37-49d6-8bf8-dded3d45965a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:42.091030 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c6446da-739a-46fa-870d-506f030a0e29 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:42.092080 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c6446da-739a-46fa-870d-506f030a0e29 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:42.092936 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c6446da-739a-46fa-870d-506f030a0e29 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:42.093863 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c6446da-739a-46fa-870d-506f030a0e29 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:42.464086 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6c6446da-739a-46fa-870d-506f030a0e29 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815408121fd94cc8897776382656d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e01ab560b24342983dc342c5235c03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:42.476343 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6c6446da-739a-46fa-870d-506f030a0e29 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] 10.222.0.27 "GET /compute/v2.1/servers/85c5ef58-2d37-49d6-8bf8-dded3d45965a" status: 200 len: 1324 microversion: 2.1 time: 0.400771 Jun 20 12:09:42.487291 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1372/2721] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:42 2022] GET /compute/v2.1/servers/85c5ef58-2d37-49d6-8bf8-dded3d45965a => generated 1324 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:42.493584 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cb766ddb-c351-4271-b88b-93e229fc72d5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:42.494230 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cb766ddb-c351-4271-b88b-93e229fc72d5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:42.495755 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b79cbe92-5ce4-4336-86f5-4ba64e68afd4 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:42.502060 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cb766ddb-c351-4271-b88b-93e229fc72d5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:42.502809 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cb766ddb-c351-4271-b88b-93e229fc72d5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:42.503817 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cb766ddb-c351-4271-b88b-93e229fc72d5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:42.504757 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cb766ddb-c351-4271-b88b-93e229fc72d5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:42.510082 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b79cbe92-5ce4-4336-86f5-4ba64e68afd4 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a" status: 200 len: 1325 microversion: 2.1 time: 0.521184 Jun 20 12:09:42.510968 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1350/2722] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:41 2022] GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a => generated 1325 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:42.535821 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2b89a57c-0fcb-4605-9a7a-720c3ae71c2c tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:42.536321 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2b89a57c-0fcb-4605-9a7a-720c3ae71c2c tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:42.557524 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2b89a57c-0fcb-4605-9a7a-720c3ae71c2c tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:42.558445 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2b89a57c-0fcb-4605-9a7a-720c3ae71c2c tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:42.560249 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2b89a57c-0fcb-4605-9a7a-720c3ae71c2c tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:42.561621 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2b89a57c-0fcb-4605-9a7a-720c3ae71c2c tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:42.984864 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cb766ddb-c351-4271-b88b-93e229fc72d5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:43.010712 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cb766ddb-c351-4271-b88b-93e229fc72d5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.521665 Jun 20 12:09:43.020367 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1373/2723] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:42 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:43.030643 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-683c2006-93a9-4fb8-92af-4d71eb523288 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:43.031603 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-683c2006-93a9-4fb8-92af-4d71eb523288 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:43.048549 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-683c2006-93a9-4fb8-92af-4d71eb523288 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:43.052349 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-683c2006-93a9-4fb8-92af-4d71eb523288 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:43.053950 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-683c2006-93a9-4fb8-92af-4d71eb523288 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:43.054520 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-683c2006-93a9-4fb8-92af-4d71eb523288 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:43.090891 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:43.540042 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2b89a57c-0fcb-4605-9a7a-720c3ae71c2c tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f16b216588946a790b42450b795ee00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9c3f1d5c64a75b49099a15fe087ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:43.550625 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2b89a57c-0fcb-4605-9a7a-720c3ae71c2c tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80" status: 200 len: 1498 microversion: 2.1 time: 1.038806 Jun 20 12:09:43.551267 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1351/2724] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:42 2022] GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 => generated 1498 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:43.571589 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-83a2b082-867c-4b55-af05-7d8c1296b5a9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:43.572144 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-83a2b082-867c-4b55-af05-7d8c1296b5a9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 2d5d208d-186c-46eb-acaf-06a04a5f0f08] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:43.584021 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-83a2b082-867c-4b55-af05-7d8c1296b5a9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] HTTP exception thrown: Instance 2d5d208d-186c-46eb-acaf-06a04a5f0f08 could not be found. Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-83a2b082-867c-4b55-af05-7d8c1296b5a9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/servers/2d5d208d-186c-46eb-acaf-06a04a5f0f08/action HTTP/1.1 Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 14 Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: {"resume": {}} Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 2d5d208d-186c-46eb-acaf-06a04a5f0f08 could not be found. Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '2d5d208d-186c-46eb-acaf-06a04a5f0f08', 'body': {'resume': {}}} Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d5d208d-186c-46eb-acaf-06a04a5f0f08 could not be found. Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d5d208d-186c-46eb-acaf-06a04a5f0f08 could not be found. Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:43.597501 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:43.605967 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:09:43.605967 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:09:43.605967 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d5d208d-186c-46eb-acaf-06a04a5f0f08 could not be found. Jun 20 12:09:43.605967 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:43.609631 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-83a2b082-867c-4b55-af05-7d8c1296b5a9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 404 to user: Instance 2d5d208d-186c-46eb-acaf-06a04a5f0f08 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:09:43.609631 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-83a2b082-867c-4b55-af05-7d8c1296b5a9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers/2d5d208d-186c-46eb-acaf-06a04a5f0f08/action" status: 404 len: 111 microversion: 2.1 time: 0.056793 Jun 20 12:09:43.613987 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1352/2725] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:09:43 2022] POST /compute/v2.1/servers/2d5d208d-186c-46eb-acaf-06a04a5f0f08/action => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:09:43.633812 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-79d84de4-56fd-4893-8cfa-68d60c1e88fb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:43.635204 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-79d84de4-56fd-4893-8cfa-68d60c1e88fb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:43.661896 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-79d84de4-56fd-4893-8cfa-68d60c1e88fb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:43.662358 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-79d84de4-56fd-4893-8cfa-68d60c1e88fb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:43.676979 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-79d84de4-56fd-4893-8cfa-68d60c1e88fb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:43.680616 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-79d84de4-56fd-4893-8cfa-68d60c1e88fb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:43.993785 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-79d84de4-56fd-4893-8cfa-68d60c1e88fb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:43.995411 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-683c2006-93a9-4fb8-92af-4d71eb523288 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:44.016553 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-683c2006-93a9-4fb8-92af-4d71eb523288 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41" status: 200 len: 1514 microversion: 2.1 time: 0.993870 Jun 20 12:09:44.020233 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-79d84de4-56fd-4893-8cfa-68d60c1e88fb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1470 microversion: 2.1 time: 0.404605 Jun 20 12:09:44.020841 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1353/2726] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:43 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1470 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:44.027028 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-36cc19f7-6308-4b09-ac6c-bdef032394ca tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:44.033209 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-36cc19f7-6308-4b09-ac6c-bdef032394ca tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] [instance: 85c5ef58-2d37-49d6-8bf8-dded3d45965a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:44.033624 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1374/2727] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:43 2022] GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 => generated 1514 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:44.047950 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-36cc19f7-6308-4b09-ac6c-bdef032394ca tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:44.050101 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-36cc19f7-6308-4b09-ac6c-bdef032394ca tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:44.052477 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e1b0abf2-45f8-47ec-85c0-65eff096403c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:44.053564 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e1b0abf2-45f8-47ec-85c0-65eff096403c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: f6bb3154-9ddf-428c-82cd-74ab476e5a0a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:44.053952 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-36cc19f7-6308-4b09-ac6c-bdef032394ca tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:44.054892 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-36cc19f7-6308-4b09-ac6c-bdef032394ca tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:44.066420 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1b0abf2-45f8-47ec-85c0-65eff096403c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:44.066747 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1b0abf2-45f8-47ec-85c0-65eff096403c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:44.075300 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1b0abf2-45f8-47ec-85c0-65eff096403c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:44.077170 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1b0abf2-45f8-47ec-85c0-65eff096403c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:44.299434 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-36cc19f7-6308-4b09-ac6c-bdef032394ca tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815408121fd94cc8897776382656d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e01ab560b24342983dc342c5235c03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:44.310386 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-36cc19f7-6308-4b09-ac6c-bdef032394ca tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] 10.222.0.27 "GET /compute/v2.1/servers/85c5ef58-2d37-49d6-8bf8-dded3d45965a" status: 200 len: 1324 microversion: 2.1 time: 0.287987 Jun 20 12:09:44.311309 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1354/2728] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:44 2022] GET /compute/v2.1/servers/85c5ef58-2d37-49d6-8bf8-dded3d45965a => generated 1324 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:44.327270 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ad9ebb33-a72e-4717-b0c0-26f6520af714 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:44.328158 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ad9ebb33-a72e-4717-b0c0-26f6520af714 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:44.336992 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ad9ebb33-a72e-4717-b0c0-26f6520af714 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:44.337480 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ad9ebb33-a72e-4717-b0c0-26f6520af714 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:44.338343 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ad9ebb33-a72e-4717-b0c0-26f6520af714 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:44.338793 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ad9ebb33-a72e-4717-b0c0-26f6520af714 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:44.555577 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ad9ebb33-a72e-4717-b0c0-26f6520af714 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:44.570811 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ad9ebb33-a72e-4717-b0c0-26f6520af714 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.247785 Jun 20 12:09:44.572371 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1355/2729] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:44 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:44.591142 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-898a8e46-121f-4eae-a63b-b996277b58b8 req-b1d0a701-1225-4da9-83f6-a9b37e0229bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49a35510-1821-49de-8e39-d45901095c80", "name": "network-vif-deleted", "tag": "bab393cc-844a-468b-9b51-51cf37ed5c0a"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:44.607314 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-898a8e46-121f-4eae-a63b-b996277b58b8 req-b1d0a701-1225-4da9-83f6-a9b37e0229bb service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:44.608282 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-898a8e46-121f-4eae-a63b-b996277b58b8 req-b1d0a701-1225-4da9-83f6-a9b37e0229bb service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:44.623875 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-898a8e46-121f-4eae-a63b-b996277b58b8 req-b1d0a701-1225-4da9-83f6-a9b37e0229bb service nova] Creating event network-vif-deleted:bab393cc-844a-468b-9b51-51cf37ed5c0a for instance 49a35510-1821-49de-8e39-d45901095c80 on n-h1-master-1 Jun 20 12:09:44.624741 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e1b0abf2-45f8-47ec-85c0-65eff096403c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:44.631658 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-898a8e46-121f-4eae-a63b-b996277b58b8 req-b1d0a701-1225-4da9-83f6-a9b37e0229bb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057514 Jun 20 12:09:44.633152 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1356/2730] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:09:44.638820 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e1b0abf2-45f8-47ec-85c0-65eff096403c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a" status: 200 len: 1325 microversion: 2.1 time: 0.603738 Jun 20 12:09:44.640905 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1375/2731] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:44 2022] GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a => generated 1325 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:44.647506 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0c4a4a8b-f027-4d08-85f4-c5dbf03aadb4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:44.648500 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0c4a4a8b-f027-4d08-85f4-c5dbf03aadb4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] [instance: 49a35510-1821-49de-8e39-d45901095c80] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:44.658925 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b4e4ad11-1891-4e60-86f4-d551568360b8 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:44.659564 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b4e4ad11-1891-4e60-86f4-d551568360b8 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:44.659691 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0c4a4a8b-f027-4d08-85f4-c5dbf03aadb4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:44.660368 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0c4a4a8b-f027-4d08-85f4-c5dbf03aadb4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:44.662493 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0c4a4a8b-f027-4d08-85f4-c5dbf03aadb4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:44.663337 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0c4a4a8b-f027-4d08-85f4-c5dbf03aadb4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:44.667740 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b4e4ad11-1891-4e60-86f4-d551568360b8 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:44.668559 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b4e4ad11-1891-4e60-86f4-d551568360b8 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:44.671103 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b4e4ad11-1891-4e60-86f4-d551568360b8 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:44.671964 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b4e4ad11-1891-4e60-86f4-d551568360b8 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:44.688565 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-0c4a4a8b-f027-4d08-85f4-c5dbf03aadb4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] HTTP exception thrown: Instance 49a35510-1821-49de-8e39-d45901095c80 could not be found. Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0c4a4a8b-f027-4d08-85f4-c5dbf03aadb4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Request method failure captured: Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 HTTP/1.1 Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGGzCfL3w9tcOc55Z9r7EAcHfRRDk3bQtKtjdiI4-k6OZuJCYCgky5sbUbqDZyZL8PkMcjpkShji-aUUeYfT0SA-paoO5QqkaTFkjb1PA6i-RS0Rbrk81uT7XEx2EIIrvJsmj0tkkpgaIWirbQfGY_cm3GD4V1mQEGUSMZ1-Z-TaEuM Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 5cf9c3f1d5c64a75b49099a15fe087ee Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-LiveMigrationTest-1776374292 Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5cf9c3f1d5c64a75b49099a15fe087ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5cf9c3f1d5c64a75b49099a15fe087ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5cf9c3f1d5c64a75b49099a15fe087ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5cf9c3f1d5c64a75b49099a15fe087ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-LiveMigrationTest-1776374292 Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 5cf9c3f1d5c64a75b49099a15fe087ee Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-LiveMigrationTest-1776374292 Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-LiveMigrationTest-1776374292-project Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 3f16b216588946a790b42450b795ee00 Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-LiveMigrationTest-1776374292-project Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 49a35510-1821-49de-8e39-d45901095c80 could not be found. Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '49a35510-1821-49de-8e39-d45901095c80'} Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49a35510-1821-49de-8e39-d45901095c80 could not be found. Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49a35510-1821-49de-8e39-d45901095c80 could not be found. Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:44.690517 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:44.696267 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:44.696267 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:44.696267 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:44.696267 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:09:44.696267 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:09:44.696267 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49a35510-1821-49de-8e39-d45901095c80 could not be found. Jun 20 12:09:44.696267 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:44.703239 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0c4a4a8b-f027-4d08-85f4-c5dbf03aadb4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] Returning 404 to user: Instance 49a35510-1821-49de-8e39-d45901095c80 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:09:44.704300 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0c4a4a8b-f027-4d08-85f4-c5dbf03aadb4 tempest-LiveMigrationTest-1776374292 tempest-LiveMigrationTest-1776374292-project] 10.222.0.27 "GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80" status: 404 len: 111 microversion: 2.1 time: 0.062038 Jun 20 12:09:44.705297 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1376/2732] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:44 2022] GET /compute/v2.1/servers/49a35510-1821-49de-8e39-d45901095c80 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:09:44.719845 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5afb9d68-584c-461f-8025-4cf0c9bfa2b5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:44.720507 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5afb9d68-584c-461f-8025-4cf0c9bfa2b5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:44.725913 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b4e4ad11-1891-4e60-86f4-d551568360b8 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:44.726374 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b4e4ad11-1891-4e60-86f4-d551568360b8 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:44.727208 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b4e4ad11-1891-4e60-86f4-d551568360b8 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:44.727646 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b4e4ad11-1891-4e60-86f4-d551568360b8 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:44.729402 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5afb9d68-584c-461f-8025-4cf0c9bfa2b5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:44.729857 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5afb9d68-584c-461f-8025-4cf0c9bfa2b5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:44.730642 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5afb9d68-584c-461f-8025-4cf0c9bfa2b5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:44.731075 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5afb9d68-584c-461f-8025-4cf0c9bfa2b5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:44.752616 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-b4e4ad11-1891-4e60-86f4-d551568360b8 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Getting quotas for project 4440dc3e2f9c4134a54b08e2585f6c59. Resources: {'ram', 'cores'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:09:44.759415 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-b4e4ad11-1891-4e60-86f4-d551568360b8 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Getting quotas for user 3d35b7c824b641099a406175bccc5be3 and project 4440dc3e2f9c4134a54b08e2585f6c59. Resources: {'ram', 'cores'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:09:44.890963 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b4e4ad11-1891-4e60-86f4-d551568360b8 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "POST /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656/action" status: 202 len: 0 microversion: 2.1 time: 0.241531 Jun 20 12:09:44.891792 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1357/2733] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:09:44 2022] POST /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:09:44.897922 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-27d8effd-8196-4900-994a-8d822a37a1f9 req-07abc613-0281-4759-8595-dfa7bf2dad98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85c5ef58-2d37-49d6-8bf8-dded3d45965a", "tag": "9031fd5a-b1b5-4a9c-be6b-39f81e3cb9aa"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:44.908499 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-27d8effd-8196-4900-994a-8d822a37a1f9 req-07abc613-0281-4759-8595-dfa7bf2dad98 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:44.908962 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-27d8effd-8196-4900-994a-8d822a37a1f9 req-07abc613-0281-4759-8595-dfa7bf2dad98 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:44.924119 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-27d8effd-8196-4900-994a-8d822a37a1f9 req-07abc613-0281-4759-8595-dfa7bf2dad98 service nova] Creating event network-changed:9031fd5a-b1b5-4a9c-be6b-39f81e3cb9aa for instance 85c5ef58-2d37-49d6-8bf8-dded3d45965a on n-h2-master-1 Jun 20 12:09:44.929307 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-27d8effd-8196-4900-994a-8d822a37a1f9 req-07abc613-0281-4759-8595-dfa7bf2dad98 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035968 Jun 20 12:09:44.929926 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1358/2734] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:09:44.935679 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-81356eb7-fa40-4cbe-bd7e-a14363c55b27 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1733877102", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "4983ec4a-c261-411f-a088-466ba2a81d57"}, {"port": "180da7b7-ef36-401f-943e-30f5c9d8ecc6", "tag": "port-1"}, {"port": "106b84b6-fcc3-4d62-a238-c341d6254586", "tag": "port-2"}, {"uuid": "16844363-5f31-4078-998f-11de5157ac55", "tag": "net-1"}, {"uuid": "16844363-5f31-4078-998f-11de5157ac55"}, {"uuid": "89bdc44a-b084-4e87-9060-3a971af49685", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "89bdc44a-b084-4e87-9060-3a971af49685", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "990f4353-8fbc-4e22-adec-8b3cef7fc5a4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "b2323cdb-877c-4bcf-99cd-33bccb866939", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "12bc588a-7788-4123-898f-c902252320a8", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--578512751"}], "key_name": "tempest-keypair-1188036854", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:45.079999 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-81356eb7-fa40-4cbe-bd7e-a14363c55b27 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] validate_networks() for [('4983ec4a-c261-411f-a088-466ba2a81d57', None, None, None, None, None), (None, None, '180da7b7-ef36-401f-943e-30f5c9d8ecc6', None, None, None), (None, None, '106b84b6-fcc3-4d62-a238-c341d6254586', None, None, None), ('16844363-5f31-4078-998f-11de5157ac55', None, None, None, None, None), ('16844363-5f31-4078-998f-11de5157ac55', None, None, None, None, None), ('89bdc44a-b084-4e87-9060-3a971af49685', '10.2.2.100', None, None, None, None), ('89bdc44a-b084-4e87-9060-3a971af49685', '10.2.2.200', None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:09:45.358082 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5afb9d68-584c-461f-8025-4cf0c9bfa2b5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:45.378466 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5afb9d68-584c-461f-8025-4cf0c9bfa2b5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.668613 Jun 20 12:09:45.381274 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1377/2735] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:44 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:45.388875 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5cdf4636-e92e-4e56-96cb-a204377aee8b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:45.390403 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5cdf4636-e92e-4e56-96cb-a204377aee8b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:45.402016 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5cdf4636-e92e-4e56-96cb-a204377aee8b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:45.406377 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5cdf4636-e92e-4e56-96cb-a204377aee8b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:45.421338 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5cdf4636-e92e-4e56-96cb-a204377aee8b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:45.422183 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5cdf4636-e92e-4e56-96cb-a204377aee8b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:46.270720 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=12 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:46.340499 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5cdf4636-e92e-4e56-96cb-a204377aee8b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:46.355228 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5cdf4636-e92e-4e56-96cb-a204377aee8b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1469 microversion: 2.1 time: 0.972615 Jun 20 12:09:46.366011 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1378/2736] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:45 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1469 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:46.366011 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7ebd886e-e1f0-46a2-920f-381c05245451 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:46.366011 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7ebd886e-e1f0-46a2-920f-381c05245451 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:46.373219 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ebd886e-e1f0-46a2-920f-381c05245451 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:46.373982 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ebd886e-e1f0-46a2-920f-381c05245451 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:46.377422 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ebd886e-e1f0-46a2-920f-381c05245451 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:46.378316 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ebd886e-e1f0-46a2-920f-381c05245451 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:46.758845 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7ebd886e-e1f0-46a2-920f-381c05245451 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:46.773679 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7ebd886e-e1f0-46a2-920f-381c05245451 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41" status: 200 len: 1514 microversion: 2.1 time: 0.416338 Jun 20 12:09:46.784409 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1379/2737] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:46 2022] GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 => generated 1514 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:46.791229 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-151dd98a-e0d0-410c-804a-92d027c55626 req-ec29c43e-c7f7-408c-a7a1-e25c2a122f06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6bb3154-9ddf-428c-82cd-74ab476e5a0a", "name": "network-vif-plugged", "status": "completed", "tag": "70588baf-f83f-4160-862a-9baa231528c7"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:46.805385 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-151dd98a-e0d0-410c-804a-92d027c55626 req-ec29c43e-c7f7-408c-a7a1-e25c2a122f06 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:46.806113 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-151dd98a-e0d0-410c-804a-92d027c55626 req-ec29c43e-c7f7-408c-a7a1-e25c2a122f06 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:46.819367 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-151dd98a-e0d0-410c-804a-92d027c55626 req-ec29c43e-c7f7-408c-a7a1-e25c2a122f06 service nova] Creating event network-vif-plugged:70588baf-f83f-4160-862a-9baa231528c7 for instance f6bb3154-9ddf-428c-82cd-74ab476e5a0a on n-h1-master-1 Jun 20 12:09:46.826016 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-151dd98a-e0d0-410c-804a-92d027c55626 req-ec29c43e-c7f7-408c-a7a1-e25c2a122f06 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037991 Jun 20 12:09:46.827195 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1380/2738] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:09:46.834040 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8f7a4e99-68bb-4d69-9a76-c9c806c8579d tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:46.835669 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8f7a4e99-68bb-4d69-9a76-c9c806c8579d tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] [instance: 85c5ef58-2d37-49d6-8bf8-dded3d45965a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:46.849317 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8f7a4e99-68bb-4d69-9a76-c9c806c8579d tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:46.850065 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8f7a4e99-68bb-4d69-9a76-c9c806c8579d tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:46.851428 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8f7a4e99-68bb-4d69-9a76-c9c806c8579d tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:46.851428 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8f7a4e99-68bb-4d69-9a76-c9c806c8579d tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:47.216582 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8f7a4e99-68bb-4d69-9a76-c9c806c8579d tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815408121fd94cc8897776382656d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e01ab560b24342983dc342c5235c03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:47.227266 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8f7a4e99-68bb-4d69-9a76-c9c806c8579d tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] 10.222.0.27 "GET /compute/v2.1/servers/85c5ef58-2d37-49d6-8bf8-dded3d45965a" status: 200 len: 1324 microversion: 2.1 time: 0.398731 Jun 20 12:09:47.228119 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1381/2739] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:46 2022] GET /compute/v2.1/servers/85c5ef58-2d37-49d6-8bf8-dded3d45965a => generated 1324 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:47.236326 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7f2a14d3-01c3-41cc-ae23-0337d3f9a5e8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:47.236942 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7f2a14d3-01c3-41cc-ae23-0337d3f9a5e8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:47.244149 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7f2a14d3-01c3-41cc-ae23-0337d3f9a5e8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:47.244725 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7f2a14d3-01c3-41cc-ae23-0337d3f9a5e8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:47.245599 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7f2a14d3-01c3-41cc-ae23-0337d3f9a5e8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:47.246095 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7f2a14d3-01c3-41cc-ae23-0337d3f9a5e8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:47.271642 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-7f2a14d3-01c3-41cc-ae23-0337d3f9a5e8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] HTTP exception thrown: Cannot 'resume' instance 593cda12-6491-4a27-8fc7-42c05e0291c3 while it is in vm_state active Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7f2a14d3-01c3-41cc-ae23-0337d3f9a5e8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3/action HTTP/1.1 Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 14 Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: {"resume": {}} Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: exception: Cannot 'resume' instance 593cda12-6491-4a27-8fc7-42c05e0291c3 while it is in vm_state active Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '593cda12-6491-4a27-8fc7-42c05e0291c3', 'body': {'resume': {}}} Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 593cda12-6491-4a27-8fc7-42c05e0291c3 in vm_state active. Cannot resume while the instance is in this state. Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 593cda12-6491-4a27-8fc7-42c05e0291c3 while it is in vm_state active Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:47.273452 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:47.278628 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:47.278628 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:09:47.278628 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:09:47.278628 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 593cda12-6491-4a27-8fc7-42c05e0291c3 while it is in vm_state active Jun 20 12:09:47.278628 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:47.278628 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7f2a14d3-01c3-41cc-ae23-0337d3f9a5e8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 409 to user: Cannot 'resume' instance 593cda12-6491-4a27-8fc7-42c05e0291c3 while it is in vm_state active {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:09:47.278628 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7f2a14d3-01c3-41cc-ae23-0337d3f9a5e8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3/action" status: 409 len: 144 microversion: 2.1 time: 0.047884 Jun 20 12:09:47.278628 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1382/2740] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:09:47 2022] POST /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3/action => generated 144 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:09:47.282638 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-16330a74-0dc0-44bc-93b0-0012844fe6b6 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:47.283256 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-16330a74-0dc0-44bc-93b0-0012844fe6b6 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: f6bb3154-9ddf-428c-82cd-74ab476e5a0a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:47.290035 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-16330a74-0dc0-44bc-93b0-0012844fe6b6 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:47.290818 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-16330a74-0dc0-44bc-93b0-0012844fe6b6 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:47.291771 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-16330a74-0dc0-44bc-93b0-0012844fe6b6 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:47.292470 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-16330a74-0dc0-44bc-93b0-0012844fe6b6 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:47.554001 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-16330a74-0dc0-44bc-93b0-0012844fe6b6 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:47.566383 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-16330a74-0dc0-44bc-93b0-0012844fe6b6 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a" status: 200 len: 1325 microversion: 2.1 time: 0.287193 Jun 20 12:09:47.580176 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1383/2741] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:47 2022] GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a => generated 1325 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:47.585891 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1c61b7bf-0c23-499e-b9d5-e3cf64d9bbd7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:47.586769 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1c61b7bf-0c23-499e-b9d5-e3cf64d9bbd7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:47.594594 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c61b7bf-0c23-499e-b9d5-e3cf64d9bbd7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:47.595306 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c61b7bf-0c23-499e-b9d5-e3cf64d9bbd7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:47.596350 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c61b7bf-0c23-499e-b9d5-e3cf64d9bbd7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:47.596955 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c61b7bf-0c23-499e-b9d5-e3cf64d9bbd7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:47.830591 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1c61b7bf-0c23-499e-b9d5-e3cf64d9bbd7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:47.839540 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1c61b7bf-0c23-499e-b9d5-e3cf64d9bbd7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.257725 Jun 20 12:09:47.840604 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1384/2742] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:47 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:47.846345 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3dddba38-70cc-411e-ad07-2133e1111678 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:47.847166 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3dddba38-70cc-411e-ad07-2133e1111678 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:47.857558 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3dddba38-70cc-411e-ad07-2133e1111678 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:47.858025 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3dddba38-70cc-411e-ad07-2133e1111678 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:47.859183 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3dddba38-70cc-411e-ad07-2133e1111678 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:47.859313 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3dddba38-70cc-411e-ad07-2133e1111678 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:48.158844 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3dddba38-70cc-411e-ad07-2133e1111678 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:48.170024 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3dddba38-70cc-411e-ad07-2133e1111678 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1469 microversion: 2.1 time: 0.327797 Jun 20 12:09:48.177838 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1385/2743] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:47 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1469 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:48.177838 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-072c38b5-9e3f-406e-a6b4-e073484ad9ca tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:48.178273 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-072c38b5-9e3f-406e-a6b4-e073484ad9ca tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:48.185669 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-072c38b5-9e3f-406e-a6b4-e073484ad9ca tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:48.186028 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-072c38b5-9e3f-406e-a6b4-e073484ad9ca tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:48.186855 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-072c38b5-9e3f-406e-a6b4-e073484ad9ca tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:48.187297 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-072c38b5-9e3f-406e-a6b4-e073484ad9ca tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:48.422161 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-072c38b5-9e3f-406e-a6b4-e073484ad9ca tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:48.438011 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-072c38b5-9e3f-406e-a6b4-e073484ad9ca tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41" status: 200 len: 1514 microversion: 2.1 time: 0.265947 Jun 20 12:09:48.438631 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1386/2744] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:48 2022] GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 => generated 1514 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:48.461026 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-54b90966-0941-40fa-a025-68c90a130402 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:48.461662 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-54b90966-0941-40fa-a025-68c90a130402 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:48.470437 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-54b90966-0941-40fa-a025-68c90a130402 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:48.470898 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-54b90966-0941-40fa-a025-68c90a130402 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:48.471707 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-54b90966-0941-40fa-a025-68c90a130402 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:48.472152 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-54b90966-0941-40fa-a025-68c90a130402 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:48.628189 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-54b90966-0941-40fa-a025-68c90a130402 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:48.639041 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-54b90966-0941-40fa-a025-68c90a130402 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.194115 Jun 20 12:09:48.639637 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1387/2745] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:48 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:48.644742 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d1fa9289-afc9-4bd8-a144-cf7e48eb418f tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:48.646100 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d1fa9289-afc9-4bd8-a144-cf7e48eb418f tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] [instance: 85c5ef58-2d37-49d6-8bf8-dded3d45965a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:48.653037 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d1fa9289-afc9-4bd8-a144-cf7e48eb418f tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:48.653818 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d1fa9289-afc9-4bd8-a144-cf7e48eb418f tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:48.654789 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d1fa9289-afc9-4bd8-a144-cf7e48eb418f tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:48.655397 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d1fa9289-afc9-4bd8-a144-cf7e48eb418f tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:48.885216 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d1fa9289-afc9-4bd8-a144-cf7e48eb418f tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815408121fd94cc8897776382656d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e01ab560b24342983dc342c5235c03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:48.902819 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d1fa9289-afc9-4bd8-a144-cf7e48eb418f tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] 10.222.0.27 "GET /compute/v2.1/servers/85c5ef58-2d37-49d6-8bf8-dded3d45965a" status: 200 len: 1324 microversion: 2.1 time: 0.260524 Jun 20 12:09:48.915212 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1388/2746] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:48 2022] GET /compute/v2.1/servers/85c5ef58-2d37-49d6-8bf8-dded3d45965a => generated 1324 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:48.924152 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-73fefe8f-10df-4aad-848a-6bc3ce80a6a1 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:48.929303 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-73fefe8f-10df-4aad-848a-6bc3ce80a6a1 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: f6bb3154-9ddf-428c-82cd-74ab476e5a0a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:48.939667 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-73fefe8f-10df-4aad-848a-6bc3ce80a6a1 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:48.940431 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-73fefe8f-10df-4aad-848a-6bc3ce80a6a1 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:48.942018 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-73fefe8f-10df-4aad-848a-6bc3ce80a6a1 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:48.948233 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-73fefe8f-10df-4aad-848a-6bc3ce80a6a1 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:49.234166 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:49.317881 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-73fefe8f-10df-4aad-848a-6bc3ce80a6a1 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:49.331449 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-73fefe8f-10df-4aad-848a-6bc3ce80a6a1 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a" status: 200 len: 1521 microversion: 2.1 time: 0.414663 Jun 20 12:09:49.334532 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1389/2747] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:48 2022] GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a => generated 1521 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:49.341047 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e78aef75-0800-4590-8371-101d24327775 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "dadde73c-e8f7-441b-8503-8f17caea8651"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e78aef75-0800-4590-8371-101d24327775 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 160 Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: {"server": {"name": "", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "dadde73c-e8f7-441b-8503-8f17caea8651"}]}} Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: exception: Invalid input for field/attribute name. Value: . '' is too short Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: action_args: {'body': {'server': {'name': '', 'imageRef': 'f16836cc-4e18-4bd0-b261-3865adf8cb83', 'flavorRef': '452', 'networks': [{'uuid': 'dadde73c-e8f7-441b-8503-8f17caea8651'}]}}} Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise error Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi '' Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 12:09:49.345483 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 12:09:49.352158 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 12:09:49.352158 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jun 20 12:09:49.352158 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:49.352158 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:49.352158 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:49.352158 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:49.352158 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:49.352158 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:49.352158 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 12:09:49.352158 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 12:09:49.352158 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jun 20 12:09:49.352158 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:49.352158 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e78aef75-0800-4590-8371-101d24327775 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:09:49.352158 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e78aef75-0800-4590-8371-101d24327775 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.014709 Jun 20 12:09:49.355931 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1390/2748] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:09:49 2022] POST /compute/v2.1/servers => generated 108 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:09:49.360983 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-847ff6c7-afed-4671-b87a-b65252506632 req-cbdb71ea-f8f5-4e4f-96ae-90d89e4415a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8b3d285-0f08-4deb-859e-babab7f3b656", "name": "network-vif-plugged", "status": "completed", "tag": "e23efb88-f8d5-4db8-8321-1c16dca584be"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:49.377131 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-847ff6c7-afed-4671-b87a-b65252506632 req-cbdb71ea-f8f5-4e4f-96ae-90d89e4415a8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:49.378066 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-847ff6c7-afed-4671-b87a-b65252506632 req-cbdb71ea-f8f5-4e4f-96ae-90d89e4415a8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:49.397210 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-847ff6c7-afed-4671-b87a-b65252506632 req-cbdb71ea-f8f5-4e4f-96ae-90d89e4415a8 service nova] Creating event network-vif-plugged:e23efb88-f8d5-4db8-8321-1c16dca584be for instance f8b3d285-0f08-4deb-859e-babab7f3b656 on n-h2-master-1 Jun 20 12:09:49.404640 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [req-847ff6c7-afed-4671-b87a-b65252506632 req-cbdb71ea-f8f5-4e4f-96ae-90d89e4415a8 service nova] Instance f8b3d285-0f08-4deb-859e-babab7f3b656 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1'} {{(pid=119127) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:09:49.413751 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-847ff6c7-afed-4671-b87a-b65252506632 req-cbdb71ea-f8f5-4e4f-96ae-90d89e4415a8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055855 Jun 20 12:09:49.419053 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1391/2749] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:09:49.425199 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0f794b9a-f2c9-4f9b-9990-03822459fac5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:49.426388 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0f794b9a-f2c9-4f9b-9990-03822459fac5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:49.434234 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f794b9a-f2c9-4f9b-9990-03822459fac5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:49.434976 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f794b9a-f2c9-4f9b-9990-03822459fac5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:49.435767 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f794b9a-f2c9-4f9b-9990-03822459fac5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:49.436223 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f794b9a-f2c9-4f9b-9990-03822459fac5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:49.620161 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0f794b9a-f2c9-4f9b-9990-03822459fac5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:49.628363 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0f794b9a-f2c9-4f9b-9990-03822459fac5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1469 microversion: 2.1 time: 0.207783 Jun 20 12:09:49.629111 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1392/2750] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:49 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1469 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:49.634029 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f18a287e-6f31-4985-9bdc-604627ab8b61 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:49.634914 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f18a287e-6f31-4985-9bdc-604627ab8b61 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: f6bb3154-9ddf-428c-82cd-74ab476e5a0a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:49.641839 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f18a287e-6f31-4985-9bdc-604627ab8b61 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:49.642386 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f18a287e-6f31-4985-9bdc-604627ab8b61 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:49.643247 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f18a287e-6f31-4985-9bdc-604627ab8b61 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:49.643688 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f18a287e-6f31-4985-9bdc-604627ab8b61 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:49.732337 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-81356eb7-fa40-4cbe-bd7e-a14363c55b27 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:09:49.732898 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-81356eb7-fa40-4cbe-bd7e-a14363c55b27 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:09:49.733592 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-81356eb7-fa40-4cbe-bd7e-a14363c55b27 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:09:49.734228 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-81356eb7-fa40-4cbe-bd7e-a14363c55b27 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:09:49.734795 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-81356eb7-fa40-4cbe-bd7e-a14363c55b27 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:09:49.755992 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-81356eb7-fa40-4cbe-bd7e-a14363c55b27 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:49.756654 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-81356eb7-fa40-4cbe-bd7e-a14363c55b27 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:49.757703 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-81356eb7-fa40-4cbe-bd7e-a14363c55b27 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:49.758466 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-81356eb7-fa40-4cbe-bd7e-a14363c55b27 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:49.785021 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-81356eb7-fa40-4cbe-bd7e-a14363c55b27 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Getting quotas for project 82fb9d01363f47cb9b0e019ad014de68. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:09:49.795667 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-81356eb7-fa40-4cbe-bd7e-a14363c55b27 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Getting quotas for user 76416b44294f4adb8320be6c3032cf35 and project 82fb9d01363f47cb9b0e019ad014de68. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:09:49.827527 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f18a287e-6f31-4985-9bdc-604627ab8b61 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:49.841464 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f18a287e-6f31-4985-9bdc-604627ab8b61 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a" status: 200 len: 1521 microversion: 2.1 time: 0.211207 Jun 20 12:09:49.842523 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1393/2751] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:49 2022] GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:49.847049 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-03757501-87ba-48d0-b075-c8860d476a78 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:49.847665 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-03757501-87ba-48d0-b075-c8860d476a78 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:49.854496 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-03757501-87ba-48d0-b075-c8860d476a78 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:49.854954 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-03757501-87ba-48d0-b075-c8860d476a78 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:49.855737 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-03757501-87ba-48d0-b075-c8860d476a78 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:49.856190 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-03757501-87ba-48d0-b075-c8860d476a78 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:49.859177 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:50.034510 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-81356eb7-fa40-4cbe-bd7e-a14363c55b27 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:09:50.038850 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-81356eb7-fa40-4cbe-bd7e-a14363c55b27 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='990f4353-8fbc-4e22-adec-8b3cef7fc5a4',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='b2323cdb-877c-4bcf-99cd-33bccb866939',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='12bc588a-7788-4123-898f-c902252320a8',volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:09:50.057289 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-03757501-87ba-48d0-b075-c8860d476a78 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:50.061991 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-03757501-87ba-48d0-b075-c8860d476a78 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.218469 Jun 20 12:09:50.062735 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1394/2752] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:49 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:50.067807 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c6f48092-c501-4755-9590-ba7f9076990a tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:50.068587 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c6f48092-c501-4755-9590-ba7f9076990a tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:50.075816 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6f48092-c501-4755-9590-ba7f9076990a tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:50.076300 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6f48092-c501-4755-9590-ba7f9076990a tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:50.077139 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6f48092-c501-4755-9590-ba7f9076990a tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:50.077578 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6f48092-c501-4755-9590-ba7f9076990a tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:50.258478 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c6f48092-c501-4755-9590-ba7f9076990a tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:50.271690 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c6f48092-c501-4755-9590-ba7f9076990a tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41" status: 200 len: 1514 microversion: 2.1 time: 0.207531 Jun 20 12:09:50.272791 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1395/2753] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:50 2022] GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 => generated 1514 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:50.286785 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-514622c5-f734-4287-8df5-04aa50843be7 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-375654759", "metadata": {"": ""}}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-514622c5-f734-4287-8df5-04aa50843be7 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Request method failure captured: Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a/action HTTP/1.1 Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 106 Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGN4qiwM-MecDHxONzVMkA72NR_SSrElKGFho2amrxg9uMlhFTBY3bq5CJPNlZORM2tW_nQRhsPIUTgettXi4lSiCQeK40e01rW_16Lzz4FJO6EC5uBs_A-i3_njR3_9I2L-oxsuaQd8HwAiDLKOUCEhiwyWJOA1WjMqhqu3KfOGLgY Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 4880e508de374c748670ce9ff5963336 Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4880e508de374c748670ce9ff5963336"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4880e508de374c748670ce9ff5963336"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4880e508de374c748670ce9ff5963336"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4880e508de374c748670ce9ff5963336"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 4880e508de374c748670ce9ff5963336 Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ImagesOneServerNegativeTestJSON-1288781692-project Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 16367ef663a74bd49162b82a7e661d1e Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692-project Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-375654759", "metadata": {"": ""}}} Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'f6bb3154-9ddf-428c-82cd-74ab476e5a0a', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-375654759', 'metadata': {'': ''}}}} Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise error Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi {'': ''} Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:09:50.290381 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 12:09:50.297845 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 12:09:50.297845 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 12:09:50.297845 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 12:09:50.297845 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 12:09:50.297845 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 12:09:50.297845 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 20 12:09:50.297845 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:50.297845 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:50.297845 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:50.297845 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:50.297845 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:50.297845 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:50.297845 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 12:09:50.297845 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 12:09:50.297845 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 20 12:09:50.297845 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:50.297845 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-514622c5-f734-4287-8df5-04aa50843be7 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:09:50.297845 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-514622c5-f734-4287-8df5-04aa50843be7 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "POST /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a/action" status: 400 len: 170 microversion: 2.1 time: 0.010245 Jun 20 12:09:50.297845 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1396/2754] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Jun 20 12:09:50 2022] POST /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a/action => generated 170 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:09:50.302758 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-842537f6-aab3-4d70-861e-8c79b84a9523 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:50.303602 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-842537f6-aab3-4d70-861e-8c79b84a9523 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] [instance: 85c5ef58-2d37-49d6-8bf8-dded3d45965a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:50.313044 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-842537f6-aab3-4d70-861e-8c79b84a9523 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:50.314880 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-842537f6-aab3-4d70-861e-8c79b84a9523 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:50.316087 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-842537f6-aab3-4d70-861e-8c79b84a9523 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:50.317099 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-842537f6-aab3-4d70-861e-8c79b84a9523 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:50.496449 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-81356eb7-fa40-4cbe-bd7e-a14363c55b27 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 5.565158 Jun 20 12:09:50.498135 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1359/2755] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Jun 20 12:09:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 5567 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 20 12:09:50.503633 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4bd031bf-21e9-4ee8-aedb-14876c614f1e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:50.504684 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4bd031bf-21e9-4ee8-aedb-14876c614f1e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:50.512098 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4bd031bf-21e9-4ee8-aedb-14876c614f1e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:50.512834 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4bd031bf-21e9-4ee8-aedb-14876c614f1e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:50.513988 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4bd031bf-21e9-4ee8-aedb-14876c614f1e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:50.514601 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4bd031bf-21e9-4ee8-aedb-14876c614f1e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:50.586696 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-842537f6-aab3-4d70-861e-8c79b84a9523 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815408121fd94cc8897776382656d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e01ab560b24342983dc342c5235c03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:50.595261 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-842537f6-aab3-4d70-861e-8c79b84a9523 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] 10.222.0.27 "GET /compute/v2.1/servers/85c5ef58-2d37-49d6-8bf8-dded3d45965a" status: 200 len: 1324 microversion: 2.1 time: 0.299214 Jun 20 12:09:50.595884 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1397/2756] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:50 2022] GET /compute/v2.1/servers/85c5ef58-2d37-49d6-8bf8-dded3d45965a => generated 1324 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:50.611262 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d54919f6-a5c4-4fed-973a-6ef25881bc9a tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:50.612968 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d54919f6-a5c4-4fed-973a-6ef25881bc9a tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: f6bb3154-9ddf-428c-82cd-74ab476e5a0a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:50.628214 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d54919f6-a5c4-4fed-973a-6ef25881bc9a tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:50.629139 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d54919f6-a5c4-4fed-973a-6ef25881bc9a tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:50.630797 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d54919f6-a5c4-4fed-973a-6ef25881bc9a tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:50.631416 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d54919f6-a5c4-4fed-973a-6ef25881bc9a tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:50.823083 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d54919f6-a5c4-4fed-973a-6ef25881bc9a tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:50.831391 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d54919f6-a5c4-4fed-973a-6ef25881bc9a tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a" status: 200 len: 1521 microversion: 2.1 time: 0.233887 Jun 20 12:09:50.831987 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1398/2757] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:50 2022] GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:50.837308 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-255051b8-5dfd-4a75-ac50-64889fce3230 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:50.837956 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-255051b8-5dfd-4a75-ac50-64889fce3230 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:50.896020 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-255051b8-5dfd-4a75-ac50-64889fce3230 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:50.906082 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-255051b8-5dfd-4a75-ac50-64889fce3230 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:50.909194 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-255051b8-5dfd-4a75-ac50-64889fce3230 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:50.911446 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-255051b8-5dfd-4a75-ac50-64889fce3230 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1286 microversion: 2.32 time: 0.078020 Jun 20 12:09:50.912561 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1399/2758] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:09:50 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:09:50.918843 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-36a3211a-20ca-4bdd-8057-e4a26a268337 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:50.919485 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-36a3211a-20ca-4bdd-8057-e4a26a268337 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:50.926444 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36a3211a-20ca-4bdd-8057-e4a26a268337 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:50.926928 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36a3211a-20ca-4bdd-8057-e4a26a268337 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:50.927773 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36a3211a-20ca-4bdd-8057-e4a26a268337 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:50.928225 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36a3211a-20ca-4bdd-8057-e4a26a268337 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:51.044846 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4bd031bf-21e9-4ee8-aedb-14876c614f1e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:51.054268 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4bd031bf-21e9-4ee8-aedb-14876c614f1e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.554807 Jun 20 12:09:51.055445 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1360/2759] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:50 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:51.066745 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e72e50fe-ad4f-4533-a9b0-670c4da2257b tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:51.067490 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e72e50fe-ad4f-4533-a9b0-670c4da2257b tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: f6bb3154-9ddf-428c-82cd-74ab476e5a0a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:51.078481 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e72e50fe-ad4f-4533-a9b0-670c4da2257b tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:51.079232 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e72e50fe-ad4f-4533-a9b0-670c4da2257b tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:51.080259 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e72e50fe-ad4f-4533-a9b0-670c4da2257b tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:51.080898 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e72e50fe-ad4f-4533-a9b0-670c4da2257b tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:51.226190 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-36a3211a-20ca-4bdd-8057-e4a26a268337 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:51.236496 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-36a3211a-20ca-4bdd-8057-e4a26a268337 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1469 microversion: 2.1 time: 0.322440 Jun 20 12:09:51.238843 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1400/2760] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:50 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1469 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:51.258673 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ed46213b-e9b0-4456-906f-30a3350f22aa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:51.259483 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ed46213b-e9b0-4456-906f-30a3350f22aa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 2a1f6262-a0c6-4ee2-9317-1d8326c7737f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:51.277245 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-ed46213b-e9b0-4456-906f-30a3350f22aa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] HTTP exception thrown: Instance 2a1f6262-a0c6-4ee2-9317-1d8326c7737f could not be found. Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ed46213b-e9b0-4456-906f-30a3350f22aa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers/2a1f6262-a0c6-4ee2-9317-1d8326c7737f/action HTTP/1.1 Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 14 Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: {"shelve": {}} Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 2a1f6262-a0c6-4ee2-9317-1d8326c7737f could not be found. Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '2a1f6262-a0c6-4ee2-9317-1d8326c7737f', 'body': {'shelve': {}}} Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a1f6262-a0c6-4ee2-9317-1d8326c7737f could not be found. Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a1f6262-a0c6-4ee2-9317-1d8326c7737f could not be found. Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:51.287101 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:51.292267 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:09:51.292267 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:09:51.292267 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a1f6262-a0c6-4ee2-9317-1d8326c7737f could not be found. Jun 20 12:09:51.292267 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:51.296668 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ed46213b-e9b0-4456-906f-30a3350f22aa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 404 to user: Instance 2a1f6262-a0c6-4ee2-9317-1d8326c7737f could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:09:51.298660 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ed46213b-e9b0-4456-906f-30a3350f22aa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers/2a1f6262-a0c6-4ee2-9317-1d8326c7737f/action" status: 404 len: 111 microversion: 2.1 time: 0.056870 Jun 20 12:09:51.300344 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1401/2761] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:09:51 2022] POST /compute/v2.1/servers/2a1f6262-a0c6-4ee2-9317-1d8326c7737f/action => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:09:51.306034 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e72e50fe-ad4f-4533-a9b0-670c4da2257b tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:51.309982 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-38e68255-5a88-4278-9329-901cf0518d58 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:51.310812 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-38e68255-5a88-4278-9329-901cf0518d58 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:51.314308 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e72e50fe-ad4f-4533-a9b0-670c4da2257b tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a" status: 200 len: 1521 microversion: 2.1 time: 0.257785 Jun 20 12:09:51.321564 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:51.324073 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-38e68255-5a88-4278-9329-901cf0518d58 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:51.325087 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-38e68255-5a88-4278-9329-901cf0518d58 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:51.326124 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-38e68255-5a88-4278-9329-901cf0518d58 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:51.327519 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-38e68255-5a88-4278-9329-901cf0518d58 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:51.328597 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1361/2762] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:51 2022] GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:51.333849 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-44078562-682d-49a2-9b65-8f6c186b4490 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:51.337647 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-44078562-682d-49a2-9b65-8f6c186b4490 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:51.353461 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-44078562-682d-49a2-9b65-8f6c186b4490 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:51.354331 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-44078562-682d-49a2-9b65-8f6c186b4490 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:51.355648 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-44078562-682d-49a2-9b65-8f6c186b4490 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:51.356269 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-44078562-682d-49a2-9b65-8f6c186b4490 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:51.628851 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-44078562-682d-49a2-9b65-8f6c186b4490 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:51.637311 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-44078562-682d-49a2-9b65-8f6c186b4490 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.307498 Jun 20 12:09:51.650770 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1362/2763] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:51 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:51.656764 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-511e0a28-ce32-45c0-9759-830559acdb27 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-537327938", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-511e0a28-ce32-45c0-9759-830559acdb27 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Request method failure captured: Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a/action HTTP/1.1 Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 618 Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGN4qiwM-MecDHxONzVMkA72NR_SSrElKGFho2amrxg9uMlhFTBY3bq5CJPNlZORM2tW_nQRhsPIUTgettXi4lSiCQeK40e01rW_16Lzz4FJO6EC5uBs_A-i3_njR3_9I2L-oxsuaQd8HwAiDLKOUCEhiwyWJOA1WjMqhqu3KfOGLgY Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 4880e508de374c748670ce9ff5963336 Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4880e508de374c748670ce9ff5963336"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4880e508de374c748670ce9ff5963336"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4880e508de374c748670ce9ff5963336"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4880e508de374c748670ce9ff5963336"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 4880e508de374c748670ce9ff5963336 Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ImagesOneServerNegativeTestJSON-1288781692-project Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 16367ef663a74bd49162b82a7e661d1e Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692-project Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-537327938", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'f6bb3154-9ddf-428c-82cd-74ab476e5a0a', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-537327938', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 12:09:51.660119 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise error Jun 20 12:09:51.663680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 20 12:09:51.663680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:51.663680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jun 20 12:09:51.663680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 20 12:09:51.663680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 20 12:09:51.663680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 20 12:09:51.663680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 20 12:09:51.663680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:51.663680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jun 20 12:09:51.663680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Jun 20 12:09:51.663680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:51.663680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:51.663680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:51.663680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:51.663680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:51.663680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:51.663680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:09:51.663680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:09:51.663680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:09:51.663680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:09:51.663680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:09:51.663680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:09:51.663680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 12:09:51.663680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 12:09:51.663680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 12:09:51.663680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 12:09:51.663680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 12:09:51.663680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 12:09:51.663680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 20 12:09:51.663680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:51.663680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:51.663680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:51.663680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:51.663680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:51.663680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:51.663680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 12:09:51.663680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 12:09:51.663680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 20 12:09:51.663680 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:51.667675 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-511e0a28-ce32-45c0-9759-830559acdb27 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:09:51.670082 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-511e0a28-ce32-45c0-9759-830559acdb27 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "POST /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a/action" status: 400 len: 938 microversion: 2.1 time: 0.017821 Jun 20 12:09:51.673164 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1363/2764] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Jun 20 12:09:51 2022] POST /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a/action => generated 938 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:09:51.688637 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-31e673c1-006c-42d6-bfcc-6f07eed653f3 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:51.689264 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-31e673c1-006c-42d6-bfcc-6f07eed653f3 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] [instance: 85c5ef58-2d37-49d6-8bf8-dded3d45965a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:51.706873 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-31e673c1-006c-42d6-bfcc-6f07eed653f3 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:51.707895 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-31e673c1-006c-42d6-bfcc-6f07eed653f3 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:51.716189 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-31e673c1-006c-42d6-bfcc-6f07eed653f3 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:51.716641 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-31e673c1-006c-42d6-bfcc-6f07eed653f3 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:51.955138 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-31e673c1-006c-42d6-bfcc-6f07eed653f3 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815408121fd94cc8897776382656d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e01ab560b24342983dc342c5235c03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:51.965947 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-31e673c1-006c-42d6-bfcc-6f07eed653f3 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] 10.222.0.27 "GET /compute/v2.1/servers/85c5ef58-2d37-49d6-8bf8-dded3d45965a" status: 200 len: 1324 microversion: 2.1 time: 0.288376 Jun 20 12:09:51.978612 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1364/2765] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:51 2022] GET /compute/v2.1/servers/85c5ef58-2d37-49d6-8bf8-dded3d45965a => generated 1324 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:51.986127 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-eccf7bdd-5ccc-40f7-b209-f59d86f67f27 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:51.987379 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-eccf7bdd-5ccc-40f7-b209-f59d86f67f27 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:51.996395 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eccf7bdd-5ccc-40f7-b209-f59d86f67f27 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:51.997359 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eccf7bdd-5ccc-40f7-b209-f59d86f67f27 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:51.999726 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eccf7bdd-5ccc-40f7-b209-f59d86f67f27 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:52.000666 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eccf7bdd-5ccc-40f7-b209-f59d86f67f27 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:52.198761 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-eccf7bdd-5ccc-40f7-b209-f59d86f67f27 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:52.214221 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-eccf7bdd-5ccc-40f7-b209-f59d86f67f27 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.233982 Jun 20 12:09:52.217981 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1365/2766] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:51 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:52.225556 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d6dc2bbf-417b-4bb9-8b12-635a1a9e5dcd tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:52.226936 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d6dc2bbf-417b-4bb9-8b12-635a1a9e5dcd tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: f6bb3154-9ddf-428c-82cd-74ab476e5a0a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:52.237239 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=92,nova_api:UPDATE=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:52.272348 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6dc2bbf-417b-4bb9-8b12-635a1a9e5dcd tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:52.273670 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6dc2bbf-417b-4bb9-8b12-635a1a9e5dcd tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:52.274749 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6dc2bbf-417b-4bb9-8b12-635a1a9e5dcd tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:52.276446 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-38e68255-5a88-4278-9329-901cf0518d58 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:52.277488 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6dc2bbf-417b-4bb9-8b12-635a1a9e5dcd tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:52.291046 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-38e68255-5a88-4278-9329-901cf0518d58 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41" status: 200 len: 1514 microversion: 2.1 time: 0.989493 Jun 20 12:09:52.291995 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1402/2767] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:51 2022] GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 => generated 1514 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:52.296926 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cf32d329-ae39-4d91-a27e-3974abe6af36 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:52.317197 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cf32d329-ae39-4d91-a27e-3974abe6af36 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:52.338103 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cf32d329-ae39-4d91-a27e-3974abe6af36 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:52.338853 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cf32d329-ae39-4d91-a27e-3974abe6af36 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:52.342292 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cf32d329-ae39-4d91-a27e-3974abe6af36 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:52.342292 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cf32d329-ae39-4d91-a27e-3974abe6af36 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:52.348962 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:52.539454 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d6dc2bbf-417b-4bb9-8b12-635a1a9e5dcd tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:52.548440 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d6dc2bbf-417b-4bb9-8b12-635a1a9e5dcd tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a" status: 200 len: 1521 microversion: 2.1 time: 0.328502 Jun 20 12:09:52.561786 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cf32d329-ae39-4d91-a27e-3974abe6af36 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:52.575098 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1366/2768] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:52 2022] GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:52.581958 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9466d147-6bd1-4c2f-9a17-2e1d67f06a93 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:52.582969 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9466d147-6bd1-4c2f-9a17-2e1d67f06a93 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:52.591975 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9466d147-6bd1-4c2f-9a17-2e1d67f06a93 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:52.592917 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9466d147-6bd1-4c2f-9a17-2e1d67f06a93 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:52.594257 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9466d147-6bd1-4c2f-9a17-2e1d67f06a93 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:52.594912 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9466d147-6bd1-4c2f-9a17-2e1d67f06a93 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:52.608338 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cf32d329-ae39-4d91-a27e-3974abe6af36 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:52.610720 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cf32d329-ae39-4d91-a27e-3974abe6af36 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:52.612569 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cf32d329-ae39-4d91-a27e-3974abe6af36 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1576 microversion: 2.32 time: 0.319261 Jun 20 12:09:52.615588 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1403/2769] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:09:52 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1576 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:09:52.623039 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bf18185e-8214-4a25-86ee-2241fa0a0c72 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:52.623996 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bf18185e-8214-4a25-86ee-2241fa0a0c72 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:52.635931 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf18185e-8214-4a25-86ee-2241fa0a0c72 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:52.637719 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf18185e-8214-4a25-86ee-2241fa0a0c72 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:52.638888 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf18185e-8214-4a25-86ee-2241fa0a0c72 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:52.639856 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf18185e-8214-4a25-86ee-2241fa0a0c72 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:52.667794 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-9466d147-6bd1-4c2f-9a17-2e1d67f06a93 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lazy-loading 'flavor' on Instance uuid 593cda12-6491-4a27-8fc7-42c05e0291c3 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:09:53.193935 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9466d147-6bd1-4c2f-9a17-2e1d67f06a93 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3/action" status: 202 len: 0 microversion: 2.1 time: 0.616332 Jun 20 12:09:53.195109 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1367/2770] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:09:52 2022] POST /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3/action => generated 0 bytes in 619 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:09:53.206086 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1545e371-b875-4eab-979b-047516e57ea6 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:53.207492 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1545e371-b875-4eab-979b-047516e57ea6 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: f6bb3154-9ddf-428c-82cd-74ab476e5a0a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:53.215729 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1545e371-b875-4eab-979b-047516e57ea6 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:53.217191 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1545e371-b875-4eab-979b-047516e57ea6 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:53.218547 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1545e371-b875-4eab-979b-047516e57ea6 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:53.220544 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1545e371-b875-4eab-979b-047516e57ea6 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:53.299827 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bf18185e-8214-4a25-86ee-2241fa0a0c72 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:53.314739 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bf18185e-8214-4a25-86ee-2241fa0a0c72 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1535 microversion: 2.1 time: 0.696465 Jun 20 12:09:53.320548 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1404/2771] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:52 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1535 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:53.330638 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d3a6e840-fb45-4839-92b6-acc38ad8e47a tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:53.332995 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d3a6e840-fb45-4839-92b6-acc38ad8e47a tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] [instance: 85c5ef58-2d37-49d6-8bf8-dded3d45965a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:53.351995 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d3a6e840-fb45-4839-92b6-acc38ad8e47a tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:53.354300 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d3a6e840-fb45-4839-92b6-acc38ad8e47a tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:53.355629 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d3a6e840-fb45-4839-92b6-acc38ad8e47a tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:53.360543 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d3a6e840-fb45-4839-92b6-acc38ad8e47a tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:53.527791 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1545e371-b875-4eab-979b-047516e57ea6 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:53.540322 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1545e371-b875-4eab-979b-047516e57ea6 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a" status: 200 len: 1521 microversion: 2.1 time: 0.343671 Jun 20 12:09:53.541383 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1368/2772] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:53 2022] GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a => generated 1521 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:53.547004 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-71666581-bdfc-47c7-9928-e9bc2b3ac934 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:53.547907 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-71666581-bdfc-47c7-9928-e9bc2b3ac934 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:53.555749 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-71666581-bdfc-47c7-9928-e9bc2b3ac934 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:53.556983 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-71666581-bdfc-47c7-9928-e9bc2b3ac934 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:53.558013 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-71666581-bdfc-47c7-9928-e9bc2b3ac934 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:53.558657 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-71666581-bdfc-47c7-9928-e9bc2b3ac934 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:53.913172 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d3a6e840-fb45-4839-92b6-acc38ad8e47a tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815408121fd94cc8897776382656d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e01ab560b24342983dc342c5235c03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:53.927987 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d3a6e840-fb45-4839-92b6-acc38ad8e47a tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] 10.222.0.27 "GET /compute/v2.1/servers/85c5ef58-2d37-49d6-8bf8-dded3d45965a" status: 200 len: 1324 microversion: 2.1 time: 0.605790 Jun 20 12:09:53.932567 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1405/2773] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:53 2022] GET /compute/v2.1/servers/85c5ef58-2d37-49d6-8bf8-dded3d45965a => generated 1324 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:53.946420 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4f360986-1c46-486f-805a-09bb437fd432 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:53.947344 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4f360986-1c46-486f-805a-09bb437fd432 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:53.969883 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4f360986-1c46-486f-805a-09bb437fd432 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:53.970794 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4f360986-1c46-486f-805a-09bb437fd432 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:53.971795 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4f360986-1c46-486f-805a-09bb437fd432 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:53.974337 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4f360986-1c46-486f-805a-09bb437fd432 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:54.288362 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-71666581-bdfc-47c7-9928-e9bc2b3ac934 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:54.302514 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-71666581-bdfc-47c7-9928-e9bc2b3ac934 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1512 microversion: 2.1 time: 0.759574 Jun 20 12:09:54.314862 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1369/2774] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:53 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1512 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:54.320585 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7d2594a3-d117-4175-8041-252ce5ae155c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7d2594a3-d117-4175-8041-252ce5ae155c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Request method failure captured: Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a/action HTTP/1.1 Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 285 Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGN4qiwM-MecDHxONzVMkA72NR_SSrElKGFho2amrxg9uMlhFTBY3bq5CJPNlZORM2tW_nQRhsPIUTgettXi4lSiCQeK40e01rW_16Lzz4FJO6EC5uBs_A-i3_njR3_9I2L-oxsuaQd8HwAiDLKOUCEhiwyWJOA1WjMqhqu3KfOGLgY Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 4880e508de374c748670ce9ff5963336 Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4880e508de374c748670ce9ff5963336"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4880e508de374c748670ce9ff5963336"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4880e508de374c748670ce9ff5963336"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4880e508de374c748670ce9ff5963336"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 4880e508de374c748670ce9ff5963336 Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ImagesOneServerNegativeTestJSON-1288781692-project Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 16367ef663a74bd49162b82a7e661d1e Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692-project Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'f6bb3154-9ddf-428c-82cd-74ab476e5a0a', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise error Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:54.325810 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:54.329230 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:54.329230 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:54.329230 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:09:54.329230 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:09:54.329230 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:09:54.329230 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:09:54.329230 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:09:54.329230 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:09:54.329230 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 12:09:54.329230 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 12:09:54.329230 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 12:09:54.329230 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 12:09:54.329230 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 12:09:54.329230 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 12:09:54.329230 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 20 12:09:54.329230 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:54.329230 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:54.329230 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:54.329230 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:54.329230 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:54.329230 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:54.329230 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 12:09:54.329230 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 12:09:54.329230 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 20 12:09:54.329230 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:09:54.334761 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7d2594a3-d117-4175-8041-252ce5ae155c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:09:54.337541 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7d2594a3-d117-4175-8041-252ce5ae155c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "POST /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a/action" status: 400 len: 619 microversion: 2.1 time: 0.020979 Jun 20 12:09:54.339080 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1370/2775] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Jun 20 12:09:54 2022] POST /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a/action => generated 619 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:09:54.348252 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0d8a5fca-8e51-4064-9243-159d25b32030 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:54.349345 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0d8a5fca-8e51-4064-9243-159d25b32030 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:54.380866 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d8a5fca-8e51-4064-9243-159d25b32030 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:54.382173 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d8a5fca-8e51-4064-9243-159d25b32030 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:54.386621 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d8a5fca-8e51-4064-9243-159d25b32030 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:54.388009 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d8a5fca-8e51-4064-9243-159d25b32030 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:54.471557 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4f360986-1c46-486f-805a-09bb437fd432 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:54.486922 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4f360986-1c46-486f-805a-09bb437fd432 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41" status: 200 len: 1514 microversion: 2.1 time: 0.552962 Jun 20 12:09:54.487838 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1406/2776] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:53 2022] GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 => generated 1514 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:54.492577 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-ba41e998-7859-425c-a426-26fe682386eb req-31582cf5-3ef6-4ec2-aebc-c04d869ef7f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c5ef58-2d37-49d6-8bf8-dded3d45965a", "name": "network-vif-plugged", "status": "completed", "tag": "9031fd5a-b1b5-4a9c-be6b-39f81e3cb9aa"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:54.543122 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ba41e998-7859-425c-a426-26fe682386eb req-31582cf5-3ef6-4ec2-aebc-c04d869ef7f8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:54.543554 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ba41e998-7859-425c-a426-26fe682386eb req-31582cf5-3ef6-4ec2-aebc-c04d869ef7f8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:54.564980 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0d8a5fca-8e51-4064-9243-159d25b32030 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:54.568493 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-ba41e998-7859-425c-a426-26fe682386eb req-31582cf5-3ef6-4ec2-aebc-c04d869ef7f8 service nova] Creating event network-vif-plugged:9031fd5a-b1b5-4a9c-be6b-39f81e3cb9aa for instance 85c5ef58-2d37-49d6-8bf8-dded3d45965a on n-h2-master-1 Jun 20 12:09:54.578058 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0d8a5fca-8e51-4064-9243-159d25b32030 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:54.581047 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0d8a5fca-8e51-4064-9243-159d25b32030 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:54.582394 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-ba41e998-7859-425c-a426-26fe682386eb req-31582cf5-3ef6-4ec2-aebc-c04d869ef7f8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093105 Jun 20 12:09:54.583783 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1407/2777] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:09:54.585490 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0d8a5fca-8e51-4064-9243-159d25b32030 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1594 microversion: 2.32 time: 0.244383 Jun 20 12:09:54.587915 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1371/2778] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:09:54 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1594 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:09:54.594517 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-409a8133-4d1b-4594-a55d-84d5a5fd82c0 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:54.595384 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-409a8133-4d1b-4594-a55d-84d5a5fd82c0 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:54.595841 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9923badb-7832-42a0-bffa-ee2dc626ace1 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:54.597447 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9923badb-7832-42a0-bffa-ee2dc626ace1 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: f6bb3154-9ddf-428c-82cd-74ab476e5a0a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:54.606934 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9923badb-7832-42a0-bffa-ee2dc626ace1 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:54.607636 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9923badb-7832-42a0-bffa-ee2dc626ace1 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:54.608918 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9923badb-7832-42a0-bffa-ee2dc626ace1 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:54.609601 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9923badb-7832-42a0-bffa-ee2dc626ace1 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:54.610359 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-409a8133-4d1b-4594-a55d-84d5a5fd82c0 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:54.610832 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-409a8133-4d1b-4594-a55d-84d5a5fd82c0 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:54.619876 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-409a8133-4d1b-4594-a55d-84d5a5fd82c0 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:54.620557 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-409a8133-4d1b-4594-a55d-84d5a5fd82c0 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:55.121830 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-409a8133-4d1b-4594-a55d-84d5a5fd82c0 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:55.131416 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-409a8133-4d1b-4594-a55d-84d5a5fd82c0 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1535 microversion: 2.1 time: 0.542067 Jun 20 12:09:55.138835 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1408/2779] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:54 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1535 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:55.151199 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-eb12a062-7756-46ad-8592-c16840f150b0 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:55.156053 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-eb12a062-7756-46ad-8592-c16840f150b0 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] [instance: 85c5ef58-2d37-49d6-8bf8-dded3d45965a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:55.165952 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb12a062-7756-46ad-8592-c16840f150b0 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:55.166788 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb12a062-7756-46ad-8592-c16840f150b0 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:55.167815 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb12a062-7756-46ad-8592-c16840f150b0 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:55.168596 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb12a062-7756-46ad-8592-c16840f150b0 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:55.316744 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9923badb-7832-42a0-bffa-ee2dc626ace1 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:55.329588 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9923badb-7832-42a0-bffa-ee2dc626ace1 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a" status: 200 len: 1521 microversion: 2.1 time: 0.740309 Jun 20 12:09:55.330444 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1372/2780] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:54 2022] GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a => generated 1521 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:55.335717 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b5b3e697-60be-4941-9f52-04f79c406b1b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:55.336577 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b5b3e697-60be-4941-9f52-04f79c406b1b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:55.346002 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b5b3e697-60be-4941-9f52-04f79c406b1b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:55.346758 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b5b3e697-60be-4941-9f52-04f79c406b1b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:55.349550 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b5b3e697-60be-4941-9f52-04f79c406b1b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:55.350288 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b5b3e697-60be-4941-9f52-04f79c406b1b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:55.446007 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-eb12a062-7756-46ad-8592-c16840f150b0 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815408121fd94cc8897776382656d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e01ab560b24342983dc342c5235c03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:55.456333 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-eb12a062-7756-46ad-8592-c16840f150b0 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] 10.222.0.27 "GET /compute/v2.1/servers/85c5ef58-2d37-49d6-8bf8-dded3d45965a" status: 200 len: 1324 microversion: 2.1 time: 0.315584 Jun 20 12:09:55.466792 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1409/2781] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:55 2022] GET /compute/v2.1/servers/85c5ef58-2d37-49d6-8bf8-dded3d45965a => generated 1324 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:55.472333 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-71e36c4f-4a36-49f6-9715-633b12525a78 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:55.474151 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-71e36c4f-4a36-49f6-9715-633b12525a78 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: f6bb3154-9ddf-428c-82cd-74ab476e5a0a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:55.482460 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-71e36c4f-4a36-49f6-9715-633b12525a78 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:55.485610 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-71e36c4f-4a36-49f6-9715-633b12525a78 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:55.488095 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-71e36c4f-4a36-49f6-9715-633b12525a78 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:55.488910 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-71e36c4f-4a36-49f6-9715-633b12525a78 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:55.801564 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-71e36c4f-4a36-49f6-9715-633b12525a78 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:55.810660 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-71e36c4f-4a36-49f6-9715-633b12525a78 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a" status: 200 len: 1521 microversion: 2.1 time: 0.342314 Jun 20 12:09:55.823455 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1410/2782] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:55 2022] GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a => generated 1521 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:55.828766 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-eb1b23af-1316-4cb5-882a-dd53c29ddeb4 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:55.831948 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-eb1b23af-1316-4cb5-882a-dd53c29ddeb4 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:55.850537 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb1b23af-1316-4cb5-882a-dd53c29ddeb4 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:55.857952 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb1b23af-1316-4cb5-882a-dd53c29ddeb4 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:55.859146 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb1b23af-1316-4cb5-882a-dd53c29ddeb4 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:55.859805 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb1b23af-1316-4cb5-882a-dd53c29ddeb4 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:55.917886 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b5b3e697-60be-4941-9f52-04f79c406b1b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:55.944950 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b5b3e697-60be-4941-9f52-04f79c406b1b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1512 microversion: 2.1 time: 0.613240 Jun 20 12:09:55.948358 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1373/2783] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:55 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1512 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:55.959368 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b1398105-3871-48e3-8ad0-a2750c52d181 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:55.960563 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b1398105-3871-48e3-8ad0-a2750c52d181 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:55.976416 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b1398105-3871-48e3-8ad0-a2750c52d181 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:55.980860 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b1398105-3871-48e3-8ad0-a2750c52d181 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:55.983103 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b1398105-3871-48e3-8ad0-a2750c52d181 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:55.990032 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b1398105-3871-48e3-8ad0-a2750c52d181 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:56.241697 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-eb1b23af-1316-4cb5-882a-dd53c29ddeb4 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:56.259100 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-eb1b23af-1316-4cb5-882a-dd53c29ddeb4 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41" status: 200 len: 1514 microversion: 2.1 time: 0.434026 Jun 20 12:09:56.260054 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1411/2784] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:55 2022] GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 => generated 1514 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:56.272392 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-98d176b7-67d8-47fc-b9c2-483fa3d3de9a tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-349490797"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:56.273614 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-98d176b7-67d8-47fc-b9c2-483fa3d3de9a tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: f6bb3154-9ddf-428c-82cd-74ab476e5a0a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:56.289678 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-98d176b7-67d8-47fc-b9c2-483fa3d3de9a tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:56.290142 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-98d176b7-67d8-47fc-b9c2-483fa3d3de9a tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:56.290936 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-98d176b7-67d8-47fc-b9c2-483fa3d3de9a tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:56.291393 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-98d176b7-67d8-47fc-b9c2-483fa3d3de9a tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:56.724564 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-98d176b7-67d8-47fc-b9c2-483fa3d3de9a tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "POST /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a/action" status: 202 len: 0 microversion: 2.1 time: 0.462473 Jun 20 12:09:56.730896 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1412/2785] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:09:56 2022] POST /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 20 12:09:56.733471 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b1e00948-aa13-478b-926a-2646e8b984fd tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:56.734714 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b1e00948-aa13-478b-926a-2646e8b984fd tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:56.744089 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b1e00948-aa13-478b-926a-2646e8b984fd tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:56.745128 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b1e00948-aa13-478b-926a-2646e8b984fd tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:56.746779 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b1e00948-aa13-478b-926a-2646e8b984fd tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:56.747716 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b1e00948-aa13-478b-926a-2646e8b984fd tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:56.754637 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:56.788469 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b1398105-3871-48e3-8ad0-a2750c52d181 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:56.802048 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b1398105-3871-48e3-8ad0-a2750c52d181 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:56.805759 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b1398105-3871-48e3-8ad0-a2750c52d181 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:56.810964 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b1398105-3871-48e3-8ad0-a2750c52d181 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1661 microversion: 2.32 time: 0.861225 Jun 20 12:09:56.813222 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1374/2786] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:09:55 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1661 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:09:56.825352 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7b94169d-3146-439c-aea5-cf1d3a5bf929 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:56.830704 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7b94169d-3146-439c-aea5-cf1d3a5bf929 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] [instance: 85c5ef58-2d37-49d6-8bf8-dded3d45965a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:56.866210 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7b94169d-3146-439c-aea5-cf1d3a5bf929 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:56.867252 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7b94169d-3146-439c-aea5-cf1d3a5bf929 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:56.869421 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7b94169d-3146-439c-aea5-cf1d3a5bf929 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:56.870157 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7b94169d-3146-439c-aea5-cf1d3a5bf929 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:57.027567 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b1e00948-aa13-478b-926a-2646e8b984fd tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:57.035953 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b1e00948-aa13-478b-926a-2646e8b984fd tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1535 microversion: 2.1 time: 0.307900 Jun 20 12:09:57.036909 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1413/2787] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:56 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1535 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:57.041764 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-78c7942b-0409-480d-a9f9-ff441347ede5 req-c70fb088-0405-4f59-80af-2cf0f0225e51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8b3d285-0f08-4deb-859e-babab7f3b656", "name": "network-vif-unplugged", "status": "completed", "tag": "e23efb88-f8d5-4db8-8321-1c16dca584be"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:57.050325 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-78c7942b-0409-480d-a9f9-ff441347ede5 req-c70fb088-0405-4f59-80af-2cf0f0225e51 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:57.050851 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-78c7942b-0409-480d-a9f9-ff441347ede5 req-c70fb088-0405-4f59-80af-2cf0f0225e51 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:57.064915 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-78c7942b-0409-480d-a9f9-ff441347ede5 req-c70fb088-0405-4f59-80af-2cf0f0225e51 service nova] Creating event network-vif-unplugged:e23efb88-f8d5-4db8-8321-1c16dca584be for instance f8b3d285-0f08-4deb-859e-babab7f3b656 on n-h2-master-1 Jun 20 12:09:57.071328 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [req-78c7942b-0409-480d-a9f9-ff441347ede5 req-c70fb088-0405-4f59-80af-2cf0f0225e51 service nova] Instance f8b3d285-0f08-4deb-859e-babab7f3b656 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1'} {{(pid=119127) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:09:57.078380 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-78c7942b-0409-480d-a9f9-ff441347ede5 req-c70fb088-0405-4f59-80af-2cf0f0225e51 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040180 Jun 20 12:09:57.079174 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1414/2788] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:09:57.088771 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cc1a411e-49d0-4fc3-9c14-7e1a0de03dbe tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1065013589"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:09:57.089916 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cc1a411e-49d0-4fc3-9c14-7e1a0de03dbe tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: f6bb3154-9ddf-428c-82cd-74ab476e5a0a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:57.096727 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cc1a411e-49d0-4fc3-9c14-7e1a0de03dbe tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:57.097270 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cc1a411e-49d0-4fc3-9c14-7e1a0de03dbe tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:57.098278 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cc1a411e-49d0-4fc3-9c14-7e1a0de03dbe tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:57.098751 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cc1a411e-49d0-4fc3-9c14-7e1a0de03dbe tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:57.147428 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-cc1a411e-49d0-4fc3-9c14-7e1a0de03dbe tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] HTTP exception thrown: Cannot 'createImage' instance f6bb3154-9ddf-428c-82cd-74ab476e5a0a while it is in task_state image_snapshot Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cc1a411e-49d0-4fc3-9c14-7e1a0de03dbe tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Request method failure captured: Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a/action HTTP/1.1 Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 85 Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGN4qiwM-MecDHxONzVMkA72NR_SSrElKGFho2amrxg9uMlhFTBY3bq5CJPNlZORM2tW_nQRhsPIUTgettXi4lSiCQeK40e01rW_16Lzz4FJO6EC5uBs_A-i3_njR3_9I2L-oxsuaQd8HwAiDLKOUCEhiwyWJOA1WjMqhqu3KfOGLgY Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 4880e508de374c748670ce9ff5963336 Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4880e508de374c748670ce9ff5963336"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4880e508de374c748670ce9ff5963336"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4880e508de374c748670ce9ff5963336"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4880e508de374c748670ce9ff5963336"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 4880e508de374c748670ce9ff5963336 Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ImagesOneServerNegativeTestJSON-1288781692-project Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 16367ef663a74bd49162b82a7e661d1e Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692-project Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1065013589"}} Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: exception: Cannot 'createImage' instance f6bb3154-9ddf-428c-82cd-74ab476e5a0a while it is in task_state image_snapshot Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'f6bb3154-9ddf-428c-82cd-74ab476e5a0a', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1065013589'}}} Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f6bb3154-9ddf-428c-82cd-74ab476e5a0a in task_state image_snapshot. Cannot snapshot while the instance is in this state. Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 20 12:09:57.149830 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance f6bb3154-9ddf-428c-82cd-74ab476e5a0a while it is in task_state image_snapshot Jun 20 12:09:57.153524 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:57.153524 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:09:57.153524 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:57.153524 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:09:57.153524 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:09:57.153524 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:09:57.153524 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:09:57.153524 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:09:57.153524 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance f6bb3154-9ddf-428c-82cd-74ab476e5a0a while it is in task_state image_snapshot Jun 20 12:09:57.153524 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:09:57.153524 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cc1a411e-49d0-4fc3-9c14-7e1a0de03dbe tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Returning 409 to user: Cannot 'createImage' instance f6bb3154-9ddf-428c-82cd-74ab476e5a0a while it is in task_state image_snapshot {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:09:57.153524 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cc1a411e-49d0-4fc3-9c14-7e1a0de03dbe tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "POST /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a/action" status: 409 len: 159 microversion: 2.1 time: 0.071193 Jun 20 12:09:57.156576 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1415/2789] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:09:57 2022] POST /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a/action => generated 159 bytes in 77 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:09:57.162363 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-22ee6970-116e-4503-a400-6608f7261492 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:57.163486 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-22ee6970-116e-4503-a400-6608f7261492 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:57.170438 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-22ee6970-116e-4503-a400-6608f7261492 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:57.171244 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-22ee6970-116e-4503-a400-6608f7261492 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:57.171693 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-22ee6970-116e-4503-a400-6608f7261492 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:57.172132 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-22ee6970-116e-4503-a400-6608f7261492 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:57.199785 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7b94169d-3146-439c-aea5-cf1d3a5bf929 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815408121fd94cc8897776382656d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e01ab560b24342983dc342c5235c03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:57.211633 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7b94169d-3146-439c-aea5-cf1d3a5bf929 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] 10.222.0.27 "GET /compute/v2.1/servers/85c5ef58-2d37-49d6-8bf8-dded3d45965a" status: 200 len: 1324 microversion: 2.1 time: 0.397012 Jun 20 12:09:57.213132 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1375/2790] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:56 2022] GET /compute/v2.1/servers/85c5ef58-2d37-49d6-8bf8-dded3d45965a => generated 1324 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:57.230221 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7ef4b060-6823-43d3-9ef5-cb84e729cba9 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '.version_select at 0x7f60731b3700>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:57.471862 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7ef4b060-6823-43d3-9ef5-cb84e729cba9 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "DELETE /compute/v2.1/images/d8a0f83c-d4a1-44fc-b026-220969de328b" status: 204 len: 0 microversion: 2.1 time: 0.254430 Jun 20 12:09:57.472882 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1376/2791] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:57 2022] DELETE /compute/v2.1/images/d8a0f83c-d4a1-44fc-b026-220969de328b => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:09:57.479626 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-867f1c29-96af-41ce-afe9-08312061bdbb tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:57.480299 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-867f1c29-96af-41ce-afe9-08312061bdbb tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:57.490552 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-867f1c29-96af-41ce-afe9-08312061bdbb tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:57.491177 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-867f1c29-96af-41ce-afe9-08312061bdbb tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:57.492033 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-867f1c29-96af-41ce-afe9-08312061bdbb tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:57.492560 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-867f1c29-96af-41ce-afe9-08312061bdbb tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:57.561405 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-22ee6970-116e-4503-a400-6608f7261492 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:57.570392 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-22ee6970-116e-4503-a400-6608f7261492 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1512 microversion: 2.1 time: 0.412586 Jun 20 12:09:57.570987 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1416/2792] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:57 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1512 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:57.579801 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-96b8db8c-5a5a-4e77-a4b7-3874f426e967 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:57.583829 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-96b8db8c-5a5a-4e77-a4b7-3874f426e967 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: f6bb3154-9ddf-428c-82cd-74ab476e5a0a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:57.601582 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-96b8db8c-5a5a-4e77-a4b7-3874f426e967 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:57.602301 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-96b8db8c-5a5a-4e77-a4b7-3874f426e967 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:57.603245 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-96b8db8c-5a5a-4e77-a4b7-3874f426e967 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:57.603842 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-96b8db8c-5a5a-4e77-a4b7-3874f426e967 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:58.424526 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-867f1c29-96af-41ce-afe9-08312061bdbb tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:58.435190 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-867f1c29-96af-41ce-afe9-08312061bdbb tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41" status: 200 len: 1514 microversion: 2.1 time: 0.961045 Jun 20 12:09:58.435598 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1377/2793] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:57 2022] GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 => generated 1514 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:58.459527 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5224bc35-e9a8-474b-9f26-8458ac130105 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:58.460816 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5224bc35-e9a8-474b-9f26-8458ac130105 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:58.468049 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5224bc35-e9a8-474b-9f26-8458ac130105 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:58.468778 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5224bc35-e9a8-474b-9f26-8458ac130105 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:58.469928 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5224bc35-e9a8-474b-9f26-8458ac130105 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:58.470910 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5224bc35-e9a8-474b-9f26-8458ac130105 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:58.625985 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-96b8db8c-5a5a-4e77-a4b7-3874f426e967 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:58.635891 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-96b8db8c-5a5a-4e77-a4b7-3874f426e967 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a" status: 200 len: 1533 microversion: 2.1 time: 1.061096 Jun 20 12:09:58.640381 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1417/2794] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:57 2022] GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a => generated 1533 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:58.653502 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d78c2eaa-c3f0-4bac-9e62-1c3e9fce419b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:58.656312 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d78c2eaa-c3f0-4bac-9e62-1c3e9fce419b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:58.680642 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d78c2eaa-c3f0-4bac-9e62-1c3e9fce419b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:58.681116 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d78c2eaa-c3f0-4bac-9e62-1c3e9fce419b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:58.682281 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d78c2eaa-c3f0-4bac-9e62-1c3e9fce419b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:58.682725 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d78c2eaa-c3f0-4bac-9e62-1c3e9fce419b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:59.137580 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d78c2eaa-c3f0-4bac-9e62-1c3e9fce419b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:59.152583 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d78c2eaa-c3f0-4bac-9e62-1c3e9fce419b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1528 microversion: 2.1 time: 0.503676 Jun 20 12:09:59.155460 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1418/2795] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:58 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1528 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:59.169249 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9752cd83-e53f-4df4-a694-886f5a457745 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:59.174829 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9752cd83-e53f-4df4-a694-886f5a457745 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] [instance: 85c5ef58-2d37-49d6-8bf8-dded3d45965a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:59.191775 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9752cd83-e53f-4df4-a694-886f5a457745 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:59.192373 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9752cd83-e53f-4df4-a694-886f5a457745 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:59.193057 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9752cd83-e53f-4df4-a694-886f5a457745 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:59.193496 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9752cd83-e53f-4df4-a694-886f5a457745 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:59.522804 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9752cd83-e53f-4df4-a694-886f5a457745 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815408121fd94cc8897776382656d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e01ab560b24342983dc342c5235c03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:59.547063 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9752cd83-e53f-4df4-a694-886f5a457745 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] 10.222.0.27 "GET /compute/v2.1/servers/85c5ef58-2d37-49d6-8bf8-dded3d45965a" status: 200 len: 1324 microversion: 2.1 time: 0.390038 Jun 20 12:09:59.549867 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1419/2796] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:59 2022] GET /compute/v2.1/servers/85c5ef58-2d37-49d6-8bf8-dded3d45965a => generated 1324 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:09:59.558920 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5c758d78-3cd0-48db-8f9c-3156d27450f2 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:59.563804 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5c758d78-3cd0-48db-8f9c-3156d27450f2 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:59.595858 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5c758d78-3cd0-48db-8f9c-3156d27450f2 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:59.599170 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5c758d78-3cd0-48db-8f9c-3156d27450f2 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:59.601168 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5c758d78-3cd0-48db-8f9c-3156d27450f2 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:59.606892 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5c758d78-3cd0-48db-8f9c-3156d27450f2 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:59.631296 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5224bc35-e9a8-474b-9f26-8458ac130105 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:59.649270 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5224bc35-e9a8-474b-9f26-8458ac130105 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:59.652000 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5224bc35-e9a8-474b-9f26-8458ac130105 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:09:59.657284 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5224bc35-e9a8-474b-9f26-8458ac130105 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1707 microversion: 2.32 time: 1.213693 Jun 20 12:09:59.659922 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1378/2797] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:09:58 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1707 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:09:59.671534 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bac85cd8-ff7a-445b-8d69-e632d9789c7d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:09:59.672627 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bac85cd8-ff7a-445b-8d69-e632d9789c7d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:09:59.700849 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bac85cd8-ff7a-445b-8d69-e632d9789c7d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:59.703327 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bac85cd8-ff7a-445b-8d69-e632d9789c7d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:59.711717 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bac85cd8-ff7a-445b-8d69-e632d9789c7d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:09:59.713153 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bac85cd8-ff7a-445b-8d69-e632d9789c7d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:09:59.795636 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=9 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:09:59.810107 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:00.088693 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5c758d78-3cd0-48db-8f9c-3156d27450f2 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:00.100858 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5c758d78-3cd0-48db-8f9c-3156d27450f2 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1512 microversion: 2.1 time: 0.548744 Jun 20 12:10:00.102803 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1420/2798] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:59 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1512 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:00.110484 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3c2f21bb-fce4-459c-bada-399daefbca13 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:00.111477 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3c2f21bb-fce4-459c-bada-399daefbca13 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:00.119793 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c2f21bb-fce4-459c-bada-399daefbca13 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:00.120622 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c2f21bb-fce4-459c-bada-399daefbca13 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:00.122693 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c2f21bb-fce4-459c-bada-399daefbca13 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:00.123316 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c2f21bb-fce4-459c-bada-399daefbca13 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:00.273951 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-bac85cd8-ff7a-445b-8d69-e632d9789c7d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:00.288439 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bac85cd8-ff7a-445b-8d69-e632d9789c7d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1528 microversion: 2.1 time: 0.626798 Jun 20 12:10:00.290204 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1379/2799] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:09:59 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1528 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:00.303009 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9a89494e-96df-4cfb-a8a9-b844d5d2dd42 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:00.307259 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9a89494e-96df-4cfb-a8a9-b844d5d2dd42 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: f6bb3154-9ddf-428c-82cd-74ab476e5a0a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:00.341134 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9a89494e-96df-4cfb-a8a9-b844d5d2dd42 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:00.343676 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9a89494e-96df-4cfb-a8a9-b844d5d2dd42 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:00.345611 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9a89494e-96df-4cfb-a8a9-b844d5d2dd42 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:00.349293 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9a89494e-96df-4cfb-a8a9-b844d5d2dd42 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:00.635390 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3c2f21bb-fce4-459c-bada-399daefbca13 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:00.650162 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3c2f21bb-fce4-459c-bada-399daefbca13 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41" status: 200 len: 1520 microversion: 2.1 time: 0.545859 Jun 20 12:10:00.651704 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1421/2800] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:00 2022] GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 => generated 1520 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:00.657279 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-628f470b-1475-4c7e-a2f2-db20869f54b1 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:00.658358 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:10:00.658358 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 12:10:00.664799 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-628f470b-1475-4c7e-a2f2-db20869f54b1 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] HTTP exception thrown: Flavor 0173425c-7c4a-4fc6-9720-5054f46e787a could not be found. Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-628f470b-1475-4c7e-a2f2-db20869f54b1 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Request method failure captured: Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/flavors/0173425c-7c4a-4fc6-9720-5054f46e787a HTTP/1.1 Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGKhIQEKI7mqr7k47mSqO7pEQJoQqsAhpEgasZGVZIAkkvpoa66gBF-IxFdG6sUyPF-FtAJTSISphr7A0kL1-PB6VFfdSaV2vGBkC4fzjwFfULUGuD02ospG1iZKPDNfb2EC-YD0QUQ7cvX-q0ACG7UXance5_eQjV-y3_46-q-7UUE Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: e410fd03e18846f8a6e0faf010cb275a Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-MigrationsAdminTest-1740254832 Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member,admin Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member,admin Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e410fd03e18846f8a6e0faf010cb275a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e410fd03e18846f8a6e0faf010cb275a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e410fd03e18846f8a6e0faf010cb275a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e410fd03e18846f8a6e0faf010cb275a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-MigrationsAdminTest-1740254832 Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: e410fd03e18846f8a6e0faf010cb275a Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-MigrationsAdminTest-1740254832 Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-MigrationsAdminTest-1740254832-project-admin Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: af812a9321804aff95e49d9e18684e83 Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-MigrationsAdminTest-1740254832-project-admin Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: exception: Flavor 0173425c-7c4a-4fc6-9720-5054f46e787a could not be found. Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '0173425c-7c4a-4fc6-9720-5054f46e787a'} Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi flavor.destroy() Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 0173425c-7c4a-4fc6-9720-5054f46e787a could not be found. Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 0173425c-7c4a-4fc6-9720-5054f46e787a could not be found. Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:10:00.680155 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:10:00.685669 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:10:00.685669 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:10:00.685669 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:10:00.685669 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:10:00.685669 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:10:00.685669 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:10:00.685669 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 0173425c-7c4a-4fc6-9720-5054f46e787a could not be found. Jun 20 12:10:00.685669 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:10:00.687697 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-628f470b-1475-4c7e-a2f2-db20869f54b1 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Returning 404 to user: Flavor 0173425c-7c4a-4fc6-9720-5054f46e787a could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:10:00.688829 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-628f470b-1475-4c7e-a2f2-db20869f54b1 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/0173425c-7c4a-4fc6-9720-5054f46e787a" status: 404 len: 109 microversion: 2.1 time: 0.035856 Jun 20 12:10:00.694860 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1422/2801] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:10:00 2022] DELETE /compute/v2.1/flavors/0173425c-7c4a-4fc6-9720-5054f46e787a => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:10:00.714631 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-71be76b4-9f7e-4e60-a25e-71a53ca1b20e tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:00.716102 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-71be76b4-9f7e-4e60-a25e-71a53ca1b20e tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] [instance: 85c5ef58-2d37-49d6-8bf8-dded3d45965a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:00.750213 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-71be76b4-9f7e-4e60-a25e-71a53ca1b20e tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:00.758251 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-71be76b4-9f7e-4e60-a25e-71a53ca1b20e tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:00.760442 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-71be76b4-9f7e-4e60-a25e-71a53ca1b20e tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:00.761405 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-71be76b4-9f7e-4e60-a25e-71a53ca1b20e tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:00.901205 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:01.001482 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9a89494e-96df-4cfb-a8a9-b844d5d2dd42 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:01.021311 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9a89494e-96df-4cfb-a8a9-b844d5d2dd42 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a" status: 200 len: 1539 microversion: 2.1 time: 0.727495 Jun 20 12:10:01.021913 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1380/2802] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:00 2022] GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a => generated 1539 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:01.026961 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8277f749-25a6-47d5-8a3e-e7ada9210cb6 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:01.027906 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8277f749-25a6-47d5-8a3e-e7ada9210cb6 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:01.040979 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8277f749-25a6-47d5-8a3e-e7ada9210cb6 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:01.041850 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8277f749-25a6-47d5-8a3e-e7ada9210cb6 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:01.043119 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8277f749-25a6-47d5-8a3e-e7ada9210cb6 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:01.050848 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8277f749-25a6-47d5-8a3e-e7ada9210cb6 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:01.155905 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-71be76b4-9f7e-4e60-a25e-71a53ca1b20e tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815408121fd94cc8897776382656d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e01ab560b24342983dc342c5235c03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:01.168624 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-71be76b4-9f7e-4e60-a25e-71a53ca1b20e tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] 10.222.0.27 "GET /compute/v2.1/servers/85c5ef58-2d37-49d6-8bf8-dded3d45965a" status: 200 len: 1521 microversion: 2.1 time: 0.472388 Jun 20 12:10:01.172266 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1423/2803] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:00 2022] GET /compute/v2.1/servers/85c5ef58-2d37-49d6-8bf8-dded3d45965a => generated 1521 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:01.178431 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3cfc6555-b8b3-4f60-ba51-ffcfc6a86611 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1935296711", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:10:01.286571 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-3cfc6555-b8b3-4f60-ba51-ffcfc6a86611 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] validate_networks() for None {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:10:01.481220 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8277f749-25a6-47d5-8a3e-e7ada9210cb6 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:01.495128 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8277f749-25a6-47d5-8a3e-e7ada9210cb6 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:01.499604 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8277f749-25a6-47d5-8a3e-e7ada9210cb6 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:01.507867 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8277f749-25a6-47d5-8a3e-e7ada9210cb6 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1707 microversion: 2.32 time: 0.484590 Jun 20 12:10:01.508857 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1381/2804] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:01 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1707 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:01.516316 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-3b97d2eb-3ee6-4344-a7fe-cd5e15d793c4 req-46bbe575-a62e-4b77-852a-52c63a4ccd4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8b3d285-0f08-4deb-859e-babab7f3b656", "name": "network-vif-plugged", "status": "completed", "tag": "e23efb88-f8d5-4db8-8321-1c16dca584be"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:10:01.555430 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-3b97d2eb-3ee6-4344-a7fe-cd5e15d793c4 req-46bbe575-a62e-4b77-852a-52c63a4ccd4e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:01.556156 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-3b97d2eb-3ee6-4344-a7fe-cd5e15d793c4 req-46bbe575-a62e-4b77-852a-52c63a4ccd4e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:01.610147 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-3b97d2eb-3ee6-4344-a7fe-cd5e15d793c4 req-46bbe575-a62e-4b77-852a-52c63a4ccd4e service nova] Creating event network-vif-plugged:e23efb88-f8d5-4db8-8321-1c16dca584be for instance f8b3d285-0f08-4deb-859e-babab7f3b656 on n-h2-master-1 Jun 20 12:10:01.629262 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-3b97d2eb-3ee6-4344-a7fe-cd5e15d793c4 req-46bbe575-a62e-4b77-852a-52c63a4ccd4e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118719 Jun 20 12:10:01.630446 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1382/2805] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:10:01.639067 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1e5e2082-f934-4e7f-804f-336b226ceb7d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:01.639920 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1e5e2082-f934-4e7f-804f-336b226ceb7d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:01.654910 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e5e2082-f934-4e7f-804f-336b226ceb7d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:01.655594 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e5e2082-f934-4e7f-804f-336b226ceb7d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:01.657764 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e5e2082-f934-4e7f-804f-336b226ceb7d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:01.658882 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e5e2082-f934-4e7f-804f-336b226ceb7d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:02.142811 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1e5e2082-f934-4e7f-804f-336b226ceb7d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:02.147359 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:02.159657 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1e5e2082-f934-4e7f-804f-336b226ceb7d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1512 microversion: 2.1 time: 0.527053 Jun 20 12:10:02.162239 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1383/2806] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:01 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1512 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:02.177905 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-75ebdd0c-b74c-4f66-afb6-a7a86fd56d89 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:02.179287 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-75ebdd0c-b74c-4f66-afb6-a7a86fd56d89 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] [instance: 85c5ef58-2d37-49d6-8bf8-dded3d45965a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:02.206948 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-75ebdd0c-b74c-4f66-afb6-a7a86fd56d89 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:02.208448 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-75ebdd0c-b74c-4f66-afb6-a7a86fd56d89 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:02.211660 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-75ebdd0c-b74c-4f66-afb6-a7a86fd56d89 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:02.212358 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-75ebdd0c-b74c-4f66-afb6-a7a86fd56d89 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:02.255096 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-3cfc6555-b8b3-4f60-ba51-ffcfc6a86611 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:10:02.256351 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-3cfc6555-b8b3-4f60-ba51-ffcfc6a86611 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:10:02.257028 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-3cfc6555-b8b3-4f60-ba51-ffcfc6a86611 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:10:02.257753 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-3cfc6555-b8b3-4f60-ba51-ffcfc6a86611 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:10:02.258363 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-3cfc6555-b8b3-4f60-ba51-ffcfc6a86611 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:10:02.286728 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3cfc6555-b8b3-4f60-ba51-ffcfc6a86611 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:02.290780 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-75ebdd0c-b74c-4f66-afb6-a7a86fd56d89 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] HTTP exception thrown: Instance is not a member of specified network Jun 20 12:10:02.291627 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3cfc6555-b8b3-4f60-ba51-ffcfc6a86611 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:02.292796 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3cfc6555-b8b3-4f60-ba51-ffcfc6a86611 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:02.293398 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3cfc6555-b8b3-4f60-ba51-ffcfc6a86611 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-75ebdd0c-b74c-4f66-afb6-a7a86fd56d89 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Request method failure captured: Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/85c5ef58-2d37-49d6-8bf8-dded3d45965a/ips/invalid HTTP/1.1 Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGN9GNBNrJ9s8JPMY5GYOw7WYN8VtCgquf0eqAfpu7hmbzEYT9Cj1nogETmCcdzpoIMEMH5HiDd0Nfpk9TPc-0SgoiWGyZo6gcy0Mb64cWA5fgygCNPwYhk7d0ckqC29mHacLNDmb6wmyBS3KHwFDCt3G6XD6tGMwM53Kccjo_iUFCA Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 02e01ab560b24342983dc342c5235c03 Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-82932581 Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/02e01ab560b24342983dc342c5235c03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/02e01ab560b24342983dc342c5235c03"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/02e01ab560b24342983dc342c5235c03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_02e01ab560b24342983dc342c5235c03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-82932581 Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 02e01ab560b24342983dc342c5235c03 Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-82932581 Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServerAddressesNegativeTestJSON-82932581-project Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 815408121fd94cc8897776382656d198 Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-82932581-project Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: exception: Instance is not a member of specified network Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: action_args: {'server_id': '85c5ef58-2d37-49d6-8bf8-dded3d45965a', 'id': 'invalid'} Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Jun 20 12:10:02.300847 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:10:02.321084 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-75ebdd0c-b74c-4f66-afb6-a7a86fd56d89 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Returning 404 to user: Instance is not a member of specified network {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:10:02.322012 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-75ebdd0c-b74c-4f66-afb6-a7a86fd56d89 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] 10.222.0.27 "GET /compute/v2.1/servers/85c5ef58-2d37-49d6-8bf8-dded3d45965a/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.148576 Jun 20 12:10:02.325107 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1384/2807] 10.222.0.27 () {58 vars in 1271 bytes} [Mon Jun 20 12:10:02 2022] GET /compute/v2.1/servers/85c5ef58-2d37-49d6-8bf8-dded3d45965a/ips/invalid => generated 91 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:10:02.346518 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e8dfd637-a182-4ef7-9d92-5e0a751fb8d7 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:02.352531 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e8dfd637-a182-4ef7-9d92-5e0a751fb8d7 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:02.365904 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e8dfd637-a182-4ef7-9d92-5e0a751fb8d7 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:02.366565 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e8dfd637-a182-4ef7-9d92-5e0a751fb8d7 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:02.366814 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-3cfc6555-b8b3-4f60-ba51-ffcfc6a86611 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Getting quotas for project 4440dc3e2f9c4134a54b08e2585f6c59. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:10:02.373475 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e8dfd637-a182-4ef7-9d92-5e0a751fb8d7 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:02.374259 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e8dfd637-a182-4ef7-9d92-5e0a751fb8d7 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:02.382742 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-3cfc6555-b8b3-4f60-ba51-ffcfc6a86611 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Getting quotas for user 3d35b7c824b641099a406175bccc5be3 and project 4440dc3e2f9c4134a54b08e2585f6c59. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:10:02.418135 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3cfc6555-b8b3-4f60-ba51-ffcfc6a86611 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:10:02.426510 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3cfc6555-b8b3-4f60-ba51-ffcfc6a86611 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:10:02.566185 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3cfc6555-b8b3-4f60-ba51-ffcfc6a86611 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.392446 Jun 20 12:10:02.569642 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1424/2808] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:10:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1397 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:10:02.615528 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e06e61c5-21f3-4e3b-a44d-a89ea8bcb026 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:02.618543 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e06e61c5-21f3-4e3b-a44d-a89ea8bcb026 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: f6bb3154-9ddf-428c-82cd-74ab476e5a0a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:02.645015 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e06e61c5-21f3-4e3b-a44d-a89ea8bcb026 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:02.645962 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e06e61c5-21f3-4e3b-a44d-a89ea8bcb026 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:02.646997 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e06e61c5-21f3-4e3b-a44d-a89ea8bcb026 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:02.652672 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e06e61c5-21f3-4e3b-a44d-a89ea8bcb026 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:03.212532 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e8dfd637-a182-4ef7-9d92-5e0a751fb8d7 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:03.226080 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e8dfd637-a182-4ef7-9d92-5e0a751fb8d7 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41" status: 200 len: 1520 microversion: 2.1 time: 0.899600 Jun 20 12:10:03.232041 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1385/2809] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:02 2022] GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 => generated 1520 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:03.246627 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f53a384d-73bb-4dd9-9a0c-f551f08d56da tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:03.247932 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f53a384d-73bb-4dd9-9a0c-f551f08d56da tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Failed to fetch instance by id 999 {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 20 12:10:03.251063 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-f53a384d-73bb-4dd9-9a0c-f551f08d56da tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] HTTP exception thrown: Instance 999 could not be found. Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f53a384d-73bb-4dd9-9a0c-f551f08d56da tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Request method failure captured: Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGN9GNBNrJ9s8JPMY5GYOw7WYN8VtCgquf0eqAfpu7hmbzEYT9Cj1nogETmCcdzpoIMEMH5HiDd0Nfpk9TPc-0SgoiWGyZo6gcy0Mb64cWA5fgygCNPwYhk7d0ckqC29mHacLNDmb6wmyBS3KHwFDCt3G6XD6tGMwM53Kccjo_iUFCA Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 02e01ab560b24342983dc342c5235c03 Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-82932581 Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/02e01ab560b24342983dc342c5235c03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/02e01ab560b24342983dc342c5235c03"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/02e01ab560b24342983dc342c5235c03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_02e01ab560b24342983dc342c5235c03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-82932581 Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 02e01ab560b24342983dc342c5235c03 Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-82932581 Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServerAddressesNegativeTestJSON-82932581-project Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 815408121fd94cc8897776382656d198 Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-82932581-project Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 999 could not be found. Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: action_args: {'server_id': '999'} Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jun 20 12:10:03.263549 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:10:03.270485 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f53a384d-73bb-4dd9-9a0c-f551f08d56da tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Returning 404 to user: Instance 999 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:10:03.271905 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f53a384d-73bb-4dd9-9a0c-f551f08d56da tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] 10.222.0.27 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.038519 Jun 20 12:10:03.273354 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1386/2810] 10.222.0.27 () {58 vars in 1148 bytes} [Mon Jun 20 12:10:03 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:10:03.288099 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-81a6b069-2170-4125-bc95-9540b5cb6361 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:03.290040 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-81a6b069-2170-4125-bc95-9540b5cb6361 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:03.309672 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-81a6b069-2170-4125-bc95-9540b5cb6361 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:03.310905 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-81a6b069-2170-4125-bc95-9540b5cb6361 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:03.314502 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-81a6b069-2170-4125-bc95-9540b5cb6361 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:03.315158 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-81a6b069-2170-4125-bc95-9540b5cb6361 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:03.387740 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e06e61c5-21f3-4e3b-a44d-a89ea8bcb026 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:03.399521 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e06e61c5-21f3-4e3b-a44d-a89ea8bcb026 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a" status: 200 len: 1521 microversion: 2.1 time: 0.828345 Jun 20 12:10:03.404796 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1425/2811] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:02 2022] GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a => generated 1521 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:03.415941 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8d3a52f7-5073-46f0-9652-5e367f9292c7 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:03.416978 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8d3a52f7-5073-46f0-9652-5e367f9292c7 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:03.536520 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8d3a52f7-5073-46f0-9652-5e367f9292c7 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:03.549130 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8d3a52f7-5073-46f0-9652-5e367f9292c7 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1213 microversion: 2.1 time: 0.142881 Jun 20 12:10:03.562264 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1426/2812] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:03 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1213 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:03.576799 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c0289def-3062-4f98-bd9e-bfe2f4607de0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:03.577779 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c0289def-3062-4f98-bd9e-bfe2f4607de0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:03.615542 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c0289def-3062-4f98-bd9e-bfe2f4607de0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:03.618760 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c0289def-3062-4f98-bd9e-bfe2f4607de0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:03.621853 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c0289def-3062-4f98-bd9e-bfe2f4607de0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:03.626614 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c0289def-3062-4f98-bd9e-bfe2f4607de0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:03.672461 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-81a6b069-2170-4125-bc95-9540b5cb6361 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:03.697692 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-81a6b069-2170-4125-bc95-9540b5cb6361 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:03.701173 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-81a6b069-2170-4125-bc95-9540b5cb6361 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:03.708795 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-81a6b069-2170-4125-bc95-9540b5cb6361 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1753 microversion: 2.32 time: 0.427874 Jun 20 12:10:03.710446 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1387/2813] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:03 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1753 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:03.725885 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-49bb3bcf-ad42-4fbe-bc49-fdea022a9727 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:03.726406 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-49bb3bcf-ad42-4fbe-bc49-fdea022a9727 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] [instance: 85c5ef58-2d37-49d6-8bf8-dded3d45965a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:03.758825 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-49bb3bcf-ad42-4fbe-bc49-fdea022a9727 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:03.759289 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-49bb3bcf-ad42-4fbe-bc49-fdea022a9727 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:03.760096 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-49bb3bcf-ad42-4fbe-bc49-fdea022a9727 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:03.760571 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-49bb3bcf-ad42-4fbe-bc49-fdea022a9727 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:03.826154 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-49bb3bcf-ad42-4fbe-bc49-fdea022a9727 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] [instance: 85c5ef58-2d37-49d6-8bf8-dded3d45965a] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:10:03.993020 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-49bb3bcf-ad42-4fbe-bc49-fdea022a9727 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] 10.222.0.27 "DELETE /compute/v2.1/servers/85c5ef58-2d37-49d6-8bf8-dded3d45965a" status: 204 len: 0 microversion: 2.1 time: 0.281261 Jun 20 12:10:03.999437 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1388/2814] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:10:03 2022] DELETE /compute/v2.1/servers/85c5ef58-2d37-49d6-8bf8-dded3d45965a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:10:04.013502 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f0d923e4-0c03-4b73-bbe3-a7d6df665048 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:04.019054 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f0d923e4-0c03-4b73-bbe3-a7d6df665048 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: f6bb3154-9ddf-428c-82cd-74ab476e5a0a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:04.038467 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f0d923e4-0c03-4b73-bbe3-a7d6df665048 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:04.041997 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f0d923e4-0c03-4b73-bbe3-a7d6df665048 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:04.044885 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f0d923e4-0c03-4b73-bbe3-a7d6df665048 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:04.046025 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f0d923e4-0c03-4b73-bbe3-a7d6df665048 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:04.118491 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f0d923e4-0c03-4b73-bbe3-a7d6df665048 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: f6bb3154-9ddf-428c-82cd-74ab476e5a0a] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:10:04.464434 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f0d923e4-0c03-4b73-bbe3-a7d6df665048 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a" status: 204 len: 0 microversion: 2.1 time: 0.460600 Jun 20 12:10:04.468807 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1389/2815] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:10:03 2022] DELETE /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:10:04.485169 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c0289def-3062-4f98-bd9e-bfe2f4607de0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:04.488774 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2ae44997-1ef8-4a11-9c1c-57f13ae1a763 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:04.492843 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2ae44997-1ef8-4a11-9c1c-57f13ae1a763 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] [instance: 85c5ef58-2d37-49d6-8bf8-dded3d45965a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:04.502033 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c0289def-3062-4f98-bd9e-bfe2f4607de0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1512 microversion: 2.1 time: 0.932937 Jun 20 12:10:04.514766 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1427/2816] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:03 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1512 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:04.518558 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2ae44997-1ef8-4a11-9c1c-57f13ae1a763 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:04.520873 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c2693165-05a7-41bf-a063-cebbbbc62c3a tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:04.521777 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c2693165-05a7-41bf-a063-cebbbbc62c3a tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:04.523378 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2ae44997-1ef8-4a11-9c1c-57f13ae1a763 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:04.530480 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c2693165-05a7-41bf-a063-cebbbbc62c3a tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:04.531124 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c2693165-05a7-41bf-a063-cebbbbc62c3a tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:04.532174 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c2693165-05a7-41bf-a063-cebbbbc62c3a tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:04.532889 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c2693165-05a7-41bf-a063-cebbbbc62c3a tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:04.533889 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2ae44997-1ef8-4a11-9c1c-57f13ae1a763 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:04.534448 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2ae44997-1ef8-4a11-9c1c-57f13ae1a763 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:04.937146 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c2693165-05a7-41bf-a063-cebbbbc62c3a tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:04.948365 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c2693165-05a7-41bf-a063-cebbbbc62c3a tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41" status: 200 len: 1520 microversion: 2.1 time: 0.432072 Jun 20 12:10:04.957136 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1428/2817] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:04 2022] GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 => generated 1520 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:04.962059 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2ae44997-1ef8-4a11-9c1c-57f13ae1a763 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815408121fd94cc8897776382656d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e01ab560b24342983dc342c5235c03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:04.967733 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f076ce80-ef8b-410e-a92e-6295d856e862 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:04.975569 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f076ce80-ef8b-410e-a92e-6295d856e862 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: f6bb3154-9ddf-428c-82cd-74ab476e5a0a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:04.985046 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f076ce80-ef8b-410e-a92e-6295d856e862 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:04.987530 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2ae44997-1ef8-4a11-9c1c-57f13ae1a763 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] 10.222.0.27 "GET /compute/v2.1/servers/85c5ef58-2d37-49d6-8bf8-dded3d45965a" status: 200 len: 1527 microversion: 2.1 time: 0.513287 Jun 20 12:10:04.988355 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f076ce80-ef8b-410e-a92e-6295d856e862 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:04.989680 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f076ce80-ef8b-410e-a92e-6295d856e862 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:04.999264 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1390/2818] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:04 2022] GET /compute/v2.1/servers/85c5ef58-2d37-49d6-8bf8-dded3d45965a => generated 1527 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:04.999546 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f076ce80-ef8b-410e-a92e-6295d856e862 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:05.002668 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d0d71963-382f-43ea-ba39-095115c9ee48 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:05.007250 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d0d71963-382f-43ea-ba39-095115c9ee48 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:05.024623 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d0d71963-382f-43ea-ba39-095115c9ee48 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:05.025399 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d0d71963-382f-43ea-ba39-095115c9ee48 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:05.030777 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d0d71963-382f-43ea-ba39-095115c9ee48 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:05.031455 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d0d71963-382f-43ea-ba39-095115c9ee48 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:05.163709 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d0d71963-382f-43ea-ba39-095115c9ee48 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:05.176315 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d0d71963-382f-43ea-ba39-095115c9ee48 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1273 microversion: 2.1 time: 0.184212 Jun 20 12:10:05.188540 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1391/2819] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:04 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1273 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:05.194121 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-138dba3a-ee51-467d-a6b8-1ba1009350b5 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:05.195113 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-138dba3a-ee51-467d-a6b8-1ba1009350b5 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:05.203033 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-138dba3a-ee51-467d-a6b8-1ba1009350b5 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:05.203877 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-138dba3a-ee51-467d-a6b8-1ba1009350b5 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:05.204867 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-138dba3a-ee51-467d-a6b8-1ba1009350b5 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:05.205463 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-138dba3a-ee51-467d-a6b8-1ba1009350b5 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:05.360807 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f076ce80-ef8b-410e-a92e-6295d856e862 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:05.381486 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f076ce80-ef8b-410e-a92e-6295d856e862 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a" status: 200 len: 1527 microversion: 2.1 time: 0.422853 Jun 20 12:10:05.391180 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1429/2820] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:04 2022] GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a => generated 1527 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:05.415459 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-ade604ed-66db-4f5d-9548-2482c133c2e6 req-f4ce6dfe-1c82-49f4-a93e-3996691df181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6bb3154-9ddf-428c-82cd-74ab476e5a0a", "name": "network-vif-plugged", "status": "completed", "tag": "70588baf-f83f-4160-862a-9baa231528c7"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:10:05.447369 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ade604ed-66db-4f5d-9548-2482c133c2e6 req-f4ce6dfe-1c82-49f4-a93e-3996691df181 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:05.448008 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ade604ed-66db-4f5d-9548-2482c133c2e6 req-f4ce6dfe-1c82-49f4-a93e-3996691df181 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:05.484138 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-ade604ed-66db-4f5d-9548-2482c133c2e6 req-f4ce6dfe-1c82-49f4-a93e-3996691df181 service nova] Creating event network-vif-plugged:70588baf-f83f-4160-862a-9baa231528c7 for instance f6bb3154-9ddf-428c-82cd-74ab476e5a0a on n-h1-master-1 Jun 20 12:10:05.493166 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-ade604ed-66db-4f5d-9548-2482c133c2e6 req-f4ce6dfe-1c82-49f4-a93e-3996691df181 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082669 Jun 20 12:10:05.498616 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1430/2821] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:10:05.524725 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cecc77c4-6503-486f-b88c-2cecb8343099 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:05.525727 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cecc77c4-6503-486f-b88c-2cecb8343099 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:05.541586 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-138dba3a-ee51-467d-a6b8-1ba1009350b5 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:05.542167 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cecc77c4-6503-486f-b88c-2cecb8343099 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:05.542848 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cecc77c4-6503-486f-b88c-2cecb8343099 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:05.544033 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cecc77c4-6503-486f-b88c-2cecb8343099 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:05.557412 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cecc77c4-6503-486f-b88c-2cecb8343099 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:05.564967 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-138dba3a-ee51-467d-a6b8-1ba1009350b5 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:05.570764 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-138dba3a-ee51-467d-a6b8-1ba1009350b5 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:05.575229 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-138dba3a-ee51-467d-a6b8-1ba1009350b5 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1799 microversion: 2.32 time: 0.383455 Jun 20 12:10:05.578488 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1392/2822] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:05 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1799 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:05.974477 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ae389cc4-2391-486c-85ac-a973990183d5 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:05.975408 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ae389cc4-2391-486c-85ac-a973990183d5 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:05.990535 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ae389cc4-2391-486c-85ac-a973990183d5 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:05.991452 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ae389cc4-2391-486c-85ac-a973990183d5 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:05.992445 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ae389cc4-2391-486c-85ac-a973990183d5 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:05.993440 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ae389cc4-2391-486c-85ac-a973990183d5 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:06.062916 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cecc77c4-6503-486f-b88c-2cecb8343099 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:06.072599 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cecc77c4-6503-486f-b88c-2cecb8343099 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1512 microversion: 2.1 time: 0.554590 Jun 20 12:10:06.078803 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1431/2823] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:05 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1512 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:06.095044 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ee5591d3-2351-4e4e-93eb-77f8894055f8 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:06.097847 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ee5591d3-2351-4e4e-93eb-77f8894055f8 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] [instance: 85c5ef58-2d37-49d6-8bf8-dded3d45965a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:06.123170 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee5591d3-2351-4e4e-93eb-77f8894055f8 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:06.123919 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee5591d3-2351-4e4e-93eb-77f8894055f8 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:06.125155 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee5591d3-2351-4e4e-93eb-77f8894055f8 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:06.125759 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee5591d3-2351-4e4e-93eb-77f8894055f8 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:06.511370 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ae389cc4-2391-486c-85ac-a973990183d5 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:06.525113 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ae389cc4-2391-486c-85ac-a973990183d5 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41" status: 200 len: 1520 microversion: 2.1 time: 0.555054 Jun 20 12:10:06.525729 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1393/2824] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:05 2022] GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 => generated 1520 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:06.539968 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3670e31e-bdfa-43ca-a5fc-24976596ef37 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:06.541599 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3670e31e-bdfa-43ca-a5fc-24976596ef37 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:06.549706 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3670e31e-bdfa-43ca-a5fc-24976596ef37 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:06.553198 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3670e31e-bdfa-43ca-a5fc-24976596ef37 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:06.557698 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3670e31e-bdfa-43ca-a5fc-24976596ef37 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:06.558374 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3670e31e-bdfa-43ca-a5fc-24976596ef37 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:06.639993 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ee5591d3-2351-4e4e-93eb-77f8894055f8 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815408121fd94cc8897776382656d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e01ab560b24342983dc342c5235c03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:06.654493 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ee5591d3-2351-4e4e-93eb-77f8894055f8 tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] 10.222.0.27 "GET /compute/v2.1/servers/85c5ef58-2d37-49d6-8bf8-dded3d45965a" status: 200 len: 1527 microversion: 2.1 time: 0.571295 Jun 20 12:10:06.656375 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1432/2825] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:06 2022] GET /compute/v2.1/servers/85c5ef58-2d37-49d6-8bf8-dded3d45965a => generated 1527 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:06.666642 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f622701f-867b-4efe-ba30-6c9145e21594 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:06.673343 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f622701f-867b-4efe-ba30-6c9145e21594 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: f6bb3154-9ddf-428c-82cd-74ab476e5a0a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:06.685679 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f622701f-867b-4efe-ba30-6c9145e21594 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:06.688976 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f622701f-867b-4efe-ba30-6c9145e21594 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:06.689758 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f622701f-867b-4efe-ba30-6c9145e21594 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:06.690211 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f622701f-867b-4efe-ba30-6c9145e21594 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:06.728748 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:06.799993 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3670e31e-bdfa-43ca-a5fc-24976596ef37 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:06.810555 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3670e31e-bdfa-43ca-a5fc-24976596ef37 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1271 microversion: 2.1 time: 0.274649 Jun 20 12:10:06.815024 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1394/2826] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:06 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1271 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:06.823888 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-30adadc3-0d39-4046-955d-02a34b618134 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:06.826762 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-30adadc3-0d39-4046-955d-02a34b618134 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:06.840269 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-30adadc3-0d39-4046-955d-02a34b618134 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:06.842658 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-30adadc3-0d39-4046-955d-02a34b618134 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:06.844040 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-30adadc3-0d39-4046-955d-02a34b618134 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:06.846724 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-30adadc3-0d39-4046-955d-02a34b618134 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:07.105165 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f622701f-867b-4efe-ba30-6c9145e21594 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:07.124859 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f622701f-867b-4efe-ba30-6c9145e21594 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a" status: 200 len: 1527 microversion: 2.1 time: 0.466965 Jun 20 12:10:07.127612 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1433/2827] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:06 2022] GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a => generated 1527 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:07.136990 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-8d80d8f9-bca3-4b76-bdd2-19c7658a00c2 req-6f78cd54-55a3-4966-b1b2-505dad71d23c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c5ef58-2d37-49d6-8bf8-dded3d45965a", "name": "network-vif-deleted", "tag": "9031fd5a-b1b5-4a9c-be6b-39f81e3cb9aa"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:10:07.150078 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-8d80d8f9-bca3-4b76-bdd2-19c7658a00c2 req-6f78cd54-55a3-4966-b1b2-505dad71d23c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:07.151450 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-8d80d8f9-bca3-4b76-bdd2-19c7658a00c2 req-6f78cd54-55a3-4966-b1b2-505dad71d23c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:07.170627 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-8d80d8f9-bca3-4b76-bdd2-19c7658a00c2 req-6f78cd54-55a3-4966-b1b2-505dad71d23c service nova] Creating event network-vif-deleted:9031fd5a-b1b5-4a9c-be6b-39f81e3cb9aa for instance 85c5ef58-2d37-49d6-8bf8-dded3d45965a on n-h2-master-1 Jun 20 12:10:07.181086 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-8d80d8f9-bca3-4b76-bdd2-19c7658a00c2 req-6f78cd54-55a3-4966-b1b2-505dad71d23c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048043 Jun 20 12:10:07.184246 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1434/2828] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:10:07.200662 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-542a03e9-9fba-45c6-81c4-94b8539b2110 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:07.201815 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-542a03e9-9fba-45c6-81c4-94b8539b2110 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:07.214772 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-542a03e9-9fba-45c6-81c4-94b8539b2110 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:07.217025 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-542a03e9-9fba-45c6-81c4-94b8539b2110 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:07.218343 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-542a03e9-9fba-45c6-81c4-94b8539b2110 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:07.218959 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-542a03e9-9fba-45c6-81c4-94b8539b2110 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:07.448869 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-542a03e9-9fba-45c6-81c4-94b8539b2110 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:07.464140 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-542a03e9-9fba-45c6-81c4-94b8539b2110 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1512 microversion: 2.1 time: 0.274245 Jun 20 12:10:07.466021 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1435/2829] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:07 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1512 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:07.543630 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1f1a1518-e6e9-4228-962c-cbfc4c308190 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:07.544662 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1f1a1518-e6e9-4228-962c-cbfc4c308190 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:07.559029 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f1a1518-e6e9-4228-962c-cbfc4c308190 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:07.563260 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f1a1518-e6e9-4228-962c-cbfc4c308190 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:07.564555 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f1a1518-e6e9-4228-962c-cbfc4c308190 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:07.565980 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f1a1518-e6e9-4228-962c-cbfc4c308190 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:07.953823 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1f1a1518-e6e9-4228-962c-cbfc4c308190 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:07.970750 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1f1a1518-e6e9-4228-962c-cbfc4c308190 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41" status: 200 len: 1520 microversion: 2.1 time: 0.432964 Jun 20 12:10:07.971375 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1436/2830] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:07 2022] GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 => generated 1520 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:10:07.981478 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-733044af-286b-4656-83f5-22ce5abb7ce4 req-b6e6d1af-793e-40f9-ace6-9b0725428d6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c9e8490-b371-4215-af47-09ebe2b7cd41", "name": "network-vif-plugged", "status": "completed", "tag": "9589165b-8125-4dbe-9ce0-546dbf131a7a"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:10:08.008284 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-733044af-286b-4656-83f5-22ce5abb7ce4 req-b6e6d1af-793e-40f9-ace6-9b0725428d6a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:08.008749 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-733044af-286b-4656-83f5-22ce5abb7ce4 req-b6e6d1af-793e-40f9-ace6-9b0725428d6a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:08.040540 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-733044af-286b-4656-83f5-22ce5abb7ce4 req-b6e6d1af-793e-40f9-ace6-9b0725428d6a service nova] Creating event network-vif-plugged:9589165b-8125-4dbe-9ce0-546dbf131a7a for instance 0c9e8490-b371-4215-af47-09ebe2b7cd41 on n-h1-master-1 Jun 20 12:10:08.047780 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-733044af-286b-4656-83f5-22ce5abb7ce4 req-b6e6d1af-793e-40f9-ace6-9b0725428d6a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070723 Jun 20 12:10:08.048634 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1437/2831] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:10:08.057592 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a9ef8399-49e1-4835-9e74-34d8e0ae91eb tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:08.059489 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a9ef8399-49e1-4835-9e74-34d8e0ae91eb tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] [instance: 85c5ef58-2d37-49d6-8bf8-dded3d45965a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:08.069366 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a9ef8399-49e1-4835-9e74-34d8e0ae91eb tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:08.069825 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a9ef8399-49e1-4835-9e74-34d8e0ae91eb tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:08.070798 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a9ef8399-49e1-4835-9e74-34d8e0ae91eb tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:08.071243 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a9ef8399-49e1-4835-9e74-34d8e0ae91eb tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:08.093909 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-a9ef8399-49e1-4835-9e74-34d8e0ae91eb tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] HTTP exception thrown: Instance 85c5ef58-2d37-49d6-8bf8-dded3d45965a could not be found. Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a9ef8399-49e1-4835-9e74-34d8e0ae91eb tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Request method failure captured: Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/85c5ef58-2d37-49d6-8bf8-dded3d45965a HTTP/1.1 Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGN9GNBNrJ9s8JPMY5GYOw7WYN8VtCgquf0eqAfpu7hmbzEYT9Cj1nogETmCcdzpoIMEMH5HiDd0Nfpk9TPc-0SgoiWGyZo6gcy0Mb64cWA5fgygCNPwYhk7d0ckqC29mHacLNDmb6wmyBS3KHwFDCt3G6XD6tGMwM53Kccjo_iUFCA Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 02e01ab560b24342983dc342c5235c03 Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-82932581 Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/02e01ab560b24342983dc342c5235c03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/02e01ab560b24342983dc342c5235c03"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/02e01ab560b24342983dc342c5235c03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_02e01ab560b24342983dc342c5235c03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-82932581 Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 02e01ab560b24342983dc342c5235c03 Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-82932581 Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServerAddressesNegativeTestJSON-82932581-project Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 815408121fd94cc8897776382656d198 Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-82932581-project Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 85c5ef58-2d37-49d6-8bf8-dded3d45965a could not be found. Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '85c5ef58-2d37-49d6-8bf8-dded3d45965a'} Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85c5ef58-2d37-49d6-8bf8-dded3d45965a could not be found. Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85c5ef58-2d37-49d6-8bf8-dded3d45965a could not be found. Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:10:08.096286 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:10:08.100612 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:10:08.100612 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:10:08.100612 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:10:08.100612 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:10:08.100612 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:10:08.100612 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:10:08.100612 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85c5ef58-2d37-49d6-8bf8-dded3d45965a could not be found. Jun 20 12:10:08.100612 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:10:08.100612 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a9ef8399-49e1-4835-9e74-34d8e0ae91eb tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] Returning 404 to user: Instance 85c5ef58-2d37-49d6-8bf8-dded3d45965a could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:10:08.100612 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a9ef8399-49e1-4835-9e74-34d8e0ae91eb tempest-ServerAddressesNegativeTestJSON-82932581 tempest-ServerAddressesNegativeTestJSON-82932581-project] 10.222.0.27 "GET /compute/v2.1/servers/85c5ef58-2d37-49d6-8bf8-dded3d45965a" status: 404 len: 111 microversion: 2.1 time: 0.049454 Jun 20 12:10:08.100612 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1438/2832] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:08 2022] GET /compute/v2.1/servers/85c5ef58-2d37-49d6-8bf8-dded3d45965a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:10:08.108044 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-693ed837-bfc4-4e80-8923-2d84ca74b6b0 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:08.109139 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-693ed837-bfc4-4e80-8923-2d84ca74b6b0 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:08.121599 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-693ed837-bfc4-4e80-8923-2d84ca74b6b0 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:08.123642 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-693ed837-bfc4-4e80-8923-2d84ca74b6b0 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:08.124571 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-693ed837-bfc4-4e80-8923-2d84ca74b6b0 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:08.125066 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-693ed837-bfc4-4e80-8923-2d84ca74b6b0 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:08.229543 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-693ed837-bfc4-4e80-8923-2d84ca74b6b0 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:08.245691 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-693ed837-bfc4-4e80-8923-2d84ca74b6b0 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1271 microversion: 2.1 time: 0.143220 Jun 20 12:10:08.255769 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1439/2833] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:08 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1271 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:08.255769 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-80c812b5-d780-4f02-8d4a-b91b72e81945 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:08.255769 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-80c812b5-d780-4f02-8d4a-b91b72e81945 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: f6bb3154-9ddf-428c-82cd-74ab476e5a0a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:08.262706 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-80c812b5-d780-4f02-8d4a-b91b72e81945 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:08.263501 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-80c812b5-d780-4f02-8d4a-b91b72e81945 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:08.264682 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-80c812b5-d780-4f02-8d4a-b91b72e81945 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:08.265391 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-80c812b5-d780-4f02-8d4a-b91b72e81945 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:08.340784 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-30adadc3-0d39-4046-955d-02a34b618134 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:08.350698 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-30adadc3-0d39-4046-955d-02a34b618134 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:08.360408 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-30adadc3-0d39-4046-955d-02a34b618134 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:08.362207 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-30adadc3-0d39-4046-955d-02a34b618134 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1799 microversion: 2.32 time: 1.546041 Jun 20 12:10:08.363500 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1395/2834] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:06 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1799 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:08.483869 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ba091340-1457-44c7-8f47-772c682eba9c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:08.484938 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ba091340-1457-44c7-8f47-772c682eba9c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:08.498284 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba091340-1457-44c7-8f47-772c682eba9c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:08.499132 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba091340-1457-44c7-8f47-772c682eba9c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:08.500327 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba091340-1457-44c7-8f47-772c682eba9c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:08.500965 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba091340-1457-44c7-8f47-772c682eba9c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:08.619594 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-80c812b5-d780-4f02-8d4a-b91b72e81945 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:08.630361 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-80c812b5-d780-4f02-8d4a-b91b72e81945 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a" status: 200 len: 1527 microversion: 2.1 time: 0.382424 Jun 20 12:10:08.639651 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1440/2835] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:08 2022] GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a => generated 1527 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:08.989699 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6df528cf-bb40-41fc-ab2b-03ca5aadcd18 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:08.990425 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6df528cf-bb40-41fc-ab2b-03ca5aadcd18 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:09.011589 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6df528cf-bb40-41fc-ab2b-03ca5aadcd18 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:09.013123 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6df528cf-bb40-41fc-ab2b-03ca5aadcd18 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:09.015568 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6df528cf-bb40-41fc-ab2b-03ca5aadcd18 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:09.016717 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6df528cf-bb40-41fc-ab2b-03ca5aadcd18 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:09.302895 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6df528cf-bb40-41fc-ab2b-03ca5aadcd18 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:09.322146 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6df528cf-bb40-41fc-ab2b-03ca5aadcd18 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41" status: 200 len: 1520 microversion: 2.1 time: 0.336747 Jun 20 12:10:09.323111 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1441/2836] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:08 2022] GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 => generated 1520 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:09.335147 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7a75faf3-70fd-46d5-9b35-4f15fc3c9a47 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:09.336399 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7a75faf3-70fd-46d5-9b35-4f15fc3c9a47 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:09.345777 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7a75faf3-70fd-46d5-9b35-4f15fc3c9a47 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:09.346727 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7a75faf3-70fd-46d5-9b35-4f15fc3c9a47 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:09.348621 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7a75faf3-70fd-46d5-9b35-4f15fc3c9a47 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:09.350429 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7a75faf3-70fd-46d5-9b35-4f15fc3c9a47 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:09.674542 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7a75faf3-70fd-46d5-9b35-4f15fc3c9a47 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:09.688186 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7a75faf3-70fd-46d5-9b35-4f15fc3c9a47 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1313 microversion: 2.1 time: 0.359150 Jun 20 12:10:09.704582 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1442/2837] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:09 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1313 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:09.709769 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-45c75b87-110a-42cc-88a9-9f9beaa1cf03 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:09.710393 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-45c75b87-110a-42cc-88a9-9f9beaa1cf03 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:09.719279 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-45c75b87-110a-42cc-88a9-9f9beaa1cf03 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:09.719642 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-45c75b87-110a-42cc-88a9-9f9beaa1cf03 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:09.720444 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-45c75b87-110a-42cc-88a9-9f9beaa1cf03 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:09.720883 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-45c75b87-110a-42cc-88a9-9f9beaa1cf03 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:10.058223 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-45c75b87-110a-42cc-88a9-9f9beaa1cf03 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:10.077959 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-45c75b87-110a-42cc-88a9-9f9beaa1cf03 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:10.080434 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-45c75b87-110a-42cc-88a9-9f9beaa1cf03 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:10.084055 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-45c75b87-110a-42cc-88a9-9f9beaa1cf03 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1799 microversion: 2.32 time: 0.377853 Jun 20 12:10:10.084414 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ba091340-1457-44c7-8f47-772c682eba9c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:10.097397 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ba091340-1457-44c7-8f47-772c682eba9c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1512 microversion: 2.1 time: 1.616794 Jun 20 12:10:10.097397 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1396/2838] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:08 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1512 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:10.099377 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1443/2839] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:09 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1799 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:10.106932 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-b9c44ed3-1ba9-41b0-b283-94d7bf68f160 req-e76f2b51-f7f4-4b8a-be48-b36e53f51509 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6bb3154-9ddf-428c-82cd-74ab476e5a0a", "name": "network-vif-deleted", "tag": "70588baf-f83f-4160-862a-9baa231528c7"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:10:10.122730 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:10.125055 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1233b3db-3e66-477a-9265-aab09bc3e643 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:10.126538 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1233b3db-3e66-477a-9265-aab09bc3e643 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: f6bb3154-9ddf-428c-82cd-74ab476e5a0a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:10.129046 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b9c44ed3-1ba9-41b0-b283-94d7bf68f160 req-e76f2b51-f7f4-4b8a-be48-b36e53f51509 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:10.129687 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b9c44ed3-1ba9-41b0-b283-94d7bf68f160 req-e76f2b51-f7f4-4b8a-be48-b36e53f51509 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:10.160098 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1233b3db-3e66-477a-9265-aab09bc3e643 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:10.160671 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1233b3db-3e66-477a-9265-aab09bc3e643 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:10.161710 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1233b3db-3e66-477a-9265-aab09bc3e643 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:10.163474 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-b9c44ed3-1ba9-41b0-b283-94d7bf68f160 req-e76f2b51-f7f4-4b8a-be48-b36e53f51509 service nova] Creating event network-vif-deleted:70588baf-f83f-4160-862a-9baa231528c7 for instance f6bb3154-9ddf-428c-82cd-74ab476e5a0a on n-h1-master-1 Jun 20 12:10:10.164159 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1233b3db-3e66-477a-9265-aab09bc3e643 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:10.169861 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-b9c44ed3-1ba9-41b0-b283-94d7bf68f160 req-e76f2b51-f7f4-4b8a-be48-b36e53f51509 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067790 Jun 20 12:10:10.171002 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1444/2840] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:10:10.227289 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1233b3db-3e66-477a-9265-aab09bc3e643 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:10.228146 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1233b3db-3e66-477a-9265-aab09bc3e643 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:10.228931 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-1233b3db-3e66-477a-9265-aab09bc3e643 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lazy-loading 'fault' on Instance uuid f6bb3154-9ddf-428c-82cd-74ab476e5a0a {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:10:10.341770 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-76d9dfb4-d8ae-4da1-88e3-5c7aee4943b7 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:10.342573 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-76d9dfb4-d8ae-4da1-88e3-5c7aee4943b7 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:10.356606 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-76d9dfb4-d8ae-4da1-88e3-5c7aee4943b7 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:10.361890 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-76d9dfb4-d8ae-4da1-88e3-5c7aee4943b7 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:10.364038 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-76d9dfb4-d8ae-4da1-88e3-5c7aee4943b7 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:10.364881 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-76d9dfb4-d8ae-4da1-88e3-5c7aee4943b7 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:10.381273 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1233b3db-3e66-477a-9265-aab09bc3e643 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:10.395888 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1233b3db-3e66-477a-9265-aab09bc3e643 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a" status: 200 len: 1315 microversion: 2.1 time: 0.296777 Jun 20 12:10:10.397012 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1397/2841] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:10 2022] GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:10.620929 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-76d9dfb4-d8ae-4da1-88e3-5c7aee4943b7 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:10.633795 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-76d9dfb4-d8ae-4da1-88e3-5c7aee4943b7 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41" status: 200 len: 1505 microversion: 2.1 time: 0.298112 Jun 20 12:10:10.637005 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1445/2842] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:10 2022] GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 => generated 1505 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:10.655950 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8da1760d-d726-48d9-afc8-aa30a89dc558 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:10.657105 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8da1760d-d726-48d9-afc8-aa30a89dc558 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:10.670987 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8da1760d-d726-48d9-afc8-aa30a89dc558 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:10.671598 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8da1760d-d726-48d9-afc8-aa30a89dc558 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:10.672549 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8da1760d-d726-48d9-afc8-aa30a89dc558 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:10.673790 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8da1760d-d726-48d9-afc8-aa30a89dc558 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:10.696574 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:10.708573 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4dc033e2-4555-4a14-afb6-8fbbf6b792f5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:10.709749 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4dc033e2-4555-4a14-afb6-8fbbf6b792f5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:10.723041 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4dc033e2-4555-4a14-afb6-8fbbf6b792f5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:10.725196 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4dc033e2-4555-4a14-afb6-8fbbf6b792f5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:10.726666 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4dc033e2-4555-4a14-afb6-8fbbf6b792f5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:10.727355 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4dc033e2-4555-4a14-afb6-8fbbf6b792f5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:10.990541 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4dc033e2-4555-4a14-afb6-8fbbf6b792f5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:11.003715 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4dc033e2-4555-4a14-afb6-8fbbf6b792f5 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1313 microversion: 2.1 time: 0.300685 Jun 20 12:10:11.005155 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1446/2843] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:10 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1313 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:10:11.331046 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d05616f4-c3fa-4b3f-8d5c-8a2624846354 tempest-QuotaClassesAdmin257Test-787272369 tempest-QuotaClassesAdmin257Test-787272369-project-admin] Calling method '.version_select at 0x7f608299e9d0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:11.333381 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:10:11.333381 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 12:10:11.351806 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d05616f4-c3fa-4b3f-8d5c-8a2624846354 tempest-QuotaClassesAdmin257Test-787272369 tempest-QuotaClassesAdmin257Test-787272369-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.344377 Jun 20 12:10:11.354152 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1447/2844] 10.222.0.27 () {60 vars in 1225 bytes} [Mon Jun 20 12:10:11 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:10:11.359082 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e66f82fc-97c4-41fd-9166-2e2971758c56 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:11.359504 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e66f82fc-97c4-41fd-9166-2e2971758c56 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:11.368193 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e66f82fc-97c4-41fd-9166-2e2971758c56 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:11.368807 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e66f82fc-97c4-41fd-9166-2e2971758c56 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:11.369706 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e66f82fc-97c4-41fd-9166-2e2971758c56 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:11.370363 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e66f82fc-97c4-41fd-9166-2e2971758c56 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:11.430013 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8da1760d-d726-48d9-afc8-aa30a89dc558 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:11.443752 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8da1760d-d726-48d9-afc8-aa30a89dc558 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41" status: 200 len: 1505 microversion: 2.1 time: 0.791860 Jun 20 12:10:11.445562 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1398/2845] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:10 2022] GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 => generated 1505 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:11.452650 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-178c118a-59c9-489f-8c95-2ef244812964 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:11.453528 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-178c118a-59c9-489f-8c95-2ef244812964 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:11.476090 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-178c118a-59c9-489f-8c95-2ef244812964 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:11.476792 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-178c118a-59c9-489f-8c95-2ef244812964 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:11.478306 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-178c118a-59c9-489f-8c95-2ef244812964 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:11.480939 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-178c118a-59c9-489f-8c95-2ef244812964 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:11.569140 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e66f82fc-97c4-41fd-9166-2e2971758c56 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:11.580632 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e66f82fc-97c4-41fd-9166-2e2971758c56 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:11.586167 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e66f82fc-97c4-41fd-9166-2e2971758c56 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:11.587579 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e66f82fc-97c4-41fd-9166-2e2971758c56 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1845 microversion: 2.32 time: 0.233738 Jun 20 12:10:11.588241 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1448/2846] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:11 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1845 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:11.594583 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0c9cbe9d-3538-403f-a324-d5edd77cc177 tempest-QuotaClassesAdmin257Test-787272369 tempest-QuotaClassesAdmin257Test-787272369-project-admin] Action: 'update', calling method: .version_select at 0x7f6084943700>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:10:11.595204 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:10:11.595204 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 12:10:11.735043 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0c9cbe9d-3538-403f-a324-d5edd77cc177 tempest-QuotaClassesAdmin257Test-787272369 tempest-QuotaClassesAdmin257Test-787272369-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.145428 Jun 20 12:10:11.743130 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1449/2847] 10.222.0.27 () {62 vars in 1246 bytes} [Mon Jun 20 12:10:11 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:10:11.749871 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cf269306-72a5-43ca-836a-f398ce5312fd tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:11.750927 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cf269306-72a5-43ca-836a-f398ce5312fd tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: f6bb3154-9ddf-428c-82cd-74ab476e5a0a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:11.759703 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cf269306-72a5-43ca-836a-f398ce5312fd tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:11.760511 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cf269306-72a5-43ca-836a-f398ce5312fd tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:11.764108 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cf269306-72a5-43ca-836a-f398ce5312fd tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:11.764936 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cf269306-72a5-43ca-836a-f398ce5312fd tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:11.784327 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-cf269306-72a5-43ca-836a-f398ce5312fd tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] HTTP exception thrown: Instance f6bb3154-9ddf-428c-82cd-74ab476e5a0a could not be found. Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cf269306-72a5-43ca-836a-f398ce5312fd tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Request method failure captured: Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a HTTP/1.1 Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGN4qiwM-MecDHxONzVMkA72NR_SSrElKGFho2amrxg9uMlhFTBY3bq5CJPNlZORM2tW_nQRhsPIUTgettXi4lSiCQeK40e01rW_16Lzz4FJO6EC5uBs_A-i3_njR3_9I2L-oxsuaQd8HwAiDLKOUCEhiwyWJOA1WjMqhqu3KfOGLgY Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 4880e508de374c748670ce9ff5963336 Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4880e508de374c748670ce9ff5963336"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4880e508de374c748670ce9ff5963336"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4880e508de374c748670ce9ff5963336"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4880e508de374c748670ce9ff5963336"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 4880e508de374c748670ce9ff5963336 Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ImagesOneServerNegativeTestJSON-1288781692-project Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 16367ef663a74bd49162b82a7e661d1e Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692-project Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: exception: Instance f6bb3154-9ddf-428c-82cd-74ab476e5a0a could not be found. Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'f6bb3154-9ddf-428c-82cd-74ab476e5a0a'} Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6bb3154-9ddf-428c-82cd-74ab476e5a0a could not be found. Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6bb3154-9ddf-428c-82cd-74ab476e5a0a could not be found. Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:10:11.786758 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:10:11.791156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:10:11.791156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:10:11.791156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:10:11.791156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:10:11.791156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:10:11.791156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:10:11.791156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6bb3154-9ddf-428c-82cd-74ab476e5a0a could not be found. Jun 20 12:10:11.791156 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:10:11.793030 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cf269306-72a5-43ca-836a-f398ce5312fd tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Returning 404 to user: Instance f6bb3154-9ddf-428c-82cd-74ab476e5a0a could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:10:11.794114 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cf269306-72a5-43ca-836a-f398ce5312fd tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a" status: 404 len: 111 microversion: 2.1 time: 0.049624 Jun 20 12:10:11.794882 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1450/2848] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:11 2022] GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:10:11.799838 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f501b3a8-28d9-4413-9aa6-5740053264ff tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:11.800928 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f501b3a8-28d9-4413-9aa6-5740053264ff tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:11.808729 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f501b3a8-28d9-4413-9aa6-5740053264ff tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:11.809693 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f501b3a8-28d9-4413-9aa6-5740053264ff tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:11.810788 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f501b3a8-28d9-4413-9aa6-5740053264ff tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:11.811428 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f501b3a8-28d9-4413-9aa6-5740053264ff tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:11.841224 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f501b3a8-28d9-4413-9aa6-5740053264ff tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:10:11.939799 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f501b3a8-28d9-4413-9aa6-5740053264ff tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41" status: 204 len: 0 microversion: 2.1 time: 0.142576 Jun 20 12:10:11.945230 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1451/2849] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:10:11 2022] DELETE /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:10:11.972879 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b8c51e7b-d45a-46a0-a4d5-479d3b731c3d tempest-QuotaClassesAdmin257Test-787272369 tempest-QuotaClassesAdmin257Test-787272369-project-admin] Calling method '.version_select at 0x7f60733d91f0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:11.975585 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:10:11.975585 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 12:10:11.999385 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b8c51e7b-d45a-46a0-a4d5-479d3b731c3d tempest-QuotaClassesAdmin257Test-787272369 tempest-QuotaClassesAdmin257Test-787272369-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.051696 Jun 20 12:10:12.006357 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1452/2850] 10.222.0.27 () {60 vars in 1225 bytes} [Mon Jun 20 12:10:11 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:10:12.022909 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e84e343a-a5b7-4633-81c4-befe11faaf14 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Action: 'create', calling method: .version_select at 0x7f6073f25c10>, body: {"keypair": {"name": "tempest-keypair-664927390", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJx9Gb5GhASMXlrjgb3CHvEFiKgO8c274bPeWGonQB97qe9tcVQndlUOd/EvzHhtrTY99O84W6Pgz3rOx+zcqrCxkvDzK8QNjm07JXjQtEwBvyDCG81OMOLQugA/l8p83Q=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:10:12.071128 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-e84e343a-a5b7-4633-81c4-befe11faaf14 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Getting quotas for project 4880e508de374c748670ce9ff5963336. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:10:12.081963 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-e84e343a-a5b7-4633-81c4-befe11faaf14 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Getting quotas for user 16367ef663a74bd49162b82a7e661d1e and project 4880e508de374c748670ce9ff5963336. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:10:12.119097 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e84e343a-a5b7-4633-81c4-befe11faaf14 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.117658 Jun 20 12:10:12.120017 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1453/2851] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 12:10:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:10:12.126232 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-443498e9-c61b-405d-becb-250757318ea2 tempest-QuotaClassesAdmin257Test-787272369 tempest-QuotaClassesAdmin257Test-787272369-project-admin] Action: 'update', calling method: .version_select at 0x7f6073542310>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:10:12.129174 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:10:12.129174 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 12:10:12.247643 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-443498e9-c61b-405d-becb-250757318ea2 tempest-QuotaClassesAdmin257Test-787272369 tempest-QuotaClassesAdmin257Test-787272369-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.125798 Jun 20 12:10:12.250094 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1454/2852] 10.222.0.27 () {62 vars in 1246 bytes} [Mon Jun 20 12:10:12 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:10:12.271606 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a70dfca3-5a48-4536-bfb4-a6b8c7de367c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:12.273775 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a70dfca3-5a48-4536-bfb4-a6b8c7de367c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:12.291694 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-178c118a-59c9-489f-8c95-2ef244812964 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:12.292972 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a70dfca3-5a48-4536-bfb4-a6b8c7de367c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:12.293351 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a70dfca3-5a48-4536-bfb4-a6b8c7de367c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:12.300954 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a70dfca3-5a48-4536-bfb4-a6b8c7de367c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:12.301799 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a70dfca3-5a48-4536-bfb4-a6b8c7de367c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:12.301962 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-178c118a-59c9-489f-8c95-2ef244812964 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1512 microversion: 2.1 time: 0.853802 Jun 20 12:10:12.313375 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1399/2853] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:11 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1512 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:12.331923 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9a6502de-97fc-414f-81e9-2bbcc5b25a99 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1282329803", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "63e98b43-e754-4964-976c-5396a9294741"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:10:12.341854 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:12.404584 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-9a6502de-97fc-414f-81e9-2bbcc5b25a99 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] validate_networks() for [('63e98b43-e754-4964-976c-5396a9294741', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:10:12.778843 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a70dfca3-5a48-4536-bfb4-a6b8c7de367c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:12.810529 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a70dfca3-5a48-4536-bfb4-a6b8c7de367c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1313 microversion: 2.1 time: 0.558997 Jun 20 12:10:12.813201 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1455/2854] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:12 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1313 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:12.839144 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e665bb37-64cd-44e6-8cd4-950204d882c2 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:12.839795 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e665bb37-64cd-44e6-8cd4-950204d882c2 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:12.852899 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e665bb37-64cd-44e6-8cd4-950204d882c2 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:12.855573 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e665bb37-64cd-44e6-8cd4-950204d882c2 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:12.856836 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e665bb37-64cd-44e6-8cd4-950204d882c2 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:12.858479 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e665bb37-64cd-44e6-8cd4-950204d882c2 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:13.177665 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e665bb37-64cd-44e6-8cd4-950204d882c2 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:13.180029 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:13.210067 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e665bb37-64cd-44e6-8cd4-950204d882c2 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:13.211760 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e665bb37-64cd-44e6-8cd4-950204d882c2 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:13.213035 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e665bb37-64cd-44e6-8cd4-950204d882c2 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1845 microversion: 2.32 time: 0.388348 Jun 20 12:10:13.214649 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1456/2855] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:12 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1845 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:13.319375 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a1e1c3ed-9963-40bd-996a-ace8e1d8aa3a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:13.320281 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a1e1c3ed-9963-40bd-996a-ace8e1d8aa3a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:13.338803 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a1e1c3ed-9963-40bd-996a-ace8e1d8aa3a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:13.339264 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a1e1c3ed-9963-40bd-996a-ace8e1d8aa3a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:13.340052 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a1e1c3ed-9963-40bd-996a-ace8e1d8aa3a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:13.340532 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a1e1c3ed-9963-40bd-996a-ace8e1d8aa3a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:13.566234 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a1e1c3ed-9963-40bd-996a-ace8e1d8aa3a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:13.581744 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a1e1c3ed-9963-40bd-996a-ace8e1d8aa3a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1512 microversion: 2.1 time: 0.264554 Jun 20 12:10:13.581744 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1457/2856] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:13 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1512 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:13.838557 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-92323d6a-bdf6-4073-ba56-56f104ab4ab8 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:13.839436 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-92323d6a-bdf6-4073-ba56-56f104ab4ab8 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:13.854358 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-92323d6a-bdf6-4073-ba56-56f104ab4ab8 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:13.856887 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-92323d6a-bdf6-4073-ba56-56f104ab4ab8 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:13.857786 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-92323d6a-bdf6-4073-ba56-56f104ab4ab8 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:13.864586 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-92323d6a-bdf6-4073-ba56-56f104ab4ab8 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:14.506631 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-92323d6a-bdf6-4073-ba56-56f104ab4ab8 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:14.518560 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-92323d6a-bdf6-4073-ba56-56f104ab4ab8 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1313 microversion: 2.1 time: 0.690245 Jun 20 12:10:14.519114 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1458/2857] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:13 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1313 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:10:14.530925 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-6dd85d9f-fe98-4565-87c1-a5f988f65533 req-3cc9775a-173c-4917-9128-f16e056217f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4404478d-26ca-49d1-a629-8cecf8b967a1", "tag": "5dd43a26-552a-45c5-9e58-286e7499c6c8"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:10:14.555413 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-6dd85d9f-fe98-4565-87c1-a5f988f65533 req-3cc9775a-173c-4917-9128-f16e056217f8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:14.555857 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-6dd85d9f-fe98-4565-87c1-a5f988f65533 req-3cc9775a-173c-4917-9128-f16e056217f8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:14.590197 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-6dd85d9f-fe98-4565-87c1-a5f988f65533 req-3cc9775a-173c-4917-9128-f16e056217f8 service nova] Creating event network-changed:5dd43a26-552a-45c5-9e58-286e7499c6c8 for instance 4404478d-26ca-49d1-a629-8cecf8b967a1 on n-h1-master-1 Jun 20 12:10:14.602153 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-6dd85d9f-fe98-4565-87c1-a5f988f65533 req-3cc9775a-173c-4917-9128-f16e056217f8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081818 Jun 20 12:10:14.602777 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1459/2858] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:10:14.612666 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a5903d8a-a298-4010-9c88-d14261d246d2 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:14.616437 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a5903d8a-a298-4010-9c88-d14261d246d2 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:14.641946 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5903d8a-a298-4010-9c88-d14261d246d2 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:14.642386 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5903d8a-a298-4010-9c88-d14261d246d2 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:14.643362 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5903d8a-a298-4010-9c88-d14261d246d2 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:14.643996 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5903d8a-a298-4010-9c88-d14261d246d2 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:14.764112 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-9a6502de-97fc-414f-81e9-2bbcc5b25a99 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:10:14.764684 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-9a6502de-97fc-414f-81e9-2bbcc5b25a99 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:10:14.765122 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-9a6502de-97fc-414f-81e9-2bbcc5b25a99 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:10:14.766497 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-9a6502de-97fc-414f-81e9-2bbcc5b25a99 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:10:14.768054 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-9a6502de-97fc-414f-81e9-2bbcc5b25a99 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:10:14.780604 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9a6502de-97fc-414f-81e9-2bbcc5b25a99 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:14.781584 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9a6502de-97fc-414f-81e9-2bbcc5b25a99 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:14.783549 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9a6502de-97fc-414f-81e9-2bbcc5b25a99 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:14.784688 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9a6502de-97fc-414f-81e9-2bbcc5b25a99 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:14.821735 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-9a6502de-97fc-414f-81e9-2bbcc5b25a99 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Getting quotas for project f62c06c318b54505b639ad49a10dc9e5. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:10:14.836183 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-9a6502de-97fc-414f-81e9-2bbcc5b25a99 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Getting quotas for user f9d39a7ff9af475b88d8ca1f1536fdf2 and project f62c06c318b54505b639ad49a10dc9e5. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:10:14.862496 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9a6502de-97fc-414f-81e9-2bbcc5b25a99 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:10:14.868756 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9a6502de-97fc-414f-81e9-2bbcc5b25a99 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:10:14.985020 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9a6502de-97fc-414f-81e9-2bbcc5b25a99 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.652029 Jun 20 12:10:14.987422 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1400/2859] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:10:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:10:14.997045 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-149dfc9b-22e6-4376-9eb8-00c031ebd9e9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:15.017089 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-149dfc9b-22e6-4376-9eb8-00c031ebd9e9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:15.057660 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-149dfc9b-22e6-4376-9eb8-00c031ebd9e9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:15.058710 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-149dfc9b-22e6-4376-9eb8-00c031ebd9e9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:15.059995 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-149dfc9b-22e6-4376-9eb8-00c031ebd9e9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:15.060787 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-149dfc9b-22e6-4376-9eb8-00c031ebd9e9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:15.067330 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a5903d8a-a298-4010-9c88-d14261d246d2 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:15.077020 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a5903d8a-a298-4010-9c88-d14261d246d2 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:15.078527 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a5903d8a-a298-4010-9c88-d14261d246d2 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:15.079726 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a5903d8a-a298-4010-9c88-d14261d246d2 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1845 microversion: 2.32 time: 0.475845 Jun 20 12:10:15.089173 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1460/2860] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:14 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1845 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:15.099064 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3c592247-0070-4169-8071-b0cb0df3db95 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:15.099617 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3c592247-0070-4169-8071-b0cb0df3db95 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:15.262757 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3c592247-0070-4169-8071-b0cb0df3db95 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:15.308849 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3c592247-0070-4169-8071-b0cb0df3db95 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1218 microversion: 2.1 time: 0.213719 Jun 20 12:10:15.311100 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1461/2861] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:15 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1218 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:15.537466 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-38260ce8-9905-48e7-9d29-a0b291b4c726 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:15.541540 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-38260ce8-9905-48e7-9d29-a0b291b4c726 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:15.592129 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-38260ce8-9905-48e7-9d29-a0b291b4c726 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:15.596030 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-38260ce8-9905-48e7-9d29-a0b291b4c726 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:15.602331 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-38260ce8-9905-48e7-9d29-a0b291b4c726 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:15.603035 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-38260ce8-9905-48e7-9d29-a0b291b4c726 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:15.876621 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-149dfc9b-22e6-4376-9eb8-00c031ebd9e9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:15.905200 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-149dfc9b-22e6-4376-9eb8-00c031ebd9e9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1512 microversion: 2.1 time: 0.916026 Jun 20 12:10:15.905826 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1401/2862] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:14 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1512 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:16.102482 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6c67ab9c-0dde-40cf-b92b-ee6b87ac081e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:16.103360 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6c67ab9c-0dde-40cf-b92b-ee6b87ac081e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:16.114508 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6c67ab9c-0dde-40cf-b92b-ee6b87ac081e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:16.115216 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6c67ab9c-0dde-40cf-b92b-ee6b87ac081e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:16.121628 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6c67ab9c-0dde-40cf-b92b-ee6b87ac081e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:16.122336 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6c67ab9c-0dde-40cf-b92b-ee6b87ac081e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:16.280683 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-38260ce8-9905-48e7-9d29-a0b291b4c726 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:16.293126 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-38260ce8-9905-48e7-9d29-a0b291b4c726 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1313 microversion: 2.1 time: 0.761733 Jun 20 12:10:16.294074 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1462/2863] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:15 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1313 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:16.328227 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8822c216-599d-49ee-a516-b3a1987758b4 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:16.332305 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8822c216-599d-49ee-a516-b3a1987758b4 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:16.344891 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8822c216-599d-49ee-a516-b3a1987758b4 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:16.346854 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8822c216-599d-49ee-a516-b3a1987758b4 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:16.347864 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8822c216-599d-49ee-a516-b3a1987758b4 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:16.348484 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8822c216-599d-49ee-a516-b3a1987758b4 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:16.452157 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8822c216-599d-49ee-a516-b3a1987758b4 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:16.462799 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8822c216-599d-49ee-a516-b3a1987758b4 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1270 microversion: 2.1 time: 0.138268 Jun 20 12:10:16.464098 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1463/2864] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:16 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1270 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:16.669159 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-fcc9d845-6e16-4da0-8830-e1fed18d57bf req-a8a3a366-0a98-4018-9794-598aeea64c17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36218945-42bd-45a4-889b-b411acdd4155", "tag": "a3f0416b-e069-41e8-9db8-7e848d1875ab"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:10:16.694607 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-fcc9d845-6e16-4da0-8830-e1fed18d57bf req-a8a3a366-0a98-4018-9794-598aeea64c17 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:16.696227 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-fcc9d845-6e16-4da0-8830-e1fed18d57bf req-a8a3a366-0a98-4018-9794-598aeea64c17 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:16.722895 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-fcc9d845-6e16-4da0-8830-e1fed18d57bf req-a8a3a366-0a98-4018-9794-598aeea64c17 service nova] Creating event network-changed:a3f0416b-e069-41e8-9db8-7e848d1875ab for instance 36218945-42bd-45a4-889b-b411acdd4155 on n-h1-master-1 Jun 20 12:10:16.738548 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-fcc9d845-6e16-4da0-8830-e1fed18d57bf req-a8a3a366-0a98-4018-9794-598aeea64c17 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072735 Jun 20 12:10:16.741117 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1464/2865] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:10:16.926181 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-931741d0-fc91-4e4c-bd32-c6e2257c882c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:16.927004 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-931741d0-fc91-4e4c-bd32-c6e2257c882c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:16.962095 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-931741d0-fc91-4e4c-bd32-c6e2257c882c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:16.963652 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-931741d0-fc91-4e4c-bd32-c6e2257c882c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:16.966882 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-931741d0-fc91-4e4c-bd32-c6e2257c882c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:16.969228 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-931741d0-fc91-4e4c-bd32-c6e2257c882c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:17.122999 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6c67ab9c-0dde-40cf-b92b-ee6b87ac081e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:17.150018 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6c67ab9c-0dde-40cf-b92b-ee6b87ac081e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:17.152328 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6c67ab9c-0dde-40cf-b92b-ee6b87ac081e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:17.154271 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6c67ab9c-0dde-40cf-b92b-ee6b87ac081e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1845 microversion: 2.32 time: 1.056198 Jun 20 12:10:17.167886 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1402/2866] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:16 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1845 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:10:17.313348 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e0b9d672-73ec-40ff-b501-f1743c5f7539 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:17.317390 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e0b9d672-73ec-40ff-b501-f1743c5f7539 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:17.341510 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e0b9d672-73ec-40ff-b501-f1743c5f7539 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:17.343525 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e0b9d672-73ec-40ff-b501-f1743c5f7539 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:17.344965 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e0b9d672-73ec-40ff-b501-f1743c5f7539 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:17.363881 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e0b9d672-73ec-40ff-b501-f1743c5f7539 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:18.010889 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e0b9d672-73ec-40ff-b501-f1743c5f7539 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:18.020286 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e0b9d672-73ec-40ff-b501-f1743c5f7539 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1313 microversion: 2.1 time: 0.711243 Jun 20 12:10:18.025480 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1403/2867] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:17 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1313 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:18.039610 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c6a1bdfa-4860-4829-8598-31b2e3e9a132 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:18.041391 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c6a1bdfa-4860-4829-8598-31b2e3e9a132 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:18.059744 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c6a1bdfa-4860-4829-8598-31b2e3e9a132 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:18.060433 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c6a1bdfa-4860-4829-8598-31b2e3e9a132 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:18.074729 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c6a1bdfa-4860-4829-8598-31b2e3e9a132 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:18.075077 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c6a1bdfa-4860-4829-8598-31b2e3e9a132 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:18.330067 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c6a1bdfa-4860-4829-8598-31b2e3e9a132 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:18.341674 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c6a1bdfa-4860-4829-8598-31b2e3e9a132 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1276 microversion: 2.1 time: 0.314698 Jun 20 12:10:18.343912 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1404/2868] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:18 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1276 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:18.356529 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-13032c33-ad2b-4475-b9be-89eb7813fccf tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:18.358735 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-13032c33-ad2b-4475-b9be-89eb7813fccf tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:18.373238 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:18.380617 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13032c33-ad2b-4475-b9be-89eb7813fccf tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:18.381422 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13032c33-ad2b-4475-b9be-89eb7813fccf tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:18.384415 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13032c33-ad2b-4475-b9be-89eb7813fccf tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:18.386764 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13032c33-ad2b-4475-b9be-89eb7813fccf tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:19.142973 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-931741d0-fc91-4e4c-bd32-c6e2257c882c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:19.157842 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-931741d0-fc91-4e4c-bd32-c6e2257c882c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1512 microversion: 2.1 time: 2.237834 Jun 20 12:10:19.159232 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1465/2869] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:16 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1512 bytes in 2240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:19.176226 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8574f33c-de89-4777-b3cf-1e6cef242028 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1951960377", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:10:19.273855 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-8574f33c-de89-4777-b3cf-1e6cef242028 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] validate_networks() for [('9bb4b974-67e4-46e5-95b7-e1615d1df6f7', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:10:20.374381 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-13032c33-ad2b-4475-b9be-89eb7813fccf tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:20.384819 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-13032c33-ad2b-4475-b9be-89eb7813fccf tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:20.386728 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-13032c33-ad2b-4475-b9be-89eb7813fccf tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:20.388231 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-13032c33-ad2b-4475-b9be-89eb7813fccf tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1866 microversion: 2.32 time: 2.041866 Jun 20 12:10:20.389581 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1405/2870] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:18 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1866 bytes in 2045 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:20.395339 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-4e38965b-7bcb-4931-8b93-467373a0b5ef req-a6b526ec-503c-4410-a71d-3be8b8dc2b2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c9e8490-b371-4215-af47-09ebe2b7cd41", "name": "network-vif-deleted", "tag": "9589165b-8125-4dbe-9ce0-546dbf131a7a"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:10:20.406021 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-4e38965b-7bcb-4931-8b93-467373a0b5ef req-a6b526ec-503c-4410-a71d-3be8b8dc2b2e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:20.406742 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-4e38965b-7bcb-4931-8b93-467373a0b5ef req-a6b526ec-503c-4410-a71d-3be8b8dc2b2e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:20.432537 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-4e38965b-7bcb-4931-8b93-467373a0b5ef req-a6b526ec-503c-4410-a71d-3be8b8dc2b2e service nova] Creating event network-vif-deleted:9589165b-8125-4dbe-9ce0-546dbf131a7a for instance 0c9e8490-b371-4215-af47-09ebe2b7cd41 on n-h1-master-1 Jun 20 12:10:20.439864 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-4e38965b-7bcb-4931-8b93-467373a0b5ef req-a6b526ec-503c-4410-a71d-3be8b8dc2b2e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048671 Jun 20 12:10:20.441660 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1406/2871] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:10:20.448055 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-23736f3b-b200-49b7-bd96-edcd4b5fa769 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:20.449100 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-23736f3b-b200-49b7-bd96-edcd4b5fa769 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:20.458578 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23736f3b-b200-49b7-bd96-edcd4b5fa769 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:20.459569 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23736f3b-b200-49b7-bd96-edcd4b5fa769 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:20.461024 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23736f3b-b200-49b7-bd96-edcd4b5fa769 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:20.462011 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23736f3b-b200-49b7-bd96-edcd4b5fa769 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:20.885885 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-23736f3b-b200-49b7-bd96-edcd4b5fa769 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:20.900741 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-23736f3b-b200-49b7-bd96-edcd4b5fa769 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1313 microversion: 2.1 time: 0.456992 Jun 20 12:10:20.902045 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1407/2872] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:20 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1313 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:20.920288 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-67474dcb-7408-435f-9d58-e573534252aa tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:20.920926 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-67474dcb-7408-435f-9d58-e573534252aa tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:20.932712 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-67474dcb-7408-435f-9d58-e573534252aa tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:20.933188 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-67474dcb-7408-435f-9d58-e573534252aa tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:20.933989 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-67474dcb-7408-435f-9d58-e573534252aa tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:20.934511 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-67474dcb-7408-435f-9d58-e573534252aa tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:21.668083 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-67474dcb-7408-435f-9d58-e573534252aa tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:21.702770 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-67474dcb-7408-435f-9d58-e573534252aa tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1318 microversion: 2.1 time: 0.791987 Jun 20 12:10:21.711819 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1408/2873] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:20 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1318 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:21.738619 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1f588388-f227-4572-9033-3dd7d8dcfe81 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:21.741181 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1f588388-f227-4572-9033-3dd7d8dcfe81 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:21.756275 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f588388-f227-4572-9033-3dd7d8dcfe81 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:21.757186 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f588388-f227-4572-9033-3dd7d8dcfe81 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:21.758147 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f588388-f227-4572-9033-3dd7d8dcfe81 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:21.758740 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f588388-f227-4572-9033-3dd7d8dcfe81 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:21.934937 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-8574f33c-de89-4777-b3cf-1e6cef242028 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:10:21.935934 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-8574f33c-de89-4777-b3cf-1e6cef242028 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:10:21.936997 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-8574f33c-de89-4777-b3cf-1e6cef242028 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:10:21.937709 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-8574f33c-de89-4777-b3cf-1e6cef242028 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:10:21.938397 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-8574f33c-de89-4777-b3cf-1e6cef242028 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:10:21.971274 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8574f33c-de89-4777-b3cf-1e6cef242028 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:21.972439 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8574f33c-de89-4777-b3cf-1e6cef242028 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:21.973450 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8574f33c-de89-4777-b3cf-1e6cef242028 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:21.974061 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8574f33c-de89-4777-b3cf-1e6cef242028 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:21.988801 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=15,nova_api:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:21.998897 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-8574f33c-de89-4777-b3cf-1e6cef242028 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Getting quotas for project 4880e508de374c748670ce9ff5963336. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:10:22.007299 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-8574f33c-de89-4777-b3cf-1e6cef242028 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Getting quotas for user 16367ef663a74bd49162b82a7e661d1e and project 4880e508de374c748670ce9ff5963336. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:10:22.026273 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8574f33c-de89-4777-b3cf-1e6cef242028 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:10:22.035707 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8574f33c-de89-4777-b3cf-1e6cef242028 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 7014bfb5-b083-485f-9711-b7cc95634c41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:10:22.095669 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1f588388-f227-4572-9033-3dd7d8dcfe81 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:22.107140 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1f588388-f227-4572-9033-3dd7d8dcfe81 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1512 microversion: 2.1 time: 0.393546 Jun 20 12:10:22.118406 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1409/2874] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:21 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1512 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:22.122100 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8574f33c-de89-4777-b3cf-1e6cef242028 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.960169 Jun 20 12:10:22.125518 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1466/2875] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:10:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 2966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:10:22.141662 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bee8ca10-f69d-4fbd-80d3-7687ca05bb6c tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:22.142444 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bee8ca10-f69d-4fbd-80d3-7687ca05bb6c tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:22.178012 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bee8ca10-f69d-4fbd-80d3-7687ca05bb6c tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:22.179505 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bee8ca10-f69d-4fbd-80d3-7687ca05bb6c tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:22.181748 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bee8ca10-f69d-4fbd-80d3-7687ca05bb6c tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:22.182402 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bee8ca10-f69d-4fbd-80d3-7687ca05bb6c tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:22.345226 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0cd23b5a-0e57-43f0-8d0c-00f7e0e73810 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1325312724", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": "none"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:10:22.484112 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-0cd23b5a-0e57-43f0-8d0c-00f7e0e73810 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:10:22.484447 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-0cd23b5a-0e57-43f0-8d0c-00f7e0e73810 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:10:22.484923 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-0cd23b5a-0e57-43f0-8d0c-00f7e0e73810 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:10:22.485327 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-0cd23b5a-0e57-43f0-8d0c-00f7e0e73810 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:10:22.485739 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-0cd23b5a-0e57-43f0-8d0c-00f7e0e73810 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:10:22.519030 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cd23b5a-0e57-43f0-8d0c-00f7e0e73810 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:22.519489 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cd23b5a-0e57-43f0-8d0c-00f7e0e73810 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:22.524320 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cd23b5a-0e57-43f0-8d0c-00f7e0e73810 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:22.526285 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cd23b5a-0e57-43f0-8d0c-00f7e0e73810 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:22.599766 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-0cd23b5a-0e57-43f0-8d0c-00f7e0e73810 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Getting quotas for project 036852f6c8fd4004b937eb3e8fe0307c. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:10:22.616052 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-0cd23b5a-0e57-43f0-8d0c-00f7e0e73810 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Getting quotas for user eeb7eb7131a44c66944ee2c53eaa3b79 and project 036852f6c8fd4004b937eb3e8fe0307c. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:10:22.637547 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0cd23b5a-0e57-43f0-8d0c-00f7e0e73810 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:10:22.640319 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0cd23b5a-0e57-43f0-8d0c-00f7e0e73810 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:10:22.775479 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0cd23b5a-0e57-43f0-8d0c-00f7e0e73810 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.653737 Jun 20 12:10:22.806991 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1410/2876] 10.222.0.27 () {62 vars in 1187 bytes} [Mon Jun 20 12:10:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 20 12:10:22.822242 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8f4da5cf-edfd-4217-a633-799af32f8350 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:22.827327 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8f4da5cf-edfd-4217-a633-799af32f8350 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:22.849312 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8f4da5cf-edfd-4217-a633-799af32f8350 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:22.849763 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8f4da5cf-edfd-4217-a633-799af32f8350 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:22.853958 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8f4da5cf-edfd-4217-a633-799af32f8350 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:22.854499 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8f4da5cf-edfd-4217-a633-799af32f8350 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:22.870520 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bee8ca10-f69d-4fbd-80d3-7687ca05bb6c tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:22.884534 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bee8ca10-f69d-4fbd-80d3-7687ca05bb6c tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:22.893306 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bee8ca10-f69d-4fbd-80d3-7687ca05bb6c tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:22.901193 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bee8ca10-f69d-4fbd-80d3-7687ca05bb6c tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1875 microversion: 2.32 time: 0.770851 Jun 20 12:10:22.902480 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1467/2877] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:22 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1875 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:22.915069 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-995a4ab3-1816-4e7f-98f9-3d1207069a51 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:22.916971 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-995a4ab3-1816-4e7f-98f9-3d1207069a51 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 7014bfb5-b083-485f-9711-b7cc95634c41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:23.105824 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-995a4ab3-1816-4e7f-98f9-3d1207069a51 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:23.138787 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-995a4ab3-1816-4e7f-98f9-3d1207069a51 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41" status: 200 len: 1225 microversion: 2.1 time: 0.232125 Jun 20 12:10:23.140776 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1468/2878] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:22 2022] GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41 => generated 1225 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:23.162006 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-e4be08f8-6f57-478f-9bd6-fea766df8103 req-f4b91bd9-ef57-482f-876e-5b08d52275d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36218945-42bd-45a4-889b-b411acdd4155", "tag": "180da7b7-ef36-401f-943e-30f5c9d8ecc6"}, {"name": "network-changed", "server_uuid": "36218945-42bd-45a4-889b-b411acdd4155", "tag": "106b84b6-fcc3-4d62-a238-c341d6254586"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:10:23.204796 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-e4be08f8-6f57-478f-9bd6-fea766df8103 req-f4b91bd9-ef57-482f-876e-5b08d52275d6 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:23.210439 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-e4be08f8-6f57-478f-9bd6-fea766df8103 req-f4b91bd9-ef57-482f-876e-5b08d52275d6 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:23.257169 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-e4be08f8-6f57-478f-9bd6-fea766df8103 req-f4b91bd9-ef57-482f-876e-5b08d52275d6 service nova] Creating event network-changed:180da7b7-ef36-401f-943e-30f5c9d8ecc6 for instance 36218945-42bd-45a4-889b-b411acdd4155 on n-h1-master-1 Jun 20 12:10:23.260784 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-e4be08f8-6f57-478f-9bd6-fea766df8103 req-f4b91bd9-ef57-482f-876e-5b08d52275d6 service nova] Creating event network-changed:106b84b6-fcc3-4d62-a238-c341d6254586 for instance 36218945-42bd-45a4-889b-b411acdd4155 on n-h1-master-1 Jun 20 12:10:23.284570 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-e4be08f8-6f57-478f-9bd6-fea766df8103 req-f4b91bd9-ef57-482f-876e-5b08d52275d6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.135961 Jun 20 12:10:23.290382 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1469/2879] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:10:23.309796 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-336faef2-cf1d-4aa3-acd7-6a6d79ac56e9 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:23.323756 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-336faef2-cf1d-4aa3-acd7-6a6d79ac56e9 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:23.366414 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-336faef2-cf1d-4aa3-acd7-6a6d79ac56e9 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:23.367143 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-336faef2-cf1d-4aa3-acd7-6a6d79ac56e9 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:23.368629 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-336faef2-cf1d-4aa3-acd7-6a6d79ac56e9 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:23.369254 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-336faef2-cf1d-4aa3-acd7-6a6d79ac56e9 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:23.609454 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-336faef2-cf1d-4aa3-acd7-6a6d79ac56e9 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:23.622604 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-336faef2-cf1d-4aa3-acd7-6a6d79ac56e9 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1318 microversion: 2.1 time: 0.330456 Jun 20 12:10:23.624010 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1470/2880] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:23 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:23.630299 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b264d7cf-8c65-4c22-89ab-5dd1e0dec08d tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:10:23.632475 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b264d7cf-8c65-4c22-89ab-5dd1e0dec08d tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:23.797260 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b264d7cf-8c65-4c22-89ab-5dd1e0dec08d tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:23.807767 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b264d7cf-8c65-4c22-89ab-5dd1e0dec08d tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:23.809245 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b264d7cf-8c65-4c22-89ab-5dd1e0dec08d tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:23.817787 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b264d7cf-8c65-4c22-89ab-5dd1e0dec08d tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "PUT /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1359 microversion: 2.75 time: 0.191974 Jun 20 12:10:23.831119 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1471/2881] 10.222.0.27 () {62 vars in 1296 bytes} [Mon Jun 20 12:10:23 2022] PUT /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1359 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:23.831119 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-aa7f657e-1369-46ad-a481-50393d90153c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:23.831119 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-aa7f657e-1369-46ad-a481-50393d90153c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:23.832874 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa7f657e-1369-46ad-a481-50393d90153c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:23.833353 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa7f657e-1369-46ad-a481-50393d90153c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:23.834160 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa7f657e-1369-46ad-a481-50393d90153c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:23.834603 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa7f657e-1369-46ad-a481-50393d90153c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:24.234049 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8f4da5cf-edfd-4217-a633-799af32f8350 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:24.253803 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8f4da5cf-edfd-4217-a633-799af32f8350 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1313 microversion: 2.1 time: 1.444994 Jun 20 12:10:24.254927 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1411/2882] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:22 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1313 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:24.259600 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-885e2e30-9016-4e93-8ddf-1d4dfd30dbf0 req-6bf13589-b21a-42fd-bb8a-ae95bff5f384 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31440c3e-bac0-437b-acd0-97351ddaae67", "tag": "63464faa-0494-41e3-88aa-fae7ed2a5773"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:10:24.278690 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-885e2e30-9016-4e93-8ddf-1d4dfd30dbf0 req-6bf13589-b21a-42fd-bb8a-ae95bff5f384 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:24.279435 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-885e2e30-9016-4e93-8ddf-1d4dfd30dbf0 req-6bf13589-b21a-42fd-bb8a-ae95bff5f384 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:24.305596 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-885e2e30-9016-4e93-8ddf-1d4dfd30dbf0 req-6bf13589-b21a-42fd-bb8a-ae95bff5f384 service nova] Creating event network-changed:63464faa-0494-41e3-88aa-fae7ed2a5773 for instance 31440c3e-bac0-437b-acd0-97351ddaae67 on n-h2-master-1 Jun 20 12:10:24.309852 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-aa7f657e-1369-46ad-a481-50393d90153c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:24.313783 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-885e2e30-9016-4e93-8ddf-1d4dfd30dbf0 req-6bf13589-b21a-42fd-bb8a-ae95bff5f384 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057565 Jun 20 12:10:24.314723 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1412/2883] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:10:24.320271 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b2c8187e-f5c5-4879-a7c6-590df665a2d7 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:24.324916 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-aa7f657e-1369-46ad-a481-50393d90153c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1512 microversion: 2.1 time: 0.503892 Jun 20 12:10:24.326343 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1472/2884] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:23 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1512 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:24.328938 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b2c8187e-f5c5-4879-a7c6-590df665a2d7 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:24.334427 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-697b4333-2808-453a-bcdf-04a5f64e5ca1 req-e53eb91c-b278-4793-b484-9a7eb33d9a31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4404478d-26ca-49d1-a629-8cecf8b967a1", "name": "network-vif-plugged", "status": "completed", "tag": "5dd43a26-552a-45c5-9e58-286e7499c6c8"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:10:24.345678 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-697b4333-2808-453a-bcdf-04a5f64e5ca1 req-e53eb91c-b278-4793-b484-9a7eb33d9a31 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:24.346872 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-697b4333-2808-453a-bcdf-04a5f64e5ca1 req-e53eb91c-b278-4793-b484-9a7eb33d9a31 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:24.347085 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2c8187e-f5c5-4879-a7c6-590df665a2d7 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:24.347681 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2c8187e-f5c5-4879-a7c6-590df665a2d7 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:24.348727 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2c8187e-f5c5-4879-a7c6-590df665a2d7 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:24.349573 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2c8187e-f5c5-4879-a7c6-590df665a2d7 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:24.375790 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-697b4333-2808-453a-bcdf-04a5f64e5ca1 req-e53eb91c-b278-4793-b484-9a7eb33d9a31 service nova] Creating event network-vif-plugged:5dd43a26-552a-45c5-9e58-286e7499c6c8 for instance 4404478d-26ca-49d1-a629-8cecf8b967a1 on n-h1-master-1 Jun 20 12:10:24.389710 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-697b4333-2808-453a-bcdf-04a5f64e5ca1 req-e53eb91c-b278-4793-b484-9a7eb33d9a31 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060417 Jun 20 12:10:24.393918 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1473/2885] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:10:24.435745 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-41e7734b-de6c-4d6a-a8f1-4bba5402f779 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:24.444544 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-41e7734b-de6c-4d6a-a8f1-4bba5402f779 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:24.470383 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-41e7734b-de6c-4d6a-a8f1-4bba5402f779 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:24.471230 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-41e7734b-de6c-4d6a-a8f1-4bba5402f779 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:24.474626 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-41e7734b-de6c-4d6a-a8f1-4bba5402f779 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:24.475304 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-41e7734b-de6c-4d6a-a8f1-4bba5402f779 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:24.643592 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b2c8187e-f5c5-4879-a7c6-590df665a2d7 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:24.659092 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b2c8187e-f5c5-4879-a7c6-590df665a2d7 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:24.660900 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b2c8187e-f5c5-4879-a7c6-590df665a2d7 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:24.679486 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b2c8187e-f5c5-4879-a7c6-590df665a2d7 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1355 microversion: 2.75 time: 0.363442 Jun 20 12:10:24.680807 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1413/2886] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:24 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1355 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:24.686054 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-89d21c1f-ce25-4f99-a30b-502c355cd16a tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:24.697254 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-89d21c1f-ce25-4f99-a30b-502c355cd16a tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 7014bfb5-b083-485f-9711-b7cc95634c41] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:24.703737 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-89d21c1f-ce25-4f99-a30b-502c355cd16a tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:24.704191 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-89d21c1f-ce25-4f99-a30b-502c355cd16a tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:24.705303 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-89d21c1f-ce25-4f99-a30b-502c355cd16a tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:24.715329 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-89d21c1f-ce25-4f99-a30b-502c355cd16a tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:24.887200 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-89d21c1f-ce25-4f99-a30b-502c355cd16a tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:24.903383 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-89d21c1f-ce25-4f99-a30b-502c355cd16a tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41" status: 200 len: 1283 microversion: 2.1 time: 0.220040 Jun 20 12:10:24.915653 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1414/2887] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:24 2022] GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41 => generated 1283 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:24.922573 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bbc9105c-37ae-4bee-9a4c-f021b8c2cde2 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:24.924981 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bbc9105c-37ae-4bee-9a4c-f021b8c2cde2 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:24.940063 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bbc9105c-37ae-4bee-9a4c-f021b8c2cde2 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:24.941017 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bbc9105c-37ae-4bee-9a4c-f021b8c2cde2 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:24.942940 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bbc9105c-37ae-4bee-9a4c-f021b8c2cde2 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:24.943679 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bbc9105c-37ae-4bee-9a4c-f021b8c2cde2 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:24.998060 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-41e7734b-de6c-4d6a-a8f1-4bba5402f779 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:25.008182 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-41e7734b-de6c-4d6a-a8f1-4bba5402f779 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:25.009702 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-41e7734b-de6c-4d6a-a8f1-4bba5402f779 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:25.024828 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-41e7734b-de6c-4d6a-a8f1-4bba5402f779 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1875 microversion: 2.32 time: 0.605464 Jun 20 12:10:25.036258 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1474/2888] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:24 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1875 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:25.280983 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cdce39d2-967d-4b59-8d9e-edd1d62e65d2 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:25.282355 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cdce39d2-967d-4b59-8d9e-edd1d62e65d2 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:25.294428 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cdce39d2-967d-4b59-8d9e-edd1d62e65d2 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:25.297444 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cdce39d2-967d-4b59-8d9e-edd1d62e65d2 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:25.303711 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cdce39d2-967d-4b59-8d9e-edd1d62e65d2 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:25.304612 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cdce39d2-967d-4b59-8d9e-edd1d62e65d2 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:25.560044 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-bbc9105c-37ae-4bee-9a4c-f021b8c2cde2 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:25.572109 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bbc9105c-37ae-4bee-9a4c-f021b8c2cde2 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1318 microversion: 2.1 time: 0.651194 Jun 20 12:10:25.576851 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1415/2889] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:24 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1318 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:25.587253 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b606a830-afa1-4c25-abbf-656428beee2b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:25.588113 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b606a830-afa1-4c25-abbf-656428beee2b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:25.603849 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b606a830-afa1-4c25-abbf-656428beee2b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:25.604334 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b606a830-afa1-4c25-abbf-656428beee2b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:25.605111 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b606a830-afa1-4c25-abbf-656428beee2b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:25.605544 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b606a830-afa1-4c25-abbf-656428beee2b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:25.654187 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cdce39d2-967d-4b59-8d9e-edd1d62e65d2 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:25.670850 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cdce39d2-967d-4b59-8d9e-edd1d62e65d2 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1313 microversion: 2.1 time: 0.395945 Jun 20 12:10:25.671795 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1475/2890] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:25 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1313 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:25.701049 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b5e10e41-13f2-4890-96d7-e650ac8a8769 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:25.703727 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b5e10e41-13f2-4890-96d7-e650ac8a8769 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:25.713725 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5e10e41-13f2-4890-96d7-e650ac8a8769 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:25.714463 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5e10e41-13f2-4890-96d7-e650ac8a8769 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:25.715483 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5e10e41-13f2-4890-96d7-e650ac8a8769 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:25.716157 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5e10e41-13f2-4890-96d7-e650ac8a8769 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:25.942127 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b5e10e41-13f2-4890-96d7-e650ac8a8769 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:25.956781 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b5e10e41-13f2-4890-96d7-e650ac8a8769 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:25.958317 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b5e10e41-13f2-4890-96d7-e650ac8a8769 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:25.977858 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b5e10e41-13f2-4890-96d7-e650ac8a8769 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1429 microversion: 2.75 time: 0.280909 Jun 20 12:10:25.978660 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1476/2891] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:25 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1429 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:25.996280 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-89180ebc-d726-4c95-b8a9-f14b8ff66b34 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:25.996945 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-89180ebc-d726-4c95-b8a9-f14b8ff66b34 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 7014bfb5-b083-485f-9711-b7cc95634c41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:26.005577 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-89180ebc-d726-4c95-b8a9-f14b8ff66b34 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:26.007506 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-89180ebc-d726-4c95-b8a9-f14b8ff66b34 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:26.009930 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-89180ebc-d726-4c95-b8a9-f14b8ff66b34 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:26.010582 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-89180ebc-d726-4c95-b8a9-f14b8ff66b34 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:26.226130 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-89180ebc-d726-4c95-b8a9-f14b8ff66b34 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:26.235257 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-89180ebc-d726-4c95-b8a9-f14b8ff66b34 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41" status: 200 len: 1325 microversion: 2.1 time: 0.255222 Jun 20 12:10:26.237182 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1477/2892] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:25 2022] GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41 => generated 1325 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:26.248167 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7a958203-44dd-4899-a8a6-62dd48a7d6f1 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:26.253583 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7a958203-44dd-4899-a8a6-62dd48a7d6f1 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:26.264012 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7a958203-44dd-4899-a8a6-62dd48a7d6f1 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:26.268177 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7a958203-44dd-4899-a8a6-62dd48a7d6f1 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:26.269727 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7a958203-44dd-4899-a8a6-62dd48a7d6f1 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:26.275711 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7a958203-44dd-4899-a8a6-62dd48a7d6f1 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:26.451163 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b606a830-afa1-4c25-abbf-656428beee2b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:26.462996 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b606a830-afa1-4c25-abbf-656428beee2b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1533 microversion: 2.1 time: 0.884893 Jun 20 12:10:26.463604 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1416/2893] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:25 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1533 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:26.582702 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-fa384f6f-88a8-42a1-94e9-98ec918d2086 req-922352b1-5c74-49e6-b4bd-8c45ad3f4cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36218945-42bd-45a4-889b-b411acdd4155", "tag": "85f1809d-90f7-4c54-9391-f68911c003bb"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:10:26.600708 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-fa384f6f-88a8-42a1-94e9-98ec918d2086 req-922352b1-5c74-49e6-b4bd-8c45ad3f4cc7 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:26.601083 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-fa384f6f-88a8-42a1-94e9-98ec918d2086 req-922352b1-5c74-49e6-b4bd-8c45ad3f4cc7 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:26.631193 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-fa384f6f-88a8-42a1-94e9-98ec918d2086 req-922352b1-5c74-49e6-b4bd-8c45ad3f4cc7 service nova] Creating event network-changed:85f1809d-90f7-4c54-9391-f68911c003bb for instance 36218945-42bd-45a4-889b-b411acdd4155 on n-h1-master-1 Jun 20 12:10:26.642084 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-fa384f6f-88a8-42a1-94e9-98ec918d2086 req-922352b1-5c74-49e6-b4bd-8c45ad3f4cc7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064973 Jun 20 12:10:26.644983 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7a958203-44dd-4899-a8a6-62dd48a7d6f1 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:26.661173 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1417/2894] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:10:26.662029 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7a958203-44dd-4899-a8a6-62dd48a7d6f1 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:26.666812 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7a958203-44dd-4899-a8a6-62dd48a7d6f1 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:26.669650 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7a958203-44dd-4899-a8a6-62dd48a7d6f1 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1875 microversion: 2.32 time: 0.430350 Jun 20 12:10:26.671608 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5c0747f4-84d6-4393-89bd-b88f6bc2c379 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:26.682853 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1478/2895] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:26 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1875 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:26.686895 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5c0747f4-84d6-4393-89bd-b88f6bc2c379 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:26.690007 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0c80e88c-3209-41f2-9e92-b6bce5774dd7 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:26.691107 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0c80e88c-3209-41f2-9e92-b6bce5774dd7 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:26.702342 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0c80e88c-3209-41f2-9e92-b6bce5774dd7 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:26.703421 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0c80e88c-3209-41f2-9e92-b6bce5774dd7 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:26.705056 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5c0747f4-84d6-4393-89bd-b88f6bc2c379 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:26.705548 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5c0747f4-84d6-4393-89bd-b88f6bc2c379 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:26.706423 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5c0747f4-84d6-4393-89bd-b88f6bc2c379 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:26.709388 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5c0747f4-84d6-4393-89bd-b88f6bc2c379 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:26.713955 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0c80e88c-3209-41f2-9e92-b6bce5774dd7 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:26.715215 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0c80e88c-3209-41f2-9e92-b6bce5774dd7 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:26.720447 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:27.045965 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0c80e88c-3209-41f2-9e92-b6bce5774dd7 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:27.052955 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:27.062518 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0c80e88c-3209-41f2-9e92-b6bce5774dd7 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1463 microversion: 2.1 time: 0.377189 Jun 20 12:10:27.063923 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1479/2896] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:26 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1463 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:10:27.070708 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-994956fd-0b0d-433f-8605-d5af5629aec8 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:27.071656 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-994956fd-0b0d-433f-8605-d5af5629aec8 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:27.084753 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-994956fd-0b0d-433f-8605-d5af5629aec8 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:27.087558 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-994956fd-0b0d-433f-8605-d5af5629aec8 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:27.089608 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-994956fd-0b0d-433f-8605-d5af5629aec8 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:27.090963 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-994956fd-0b0d-433f-8605-d5af5629aec8 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:27.189525 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-994956fd-0b0d-433f-8605-d5af5629aec8 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:27.200361 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-994956fd-0b0d-433f-8605-d5af5629aec8 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:27.204335 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-994956fd-0b0d-433f-8605-d5af5629aec8 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:27.210722 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-994956fd-0b0d-433f-8605-d5af5629aec8 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1429 microversion: 2.75 time: 0.144847 Jun 20 12:10:27.211749 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1480/2897] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:27 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1429 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:27.215633 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5c0747f4-84d6-4393-89bd-b88f6bc2c379 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:27.223172 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a87f9fff-11fb-4014-876b-5c0c4cbc0a31 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:27.229185 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a87f9fff-11fb-4014-876b-5c0c4cbc0a31 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:27.230185 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5c0747f4-84d6-4393-89bd-b88f6bc2c379 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1318 microversion: 2.1 time: 0.567683 Jun 20 12:10:27.230791 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1418/2898] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:26 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1318 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:27.237272 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a87f9fff-11fb-4014-876b-5c0c4cbc0a31 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:27.237649 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a87f9fff-11fb-4014-876b-5c0c4cbc0a31 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:27.238550 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a87f9fff-11fb-4014-876b-5c0c4cbc0a31 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:27.239120 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a87f9fff-11fb-4014-876b-5c0c4cbc0a31 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:27.254768 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d15d26a2-372b-4c1f-b9f5-c9503f631514 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:27.255822 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d15d26a2-372b-4c1f-b9f5-c9503f631514 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 7014bfb5-b083-485f-9711-b7cc95634c41] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:27.274146 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d15d26a2-372b-4c1f-b9f5-c9503f631514 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:27.275717 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d15d26a2-372b-4c1f-b9f5-c9503f631514 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:27.277273 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d15d26a2-372b-4c1f-b9f5-c9503f631514 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:27.280894 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d15d26a2-372b-4c1f-b9f5-c9503f631514 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:27.398820 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a87f9fff-11fb-4014-876b-5c0c4cbc0a31 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1614 microversion: 2.1 time: 0.185084 Jun 20 12:10:27.405807 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1481/2899] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:27 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1614 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:27.416404 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7159a0a2-b7ba-4327-9a80-08bd04ff5567 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:10:27.417592 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7159a0a2-b7ba-4327-9a80-08bd04ff5567 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:27.426612 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7159a0a2-b7ba-4327-9a80-08bd04ff5567 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:27.427727 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7159a0a2-b7ba-4327-9a80-08bd04ff5567 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:27.428787 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7159a0a2-b7ba-4327-9a80-08bd04ff5567 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:27.429736 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7159a0a2-b7ba-4327-9a80-08bd04ff5567 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:27.490400 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7159a0a2-b7ba-4327-9a80-08bd04ff5567 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'af812a9321804aff95e49d9e18684e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e410fd03e18846f8a6e0faf010cb275a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:27.492149 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7159a0a2-b7ba-4327-9a80-08bd04ff5567 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] flavor_id is None. Assuming migration. {{(pid=119127) resize /opt/stack/nova/nova/compute/api.py:4142}} Jun 20 12:10:27.493868 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7159a0a2-b7ba-4327-9a80-08bd04ff5567 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119127) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 20 12:10:27.698103 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7159a0a2-b7ba-4327-9a80-08bd04ff5567 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1/action" status: 202 len: 0 microversion: 2.1 time: 0.286077 Jun 20 12:10:27.702194 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1482/2900] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:10:27 2022] POST /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:10:27.710713 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a5d06000-772f-46a6-9513-676a1e5e546d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:27.711330 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a5d06000-772f-46a6-9513-676a1e5e546d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:27.727962 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5d06000-772f-46a6-9513-676a1e5e546d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:27.728485 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5d06000-772f-46a6-9513-676a1e5e546d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:27.729456 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5d06000-772f-46a6-9513-676a1e5e546d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:27.730048 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5d06000-772f-46a6-9513-676a1e5e546d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:27.829400 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d15d26a2-372b-4c1f-b9f5-c9503f631514 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:27.841507 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d15d26a2-372b-4c1f-b9f5-c9503f631514 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41" status: 200 len: 1325 microversion: 2.1 time: 0.590878 Jun 20 12:10:27.843563 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1419/2901] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:27 2022] GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41 => generated 1325 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:27.856466 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ef2df708-80b9-4ad6-a20b-917446e14176 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:27.859674 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ef2df708-80b9-4ad6-a20b-917446e14176 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:27.869122 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef2df708-80b9-4ad6-a20b-917446e14176 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:27.869913 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef2df708-80b9-4ad6-a20b-917446e14176 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:27.871489 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef2df708-80b9-4ad6-a20b-917446e14176 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:27.872392 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef2df708-80b9-4ad6-a20b-917446e14176 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:28.325480 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ef2df708-80b9-4ad6-a20b-917446e14176 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:28.352668 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ef2df708-80b9-4ad6-a20b-917446e14176 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:28.358530 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ef2df708-80b9-4ad6-a20b-917446e14176 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:28.359981 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ef2df708-80b9-4ad6-a20b-917446e14176 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1875 microversion: 2.32 time: 0.515092 Jun 20 12:10:28.376745 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1420/2902] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:27 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1875 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:28.385908 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-05db7cf9-d1ff-4c1c-9f39-f969a3587e16 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:28.386561 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-05db7cf9-d1ff-4c1c-9f39-f969a3587e16 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:28.410654 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05db7cf9-d1ff-4c1c-9f39-f969a3587e16 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:28.411125 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05db7cf9-d1ff-4c1c-9f39-f969a3587e16 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:28.412488 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05db7cf9-d1ff-4c1c-9f39-f969a3587e16 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:28.412941 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05db7cf9-d1ff-4c1c-9f39-f969a3587e16 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:28.551989 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a5d06000-772f-46a6-9513-676a1e5e546d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:28.567769 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a5d06000-772f-46a6-9513-676a1e5e546d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1533 microversion: 2.1 time: 0.864090 Jun 20 12:10:28.577209 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1483/2903] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:27 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1533 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:28.585215 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-644cede5-04dc-448f-bd32-2826dbda9f3e tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:28.585841 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-644cede5-04dc-448f-bd32-2826dbda9f3e tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:28.604746 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-644cede5-04dc-448f-bd32-2826dbda9f3e tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:28.605265 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-644cede5-04dc-448f-bd32-2826dbda9f3e tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:28.605997 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-644cede5-04dc-448f-bd32-2826dbda9f3e tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:28.606442 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-644cede5-04dc-448f-bd32-2826dbda9f3e tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:28.726908 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-644cede5-04dc-448f-bd32-2826dbda9f3e tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:28.741205 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-644cede5-04dc-448f-bd32-2826dbda9f3e tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:28.743626 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-644cede5-04dc-448f-bd32-2826dbda9f3e tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:28.749358 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-644cede5-04dc-448f-bd32-2826dbda9f3e tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1417 microversion: 2.75 time: 0.170513 Jun 20 12:10:28.750195 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1484/2904] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:28 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1417 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:28.755690 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-39f7e092-8ea4-4c91-b383-9f51c04c831f tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:28.756557 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-39f7e092-8ea4-4c91-b383-9f51c04c831f tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:28.763988 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-39f7e092-8ea4-4c91-b383-9f51c04c831f tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:28.765049 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-39f7e092-8ea4-4c91-b383-9f51c04c831f tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:28.766661 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-39f7e092-8ea4-4c91-b383-9f51c04c831f tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:28.767642 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-39f7e092-8ea4-4c91-b383-9f51c04c831f tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:29.189122 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-39f7e092-8ea4-4c91-b383-9f51c04c831f tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:29.197748 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-39f7e092-8ea4-4c91-b383-9f51c04c831f tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1318 microversion: 2.1 time: 0.446108 Jun 20 12:10:29.211508 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1485/2905] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:28 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1318 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:29.222390 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-4f23de99-fce7-4f8c-b7ac-2dca15685c09 req-d53a4cbe-6e09-401d-a6c1-8ad3b073a0f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36218945-42bd-45a4-889b-b411acdd4155", "tag": "e18c6fa7-dd45-494c-a0a7-a1e50521794b"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:10:29.242949 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-05db7cf9-d1ff-4c1c-9f39-f969a3587e16 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:29.243697 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-4f23de99-fce7-4f8c-b7ac-2dca15685c09 req-d53a4cbe-6e09-401d-a6c1-8ad3b073a0f9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:29.247973 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-4f23de99-fce7-4f8c-b7ac-2dca15685c09 req-d53a4cbe-6e09-401d-a6c1-8ad3b073a0f9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:29.293405 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-05db7cf9-d1ff-4c1c-9f39-f969a3587e16 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1472 microversion: 2.1 time: 0.908964 Jun 20 12:10:29.295926 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1421/2906] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:28 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1472 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:29.310861 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-608e8fff-5e20-4044-b4a7-54b5f666d5d7 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:29.311808 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-608e8fff-5e20-4044-b4a7-54b5f666d5d7 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 7014bfb5-b083-485f-9711-b7cc95634c41] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:29.328005 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-608e8fff-5e20-4044-b4a7-54b5f666d5d7 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:29.329096 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-608e8fff-5e20-4044-b4a7-54b5f666d5d7 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:29.330174 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-608e8fff-5e20-4044-b4a7-54b5f666d5d7 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:29.330809 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-608e8fff-5e20-4044-b4a7-54b5f666d5d7 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:29.334941 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-4f23de99-fce7-4f8c-b7ac-2dca15685c09 req-d53a4cbe-6e09-401d-a6c1-8ad3b073a0f9 service nova] Creating event network-changed:e18c6fa7-dd45-494c-a0a7-a1e50521794b for instance 36218945-42bd-45a4-889b-b411acdd4155 on n-h1-master-1 Jun 20 12:10:29.363880 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-4f23de99-fce7-4f8c-b7ac-2dca15685c09 req-d53a4cbe-6e09-401d-a6c1-8ad3b073a0f9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150891 Jun 20 12:10:29.368609 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1486/2907] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:10:29.376929 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-b45fca82-569e-4645-a4d2-c369275bb8a9 req-658a817c-3295-472b-a7ad-1a2b085f29fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "593cda12-6491-4a27-8fc7-42c05e0291c3", "name": "network-vif-plugged", "status": "completed", "tag": "2a9eb762-96f9-45b2-8446-311d784377f5"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:10:29.423532 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b45fca82-569e-4645-a4d2-c369275bb8a9 req-658a817c-3295-472b-a7ad-1a2b085f29fe service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:29.442505 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b45fca82-569e-4645-a4d2-c369275bb8a9 req-658a817c-3295-472b-a7ad-1a2b085f29fe service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:29.475919 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-b45fca82-569e-4645-a4d2-c369275bb8a9 req-658a817c-3295-472b-a7ad-1a2b085f29fe service nova] Creating event network-vif-plugged:2a9eb762-96f9-45b2-8446-311d784377f5 for instance 593cda12-6491-4a27-8fc7-42c05e0291c3 on n-h2-master-1 Jun 20 12:10:29.482304 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-b45fca82-569e-4645-a4d2-c369275bb8a9 req-658a817c-3295-472b-a7ad-1a2b085f29fe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109837 Jun 20 12:10:29.483204 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1487/2908] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:10:29.506074 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-582c98f6-cc5c-4a92-8173-9ddb850010fd tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:29.513261 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-582c98f6-cc5c-4a92-8173-9ddb850010fd tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:29.532507 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-582c98f6-cc5c-4a92-8173-9ddb850010fd tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:29.533737 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-582c98f6-cc5c-4a92-8173-9ddb850010fd tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:29.535444 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-582c98f6-cc5c-4a92-8173-9ddb850010fd tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:29.546241 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-582c98f6-cc5c-4a92-8173-9ddb850010fd tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:29.958300 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-582c98f6-cc5c-4a92-8173-9ddb850010fd tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:29.970141 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-582c98f6-cc5c-4a92-8173-9ddb850010fd tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:29.971785 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-582c98f6-cc5c-4a92-8173-9ddb850010fd tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:29.973229 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-582c98f6-cc5c-4a92-8173-9ddb850010fd tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1875 microversion: 2.32 time: 0.488722 Jun 20 12:10:29.985150 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1488/2909] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:29 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1875 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:29.991116 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d368248a-be67-4670-8551-b9418690d89f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:29.991749 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d368248a-be67-4670-8551-b9418690d89f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:30.004618 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d368248a-be67-4670-8551-b9418690d89f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:30.006912 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d368248a-be67-4670-8551-b9418690d89f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:30.009138 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d368248a-be67-4670-8551-b9418690d89f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:30.013653 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d368248a-be67-4670-8551-b9418690d89f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:30.106705 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-608e8fff-5e20-4044-b4a7-54b5f666d5d7 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:30.118779 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-608e8fff-5e20-4044-b4a7-54b5f666d5d7 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41" status: 200 len: 1325 microversion: 2.1 time: 0.819561 Jun 20 12:10:30.119753 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1422/2910] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:29 2022] GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41 => generated 1325 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:30.146332 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e7278fb3-dec5-4114-9c29-05ecbad33144 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:30.149040 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e7278fb3-dec5-4114-9c29-05ecbad33144 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:30.175570 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e7278fb3-dec5-4114-9c29-05ecbad33144 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:30.176829 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e7278fb3-dec5-4114-9c29-05ecbad33144 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:30.177829 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e7278fb3-dec5-4114-9c29-05ecbad33144 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:30.179636 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e7278fb3-dec5-4114-9c29-05ecbad33144 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:30.299504 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d368248a-be67-4670-8551-b9418690d89f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:30.313766 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d368248a-be67-4670-8551-b9418690d89f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1533 microversion: 2.1 time: 0.323467 Jun 20 12:10:30.314626 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1489/2911] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:29 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1533 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:30.326575 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-d1967688-574a-4333-a50f-bc803d353478 req-6e650d98-17ab-4357-af6c-4de720332b51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7014bfb5-b083-485f-9711-b7cc95634c41", "tag": "2b4ae774-61d2-4117-bf2a-8e8514f99147"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:10:30.341300 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-d1967688-574a-4333-a50f-bc803d353478 req-6e650d98-17ab-4357-af6c-4de720332b51 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:30.341746 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-d1967688-574a-4333-a50f-bc803d353478 req-6e650d98-17ab-4357-af6c-4de720332b51 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:30.399282 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-d1967688-574a-4333-a50f-bc803d353478 req-6e650d98-17ab-4357-af6c-4de720332b51 service nova] Creating event network-changed:2b4ae774-61d2-4117-bf2a-8e8514f99147 for instance 7014bfb5-b083-485f-9711-b7cc95634c41 on n-h2-master-1 Jun 20 12:10:30.406513 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-d1967688-574a-4333-a50f-bc803d353478 req-6e650d98-17ab-4357-af6c-4de720332b51 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089829 Jun 20 12:10:30.408248 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1490/2912] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:10:30.415422 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e7ca8c0a-2288-4df1-bd95-738094d33db0 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:30.416403 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e7ca8c0a-2288-4df1-bd95-738094d33db0 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:30.416523 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e7278fb3-dec5-4114-9c29-05ecbad33144 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:30.424513 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e7ca8c0a-2288-4df1-bd95-738094d33db0 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:30.425485 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e7ca8c0a-2288-4df1-bd95-738094d33db0 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:30.426522 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e7ca8c0a-2288-4df1-bd95-738094d33db0 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:30.427186 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e7ca8c0a-2288-4df1-bd95-738094d33db0 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:30.432190 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e7278fb3-dec5-4114-9c29-05ecbad33144 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:30.435815 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e7278fb3-dec5-4114-9c29-05ecbad33144 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:30.444097 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e7278fb3-dec5-4114-9c29-05ecbad33144 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1417 microversion: 2.75 time: 0.321982 Jun 20 12:10:30.445747 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1423/2913] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:30 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1417 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:30.454591 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ba2e1c78-6884-4e3c-9815-ace69dd6e008 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:30.460985 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ba2e1c78-6884-4e3c-9815-ace69dd6e008 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:30.472408 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba2e1c78-6884-4e3c-9815-ace69dd6e008 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:30.473258 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba2e1c78-6884-4e3c-9815-ace69dd6e008 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:30.477146 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba2e1c78-6884-4e3c-9815-ace69dd6e008 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:30.477911 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba2e1c78-6884-4e3c-9815-ace69dd6e008 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:30.724687 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ba2e1c78-6884-4e3c-9815-ace69dd6e008 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:30.739017 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ba2e1c78-6884-4e3c-9815-ace69dd6e008 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1472 microversion: 2.1 time: 0.291960 Jun 20 12:10:30.749317 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1424/2914] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:30 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1472 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:30.996262 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fe11020e-d6a2-4a86-bcb3-e414080e8921 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:30.997161 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fe11020e-d6a2-4a86-bcb3-e414080e8921 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:31.006048 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe11020e-d6a2-4a86-bcb3-e414080e8921 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:31.006745 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe11020e-d6a2-4a86-bcb3-e414080e8921 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:31.011102 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe11020e-d6a2-4a86-bcb3-e414080e8921 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:31.011102 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe11020e-d6a2-4a86-bcb3-e414080e8921 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:31.172657 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e7ca8c0a-2288-4df1-bd95-738094d33db0 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:31.188370 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e7ca8c0a-2288-4df1-bd95-738094d33db0 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1318 microversion: 2.1 time: 0.778594 Jun 20 12:10:31.189604 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1491/2915] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:30 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1318 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:31.196431 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-db022102-0ae2-4f86-b7a9-706a068c391b tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:31.197320 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-db022102-0ae2-4f86-b7a9-706a068c391b tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 7014bfb5-b083-485f-9711-b7cc95634c41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:31.206676 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-db022102-0ae2-4f86-b7a9-706a068c391b tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:31.207448 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-db022102-0ae2-4f86-b7a9-706a068c391b tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:31.208435 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-db022102-0ae2-4f86-b7a9-706a068c391b tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:31.209692 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-db022102-0ae2-4f86-b7a9-706a068c391b tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:31.589887 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fe11020e-d6a2-4a86-bcb3-e414080e8921 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:31.611807 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fe11020e-d6a2-4a86-bcb3-e414080e8921 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:31.614846 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fe11020e-d6a2-4a86-bcb3-e414080e8921 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:31.616931 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fe11020e-d6a2-4a86-bcb3-e414080e8921 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1875 microversion: 2.32 time: 0.627512 Jun 20 12:10:31.617994 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1425/2916] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:30 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1875 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:10:31.623016 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3fe8bcfc-2d6d-43ad-8a6c-68b28bd293d3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:31.623861 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3fe8bcfc-2d6d-43ad-8a6c-68b28bd293d3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:31.639515 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3fe8bcfc-2d6d-43ad-8a6c-68b28bd293d3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:31.643157 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3fe8bcfc-2d6d-43ad-8a6c-68b28bd293d3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:31.645086 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3fe8bcfc-2d6d-43ad-8a6c-68b28bd293d3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:31.645793 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3fe8bcfc-2d6d-43ad-8a6c-68b28bd293d3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:31.661973 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-db022102-0ae2-4f86-b7a9-706a068c391b tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:31.673881 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-db022102-0ae2-4f86-b7a9-706a068c391b tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41" status: 200 len: 1325 microversion: 2.1 time: 0.481793 Jun 20 12:10:31.674771 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1492/2917] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:31 2022] GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41 => generated 1325 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:31.694912 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-221222cd-1a83-46e6-9285-18849d4dd174 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:31.696149 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-221222cd-1a83-46e6-9285-18849d4dd174 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:31.710076 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-221222cd-1a83-46e6-9285-18849d4dd174 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:31.712107 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-221222cd-1a83-46e6-9285-18849d4dd174 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:31.713971 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-221222cd-1a83-46e6-9285-18849d4dd174 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:31.715281 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-221222cd-1a83-46e6-9285-18849d4dd174 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:31.833808 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-221222cd-1a83-46e6-9285-18849d4dd174 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:31.844580 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-221222cd-1a83-46e6-9285-18849d4dd174 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:31.847086 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-221222cd-1a83-46e6-9285-18849d4dd174 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:31.855794 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-221222cd-1a83-46e6-9285-18849d4dd174 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1417 microversion: 2.75 time: 0.167035 Jun 20 12:10:31.870800 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1493/2918] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:31 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1417 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:31.889538 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-c044629d-9bd8-4291-b611-e612e365dd36 req-6a580bcb-926e-4f16-ae8c-22968e959f34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36218945-42bd-45a4-889b-b411acdd4155", "tag": "c92e56c8-a1a7-41dc-b4c8-8b2e57dae74e"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:10:31.907371 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-c044629d-9bd8-4291-b611-e612e365dd36 req-6a580bcb-926e-4f16-ae8c-22968e959f34 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:31.908116 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-c044629d-9bd8-4291-b611-e612e365dd36 req-6a580bcb-926e-4f16-ae8c-22968e959f34 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:31.922440 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-c044629d-9bd8-4291-b611-e612e365dd36 req-6a580bcb-926e-4f16-ae8c-22968e959f34 service nova] Creating event network-changed:c92e56c8-a1a7-41dc-b4c8-8b2e57dae74e for instance 36218945-42bd-45a4-889b-b411acdd4155 on n-h1-master-1 Jun 20 12:10:31.929380 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-c044629d-9bd8-4291-b611-e612e365dd36 req-6a580bcb-926e-4f16-ae8c-22968e959f34 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054724 Jun 20 12:10:31.931018 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1494/2919] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:10:31.943733 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2d668945-890b-46f5-a03a-8cb04487d7ce tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:31.945116 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2d668945-890b-46f5-a03a-8cb04487d7ce tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:31.952359 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2d668945-890b-46f5-a03a-8cb04487d7ce tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:31.953168 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2d668945-890b-46f5-a03a-8cb04487d7ce tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:31.954272 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2d668945-890b-46f5-a03a-8cb04487d7ce tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:31.959973 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2d668945-890b-46f5-a03a-8cb04487d7ce tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:31.994387 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:32.013164 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3fe8bcfc-2d6d-43ad-8a6c-68b28bd293d3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:32.024989 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3fe8bcfc-2d6d-43ad-8a6c-68b28bd293d3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1533 microversion: 2.1 time: 0.405707 Jun 20 12:10:32.039031 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1426/2920] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:31 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1533 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:32.205705 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f5c3c50f-0b29-4b3a-a0cd-27739e75a127 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:32.206985 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f5c3c50f-0b29-4b3a-a0cd-27739e75a127 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:32.224455 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f5c3c50f-0b29-4b3a-a0cd-27739e75a127 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:32.224961 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f5c3c50f-0b29-4b3a-a0cd-27739e75a127 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:32.225693 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f5c3c50f-0b29-4b3a-a0cd-27739e75a127 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:32.226132 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f5c3c50f-0b29-4b3a-a0cd-27739e75a127 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:32.558661 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2d668945-890b-46f5-a03a-8cb04487d7ce tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:32.569484 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2d668945-890b-46f5-a03a-8cb04487d7ce tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1472 microversion: 2.1 time: 0.636748 Jun 20 12:10:32.571592 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1495/2921] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:31 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1472 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:32.577445 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=4 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:32.578295 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-7d83493d-60cb-423e-b1a6-c2bed8652b63 req-477274d5-eb06-4f1a-97d2-bf03740e353c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31440c3e-bac0-437b-acd0-97351ddaae67", "name": "network-vif-plugged", "status": "completed", "tag": "63464faa-0494-41e3-88aa-fae7ed2a5773"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:10:32.589814 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-7d83493d-60cb-423e-b1a6-c2bed8652b63 req-477274d5-eb06-4f1a-97d2-bf03740e353c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:32.591276 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-7d83493d-60cb-423e-b1a6-c2bed8652b63 req-477274d5-eb06-4f1a-97d2-bf03740e353c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:32.607279 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-7d83493d-60cb-423e-b1a6-c2bed8652b63 req-477274d5-eb06-4f1a-97d2-bf03740e353c service nova] Creating event network-vif-plugged:63464faa-0494-41e3-88aa-fae7ed2a5773 for instance 31440c3e-bac0-437b-acd0-97351ddaae67 on n-h2-master-1 Jun 20 12:10:32.614758 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-7d83493d-60cb-423e-b1a6-c2bed8652b63 req-477274d5-eb06-4f1a-97d2-bf03740e353c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041434 Jun 20 12:10:32.615444 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1496/2922] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:10:32.630639 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=12 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:32.641404 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5a95e2d7-4c19-4223-805d-98e67db561a1 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:32.643349 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5a95e2d7-4c19-4223-805d-98e67db561a1 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:32.651585 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5a95e2d7-4c19-4223-805d-98e67db561a1 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:32.652337 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5a95e2d7-4c19-4223-805d-98e67db561a1 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:32.653458 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5a95e2d7-4c19-4223-805d-98e67db561a1 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:32.653900 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5a95e2d7-4c19-4223-805d-98e67db561a1 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:33.003748 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5a95e2d7-4c19-4223-805d-98e67db561a1 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:33.019516 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5a95e2d7-4c19-4223-805d-98e67db561a1 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:33.022356 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5a95e2d7-4c19-4223-805d-98e67db561a1 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:33.026788 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5a95e2d7-4c19-4223-805d-98e67db561a1 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1875 microversion: 2.32 time: 0.390114 Jun 20 12:10:33.027852 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1497/2923] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:32 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1875 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:33.038344 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1910b2dc-f3ac-454f-aebc-39a191bbc5f5 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:33.042174 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1910b2dc-f3ac-454f-aebc-39a191bbc5f5 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 7014bfb5-b083-485f-9711-b7cc95634c41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:33.050382 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1910b2dc-f3ac-454f-aebc-39a191bbc5f5 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:33.051020 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1910b2dc-f3ac-454f-aebc-39a191bbc5f5 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:33.052024 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1910b2dc-f3ac-454f-aebc-39a191bbc5f5 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:33.052619 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1910b2dc-f3ac-454f-aebc-39a191bbc5f5 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:33.057849 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:33.110727 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f5c3c50f-0b29-4b3a-a0cd-27739e75a127 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:33.121999 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f5c3c50f-0b29-4b3a-a0cd-27739e75a127 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1318 microversion: 2.1 time: 0.920073 Jun 20 12:10:33.123764 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1427/2924] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:32 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1318 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:10:33.129735 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-415d525b-d922-4011-9227-7daf9efd8824 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:33.130651 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-415d525b-d922-4011-9227-7daf9efd8824 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:33.168499 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-415d525b-d922-4011-9227-7daf9efd8824 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:33.169346 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-415d525b-d922-4011-9227-7daf9efd8824 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:33.170392 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-415d525b-d922-4011-9227-7daf9efd8824 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:33.171058 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-415d525b-d922-4011-9227-7daf9efd8824 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:33.383214 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1910b2dc-f3ac-454f-aebc-39a191bbc5f5 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:33.391302 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1910b2dc-f3ac-454f-aebc-39a191bbc5f5 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41" status: 200 len: 1325 microversion: 2.1 time: 0.361406 Jun 20 12:10:33.391913 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1498/2925] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:33 2022] GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41 => generated 1325 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:33.397267 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a24dc695-0bda-4185-8a84-928fcd2aa53e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:33.397883 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a24dc695-0bda-4185-8a84-928fcd2aa53e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:33.402312 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-415d525b-d922-4011-9227-7daf9efd8824 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:33.408103 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a24dc695-0bda-4185-8a84-928fcd2aa53e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:33.408103 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a24dc695-0bda-4185-8a84-928fcd2aa53e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:33.408103 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a24dc695-0bda-4185-8a84-928fcd2aa53e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:33.408103 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a24dc695-0bda-4185-8a84-928fcd2aa53e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:33.417345 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-415d525b-d922-4011-9227-7daf9efd8824 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:33.426453 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-415d525b-d922-4011-9227-7daf9efd8824 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:33.439468 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-415d525b-d922-4011-9227-7daf9efd8824 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1417 microversion: 2.75 time: 0.313745 Jun 20 12:10:33.440072 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1428/2926] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:33 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1417 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:33.612068 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3bd57ff4-2e9a-475c-aed1-662a9a141d75 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:33.616108 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3bd57ff4-2e9a-475c-aed1-662a9a141d75 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:33.623996 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a24dc695-0bda-4185-8a84-928fcd2aa53e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:33.638294 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a24dc695-0bda-4185-8a84-928fcd2aa53e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1533 microversion: 2.1 time: 0.245271 Jun 20 12:10:33.638988 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1499/2927] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:33 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1533 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:33.640448 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3bd57ff4-2e9a-475c-aed1-662a9a141d75 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:33.641586 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3bd57ff4-2e9a-475c-aed1-662a9a141d75 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:33.643377 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3bd57ff4-2e9a-475c-aed1-662a9a141d75 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:33.644051 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3bd57ff4-2e9a-475c-aed1-662a9a141d75 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:33.968535 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-0f136061-fd78-4fd2-b251-39caa4bbe9c4 req-1474b7f3-4e58-44b2-b367-f1cfcffcfd1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36218945-42bd-45a4-889b-b411acdd4155", "tag": "9df2cf8c-5928-405e-ac7c-65c330f2acbf"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:10:33.976787 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=38,nova_cell0:UPDATE=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:33.978882 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-0f136061-fd78-4fd2-b251-39caa4bbe9c4 req-1474b7f3-4e58-44b2-b367-f1cfcffcfd1c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:33.979622 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-0f136061-fd78-4fd2-b251-39caa4bbe9c4 req-1474b7f3-4e58-44b2-b367-f1cfcffcfd1c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:33.996474 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-0f136061-fd78-4fd2-b251-39caa4bbe9c4 req-1474b7f3-4e58-44b2-b367-f1cfcffcfd1c service nova] Creating event network-changed:9df2cf8c-5928-405e-ac7c-65c330f2acbf for instance 36218945-42bd-45a4-889b-b411acdd4155 on n-h1-master-1 Jun 20 12:10:34.001276 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-0f136061-fd78-4fd2-b251-39caa4bbe9c4 req-1474b7f3-4e58-44b2-b367-f1cfcffcfd1c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036871 Jun 20 12:10:34.008684 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1500/2928] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:10:34.054327 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-49721f94-b420-4307-80e2-03491ce48ad4 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:34.055562 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-49721f94-b420-4307-80e2-03491ce48ad4 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:34.064278 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:34.067112 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-49721f94-b420-4307-80e2-03491ce48ad4 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:34.067813 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-49721f94-b420-4307-80e2-03491ce48ad4 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:34.068930 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-49721f94-b420-4307-80e2-03491ce48ad4 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:34.069628 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-49721f94-b420-4307-80e2-03491ce48ad4 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:34.110138 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3bd57ff4-2e9a-475c-aed1-662a9a141d75 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:34.142467 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3bd57ff4-2e9a-475c-aed1-662a9a141d75 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1472 microversion: 2.1 time: 0.544896 Jun 20 12:10:34.160190 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1429/2929] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:33 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1472 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:10:34.167810 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4380c05f-dc67-4636-aa77-4dd20532d182 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:34.168805 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4380c05f-dc67-4636-aa77-4dd20532d182 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:34.177727 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4380c05f-dc67-4636-aa77-4dd20532d182 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:34.178579 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4380c05f-dc67-4636-aa77-4dd20532d182 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:34.179909 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4380c05f-dc67-4636-aa77-4dd20532d182 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:34.180770 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4380c05f-dc67-4636-aa77-4dd20532d182 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:34.360150 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-49721f94-b420-4307-80e2-03491ce48ad4 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:34.372887 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-49721f94-b420-4307-80e2-03491ce48ad4 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:34.374750 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-49721f94-b420-4307-80e2-03491ce48ad4 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:34.376667 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-49721f94-b420-4307-80e2-03491ce48ad4 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1875 microversion: 2.32 time: 0.328973 Jun 20 12:10:34.389190 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1501/2930] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:34 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1875 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:34.414867 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a5194210-1b5c-4576-89cd-baa966b58c59 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:34.415497 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a5194210-1b5c-4576-89cd-baa966b58c59 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 7014bfb5-b083-485f-9711-b7cc95634c41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:34.432649 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5194210-1b5c-4576-89cd-baa966b58c59 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:34.433117 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5194210-1b5c-4576-89cd-baa966b58c59 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:34.433910 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5194210-1b5c-4576-89cd-baa966b58c59 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:34.434351 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5194210-1b5c-4576-89cd-baa966b58c59 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:34.530146 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4380c05f-dc67-4636-aa77-4dd20532d182 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:34.543652 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4380c05f-dc67-4636-aa77-4dd20532d182 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1318 microversion: 2.1 time: 0.393642 Jun 20 12:10:34.548946 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1430/2931] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:34 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1318 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:34.557432 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-12022dd5-cb0e-4eab-9fa3-fb094848cf1d tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:34.558666 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-12022dd5-cb0e-4eab-9fa3-fb094848cf1d tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:34.570475 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-12022dd5-cb0e-4eab-9fa3-fb094848cf1d tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:34.571943 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-12022dd5-cb0e-4eab-9fa3-fb094848cf1d tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:34.573338 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-12022dd5-cb0e-4eab-9fa3-fb094848cf1d tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:34.574042 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-12022dd5-cb0e-4eab-9fa3-fb094848cf1d tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:34.615857 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a5194210-1b5c-4576-89cd-baa966b58c59 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:34.625409 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a5194210-1b5c-4576-89cd-baa966b58c59 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41" status: 200 len: 1325 microversion: 2.1 time: 0.219899 Jun 20 12:10:34.637125 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1502/2932] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:34 2022] GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41 => generated 1325 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:10:34.657771 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e47c32a1-fb7b-4087-a843-144a69a0e71a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:34.658393 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e47c32a1-fb7b-4087-a843-144a69a0e71a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:34.665253 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e47c32a1-fb7b-4087-a843-144a69a0e71a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:34.665986 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e47c32a1-fb7b-4087-a843-144a69a0e71a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:34.666904 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e47c32a1-fb7b-4087-a843-144a69a0e71a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:34.667532 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e47c32a1-fb7b-4087-a843-144a69a0e71a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:34.760907 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-12022dd5-cb0e-4eab-9fa3-fb094848cf1d tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:34.773511 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-12022dd5-cb0e-4eab-9fa3-fb094848cf1d tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:34.775666 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-12022dd5-cb0e-4eab-9fa3-fb094848cf1d tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:34.781553 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-12022dd5-cb0e-4eab-9fa3-fb094848cf1d tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1438 microversion: 2.75 time: 0.231247 Jun 20 12:10:34.782395 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1431/2933] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:34 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1438 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:34.801839 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-02157c93-195e-4a89-b925-d08dad6aa1b5 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:10:34.803687 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-02157c93-195e-4a89-b925-d08dad6aa1b5 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:34.813599 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-02157c93-195e-4a89-b925-d08dad6aa1b5 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:34.814329 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-02157c93-195e-4a89-b925-d08dad6aa1b5 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:34.815305 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-02157c93-195e-4a89-b925-d08dad6aa1b5 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:34.816084 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-02157c93-195e-4a89-b925-d08dad6aa1b5 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:34.840253 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e47c32a1-fb7b-4087-a843-144a69a0e71a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:34.853139 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e47c32a1-fb7b-4087-a843-144a69a0e71a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1533 microversion: 2.1 time: 0.199438 Jun 20 12:10:34.863247 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1503/2934] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:34 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1533 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:34.915216 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-02157c93-195e-4a89-b925-d08dad6aa1b5 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:10:34.917322 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-02157c93-195e-4a89-b925-d08dad6aa1b5 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:10:34.918124 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-02157c93-195e-4a89-b925-d08dad6aa1b5 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:10:34.918557 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-02157c93-195e-4a89-b925-d08dad6aa1b5 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:10:34.919018 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-02157c93-195e-4a89-b925-d08dad6aa1b5 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:10:34.985930 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-02157c93-195e-4a89-b925-d08dad6aa1b5 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:34.992973 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-02157c93-195e-4a89-b925-d08dad6aa1b5 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:34.993497 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-02157c93-195e-4a89-b925-d08dad6aa1b5 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:34.994357 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-02157c93-195e-4a89-b925-d08dad6aa1b5 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:34.994860 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-02157c93-195e-4a89-b925-d08dad6aa1b5 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:35.027645 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:35.169006 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-93c1ef67-67cf-417e-870d-d71aaae1a7f2 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:35.170238 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-93c1ef67-67cf-417e-870d-d71aaae1a7f2 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:35.179584 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93c1ef67-67cf-417e-870d-d71aaae1a7f2 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:35.180109 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93c1ef67-67cf-417e-870d-d71aaae1a7f2 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:35.181117 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93c1ef67-67cf-417e-870d-d71aaae1a7f2 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:35.182004 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93c1ef67-67cf-417e-870d-d71aaae1a7f2 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:35.183365 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-02157c93-195e-4a89-b925-d08dad6aa1b5 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:35.218626 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-02157c93-195e-4a89-b925-d08dad6aa1b5 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:35.230960 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-02157c93-195e-4a89-b925-d08dad6aa1b5 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:35.239272 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-02157c93-195e-4a89-b925-d08dad6aa1b5 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "POST /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e/action" status: 202 len: 1495 microversion: 2.75 time: 0.442076 Jun 20 12:10:35.253172 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1432/2935] 10.222.0.27 () {62 vars in 1318 bytes} [Mon Jun 20 12:10:34 2022] POST /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e/action => generated 1495 bytes in 457 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Jun 20 12:10:35.261183 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-52b5a3d3-2743-4cdf-a53b-600ef7ead9eb tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:35.262151 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-52b5a3d3-2743-4cdf-a53b-600ef7ead9eb tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:35.271240 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-52b5a3d3-2743-4cdf-a53b-600ef7ead9eb tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:35.272333 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-52b5a3d3-2743-4cdf-a53b-600ef7ead9eb tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:35.274166 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-52b5a3d3-2743-4cdf-a53b-600ef7ead9eb tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:35.275014 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-52b5a3d3-2743-4cdf-a53b-600ef7ead9eb tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:35.422198 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-93c1ef67-67cf-417e-870d-d71aaae1a7f2 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:35.439587 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-93c1ef67-67cf-417e-870d-d71aaae1a7f2 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1472 microversion: 2.1 time: 0.275218 Jun 20 12:10:35.441067 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1504/2936] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:35 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1472 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:10:35.455861 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f092f2aa-c973-46fd-9340-13b1f797151f tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:35.456999 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f092f2aa-c973-46fd-9340-13b1f797151f tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:35.463768 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f092f2aa-c973-46fd-9340-13b1f797151f tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:35.464276 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f092f2aa-c973-46fd-9340-13b1f797151f tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:35.465077 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f092f2aa-c973-46fd-9340-13b1f797151f tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:35.465518 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f092f2aa-c973-46fd-9340-13b1f797151f tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:35.753365 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-52b5a3d3-2743-4cdf-a53b-600ef7ead9eb tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:35.763350 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-52b5a3d3-2743-4cdf-a53b-600ef7ead9eb tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:35.769286 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-52b5a3d3-2743-4cdf-a53b-600ef7ead9eb tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:35.782208 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-52b5a3d3-2743-4cdf-a53b-600ef7ead9eb tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1447 microversion: 2.75 time: 0.526174 Jun 20 12:10:35.798490 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1433/2937] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:35 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1447 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:35.801882 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f092f2aa-c973-46fd-9340-13b1f797151f tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:35.810248 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0d0d4646-2277-4019-a7bb-aee332fc416d tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:35.813214 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f092f2aa-c973-46fd-9340-13b1f797151f tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:35.814039 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0d0d4646-2277-4019-a7bb-aee332fc416d tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:35.821854 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d0d4646-2277-4019-a7bb-aee332fc416d tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:35.822571 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d0d4646-2277-4019-a7bb-aee332fc416d tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:35.823555 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d0d4646-2277-4019-a7bb-aee332fc416d tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:35.824088 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f092f2aa-c973-46fd-9340-13b1f797151f tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:35.824380 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d0d4646-2277-4019-a7bb-aee332fc416d tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:35.825569 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f092f2aa-c973-46fd-9340-13b1f797151f tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1875 microversion: 2.32 time: 0.374285 Jun 20 12:10:35.837329 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1505/2938] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:35 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1875 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:35.842554 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0bb1fa7b-d4ef-413d-9183-b4d1a794b9ec tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:35.857710 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0bb1fa7b-d4ef-413d-9183-b4d1a794b9ec tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 7014bfb5-b083-485f-9711-b7cc95634c41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:35.871634 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0bb1fa7b-d4ef-413d-9183-b4d1a794b9ec tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:35.872757 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0bb1fa7b-d4ef-413d-9183-b4d1a794b9ec tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:35.873828 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0bb1fa7b-d4ef-413d-9183-b4d1a794b9ec tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:35.874493 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0bb1fa7b-d4ef-413d-9183-b4d1a794b9ec tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:36.201651 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0bb1fa7b-d4ef-413d-9183-b4d1a794b9ec tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:36.210898 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0bb1fa7b-d4ef-413d-9183-b4d1a794b9ec tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41" status: 200 len: 1325 microversion: 2.1 time: 0.372345 Jun 20 12:10:36.214269 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1506/2939] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:35 2022] GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41 => generated 1325 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:36.225983 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5de67073-302f-4c55-9986-258a19b239d5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:36.226830 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5de67073-302f-4c55-9986-258a19b239d5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:36.239370 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5de67073-302f-4c55-9986-258a19b239d5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:36.240035 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5de67073-302f-4c55-9986-258a19b239d5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:36.241154 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5de67073-302f-4c55-9986-258a19b239d5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:36.241758 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5de67073-302f-4c55-9986-258a19b239d5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:36.494564 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5de67073-302f-4c55-9986-258a19b239d5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:36.497160 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0d0d4646-2277-4019-a7bb-aee332fc416d tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:36.507683 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5de67073-302f-4c55-9986-258a19b239d5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1528 microversion: 2.1 time: 0.292278 Jun 20 12:10:36.508866 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1507/2940] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:36 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1528 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:36.510121 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0d0d4646-2277-4019-a7bb-aee332fc416d tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1508 microversion: 2.1 time: 0.710526 Jun 20 12:10:36.510706 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1434/2941] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:35 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1508 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:36.528446 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-44a080d2-a89e-4513-9625-f1364c69395b tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:36.529072 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-44a080d2-a89e-4513-9625-f1364c69395b tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:36.530490 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d1ca03df-badb-4c1e-9c3f-ce596c6176b4 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:36.531365 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d1ca03df-badb-4c1e-9c3f-ce596c6176b4 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:36.539906 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d1ca03df-badb-4c1e-9c3f-ce596c6176b4 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:36.540662 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d1ca03df-badb-4c1e-9c3f-ce596c6176b4 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:36.541710 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d1ca03df-badb-4c1e-9c3f-ce596c6176b4 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:36.542405 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d1ca03df-badb-4c1e-9c3f-ce596c6176b4 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:36.542825 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-44a080d2-a89e-4513-9625-f1364c69395b tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:36.543396 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-44a080d2-a89e-4513-9625-f1364c69395b tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:36.547255 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-44a080d2-a89e-4513-9625-f1364c69395b tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:36.547829 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-44a080d2-a89e-4513-9625-f1364c69395b tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:36.743671 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d1ca03df-badb-4c1e-9c3f-ce596c6176b4 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:36.754744 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d1ca03df-badb-4c1e-9c3f-ce596c6176b4 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1472 microversion: 2.1 time: 0.244616 Jun 20 12:10:36.755613 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1508/2942] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:36 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1472 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:36.808699 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-190e0e36-8c7a-4203-ba14-467d513ee58f tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:36.811776 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-190e0e36-8c7a-4203-ba14-467d513ee58f tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:36.824375 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-190e0e36-8c7a-4203-ba14-467d513ee58f tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:36.825936 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-190e0e36-8c7a-4203-ba14-467d513ee58f tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:36.827173 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-190e0e36-8c7a-4203-ba14-467d513ee58f tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:36.827778 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-190e0e36-8c7a-4203-ba14-467d513ee58f tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:36.923886 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-190e0e36-8c7a-4203-ba14-467d513ee58f tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:36.935436 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-190e0e36-8c7a-4203-ba14-467d513ee58f tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:36.937526 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-190e0e36-8c7a-4203-ba14-467d513ee58f tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:36.951218 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-190e0e36-8c7a-4203-ba14-467d513ee58f tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1447 microversion: 2.75 time: 0.152292 Jun 20 12:10:36.957128 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1509/2943] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:36 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1447 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:10:36.964437 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cdb4b3c5-1b76-4f0b-87f4-944a88c56f30 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:36.965749 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cdb4b3c5-1b76-4f0b-87f4-944a88c56f30 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:36.982715 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-44a080d2-a89e-4513-9625-f1364c69395b tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:36.994455 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cdb4b3c5-1b76-4f0b-87f4-944a88c56f30 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:36.995028 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cdb4b3c5-1b76-4f0b-87f4-944a88c56f30 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:36.996413 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-44a080d2-a89e-4513-9625-f1364c69395b tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1508 microversion: 2.1 time: 0.472481 Jun 20 12:10:36.997156 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cdb4b3c5-1b76-4f0b-87f4-944a88c56f30 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:36.997809 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cdb4b3c5-1b76-4f0b-87f4-944a88c56f30 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:36.999829 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1435/2944] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:36 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1508 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:37.015578 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a7d48bbb-acd0-4ac7-8418-75b205cf0ce6 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:10:37.020529 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a7d48bbb-acd0-4ac7-8418-75b205cf0ce6 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:37.032673 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a7d48bbb-acd0-4ac7-8418-75b205cf0ce6 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:37.033489 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a7d48bbb-acd0-4ac7-8418-75b205cf0ce6 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:37.035019 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a7d48bbb-acd0-4ac7-8418-75b205cf0ce6 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:37.035650 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a7d48bbb-acd0-4ac7-8418-75b205cf0ce6 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:37.173711 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a7d48bbb-acd0-4ac7-8418-75b205cf0ce6 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "PUT /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1080 microversion: 2.1 time: 0.161878 Jun 20 12:10:37.175840 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1436/2945] 10.222.0.27 () {60 vars in 1255 bytes} [Mon Jun 20 12:10:37 2022] PUT /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1080 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:37.194803 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1da3af4f-e3bd-4709-8aa9-f9e13a71ed78 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:37.195694 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1da3af4f-e3bd-4709-8aa9-f9e13a71ed78 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:37.213024 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1da3af4f-e3bd-4709-8aa9-f9e13a71ed78 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:37.215112 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1da3af4f-e3bd-4709-8aa9-f9e13a71ed78 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:37.216783 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1da3af4f-e3bd-4709-8aa9-f9e13a71ed78 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:37.217675 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1da3af4f-e3bd-4709-8aa9-f9e13a71ed78 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:37.373755 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cdb4b3c5-1b76-4f0b-87f4-944a88c56f30 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:37.391640 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cdb4b3c5-1b76-4f0b-87f4-944a88c56f30 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:37.393646 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cdb4b3c5-1b76-4f0b-87f4-944a88c56f30 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:37.396054 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cdb4b3c5-1b76-4f0b-87f4-944a88c56f30 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1875 microversion: 2.32 time: 0.436982 Jun 20 12:10:37.407086 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1510/2946] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:36 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1875 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:37.419914 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-39b0588a-e048-454a-b4ef-d6d2fd3f228b tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:37.420748 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-39b0588a-e048-454a-b4ef-d6d2fd3f228b tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 7014bfb5-b083-485f-9711-b7cc95634c41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:37.436901 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-39b0588a-e048-454a-b4ef-d6d2fd3f228b tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:37.437601 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-39b0588a-e048-454a-b4ef-d6d2fd3f228b tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:37.438670 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-39b0588a-e048-454a-b4ef-d6d2fd3f228b tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:37.439376 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-39b0588a-e048-454a-b4ef-d6d2fd3f228b tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:37.598147 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1da3af4f-e3bd-4709-8aa9-f9e13a71ed78 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:37.607032 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1da3af4f-e3bd-4709-8aa9-f9e13a71ed78 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1506 microversion: 2.1 time: 0.416211 Jun 20 12:10:37.612839 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1437/2947] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:37 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1506 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:10:37.633573 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0ea020fb-3a0a-4a38-a2f8-4f8203039c4c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:37.642671 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0ea020fb-3a0a-4a38-a2f8-4f8203039c4c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:37.661479 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0ea020fb-3a0a-4a38-a2f8-4f8203039c4c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:37.662669 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0ea020fb-3a0a-4a38-a2f8-4f8203039c4c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:37.664305 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0ea020fb-3a0a-4a38-a2f8-4f8203039c4c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:37.665298 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0ea020fb-3a0a-4a38-a2f8-4f8203039c4c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:37.753431 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-39b0588a-e048-454a-b4ef-d6d2fd3f228b tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:37.766619 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-39b0588a-e048-454a-b4ef-d6d2fd3f228b tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41" status: 200 len: 1325 microversion: 2.1 time: 0.364466 Jun 20 12:10:37.767404 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1511/2948] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:37 2022] GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41 => generated 1325 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:37.781668 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-46b761b4-6b49-440b-a72f-14f918a22fc1 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:37.790865 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-46b761b4-6b49-440b-a72f-14f918a22fc1 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:37.809416 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-46b761b4-6b49-440b-a72f-14f918a22fc1 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:37.813886 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-46b761b4-6b49-440b-a72f-14f918a22fc1 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:37.817650 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-46b761b4-6b49-440b-a72f-14f918a22fc1 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:37.819250 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-46b761b4-6b49-440b-a72f-14f918a22fc1 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:38.079686 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0ea020fb-3a0a-4a38-a2f8-4f8203039c4c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:38.096141 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0ea020fb-3a0a-4a38-a2f8-4f8203039c4c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1528 microversion: 2.1 time: 0.479680 Jun 20 12:10:38.097963 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1438/2949] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:37 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1528 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:38.125740 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d1ce7774-d9d9-49ce-a2ed-27891f304ee9 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:38.127270 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d1ce7774-d9d9-49ce-a2ed-27891f304ee9 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:38.142317 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d1ce7774-d9d9-49ce-a2ed-27891f304ee9 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:38.143247 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d1ce7774-d9d9-49ce-a2ed-27891f304ee9 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:38.146757 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d1ce7774-d9d9-49ce-a2ed-27891f304ee9 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:38.147528 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d1ce7774-d9d9-49ce-a2ed-27891f304ee9 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:38.314570 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-46b761b4-6b49-440b-a72f-14f918a22fc1 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:38.329015 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-46b761b4-6b49-440b-a72f-14f918a22fc1 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1506 microversion: 2.1 time: 0.551124 Jun 20 12:10:38.329640 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1512/2950] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:37 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1506 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:38.338036 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-04ab2f19-af53-4f03-a2e1-e7913144391b tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:38.341718 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-04ab2f19-af53-4f03-a2e1-e7913144391b tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:38.354773 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-04ab2f19-af53-4f03-a2e1-e7913144391b tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:38.363156 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-04ab2f19-af53-4f03-a2e1-e7913144391b tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:38.364723 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-04ab2f19-af53-4f03-a2e1-e7913144391b tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:38.365499 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-04ab2f19-af53-4f03-a2e1-e7913144391b tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:38.538255 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-04ab2f19-af53-4f03-a2e1-e7913144391b tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:38.550421 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-04ab2f19-af53-4f03-a2e1-e7913144391b tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:38.553813 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-04ab2f19-af53-4f03-a2e1-e7913144391b tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:38.576696 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-04ab2f19-af53-4f03-a2e1-e7913144391b tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1447 microversion: 2.75 time: 0.241393 Jun 20 12:10:38.578055 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1513/2951] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:38 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1447 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:38.603330 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-eb3c0eef-00af-4253-981b-4cc244c98b60 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:10:38.608668 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-eb3c0eef-00af-4253-981b-4cc244c98b60 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:38.637783 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb3c0eef-00af-4253-981b-4cc244c98b60 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:38.640139 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb3c0eef-00af-4253-981b-4cc244c98b60 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:38.641200 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb3c0eef-00af-4253-981b-4cc244c98b60 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:38.645291 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb3c0eef-00af-4253-981b-4cc244c98b60 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:38.664926 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d1ce7774-d9d9-49ce-a2ed-27891f304ee9 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:38.693250 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d1ce7774-d9d9-49ce-a2ed-27891f304ee9 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1477 microversion: 2.1 time: 0.593637 Jun 20 12:10:38.699417 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1439/2952] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:38 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1477 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:38.744796 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ba42a84c-1262-4b2c-9af7-b1dab2af1daa tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:38.745656 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ba42a84c-1262-4b2c-9af7-b1dab2af1daa tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:38.751408 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:38.754512 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba42a84c-1262-4b2c-9af7-b1dab2af1daa tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:38.770296 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba42a84c-1262-4b2c-9af7-b1dab2af1daa tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:38.771900 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba42a84c-1262-4b2c-9af7-b1dab2af1daa tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:38.772585 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba42a84c-1262-4b2c-9af7-b1dab2af1daa tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:38.905430 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-eb3c0eef-00af-4253-981b-4cc244c98b60 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:10:38.906696 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-eb3c0eef-00af-4253-981b-4cc244c98b60 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:10:38.907809 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-eb3c0eef-00af-4253-981b-4cc244c98b60 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:10:38.908808 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-eb3c0eef-00af-4253-981b-4cc244c98b60 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:10:38.912419 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-eb3c0eef-00af-4253-981b-4cc244c98b60 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:10:38.971671 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:39.098820 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-eb3c0eef-00af-4253-981b-4cc244c98b60 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:39.125690 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb3c0eef-00af-4253-981b-4cc244c98b60 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:39.130306 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb3c0eef-00af-4253-981b-4cc244c98b60 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:39.134545 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb3c0eef-00af-4253-981b-4cc244c98b60 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:39.135061 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb3c0eef-00af-4253-981b-4cc244c98b60 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:39.221611 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-eb3c0eef-00af-4253-981b-4cc244c98b60 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "POST /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67/action" status: 202 len: 1112 microversion: 2.1 time: 0.638815 Jun 20 12:10:39.223043 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1514/2953] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:10:38 2022] POST /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67/action => generated 1112 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jun 20 12:10:39.255969 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8d614639-4d71-4e2a-aacc-489be5497554 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:39.259294 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8d614639-4d71-4e2a-aacc-489be5497554 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 7014bfb5-b083-485f-9711-b7cc95634c41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:39.283155 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8d614639-4d71-4e2a-aacc-489be5497554 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:39.283717 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8d614639-4d71-4e2a-aacc-489be5497554 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:39.291389 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8d614639-4d71-4e2a-aacc-489be5497554 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:39.291903 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8d614639-4d71-4e2a-aacc-489be5497554 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:39.641008 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8d614639-4d71-4e2a-aacc-489be5497554 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:39.646056 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ba42a84c-1262-4b2c-9af7-b1dab2af1daa tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:39.662123 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8d614639-4d71-4e2a-aacc-489be5497554 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41" status: 200 len: 1325 microversion: 2.1 time: 0.425574 Jun 20 12:10:39.663518 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1515/2954] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:39 2022] GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41 => generated 1325 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:39.678505 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-046f5518-6993-43d6-b148-dc85e9ee0fcb tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:39.683059 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-046f5518-6993-43d6-b148-dc85e9ee0fcb tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:39.693617 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ba42a84c-1262-4b2c-9af7-b1dab2af1daa tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:39.699138 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ba42a84c-1262-4b2c-9af7-b1dab2af1daa tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:39.706570 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ba42a84c-1262-4b2c-9af7-b1dab2af1daa tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1875 microversion: 2.32 time: 1.000539 Jun 20 12:10:39.709464 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-046f5518-6993-43d6-b148-dc85e9ee0fcb tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:39.710106 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-046f5518-6993-43d6-b148-dc85e9ee0fcb tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:39.710364 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1440/2955] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:38 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1875 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:39.715302 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-046f5518-6993-43d6-b148-dc85e9ee0fcb tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:39.715771 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-046f5518-6993-43d6-b148-dc85e9ee0fcb tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:39.737142 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-011db591-8dd4-44f5-9df1-3607ea535bcf tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:39.738347 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-011db591-8dd4-44f5-9df1-3607ea535bcf tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:39.757452 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-011db591-8dd4-44f5-9df1-3607ea535bcf tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:39.759722 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-011db591-8dd4-44f5-9df1-3607ea535bcf tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:39.761440 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-011db591-8dd4-44f5-9df1-3607ea535bcf tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:39.764130 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-011db591-8dd4-44f5-9df1-3607ea535bcf tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:40.223223 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-046f5518-6993-43d6-b148-dc85e9ee0fcb tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:40.234393 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-046f5518-6993-43d6-b148-dc85e9ee0fcb tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1528 microversion: 2.1 time: 0.569327 Jun 20 12:10:40.237357 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1516/2956] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:39 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1528 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:40.243132 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ca35c036-af7f-48ea-8d92-8f18a3efb54c tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:40.243751 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ca35c036-af7f-48ea-8d92-8f18a3efb54c tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:40.266313 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ca35c036-af7f-48ea-8d92-8f18a3efb54c tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:40.266829 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ca35c036-af7f-48ea-8d92-8f18a3efb54c tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:40.267687 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ca35c036-af7f-48ea-8d92-8f18a3efb54c tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:40.268125 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ca35c036-af7f-48ea-8d92-8f18a3efb54c tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:40.456090 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ca35c036-af7f-48ea-8d92-8f18a3efb54c tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:40.482849 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ca35c036-af7f-48ea-8d92-8f18a3efb54c tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:40.485024 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ca35c036-af7f-48ea-8d92-8f18a3efb54c tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:40.509947 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ca35c036-af7f-48ea-8d92-8f18a3efb54c tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1447 microversion: 2.75 time: 0.270994 Jun 20 12:10:40.511337 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1517/2957] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:40 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1447 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:40.523028 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-11cc3bd8-9802-4146-a202-36c671b3ea10 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:40.527786 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-11cc3bd8-9802-4146-a202-36c671b3ea10 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:40.548936 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11cc3bd8-9802-4146-a202-36c671b3ea10 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:40.549587 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11cc3bd8-9802-4146-a202-36c671b3ea10 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:40.555415 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11cc3bd8-9802-4146-a202-36c671b3ea10 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:40.556754 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11cc3bd8-9802-4146-a202-36c671b3ea10 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:40.847274 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-011db591-8dd4-44f5-9df1-3607ea535bcf tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:40.870514 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-011db591-8dd4-44f5-9df1-3607ea535bcf tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1517 microversion: 2.1 time: 1.156955 Jun 20 12:10:40.875793 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1441/2958] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:39 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1517 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:40.889708 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-90add0e6-2fb7-43ec-85fa-dc181b27f9dc tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:40.891394 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-90add0e6-2fb7-43ec-85fa-dc181b27f9dc tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 7014bfb5-b083-485f-9711-b7cc95634c41] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:40.906574 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-90add0e6-2fb7-43ec-85fa-dc181b27f9dc tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:40.909292 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-90add0e6-2fb7-43ec-85fa-dc181b27f9dc tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:40.912026 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-90add0e6-2fb7-43ec-85fa-dc181b27f9dc tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:40.913105 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-90add0e6-2fb7-43ec-85fa-dc181b27f9dc tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:41.109193 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-11cc3bd8-9802-4146-a202-36c671b3ea10 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:41.138980 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-11cc3bd8-9802-4146-a202-36c671b3ea10 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1477 microversion: 2.1 time: 0.625893 Jun 20 12:10:41.145607 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1518/2959] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:40 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1477 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:41.163974 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ff03cb9c-6e1b-4ad2-b1f3-50dc07e72890 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:41.173137 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ff03cb9c-6e1b-4ad2-b1f3-50dc07e72890 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:41.189950 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff03cb9c-6e1b-4ad2-b1f3-50dc07e72890 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:41.190894 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff03cb9c-6e1b-4ad2-b1f3-50dc07e72890 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:41.191945 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff03cb9c-6e1b-4ad2-b1f3-50dc07e72890 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:41.192509 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff03cb9c-6e1b-4ad2-b1f3-50dc07e72890 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:41.442799 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-90add0e6-2fb7-43ec-85fa-dc181b27f9dc tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:41.462325 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-90add0e6-2fb7-43ec-85fa-dc181b27f9dc tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41" status: 200 len: 1325 microversion: 2.1 time: 0.582251 Jun 20 12:10:41.465432 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1442/2960] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:40 2022] GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41 => generated 1325 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:41.471561 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3ff2b38d-dfcf-4da9-9fc8-b1788c33e0de tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:41.477686 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3ff2b38d-dfcf-4da9-9fc8-b1788c33e0de tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:41.489286 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3ff2b38d-dfcf-4da9-9fc8-b1788c33e0de tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:41.489798 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3ff2b38d-dfcf-4da9-9fc8-b1788c33e0de tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:41.490838 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3ff2b38d-dfcf-4da9-9fc8-b1788c33e0de tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:41.491441 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3ff2b38d-dfcf-4da9-9fc8-b1788c33e0de tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:41.755378 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ff03cb9c-6e1b-4ad2-b1f3-50dc07e72890 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:41.775499 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ff03cb9c-6e1b-4ad2-b1f3-50dc07e72890 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:41.777636 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ff03cb9c-6e1b-4ad2-b1f3-50dc07e72890 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:41.779203 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ff03cb9c-6e1b-4ad2-b1f3-50dc07e72890 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1875 microversion: 2.32 time: 0.628986 Jun 20 12:10:41.780553 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1519/2961] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:41 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1875 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:41.795612 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7c1bf989-7d9d-4f0d-ad49-b888f2aa0380 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:41.796726 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7c1bf989-7d9d-4f0d-ad49-b888f2aa0380 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:41.816509 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c1bf989-7d9d-4f0d-ad49-b888f2aa0380 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:41.817349 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c1bf989-7d9d-4f0d-ad49-b888f2aa0380 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:41.818316 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c1bf989-7d9d-4f0d-ad49-b888f2aa0380 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:41.818921 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c1bf989-7d9d-4f0d-ad49-b888f2aa0380 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:42.251207 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3ff2b38d-dfcf-4da9-9fc8-b1788c33e0de tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:42.275532 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3ff2b38d-dfcf-4da9-9fc8-b1788c33e0de tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1528 microversion: 2.1 time: 0.801752 Jun 20 12:10:42.276815 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1443/2962] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:41 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1528 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:42.283307 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9ef972f8-ca87-42c7-a884-f7924587db2e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:42.285801 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9ef972f8-ca87-42c7-a884-f7924587db2e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:42.303763 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9ef972f8-ca87-42c7-a884-f7924587db2e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:42.304505 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9ef972f8-ca87-42c7-a884-f7924587db2e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:42.305844 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9ef972f8-ca87-42c7-a884-f7924587db2e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:42.307205 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9ef972f8-ca87-42c7-a884-f7924587db2e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:42.533420 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7c1bf989-7d9d-4f0d-ad49-b888f2aa0380 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:42.556934 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7c1bf989-7d9d-4f0d-ad49-b888f2aa0380 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:42.561751 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7c1bf989-7d9d-4f0d-ad49-b888f2aa0380 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:42.578677 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7c1bf989-7d9d-4f0d-ad49-b888f2aa0380 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1447 microversion: 2.75 time: 0.796559 Jun 20 12:10:42.582294 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1520/2963] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:41 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1447 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:42.609539 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e16a87b6-7a2b-4de8-9159-859b5bf897dc tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:42.611148 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e16a87b6-7a2b-4de8-9159-859b5bf897dc tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:42.622840 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e16a87b6-7a2b-4de8-9159-859b5bf897dc tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:42.623526 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e16a87b6-7a2b-4de8-9159-859b5bf897dc tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:42.624477 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e16a87b6-7a2b-4de8-9159-859b5bf897dc tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:42.625061 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e16a87b6-7a2b-4de8-9159-859b5bf897dc tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:42.747875 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9ef972f8-ca87-42c7-a884-f7924587db2e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:42.760579 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9ef972f8-ca87-42c7-a884-f7924587db2e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1517 microversion: 2.1 time: 0.478532 Jun 20 12:10:42.774607 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1444/2964] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:42 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1517 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:42.780061 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-889d28df-d733-4073-9edf-7490e6b3aa51 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:42.780930 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-889d28df-d733-4073-9edf-7490e6b3aa51 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 7014bfb5-b083-485f-9711-b7cc95634c41] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:42.788691 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-889d28df-d733-4073-9edf-7490e6b3aa51 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:42.789735 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-889d28df-d733-4073-9edf-7490e6b3aa51 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:42.790713 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-889d28df-d733-4073-9edf-7490e6b3aa51 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:42.791312 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-889d28df-d733-4073-9edf-7490e6b3aa51 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:43.119698 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e16a87b6-7a2b-4de8-9159-859b5bf897dc tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:43.138341 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e16a87b6-7a2b-4de8-9159-859b5bf897dc tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1477 microversion: 2.1 time: 0.553492 Jun 20 12:10:43.139716 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1521/2965] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:42 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1477 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:43.163040 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-345678b1-86f7-4a27-b2ac-27f9db0e2461 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:43.163852 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-345678b1-86f7-4a27-b2ac-27f9db0e2461 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:43.179514 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-345678b1-86f7-4a27-b2ac-27f9db0e2461 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:43.182042 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-345678b1-86f7-4a27-b2ac-27f9db0e2461 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:43.183583 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-345678b1-86f7-4a27-b2ac-27f9db0e2461 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:43.184287 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-345678b1-86f7-4a27-b2ac-27f9db0e2461 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:43.299089 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-889d28df-d733-4073-9edf-7490e6b3aa51 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:43.333815 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-889d28df-d733-4073-9edf-7490e6b3aa51 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41" status: 200 len: 1325 microversion: 2.1 time: 0.557171 Jun 20 12:10:43.353998 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1445/2966] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:42 2022] GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41 => generated 1325 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:43.362240 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-17371cce-aa45-4abc-8f0a-d6e3893a2447 req-c7e78165-eca9-434c-8cbd-d5f260f1bb17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7014bfb5-b083-485f-9711-b7cc95634c41", "name": "network-vif-plugged", "status": "completed", "tag": "2b4ae774-61d2-4117-bf2a-8e8514f99147"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:10:43.386891 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-17371cce-aa45-4abc-8f0a-d6e3893a2447 req-c7e78165-eca9-434c-8cbd-d5f260f1bb17 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:43.387248 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-17371cce-aa45-4abc-8f0a-d6e3893a2447 req-c7e78165-eca9-434c-8cbd-d5f260f1bb17 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:43.416801 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-17371cce-aa45-4abc-8f0a-d6e3893a2447 req-c7e78165-eca9-434c-8cbd-d5f260f1bb17 service nova] Creating event network-vif-plugged:2b4ae774-61d2-4117-bf2a-8e8514f99147 for instance 7014bfb5-b083-485f-9711-b7cc95634c41 on n-h2-master-1 Jun 20 12:10:43.434901 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-17371cce-aa45-4abc-8f0a-d6e3893a2447 req-c7e78165-eca9-434c-8cbd-d5f260f1bb17 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078787 Jun 20 12:10:43.436381 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1446/2967] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:10:43.446039 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0bd063d9-e748-4d06-96e0-5b8af4e15afc tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:43.453599 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0bd063d9-e748-4d06-96e0-5b8af4e15afc tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:43.467280 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0bd063d9-e748-4d06-96e0-5b8af4e15afc tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:43.470627 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0bd063d9-e748-4d06-96e0-5b8af4e15afc tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:43.473699 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0bd063d9-e748-4d06-96e0-5b8af4e15afc tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:43.477294 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0bd063d9-e748-4d06-96e0-5b8af4e15afc tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:43.762127 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0bd063d9-e748-4d06-96e0-5b8af4e15afc tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:43.772249 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0bd063d9-e748-4d06-96e0-5b8af4e15afc tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1528 microversion: 2.1 time: 0.332574 Jun 20 12:10:43.786409 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1447/2968] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:43 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1528 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:43.793147 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fbe8cf23-4df6-4e57-a57c-dbcd9b6c1089 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:43.800420 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fbe8cf23-4df6-4e57-a57c-dbcd9b6c1089 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:43.808436 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fbe8cf23-4df6-4e57-a57c-dbcd9b6c1089 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:43.809134 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fbe8cf23-4df6-4e57-a57c-dbcd9b6c1089 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:43.810589 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fbe8cf23-4df6-4e57-a57c-dbcd9b6c1089 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:43.811195 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fbe8cf23-4df6-4e57-a57c-dbcd9b6c1089 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:43.946894 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fbe8cf23-4df6-4e57-a57c-dbcd9b6c1089 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:43.958740 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fbe8cf23-4df6-4e57-a57c-dbcd9b6c1089 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:43.961784 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fbe8cf23-4df6-4e57-a57c-dbcd9b6c1089 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:43.976049 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fbe8cf23-4df6-4e57-a57c-dbcd9b6c1089 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1447 microversion: 2.75 time: 0.187021 Jun 20 12:10:43.978731 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1448/2969] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:43 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1447 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:43.992768 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a6a4d6b1-4c11-4371-914e-9d90981de999 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:43.993690 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a6a4d6b1-4c11-4371-914e-9d90981de999 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:44.010331 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6a4d6b1-4c11-4371-914e-9d90981de999 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:44.012059 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6a4d6b1-4c11-4371-914e-9d90981de999 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:44.012995 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6a4d6b1-4c11-4371-914e-9d90981de999 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:44.016224 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6a4d6b1-4c11-4371-914e-9d90981de999 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:44.021916 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:44.073049 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-345678b1-86f7-4a27-b2ac-27f9db0e2461 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:44.088115 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-345678b1-86f7-4a27-b2ac-27f9db0e2461 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:44.099669 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-345678b1-86f7-4a27-b2ac-27f9db0e2461 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:44.102395 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-345678b1-86f7-4a27-b2ac-27f9db0e2461 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1875 microversion: 2.32 time: 0.960699 Jun 20 12:10:44.103634 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1522/2970] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:43 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1875 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:44.386348 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-05691e69-096b-4e2c-aa8a-0330bc90ecb0 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1933604876", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:10:44.523901 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-05691e69-096b-4e2c-aa8a-0330bc90ecb0 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] validate_networks() for [('844279f1-b6b7-42d1-9946-2fe7ef088f0b', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:10:44.536041 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a6a4d6b1-4c11-4371-914e-9d90981de999 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:44.544489 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a6a4d6b1-4c11-4371-914e-9d90981de999 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1517 microversion: 2.1 time: 0.563676 Jun 20 12:10:44.551109 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1449/2971] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:43 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1517 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:44.560155 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9f52a0e3-ebf8-4dfe-ba6a-914af6acc0dc tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:44.560792 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9f52a0e3-ebf8-4dfe-ba6a-914af6acc0dc tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:44.570377 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9f52a0e3-ebf8-4dfe-ba6a-914af6acc0dc tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:44.571165 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9f52a0e3-ebf8-4dfe-ba6a-914af6acc0dc tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:44.576492 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9f52a0e3-ebf8-4dfe-ba6a-914af6acc0dc tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:44.577296 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9f52a0e3-ebf8-4dfe-ba6a-914af6acc0dc tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:44.901090 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9f52a0e3-ebf8-4dfe-ba6a-914af6acc0dc tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:44.923773 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9f52a0e3-ebf8-4dfe-ba6a-914af6acc0dc tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1477 microversion: 2.1 time: 0.371465 Jun 20 12:10:44.937104 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1450/2972] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:44 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1477 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:44.957105 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6cad15ab-1673-45a7-9866-c5ebbb91c381 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:44.957449 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6cad15ab-1673-45a7-9866-c5ebbb91c381 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 7014bfb5-b083-485f-9711-b7cc95634c41] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:44.965102 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6cad15ab-1673-45a7-9866-c5ebbb91c381 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:44.965693 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6cad15ab-1673-45a7-9866-c5ebbb91c381 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:44.968391 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6cad15ab-1673-45a7-9866-c5ebbb91c381 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:44.969817 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6cad15ab-1673-45a7-9866-c5ebbb91c381 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:45.191432 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6cad15ab-1673-45a7-9866-c5ebbb91c381 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:45.203893 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6cad15ab-1673-45a7-9866-c5ebbb91c381 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41" status: 200 len: 1325 microversion: 2.1 time: 0.265543 Jun 20 12:10:45.233765 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1451/2973] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:44 2022] GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41 => generated 1325 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:45.258226 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2891b6c7-b1bc-4745-85e5-c373b2968412 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:45.259170 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2891b6c7-b1bc-4745-85e5-c373b2968412 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:45.273089 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2891b6c7-b1bc-4745-85e5-c373b2968412 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:45.273538 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2891b6c7-b1bc-4745-85e5-c373b2968412 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:45.274329 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2891b6c7-b1bc-4745-85e5-c373b2968412 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:45.274762 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2891b6c7-b1bc-4745-85e5-c373b2968412 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:45.381028 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-05691e69-096b-4e2c-aa8a-0330bc90ecb0 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:10:45.381532 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-05691e69-096b-4e2c-aa8a-0330bc90ecb0 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:10:45.382077 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-05691e69-096b-4e2c-aa8a-0330bc90ecb0 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:10:45.382629 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-05691e69-096b-4e2c-aa8a-0330bc90ecb0 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:10:45.384058 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-05691e69-096b-4e2c-aa8a-0330bc90ecb0 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:10:45.410134 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-05691e69-096b-4e2c-aa8a-0330bc90ecb0 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:45.422986 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-05691e69-096b-4e2c-aa8a-0330bc90ecb0 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:45.431608 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-05691e69-096b-4e2c-aa8a-0330bc90ecb0 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:45.432093 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-05691e69-096b-4e2c-aa8a-0330bc90ecb0 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:45.481247 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-05691e69-096b-4e2c-aa8a-0330bc90ecb0 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Getting quotas for project 5c47b977a1334cd486385213ff23de86. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:10:45.498656 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-05691e69-096b-4e2c-aa8a-0330bc90ecb0 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Getting quotas for user d07f91cbf86a444fb06e050d4c4532fd and project 5c47b977a1334cd486385213ff23de86. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:10:45.540279 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-05691e69-096b-4e2c-aa8a-0330bc90ecb0 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:10:45.545772 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-05691e69-096b-4e2c-aa8a-0330bc90ecb0 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:10:45.581857 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2891b6c7-b1bc-4745-85e5-c373b2968412 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:45.581857 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2891b6c7-b1bc-4745-85e5-c373b2968412 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1528 microversion: 2.1 time: 0.334536 Jun 20 12:10:45.581857 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1452/2974] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:45 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1528 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:45.586414 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cdc36a69-97a0-40f7-86dc-d0633c7cec6e tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:45.587515 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cdc36a69-97a0-40f7-86dc-d0633c7cec6e tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:45.609562 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cdc36a69-97a0-40f7-86dc-d0633c7cec6e tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:45.610162 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cdc36a69-97a0-40f7-86dc-d0633c7cec6e tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:45.611439 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cdc36a69-97a0-40f7-86dc-d0633c7cec6e tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:45.612134 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cdc36a69-97a0-40f7-86dc-d0633c7cec6e tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:45.636774 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-05691e69-096b-4e2c-aa8a-0330bc90ecb0 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.530499 Jun 20 12:10:45.644469 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1523/2975] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:10:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 1539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:10:45.664239 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3575f2f3-8f30-4b87-81c5-fbdd73be4832 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:45.666161 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3575f2f3-8f30-4b87-81c5-fbdd73be4832 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:45.678509 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3575f2f3-8f30-4b87-81c5-fbdd73be4832 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:45.679967 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3575f2f3-8f30-4b87-81c5-fbdd73be4832 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:45.682080 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3575f2f3-8f30-4b87-81c5-fbdd73be4832 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:45.683582 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3575f2f3-8f30-4b87-81c5-fbdd73be4832 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:45.885757 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-cdc36a69-97a0-40f7-86dc-d0633c7cec6e tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:45.914494 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-cdc36a69-97a0-40f7-86dc-d0633c7cec6e tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:45.920761 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-cdc36a69-97a0-40f7-86dc-d0633c7cec6e tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:45.944600 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cdc36a69-97a0-40f7-86dc-d0633c7cec6e tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1447 microversion: 2.75 time: 0.369117 Jun 20 12:10:45.970432 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1453/2976] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:45 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1447 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:45.994845 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9aa330e6-d139-4ab3-8597-771eaec5a4b4 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:45.995762 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9aa330e6-d139-4ab3-8597-771eaec5a4b4 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:46.029023 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9aa330e6-d139-4ab3-8597-771eaec5a4b4 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:46.034406 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9aa330e6-d139-4ab3-8597-771eaec5a4b4 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:46.038085 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9aa330e6-d139-4ab3-8597-771eaec5a4b4 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:46.039092 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9aa330e6-d139-4ab3-8597-771eaec5a4b4 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:46.294269 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3575f2f3-8f30-4b87-81c5-fbdd73be4832 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:46.323980 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3575f2f3-8f30-4b87-81c5-fbdd73be4832 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:46.327924 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3575f2f3-8f30-4b87-81c5-fbdd73be4832 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:46.330238 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3575f2f3-8f30-4b87-81c5-fbdd73be4832 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1875 microversion: 2.32 time: 0.682907 Jun 20 12:10:46.332319 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1524/2977] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:45 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1875 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:46.373488 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-792804bc-b13b-4b50-925d-c8f31f531126 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:46.377207 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-792804bc-b13b-4b50-925d-c8f31f531126 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:46.513301 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9aa330e6-d139-4ab3-8597-771eaec5a4b4 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:46.529638 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9aa330e6-d139-4ab3-8597-771eaec5a4b4 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1517 microversion: 2.1 time: 0.557668 Jun 20 12:10:46.532175 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1454/2978] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:45 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1517 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:46.541345 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-36d1e2b3-9f41-4528-85c0-2d83f5a28901 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:46.542755 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-36d1e2b3-9f41-4528-85c0-2d83f5a28901 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:46.561275 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-36d1e2b3-9f41-4528-85c0-2d83f5a28901 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:46.562637 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-36d1e2b3-9f41-4528-85c0-2d83f5a28901 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:46.565771 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-36d1e2b3-9f41-4528-85c0-2d83f5a28901 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:46.566761 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-36d1e2b3-9f41-4528-85c0-2d83f5a28901 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:46.580232 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-792804bc-b13b-4b50-925d-c8f31f531126 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07f91cbf86a444fb06e050d4c4532fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c47b977a1334cd486385213ff23de86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:46.593806 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-792804bc-b13b-4b50-925d-c8f31f531126 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 200 len: 1223 microversion: 2.1 time: 0.239742 Jun 20 12:10:46.595584 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1525/2979] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:46 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 1223 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:46.613252 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-770a8c99-95de-4c7b-9df6-3d5a951fb6cb tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:46.614378 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-770a8c99-95de-4c7b-9df6-3d5a951fb6cb tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 7014bfb5-b083-485f-9711-b7cc95634c41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:46.627603 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-770a8c99-95de-4c7b-9df6-3d5a951fb6cb tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:46.633221 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-770a8c99-95de-4c7b-9df6-3d5a951fb6cb tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:46.634524 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-770a8c99-95de-4c7b-9df6-3d5a951fb6cb tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:46.635140 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-770a8c99-95de-4c7b-9df6-3d5a951fb6cb tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:46.859116 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-36d1e2b3-9f41-4528-85c0-2d83f5a28901 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:46.891085 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-36d1e2b3-9f41-4528-85c0-2d83f5a28901 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1477 microversion: 2.1 time: 0.356716 Jun 20 12:10:46.907520 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1455/2980] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:46 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1477 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:46.921918 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6d31a2f4-eece-4b84-9992-edc5034ec84c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:46.926628 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6d31a2f4-eece-4b84-9992-edc5034ec84c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:46.950550 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6d31a2f4-eece-4b84-9992-edc5034ec84c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:46.950550 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6d31a2f4-eece-4b84-9992-edc5034ec84c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:46.950550 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6d31a2f4-eece-4b84-9992-edc5034ec84c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:46.951761 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6d31a2f4-eece-4b84-9992-edc5034ec84c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:47.084061 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-770a8c99-95de-4c7b-9df6-3d5a951fb6cb tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:47.101571 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-770a8c99-95de-4c7b-9df6-3d5a951fb6cb tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41" status: 200 len: 1521 microversion: 2.1 time: 0.492764 Jun 20 12:10:47.102090 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1526/2981] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:46 2022] GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41 => generated 1521 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:47.115856 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1533908c-f02b-4773-8618-5531e2fadd43 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:47.119245 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1533908c-f02b-4773-8618-5531e2fadd43 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:47.137026 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1533908c-f02b-4773-8618-5531e2fadd43 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:47.137935 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1533908c-f02b-4773-8618-5531e2fadd43 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:47.138929 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1533908c-f02b-4773-8618-5531e2fadd43 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:47.141226 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1533908c-f02b-4773-8618-5531e2fadd43 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:47.311375 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1533908c-f02b-4773-8618-5531e2fadd43 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:47.329727 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1533908c-f02b-4773-8618-5531e2fadd43 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:47.333310 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6d31a2f4-eece-4b84-9992-edc5034ec84c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:47.333646 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1533908c-f02b-4773-8618-5531e2fadd43 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:47.343078 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1533908c-f02b-4773-8618-5531e2fadd43 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1447 microversion: 2.75 time: 0.237822 Jun 20 12:10:47.343562 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6d31a2f4-eece-4b84-9992-edc5034ec84c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1528 microversion: 2.1 time: 0.434708 Jun 20 12:10:47.346876 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1456/2982] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:46 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1528 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:47.352564 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4c8bcc40-6239-49f9-9854-3e455199991c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:47.353461 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4c8bcc40-6239-49f9-9854-3e455199991c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 7014bfb5-b083-485f-9711-b7cc95634c41] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:47.354909 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1527/2983] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:47 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1447 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:47.360063 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0b8d8d1b-0b1b-461c-9ece-b735fe50055a tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:47.360996 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0b8d8d1b-0b1b-461c-9ece-b735fe50055a tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:47.361192 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4c8bcc40-6239-49f9-9854-3e455199991c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:47.361686 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4c8bcc40-6239-49f9-9854-3e455199991c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:47.362714 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4c8bcc40-6239-49f9-9854-3e455199991c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:47.363177 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4c8bcc40-6239-49f9-9854-3e455199991c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:47.387729 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0b8d8d1b-0b1b-461c-9ece-b735fe50055a tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:47.388533 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0b8d8d1b-0b1b-461c-9ece-b735fe50055a tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:47.390928 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0b8d8d1b-0b1b-461c-9ece-b735fe50055a tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:47.391903 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0b8d8d1b-0b1b-461c-9ece-b735fe50055a tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:47.673350 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4c8bcc40-6239-49f9-9854-3e455199991c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:47.685442 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4c8bcc40-6239-49f9-9854-3e455199991c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41" status: 200 len: 1521 microversion: 2.1 time: 0.337190 Jun 20 12:10:47.687960 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1457/2984] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:47 2022] GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41 => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:47.701115 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5f8ef961-ac13-4ef5-9c34-65e3bc81ee68 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:47.702033 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5f8ef961-ac13-4ef5-9c34-65e3bc81ee68 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:47.717229 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5f8ef961-ac13-4ef5-9c34-65e3bc81ee68 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:47.717961 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5f8ef961-ac13-4ef5-9c34-65e3bc81ee68 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:47.718960 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5f8ef961-ac13-4ef5-9c34-65e3bc81ee68 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:47.720731 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5f8ef961-ac13-4ef5-9c34-65e3bc81ee68 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:48.014785 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0b8d8d1b-0b1b-461c-9ece-b735fe50055a tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:48.031153 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0b8d8d1b-0b1b-461c-9ece-b735fe50055a tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:48.044822 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0b8d8d1b-0b1b-461c-9ece-b735fe50055a tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:48.046295 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0b8d8d1b-0b1b-461c-9ece-b735fe50055a tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1875 microversion: 2.32 time: 0.690104 Jun 20 12:10:48.047161 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1528/2985] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:47 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1875 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:48.052744 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ca7431d2-2a16-4685-9c9c-f600c4ebc25b tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:48.053845 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ca7431d2-2a16-4685-9c9c-f600c4ebc25b tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:48.063745 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ca7431d2-2a16-4685-9c9c-f600c4ebc25b tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:48.064534 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ca7431d2-2a16-4685-9c9c-f600c4ebc25b tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:48.065560 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ca7431d2-2a16-4685-9c9c-f600c4ebc25b tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:48.066161 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ca7431d2-2a16-4685-9c9c-f600c4ebc25b tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:48.147522 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ca7431d2-2a16-4685-9c9c-f600c4ebc25b tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07f91cbf86a444fb06e050d4c4532fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c47b977a1334cd486385213ff23de86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:48.176364 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ca7431d2-2a16-4685-9c9c-f600c4ebc25b tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 200 len: 1281 microversion: 2.1 time: 0.119128 Jun 20 12:10:48.177578 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1529/2986] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:48 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 1281 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:48.195663 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-86c37e67-629f-4abf-b13f-2c2c32547327 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1250289627"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:10:48.197912 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-86c37e67-629f-4abf-b13f-2c2c32547327 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 7014bfb5-b083-485f-9711-b7cc95634c41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:48.219514 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86c37e67-629f-4abf-b13f-2c2c32547327 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:48.220304 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86c37e67-629f-4abf-b13f-2c2c32547327 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:48.221340 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86c37e67-629f-4abf-b13f-2c2c32547327 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:48.222012 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86c37e67-629f-4abf-b13f-2c2c32547327 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:48.343361 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5f8ef961-ac13-4ef5-9c34-65e3bc81ee68 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:48.360103 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5f8ef961-ac13-4ef5-9c34-65e3bc81ee68 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1517 microversion: 2.1 time: 0.670722 Jun 20 12:10:48.363788 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1458/2987] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:47 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1517 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:48.377611 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-19e6c12a-0804-473a-b7a4-9a93000b920a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:48.383155 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-19e6c12a-0804-473a-b7a4-9a93000b920a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:48.412814 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-19e6c12a-0804-473a-b7a4-9a93000b920a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:48.415867 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-19e6c12a-0804-473a-b7a4-9a93000b920a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:48.424316 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-19e6c12a-0804-473a-b7a4-9a93000b920a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:48.426053 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-19e6c12a-0804-473a-b7a4-9a93000b920a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:48.760443 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-19e6c12a-0804-473a-b7a4-9a93000b920a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:48.779384 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-19e6c12a-0804-473a-b7a4-9a93000b920a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1477 microversion: 2.1 time: 0.410614 Jun 20 12:10:48.788669 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1459/2988] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:48 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1477 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:48.817590 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e83d1434-b492-4311-84e2-add297629fce tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:48.818733 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e83d1434-b492-4311-84e2-add297629fce tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:48.846036 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e83d1434-b492-4311-84e2-add297629fce tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:48.847390 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e83d1434-b492-4311-84e2-add297629fce tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:48.848062 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e83d1434-b492-4311-84e2-add297629fce tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:48.848532 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e83d1434-b492-4311-84e2-add297629fce tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:48.938859 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:49.015409 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-86c37e67-629f-4abf-b13f-2c2c32547327 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "POST /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41/action" status: 202 len: 0 microversion: 2.1 time: 0.823353 Jun 20 12:10:49.019240 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1530/2989] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:10:48 2022] POST /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41/action => generated 0 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 20 12:10:49.036737 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0243f185-bd85-4135-b7c0-d6742c98b96a tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:49.036737 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0243f185-bd85-4135-b7c0-d6742c98b96a tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:49.055722 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0243f185-bd85-4135-b7c0-d6742c98b96a tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:49.056611 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0243f185-bd85-4135-b7c0-d6742c98b96a tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:49.057480 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0243f185-bd85-4135-b7c0-d6742c98b96a tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:49.057923 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0243f185-bd85-4135-b7c0-d6742c98b96a tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:49.267570 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0243f185-bd85-4135-b7c0-d6742c98b96a tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:49.286629 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0243f185-bd85-4135-b7c0-d6742c98b96a tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:49.296395 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0243f185-bd85-4135-b7c0-d6742c98b96a tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:49.311882 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0243f185-bd85-4135-b7c0-d6742c98b96a tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1447 microversion: 2.75 time: 0.291083 Jun 20 12:10:49.313968 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1531/2990] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:49 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1447 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:49.343434 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b42e7ee1-3e5a-4e3b-9c1f-aa0991d61ae7 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '.version_select at 0x7f6072c1f820>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:49.586647 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b42e7ee1-3e5a-4e3b-9c1f-aa0991d61ae7 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "DELETE /compute/v2.1/images/2eb351c3-ad27-4431-b5b6-6320737c10cb" status: 204 len: 0 microversion: 2.1 time: 0.269034 Jun 20 12:10:49.587255 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1532/2991] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:49 2022] DELETE /compute/v2.1/images/2eb351c3-ad27-4431-b5b6-6320737c10cb => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:10:49.593323 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b643da41-f78a-44ce-b005-a9138b38a07b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:49.593973 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b643da41-f78a-44ce-b005-a9138b38a07b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:49.617251 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b643da41-f78a-44ce-b005-a9138b38a07b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:49.617251 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b643da41-f78a-44ce-b005-a9138b38a07b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:49.618541 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b643da41-f78a-44ce-b005-a9138b38a07b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:49.619111 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b643da41-f78a-44ce-b005-a9138b38a07b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:49.710521 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e83d1434-b492-4311-84e2-add297629fce tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:49.743288 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e83d1434-b492-4311-84e2-add297629fce tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1528 microversion: 2.1 time: 0.945274 Jun 20 12:10:49.746322 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1460/2992] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:48 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1528 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:49.762171 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0cbc8447-1240-4058-a22f-efb7382c3752 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:49.768981 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0cbc8447-1240-4058-a22f-efb7382c3752 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:49.797301 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cbc8447-1240-4058-a22f-efb7382c3752 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:49.798341 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cbc8447-1240-4058-a22f-efb7382c3752 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:49.799854 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cbc8447-1240-4058-a22f-efb7382c3752 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:49.800991 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cbc8447-1240-4058-a22f-efb7382c3752 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:49.926547 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b643da41-f78a-44ce-b005-a9138b38a07b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:49.947841 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b643da41-f78a-44ce-b005-a9138b38a07b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:49.957630 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b643da41-f78a-44ce-b005-a9138b38a07b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:49.959205 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b643da41-f78a-44ce-b005-a9138b38a07b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1875 microversion: 2.32 time: 0.370788 Jun 20 12:10:49.971296 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1533/2993] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:49 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1875 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:49.973008 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3e1fa4fd-2965-44b1-8f42-b6304f129ad4 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:49.973959 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3e1fa4fd-2965-44b1-8f42-b6304f129ad4 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:49.984661 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e1fa4fd-2965-44b1-8f42-b6304f129ad4 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:49.985269 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e1fa4fd-2965-44b1-8f42-b6304f129ad4 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:49.986159 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e1fa4fd-2965-44b1-8f42-b6304f129ad4 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:49.988431 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e1fa4fd-2965-44b1-8f42-b6304f129ad4 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:50.219442 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3e1fa4fd-2965-44b1-8f42-b6304f129ad4 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:50.229576 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3e1fa4fd-2965-44b1-8f42-b6304f129ad4 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1517 microversion: 2.1 time: 0.264209 Jun 20 12:10:50.240929 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1534/2994] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:49 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1517 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:50.250180 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-42134690-9a9e-4780-9936-b285ddeb55a9 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '.version_select at 0x7f6072bf6940>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:50.275727 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0cbc8447-1240-4058-a22f-efb7382c3752 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07f91cbf86a444fb06e050d4c4532fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c47b977a1334cd486385213ff23de86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:50.277939 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-42134690-9a9e-4780-9936-b285ddeb55a9 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] HTTP exception thrown: Image not found. Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-42134690-9a9e-4780-9936-b285ddeb55a9 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Request method failure captured: Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/images/2eb351c3-ad27-4431-b5b6-6320737c10cb HTTP/1.1 Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGN4qiwM-MecDHxONzVMkA72NR_SSrElKGFho2amrxg9uMlhFTBY3bq5CJPNlZORM2tW_nQRhsPIUTgettXi4lSiCQeK40e01rW_16Lzz4FJO6EC5uBs_A-i3_njR3_9I2L-oxsuaQd8HwAiDLKOUCEhiwyWJOA1WjMqhqu3KfOGLgY Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 4880e508de374c748670ce9ff5963336 Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4880e508de374c748670ce9ff5963336"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4880e508de374c748670ce9ff5963336"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4880e508de374c748670ce9ff5963336"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4880e508de374c748670ce9ff5963336"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 4880e508de374c748670ce9ff5963336 Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ImagesOneServerNegativeTestJSON-1288781692-project Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 16367ef663a74bd49162b82a7e661d1e Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692-project Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: exception: Image not found. Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '2eb351c3-ad27-4431-b5b6-6320737c10cb'} Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2eb351c3-ad27-4431-b5b6-6320737c10cb Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 20 12:10:50.280117 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2eb351c3-ad27-4431-b5b6-6320737c10cb could not be found. Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-42134690-9a9e-4780-9936-b285ddeb55a9 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Returning 404 to user: Image not found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-42134690-9a9e-4780-9936-b285ddeb55a9 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/images/2eb351c3-ad27-4431-b5b6-6320737c10cb" status: 404 len: 62 microversion: 2.1 time: 0.039856 Jun 20 12:10:50.285636 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1535/2995] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:10:50 2022] GET /compute/v2.1/images/2eb351c3-ad27-4431-b5b6-6320737c10cb => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:10:50.292422 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d480e91c-1039-4475-bf80-045980819788 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:50.292422 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d480e91c-1039-4475-bf80-045980819788 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:50.300925 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d480e91c-1039-4475-bf80-045980819788 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:50.301374 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d480e91c-1039-4475-bf80-045980819788 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:50.302172 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d480e91c-1039-4475-bf80-045980819788 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:50.306029 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0cbc8447-1240-4058-a22f-efb7382c3752 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 200 len: 1323 microversion: 2.1 time: 0.553331 Jun 20 12:10:50.313432 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d480e91c-1039-4475-bf80-045980819788 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:50.324071 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1461/2996] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:49 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 1323 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:50.328242 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-52b40ae2-1ca7-465e-900a-024fcd7fac28 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:50.328530 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-52b40ae2-1ca7-465e-900a-024fcd7fac28 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 7014bfb5-b083-485f-9711-b7cc95634c41] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:50.367978 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-52b40ae2-1ca7-465e-900a-024fcd7fac28 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:50.367978 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-52b40ae2-1ca7-465e-900a-024fcd7fac28 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:50.367978 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-52b40ae2-1ca7-465e-900a-024fcd7fac28 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:50.367978 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-52b40ae2-1ca7-465e-900a-024fcd7fac28 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:50.575387 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d480e91c-1039-4475-bf80-045980819788 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:50.585543 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d480e91c-1039-4475-bf80-045980819788 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1477 microversion: 2.1 time: 0.302049 Jun 20 12:10:50.586375 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1536/2997] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:50 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1477 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:50.591042 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8de5100f-b89d-4377-8c2e-f08865bde5ec tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:50.591846 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8de5100f-b89d-4377-8c2e-f08865bde5ec tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:50.598333 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:50.600899 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8de5100f-b89d-4377-8c2e-f08865bde5ec tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:50.601953 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8de5100f-b89d-4377-8c2e-f08865bde5ec tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:50.603177 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8de5100f-b89d-4377-8c2e-f08865bde5ec tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:50.603833 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8de5100f-b89d-4377-8c2e-f08865bde5ec tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:50.775342 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8de5100f-b89d-4377-8c2e-f08865bde5ec tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:50.785928 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8de5100f-b89d-4377-8c2e-f08865bde5ec tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:50.791233 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8de5100f-b89d-4377-8c2e-f08865bde5ec tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:50.807610 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8de5100f-b89d-4377-8c2e-f08865bde5ec tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1447 microversion: 2.75 time: 0.219923 Jun 20 12:10:50.810338 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1537/2998] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:50 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1447 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:50.815439 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-efffc0b6-c274-430d-95d5-324f0c065c88 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:50.821095 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-efffc0b6-c274-430d-95d5-324f0c065c88 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:50.831844 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-efffc0b6-c274-430d-95d5-324f0c065c88 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:50.832646 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-efffc0b6-c274-430d-95d5-324f0c065c88 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:50.833724 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-efffc0b6-c274-430d-95d5-324f0c065c88 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:50.835170 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-efffc0b6-c274-430d-95d5-324f0c065c88 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:50.870249 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-52b40ae2-1ca7-465e-900a-024fcd7fac28 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:50.880065 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-52b40ae2-1ca7-465e-900a-024fcd7fac28 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41" status: 200 len: 1533 microversion: 2.1 time: 0.563166 Jun 20 12:10:50.880898 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1462/2999] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:50 2022] GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41 => generated 1533 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:50.979315 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-51023d31-e284-4df9-b81b-5e034c5d2e96 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:50.980901 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-51023d31-e284-4df9-b81b-5e034c5d2e96 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:50.993401 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-51023d31-e284-4df9-b81b-5e034c5d2e96 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:50.994215 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-51023d31-e284-4df9-b81b-5e034c5d2e96 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:50.995247 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-51023d31-e284-4df9-b81b-5e034c5d2e96 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:51.001235 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-51023d31-e284-4df9-b81b-5e034c5d2e96 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:51.087613 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-efffc0b6-c274-430d-95d5-324f0c065c88 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:51.104593 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-efffc0b6-c274-430d-95d5-324f0c065c88 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1528 microversion: 2.1 time: 0.292832 Jun 20 12:10:51.107224 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1538/3000] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:50 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1528 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:51.247646 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4fb08b68-2b7b-4e83-b426-93f4916a9389 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:51.249335 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4fb08b68-2b7b-4e83-b426-93f4916a9389 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:51.260401 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4fb08b68-2b7b-4e83-b426-93f4916a9389 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:51.261426 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4fb08b68-2b7b-4e83-b426-93f4916a9389 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:51.262704 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4fb08b68-2b7b-4e83-b426-93f4916a9389 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:51.264824 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4fb08b68-2b7b-4e83-b426-93f4916a9389 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:51.484993 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-51023d31-e284-4df9-b81b-5e034c5d2e96 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:51.497353 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-51023d31-e284-4df9-b81b-5e034c5d2e96 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:51.499631 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-51023d31-e284-4df9-b81b-5e034c5d2e96 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:51.502430 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-51023d31-e284-4df9-b81b-5e034c5d2e96 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1875 microversion: 2.32 time: 0.527070 Jun 20 12:10:51.503693 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4fb08b68-2b7b-4e83-b426-93f4916a9389 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:51.504101 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1463/3001] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:50 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1875 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:51.509475 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ebeb6780-3780-4944-8bcc-9dcfd3757d13 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:51.510689 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ebeb6780-3780-4944-8bcc-9dcfd3757d13 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:51.518519 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ebeb6780-3780-4944-8bcc-9dcfd3757d13 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:51.519822 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ebeb6780-3780-4944-8bcc-9dcfd3757d13 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:51.521291 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ebeb6780-3780-4944-8bcc-9dcfd3757d13 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:51.522176 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ebeb6780-3780-4944-8bcc-9dcfd3757d13 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:51.522544 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4fb08b68-2b7b-4e83-b426-93f4916a9389 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1517 microversion: 2.1 time: 0.279274 Jun 20 12:10:51.532469 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1539/3002] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:51 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1517 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:10:51.607713 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b9a76f25-5767-450f-a441-36a8128aa100 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:51.609998 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b9a76f25-5767-450f-a441-36a8128aa100 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:51.637505 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b9a76f25-5767-450f-a441-36a8128aa100 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:51.639434 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b9a76f25-5767-450f-a441-36a8128aa100 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:51.644267 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b9a76f25-5767-450f-a441-36a8128aa100 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:51.645853 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b9a76f25-5767-450f-a441-36a8128aa100 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:51.837134 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ebeb6780-3780-4944-8bcc-9dcfd3757d13 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07f91cbf86a444fb06e050d4c4532fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c47b977a1334cd486385213ff23de86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:51.853548 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ebeb6780-3780-4944-8bcc-9dcfd3757d13 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 200 len: 1323 microversion: 2.1 time: 0.347799 Jun 20 12:10:51.854445 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1464/3003] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:51 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 1323 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:51.868006 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-04a44b78-e55d-468b-9f7d-a3f585907379 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:51.869976 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-04a44b78-e55d-468b-9f7d-a3f585907379 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:51.884663 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-04a44b78-e55d-468b-9f7d-a3f585907379 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:51.885327 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-04a44b78-e55d-468b-9f7d-a3f585907379 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:51.888460 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-04a44b78-e55d-468b-9f7d-a3f585907379 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:51.893211 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-04a44b78-e55d-468b-9f7d-a3f585907379 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:51.939436 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b9a76f25-5767-450f-a441-36a8128aa100 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:51.971341 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b9a76f25-5767-450f-a441-36a8128aa100 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1477 microversion: 2.1 time: 0.367959 Jun 20 12:10:51.983517 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1540/3004] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:51 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1477 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:51.989624 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3b6c431a-5423-43ad-8eb1-887fd53ec63d tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:51.990824 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3b6c431a-5423-43ad-8eb1-887fd53ec63d tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 7014bfb5-b083-485f-9711-b7cc95634c41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:52.014718 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3b6c431a-5423-43ad-8eb1-887fd53ec63d tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:52.015611 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3b6c431a-5423-43ad-8eb1-887fd53ec63d tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:52.018412 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3b6c431a-5423-43ad-8eb1-887fd53ec63d tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:52.020618 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3b6c431a-5423-43ad-8eb1-887fd53ec63d tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:52.162200 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-04a44b78-e55d-468b-9f7d-a3f585907379 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:52.164545 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:52.187393 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-04a44b78-e55d-468b-9f7d-a3f585907379 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:52.189285 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-04a44b78-e55d-468b-9f7d-a3f585907379 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:52.195435 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-04a44b78-e55d-468b-9f7d-a3f585907379 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1447 microversion: 2.75 time: 0.337854 Jun 20 12:10:52.208585 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1465/3005] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:51 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1447 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:52.213779 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-8eec4c06-dc41-45e9-ae0d-c1ae8201778b req-f5c0859b-53f8-45a2-bb51-a9607b928cfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3163bfa2-d7b5-451e-ae0c-cc2ec445c532", "tag": "eb877463-7d93-4069-944d-8674a91f4b80"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:10:52.227901 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-8eec4c06-dc41-45e9-ae0d-c1ae8201778b req-f5c0859b-53f8-45a2-bb51-a9607b928cfa service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:52.228696 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-8eec4c06-dc41-45e9-ae0d-c1ae8201778b req-f5c0859b-53f8-45a2-bb51-a9607b928cfa service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:52.254821 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-8eec4c06-dc41-45e9-ae0d-c1ae8201778b req-f5c0859b-53f8-45a2-bb51-a9607b928cfa service nova] Creating event network-changed:eb877463-7d93-4069-944d-8674a91f4b80 for instance 3163bfa2-d7b5-451e-ae0c-cc2ec445c532 on n-h1-master-1 Jun 20 12:10:52.267933 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-8eec4c06-dc41-45e9-ae0d-c1ae8201778b req-f5c0859b-53f8-45a2-bb51-a9607b928cfa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057482 Jun 20 12:10:52.273499 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1466/3006] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:10:52.279962 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-53c35ef6-6713-4a87-81f4-1e33f68bd780 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:52.286693 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-53c35ef6-6713-4a87-81f4-1e33f68bd780 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:52.301472 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-53c35ef6-6713-4a87-81f4-1e33f68bd780 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:52.305931 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-53c35ef6-6713-4a87-81f4-1e33f68bd780 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:52.307298 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-53c35ef6-6713-4a87-81f4-1e33f68bd780 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:52.307980 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-53c35ef6-6713-4a87-81f4-1e33f68bd780 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:52.329579 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3b6c431a-5423-43ad-8eb1-887fd53ec63d tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:52.341516 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3b6c431a-5423-43ad-8eb1-887fd53ec63d tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41" status: 200 len: 1539 microversion: 2.1 time: 0.354148 Jun 20 12:10:52.346188 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1541/3007] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:51 2022] GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41 => generated 1539 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:52.522157 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b786d77c-cfde-4ed7-a1b2-76aa6755c9fa tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:52.522939 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b786d77c-cfde-4ed7-a1b2-76aa6755c9fa tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:52.538824 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-53c35ef6-6713-4a87-81f4-1e33f68bd780 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:52.539398 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b786d77c-cfde-4ed7-a1b2-76aa6755c9fa tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:52.540120 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b786d77c-cfde-4ed7-a1b2-76aa6755c9fa tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:52.541228 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b786d77c-cfde-4ed7-a1b2-76aa6755c9fa tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:52.541913 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b786d77c-cfde-4ed7-a1b2-76aa6755c9fa tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:52.551753 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-53c35ef6-6713-4a87-81f4-1e33f68bd780 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1528 microversion: 2.1 time: 0.276469 Jun 20 12:10:52.562211 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1467/3008] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:52 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1528 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:52.568079 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9eff71bf-f138-489a-9f04-808ef87f032a tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:52.568884 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9eff71bf-f138-489a-9f04-808ef87f032a tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:52.576133 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9eff71bf-f138-489a-9f04-808ef87f032a tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:52.586721 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9eff71bf-f138-489a-9f04-808ef87f032a tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:52.589754 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9eff71bf-f138-489a-9f04-808ef87f032a tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:52.593046 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9eff71bf-f138-489a-9f04-808ef87f032a tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:52.888588 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9eff71bf-f138-489a-9f04-808ef87f032a tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:52.909586 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9eff71bf-f138-489a-9f04-808ef87f032a tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1517 microversion: 2.1 time: 0.345697 Jun 20 12:10:52.911355 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1468/3009] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:52 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1517 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:52.917614 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2a5bfc80-de31-44cd-a761-293cb5493755 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:52.919055 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2a5bfc80-de31-44cd-a761-293cb5493755 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:52.928015 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a5bfc80-de31-44cd-a761-293cb5493755 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:52.928907 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a5bfc80-de31-44cd-a761-293cb5493755 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:52.929778 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a5bfc80-de31-44cd-a761-293cb5493755 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:52.930334 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a5bfc80-de31-44cd-a761-293cb5493755 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:53.007120 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b786d77c-cfde-4ed7-a1b2-76aa6755c9fa tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:53.024231 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b786d77c-cfde-4ed7-a1b2-76aa6755c9fa tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:53.025761 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b786d77c-cfde-4ed7-a1b2-76aa6755c9fa tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:53.041489 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b786d77c-cfde-4ed7-a1b2-76aa6755c9fa tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1875 microversion: 2.32 time: 0.509755 Jun 20 12:10:53.053384 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1542/3010] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:52 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1875 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:10:53.066137 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f0955e3f-a7ae-489a-9344-2affa10de44c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:53.067059 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f0955e3f-a7ae-489a-9344-2affa10de44c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:53.103022 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f0955e3f-a7ae-489a-9344-2affa10de44c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:53.122060 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f0955e3f-a7ae-489a-9344-2affa10de44c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:53.123194 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f0955e3f-a7ae-489a-9344-2affa10de44c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:53.123825 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f0955e3f-a7ae-489a-9344-2affa10de44c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:53.311694 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2a5bfc80-de31-44cd-a761-293cb5493755 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07f91cbf86a444fb06e050d4c4532fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c47b977a1334cd486385213ff23de86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:53.325784 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2a5bfc80-de31-44cd-a761-293cb5493755 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 200 len: 1323 microversion: 2.1 time: 0.412709 Jun 20 12:10:53.327814 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1469/3011] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:52 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 1323 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:53.339460 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-be2e6479-5cd3-4a18-b273-d87ada0d1b37 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:53.352606 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-be2e6479-5cd3-4a18-b273-d87ada0d1b37 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:53.366072 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-be2e6479-5cd3-4a18-b273-d87ada0d1b37 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:53.366847 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-be2e6479-5cd3-4a18-b273-d87ada0d1b37 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:53.368062 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-be2e6479-5cd3-4a18-b273-d87ada0d1b37 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:53.371148 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-be2e6479-5cd3-4a18-b273-d87ada0d1b37 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:53.394571 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f0955e3f-a7ae-489a-9344-2affa10de44c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:53.412246 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f0955e3f-a7ae-489a-9344-2affa10de44c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1477 microversion: 2.1 time: 0.357501 Jun 20 12:10:53.412839 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1543/3012] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:53 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1477 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:53.428747 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5e25fe49-6bec-4b2c-af0e-b005a55b5dda tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:53.431798 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5e25fe49-6bec-4b2c-af0e-b005a55b5dda tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 7014bfb5-b083-485f-9711-b7cc95634c41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:53.458360 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5e25fe49-6bec-4b2c-af0e-b005a55b5dda tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:53.459135 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5e25fe49-6bec-4b2c-af0e-b005a55b5dda tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:53.460807 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5e25fe49-6bec-4b2c-af0e-b005a55b5dda tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:53.461479 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5e25fe49-6bec-4b2c-af0e-b005a55b5dda tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:53.560317 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-be2e6479-5cd3-4a18-b273-d87ada0d1b37 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:53.570834 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-be2e6479-5cd3-4a18-b273-d87ada0d1b37 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:53.573597 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-be2e6479-5cd3-4a18-b273-d87ada0d1b37 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:53.580731 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-be2e6479-5cd3-4a18-b273-d87ada0d1b37 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1447 microversion: 2.75 time: 0.250213 Jun 20 12:10:53.582617 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1470/3013] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:53 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1447 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:53.588323 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-058362f5-0420-46c7-b578-7600dd5f70cd tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:53.589405 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-058362f5-0420-46c7-b578-7600dd5f70cd tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:53.598519 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-058362f5-0420-46c7-b578-7600dd5f70cd tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:53.599759 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-058362f5-0420-46c7-b578-7600dd5f70cd tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:53.601480 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-058362f5-0420-46c7-b578-7600dd5f70cd tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:53.602349 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-058362f5-0420-46c7-b578-7600dd5f70cd tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:53.729737 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5e25fe49-6bec-4b2c-af0e-b005a55b5dda tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:53.747417 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5e25fe49-6bec-4b2c-af0e-b005a55b5dda tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41" status: 200 len: 1539 microversion: 2.1 time: 0.329945 Jun 20 12:10:53.758013 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1544/3014] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:53 2022] GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41 => generated 1539 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:53.882176 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-058362f5-0420-46c7-b578-7600dd5f70cd tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:53.918712 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-058362f5-0420-46c7-b578-7600dd5f70cd tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1528 microversion: 2.1 time: 0.334194 Jun 20 12:10:53.919422 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1471/3015] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:53 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1528 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:53.936995 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9b4fc8e3-913f-44cd-9ba2-4df33394363b tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:53.938414 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9b4fc8e3-913f-44cd-9ba2-4df33394363b tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:53.959689 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b4fc8e3-913f-44cd-9ba2-4df33394363b tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:53.961772 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b4fc8e3-913f-44cd-9ba2-4df33394363b tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:53.968807 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b4fc8e3-913f-44cd-9ba2-4df33394363b tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:53.972907 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b4fc8e3-913f-44cd-9ba2-4df33394363b tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:54.062067 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3fa0a6df-5fc1-4dee-93d0-189d0ca6253b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:54.062827 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3fa0a6df-5fc1-4dee-93d0-189d0ca6253b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:54.075480 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3fa0a6df-5fc1-4dee-93d0-189d0ca6253b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:54.076046 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3fa0a6df-5fc1-4dee-93d0-189d0ca6253b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:54.076929 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3fa0a6df-5fc1-4dee-93d0-189d0ca6253b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:54.077734 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3fa0a6df-5fc1-4dee-93d0-189d0ca6253b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:54.268400 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9b4fc8e3-913f-44cd-9ba2-4df33394363b tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:54.283624 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9b4fc8e3-913f-44cd-9ba2-4df33394363b tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1517 microversion: 2.1 time: 0.352426 Jun 20 12:10:54.286196 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1545/3016] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:53 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1517 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:54.351348 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4cafceed-3e84-447e-9d1b-57c11c22e50b tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:54.351348 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4cafceed-3e84-447e-9d1b-57c11c22e50b tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:54.375661 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4cafceed-3e84-447e-9d1b-57c11c22e50b tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:54.382233 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4cafceed-3e84-447e-9d1b-57c11c22e50b tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:54.383496 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4cafceed-3e84-447e-9d1b-57c11c22e50b tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:54.385320 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4cafceed-3e84-447e-9d1b-57c11c22e50b tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:54.504178 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3fa0a6df-5fc1-4dee-93d0-189d0ca6253b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:54.514699 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3fa0a6df-5fc1-4dee-93d0-189d0ca6253b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:54.517640 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3fa0a6df-5fc1-4dee-93d0-189d0ca6253b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:54.519731 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3fa0a6df-5fc1-4dee-93d0-189d0ca6253b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1875 microversion: 2.32 time: 0.463064 Jun 20 12:10:54.520983 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1472/3017] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:54 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1875 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:10:54.740761 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4cafceed-3e84-447e-9d1b-57c11c22e50b tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07f91cbf86a444fb06e050d4c4532fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c47b977a1334cd486385213ff23de86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:54.759075 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4cafceed-3e84-447e-9d1b-57c11c22e50b tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 200 len: 1323 microversion: 2.1 time: 0.419258 Jun 20 12:10:54.771395 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1546/3018] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:54 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 1323 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:54.776751 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c096da69-6773-44d2-8926-2b87ae476652 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:54.783689 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c096da69-6773-44d2-8926-2b87ae476652 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:54.798812 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c096da69-6773-44d2-8926-2b87ae476652 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:54.799568 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c096da69-6773-44d2-8926-2b87ae476652 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:54.800739 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c096da69-6773-44d2-8926-2b87ae476652 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:54.804156 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c096da69-6773-44d2-8926-2b87ae476652 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:54.815063 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dd967790-fd9c-47d5-8474-9ddca89fac61 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:54.815870 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-dd967790-fd9c-47d5-8474-9ddca89fac61 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:54.831434 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dd967790-fd9c-47d5-8474-9ddca89fac61 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:54.831899 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dd967790-fd9c-47d5-8474-9ddca89fac61 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:54.834066 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dd967790-fd9c-47d5-8474-9ddca89fac61 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:54.834832 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dd967790-fd9c-47d5-8474-9ddca89fac61 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:55.058988 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c096da69-6773-44d2-8926-2b87ae476652 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:55.082210 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c096da69-6773-44d2-8926-2b87ae476652 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:55.092696 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c096da69-6773-44d2-8926-2b87ae476652 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:55.111378 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c096da69-6773-44d2-8926-2b87ae476652 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1447 microversion: 2.75 time: 0.338421 Jun 20 12:10:55.120280 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1547/3019] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:54 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1447 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:55.134897 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e0cda8cf-dbf1-4878-ab65-0cba5dbf7819 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:55.135717 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e0cda8cf-dbf1-4878-ab65-0cba5dbf7819 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 7014bfb5-b083-485f-9711-b7cc95634c41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:55.156277 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e0cda8cf-dbf1-4878-ab65-0cba5dbf7819 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:55.156815 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e0cda8cf-dbf1-4878-ab65-0cba5dbf7819 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:55.161365 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e0cda8cf-dbf1-4878-ab65-0cba5dbf7819 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:55.164949 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e0cda8cf-dbf1-4878-ab65-0cba5dbf7819 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:55.289214 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-dd967790-fd9c-47d5-8474-9ddca89fac61 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:55.311141 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dd967790-fd9c-47d5-8474-9ddca89fac61 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1476 microversion: 2.1 time: 0.788794 Jun 20 12:10:55.321217 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1473/3020] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:54 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1476 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:55.330329 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9a0092c7-e921-4ef3-bb5f-7756ca575e96 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:55.331373 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9a0092c7-e921-4ef3-bb5f-7756ca575e96 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:55.345070 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9a0092c7-e921-4ef3-bb5f-7756ca575e96 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:55.352150 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9a0092c7-e921-4ef3-bb5f-7756ca575e96 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:55.353621 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9a0092c7-e921-4ef3-bb5f-7756ca575e96 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:55.354254 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9a0092c7-e921-4ef3-bb5f-7756ca575e96 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:55.460748 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e0cda8cf-dbf1-4878-ab65-0cba5dbf7819 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:55.471206 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:55.477634 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e0cda8cf-dbf1-4878-ab65-0cba5dbf7819 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41" status: 200 len: 1539 microversion: 2.1 time: 0.363295 Jun 20 12:10:55.489477 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1548/3021] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:55 2022] GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41 => generated 1539 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:55.493844 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-2b07245b-3210-46cd-9fc5-8ae039fa96a5 req-907a8512-e552-4ed0-a37a-d8511c434eda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7014bfb5-b083-485f-9711-b7cc95634c41", "name": "network-vif-plugged", "status": "completed", "tag": "2b4ae774-61d2-4117-bf2a-8e8514f99147"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:10:55.507920 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-2b07245b-3210-46cd-9fc5-8ae039fa96a5 req-907a8512-e552-4ed0-a37a-d8511c434eda service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:55.508411 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-2b07245b-3210-46cd-9fc5-8ae039fa96a5 req-907a8512-e552-4ed0-a37a-d8511c434eda service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:55.512981 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:55.549543 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-2b07245b-3210-46cd-9fc5-8ae039fa96a5 req-907a8512-e552-4ed0-a37a-d8511c434eda service nova] Creating event network-vif-plugged:2b4ae774-61d2-4117-bf2a-8e8514f99147 for instance 7014bfb5-b083-485f-9711-b7cc95634c41 on n-h2-master-1 Jun 20 12:10:55.561471 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-2b07245b-3210-46cd-9fc5-8ae039fa96a5 req-907a8512-e552-4ed0-a37a-d8511c434eda service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080423 Jun 20 12:10:55.562433 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1549/3022] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:10:55.568006 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e453b994-303b-4821-98dd-008386a4ab2e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:55.574738 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e453b994-303b-4821-98dd-008386a4ab2e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:55.586260 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e453b994-303b-4821-98dd-008386a4ab2e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:55.586715 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e453b994-303b-4821-98dd-008386a4ab2e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:55.587917 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e453b994-303b-4821-98dd-008386a4ab2e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:55.596774 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e453b994-303b-4821-98dd-008386a4ab2e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:55.952674 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e453b994-303b-4821-98dd-008386a4ab2e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:55.960498 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e453b994-303b-4821-98dd-008386a4ab2e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1517 microversion: 2.1 time: 0.396777 Jun 20 12:10:55.963418 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1550/3023] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:55 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1517 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:55.970800 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ca08be34-a7cd-466a-b744-521f13f1a5d7 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:55.975858 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ca08be34-a7cd-466a-b744-521f13f1a5d7 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:55.991035 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ca08be34-a7cd-466a-b744-521f13f1a5d7 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:55.999268 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ca08be34-a7cd-466a-b744-521f13f1a5d7 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:56.002940 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ca08be34-a7cd-466a-b744-521f13f1a5d7 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:56.003630 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ca08be34-a7cd-466a-b744-521f13f1a5d7 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:56.039020 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9a0092c7-e921-4ef3-bb5f-7756ca575e96 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:56.049057 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9a0092c7-e921-4ef3-bb5f-7756ca575e96 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1528 microversion: 2.1 time: 0.725076 Jun 20 12:10:56.049669 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1474/3024] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:55 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1528 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:56.062759 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-e73e115a-88c6-440f-aaa4-ea2ca5a808b2 req-32895296-bad9-4674-addc-e57efb1c2cbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4404478d-26ca-49d1-a629-8cecf8b967a1", "name": "network-vif-unplugged", "status": "completed", "tag": "5dd43a26-552a-45c5-9e58-286e7499c6c8"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:10:56.090671 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e73e115a-88c6-440f-aaa4-ea2ca5a808b2 req-32895296-bad9-4674-addc-e57efb1c2cbd service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:56.095757 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e73e115a-88c6-440f-aaa4-ea2ca5a808b2 req-32895296-bad9-4674-addc-e57efb1c2cbd service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:56.147145 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-e73e115a-88c6-440f-aaa4-ea2ca5a808b2 req-32895296-bad9-4674-addc-e57efb1c2cbd service nova] Creating event network-vif-unplugged:5dd43a26-552a-45c5-9e58-286e7499c6c8 for instance 4404478d-26ca-49d1-a629-8cecf8b967a1 on n-h2-master-1 Jun 20 12:10:56.192320 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [req-e73e115a-88c6-440f-aaa4-ea2ca5a808b2 req-32895296-bad9-4674-addc-e57efb1c2cbd service nova] Instance 4404478d-26ca-49d1-a629-8cecf8b967a1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:10:56.262401 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-e73e115a-88c6-440f-aaa4-ea2ca5a808b2 req-32895296-bad9-4674-addc-e57efb1c2cbd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.206947 Jun 20 12:10:56.265266 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1475/3025] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:10:56.286501 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-02f83abe-fbc5-4c12-bb4b-339f50be4014 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:56.287218 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-02f83abe-fbc5-4c12-bb4b-339f50be4014 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:56.306725 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-02f83abe-fbc5-4c12-bb4b-339f50be4014 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:56.307334 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-02f83abe-fbc5-4c12-bb4b-339f50be4014 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:56.307956 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-02f83abe-fbc5-4c12-bb4b-339f50be4014 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:56.308614 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-02f83abe-fbc5-4c12-bb4b-339f50be4014 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:56.550326 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ca08be34-a7cd-466a-b744-521f13f1a5d7 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:56.569609 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ca08be34-a7cd-466a-b744-521f13f1a5d7 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:56.571281 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ca08be34-a7cd-466a-b744-521f13f1a5d7 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:56.572567 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ca08be34-a7cd-466a-b744-521f13f1a5d7 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1875 microversion: 2.32 time: 0.605478 Jun 20 12:10:56.576601 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1551/3026] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:55 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1875 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:56.585784 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3e9c980b-cf82-4573-b02d-14e20a7d5742 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:56.590751 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3e9c980b-cf82-4573-b02d-14e20a7d5742 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:56.599144 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=8 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:56.612676 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e9c980b-cf82-4573-b02d-14e20a7d5742 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:56.613919 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e9c980b-cf82-4573-b02d-14e20a7d5742 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:56.617674 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e9c980b-cf82-4573-b02d-14e20a7d5742 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:56.620578 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e9c980b-cf82-4573-b02d-14e20a7d5742 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:56.794789 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-02f83abe-fbc5-4c12-bb4b-339f50be4014 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07f91cbf86a444fb06e050d4c4532fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c47b977a1334cd486385213ff23de86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:56.812104 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-02f83abe-fbc5-4c12-bb4b-339f50be4014 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 200 len: 1323 microversion: 2.1 time: 0.544205 Jun 20 12:10:56.835000 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1476/3027] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:56 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 1323 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:56.851360 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-377fa206-def9-4eb9-a751-e5c5189a9d8f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:56.857302 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-377fa206-def9-4eb9-a751-e5c5189a9d8f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:56.864024 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3e9c980b-cf82-4573-b02d-14e20a7d5742 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:56.885654 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-377fa206-def9-4eb9-a751-e5c5189a9d8f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:56.888932 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-377fa206-def9-4eb9-a751-e5c5189a9d8f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:56.897251 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-377fa206-def9-4eb9-a751-e5c5189a9d8f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:56.898016 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-377fa206-def9-4eb9-a751-e5c5189a9d8f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:56.901640 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3e9c980b-cf82-4573-b02d-14e20a7d5742 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:56.905663 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3e9c980b-cf82-4573-b02d-14e20a7d5742 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:56.953922 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3e9c980b-cf82-4573-b02d-14e20a7d5742 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1447 microversion: 2.75 time: 0.374060 Jun 20 12:10:56.963632 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1552/3028] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:56 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1447 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:56.981038 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b6633ec9-e2e5-4199-9c33-9cfd99236692 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:56.982539 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b6633ec9-e2e5-4199-9c33-9cfd99236692 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 7014bfb5-b083-485f-9711-b7cc95634c41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:57.007724 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b6633ec9-e2e5-4199-9c33-9cfd99236692 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:57.008561 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b6633ec9-e2e5-4199-9c33-9cfd99236692 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:57.013810 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b6633ec9-e2e5-4199-9c33-9cfd99236692 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:57.016303 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b6633ec9-e2e5-4199-9c33-9cfd99236692 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:57.184523 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-377fa206-def9-4eb9-a751-e5c5189a9d8f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:57.198752 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-377fa206-def9-4eb9-a751-e5c5189a9d8f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1476 microversion: 2.1 time: 0.359292 Jun 20 12:10:57.201851 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1477/3029] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:56 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1476 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:57.212006 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-35d9342c-9077-4f29-ae92-b594ad9ece82 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:57.213039 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-35d9342c-9077-4f29-ae92-b594ad9ece82 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:57.222642 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-35d9342c-9077-4f29-ae92-b594ad9ece82 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:57.223128 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-35d9342c-9077-4f29-ae92-b594ad9ece82 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:57.224121 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-35d9342c-9077-4f29-ae92-b594ad9ece82 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:57.224754 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-35d9342c-9077-4f29-ae92-b594ad9ece82 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:57.514574 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-35d9342c-9077-4f29-ae92-b594ad9ece82 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:57.519688 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b6633ec9-e2e5-4199-9c33-9cfd99236692 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:57.528251 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-35d9342c-9077-4f29-ae92-b594ad9ece82 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1517 microversion: 2.1 time: 0.323529 Jun 20 12:10:57.528853 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1478/3030] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:57 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1517 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:57.538247 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b6633ec9-e2e5-4199-9c33-9cfd99236692 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41" status: 200 len: 1539 microversion: 2.1 time: 0.572813 Jun 20 12:10:57.547967 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-eba42826-1a40-4d7b-975f-2cb316c603f7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:57.548648 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1553/3031] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:56 2022] GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41 => generated 1539 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:57.553204 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-eba42826-1a40-4d7b-975f-2cb316c603f7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:57.570259 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eba42826-1a40-4d7b-975f-2cb316c603f7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:57.570910 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eba42826-1a40-4d7b-975f-2cb316c603f7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:57.572041 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eba42826-1a40-4d7b-975f-2cb316c603f7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:57.572596 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eba42826-1a40-4d7b-975f-2cb316c603f7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:57.598141 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-92ce4dd6-0882-44e5-b86a-16958db3d89a tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:57.599184 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-92ce4dd6-0882-44e5-b86a-16958db3d89a tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:57.614200 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-92ce4dd6-0882-44e5-b86a-16958db3d89a tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:57.616492 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-92ce4dd6-0882-44e5-b86a-16958db3d89a tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:57.618906 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-92ce4dd6-0882-44e5-b86a-16958db3d89a tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:57.619642 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-92ce4dd6-0882-44e5-b86a-16958db3d89a tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:57.880587 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-eba42826-1a40-4d7b-975f-2cb316c603f7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:57.897695 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-eba42826-1a40-4d7b-975f-2cb316c603f7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1528 microversion: 2.1 time: 0.362782 Jun 20 12:10:57.912393 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1479/3032] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:57 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1528 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:57.925987 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-14488c3e-0cb8-40d9-9b2b-6be1327623ac tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:57.926682 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-14488c3e-0cb8-40d9-9b2b-6be1327623ac tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:57.957300 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-14488c3e-0cb8-40d9-9b2b-6be1327623ac tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:57.958141 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-14488c3e-0cb8-40d9-9b2b-6be1327623ac tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:57.959134 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-14488c3e-0cb8-40d9-9b2b-6be1327623ac tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:57.959751 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-14488c3e-0cb8-40d9-9b2b-6be1327623ac tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:58.273542 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-14488c3e-0cb8-40d9-9b2b-6be1327623ac tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07f91cbf86a444fb06e050d4c4532fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c47b977a1334cd486385213ff23de86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:58.285372 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-14488c3e-0cb8-40d9-9b2b-6be1327623ac tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 200 len: 1323 microversion: 2.1 time: 0.371331 Jun 20 12:10:58.286535 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1480/3033] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:57 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 1323 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:58.295638 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-13978c4a-8208-4258-8194-bbc32b9ca6aa tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:58.296846 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-13978c4a-8208-4258-8194-bbc32b9ca6aa tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:58.320256 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13978c4a-8208-4258-8194-bbc32b9ca6aa tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:58.321512 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13978c4a-8208-4258-8194-bbc32b9ca6aa tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:58.322657 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13978c4a-8208-4258-8194-bbc32b9ca6aa tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:58.327788 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13978c4a-8208-4258-8194-bbc32b9ca6aa tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:58.344442 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-92ce4dd6-0882-44e5-b86a-16958db3d89a tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:58.356773 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-92ce4dd6-0882-44e5-b86a-16958db3d89a tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:58.358290 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-92ce4dd6-0882-44e5-b86a-16958db3d89a tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:58.369831 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-92ce4dd6-0882-44e5-b86a-16958db3d89a tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1875 microversion: 2.32 time: 0.776472 Jun 20 12:10:58.370785 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1554/3034] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:57 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1875 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:58.376073 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3a52cb88-b247-4d4f-b6d1-843a45f89455 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:58.389172 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3a52cb88-b247-4d4f-b6d1-843a45f89455 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:58.396888 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a52cb88-b247-4d4f-b6d1-843a45f89455 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:58.397594 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a52cb88-b247-4d4f-b6d1-843a45f89455 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:58.398581 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a52cb88-b247-4d4f-b6d1-843a45f89455 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:58.399235 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a52cb88-b247-4d4f-b6d1-843a45f89455 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:58.490930 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-13978c4a-8208-4258-8194-bbc32b9ca6aa tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:58.503549 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-13978c4a-8208-4258-8194-bbc32b9ca6aa tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:58.516301 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-13978c4a-8208-4258-8194-bbc32b9ca6aa tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:58.532592 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-13978c4a-8208-4258-8194-bbc32b9ca6aa tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1447 microversion: 2.75 time: 0.244378 Jun 20 12:10:58.533960 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1481/3035] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:58 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1447 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:58.539520 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-2a6bbbe7-7298-4381-ad9b-171233c744f0 req-1d926c4c-3083-4291-a3b5-aec83a5b0df5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4404478d-26ca-49d1-a629-8cecf8b967a1", "tag": "5dd43a26-552a-45c5-9e58-286e7499c6c8"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:10:58.568708 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-2a6bbbe7-7298-4381-ad9b-171233c744f0 req-1d926c4c-3083-4291-a3b5-aec83a5b0df5 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:58.569560 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-2a6bbbe7-7298-4381-ad9b-171233c744f0 req-1d926c4c-3083-4291-a3b5-aec83a5b0df5 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:58.583787 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-2a6bbbe7-7298-4381-ad9b-171233c744f0 req-1d926c4c-3083-4291-a3b5-aec83a5b0df5 service nova] Creating event network-changed:5dd43a26-552a-45c5-9e58-286e7499c6c8 for instance 4404478d-26ca-49d1-a629-8cecf8b967a1 on n-h2-master-1 Jun 20 12:10:58.590360 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [req-2a6bbbe7-7298-4381-ad9b-171233c744f0 req-1d926c4c-3083-4291-a3b5-aec83a5b0df5 service nova] Instance 4404478d-26ca-49d1-a629-8cecf8b967a1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:10:58.621999 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-2a6bbbe7-7298-4381-ad9b-171233c744f0 req-1d926c4c-3083-4291-a3b5-aec83a5b0df5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085473 Jun 20 12:10:58.623139 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1482/3036] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:10:58.644447 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d2adc702-364c-4220-b8d3-535d25161c47 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:58.654392 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d2adc702-364c-4220-b8d3-535d25161c47 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:58.666817 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d2adc702-364c-4220-b8d3-535d25161c47 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:58.667546 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d2adc702-364c-4220-b8d3-535d25161c47 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:58.669300 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d2adc702-364c-4220-b8d3-535d25161c47 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:58.670144 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d2adc702-364c-4220-b8d3-535d25161c47 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:58.747281 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3a52cb88-b247-4d4f-b6d1-843a45f89455 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:58.769975 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3a52cb88-b247-4d4f-b6d1-843a45f89455 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1476 microversion: 2.1 time: 0.397738 Jun 20 12:10:58.782758 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1555/3037] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:58 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1476 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:58.795350 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d9ddd580-53d3-4d16-b494-56a0364d5bab tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:58.796294 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d9ddd580-53d3-4d16-b494-56a0364d5bab tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 7014bfb5-b083-485f-9711-b7cc95634c41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:58.814960 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9ddd580-53d3-4d16-b494-56a0364d5bab tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:58.815822 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9ddd580-53d3-4d16-b494-56a0364d5bab tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:58.816845 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9ddd580-53d3-4d16-b494-56a0364d5bab tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:58.822621 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9ddd580-53d3-4d16-b494-56a0364d5bab tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:58.984059 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d2adc702-364c-4220-b8d3-535d25161c47 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:58.992342 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:58.994678 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d2adc702-364c-4220-b8d3-535d25161c47 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1517 microversion: 2.1 time: 0.370067 Jun 20 12:10:58.995286 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1483/3038] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:58 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1517 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:59.015032 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-64863ccc-9e36-4d79-82f6-cbdf4a51ca3d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:59.016288 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-64863ccc-9e36-4d79-82f6-cbdf4a51ca3d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:59.040749 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64863ccc-9e36-4d79-82f6-cbdf4a51ca3d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:59.041788 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64863ccc-9e36-4d79-82f6-cbdf4a51ca3d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:59.043509 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64863ccc-9e36-4d79-82f6-cbdf4a51ca3d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:59.046963 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64863ccc-9e36-4d79-82f6-cbdf4a51ca3d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:59.047438 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d9ddd580-53d3-4d16-b494-56a0364d5bab tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:59.058600 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d9ddd580-53d3-4d16-b494-56a0364d5bab tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41" status: 200 len: 1534 microversion: 2.1 time: 0.273857 Jun 20 12:10:59.060629 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1556/3039] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:58 2022] GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41 => generated 1534 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:59.255737 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-64863ccc-9e36-4d79-82f6-cbdf4a51ca3d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:59.270941 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-64863ccc-9e36-4d79-82f6-cbdf4a51ca3d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1528 microversion: 2.1 time: 0.274562 Jun 20 12:10:59.278650 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1484/3040] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:58 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1528 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:59.305088 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c511ad14-da7a-4f40-8d30-857557d1689a tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:59.306039 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c511ad14-da7a-4f40-8d30-857557d1689a tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:59.316307 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c511ad14-da7a-4f40-8d30-857557d1689a tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:59.317157 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c511ad14-da7a-4f40-8d30-857557d1689a tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:59.318512 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c511ad14-da7a-4f40-8d30-857557d1689a tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:59.319548 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c511ad14-da7a-4f40-8d30-857557d1689a tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:59.392151 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7e2a7eaf-a5f9-48f4-9b94-c72fafb17c4e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:59.393531 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7e2a7eaf-a5f9-48f4-9b94-c72fafb17c4e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:59.401672 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:10:59.403914 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7e2a7eaf-a5f9-48f4-9b94-c72fafb17c4e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:59.404798 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7e2a7eaf-a5f9-48f4-9b94-c72fafb17c4e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:59.405887 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7e2a7eaf-a5f9-48f4-9b94-c72fafb17c4e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:59.406697 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7e2a7eaf-a5f9-48f4-9b94-c72fafb17c4e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:59.637593 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c511ad14-da7a-4f40-8d30-857557d1689a tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07f91cbf86a444fb06e050d4c4532fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c47b977a1334cd486385213ff23de86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:59.648726 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c511ad14-da7a-4f40-8d30-857557d1689a tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 200 len: 1323 microversion: 2.1 time: 0.348387 Jun 20 12:10:59.660075 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1557/3041] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:59 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 1323 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:10:59.666031 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d2c3a9df-4893-4aa0-85d6-11420aac26b6 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:59.667745 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d2c3a9df-4893-4aa0-85d6-11420aac26b6 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:59.675407 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d2c3a9df-4893-4aa0-85d6-11420aac26b6 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:59.676844 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d2c3a9df-4893-4aa0-85d6-11420aac26b6 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:59.677871 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d2c3a9df-4893-4aa0-85d6-11420aac26b6 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:59.678486 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d2c3a9df-4893-4aa0-85d6-11420aac26b6 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:59.742771 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7e2a7eaf-a5f9-48f4-9b94-c72fafb17c4e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:59.761223 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7e2a7eaf-a5f9-48f4-9b94-c72fafb17c4e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:59.764057 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7e2a7eaf-a5f9-48f4-9b94-c72fafb17c4e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:59.765954 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7e2a7eaf-a5f9-48f4-9b94-c72fafb17c4e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1875 microversion: 2.32 time: 0.378593 Jun 20 12:10:59.767545 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1485/3042] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:59 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1875 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:10:59.788194 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-126ae14a-b2f3-4bcb-9973-bb0c4ec0c84a req-47e96640-399d-45b7-a7d0-9f93552aa4d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3163bfa2-d7b5-451e-ae0c-cc2ec445c532", "name": "network-vif-plugged", "status": "completed", "tag": "eb877463-7d93-4069-944d-8674a91f4b80"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:10:59.788729 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d2c3a9df-4893-4aa0-85d6-11420aac26b6 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:59.800152 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d2c3a9df-4893-4aa0-85d6-11420aac26b6 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:59.801775 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d2c3a9df-4893-4aa0-85d6-11420aac26b6 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:10:59.807450 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-126ae14a-b2f3-4bcb-9973-bb0c4ec0c84a req-47e96640-399d-45b7-a7d0-9f93552aa4d7 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:59.808530 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d2c3a9df-4893-4aa0-85d6-11420aac26b6 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1447 microversion: 2.75 time: 0.146766 Jun 20 12:10:59.809073 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-126ae14a-b2f3-4bcb-9973-bb0c4ec0c84a req-47e96640-399d-45b7-a7d0-9f93552aa4d7 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:59.819095 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1558/3043] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:10:59 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1447 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:10:59.836156 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-126ae14a-b2f3-4bcb-9973-bb0c4ec0c84a req-47e96640-399d-45b7-a7d0-9f93552aa4d7 service nova] Creating event network-vif-plugged:eb877463-7d93-4069-944d-8674a91f4b80 for instance 3163bfa2-d7b5-451e-ae0c-cc2ec445c532 on n-h1-master-1 Jun 20 12:10:59.851629 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-01286144-02aa-439f-a802-195a25524e10 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:10:59.852332 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-01286144-02aa-439f-a802-195a25524e10 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:10:59.870096 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-126ae14a-b2f3-4bcb-9973-bb0c4ec0c84a req-47e96640-399d-45b7-a7d0-9f93552aa4d7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099725 Jun 20 12:10:59.873170 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01286144-02aa-439f-a802-195a25524e10 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:59.873646 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01286144-02aa-439f-a802-195a25524e10 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:10:59.873939 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1486/3044] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:10:59.874453 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01286144-02aa-439f-a802-195a25524e10 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:10:59.874893 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01286144-02aa-439f-a802-195a25524e10 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:00.077230 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2acf470b-af6f-4197-96af-efab6c73098d tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:00.078525 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2acf470b-af6f-4197-96af-efab6c73098d tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:00.113584 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2acf470b-af6f-4197-96af-efab6c73098d tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:00.116636 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2acf470b-af6f-4197-96af-efab6c73098d tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:00.120221 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2acf470b-af6f-4197-96af-efab6c73098d tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:00.123415 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2acf470b-af6f-4197-96af-efab6c73098d tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:00.303157 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-01286144-02aa-439f-a802-195a25524e10 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:00.312717 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-01286144-02aa-439f-a802-195a25524e10 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1474 microversion: 2.1 time: 0.491159 Jun 20 12:11:00.324054 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1559/3045] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:10:59 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1474 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:00.332711 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7e5aa022-9b06-4905-8fd4-0f34385417a8 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:00.333685 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7e5aa022-9b06-4905-8fd4-0f34385417a8 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 7014bfb5-b083-485f-9711-b7cc95634c41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:00.341216 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7e5aa022-9b06-4905-8fd4-0f34385417a8 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:00.341961 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7e5aa022-9b06-4905-8fd4-0f34385417a8 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:00.342780 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7e5aa022-9b06-4905-8fd4-0f34385417a8 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:00.343272 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7e5aa022-9b06-4905-8fd4-0f34385417a8 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:00.520133 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2acf470b-af6f-4197-96af-efab6c73098d tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:00.536843 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2acf470b-af6f-4197-96af-efab6c73098d tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1517 microversion: 2.1 time: 0.522456 Jun 20 12:11:00.538294 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1487/3046] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:00 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1517 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:00.552772 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-23f8af17-c2bf-44f1-ac6a-86034a53c16a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:00.554560 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-23f8af17-c2bf-44f1-ac6a-86034a53c16a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:00.566332 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23f8af17-c2bf-44f1-ac6a-86034a53c16a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:00.567994 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23f8af17-c2bf-44f1-ac6a-86034a53c16a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:00.569678 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23f8af17-c2bf-44f1-ac6a-86034a53c16a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:00.570330 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23f8af17-c2bf-44f1-ac6a-86034a53c16a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:00.605930 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7e5aa022-9b06-4905-8fd4-0f34385417a8 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:00.617414 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7e5aa022-9b06-4905-8fd4-0f34385417a8 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41" status: 200 len: 1534 microversion: 2.1 time: 0.291763 Jun 20 12:11:00.627792 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1560/3047] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:00 2022] GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41 => generated 1534 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:00.667886 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-161354b5-b327-4969-933e-1bb5bfba733c tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:00.668730 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-161354b5-b327-4969-933e-1bb5bfba733c tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:00.676898 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-161354b5-b327-4969-933e-1bb5bfba733c tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:00.677256 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-161354b5-b327-4969-933e-1bb5bfba733c tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:00.678051 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-161354b5-b327-4969-933e-1bb5bfba733c tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:00.681806 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-161354b5-b327-4969-933e-1bb5bfba733c tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:00.851843 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-23f8af17-c2bf-44f1-ac6a-86034a53c16a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:00.864757 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-23f8af17-c2bf-44f1-ac6a-86034a53c16a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1528 microversion: 2.1 time: 0.324108 Jun 20 12:11:00.873448 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-161354b5-b327-4969-933e-1bb5bfba733c tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07f91cbf86a444fb06e050d4c4532fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c47b977a1334cd486385213ff23de86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:00.875417 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1488/3048] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:00 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1528 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:00.881305 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-88ea23f4-1725-43d8-96f9-278c5ea5fb5b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:00.882051 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-88ea23f4-1725-43d8-96f9-278c5ea5fb5b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:00.886520 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-161354b5-b327-4969-933e-1bb5bfba733c tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 200 len: 1323 microversion: 2.1 time: 0.223070 Jun 20 12:11:00.887844 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1561/3049] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:00 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 1323 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:11:00.893671 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dd59a712-b8c4-40e1-a9ea-087cc77ecc63 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:00.894308 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dd59a712-b8c4-40e1-a9ea-087cc77ecc63 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:00.904251 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd59a712-b8c4-40e1-a9ea-087cc77ecc63 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:00.904251 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd59a712-b8c4-40e1-a9ea-087cc77ecc63 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:00.904251 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd59a712-b8c4-40e1-a9ea-087cc77ecc63 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:00.904251 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd59a712-b8c4-40e1-a9ea-087cc77ecc63 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:00.908555 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88ea23f4-1725-43d8-96f9-278c5ea5fb5b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:00.909225 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88ea23f4-1725-43d8-96f9-278c5ea5fb5b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:00.910101 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88ea23f4-1725-43d8-96f9-278c5ea5fb5b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:00.910540 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88ea23f4-1725-43d8-96f9-278c5ea5fb5b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:00.978067 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dd59a712-b8c4-40e1-a9ea-087cc77ecc63 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:00.989015 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dd59a712-b8c4-40e1-a9ea-087cc77ecc63 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:00.990568 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dd59a712-b8c4-40e1-a9ea-087cc77ecc63 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:01.006421 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dd59a712-b8c4-40e1-a9ea-087cc77ecc63 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1447 microversion: 2.75 time: 0.116943 Jun 20 12:11:01.007138 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1562/3050] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:00 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1447 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:01.206202 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-88ea23f4-1725-43d8-96f9-278c5ea5fb5b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:01.217591 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-88ea23f4-1725-43d8-96f9-278c5ea5fb5b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:01.219750 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-88ea23f4-1725-43d8-96f9-278c5ea5fb5b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:01.221372 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-88ea23f4-1725-43d8-96f9-278c5ea5fb5b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1875 microversion: 2.32 time: 0.344733 Jun 20 12:11:01.222067 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1489/3051] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:00 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1875 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:01.333476 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a5acec45-28fd-4622-abcf-5ab87a5cc525 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:01.334395 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a5acec45-28fd-4622-abcf-5ab87a5cc525 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:01.342013 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5acec45-28fd-4622-abcf-5ab87a5cc525 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:01.342473 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5acec45-28fd-4622-abcf-5ab87a5cc525 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:01.343590 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5acec45-28fd-4622-abcf-5ab87a5cc525 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:01.343974 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5acec45-28fd-4622-abcf-5ab87a5cc525 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:01.534274 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a5acec45-28fd-4622-abcf-5ab87a5cc525 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:01.551336 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a5acec45-28fd-4622-abcf-5ab87a5cc525 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1474 microversion: 2.1 time: 0.221197 Jun 20 12:11:01.557310 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b044f8a4-e3fc-4fe5-ad0a-e390529f5988 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:01.558174 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b044f8a4-e3fc-4fe5-ad0a-e390529f5988 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:01.563340 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1563/3052] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:01 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1474 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:01.566213 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b044f8a4-e3fc-4fe5-ad0a-e390529f5988 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:01.566674 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b044f8a4-e3fc-4fe5-ad0a-e390529f5988 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:01.567466 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b044f8a4-e3fc-4fe5-ad0a-e390529f5988 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:01.567903 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b044f8a4-e3fc-4fe5-ad0a-e390529f5988 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:01.635807 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e43fd72b-a96f-46eb-954c-1b17626b4663 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:01.637249 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e43fd72b-a96f-46eb-954c-1b17626b4663 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 7014bfb5-b083-485f-9711-b7cc95634c41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:01.647125 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e43fd72b-a96f-46eb-954c-1b17626b4663 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:01.647913 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e43fd72b-a96f-46eb-954c-1b17626b4663 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:01.649561 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e43fd72b-a96f-46eb-954c-1b17626b4663 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:01.650225 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e43fd72b-a96f-46eb-954c-1b17626b4663 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:01.745712 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b044f8a4-e3fc-4fe5-ad0a-e390529f5988 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:01.774166 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b044f8a4-e3fc-4fe5-ad0a-e390529f5988 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1517 microversion: 2.1 time: 0.221949 Jun 20 12:11:01.784590 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1490/3053] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:01 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1517 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:01.883574 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-39c51272-aabe-42d5-b3f8-964ce0482030 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:01.884411 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-39c51272-aabe-42d5-b3f8-964ce0482030 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:01.891327 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-39c51272-aabe-42d5-b3f8-964ce0482030 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:01.891758 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-39c51272-aabe-42d5-b3f8-964ce0482030 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:01.892627 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-39c51272-aabe-42d5-b3f8-964ce0482030 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:01.893120 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-39c51272-aabe-42d5-b3f8-964ce0482030 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:02.103318 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e43fd72b-a96f-46eb-954c-1b17626b4663 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:02.113200 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e43fd72b-a96f-46eb-954c-1b17626b4663 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41" status: 200 len: 1534 microversion: 2.1 time: 0.481896 Jun 20 12:11:02.114131 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1564/3054] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:01 2022] GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41 => generated 1534 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:02.118980 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-39c51272-aabe-42d5-b3f8-964ce0482030 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:02.119268 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b8fc2c9e-b87f-418d-a746-fff07b502dda tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:02.120166 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b8fc2c9e-b87f-418d-a746-fff07b502dda tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:02.128094 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b8fc2c9e-b87f-418d-a746-fff07b502dda tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:02.128973 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b8fc2c9e-b87f-418d-a746-fff07b502dda tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:02.130011 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b8fc2c9e-b87f-418d-a746-fff07b502dda tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:02.130609 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b8fc2c9e-b87f-418d-a746-fff07b502dda tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:02.131419 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-39c51272-aabe-42d5-b3f8-964ce0482030 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1528 microversion: 2.1 time: 0.252127 Jun 20 12:11:02.137106 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1491/3055] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:01 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1528 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:02.151650 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-93ac3cbc-e0f6-488b-bc47-e554371b062a tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:02.152306 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-93ac3cbc-e0f6-488b-bc47-e554371b062a tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:02.163167 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-93ac3cbc-e0f6-488b-bc47-e554371b062a tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:02.167610 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-93ac3cbc-e0f6-488b-bc47-e554371b062a tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:02.168909 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-93ac3cbc-e0f6-488b-bc47-e554371b062a tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:02.171156 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-93ac3cbc-e0f6-488b-bc47-e554371b062a tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:02.301526 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-93ac3cbc-e0f6-488b-bc47-e554371b062a tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:02.316039 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-93ac3cbc-e0f6-488b-bc47-e554371b062a tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:02.321681 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-93ac3cbc-e0f6-488b-bc47-e554371b062a tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:02.338049 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-93ac3cbc-e0f6-488b-bc47-e554371b062a tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1447 microversion: 2.75 time: 0.190611 Jun 20 12:11:02.354389 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1492/3056] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:02 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1447 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:02.362012 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-79baa556-f11a-4d55-bf83-6be328896c44 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:02.363000 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-79baa556-f11a-4d55-bf83-6be328896c44 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:02.369660 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b8fc2c9e-b87f-418d-a746-fff07b502dda tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07f91cbf86a444fb06e050d4c4532fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c47b977a1334cd486385213ff23de86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:02.375507 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-79baa556-f11a-4d55-bf83-6be328896c44 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:02.376590 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-79baa556-f11a-4d55-bf83-6be328896c44 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:02.378176 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-79baa556-f11a-4d55-bf83-6be328896c44 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:02.379666 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b8fc2c9e-b87f-418d-a746-fff07b502dda tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 200 len: 1519 microversion: 2.1 time: 0.264320 Jun 20 12:11:02.380097 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-79baa556-f11a-4d55-bf83-6be328896c44 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:02.380716 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1565/3057] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:02 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 1519 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:02.401807 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-71274685-3c47-4bc6-9390-670df73dfc94 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:02.403300 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-71274685-3c47-4bc6-9390-670df73dfc94 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:02.415544 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-71274685-3c47-4bc6-9390-670df73dfc94 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:02.420959 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-71274685-3c47-4bc6-9390-670df73dfc94 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:02.422111 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-71274685-3c47-4bc6-9390-670df73dfc94 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:02.423135 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-71274685-3c47-4bc6-9390-670df73dfc94 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:02.464155 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:11:02.470566 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-71274685-3c47-4bc6-9390-670df73dfc94 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lazy-loading 'flavor' on Instance uuid 3163bfa2-d7b5-451e-ae0c-cc2ec445c532 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:11:02.627718 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-71274685-3c47-4bc6-9390-670df73dfc94 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "POST /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532/action" status: 200 len: 32 microversion: 2.1 time: 0.229984 Jun 20 12:11:02.633880 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1566/3058] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:11:02 2022] POST /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532/action => generated 32 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:11:02.640300 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-72e57ecb-40d3-4695-a844-323a27f5768d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:02.641537 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-72e57ecb-40d3-4695-a844-323a27f5768d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:02.660836 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-72e57ecb-40d3-4695-a844-323a27f5768d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:02.661640 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-72e57ecb-40d3-4695-a844-323a27f5768d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:02.664675 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-72e57ecb-40d3-4695-a844-323a27f5768d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:02.665877 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-72e57ecb-40d3-4695-a844-323a27f5768d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:02.696950 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-79baa556-f11a-4d55-bf83-6be328896c44 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:02.717057 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-79baa556-f11a-4d55-bf83-6be328896c44 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:02.720485 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-79baa556-f11a-4d55-bf83-6be328896c44 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:02.721874 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-79baa556-f11a-4d55-bf83-6be328896c44 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1875 microversion: 2.32 time: 0.365491 Jun 20 12:11:02.728587 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1493/3059] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:02 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1875 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:02.747095 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9e5ff1da-c713-44b7-9fd7-6931df47ba86 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:02.749504 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9e5ff1da-c713-44b7-9fd7-6931df47ba86 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:02.769539 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9e5ff1da-c713-44b7-9fd7-6931df47ba86 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:02.771486 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9e5ff1da-c713-44b7-9fd7-6931df47ba86 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:02.776028 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9e5ff1da-c713-44b7-9fd7-6931df47ba86 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:02.778545 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9e5ff1da-c713-44b7-9fd7-6931df47ba86 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:03.180521 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-72e57ecb-40d3-4695-a844-323a27f5768d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:03.195672 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9e5ff1da-c713-44b7-9fd7-6931df47ba86 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07f91cbf86a444fb06e050d4c4532fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c47b977a1334cd486385213ff23de86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:03.199480 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-72e57ecb-40d3-4695-a844-323a27f5768d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1474 microversion: 2.1 time: 0.566676 Jun 20 12:11:03.224570 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1567/3060] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:02 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1474 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:03.225771 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9e5ff1da-c713-44b7-9fd7-6931df47ba86 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 200 len: 1525 microversion: 2.1 time: 0.492147 Jun 20 12:11:03.233547 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1494/3061] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:02 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 1525 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:03.239997 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-461bcbdd-52f5-4566-b60e-9aa6b2444375 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:03.242299 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-461bcbdd-52f5-4566-b60e-9aa6b2444375 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:03.250986 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3911f7f2-645c-4d50-a529-340399c9902c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:03.251698 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3911f7f2-645c-4d50-a529-340399c9902c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 7014bfb5-b083-485f-9711-b7cc95634c41] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:03.255986 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-461bcbdd-52f5-4566-b60e-9aa6b2444375 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:03.256472 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-461bcbdd-52f5-4566-b60e-9aa6b2444375 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:03.258415 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-461bcbdd-52f5-4566-b60e-9aa6b2444375 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:03.258415 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-461bcbdd-52f5-4566-b60e-9aa6b2444375 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:03.268144 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3911f7f2-645c-4d50-a529-340399c9902c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:03.271202 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3911f7f2-645c-4d50-a529-340399c9902c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:03.272055 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3911f7f2-645c-4d50-a529-340399c9902c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:03.272575 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3911f7f2-645c-4d50-a529-340399c9902c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:03.523183 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-461bcbdd-52f5-4566-b60e-9aa6b2444375 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:03.534214 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-461bcbdd-52f5-4566-b60e-9aa6b2444375 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1517 microversion: 2.1 time: 0.308114 Jun 20 12:11:03.534653 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1568/3062] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:03 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1517 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:03.555685 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d4463472-2d3c-4206-b23a-73e89f93d5db tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:03.557657 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d4463472-2d3c-4206-b23a-73e89f93d5db tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:03.570640 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d4463472-2d3c-4206-b23a-73e89f93d5db tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:03.571108 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d4463472-2d3c-4206-b23a-73e89f93d5db tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:03.571935 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d4463472-2d3c-4206-b23a-73e89f93d5db tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:03.572426 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d4463472-2d3c-4206-b23a-73e89f93d5db tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:03.641989 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3911f7f2-645c-4d50-a529-340399c9902c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:03.656347 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3911f7f2-645c-4d50-a529-340399c9902c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41" status: 200 len: 1534 microversion: 2.1 time: 0.417133 Jun 20 12:11:03.657581 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1495/3063] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:03 2022] GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41 => generated 1534 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:03.663994 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cfdabf4b-fb54-475a-99f3-ac15400e4080 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:03.665681 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cfdabf4b-fb54-475a-99f3-ac15400e4080 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:03.676121 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cfdabf4b-fb54-475a-99f3-ac15400e4080 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:03.677808 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cfdabf4b-fb54-475a-99f3-ac15400e4080 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:03.678938 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cfdabf4b-fb54-475a-99f3-ac15400e4080 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:03.680105 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cfdabf4b-fb54-475a-99f3-ac15400e4080 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:03.817374 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-cfdabf4b-fb54-475a-99f3-ac15400e4080 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:03.831373 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-cfdabf4b-fb54-475a-99f3-ac15400e4080 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:03.849720 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-cfdabf4b-fb54-475a-99f3-ac15400e4080 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:03.864125 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cfdabf4b-fb54-475a-99f3-ac15400e4080 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1447 microversion: 2.75 time: 0.204081 Jun 20 12:11:03.864889 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d4463472-2d3c-4206-b23a-73e89f93d5db tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:03.874012 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1496/3064] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:03 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1447 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:03.882086 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d4463472-2d3c-4206-b23a-73e89f93d5db tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1528 microversion: 2.1 time: 0.339489 Jun 20 12:11:03.883398 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1569/3065] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:03 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1528 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:03.889266 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9c2d3648-713d-4378-a462-f17ccea98212 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:03.890408 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9c2d3648-713d-4378-a462-f17ccea98212 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:03.899669 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c2d3648-713d-4378-a462-f17ccea98212 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:03.900866 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c2d3648-713d-4378-a462-f17ccea98212 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:03.902282 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c2d3648-713d-4378-a462-f17ccea98212 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:03.902957 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c2d3648-713d-4378-a462-f17ccea98212 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:04.221072 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4feb7d7f-306f-484b-800f-9a32a9bcd43b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:04.222203 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4feb7d7f-306f-484b-800f-9a32a9bcd43b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:04.255460 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4feb7d7f-306f-484b-800f-9a32a9bcd43b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:04.257104 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4feb7d7f-306f-484b-800f-9a32a9bcd43b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:04.258025 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4feb7d7f-306f-484b-800f-9a32a9bcd43b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:04.258662 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4feb7d7f-306f-484b-800f-9a32a9bcd43b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:04.300931 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9c2d3648-713d-4378-a462-f17ccea98212 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:04.320784 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9c2d3648-713d-4378-a462-f17ccea98212 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:04.333446 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9c2d3648-713d-4378-a462-f17ccea98212 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:04.339025 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9c2d3648-713d-4378-a462-f17ccea98212 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1875 microversion: 2.32 time: 0.462730 Jun 20 12:11:04.344335 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1497/3066] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:03 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1875 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:04.355740 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c986f55a-f679-4ac2-b9ba-7018ba576a66 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:04.356715 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c986f55a-f679-4ac2-b9ba-7018ba576a66 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:04.366286 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c986f55a-f679-4ac2-b9ba-7018ba576a66 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:04.366742 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c986f55a-f679-4ac2-b9ba-7018ba576a66 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:04.367530 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c986f55a-f679-4ac2-b9ba-7018ba576a66 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:04.367966 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c986f55a-f679-4ac2-b9ba-7018ba576a66 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:04.511313 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4feb7d7f-306f-484b-800f-9a32a9bcd43b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:04.543549 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4feb7d7f-306f-484b-800f-9a32a9bcd43b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1471 microversion: 2.1 time: 0.324615 Jun 20 12:11:04.557888 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1570/3067] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:04 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1471 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:11:04.557888 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6883f9b9-5db7-4782-9cfb-fb1ac29ce4d4 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:04.557888 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6883f9b9-5db7-4782-9cfb-fb1ac29ce4d4 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:04.570684 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6883f9b9-5db7-4782-9cfb-fb1ac29ce4d4 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:04.571482 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6883f9b9-5db7-4782-9cfb-fb1ac29ce4d4 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:04.578057 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6883f9b9-5db7-4782-9cfb-fb1ac29ce4d4 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:04.579576 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6883f9b9-5db7-4782-9cfb-fb1ac29ce4d4 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:04.589716 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c986f55a-f679-4ac2-b9ba-7018ba576a66 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07f91cbf86a444fb06e050d4c4532fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c47b977a1334cd486385213ff23de86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:04.599450 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c986f55a-f679-4ac2-b9ba-7018ba576a66 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 200 len: 1525 microversion: 2.1 time: 0.252331 Jun 20 12:11:04.600227 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1498/3068] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:04 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 1525 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:04.617461 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-648cf6af-9e75-4ee1-8548-7e6e6c27b642 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:04.618405 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-648cf6af-9e75-4ee1-8548-7e6e6c27b642 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:04.625628 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-648cf6af-9e75-4ee1-8548-7e6e6c27b642 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:04.626450 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-648cf6af-9e75-4ee1-8548-7e6e6c27b642 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:04.628270 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-648cf6af-9e75-4ee1-8548-7e6e6c27b642 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:04.628952 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-648cf6af-9e75-4ee1-8548-7e6e6c27b642 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:04.795737 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:11:04.835148 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-648cf6af-9e75-4ee1-8548-7e6e6c27b642 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "POST /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1/action" status: 202 len: 0 microversion: 2.1 time: 0.223254 Jun 20 12:11:04.836075 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1499/3069] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:11:04 2022] POST /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:11:04.841768 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d18e4240-7386-4d4c-af0b-a8415418e14c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:04.842470 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d18e4240-7386-4d4c-af0b-a8415418e14c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 7014bfb5-b083-485f-9711-b7cc95634c41] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:04.861410 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d18e4240-7386-4d4c-af0b-a8415418e14c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:04.862936 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d18e4240-7386-4d4c-af0b-a8415418e14c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:04.863857 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d18e4240-7386-4d4c-af0b-a8415418e14c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:04.864602 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d18e4240-7386-4d4c-af0b-a8415418e14c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:05.058156 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6883f9b9-5db7-4782-9cfb-fb1ac29ce4d4 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:05.066228 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6883f9b9-5db7-4782-9cfb-fb1ac29ce4d4 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1517 microversion: 2.1 time: 0.516526 Jun 20 12:11:05.076276 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1571/3070] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:04 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1517 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:11:05.081872 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ff8aebf3-44b0-47e9-ac60-e07c1891ae14 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:05.082726 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ff8aebf3-44b0-47e9-ac60-e07c1891ae14 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:05.089339 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff8aebf3-44b0-47e9-ac60-e07c1891ae14 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:05.090064 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff8aebf3-44b0-47e9-ac60-e07c1891ae14 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:05.091033 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff8aebf3-44b0-47e9-ac60-e07c1891ae14 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:05.091655 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff8aebf3-44b0-47e9-ac60-e07c1891ae14 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:05.106578 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d18e4240-7386-4d4c-af0b-a8415418e14c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:05.120095 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d18e4240-7386-4d4c-af0b-a8415418e14c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41" status: 200 len: 1521 microversion: 2.1 time: 0.282415 Jun 20 12:11:05.133620 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1500/3071] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:04 2022] GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41 => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:05.140319 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-496a2180-01a3-4142-94d9-adf5601d32a3 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:05.141734 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-496a2180-01a3-4142-94d9-adf5601d32a3 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:05.151812 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-496a2180-01a3-4142-94d9-adf5601d32a3 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:05.152649 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-496a2180-01a3-4142-94d9-adf5601d32a3 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:05.154175 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-496a2180-01a3-4142-94d9-adf5601d32a3 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:05.155002 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-496a2180-01a3-4142-94d9-adf5601d32a3 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:05.228966 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-496a2180-01a3-4142-94d9-adf5601d32a3 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:05.238317 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-496a2180-01a3-4142-94d9-adf5601d32a3 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:05.240002 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-496a2180-01a3-4142-94d9-adf5601d32a3 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:05.246805 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-496a2180-01a3-4142-94d9-adf5601d32a3 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1447 microversion: 2.75 time: 0.112051 Jun 20 12:11:05.248478 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1501/3072] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:05 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1447 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:05.253301 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f9508a28-eeda-4a3b-b720-e24b1f63691e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:05.253918 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f9508a28-eeda-4a3b-b720-e24b1f63691e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:05.261103 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f9508a28-eeda-4a3b-b720-e24b1f63691e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:05.261578 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f9508a28-eeda-4a3b-b720-e24b1f63691e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:05.262340 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f9508a28-eeda-4a3b-b720-e24b1f63691e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:05.262785 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f9508a28-eeda-4a3b-b720-e24b1f63691e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:05.438655 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f9508a28-eeda-4a3b-b720-e24b1f63691e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:05.448095 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f9508a28-eeda-4a3b-b720-e24b1f63691e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1510 microversion: 2.1 time: 0.198758 Jun 20 12:11:05.460318 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1502/3073] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:05 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1510 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:05.466430 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0d0d97b4-f5f1-4d16-881b-cf3a11a4ff81 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:05.467324 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0d0d97b4-f5f1-4d16-881b-cf3a11a4ff81 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 7014bfb5-b083-485f-9711-b7cc95634c41] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:05.477692 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d0d97b4-f5f1-4d16-881b-cf3a11a4ff81 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:05.478043 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d0d97b4-f5f1-4d16-881b-cf3a11a4ff81 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:05.478872 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d0d97b4-f5f1-4d16-881b-cf3a11a4ff81 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:05.479314 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d0d97b4-f5f1-4d16-881b-cf3a11a4ff81 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:05.516909 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0d0d97b4-f5f1-4d16-881b-cf3a11a4ff81 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 7014bfb5-b083-485f-9711-b7cc95634c41] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:11:05.658999 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0d0d97b4-f5f1-4d16-881b-cf3a11a4ff81 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41" status: 204 len: 0 microversion: 2.1 time: 0.207723 Jun 20 12:11:05.660522 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1503/3074] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:11:05 2022] DELETE /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:11:05.671782 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ed3ec349-885c-4065-92e3-b5c53ca46314 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:05.673833 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ed3ec349-885c-4065-92e3-b5c53ca46314 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:05.682595 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed3ec349-885c-4065-92e3-b5c53ca46314 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:05.684256 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed3ec349-885c-4065-92e3-b5c53ca46314 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:05.685292 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed3ec349-885c-4065-92e3-b5c53ca46314 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:05.686092 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed3ec349-885c-4065-92e3-b5c53ca46314 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:05.877490 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ff8aebf3-44b0-47e9-ac60-e07c1891ae14 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:05.895108 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ff8aebf3-44b0-47e9-ac60-e07c1891ae14 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1470 microversion: 2.1 time: 0.817144 Jun 20 12:11:05.897109 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1572/3075] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:05 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1470 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:05.909596 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a4bf53a5-e0fc-4bef-b055-28708da73d53 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:05.910730 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a4bf53a5-e0fc-4bef-b055-28708da73d53 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:05.920001 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a4bf53a5-e0fc-4bef-b055-28708da73d53 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:05.920878 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a4bf53a5-e0fc-4bef-b055-28708da73d53 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:05.922119 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a4bf53a5-e0fc-4bef-b055-28708da73d53 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:05.923477 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a4bf53a5-e0fc-4bef-b055-28708da73d53 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:05.976567 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ed3ec349-885c-4065-92e3-b5c53ca46314 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:06.006678 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ed3ec349-885c-4065-92e3-b5c53ca46314 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:06.009468 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ed3ec349-885c-4065-92e3-b5c53ca46314 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:06.011245 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ed3ec349-885c-4065-92e3-b5c53ca46314 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1875 microversion: 2.32 time: 0.348052 Jun 20 12:11:06.012434 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1504/3076] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:05 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1875 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:06.017878 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a1a3a466-69a1-4fea-91fa-9eb965c99435 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:06.018904 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a1a3a466-69a1-4fea-91fa-9eb965c99435 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 7014bfb5-b083-485f-9711-b7cc95634c41] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:06.025376 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a1a3a466-69a1-4fea-91fa-9eb965c99435 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:06.026281 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a1a3a466-69a1-4fea-91fa-9eb965c99435 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:06.027309 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a1a3a466-69a1-4fea-91fa-9eb965c99435 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:06.027969 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a1a3a466-69a1-4fea-91fa-9eb965c99435 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:06.170031 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a4bf53a5-e0fc-4bef-b055-28708da73d53 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07f91cbf86a444fb06e050d4c4532fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c47b977a1334cd486385213ff23de86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:06.187329 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a4bf53a5-e0fc-4bef-b055-28708da73d53 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 200 len: 1525 microversion: 2.1 time: 0.288351 Jun 20 12:11:06.188641 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1573/3077] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:05 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 1525 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:06.194725 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a1a3a466-69a1-4fea-91fa-9eb965c99435 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:06.195696 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-40381abc-2029-47fa-ab93-26a979ced062 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:06.196533 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-40381abc-2029-47fa-ab93-26a979ced062 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:06.205163 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-40381abc-2029-47fa-ab93-26a979ced062 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:06.206687 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-40381abc-2029-47fa-ab93-26a979ced062 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:06.207518 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a1a3a466-69a1-4fea-91fa-9eb965c99435 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41" status: 200 len: 1527 microversion: 2.1 time: 0.193687 Jun 20 12:11:06.207902 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-40381abc-2029-47fa-ab93-26a979ced062 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:06.208490 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1505/3078] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:06 2022] GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41 => generated 1527 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:06.208757 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-40381abc-2029-47fa-ab93-26a979ced062 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:06.269811 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2af1ee82-7571-420c-8713-f00f2013be76 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:06.270813 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2af1ee82-7571-420c-8713-f00f2013be76 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:06.277589 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2af1ee82-7571-420c-8713-f00f2013be76 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:06.278328 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2af1ee82-7571-420c-8713-f00f2013be76 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:06.279295 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2af1ee82-7571-420c-8713-f00f2013be76 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:06.279728 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2af1ee82-7571-420c-8713-f00f2013be76 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:06.484778 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-40381abc-2029-47fa-ab93-26a979ced062 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:06.488012 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2af1ee82-7571-420c-8713-f00f2013be76 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:06.496019 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-40381abc-2029-47fa-ab93-26a979ced062 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1517 microversion: 2.1 time: 0.306086 Jun 20 12:11:06.497302 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1574/3079] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:06 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1517 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:06.502060 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2af1ee82-7571-420c-8713-f00f2013be76 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:06.506561 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2af1ee82-7571-420c-8713-f00f2013be76 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:06.507630 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5bc37fea-a27f-4d88-9f11-2294cb5b08fe tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:06.508718 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5bc37fea-a27f-4d88-9f11-2294cb5b08fe tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:06.515585 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5bc37fea-a27f-4d88-9f11-2294cb5b08fe tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:06.516453 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5bc37fea-a27f-4d88-9f11-2294cb5b08fe tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:06.518316 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5bc37fea-a27f-4d88-9f11-2294cb5b08fe tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:06.518958 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5bc37fea-a27f-4d88-9f11-2294cb5b08fe tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:06.522331 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2af1ee82-7571-420c-8713-f00f2013be76 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1447 microversion: 2.75 time: 0.255846 Jun 20 12:11:06.524927 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1506/3080] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:06 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1447 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:06.677558 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5bc37fea-a27f-4d88-9f11-2294cb5b08fe tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:06.686827 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5bc37fea-a27f-4d88-9f11-2294cb5b08fe tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1510 microversion: 2.1 time: 0.187713 Jun 20 12:11:06.687235 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1575/3081] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:06 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1510 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:06.914317 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-573b0f9c-3161-48a0-9cdc-eebcdae8afa1 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:06.915085 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-573b0f9c-3161-48a0-9cdc-eebcdae8afa1 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:06.923291 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-573b0f9c-3161-48a0-9cdc-eebcdae8afa1 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:06.923430 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-573b0f9c-3161-48a0-9cdc-eebcdae8afa1 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:06.924738 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-573b0f9c-3161-48a0-9cdc-eebcdae8afa1 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:06.925690 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-573b0f9c-3161-48a0-9cdc-eebcdae8afa1 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:06.959055 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-91a6e673-ea5a-444d-984d-4afa7b26fcfd req-bfe2ab8d-7f0a-4fc2-ac78-b99f6c13b25d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4404478d-26ca-49d1-a629-8cecf8b967a1", "name": "network-vif-plugged", "status": "completed", "tag": "5dd43a26-552a-45c5-9e58-286e7499c6c8"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:06.971913 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-91a6e673-ea5a-444d-984d-4afa7b26fcfd req-bfe2ab8d-7f0a-4fc2-ac78-b99f6c13b25d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:06.972751 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-91a6e673-ea5a-444d-984d-4afa7b26fcfd req-bfe2ab8d-7f0a-4fc2-ac78-b99f6c13b25d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:06.996519 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-91a6e673-ea5a-444d-984d-4afa7b26fcfd req-bfe2ab8d-7f0a-4fc2-ac78-b99f6c13b25d service nova] Creating event network-vif-plugged:5dd43a26-552a-45c5-9e58-286e7499c6c8 for instance 4404478d-26ca-49d1-a629-8cecf8b967a1 on n-h2-master-1 Jun 20 12:11:07.003483 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [req-91a6e673-ea5a-444d-984d-4afa7b26fcfd req-bfe2ab8d-7f0a-4fc2-ac78-b99f6c13b25d service nova] Instance 4404478d-26ca-49d1-a629-8cecf8b967a1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119127) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:11:07.023320 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-91a6e673-ea5a-444d-984d-4afa7b26fcfd req-bfe2ab8d-7f0a-4fc2-ac78-b99f6c13b25d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072601 Jun 20 12:11:07.024756 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1576/3082] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:11:07.033872 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9aae27f2-886e-4a1e-b354-cc32a1def8f3 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:07.034924 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9aae27f2-886e-4a1e-b354-cc32a1def8f3 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:07.043430 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9aae27f2-886e-4a1e-b354-cc32a1def8f3 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:07.044903 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9aae27f2-886e-4a1e-b354-cc32a1def8f3 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:07.046085 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9aae27f2-886e-4a1e-b354-cc32a1def8f3 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:07.046865 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9aae27f2-886e-4a1e-b354-cc32a1def8f3 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:07.131113 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-573b0f9c-3161-48a0-9cdc-eebcdae8afa1 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:07.140445 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-573b0f9c-3161-48a0-9cdc-eebcdae8afa1 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1470 microversion: 2.1 time: 0.230371 Jun 20 12:11:07.151119 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1507/3083] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:06 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1470 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:07.205514 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5f6686b4-b919-4615-a208-d8d167495f79 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:07.206300 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5f6686b4-b919-4615-a208-d8d167495f79 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:07.221461 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5f6686b4-b919-4615-a208-d8d167495f79 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:07.222146 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5f6686b4-b919-4615-a208-d8d167495f79 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:07.222953 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5f6686b4-b919-4615-a208-d8d167495f79 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:07.223393 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5f6686b4-b919-4615-a208-d8d167495f79 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:07.297942 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9aae27f2-886e-4a1e-b354-cc32a1def8f3 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:07.309410 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9aae27f2-886e-4a1e-b354-cc32a1def8f3 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:07.311100 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9aae27f2-886e-4a1e-b354-cc32a1def8f3 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:07.312333 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9aae27f2-886e-4a1e-b354-cc32a1def8f3 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1875 microversion: 2.32 time: 0.284766 Jun 20 12:11:07.313355 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1577/3084] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:07 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1875 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:07.328703 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d6aae028-b184-47ad-9060-4e36c3be54d9 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:07.329326 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d6aae028-b184-47ad-9060-4e36c3be54d9 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 7014bfb5-b083-485f-9711-b7cc95634c41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:07.336903 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d6aae028-b184-47ad-9060-4e36c3be54d9 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:07.337362 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d6aae028-b184-47ad-9060-4e36c3be54d9 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:07.338256 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d6aae028-b184-47ad-9060-4e36c3be54d9 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:07.338701 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d6aae028-b184-47ad-9060-4e36c3be54d9 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:07.406260 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5f6686b4-b919-4615-a208-d8d167495f79 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07f91cbf86a444fb06e050d4c4532fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c47b977a1334cd486385213ff23de86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:07.414894 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5f6686b4-b919-4615-a208-d8d167495f79 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 200 len: 1525 microversion: 2.1 time: 0.213683 Jun 20 12:11:07.415814 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1508/3085] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:07 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 1525 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:07.513990 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3f8db2c0-9a3f-45f2-9815-0589972fbbe2 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:07.514891 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3f8db2c0-9a3f-45f2-9815-0589972fbbe2 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:07.524149 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3f8db2c0-9a3f-45f2-9815-0589972fbbe2 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:07.524722 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3f8db2c0-9a3f-45f2-9815-0589972fbbe2 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:07.525629 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3f8db2c0-9a3f-45f2-9815-0589972fbbe2 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:07.526224 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3f8db2c0-9a3f-45f2-9815-0589972fbbe2 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:07.645865 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d6aae028-b184-47ad-9060-4e36c3be54d9 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:07.657019 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d6aae028-b184-47ad-9060-4e36c3be54d9 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41" status: 200 len: 1527 microversion: 2.1 time: 0.332196 Jun 20 12:11:07.658227 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1578/3086] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:07 2022] GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41 => generated 1527 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:07.664894 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b39e3610-1ebe-422c-a7a1-37a5e7d1c61d tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:07.665730 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b39e3610-1ebe-422c-a7a1-37a5e7d1c61d tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:07.673380 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b39e3610-1ebe-422c-a7a1-37a5e7d1c61d tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:07.673887 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b39e3610-1ebe-422c-a7a1-37a5e7d1c61d tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:07.674845 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b39e3610-1ebe-422c-a7a1-37a5e7d1c61d tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:07.675282 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b39e3610-1ebe-422c-a7a1-37a5e7d1c61d tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:07.683780 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3f8db2c0-9a3f-45f2-9815-0589972fbbe2 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:07.692584 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3f8db2c0-9a3f-45f2-9815-0589972fbbe2 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1517 microversion: 2.1 time: 0.182868 Jun 20 12:11:07.698370 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1509/3087] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:07 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1517 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:11:07.714563 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-201fad0f-4010-43c9-8bda-4f680d0eaf14 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:07.715509 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-201fad0f-4010-43c9-8bda-4f680d0eaf14 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:07.723558 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-201fad0f-4010-43c9-8bda-4f680d0eaf14 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:07.724005 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-201fad0f-4010-43c9-8bda-4f680d0eaf14 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:07.724990 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-201fad0f-4010-43c9-8bda-4f680d0eaf14 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:07.725426 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-201fad0f-4010-43c9-8bda-4f680d0eaf14 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:07.817973 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b39e3610-1ebe-422c-a7a1-37a5e7d1c61d tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:07.827929 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b39e3610-1ebe-422c-a7a1-37a5e7d1c61d tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:07.829574 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b39e3610-1ebe-422c-a7a1-37a5e7d1c61d tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:07.838024 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b39e3610-1ebe-422c-a7a1-37a5e7d1c61d tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1447 microversion: 2.75 time: 0.177826 Jun 20 12:11:07.850160 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1579/3088] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:07 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1447 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:07.901642 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-201fad0f-4010-43c9-8bda-4f680d0eaf14 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:07.909765 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-201fad0f-4010-43c9-8bda-4f680d0eaf14 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1510 microversion: 2.1 time: 0.209951 Jun 20 12:11:07.910356 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1510/3089] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:07 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1510 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:08.158556 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3676fa9c-8f03-429a-b72d-7567cbf03347 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:08.159223 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3676fa9c-8f03-429a-b72d-7567cbf03347 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:08.166238 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3676fa9c-8f03-429a-b72d-7567cbf03347 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:08.166655 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3676fa9c-8f03-429a-b72d-7567cbf03347 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:08.167438 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3676fa9c-8f03-429a-b72d-7567cbf03347 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:08.167872 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3676fa9c-8f03-429a-b72d-7567cbf03347 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:08.323128 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3676fa9c-8f03-429a-b72d-7567cbf03347 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:08.331811 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-db3e3440-64f4-4d72-96c1-c0e9eb0a3883 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:08.332538 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-db3e3440-64f4-4d72-96c1-c0e9eb0a3883 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:08.332657 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3676fa9c-8f03-429a-b72d-7567cbf03347 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1470 microversion: 2.1 time: 0.178207 Jun 20 12:11:08.333415 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1580/3090] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:08 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1470 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:08.339835 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-db3e3440-64f4-4d72-96c1-c0e9eb0a3883 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:08.340426 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-db3e3440-64f4-4d72-96c1-c0e9eb0a3883 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:08.341984 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-db3e3440-64f4-4d72-96c1-c0e9eb0a3883 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:08.343911 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-db3e3440-64f4-4d72-96c1-c0e9eb0a3883 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:08.432955 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a12ab137-19cb-4712-b584-d37da9532a6c tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:08.433617 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a12ab137-19cb-4712-b584-d37da9532a6c tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:08.437299 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:11:08.442695 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a12ab137-19cb-4712-b584-d37da9532a6c tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:08.443218 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a12ab137-19cb-4712-b584-d37da9532a6c tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:08.444062 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a12ab137-19cb-4712-b584-d37da9532a6c tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:08.444588 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a12ab137-19cb-4712-b584-d37da9532a6c tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:08.463861 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:11:08.584828 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-db3e3440-64f4-4d72-96c1-c0e9eb0a3883 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:08.596835 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-db3e3440-64f4-4d72-96c1-c0e9eb0a3883 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:08.599515 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-db3e3440-64f4-4d72-96c1-c0e9eb0a3883 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:08.605500 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a12ab137-19cb-4712-b584-d37da9532a6c tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07f91cbf86a444fb06e050d4c4532fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c47b977a1334cd486385213ff23de86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:08.609630 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-db3e3440-64f4-4d72-96c1-c0e9eb0a3883 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1875 microversion: 2.32 time: 0.274287 Jun 20 12:11:08.610291 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1511/3091] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:08 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1875 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:08.614855 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a12ab137-19cb-4712-b584-d37da9532a6c tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 200 len: 1525 microversion: 2.1 time: 0.186287 Jun 20 12:11:08.625705 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1581/3092] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:08 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 1525 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:11:08.675603 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4ed29699-ac61-4c07-837c-a6639bec2060 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:08.676247 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4ed29699-ac61-4c07-837c-a6639bec2060 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 7014bfb5-b083-485f-9711-b7cc95634c41] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:08.683882 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ed29699-ac61-4c07-837c-a6639bec2060 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:08.684654 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ed29699-ac61-4c07-837c-a6639bec2060 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:08.685652 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ed29699-ac61-4c07-837c-a6639bec2060 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:08.686102 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ed29699-ac61-4c07-837c-a6639bec2060 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:08.717772 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-816b69fd-4fe2-447a-95df-cc8912411672 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:08.718995 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-816b69fd-4fe2-447a-95df-cc8912411672 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:08.734254 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-816b69fd-4fe2-447a-95df-cc8912411672 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:08.735347 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-816b69fd-4fe2-447a-95df-cc8912411672 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:08.737716 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-816b69fd-4fe2-447a-95df-cc8912411672 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:08.738593 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-816b69fd-4fe2-447a-95df-cc8912411672 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:08.868279 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4ed29699-ac61-4c07-837c-a6639bec2060 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:08.878714 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4ed29699-ac61-4c07-837c-a6639bec2060 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41" status: 200 len: 1527 microversion: 2.1 time: 0.207715 Jun 20 12:11:08.879399 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1512/3093] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:08 2022] GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41 => generated 1527 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:08.885404 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ceee48d1-05a2-4367-b61c-aa84d468a33e tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:08.886319 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ceee48d1-05a2-4367-b61c-aa84d468a33e tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:08.894438 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ceee48d1-05a2-4367-b61c-aa84d468a33e tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:08.894996 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ceee48d1-05a2-4367-b61c-aa84d468a33e tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:08.895776 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ceee48d1-05a2-4367-b61c-aa84d468a33e tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:08.896173 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ceee48d1-05a2-4367-b61c-aa84d468a33e tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:08.916688 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-816b69fd-4fe2-447a-95df-cc8912411672 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:08.926851 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-816b69fd-4fe2-447a-95df-cc8912411672 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1517 microversion: 2.1 time: 0.218133 Jun 20 12:11:08.928165 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1582/3094] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:08 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1517 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:08.935153 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3d5b5cfe-58a7-4e54-9b08-c5841001919f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:08.935788 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3d5b5cfe-58a7-4e54-9b08-c5841001919f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:08.943324 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3d5b5cfe-58a7-4e54-9b08-c5841001919f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:08.943996 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3d5b5cfe-58a7-4e54-9b08-c5841001919f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:08.945009 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3d5b5cfe-58a7-4e54-9b08-c5841001919f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:08.945704 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3d5b5cfe-58a7-4e54-9b08-c5841001919f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:08.988861 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ceee48d1-05a2-4367-b61c-aa84d468a33e tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:08.998820 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ceee48d1-05a2-4367-b61c-aa84d468a33e tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:09.001011 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ceee48d1-05a2-4367-b61c-aa84d468a33e tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:09.007601 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ceee48d1-05a2-4367-b61c-aa84d468a33e tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1447 microversion: 2.75 time: 0.126649 Jun 20 12:11:09.018243 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1513/3095] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:08 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1447 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:09.101076 n-d-master-1 devstack@n-api.service[119128]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 12:11:09.101360 n-d-master-1 devstack@n-api.service[119128]: Mon Jun 20 12:11:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 12:11:09.108943 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3d5b5cfe-58a7-4e54-9b08-c5841001919f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:09.117652 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3d5b5cfe-58a7-4e54-9b08-c5841001919f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1510 microversion: 2.1 time: 0.186980 Jun 20 12:11:09.118230 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1583/3096] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:08 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1510 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:09.153867 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-2c085dd9-cf30-4ae1-a8c7-54898c64f026 req-f20dfe5a-c041-420c-8a88-5eafc9435669 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7014bfb5-b083-485f-9711-b7cc95634c41", "name": "network-vif-unplugged", "status": "completed", "tag": "2b4ae774-61d2-4117-bf2a-8e8514f99147"}, {"server_uuid": "593cda12-6491-4a27-8fc7-42c05e0291c3", "name": "network-vif-unplugged", "status": "completed", "tag": "2a9eb762-96f9-45b2-8446-311d784377f5"}, {"server_uuid": "36218945-42bd-45a4-889b-b411acdd4155", "name": "network-vif-plugged", "status": "completed", "tag": "85f1809d-90f7-4c54-9391-f68911c003bb"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:09.164668 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-2c085dd9-cf30-4ae1-a8c7-54898c64f026 req-f20dfe5a-c041-420c-8a88-5eafc9435669 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:09.165144 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-2c085dd9-cf30-4ae1-a8c7-54898c64f026 req-f20dfe5a-c041-420c-8a88-5eafc9435669 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:09.169527 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:11:09.182133 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-2c085dd9-cf30-4ae1-a8c7-54898c64f026 req-f20dfe5a-c041-420c-8a88-5eafc9435669 service nova] Creating event network-vif-unplugged:2b4ae774-61d2-4117-bf2a-8e8514f99147 for instance 7014bfb5-b083-485f-9711-b7cc95634c41 on n-h2-master-1 Jun 20 12:11:09.182899 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-2c085dd9-cf30-4ae1-a8c7-54898c64f026 req-f20dfe5a-c041-420c-8a88-5eafc9435669 service nova] Creating event network-vif-unplugged:2a9eb762-96f9-45b2-8446-311d784377f5 for instance 593cda12-6491-4a27-8fc7-42c05e0291c3 on n-h2-master-1 Jun 20 12:11:09.183426 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-2c085dd9-cf30-4ae1-a8c7-54898c64f026 req-f20dfe5a-c041-420c-8a88-5eafc9435669 service nova] Creating event network-vif-plugged:85f1809d-90f7-4c54-9391-f68911c003bb for instance 36218945-42bd-45a4-889b-b411acdd4155 on n-h1-master-1 Jun 20 12:11:09.195136 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-2c085dd9-cf30-4ae1-a8c7-54898c64f026 req-f20dfe5a-c041-420c-8a88-5eafc9435669 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 529 microversion: 2.1 time: 0.044997 Jun 20 12:11:09.196183 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1514/3097] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 529 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:11:09.351111 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-427a81a4-ed76-4b0c-8545-511293bbddb3 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:09.351877 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-427a81a4-ed76-4b0c-8545-511293bbddb3 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:09.362905 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-427a81a4-ed76-4b0c-8545-511293bbddb3 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:09.363259 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-427a81a4-ed76-4b0c-8545-511293bbddb3 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:09.364165 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-427a81a4-ed76-4b0c-8545-511293bbddb3 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:09.364844 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-427a81a4-ed76-4b0c-8545-511293bbddb3 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:09.552471 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-427a81a4-ed76-4b0c-8545-511293bbddb3 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:09.563656 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-427a81a4-ed76-4b0c-8545-511293bbddb3 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1470 microversion: 2.1 time: 0.216113 Jun 20 12:11:09.565506 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1584/3098] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:09 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1470 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:09.633682 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fce16b9e-19ac-4d5e-b9ed-c1764665c8a7 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:09.635031 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fce16b9e-19ac-4d5e-b9ed-c1764665c8a7 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:09.635394 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-145fe39a-4f52-4a81-908f-c06d9853ece8 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:09.636118 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-145fe39a-4f52-4a81-908f-c06d9853ece8 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:09.649956 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fce16b9e-19ac-4d5e-b9ed-c1764665c8a7 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:09.650860 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fce16b9e-19ac-4d5e-b9ed-c1764665c8a7 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:09.652088 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fce16b9e-19ac-4d5e-b9ed-c1764665c8a7 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:09.652769 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fce16b9e-19ac-4d5e-b9ed-c1764665c8a7 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:09.657743 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-145fe39a-4f52-4a81-908f-c06d9853ece8 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:09.658511 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-145fe39a-4f52-4a81-908f-c06d9853ece8 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:09.660036 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-145fe39a-4f52-4a81-908f-c06d9853ece8 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:09.661877 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-145fe39a-4f52-4a81-908f-c06d9853ece8 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:10.041378 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-145fe39a-4f52-4a81-908f-c06d9853ece8 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:10.064082 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fce16b9e-19ac-4d5e-b9ed-c1764665c8a7 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07f91cbf86a444fb06e050d4c4532fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c47b977a1334cd486385213ff23de86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:10.068525 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-145fe39a-4f52-4a81-908f-c06d9853ece8 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:10.080482 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-145fe39a-4f52-4a81-908f-c06d9853ece8 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:10.082442 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-145fe39a-4f52-4a81-908f-c06d9853ece8 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1875 microversion: 2.32 time: 0.455806 Jun 20 12:11:10.083871 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1515/3099] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:09 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1875 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:10.091571 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fce16b9e-19ac-4d5e-b9ed-c1764665c8a7 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 200 len: 1525 microversion: 2.1 time: 0.462656 Jun 20 12:11:10.097887 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1716c883-8d9e-4382-945f-b7a0498b760f tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:10.099935 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1716c883-8d9e-4382-945f-b7a0498b760f tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 7014bfb5-b083-485f-9711-b7cc95634c41] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:10.104420 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1585/3100] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:09 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 1525 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:10.117434 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d4f66955-9338-4dc2-b9e0-05253275749e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:10.117824 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d4f66955-9338-4dc2-b9e0-05253275749e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:10.122437 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1716c883-8d9e-4382-945f-b7a0498b760f tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:10.123463 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1716c883-8d9e-4382-945f-b7a0498b760f tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:10.125654 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d4f66955-9338-4dc2-b9e0-05253275749e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:10.126172 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d4f66955-9338-4dc2-b9e0-05253275749e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:10.126544 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1716c883-8d9e-4382-945f-b7a0498b760f tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:10.127849 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d4f66955-9338-4dc2-b9e0-05253275749e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:10.128427 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d4f66955-9338-4dc2-b9e0-05253275749e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:10.129299 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1716c883-8d9e-4382-945f-b7a0498b760f tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:10.393407 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1716c883-8d9e-4382-945f-b7a0498b760f tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:10.403092 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1716c883-8d9e-4382-945f-b7a0498b760f tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41" status: 200 len: 1527 microversion: 2.1 time: 0.317713 Jun 20 12:11:10.404275 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1516/3101] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:10 2022] GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41 => generated 1527 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:10.409696 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7dfb1e8f-b242-4f42-99fa-5a4c49d0f303 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:10.410940 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7dfb1e8f-b242-4f42-99fa-5a4c49d0f303 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:10.419411 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7dfb1e8f-b242-4f42-99fa-5a4c49d0f303 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:10.420563 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7dfb1e8f-b242-4f42-99fa-5a4c49d0f303 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:10.421732 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7dfb1e8f-b242-4f42-99fa-5a4c49d0f303 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:10.422822 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7dfb1e8f-b242-4f42-99fa-5a4c49d0f303 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:10.512381 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7dfb1e8f-b242-4f42-99fa-5a4c49d0f303 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:10.528933 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7dfb1e8f-b242-4f42-99fa-5a4c49d0f303 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:10.531440 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7dfb1e8f-b242-4f42-99fa-5a4c49d0f303 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:10.539227 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7dfb1e8f-b242-4f42-99fa-5a4c49d0f303 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1447 microversion: 2.75 time: 0.133610 Jun 20 12:11:10.540320 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1517/3102] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:10 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1447 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:10.555407 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-066ec399-b181-4570-9ddd-5127871d0f9b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:10.556365 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-066ec399-b181-4570-9ddd-5127871d0f9b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:10.564937 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-066ec399-b181-4570-9ddd-5127871d0f9b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:10.565493 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-066ec399-b181-4570-9ddd-5127871d0f9b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:10.566913 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-066ec399-b181-4570-9ddd-5127871d0f9b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:10.567619 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-066ec399-b181-4570-9ddd-5127871d0f9b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:10.862265 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-066ec399-b181-4570-9ddd-5127871d0f9b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:10.862948 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d4f66955-9338-4dc2-b9e0-05253275749e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:10.872799 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-066ec399-b181-4570-9ddd-5127871d0f9b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1513 microversion: 2.1 time: 0.326565 Jun 20 12:11:10.884231 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1518/3103] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:10 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1513 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:10.884488 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d4f66955-9338-4dc2-b9e0-05253275749e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1517 microversion: 2.1 time: 0.770034 Jun 20 12:11:10.884488 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1586/3104] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:10 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1517 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:10.889836 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d0a82962-b85f-46de-af09-c17a8fd112c2 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:10.890828 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d0a82962-b85f-46de-af09-c17a8fd112c2 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:10.896617 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b54509fe-49ba-453e-b606-d2a022c6736a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:10.897255 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b54509fe-49ba-453e-b606-d2a022c6736a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:10.898622 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d0a82962-b85f-46de-af09-c17a8fd112c2 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:10.899458 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d0a82962-b85f-46de-af09-c17a8fd112c2 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:10.901166 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d0a82962-b85f-46de-af09-c17a8fd112c2 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:10.902049 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d0a82962-b85f-46de-af09-c17a8fd112c2 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:10.908591 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b54509fe-49ba-453e-b606-d2a022c6736a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:10.909049 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b54509fe-49ba-453e-b606-d2a022c6736a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:10.912403 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b54509fe-49ba-453e-b606-d2a022c6736a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:10.913209 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b54509fe-49ba-453e-b606-d2a022c6736a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:11.140597 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b54509fe-49ba-453e-b606-d2a022c6736a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:11.146201 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d0a82962-b85f-46de-af09-c17a8fd112c2 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:11.163802 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d0a82962-b85f-46de-af09-c17a8fd112c2 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1470 microversion: 2.1 time: 0.288658 Jun 20 12:11:11.174192 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1519/3105] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:10 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1470 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:11.175174 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b54509fe-49ba-453e-b606-d2a022c6736a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1453 microversion: 2.1 time: 0.274560 Jun 20 12:11:11.175174 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1587/3106] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:10 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1453 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:11:11.182552 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fc4e41de-d09f-4a10-ade5-3b95713120fd tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:11.182892 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-92365670-c123-40d3-a1cc-89b5aed75d28 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:11.183169 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fc4e41de-d09f-4a10-ade5-3b95713120fd tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:11.183511 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-92365670-c123-40d3-a1cc-89b5aed75d28 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:11.191512 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fc4e41de-d09f-4a10-ade5-3b95713120fd tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:11.192013 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fc4e41de-d09f-4a10-ade5-3b95713120fd tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:11.192819 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fc4e41de-d09f-4a10-ade5-3b95713120fd tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:11.193251 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fc4e41de-d09f-4a10-ade5-3b95713120fd tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:11.210165 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-92365670-c123-40d3-a1cc-89b5aed75d28 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:11.210633 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-92365670-c123-40d3-a1cc-89b5aed75d28 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:11.211488 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-92365670-c123-40d3-a1cc-89b5aed75d28 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:11.211924 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-92365670-c123-40d3-a1cc-89b5aed75d28 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:11.406246 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-92365670-c123-40d3-a1cc-89b5aed75d28 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07f91cbf86a444fb06e050d4c4532fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c47b977a1334cd486385213ff23de86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:11.420718 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-92365670-c123-40d3-a1cc-89b5aed75d28 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 200 len: 1525 microversion: 2.1 time: 0.243533 Jun 20 12:11:11.421536 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1588/3107] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:11 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 1525 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:11.431449 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-7ac6a070-930c-4275-9095-35a492725bf7 req-f6cfce05-3f48-4232-b085-4767b09c26f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36218945-42bd-45a4-889b-b411acdd4155", "name": "network-vif-plugged", "status": "completed", "tag": "106b84b6-fcc3-4d62-a238-c341d6254586"}, {"server_uuid": "36218945-42bd-45a4-889b-b411acdd4155", "name": "network-vif-plugged", "status": "completed", "tag": "180da7b7-ef36-401f-943e-30f5c9d8ecc6"}, {"server_uuid": "36218945-42bd-45a4-889b-b411acdd4155", "name": "network-vif-plugged", "status": "completed", "tag": "c92e56c8-a1a7-41dc-b4c8-8b2e57dae74e"}, {"server_uuid": "36218945-42bd-45a4-889b-b411acdd4155", "name": "network-vif-plugged", "status": "completed", "tag": "a3f0416b-e069-41e8-9db8-7e848d1875ab"}, {"server_uuid": "36218945-42bd-45a4-889b-b411acdd4155", "name": "network-vif-plugged", "status": "completed", "tag": "9df2cf8c-5928-405e-ac7c-65c330f2acbf"}, {"server_uuid": "36218945-42bd-45a4-889b-b411acdd4155", "name": "network-vif-plugged", "status": "completed", "tag": "e18c6fa7-dd45-494c-a0a7-a1e50521794b"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:11.442251 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-7ac6a070-930c-4275-9095-35a492725bf7 req-f6cfce05-3f48-4232-b085-4767b09c26f8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:11.443808 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-7ac6a070-930c-4275-9095-35a492725bf7 req-f6cfce05-3f48-4232-b085-4767b09c26f8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:11.460731 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-7ac6a070-930c-4275-9095-35a492725bf7 req-f6cfce05-3f48-4232-b085-4767b09c26f8 service nova] Creating event network-vif-plugged:106b84b6-fcc3-4d62-a238-c341d6254586 for instance 36218945-42bd-45a4-889b-b411acdd4155 on n-h1-master-1 Jun 20 12:11:11.461700 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-7ac6a070-930c-4275-9095-35a492725bf7 req-f6cfce05-3f48-4232-b085-4767b09c26f8 service nova] Creating event network-vif-plugged:180da7b7-ef36-401f-943e-30f5c9d8ecc6 for instance 36218945-42bd-45a4-889b-b411acdd4155 on n-h1-master-1 Jun 20 12:11:11.462717 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-7ac6a070-930c-4275-9095-35a492725bf7 req-f6cfce05-3f48-4232-b085-4767b09c26f8 service nova] Creating event network-vif-plugged:c92e56c8-a1a7-41dc-b4c8-8b2e57dae74e for instance 36218945-42bd-45a4-889b-b411acdd4155 on n-h1-master-1 Jun 20 12:11:11.467398 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-7ac6a070-930c-4275-9095-35a492725bf7 req-f6cfce05-3f48-4232-b085-4767b09c26f8 service nova] Creating event network-vif-plugged:a3f0416b-e069-41e8-9db8-7e848d1875ab for instance 36218945-42bd-45a4-889b-b411acdd4155 on n-h1-master-1 Jun 20 12:11:11.468660 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-7ac6a070-930c-4275-9095-35a492725bf7 req-f6cfce05-3f48-4232-b085-4767b09c26f8 service nova] Creating event network-vif-plugged:9df2cf8c-5928-405e-ac7c-65c330f2acbf for instance 36218945-42bd-45a4-889b-b411acdd4155 on n-h1-master-1 Jun 20 12:11:11.469221 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-7ac6a070-930c-4275-9095-35a492725bf7 req-f6cfce05-3f48-4232-b085-4767b09c26f8 service nova] Creating event network-vif-plugged:e18c6fa7-dd45-494c-a0a7-a1e50521794b for instance 36218945-42bd-45a4-889b-b411acdd4155 on n-h1-master-1 Jun 20 12:11:11.474210 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fc4e41de-d09f-4a10-ade5-3b95713120fd tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:11.481029 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-7ac6a070-930c-4275-9095-35a492725bf7 req-f6cfce05-3f48-4232-b085-4767b09c26f8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.057615 Jun 20 12:11:11.490807 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fc4e41de-d09f-4a10-ade5-3b95713120fd tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:11.492819 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1589/3108] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:11.493055 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fc4e41de-d09f-4a10-ade5-3b95713120fd tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:11.494349 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fc4e41de-d09f-4a10-ade5-3b95713120fd tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1875 microversion: 2.32 time: 0.327894 Jun 20 12:11:11.494950 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1520/3109] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:11 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1875 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:11.500502 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7de26bbb-c258-453c-ad94-692c8855cb53 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:11.500502 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7de26bbb-c258-453c-ad94-692c8855cb53 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:11.500856 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-7a6cf76d-c2c1-4c37-86fd-4ccb7d609b64 req-3d0b8bac-0dba-49f7-bfa7-f3cee71128d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7014bfb5-b083-485f-9711-b7cc95634c41", "name": "network-vif-deleted", "tag": "2b4ae774-61d2-4117-bf2a-8e8514f99147"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:11.512372 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7de26bbb-c258-453c-ad94-692c8855cb53 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:11.513198 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7de26bbb-c258-453c-ad94-692c8855cb53 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:11.513906 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-7a6cf76d-c2c1-4c37-86fd-4ccb7d609b64 req-3d0b8bac-0dba-49f7-bfa7-f3cee71128d3 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:11.514364 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-7a6cf76d-c2c1-4c37-86fd-4ccb7d609b64 req-3d0b8bac-0dba-49f7-bfa7-f3cee71128d3 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:11.514796 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7de26bbb-c258-453c-ad94-692c8855cb53 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:11.515545 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7de26bbb-c258-453c-ad94-692c8855cb53 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:11.548379 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-7de26bbb-c258-453c-ad94-692c8855cb53 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lazy-loading 'flavor' on Instance uuid 593cda12-6491-4a27-8fc7-42c05e0291c3 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:11:11.549674 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-7a6cf76d-c2c1-4c37-86fd-4ccb7d609b64 req-3d0b8bac-0dba-49f7-bfa7-f3cee71128d3 service nova] Creating event network-vif-deleted:2b4ae774-61d2-4117-bf2a-8e8514f99147 for instance 7014bfb5-b083-485f-9711-b7cc95634c41 on n-h2-master-1 Jun 20 12:11:11.560783 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-7a6cf76d-c2c1-4c37-86fd-4ccb7d609b64 req-3d0b8bac-0dba-49f7-bfa7-f3cee71128d3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063765 Jun 20 12:11:11.561547 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1521/3110] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:11:11.568156 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-50dfc341-e23a-4134-9b9a-b7aaf6a86d2d tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:11.569027 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-50dfc341-e23a-4134-9b9a-b7aaf6a86d2d tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 7014bfb5-b083-485f-9711-b7cc95634c41] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:11.575280 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-7de26bbb-c258-453c-ad94-692c8855cb53 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] HTTP exception thrown: Cannot 'shelve' instance 593cda12-6491-4a27-8fc7-42c05e0291c3 while it is in vm_state shelved_offloaded Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7de26bbb-c258-453c-ad94-692c8855cb53 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3/action HTTP/1.1 Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 14 Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: {"shelve": {}} Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: exception: Cannot 'shelve' instance 593cda12-6491-4a27-8fc7-42c05e0291c3 while it is in vm_state shelved_offloaded Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '593cda12-6491-4a27-8fc7-42c05e0291c3', 'body': {'shelve': {}}} Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 593cda12-6491-4a27-8fc7-42c05e0291c3 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Jun 20 12:11:11.577258 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 20 12:11:11.582746 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 20 12:11:11.582746 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 20 12:11:11.582746 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 593cda12-6491-4a27-8fc7-42c05e0291c3 while it is in vm_state shelved_offloaded Jun 20 12:11:11.582746 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:11.582746 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:11.582746 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:11.582746 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:11.582746 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:11.582746 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:11.582746 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:11:11.582746 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:11:11.582746 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 593cda12-6491-4a27-8fc7-42c05e0291c3 while it is in vm_state shelved_offloaded Jun 20 12:11:11.582746 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:11.584816 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7de26bbb-c258-453c-ad94-692c8855cb53 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 409 to user: Cannot 'shelve' instance 593cda12-6491-4a27-8fc7-42c05e0291c3 while it is in vm_state shelved_offloaded {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:11:11.585008 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-50dfc341-e23a-4134-9b9a-b7aaf6a86d2d tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:11.585895 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-50dfc341-e23a-4134-9b9a-b7aaf6a86d2d tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:11.586277 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7de26bbb-c258-453c-ad94-692c8855cb53 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3/action" status: 409 len: 155 microversion: 2.1 time: 0.091958 Jun 20 12:11:11.587371 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1590/3111] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:11:11 2022] POST /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3/action => generated 155 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:11:11.587879 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-50dfc341-e23a-4134-9b9a-b7aaf6a86d2d tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:11.589050 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-50dfc341-e23a-4134-9b9a-b7aaf6a86d2d tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:11.601086 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b97801fa-4c42-49e5-aea8-6ca01b328874 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:11.601871 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b97801fa-4c42-49e5-aea8-6ca01b328874 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:11.613902 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b97801fa-4c42-49e5-aea8-6ca01b328874 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:11.614488 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b97801fa-4c42-49e5-aea8-6ca01b328874 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:11.615479 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b97801fa-4c42-49e5-aea8-6ca01b328874 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:11.616025 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b97801fa-4c42-49e5-aea8-6ca01b328874 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:11.705822 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b97801fa-4c42-49e5-aea8-6ca01b328874 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:11.709085 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-50dfc341-e23a-4134-9b9a-b7aaf6a86d2d tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:11.716907 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b97801fa-4c42-49e5-aea8-6ca01b328874 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:11.717769 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-50dfc341-e23a-4134-9b9a-b7aaf6a86d2d tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41" status: 200 len: 1485 microversion: 2.1 time: 0.154651 Jun 20 12:11:11.718626 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b97801fa-4c42-49e5-aea8-6ca01b328874 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:11.719851 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1522/3112] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:11 2022] GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41 => generated 1485 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:11.725455 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-76f2d4b8-fdf5-4a4a-aa3f-ab85592b4c41 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:11.726043 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-76f2d4b8-fdf5-4a4a-aa3f-ab85592b4c41 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:11.726182 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b97801fa-4c42-49e5-aea8-6ca01b328874 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1447 microversion: 2.75 time: 0.136159 Jun 20 12:11:11.727504 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1591/3113] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:11 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1447 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:11.743293 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-76f2d4b8-fdf5-4a4a-aa3f-ab85592b4c41 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:11.743998 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-76f2d4b8-fdf5-4a4a-aa3f-ab85592b4c41 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:11.745543 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-76f2d4b8-fdf5-4a4a-aa3f-ab85592b4c41 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:11.746120 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-76f2d4b8-fdf5-4a4a-aa3f-ab85592b4c41 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:11.796024 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:11:11.883263 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-76f2d4b8-fdf5-4a4a-aa3f-ab85592b4c41 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3/action" status: 202 len: 0 microversion: 2.1 time: 0.161996 Jun 20 12:11:11.884826 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1523/3114] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:11:11 2022] POST /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:11:11.899610 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1d317350-c8d2-4f6a-83c4-f64b06f68260 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:11.900058 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5568607d-bfdc-407d-bcc1-dc9dadc018ae tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:11.900594 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1d317350-c8d2-4f6a-83c4-f64b06f68260 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:11.900865 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5568607d-bfdc-407d-bcc1-dc9dadc018ae tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:11.907123 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d317350-c8d2-4f6a-83c4-f64b06f68260 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:11.907575 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d317350-c8d2-4f6a-83c4-f64b06f68260 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:11.909403 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d317350-c8d2-4f6a-83c4-f64b06f68260 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:11.909509 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d317350-c8d2-4f6a-83c4-f64b06f68260 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:11.913065 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5568607d-bfdc-407d-bcc1-dc9dadc018ae tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:11.913775 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5568607d-bfdc-407d-bcc1-dc9dadc018ae tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:11.914798 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5568607d-bfdc-407d-bcc1-dc9dadc018ae tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:11.915465 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5568607d-bfdc-407d-bcc1-dc9dadc018ae tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:12.064336 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1d317350-c8d2-4f6a-83c4-f64b06f68260 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:12.077258 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1d317350-c8d2-4f6a-83c4-f64b06f68260 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1461 microversion: 2.1 time: 0.178906 Jun 20 12:11:12.077258 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1524/3115] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:11 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1461 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:12.182414 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bb94b94d-cd1e-4d91-b6e3-5a6cb8aea493 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:12.183124 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bb94b94d-cd1e-4d91-b6e3-5a6cb8aea493 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:12.190044 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bb94b94d-cd1e-4d91-b6e3-5a6cb8aea493 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:12.190529 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bb94b94d-cd1e-4d91-b6e3-5a6cb8aea493 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:12.191320 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bb94b94d-cd1e-4d91-b6e3-5a6cb8aea493 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:12.191761 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bb94b94d-cd1e-4d91-b6e3-5a6cb8aea493 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:12.277224 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5568607d-bfdc-407d-bcc1-dc9dadc018ae tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:12.286284 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5568607d-bfdc-407d-bcc1-dc9dadc018ae tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1517 microversion: 2.1 time: 0.392169 Jun 20 12:11:12.286979 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1592/3116] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:11 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1517 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:12.344760 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-bb94b94d-cd1e-4d91-b6e3-5a6cb8aea493 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:12.355715 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bb94b94d-cd1e-4d91-b6e3-5a6cb8aea493 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1470 microversion: 2.1 time: 0.177441 Jun 20 12:11:12.356339 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1525/3117] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:12 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1470 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:12.442964 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5b3d64be-a77b-4fbd-b74b-49149f15880b tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:12.443618 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5b3d64be-a77b-4fbd-b74b-49149f15880b tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:12.451359 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b3d64be-a77b-4fbd-b74b-49149f15880b tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:12.452754 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b3d64be-a77b-4fbd-b74b-49149f15880b tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:12.453584 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b3d64be-a77b-4fbd-b74b-49149f15880b tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:12.454160 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b3d64be-a77b-4fbd-b74b-49149f15880b tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:12.518736 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-71bcd3ad-6870-4712-922e-e5f0595e9189 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:12.519526 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-71bcd3ad-6870-4712-922e-e5f0595e9189 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:12.531281 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-71bcd3ad-6870-4712-922e-e5f0595e9189 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:12.532028 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-71bcd3ad-6870-4712-922e-e5f0595e9189 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:12.533042 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-71bcd3ad-6870-4712-922e-e5f0595e9189 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:12.533627 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-71bcd3ad-6870-4712-922e-e5f0595e9189 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:12.672036 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5b3d64be-a77b-4fbd-b74b-49149f15880b tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07f91cbf86a444fb06e050d4c4532fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c47b977a1334cd486385213ff23de86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:12.692187 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5b3d64be-a77b-4fbd-b74b-49149f15880b tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 200 len: 1525 microversion: 2.1 time: 0.255317 Jun 20 12:11:12.696684 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1593/3118] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:12 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 1525 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:12.751560 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-eb643624-b66d-4845-bb11-42927d26188c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:12.753092 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-eb643624-b66d-4845-bb11-42927d26188c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 7014bfb5-b083-485f-9711-b7cc95634c41] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:12.760091 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb643624-b66d-4845-bb11-42927d26188c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:12.761142 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb643624-b66d-4845-bb11-42927d26188c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:12.761994 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb643624-b66d-4845-bb11-42927d26188c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:12.762631 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb643624-b66d-4845-bb11-42927d26188c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:12.780259 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-71bcd3ad-6870-4712-922e-e5f0595e9189 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:12.792457 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-71bcd3ad-6870-4712-922e-e5f0595e9189 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:12.794392 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-71bcd3ad-6870-4712-922e-e5f0595e9189 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:12.795675 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-71bcd3ad-6870-4712-922e-e5f0595e9189 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1875 microversion: 2.32 time: 0.282331 Jun 20 12:11:12.796502 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1526/3119] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:12 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1875 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:11:12.800123 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb643624-b66d-4845-bb11-42927d26188c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:12.800630 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb643624-b66d-4845-bb11-42927d26188c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:12.801287 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-eb643624-b66d-4845-bb11-42927d26188c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lazy-loading 'fault' on Instance uuid 7014bfb5-b083-485f-9711-b7cc95634c41 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:11:12.803356 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fbae9fd6-c24b-400b-8560-0cb4f23c4462 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:12.804039 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fbae9fd6-c24b-400b-8560-0cb4f23c4462 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:12.812287 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fbae9fd6-c24b-400b-8560-0cb4f23c4462 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:12.812738 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fbae9fd6-c24b-400b-8560-0cb4f23c4462 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:12.813538 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fbae9fd6-c24b-400b-8560-0cb4f23c4462 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:12.813977 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fbae9fd6-c24b-400b-8560-0cb4f23c4462 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:12.857035 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-eb643624-b66d-4845-bb11-42927d26188c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:12.865151 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-eb643624-b66d-4845-bb11-42927d26188c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41" status: 200 len: 1315 microversion: 2.1 time: 0.118454 Jun 20 12:11:12.866094 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1594/3120] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:12 2022] GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41 => generated 1315 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:12.891955 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fbae9fd6-c24b-400b-8560-0cb4f23c4462 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:12.901066 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fbae9fd6-c24b-400b-8560-0cb4f23c4462 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:12.902757 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fbae9fd6-c24b-400b-8560-0cb4f23c4462 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:12.909451 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fbae9fd6-c24b-400b-8560-0cb4f23c4462 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1447 microversion: 2.75 time: 0.109645 Jun 20 12:11:12.909451 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1527/3121] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:12 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1447 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:13.094904 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-99bd46f2-5292-4f07-b9c4-aa7c03e68fd2 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:13.096655 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-99bd46f2-5292-4f07-b9c4-aa7c03e68fd2 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:13.103453 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-99bd46f2-5292-4f07-b9c4-aa7c03e68fd2 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:13.104342 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-99bd46f2-5292-4f07-b9c4-aa7c03e68fd2 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:13.105221 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-99bd46f2-5292-4f07-b9c4-aa7c03e68fd2 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:13.105894 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-99bd46f2-5292-4f07-b9c4-aa7c03e68fd2 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:13.257904 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-99bd46f2-5292-4f07-b9c4-aa7c03e68fd2 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:13.266200 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-99bd46f2-5292-4f07-b9c4-aa7c03e68fd2 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1519 microversion: 2.1 time: 0.177713 Jun 20 12:11:13.267653 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1595/3122] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:13 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1519 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:13.306625 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-842f7517-dc43-4ed1-81d9-6eece266a518 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:13.307516 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-842f7517-dc43-4ed1-81d9-6eece266a518 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:13.319041 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-842f7517-dc43-4ed1-81d9-6eece266a518 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:13.319635 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-842f7517-dc43-4ed1-81d9-6eece266a518 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:13.320679 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-842f7517-dc43-4ed1-81d9-6eece266a518 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:13.321222 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-842f7517-dc43-4ed1-81d9-6eece266a518 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:13.373172 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8ad7ff02-ae6d-4e2a-8f53-af629b31c259 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:13.373774 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8ad7ff02-ae6d-4e2a-8f53-af629b31c259 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:13.380261 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8ad7ff02-ae6d-4e2a-8f53-af629b31c259 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:13.380716 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8ad7ff02-ae6d-4e2a-8f53-af629b31c259 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:13.381490 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8ad7ff02-ae6d-4e2a-8f53-af629b31c259 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:13.381985 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8ad7ff02-ae6d-4e2a-8f53-af629b31c259 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:13.470139 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-842f7517-dc43-4ed1-81d9-6eece266a518 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:13.480865 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-842f7517-dc43-4ed1-81d9-6eece266a518 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1517 microversion: 2.1 time: 0.180537 Jun 20 12:11:13.481471 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1528/3123] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:13 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1517 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:11:13.547071 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8ad7ff02-ae6d-4e2a-8f53-af629b31c259 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:13.555151 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8ad7ff02-ae6d-4e2a-8f53-af629b31c259 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1470 microversion: 2.1 time: 0.186126 Jun 20 12:11:13.555775 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1596/3124] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:13 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1470 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:13.711882 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3a7b1e0c-7cf8-4aad-8ff6-210d7035eb1c tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:13.712525 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3a7b1e0c-7cf8-4aad-8ff6-210d7035eb1c tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:13.719348 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3a7b1e0c-7cf8-4aad-8ff6-210d7035eb1c tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:13.719730 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3a7b1e0c-7cf8-4aad-8ff6-210d7035eb1c tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:13.720789 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3a7b1e0c-7cf8-4aad-8ff6-210d7035eb1c tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:13.721219 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3a7b1e0c-7cf8-4aad-8ff6-210d7035eb1c tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:13.816356 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-77ba90f6-2381-45a5-991b-634a98091dda tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:13.817669 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-77ba90f6-2381-45a5-991b-634a98091dda tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:13.824523 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-77ba90f6-2381-45a5-991b-634a98091dda tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:13.825251 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-77ba90f6-2381-45a5-991b-634a98091dda tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:13.826118 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-77ba90f6-2381-45a5-991b-634a98091dda tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:13.826772 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-77ba90f6-2381-45a5-991b-634a98091dda tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:13.972648 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3a7b1e0c-7cf8-4aad-8ff6-210d7035eb1c tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07f91cbf86a444fb06e050d4c4532fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c47b977a1334cd486385213ff23de86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:13.985923 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3a7b1e0c-7cf8-4aad-8ff6-210d7035eb1c tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 200 len: 1525 microversion: 2.1 time: 0.278286 Jun 20 12:11:13.997330 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1529/3125] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:13 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 1525 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:14.002531 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-368ffc4c-1ac6-4280-b7f3-4df2962b9a4f tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:14.003314 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-368ffc4c-1ac6-4280-b7f3-4df2962b9a4f tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 7014bfb5-b083-485f-9711-b7cc95634c41] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:14.011674 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-368ffc4c-1ac6-4280-b7f3-4df2962b9a4f tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:14.012469 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-368ffc4c-1ac6-4280-b7f3-4df2962b9a4f tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:14.014343 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-368ffc4c-1ac6-4280-b7f3-4df2962b9a4f tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:14.015281 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-368ffc4c-1ac6-4280-b7f3-4df2962b9a4f tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:14.083671 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-368ffc4c-1ac6-4280-b7f3-4df2962b9a4f tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:14.084125 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-368ffc4c-1ac6-4280-b7f3-4df2962b9a4f tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:14.087565 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-368ffc4c-1ac6-4280-b7f3-4df2962b9a4f tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lazy-loading 'fault' on Instance uuid 7014bfb5-b083-485f-9711-b7cc95634c41 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:11:14.126418 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-77ba90f6-2381-45a5-991b-634a98091dda tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:14.136543 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-77ba90f6-2381-45a5-991b-634a98091dda tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:14.138322 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-77ba90f6-2381-45a5-991b-634a98091dda tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:14.139635 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-77ba90f6-2381-45a5-991b-634a98091dda tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 2827 microversion: 2.32 time: 0.328473 Jun 20 12:11:14.140240 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1597/3126] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:13 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 2827 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:11:14.146212 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-03e4743e-adb9-4f7f-a49e-c67b688db788 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:14.147110 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-03e4743e-adb9-4f7f-a49e-c67b688db788 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:14.153849 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-03e4743e-adb9-4f7f-a49e-c67b688db788 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:14.154823 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-03e4743e-adb9-4f7f-a49e-c67b688db788 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:14.155940 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-03e4743e-adb9-4f7f-a49e-c67b688db788 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:14.156419 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-03e4743e-adb9-4f7f-a49e-c67b688db788 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:14.174326 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:11:14.229806 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-03e4743e-adb9-4f7f-a49e-c67b688db788 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:14.239447 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-03e4743e-adb9-4f7f-a49e-c67b688db788 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:14.241071 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-03e4743e-adb9-4f7f-a49e-c67b688db788 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:14.247816 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-03e4743e-adb9-4f7f-a49e-c67b688db788 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1447 microversion: 2.75 time: 0.106268 Jun 20 12:11:14.248669 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1598/3127] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:14 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1447 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:14.253602 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-66703015-a7c7-4fbd-b996-aae414df03e1 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:14.254107 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-66703015-a7c7-4fbd-b996-aae414df03e1 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:14.261459 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66703015-a7c7-4fbd-b996-aae414df03e1 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:14.261906 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66703015-a7c7-4fbd-b996-aae414df03e1 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:14.262741 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66703015-a7c7-4fbd-b996-aae414df03e1 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:14.263207 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66703015-a7c7-4fbd-b996-aae414df03e1 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:14.453287 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-66703015-a7c7-4fbd-b996-aae414df03e1 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.203560 Jun 20 12:11:14.454343 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1599/3128] 10.222.0.27 () {60 vars in 1315 bytes} [Mon Jun 20 12:11:14 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155/os-interface => generated 1829 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:14.460077 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fa7c4068-c006-43d0-a4fd-85c0cbcb33f8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:14.460731 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fa7c4068-c006-43d0-a4fd-85c0cbcb33f8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:14.488306 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fa7c4068-c006-43d0-a4fd-85c0cbcb33f8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:14.489293 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fa7c4068-c006-43d0-a4fd-85c0cbcb33f8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:14.490163 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fa7c4068-c006-43d0-a4fd-85c0cbcb33f8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:14.490908 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fa7c4068-c006-43d0-a4fd-85c0cbcb33f8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:14.510066 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-368ffc4c-1ac6-4280-b7f3-4df2962b9a4f tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:14.513949 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:11:14.522314 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-368ffc4c-1ac6-4280-b7f3-4df2962b9a4f tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41" status: 200 len: 1315 microversion: 2.1 time: 0.523630 Jun 20 12:11:14.526286 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1530/3129] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:13 2022] GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41 => generated 1315 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:14.531992 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-222dd33f-85ba-4d5b-b79c-ee0331850353 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:14.542207 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-222dd33f-85ba-4d5b-b79c-ee0331850353 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:14.558548 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-222dd33f-85ba-4d5b-b79c-ee0331850353 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:14.559076 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-222dd33f-85ba-4d5b-b79c-ee0331850353 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:14.559965 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-222dd33f-85ba-4d5b-b79c-ee0331850353 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:14.562896 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-222dd33f-85ba-4d5b-b79c-ee0331850353 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:14.862186 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-222dd33f-85ba-4d5b-b79c-ee0331850353 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:14.874568 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-222dd33f-85ba-4d5b-b79c-ee0331850353 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1535 microversion: 2.1 time: 0.346658 Jun 20 12:11:14.878269 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1531/3130] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:14 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1535 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:14.881355 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fa7c4068-c006-43d0-a4fd-85c0cbcb33f8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:14.887264 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6c54a2d1-1a71-46b3-82d4-2a792467f719 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:14.888430 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6c54a2d1-1a71-46b3-82d4-2a792467f719 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:14.901540 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fa7c4068-c006-43d0-a4fd-85c0cbcb33f8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1519 microversion: 2.1 time: 0.445684 Jun 20 12:11:14.911740 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6c54a2d1-1a71-46b3-82d4-2a792467f719 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:14.912218 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6c54a2d1-1a71-46b3-82d4-2a792467f719 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:14.913001 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6c54a2d1-1a71-46b3-82d4-2a792467f719 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:14.913759 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1600/3131] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:14 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1519 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:14.920818 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6c54a2d1-1a71-46b3-82d4-2a792467f719 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:15.003500 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-abc3843e-d289-4863-ba8f-d4354ba670a4 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:15.004232 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-abc3843e-d289-4863-ba8f-d4354ba670a4 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:15.018550 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-abc3843e-d289-4863-ba8f-d4354ba670a4 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:15.019110 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-abc3843e-d289-4863-ba8f-d4354ba670a4 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:15.020807 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-abc3843e-d289-4863-ba8f-d4354ba670a4 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:15.022748 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-abc3843e-d289-4863-ba8f-d4354ba670a4 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:15.424226 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-abc3843e-d289-4863-ba8f-d4354ba670a4 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07f91cbf86a444fb06e050d4c4532fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c47b977a1334cd486385213ff23de86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:15.433009 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-abc3843e-d289-4863-ba8f-d4354ba670a4 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 200 len: 1525 microversion: 2.1 time: 0.433941 Jun 20 12:11:15.434165 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1601/3132] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:14 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 1525 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:15.438851 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-27256149-7f27-4ab4-8005-93c8eb11ef77 req-235726ea-7614-435a-a31b-fe09433572f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "593cda12-6491-4a27-8fc7-42c05e0291c3", "tag": "2a9eb762-96f9-45b2-8446-311d784377f5"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:15.448805 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-27256149-7f27-4ab4-8005-93c8eb11ef77 req-235726ea-7614-435a-a31b-fe09433572f0 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:15.449533 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-27256149-7f27-4ab4-8005-93c8eb11ef77 req-235726ea-7614-435a-a31b-fe09433572f0 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:15.463420 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-27256149-7f27-4ab4-8005-93c8eb11ef77 req-235726ea-7614-435a-a31b-fe09433572f0 service nova] Creating event network-changed:2a9eb762-96f9-45b2-8446-311d784377f5 for instance 593cda12-6491-4a27-8fc7-42c05e0291c3 on n-h1-master-1 Jun 20 12:11:15.469912 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-27256149-7f27-4ab4-8005-93c8eb11ef77 req-235726ea-7614-435a-a31b-fe09433572f0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034257 Jun 20 12:11:15.470938 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1602/3133] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:11:15.477463 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-de8020ef-9b16-420d-9ac5-78dcdef289e4 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:15.478353 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-de8020ef-9b16-420d-9ac5-78dcdef289e4 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:15.486023 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-de8020ef-9b16-420d-9ac5-78dcdef289e4 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:15.486897 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-de8020ef-9b16-420d-9ac5-78dcdef289e4 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:15.488860 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-de8020ef-9b16-420d-9ac5-78dcdef289e4 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:15.489652 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-de8020ef-9b16-420d-9ac5-78dcdef289e4 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:15.514531 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6c54a2d1-1a71-46b3-82d4-2a792467f719 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:15.528367 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6c54a2d1-1a71-46b3-82d4-2a792467f719 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1470 microversion: 2.1 time: 0.644499 Jun 20 12:11:15.530042 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1532/3134] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:14 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1470 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:15.544088 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f410fb5c-0f88-48a3-8be4-a540c7abd49e tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:15.547029 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f410fb5c-0f88-48a3-8be4-a540c7abd49e tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 7014bfb5-b083-485f-9711-b7cc95634c41] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:15.560496 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f410fb5c-0f88-48a3-8be4-a540c7abd49e tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:15.562176 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f410fb5c-0f88-48a3-8be4-a540c7abd49e tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:15.562996 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f410fb5c-0f88-48a3-8be4-a540c7abd49e tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:15.565064 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f410fb5c-0f88-48a3-8be4-a540c7abd49e tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:15.589915 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-f410fb5c-0f88-48a3-8be4-a540c7abd49e tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] HTTP exception thrown: Instance 7014bfb5-b083-485f-9711-b7cc95634c41 could not be found. Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f410fb5c-0f88-48a3-8be4-a540c7abd49e tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Request method failure captured: Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41 HTTP/1.1 Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGN4qiwM-MecDHxONzVMkA72NR_SSrElKGFho2amrxg9uMlhFTBY3bq5CJPNlZORM2tW_nQRhsPIUTgettXi4lSiCQeK40e01rW_16Lzz4FJO6EC5uBs_A-i3_njR3_9I2L-oxsuaQd8HwAiDLKOUCEhiwyWJOA1WjMqhqu3KfOGLgY Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 4880e508de374c748670ce9ff5963336 Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4880e508de374c748670ce9ff5963336"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4880e508de374c748670ce9ff5963336"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4880e508de374c748670ce9ff5963336"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4880e508de374c748670ce9ff5963336"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 4880e508de374c748670ce9ff5963336 Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ImagesOneServerNegativeTestJSON-1288781692-project Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 16367ef663a74bd49162b82a7e661d1e Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692-project Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 7014bfb5-b083-485f-9711-b7cc95634c41 could not be found. Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '7014bfb5-b083-485f-9711-b7cc95634c41'} Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7014bfb5-b083-485f-9711-b7cc95634c41 could not be found. Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7014bfb5-b083-485f-9711-b7cc95634c41 could not be found. Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:15.591820 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:15.596673 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:15.596673 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:15.596673 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:15.596673 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:15.596673 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:11:15.596673 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:11:15.596673 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7014bfb5-b083-485f-9711-b7cc95634c41 could not be found. Jun 20 12:11:15.596673 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:15.598209 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f410fb5c-0f88-48a3-8be4-a540c7abd49e tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Returning 404 to user: Instance 7014bfb5-b083-485f-9711-b7cc95634c41 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:11:15.599302 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f410fb5c-0f88-48a3-8be4-a540c7abd49e tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41" status: 404 len: 111 microversion: 2.1 time: 0.059657 Jun 20 12:11:15.610392 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1533/3135] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:15 2022] GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:11:15.625938 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-de8020ef-9b16-420d-9ac5-78dcdef289e4 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:15.639377 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-de8020ef-9b16-420d-9ac5-78dcdef289e4 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:15.642152 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-de8020ef-9b16-420d-9ac5-78dcdef289e4 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:15.650497 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-de8020ef-9b16-420d-9ac5-78dcdef289e4 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1447 microversion: 2.75 time: 0.178001 Jun 20 12:11:15.660866 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1603/3136] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:15 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1447 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:15.759219 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6cefae83-f25e-4263-8671-c93d06da4d1e tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1716842827", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:15.830100 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-6cefae83-f25e-4263-8671-c93d06da4d1e tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] validate_networks() for [('9bb4b974-67e4-46e5-95b7-e1615d1df6f7', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:11:15.895761 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-37badb82-8779-4cad-be3c-1d85846176d5 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:15.896600 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-37badb82-8779-4cad-be3c-1d85846176d5 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:15.904465 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-37badb82-8779-4cad-be3c-1d85846176d5 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:15.905255 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-37badb82-8779-4cad-be3c-1d85846176d5 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:15.906414 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-37badb82-8779-4cad-be3c-1d85846176d5 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:15.907069 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-37badb82-8779-4cad-be3c-1d85846176d5 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:16.117163 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-37badb82-8779-4cad-be3c-1d85846176d5 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:16.132418 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-37badb82-8779-4cad-be3c-1d85846176d5 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1523 microversion: 2.1 time: 0.240765 Jun 20 12:11:16.138894 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1604/3137] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:15 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1523 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:11:16.164325 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9112a4b1-395e-46f5-81fc-6ef031b4acf3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:16.165638 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9112a4b1-395e-46f5-81fc-6ef031b4acf3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:16.176751 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9112a4b1-395e-46f5-81fc-6ef031b4acf3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:16.177384 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9112a4b1-395e-46f5-81fc-6ef031b4acf3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:16.179216 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9112a4b1-395e-46f5-81fc-6ef031b4acf3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:16.179834 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9112a4b1-395e-46f5-81fc-6ef031b4acf3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:16.423675 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9112a4b1-395e-46f5-81fc-6ef031b4acf3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:16.434216 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9112a4b1-395e-46f5-81fc-6ef031b4acf3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1519 microversion: 2.1 time: 0.285313 Jun 20 12:11:16.435179 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1605/3138] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:16 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1519 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:16.440959 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-e6288d04-191a-4b4c-8178-ad03b1c465bb req-33cb3126-5dcd-4ee4-8759-04cc49e77f1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36218945-42bd-45a4-889b-b411acdd4155", "tag": "a3f0416b-e069-41e8-9db8-7e848d1875ab"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:16.450654 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-e6288d04-191a-4b4c-8178-ad03b1c465bb req-33cb3126-5dcd-4ee4-8759-04cc49e77f1e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:16.451544 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-e6288d04-191a-4b4c-8178-ad03b1c465bb req-33cb3126-5dcd-4ee4-8759-04cc49e77f1e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:16.468297 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-e6288d04-191a-4b4c-8178-ad03b1c465bb req-33cb3126-5dcd-4ee4-8759-04cc49e77f1e service nova] Creating event network-changed:a3f0416b-e069-41e8-9db8-7e848d1875ab for instance 36218945-42bd-45a4-889b-b411acdd4155 on n-h1-master-1 Jun 20 12:11:16.475440 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-e6288d04-191a-4b4c-8178-ad03b1c465bb req-33cb3126-5dcd-4ee4-8759-04cc49e77f1e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037863 Jun 20 12:11:16.476461 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1606/3139] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:11:16.487618 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8749d4d0-d67d-4ee0-a4fe-6dd9adf30403 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:16.490348 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8749d4d0-d67d-4ee0-a4fe-6dd9adf30403 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:16.501588 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8749d4d0-d67d-4ee0-a4fe-6dd9adf30403 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:16.506181 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8749d4d0-d67d-4ee0-a4fe-6dd9adf30403 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:16.508562 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8749d4d0-d67d-4ee0-a4fe-6dd9adf30403 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:16.511085 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8749d4d0-d67d-4ee0-a4fe-6dd9adf30403 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:16.798890 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8749d4d0-d67d-4ee0-a4fe-6dd9adf30403 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07f91cbf86a444fb06e050d4c4532fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c47b977a1334cd486385213ff23de86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:16.807965 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8749d4d0-d67d-4ee0-a4fe-6dd9adf30403 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 200 len: 1525 microversion: 2.1 time: 0.330017 Jun 20 12:11:16.821642 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1607/3140] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:16 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 1525 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:16.838975 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8a08b041-8c55-463b-902d-ace16b2cbc5b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:16.840382 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8a08b041-8c55-463b-902d-ace16b2cbc5b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:16.852726 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a08b041-8c55-463b-902d-ace16b2cbc5b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:16.853710 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a08b041-8c55-463b-902d-ace16b2cbc5b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:16.857684 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a08b041-8c55-463b-902d-ace16b2cbc5b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:16.858400 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a08b041-8c55-463b-902d-ace16b2cbc5b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:17.370214 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-6cefae83-f25e-4263-8671-c93d06da4d1e tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:11:17.371788 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-6cefae83-f25e-4263-8671-c93d06da4d1e tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:11:17.372314 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-6cefae83-f25e-4263-8671-c93d06da4d1e tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:11:17.372732 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-6cefae83-f25e-4263-8671-c93d06da4d1e tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:11:17.373474 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-6cefae83-f25e-4263-8671-c93d06da4d1e tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:11:17.386774 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6cefae83-f25e-4263-8671-c93d06da4d1e tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:17.394211 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6cefae83-f25e-4263-8671-c93d06da4d1e tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:17.395600 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6cefae83-f25e-4263-8671-c93d06da4d1e tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:17.396283 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6cefae83-f25e-4263-8671-c93d06da4d1e tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:17.438603 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-6cefae83-f25e-4263-8671-c93d06da4d1e tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Getting quotas for project 4880e508de374c748670ce9ff5963336. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:11:17.454415 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-6cefae83-f25e-4263-8671-c93d06da4d1e tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Getting quotas for user 16367ef663a74bd49162b82a7e661d1e and project 4880e508de374c748670ce9ff5963336. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:11:17.489036 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6cefae83-f25e-4263-8671-c93d06da4d1e tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:11:17.492040 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6cefae83-f25e-4263-8671-c93d06da4d1e tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 9df7a71a-0efc-4929-888a-783e6fded5f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:11:17.644132 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6cefae83-f25e-4263-8671-c93d06da4d1e tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.893866 Jun 20 12:11:17.645630 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1534/3141] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:11:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 1896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 12:11:17.659778 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3ef0d0be-9da3-4224-a788-3fb01a2600c3 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:17.660975 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3ef0d0be-9da3-4224-a788-3fb01a2600c3 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:17.674014 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3ef0d0be-9da3-4224-a788-3fb01a2600c3 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:17.674927 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3ef0d0be-9da3-4224-a788-3fb01a2600c3 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:17.678437 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3ef0d0be-9da3-4224-a788-3fb01a2600c3 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:17.679263 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3ef0d0be-9da3-4224-a788-3fb01a2600c3 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:17.933549 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3ef0d0be-9da3-4224-a788-3fb01a2600c3 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:17.956050 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3ef0d0be-9da3-4224-a788-3fb01a2600c3 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:17.961989 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3ef0d0be-9da3-4224-a788-3fb01a2600c3 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:17.990454 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3ef0d0be-9da3-4224-a788-3fb01a2600c3 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1447 microversion: 2.75 time: 0.330647 Jun 20 12:11:17.998192 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1535/3142] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:17 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1447 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:18.007601 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4707e153-1cbf-4c64-baf1-ee62df631e18 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:18.020560 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4707e153-1cbf-4c64-baf1-ee62df631e18 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:18.039391 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4707e153-1cbf-4c64-baf1-ee62df631e18 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:18.040886 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4707e153-1cbf-4c64-baf1-ee62df631e18 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:18.043343 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4707e153-1cbf-4c64-baf1-ee62df631e18 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:18.043853 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4707e153-1cbf-4c64-baf1-ee62df631e18 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:18.065094 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8a08b041-8c55-463b-902d-ace16b2cbc5b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:18.078102 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8a08b041-8c55-463b-902d-ace16b2cbc5b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1470 microversion: 2.1 time: 1.254253 Jun 20 12:11:18.090025 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1608/3143] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:16 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1470 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:18.111195 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-7b89c505-127f-44e7-b969-43ecb45cdc45 req-335a9d39-908d-4a4e-a7eb-072d235fa3c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31440c3e-bac0-437b-acd0-97351ddaae67", "name": "network-vif-unplugged", "status": "completed", "tag": "63464faa-0494-41e3-88aa-fae7ed2a5773"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:18.122096 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-7b89c505-127f-44e7-b969-43ecb45cdc45 req-335a9d39-908d-4a4e-a7eb-072d235fa3c9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:18.125946 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-7b89c505-127f-44e7-b969-43ecb45cdc45 req-335a9d39-908d-4a4e-a7eb-072d235fa3c9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:18.146970 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-7b89c505-127f-44e7-b969-43ecb45cdc45 req-335a9d39-908d-4a4e-a7eb-072d235fa3c9 service nova] Creating event network-vif-unplugged:63464faa-0494-41e3-88aa-fae7ed2a5773 for instance 31440c3e-bac0-437b-acd0-97351ddaae67 on n-h2-master-1 Jun 20 12:11:18.153715 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-7b89c505-127f-44e7-b969-43ecb45cdc45 req-335a9d39-908d-4a4e-a7eb-072d235fa3c9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059678 Jun 20 12:11:18.156518 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1609/3144] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:11:18.173183 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b32c8115-fa09-4917-9b0b-7a338d4eeda3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:18.174389 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b32c8115-fa09-4917-9b0b-7a338d4eeda3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:18.190492 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b32c8115-fa09-4917-9b0b-7a338d4eeda3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:18.193306 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b32c8115-fa09-4917-9b0b-7a338d4eeda3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:18.198499 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b32c8115-fa09-4917-9b0b-7a338d4eeda3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:18.199265 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b32c8115-fa09-4917-9b0b-7a338d4eeda3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:18.641640 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b32c8115-fa09-4917-9b0b-7a338d4eeda3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:18.668326 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b32c8115-fa09-4917-9b0b-7a338d4eeda3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1519 microversion: 2.1 time: 0.509987 Jun 20 12:11:18.670240 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1610/3145] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:18 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1519 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:18.691169 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-09bb4dc9-ac02-484a-be52-d0d537022ff0 req-81111436-025f-403e-808f-ed14ae68933b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4404478d-26ca-49d1-a629-8cecf8b967a1", "name": "network-vif-unplugged", "status": "completed", "tag": "5dd43a26-552a-45c5-9e58-286e7499c6c8"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:18.717331 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-09bb4dc9-ac02-484a-be52-d0d537022ff0 req-81111436-025f-403e-808f-ed14ae68933b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:18.718239 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-09bb4dc9-ac02-484a-be52-d0d537022ff0 req-81111436-025f-403e-808f-ed14ae68933b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:18.760317 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-09bb4dc9-ac02-484a-be52-d0d537022ff0 req-81111436-025f-403e-808f-ed14ae68933b service nova] Creating event network-vif-unplugged:5dd43a26-552a-45c5-9e58-286e7499c6c8 for instance 4404478d-26ca-49d1-a629-8cecf8b967a1 on n-h1-master-1 Jun 20 12:11:18.770262 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [req-09bb4dc9-ac02-484a-be52-d0d537022ff0 req-81111436-025f-403e-808f-ed14ae68933b service nova] Instance 4404478d-26ca-49d1-a629-8cecf8b967a1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119127) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:11:18.787944 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-09bb4dc9-ac02-484a-be52-d0d537022ff0 req-81111436-025f-403e-808f-ed14ae68933b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111445 Jun 20 12:11:18.789250 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1611/3146] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:11:18.796822 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-41c9999e-b365-4245-8b2a-86ec42a7dfef tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:18.798706 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-41c9999e-b365-4245-8b2a-86ec42a7dfef tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 9df7a71a-0efc-4929-888a-783e6fded5f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:18.806657 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-41c9999e-b365-4245-8b2a-86ec42a7dfef tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:18.807404 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-41c9999e-b365-4245-8b2a-86ec42a7dfef tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:18.808494 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-41c9999e-b365-4245-8b2a-86ec42a7dfef tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:18.809138 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-41c9999e-b365-4245-8b2a-86ec42a7dfef tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:18.993164 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-41c9999e-b365-4245-8b2a-86ec42a7dfef tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:19.037068 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-41c9999e-b365-4245-8b2a-86ec42a7dfef tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2" status: 200 len: 1221 microversion: 2.1 time: 0.245405 Jun 20 12:11:19.051254 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1612/3147] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:18 2022] GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2 => generated 1221 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:19.063380 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9fa04473-01a7-435c-bdff-8785dd92c465 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:19.064170 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9fa04473-01a7-435c-bdff-8785dd92c465 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:19.080023 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9fa04473-01a7-435c-bdff-8785dd92c465 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:19.089522 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9fa04473-01a7-435c-bdff-8785dd92c465 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:19.092803 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9fa04473-01a7-435c-bdff-8785dd92c465 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:19.093630 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9fa04473-01a7-435c-bdff-8785dd92c465 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:19.335636 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9fa04473-01a7-435c-bdff-8785dd92c465 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07f91cbf86a444fb06e050d4c4532fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c47b977a1334cd486385213ff23de86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:19.350324 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9fa04473-01a7-435c-bdff-8785dd92c465 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 200 len: 1525 microversion: 2.1 time: 0.297554 Jun 20 12:11:19.351258 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1613/3148] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:19 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 1525 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:19.356836 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ed921df9-2427-4d41-8860-301d6fb3115f tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:19.357785 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ed921df9-2427-4d41-8860-301d6fb3115f tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:19.365486 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ed921df9-2427-4d41-8860-301d6fb3115f tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:19.365981 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ed921df9-2427-4d41-8860-301d6fb3115f tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:19.366739 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ed921df9-2427-4d41-8860-301d6fb3115f tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:19.367361 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ed921df9-2427-4d41-8860-301d6fb3115f tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:19.467738 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ed921df9-2427-4d41-8860-301d6fb3115f tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:19.481497 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ed921df9-2427-4d41-8860-301d6fb3115f tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:19.484661 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ed921df9-2427-4d41-8860-301d6fb3115f tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:19.491855 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ed921df9-2427-4d41-8860-301d6fb3115f tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1447 microversion: 2.75 time: 0.139278 Jun 20 12:11:19.493376 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1614/3149] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:19 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1447 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:19.499690 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-17658cc7-3b2e-4aee-abb5-76aaddb83eb4 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:19.500740 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-17658cc7-3b2e-4aee-abb5-76aaddb83eb4 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:19.509002 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4707e153-1cbf-4c64-baf1-ee62df631e18 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:19.510327 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17658cc7-3b2e-4aee-abb5-76aaddb83eb4 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:19.511023 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17658cc7-3b2e-4aee-abb5-76aaddb83eb4 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:19.512122 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17658cc7-3b2e-4aee-abb5-76aaddb83eb4 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:19.512815 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17658cc7-3b2e-4aee-abb5-76aaddb83eb4 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:19.544881 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4707e153-1cbf-4c64-baf1-ee62df631e18 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1523 microversion: 2.1 time: 1.538089 Jun 20 12:11:19.545553 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1536/3150] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:17 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1523 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:19.690618 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-28740f16-a81d-4eb4-9a7e-806834539000 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:19.691501 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-28740f16-a81d-4eb4-9a7e-806834539000 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:19.710137 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-28740f16-a81d-4eb4-9a7e-806834539000 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:19.717918 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-28740f16-a81d-4eb4-9a7e-806834539000 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:19.720002 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-28740f16-a81d-4eb4-9a7e-806834539000 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:19.728509 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-28740f16-a81d-4eb4-9a7e-806834539000 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:19.818867 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-17658cc7-3b2e-4aee-abb5-76aaddb83eb4 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:19.835666 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-17658cc7-3b2e-4aee-abb5-76aaddb83eb4 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1470 microversion: 2.1 time: 0.340865 Jun 20 12:11:19.836945 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1615/3151] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:19 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1470 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:20.058984 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fa2b9f5f-8f3e-4533-adcb-27c621b7d8e4 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:20.061077 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fa2b9f5f-8f3e-4533-adcb-27c621b7d8e4 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 9df7a71a-0efc-4929-888a-783e6fded5f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:20.064513 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-28740f16-a81d-4eb4-9a7e-806834539000 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:20.078000 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-28740f16-a81d-4eb4-9a7e-806834539000 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1519 microversion: 2.1 time: 0.392278 Jun 20 12:11:20.079116 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1537/3152] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:19 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1519 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:20.081454 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fa2b9f5f-8f3e-4533-adcb-27c621b7d8e4 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:20.081986 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fa2b9f5f-8f3e-4533-adcb-27c621b7d8e4 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:20.086302 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fa2b9f5f-8f3e-4533-adcb-27c621b7d8e4 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:20.086926 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fa2b9f5f-8f3e-4533-adcb-27c621b7d8e4 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:20.184750 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fa2b9f5f-8f3e-4533-adcb-27c621b7d8e4 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:20.194317 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fa2b9f5f-8f3e-4533-adcb-27c621b7d8e4 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2" status: 200 len: 1285 microversion: 2.1 time: 0.139740 Jun 20 12:11:20.195262 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1616/3153] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:20 2022] GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2 => generated 1285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:11:20.370904 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8e2aaf04-43a9-4fa0-b4eb-8a810a9632a2 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:20.372085 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8e2aaf04-43a9-4fa0-b4eb-8a810a9632a2 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:20.409652 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e2aaf04-43a9-4fa0-b4eb-8a810a9632a2 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:20.412671 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e2aaf04-43a9-4fa0-b4eb-8a810a9632a2 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:20.417413 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e2aaf04-43a9-4fa0-b4eb-8a810a9632a2 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:20.420818 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e2aaf04-43a9-4fa0-b4eb-8a810a9632a2 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:20.519422 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3a57a012-74a2-463c-8c41-dd42d7e2108d tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:20.520029 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3a57a012-74a2-463c-8c41-dd42d7e2108d tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:20.536161 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a57a012-74a2-463c-8c41-dd42d7e2108d tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:20.536992 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a57a012-74a2-463c-8c41-dd42d7e2108d tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:20.538243 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a57a012-74a2-463c-8c41-dd42d7e2108d tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:20.538863 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a57a012-74a2-463c-8c41-dd42d7e2108d tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:20.665117 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3a57a012-74a2-463c-8c41-dd42d7e2108d tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:20.669711 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:11:20.687870 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3a57a012-74a2-463c-8c41-dd42d7e2108d tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:20.690293 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3a57a012-74a2-463c-8c41-dd42d7e2108d tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:20.703008 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3a57a012-74a2-463c-8c41-dd42d7e2108d tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1453 microversion: 2.75 time: 0.187827 Jun 20 12:11:20.717224 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1617/3154] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:20 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1453 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:11:20.719288 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f7d5d120-cc33-47ec-b66e-74c8b861ad54 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:20.721206 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f7d5d120-cc33-47ec-b66e-74c8b861ad54 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:20.733408 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f7d5d120-cc33-47ec-b66e-74c8b861ad54 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:20.733977 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f7d5d120-cc33-47ec-b66e-74c8b861ad54 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:20.752262 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f7d5d120-cc33-47ec-b66e-74c8b861ad54 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:20.753027 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f7d5d120-cc33-47ec-b66e-74c8b861ad54 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:21.051657 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8e2aaf04-43a9-4fa0-b4eb-8a810a9632a2 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07f91cbf86a444fb06e050d4c4532fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c47b977a1334cd486385213ff23de86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:21.065487 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8e2aaf04-43a9-4fa0-b4eb-8a810a9632a2 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 200 len: 1525 microversion: 2.1 time: 0.699361 Jun 20 12:11:21.066867 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1538/3155] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:20 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 1525 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:21.072424 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0b79dca8-a1c4-49dd-aca5-1c3e480154a1 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:21.073466 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0b79dca8-a1c4-49dd-aca5-1c3e480154a1 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:21.082385 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0b79dca8-a1c4-49dd-aca5-1c3e480154a1 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:21.083084 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0b79dca8-a1c4-49dd-aca5-1c3e480154a1 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:21.084091 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0b79dca8-a1c4-49dd-aca5-1c3e480154a1 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:21.084579 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0b79dca8-a1c4-49dd-aca5-1c3e480154a1 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:21.151627 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f7d5d120-cc33-47ec-b66e-74c8b861ad54 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:21.187447 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f7d5d120-cc33-47ec-b66e-74c8b861ad54 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1523 microversion: 2.1 time: 0.471273 Jun 20 12:11:21.188272 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1618/3156] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:20 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1523 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:21.222209 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1cd4ecf9-db8e-4be8-8944-a8c12ab994e4 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:21.223208 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1cd4ecf9-db8e-4be8-8944-a8c12ab994e4 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:21.232161 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1cd4ecf9-db8e-4be8-8944-a8c12ab994e4 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:21.232968 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1cd4ecf9-db8e-4be8-8944-a8c12ab994e4 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:21.233921 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1cd4ecf9-db8e-4be8-8944-a8c12ab994e4 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:21.234530 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1cd4ecf9-db8e-4be8-8944-a8c12ab994e4 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:21.573403 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1cd4ecf9-db8e-4be8-8944-a8c12ab994e4 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:21.592663 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1cd4ecf9-db8e-4be8-8944-a8c12ab994e4 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1519 microversion: 2.1 time: 0.403204 Jun 20 12:11:21.593266 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1619/3157] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:21 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1519 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:21.627497 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-81090cfb-eab0-492b-9598-41fad03c8f3c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:21.629374 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-81090cfb-eab0-492b-9598-41fad03c8f3c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 9df7a71a-0efc-4929-888a-783e6fded5f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:21.653740 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-81090cfb-eab0-492b-9598-41fad03c8f3c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:21.654584 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-81090cfb-eab0-492b-9598-41fad03c8f3c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:21.655639 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-81090cfb-eab0-492b-9598-41fad03c8f3c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:21.656281 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-81090cfb-eab0-492b-9598-41fad03c8f3c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:21.740472 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-81090cfb-eab0-492b-9598-41fad03c8f3c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:21.749523 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-81090cfb-eab0-492b-9598-41fad03c8f3c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2" status: 200 len: 1283 microversion: 2.1 time: 0.151783 Jun 20 12:11:21.753154 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1620/3158] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:21 2022] GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2 => generated 1283 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:21.760851 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-8fb4f673-bfbf-48eb-a592-9da9fe9469df req-857be519-544a-4ada-ad5e-f21c1d5d2975 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4404478d-26ca-49d1-a629-8cecf8b967a1", "tag": "5dd43a26-552a-45c5-9e58-286e7499c6c8"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:21.785948 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-8fb4f673-bfbf-48eb-a592-9da9fe9469df req-857be519-544a-4ada-ad5e-f21c1d5d2975 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:21.786534 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-8fb4f673-bfbf-48eb-a592-9da9fe9469df req-857be519-544a-4ada-ad5e-f21c1d5d2975 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:21.819138 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-8fb4f673-bfbf-48eb-a592-9da9fe9469df req-857be519-544a-4ada-ad5e-f21c1d5d2975 service nova] Creating event network-changed:5dd43a26-552a-45c5-9e58-286e7499c6c8 for instance 4404478d-26ca-49d1-a629-8cecf8b967a1 on n-h1-master-1 Jun 20 12:11:21.826611 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [req-8fb4f673-bfbf-48eb-a592-9da9fe9469df req-857be519-544a-4ada-ad5e-f21c1d5d2975 service nova] Instance 4404478d-26ca-49d1-a629-8cecf8b967a1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119127) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:11:21.840414 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-8fb4f673-bfbf-48eb-a592-9da9fe9469df req-857be519-544a-4ada-ad5e-f21c1d5d2975 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085845 Jun 20 12:11:21.841118 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1621/3159] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:11:21.850690 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-db142a41-ec19-419f-be5b-377fb82bf791 req-6ddb3f21-46e0-4e6c-962a-b69cb06b7976 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31440c3e-bac0-437b-acd0-97351ddaae67", "name": "network-vif-plugged", "status": "completed", "tag": "63464faa-0494-41e3-88aa-fae7ed2a5773"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:21.864929 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-db142a41-ec19-419f-be5b-377fb82bf791 req-6ddb3f21-46e0-4e6c-962a-b69cb06b7976 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:21.866523 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-db142a41-ec19-419f-be5b-377fb82bf791 req-6ddb3f21-46e0-4e6c-962a-b69cb06b7976 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:21.890209 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-db142a41-ec19-419f-be5b-377fb82bf791 req-6ddb3f21-46e0-4e6c-962a-b69cb06b7976 service nova] Creating event network-vif-plugged:63464faa-0494-41e3-88aa-fae7ed2a5773 for instance 31440c3e-bac0-437b-acd0-97351ddaae67 on n-h2-master-1 Jun 20 12:11:21.899527 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-db142a41-ec19-419f-be5b-377fb82bf791 req-6ddb3f21-46e0-4e6c-962a-b69cb06b7976 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056570 Jun 20 12:11:21.901187 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1622/3160] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:11:21.910157 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0b79dca8-a1c4-49dd-aca5-1c3e480154a1 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:21.911333 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-902e6a16-2cf1-45f7-b06b-18407933f1fe tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:21.912488 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-902e6a16-2cf1-45f7-b06b-18407933f1fe tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:21.923524 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0b79dca8-a1c4-49dd-aca5-1c3e480154a1 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1470 microversion: 2.1 time: 0.854026 Jun 20 12:11:21.927083 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-902e6a16-2cf1-45f7-b06b-18407933f1fe tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:21.928069 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-902e6a16-2cf1-45f7-b06b-18407933f1fe tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:21.937747 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1539/3161] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:21 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1470 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:21.938077 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-902e6a16-2cf1-45f7-b06b-18407933f1fe tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:21.938077 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-902e6a16-2cf1-45f7-b06b-18407933f1fe tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:22.083162 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d69317a9-3e2f-4f4f-aa4e-118111b0668d tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:22.084878 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d69317a9-3e2f-4f4f-aa4e-118111b0668d tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:22.091805 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-902e6a16-2cf1-45f7-b06b-18407933f1fe tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:22.102947 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d69317a9-3e2f-4f4f-aa4e-118111b0668d tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:22.103202 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-902e6a16-2cf1-45f7-b06b-18407933f1fe tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:22.104676 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-902e6a16-2cf1-45f7-b06b-18407933f1fe tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:22.112467 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d69317a9-3e2f-4f4f-aa4e-118111b0668d tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:22.117435 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d69317a9-3e2f-4f4f-aa4e-118111b0668d tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:22.118794 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d69317a9-3e2f-4f4f-aa4e-118111b0668d tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:22.129498 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-902e6a16-2cf1-45f7-b06b-18407933f1fe tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1453 microversion: 2.75 time: 0.226768 Jun 20 12:11:22.142215 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1623/3162] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:21 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1453 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:22.210124 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-20e89cc9-5612-4222-ba9c-908a4e8a9b35 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:22.210798 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-20e89cc9-5612-4222-ba9c-908a4e8a9b35 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:22.214147 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:11:22.224640 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-20e89cc9-5612-4222-ba9c-908a4e8a9b35 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:22.228961 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-20e89cc9-5612-4222-ba9c-908a4e8a9b35 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:22.229871 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-20e89cc9-5612-4222-ba9c-908a4e8a9b35 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:22.232953 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-20e89cc9-5612-4222-ba9c-908a4e8a9b35 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:22.374607 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d69317a9-3e2f-4f4f-aa4e-118111b0668d tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07f91cbf86a444fb06e050d4c4532fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c47b977a1334cd486385213ff23de86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:22.387446 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d69317a9-3e2f-4f4f-aa4e-118111b0668d tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 200 len: 1525 microversion: 2.1 time: 0.308476 Jun 20 12:11:22.393136 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1540/3163] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:22 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 1525 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:11:22.428759 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-20e89cc9-5612-4222-ba9c-908a4e8a9b35 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:22.440855 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-20e89cc9-5612-4222-ba9c-908a4e8a9b35 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1523 microversion: 2.1 time: 0.235983 Jun 20 12:11:22.442417 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1624/3164] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:22 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1523 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:11:22.609836 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f23515cd-c23a-45db-9ceb-1a11f42797aa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:22.610826 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f23515cd-c23a-45db-9ceb-1a11f42797aa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:22.617625 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f23515cd-c23a-45db-9ceb-1a11f42797aa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:22.618167 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f23515cd-c23a-45db-9ceb-1a11f42797aa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:22.619010 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f23515cd-c23a-45db-9ceb-1a11f42797aa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:22.619514 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f23515cd-c23a-45db-9ceb-1a11f42797aa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:22.771118 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-235cc471-22da-48e4-82ce-a3364af90905 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:22.771773 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-235cc471-22da-48e4-82ce-a3364af90905 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 9df7a71a-0efc-4929-888a-783e6fded5f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:22.778700 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f23515cd-c23a-45db-9ceb-1a11f42797aa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:22.791590 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f23515cd-c23a-45db-9ceb-1a11f42797aa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1519 microversion: 2.1 time: 0.183286 Jun 20 12:11:22.793823 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1541/3165] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:22 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1519 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:22.796374 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-235cc471-22da-48e4-82ce-a3364af90905 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:22.797178 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-235cc471-22da-48e4-82ce-a3364af90905 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:22.798271 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-235cc471-22da-48e4-82ce-a3364af90905 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:22.798754 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-235cc471-22da-48e4-82ce-a3364af90905 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:22.947286 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-eae85313-d3d6-4842-a2fa-bc610210e493 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:22.948620 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-eae85313-d3d6-4842-a2fa-bc610210e493 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:22.967948 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eae85313-d3d6-4842-a2fa-bc610210e493 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:22.968940 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eae85313-d3d6-4842-a2fa-bc610210e493 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:22.970060 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eae85313-d3d6-4842-a2fa-bc610210e493 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:22.970925 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eae85313-d3d6-4842-a2fa-bc610210e493 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:23.044932 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-235cc471-22da-48e4-82ce-a3364af90905 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:23.056272 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-235cc471-22da-48e4-82ce-a3364af90905 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2" status: 200 len: 1325 microversion: 2.1 time: 0.289014 Jun 20 12:11:23.066117 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1625/3166] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:22 2022] GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2 => generated 1325 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:11:23.149285 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c311caa9-bde1-480a-8bfa-fe2fdef49ad5 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:23.149908 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c311caa9-bde1-480a-8bfa-fe2fdef49ad5 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:23.156828 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c311caa9-bde1-480a-8bfa-fe2fdef49ad5 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:23.157182 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c311caa9-bde1-480a-8bfa-fe2fdef49ad5 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:23.158279 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c311caa9-bde1-480a-8bfa-fe2fdef49ad5 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:23.158954 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c311caa9-bde1-480a-8bfa-fe2fdef49ad5 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:23.204066 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-eae85313-d3d6-4842-a2fa-bc610210e493 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:23.213082 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-eae85313-d3d6-4842-a2fa-bc610210e493 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1470 microversion: 2.1 time: 0.270693 Jun 20 12:11:23.214093 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1542/3167] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:22 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1470 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:23.229783 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c311caa9-bde1-480a-8bfa-fe2fdef49ad5 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:23.239038 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c311caa9-bde1-480a-8bfa-fe2fdef49ad5 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:23.240692 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c311caa9-bde1-480a-8bfa-fe2fdef49ad5 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:23.246688 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c311caa9-bde1-480a-8bfa-fe2fdef49ad5 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1453 microversion: 2.75 time: 0.101366 Jun 20 12:11:23.248241 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1626/3168] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:23 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:23.413297 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ffc2064e-cbba-48a1-a810-c2fe382a8b8c tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:23.414924 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ffc2064e-cbba-48a1-a810-c2fe382a8b8c tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:23.422315 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ffc2064e-cbba-48a1-a810-c2fe382a8b8c tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:23.423030 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ffc2064e-cbba-48a1-a810-c2fe382a8b8c tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:23.424680 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ffc2064e-cbba-48a1-a810-c2fe382a8b8c tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:23.425803 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ffc2064e-cbba-48a1-a810-c2fe382a8b8c tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:23.460505 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-18372302-7a5f-4b49-ada4-942e7d49cad8 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:23.461528 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-18372302-7a5f-4b49-ada4-942e7d49cad8 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:23.475046 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-18372302-7a5f-4b49-ada4-942e7d49cad8 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:23.475774 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-18372302-7a5f-4b49-ada4-942e7d49cad8 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:23.476832 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-18372302-7a5f-4b49-ada4-942e7d49cad8 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:23.492534 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-18372302-7a5f-4b49-ada4-942e7d49cad8 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:23.719987 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ffc2064e-cbba-48a1-a810-c2fe382a8b8c tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07f91cbf86a444fb06e050d4c4532fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c47b977a1334cd486385213ff23de86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:23.744790 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ffc2064e-cbba-48a1-a810-c2fe382a8b8c tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 200 len: 1525 microversion: 2.1 time: 0.324741 Jun 20 12:11:23.744790 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1543/3169] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:23 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 1525 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:23.812145 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-530631b0-a051-4b27-9aba-884a0e7f3896 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:23.813014 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-530631b0-a051-4b27-9aba-884a0e7f3896 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:23.829047 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-530631b0-a051-4b27-9aba-884a0e7f3896 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:23.829261 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-530631b0-a051-4b27-9aba-884a0e7f3896 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:23.832469 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-530631b0-a051-4b27-9aba-884a0e7f3896 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:23.841457 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-530631b0-a051-4b27-9aba-884a0e7f3896 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:23.891596 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-18372302-7a5f-4b49-ada4-942e7d49cad8 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:23.934974 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-18372302-7a5f-4b49-ada4-942e7d49cad8 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1523 microversion: 2.1 time: 0.479619 Jun 20 12:11:23.937872 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1627/3170] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:23 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1523 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:24.074928 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-84732de7-21fd-42ca-98e1-b33663301aab tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:24.075543 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-84732de7-21fd-42ca-98e1-b33663301aab tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 9df7a71a-0efc-4929-888a-783e6fded5f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:24.089905 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-84732de7-21fd-42ca-98e1-b33663301aab tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:24.090364 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-84732de7-21fd-42ca-98e1-b33663301aab tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:24.091149 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-84732de7-21fd-42ca-98e1-b33663301aab tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:24.091582 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-84732de7-21fd-42ca-98e1-b33663301aab tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:24.108941 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-530631b0-a051-4b27-9aba-884a0e7f3896 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:24.119764 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-530631b0-a051-4b27-9aba-884a0e7f3896 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1519 microversion: 2.1 time: 0.312008 Jun 20 12:11:24.123297 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1544/3171] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:23 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1519 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:24.230999 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-738fa493-6f5b-40be-8dcb-ffe057f021f0 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:24.231623 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-738fa493-6f5b-40be-8dcb-ffe057f021f0 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:24.241022 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-738fa493-6f5b-40be-8dcb-ffe057f021f0 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:24.241790 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-738fa493-6f5b-40be-8dcb-ffe057f021f0 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:24.242566 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-738fa493-6f5b-40be-8dcb-ffe057f021f0 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:24.243171 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-738fa493-6f5b-40be-8dcb-ffe057f021f0 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:24.336863 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-84732de7-21fd-42ca-98e1-b33663301aab tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:24.350309 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-84732de7-21fd-42ca-98e1-b33663301aab tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2" status: 200 len: 1325 microversion: 2.1 time: 0.279722 Jun 20 12:11:24.352268 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1628/3172] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:24 2022] GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2 => generated 1325 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:24.360282 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ef524bd0-5455-4238-b344-28d5664c53ec tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:24.362358 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ef524bd0-5455-4238-b344-28d5664c53ec tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:24.370212 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef524bd0-5455-4238-b344-28d5664c53ec tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:24.371145 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef524bd0-5455-4238-b344-28d5664c53ec tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:24.372154 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef524bd0-5455-4238-b344-28d5664c53ec tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:24.373445 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef524bd0-5455-4238-b344-28d5664c53ec tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:24.454250 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-738fa493-6f5b-40be-8dcb-ffe057f021f0 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:24.492128 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-738fa493-6f5b-40be-8dcb-ffe057f021f0 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1470 microversion: 2.1 time: 0.263650 Jun 20 12:11:24.506670 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1545/3173] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:24 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1470 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:24.531560 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ef524bd0-5455-4238-b344-28d5664c53ec tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:24.551124 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ef524bd0-5455-4238-b344-28d5664c53ec tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:24.573017 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ef524bd0-5455-4238-b344-28d5664c53ec tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:24.588616 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ef524bd0-5455-4238-b344-28d5664c53ec tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1453 microversion: 2.75 time: 0.226749 Jun 20 12:11:24.594000 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1629/3174] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:24 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1453 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:24.753319 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-69949490-c60f-48cf-9b89-c1e1fa821d0a tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:24.754357 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-69949490-c60f-48cf-9b89-c1e1fa821d0a tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:24.774378 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-69949490-c60f-48cf-9b89-c1e1fa821d0a tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:24.774875 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-69949490-c60f-48cf-9b89-c1e1fa821d0a tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:24.775970 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-69949490-c60f-48cf-9b89-c1e1fa821d0a tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:24.776669 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-69949490-c60f-48cf-9b89-c1e1fa821d0a tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:24.953434 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-94a43349-9146-43f3-8999-1d0009b5f1b6 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:24.954241 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-94a43349-9146-43f3-8999-1d0009b5f1b6 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:24.963682 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-94a43349-9146-43f3-8999-1d0009b5f1b6 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:24.967219 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-94a43349-9146-43f3-8999-1d0009b5f1b6 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:24.968631 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-94a43349-9146-43f3-8999-1d0009b5f1b6 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:24.969219 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-94a43349-9146-43f3-8999-1d0009b5f1b6 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:25.055381 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-69949490-c60f-48cf-9b89-c1e1fa821d0a tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07f91cbf86a444fb06e050d4c4532fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c47b977a1334cd486385213ff23de86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:25.083016 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-69949490-c60f-48cf-9b89-c1e1fa821d0a tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 200 len: 1525 microversion: 2.1 time: 0.334303 Jun 20 12:11:25.094055 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1546/3175] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:24 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 1525 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:25.140039 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-aa0439a5-bca9-47cd-8595-74375edb1285 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:25.140695 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-aa0439a5-bca9-47cd-8595-74375edb1285 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:25.150139 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aa0439a5-bca9-47cd-8595-74375edb1285 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:25.150596 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aa0439a5-bca9-47cd-8595-74375edb1285 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:25.151388 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aa0439a5-bca9-47cd-8595-74375edb1285 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:25.151828 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aa0439a5-bca9-47cd-8595-74375edb1285 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:25.470542 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-aa0439a5-bca9-47cd-8595-74375edb1285 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:25.480501 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-aa0439a5-bca9-47cd-8595-74375edb1285 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1519 microversion: 2.1 time: 0.344422 Jun 20 12:11:25.482985 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1547/3176] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:25 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1519 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:25.495236 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6a0769c0-1f8a-4437-9407-5b1bc98de2bb tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:25.496163 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6a0769c0-1f8a-4437-9407-5b1bc98de2bb tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 9df7a71a-0efc-4929-888a-783e6fded5f2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:25.509807 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a0769c0-1f8a-4437-9407-5b1bc98de2bb tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:25.512869 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a0769c0-1f8a-4437-9407-5b1bc98de2bb tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:25.514087 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a0769c0-1f8a-4437-9407-5b1bc98de2bb tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:25.516863 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a0769c0-1f8a-4437-9407-5b1bc98de2bb tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:25.541822 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-94a43349-9146-43f3-8999-1d0009b5f1b6 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:25.555887 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-94a43349-9146-43f3-8999-1d0009b5f1b6 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1523 microversion: 2.1 time: 0.606494 Jun 20 12:11:25.563885 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1630/3177] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:24 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1523 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:11:25.569248 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-120166df-1fba-41fa-a981-f4a95619df00 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:25.575591 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-120166df-1fba-41fa-a981-f4a95619df00 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:25.606056 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-120166df-1fba-41fa-a981-f4a95619df00 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:25.609013 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-120166df-1fba-41fa-a981-f4a95619df00 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:25.615920 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-120166df-1fba-41fa-a981-f4a95619df00 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:25.616751 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-120166df-1fba-41fa-a981-f4a95619df00 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:26.043248 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6a0769c0-1f8a-4437-9407-5b1bc98de2bb tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:26.047555 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:11:26.053514 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6a0769c0-1f8a-4437-9407-5b1bc98de2bb tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2" status: 200 len: 1325 microversion: 2.1 time: 0.568159 Jun 20 12:11:26.064588 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1548/3178] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:25 2022] GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2 => generated 1325 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:26.079099 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-342125d9-9867-45fc-a32f-57bec9d1ba26 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:26.080315 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-342125d9-9867-45fc-a32f-57bec9d1ba26 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:26.088753 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-342125d9-9867-45fc-a32f-57bec9d1ba26 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:26.098854 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-120166df-1fba-41fa-a981-f4a95619df00 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:26.103615 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-342125d9-9867-45fc-a32f-57bec9d1ba26 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:26.104884 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-342125d9-9867-45fc-a32f-57bec9d1ba26 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:26.113654 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-120166df-1fba-41fa-a981-f4a95619df00 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1470 microversion: 2.1 time: 0.547938 Jun 20 12:11:26.114299 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1631/3179] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:25 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1470 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:26.116147 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-342125d9-9867-45fc-a32f-57bec9d1ba26 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:26.142824 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-55fbb0f0-0c78-442c-9e31-b5fe046f70b1 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:26.147625 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-55fbb0f0-0c78-442c-9e31-b5fe046f70b1 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:26.198410 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-55fbb0f0-0c78-442c-9e31-b5fe046f70b1 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:26.201399 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-55fbb0f0-0c78-442c-9e31-b5fe046f70b1 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:26.202481 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-55fbb0f0-0c78-442c-9e31-b5fe046f70b1 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:26.205224 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-55fbb0f0-0c78-442c-9e31-b5fe046f70b1 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:26.481174 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-342125d9-9867-45fc-a32f-57bec9d1ba26 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:26.497302 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-342125d9-9867-45fc-a32f-57bec9d1ba26 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:26.501363 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-342125d9-9867-45fc-a32f-57bec9d1ba26 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:26.524264 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-342125d9-9867-45fc-a32f-57bec9d1ba26 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1438 microversion: 2.75 time: 0.458177 Jun 20 12:11:26.525191 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1549/3180] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:26 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1438 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:26.528043 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-55fbb0f0-0c78-442c-9e31-b5fe046f70b1 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07f91cbf86a444fb06e050d4c4532fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c47b977a1334cd486385213ff23de86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:26.548980 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f97234b8-004e-40f0-a61e-d525341cd959 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:26.549890 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f97234b8-004e-40f0-a61e-d525341cd959 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:26.553003 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-55fbb0f0-0c78-442c-9e31-b5fe046f70b1 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 200 len: 1525 microversion: 2.1 time: 0.433795 Jun 20 12:11:26.554661 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1632/3181] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:26 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 1525 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:26.593452 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f97234b8-004e-40f0-a61e-d525341cd959 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:26.594318 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f97234b8-004e-40f0-a61e-d525341cd959 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:26.597406 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f97234b8-004e-40f0-a61e-d525341cd959 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:26.600379 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f97234b8-004e-40f0-a61e-d525341cd959 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:27.099895 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-50205c83-2cbc-4379-9233-1bcfce6b8e2d tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:27.103799 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-50205c83-2cbc-4379-9233-1bcfce6b8e2d tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:27.124014 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-50205c83-2cbc-4379-9233-1bcfce6b8e2d tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:27.124700 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-50205c83-2cbc-4379-9233-1bcfce6b8e2d tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:27.129530 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-50205c83-2cbc-4379-9233-1bcfce6b8e2d tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:27.130890 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-50205c83-2cbc-4379-9233-1bcfce6b8e2d tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:27.366930 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-50205c83-2cbc-4379-9233-1bcfce6b8e2d tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:11:27.367365 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-50205c83-2cbc-4379-9233-1bcfce6b8e2d tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:11:27.376584 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-50205c83-2cbc-4379-9233-1bcfce6b8e2d tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:11:27.377792 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-50205c83-2cbc-4379-9233-1bcfce6b8e2d tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:11:27.382006 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-50205c83-2cbc-4379-9233-1bcfce6b8e2d tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:11:27.413423 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f97234b8-004e-40f0-a61e-d525341cd959 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:27.416191 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:11:27.431972 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f97234b8-004e-40f0-a61e-d525341cd959 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1519 microversion: 2.1 time: 0.901423 Jun 20 12:11:27.433362 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1550/3182] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:26 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1519 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:27.443329 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5f562fb2-4734-4d4f-9f53-be7faec4b0b3 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:27.445708 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5f562fb2-4734-4d4f-9f53-be7faec4b0b3 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:27.462672 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5f562fb2-4734-4d4f-9f53-be7faec4b0b3 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:27.464440 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5f562fb2-4734-4d4f-9f53-be7faec4b0b3 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:27.467869 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5f562fb2-4734-4d4f-9f53-be7faec4b0b3 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:27.468849 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5f562fb2-4734-4d4f-9f53-be7faec4b0b3 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:27.475028 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:11:27.547316 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-50205c83-2cbc-4379-9233-1bcfce6b8e2d tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:27.569850 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-50205c83-2cbc-4379-9233-1bcfce6b8e2d tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:27.570526 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-50205c83-2cbc-4379-9233-1bcfce6b8e2d tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:27.574022 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-50205c83-2cbc-4379-9233-1bcfce6b8e2d tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:27.576576 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-50205c83-2cbc-4379-9233-1bcfce6b8e2d tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:27.638019 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:11:27.907985 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-50205c83-2cbc-4379-9233-1bcfce6b8e2d tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lazy-loading 'services' on Instance uuid 3c658f2d-9442-4b10-b5f5-2d484553330e {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:11:27.949878 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5f562fb2-4734-4d4f-9f53-be7faec4b0b3 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:27.950497 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-50205c83-2cbc-4379-9233-1bcfce6b8e2d tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e/action" status: 202 len: 1942 microversion: 2.75 time: 1.384679 Jun 20 12:11:27.960636 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1633/3183] 10.222.0.27 () {62 vars in 1318 bytes} [Mon Jun 20 12:11:26 2022] POST /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e/action => generated 1942 bytes in 1404 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jun 20 12:11:27.962023 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5f562fb2-4734-4d4f-9f53-be7faec4b0b3 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1508 microversion: 2.1 time: 0.527343 Jun 20 12:11:27.963092 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1551/3184] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:27 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1508 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:27.967268 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-56dbd638-b1a2-4a3f-9861-fcbebd69238f tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:27.968511 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-88979adf-ad5c-44e7-9900-dfe330d683ca tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:27.969792 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-88979adf-ad5c-44e7-9900-dfe330d683ca tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:27.973048 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-56dbd638-b1a2-4a3f-9861-fcbebd69238f tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 9df7a71a-0efc-4929-888a-783e6fded5f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:27.984407 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-56dbd638-b1a2-4a3f-9861-fcbebd69238f tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:27.992587 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-56dbd638-b1a2-4a3f-9861-fcbebd69238f tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:27.994917 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-56dbd638-b1a2-4a3f-9861-fcbebd69238f tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:27.997150 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-56dbd638-b1a2-4a3f-9861-fcbebd69238f tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:28.014034 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88979adf-ad5c-44e7-9900-dfe330d683ca tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:28.018081 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88979adf-ad5c-44e7-9900-dfe330d683ca tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:28.021610 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88979adf-ad5c-44e7-9900-dfe330d683ca tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:28.022067 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88979adf-ad5c-44e7-9900-dfe330d683ca tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:28.355755 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-56dbd638-b1a2-4a3f-9861-fcbebd69238f tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:28.371607 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-56dbd638-b1a2-4a3f-9861-fcbebd69238f tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2" status: 200 len: 1325 microversion: 2.1 time: 0.404174 Jun 20 12:11:28.409267 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1634/3185] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:27 2022] GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2 => generated 1325 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:28.436133 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-63f5e1e6-d43d-45cf-9f80-01e5e4c917f6 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:28.443710 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-63f5e1e6-d43d-45cf-9f80-01e5e4c917f6 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:28.480511 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63f5e1e6-d43d-45cf-9f80-01e5e4c917f6 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:28.485659 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63f5e1e6-d43d-45cf-9f80-01e5e4c917f6 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:28.488243 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63f5e1e6-d43d-45cf-9f80-01e5e4c917f6 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:28.496418 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63f5e1e6-d43d-45cf-9f80-01e5e4c917f6 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:28.782961 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-88979adf-ad5c-44e7-9900-dfe330d683ca tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:28.801764 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-88979adf-ad5c-44e7-9900-dfe330d683ca tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1463 microversion: 2.1 time: 0.835756 Jun 20 12:11:28.803801 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1552/3186] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:27 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1463 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:28.816475 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-0d496caf-2c45-49de-84b3-9823a3c690fc req-252a92c6-2c52-48ab-aca1-40244da24110 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9df7a71a-0efc-4929-888a-783e6fded5f2", "tag": "043adafc-5190-43bd-9f51-c1f1a4c5401b"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:28.841761 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-0d496caf-2c45-49de-84b3-9823a3c690fc req-252a92c6-2c52-48ab-aca1-40244da24110 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:28.841761 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-0d496caf-2c45-49de-84b3-9823a3c690fc req-252a92c6-2c52-48ab-aca1-40244da24110 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:28.867803 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-63f5e1e6-d43d-45cf-9f80-01e5e4c917f6 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07f91cbf86a444fb06e050d4c4532fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c47b977a1334cd486385213ff23de86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:28.877880 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-63f5e1e6-d43d-45cf-9f80-01e5e4c917f6 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 200 len: 1525 microversion: 2.1 time: 0.465350 Jun 20 12:11:28.879152 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1635/3187] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:28 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 1525 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:28.886571 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9a4e70fc-9d4a-4680-b2b9-297565a4c46e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:28.887148 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9a4e70fc-9d4a-4680-b2b9-297565a4c46e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:28.893796 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-0d496caf-2c45-49de-84b3-9823a3c690fc req-252a92c6-2c52-48ab-aca1-40244da24110 service nova] Creating event network-changed:043adafc-5190-43bd-9f51-c1f1a4c5401b for instance 9df7a71a-0efc-4929-888a-783e6fded5f2 on n-h1-master-1 Jun 20 12:11:28.900443 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-0d496caf-2c45-49de-84b3-9823a3c690fc req-252a92c6-2c52-48ab-aca1-40244da24110 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094846 Jun 20 12:11:28.901528 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1553/3188] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:11:28.910895 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-35f7f34c-a130-433a-8fe0-87a0ab0e0787 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:28.911899 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-35f7f34c-a130-433a-8fe0-87a0ab0e0787 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:28.915944 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a4e70fc-9d4a-4680-b2b9-297565a4c46e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:28.916243 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a4e70fc-9d4a-4680-b2b9-297565a4c46e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:28.917035 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a4e70fc-9d4a-4680-b2b9-297565a4c46e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:28.917467 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a4e70fc-9d4a-4680-b2b9-297565a4c46e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:28.921099 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-35f7f34c-a130-433a-8fe0-87a0ab0e0787 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:28.921863 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-35f7f34c-a130-433a-8fe0-87a0ab0e0787 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:28.923447 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-35f7f34c-a130-433a-8fe0-87a0ab0e0787 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:28.924216 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-35f7f34c-a130-433a-8fe0-87a0ab0e0787 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:29.289696 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9a4e70fc-9d4a-4680-b2b9-297565a4c46e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:29.298722 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9a4e70fc-9d4a-4680-b2b9-297565a4c46e tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 200 len: 1508 microversion: 2.1 time: 0.415734 Jun 20 12:11:29.299528 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1636/3189] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:28 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 1508 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:29.304127 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cada5cd1-3988-4a1d-904d-79af13a9ecdd tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:29.315172 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cada5cd1-3988-4a1d-904d-79af13a9ecdd tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:29.321524 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-35f7f34c-a130-433a-8fe0-87a0ab0e0787 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lazy-loading 'services' on Instance uuid 3c658f2d-9442-4b10-b5f5-2d484553330e {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:11:29.328754 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cada5cd1-3988-4a1d-904d-79af13a9ecdd tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:29.329240 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cada5cd1-3988-4a1d-904d-79af13a9ecdd tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:29.330042 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cada5cd1-3988-4a1d-904d-79af13a9ecdd tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:29.330475 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cada5cd1-3988-4a1d-904d-79af13a9ecdd tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:29.359925 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-35f7f34c-a130-433a-8fe0-87a0ab0e0787 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1929 microversion: 2.75 time: 0.456706 Jun 20 12:11:29.360961 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1554/3190] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:28 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1929 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:29.381357 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-ed72ab22-bc85-400a-b514-dc6d97625518 req-0fd5f11a-bd25-4fa7-a423-7b21cae290fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4404478d-26ca-49d1-a629-8cecf8b967a1", "name": "network-vif-plugged", "status": "completed", "tag": "5dd43a26-552a-45c5-9e58-286e7499c6c8"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:29.407191 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-ed72ab22-bc85-400a-b514-dc6d97625518 req-0fd5f11a-bd25-4fa7-a423-7b21cae290fa service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:29.408291 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-ed72ab22-bc85-400a-b514-dc6d97625518 req-0fd5f11a-bd25-4fa7-a423-7b21cae290fa service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:29.434491 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-ed72ab22-bc85-400a-b514-dc6d97625518 req-0fd5f11a-bd25-4fa7-a423-7b21cae290fa service nova] Creating event network-vif-plugged:5dd43a26-552a-45c5-9e58-286e7499c6c8 for instance 4404478d-26ca-49d1-a629-8cecf8b967a1 on n-h1-master-1 Jun 20 12:11:29.451418 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-ed72ab22-bc85-400a-b514-dc6d97625518 req-0fd5f11a-bd25-4fa7-a423-7b21cae290fa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073168 Jun 20 12:11:29.453396 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1555/3191] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:11:29.613768 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cada5cd1-3988-4a1d-904d-79af13a9ecdd tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:29.624044 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cada5cd1-3988-4a1d-904d-79af13a9ecdd tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1519 microversion: 2.1 time: 0.323460 Jun 20 12:11:29.624681 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1637/3192] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:29 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1519 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:29.630643 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4e01698c-842b-407d-9f93-0fb3c0b3a684 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:29.631209 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4e01698c-842b-407d-9f93-0fb3c0b3a684 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:29.639635 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4e01698c-842b-407d-9f93-0fb3c0b3a684 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:29.640173 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4e01698c-842b-407d-9f93-0fb3c0b3a684 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:29.641027 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4e01698c-842b-407d-9f93-0fb3c0b3a684 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:29.641495 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4e01698c-842b-407d-9f93-0fb3c0b3a684 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:29.673678 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4e01698c-842b-407d-9f93-0fb3c0b3a684 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:11:29.724527 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-78892fb9-9753-4d43-bb95-2d10af5aa759 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:29.725419 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-78892fb9-9753-4d43-bb95-2d10af5aa759 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:29.733793 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-78892fb9-9753-4d43-bb95-2d10af5aa759 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:29.734248 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-78892fb9-9753-4d43-bb95-2d10af5aa759 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:29.735025 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-78892fb9-9753-4d43-bb95-2d10af5aa759 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:29.735464 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-78892fb9-9753-4d43-bb95-2d10af5aa759 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:29.773956 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4e01698c-842b-407d-9f93-0fb3c0b3a684 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "DELETE /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 204 len: 0 microversion: 2.1 time: 0.147558 Jun 20 12:11:29.774762 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1638/3193] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:11:29 2022] DELETE /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:11:29.794474 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5b62c4dd-64eb-43c1-90fa-f01a5da5dae3 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:29.795500 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5b62c4dd-64eb-43c1-90fa-f01a5da5dae3 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 9df7a71a-0efc-4929-888a-783e6fded5f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:29.804319 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b62c4dd-64eb-43c1-90fa-f01a5da5dae3 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:29.804982 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b62c4dd-64eb-43c1-90fa-f01a5da5dae3 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:29.806864 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b62c4dd-64eb-43c1-90fa-f01a5da5dae3 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:29.807468 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b62c4dd-64eb-43c1-90fa-f01a5da5dae3 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:29.973743 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-78892fb9-9753-4d43-bb95-2d10af5aa759 tempest-MigrationsAdminTest-1740254832 tempest-MigrationsAdminTest-1740254832-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1614 microversion: 2.1 time: 0.513632 Jun 20 12:11:29.974944 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1556/3194] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:29 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1614 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:29.980305 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-05f1f208-b01e-463a-9930-70843546676b tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:29.981187 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-05f1f208-b01e-463a-9930-70843546676b tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:29.989048 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05f1f208-b01e-463a-9930-70843546676b tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:29.989783 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05f1f208-b01e-463a-9930-70843546676b tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:29.990743 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05f1f208-b01e-463a-9930-70843546676b tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:29.991616 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05f1f208-b01e-463a-9930-70843546676b tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:30.010603 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5b62c4dd-64eb-43c1-90fa-f01a5da5dae3 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:30.018797 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5b62c4dd-64eb-43c1-90fa-f01a5da5dae3 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2" status: 200 len: 1325 microversion: 2.1 time: 0.242426 Jun 20 12:11:30.028291 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1639/3195] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:29 2022] GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2 => generated 1325 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:30.028291 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c83ad4bd-61a0-47a8-a436-5521f65a6330 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1281739280", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "63e98b43-e754-4964-976c-5396a9294741"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:30.086287 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-c83ad4bd-61a0-47a8-a436-5521f65a6330 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] validate_networks() for [('63e98b43-e754-4964-976c-5396a9294741', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:11:30.199556 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-05f1f208-b01e-463a-9930-70843546676b tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07f91cbf86a444fb06e050d4c4532fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c47b977a1334cd486385213ff23de86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:30.209223 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-05f1f208-b01e-463a-9930-70843546676b tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 200 len: 1525 microversion: 2.1 time: 0.232727 Jun 20 12:11:30.210114 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1557/3196] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:29 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 1525 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:30.215029 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-066771b6-dc26-464c-80a0-c27db0cdc24f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:30.215637 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-066771b6-dc26-464c-80a0-c27db0cdc24f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:30.222700 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-066771b6-dc26-464c-80a0-c27db0cdc24f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:30.223155 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-066771b6-dc26-464c-80a0-c27db0cdc24f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:30.223928 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-066771b6-dc26-464c-80a0-c27db0cdc24f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:30.224391 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-066771b6-dc26-464c-80a0-c27db0cdc24f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:30.263868 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-066771b6-dc26-464c-80a0-c27db0cdc24f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:11:30.359568 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:11:30.372860 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-066771b6-dc26-464c-80a0-c27db0cdc24f tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 204 len: 0 microversion: 2.1 time: 0.161159 Jun 20 12:11:30.374598 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1558/3197] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:11:30 2022] DELETE /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:11:30.385407 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-47df5b32-a343-4111-8a39-02a4f03b3db4 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:30.391169 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-47df5b32-a343-4111-8a39-02a4f03b3db4 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:30.395041 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-47df5b32-a343-4111-8a39-02a4f03b3db4 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:30.395811 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-47df5b32-a343-4111-8a39-02a4f03b3db4 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:30.397161 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-47df5b32-a343-4111-8a39-02a4f03b3db4 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:30.398044 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-47df5b32-a343-4111-8a39-02a4f03b3db4 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:30.553196 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-c83ad4bd-61a0-47a8-a436-5521f65a6330 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:11:30.553646 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-c83ad4bd-61a0-47a8-a436-5521f65a6330 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:11:30.554120 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-c83ad4bd-61a0-47a8-a436-5521f65a6330 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:11:30.554535 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-c83ad4bd-61a0-47a8-a436-5521f65a6330 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:11:30.554952 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-c83ad4bd-61a0-47a8-a436-5521f65a6330 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:11:30.559091 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-47df5b32-a343-4111-8a39-02a4f03b3db4 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:30.565677 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c83ad4bd-61a0-47a8-a436-5521f65a6330 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:30.566308 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c83ad4bd-61a0-47a8-a436-5521f65a6330 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:30.567671 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-47df5b32-a343-4111-8a39-02a4f03b3db4 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1469 microversion: 2.1 time: 0.188294 Jun 20 12:11:30.568213 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c83ad4bd-61a0-47a8-a436-5521f65a6330 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:30.568213 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c83ad4bd-61a0-47a8-a436-5521f65a6330 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:30.572582 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1559/3198] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:30 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1469 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:30.577758 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-986a36af-51c3-41fb-9cec-df0c2243630e tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:30.578610 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-986a36af-51c3-41fb-9cec-df0c2243630e tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:30.585974 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-986a36af-51c3-41fb-9cec-df0c2243630e tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:30.586430 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-986a36af-51c3-41fb-9cec-df0c2243630e tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:30.587186 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-986a36af-51c3-41fb-9cec-df0c2243630e tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:30.587814 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-986a36af-51c3-41fb-9cec-df0c2243630e tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:30.588551 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-c83ad4bd-61a0-47a8-a436-5521f65a6330 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Getting quotas for project f62c06c318b54505b639ad49a10dc9e5. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:11:30.594254 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-c83ad4bd-61a0-47a8-a436-5521f65a6330 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Getting quotas for user f9d39a7ff9af475b88d8ca1f1536fdf2 and project f62c06c318b54505b639ad49a10dc9e5. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:11:30.608002 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c83ad4bd-61a0-47a8-a436-5521f65a6330 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:11:30.610947 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c83ad4bd-61a0-47a8-a436-5521f65a6330 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:11:30.664248 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c83ad4bd-61a0-47a8-a436-5521f65a6330 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.642869 Jun 20 12:11:30.665257 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1640/3199] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:11:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:11:30.670096 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dfdb36c5-690e-4045-ad06-a481a6a82d16 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:30.671254 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dfdb36c5-690e-4045-ad06-a481a6a82d16 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:30.673390 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-986a36af-51c3-41fb-9cec-df0c2243630e tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lazy-loading 'services' on Instance uuid 3c658f2d-9442-4b10-b5f5-2d484553330e {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:11:30.680292 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dfdb36c5-690e-4045-ad06-a481a6a82d16 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:30.681523 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dfdb36c5-690e-4045-ad06-a481a6a82d16 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:30.682659 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dfdb36c5-690e-4045-ad06-a481a6a82d16 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:30.683318 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dfdb36c5-690e-4045-ad06-a481a6a82d16 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:30.700703 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-986a36af-51c3-41fb-9cec-df0c2243630e tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1929 microversion: 2.75 time: 0.126613 Jun 20 12:11:30.701605 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1560/3200] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:30 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1929 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:30.707416 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-40122758-e1c5-4d2f-a1c2-1e2b093a5609 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:30.708156 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-40122758-e1c5-4d2f-a1c2-1e2b093a5609 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:30.772540 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-40122758-e1c5-4d2f-a1c2-1e2b093a5609 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:30.785276 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-40122758-e1c5-4d2f-a1c2-1e2b093a5609 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546" status: 200 len: 1218 microversion: 2.1 time: 0.082339 Jun 20 12:11:30.786579 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1561/3201] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:30 2022] GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:30.901064 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dfdb36c5-690e-4045-ad06-a481a6a82d16 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:30.918692 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dfdb36c5-690e-4045-ad06-a481a6a82d16 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1519 microversion: 2.1 time: 0.251770 Jun 20 12:11:30.920748 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1641/3202] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:30 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1519 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:31.036454 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7425bc44-9c02-42d1-bba9-37b77f49fa57 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:31.037166 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7425bc44-9c02-42d1-bba9-37b77f49fa57 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 9df7a71a-0efc-4929-888a-783e6fded5f2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:31.046585 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7425bc44-9c02-42d1-bba9-37b77f49fa57 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:31.047359 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7425bc44-9c02-42d1-bba9-37b77f49fa57 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:31.048842 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7425bc44-9c02-42d1-bba9-37b77f49fa57 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:31.049516 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7425bc44-9c02-42d1-bba9-37b77f49fa57 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:31.229520 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-06314a5e-96a1-4c5e-80f6-be32edf06e4e tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:31.230152 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-06314a5e-96a1-4c5e-80f6-be32edf06e4e tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:31.231313 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7425bc44-9c02-42d1-bba9-37b77f49fa57 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:31.238939 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06314a5e-96a1-4c5e-80f6-be32edf06e4e tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:31.239397 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06314a5e-96a1-4c5e-80f6-be32edf06e4e tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:31.240192 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06314a5e-96a1-4c5e-80f6-be32edf06e4e tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:31.240658 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06314a5e-96a1-4c5e-80f6-be32edf06e4e tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:31.252783 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7425bc44-9c02-42d1-bba9-37b77f49fa57 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2" status: 200 len: 1325 microversion: 2.1 time: 0.220803 Jun 20 12:11:31.254070 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1562/3203] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:31 2022] GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2 => generated 1325 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:31.448741 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-06314a5e-96a1-4c5e-80f6-be32edf06e4e tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07f91cbf86a444fb06e050d4c4532fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c47b977a1334cd486385213ff23de86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:31.457090 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-06314a5e-96a1-4c5e-80f6-be32edf06e4e tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 200 len: 1525 microversion: 2.1 time: 0.231260 Jun 20 12:11:31.457594 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1642/3204] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:31 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 1525 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:11:31.584824 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-43d76755-3cd9-4a78-affb-d412fa4e2c8e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:31.586584 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-43d76755-3cd9-4a78-affb-d412fa4e2c8e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:31.591847 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-43d76755-3cd9-4a78-affb-d412fa4e2c8e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:31.592329 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-43d76755-3cd9-4a78-affb-d412fa4e2c8e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:31.593100 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-43d76755-3cd9-4a78-affb-d412fa4e2c8e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:31.593540 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-43d76755-3cd9-4a78-affb-d412fa4e2c8e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:31.723382 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-25cc9f8e-24c1-46ff-8ca1-5b1bdf02588a tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:31.723912 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-25cc9f8e-24c1-46ff-8ca1-5b1bdf02588a tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:31.731591 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-25cc9f8e-24c1-46ff-8ca1-5b1bdf02588a tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:31.732380 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-25cc9f8e-24c1-46ff-8ca1-5b1bdf02588a tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:31.733928 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-25cc9f8e-24c1-46ff-8ca1-5b1bdf02588a tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:31.734534 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-25cc9f8e-24c1-46ff-8ca1-5b1bdf02588a tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:31.742439 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-43d76755-3cd9-4a78-affb-d412fa4e2c8e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:31.752664 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-43d76755-3cd9-4a78-affb-d412fa4e2c8e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1469 microversion: 2.1 time: 0.171623 Jun 20 12:11:31.764460 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1563/3205] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:31 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1469 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:31.803633 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-80550915-4eb5-4837-ac74-f47cba4be6b6 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:31.804580 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-80550915-4eb5-4837-ac74-f47cba4be6b6 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:31.811490 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80550915-4eb5-4837-ac74-f47cba4be6b6 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:31.812166 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80550915-4eb5-4837-ac74-f47cba4be6b6 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:31.813018 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80550915-4eb5-4837-ac74-f47cba4be6b6 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:31.813454 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80550915-4eb5-4837-ac74-f47cba4be6b6 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:31.834074 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-25cc9f8e-24c1-46ff-8ca1-5b1bdf02588a tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lazy-loading 'services' on Instance uuid 3c658f2d-9442-4b10-b5f5-2d484553330e {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:11:31.851900 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-25cc9f8e-24c1-46ff-8ca1-5b1bdf02588a tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1929 microversion: 2.75 time: 0.133509 Jun 20 12:11:31.852701 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1643/3206] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:31 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1929 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:11:31.889069 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-80550915-4eb5-4837-ac74-f47cba4be6b6 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:31.897545 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-80550915-4eb5-4837-ac74-f47cba4be6b6 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546" status: 200 len: 1270 microversion: 2.1 time: 0.097900 Jun 20 12:11:31.898146 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1564/3207] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:31 2022] GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546 => generated 1270 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:11:31.936796 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7f74c96b-bab5-4afd-9953-d808b9a4d18d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:31.937463 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7f74c96b-bab5-4afd-9953-d808b9a4d18d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:31.946707 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7f74c96b-bab5-4afd-9953-d808b9a4d18d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:31.947138 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7f74c96b-bab5-4afd-9953-d808b9a4d18d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:31.948789 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7f74c96b-bab5-4afd-9953-d808b9a4d18d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:31.949277 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7f74c96b-bab5-4afd-9953-d808b9a4d18d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:32.069677 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-a183280d-1ad3-47ce-8650-b75425edbc32 req-98b4980f-e8b1-465c-909f-fea741d22c84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31440c3e-bac0-437b-acd0-97351ddaae67", "name": "network-vif-deleted", "tag": "63464faa-0494-41e3-88aa-fae7ed2a5773"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:32.085232 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-a183280d-1ad3-47ce-8650-b75425edbc32 req-98b4980f-e8b1-465c-909f-fea741d22c84 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:32.085680 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-a183280d-1ad3-47ce-8650-b75425edbc32 req-98b4980f-e8b1-465c-909f-fea741d22c84 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:32.106354 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-a183280d-1ad3-47ce-8650-b75425edbc32 req-98b4980f-e8b1-465c-909f-fea741d22c84 service nova] Creating event network-vif-deleted:63464faa-0494-41e3-88aa-fae7ed2a5773 for instance 31440c3e-bac0-437b-acd0-97351ddaae67 on n-h2-master-1 Jun 20 12:11:32.112099 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-a183280d-1ad3-47ce-8650-b75425edbc32 req-98b4980f-e8b1-465c-909f-fea741d22c84 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046096 Jun 20 12:11:32.113626 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1565/3208] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:11:32.162417 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7f74c96b-bab5-4afd-9953-d808b9a4d18d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:32.170884 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7f74c96b-bab5-4afd-9953-d808b9a4d18d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1519 microversion: 2.1 time: 0.238171 Jun 20 12:11:32.171496 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1644/3209] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:31 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1519 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:32.272792 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-21174bff-3e85-4228-96bf-11d508ece510 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:32.274981 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-21174bff-3e85-4228-96bf-11d508ece510 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 9df7a71a-0efc-4929-888a-783e6fded5f2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:32.290264 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-21174bff-3e85-4228-96bf-11d508ece510 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:32.290745 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-21174bff-3e85-4228-96bf-11d508ece510 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:32.293324 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-21174bff-3e85-4228-96bf-11d508ece510 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:32.294142 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-21174bff-3e85-4228-96bf-11d508ece510 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:32.303352 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:11:32.453563 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-21174bff-3e85-4228-96bf-11d508ece510 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:32.461672 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-21174bff-3e85-4228-96bf-11d508ece510 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2" status: 200 len: 1325 microversion: 2.1 time: 0.194354 Jun 20 12:11:32.462214 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1566/3210] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:32 2022] GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2 => generated 1325 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:32.474216 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dfa75eb6-ed25-40e4-bf95-4e9c3d8beb3d tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:32.475598 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dfa75eb6-ed25-40e4-bf95-4e9c3d8beb3d tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:32.483074 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dfa75eb6-ed25-40e4-bf95-4e9c3d8beb3d tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:32.483704 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dfa75eb6-ed25-40e4-bf95-4e9c3d8beb3d tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:32.484601 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dfa75eb6-ed25-40e4-bf95-4e9c3d8beb3d tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:32.485095 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dfa75eb6-ed25-40e4-bf95-4e9c3d8beb3d tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:32.640667 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dfa75eb6-ed25-40e4-bf95-4e9c3d8beb3d tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07f91cbf86a444fb06e050d4c4532fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c47b977a1334cd486385213ff23de86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:32.652911 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dfa75eb6-ed25-40e4-bf95-4e9c3d8beb3d tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 200 len: 1525 microversion: 2.1 time: 0.182563 Jun 20 12:11:32.654067 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1645/3211] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:32 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 1525 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:32.771248 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9f151864-9355-4c14-ab3e-fe868da0d89a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:32.772521 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9f151864-9355-4c14-ab3e-fe868da0d89a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:32.785463 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9f151864-9355-4c14-ab3e-fe868da0d89a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:32.785918 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9f151864-9355-4c14-ab3e-fe868da0d89a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:32.786703 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9f151864-9355-4c14-ab3e-fe868da0d89a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:32.787139 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9f151864-9355-4c14-ab3e-fe868da0d89a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:32.879004 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2217e2c5-ac5d-4a54-a0d6-bb864bed5c23 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:32.880586 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2217e2c5-ac5d-4a54-a0d6-bb864bed5c23 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:32.905550 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2217e2c5-ac5d-4a54-a0d6-bb864bed5c23 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:32.908680 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2217e2c5-ac5d-4a54-a0d6-bb864bed5c23 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:32.910126 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2217e2c5-ac5d-4a54-a0d6-bb864bed5c23 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:32.912464 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2217e2c5-ac5d-4a54-a0d6-bb864bed5c23 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:33.032278 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9f151864-9355-4c14-ab3e-fe868da0d89a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:33.040942 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-2217e2c5-ac5d-4a54-a0d6-bb864bed5c23 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lazy-loading 'services' on Instance uuid 3c658f2d-9442-4b10-b5f5-2d484553330e {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:11:33.043559 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9f151864-9355-4c14-ab3e-fe868da0d89a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1469 microversion: 2.1 time: 0.276304 Jun 20 12:11:33.044624 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1567/3212] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:32 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1469 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:33.049233 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8206f34f-68d2-4b69-8c3e-c207ae92c660 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:33.050488 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8206f34f-68d2-4b69-8c3e-c207ae92c660 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:33.060293 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8206f34f-68d2-4b69-8c3e-c207ae92c660 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:33.062102 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8206f34f-68d2-4b69-8c3e-c207ae92c660 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:33.063648 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8206f34f-68d2-4b69-8c3e-c207ae92c660 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:33.064873 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8206f34f-68d2-4b69-8c3e-c207ae92c660 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:33.066877 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2217e2c5-ac5d-4a54-a0d6-bb864bed5c23 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1929 microversion: 2.75 time: 0.197686 Jun 20 12:11:33.068029 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1646/3213] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:32 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1929 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:33.139155 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8206f34f-68d2-4b69-8c3e-c207ae92c660 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:33.147594 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8206f34f-68d2-4b69-8c3e-c207ae92c660 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546" status: 200 len: 1276 microversion: 2.1 time: 0.101899 Jun 20 12:11:33.148526 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1568/3214] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:33 2022] GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546 => generated 1276 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:33.188271 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-319c7759-0cc1-4750-9c26-4d69e5dbee0f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:33.190095 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-319c7759-0cc1-4750-9c26-4d69e5dbee0f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:33.206443 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-319c7759-0cc1-4750-9c26-4d69e5dbee0f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:33.207253 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-319c7759-0cc1-4750-9c26-4d69e5dbee0f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:33.208274 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-319c7759-0cc1-4750-9c26-4d69e5dbee0f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:33.208718 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-319c7759-0cc1-4750-9c26-4d69e5dbee0f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:33.465488 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-319c7759-0cc1-4750-9c26-4d69e5dbee0f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:33.469449 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:11:33.481982 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2e90deff-8a0f-4e73-bf82-8f5614783acc tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:33.482928 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2e90deff-8a0f-4e73-bf82-8f5614783acc tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 9df7a71a-0efc-4929-888a-783e6fded5f2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:33.501188 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2e90deff-8a0f-4e73-bf82-8f5614783acc tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:33.501849 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-319c7759-0cc1-4750-9c26-4d69e5dbee0f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1519 microversion: 2.1 time: 0.316948 Jun 20 12:11:33.502493 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2e90deff-8a0f-4e73-bf82-8f5614783acc tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:33.512775 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2e90deff-8a0f-4e73-bf82-8f5614783acc tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:33.512775 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2e90deff-8a0f-4e73-bf82-8f5614783acc tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:33.515950 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1647/3215] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:33 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1519 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:33.676704 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dbc00052-972b-4bb9-aec1-701a79d355ee tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:33.677848 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dbc00052-972b-4bb9-aec1-701a79d355ee tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:33.688342 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dbc00052-972b-4bb9-aec1-701a79d355ee tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:33.689754 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dbc00052-972b-4bb9-aec1-701a79d355ee tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:33.691149 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dbc00052-972b-4bb9-aec1-701a79d355ee tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:33.692507 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dbc00052-972b-4bb9-aec1-701a79d355ee tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:33.756038 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2e90deff-8a0f-4e73-bf82-8f5614783acc tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:33.766214 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2e90deff-8a0f-4e73-bf82-8f5614783acc tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2" status: 200 len: 1325 microversion: 2.1 time: 0.291126 Jun 20 12:11:33.767219 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1569/3216] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:33 2022] GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2 => generated 1325 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:11:34.039071 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dbc00052-972b-4bb9-aec1-701a79d355ee tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07f91cbf86a444fb06e050d4c4532fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c47b977a1334cd486385213ff23de86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:34.049701 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dbc00052-972b-4bb9-aec1-701a79d355ee tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 200 len: 1525 microversion: 2.1 time: 0.383081 Jun 20 12:11:34.051115 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1648/3217] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:33 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 1525 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:34.062198 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7ef85215-7f9c-49b6-9168-4f90584be292 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:34.062808 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7ef85215-7f9c-49b6-9168-4f90584be292 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:34.071651 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ef85215-7f9c-49b6-9168-4f90584be292 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:34.072559 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ef85215-7f9c-49b6-9168-4f90584be292 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:34.073553 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ef85215-7f9c-49b6-9168-4f90584be292 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:34.074183 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ef85215-7f9c-49b6-9168-4f90584be292 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:34.089398 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c8a24ec6-6ee6-462e-99ec-1708c2397526 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:34.090293 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c8a24ec6-6ee6-462e-99ec-1708c2397526 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:34.100782 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c8a24ec6-6ee6-462e-99ec-1708c2397526 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:34.103171 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c8a24ec6-6ee6-462e-99ec-1708c2397526 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:34.104257 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c8a24ec6-6ee6-462e-99ec-1708c2397526 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:34.104891 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c8a24ec6-6ee6-462e-99ec-1708c2397526 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:34.266259 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-c8a24ec6-6ee6-462e-99ec-1708c2397526 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lazy-loading 'services' on Instance uuid 3c658f2d-9442-4b10-b5f5-2d484553330e {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:11:34.334698 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c8a24ec6-6ee6-462e-99ec-1708c2397526 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1929 microversion: 2.75 time: 0.250518 Jun 20 12:11:34.335012 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1649/3218] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:34 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1929 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:11:34.367928 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e967fe46-566f-4f7b-9019-fefa525eff79 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:34.368564 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e967fe46-566f-4f7b-9019-fefa525eff79 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:34.382949 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e967fe46-566f-4f7b-9019-fefa525eff79 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:34.384045 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e967fe46-566f-4f7b-9019-fefa525eff79 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:34.385664 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e967fe46-566f-4f7b-9019-fefa525eff79 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:34.386634 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e967fe46-566f-4f7b-9019-fefa525eff79 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:34.564172 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7ef85215-7f9c-49b6-9168-4f90584be292 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:34.591193 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7ef85215-7f9c-49b6-9168-4f90584be292 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1469 microversion: 2.1 time: 0.532710 Jun 20 12:11:34.594457 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1570/3219] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:34 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1469 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:34.618185 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5a545118-b9b3-46ea-850c-5815c847bb84 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:34.623433 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5a545118-b9b3-46ea-850c-5815c847bb84 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:34.665546 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a545118-b9b3-46ea-850c-5815c847bb84 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:34.666328 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a545118-b9b3-46ea-850c-5815c847bb84 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:34.667934 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a545118-b9b3-46ea-850c-5815c847bb84 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:34.670872 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a545118-b9b3-46ea-850c-5815c847bb84 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:34.922661 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e967fe46-566f-4f7b-9019-fefa525eff79 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:34.937579 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e967fe46-566f-4f7b-9019-fefa525eff79 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546" status: 200 len: 1318 microversion: 2.1 time: 0.582290 Jun 20 12:11:34.940782 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1650/3220] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:34 2022] GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546 => generated 1318 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:34.956332 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-da1a6a63-0c9a-44fc-9f29-57080e295020 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:34.958826 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-da1a6a63-0c9a-44fc-9f29-57080e295020 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 9df7a71a-0efc-4929-888a-783e6fded5f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:34.979391 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da1a6a63-0c9a-44fc-9f29-57080e295020 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:34.981294 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da1a6a63-0c9a-44fc-9f29-57080e295020 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:34.984599 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da1a6a63-0c9a-44fc-9f29-57080e295020 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:34.985074 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da1a6a63-0c9a-44fc-9f29-57080e295020 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:35.172573 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5a545118-b9b3-46ea-850c-5815c847bb84 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:35.195051 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5a545118-b9b3-46ea-850c-5815c847bb84 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1519 microversion: 2.1 time: 0.597009 Jun 20 12:11:35.196119 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1571/3221] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:34 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1519 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:35.214379 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4e3e894d-07c9-42c3-ae20-9c05a6349705 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:35.214998 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4e3e894d-07c9-42c3-ae20-9c05a6349705 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:35.231823 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4e3e894d-07c9-42c3-ae20-9c05a6349705 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:35.232303 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4e3e894d-07c9-42c3-ae20-9c05a6349705 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:35.233091 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4e3e894d-07c9-42c3-ae20-9c05a6349705 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:35.233531 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4e3e894d-07c9-42c3-ae20-9c05a6349705 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:35.458460 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-da1a6a63-0c9a-44fc-9f29-57080e295020 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:35.473469 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-da1a6a63-0c9a-44fc-9f29-57080e295020 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2" status: 200 len: 1325 microversion: 2.1 time: 0.527743 Jun 20 12:11:35.484083 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1651/3222] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:34 2022] GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2 => generated 1325 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:35.499853 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-524feb6b-c587-41b3-9849-91be6aed7b56 req-1942f3d2-d04b-4a8a-8100-272312c350cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546", "tag": "e3be9c58-3684-4be2-8bc7-be13922b9ca1"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:35.529269 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-524feb6b-c587-41b3-9849-91be6aed7b56 req-1942f3d2-d04b-4a8a-8100-272312c350cb service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:35.529269 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-524feb6b-c587-41b3-9849-91be6aed7b56 req-1942f3d2-d04b-4a8a-8100-272312c350cb service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:35.556751 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-524feb6b-c587-41b3-9849-91be6aed7b56 req-1942f3d2-d04b-4a8a-8100-272312c350cb service nova] Creating event network-changed:e3be9c58-3684-4be2-8bc7-be13922b9ca1 for instance cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546 on n-h2-master-1 Jun 20 12:11:35.577002 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-524feb6b-c587-41b3-9849-91be6aed7b56 req-1942f3d2-d04b-4a8a-8100-272312c350cb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097116 Jun 20 12:11:35.581400 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1652/3223] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:11:35.598720 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f3ef2709-44fc-4d84-b9ff-eb31182b860d tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:35.599626 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f3ef2709-44fc-4d84-b9ff-eb31182b860d tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:35.619685 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f3ef2709-44fc-4d84-b9ff-eb31182b860d tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:35.620667 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f3ef2709-44fc-4d84-b9ff-eb31182b860d tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:35.626621 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f3ef2709-44fc-4d84-b9ff-eb31182b860d tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:35.627487 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f3ef2709-44fc-4d84-b9ff-eb31182b860d tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:35.930216 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4e3e894d-07c9-42c3-ae20-9c05a6349705 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07f91cbf86a444fb06e050d4c4532fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c47b977a1334cd486385213ff23de86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:35.975442 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4e3e894d-07c9-42c3-ae20-9c05a6349705 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 200 len: 1525 microversion: 2.1 time: 0.771890 Jun 20 12:11:35.995869 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1572/3224] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:35 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 1525 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:36.016428 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-35c47d67-d9e8-41bb-a42e-df89d05d637c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:36.018153 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-35c47d67-d9e8-41bb-a42e-df89d05d637c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:36.040437 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-35c47d67-d9e8-41bb-a42e-df89d05d637c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:36.040899 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-35c47d67-d9e8-41bb-a42e-df89d05d637c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:36.041853 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-35c47d67-d9e8-41bb-a42e-df89d05d637c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:36.042720 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-35c47d67-d9e8-41bb-a42e-df89d05d637c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:36.183508 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-35c47d67-d9e8-41bb-a42e-df89d05d637c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:36.193369 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-35c47d67-d9e8-41bb-a42e-df89d05d637c tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 200 len: 1427 microversion: 2.1 time: 0.195535 Jun 20 12:11:36.205470 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1573/3225] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:35 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 1427 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:36.219147 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0af74200-97b5-44c1-a473-ce1e8af93a25 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:36.220689 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0af74200-97b5-44c1-a473-ce1e8af93a25 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:36.239622 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0af74200-97b5-44c1-a473-ce1e8af93a25 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:36.240428 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0af74200-97b5-44c1-a473-ce1e8af93a25 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:36.241430 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0af74200-97b5-44c1-a473-ce1e8af93a25 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:36.242121 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0af74200-97b5-44c1-a473-ce1e8af93a25 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:36.470694 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0af74200-97b5-44c1-a473-ce1e8af93a25 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:36.484590 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0af74200-97b5-44c1-a473-ce1e8af93a25 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546" status: 200 len: 1318 microversion: 2.1 time: 0.277482 Jun 20 12:11:36.487427 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1574/3226] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:36 2022] GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546 => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:36.515995 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-f3ef2709-44fc-4d84-b9ff-eb31182b860d tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lazy-loading 'services' on Instance uuid 3c658f2d-9442-4b10-b5f5-2d484553330e {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:11:36.624820 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f3ef2709-44fc-4d84-b9ff-eb31182b860d tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1929 microversion: 2.75 time: 1.037579 Jun 20 12:11:36.628993 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1653/3227] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:35 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1929 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:36.649474 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-219acd74-2932-41f0-b167-6ba59d46a68a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:36.656435 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-219acd74-2932-41f0-b167-6ba59d46a68a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:36.671019 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-219acd74-2932-41f0-b167-6ba59d46a68a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:36.671481 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-219acd74-2932-41f0-b167-6ba59d46a68a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:36.672916 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-219acd74-2932-41f0-b167-6ba59d46a68a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:36.673743 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-219acd74-2932-41f0-b167-6ba59d46a68a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:36.724365 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-026bd965-76f6-4aac-86e5-dbd036f51de6 req-9055f8fb-e184-4fbb-9326-add7c869402f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4404478d-26ca-49d1-a629-8cecf8b967a1", "name": "network-vif-deleted", "tag": "5dd43a26-552a-45c5-9e58-286e7499c6c8"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:36.742108 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-026bd965-76f6-4aac-86e5-dbd036f51de6 req-9055f8fb-e184-4fbb-9326-add7c869402f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:36.750180 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-026bd965-76f6-4aac-86e5-dbd036f51de6 req-9055f8fb-e184-4fbb-9326-add7c869402f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:36.794171 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-026bd965-76f6-4aac-86e5-dbd036f51de6 req-9055f8fb-e184-4fbb-9326-add7c869402f service nova] Creating event network-vif-deleted:5dd43a26-552a-45c5-9e58-286e7499c6c8 for instance 4404478d-26ca-49d1-a629-8cecf8b967a1 on n-h1-master-1 Jun 20 12:11:36.824714 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-026bd965-76f6-4aac-86e5-dbd036f51de6 req-9055f8fb-e184-4fbb-9326-add7c869402f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.335102 Jun 20 12:11:36.827671 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1575/3228] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:11:36.851717 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6e1c1416-3501-4f2e-9f2e-46702b899138 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:36.857166 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6e1c1416-3501-4f2e-9f2e-46702b899138 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 9df7a71a-0efc-4929-888a-783e6fded5f2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:36.886361 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6e1c1416-3501-4f2e-9f2e-46702b899138 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:36.894592 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6e1c1416-3501-4f2e-9f2e-46702b899138 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:36.897878 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6e1c1416-3501-4f2e-9f2e-46702b899138 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:36.898914 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6e1c1416-3501-4f2e-9f2e-46702b899138 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:37.015901 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-219acd74-2932-41f0-b167-6ba59d46a68a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:37.044775 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-219acd74-2932-41f0-b167-6ba59d46a68a tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1519 microversion: 2.1 time: 0.411988 Jun 20 12:11:37.052343 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1654/3229] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:36 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1519 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:37.069546 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-72f2d88e-3ca0-4f7e-bf2d-c3aa4481b6e6 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:37.070556 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-72f2d88e-3ca0-4f7e-bf2d-c3aa4481b6e6 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:37.080671 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:11:37.083028 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-72f2d88e-3ca0-4f7e-bf2d-c3aa4481b6e6 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:37.083790 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-72f2d88e-3ca0-4f7e-bf2d-c3aa4481b6e6 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:37.085352 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-72f2d88e-3ca0-4f7e-bf2d-c3aa4481b6e6 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:37.086342 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-72f2d88e-3ca0-4f7e-bf2d-c3aa4481b6e6 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:37.243666 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6e1c1416-3501-4f2e-9f2e-46702b899138 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:37.260314 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6e1c1416-3501-4f2e-9f2e-46702b899138 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2" status: 200 len: 1325 microversion: 2.1 time: 0.429139 Jun 20 12:11:37.261791 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1576/3230] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:36 2022] GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2 => generated 1325 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:37.500606 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-72f2d88e-3ca0-4f7e-bf2d-c3aa4481b6e6 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07f91cbf86a444fb06e050d4c4532fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c47b977a1334cd486385213ff23de86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:37.529885 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-72f2d88e-3ca0-4f7e-bf2d-c3aa4481b6e6 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 200 len: 1525 microversion: 2.1 time: 0.475288 Jun 20 12:11:37.531397 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1655/3231] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:37 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 1525 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:37.542496 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-556ac423-df85-4add-b904-3eb4c1ebdd4d req-76b434a5-7963-4ba9-b1fb-de686ac44ebc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "593cda12-6491-4a27-8fc7-42c05e0291c3", "name": "network-vif-plugged", "status": "completed", "tag": "2a9eb762-96f9-45b2-8446-311d784377f5"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:37.553564 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e9184edb-97dd-4be8-a9a6-e2f48f036974 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:37.554800 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e9184edb-97dd-4be8-a9a6-e2f48f036974 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 4404478d-26ca-49d1-a629-8cecf8b967a1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:37.572903 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e9184edb-97dd-4be8-a9a6-e2f48f036974 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:37.574287 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e9184edb-97dd-4be8-a9a6-e2f48f036974 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:37.576283 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e9184edb-97dd-4be8-a9a6-e2f48f036974 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:37.577632 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e9184edb-97dd-4be8-a9a6-e2f48f036974 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:37.584555 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-556ac423-df85-4add-b904-3eb4c1ebdd4d req-76b434a5-7963-4ba9-b1fb-de686ac44ebc service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:37.585304 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-556ac423-df85-4add-b904-3eb4c1ebdd4d req-76b434a5-7963-4ba9-b1fb-de686ac44ebc service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:37.610397 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-556ac423-df85-4add-b904-3eb4c1ebdd4d req-76b434a5-7963-4ba9-b1fb-de686ac44ebc service nova] Creating event network-vif-plugged:2a9eb762-96f9-45b2-8446-311d784377f5 for instance 593cda12-6491-4a27-8fc7-42c05e0291c3 on n-h1-master-1 Jun 20 12:11:37.621252 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-556ac423-df85-4add-b904-3eb4c1ebdd4d req-76b434a5-7963-4ba9-b1fb-de686ac44ebc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.356460 Jun 20 12:11:37.622856 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1577/3232] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:11:37.633029 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a342b5f5-081e-419b-bb3d-8d7fe0944f23 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:37.634581 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a342b5f5-081e-419b-bb3d-8d7fe0944f23 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:37.647248 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a342b5f5-081e-419b-bb3d-8d7fe0944f23 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:37.648323 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a342b5f5-081e-419b-bb3d-8d7fe0944f23 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:37.648996 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-e9184edb-97dd-4be8-a9a6-e2f48f036974 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] HTTP exception thrown: Instance 4404478d-26ca-49d1-a629-8cecf8b967a1 could not be found. Jun 20 12:11:37.650112 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a342b5f5-081e-419b-bb3d-8d7fe0944f23 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:37.653378 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a342b5f5-081e-419b-bb3d-8d7fe0944f23 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e9184edb-97dd-4be8-a9a6-e2f48f036974 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Request method failure captured: Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 HTTP/1.1 Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGKgi6jYIAm3mfrUjSiNYuEgcTX-WvqX2nMthzvsgeNwQ63Cs23utZPsmVsS6vSezI6Nxdnn7Zt7mq7APT9g109DZ_381MHORhtFZLL5CBWrwSUf5JupH83uMJgSQkQuNZkzrfhiFeMJ-I3PkrvVM-3iB1YjUY3Lg7SvpH9-AzUhDwc Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 4440dc3e2f9c4134a54b08e2585f6c59 Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-MigrationsAdminTest-286401708 Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4440dc3e2f9c4134a54b08e2585f6c59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4440dc3e2f9c4134a54b08e2585f6c59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4440dc3e2f9c4134a54b08e2585f6c59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4440dc3e2f9c4134a54b08e2585f6c59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-MigrationsAdminTest-286401708 Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 4440dc3e2f9c4134a54b08e2585f6c59 Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-MigrationsAdminTest-286401708 Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-MigrationsAdminTest-286401708-project Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 3d35b7c824b641099a406175bccc5be3 Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-MigrationsAdminTest-286401708-project Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 4404478d-26ca-49d1-a629-8cecf8b967a1 could not be found. Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '4404478d-26ca-49d1-a629-8cecf8b967a1'} Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4404478d-26ca-49d1-a629-8cecf8b967a1 could not be found. Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4404478d-26ca-49d1-a629-8cecf8b967a1 could not be found. Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:37.667275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:37.677149 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:37.677149 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:37.677149 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:37.677149 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:11:37.677149 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:11:37.677149 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4404478d-26ca-49d1-a629-8cecf8b967a1 could not be found. Jun 20 12:11:37.677149 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:37.681644 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e9184edb-97dd-4be8-a9a6-e2f48f036974 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Returning 404 to user: Instance 4404478d-26ca-49d1-a629-8cecf8b967a1 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:11:37.690869 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e9184edb-97dd-4be8-a9a6-e2f48f036974 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1" status: 404 len: 111 microversion: 2.1 time: 0.146402 Jun 20 12:11:37.692510 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1656/3233] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:37 2022] GET /compute/v2.1/servers/4404478d-26ca-49d1-a629-8cecf8b967a1 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:11:37.709622 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b139483f-eb10-4349-a5c7-e02584c57577 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:37.710360 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b139483f-eb10-4349-a5c7-e02584c57577 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:37.718726 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b139483f-eb10-4349-a5c7-e02584c57577 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:37.720060 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b139483f-eb10-4349-a5c7-e02584c57577 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:37.720952 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b139483f-eb10-4349-a5c7-e02584c57577 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:37.721571 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b139483f-eb10-4349-a5c7-e02584c57577 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:37.838012 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-b139483f-eb10-4349-a5c7-e02584c57577 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lazy-loading 'services' on Instance uuid 3c658f2d-9442-4b10-b5f5-2d484553330e {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:11:37.861172 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b139483f-eb10-4349-a5c7-e02584c57577 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1929 microversion: 2.75 time: 0.167104 Jun 20 12:11:37.864992 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1657/3234] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:37 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1929 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:37.876708 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6c88fb5f-31b4-4b51-80bf-6073a45afb78 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:37.877494 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6c88fb5f-31b4-4b51-80bf-6073a45afb78 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:37.894686 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c88fb5f-31b4-4b51-80bf-6073a45afb78 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:37.895406 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c88fb5f-31b4-4b51-80bf-6073a45afb78 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:37.896227 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c88fb5f-31b4-4b51-80bf-6073a45afb78 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:37.896695 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c88fb5f-31b4-4b51-80bf-6073a45afb78 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:37.932448 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6c88fb5f-31b4-4b51-80bf-6073a45afb78 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:11:37.960799 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a342b5f5-081e-419b-bb3d-8d7fe0944f23 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:37.971313 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a342b5f5-081e-419b-bb3d-8d7fe0944f23 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546" status: 200 len: 1318 microversion: 2.1 time: 0.346584 Jun 20 12:11:37.972721 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1578/3235] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:37 2022] GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546 => generated 1318 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:38.064954 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-774548ed-2eae-473e-91ed-1fd126cb7a0f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:38.066399 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-774548ed-2eae-473e-91ed-1fd126cb7a0f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:38.080785 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-774548ed-2eae-473e-91ed-1fd126cb7a0f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:38.081296 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-774548ed-2eae-473e-91ed-1fd126cb7a0f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:38.082083 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-774548ed-2eae-473e-91ed-1fd126cb7a0f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:38.082523 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-774548ed-2eae-473e-91ed-1fd126cb7a0f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:38.088892 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6c88fb5f-31b4-4b51-80bf-6073a45afb78 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 204 len: 0 microversion: 2.1 time: 0.220504 Jun 20 12:11:38.090689 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1658/3236] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:11:37 2022] DELETE /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:11:38.100920 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-58a2070d-8b1f-416a-98ae-d29b38d59b1e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:38.102032 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-58a2070d-8b1f-416a-98ae-d29b38d59b1e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:38.110820 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-58a2070d-8b1f-416a-98ae-d29b38d59b1e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:38.111943 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-58a2070d-8b1f-416a-98ae-d29b38d59b1e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:38.113302 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-58a2070d-8b1f-416a-98ae-d29b38d59b1e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:38.114195 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-58a2070d-8b1f-416a-98ae-d29b38d59b1e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:38.334975 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-58a2070d-8b1f-416a-98ae-d29b38d59b1e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:38.337634 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-774548ed-2eae-473e-91ed-1fd126cb7a0f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:38.346127 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-58a2070d-8b1f-416a-98ae-d29b38d59b1e tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1534 microversion: 2.1 time: 0.251513 Jun 20 12:11:38.346843 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1659/3237] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:38 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1534 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:11:38.348971 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-774548ed-2eae-473e-91ed-1fd126cb7a0f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1519 microversion: 2.1 time: 0.289468 Jun 20 12:11:38.352923 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1f84f864-5aba-4b37-b4f3-fe2f2da3a3cb tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:38.353943 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1f84f864-5aba-4b37-b4f3-fe2f2da3a3cb tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 9df7a71a-0efc-4929-888a-783e6fded5f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:38.362706 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f84f864-5aba-4b37-b4f3-fe2f2da3a3cb tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:38.363102 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1579/3238] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:38 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1519 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:38.363317 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f84f864-5aba-4b37-b4f3-fe2f2da3a3cb tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:38.363948 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f84f864-5aba-4b37-b4f3-fe2f2da3a3cb tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:38.364487 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f84f864-5aba-4b37-b4f3-fe2f2da3a3cb tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:38.529965 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1f84f864-5aba-4b37-b4f3-fe2f2da3a3cb tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:38.538195 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1f84f864-5aba-4b37-b4f3-fe2f2da3a3cb tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2" status: 200 len: 1325 microversion: 2.1 time: 0.190063 Jun 20 12:11:38.538809 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1660/3239] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:38 2022] GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2 => generated 1325 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:38.556506 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ad837ae6-b9ca-4c10-b1e2-9af834deb2a4 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:38.557707 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ad837ae6-b9ca-4c10-b1e2-9af834deb2a4 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:38.565323 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ad837ae6-b9ca-4c10-b1e2-9af834deb2a4 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:38.566227 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ad837ae6-b9ca-4c10-b1e2-9af834deb2a4 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:38.566820 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ad837ae6-b9ca-4c10-b1e2-9af834deb2a4 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:38.567260 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ad837ae6-b9ca-4c10-b1e2-9af834deb2a4 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:38.763081 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ad837ae6-b9ca-4c10-b1e2-9af834deb2a4 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07f91cbf86a444fb06e050d4c4532fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c47b977a1334cd486385213ff23de86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:38.775721 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ad837ae6-b9ca-4c10-b1e2-9af834deb2a4 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 200 len: 1505 microversion: 2.1 time: 0.224634 Jun 20 12:11:38.776840 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1580/3240] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:38 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 1505 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:38.801481 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-07442768-aaaa-477a-b617-6892963124bb tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Action: 'create', calling method: .version_select at 0x7f60736df550>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1787587488", "description": "tempest-description-416689898"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:38.890612 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e388381e-40c2-47e8-8a24-24f0a66daf7e tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:38.891244 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e388381e-40c2-47e8-8a24-24f0a66daf7e tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:38.906806 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e388381e-40c2-47e8-8a24-24f0a66daf7e tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:38.911400 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e388381e-40c2-47e8-8a24-24f0a66daf7e tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:38.914186 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e388381e-40c2-47e8-8a24-24f0a66daf7e tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:38.915695 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e388381e-40c2-47e8-8a24-24f0a66daf7e tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:39.045147 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-07442768-aaaa-477a-b617-6892963124bb tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.253166 Jun 20 12:11:39.052297 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1661/3241] 10.222.0.27 () {60 vars in 1179 bytes} [Mon Jun 20 12:11:38 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:11:39.055205 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8aa4aa42-5dea-4ea1-bc04-c8a2509ebbd1 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:39.056432 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8aa4aa42-5dea-4ea1-bc04-c8a2509ebbd1 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:39.065767 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8aa4aa42-5dea-4ea1-bc04-c8a2509ebbd1 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:39.065993 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8aa4aa42-5dea-4ea1-bc04-c8a2509ebbd1 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:39.066806 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8aa4aa42-5dea-4ea1-bc04-c8a2509ebbd1 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:39.067254 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8aa4aa42-5dea-4ea1-bc04-c8a2509ebbd1 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:39.073143 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-e388381e-40c2-47e8-8a24-24f0a66daf7e tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lazy-loading 'services' on Instance uuid 3c658f2d-9442-4b10-b5f5-2d484553330e {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:11:39.103413 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e388381e-40c2-47e8-8a24-24f0a66daf7e tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1929 microversion: 2.75 time: 0.216922 Jun 20 12:11:39.104342 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1581/3242] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:38 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1929 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:39.109562 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-83727b84-0784-44d6-abfc-35d919163503 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1787587488"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:39.110610 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-83727b84-0784-44d6-abfc-35d919163503 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:39.117621 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-83727b84-0784-44d6-abfc-35d919163503 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:39.118250 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-83727b84-0784-44d6-abfc-35d919163503 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:39.119100 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-83727b84-0784-44d6-abfc-35d919163503 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:39.119608 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-83727b84-0784-44d6-abfc-35d919163503 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:39.263425 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8aa4aa42-5dea-4ea1-bc04-c8a2509ebbd1 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:39.273398 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8aa4aa42-5dea-4ea1-bc04-c8a2509ebbd1 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546" status: 200 len: 1318 microversion: 2.1 time: 0.224303 Jun 20 12:11:39.273998 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1662/3243] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:39 2022] GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:39.281416 n-d-master-1 devstack@n-api.service[119128]: INFO nova.network.security_group_api [None req-83727b84-0784-44d6-abfc-35d919163503 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Adding security group fc22617a-f1cc-4046-8310-1b0589e09058 to port eb877463-7d93-4069-944d-8674a91f4b80 Jun 20 12:11:39.374700 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-04ceff79-0c4c-4970-ac9c-98c6052ed22a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:39.377059 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-04ceff79-0c4c-4970-ac9c-98c6052ed22a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:39.388019 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-04ceff79-0c4c-4970-ac9c-98c6052ed22a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:39.397942 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-04ceff79-0c4c-4970-ac9c-98c6052ed22a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:39.397942 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-04ceff79-0c4c-4970-ac9c-98c6052ed22a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:39.397942 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-04ceff79-0c4c-4970-ac9c-98c6052ed22a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:39.646073 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-04ceff79-0c4c-4970-ac9c-98c6052ed22a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:39.660921 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-04ceff79-0c4c-4970-ac9c-98c6052ed22a tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1534 microversion: 2.1 time: 0.290326 Jun 20 12:11:39.662450 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1663/3244] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:39 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1534 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:39.668845 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c457427c-d125-48bd-a9e3-8148d33c58a1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:39.669948 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c457427c-d125-48bd-a9e3-8148d33c58a1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:39.677240 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c457427c-d125-48bd-a9e3-8148d33c58a1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:39.677690 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c457427c-d125-48bd-a9e3-8148d33c58a1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:39.678464 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c457427c-d125-48bd-a9e3-8148d33c58a1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:39.678899 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c457427c-d125-48bd-a9e3-8148d33c58a1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:39.682382 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:11:39.858378 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c457427c-d125-48bd-a9e3-8148d33c58a1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:39.871369 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c457427c-d125-48bd-a9e3-8148d33c58a1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1519 microversion: 2.1 time: 0.206156 Jun 20 12:11:39.872812 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1664/3245] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:39 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1519 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:39.879604 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9da38b9f-0490-42c9-8efd-f4df11ea2e19 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:39.880672 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9da38b9f-0490-42c9-8efd-f4df11ea2e19 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 9df7a71a-0efc-4929-888a-783e6fded5f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:39.906487 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9da38b9f-0490-42c9-8efd-f4df11ea2e19 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:39.907451 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9da38b9f-0490-42c9-8efd-f4df11ea2e19 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:39.910024 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9da38b9f-0490-42c9-8efd-f4df11ea2e19 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:39.911313 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9da38b9f-0490-42c9-8efd-f4df11ea2e19 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:39.952574 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-83727b84-0784-44d6-abfc-35d919163503 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "POST /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532/action" status: 202 len: 0 microversion: 2.1 time: 0.846090 Jun 20 12:11:39.954906 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1582/3246] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:11:39 2022] POST /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532/action => generated 0 bytes in 849 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:11:39.964667 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-f22328e5-a8e1-4cb6-bf5c-9e135b6ddc0b req-b7159239-82d4-4d36-843e-2653f79e8c7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9df7a71a-0efc-4929-888a-783e6fded5f2", "name": "network-vif-plugged", "status": "completed", "tag": "043adafc-5190-43bd-9f51-c1f1a4c5401b"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:40.004552 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-f22328e5-a8e1-4cb6-bf5c-9e135b6ddc0b req-b7159239-82d4-4d36-843e-2653f79e8c7b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:40.007317 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-f22328e5-a8e1-4cb6-bf5c-9e135b6ddc0b req-b7159239-82d4-4d36-843e-2653f79e8c7b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:40.042494 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-f22328e5-a8e1-4cb6-bf5c-9e135b6ddc0b req-b7159239-82d4-4d36-843e-2653f79e8c7b service nova] Creating event network-vif-plugged:043adafc-5190-43bd-9f51-c1f1a4c5401b for instance 9df7a71a-0efc-4929-888a-783e6fded5f2 on n-h1-master-1 Jun 20 12:11:40.052988 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-f22328e5-a8e1-4cb6-bf5c-9e135b6ddc0b req-b7159239-82d4-4d36-843e-2653f79e8c7b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094525 Jun 20 12:11:40.055115 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1583/3247] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:11:40.073127 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-72febb8a-590e-42f4-ba25-3e4e86169e0b tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1787587488"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:40.077796 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-72febb8a-590e-42f4-ba25-3e4e86169e0b tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:40.106263 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-72febb8a-590e-42f4-ba25-3e4e86169e0b tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:40.110696 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-72febb8a-590e-42f4-ba25-3e4e86169e0b tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:40.112822 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-72febb8a-590e-42f4-ba25-3e4e86169e0b tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:40.114179 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-72febb8a-590e-42f4-ba25-3e4e86169e0b tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:40.394838 n-d-master-1 devstack@n-api.service[119128]: INFO nova.network.security_group_api [None req-72febb8a-590e-42f4-ba25-3e4e86169e0b tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Removing security group fc22617a-f1cc-4046-8310-1b0589e09058 from port eb877463-7d93-4069-944d-8674a91f4b80 Jun 20 12:11:40.414095 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9da38b9f-0490-42c9-8efd-f4df11ea2e19 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:40.447878 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9da38b9f-0490-42c9-8efd-f4df11ea2e19 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2" status: 200 len: 1325 microversion: 2.1 time: 0.573205 Jun 20 12:11:40.452988 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1665/3248] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:39 2022] GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2 => generated 1325 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:40.462133 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-54bc6237-2ef3-4c5b-aadd-6fcf8a9becbd req-41493b90-69cb-4d68-b9db-90a900f8c909 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3163bfa2-d7b5-451e-ae0c-cc2ec445c532", "tag": "eb877463-7d93-4069-944d-8674a91f4b80"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:40.482248 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-54bc6237-2ef3-4c5b-aadd-6fcf8a9becbd req-41493b90-69cb-4d68-b9db-90a900f8c909 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:40.484427 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-54bc6237-2ef3-4c5b-aadd-6fcf8a9becbd req-41493b90-69cb-4d68-b9db-90a900f8c909 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:40.507454 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-54bc6237-2ef3-4c5b-aadd-6fcf8a9becbd req-41493b90-69cb-4d68-b9db-90a900f8c909 service nova] Creating event network-changed:eb877463-7d93-4069-944d-8674a91f4b80 for instance 3163bfa2-d7b5-451e-ae0c-cc2ec445c532 on n-h1-master-1 Jun 20 12:11:40.527962 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-54bc6237-2ef3-4c5b-aadd-6fcf8a9becbd req-41493b90-69cb-4d68-b9db-90a900f8c909 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072788 Jun 20 12:11:40.535377 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1666/3249] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:11:40.543527 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0b5ecf10-ae28-41e1-abdb-195d546cfe53 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:40.544480 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0b5ecf10-ae28-41e1-abdb-195d546cfe53 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:40.553644 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0b5ecf10-ae28-41e1-abdb-195d546cfe53 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:40.554354 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0b5ecf10-ae28-41e1-abdb-195d546cfe53 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:40.555337 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0b5ecf10-ae28-41e1-abdb-195d546cfe53 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:40.556510 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0b5ecf10-ae28-41e1-abdb-195d546cfe53 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:40.599821 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:11:40.611275 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:11:40.695610 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-0b5ecf10-ae28-41e1-abdb-195d546cfe53 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lazy-loading 'services' on Instance uuid 3c658f2d-9442-4b10-b5f5-2d484553330e {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:11:40.718458 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0b5ecf10-ae28-41e1-abdb-195d546cfe53 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1929 microversion: 2.75 time: 0.181164 Jun 20 12:11:40.719878 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1667/3250] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:40 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1929 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:40.725909 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c038c9d1-3d16-4b2c-a5e5-2e003d1fd35f tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:40.727601 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c038c9d1-3d16-4b2c-a5e5-2e003d1fd35f tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:40.740862 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c038c9d1-3d16-4b2c-a5e5-2e003d1fd35f tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:40.741786 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c038c9d1-3d16-4b2c-a5e5-2e003d1fd35f tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:40.742936 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c038c9d1-3d16-4b2c-a5e5-2e003d1fd35f tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:40.743588 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c038c9d1-3d16-4b2c-a5e5-2e003d1fd35f tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:40.784824 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:11:41.011557 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c038c9d1-3d16-4b2c-a5e5-2e003d1fd35f tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:41.024548 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c038c9d1-3d16-4b2c-a5e5-2e003d1fd35f tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546" status: 200 len: 1318 microversion: 2.1 time: 0.303113 Jun 20 12:11:41.025614 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1668/3251] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:40 2022] GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546 => generated 1318 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:41.056233 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b7d61f76-c36a-48b0-b2fd-577aea19bc45 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:41.058689 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b7d61f76-c36a-48b0-b2fd-577aea19bc45 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:41.075902 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b7d61f76-c36a-48b0-b2fd-577aea19bc45 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:41.084600 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b7d61f76-c36a-48b0-b2fd-577aea19bc45 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:41.086888 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b7d61f76-c36a-48b0-b2fd-577aea19bc45 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:41.089155 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b7d61f76-c36a-48b0-b2fd-577aea19bc45 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:41.098849 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-72febb8a-590e-42f4-ba25-3e4e86169e0b tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "POST /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532/action" status: 202 len: 0 microversion: 2.1 time: 1.038367 Jun 20 12:11:41.099617 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1584/3252] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:11:40 2022] POST /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532/action => generated 0 bytes in 1044 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:11:41.109759 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-61b43886-cc3b-45ff-84ae-2f272b190942 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:41.110514 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-61b43886-cc3b-45ff-84ae-2f272b190942 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:41.130391 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-61b43886-cc3b-45ff-84ae-2f272b190942 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:41.131816 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-61b43886-cc3b-45ff-84ae-2f272b190942 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:41.133073 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-61b43886-cc3b-45ff-84ae-2f272b190942 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:41.133624 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-61b43886-cc3b-45ff-84ae-2f272b190942 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:41.139002 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:11:41.464331 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b7d61f76-c36a-48b0-b2fd-577aea19bc45 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:41.473916 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-61b43886-cc3b-45ff-84ae-2f272b190942 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:41.496724 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-61b43886-cc3b-45ff-84ae-2f272b190942 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.390525 Jun 20 12:11:41.511491 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1585/3253] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:41 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:41.517525 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b7d61f76-c36a-48b0-b2fd-577aea19bc45 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1534 microversion: 2.1 time: 0.490303 Jun 20 12:11:41.518260 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1669/3254] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:41 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1534 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:41.523470 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7dc44594-8a32-42fa-9673-201933d16f20 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:41.524101 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7dc44594-8a32-42fa-9673-201933d16f20 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 9df7a71a-0efc-4929-888a-783e6fded5f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:41.525257 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f102d262-71ad-4c49-86fa-e1a1f10738f2 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Action: 'create', calling method: .version_select at 0x7f6073b78af0>, body: {"pool": null} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:41.546106 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7dc44594-8a32-42fa-9673-201933d16f20 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:41.546394 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7dc44594-8a32-42fa-9673-201933d16f20 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:41.547037 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7dc44594-8a32-42fa-9673-201933d16f20 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:41.547481 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7dc44594-8a32-42fa-9673-201933d16f20 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:42.068789 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7dc44594-8a32-42fa-9673-201933d16f20 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:42.078410 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7dc44594-8a32-42fa-9673-201933d16f20 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2" status: 200 len: 1325 microversion: 2.1 time: 0.558963 Jun 20 12:11:42.088685 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1670/3255] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:41 2022] GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2 => generated 1325 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:42.096086 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2ce99118-944c-4eba-b348-bea0c5bf2e76 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:42.096745 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2ce99118-944c-4eba-b348-bea0c5bf2e76 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:42.106493 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2ce99118-944c-4eba-b348-bea0c5bf2e76 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:42.107317 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2ce99118-944c-4eba-b348-bea0c5bf2e76 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:42.108150 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2ce99118-944c-4eba-b348-bea0c5bf2e76 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:42.108624 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2ce99118-944c-4eba-b348-bea0c5bf2e76 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:42.431367 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2ce99118-944c-4eba-b348-bea0c5bf2e76 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:42.446110 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2ce99118-944c-4eba-b348-bea0c5bf2e76 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.355494 Jun 20 12:11:42.448420 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1671/3256] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:42 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:42.457263 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fccf53fd-23c0-4171-b1bd-6c057afcaf59 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:42.459398 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fccf53fd-23c0-4171-b1bd-6c057afcaf59 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:42.476114 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fccf53fd-23c0-4171-b1bd-6c057afcaf59 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:42.477084 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fccf53fd-23c0-4171-b1bd-6c057afcaf59 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:42.478375 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fccf53fd-23c0-4171-b1bd-6c057afcaf59 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:42.479252 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fccf53fd-23c0-4171-b1bd-6c057afcaf59 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:42.580289 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-fccf53fd-23c0-4171-b1bd-6c057afcaf59 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lazy-loading 'services' on Instance uuid 3c658f2d-9442-4b10-b5f5-2d484553330e {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:11:42.611308 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fccf53fd-23c0-4171-b1bd-6c057afcaf59 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1929 microversion: 2.75 time: 0.160882 Jun 20 12:11:42.623876 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1672/3257] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:42 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1929 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:42.629973 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-97373ada-8ee6-4c81-a35d-5733c8aa0f9b tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:42.633454 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-97373ada-8ee6-4c81-a35d-5733c8aa0f9b tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:42.644488 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-97373ada-8ee6-4c81-a35d-5733c8aa0f9b tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:42.644965 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-97373ada-8ee6-4c81-a35d-5733c8aa0f9b tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:42.645764 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-97373ada-8ee6-4c81-a35d-5733c8aa0f9b tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:42.646209 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-97373ada-8ee6-4c81-a35d-5733c8aa0f9b tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:42.835672 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-97373ada-8ee6-4c81-a35d-5733c8aa0f9b tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:42.857380 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-97373ada-8ee6-4c81-a35d-5733c8aa0f9b tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546" status: 200 len: 1318 microversion: 2.1 time: 0.236656 Jun 20 12:11:42.860032 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1673/3258] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:42 2022] GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:42.870090 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3fcb45ca-3a97-46f9-a5ae-02feb15af0d0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:42.886380 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3fcb45ca-3a97-46f9-a5ae-02feb15af0d0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:42.904445 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3fcb45ca-3a97-46f9-a5ae-02feb15af0d0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:42.905800 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3fcb45ca-3a97-46f9-a5ae-02feb15af0d0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:42.907076 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3fcb45ca-3a97-46f9-a5ae-02feb15af0d0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:42.907670 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3fcb45ca-3a97-46f9-a5ae-02feb15af0d0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:43.102245 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3fcb45ca-3a97-46f9-a5ae-02feb15af0d0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:43.114083 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3fcb45ca-3a97-46f9-a5ae-02feb15af0d0 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.251830 Jun 20 12:11:43.115251 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1674/3259] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:42 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:43.137638 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-207e6765-1d7b-45bb-aeca-8fbd80a930c7 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:43.138577 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-207e6765-1d7b-45bb-aeca-8fbd80a930c7 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:43.146119 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-207e6765-1d7b-45bb-aeca-8fbd80a930c7 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:43.146874 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-207e6765-1d7b-45bb-aeca-8fbd80a930c7 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:43.149529 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-207e6765-1d7b-45bb-aeca-8fbd80a930c7 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:43.150528 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-207e6765-1d7b-45bb-aeca-8fbd80a930c7 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:43.205886 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-207e6765-1d7b-45bb-aeca-8fbd80a930c7 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:43.206859 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-207e6765-1d7b-45bb-aeca-8fbd80a930c7 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:43.207532 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-207e6765-1d7b-45bb-aeca-8fbd80a930c7 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lazy-loading 'fault' on Instance uuid f8b3d285-0f08-4deb-859e-babab7f3b656 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:11:43.296600 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-207e6765-1d7b-45bb-aeca-8fbd80a930c7 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:43.308469 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-207e6765-1d7b-45bb-aeca-8fbd80a930c7 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 200 len: 1368 microversion: 2.1 time: 0.191428 Jun 20 12:11:43.309541 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1675/3260] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:43 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 1368 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:43.320336 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-3e3c9373-2051-4b33-b844-17afa01310ed req-7c6e10b4-4841-4f44-a1f6-b22433982e30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3163bfa2-d7b5-451e-ae0c-cc2ec445c532", "tag": "eb877463-7d93-4069-944d-8674a91f4b80"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:43.342238 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-3e3c9373-2051-4b33-b844-17afa01310ed req-7c6e10b4-4841-4f44-a1f6-b22433982e30 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:43.344458 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-3e3c9373-2051-4b33-b844-17afa01310ed req-7c6e10b4-4841-4f44-a1f6-b22433982e30 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:43.367012 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-3e3c9373-2051-4b33-b844-17afa01310ed req-7c6e10b4-4841-4f44-a1f6-b22433982e30 service nova] Creating event network-changed:eb877463-7d93-4069-944d-8674a91f4b80 for instance 3163bfa2-d7b5-451e-ae0c-cc2ec445c532 on n-h1-master-1 Jun 20 12:11:43.373937 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-3e3c9373-2051-4b33-b844-17afa01310ed req-7c6e10b4-4841-4f44-a1f6-b22433982e30 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062153 Jun 20 12:11:43.375229 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1676/3261] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:11:43.398160 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-0c5eca76-5fa7-4f5a-979f-cc36d5910da6 req-5c473514-970b-4f94-9197-4eff8dee26e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8b3d285-0f08-4deb-859e-babab7f3b656", "name": "network-vif-deleted", "tag": "e23efb88-f8d5-4db8-8321-1c16dca584be"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:43.415789 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-0c5eca76-5fa7-4f5a-979f-cc36d5910da6 req-5c473514-970b-4f94-9197-4eff8dee26e8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:43.417062 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-0c5eca76-5fa7-4f5a-979f-cc36d5910da6 req-5c473514-970b-4f94-9197-4eff8dee26e8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:43.436738 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-0c5eca76-5fa7-4f5a-979f-cc36d5910da6 req-5c473514-970b-4f94-9197-4eff8dee26e8 service nova] Creating event network-vif-deleted:e23efb88-f8d5-4db8-8321-1c16dca584be for instance f8b3d285-0f08-4deb-859e-babab7f3b656 on n-h2-master-1 Jun 20 12:11:43.443995 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-0c5eca76-5fa7-4f5a-979f-cc36d5910da6 req-5c473514-970b-4f94-9197-4eff8dee26e8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066514 Jun 20 12:11:43.449356 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1677/3262] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:11:43.457495 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-092b0a95-ccde-49e5-8045-ca977773a89b tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:43.460179 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-092b0a95-ccde-49e5-8045-ca977773a89b tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 9df7a71a-0efc-4929-888a-783e6fded5f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:43.473556 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-092b0a95-ccde-49e5-8045-ca977773a89b tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:43.474562 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-092b0a95-ccde-49e5-8045-ca977773a89b tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:43.475896 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-092b0a95-ccde-49e5-8045-ca977773a89b tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:43.476847 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-092b0a95-ccde-49e5-8045-ca977773a89b tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:43.711082 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-092b0a95-ccde-49e5-8045-ca977773a89b tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:43.722988 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-092b0a95-ccde-49e5-8045-ca977773a89b tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2" status: 200 len: 1521 microversion: 2.1 time: 0.271071 Jun 20 12:11:43.724865 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1678/3263] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:43 2022] GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:43.741126 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ebf54136-6bbd-45ca-8c18-44002d06e5b9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:43.755722 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-ebf54136-6bbd-45ca-8c18-44002d06e5b9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] HTTP exception thrown: Instance 6c678fd4-d250-40e3-899f-ef365b0e744e has no mapping to a cell. Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ebf54136-6bbd-45ca-8c18-44002d06e5b9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers/6c678fd4-d250-40e3-899f-ef365b0e744e/action HTTP/1.1 Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 15 Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: {"os-stop": {}} Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 6c678fd4-d250-40e3-899f-ef365b0e744e has no mapping to a cell. Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '6c678fd4-d250-40e3-899f-ef365b0e744e', 'body': {'os-stop': {}}} Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 6c678fd4-d250-40e3-899f-ef365b0e744e has no mapping to a cell. Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:11:43.766182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c678fd4-d250-40e3-899f-ef365b0e744e has no mapping to a cell. Jun 20 12:11:43.775165 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:43.775165 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:43.775165 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:43.775165 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:43.775165 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:43.775165 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:43.775165 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:11:43.775165 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:11:43.775165 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c678fd4-d250-40e3-899f-ef365b0e744e has no mapping to a cell. Jun 20 12:11:43.775165 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:43.780934 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ebf54136-6bbd-45ca-8c18-44002d06e5b9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 404 to user: Instance 6c678fd4-d250-40e3-899f-ef365b0e744e has no mapping to a cell. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:11:43.782628 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ebf54136-6bbd-45ca-8c18-44002d06e5b9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers/6c678fd4-d250-40e3-899f-ef365b0e744e/action" status: 404 len: 117 microversion: 2.1 time: 0.056052 Jun 20 12:11:43.783648 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1679/3264] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:11:43 2022] POST /compute/v2.1/servers/6c678fd4-d250-40e3-899f-ef365b0e744e/action => generated 117 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:11:43.796094 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1a3f008a-3914-4008-bae3-37294c88a431 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:43.797024 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1a3f008a-3914-4008-bae3-37294c88a431 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:43.807573 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a3f008a-3914-4008-bae3-37294c88a431 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:43.810007 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a3f008a-3914-4008-bae3-37294c88a431 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:43.811061 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a3f008a-3914-4008-bae3-37294c88a431 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:43.811813 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a3f008a-3914-4008-bae3-37294c88a431 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:43.958340 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-1a3f008a-3914-4008-bae3-37294c88a431 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lazy-loading 'services' on Instance uuid 3c658f2d-9442-4b10-b5f5-2d484553330e {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:11:44.046576 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f102d262-71ad-4c49-86fa-e1a1f10738f2 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.531738 Jun 20 12:11:44.048765 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1586/3265] 10.222.0.27 () {60 vars in 1169 bytes} [Mon Jun 20 12:11:41 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:11:44.052804 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1a3f008a-3914-4008-bae3-37294c88a431 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1929 microversion: 2.75 time: 0.248390 Jun 20 12:11:44.057837 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1680/3266] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:43 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1929 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:44.078464 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-491e26d7-efdc-4fc3-b6a0-10a01ffbaea3 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:44.079824 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-491e26d7-efdc-4fc3-b6a0-10a01ffbaea3 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 9df7a71a-0efc-4929-888a-783e6fded5f2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:44.091731 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9348947a-7783-4c9a-922f-421f1d7aaeca tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:44.093823 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9348947a-7783-4c9a-922f-421f1d7aaeca tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:44.101892 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-491e26d7-efdc-4fc3-b6a0-10a01ffbaea3 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:44.102631 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-491e26d7-efdc-4fc3-b6a0-10a01ffbaea3 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:44.107634 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-491e26d7-efdc-4fc3-b6a0-10a01ffbaea3 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:44.108031 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9348947a-7783-4c9a-922f-421f1d7aaeca tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:44.109066 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-491e26d7-efdc-4fc3-b6a0-10a01ffbaea3 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:44.109275 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9348947a-7783-4c9a-922f-421f1d7aaeca tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:44.111802 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9348947a-7783-4c9a-922f-421f1d7aaeca tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:44.112849 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9348947a-7783-4c9a-922f-421f1d7aaeca tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:44.215542 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-491e26d7-efdc-4fc3-b6a0-10a01ffbaea3 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 9df7a71a-0efc-4929-888a-783e6fded5f2] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:11:44.405521 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-491e26d7-efdc-4fc3-b6a0-10a01ffbaea3 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2" status: 204 len: 0 microversion: 2.1 time: 0.354063 Jun 20 12:11:44.406693 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1587/3267] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:11:44 2022] DELETE /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:11:44.419452 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7a17c1ea-7e29-4b35-a88b-d8a61c2e3a14 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:44.420971 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7a17c1ea-7e29-4b35-a88b-d8a61c2e3a14 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:44.433956 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7a17c1ea-7e29-4b35-a88b-d8a61c2e3a14 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:44.434908 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7a17c1ea-7e29-4b35-a88b-d8a61c2e3a14 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:44.436541 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7a17c1ea-7e29-4b35-a88b-d8a61c2e3a14 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:44.437613 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7a17c1ea-7e29-4b35-a88b-d8a61c2e3a14 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:44.442111 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9348947a-7783-4c9a-922f-421f1d7aaeca tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:44.463022 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9348947a-7783-4c9a-922f-421f1d7aaeca tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.400760 Jun 20 12:11:44.469192 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1681/3268] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:44 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:44.486481 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-95a4ea4a-d518-4bff-977e-bddfb672aef1 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.2.40"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:44.488980 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-95a4ea4a-d518-4bff-977e-bddfb672aef1 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:44.504027 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-95a4ea4a-d518-4bff-977e-bddfb672aef1 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:44.504584 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-95a4ea4a-d518-4bff-977e-bddfb672aef1 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:44.505621 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-95a4ea4a-d518-4bff-977e-bddfb672aef1 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:44.506179 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-95a4ea4a-d518-4bff-977e-bddfb672aef1 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:44.530430 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:11:44.546108 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-95a4ea4a-d518-4bff-977e-bddfb672aef1 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Acquired lock "refresh_cache-3163bfa2-d7b5-451e-ae0c-cc2ec445c532" {{(pid=119127) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 20 12:11:44.632327 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7a17c1ea-7e29-4b35-a88b-d8a61c2e3a14 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:44.650035 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7a17c1ea-7e29-4b35-a88b-d8a61c2e3a14 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546" status: 200 len: 1318 microversion: 2.1 time: 0.240362 Jun 20 12:11:44.651983 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1588/3269] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:44 2022] GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:44.661838 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-3693fea5-55fe-40fd-a31a-6c03e4feef31 req-b93fde4f-9f5a-4ea3-a27c-578efb665a3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546", "name": "network-vif-plugged", "status": "completed", "tag": "e3be9c58-3684-4be2-8bc7-be13922b9ca1"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:44.684347 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-3693fea5-55fe-40fd-a31a-6c03e4feef31 req-b93fde4f-9f5a-4ea3-a27c-578efb665a3c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:44.685315 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-3693fea5-55fe-40fd-a31a-6c03e4feef31 req-b93fde4f-9f5a-4ea3-a27c-578efb665a3c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:44.702260 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-3693fea5-55fe-40fd-a31a-6c03e4feef31 req-b93fde4f-9f5a-4ea3-a27c-578efb665a3c service nova] Creating event network-vif-plugged:e3be9c58-3684-4be2-8bc7-be13922b9ca1 for instance cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546 on n-h2-master-1 Jun 20 12:11:44.708356 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-3693fea5-55fe-40fd-a31a-6c03e4feef31 req-b93fde4f-9f5a-4ea3-a27c-578efb665a3c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055142 Jun 20 12:11:44.709383 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1589/3270] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:11:44.715123 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3d777367-822b-44e0-ae16-1c5c015a687d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:44.715846 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3d777367-822b-44e0-ae16-1c5c015a687d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f8b3d285-0f08-4deb-859e-babab7f3b656] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:44.723071 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3d777367-822b-44e0-ae16-1c5c015a687d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:44.723612 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3d777367-822b-44e0-ae16-1c5c015a687d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:44.724707 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3d777367-822b-44e0-ae16-1c5c015a687d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:44.725189 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3d777367-822b-44e0-ae16-1c5c015a687d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:44.741542 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-3d777367-822b-44e0-ae16-1c5c015a687d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] HTTP exception thrown: Instance f8b3d285-0f08-4deb-859e-babab7f3b656 could not be found. Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3d777367-822b-44e0-ae16-1c5c015a687d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Request method failure captured: Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 HTTP/1.1 Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGKgi6jYIAm3mfrUjSiNYuEgcTX-WvqX2nMthzvsgeNwQ63Cs23utZPsmVsS6vSezI6Nxdnn7Zt7mq7APT9g109DZ_381MHORhtFZLL5CBWrwSUf5JupH83uMJgSQkQuNZkzrfhiFeMJ-I3PkrvVM-3iB1YjUY3Lg7SvpH9-AzUhDwc Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 4440dc3e2f9c4134a54b08e2585f6c59 Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-MigrationsAdminTest-286401708 Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4440dc3e2f9c4134a54b08e2585f6c59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4440dc3e2f9c4134a54b08e2585f6c59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4440dc3e2f9c4134a54b08e2585f6c59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4440dc3e2f9c4134a54b08e2585f6c59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-MigrationsAdminTest-286401708 Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 4440dc3e2f9c4134a54b08e2585f6c59 Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-MigrationsAdminTest-286401708 Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-MigrationsAdminTest-286401708-project Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 3d35b7c824b641099a406175bccc5be3 Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-MigrationsAdminTest-286401708-project Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: exception: Instance f8b3d285-0f08-4deb-859e-babab7f3b656 could not be found. Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'f8b3d285-0f08-4deb-859e-babab7f3b656'} Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8b3d285-0f08-4deb-859e-babab7f3b656 could not be found. Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8b3d285-0f08-4deb-859e-babab7f3b656 could not be found. Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:44.743441 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:44.749199 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:44.749199 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:44.749199 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:44.749199 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:11:44.749199 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:11:44.749199 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8b3d285-0f08-4deb-859e-babab7f3b656 could not be found. Jun 20 12:11:44.749199 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:44.749199 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3d777367-822b-44e0-ae16-1c5c015a687d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Returning 404 to user: Instance f8b3d285-0f08-4deb-859e-babab7f3b656 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:11:44.749199 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3d777367-822b-44e0-ae16-1c5c015a687d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656" status: 404 len: 111 microversion: 2.1 time: 0.034578 Jun 20 12:11:44.750018 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1590/3271] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:44 2022] GET /compute/v2.1/servers/f8b3d285-0f08-4deb-859e-babab7f3b656 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:11:44.759498 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8307fb31-c6b5-4845-b7e2-a5bc66054e8c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:44.760673 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8307fb31-c6b5-4845-b7e2-a5bc66054e8c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 9df7a71a-0efc-4929-888a-783e6fded5f2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:44.773108 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8307fb31-c6b5-4845-b7e2-a5bc66054e8c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:44.774699 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8307fb31-c6b5-4845-b7e2-a5bc66054e8c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:44.776106 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8307fb31-c6b5-4845-b7e2-a5bc66054e8c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:44.777835 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8307fb31-c6b5-4845-b7e2-a5bc66054e8c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:44.956328 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8307fb31-c6b5-4845-b7e2-a5bc66054e8c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:44.964677 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8307fb31-c6b5-4845-b7e2-a5bc66054e8c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2" status: 200 len: 1527 microversion: 2.1 time: 0.213640 Jun 20 12:11:44.974917 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1591/3272] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:44 2022] GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2 => generated 1527 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:44.980270 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b90b10d0-c741-45fa-9a7b-3e6da5fe9b55 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:44.980925 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b90b10d0-c741-45fa-9a7b-3e6da5fe9b55 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:44.988167 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b90b10d0-c741-45fa-9a7b-3e6da5fe9b55 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:44.988654 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b90b10d0-c741-45fa-9a7b-3e6da5fe9b55 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:44.989695 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b90b10d0-c741-45fa-9a7b-3e6da5fe9b55 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:44.990132 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b90b10d0-c741-45fa-9a7b-3e6da5fe9b55 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:45.153960 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b90b10d0-c741-45fa-9a7b-3e6da5fe9b55 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:45.162813 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b90b10d0-c741-45fa-9a7b-3e6da5fe9b55 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.186458 Jun 20 12:11:45.163540 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1592/3273] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:44 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:45.172323 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-54fa0266-c29d-421a-bc23-45488385fd2b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '.version_select at 0x7f60847b6e50>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:45.202496 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-54fa0266-c29d-421a-bc23-45488385fd2b tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-425251801" status: 202 len: 0 microversion: 2.1 time: 0.037521 Jun 20 12:11:45.203309 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1593/3274] 10.222.0.27 () {58 vars in 1217 bytes} [Mon Jun 20 12:11:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-425251801 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:11:45.210964 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b7824390-2fdd-4ced-b61b-5805d7af2083 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:45.211806 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b7824390-2fdd-4ced-b61b-5805d7af2083 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:45.221038 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b7824390-2fdd-4ced-b61b-5805d7af2083 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:45.221806 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b7824390-2fdd-4ced-b61b-5805d7af2083 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:45.222882 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b7824390-2fdd-4ced-b61b-5805d7af2083 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:45.223575 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b7824390-2fdd-4ced-b61b-5805d7af2083 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:45.329010 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-b7824390-2fdd-4ced-b61b-5805d7af2083 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lazy-loading 'services' on Instance uuid 3c658f2d-9442-4b10-b5f5-2d484553330e {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:11:45.362999 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b7824390-2fdd-4ced-b61b-5805d7af2083 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1929 microversion: 2.75 time: 0.157652 Jun 20 12:11:45.363631 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1594/3275] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:45 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1929 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:45.378125 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-427d4924-a6ed-4e30-a38e-5a20e9701248 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:45.379828 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-427d4924-a6ed-4e30-a38e-5a20e9701248 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 30b6fcad-f8c5-4f58-a6d2-26d81ff26625] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:45.389355 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-427d4924-a6ed-4e30-a38e-5a20e9701248 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] HTTP exception thrown: Instance 30b6fcad-f8c5-4f58-a6d2-26d81ff26625 could not be found. Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-427d4924-a6ed-4e30-a38e-5a20e9701248 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/servers/30b6fcad-f8c5-4f58-a6d2-26d81ff26625/action HTTP/1.1 Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 15 Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: {"suspend": {}} Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 30b6fcad-f8c5-4f58-a6d2-26d81ff26625 could not be found. Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '30b6fcad-f8c5-4f58-a6d2-26d81ff26625', 'body': {'suspend': {}}} Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30b6fcad-f8c5-4f58-a6d2-26d81ff26625 could not be found. Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30b6fcad-f8c5-4f58-a6d2-26d81ff26625 could not be found. Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:45.392383 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:45.400762 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:11:45.400762 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:11:45.400762 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30b6fcad-f8c5-4f58-a6d2-26d81ff26625 could not be found. Jun 20 12:11:45.400762 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:45.400762 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-427d4924-a6ed-4e30-a38e-5a20e9701248 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 404 to user: Instance 30b6fcad-f8c5-4f58-a6d2-26d81ff26625 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:11:45.400762 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-427d4924-a6ed-4e30-a38e-5a20e9701248 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers/30b6fcad-f8c5-4f58-a6d2-26d81ff26625/action" status: 404 len: 111 microversion: 2.1 time: 0.029250 Jun 20 12:11:45.400762 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1595/3276] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:11:45 2022] POST /compute/v2.1/servers/30b6fcad-f8c5-4f58-a6d2-26d81ff26625/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:11:45.406149 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3961e14c-b5fd-48f0-8c72-94dc3d5ef072 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:45.411364 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3961e14c-b5fd-48f0-8c72-94dc3d5ef072 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:45.434689 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3961e14c-b5fd-48f0-8c72-94dc3d5ef072 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:45.435314 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3961e14c-b5fd-48f0-8c72-94dc3d5ef072 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:45.436306 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3961e14c-b5fd-48f0-8c72-94dc3d5ef072 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:45.436695 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3961e14c-b5fd-48f0-8c72-94dc3d5ef072 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:45.779985 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3961e14c-b5fd-48f0-8c72-94dc3d5ef072 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:45.790415 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3961e14c-b5fd-48f0-8c72-94dc3d5ef072 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.391648 Jun 20 12:11:45.792268 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1596/3277] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:45 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:45.797643 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-87045497-d867-458a-bca4-9111b359f7d8 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:45.798695 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-87045497-d867-458a-bca4-9111b359f7d8 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:45.812543 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-87045497-d867-458a-bca4-9111b359f7d8 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:45.814904 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-87045497-d867-458a-bca4-9111b359f7d8 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:45.816299 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-87045497-d867-458a-bca4-9111b359f7d8 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:45.816954 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-87045497-d867-458a-bca4-9111b359f7d8 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:46.004842 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-95a4ea4a-d518-4bff-977e-bddfb672aef1 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Building network info cache for instance {{(pid=119127) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 20 12:11:46.540872 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-87045497-d867-458a-bca4-9111b359f7d8 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:46.556096 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-87045497-d867-458a-bca4-9111b359f7d8 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546" status: 200 len: 1318 microversion: 2.1 time: 0.761154 Jun 20 12:11:46.561346 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1597/3278] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:45 2022] GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546 => generated 1318 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:46.577229 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a73fb5d1-a620-41d6-8265-5b28870abf78 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:46.577901 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a73fb5d1-a620-41d6-8265-5b28870abf78 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:46.597469 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a73fb5d1-a620-41d6-8265-5b28870abf78 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:46.600693 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a73fb5d1-a620-41d6-8265-5b28870abf78 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:46.613383 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a73fb5d1-a620-41d6-8265-5b28870abf78 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:46.621487 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a73fb5d1-a620-41d6-8265-5b28870abf78 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:46.978968 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a73fb5d1-a620-41d6-8265-5b28870abf78 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:46.993334 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a73fb5d1-a620-41d6-8265-5b28870abf78 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.428631 Jun 20 12:11:46.994356 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1598/3279] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:46 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:47.003521 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6bbf8ae3-e149-4bec-9c67-82d732c5a62b tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:47.007764 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6bbf8ae3-e149-4bec-9c67-82d732c5a62b tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 9df7a71a-0efc-4929-888a-783e6fded5f2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:47.025788 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6bbf8ae3-e149-4bec-9c67-82d732c5a62b tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:47.027650 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6bbf8ae3-e149-4bec-9c67-82d732c5a62b tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:47.029216 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6bbf8ae3-e149-4bec-9c67-82d732c5a62b tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:47.031270 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6bbf8ae3-e149-4bec-9c67-82d732c5a62b tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:47.119113 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-95a4ea4a-d518-4bff-977e-bddfb672aef1 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Updating instance_info_cache with network_info: [{"id": "eb877463-7d93-4069-944d-8674a91f4b80", "address": "fa:16:3e:cb:a2:ea", "network": {"id": "844279f1-b6b7-42d1-9946-2fe7ef088f0b", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1982825746-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.2.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5c47b977a1334cd486385213ff23de86", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapeb877463-7d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119127) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 20 12:11:47.134148 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-95a4ea4a-d518-4bff-977e-bddfb672aef1 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Releasing lock "refresh_cache-3163bfa2-d7b5-451e-ae0c-cc2ec445c532" {{(pid=119127) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 20 12:11:47.135739 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-95a4ea4a-d518-4bff-977e-bddfb672aef1 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "POST /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532/action" status: 202 len: 0 microversion: 2.1 time: 2.661166 Jun 20 12:11:47.138951 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1682/3280] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:11:44 2022] POST /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532/action => generated 0 bytes in 2667 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 20 12:11:47.150438 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-be925da2-2347-4e05-b612-bef6ade73d96 req-699b7555-23ad-4131-b53d-bcdc626eda0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3163bfa2-d7b5-451e-ae0c-cc2ec445c532", "tag": "eb877463-7d93-4069-944d-8674a91f4b80"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:47.164351 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-be925da2-2347-4e05-b612-bef6ade73d96 req-699b7555-23ad-4131-b53d-bcdc626eda0f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:47.166974 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-be925da2-2347-4e05-b612-bef6ade73d96 req-699b7555-23ad-4131-b53d-bcdc626eda0f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:47.189299 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-be925da2-2347-4e05-b612-bef6ade73d96 req-699b7555-23ad-4131-b53d-bcdc626eda0f service nova] Creating event network-changed:eb877463-7d93-4069-944d-8674a91f4b80 for instance 3163bfa2-d7b5-451e-ae0c-cc2ec445c532 on n-h1-master-1 Jun 20 12:11:47.199126 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-be925da2-2347-4e05-b612-bef6ade73d96 req-699b7555-23ad-4131-b53d-bcdc626eda0f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052108 Jun 20 12:11:47.206762 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1683/3281] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:11:47.213863 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-21f3bf7f-6f30-4459-ace1-87fba7e26fb5 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:47.214959 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-21f3bf7f-6f30-4459-ace1-87fba7e26fb5 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:47.228658 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21f3bf7f-6f30-4459-ace1-87fba7e26fb5 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:47.229577 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21f3bf7f-6f30-4459-ace1-87fba7e26fb5 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:47.230896 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21f3bf7f-6f30-4459-ace1-87fba7e26fb5 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:47.232063 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21f3bf7f-6f30-4459-ace1-87fba7e26fb5 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:47.358979 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-21f3bf7f-6f30-4459-ace1-87fba7e26fb5 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lazy-loading 'services' on Instance uuid 3c658f2d-9442-4b10-b5f5-2d484553330e {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:11:47.394146 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-21f3bf7f-6f30-4459-ace1-87fba7e26fb5 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1929 microversion: 2.75 time: 0.185306 Jun 20 12:11:47.407360 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1684/3282] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:47 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1929 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:47.407360 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-29a5b5ce-42e5-480a-a083-f312e81d3637 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:47.407360 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-29a5b5ce-42e5-480a-a083-f312e81d3637 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:47.409169 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-29a5b5ce-42e5-480a-a083-f312e81d3637 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:47.409748 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-29a5b5ce-42e5-480a-a083-f312e81d3637 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:47.410572 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-29a5b5ce-42e5-480a-a083-f312e81d3637 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:47.410844 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-29a5b5ce-42e5-480a-a083-f312e81d3637 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:47.451340 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6bbf8ae3-e149-4bec-9c67-82d732c5a62b tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16367ef663a74bd49162b82a7e661d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4880e508de374c748670ce9ff5963336', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:47.464056 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6bbf8ae3-e149-4bec-9c67-82d732c5a62b tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2" status: 200 len: 1527 microversion: 2.1 time: 0.467679 Jun 20 12:11:47.474564 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-29a5b5ce-42e5-480a-a083-f312e81d3637 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:11:47.476158 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1599/3283] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:46 2022] GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2 => generated 1527 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:47.482274 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c7fb356a-f07f-415d-9ee7-9e4a837944bb tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:47.482877 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c7fb356a-f07f-415d-9ee7-9e4a837944bb tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:47.496493 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c7fb356a-f07f-415d-9ee7-9e4a837944bb tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:47.497012 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c7fb356a-f07f-415d-9ee7-9e4a837944bb tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:47.498492 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c7fb356a-f07f-415d-9ee7-9e4a837944bb tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:47.498943 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c7fb356a-f07f-415d-9ee7-9e4a837944bb tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:47.531686 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-c7fb356a-f07f-415d-9ee7-9e4a837944bb tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lazy-loading 'flavor' on Instance uuid 593cda12-6491-4a27-8fc7-42c05e0291c3 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:11:47.615829 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-29a5b5ce-42e5-480a-a083-f312e81d3637 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 204 len: 0 microversion: 2.1 time: 0.218645 Jun 20 12:11:47.616814 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1685/3284] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:11:47 2022] DELETE /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:11:47.626523 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0351aef5-905c-47df-9eed-9e50ce23f02f tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.2.40"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:47.699956 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c7fb356a-f07f-415d-9ee7-9e4a837944bb tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3/action" status: 202 len: 0 microversion: 2.1 time: 0.222320 Jun 20 12:11:47.707993 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1600/3285] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:11:47 2022] POST /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:11:47.717961 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-7014db70-2230-4b06-89c3-5d03d668e297 req-492eb8e6-1707-4084-98a0-862f1e1ebbed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9df7a71a-0efc-4929-888a-783e6fded5f2", "name": "network-vif-deleted", "tag": "043adafc-5190-43bd-9f51-c1f1a4c5401b"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:47.724744 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:11:47.731027 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-7014db70-2230-4b06-89c3-5d03d668e297 req-492eb8e6-1707-4084-98a0-862f1e1ebbed service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:47.731581 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-7014db70-2230-4b06-89c3-5d03d668e297 req-492eb8e6-1707-4084-98a0-862f1e1ebbed service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:47.745207 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-7014db70-2230-4b06-89c3-5d03d668e297 req-492eb8e6-1707-4084-98a0-862f1e1ebbed service nova] Creating event network-vif-deleted:043adafc-5190-43bd-9f51-c1f1a4c5401b for instance 9df7a71a-0efc-4929-888a-783e6fded5f2 on n-h1-master-1 Jun 20 12:11:47.751258 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-7014db70-2230-4b06-89c3-5d03d668e297 req-492eb8e6-1707-4084-98a0-862f1e1ebbed service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041573 Jun 20 12:11:47.752361 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1601/3286] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:11:47.761147 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7b20e2d1-fed4-4d35-b6ca-2d0e1fca803c tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:47.762261 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7b20e2d1-fed4-4d35-b6ca-2d0e1fca803c tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:47.771952 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7b20e2d1-fed4-4d35-b6ca-2d0e1fca803c tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:47.772695 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7b20e2d1-fed4-4d35-b6ca-2d0e1fca803c tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:47.773667 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7b20e2d1-fed4-4d35-b6ca-2d0e1fca803c tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:47.774553 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7b20e2d1-fed4-4d35-b6ca-2d0e1fca803c tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:47.815685 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0351aef5-905c-47df-9eed-9e50ce23f02f tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:47.821871 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0351aef5-905c-47df-9eed-9e50ce23f02f tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:47.822315 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0351aef5-905c-47df-9eed-9e50ce23f02f tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:47.823282 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0351aef5-905c-47df-9eed-9e50ce23f02f tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:47.823863 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0351aef5-905c-47df-9eed-9e50ce23f02f tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:48.057980 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7b20e2d1-fed4-4d35-b6ca-2d0e1fca803c tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:48.068095 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7b20e2d1-fed4-4d35-b6ca-2d0e1fca803c tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546" status: 200 len: 1509 microversion: 2.1 time: 0.313569 Jun 20 12:11:48.080409 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1602/3287] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:47 2022] GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546 => generated 1509 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:48.087061 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0c3e1df9-2c43-40be-8b34-5260042df26d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:48.088042 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0c3e1df9-2c43-40be-8b34-5260042df26d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:48.096302 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c3e1df9-2c43-40be-8b34-5260042df26d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:48.097176 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c3e1df9-2c43-40be-8b34-5260042df26d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:48.098177 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c3e1df9-2c43-40be-8b34-5260042df26d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:48.098780 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c3e1df9-2c43-40be-8b34-5260042df26d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:48.104148 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:11:48.333783 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0c3e1df9-2c43-40be-8b34-5260042df26d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:48.344499 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0c3e1df9-2c43-40be-8b34-5260042df26d tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 200 len: 1469 microversion: 2.1 time: 0.262090 Jun 20 12:11:48.346490 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1603/3288] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:48 2022] GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 1469 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:48.352713 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4fcb852a-c562-40ac-b1b8-7a579de6fb38 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:48.354275 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4fcb852a-c562-40ac-b1b8-7a579de6fb38 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:48.362574 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4fcb852a-c562-40ac-b1b8-7a579de6fb38 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:48.363908 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4fcb852a-c562-40ac-b1b8-7a579de6fb38 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:48.365049 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4fcb852a-c562-40ac-b1b8-7a579de6fb38 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:48.365706 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4fcb852a-c562-40ac-b1b8-7a579de6fb38 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:48.500650 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0351aef5-905c-47df-9eed-9e50ce23f02f tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Acquired lock "refresh_cache-3163bfa2-d7b5-451e-ae0c-cc2ec445c532" {{(pid=119127) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 20 12:11:48.895767 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4fcb852a-c562-40ac-b1b8-7a579de6fb38 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:48.903717 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4fcb852a-c562-40ac-b1b8-7a579de6fb38 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1514 microversion: 2.1 time: 0.555942 Jun 20 12:11:48.914839 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1604/3289] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:48 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1514 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:48.914839 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5e4819c5-211f-4e68-a8da-3783787b347d tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:48.914839 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5e4819c5-211f-4e68-a8da-3783787b347d tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:48.918185 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e4819c5-211f-4e68-a8da-3783787b347d tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:48.919275 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e4819c5-211f-4e68-a8da-3783787b347d tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:48.920051 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e4819c5-211f-4e68-a8da-3783787b347d tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:48.920804 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e4819c5-211f-4e68-a8da-3783787b347d tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:49.080681 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5e4819c5-211f-4e68-a8da-3783787b347d tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:49.093653 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5e4819c5-211f-4e68-a8da-3783787b347d tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546" status: 200 len: 1509 microversion: 2.1 time: 0.188171 Jun 20 12:11:49.094500 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1605/3290] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:48 2022] GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546 => generated 1509 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:49.100283 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-db750953-2fd6-44a5-99da-d8c3a0bdad93 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:49.101717 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-db750953-2fd6-44a5-99da-d8c3a0bdad93 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:49.108299 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-db750953-2fd6-44a5-99da-d8c3a0bdad93 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:49.109124 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-db750953-2fd6-44a5-99da-d8c3a0bdad93 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:49.111000 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-db750953-2fd6-44a5-99da-d8c3a0bdad93 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:49.111600 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-db750953-2fd6-44a5-99da-d8c3a0bdad93 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:49.201634 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-db750953-2fd6-44a5-99da-d8c3a0bdad93 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lazy-loading 'services' on Instance uuid 3c658f2d-9442-4b10-b5f5-2d484553330e {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:11:49.222824 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-db750953-2fd6-44a5-99da-d8c3a0bdad93 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1929 microversion: 2.75 time: 0.127074 Jun 20 12:11:49.223398 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1606/3291] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:49 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1929 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:49.228883 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7d9437cb-24ec-4bbe-9842-81fe633f0abe tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:49.229700 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7d9437cb-24ec-4bbe-9842-81fe633f0abe tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 9df7a71a-0efc-4929-888a-783e6fded5f2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:49.233987 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-0351aef5-905c-47df-9eed-9e50ce23f02f tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Building network info cache for instance {{(pid=119127) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 20 12:11:49.237923 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7d9437cb-24ec-4bbe-9842-81fe633f0abe tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:49.238628 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7d9437cb-24ec-4bbe-9842-81fe633f0abe tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:49.239598 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7d9437cb-24ec-4bbe-9842-81fe633f0abe tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:49.240233 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7d9437cb-24ec-4bbe-9842-81fe633f0abe tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:49.256251 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-7d9437cb-24ec-4bbe-9842-81fe633f0abe tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] HTTP exception thrown: Instance 9df7a71a-0efc-4929-888a-783e6fded5f2 could not be found. Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7d9437cb-24ec-4bbe-9842-81fe633f0abe tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Request method failure captured: Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2 HTTP/1.1 Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGN4qiwM-MecDHxONzVMkA72NR_SSrElKGFho2amrxg9uMlhFTBY3bq5CJPNlZORM2tW_nQRhsPIUTgettXi4lSiCQeK40e01rW_16Lzz4FJO6EC5uBs_A-i3_njR3_9I2L-oxsuaQd8HwAiDLKOUCEhiwyWJOA1WjMqhqu3KfOGLgY Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 4880e508de374c748670ce9ff5963336 Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4880e508de374c748670ce9ff5963336"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4880e508de374c748670ce9ff5963336"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4880e508de374c748670ce9ff5963336"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4880e508de374c748670ce9ff5963336"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 4880e508de374c748670ce9ff5963336 Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ImagesOneServerNegativeTestJSON-1288781692-project Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 16367ef663a74bd49162b82a7e661d1e Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692-project Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 9df7a71a-0efc-4929-888a-783e6fded5f2 could not be found. Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '9df7a71a-0efc-4929-888a-783e6fded5f2'} Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9df7a71a-0efc-4929-888a-783e6fded5f2 could not be found. Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9df7a71a-0efc-4929-888a-783e6fded5f2 could not be found. Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:49.258346 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:49.262470 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:49.262470 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:49.262470 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:49.262470 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:49.262470 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:11:49.262470 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:11:49.262470 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9df7a71a-0efc-4929-888a-783e6fded5f2 could not be found. Jun 20 12:11:49.262470 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:49.266879 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7d9437cb-24ec-4bbe-9842-81fe633f0abe tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Returning 404 to user: Instance 9df7a71a-0efc-4929-888a-783e6fded5f2 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:11:49.267366 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7d9437cb-24ec-4bbe-9842-81fe633f0abe tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2" status: 404 len: 111 microversion: 2.1 time: 0.042619 Jun 20 12:11:49.268153 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1607/3292] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:49 2022] GET /compute/v2.1/servers/9df7a71a-0efc-4929-888a-783e6fded5f2 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:11:49.275680 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-79a1bd0c-c376-427d-87fb-28c4d296b583 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:49.277085 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-79a1bd0c-c376-427d-87fb-28c4d296b583 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:49.283443 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-79a1bd0c-c376-427d-87fb-28c4d296b583 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:49.283896 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-79a1bd0c-c376-427d-87fb-28c4d296b583 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:49.286065 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-79a1bd0c-c376-427d-87fb-28c4d296b583 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:49.286218 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-79a1bd0c-c376-427d-87fb-28c4d296b583 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:49.367807 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-79a1bd0c-c376-427d-87fb-28c4d296b583 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "PUT /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546" status: 200 len: 1081 microversion: 2.1 time: 0.095623 Jun 20 12:11:49.369736 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1608/3293] 10.222.0.27 () {60 vars in 1255 bytes} [Mon Jun 20 12:11:49 2022] PUT /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546 => generated 1081 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:49.376546 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-b789424d-37ce-4560-b79e-96d30007355b req-6c1d9180-aae6-4833-91a9-c3dc3d9b5ab9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3163bfa2-d7b5-451e-ae0c-cc2ec445c532", "tag": "eb877463-7d93-4069-944d-8674a91f4b80"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:49.388359 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-b789424d-37ce-4560-b79e-96d30007355b req-6c1d9180-aae6-4833-91a9-c3dc3d9b5ab9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:49.389313 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-b789424d-37ce-4560-b79e-96d30007355b req-6c1d9180-aae6-4833-91a9-c3dc3d9b5ab9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:49.404758 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-b789424d-37ce-4560-b79e-96d30007355b req-6c1d9180-aae6-4833-91a9-c3dc3d9b5ab9 service nova] Creating event network-changed:eb877463-7d93-4069-944d-8674a91f4b80 for instance 3163bfa2-d7b5-451e-ae0c-cc2ec445c532 on n-h1-master-1 Jun 20 12:11:49.411350 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-b789424d-37ce-4560-b79e-96d30007355b req-6c1d9180-aae6-4833-91a9-c3dc3d9b5ab9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039706 Jun 20 12:11:49.412853 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1609/3294] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:11:49.418289 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-82e09032-acd9-48b2-8d82-175696875574 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '.version_select at 0x7f60847d9310>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:49.452994 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-82e09032-acd9-48b2-8d82-175696875574 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] HTTP exception thrown: Image not found. Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-82e09032-acd9-48b2-8d82-175696875574 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Request method failure captured: Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/images/2eb351c3-ad27-4431-b5b6-6320737c10cb HTTP/1.1 Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGN4qiwM-MecDHxONzVMkA72NR_SSrElKGFho2amrxg9uMlhFTBY3bq5CJPNlZORM2tW_nQRhsPIUTgettXi4lSiCQeK40e01rW_16Lzz4FJO6EC5uBs_A-i3_njR3_9I2L-oxsuaQd8HwAiDLKOUCEhiwyWJOA1WjMqhqu3KfOGLgY Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 4880e508de374c748670ce9ff5963336 Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4880e508de374c748670ce9ff5963336"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4880e508de374c748670ce9ff5963336"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4880e508de374c748670ce9ff5963336"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4880e508de374c748670ce9ff5963336"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 4880e508de374c748670ce9ff5963336 Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ImagesOneServerNegativeTestJSON-1288781692-project Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 16367ef663a74bd49162b82a7e661d1e Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692-project Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: exception: Image not found. Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '2eb351c3-ad27-4431-b5b6-6320737c10cb'} Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2eb351c3-ad27-4431-b5b6-6320737c10cb to delete Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2eb351c3-ad27-4431-b5b6-6320737c10cb could not be found. Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:49.456719 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:49.464750 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:49.464750 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:49.464750 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:49.464750 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:11:49.464750 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:11:49.464750 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:11:49.464750 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:11:49.464750 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:11:49.464750 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:11:49.464750 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 20 12:11:49.464750 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 20 12:11:49.464750 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 20 12:11:49.464750 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:49.464750 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:49.464750 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:49.464750 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:49.464750 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:49.464750 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:49.464750 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:11:49.464750 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:11:49.464750 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 20 12:11:49.464750 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:49.464750 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-82e09032-acd9-48b2-8d82-175696875574 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Returning 404 to user: Image not found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:11:49.464750 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-82e09032-acd9-48b2-8d82-175696875574 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "DELETE /compute/v2.1/images/2eb351c3-ad27-4431-b5b6-6320737c10cb" status: 404 len: 62 microversion: 2.1 time: 0.044421 Jun 20 12:11:49.464750 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1610/3295] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:49 2022] DELETE /compute/v2.1/images/2eb351c3-ad27-4431-b5b6-6320737c10cb => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:11:49.474382 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-65d9796f-37b1-462f-8b7d-2439fd2c1e53 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:49.475387 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-65d9796f-37b1-462f-8b7d-2439fd2c1e53 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:49.486002 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65d9796f-37b1-462f-8b7d-2439fd2c1e53 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:49.486587 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65d9796f-37b1-462f-8b7d-2439fd2c1e53 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:49.487457 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65d9796f-37b1-462f-8b7d-2439fd2c1e53 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:49.487947 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65d9796f-37b1-462f-8b7d-2439fd2c1e53 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:49.797058 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-65d9796f-37b1-462f-8b7d-2439fd2c1e53 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:49.807401 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-65d9796f-37b1-462f-8b7d-2439fd2c1e53 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 200 len: 1469 microversion: 2.1 time: 0.347092 Jun 20 12:11:49.811898 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1611/3296] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:49 2022] GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 1469 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:49.819298 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a99571e2-24cd-405a-9b8e-30e8b23fb624 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:49.820845 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a99571e2-24cd-405a-9b8e-30e8b23fb624 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:49.837012 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a99571e2-24cd-405a-9b8e-30e8b23fb624 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:49.838561 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a99571e2-24cd-405a-9b8e-30e8b23fb624 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:49.839461 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a99571e2-24cd-405a-9b8e-30e8b23fb624 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:49.842515 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a99571e2-24cd-405a-9b8e-30e8b23fb624 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:50.126634 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a99571e2-24cd-405a-9b8e-30e8b23fb624 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:50.137132 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a99571e2-24cd-405a-9b8e-30e8b23fb624 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546" status: 200 len: 1507 microversion: 2.1 time: 0.324142 Jun 20 12:11:50.138462 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1612/3297] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:49 2022] GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546 => generated 1507 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:50.144386 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e993610f-86ef-49b6-abf3-ed75124326b1 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:50.145276 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e993610f-86ef-49b6-abf3-ed75124326b1 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 7014bfb5-b083-485f-9711-b7cc95634c41] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:50.153310 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e993610f-86ef-49b6-abf3-ed75124326b1 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:50.154303 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e993610f-86ef-49b6-abf3-ed75124326b1 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:50.155512 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e993610f-86ef-49b6-abf3-ed75124326b1 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:50.156046 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e993610f-86ef-49b6-abf3-ed75124326b1 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:50.174426 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-e993610f-86ef-49b6-abf3-ed75124326b1 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] HTTP exception thrown: Instance 7014bfb5-b083-485f-9711-b7cc95634c41 could not be found. Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e993610f-86ef-49b6-abf3-ed75124326b1 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Request method failure captured: Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41 HTTP/1.1 Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGN4qiwM-MecDHxONzVMkA72NR_SSrElKGFho2amrxg9uMlhFTBY3bq5CJPNlZORM2tW_nQRhsPIUTgettXi4lSiCQeK40e01rW_16Lzz4FJO6EC5uBs_A-i3_njR3_9I2L-oxsuaQd8HwAiDLKOUCEhiwyWJOA1WjMqhqu3KfOGLgY Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 4880e508de374c748670ce9ff5963336 Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4880e508de374c748670ce9ff5963336"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4880e508de374c748670ce9ff5963336"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4880e508de374c748670ce9ff5963336"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4880e508de374c748670ce9ff5963336"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 4880e508de374c748670ce9ff5963336 Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ImagesOneServerNegativeTestJSON-1288781692-project Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 16367ef663a74bd49162b82a7e661d1e Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692-project Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 7014bfb5-b083-485f-9711-b7cc95634c41 could not be found. Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '7014bfb5-b083-485f-9711-b7cc95634c41'} Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7014bfb5-b083-485f-9711-b7cc95634c41 could not be found. Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:11:50.176529 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:11:50.182587 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7014bfb5-b083-485f-9711-b7cc95634c41 could not be found. Jun 20 12:11:50.182587 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:50.182587 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:50.182587 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:50.182587 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:50.182587 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:50.182587 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:50.182587 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:11:50.182587 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:11:50.182587 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7014bfb5-b083-485f-9711-b7cc95634c41 could not be found. Jun 20 12:11:50.182587 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:50.182587 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e993610f-86ef-49b6-abf3-ed75124326b1 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Returning 404 to user: Instance 7014bfb5-b083-485f-9711-b7cc95634c41 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:11:50.182587 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e993610f-86ef-49b6-abf3-ed75124326b1 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41" status: 404 len: 111 microversion: 2.1 time: 0.038317 Jun 20 12:11:50.182587 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1613/3298] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:11:50 2022] DELETE /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:11:50.195276 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6d5c4f03-7745-43db-82e2-6afc0c498dcd tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:50.196420 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6d5c4f03-7745-43db-82e2-6afc0c498dcd tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:50.204964 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6d5c4f03-7745-43db-82e2-6afc0c498dcd tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:50.205851 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6d5c4f03-7745-43db-82e2-6afc0c498dcd tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:50.206929 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6d5c4f03-7745-43db-82e2-6afc0c498dcd tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:50.207554 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6d5c4f03-7745-43db-82e2-6afc0c498dcd tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:50.210869 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-0351aef5-905c-47df-9eed-9e50ce23f02f tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Updating instance_info_cache with network_info: [{"id": "eb877463-7d93-4069-944d-8674a91f4b80", "address": "fa:16:3e:cb:a2:ea", "network": {"id": "844279f1-b6b7-42d1-9946-2fe7ef088f0b", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1982825746-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5c47b977a1334cd486385213ff23de86", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapeb877463-7d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119127) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 20 12:11:50.236467 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0351aef5-905c-47df-9eed-9e50ce23f02f tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Releasing lock "refresh_cache-3163bfa2-d7b5-451e-ae0c-cc2ec445c532" {{(pid=119127) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 20 12:11:50.237380 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0351aef5-905c-47df-9eed-9e50ce23f02f tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "POST /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532/action" status: 202 len: 0 microversion: 2.1 time: 2.618510 Jun 20 12:11:50.238005 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1686/3299] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:11:47 2022] POST /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532/action => generated 0 bytes in 2620 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 20 12:11:50.245903 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-47506a10-d94e-4dd4-8938-3def322b7d4d tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:50.247820 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-47506a10-d94e-4dd4-8938-3def322b7d4d tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:50.270768 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-47506a10-d94e-4dd4-8938-3def322b7d4d tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:50.271510 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-47506a10-d94e-4dd4-8938-3def322b7d4d tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:50.272621 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-47506a10-d94e-4dd4-8938-3def322b7d4d tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:50.273074 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-47506a10-d94e-4dd4-8938-3def322b7d4d tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:50.487224 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6d5c4f03-7745-43db-82e2-6afc0c498dcd tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:50.498701 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6d5c4f03-7745-43db-82e2-6afc0c498dcd tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1497 microversion: 2.1 time: 0.314460 Jun 20 12:11:50.502974 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1614/3300] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:50 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1497 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:50.512918 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-84601e1f-7b7a-4abb-8bc6-d43978e9b17e tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:50.513801 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-84601e1f-7b7a-4abb-8bc6-d43978e9b17e tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: 7014bfb5-b083-485f-9711-b7cc95634c41] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:50.525017 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-84601e1f-7b7a-4abb-8bc6-d43978e9b17e tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:50.528793 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-84601e1f-7b7a-4abb-8bc6-d43978e9b17e tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:50.529710 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-84601e1f-7b7a-4abb-8bc6-d43978e9b17e tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:50.530148 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-84601e1f-7b7a-4abb-8bc6-d43978e9b17e tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:50.558295 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-84601e1f-7b7a-4abb-8bc6-d43978e9b17e tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] HTTP exception thrown: Instance 7014bfb5-b083-485f-9711-b7cc95634c41 could not be found. Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-84601e1f-7b7a-4abb-8bc6-d43978e9b17e tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Request method failure captured: Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41 HTTP/1.1 Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGN4qiwM-MecDHxONzVMkA72NR_SSrElKGFho2amrxg9uMlhFTBY3bq5CJPNlZORM2tW_nQRhsPIUTgettXi4lSiCQeK40e01rW_16Lzz4FJO6EC5uBs_A-i3_njR3_9I2L-oxsuaQd8HwAiDLKOUCEhiwyWJOA1WjMqhqu3KfOGLgY Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 4880e508de374c748670ce9ff5963336 Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4880e508de374c748670ce9ff5963336"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4880e508de374c748670ce9ff5963336"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4880e508de374c748670ce9ff5963336"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4880e508de374c748670ce9ff5963336"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 4880e508de374c748670ce9ff5963336 Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ImagesOneServerNegativeTestJSON-1288781692-project Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 16367ef663a74bd49162b82a7e661d1e Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692-project Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 7014bfb5-b083-485f-9711-b7cc95634c41 could not be found. Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '7014bfb5-b083-485f-9711-b7cc95634c41'} Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7014bfb5-b083-485f-9711-b7cc95634c41 could not be found. Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7014bfb5-b083-485f-9711-b7cc95634c41 could not be found. Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:50.559859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:50.567078 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:50.567078 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:50.567078 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:50.567078 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:50.567078 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:11:50.567078 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:11:50.567078 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7014bfb5-b083-485f-9711-b7cc95634c41 could not be found. Jun 20 12:11:50.567078 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:50.567078 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-84601e1f-7b7a-4abb-8bc6-d43978e9b17e tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Returning 404 to user: Instance 7014bfb5-b083-485f-9711-b7cc95634c41 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:11:50.567078 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-84601e1f-7b7a-4abb-8bc6-d43978e9b17e tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41" status: 404 len: 111 microversion: 2.1 time: 0.057088 Jun 20 12:11:50.567078 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1615/3301] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:50 2022] GET /compute/v2.1/servers/7014bfb5-b083-485f-9711-b7cc95634c41 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:11:50.585299 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8b3b2e2f-76e8-42bd-9958-a8f38cf9ae1a tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:50.586096 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8b3b2e2f-76e8-42bd-9958-a8f38cf9ae1a tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:50.595340 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8b3b2e2f-76e8-42bd-9958-a8f38cf9ae1a tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:50.595998 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8b3b2e2f-76e8-42bd-9958-a8f38cf9ae1a tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:50.596861 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8b3b2e2f-76e8-42bd-9958-a8f38cf9ae1a tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:50.597303 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8b3b2e2f-76e8-42bd-9958-a8f38cf9ae1a tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:50.632747 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-47506a10-d94e-4dd4-8938-3def322b7d4d tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:50.648989 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-47506a10-d94e-4dd4-8938-3def322b7d4d tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546" status: 200 len: 1507 microversion: 2.1 time: 0.408548 Jun 20 12:11:50.660300 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1687/3302] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:50 2022] GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546 => generated 1507 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:50.667439 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c2190563-6235-4cc2-bdbb-20aa23aa7f3a tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '.version_select at 0x7f60734539d0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:50.738550 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-8b3b2e2f-76e8-42bd-9958-a8f38cf9ae1a tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lazy-loading 'services' on Instance uuid 3c658f2d-9442-4b10-b5f5-2d484553330e {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:11:50.778306 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8b3b2e2f-76e8-42bd-9958-a8f38cf9ae1a tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1929 microversion: 2.75 time: 0.209721 Jun 20 12:11:50.779168 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1616/3303] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:50 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1929 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:50.784606 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6b1da172-1704-4734-ae36-21a426435d3b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:50.785365 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6b1da172-1704-4734-ae36-21a426435d3b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:50.793251 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6b1da172-1704-4734-ae36-21a426435d3b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:50.793978 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6b1da172-1704-4734-ae36-21a426435d3b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:50.795194 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6b1da172-1704-4734-ae36-21a426435d3b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:50.795792 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6b1da172-1704-4734-ae36-21a426435d3b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:50.833242 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-6b1da172-1704-4734-ae36-21a426435d3b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lazy-loading 'flavor' on Instance uuid 593cda12-6491-4a27-8fc7-42c05e0291c3 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:11:50.871525 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-6b1da172-1704-4734-ae36-21a426435d3b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] HTTP exception thrown: Cannot 'suspend' instance 593cda12-6491-4a27-8fc7-42c05e0291c3 while it is in vm_state suspended Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6b1da172-1704-4734-ae36-21a426435d3b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3/action HTTP/1.1 Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 15 Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: {"suspend": {}} Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: exception: Cannot 'suspend' instance 593cda12-6491-4a27-8fc7-42c05e0291c3 while it is in vm_state suspended Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '593cda12-6491-4a27-8fc7-42c05e0291c3', 'body': {'suspend': {}}} Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 593cda12-6491-4a27-8fc7-42c05e0291c3 in vm_state suspended. Cannot suspend while the instance is in this state. Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Jun 20 12:11:50.873220 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 20 12:11:50.878434 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 20 12:11:50.878434 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 20 12:11:50.878434 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 593cda12-6491-4a27-8fc7-42c05e0291c3 while it is in vm_state suspended Jun 20 12:11:50.878434 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:50.878434 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:50.878434 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:50.878434 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:50.878434 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:50.878434 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:50.878434 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:11:50.878434 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:11:50.878434 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 593cda12-6491-4a27-8fc7-42c05e0291c3 while it is in vm_state suspended Jun 20 12:11:50.878434 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:50.878434 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6b1da172-1704-4734-ae36-21a426435d3b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 409 to user: Cannot 'suspend' instance 593cda12-6491-4a27-8fc7-42c05e0291c3 while it is in vm_state suspended {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:11:50.878434 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6b1da172-1704-4734-ae36-21a426435d3b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3/action" status: 409 len: 148 microversion: 2.1 time: 0.094396 Jun 20 12:11:50.878434 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1617/3304] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:11:50 2022] POST /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3/action => generated 148 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:11:50.885226 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-70c180f3-91df-4a72-8e79-28f8cd607c3c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '.version_select at 0x7f60847b6af0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:50.918355 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-70c180f3-91df-4a72-8e79-28f8cd607c3c tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-664927390" status: 202 len: 0 microversion: 2.1 time: 0.041120 Jun 20 12:11:50.922066 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1618/3305] 10.222.0.27 () {58 vars in 1217 bytes} [Mon Jun 20 12:11:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-664927390 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:11:50.929507 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-76b5c17c-8ad3-4710-9b66-2bdf86496942 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:50.931259 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-76b5c17c-8ad3-4710-9b66-2bdf86496942 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:50.948929 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-76b5c17c-8ad3-4710-9b66-2bdf86496942 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:50.949572 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-76b5c17c-8ad3-4710-9b66-2bdf86496942 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:50.950304 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-76b5c17c-8ad3-4710-9b66-2bdf86496942 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:50.950802 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-76b5c17c-8ad3-4710-9b66-2bdf86496942 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:51.070889 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-76b5c17c-8ad3-4710-9b66-2bdf86496942 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "PUT /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546" status: 200 len: 1083 microversion: 2.1 time: 0.150776 Jun 20 12:11:51.071543 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1619/3306] 10.222.0.27 () {60 vars in 1255 bytes} [Mon Jun 20 12:11:50 2022] PUT /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546 => generated 1083 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:51.077490 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b288c585-99cd-4426-b39d-e61dd93f3f30 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:51.078118 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b288c585-99cd-4426-b39d-e61dd93f3f30 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:51.085770 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b288c585-99cd-4426-b39d-e61dd93f3f30 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:51.087190 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b288c585-99cd-4426-b39d-e61dd93f3f30 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:51.087190 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b288c585-99cd-4426-b39d-e61dd93f3f30 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:51.087555 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b288c585-99cd-4426-b39d-e61dd93f3f30 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:51.152180 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b288c585-99cd-4426-b39d-e61dd93f3f30 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:51.153012 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b288c585-99cd-4426-b39d-e61dd93f3f30 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:51.153184 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-b288c585-99cd-4426-b39d-e61dd93f3f30 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lazy-loading 'fault' on Instance uuid f55b114d-9a13-46f1-ac8c-c8279476cd3d {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:11:51.240019 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b288c585-99cd-4426-b39d-e61dd93f3f30 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:51.254016 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b288c585-99cd-4426-b39d-e61dd93f3f30 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 200 len: 1303 microversion: 2.1 time: 0.180272 Jun 20 12:11:51.256527 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1620/3307] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:51 2022] GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 1303 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:51.265390 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-98dc1e7d-ed29-44ec-a5cd-d70fb17dae3f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:51.267529 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-98dc1e7d-ed29-44ec-a5cd-d70fb17dae3f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:51.287424 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-98dc1e7d-ed29-44ec-a5cd-d70fb17dae3f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:51.288137 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-98dc1e7d-ed29-44ec-a5cd-d70fb17dae3f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:51.291834 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-98dc1e7d-ed29-44ec-a5cd-d70fb17dae3f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:51.292502 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-98dc1e7d-ed29-44ec-a5cd-d70fb17dae3f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:51.359175 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:11:51.405276 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-98dc1e7d-ed29-44ec-a5cd-d70fb17dae3f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3/action" status: 202 len: 0 microversion: 2.1 time: 0.146531 Jun 20 12:11:51.408056 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1621/3308] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:11:51 2022] POST /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:11:51.420668 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d93e0c93-3198-4a54-afd4-3993fd4a9b98 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:51.425761 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d93e0c93-3198-4a54-afd4-3993fd4a9b98 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:51.442740 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d93e0c93-3198-4a54-afd4-3993fd4a9b98 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:51.445117 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d93e0c93-3198-4a54-afd4-3993fd4a9b98 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:51.446267 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d93e0c93-3198-4a54-afd4-3993fd4a9b98 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:51.447009 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d93e0c93-3198-4a54-afd4-3993fd4a9b98 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:51.761334 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d93e0c93-3198-4a54-afd4-3993fd4a9b98 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:51.773616 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d93e0c93-3198-4a54-afd4-3993fd4a9b98 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546" status: 200 len: 1509 microversion: 2.1 time: 0.363727 Jun 20 12:11:51.774612 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1622/3309] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:51 2022] GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546 => generated 1509 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:51.785390 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-aa7d9337-e7e0-48dc-9f3e-f7d863749cf7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:51.786812 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-aa7d9337-e7e0-48dc-9f3e-f7d863749cf7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:51.795097 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aa7d9337-e7e0-48dc-9f3e-f7d863749cf7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:51.795782 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aa7d9337-e7e0-48dc-9f3e-f7d863749cf7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:51.797501 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aa7d9337-e7e0-48dc-9f3e-f7d863749cf7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:51.798240 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aa7d9337-e7e0-48dc-9f3e-f7d863749cf7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:51.820039 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c2190563-6235-4cc2-bdbb-20aa23aa7f3a tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/73b00ba3-c8c4-4d5e-b51f-b34ff718bd38" status: 202 len: 0 microversion: 2.1 time: 1.162973 Jun 20 12:11:51.825159 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1688/3310] 10.222.0.27 () {58 vars in 1262 bytes} [Mon Jun 20 12:11:50 2022] DELETE /compute/v2.1/os-floating-ips/73b00ba3-c8c4-4d5e-b51f-b34ff718bd38 => generated 0 bytes in 1166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:11:51.829182 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-d4220773-ae34-4420-8780-ea17f13b287f req-44212240-22c2-47bb-8e32-ab051e11ba2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f55b114d-9a13-46f1-ac8c-c8279476cd3d", "name": "network-vif-deleted", "tag": "70821ef2-9856-4c6f-b5f5-69d62c36c8b7"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:51.847456 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-d4220773-ae34-4420-8780-ea17f13b287f req-44212240-22c2-47bb-8e32-ab051e11ba2f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:51.848176 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-d4220773-ae34-4420-8780-ea17f13b287f req-44212240-22c2-47bb-8e32-ab051e11ba2f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:51.863971 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-d4220773-ae34-4420-8780-ea17f13b287f req-44212240-22c2-47bb-8e32-ab051e11ba2f service nova] Creating event network-vif-deleted:70821ef2-9856-4c6f-b5f5-69d62c36c8b7 for instance f55b114d-9a13-46f1-ac8c-c8279476cd3d on n-h2-master-1 Jun 20 12:11:51.878135 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-d4220773-ae34-4420-8780-ea17f13b287f req-44212240-22c2-47bb-8e32-ab051e11ba2f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056007 Jun 20 12:11:51.879213 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1689/3311] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:11:51.885832 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1bc6df20-8ac9-4c6f-8fd6-da363b1f604d tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:51.886646 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1bc6df20-8ac9-4c6f-8fd6-da363b1f604d tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:51.893653 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1bc6df20-8ac9-4c6f-8fd6-da363b1f604d tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:51.894226 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1bc6df20-8ac9-4c6f-8fd6-da363b1f604d tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:51.895300 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1bc6df20-8ac9-4c6f-8fd6-da363b1f604d tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:51.895842 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1bc6df20-8ac9-4c6f-8fd6-da363b1f604d tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:52.076983 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1bc6df20-8ac9-4c6f-8fd6-da363b1f604d tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:52.089040 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1bc6df20-8ac9-4c6f-8fd6-da363b1f604d tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546" status: 200 len: 1509 microversion: 2.1 time: 0.208313 Jun 20 12:11:52.089752 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1690/3312] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:51 2022] GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546 => generated 1509 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:52.096440 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b80feeb6-1b01-4b02-b8a6-b3dc19baffdc tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:52.097421 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b80feeb6-1b01-4b02-b8a6-b3dc19baffdc tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:52.105326 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b80feeb6-1b01-4b02-b8a6-b3dc19baffdc tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:52.105877 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b80feeb6-1b01-4b02-b8a6-b3dc19baffdc tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:52.106744 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b80feeb6-1b01-4b02-b8a6-b3dc19baffdc tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:52.107259 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b80feeb6-1b01-4b02-b8a6-b3dc19baffdc tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:52.130459 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-aa7d9337-e7e0-48dc-9f3e-f7d863749cf7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:52.138702 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-aa7d9337-e7e0-48dc-9f3e-f7d863749cf7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1503 microversion: 2.1 time: 0.362795 Jun 20 12:11:52.139974 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1623/3313] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:51 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1503 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:52.145926 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2ef086a3-e009-4852-b702-7335ff942da8 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '.version_select at 0x7f60847c6d30>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:52.217174 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-b80feeb6-1b01-4b02-b8a6-b3dc19baffdc tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lazy-loading 'services' on Instance uuid 3c658f2d-9442-4b10-b5f5-2d484553330e {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:11:52.238851 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b80feeb6-1b01-4b02-b8a6-b3dc19baffdc tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1929 microversion: 2.75 time: 0.147928 Jun 20 12:11:52.239477 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1691/3314] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:52 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1929 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:52.251790 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-97a7123b-bbc6-42d6-863e-cf389eef1384 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:52.252616 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-97a7123b-bbc6-42d6-863e-cf389eef1384 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:52.259884 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-97a7123b-bbc6-42d6-863e-cf389eef1384 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:52.260452 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-97a7123b-bbc6-42d6-863e-cf389eef1384 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:52.261604 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-97a7123b-bbc6-42d6-863e-cf389eef1384 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:52.262305 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-97a7123b-bbc6-42d6-863e-cf389eef1384 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:52.299975 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-97a7123b-bbc6-42d6-863e-cf389eef1384 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:11:52.398934 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:11:52.410054 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-97a7123b-bbc6-42d6-863e-cf389eef1384 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546" status: 204 len: 0 microversion: 2.1 time: 0.162350 Jun 20 12:11:52.411350 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1692/3315] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:11:52 2022] DELETE /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:11:52.419899 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-324e5475-d22d-4b69-9450-76de1f62d6bb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:52.420906 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-324e5475-d22d-4b69-9450-76de1f62d6bb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: f55b114d-9a13-46f1-ac8c-c8279476cd3d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:52.429631 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-324e5475-d22d-4b69-9450-76de1f62d6bb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:52.430189 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-324e5475-d22d-4b69-9450-76de1f62d6bb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:52.431689 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-324e5475-d22d-4b69-9450-76de1f62d6bb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:52.432140 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-324e5475-d22d-4b69-9450-76de1f62d6bb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:52.450701 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-324e5475-d22d-4b69-9450-76de1f62d6bb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] HTTP exception thrown: Instance f55b114d-9a13-46f1-ac8c-c8279476cd3d could not be found. Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-324e5475-d22d-4b69-9450-76de1f62d6bb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Request method failure captured: Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d HTTP/1.1 Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGKgi6jYIAm3mfrUjSiNYuEgcTX-WvqX2nMthzvsgeNwQ63Cs23utZPsmVsS6vSezI6Nxdnn7Zt7mq7APT9g109DZ_381MHORhtFZLL5CBWrwSUf5JupH83uMJgSQkQuNZkzrfhiFeMJ-I3PkrvVM-3iB1YjUY3Lg7SvpH9-AzUhDwc Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 4440dc3e2f9c4134a54b08e2585f6c59 Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-MigrationsAdminTest-286401708 Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4440dc3e2f9c4134a54b08e2585f6c59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4440dc3e2f9c4134a54b08e2585f6c59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4440dc3e2f9c4134a54b08e2585f6c59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4440dc3e2f9c4134a54b08e2585f6c59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-MigrationsAdminTest-286401708 Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 4440dc3e2f9c4134a54b08e2585f6c59 Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-MigrationsAdminTest-286401708 Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-MigrationsAdminTest-286401708-project Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 3d35b7c824b641099a406175bccc5be3 Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-MigrationsAdminTest-286401708-project Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: exception: Instance f55b114d-9a13-46f1-ac8c-c8279476cd3d could not be found. Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'f55b114d-9a13-46f1-ac8c-c8279476cd3d'} Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f55b114d-9a13-46f1-ac8c-c8279476cd3d could not be found. Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f55b114d-9a13-46f1-ac8c-c8279476cd3d could not be found. Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:52.453870 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:52.463400 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:52.463400 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:52.463400 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:52.463400 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:11:52.463400 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:11:52.463400 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f55b114d-9a13-46f1-ac8c-c8279476cd3d could not be found. Jun 20 12:11:52.463400 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:52.465609 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-324e5475-d22d-4b69-9450-76de1f62d6bb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Returning 404 to user: Instance f55b114d-9a13-46f1-ac8c-c8279476cd3d could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:11:52.466754 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-324e5475-d22d-4b69-9450-76de1f62d6bb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d" status: 404 len: 111 microversion: 2.1 time: 0.053114 Jun 20 12:11:52.467809 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1693/3316] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:52 2022] GET /compute/v2.1/servers/f55b114d-9a13-46f1-ac8c-c8279476cd3d => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:11:52.474054 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c11e4e0b-1e39-457b-a51d-7748ec36a863 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:52.474832 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c11e4e0b-1e39-457b-a51d-7748ec36a863 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:52.489787 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c11e4e0b-1e39-457b-a51d-7748ec36a863 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:52.490592 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c11e4e0b-1e39-457b-a51d-7748ec36a863 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:52.491587 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c11e4e0b-1e39-457b-a51d-7748ec36a863 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:52.492583 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c11e4e0b-1e39-457b-a51d-7748ec36a863 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:52.529422 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c11e4e0b-1e39-457b-a51d-7748ec36a863 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:11:52.599589 n-d-master-1 devstack@n-api.service[119127]: INFO nova.compute.api [None req-c11e4e0b-1e39-457b-a51d-7748ec36a863 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546] Instance is already in deleting state, ignoring this request Jun 20 12:11:52.601097 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c11e4e0b-1e39-457b-a51d-7748ec36a863 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546" status: 204 len: 0 microversion: 2.1 time: 0.131504 Jun 20 12:11:52.601733 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1694/3317] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:11:52 2022] DELETE /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:11:52.607300 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d6b8970c-94ef-410d-a817-e86d468948aa tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:52.607804 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d6b8970c-94ef-410d-a817-e86d468948aa tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:52.615072 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d6b8970c-94ef-410d-a817-e86d468948aa tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:52.615520 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d6b8970c-94ef-410d-a817-e86d468948aa tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:52.616325 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d6b8970c-94ef-410d-a817-e86d468948aa tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:52.617556 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d6b8970c-94ef-410d-a817-e86d468948aa tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:52.620619 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=5,nova_cell1:RELEASE=2,nova_cell1:INSERT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:11:52.649646 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d6b8970c-94ef-410d-a817-e86d468948aa tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:11:52.733913 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2ef086a3-e009-4852-b702-7335ff942da8 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/fc22617a-f1cc-4046-8310-1b0589e09058" status: 202 len: 0 microversion: 2.1 time: 0.592118 Jun 20 12:11:52.736394 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1624/3318] 10.222.0.27 () {58 vars in 1271 bytes} [Mon Jun 20 12:11:52 2022] DELETE /compute/v2.1/os-security-groups/fc22617a-f1cc-4046-8310-1b0589e09058 => generated 0 bytes in 596 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:11:52.742239 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f0cfb009-0bd5-44f6-82e3-284411d03852 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:52.743111 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f0cfb009-0bd5-44f6-82e3-284411d03852 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:52.751703 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d6b8970c-94ef-410d-a817-e86d468948aa tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "DELETE /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c" status: 204 len: 0 microversion: 2.1 time: 0.147813 Jun 20 12:11:52.755035 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1695/3319] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:11:52 2022] DELETE /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:11:52.760953 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f0cfb009-0bd5-44f6-82e3-284411d03852 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:52.761171 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a9607dbe-daba-43ec-9f45-cd5488f691e9 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '.version_select at 0x7f607338e5e0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:52.761435 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f0cfb009-0bd5-44f6-82e3-284411d03852 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:52.763113 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f0cfb009-0bd5-44f6-82e3-284411d03852 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:52.764139 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f0cfb009-0bd5-44f6-82e3-284411d03852 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:52.790115 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-a9607dbe-daba-43ec-9f45-cd5488f691e9 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] HTTP exception thrown: Image not found. Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a9607dbe-daba-43ec-9f45-cd5488f691e9 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Request method failure captured: Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/images/d8a0f83c-d4a1-44fc-b026-220969de328b HTTP/1.1 Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGN4qiwM-MecDHxONzVMkA72NR_SSrElKGFho2amrxg9uMlhFTBY3bq5CJPNlZORM2tW_nQRhsPIUTgettXi4lSiCQeK40e01rW_16Lzz4FJO6EC5uBs_A-i3_njR3_9I2L-oxsuaQd8HwAiDLKOUCEhiwyWJOA1WjMqhqu3KfOGLgY Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 4880e508de374c748670ce9ff5963336 Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4880e508de374c748670ce9ff5963336"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4880e508de374c748670ce9ff5963336"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4880e508de374c748670ce9ff5963336"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4880e508de374c748670ce9ff5963336"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 4880e508de374c748670ce9ff5963336 Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ImagesOneServerNegativeTestJSON-1288781692-project Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 16367ef663a74bd49162b82a7e661d1e Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692-project Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: exception: Image not found. Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'd8a0f83c-d4a1-44fc-b026-220969de328b'} Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d8a0f83c-d4a1-44fc-b026-220969de328b to delete Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d8a0f83c-d4a1-44fc-b026-220969de328b could not be found. Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:52.793504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:52.798502 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:52.798502 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:52.798502 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:52.798502 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:11:52.798502 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:11:52.798502 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:11:52.798502 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:11:52.798502 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:11:52.798502 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:11:52.798502 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 20 12:11:52.798502 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 20 12:11:52.798502 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 20 12:11:52.798502 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:52.798502 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:52.798502 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:52.798502 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:52.798502 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:52.798502 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:52.798502 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:11:52.798502 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:11:52.798502 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 20 12:11:52.798502 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:52.798502 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a9607dbe-daba-43ec-9f45-cd5488f691e9 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Returning 404 to user: Image not found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:11:52.798502 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a9607dbe-daba-43ec-9f45-cd5488f691e9 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "DELETE /compute/v2.1/images/d8a0f83c-d4a1-44fc-b026-220969de328b" status: 404 len: 62 microversion: 2.1 time: 0.037272 Jun 20 12:11:52.798502 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1696/3320] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:52 2022] DELETE /compute/v2.1/images/d8a0f83c-d4a1-44fc-b026-220969de328b => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:11:52.802643 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-94931b24-e507-4c17-906f-eeb52bcbbda6 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:52.803573 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-94931b24-e507-4c17-906f-eeb52bcbbda6 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:52.813619 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-94931b24-e507-4c17-906f-eeb52bcbbda6 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:52.814130 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-94931b24-e507-4c17-906f-eeb52bcbbda6 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:52.815185 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-94931b24-e507-4c17-906f-eeb52bcbbda6 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:52.815630 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-94931b24-e507-4c17-906f-eeb52bcbbda6 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:52.844468 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-94931b24-e507-4c17-906f-eeb52bcbbda6 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:11:52.922576 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f0cfb009-0bd5-44f6-82e3-284411d03852 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:52.941219 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f0cfb009-0bd5-44f6-82e3-284411d03852 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546" status: 200 len: 1515 microversion: 2.1 time: 0.203269 Jun 20 12:11:52.942464 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1625/3321] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:52 2022] GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546 => generated 1515 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:52.947741 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-206bcc22-eb80-4e5d-8ea0-d2385a1ded92 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:52.948565 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-206bcc22-eb80-4e5d-8ea0-d2385a1ded92 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:52.956606 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-206bcc22-eb80-4e5d-8ea0-d2385a1ded92 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:52.957206 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-206bcc22-eb80-4e5d-8ea0-d2385a1ded92 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:52.958114 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-206bcc22-eb80-4e5d-8ea0-d2385a1ded92 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:52.958579 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-206bcc22-eb80-4e5d-8ea0-d2385a1ded92 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:52.980289 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-94931b24-e507-4c17-906f-eeb52bcbbda6 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 204 len: 0 microversion: 2.1 time: 0.180153 Jun 20 12:11:52.981112 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1697/3322] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:11:52 2022] DELETE /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:11:52.988045 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c1bc5961-8f15-4a12-9705-3f183fe783da tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:52.988682 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c1bc5961-8f15-4a12-9705-3f183fe783da tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: f6bb3154-9ddf-428c-82cd-74ab476e5a0a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:52.996595 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c1bc5961-8f15-4a12-9705-3f183fe783da tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:52.997056 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c1bc5961-8f15-4a12-9705-3f183fe783da tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:52.998087 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c1bc5961-8f15-4a12-9705-3f183fe783da tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:52.998539 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c1bc5961-8f15-4a12-9705-3f183fe783da tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:53.014971 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-c1bc5961-8f15-4a12-9705-3f183fe783da tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] HTTP exception thrown: Instance f6bb3154-9ddf-428c-82cd-74ab476e5a0a could not be found. Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c1bc5961-8f15-4a12-9705-3f183fe783da tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Request method failure captured: Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a HTTP/1.1 Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGN4qiwM-MecDHxONzVMkA72NR_SSrElKGFho2amrxg9uMlhFTBY3bq5CJPNlZORM2tW_nQRhsPIUTgettXi4lSiCQeK40e01rW_16Lzz4FJO6EC5uBs_A-i3_njR3_9I2L-oxsuaQd8HwAiDLKOUCEhiwyWJOA1WjMqhqu3KfOGLgY Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 4880e508de374c748670ce9ff5963336 Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4880e508de374c748670ce9ff5963336"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4880e508de374c748670ce9ff5963336"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4880e508de374c748670ce9ff5963336"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4880e508de374c748670ce9ff5963336"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 4880e508de374c748670ce9ff5963336 Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ImagesOneServerNegativeTestJSON-1288781692-project Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 16367ef663a74bd49162b82a7e661d1e Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692-project Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: exception: Instance f6bb3154-9ddf-428c-82cd-74ab476e5a0a could not be found. Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'f6bb3154-9ddf-428c-82cd-74ab476e5a0a'} Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6bb3154-9ddf-428c-82cd-74ab476e5a0a could not be found. Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:11:53.016951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:11:53.021423 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6bb3154-9ddf-428c-82cd-74ab476e5a0a could not be found. Jun 20 12:11:53.021423 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:53.021423 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:53.021423 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:53.021423 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:53.021423 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:53.021423 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:53.021423 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:11:53.021423 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:11:53.021423 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6bb3154-9ddf-428c-82cd-74ab476e5a0a could not be found. Jun 20 12:11:53.021423 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:53.021423 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c1bc5961-8f15-4a12-9705-3f183fe783da tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Returning 404 to user: Instance f6bb3154-9ddf-428c-82cd-74ab476e5a0a could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:11:53.021423 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c1bc5961-8f15-4a12-9705-3f183fe783da tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a" status: 404 len: 111 microversion: 2.1 time: 0.036228 Jun 20 12:11:53.021423 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1698/3323] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:11:52 2022] DELETE /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:11:53.024267 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4a404fb5-bb81-4abf-aaec-7f48b6f06b61 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:53.024886 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4a404fb5-bb81-4abf-aaec-7f48b6f06b61 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:53.033224 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4a404fb5-bb81-4abf-aaec-7f48b6f06b61 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:53.033599 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4a404fb5-bb81-4abf-aaec-7f48b6f06b61 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:53.034373 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4a404fb5-bb81-4abf-aaec-7f48b6f06b61 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:53.034806 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4a404fb5-bb81-4abf-aaec-7f48b6f06b61 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:53.123464 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-206bcc22-eb80-4e5d-8ea0-d2385a1ded92 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:53.131630 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-206bcc22-eb80-4e5d-8ea0-d2385a1ded92 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c" status: 200 len: 1469 microversion: 2.1 time: 0.187999 Jun 20 12:11:53.132637 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1626/3324] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:52 2022] GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c => generated 1469 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:53.137225 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6f553de0-c4db-4aed-a31a-02c65d1b92f7 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:53.138019 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6f553de0-c4db-4aed-a31a-02c65d1b92f7 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] [instance: f6bb3154-9ddf-428c-82cd-74ab476e5a0a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:53.147039 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6f553de0-c4db-4aed-a31a-02c65d1b92f7 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:53.147809 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6f553de0-c4db-4aed-a31a-02c65d1b92f7 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:53.148607 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6f553de0-c4db-4aed-a31a-02c65d1b92f7 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:53.149207 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6f553de0-c4db-4aed-a31a-02c65d1b92f7 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:53.164977 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-6f553de0-c4db-4aed-a31a-02c65d1b92f7 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] HTTP exception thrown: Instance f6bb3154-9ddf-428c-82cd-74ab476e5a0a could not be found. Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6f553de0-c4db-4aed-a31a-02c65d1b92f7 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Request method failure captured: Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a HTTP/1.1 Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGN4qiwM-MecDHxONzVMkA72NR_SSrElKGFho2amrxg9uMlhFTBY3bq5CJPNlZORM2tW_nQRhsPIUTgettXi4lSiCQeK40e01rW_16Lzz4FJO6EC5uBs_A-i3_njR3_9I2L-oxsuaQd8HwAiDLKOUCEhiwyWJOA1WjMqhqu3KfOGLgY Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 4880e508de374c748670ce9ff5963336 Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4880e508de374c748670ce9ff5963336"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4880e508de374c748670ce9ff5963336"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4880e508de374c748670ce9ff5963336"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4880e508de374c748670ce9ff5963336"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 4880e508de374c748670ce9ff5963336 Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692 Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ImagesOneServerNegativeTestJSON-1288781692-project Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 16367ef663a74bd49162b82a7e661d1e Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1288781692-project Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: exception: Instance f6bb3154-9ddf-428c-82cd-74ab476e5a0a could not be found. Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'f6bb3154-9ddf-428c-82cd-74ab476e5a0a'} Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6bb3154-9ddf-428c-82cd-74ab476e5a0a could not be found. Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6bb3154-9ddf-428c-82cd-74ab476e5a0a could not be found. Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:53.166924 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:53.171798 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:53.171798 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:53.171798 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:53.171798 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:53.171798 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:11:53.171798 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:11:53.171798 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6bb3154-9ddf-428c-82cd-74ab476e5a0a could not be found. Jun 20 12:11:53.171798 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:53.171798 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6f553de0-c4db-4aed-a31a-02c65d1b92f7 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] Returning 404 to user: Instance f6bb3154-9ddf-428c-82cd-74ab476e5a0a could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:11:53.171798 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6f553de0-c4db-4aed-a31a-02c65d1b92f7 tempest-ImagesOneServerNegativeTestJSON-1288781692 tempest-ImagesOneServerNegativeTestJSON-1288781692-project] 10.222.0.27 "GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a" status: 404 len: 111 microversion: 2.1 time: 0.034609 Jun 20 12:11:53.171798 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1627/3325] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:53 2022] GET /compute/v2.1/servers/f6bb3154-9ddf-428c-82cd-74ab476e5a0a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:11:53.183819 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b66ec86b-0f03-4510-a0e7-eb2cb2dae338 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:53.184459 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b66ec86b-0f03-4510-a0e7-eb2cb2dae338 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:53.194963 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b66ec86b-0f03-4510-a0e7-eb2cb2dae338 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:53.196152 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b66ec86b-0f03-4510-a0e7-eb2cb2dae338 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:53.197312 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b66ec86b-0f03-4510-a0e7-eb2cb2dae338 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:53.197848 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b66ec86b-0f03-4510-a0e7-eb2cb2dae338 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:53.199374 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4a404fb5-bb81-4abf-aaec-7f48b6f06b61 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07f91cbf86a444fb06e050d4c4532fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c47b977a1334cd486385213ff23de86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:53.208665 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4a404fb5-bb81-4abf-aaec-7f48b6f06b61 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 200 len: 1511 microversion: 2.1 time: 0.187340 Jun 20 12:11:53.208904 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1699/3326] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:53 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 1511 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:53.259411 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ce9f136d-58ce-408c-92f7-664e76da3cb8 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:53.260168 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ce9f136d-58ce-408c-92f7-664e76da3cb8 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:53.268815 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ce9f136d-58ce-408c-92f7-664e76da3cb8 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:53.269278 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ce9f136d-58ce-408c-92f7-664e76da3cb8 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:53.270106 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ce9f136d-58ce-408c-92f7-664e76da3cb8 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:53.270890 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ce9f136d-58ce-408c-92f7-664e76da3cb8 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:53.363286 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-ce9f136d-58ce-408c-92f7-664e76da3cb8 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lazy-loading 'services' on Instance uuid 3c658f2d-9442-4b10-b5f5-2d484553330e {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:11:53.386918 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ce9f136d-58ce-408c-92f7-664e76da3cb8 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1929 microversion: 2.75 time: 0.131532 Jun 20 12:11:53.387997 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1700/3327] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:53 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1929 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:53.483003 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b66ec86b-0f03-4510-a0e7-eb2cb2dae338 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:53.491941 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b66ec86b-0f03-4510-a0e7-eb2cb2dae338 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1503 microversion: 2.1 time: 0.321974 Jun 20 12:11:53.492759 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1628/3328] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:53 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1503 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:53.959465 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-061b1b5d-7246-494f-ad6e-aba289430f88 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:53.960569 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-061b1b5d-7246-494f-ad6e-aba289430f88 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:53.971203 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-061b1b5d-7246-494f-ad6e-aba289430f88 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:53.971663 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-061b1b5d-7246-494f-ad6e-aba289430f88 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:53.972488 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-061b1b5d-7246-494f-ad6e-aba289430f88 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:53.973065 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-061b1b5d-7246-494f-ad6e-aba289430f88 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:54.129237 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-061b1b5d-7246-494f-ad6e-aba289430f88 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:54.138234 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-061b1b5d-7246-494f-ad6e-aba289430f88 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546" status: 200 len: 1515 microversion: 2.1 time: 0.182851 Jun 20 12:11:54.148248 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1701/3329] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:53 2022] GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546 => generated 1515 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:54.153684 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e07eca0f-19b0-4dae-9393-a460f1b10f59 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:54.155375 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e07eca0f-19b0-4dae-9393-a460f1b10f59 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:54.162840 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e07eca0f-19b0-4dae-9393-a460f1b10f59 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:54.163369 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e07eca0f-19b0-4dae-9393-a460f1b10f59 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:54.164485 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e07eca0f-19b0-4dae-9393-a460f1b10f59 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:54.165165 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e07eca0f-19b0-4dae-9393-a460f1b10f59 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:54.226391 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-210d6b3a-e228-4ff4-832e-b3ce79348564 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:54.227699 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-210d6b3a-e228-4ff4-832e-b3ce79348564 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:54.234775 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-210d6b3a-e228-4ff4-832e-b3ce79348564 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:54.235252 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-210d6b3a-e228-4ff4-832e-b3ce79348564 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:54.236040 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-210d6b3a-e228-4ff4-832e-b3ce79348564 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:54.236514 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-210d6b3a-e228-4ff4-832e-b3ce79348564 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:54.488717 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e07eca0f-19b0-4dae-9393-a460f1b10f59 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:54.507448 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e07eca0f-19b0-4dae-9393-a460f1b10f59 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c" status: 200 len: 1469 microversion: 2.1 time: 0.357559 Jun 20 12:11:54.511594 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1629/3330] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:54 2022] GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c => generated 1469 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:54.519405 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f60f12fe-4ba7-452f-85df-fbec256b1694 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:54.520637 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f60f12fe-4ba7-452f-85df-fbec256b1694 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:54.541658 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f60f12fe-4ba7-452f-85df-fbec256b1694 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:54.542369 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f60f12fe-4ba7-452f-85df-fbec256b1694 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:54.543529 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f60f12fe-4ba7-452f-85df-fbec256b1694 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:54.544447 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f60f12fe-4ba7-452f-85df-fbec256b1694 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:54.681831 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-f60f12fe-4ba7-452f-85df-fbec256b1694 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lazy-loading 'services' on Instance uuid 3c658f2d-9442-4b10-b5f5-2d484553330e {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:11:54.704370 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f60f12fe-4ba7-452f-85df-fbec256b1694 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1929 microversion: 2.75 time: 0.190913 Jun 20 12:11:54.705569 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1630/3331] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:54 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1929 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:54.707355 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-210d6b3a-e228-4ff4-832e-b3ce79348564 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07f91cbf86a444fb06e050d4c4532fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c47b977a1334cd486385213ff23de86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:54.710939 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-50685e70-99a4-4803-8440-674c9b1943f3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:54.711744 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-50685e70-99a4-4803-8440-674c9b1943f3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:54.718262 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-50685e70-99a4-4803-8440-674c9b1943f3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:54.719222 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-50685e70-99a4-4803-8440-674c9b1943f3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:54.720452 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-50685e70-99a4-4803-8440-674c9b1943f3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:54.721060 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-50685e70-99a4-4803-8440-674c9b1943f3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:54.722270 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-210d6b3a-e228-4ff4-832e-b3ce79348564 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 200 len: 1511 microversion: 2.1 time: 0.500849 Jun 20 12:11:54.735355 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1702/3332] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:54 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 1511 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:11:55.105506 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-50685e70-99a4-4803-8440-674c9b1943f3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:55.116317 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-50685e70-99a4-4803-8440-674c9b1943f3 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1503 microversion: 2.1 time: 0.409376 Jun 20 12:11:55.117905 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1631/3333] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:54 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1503 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:55.155888 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0038ba70-056a-4721-867d-3dfe980f303f tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:55.164785 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0038ba70-056a-4721-867d-3dfe980f303f tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:55.184036 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0038ba70-056a-4721-867d-3dfe980f303f tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:55.188185 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0038ba70-056a-4721-867d-3dfe980f303f tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:55.191736 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0038ba70-056a-4721-867d-3dfe980f303f tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:55.193007 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0038ba70-056a-4721-867d-3dfe980f303f tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:55.528558 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5e0785df-525b-4293-b069-0f601cdacf69 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:55.529129 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5e0785df-525b-4293-b069-0f601cdacf69 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:55.542474 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e0785df-525b-4293-b069-0f601cdacf69 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:55.547468 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e0785df-525b-4293-b069-0f601cdacf69 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:55.548596 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e0785df-525b-4293-b069-0f601cdacf69 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:55.549057 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e0785df-525b-4293-b069-0f601cdacf69 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:55.733915 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5e0785df-525b-4293-b069-0f601cdacf69 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:55.735610 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0038ba70-056a-4721-867d-3dfe980f303f tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:55.745073 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0038ba70-056a-4721-867d-3dfe980f303f tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546" status: 200 len: 1515 microversion: 2.1 time: 0.593711 Jun 20 12:11:55.755197 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1703/3334] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:55 2022] GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546 => generated 1515 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:55.760924 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0ef0f432-011b-4e2b-9123-db6fb75604cf tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:55.761818 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0ef0f432-011b-4e2b-9123-db6fb75604cf tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:55.762272 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5e0785df-525b-4293-b069-0f601cdacf69 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c" status: 200 len: 1427 microversion: 2.1 time: 0.236855 Jun 20 12:11:55.763694 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1632/3335] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:55 2022] GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c => generated 1427 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:55.769596 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0ef0f432-011b-4e2b-9123-db6fb75604cf tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:55.770203 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0ef0f432-011b-4e2b-9123-db6fb75604cf tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:55.771492 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0ef0f432-011b-4e2b-9123-db6fb75604cf tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:55.772249 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0ef0f432-011b-4e2b-9123-db6fb75604cf tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:55.784681 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-eaafeb4e-6405-4669-aa6b-aabb5408c5de req-03df502d-00eb-461f-adac-3b654ef34ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "169d4a6b-c7e8-4fb6-9230-0daccebb7c1c", "name": "network-vif-deleted", "tag": "d2a8d75a-6185-40a8-a750-83b919830f6e"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:55.799520 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-eaafeb4e-6405-4669-aa6b-aabb5408c5de req-03df502d-00eb-461f-adac-3b654ef34ff4 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:55.800259 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-eaafeb4e-6405-4669-aa6b-aabb5408c5de req-03df502d-00eb-461f-adac-3b654ef34ff4 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:55.838087 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-eaafeb4e-6405-4669-aa6b-aabb5408c5de req-03df502d-00eb-461f-adac-3b654ef34ff4 service nova] Creating event network-vif-deleted:d2a8d75a-6185-40a8-a750-83b919830f6e for instance 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c on n-h2-master-1 Jun 20 12:11:55.859157 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-eaafeb4e-6405-4669-aa6b-aabb5408c5de req-03df502d-00eb-461f-adac-3b654ef34ff4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089537 Jun 20 12:11:55.861826 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1633/3336] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:11:55.883414 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f2700e2b-f1f1-4fe6-9674-a46d5eea72fd tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:55.897019 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f2700e2b-f1f1-4fe6-9674-a46d5eea72fd tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:55.922322 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-0ef0f432-011b-4e2b-9123-db6fb75604cf tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lazy-loading 'services' on Instance uuid 3c658f2d-9442-4b10-b5f5-2d484553330e {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:11:55.940376 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f2700e2b-f1f1-4fe6-9674-a46d5eea72fd tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:55.940630 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f2700e2b-f1f1-4fe6-9674-a46d5eea72fd tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:55.948840 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f2700e2b-f1f1-4fe6-9674-a46d5eea72fd tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:55.949357 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f2700e2b-f1f1-4fe6-9674-a46d5eea72fd tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:55.993042 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0ef0f432-011b-4e2b-9123-db6fb75604cf tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1929 microversion: 2.75 time: 0.235502 Jun 20 12:11:55.993696 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1704/3337] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:55 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1929 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:56.138383 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2c702f65-66b2-4f11-ada8-28573f32eebc tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:56.139442 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2c702f65-66b2-4f11-ada8-28573f32eebc tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:56.156135 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2c702f65-66b2-4f11-ada8-28573f32eebc tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:56.163949 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2c702f65-66b2-4f11-ada8-28573f32eebc tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:56.169039 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2c702f65-66b2-4f11-ada8-28573f32eebc tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:56.172381 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2c702f65-66b2-4f11-ada8-28573f32eebc tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:56.502781 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2c702f65-66b2-4f11-ada8-28573f32eebc tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:56.512980 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2c702f65-66b2-4f11-ada8-28573f32eebc tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.382611 Jun 20 12:11:56.514335 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1705/3338] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:56 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:56.541852 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2db93bf8-03a7-45fa-9174-ea76e02d8e69 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:56.548595 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2db93bf8-03a7-45fa-9174-ea76e02d8e69 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:56.557211 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2db93bf8-03a7-45fa-9174-ea76e02d8e69 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:56.558180 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2db93bf8-03a7-45fa-9174-ea76e02d8e69 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:56.559390 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2db93bf8-03a7-45fa-9174-ea76e02d8e69 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:56.560047 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2db93bf8-03a7-45fa-9174-ea76e02d8e69 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:56.766652 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2db93bf8-03a7-45fa-9174-ea76e02d8e69 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:56.789461 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2db93bf8-03a7-45fa-9174-ea76e02d8e69 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.257498 Jun 20 12:11:56.790127 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1706/3339] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:56 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:56.795059 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3d3dab7b-d72f-4a3f-8dd8-5a5af3a36b77 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:56.795960 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3d3dab7b-d72f-4a3f-8dd8-5a5af3a36b77 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:56.813010 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3d3dab7b-d72f-4a3f-8dd8-5a5af3a36b77 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:56.815210 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3d3dab7b-d72f-4a3f-8dd8-5a5af3a36b77 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:56.816184 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3d3dab7b-d72f-4a3f-8dd8-5a5af3a36b77 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:56.817932 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3d3dab7b-d72f-4a3f-8dd8-5a5af3a36b77 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:56.860612 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f2700e2b-f1f1-4fe6-9674-a46d5eea72fd tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07f91cbf86a444fb06e050d4c4532fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c47b977a1334cd486385213ff23de86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:56.861259 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3d3dab7b-d72f-4a3f-8dd8-5a5af3a36b77 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:56.861693 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3d3dab7b-d72f-4a3f-8dd8-5a5af3a36b77 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:56.862166 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-3d3dab7b-d72f-4a3f-8dd8-5a5af3a36b77 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lazy-loading 'fault' on Instance uuid cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:11:56.874327 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f2700e2b-f1f1-4fe6-9674-a46d5eea72fd tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 200 len: 1511 microversion: 2.1 time: 1.009566 Jun 20 12:11:56.875446 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1634/3340] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:55 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 1511 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:56.882103 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f9fefd0c-0e9d-4797-959c-a8730f2411fb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:56.883028 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f9fefd0c-0e9d-4797-959c-a8730f2411fb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:56.894166 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f9fefd0c-0e9d-4797-959c-a8730f2411fb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:56.895405 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f9fefd0c-0e9d-4797-959c-a8730f2411fb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:56.896538 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f9fefd0c-0e9d-4797-959c-a8730f2411fb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:56.897191 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f9fefd0c-0e9d-4797-959c-a8730f2411fb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:56.938295 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3d3dab7b-d72f-4a3f-8dd8-5a5af3a36b77 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d39a7ff9af475b88d8ca1f1536fdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62c06c318b54505b639ad49a10dc9e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:56.953477 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3d3dab7b-d72f-4a3f-8dd8-5a5af3a36b77 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546" status: 200 len: 1308 microversion: 2.1 time: 0.159217 Jun 20 12:11:56.955239 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1707/3341] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:56 2022] GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546 => generated 1308 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:56.956091 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f9fefd0c-0e9d-4797-959c-a8730f2411fb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:56.956792 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f9fefd0c-0e9d-4797-959c-a8730f2411fb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:56.957467 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-f9fefd0c-0e9d-4797-959c-a8730f2411fb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lazy-loading 'fault' on Instance uuid 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:11:56.980075 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1e2d5cad-3db0-4b99-a76b-c16b0729a4e1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:56.980795 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1e2d5cad-3db0-4b99-a76b-c16b0729a4e1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: a2b6fa82-e800-4bf9-bf91-7e662d2302dd] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:56.994466 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-1e2d5cad-3db0-4b99-a76b-c16b0729a4e1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] HTTP exception thrown: Instance a2b6fa82-e800-4bf9-bf91-7e662d2302dd could not be found. Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1e2d5cad-3db0-4b99-a76b-c16b0729a4e1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers/a2b6fa82-e800-4bf9-bf91-7e662d2302dd/action HTTP/1.1 Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 15 Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: {"unpause": {}} Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: exception: Instance a2b6fa82-e800-4bf9-bf91-7e662d2302dd could not be found. Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'a2b6fa82-e800-4bf9-bf91-7e662d2302dd', 'body': {'unpause': {}}} Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2b6fa82-e800-4bf9-bf91-7e662d2302dd could not be found. Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2b6fa82-e800-4bf9-bf91-7e662d2302dd could not be found. Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:56.996066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:57.004779 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:11:57.004779 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:11:57.004779 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2b6fa82-e800-4bf9-bf91-7e662d2302dd could not be found. Jun 20 12:11:57.004779 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:57.004779 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1e2d5cad-3db0-4b99-a76b-c16b0729a4e1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 404 to user: Instance a2b6fa82-e800-4bf9-bf91-7e662d2302dd could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:11:57.004779 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1e2d5cad-3db0-4b99-a76b-c16b0729a4e1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers/a2b6fa82-e800-4bf9-bf91-7e662d2302dd/action" status: 404 len: 111 microversion: 2.1 time: 0.042104 Jun 20 12:11:57.004779 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1708/3342] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:11:56 2022] POST /compute/v2.1/servers/a2b6fa82-e800-4bf9-bf91-7e662d2302dd/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:11:57.013243 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6f229e63-202f-4b4b-b3d4-21fbe03468dc tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:57.013960 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6f229e63-202f-4b4b-b3d4-21fbe03468dc tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:57.023726 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6f229e63-202f-4b4b-b3d4-21fbe03468dc tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:57.024399 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6f229e63-202f-4b4b-b3d4-21fbe03468dc tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:57.025384 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6f229e63-202f-4b4b-b3d4-21fbe03468dc tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:57.026039 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6f229e63-202f-4b4b-b3d4-21fbe03468dc tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:57.053824 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f9fefd0c-0e9d-4797-959c-a8730f2411fb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d35b7c824b641099a406175bccc5be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4440dc3e2f9c4134a54b08e2585f6c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:57.064548 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f9fefd0c-0e9d-4797-959c-a8730f2411fb tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c" status: 200 len: 1303 microversion: 2.1 time: 0.185628 Jun 20 12:11:57.067570 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1635/3343] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:56 2022] GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c => generated 1303 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:57.073047 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b565c6f3-0b68-4122-a62b-605350220a49 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:57.074034 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b565c6f3-0b68-4122-a62b-605350220a49 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:57.088086 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b565c6f3-0b68-4122-a62b-605350220a49 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:57.089008 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b565c6f3-0b68-4122-a62b-605350220a49 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:57.090845 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b565c6f3-0b68-4122-a62b-605350220a49 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:57.091658 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b565c6f3-0b68-4122-a62b-605350220a49 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:57.260057 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6f229e63-202f-4b4b-b3d4-21fbe03468dc tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:57.263203 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-b565c6f3-0b68-4122-a62b-605350220a49 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lazy-loading 'services' on Instance uuid 3c658f2d-9442-4b10-b5f5-2d484553330e {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:11:57.269968 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6f229e63-202f-4b4b-b3d4-21fbe03468dc tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.265366 Jun 20 12:11:57.271252 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1709/3344] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:57 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:57.289901 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-91f48ed2-2f1e-4d51-b614-8630397b5b3b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:57.290520 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-91f48ed2-2f1e-4d51-b614-8630397b5b3b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:57.297850 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91f48ed2-2f1e-4d51-b614-8630397b5b3b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:57.298411 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91f48ed2-2f1e-4d51-b614-8630397b5b3b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:57.299194 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91f48ed2-2f1e-4d51-b614-8630397b5b3b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:57.299808 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91f48ed2-2f1e-4d51-b614-8630397b5b3b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:57.307567 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:11:57.308470 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b565c6f3-0b68-4122-a62b-605350220a49 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1935 microversion: 2.75 time: 0.239448 Jun 20 12:11:57.312583 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1636/3345] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:57 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1935 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:57.469045 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-91f48ed2-2f1e-4d51-b614-8630397b5b3b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:57.477513 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-91f48ed2-2f1e-4d51-b614-8630397b5b3b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.192276 Jun 20 12:11:57.478138 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1710/3346] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:57 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:11:57.498093 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7f695de3-0945-4867-aae9-dc522f307c22 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:57.498815 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7f695de3-0945-4867-aae9-dc522f307c22 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:57.505480 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f695de3-0945-4867-aae9-dc522f307c22 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:57.505935 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f695de3-0945-4867-aae9-dc522f307c22 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:57.506716 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f695de3-0945-4867-aae9-dc522f307c22 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:57.507257 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f695de3-0945-4867-aae9-dc522f307c22 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:57.533167 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-7f695de3-0945-4867-aae9-dc522f307c22 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] HTTP exception thrown: Cannot 'unpause' instance 593cda12-6491-4a27-8fc7-42c05e0291c3 while it is in vm_state active Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7f695de3-0945-4867-aae9-dc522f307c22 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3/action HTTP/1.1 Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 15 Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: {"unpause": {}} Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: exception: Cannot 'unpause' instance 593cda12-6491-4a27-8fc7-42c05e0291c3 while it is in vm_state active Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '593cda12-6491-4a27-8fc7-42c05e0291c3', 'body': {'unpause': {}}} Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 593cda12-6491-4a27-8fc7-42c05e0291c3 in vm_state active. Cannot unpause while the instance is in this state. Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 593cda12-6491-4a27-8fc7-42c05e0291c3 while it is in vm_state active Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:57.535008 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:57.543058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:57.543058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:11:57.543058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:11:57.543058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 593cda12-6491-4a27-8fc7-42c05e0291c3 while it is in vm_state active Jun 20 12:11:57.543058 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:57.543058 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7f695de3-0945-4867-aae9-dc522f307c22 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 409 to user: Cannot 'unpause' instance 593cda12-6491-4a27-8fc7-42c05e0291c3 while it is in vm_state active {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:11:57.543058 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7f695de3-0945-4867-aae9-dc522f307c22 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3/action" status: 409 len: 145 microversion: 2.1 time: 0.042836 Jun 20 12:11:57.543058 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1637/3347] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:11:57 2022] POST /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3/action => generated 145 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:11:57.551017 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d0bd55db-1f6c-447f-8ca4-e4f51aea834b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:57.551644 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d0bd55db-1f6c-447f-8ca4-e4f51aea834b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:57.560715 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-165f5a8d-4852-4b3c-a30e-42b052081ff7 req-7f4cc37e-6a1e-42b2-9c88-24c8bd71a883 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3163bfa2-d7b5-451e-ae0c-cc2ec445c532", "name": "network-vif-deleted", "tag": "eb877463-7d93-4069-944d-8674a91f4b80"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:57.563640 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d0bd55db-1f6c-447f-8ca4-e4f51aea834b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:57.564863 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d0bd55db-1f6c-447f-8ca4-e4f51aea834b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:57.567358 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d0bd55db-1f6c-447f-8ca4-e4f51aea834b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:57.568969 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d0bd55db-1f6c-447f-8ca4-e4f51aea834b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:57.574669 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-165f5a8d-4852-4b3c-a30e-42b052081ff7 req-7f4cc37e-6a1e-42b2-9c88-24c8bd71a883 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:57.575384 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-165f5a8d-4852-4b3c-a30e-42b052081ff7 req-7f4cc37e-6a1e-42b2-9c88-24c8bd71a883 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:57.590390 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-165f5a8d-4852-4b3c-a30e-42b052081ff7 req-7f4cc37e-6a1e-42b2-9c88-24c8bd71a883 service nova] Creating event network-vif-deleted:eb877463-7d93-4069-944d-8674a91f4b80 for instance 3163bfa2-d7b5-451e-ae0c-cc2ec445c532 on n-h1-master-1 Jun 20 12:11:57.596269 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-165f5a8d-4852-4b3c-a30e-42b052081ff7 req-7f4cc37e-6a1e-42b2-9c88-24c8bd71a883 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040511 Jun 20 12:11:57.597080 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1638/3348] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:11:57.777205 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d0bd55db-1f6c-447f-8ca4-e4f51aea834b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:57.790220 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d0bd55db-1f6c-447f-8ca4-e4f51aea834b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.243183 Jun 20 12:11:57.791072 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1711/3349] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:57 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:57.810299 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-25ec775c-2e09-4652-94c7-077b6b3b79a1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:57.811067 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-25ec775c-2e09-4652-94c7-077b6b3b79a1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:57.819270 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-25ec775c-2e09-4652-94c7-077b6b3b79a1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:57.819843 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-25ec775c-2e09-4652-94c7-077b6b3b79a1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:57.820898 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-25ec775c-2e09-4652-94c7-077b6b3b79a1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:57.821367 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-25ec775c-2e09-4652-94c7-077b6b3b79a1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:57.897356 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a3591f3d-2f9b-41d1-83f8-78ab85469e88 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:57.898501 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a3591f3d-2f9b-41d1-83f8-78ab85469e88 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:57.909879 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a3591f3d-2f9b-41d1-83f8-78ab85469e88 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:57.910984 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a3591f3d-2f9b-41d1-83f8-78ab85469e88 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:57.912689 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a3591f3d-2f9b-41d1-83f8-78ab85469e88 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:57.913443 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a3591f3d-2f9b-41d1-83f8-78ab85469e88 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:57.985098 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a3591f3d-2f9b-41d1-83f8-78ab85469e88 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:57.985800 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a3591f3d-2f9b-41d1-83f8-78ab85469e88 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:57.985899 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-a3591f3d-2f9b-41d1-83f8-78ab85469e88 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lazy-loading 'fault' on Instance uuid 3163bfa2-d7b5-451e-ae0c-cc2ec445c532 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:11:58.048941 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-25ec775c-2e09-4652-94c7-077b6b3b79a1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:58.060059 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-25ec775c-2e09-4652-94c7-077b6b3b79a1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.254597 Jun 20 12:11:58.065197 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1639/3350] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:57 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:58.078677 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-84efcfe9-7a27-4fac-8fda-0ec002efae0c req-8d84b1e0-38ad-4fae-8120-3f7d4f9cfeaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546", "name": "network-vif-deleted", "tag": "e3be9c58-3684-4be2-8bc7-be13922b9ca1"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:58.093913 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-84efcfe9-7a27-4fac-8fda-0ec002efae0c req-8d84b1e0-38ad-4fae-8120-3f7d4f9cfeaf service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:58.095452 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-84efcfe9-7a27-4fac-8fda-0ec002efae0c req-8d84b1e0-38ad-4fae-8120-3f7d4f9cfeaf service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:58.096501 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a3591f3d-2f9b-41d1-83f8-78ab85469e88 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07f91cbf86a444fb06e050d4c4532fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c47b977a1334cd486385213ff23de86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:58.109540 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a3591f3d-2f9b-41d1-83f8-78ab85469e88 tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 200 len: 1313 microversion: 2.1 time: 0.221256 Jun 20 12:11:58.111350 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1712/3351] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:57 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:58.116235 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e835dab0-37ba-4ad9-8bc8-dbd40f596d84 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:58.116945 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e835dab0-37ba-4ad9-8bc8-dbd40f596d84 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:58.117114 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:11:58.121124 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-84efcfe9-7a27-4fac-8fda-0ec002efae0c req-8d84b1e0-38ad-4fae-8120-3f7d4f9cfeaf service nova] Creating event network-vif-deleted:e3be9c58-3684-4be2-8bc7-be13922b9ca1 for instance cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546 on n-h2-master-1 Jun 20 12:11:58.127892 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-84efcfe9-7a27-4fac-8fda-0ec002efae0c req-8d84b1e0-38ad-4fae-8120-3f7d4f9cfeaf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060344 Jun 20 12:11:58.128762 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1640/3352] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:11:58.136542 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-740c3429-6850-4e4b-b252-90d378bba86d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:58.136894 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e835dab0-37ba-4ad9-8bc8-dbd40f596d84 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:58.137359 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e835dab0-37ba-4ad9-8bc8-dbd40f596d84 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:58.137853 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-740c3429-6850-4e4b-b252-90d378bba86d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 47633bac-183d-48da-a8dc-38137d222cfb] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:58.140355 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e835dab0-37ba-4ad9-8bc8-dbd40f596d84 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:58.140806 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e835dab0-37ba-4ad9-8bc8-dbd40f596d84 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:58.149087 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-740c3429-6850-4e4b-b252-90d378bba86d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] HTTP exception thrown: Instance 47633bac-183d-48da-a8dc-38137d222cfb could not be found. Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-740c3429-6850-4e4b-b252-90d378bba86d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/servers/47633bac-183d-48da-a8dc-38137d222cfb/action HTTP/1.1 Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 18 Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: {"unshelve": null} Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 47633bac-183d-48da-a8dc-38137d222cfb could not be found. Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '47633bac-183d-48da-a8dc-38137d222cfb', 'body': {'unshelve': None}} Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47633bac-183d-48da-a8dc-38137d222cfb could not be found. Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 94, in _unshelve Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47633bac-183d-48da-a8dc-38137d222cfb could not be found. Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:58.151904 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:58.163594 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:58.163594 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:11:58.163594 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:11:58.163594 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47633bac-183d-48da-a8dc-38137d222cfb could not be found. Jun 20 12:11:58.163594 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:58.163594 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-740c3429-6850-4e4b-b252-90d378bba86d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 404 to user: Instance 47633bac-183d-48da-a8dc-38137d222cfb could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:11:58.163594 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-740c3429-6850-4e4b-b252-90d378bba86d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers/47633bac-183d-48da-a8dc-38137d222cfb/action" status: 404 len: 111 microversion: 2.1 time: 0.023239 Jun 20 12:11:58.163594 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1641/3353] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:11:58 2022] POST /compute/v2.1/servers/47633bac-183d-48da-a8dc-38137d222cfb/action => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:11:58.163594 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0bfac63e-34fa-4823-b5e0-bca993685a27 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:58.163594 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0bfac63e-34fa-4823-b5e0-bca993685a27 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] [instance: 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:58.170173 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0bfac63e-34fa-4823-b5e0-bca993685a27 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:58.171343 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0bfac63e-34fa-4823-b5e0-bca993685a27 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:58.173191 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0bfac63e-34fa-4823-b5e0-bca993685a27 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:58.175069 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0bfac63e-34fa-4823-b5e0-bca993685a27 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:58.187425 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-e835dab0-37ba-4ad9-8bc8-dbd40f596d84 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] HTTP exception thrown: Instance cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546 could not be found. Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e835dab0-37ba-4ad9-8bc8-dbd40f596d84 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Request method failure captured: Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546 HTTP/1.1 Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGNZu11mbuzUHfROfUI-WhycOX7FshKFmHvB-sW2lQluqPvVCpJUdrBQf08QrnlF5RZ1vIJXWzrHxM3J-audVxli4WOFiHit5BTvqHVm17jw5Wevjrv8Pm8k6Di04Jw0UtnONV5qZCFvJ5KprHRyg3DOZFJAouo-C8LpEBsjtKPLwA4 Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: f62c06c318b54505b639ad49a10dc9e5 Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServerDiskConfigTestJSON-878717633 Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f62c06c318b54505b639ad49a10dc9e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f62c06c318b54505b639ad49a10dc9e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f62c06c318b54505b639ad49a10dc9e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f62c06c318b54505b639ad49a10dc9e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServerDiskConfigTestJSON-878717633 Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: f62c06c318b54505b639ad49a10dc9e5 Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-878717633 Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServerDiskConfigTestJSON-878717633-project Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: f9d39a7ff9af475b88d8ca1f1536fdf2 Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServerDiskConfigTestJSON-878717633-project Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: exception: Instance cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546 could not be found. Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546'} Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546 could not be found. Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546 could not be found. Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:58.189323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:58.194555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:58.194555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:58.194555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:58.194555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:11:58.194555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:11:58.194555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546 could not be found. Jun 20 12:11:58.194555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:58.194555 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e835dab0-37ba-4ad9-8bc8-dbd40f596d84 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Returning 404 to user: Instance cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:11:58.194555 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e835dab0-37ba-4ad9-8bc8-dbd40f596d84 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546" status: 404 len: 111 microversion: 2.1 time: 0.078459 Jun 20 12:11:58.194555 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1713/3354] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:58 2022] GET /compute/v2.1/servers/cd7ed1b8-4a8b-4432-9e77-f5e7f9c5b546 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:11:58.203360 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-0bfac63e-34fa-4823-b5e0-bca993685a27 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] HTTP exception thrown: Instance 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c could not be found. Jun 20 12:11:58.204756 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-aaf95475-0e9a-40cd-b7ca-8f3b2a9ea5f9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:58.204952 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-aaf95475-0e9a-40cd-b7ca-8f3b2a9ea5f9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0bfac63e-34fa-4823-b5e0-bca993685a27 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Request method failure captured: Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c HTTP/1.1 Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGKgi6jYIAm3mfrUjSiNYuEgcTX-WvqX2nMthzvsgeNwQ63Cs23utZPsmVsS6vSezI6Nxdnn7Zt7mq7APT9g109DZ_381MHORhtFZLL5CBWrwSUf5JupH83uMJgSQkQuNZkzrfhiFeMJ-I3PkrvVM-3iB1YjUY3Lg7SvpH9-AzUhDwc Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 4440dc3e2f9c4134a54b08e2585f6c59 Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-MigrationsAdminTest-286401708 Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4440dc3e2f9c4134a54b08e2585f6c59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4440dc3e2f9c4134a54b08e2585f6c59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4440dc3e2f9c4134a54b08e2585f6c59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4440dc3e2f9c4134a54b08e2585f6c59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-MigrationsAdminTest-286401708 Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 4440dc3e2f9c4134a54b08e2585f6c59 Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-MigrationsAdminTest-286401708 Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-MigrationsAdminTest-286401708-project Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 3d35b7c824b641099a406175bccc5be3 Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-MigrationsAdminTest-286401708-project Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c could not be found. Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '169d4a6b-c7e8-4fb6-9230-0daccebb7c1c'} Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c could not be found. Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c could not be found. Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:58.208944 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:58.216250 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:58.216250 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:58.216250 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:58.216250 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:11:58.216250 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:11:58.216250 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c could not be found. Jun 20 12:11:58.216250 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:58.216250 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0bfac63e-34fa-4823-b5e0-bca993685a27 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] Returning 404 to user: Instance 169d4a6b-c7e8-4fb6-9230-0daccebb7c1c could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:11:58.218907 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aaf95475-0e9a-40cd-b7ca-8f3b2a9ea5f9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:58.219153 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0bfac63e-34fa-4823-b5e0-bca993685a27 tempest-MigrationsAdminTest-286401708 tempest-MigrationsAdminTest-286401708-project] 10.222.0.27 "GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c" status: 404 len: 111 microversion: 2.1 time: 0.060735 Jun 20 12:11:58.220146 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aaf95475-0e9a-40cd-b7ca-8f3b2a9ea5f9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:58.220426 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1642/3355] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:58 2022] GET /compute/v2.1/servers/169d4a6b-c7e8-4fb6-9230-0daccebb7c1c => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:11:58.224847 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aaf95475-0e9a-40cd-b7ca-8f3b2a9ea5f9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:58.226099 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c2aa530a-4238-4b56-9958-c1d4664fa6cd tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:58.227128 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c2aa530a-4238-4b56-9958-c1d4664fa6cd tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:58.229143 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aaf95475-0e9a-40cd-b7ca-8f3b2a9ea5f9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:58.236287 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c2aa530a-4238-4b56-9958-c1d4664fa6cd tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:58.236646 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c2aa530a-4238-4b56-9958-c1d4664fa6cd tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:58.237511 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c2aa530a-4238-4b56-9958-c1d4664fa6cd tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:58.237902 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c2aa530a-4238-4b56-9958-c1d4664fa6cd tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:58.258384 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-c2aa530a-4238-4b56-9958-c1d4664fa6cd tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] HTTP exception thrown: Instance 31440c3e-bac0-437b-acd0-97351ddaae67 could not be found. Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c2aa530a-4238-4b56-9958-c1d4664fa6cd tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Request method failure captured: Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 HTTP/1.1 Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGNZu11mbuzUHfROfUI-WhycOX7FshKFmHvB-sW2lQluqPvVCpJUdrBQf08QrnlF5RZ1vIJXWzrHxM3J-audVxli4WOFiHit5BTvqHVm17jw5Wevjrv8Pm8k6Di04Jw0UtnONV5qZCFvJ5KprHRyg3DOZFJAouo-C8LpEBsjtKPLwA4 Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: f62c06c318b54505b639ad49a10dc9e5 Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServerDiskConfigTestJSON-878717633 Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f62c06c318b54505b639ad49a10dc9e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f62c06c318b54505b639ad49a10dc9e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f62c06c318b54505b639ad49a10dc9e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f62c06c318b54505b639ad49a10dc9e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServerDiskConfigTestJSON-878717633 Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: f62c06c318b54505b639ad49a10dc9e5 Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-878717633 Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServerDiskConfigTestJSON-878717633-project Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: f9d39a7ff9af475b88d8ca1f1536fdf2 Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServerDiskConfigTestJSON-878717633-project Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 31440c3e-bac0-437b-acd0-97351ddaae67 could not be found. Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '31440c3e-bac0-437b-acd0-97351ddaae67'} Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31440c3e-bac0-437b-acd0-97351ddaae67 could not be found. Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:11:58.260161 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:11:58.271263 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31440c3e-bac0-437b-acd0-97351ddaae67 could not be found. Jun 20 12:11:58.271263 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:58.271263 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:58.271263 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:58.271263 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:58.271263 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:58.271263 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:58.271263 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:11:58.271263 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:11:58.271263 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31440c3e-bac0-437b-acd0-97351ddaae67 could not be found. Jun 20 12:11:58.271263 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:58.271263 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c2aa530a-4238-4b56-9958-c1d4664fa6cd tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Returning 404 to user: Instance 31440c3e-bac0-437b-acd0-97351ddaae67 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:11:58.271263 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c2aa530a-4238-4b56-9958-c1d4664fa6cd tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "DELETE /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 404 len: 111 microversion: 2.1 time: 0.042174 Jun 20 12:11:58.271263 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1643/3356] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:11:58 2022] DELETE /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:11:58.282708 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-aa5c23f9-52cf-44aa-bde0-6494f8231d34 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:58.283450 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-aa5c23f9-52cf-44aa-bde0-6494f8231d34 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 31440c3e-bac0-437b-acd0-97351ddaae67] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:58.300047 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aa5c23f9-52cf-44aa-bde0-6494f8231d34 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:58.300537 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aa5c23f9-52cf-44aa-bde0-6494f8231d34 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:58.301903 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aa5c23f9-52cf-44aa-bde0-6494f8231d34 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:58.302420 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aa5c23f9-52cf-44aa-bde0-6494f8231d34 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:58.324909 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-aa5c23f9-52cf-44aa-bde0-6494f8231d34 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] HTTP exception thrown: Instance 31440c3e-bac0-437b-acd0-97351ddaae67 could not be found. Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-aa5c23f9-52cf-44aa-bde0-6494f8231d34 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Request method failure captured: Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 HTTP/1.1 Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGNZu11mbuzUHfROfUI-WhycOX7FshKFmHvB-sW2lQluqPvVCpJUdrBQf08QrnlF5RZ1vIJXWzrHxM3J-audVxli4WOFiHit5BTvqHVm17jw5Wevjrv8Pm8k6Di04Jw0UtnONV5qZCFvJ5KprHRyg3DOZFJAouo-C8LpEBsjtKPLwA4 Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: f62c06c318b54505b639ad49a10dc9e5 Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServerDiskConfigTestJSON-878717633 Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f62c06c318b54505b639ad49a10dc9e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f62c06c318b54505b639ad49a10dc9e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f62c06c318b54505b639ad49a10dc9e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f62c06c318b54505b639ad49a10dc9e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServerDiskConfigTestJSON-878717633 Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: f62c06c318b54505b639ad49a10dc9e5 Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-878717633 Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServerDiskConfigTestJSON-878717633-project Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: f9d39a7ff9af475b88d8ca1f1536fdf2 Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServerDiskConfigTestJSON-878717633-project Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 31440c3e-bac0-437b-acd0-97351ddaae67 could not be found. Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '31440c3e-bac0-437b-acd0-97351ddaae67'} Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31440c3e-bac0-437b-acd0-97351ddaae67 could not be found. Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31440c3e-bac0-437b-acd0-97351ddaae67 could not be found. Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:58.327235 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:58.334045 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:58.334045 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:58.334045 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:58.334045 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:11:58.334045 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:11:58.334045 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31440c3e-bac0-437b-acd0-97351ddaae67 could not be found. Jun 20 12:11:58.334045 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:58.334045 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-aa5c23f9-52cf-44aa-bde0-6494f8231d34 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Returning 404 to user: Instance 31440c3e-bac0-437b-acd0-97351ddaae67 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:11:58.334045 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-aa5c23f9-52cf-44aa-bde0-6494f8231d34 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67" status: 404 len: 111 microversion: 2.1 time: 0.059618 Jun 20 12:11:58.334045 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1644/3357] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:58 2022] GET /compute/v2.1/servers/31440c3e-bac0-437b-acd0-97351ddaae67 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:11:58.336053 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-855004a9-3e75-466b-a56f-c8953239d1a1 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:58.336781 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-855004a9-3e75-466b-a56f-c8953239d1a1 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:58.345935 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-855004a9-3e75-466b-a56f-c8953239d1a1 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:58.346461 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-855004a9-3e75-466b-a56f-c8953239d1a1 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:58.347745 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-855004a9-3e75-466b-a56f-c8953239d1a1 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:58.348407 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-855004a9-3e75-466b-a56f-c8953239d1a1 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:58.476534 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-855004a9-3e75-466b-a56f-c8953239d1a1 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lazy-loading 'services' on Instance uuid 3c658f2d-9442-4b10-b5f5-2d484553330e {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:11:58.502551 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:11:58.506994 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-855004a9-3e75-466b-a56f-c8953239d1a1 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1935 microversion: 2.75 time: 0.176001 Jun 20 12:11:58.507793 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1645/3358] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:58 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1935 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:58.513859 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-56fd0b9a-7423-451d-80b8-56e94c92d2e9 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:58.516418 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-56fd0b9a-7423-451d-80b8-56e94c92d2e9 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:58.530786 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-56fd0b9a-7423-451d-80b8-56e94c92d2e9 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:58.531287 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-56fd0b9a-7423-451d-80b8-56e94c92d2e9 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:58.532407 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-56fd0b9a-7423-451d-80b8-56e94c92d2e9 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:58.532854 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-56fd0b9a-7423-451d-80b8-56e94c92d2e9 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:58.562003 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-56fd0b9a-7423-451d-80b8-56e94c92d2e9 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] HTTP exception thrown: Instance 0c9e8490-b371-4215-af47-09ebe2b7cd41 could not be found. Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-56fd0b9a-7423-451d-80b8-56e94c92d2e9 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Request method failure captured: Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 HTTP/1.1 Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGNZu11mbuzUHfROfUI-WhycOX7FshKFmHvB-sW2lQluqPvVCpJUdrBQf08QrnlF5RZ1vIJXWzrHxM3J-audVxli4WOFiHit5BTvqHVm17jw5Wevjrv8Pm8k6Di04Jw0UtnONV5qZCFvJ5KprHRyg3DOZFJAouo-C8LpEBsjtKPLwA4 Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: f62c06c318b54505b639ad49a10dc9e5 Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServerDiskConfigTestJSON-878717633 Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f62c06c318b54505b639ad49a10dc9e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f62c06c318b54505b639ad49a10dc9e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f62c06c318b54505b639ad49a10dc9e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f62c06c318b54505b639ad49a10dc9e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServerDiskConfigTestJSON-878717633 Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: f62c06c318b54505b639ad49a10dc9e5 Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-878717633 Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServerDiskConfigTestJSON-878717633-project Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: f9d39a7ff9af475b88d8ca1f1536fdf2 Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServerDiskConfigTestJSON-878717633-project Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 0c9e8490-b371-4215-af47-09ebe2b7cd41 could not be found. Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '0c9e8490-b371-4215-af47-09ebe2b7cd41'} Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c9e8490-b371-4215-af47-09ebe2b7cd41 could not be found. Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:11:58.564344 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:11:58.569995 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c9e8490-b371-4215-af47-09ebe2b7cd41 could not be found. Jun 20 12:11:58.569995 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:58.569995 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:58.569995 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:58.569995 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:58.569995 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:58.569995 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:58.569995 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:11:58.569995 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:11:58.569995 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c9e8490-b371-4215-af47-09ebe2b7cd41 could not be found. Jun 20 12:11:58.569995 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:58.569995 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-56fd0b9a-7423-451d-80b8-56e94c92d2e9 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Returning 404 to user: Instance 0c9e8490-b371-4215-af47-09ebe2b7cd41 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:11:58.569995 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-56fd0b9a-7423-451d-80b8-56e94c92d2e9 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41" status: 404 len: 111 microversion: 2.1 time: 0.057438 Jun 20 12:11:58.569995 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1646/3359] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:11:58 2022] DELETE /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:11:58.586660 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9fc4a9e2-3027-4190-bc5f-578ba61aa950 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:58.588044 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9fc4a9e2-3027-4190-bc5f-578ba61aa950 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] [instance: 0c9e8490-b371-4215-af47-09ebe2b7cd41] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:58.622755 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9fc4a9e2-3027-4190-bc5f-578ba61aa950 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:58.623149 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9fc4a9e2-3027-4190-bc5f-578ba61aa950 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:58.627928 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9fc4a9e2-3027-4190-bc5f-578ba61aa950 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:58.628484 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9fc4a9e2-3027-4190-bc5f-578ba61aa950 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:58.642954 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-aaf95475-0e9a-40cd-b7ca-8f3b2a9ea5f9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:58.663306 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-9fc4a9e2-3027-4190-bc5f-578ba61aa950 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] HTTP exception thrown: Instance 0c9e8490-b371-4215-af47-09ebe2b7cd41 could not be found. Jun 20 12:11:58.664305 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-aaf95475-0e9a-40cd-b7ca-8f3b2a9ea5f9 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.470656 Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9fc4a9e2-3027-4190-bc5f-578ba61aa950 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Request method failure captured: Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 HTTP/1.1 Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGNZu11mbuzUHfROfUI-WhycOX7FshKFmHvB-sW2lQluqPvVCpJUdrBQf08QrnlF5RZ1vIJXWzrHxM3J-audVxli4WOFiHit5BTvqHVm17jw5Wevjrv8Pm8k6Di04Jw0UtnONV5qZCFvJ5KprHRyg3DOZFJAouo-C8LpEBsjtKPLwA4 Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: f62c06c318b54505b639ad49a10dc9e5 Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServerDiskConfigTestJSON-878717633 Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f62c06c318b54505b639ad49a10dc9e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f62c06c318b54505b639ad49a10dc9e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f62c06c318b54505b639ad49a10dc9e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f62c06c318b54505b639ad49a10dc9e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServerDiskConfigTestJSON-878717633 Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: f62c06c318b54505b639ad49a10dc9e5 Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-878717633 Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServerDiskConfigTestJSON-878717633-project Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: f9d39a7ff9af475b88d8ca1f1536fdf2 Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServerDiskConfigTestJSON-878717633-project Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 0c9e8490-b371-4215-af47-09ebe2b7cd41 could not be found. Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '0c9e8490-b371-4215-af47-09ebe2b7cd41'} Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c9e8490-b371-4215-af47-09ebe2b7cd41 could not be found. Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c9e8490-b371-4215-af47-09ebe2b7cd41 could not be found. Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:58.666582 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:58.674442 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:58.674442 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:58.674442 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:58.674442 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:11:58.674442 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:11:58.674442 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c9e8490-b371-4215-af47-09ebe2b7cd41 could not be found. Jun 20 12:11:58.674442 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:58.674442 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9fc4a9e2-3027-4190-bc5f-578ba61aa950 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] Returning 404 to user: Instance 0c9e8490-b371-4215-af47-09ebe2b7cd41 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:11:58.674442 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9fc4a9e2-3027-4190-bc5f-578ba61aa950 tempest-ServerDiskConfigTestJSON-878717633 tempest-ServerDiskConfigTestJSON-878717633-project] 10.222.0.27 "GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41" status: 404 len: 111 microversion: 2.1 time: 0.091061 Jun 20 12:11:58.674442 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1647/3360] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:58 2022] GET /compute/v2.1/servers/0c9e8490-b371-4215-af47-09ebe2b7cd41 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:11:58.678199 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1714/3361] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:58 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:58.687540 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-19d9ce91-3a6c-4b03-b8fe-ff4fbf9ecaba tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:58.690395 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-19d9ce91-3a6c-4b03-b8fe-ff4fbf9ecaba tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:58.698803 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-19d9ce91-3a6c-4b03-b8fe-ff4fbf9ecaba tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:58.700314 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-19d9ce91-3a6c-4b03-b8fe-ff4fbf9ecaba tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:58.701837 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-19d9ce91-3a6c-4b03-b8fe-ff4fbf9ecaba tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:58.702763 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-19d9ce91-3a6c-4b03-b8fe-ff4fbf9ecaba tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:59.095752 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-19d9ce91-3a6c-4b03-b8fe-ff4fbf9ecaba tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:59.106192 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-19d9ce91-3a6c-4b03-b8fe-ff4fbf9ecaba tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.425801 Jun 20 12:11:59.108964 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1648/3362] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:58 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:11:59.128490 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-552f4b7d-4a10-4b23-90fd-d463cb7a00ee tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:59.129106 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-552f4b7d-4a10-4b23-90fd-d463cb7a00ee tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] [instance: 3163bfa2-d7b5-451e-ae0c-cc2ec445c532] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:59.130836 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-414372e1-24c0-4b8b-9a0f-f1434d3c2ab7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:59.132005 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-414372e1-24c0-4b8b-9a0f-f1434d3c2ab7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:59.140238 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-552f4b7d-4a10-4b23-90fd-d463cb7a00ee tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:59.142743 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-552f4b7d-4a10-4b23-90fd-d463cb7a00ee tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:59.145116 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-552f4b7d-4a10-4b23-90fd-d463cb7a00ee tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:59.145575 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-552f4b7d-4a10-4b23-90fd-d463cb7a00ee tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:59.145772 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-414372e1-24c0-4b8b-9a0f-f1434d3c2ab7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:59.146441 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-414372e1-24c0-4b8b-9a0f-f1434d3c2ab7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:59.150739 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-414372e1-24c0-4b8b-9a0f-f1434d3c2ab7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:59.151582 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-414372e1-24c0-4b8b-9a0f-f1434d3c2ab7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:59.184006 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-552f4b7d-4a10-4b23-90fd-d463cb7a00ee tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] HTTP exception thrown: Instance 3163bfa2-d7b5-451e-ae0c-cc2ec445c532 could not be found. Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-552f4b7d-4a10-4b23-90fd-d463cb7a00ee tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Request method failure captured: Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 HTTP/1.1 Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGPDeSVyf7jQDl4qVlOVhSxwbw-Sg5qW-fWQWzYdHM7-AoML_QN2TEuFrRzN3W-IffWo4Lspm5X7udq1lVU33Q6sazpAYhUuimzda3UluSiwZuOMtOf9lGdMweEUtuDru49mwAHM1Vny6BPOcj4FGUQ0vC-xit_LmmNvGsjGixS8nmQ Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 5c47b977a1334cd486385213ff23de86 Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1204835389 Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5c47b977a1334cd486385213ff23de86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5c47b977a1334cd486385213ff23de86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5c47b977a1334cd486385213ff23de86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5c47b977a1334cd486385213ff23de86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1204835389 Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 5c47b977a1334cd486385213ff23de86 Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1204835389 Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServerRescueTestJSONUnderV235-1204835389-project Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: d07f91cbf86a444fb06e050d4c4532fd Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1204835389-project Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 3163bfa2-d7b5-451e-ae0c-cc2ec445c532 could not be found. Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '3163bfa2-d7b5-451e-ae0c-cc2ec445c532'} Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3163bfa2-d7b5-451e-ae0c-cc2ec445c532 could not be found. Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3163bfa2-d7b5-451e-ae0c-cc2ec445c532 could not be found. Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:59.191229 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:59.196356 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:59.196356 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:59.196356 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:59.196356 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:59.196356 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:11:59.196356 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:11:59.196356 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3163bfa2-d7b5-451e-ae0c-cc2ec445c532 could not be found. Jun 20 12:11:59.196356 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:11:59.196356 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-552f4b7d-4a10-4b23-90fd-d463cb7a00ee tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] Returning 404 to user: Instance 3163bfa2-d7b5-451e-ae0c-cc2ec445c532 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:11:59.199193 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-552f4b7d-4a10-4b23-90fd-d463cb7a00ee tempest-ServerRescueTestJSONUnderV235-1204835389 tempest-ServerRescueTestJSONUnderV235-1204835389-project] 10.222.0.27 "GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532" status: 404 len: 111 microversion: 2.1 time: 0.075693 Jun 20 12:11:59.199785 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1715/3363] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:59 2022] GET /compute/v2.1/servers/3163bfa2-d7b5-451e-ae0c-cc2ec445c532 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:11:59.211287 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-414372e1-24c0-4b8b-9a0f-f1434d3c2ab7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] HTTP exception thrown: Cannot 'unshelve' instance 593cda12-6491-4a27-8fc7-42c05e0291c3 while it is in vm_state active Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-414372e1-24c0-4b8b-9a0f-f1434d3c2ab7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3/action HTTP/1.1 Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 18 Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: {"unshelve": null} Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: exception: Cannot 'unshelve' instance 593cda12-6491-4a27-8fc7-42c05e0291c3 while it is in vm_state active Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '593cda12-6491-4a27-8fc7-42c05e0291c3', 'body': {'unshelve': None}} Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 105, in _unshelve Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve(context, instance, new_az=new_az) Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 593cda12-6491-4a27-8fc7-42c05e0291c3 in vm_state active. Cannot unshelve while the instance is in this state. Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 111, in _unshelve Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 593cda12-6491-4a27-8fc7-42c05e0291c3 while it is in vm_state active Jun 20 12:11:59.214314 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:59.220634 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:59.220634 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:59.220634 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:59.220634 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:59.220634 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:59.220634 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:11:59.220634 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:11:59.220634 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 593cda12-6491-4a27-8fc7-42c05e0291c3 while it is in vm_state active Jun 20 12:11:59.220634 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:59.224028 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-414372e1-24c0-4b8b-9a0f-f1434d3c2ab7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 409 to user: Cannot 'unshelve' instance 593cda12-6491-4a27-8fc7-42c05e0291c3 while it is in vm_state active {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:11:59.225190 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-414372e1-24c0-4b8b-9a0f-f1434d3c2ab7 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "POST /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3/action" status: 409 len: 146 microversion: 2.1 time: 0.099552 Jun 20 12:11:59.244742 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f7a797f4-a9cc-4a61-9cf5-708e4be7db6b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:59.245686 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f7a797f4-a9cc-4a61-9cf5-708e4be7db6b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:59.251254 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1649/3364] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:11:59 2022] POST /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3/action => generated 146 bytes in 123 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 20 12:11:59.255683 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f7a797f4-a9cc-4a61-9cf5-708e4be7db6b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:59.256149 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f7a797f4-a9cc-4a61-9cf5-708e4be7db6b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:59.258569 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f7a797f4-a9cc-4a61-9cf5-708e4be7db6b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:59.259092 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f7a797f4-a9cc-4a61-9cf5-708e4be7db6b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:59.533880 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4d98798e-9e56-4aec-b0fa-5faa733a8860 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:59.534760 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4d98798e-9e56-4aec-b0fa-5faa733a8860 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:59.543180 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4d98798e-9e56-4aec-b0fa-5faa733a8860 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:59.544010 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4d98798e-9e56-4aec-b0fa-5faa733a8860 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:59.547761 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4d98798e-9e56-4aec-b0fa-5faa733a8860 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:59.563115 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4d98798e-9e56-4aec-b0fa-5faa733a8860 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:59.660651 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f7a797f4-a9cc-4a61-9cf5-708e4be7db6b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:59.670502 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f7a797f4-a9cc-4a61-9cf5-708e4be7db6b tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.431339 Jun 20 12:11:59.671102 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1716/3365] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:59 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:11:59.689921 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9147eeaf-580f-49a6-af03-d7b1a85cf062 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:59.690551 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9147eeaf-580f-49a6-af03-d7b1a85cf062 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:59.701432 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9147eeaf-580f-49a6-af03-d7b1a85cf062 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:59.701891 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9147eeaf-580f-49a6-af03-d7b1a85cf062 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:59.702896 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9147eeaf-580f-49a6-af03-d7b1a85cf062 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:59.703635 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9147eeaf-580f-49a6-af03-d7b1a85cf062 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:59.748815 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-4d98798e-9e56-4aec-b0fa-5faa733a8860 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lazy-loading 'services' on Instance uuid 3c658f2d-9442-4b10-b5f5-2d484553330e {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:11:59.782161 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4d98798e-9e56-4aec-b0fa-5faa733a8860 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1935 microversion: 2.75 time: 0.254808 Jun 20 12:11:59.783039 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1650/3366] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:11:59 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1935 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:11:59.913582 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9147eeaf-580f-49a6-af03-d7b1a85cf062 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:11:59.924654 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9147eeaf-580f-49a6-af03-d7b1a85cf062 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.239467 Jun 20 12:11:59.929970 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1717/3367] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:59 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:11:59.944088 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-df4eb174-c1b9-46cd-b479-bff54585514d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1822497839_updated"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:11:59.946622 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-df4eb174-c1b9-46cd-b479-bff54585514d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 3f8d0897-ca73-4064-bb35-ddec16a69cb5] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:59.956912 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-df4eb174-c1b9-46cd-b479-bff54585514d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] HTTP exception thrown: Instance 3f8d0897-ca73-4064-bb35-ddec16a69cb5 could not be found. Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-df4eb174-c1b9-46cd-b479-bff54585514d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: request: PUT /compute/v2.1/servers/3f8d0897-ca73-4064-bb35-ddec16a69cb5 HTTP/1.1 Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 81 Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1822497839_updated"}} Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 3f8d0897-ca73-4064-bb35-ddec16a69cb5 could not be found. Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '3f8d0897-ca73-4064-bb35-ddec16a69cb5', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1822497839_updated'}}} Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f8d0897-ca73-4064-bb35-ddec16a69cb5 could not be found. Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jun 20 12:11:59.959454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:11:59.967255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:11:59.967255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:11:59.967255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:11:59.967255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f8d0897-ca73-4064-bb35-ddec16a69cb5 could not be found. Jun 20 12:11:59.967255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:59.967255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:11:59.967255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:59.967255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:11:59.967255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:11:59.967255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:11:59.967255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:11:59.967255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:11:59.967255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f8d0897-ca73-4064-bb35-ddec16a69cb5 could not be found. Jun 20 12:11:59.967255 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:11:59.967255 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-df4eb174-c1b9-46cd-b479-bff54585514d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 404 to user: Instance 3f8d0897-ca73-4064-bb35-ddec16a69cb5 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:11:59.968470 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-df4eb174-c1b9-46cd-b479-bff54585514d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "PUT /compute/v2.1/servers/3f8d0897-ca73-4064-bb35-ddec16a69cb5" status: 404 len: 111 microversion: 2.1 time: 0.029856 Jun 20 12:11:59.972381 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1651/3368] 10.222.0.27 () {60 vars in 1255 bytes} [Mon Jun 20 12:11:59 2022] PUT /compute/v2.1/servers/3f8d0897-ca73-4064-bb35-ddec16a69cb5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:11:59.977130 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-60593459-3424-4657-8059-8092cbe7e7b1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:11:59.977823 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-60593459-3424-4657-8059-8092cbe7e7b1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:11:59.984649 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-60593459-3424-4657-8059-8092cbe7e7b1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:59.985946 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-60593459-3424-4657-8059-8092cbe7e7b1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:11:59.987008 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-60593459-3424-4657-8059-8092cbe7e7b1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:11:59.987665 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-60593459-3424-4657-8059-8092cbe7e7b1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:00.207197 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-60593459-3424-4657-8059-8092cbe7e7b1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:00.217934 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-60593459-3424-4657-8059-8092cbe7e7b1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.242851 Jun 20 12:12:00.231217 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1718/3369] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:11:59 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:12:00.236727 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1d3e9d45-21de-4a2f-aad0-c76e012f2c52 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:00.237430 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1d3e9d45-21de-4a2f-aad0-c76e012f2c52 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:00.250719 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d3e9d45-21de-4a2f-aad0-c76e012f2c52 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:00.252328 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d3e9d45-21de-4a2f-aad0-c76e012f2c52 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:00.253194 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d3e9d45-21de-4a2f-aad0-c76e012f2c52 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:00.255454 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d3e9d45-21de-4a2f-aad0-c76e012f2c52 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:00.802694 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fa40ab41-1a9b-4ae9-a705-ef42ef9a00b5 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:00.803317 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fa40ab41-1a9b-4ae9-a705-ef42ef9a00b5 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:00.823517 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fa40ab41-1a9b-4ae9-a705-ef42ef9a00b5 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:00.823979 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fa40ab41-1a9b-4ae9-a705-ef42ef9a00b5 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:00.824859 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fa40ab41-1a9b-4ae9-a705-ef42ef9a00b5 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:00.825229 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fa40ab41-1a9b-4ae9-a705-ef42ef9a00b5 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:00.837443 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1d3e9d45-21de-4a2f-aad0-c76e012f2c52 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:00.851522 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1d3e9d45-21de-4a2f-aad0-c76e012f2c52 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.618981 Jun 20 12:12:00.855612 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1652/3370] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:00 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:12:00.869963 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-724be4e3-200a-46f6-9104-e1b8bc26fc3c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-724be4e3-200a-46f6-9104-e1b8bc26fc3c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: request: PUT /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 HTTP/1.1 Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 280 Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '593cda12-6491-4a27-8fc7-42c05e0291c3', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise error Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:00.878295 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:00.882816 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:12:00.882816 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:12:00.882816 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:12:00.882816 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:12:00.882816 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:12:00.882816 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:12:00.882816 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:12:00.882816 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:12:00.882816 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 12:12:00.882816 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 12:12:00.882816 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 12:12:00.882816 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 12:12:00.882816 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 12:12:00.882816 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 12:12:00.882816 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 20 12:12:00.882816 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:00.882816 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:12:00.882816 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:00.882816 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:00.882816 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:12:00.882816 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:12:00.882816 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 12:12:00.882816 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 12:12:00.882816 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 20 12:12:00.882816 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:00.888757 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-724be4e3-200a-46f6-9104-e1b8bc26fc3c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:12:00.896857 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-724be4e3-200a-46f6-9104-e1b8bc26fc3c tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "PUT /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 400 len: 619 microversion: 2.1 time: 0.031829 Jun 20 12:12:00.899420 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1653/3371] 10.222.0.27 () {60 vars in 1256 bytes} [Mon Jun 20 12:12:00 2022] PUT /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 619 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:12:00.913830 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c0e9b1ea-6b5d-4df9-bebf-d07e968e0ef4 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:00.916632 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c0e9b1ea-6b5d-4df9-bebf-d07e968e0ef4 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:00.940550 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c0e9b1ea-6b5d-4df9-bebf-d07e968e0ef4 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:00.945177 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c0e9b1ea-6b5d-4df9-bebf-d07e968e0ef4 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:00.946322 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c0e9b1ea-6b5d-4df9-bebf-d07e968e0ef4 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:00.947569 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c0e9b1ea-6b5d-4df9-bebf-d07e968e0ef4 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:01.007595 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-fa40ab41-1a9b-4ae9-a705-ef42ef9a00b5 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lazy-loading 'services' on Instance uuid 3c658f2d-9442-4b10-b5f5-2d484553330e {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:12:01.064769 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fa40ab41-1a9b-4ae9-a705-ef42ef9a00b5 tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1935 microversion: 2.75 time: 0.266261 Jun 20 12:12:01.071154 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1719/3372] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:12:00 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1935 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:12:01.703638 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c0e9b1ea-6b5d-4df9-bebf-d07e968e0ef4 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:01.714041 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c0e9b1ea-6b5d-4df9-bebf-d07e968e0ef4 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.810153 Jun 20 12:12:01.717129 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1654/3373] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:00 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:12:01.737782 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b9c4b044-11de-4962-a8db-13ea0ae75ec8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:01.738735 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b9c4b044-11de-4962-a8db-13ea0ae75ec8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:01.749821 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b9c4b044-11de-4962-a8db-13ea0ae75ec8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:01.750545 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b9c4b044-11de-4962-a8db-13ea0ae75ec8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:01.752534 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b9c4b044-11de-4962-a8db-13ea0ae75ec8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:01.752829 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b9c4b044-11de-4962-a8db-13ea0ae75ec8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:02.049197 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b9c4b044-11de-4962-a8db-13ea0ae75ec8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:02.060697 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b9c4b044-11de-4962-a8db-13ea0ae75ec8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.327379 Jun 20 12:12:02.065536 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1720/3374] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:01 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:12:02.079690 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a8658fe2-f348-4883-a258-27329fc48fd2 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a8658fe2-f348-4883-a258-27329fc48fd2 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: request: PUT /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 HTTP/1.1 Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 24 Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: {"server": {"name": ""}} Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: exception: Invalid input for field/attribute name. Value: . '' is too short Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '593cda12-6491-4a27-8fc7-42c05e0291c3', 'body': {'server': {'name': ''}}} Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise error Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi '' Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 12:12:02.082382 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jun 20 12:12:02.087850 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:02.087850 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:12:02.087850 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:02.087850 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:02.087850 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:12:02.087850 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:12:02.087850 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 12:12:02.087850 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 12:12:02.087850 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jun 20 12:12:02.087850 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:02.087850 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a8658fe2-f348-4883-a258-27329fc48fd2 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:12:02.087850 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a8658fe2-f348-4883-a258-27329fc48fd2 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "PUT /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 400 len: 108 microversion: 2.1 time: 0.008370 Jun 20 12:12:02.096939 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b90e8a7f-fe49-4477-a5f8-580e6455f07d tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:02.097570 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b90e8a7f-fe49-4477-a5f8-580e6455f07d tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:02.100302 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1655/3375] 10.222.0.27 () {60 vars in 1255 bytes} [Mon Jun 20 12:12:02 2022] PUT /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 108 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:12:02.112404 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b90e8a7f-fe49-4477-a5f8-580e6455f07d tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:02.112872 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b90e8a7f-fe49-4477-a5f8-580e6455f07d tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:02.113656 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b90e8a7f-fe49-4477-a5f8-580e6455f07d tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:02.114098 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b90e8a7f-fe49-4477-a5f8-580e6455f07d tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:02.119344 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f1337635-45be-42f3-9755-456a392b5d74 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:02.120042 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f1337635-45be-42f3-9755-456a392b5d74 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:02.138229 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f1337635-45be-42f3-9755-456a392b5d74 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:02.138687 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f1337635-45be-42f3-9755-456a392b5d74 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:02.150694 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f1337635-45be-42f3-9755-456a392b5d74 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:02.150694 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f1337635-45be-42f3-9755-456a392b5d74 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:02.933140 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f1337635-45be-42f3-9755-456a392b5d74 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:02.948421 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f1337635-45be-42f3-9755-456a392b5d74 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1506 microversion: 2.1 time: 0.842893 Jun 20 12:12:02.948421 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1656/3376] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:02 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1506 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:12:02.980130 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-b90e8a7f-fe49-4477-a5f8-580e6455f07d tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] Lazy-loading 'services' on Instance uuid 3c658f2d-9442-4b10-b5f5-2d484553330e {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:12:03.037427 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b90e8a7f-fe49-4477-a5f8-580e6455f07d tempest-ServersAdmin275Test-1012567215 tempest-ServersAdmin275Test-1012567215-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1920 microversion: 2.75 time: 0.944896 Jun 20 12:12:03.048236 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1721/3377] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:12:02 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1920 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:12:03.256357 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ff0f63bc-2941-4f88-af01-bba6d60744f9 tempest-AbsoluteLimitsNegativeTestJSON-1900055362 tempest-AbsoluteLimitsNegativeTestJSON-1900055362-project] Calling method '.version_select at 0x7f60736553a0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:03.269463 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1f6b4f74-3a94-4297-9271-0ad1ba8bc8d4 tempest-NetworksTest-173922489 tempest-NetworksTest-173922489-project-admin] Calling method '.version_select at 0x7f6072c1b3a0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:03.273005 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff0f63bc-2941-4f88-af01-bba6d60744f9 tempest-AbsoluteLimitsNegativeTestJSON-1900055362 tempest-AbsoluteLimitsNegativeTestJSON-1900055362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:03.273444 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff0f63bc-2941-4f88-af01-bba6d60744f9 tempest-AbsoluteLimitsNegativeTestJSON-1900055362 tempest-AbsoluteLimitsNegativeTestJSON-1900055362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:03.274422 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff0f63bc-2941-4f88-af01-bba6d60744f9 tempest-AbsoluteLimitsNegativeTestJSON-1900055362 tempest-AbsoluteLimitsNegativeTestJSON-1900055362-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:03.275057 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff0f63bc-2941-4f88-af01-bba6d60744f9 tempest-AbsoluteLimitsNegativeTestJSON-1900055362 tempest-AbsoluteLimitsNegativeTestJSON-1900055362-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:03.297715 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ff0f63bc-2941-4f88-af01-bba6d60744f9 tempest-AbsoluteLimitsNegativeTestJSON-1900055362 tempest-AbsoluteLimitsNegativeTestJSON-1900055362-project] 10.222.0.27 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.255831 Jun 20 12:12:03.298731 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1722/3378] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jun 20 12:12:03 2022] GET /compute/v2.1/limits => generated 511 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:12:03.304094 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f05eedbb-f246-48d0-9340-d62a7fb88a13 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:03.304831 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f05eedbb-f246-48d0-9340-d62a7fb88a13 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:03.313014 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f05eedbb-f246-48d0-9340-d62a7fb88a13 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:03.320429 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f05eedbb-f246-48d0-9340-d62a7fb88a13 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:03.321277 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f05eedbb-f246-48d0-9340-d62a7fb88a13 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:03.321767 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f05eedbb-f246-48d0-9340-d62a7fb88a13 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:03.374663 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f05eedbb-f246-48d0-9340-d62a7fb88a13 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:12:03.498833 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f05eedbb-f246-48d0-9340-d62a7fb88a13 tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 204 len: 0 microversion: 2.75 time: 0.197452 Jun 20 12:12:03.501047 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1723/3379] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Jun 20 12:12:03 2022] DELETE /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 12:12:03.513955 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-db321e6f-021d-42b4-96c5-4cb691b220bf tempest-AbsoluteLimitsNegativeTestJSON-1900055362 tempest-AbsoluteLimitsNegativeTestJSON-1900055362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-830944534", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:12:03.585869 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-db321e6f-021d-42b4-96c5-4cb691b220bf tempest-AbsoluteLimitsNegativeTestJSON-1900055362 tempest-AbsoluteLimitsNegativeTestJSON-1900055362-project] validate_networks() for None {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:12:03.820612 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1f6b4f74-3a94-4297-9271-0ad1ba8bc8d4 tempest-NetworksTest-173922489 tempest-NetworksTest-173922489-project-admin] 10.222.0.27 "GET /compute/v2.1/os-networks" status: 200 len: 6711 microversion: 2.1 time: 0.868593 Jun 20 12:12:03.821535 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1657/3380] 10.222.0.27 () {58 vars in 1136 bytes} [Mon Jun 20 12:12:02 2022] GET /compute/v2.1/os-networks => generated 6711 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:12:03.828569 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-65d76163-5556-4efe-a377-4d4c168d81bb tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:03.829973 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-65d76163-5556-4efe-a377-4d4c168d81bb tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:03.847068 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65d76163-5556-4efe-a377-4d4c168d81bb tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:03.854381 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65d76163-5556-4efe-a377-4d4c168d81bb tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:03.855229 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65d76163-5556-4efe-a377-4d4c168d81bb tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:03.855676 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65d76163-5556-4efe-a377-4d4c168d81bb tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:04.170865 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-65d76163-5556-4efe-a377-4d4c168d81bb tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:04.195118 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-65d76163-5556-4efe-a377-4d4c168d81bb tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:04.204127 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-65d76163-5556-4efe-a377-4d4c168d81bb tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:04.224857 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-65d76163-5556-4efe-a377-4d4c168d81bb tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1444 microversion: 2.75 time: 0.401923 Jun 20 12:12:04.227401 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1658/3381] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:12:03 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1444 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:12:04.240654 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-de06c4b8-e436-4036-8639-8bbc527da880 tempest-NetworksTest-173922489 tempest-NetworksTest-173922489-project-admin] Calling method '.version_select at 0x7f6072c1b700>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:04.249227 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:UPDATE=4,nova_api:SELECT=96 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:04.263520 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-db321e6f-021d-42b4-96c5-4cb691b220bf tempest-AbsoluteLimitsNegativeTestJSON-1900055362 tempest-AbsoluteLimitsNegativeTestJSON-1900055362-project] Getting quotas for project d98f74a033814dc2b978cbb07b3f9031. Resources: dict_keys(['metadata_items']) {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:12:04.276972 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-db321e6f-021d-42b4-96c5-4cb691b220bf tempest-AbsoluteLimitsNegativeTestJSON-1900055362 tempest-AbsoluteLimitsNegativeTestJSON-1900055362-project] Getting quotas for user 6712da80c77a40f8a8d33c9bd966d18f and project d98f74a033814dc2b978cbb07b3f9031. Resources: dict_keys(['metadata_items']) {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:12:04.312511 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-db321e6f-021d-42b4-96c5-4cb691b220bf tempest-AbsoluteLimitsNegativeTestJSON-1900055362 tempest-AbsoluteLimitsNegativeTestJSON-1900055362-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Jun 20 12:12:04.315065 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-db321e6f-021d-42b4-96c5-4cb691b220bf tempest-AbsoluteLimitsNegativeTestJSON-1900055362 tempest-AbsoluteLimitsNegativeTestJSON-1900055362-project] Request method failure captured: Jun 20 12:12:04.315065 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 20 12:12:04.315065 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:12:04.315065 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:12:04.315065 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:12:04.315065 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 1751 Jun 20 12:12:04.315065 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:12:04.315065 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:12:04.315065 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:12:04.315065 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:12:04.315065 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGQSlBLilpZJtVl9RQ9XILU4U53OmkPrH5x5n3bRkqI6UuT5Bv7H9YuV-FA0hZif5p70x-d8T4zEo9aePnivWAC3VuEzjA_-ABvilfpwEb4ORB1gtg3D1numDjStm7pLg7qZuKpMvWW3sXBrIGmf9_5cYsyKAKw_x_Rj0DDptDGCqZE Jun 20 12:12:04.315065 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:12:04.315065 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:12:04.315065 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:12:04.315065 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:12:04.315065 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:12:04.315065 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:12:04.315065 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: d98f74a033814dc2b978cbb07b3f9031 Jun 20 12:12:04.315065 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1900055362 Jun 20 12:12:04.315065 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:12:04.315065 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:12:04.315065 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d98f74a033814dc2b978cbb07b3f9031"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d98f74a033814dc2b978cbb07b3f9031"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d98f74a033814dc2b978cbb07b3f9031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d98f74a033814dc2b978cbb07b3f9031"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:12:04.315065 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1900055362 Jun 20 12:12:04.315065 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: d98f74a033814dc2b978cbb07b3f9031 Jun 20 12:12:04.315065 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1900055362 Jun 20 12:12:04.315065 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1900055362-project Jun 20 12:12:04.315065 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:12:04.315065 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:12:04.315065 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 6712da80c77a40f8a8d33c9bd966d18f Jun 20 12:12:04.315065 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1900055362-project Jun 20 12:12:04.315065 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:12:04.315065 n-d-master-1 devstack@n-api.service[119127]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-830944534", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Jun 20 12:12:04.315065 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:12:04.315065 n-d-master-1 devstack@n-api.service[119127]: exception: Maximum number of metadata items exceeds 128 Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-830944534', 'imageRef': 'f16836cc-4e18-4bd0-b261-3865adf8cb83', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:12:04.317931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:12:04.322959 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:12:04.322959 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 20 12:12:04.322959 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jun 20 12:12:04.322959 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 20 12:12:04.322959 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Jun 20 12:12:04.322959 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:12:04.322959 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:12:04.322959 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:12:04.322959 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:04.322959 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:12:04.322959 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:12:04.322959 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:12:04.322959 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:12:04.322959 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Jun 20 12:12:04.322959 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:12:04.322959 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-db321e6f-021d-42b4-96c5-4cb691b220bf tempest-AbsoluteLimitsNegativeTestJSON-1900055362 tempest-AbsoluteLimitsNegativeTestJSON-1900055362-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:12:04.322959 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-db321e6f-021d-42b4-96c5-4cb691b220bf tempest-AbsoluteLimitsNegativeTestJSON-1900055362 tempest-AbsoluteLimitsNegativeTestJSON-1900055362-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.810290 Jun 20 12:12:04.322959 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1724/3382] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Jun 20 12:12:03 2022] POST /compute/v2.1/servers => generated 87 bytes in 815 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:12:04.713396 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-de06c4b8-e436-4036-8639-8bbc527da880 tempest-NetworksTest-173922489 tempest-NetworksTest-173922489-project-admin] 10.222.0.27 "GET /compute/v2.1/os-networks/3ed3a8e4-7c00-428f-937b-200c1d0b8ae0" status: 200 len: 652 microversion: 2.1 time: 0.484756 Jun 20 12:12:04.720497 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1659/3383] 10.222.0.27 () {58 vars in 1247 bytes} [Mon Jun 20 12:12:04 2022] GET /compute/v2.1/os-networks/3ed3a8e4-7c00-428f-937b-200c1d0b8ae0 => generated 652 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:12:04.723508 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a54fea81-47ff-4dc2-b4e8-7e2bc2e4af21 tempest-NetworksTest-173922489 tempest-NetworksTest-173922489-project-admin] Calling method '.version_select at 0x7f607370e550>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:05.247521 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-be51f169-66b3-4307-aea5-d5a88ba0e78a tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:05.248919 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-be51f169-66b3-4307-aea5-d5a88ba0e78a tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:05.262662 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-be51f169-66b3-4307-aea5-d5a88ba0e78a tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:05.263406 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-be51f169-66b3-4307-aea5-d5a88ba0e78a tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:05.264392 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-be51f169-66b3-4307-aea5-d5a88ba0e78a tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:05.264982 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-be51f169-66b3-4307-aea5-d5a88ba0e78a tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:05.467355 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a54fea81-47ff-4dc2-b4e8-7e2bc2e4af21 tempest-NetworksTest-173922489 tempest-NetworksTest-173922489-project-admin] 10.222.0.27 "GET /compute/v2.1/os-networks" status: 200 len: 6711 microversion: 2.1 time: 0.747346 Jun 20 12:12:05.468093 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1725/3384] 10.222.0.27 () {58 vars in 1136 bytes} [Mon Jun 20 12:12:04 2022] GET /compute/v2.1/os-networks => generated 6711 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:12:06.130015 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-be51f169-66b3-4307-aea5-d5a88ba0e78a tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:06.147481 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-be51f169-66b3-4307-aea5-d5a88ba0e78a tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:06.151135 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-be51f169-66b3-4307-aea5-d5a88ba0e78a tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeb7eb7131a44c66944ee2c53eaa3b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036852f6c8fd4004b937eb3e8fe0307c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:06.171308 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-be51f169-66b3-4307-aea5-d5a88ba0e78a tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 200 len: 1444 microversion: 2.75 time: 0.928472 Jun 20 12:12:06.181587 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1660/3385] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:12:05 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 1444 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:12:07.201101 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3b68463c-af44-4eed-8083-c33a2a35a92c tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:07.202895 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3b68463c-af44-4eed-8083-c33a2a35a92c tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] [instance: 3c658f2d-9442-4b10-b5f5-2d484553330e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:07.216287 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3b68463c-af44-4eed-8083-c33a2a35a92c tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:07.235680 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3b68463c-af44-4eed-8083-c33a2a35a92c tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:07.237349 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3b68463c-af44-4eed-8083-c33a2a35a92c tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:07.238004 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3b68463c-af44-4eed-8083-c33a2a35a92c tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:07.269961 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-3b68463c-af44-4eed-8083-c33a2a35a92c tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] HTTP exception thrown: Instance 3c658f2d-9442-4b10-b5f5-2d484553330e could not be found. Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3b68463c-af44-4eed-8083-c33a2a35a92c tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Request method failure captured: Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e HTTP/1.1 Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGOqLWeXjSVuY4bFtx-_HQrkV5Spm56_9COPBPoK7rPR7nGwmCNLg_xziFMT-8nqJ5IIQ1g2Vz8Ui-V9jkKdBMOpc2ZUGPlrcCRpNY2vI5YKuUV2DrzklSoF1rsY0V4WJ40BQyb18B52gYmEeW1GSjmV0zjnt3T3s6G3v_BB_omhPvk Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: X-Openstack-Nova-Api-Version: 2.75 Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 036852f6c8fd4004b937eb3e8fe0307c Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersAdmin275Test-586612291 Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/036852f6c8fd4004b937eb3e8fe0307c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/036852f6c8fd4004b937eb3e8fe0307c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/036852f6c8fd4004b937eb3e8fe0307c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_036852f6c8fd4004b937eb3e8fe0307c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersAdmin275Test-586612291 Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 036852f6c8fd4004b937eb3e8fe0307c Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersAdmin275Test-586612291 Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersAdmin275Test-586612291-project Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: eeb7eb7131a44c66944ee2c53eaa3b79 Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersAdmin275Test-586612291-project Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 3c658f2d-9442-4b10-b5f5-2d484553330e could not be found. Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '3c658f2d-9442-4b10-b5f5-2d484553330e'} Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c658f2d-9442-4b10-b5f5-2d484553330e could not be found. Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c658f2d-9442-4b10-b5f5-2d484553330e could not be found. Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:12:07.276820 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:12:07.282281 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:07.282281 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:12:07.282281 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:12:07.282281 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:12:07.282281 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:12:07.282281 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c658f2d-9442-4b10-b5f5-2d484553330e could not be found. Jun 20 12:12:07.282281 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:12:07.286803 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3b68463c-af44-4eed-8083-c33a2a35a92c tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] Returning 404 to user: Instance 3c658f2d-9442-4b10-b5f5-2d484553330e could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:12:07.288049 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3b68463c-af44-4eed-8083-c33a2a35a92c tempest-ServersAdmin275Test-586612291 tempest-ServersAdmin275Test-586612291-project] 10.222.0.27 "GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e" status: 404 len: 111 microversion: 2.75 time: 0.092719 Jun 20 12:12:07.291829 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1726/3386] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:12:07 2022] GET /compute/v2.1/servers/3c658f2d-9442-4b10-b5f5-2d484553330e => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:12:10.096809 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-830e3f3a-2f5f-4775-ab59-26f2f9eb8a74 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:10.097441 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-830e3f3a-2f5f-4775-ab59-26f2f9eb8a74 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:10.119837 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-830e3f3a-2f5f-4775-ab59-26f2f9eb8a74 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:10.124658 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-830e3f3a-2f5f-4775-ab59-26f2f9eb8a74 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:10.128794 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-830e3f3a-2f5f-4775-ab59-26f2f9eb8a74 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:10.130878 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-830e3f3a-2f5f-4775-ab59-26f2f9eb8a74 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:10.783817 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-830e3f3a-2f5f-4775-ab59-26f2f9eb8a74 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:10.803529 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-830e3f3a-2f5f-4775-ab59-26f2f9eb8a74 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:10.806223 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-830e3f3a-2f5f-4775-ab59-26f2f9eb8a74 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:10.807733 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-830e3f3a-2f5f-4775-ab59-26f2f9eb8a74 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 2946 microversion: 2.32 time: 0.718228 Jun 20 12:12:10.808564 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1661/3387] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:12:10 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 2946 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:12:10.833638 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b8e6e2b4-ec9a-4f74-9540-195587bb3558 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:10.834234 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b8e6e2b4-ec9a-4f74-9540-195587bb3558 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:10.851166 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b8e6e2b4-ec9a-4f74-9540-195587bb3558 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:10.851423 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b8e6e2b4-ec9a-4f74-9540-195587bb3558 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:10.865939 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b8e6e2b4-ec9a-4f74-9540-195587bb3558 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:10.867014 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b8e6e2b4-ec9a-4f74-9540-195587bb3558 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:11.186766 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b8e6e2b4-ec9a-4f74-9540-195587bb3558 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.358266 Jun 20 12:12:11.188843 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1727/3388] 10.222.0.27 () {60 vars in 1315 bytes} [Mon Jun 20 12:12:10 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155/os-interface => generated 1829 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:12:13.445072 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-99b48737-e371-4adb-bbb6-e962dcfcfdb5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:13.446003 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-99b48737-e371-4adb-bbb6-e962dcfcfdb5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:13.467876 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-99b48737-e371-4adb-bbb6-e962dcfcfdb5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:13.470220 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-99b48737-e371-4adb-bbb6-e962dcfcfdb5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:13.472399 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-99b48737-e371-4adb-bbb6-e962dcfcfdb5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:13.474536 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-99b48737-e371-4adb-bbb6-e962dcfcfdb5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:13.509939 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-99b48737-e371-4adb-bbb6-e962dcfcfdb5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] HTTP exception thrown: Instance 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 could not be found. Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-99b48737-e371-4adb-bbb6-e962dcfcfdb5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 HTTP/1.1 Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 could not be found. Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6'} Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 could not be found. Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:12:13.512442 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:12:13.517974 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 could not be found. Jun 20 12:12:13.517974 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:13.517974 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:12:13.517974 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:13.517974 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:13.517974 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:12:13.517974 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:12:13.517974 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:12:13.517974 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:12:13.517974 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 could not be found. Jun 20 12:12:13.517974 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:13.520125 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-99b48737-e371-4adb-bbb6-e962dcfcfdb5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 404 to user: Instance 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:12:13.521771 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-99b48737-e371-4adb-bbb6-e962dcfcfdb5 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6" status: 404 len: 111 microversion: 2.1 time: 0.080566 Jun 20 12:12:13.523032 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1662/3389] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:12:13 2022] DELETE /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:12:13.528937 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:13.535480 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-05b4cc84-0c54-4c03-b12b-ec9dae3aabb8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:13.536303 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-05b4cc84-0c54-4c03-b12b-ec9dae3aabb8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:13.549301 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-05b4cc84-0c54-4c03-b12b-ec9dae3aabb8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:13.550892 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-05b4cc84-0c54-4c03-b12b-ec9dae3aabb8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:13.555371 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-05b4cc84-0c54-4c03-b12b-ec9dae3aabb8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:13.556819 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-05b4cc84-0c54-4c03-b12b-ec9dae3aabb8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:13.594896 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-05b4cc84-0c54-4c03-b12b-ec9dae3aabb8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] HTTP exception thrown: Instance 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 could not be found. Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-05b4cc84-0c54-4c03-b12b-ec9dae3aabb8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 HTTP/1.1 Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 could not be found. Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6'} Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 could not be found. Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 could not be found. Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:12:13.601815 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:12:13.606865 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:13.606865 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:12:13.606865 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:12:13.606865 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:12:13.606865 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:12:13.606865 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 could not be found. Jun 20 12:12:13.606865 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:12:13.609468 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-05b4cc84-0c54-4c03-b12b-ec9dae3aabb8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 404 to user: Instance 0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:12:13.610988 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-05b4cc84-0c54-4c03-b12b-ec9dae3aabb8 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6" status: 404 len: 111 microversion: 2.1 time: 0.083996 Jun 20 12:12:13.613436 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1728/3390] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:13 2022] GET /compute/v2.1/servers/0eb1e81f-a6d4-4ec7-acc6-2310b2162ed6 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:12:13.621479 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-eac65b18-c267-4e38-94fb-11f3081e5cf1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:13.625721 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-eac65b18-c267-4e38-94fb-11f3081e5cf1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:13.638473 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eac65b18-c267-4e38-94fb-11f3081e5cf1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:13.638932 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eac65b18-c267-4e38-94fb-11f3081e5cf1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:13.639728 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eac65b18-c267-4e38-94fb-11f3081e5cf1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:13.640174 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eac65b18-c267-4e38-94fb-11f3081e5cf1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:13.737628 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-eac65b18-c267-4e38-94fb-11f3081e5cf1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:12:13.768848 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:13.910573 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-eac65b18-c267-4e38-94fb-11f3081e5cf1 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "DELETE /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 204 len: 0 microversion: 2.1 time: 0.292520 Jun 20 12:12:13.915139 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1729/3391] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:12:13 2022] DELETE /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:12:13.936553 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ff048bbe-7e3d-4d19-b7ab-b9616e48612f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:13.940122 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ff048bbe-7e3d-4d19-b7ab-b9616e48612f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:13.956778 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff048bbe-7e3d-4d19-b7ab-b9616e48612f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:13.957757 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff048bbe-7e3d-4d19-b7ab-b9616e48612f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:13.958874 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff048bbe-7e3d-4d19-b7ab-b9616e48612f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:13.959506 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff048bbe-7e3d-4d19-b7ab-b9616e48612f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:14.083630 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dee032c9-3404-4669-9df6-67d9f820a4c3 tempest-FlavorsV2TestJSON-1121535657 tempest-FlavorsV2TestJSON-1121535657-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:14.106312 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dee032c9-3404-4669-9df6-67d9f820a4c3 tempest-FlavorsV2TestJSON-1121535657 tempest-FlavorsV2TestJSON-1121535657-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.540740 Jun 20 12:12:14.114155 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1663/3392] 10.222.0.27 () {58 vars in 1136 bytes} [Mon Jun 20 12:12:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:12:14.211946 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0197ef80-c00a-4468-8353-5b2b4baa4ef0 tempest-VolumesGetTestJSON-1630896545 tempest-VolumesGetTestJSON-1630896545-project] Action: 'create', calling method: .version_select at 0x7f6072c31e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-290105824", "metadata": {"Type": "work"}}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:12:14.291703 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ff048bbe-7e3d-4d19-b7ab-b9616e48612f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:14.295585 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:14.305214 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ff048bbe-7e3d-4d19-b7ab-b9616e48612f tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1512 microversion: 2.1 time: 0.380596 Jun 20 12:12:14.306725 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1730/3393] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:13 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1512 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:12:14.317612 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-237c3f9a-7f49-40ae-9b12-31d11dafc137 tempest-FlavorsV2TestJSON-1121535657 tempest-FlavorsV2TestJSON-1121535657-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:14.371307 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-237c3f9a-7f49-40ae-9b12-31d11dafc137 tempest-FlavorsV2TestJSON-1121535657 tempest-FlavorsV2TestJSON-1121535657-project] 10.222.0.27 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.063183 Jun 20 12:12:14.374384 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1731/3394] 10.222.0.27 () {58 vars in 1124 bytes} [Mon Jun 20 12:12:14 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:12:14.388430 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a8a76397-b341-4eb2-8f07-392f55d424a9 tempest-FlavorsV2TestJSON-1121535657 tempest-FlavorsV2TestJSON-1121535657-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:14.400076 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a8a76397-b341-4eb2-8f07-392f55d424a9 tempest-FlavorsV2TestJSON-1121535657 tempest-FlavorsV2TestJSON-1121535657-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016407 Jun 20 12:12:14.401776 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1732/3395] 10.222.0.27 () {58 vars in 1136 bytes} [Mon Jun 20 12:12:14 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:12:14.424496 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ed665fb5-b1cc-4a94-8e65-6065465f7479 tempest-FlavorsV2TestJSON-1121535657 tempest-FlavorsV2TestJSON-1121535657-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:14.448112 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ed665fb5-b1cc-4a94-8e65-6065465f7479 tempest-FlavorsV2TestJSON-1121535657 tempest-FlavorsV2TestJSON-1121535657-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.035480 Jun 20 12:12:14.449616 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1733/3396] 10.222.0.27 () {58 vars in 1136 bytes} [Mon Jun 20 12:12:14 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:12:14.462792 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-78c6c034-7e49-4c49-a767-6d198d482134 tempest-FlavorsV2TestJSON-1121535657 tempest-FlavorsV2TestJSON-1121535657-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:14.558826 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-78c6c034-7e49-4c49-a767-6d198d482134 tempest-FlavorsV2TestJSON-1121535657 tempest-FlavorsV2TestJSON-1121535657-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.101862 Jun 20 12:12:14.564953 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1734/3397] 10.222.0.27 () {58 vars in 1164 bytes} [Mon Jun 20 12:12:14 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:12:14.576459 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bfd3cb92-8068-4d6a-b64d-793129d0ffc6 tempest-FlavorsV2TestJSON-1121535657 tempest-FlavorsV2TestJSON-1121535657-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:14.611392 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bfd3cb92-8068-4d6a-b64d-793129d0ffc6 tempest-FlavorsV2TestJSON-1121535657 tempest-FlavorsV2TestJSON-1121535657-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.038313 Jun 20 12:12:14.613000 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1735/3398] 10.222.0.27 () {58 vars in 1136 bytes} [Mon Jun 20 12:12:14 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:12:14.630717 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-02666b24-deb7-4156-8b74-b7f86ba5ce1a tempest-FlavorsV2TestJSON-1121535657 tempest-FlavorsV2TestJSON-1121535657-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:14.737211 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-02666b24-deb7-4156-8b74-b7f86ba5ce1a tempest-FlavorsV2TestJSON-1121535657 tempest-FlavorsV2TestJSON-1121535657-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.116726 Jun 20 12:12:14.740576 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1736/3399] 10.222.0.27 () {58 vars in 1168 bytes} [Mon Jun 20 12:12:14 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:12:14.758009 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fbdb2c6e-9344-4300-ba0b-921712027a53 tempest-FlavorsV2TestJSON-1121535657 tempest-FlavorsV2TestJSON-1121535657-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:14.783633 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fbdb2c6e-9344-4300-ba0b-921712027a53 tempest-FlavorsV2TestJSON-1121535657 tempest-FlavorsV2TestJSON-1121535657-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.029334 Jun 20 12:12:14.785029 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1737/3400] 10.222.0.27 () {58 vars in 1160 bytes} [Mon Jun 20 12:12:14 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:12:14.828192 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1bc5c49d-b90a-4afd-8039-833662a1fda0 tempest-FlavorsV2TestJSON-1121535657 tempest-FlavorsV2TestJSON-1121535657-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:14.864742 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1bc5c49d-b90a-4afd-8039-833662a1fda0 tempest-FlavorsV2TestJSON-1121535657 tempest-FlavorsV2TestJSON-1121535657-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.067582 Jun 20 12:12:14.874650 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1738/3401] 10.222.0.27 () {58 vars in 1136 bytes} [Mon Jun 20 12:12:14 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:12:14.901138 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-24e1edd2-a9eb-474b-90c3-c9d0dc43341a tempest-FlavorsV2TestJSON-1121535657 tempest-FlavorsV2TestJSON-1121535657-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:15.029723 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0197ef80-c00a-4468-8353-5b2b4baa4ef0 tempest-VolumesGetTestJSON-1630896545 tempest-VolumesGetTestJSON-1630896545-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.915538 Jun 20 12:12:15.030615 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1664/3402] 10.222.0.27 () {60 vars in 1155 bytes} [Mon Jun 20 12:12:14 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 917 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 20 12:12:15.045053 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c8aaceb2-fe8f-4846-a947-95638c7751f7 tempest-VolumesGetTestJSON-1630896545 tempest-VolumesGetTestJSON-1630896545-project] Calling method '.version_select at 0x7f60847d91f0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:15.075168 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-24e1edd2-a9eb-474b-90c3-c9d0dc43341a tempest-FlavorsV2TestJSON-1121535657 tempest-FlavorsV2TestJSON-1121535657-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.192065 Jun 20 12:12:15.078420 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1739/3403] 10.222.0.27 () {58 vars in 1166 bytes} [Mon Jun 20 12:12:14 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:12:15.093475 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2ba4ec54-4226-4dda-93ff-3028c5225a33 tempest-FlavorsV2TestJSON-1121535657 tempest-FlavorsV2TestJSON-1121535657-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:15.159312 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2ba4ec54-4226-4dda-93ff-3028c5225a33 tempest-FlavorsV2TestJSON-1121535657 tempest-FlavorsV2TestJSON-1121535657-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.058345 Jun 20 12:12:15.160185 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1740/3404] 10.222.0.27 () {58 vars in 1136 bytes} [Mon Jun 20 12:12:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:12:15.178693 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c434820c-fa66-4230-8955-7bf14c746ba4 tempest-FlavorsV2TestJSON-1121535657 tempest-FlavorsV2TestJSON-1121535657-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:15.215056 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c434820c-fa66-4230-8955-7bf14c746ba4 tempest-FlavorsV2TestJSON-1121535657 tempest-FlavorsV2TestJSON-1121535657-project] 10.222.0.27 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.045671 Jun 20 12:12:15.215450 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c8aaceb2-fe8f-4846-a947-95638c7751f7 tempest-VolumesGetTestJSON-1630896545 tempest-VolumesGetTestJSON-1630896545-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/2ed0a35e-7966-4a28-a9fe-e0fd30275a41" status: 200 len: 352 microversion: 2.1 time: 0.174872 Jun 20 12:12:15.216707 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1665/3405] 10.222.0.27 () {58 vars in 1244 bytes} [Mon Jun 20 12:12:15 2022] GET /compute/v2.1/os-volumes/2ed0a35e-7966-4a28-a9fe-e0fd30275a41 => generated 352 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:12:15.230816 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1741/3406] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Jun 20 12:12:15 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:12:15.241749 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f779a292-b1d8-4578-9f75-387a3fd64904 tempest-FlavorsV2TestJSON-1121535657 tempest-FlavorsV2TestJSON-1121535657-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:15.274116 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f779a292-b1d8-4578-9f75-387a3fd64904 tempest-FlavorsV2TestJSON-1121535657 tempest-FlavorsV2TestJSON-1121535657-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.043236 Jun 20 12:12:15.276936 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1666/3407] 10.222.0.27 () {58 vars in 1136 bytes} [Mon Jun 20 12:12:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:12:15.288014 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b4623380-310c-41d1-9d5e-e5154696719c tempest-FlavorsV2TestJSON-1121535657 tempest-FlavorsV2TestJSON-1121535657-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:15.320545 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b4623380-310c-41d1-9d5e-e5154696719c tempest-FlavorsV2TestJSON-1121535657 tempest-FlavorsV2TestJSON-1121535657-project] 10.222.0.27 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.036960 Jun 20 12:12:15.322012 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1742/3408] 10.222.0.27 () {58 vars in 1147 bytes} [Mon Jun 20 12:12:15 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:12:15.334610 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d4111ba8-2e03-41b0-9713-57298e4e591d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:15.336815 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d4111ba8-2e03-41b0-9713-57298e4e591d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:15.338791 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ed5dedda-25b3-4cca-976c-3b6ca4fbc73a tempest-FlavorsV2TestJSON-1121535657 tempest-FlavorsV2TestJSON-1121535657-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:15.353092 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ed5dedda-25b3-4cca-976c-3b6ca4fbc73a tempest-FlavorsV2TestJSON-1121535657 tempest-FlavorsV2TestJSON-1121535657-project] 10.222.0.27 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.020427 Jun 20 12:12:15.354154 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1743/3409] 10.222.0.27 () {58 vars in 1139 bytes} [Mon Jun 20 12:12:15 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:12:15.374821 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7462481a-7d0f-4658-9a56-7170523313b5 tempest-FlavorsV2TestJSON-1121535657 tempest-FlavorsV2TestJSON-1121535657-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:15.375404 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4111ba8-2e03-41b0-9713-57298e4e591d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:15.375859 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4111ba8-2e03-41b0-9713-57298e4e591d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:15.376670 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4111ba8-2e03-41b0-9713-57298e4e591d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:15.377107 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4111ba8-2e03-41b0-9713-57298e4e591d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:15.385571 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7462481a-7d0f-4658-9a56-7170523313b5 tempest-FlavorsV2TestJSON-1121535657 tempest-FlavorsV2TestJSON-1121535657-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016791 Jun 20 12:12:15.386663 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1744/3410] 10.222.0.27 () {58 vars in 1136 bytes} [Mon Jun 20 12:12:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:12:15.400797 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c4dd474c-2c46-4d6f-9d1e-6cf7401e8984 tempest-FlavorsV2TestJSON-1121535657 tempest-FlavorsV2TestJSON-1121535657-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:15.424885 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c4dd474c-2c46-4d6f-9d1e-6cf7401e8984 tempest-FlavorsV2TestJSON-1121535657 tempest-FlavorsV2TestJSON-1121535657-project] 10.222.0.27 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.028535 Jun 20 12:12:15.433645 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1745/3411] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 12:12:15 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:12:15.453273 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0d8a7489-c3d1-48c6-abeb-ecef1be43df0 tempest-FlavorsV2TestJSON-1121535657 tempest-FlavorsV2TestJSON-1121535657-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:15.481589 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0d8a7489-c3d1-48c6-abeb-ecef1be43df0 tempest-FlavorsV2TestJSON-1121535657 tempest-FlavorsV2TestJSON-1121535657-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045789 Jun 20 12:12:15.482444 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1746/3412] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 12:12:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:12:15.497564 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f1da8c41-44ec-43b7-8d62-5949b6d8e5dd tempest-FlavorsV2TestJSON-1121535657 tempest-FlavorsV2TestJSON-1121535657-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:15.510982 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f1da8c41-44ec-43b7-8d62-5949b6d8e5dd tempest-FlavorsV2TestJSON-1121535657 tempest-FlavorsV2TestJSON-1121535657-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017185 Jun 20 12:12:15.516310 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1747/3413] 10.222.0.27 () {58 vars in 1136 bytes} [Mon Jun 20 12:12:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:12:16.232117 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-98821feb-6d0b-491a-8ea9-17740b841f54 tempest-VolumesGetTestJSON-1630896545 tempest-VolumesGetTestJSON-1630896545-project] Calling method '.version_select at 0x7f607397e9d0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:16.286937 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d4111ba8-2e03-41b0-9713-57298e4e591d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:16.308421 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d4111ba8-2e03-41b0-9713-57298e4e591d tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1512 microversion: 2.1 time: 0.978585 Jun 20 12:12:16.309113 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1667/3414] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:15 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1512 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:12:16.409985 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-98821feb-6d0b-491a-8ea9-17740b841f54 tempest-VolumesGetTestJSON-1630896545 tempest-VolumesGetTestJSON-1630896545-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/2ed0a35e-7966-4a28-a9fe-e0fd30275a41" status: 200 len: 352 microversion: 2.1 time: 0.184158 Jun 20 12:12:16.411544 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1748/3415] 10.222.0.27 () {58 vars in 1244 bytes} [Mon Jun 20 12:12:16 2022] GET /compute/v2.1/os-volumes/2ed0a35e-7966-4a28-a9fe-e0fd30275a41 => generated 352 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:12:16.999834 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ee9dc3a1-7107-41a6-b127-18b11765ec8a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-855792220", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:12:17.113555 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-ee9dc3a1-7107-41a6-b127-18b11765ec8a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] validate_networks() for None {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:12:17.332269 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ea506102-6ae6-4505-a965-b3d176047d65 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:17.334918 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ea506102-6ae6-4505-a965-b3d176047d65 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:17.353017 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea506102-6ae6-4505-a965-b3d176047d65 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:17.355165 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea506102-6ae6-4505-a965-b3d176047d65 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:17.360046 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea506102-6ae6-4505-a965-b3d176047d65 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:17.361568 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea506102-6ae6-4505-a965-b3d176047d65 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:17.719852 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ea506102-6ae6-4505-a965-b3d176047d65 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:17.728569 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ea506102-6ae6-4505-a965-b3d176047d65 tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1512 microversion: 2.1 time: 0.404903 Jun 20 12:12:17.744599 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1749/3416] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:17 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1512 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:12:17.757999 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-19419f4a-0c75-41e1-897c-ea2a827d4473 tempest-VolumesGetTestJSON-1630896545 tempest-VolumesGetTestJSON-1630896545-project] Calling method '.version_select at 0x7f6073f2f670>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:17.885367 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-19419f4a-0c75-41e1-897c-ea2a827d4473 tempest-VolumesGetTestJSON-1630896545 tempest-VolumesGetTestJSON-1630896545-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/2ed0a35e-7966-4a28-a9fe-e0fd30275a41" status: 200 len: 353 microversion: 2.1 time: 0.136776 Jun 20 12:12:17.893726 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1750/3417] 10.222.0.27 () {58 vars in 1244 bytes} [Mon Jun 20 12:12:17 2022] GET /compute/v2.1/os-volumes/2ed0a35e-7966-4a28-a9fe-e0fd30275a41 => generated 353 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:12:17.902906 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e2923a96-e8cf-4c0d-ba67-26c2710375bf tempest-VolumesGetTestJSON-1630896545 tempest-VolumesGetTestJSON-1630896545-project] Calling method '.version_select at 0x7f607397e0d0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:18.049128 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e2923a96-e8cf-4c0d-ba67-26c2710375bf tempest-VolumesGetTestJSON-1630896545 tempest-VolumesGetTestJSON-1630896545-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/2ed0a35e-7966-4a28-a9fe-e0fd30275a41" status: 200 len: 353 microversion: 2.1 time: 0.153061 Jun 20 12:12:18.060669 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1751/3418] 10.222.0.27 () {58 vars in 1244 bytes} [Mon Jun 20 12:12:17 2022] GET /compute/v2.1/os-volumes/2ed0a35e-7966-4a28-a9fe-e0fd30275a41 => generated 353 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:12:18.067487 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a2f27d33-9ff3-42fc-96e1-ee06000c66a5 tempest-VolumesGetTestJSON-1630896545 tempest-VolumesGetTestJSON-1630896545-project] Calling method '.version_select at 0x7f607397e430>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:18.095092 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-ee9dc3a1-7107-41a6-b127-18b11765ec8a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:12:18.095618 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-ee9dc3a1-7107-41a6-b127-18b11765ec8a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:12:18.095976 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-ee9dc3a1-7107-41a6-b127-18b11765ec8a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:12:18.097109 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-ee9dc3a1-7107-41a6-b127-18b11765ec8a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:12:18.097109 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-ee9dc3a1-7107-41a6-b127-18b11765ec8a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:12:18.129626 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ee9dc3a1-7107-41a6-b127-18b11765ec8a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:18.130078 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ee9dc3a1-7107-41a6-b127-18b11765ec8a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:18.135583 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ee9dc3a1-7107-41a6-b127-18b11765ec8a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:18.143824 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ee9dc3a1-7107-41a6-b127-18b11765ec8a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:18.166578 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-ee9dc3a1-7107-41a6-b127-18b11765ec8a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Getting quotas for project df4cb5022443461395424ace464a41e6. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:12:18.196593 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-ee9dc3a1-7107-41a6-b127-18b11765ec8a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Getting quotas for user 8267303c2c734c10b081b154a1795b82 and project df4cb5022443461395424ace464a41e6. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:12:18.225602 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a2f27d33-9ff3-42fc-96e1-ee06000c66a5 tempest-VolumesGetTestJSON-1630896545 tempest-VolumesGetTestJSON-1630896545-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/2ed0a35e-7966-4a28-a9fe-e0fd30275a41" status: 202 len: 0 microversion: 2.1 time: 0.161484 Jun 20 12:12:18.230366 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1752/3419] 10.222.0.27 () {58 vars in 1247 bytes} [Mon Jun 20 12:12:18 2022] DELETE /compute/v2.1/os-volumes/2ed0a35e-7966-4a28-a9fe-e0fd30275a41 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:12:18.234362 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ee9dc3a1-7107-41a6-b127-18b11765ec8a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:12:18.241188 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ee9dc3a1-7107-41a6-b127-18b11765ec8a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:12:18.249244 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-df7de03c-a35c-4111-b601-bda69ab5c9bb tempest-VolumesGetTestJSON-1630896545 tempest-VolumesGetTestJSON-1630896545-project] Calling method '.version_select at 0x7f607397e310>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:18.360721 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ee9dc3a1-7107-41a6-b127-18b11765ec8a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.645722 Jun 20 12:12:18.362381 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1668/3420] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:12:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:12:18.422062 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-2af9ed26-61b5-469e-9b02-345732549e37 req-67516cf8-598f-47e2-8fde-088de0e50d58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "593cda12-6491-4a27-8fc7-42c05e0291c3", "name": "network-vif-deleted", "tag": "2a9eb762-96f9-45b2-8446-311d784377f5"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:12:18.499505 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-2af9ed26-61b5-469e-9b02-345732549e37 req-67516cf8-598f-47e2-8fde-088de0e50d58 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:18.502318 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-2af9ed26-61b5-469e-9b02-345732549e37 req-67516cf8-598f-47e2-8fde-088de0e50d58 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:18.563221 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-2af9ed26-61b5-469e-9b02-345732549e37 req-67516cf8-598f-47e2-8fde-088de0e50d58 service nova] Creating event network-vif-deleted:2a9eb762-96f9-45b2-8446-311d784377f5 for instance 593cda12-6491-4a27-8fc7-42c05e0291c3 on n-h1-master-1 Jun 20 12:12:18.566393 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-df7de03c-a35c-4111-b601-bda69ab5c9bb tempest-VolumesGetTestJSON-1630896545 tempest-VolumesGetTestJSON-1630896545-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/2ed0a35e-7966-4a28-a9fe-e0fd30275a41" status: 200 len: 352 microversion: 2.1 time: 0.334825 Jun 20 12:12:18.567831 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1753/3421] 10.222.0.27 () {58 vars in 1244 bytes} [Mon Jun 20 12:12:18 2022] GET /compute/v2.1/os-volumes/2ed0a35e-7966-4a28-a9fe-e0fd30275a41 => generated 352 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:12:18.588141 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-2af9ed26-61b5-469e-9b02-345732549e37 req-67516cf8-598f-47e2-8fde-088de0e50d58 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.224245 Jun 20 12:12:18.588788 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1669/3422] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:12:18.597823 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4b71cfb4-e307-4327-99d5-a876bd480f71 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1580269180", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:12:18.715435 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-4b71cfb4-e307-4327-99d5-a876bd480f71 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] validate_networks() for None {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:12:18.747174 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d36fdb43-ad1b-42e8-8e44-fff527b8227e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:18.747877 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d36fdb43-ad1b-42e8-8e44-fff527b8227e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:18.760078 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d36fdb43-ad1b-42e8-8e44-fff527b8227e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:18.760560 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d36fdb43-ad1b-42e8-8e44-fff527b8227e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:18.761347 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d36fdb43-ad1b-42e8-8e44-fff527b8227e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:18.762010 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d36fdb43-ad1b-42e8-8e44-fff527b8227e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:18.877045 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d36fdb43-ad1b-42e8-8e44-fff527b8227e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:18.877503 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d36fdb43-ad1b-42e8-8e44-fff527b8227e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:18.877966 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-d36fdb43-ad1b-42e8-8e44-fff527b8227e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lazy-loading 'fault' on Instance uuid 593cda12-6491-4a27-8fc7-42c05e0291c3 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:12:19.022677 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d36fdb43-ad1b-42e8-8e44-fff527b8227e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719eacccdc9f4daea56644de31876572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68f0f3fd0f8415eae2b397f27fe12f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:19.031360 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d36fdb43-ad1b-42e8-8e44-fff527b8227e tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 200 len: 1307 microversion: 2.1 time: 0.288766 Jun 20 12:12:19.038317 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1670/3423] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:18 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 1307 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:12:19.579112 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3b3050a0-a32c-4d3f-bcf1-167d0f5e2ae3 tempest-VolumesGetTestJSON-1630896545 tempest-VolumesGetTestJSON-1630896545-project] Calling method '.version_select at 0x7f6072c32ca0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:19.724401 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3b3050a0-a32c-4d3f-bcf1-167d0f5e2ae3 tempest-VolumesGetTestJSON-1630896545 tempest-VolumesGetTestJSON-1630896545-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/2ed0a35e-7966-4a28-a9fe-e0fd30275a41" status: 200 len: 352 microversion: 2.1 time: 0.149273 Jun 20 12:12:19.725448 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1671/3424] 10.222.0.27 () {58 vars in 1244 bytes} [Mon Jun 20 12:12:19 2022] GET /compute/v2.1/os-volumes/2ed0a35e-7966-4a28-a9fe-e0fd30275a41 => generated 352 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:12:20.051828 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-28ebdbcd-6e0b-4d88-a7a4-aa1c5303c4fa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:20.052981 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-28ebdbcd-6e0b-4d88-a7a4-aa1c5303c4fa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] [instance: 593cda12-6491-4a27-8fc7-42c05e0291c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:20.084322 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-28ebdbcd-6e0b-4d88-a7a4-aa1c5303c4fa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:20.085326 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-28ebdbcd-6e0b-4d88-a7a4-aa1c5303c4fa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:20.086356 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-28ebdbcd-6e0b-4d88-a7a4-aa1c5303c4fa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:20.086993 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-28ebdbcd-6e0b-4d88-a7a4-aa1c5303c4fa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:20.119990 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-28ebdbcd-6e0b-4d88-a7a4-aa1c5303c4fa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] HTTP exception thrown: Instance 593cda12-6491-4a27-8fc7-42c05e0291c3 could not be found. Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-28ebdbcd-6e0b-4d88-a7a4-aa1c5303c4fa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Request method failure captured: Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 HTTP/1.1 Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGL2CldvAjQtQwxQGJoLmi-VwbV6ZET23LNpDYTRGV1uciru1klB_dfYvNClNYJZb8hAA4FuPH36glTJ6tThLbGqL2Lh7w5BW2_drz6Hm0n59sUfPaKC2zHONJjQDdp_yuqkD7J6B7TH3ELhArvJgkolVqFEDSD3sACCIBTAdsukvdQ Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a68f0f3fd0f8415eae2b397f27fe12f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: a68f0f3fd0f8415eae2b397f27fe12f7 Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-841701450 Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 719eacccdc9f4daea56644de31876572 Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersNegativeTestJSON-841701450-project Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 593cda12-6491-4a27-8fc7-42c05e0291c3 could not be found. Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '593cda12-6491-4a27-8fc7-42c05e0291c3'} Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 593cda12-6491-4a27-8fc7-42c05e0291c3 could not be found. Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 593cda12-6491-4a27-8fc7-42c05e0291c3 could not be found. Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:12:20.128079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:20.133600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:20.133600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:12:20.133600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:12:20.133600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:12:20.133600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:12:20.133600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 593cda12-6491-4a27-8fc7-42c05e0291c3 could not be found. Jun 20 12:12:20.133600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:20.135740 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-28ebdbcd-6e0b-4d88-a7a4-aa1c5303c4fa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] Returning 404 to user: Instance 593cda12-6491-4a27-8fc7-42c05e0291c3 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:12:20.137200 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-28ebdbcd-6e0b-4d88-a7a4-aa1c5303c4fa tempest-ServersNegativeTestJSON-841701450 tempest-ServersNegativeTestJSON-841701450-project] 10.222.0.27 "GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3" status: 404 len: 111 microversion: 2.1 time: 0.092129 Jun 20 12:12:20.138113 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1672/3425] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:20 2022] GET /compute/v2.1/servers/593cda12-6491-4a27-8fc7-42c05e0291c3 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:12:20.737996 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-642a6522-ba1f-4119-ad49-ea0cfd5748e7 tempest-VolumesGetTestJSON-1630896545 tempest-VolumesGetTestJSON-1630896545-project] Calling method '.version_select at 0x7f6072c47f70>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:20.823524 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-4b71cfb4-e307-4327-99d5-a876bd480f71 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:12:20.824886 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-4b71cfb4-e307-4327-99d5-a876bd480f71 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:12:20.832065 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-4b71cfb4-e307-4327-99d5-a876bd480f71 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:12:20.832540 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-4b71cfb4-e307-4327-99d5-a876bd480f71 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:12:20.832980 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-4b71cfb4-e307-4327-99d5-a876bd480f71 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:12:20.850696 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-642a6522-ba1f-4119-ad49-ea0cfd5748e7 tempest-VolumesGetTestJSON-1630896545 tempest-VolumesGetTestJSON-1630896545-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/2ed0a35e-7966-4a28-a9fe-e0fd30275a41" status: 200 len: 352 microversion: 2.1 time: 0.117226 Jun 20 12:12:20.851895 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1673/3426] 10.222.0.27 () {58 vars in 1244 bytes} [Mon Jun 20 12:12:20 2022] GET /compute/v2.1/os-volumes/2ed0a35e-7966-4a28-a9fe-e0fd30275a41 => generated 352 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:12:20.882236 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4b71cfb4-e307-4327-99d5-a876bd480f71 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:20.885491 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4b71cfb4-e307-4327-99d5-a876bd480f71 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:20.892686 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4b71cfb4-e307-4327-99d5-a876bd480f71 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:20.894761 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4b71cfb4-e307-4327-99d5-a876bd480f71 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:20.948678 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-4b71cfb4-e307-4327-99d5-a876bd480f71 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Getting quotas for project df4cb5022443461395424ace464a41e6. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:12:20.957330 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-4b71cfb4-e307-4327-99d5-a876bd480f71 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Getting quotas for user 8267303c2c734c10b081b154a1795b82 and project df4cb5022443461395424ace464a41e6. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:12:20.996944 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4b71cfb4-e307-4327-99d5-a876bd480f71 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:12:21.008492 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4b71cfb4-e307-4327-99d5-a876bd480f71 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 58edde4b-1f8f-488b-a632-764122b7fa53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:12:21.097780 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4b71cfb4-e307-4327-99d5-a876bd480f71 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.528815 Jun 20 12:12:21.099012 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1754/3427] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:12:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:12:21.109185 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-adf7bca1-969a-4120-be78-4e0621a2bb5a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:21.109870 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-adf7bca1-969a-4120-be78-4e0621a2bb5a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 58edde4b-1f8f-488b-a632-764122b7fa53] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:21.354696 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-adf7bca1-969a-4120-be78-4e0621a2bb5a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:21.364190 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-adf7bca1-969a-4120-be78-4e0621a2bb5a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53" status: 200 len: 1214 microversion: 2.1 time: 0.259435 Jun 20 12:12:21.367709 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1674/3428] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:21 2022] GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53 => generated 1214 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:12:21.881956 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-60755b94-fd36-4dd2-b511-f16f388db828 tempest-VolumesGetTestJSON-1630896545 tempest-VolumesGetTestJSON-1630896545-project] Calling method '.version_select at 0x7f6073a1e430>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:22.052963 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-60755b94-fd36-4dd2-b511-f16f388db828 tempest-VolumesGetTestJSON-1630896545 tempest-VolumesGetTestJSON-1630896545-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/2ed0a35e-7966-4a28-a9fe-e0fd30275a41" status: 200 len: 352 microversion: 2.1 time: 0.193564 Jun 20 12:12:22.053557 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1755/3429] 10.222.0.27 () {58 vars in 1244 bytes} [Mon Jun 20 12:12:21 2022] GET /compute/v2.1/os-volumes/2ed0a35e-7966-4a28-a9fe-e0fd30275a41 => generated 352 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:12:22.386074 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2f76be3a-ef28-4943-9683-1889b4798556 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:22.386781 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2f76be3a-ef28-4943-9683-1889b4798556 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 58edde4b-1f8f-488b-a632-764122b7fa53] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:22.399489 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2f76be3a-ef28-4943-9683-1889b4798556 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:22.404497 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2f76be3a-ef28-4943-9683-1889b4798556 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:22.416758 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2f76be3a-ef28-4943-9683-1889b4798556 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:22.425870 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2f76be3a-ef28-4943-9683-1889b4798556 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:22.684505 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2f76be3a-ef28-4943-9683-1889b4798556 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:22.696278 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:22.703755 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2f76be3a-ef28-4943-9683-1889b4798556 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53" status: 200 len: 1210 microversion: 2.1 time: 0.323964 Jun 20 12:12:22.705104 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1675/3430] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:22 2022] GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53 => generated 1210 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:12:23.072235 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ee8db156-c846-4cf0-adc8-f850987b6398 tempest-VolumesGetTestJSON-1630896545 tempest-VolumesGetTestJSON-1630896545-project] Calling method '.version_select at 0x7f607350daf0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:23.238692 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ee8db156-c846-4cf0-adc8-f850987b6398 tempest-VolumesGetTestJSON-1630896545 tempest-VolumesGetTestJSON-1630896545-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/2ed0a35e-7966-4a28-a9fe-e0fd30275a41" status: 200 len: 352 microversion: 2.1 time: 0.176249 Jun 20 12:12:23.239432 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1756/3431] 10.222.0.27 () {58 vars in 1244 bytes} [Mon Jun 20 12:12:23 2022] GET /compute/v2.1/os-volumes/2ed0a35e-7966-4a28-a9fe-e0fd30275a41 => generated 352 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:12:23.684466 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8fc78165-3434-4a45-911f-7449bc9f8e3d tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] Action: 'create', calling method: .version_select at 0x7f6072c479d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1018338080", "description": "tempest-description-1941469389"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:12:23.724620 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-97e9113c-0f48-4018-8d38-1f97b9ca7ef5 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:23.725482 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-97e9113c-0f48-4018-8d38-1f97b9ca7ef5 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 58edde4b-1f8f-488b-a632-764122b7fa53] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:23.742649 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-97e9113c-0f48-4018-8d38-1f97b9ca7ef5 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:23.743093 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-97e9113c-0f48-4018-8d38-1f97b9ca7ef5 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:23.754142 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-97e9113c-0f48-4018-8d38-1f97b9ca7ef5 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:23.760193 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-97e9113c-0f48-4018-8d38-1f97b9ca7ef5 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:24.290780 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-97e9113c-0f48-4018-8d38-1f97b9ca7ef5 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:24.309154 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-97e9113c-0f48-4018-8d38-1f97b9ca7ef5 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53" status: 200 len: 1272 microversion: 2.1 time: 0.590596 Jun 20 12:12:24.312988 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1757/3432] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:23 2022] GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53 => generated 1272 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:12:24.322891 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-51e509e2-67c9-4599-96b3-b3f750bcf24b tempest-VolumesGetTestJSON-1630896545 tempest-VolumesGetTestJSON-1630896545-project] Calling method '.version_select at 0x7f607397e280>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:24.465843 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-51e509e2-67c9-4599-96b3-b3f750bcf24b tempest-VolumesGetTestJSON-1630896545 tempest-VolumesGetTestJSON-1630896545-project] HTTP exception thrown: Volume 2ed0a35e-7966-4a28-a9fe-e0fd30275a41 could not be found. Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-51e509e2-67c9-4599-96b3-b3f750bcf24b tempest-VolumesGetTestJSON-1630896545 tempest-VolumesGetTestJSON-1630896545-project] Request method failure captured: Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/os-volumes/2ed0a35e-7966-4a28-a9fe-e0fd30275a41 HTTP/1.1 Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGQdel8C3p8224l5iSGNpzBDLvqAHtKYeqXiV0pYOqRx2EixjOG8JIx04Krhb_B4j2iTTcD8mBBe3eCCCICpB8M1SmoC9AM63Da-er4HsaI3AVOis2UUlXGn6yYvkpMt4d4NoR9FvURCpsiw08BJX7qYHlQfF0RpYMwoV22Z-ZntfDE Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 1aefb9fb3f204710a9e58474d7cafa09 Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-VolumesGetTestJSON-1630896545 Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1aefb9fb3f204710a9e58474d7cafa09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1aefb9fb3f204710a9e58474d7cafa09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1aefb9fb3f204710a9e58474d7cafa09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1aefb9fb3f204710a9e58474d7cafa09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-VolumesGetTestJSON-1630896545 Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 1aefb9fb3f204710a9e58474d7cafa09 Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-VolumesGetTestJSON-1630896545 Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-VolumesGetTestJSON-1630896545-project Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 52cabf04af0f4dc8837d7113738bee7d Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-VolumesGetTestJSON-1630896545-project Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: exception: Volume 2ed0a35e-7966-4a28-a9fe-e0fd30275a41 could not be found. Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '2ed0a35e-7966-4a28-a9fe-e0fd30275a41'} Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2ed0a35e-7966-4a28-a9fe-e0fd30275a41 could not be found. (HTTP 404) (Request-ID: req-7cc546fa-25db-4dfe-9fcc-a3dd0608f7c0) Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 12:12:24.468555 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2ed0a35e-7966-4a28-a9fe-e0fd30275a41 could not be found. Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2ed0a35e-7966-4a28-a9fe-e0fd30275a41 could not be found. Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2ed0a35e-7966-4a28-a9fe-e0fd30275a41 could not be found. Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-51e509e2-67c9-4599-96b3-b3f750bcf24b tempest-VolumesGetTestJSON-1630896545 tempest-VolumesGetTestJSON-1630896545-project] Returning 404 to user: Volume 2ed0a35e-7966-4a28-a9fe-e0fd30275a41 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-51e509e2-67c9-4599-96b3-b3f750bcf24b tempest-VolumesGetTestJSON-1630896545 tempest-VolumesGetTestJSON-1630896545-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/2ed0a35e-7966-4a28-a9fe-e0fd30275a41" status: 404 len: 109 microversion: 2.1 time: 0.156878 Jun 20 12:12:24.473737 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1758/3433] 10.222.0.27 () {58 vars in 1244 bytes} [Mon Jun 20 12:12:24 2022] GET /compute/v2.1/os-volumes/2ed0a35e-7966-4a28-a9fe-e0fd30275a41 => generated 109 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:12:25.215741 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8fc78165-3434-4a45-911f-7449bc9f8e3d tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.808424 Jun 20 12:12:25.217610 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1676/3434] 10.222.0.27 () {60 vars in 1179 bytes} [Mon Jun 20 12:12:23 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1811 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:12:25.237044 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-402f8783-3d79-4198-be1e-773c67c69eff tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] Action: 'create', calling method: .version_select at 0x7f6080c80700>, body: {"security_group_rule": {"parent_group_id": "0c8e4823-3384-44e3-96f8-ecbbf8535c33", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:12:25.330732 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b0caec6d-5d32-488d-b3b5-09b3a853a635 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:25.332254 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b0caec6d-5d32-488d-b3b5-09b3a853a635 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 58edde4b-1f8f-488b-a632-764122b7fa53] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:25.339958 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b0caec6d-5d32-488d-b3b5-09b3a853a635 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:25.354055 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b0caec6d-5d32-488d-b3b5-09b3a853a635 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:25.355263 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b0caec6d-5d32-488d-b3b5-09b3a853a635 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:25.357293 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b0caec6d-5d32-488d-b3b5-09b3a853a635 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:25.544599 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b0caec6d-5d32-488d-b3b5-09b3a853a635 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:25.558260 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b0caec6d-5d32-488d-b3b5-09b3a853a635 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53" status: 200 len: 1272 microversion: 2.1 time: 0.229995 Jun 20 12:12:25.560224 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1677/3435] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:25 2022] GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53 => generated 1272 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:12:26.594560 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-575a1b33-508a-441d-9d02-62a1febe225b tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:26.595234 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-575a1b33-508a-441d-9d02-62a1febe225b tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 58edde4b-1f8f-488b-a632-764122b7fa53] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:26.626500 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-575a1b33-508a-441d-9d02-62a1febe225b tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:26.638476 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-575a1b33-508a-441d-9d02-62a1febe225b tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:26.639637 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-575a1b33-508a-441d-9d02-62a1febe225b tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:26.641295 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-575a1b33-508a-441d-9d02-62a1febe225b tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:26.916785 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-575a1b33-508a-441d-9d02-62a1febe225b tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:26.926502 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-575a1b33-508a-441d-9d02-62a1febe225b tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53" status: 200 len: 1272 microversion: 2.1 time: 0.349438 Jun 20 12:12:26.933178 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1678/3436] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:26 2022] GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53 => generated 1272 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:12:27.952744 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dfd209cd-b62c-49e7-b67c-c1f81abbd0f7 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:27.956300 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-dfd209cd-b62c-49e7-b67c-c1f81abbd0f7 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 58edde4b-1f8f-488b-a632-764122b7fa53] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:27.979340 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dfd209cd-b62c-49e7-b67c-c1f81abbd0f7 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:27.981220 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dfd209cd-b62c-49e7-b67c-c1f81abbd0f7 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:27.982414 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dfd209cd-b62c-49e7-b67c-c1f81abbd0f7 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:27.986609 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dfd209cd-b62c-49e7-b67c-c1f81abbd0f7 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:28.066838 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-402f8783-3d79-4198-be1e-773c67c69eff tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 2.841553 Jun 20 12:12:28.068293 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1759/3437] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Jun 20 12:12:25 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 2844 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:12:28.082776 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-eff5c4ea-e45f-43d5-bcc9-67a309bd065e tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] Action: 'create', calling method: .version_select at 0x7f6073ec74c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-687921672", "description": "tempest-description-360919606"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:12:28.154377 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:28.641891 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-dfd209cd-b62c-49e7-b67c-c1f81abbd0f7 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:28.655713 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dfd209cd-b62c-49e7-b67c-c1f81abbd0f7 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53" status: 200 len: 1272 microversion: 2.1 time: 0.710890 Jun 20 12:12:28.673412 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1679/3438] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:27 2022] GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53 => generated 1272 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:12:28.977354 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9470991a-9f69-47df-b555-a4680e35e7d2 tempest-VolumesNegativeTest-1176382171 tempest-VolumesNegativeTest-1176382171-project] Action: 'create', calling method: .version_select at 0x7f6072c34dc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1069817354", "metadata": {"Type": "work"}}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9470991a-9f69-47df-b555-a4680e35e7d2 tempest-VolumesNegativeTest-1176382171 tempest-VolumesNegativeTest-1176382171-project] Request method failure captured: Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 122 Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGQsSxBa-LD6sZPccDnU7QC39dzePCCpZmOVXawgc1wPsNrLMNtD8_hNvvYm_QaTSRy7_1LP3gqgpWgYeF3USDcens_XRVh8jY4LY3HZvurFkKWyTrsMIsFIYHCBHRiStCllmZhK1alecPvcVl_ODtU6WsY3ij52QEt_9xe4j43U9bk Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 970a22effd024b74b22c232ac80ea640 Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-VolumesNegativeTest-1176382171 Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/970a22effd024b74b22c232ac80ea640"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/970a22effd024b74b22c232ac80ea640"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/970a22effd024b74b22c232ac80ea640"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_970a22effd024b74b22c232ac80ea640"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-VolumesNegativeTest-1176382171 Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 970a22effd024b74b22c232ac80ea640 Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-VolumesNegativeTest-1176382171 Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-VolumesNegativeTest-1176382171-project Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 899619a2de7d4628a62d445ebe1aeb28 Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-VolumesNegativeTest-1176382171-project Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1069817354", "metadata": {"Type": "work"}}} Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1069817354', 'metadata': {'Type': 'work'}}}} Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise error Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi '#$%' Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 12:12:28.994764 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 12:12:29.002261 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 20 12:12:29.002261 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:29.002261 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:12:29.002261 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:29.002261 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:29.002261 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:12:29.002261 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:12:29.002261 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 12:12:29.002261 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 12:12:29.002261 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 20 12:12:29.002261 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:29.007083 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9470991a-9f69-47df-b555-a4680e35e7d2 tempest-VolumesNegativeTest-1176382171 tempest-VolumesNegativeTest-1176382171-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:12:29.008177 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9470991a-9f69-47df-b555-a4680e35e7d2 tempest-VolumesNegativeTest-1176382171 tempest-VolumesNegativeTest-1176382171-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.332236 Jun 20 12:12:29.016101 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1680/3439] 10.222.0.27 () {60 vars in 1155 bytes} [Mon Jun 20 12:12:28 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 342 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:12:29.053636 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3a357781-b85b-4d19-ab37-d1240ddc5f25 tempest-VolumesNegativeTest-1176382171 tempest-VolumesNegativeTest-1176382171-project] Action: 'create', calling method: .version_select at 0x7f6072c318b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1631545490", "metadata": {"Type": "work"}}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3a357781-b85b-4d19-ab37-d1240ddc5f25 tempest-VolumesNegativeTest-1176382171 tempest-VolumesNegativeTest-1176382171-project] Request method failure captured: Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 120 Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGQsSxBa-LD6sZPccDnU7QC39dzePCCpZmOVXawgc1wPsNrLMNtD8_hNvvYm_QaTSRy7_1LP3gqgpWgYeF3USDcens_XRVh8jY4LY3HZvurFkKWyTrsMIsFIYHCBHRiStCllmZhK1alecPvcVl_ODtU6WsY3ij52QEt_9xe4j43U9bk Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 970a22effd024b74b22c232ac80ea640 Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-VolumesNegativeTest-1176382171 Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/970a22effd024b74b22c232ac80ea640"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/970a22effd024b74b22c232ac80ea640"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/970a22effd024b74b22c232ac80ea640"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_970a22effd024b74b22c232ac80ea640"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-VolumesNegativeTest-1176382171 Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 970a22effd024b74b22c232ac80ea640 Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-VolumesNegativeTest-1176382171 Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-VolumesNegativeTest-1176382171-project Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 899619a2de7d4628a62d445ebe1aeb28 Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-VolumesNegativeTest-1176382171-project Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1631545490", "metadata": {"Type": "work"}}} Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1631545490', 'metadata': {'Type': 'work'}}}} Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise error Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi '0' Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 12:12:29.063054 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 12:12:29.068947 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 20 12:12:29.068947 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:29.068947 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:12:29.068947 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:29.068947 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:29.068947 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:12:29.068947 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:12:29.068947 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 12:12:29.068947 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 12:12:29.068947 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 20 12:12:29.068947 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:29.075727 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3a357781-b85b-4d19-ab37-d1240ddc5f25 tempest-VolumesNegativeTest-1176382171 tempest-VolumesNegativeTest-1176382171-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:12:29.080525 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3a357781-b85b-4d19-ab37-d1240ddc5f25 tempest-VolumesNegativeTest-1176382171 tempest-VolumesNegativeTest-1176382171-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.055207 Jun 20 12:12:29.084029 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1681/3440] 10.222.0.27 () {60 vars in 1155 bytes} [Mon Jun 20 12:12:29 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 62 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:12:29.110123 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c30aa75f-696b-4007-9453-78eca1f28add tempest-VolumesNegativeTest-1176382171 tempest-VolumesNegativeTest-1176382171-project] Action: 'create', calling method: .version_select at 0x7f6072c31550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-620892030", "metadata": {"Type": "work"}}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c30aa75f-696b-4007-9453-78eca1f28add tempest-VolumesNegativeTest-1176382171 tempest-VolumesNegativeTest-1176382171-project] Request method failure captured: Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 118 Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGQsSxBa-LD6sZPccDnU7QC39dzePCCpZmOVXawgc1wPsNrLMNtD8_hNvvYm_QaTSRy7_1LP3gqgpWgYeF3USDcens_XRVh8jY4LY3HZvurFkKWyTrsMIsFIYHCBHRiStCllmZhK1alecPvcVl_ODtU6WsY3ij52QEt_9xe4j43U9bk Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 970a22effd024b74b22c232ac80ea640 Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-VolumesNegativeTest-1176382171 Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/970a22effd024b74b22c232ac80ea640"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/970a22effd024b74b22c232ac80ea640"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/970a22effd024b74b22c232ac80ea640"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_970a22effd024b74b22c232ac80ea640"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-VolumesNegativeTest-1176382171 Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 970a22effd024b74b22c232ac80ea640 Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-VolumesNegativeTest-1176382171 Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-VolumesNegativeTest-1176382171-project Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 899619a2de7d4628a62d445ebe1aeb28 Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-VolumesNegativeTest-1176382171-project Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-620892030", "metadata": {"Type": "work"}}} Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-620892030', 'metadata': {'Type': 'work'}}}} Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise error Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi '' Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 12:12:29.115400 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 12:12:29.120342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 20 12:12:29.120342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:29.120342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:12:29.120342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:29.120342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:29.120342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:12:29.120342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:12:29.120342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 12:12:29.120342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 12:12:29.120342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 20 12:12:29.120342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:29.125804 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c30aa75f-696b-4007-9453-78eca1f28add tempest-VolumesNegativeTest-1176382171 tempest-VolumesNegativeTest-1176382171-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:12:29.127235 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c30aa75f-696b-4007-9453-78eca1f28add tempest-VolumesNegativeTest-1176382171 tempest-VolumesNegativeTest-1176382171-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.026467 Jun 20 12:12:29.132622 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1682/3441] 10.222.0.27 () {60 vars in 1155 bytes} [Mon Jun 20 12:12:29 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:12:29.138925 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3381a460-c387-40d1-9083-8283a02a81b7 tempest-VolumesNegativeTest-1176382171 tempest-VolumesNegativeTest-1176382171-project] Calling method '.version_select at 0x7f6072c7ea60>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:29.210301 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-3381a460-c387-40d1-9083-8283a02a81b7 tempest-VolumesNegativeTest-1176382171 tempest-VolumesNegativeTest-1176382171-project] HTTP exception thrown: Volume tempest-invalid-1764704529 could not be found. Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3381a460-c387-40d1-9083-8283a02a81b7 tempest-VolumesNegativeTest-1176382171 tempest-VolumesNegativeTest-1176382171-project] Request method failure captured: Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1764704529 HTTP/1.1 Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGQsSxBa-LD6sZPccDnU7QC39dzePCCpZmOVXawgc1wPsNrLMNtD8_hNvvYm_QaTSRy7_1LP3gqgpWgYeF3USDcens_XRVh8jY4LY3HZvurFkKWyTrsMIsFIYHCBHRiStCllmZhK1alecPvcVl_ODtU6WsY3ij52QEt_9xe4j43U9bk Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 970a22effd024b74b22c232ac80ea640 Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-VolumesNegativeTest-1176382171 Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/970a22effd024b74b22c232ac80ea640"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/970a22effd024b74b22c232ac80ea640"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/970a22effd024b74b22c232ac80ea640"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_970a22effd024b74b22c232ac80ea640"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-VolumesNegativeTest-1176382171 Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 970a22effd024b74b22c232ac80ea640 Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-VolumesNegativeTest-1176382171 Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-VolumesNegativeTest-1176382171-project Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 899619a2de7d4628a62d445ebe1aeb28 Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-VolumesNegativeTest-1176382171-project Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: exception: Volume tempest-invalid-1764704529 could not be found. Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'tempest-invalid-1764704529'} Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1764704529 could not be found. (HTTP 404) (Request-ID: req-1f48a368-1650-415f-ad7a-b419b650f3fe) Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 12:12:29.213785 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 12:12:29.219060 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 12:12:29.219060 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 12:12:29.219060 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 12:12:29.219060 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 12:12:29.219060 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 12:12:29.219060 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 12:12:29.219060 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 12:12:29.219060 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 12:12:29.219060 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 12:12:29.219060 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 12:12:29.219060 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 12:12:29.219060 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 12:12:29.219060 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1764704529 could not be found. Jun 20 12:12:29.219060 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:29.219060 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:12:29.219060 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:29.219060 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:29.219060 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:12:29.219060 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:12:29.219060 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:12:29.219060 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:12:29.219060 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:12:29.219060 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:12:29.219060 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:12:29.219060 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:12:29.219060 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 20 12:12:29.219060 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:12:29.219060 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1764704529 could not be found. Jun 20 12:12:29.219060 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:29.219060 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:12:29.219060 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:29.219060 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:29.219060 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:12:29.219060 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:12:29.219060 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:12:29.219060 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:12:29.219060 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1764704529 could not be found. Jun 20 12:12:29.219060 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:29.226776 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3381a460-c387-40d1-9083-8283a02a81b7 tempest-VolumesNegativeTest-1176382171 tempest-VolumesNegativeTest-1176382171-project] Returning 404 to user: Volume tempest-invalid-1764704529 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:12:29.228681 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3381a460-c387-40d1-9083-8283a02a81b7 tempest-VolumesNegativeTest-1176382171 tempest-VolumesNegativeTest-1176382171-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1764704529" status: 404 len: 99 microversion: 2.1 time: 0.094096 Jun 20 12:12:29.235833 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1683/3442] 10.222.0.27 () {58 vars in 1217 bytes} [Mon Jun 20 12:12:29 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1764704529 => generated 99 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:12:29.248411 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-84b76c54-a990-4c33-ad37-7ed414629dad tempest-VolumesNegativeTest-1176382171 tempest-VolumesNegativeTest-1176382171-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011078 Jun 20 12:12:29.255994 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1684/3443] 10.222.0.27 () {58 vars in 1139 bytes} [Mon Jun 20 12:12:29 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 20 12:12:29.268405 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d8d5b890-375a-43ee-84b6-d514089dd748 tempest-VolumesNegativeTest-1176382171 tempest-VolumesNegativeTest-1176382171-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009907 Jun 20 12:12:29.276401 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1685/3444] 10.222.0.27 () {58 vars in 1136 bytes} [Mon Jun 20 12:12:29 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 20 12:12:29.306810 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f5c8d7b7-78c9-4408-9464-88d6471be9b3 tempest-VolumesNegativeTest-1176382171 tempest-VolumesNegativeTest-1176382171-project] Calling method '.version_select at 0x7f607350c430>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:29.380105 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-f5c8d7b7-78c9-4408-9464-88d6471be9b3 tempest-VolumesNegativeTest-1176382171 tempest-VolumesNegativeTest-1176382171-project] HTTP exception thrown: Volume c37bad7a-b521-4df6-a32e-e24165d3698e could not be found. Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f5c8d7b7-78c9-4408-9464-88d6471be9b3 tempest-VolumesNegativeTest-1176382171 tempest-VolumesNegativeTest-1176382171-project] Request method failure captured: Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/os-volumes/c37bad7a-b521-4df6-a32e-e24165d3698e HTTP/1.1 Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGQsSxBa-LD6sZPccDnU7QC39dzePCCpZmOVXawgc1wPsNrLMNtD8_hNvvYm_QaTSRy7_1LP3gqgpWgYeF3USDcens_XRVh8jY4LY3HZvurFkKWyTrsMIsFIYHCBHRiStCllmZhK1alecPvcVl_ODtU6WsY3ij52QEt_9xe4j43U9bk Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 970a22effd024b74b22c232ac80ea640 Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-VolumesNegativeTest-1176382171 Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/970a22effd024b74b22c232ac80ea640"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/970a22effd024b74b22c232ac80ea640"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/970a22effd024b74b22c232ac80ea640"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_970a22effd024b74b22c232ac80ea640"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-VolumesNegativeTest-1176382171 Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 970a22effd024b74b22c232ac80ea640 Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-VolumesNegativeTest-1176382171 Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-VolumesNegativeTest-1176382171-project Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 899619a2de7d4628a62d445ebe1aeb28 Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-VolumesNegativeTest-1176382171-project Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: exception: Volume c37bad7a-b521-4df6-a32e-e24165d3698e could not be found. Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'c37bad7a-b521-4df6-a32e-e24165d3698e'} Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c37bad7a-b521-4df6-a32e-e24165d3698e could not be found. (HTTP 404) (Request-ID: req-e5fe1a8c-2e84-45e6-9a60-c23be34af40e) Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 12:12:29.382667 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c37bad7a-b521-4df6-a32e-e24165d3698e could not be found. Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c37bad7a-b521-4df6-a32e-e24165d3698e could not be found. Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c37bad7a-b521-4df6-a32e-e24165d3698e could not be found. Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f5c8d7b7-78c9-4408-9464-88d6471be9b3 tempest-VolumesNegativeTest-1176382171 tempest-VolumesNegativeTest-1176382171-project] Returning 404 to user: Volume c37bad7a-b521-4df6-a32e-e24165d3698e could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f5c8d7b7-78c9-4408-9464-88d6471be9b3 tempest-VolumesNegativeTest-1176382171 tempest-VolumesNegativeTest-1176382171-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/c37bad7a-b521-4df6-a32e-e24165d3698e" status: 404 len: 109 microversion: 2.1 time: 0.106316 Jun 20 12:12:29.386843 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1686/3445] 10.222.0.27 () {58 vars in 1247 bytes} [Mon Jun 20 12:12:29 2022] DELETE /compute/v2.1/os-volumes/c37bad7a-b521-4df6-a32e-e24165d3698e => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:12:29.396263 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-677fdc55-4a3d-4b34-9c21-d7e2a3a43893 tempest-VolumesNegativeTest-1176382171 tempest-VolumesNegativeTest-1176382171-project] Calling method '.version_select at 0x7f6072c34820>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:29.451750 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-677fdc55-4a3d-4b34-9c21-d7e2a3a43893 tempest-VolumesNegativeTest-1176382171 tempest-VolumesNegativeTest-1176382171-project] HTTP exception thrown: Volume e43186d7-49e9-45d7-82b0-fd8ba295cfe0 could not be found. Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-677fdc55-4a3d-4b34-9c21-d7e2a3a43893 tempest-VolumesNegativeTest-1176382171 tempest-VolumesNegativeTest-1176382171-project] Request method failure captured: Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/os-volumes/e43186d7-49e9-45d7-82b0-fd8ba295cfe0 HTTP/1.1 Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGQsSxBa-LD6sZPccDnU7QC39dzePCCpZmOVXawgc1wPsNrLMNtD8_hNvvYm_QaTSRy7_1LP3gqgpWgYeF3USDcens_XRVh8jY4LY3HZvurFkKWyTrsMIsFIYHCBHRiStCllmZhK1alecPvcVl_ODtU6WsY3ij52QEt_9xe4j43U9bk Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 970a22effd024b74b22c232ac80ea640 Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-VolumesNegativeTest-1176382171 Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/970a22effd024b74b22c232ac80ea640"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/970a22effd024b74b22c232ac80ea640"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/970a22effd024b74b22c232ac80ea640"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_970a22effd024b74b22c232ac80ea640"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-VolumesNegativeTest-1176382171 Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 970a22effd024b74b22c232ac80ea640 Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-VolumesNegativeTest-1176382171 Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-VolumesNegativeTest-1176382171-project Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 899619a2de7d4628a62d445ebe1aeb28 Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-VolumesNegativeTest-1176382171-project Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: exception: Volume e43186d7-49e9-45d7-82b0-fd8ba295cfe0 could not be found. Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'e43186d7-49e9-45d7-82b0-fd8ba295cfe0'} Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e43186d7-49e9-45d7-82b0-fd8ba295cfe0 could not be found. (HTTP 404) (Request-ID: req-b837004e-d17a-469e-a9e7-c6bbaf806174) Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 12:12:29.454476 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e43186d7-49e9-45d7-82b0-fd8ba295cfe0 could not be found. Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e43186d7-49e9-45d7-82b0-fd8ba295cfe0 could not be found. Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e43186d7-49e9-45d7-82b0-fd8ba295cfe0 could not be found. Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-677fdc55-4a3d-4b34-9c21-d7e2a3a43893 tempest-VolumesNegativeTest-1176382171 tempest-VolumesNegativeTest-1176382171-project] Returning 404 to user: Volume e43186d7-49e9-45d7-82b0-fd8ba295cfe0 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-677fdc55-4a3d-4b34-9c21-d7e2a3a43893 tempest-VolumesNegativeTest-1176382171 tempest-VolumesNegativeTest-1176382171-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/e43186d7-49e9-45d7-82b0-fd8ba295cfe0" status: 404 len: 109 microversion: 2.1 time: 0.065712 Jun 20 12:12:29.460310 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1687/3446] 10.222.0.27 () {58 vars in 1244 bytes} [Mon Jun 20 12:12:29 2022] GET /compute/v2.1/os-volumes/e43186d7-49e9-45d7-82b0-fd8ba295cfe0 => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:12:29.682439 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ca6901fd-2b2d-4178-a50b-52050e3ecbee tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:29.683071 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ca6901fd-2b2d-4178-a50b-52050e3ecbee tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 58edde4b-1f8f-488b-a632-764122b7fa53] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:29.691317 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:29.697059 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ca6901fd-2b2d-4178-a50b-52050e3ecbee tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:29.697565 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ca6901fd-2b2d-4178-a50b-52050e3ecbee tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:29.698419 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ca6901fd-2b2d-4178-a50b-52050e3ecbee tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:29.698825 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ca6901fd-2b2d-4178-a50b-52050e3ecbee tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:29.826052 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-eff5c4ea-e45f-43d5-bcc9-67a309bd065e tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.749103 Jun 20 12:12:29.834665 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1760/3447] 10.222.0.27 () {60 vars in 1179 bytes} [Mon Jun 20 12:12:28 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1758 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:12:29.840189 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a6d61865-c8bf-4ef9-8046-16acdc835db8 tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] Action: 'create', calling method: .version_select at 0x7f6073b6ba60>, body: {"security_group_rule": {"parent_group_id": "c52a0f90-4163-4470-98f1-123855b7a643", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:12:30.253698 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ca6901fd-2b2d-4178-a50b-52050e3ecbee tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:30.262105 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ca6901fd-2b2d-4178-a50b-52050e3ecbee tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53" status: 200 len: 1314 microversion: 2.1 time: 0.584298 Jun 20 12:12:30.266055 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1688/3448] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:29 2022] GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53 => generated 1314 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:12:30.922568 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:30.979883 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:31.283626 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-25a60be0-57ff-4aa6-bca5-04be28583e07 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:31.284907 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-25a60be0-57ff-4aa6-bca5-04be28583e07 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 58edde4b-1f8f-488b-a632-764122b7fa53] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:31.314910 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-25a60be0-57ff-4aa6-bca5-04be28583e07 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:31.323222 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-25a60be0-57ff-4aa6-bca5-04be28583e07 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:31.329268 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-25a60be0-57ff-4aa6-bca5-04be28583e07 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:31.329767 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-25a60be0-57ff-4aa6-bca5-04be28583e07 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:31.391314 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=8 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:31.794508 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a6d61865-c8bf-4ef9-8046-16acdc835db8 tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.956410 Jun 20 12:12:31.796180 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1761/3449] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Jun 20 12:12:29 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1961 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:12:31.809642 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bf7862de-1fae-41b3-812b-4363c9cc2bc8 tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] Action: 'create', calling method: .version_select at 0x7f608299e4c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1961258124", "description": "tempest-description-1565737542"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:12:32.038337 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-25a60be0-57ff-4aa6-bca5-04be28583e07 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:32.046300 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-25a60be0-57ff-4aa6-bca5-04be28583e07 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53" status: 200 len: 1314 microversion: 2.1 time: 0.768118 Jun 20 12:12:32.052389 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1689/3450] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:31 2022] GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53 => generated 1314 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:12:33.270232 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bf7862de-1fae-41b3-812b-4363c9cc2bc8 tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.466740 Jun 20 12:12:33.271909 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1762/3451] 10.222.0.27 () {60 vars in 1179 bytes} [Mon Jun 20 12:12:31 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:12:33.277248 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e1a1ab22-061e-494b-bb47-000aa4c596f5 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:33.278131 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e1a1ab22-061e-494b-bb47-000aa4c596f5 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 58edde4b-1f8f-488b-a632-764122b7fa53] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:33.292655 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1a1ab22-061e-494b-bb47-000aa4c596f5 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:33.294181 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1a1ab22-061e-494b-bb47-000aa4c596f5 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:33.296479 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1a1ab22-061e-494b-bb47-000aa4c596f5 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:33.297948 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1a1ab22-061e-494b-bb47-000aa4c596f5 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:33.386163 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-59bfdd7e-5e96-417b-bfcc-9ad2a6cfb140 req-11669f4a-211a-4a1b-9aa1-86ac2e55eaaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5b82c0b-6c6a-4d96-a8b2-437d242334f2", "tag": "37e16ff5-1455-4eef-bf70-355b74b7eff3"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:12:33.406668 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-59bfdd7e-5e96-417b-bfcc-9ad2a6cfb140 req-11669f4a-211a-4a1b-9aa1-86ac2e55eaaf service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:33.408245 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-59bfdd7e-5e96-417b-bfcc-9ad2a6cfb140 req-11669f4a-211a-4a1b-9aa1-86ac2e55eaaf service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:33.452717 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-59bfdd7e-5e96-417b-bfcc-9ad2a6cfb140 req-11669f4a-211a-4a1b-9aa1-86ac2e55eaaf service nova] Creating event network-changed:37e16ff5-1455-4eef-bf70-355b74b7eff3 for instance d5b82c0b-6c6a-4d96-a8b2-437d242334f2 on n-h2-master-1 Jun 20 12:12:33.461525 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-59bfdd7e-5e96-417b-bfcc-9ad2a6cfb140 req-11669f4a-211a-4a1b-9aa1-86ac2e55eaaf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.594202 Jun 20 12:12:33.462704 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1690/3452] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:12:33.469513 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-2a27338d-9219-4a8d-9de2-51057f767c93 req-9a1af1da-c0f5-433a-a451-1343bf41ddee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58edde4b-1f8f-488b-a632-764122b7fa53", "tag": "78e6a6b3-f589-42c2-8a9b-76372d32a75f"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:12:33.490684 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-2a27338d-9219-4a8d-9de2-51057f767c93 req-9a1af1da-c0f5-433a-a451-1343bf41ddee service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:33.491688 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-2a27338d-9219-4a8d-9de2-51057f767c93 req-9a1af1da-c0f5-433a-a451-1343bf41ddee service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:33.534770 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-2a27338d-9219-4a8d-9de2-51057f767c93 req-9a1af1da-c0f5-433a-a451-1343bf41ddee service nova] Creating event network-changed:78e6a6b3-f589-42c2-8a9b-76372d32a75f for instance 58edde4b-1f8f-488b-a632-764122b7fa53 on n-h1-master-1 Jun 20 12:12:33.542727 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-2a27338d-9219-4a8d-9de2-51057f767c93 req-9a1af1da-c0f5-433a-a451-1343bf41ddee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077995 Jun 20 12:12:33.545917 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1691/3453] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:12:33.561332 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-06c88efd-d652-4a66-8a25-1502f112f8a8 tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] Action: 'create', calling method: .version_select at 0x7f6072c31c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-528366269", "description": "tempest-description-310572014"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:12:34.862647 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e1a1ab22-061e-494b-bb47-000aa4c596f5 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:34.906814 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e1a1ab22-061e-494b-bb47-000aa4c596f5 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53" status: 200 len: 1314 microversion: 2.1 time: 1.632371 Jun 20 12:12:34.913710 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1763/3454] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:33 2022] GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53 => generated 1314 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:12:35.673986 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-06c88efd-d652-4a66-8a25-1502f112f8a8 tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 2.126029 Jun 20 12:12:35.675127 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1692/3455] 10.222.0.27 () {60 vars in 1179 bytes} [Mon Jun 20 12:12:33 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 2128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:12:35.689478 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-323d25a9-1925-4d3a-8a21-70f078158986 tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] Action: 'create', calling method: .version_select at 0x7f6073ec7790>, body: {"security_group_rule": {"parent_group_id": "8dedb4ee-9aa9-4d2c-89f3-3aff2da28527", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "28161d8e-6183-4c84-9bd4-21321f90310d"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:12:35.937558 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-64878485-b421-43b2-9801-bc113c2192f3 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:35.938309 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-64878485-b421-43b2-9801-bc113c2192f3 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 58edde4b-1f8f-488b-a632-764122b7fa53] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:35.954990 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64878485-b421-43b2-9801-bc113c2192f3 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:35.956543 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64878485-b421-43b2-9801-bc113c2192f3 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:35.958796 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64878485-b421-43b2-9801-bc113c2192f3 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:35.963066 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64878485-b421-43b2-9801-bc113c2192f3 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:36.418850 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-64878485-b421-43b2-9801-bc113c2192f3 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:36.449088 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-64878485-b421-43b2-9801-bc113c2192f3 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53" status: 200 len: 1314 microversion: 2.1 time: 0.514657 Jun 20 12:12:36.461881 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1693/3456] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:35 2022] GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53 => generated 1314 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:12:37.079619 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3ed8b9bc-dee8-40a9-9050-514618fb6e0d tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1206209051", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "7008f70c-01aa-4e56-8d21-476b213f1027"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:12:37.176881 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-3ed8b9bc-dee8-40a9-9050-514618fb6e0d tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] validate_networks() for [('7008f70c-01aa-4e56-8d21-476b213f1027', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:12:37.417022 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-323d25a9-1925-4d3a-8a21-70f078158986 tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.734236 Jun 20 12:12:37.418990 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1764/3457] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Jun 20 12:12:35 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:12:37.432647 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-452b6ef0-c7f0-4172-958a-7401947eec3b tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] Action: 'create', calling method: .version_select at 0x7f6073cb24c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-714326854", "description": "tempest-description-2071957018"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:12:38.227637 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-452b6ef0-c7f0-4172-958a-7401947eec3b tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.800130 Jun 20 12:12:38.228371 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1765/3458] 10.222.0.27 () {60 vars in 1179 bytes} [Mon Jun 20 12:12:37 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:12:38.233559 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-eb28240b-e479-4caf-a7dc-bcc36e520893 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:38.235631 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-eb28240b-e479-4caf-a7dc-bcc36e520893 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 58edde4b-1f8f-488b-a632-764122b7fa53] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:38.256956 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:38.268235 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb28240b-e479-4caf-a7dc-bcc36e520893 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:38.268877 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb28240b-e479-4caf-a7dc-bcc36e520893 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:38.269698 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb28240b-e479-4caf-a7dc-bcc36e520893 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:38.291094 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb28240b-e479-4caf-a7dc-bcc36e520893 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:39.140383 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-eb28240b-e479-4caf-a7dc-bcc36e520893 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:39.189062 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-eb28240b-e479-4caf-a7dc-bcc36e520893 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53" status: 200 len: 1314 microversion: 2.1 time: 0.959316 Jun 20 12:12:39.192379 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1766/3459] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:38 2022] GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53 => generated 1314 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:12:39.225628 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-25181208-4658-4169-97eb-cee34c462e6d tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] Action: 'create', calling method: .version_select at 0x7f6073b76040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1963974708", "description": "tempest-description-1195997362"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:12:39.637129 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-3ed8b9bc-dee8-40a9-9050-514618fb6e0d tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:12:39.637681 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-3ed8b9bc-dee8-40a9-9050-514618fb6e0d tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:12:39.637785 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-3ed8b9bc-dee8-40a9-9050-514618fb6e0d tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:12:39.638910 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-3ed8b9bc-dee8-40a9-9050-514618fb6e0d tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:12:39.639346 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-3ed8b9bc-dee8-40a9-9050-514618fb6e0d tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:12:39.665831 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3ed8b9bc-dee8-40a9-9050-514618fb6e0d tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:39.666274 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3ed8b9bc-dee8-40a9-9050-514618fb6e0d tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:39.667300 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3ed8b9bc-dee8-40a9-9050-514618fb6e0d tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:39.669217 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3ed8b9bc-dee8-40a9-9050-514618fb6e0d tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:39.744444 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-3ed8b9bc-dee8-40a9-9050-514618fb6e0d tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Getting quotas for project 604fcdefd2244bdbaa79919d2bb49ed9. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:12:39.764759 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-3ed8b9bc-dee8-40a9-9050-514618fb6e0d tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Getting quotas for user 18485f98265e4c4abfc8b6da093d3a0c and project 604fcdefd2244bdbaa79919d2bb49ed9. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:12:39.802797 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3ed8b9bc-dee8-40a9-9050-514618fb6e0d tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:12:39.810925 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3ed8b9bc-dee8-40a9-9050-514618fb6e0d tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] [instance: 1ff38290-9d23-40c5-94be-14608f6e1902] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:12:39.956900 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3ed8b9bc-dee8-40a9-9050-514618fb6e0d tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 3.493262 Jun 20 12:12:39.963730 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1694/3460] 10.222.0.27 () {62 vars in 1187 bytes} [Mon Jun 20 12:12:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 3501 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 20 12:12:39.978875 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e894d2f1-0531-42cf-a1b7-0a68507e1a57 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:39.981476 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e894d2f1-0531-42cf-a1b7-0a68507e1a57 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] [instance: 1ff38290-9d23-40c5-94be-14608f6e1902] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:40.128831 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-25181208-4658-4169-97eb-cee34c462e6d tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.919286 Jun 20 12:12:40.129659 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1767/3461] 10.222.0.27 () {60 vars in 1179 bytes} [Mon Jun 20 12:12:39 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:12:40.143170 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4f8297fe-89c3-417d-9bff-c3a78943224b tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] Action: 'create', calling method: .version_select at 0x7f608299ea60>, body: {"security_group_rule": {"parent_group_id": "17d6e759-87fe-45a7-9a98-a92b5895033c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "ec94ac01-63a9-4b09-8e6d-32475e21f482"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:12:40.156961 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e894d2f1-0531-42cf-a1b7-0a68507e1a57 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:40.173012 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e894d2f1-0531-42cf-a1b7-0a68507e1a57 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:40.174838 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e894d2f1-0531-42cf-a1b7-0a68507e1a57 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:40.176010 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e894d2f1-0531-42cf-a1b7-0a68507e1a57 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] 10.222.0.27 "GET /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902" status: 200 len: 1259 microversion: 2.21 time: 0.208527 Jun 20 12:12:40.187425 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1695/3462] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:12:39 2022] GET /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902 => generated 1259 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:12:40.209175 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d3b7dc52-2450-4c2a-8cc0-3607b298a8e3 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:40.209822 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d3b7dc52-2450-4c2a-8cc0-3607b298a8e3 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 58edde4b-1f8f-488b-a632-764122b7fa53] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:40.230538 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3b7dc52-2450-4c2a-8cc0-3607b298a8e3 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:40.231045 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3b7dc52-2450-4c2a-8cc0-3607b298a8e3 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:40.231913 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3b7dc52-2450-4c2a-8cc0-3607b298a8e3 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:40.236636 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3b7dc52-2450-4c2a-8cc0-3607b298a8e3 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:40.878813 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d3b7dc52-2450-4c2a-8cc0-3607b298a8e3 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:40.891644 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d3b7dc52-2450-4c2a-8cc0-3607b298a8e3 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53" status: 200 len: 1314 microversion: 2.1 time: 0.684008 Jun 20 12:12:40.892993 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1696/3463] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:40 2022] GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53 => generated 1314 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:12:41.198257 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-425f651e-03e8-46dc-bf5d-224089c724f1 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:41.199069 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-425f651e-03e8-46dc-bf5d-224089c724f1 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] [instance: 1ff38290-9d23-40c5-94be-14608f6e1902] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:41.206631 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-425f651e-03e8-46dc-bf5d-224089c724f1 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:41.207092 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-425f651e-03e8-46dc-bf5d-224089c724f1 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:41.207864 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-425f651e-03e8-46dc-bf5d-224089c724f1 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:41.208326 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-425f651e-03e8-46dc-bf5d-224089c724f1 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:41.386867 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-425f651e-03e8-46dc-bf5d-224089c724f1 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:41.398718 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-425f651e-03e8-46dc-bf5d-224089c724f1 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:41.418523 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-425f651e-03e8-46dc-bf5d-224089c724f1 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:41.419687 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-425f651e-03e8-46dc-bf5d-224089c724f1 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] 10.222.0.27 "GET /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902" status: 200 len: 1255 microversion: 2.21 time: 0.229711 Jun 20 12:12:41.420896 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1697/3464] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:12:41 2022] GET /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902 => generated 1255 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:12:41.832766 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4f8297fe-89c3-417d-9bff-c3a78943224b tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.694614 Jun 20 12:12:41.833824 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1768/3465] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Jun 20 12:12:40 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:12:41.849270 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1dc17d03-c287-43b2-971a-8cc9719dd425 tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] Calling method '.version_select at 0x7f6073f78ee0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:42.059959 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-545cf1fb-1ae0-495c-b2d2-5351de49d9c1 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-2091410975", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "e52cf695-08a7-4228-8afa-64520bdba860"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:12:42.322925 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-545cf1fb-1ae0-495c-b2d2-5351de49d9c1 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] validate_networks() for [('e52cf695-08a7-4228-8afa-64520bdba860', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:12:43.481622 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1dc17d03-c287-43b2-971a-8cc9719dd425 tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/ec94ac01-63a9-4b09-8e6d-32475e21f482" status: 202 len: 0 microversion: 2.1 time: 1.641043 Jun 20 12:12:43.483079 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1769/3466] 10.222.0.27 () {58 vars in 1271 bytes} [Mon Jun 20 12:12:41 2022] DELETE /compute/v2.1/os-security-groups/ec94ac01-63a9-4b09-8e6d-32475e21f482 => generated 0 bytes in 1644 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 12:12:43.496904 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-545cf1fb-1ae0-495c-b2d2-5351de49d9c1 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:12:43.497738 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-545cf1fb-1ae0-495c-b2d2-5351de49d9c1 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:12:43.498809 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-545cf1fb-1ae0-495c-b2d2-5351de49d9c1 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:12:43.499772 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-545cf1fb-1ae0-495c-b2d2-5351de49d9c1 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:12:43.500724 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-545cf1fb-1ae0-495c-b2d2-5351de49d9c1 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:12:43.505676 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1aaa3207-5bba-47f5-be6f-309ac8e7f1d7 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:43.506818 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1aaa3207-5bba-47f5-be6f-309ac8e7f1d7 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 58edde4b-1f8f-488b-a632-764122b7fa53] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:43.535185 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-545cf1fb-1ae0-495c-b2d2-5351de49d9c1 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:43.535873 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-545cf1fb-1ae0-495c-b2d2-5351de49d9c1 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:43.536893 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-545cf1fb-1ae0-495c-b2d2-5351de49d9c1 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:43.544982 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-545cf1fb-1ae0-495c-b2d2-5351de49d9c1 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:43.545388 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1aaa3207-5bba-47f5-be6f-309ac8e7f1d7 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:43.546573 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1aaa3207-5bba-47f5-be6f-309ac8e7f1d7 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:43.553601 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1aaa3207-5bba-47f5-be6f-309ac8e7f1d7 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:43.553898 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1aaa3207-5bba-47f5-be6f-309ac8e7f1d7 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:43.614008 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-545cf1fb-1ae0-495c-b2d2-5351de49d9c1 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Getting quotas for project 6b5ce0a299ef4e10be4dccca2ef8b957. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:12:43.636367 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-545cf1fb-1ae0-495c-b2d2-5351de49d9c1 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Getting quotas for user 0e4a7cec6b754f4095917bb4cb9ee283 and project 6b5ce0a299ef4e10be4dccca2ef8b957. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:12:43.674066 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-545cf1fb-1ae0-495c-b2d2-5351de49d9c1 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:12:43.676285 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-545cf1fb-1ae0-495c-b2d2-5351de49d9c1 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: fd56a5df-a994-416e-b1d4-a5a78df871b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:12:43.729599 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-545cf1fb-1ae0-495c-b2d2-5351de49d9c1 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.235449 Jun 20 12:12:43.730828 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1698/3467] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:12:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2238 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 12:12:43.736411 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ab07e815-7090-42d7-8d04-bed239b0e47c tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:43.737737 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ab07e815-7090-42d7-8d04-bed239b0e47c tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] [instance: 1ff38290-9d23-40c5-94be-14608f6e1902] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:43.744658 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ab07e815-7090-42d7-8d04-bed239b0e47c tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:43.745395 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ab07e815-7090-42d7-8d04-bed239b0e47c tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:43.746339 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ab07e815-7090-42d7-8d04-bed239b0e47c tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:43.746994 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ab07e815-7090-42d7-8d04-bed239b0e47c tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:43.839397 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1aaa3207-5bba-47f5-be6f-309ac8e7f1d7 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:43.868760 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1aaa3207-5bba-47f5-be6f-309ac8e7f1d7 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53" status: 200 len: 1314 microversion: 2.1 time: 0.383926 Jun 20 12:12:43.872603 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1770/3468] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:43 2022] GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53 => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:12:43.900341 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ebb5e6a1-648a-4b1f-85de-6b41591cddca tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] Calling method '.version_select at 0x7f6073b17700>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:43.986108 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ab07e815-7090-42d7-8d04-bed239b0e47c tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:43.998420 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ab07e815-7090-42d7-8d04-bed239b0e47c tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:44.007762 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ab07e815-7090-42d7-8d04-bed239b0e47c tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:44.014935 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ab07e815-7090-42d7-8d04-bed239b0e47c tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] 10.222.0.27 "GET /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902" status: 200 len: 1317 microversion: 2.21 time: 0.282572 Jun 20 12:12:44.019202 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1699/3469] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:12:43 2022] GET /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902 => generated 1317 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:12:44.038127 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e77bb7fa-d698-4f7a-8f54-c3b461e93073 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:44.039001 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e77bb7fa-d698-4f7a-8f54-c3b461e93073 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: fd56a5df-a994-416e-b1d4-a5a78df871b2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:44.190721 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ebb5e6a1-648a-4b1f-85de-6b41591cddca tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/17d6e759-87fe-45a7-9a98-a92b5895033c" status: 200 len: 247 microversion: 2.1 time: 0.316746 Jun 20 12:12:44.196245 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1771/3470] 10.222.0.27 () {58 vars in 1268 bytes} [Mon Jun 20 12:12:43 2022] GET /compute/v2.1/os-security-groups/17d6e759-87fe-45a7-9a98-a92b5895033c => generated 247 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:12:44.209835 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9d9c3560-5496-4cb5-a836-96f1964e2670 tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] Action: 'create', calling method: .version_select at 0x7f608299eca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-970570307", "description": "tempest-description-533502483"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:12:44.238752 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e77bb7fa-d698-4f7a-8f54-c3b461e93073 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4a7cec6b754f4095917bb4cb9ee283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5ce0a299ef4e10be4dccca2ef8b957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:44.256708 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e77bb7fa-d698-4f7a-8f54-c3b461e93073 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "GET /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2" status: 200 len: 1224 microversion: 2.1 time: 0.232705 Jun 20 12:12:44.269092 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1700/3471] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:44 2022] GET /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2 => generated 1224 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:12:44.889881 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5abbbdb1-0e58-4078-9a3b-c603dd91d5be tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:44.891568 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5abbbdb1-0e58-4078-9a3b-c603dd91d5be tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 58edde4b-1f8f-488b-a632-764122b7fa53] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:44.910888 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5abbbdb1-0e58-4078-9a3b-c603dd91d5be tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:44.920121 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5abbbdb1-0e58-4078-9a3b-c603dd91d5be tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:44.921581 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5abbbdb1-0e58-4078-9a3b-c603dd91d5be tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:44.922636 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5abbbdb1-0e58-4078-9a3b-c603dd91d5be tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:45.227967 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9d9c3560-5496-4cb5-a836-96f1964e2670 tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.025412 Jun 20 12:12:45.229116 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1772/3472] 10.222.0.27 () {60 vars in 1179 bytes} [Mon Jun 20 12:12:44 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:12:45.234241 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8bceb4ab-75b0-4a6d-aac9-7ed4f12291fb tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:45.234799 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8bceb4ab-75b0-4a6d-aac9-7ed4f12291fb tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] [instance: 1ff38290-9d23-40c5-94be-14608f6e1902] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:45.250713 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5abbbdb1-0e58-4078-9a3b-c603dd91d5be tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:45.266593 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5abbbdb1-0e58-4078-9a3b-c603dd91d5be tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53" status: 200 len: 1314 microversion: 2.1 time: 0.377208 Jun 20 12:12:45.267317 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1701/3473] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:44 2022] GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53 => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:12:45.273774 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bceb4ab-75b0-4a6d-aac9-7ed4f12291fb tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:45.274837 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bceb4ab-75b0-4a6d-aac9-7ed4f12291fb tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:45.275790 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bceb4ab-75b0-4a6d-aac9-7ed4f12291fb tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:45.279800 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-86ba4a26-5530-4fdf-a22b-240e2342e401 tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] Action: 'create', calling method: .version_select at 0x7f6072c339d0>, body: {"security_group_rule": {"parent_group_id": "491929b5-07b9-4e55-b42c-c1a57698c17f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:12:45.292643 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bceb4ab-75b0-4a6d-aac9-7ed4f12291fb tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:45.365350 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:45.974317 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-86ba4a26-5530-4fdf-a22b-240e2342e401 tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.703571 Jun 20 12:12:45.976249 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1702/3474] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Jun 20 12:12:45 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:12:45.981375 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ac6a8f9e-c543-457f-be40-a1fd53bdb682 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:45.984450 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ac6a8f9e-c543-457f-be40-a1fd53bdb682 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: fd56a5df-a994-416e-b1d4-a5a78df871b2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:46.020492 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ac6a8f9e-c543-457f-be40-a1fd53bdb682 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:46.025001 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ac6a8f9e-c543-457f-be40-a1fd53bdb682 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:46.027195 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ac6a8f9e-c543-457f-be40-a1fd53bdb682 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:46.030910 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ac6a8f9e-c543-457f-be40-a1fd53bdb682 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:46.243808 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ac6a8f9e-c543-457f-be40-a1fd53bdb682 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4a7cec6b754f4095917bb4cb9ee283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5ce0a299ef4e10be4dccca2ef8b957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:46.271010 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ac6a8f9e-c543-457f-be40-a1fd53bdb682 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "GET /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2" status: 200 len: 1294 microversion: 2.1 time: 0.293334 Jun 20 12:12:46.276941 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1703/3475] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:45 2022] GET /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2 => generated 1294 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:12:46.295336 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-dda490ab-6e45-4843-9457-1736c5da8809 req-589ac9a8-b46e-4ad2-8b22-e04f36f23237 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5b82c0b-6c6a-4d96-a8b2-437d242334f2", "name": "network-vif-plugged", "status": "completed", "tag": "37e16ff5-1455-4eef-bf70-355b74b7eff3"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:12:46.335511 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-dda490ab-6e45-4843-9457-1736c5da8809 req-589ac9a8-b46e-4ad2-8b22-e04f36f23237 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:46.336556 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-dda490ab-6e45-4843-9457-1736c5da8809 req-589ac9a8-b46e-4ad2-8b22-e04f36f23237 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:46.353101 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8bceb4ab-75b0-4a6d-aac9-7ed4f12291fb tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:46.379682 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8bceb4ab-75b0-4a6d-aac9-7ed4f12291fb tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:46.391736 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8bceb4ab-75b0-4a6d-aac9-7ed4f12291fb tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:46.394743 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8bceb4ab-75b0-4a6d-aac9-7ed4f12291fb tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] 10.222.0.27 "GET /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902" status: 200 len: 1359 microversion: 2.21 time: 1.164600 Jun 20 12:12:46.395198 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-dda490ab-6e45-4843-9457-1736c5da8809 req-589ac9a8-b46e-4ad2-8b22-e04f36f23237 service nova] Creating event network-vif-plugged:37e16ff5-1455-4eef-bf70-355b74b7eff3 for instance d5b82c0b-6c6a-4d96-a8b2-437d242334f2 on n-h2-master-1 Jun 20 12:12:46.401989 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1773/3476] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:12:45 2022] GET /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902 => generated 1359 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:12:46.411910 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-dda490ab-6e45-4843-9457-1736c5da8809 req-589ac9a8-b46e-4ad2-8b22-e04f36f23237 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133217 Jun 20 12:12:46.416589 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1704/3477] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:12:46.421438 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f7ddd308-f71f-4f3d-bc43-c15b223d69d5 tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] Action: 'create', calling method: .version_select at 0x7f6073b17040>, body: {"security_group_rule": {"parent_group_id": "491929b5-07b9-4e55-b42c-c1a57698c17f", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:12:46.447578 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2c5175ff-d0ff-4697-80d5-79ca675cda91 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:46.451709 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2c5175ff-d0ff-4697-80d5-79ca675cda91 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 58edde4b-1f8f-488b-a632-764122b7fa53] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:46.472897 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2c5175ff-d0ff-4697-80d5-79ca675cda91 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:46.478348 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2c5175ff-d0ff-4697-80d5-79ca675cda91 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:46.479587 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2c5175ff-d0ff-4697-80d5-79ca675cda91 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:46.480358 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2c5175ff-d0ff-4697-80d5-79ca675cda91 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:46.829242 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2c5175ff-d0ff-4697-80d5-79ca675cda91 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:46.841106 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2c5175ff-d0ff-4697-80d5-79ca675cda91 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53" status: 200 len: 1314 microversion: 2.1 time: 0.423073 Jun 20 12:12:46.847664 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1705/3478] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:46 2022] GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53 => generated 1314 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:12:47.303216 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a0c2a580-8707-409a-8ecf-0c1c20298574 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:47.304242 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a0c2a580-8707-409a-8ecf-0c1c20298574 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: fd56a5df-a994-416e-b1d4-a5a78df871b2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:47.312473 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a0c2a580-8707-409a-8ecf-0c1c20298574 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:47.313070 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a0c2a580-8707-409a-8ecf-0c1c20298574 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:47.313855 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a0c2a580-8707-409a-8ecf-0c1c20298574 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:47.314287 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a0c2a580-8707-409a-8ecf-0c1c20298574 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:47.440858 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a0c2a580-8707-409a-8ecf-0c1c20298574 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4a7cec6b754f4095917bb4cb9ee283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5ce0a299ef4e10be4dccca2ef8b957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:47.457339 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a0c2a580-8707-409a-8ecf-0c1c20298574 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "GET /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2" status: 200 len: 1282 microversion: 2.1 time: 0.160014 Jun 20 12:12:47.458429 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1706/3479] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:47 2022] GET /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2 => generated 1282 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:12:47.475171 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8e5ad2af-a362-4240-97f4-b7c893981276 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:47.475839 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8e5ad2af-a362-4240-97f4-b7c893981276 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] [instance: 1ff38290-9d23-40c5-94be-14608f6e1902] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:47.494416 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e5ad2af-a362-4240-97f4-b7c893981276 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:47.494868 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e5ad2af-a362-4240-97f4-b7c893981276 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:47.495795 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e5ad2af-a362-4240-97f4-b7c893981276 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:47.496262 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e5ad2af-a362-4240-97f4-b7c893981276 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:47.809730 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8e5ad2af-a362-4240-97f4-b7c893981276 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:47.837709 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8e5ad2af-a362-4240-97f4-b7c893981276 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:47.843730 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8e5ad2af-a362-4240-97f4-b7c893981276 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:47.845337 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8e5ad2af-a362-4240-97f4-b7c893981276 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] 10.222.0.27 "GET /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902" status: 200 len: 1359 microversion: 2.21 time: 0.385644 Jun 20 12:12:47.847195 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1707/3480] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:12:47 2022] GET /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902 => generated 1359 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:12:47.876163 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6e722456-69f2-4153-8538-daf861fa4ea7 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:47.877273 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6e722456-69f2-4153-8538-daf861fa4ea7 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 58edde4b-1f8f-488b-a632-764122b7fa53] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:47.898392 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6e722456-69f2-4153-8538-daf861fa4ea7 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:47.899310 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6e722456-69f2-4153-8538-daf861fa4ea7 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:47.901956 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6e722456-69f2-4153-8538-daf861fa4ea7 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:47.902450 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6e722456-69f2-4153-8538-daf861fa4ea7 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:48.251744 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f7ddd308-f71f-4f3d-bc43-c15b223d69d5 tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.848389 Jun 20 12:12:48.252914 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1774/3481] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Jun 20 12:12:46 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1850 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:12:48.264457 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-96aa19e4-dad6-474e-b84c-eed1f22fcfcd tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] Calling method '.version_select at 0x7f6073edcd30>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:48.330682 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6e722456-69f2-4153-8538-daf861fa4ea7 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:48.342237 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:48.344688 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6e722456-69f2-4153-8538-daf861fa4ea7 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53" status: 200 len: 1314 microversion: 2.1 time: 0.477744 Jun 20 12:12:48.345285 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1708/3482] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:47 2022] GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53 => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:12:48.366462 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-4eec360c-b507-46a7-a5ef-7b6e6acf6ab8 req-e096894f-0eaf-47e4-824a-5518fbc70ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ff38290-9d23-40c5-94be-14608f6e1902", "tag": "40439874-ea15-43be-bbd1-5011939b3c4e"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:12:48.392012 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-4eec360c-b507-46a7-a5ef-7b6e6acf6ab8 req-e096894f-0eaf-47e4-824a-5518fbc70ed8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:48.392832 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-4eec360c-b507-46a7-a5ef-7b6e6acf6ab8 req-e096894f-0eaf-47e4-824a-5518fbc70ed8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:48.414896 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-4eec360c-b507-46a7-a5ef-7b6e6acf6ab8 req-e096894f-0eaf-47e4-824a-5518fbc70ed8 service nova] Creating event network-changed:40439874-ea15-43be-bbd1-5011939b3c4e for instance 1ff38290-9d23-40c5-94be-14608f6e1902 on n-h2-master-1 Jun 20 12:12:48.422392 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-4eec360c-b507-46a7-a5ef-7b6e6acf6ab8 req-e096894f-0eaf-47e4-824a-5518fbc70ed8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071139 Jun 20 12:12:48.423520 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1709/3483] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:12:48.451067 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-9a9d51b5-0ad7-4759-9f1b-50a0da8325ff req-a934d34a-2c8d-4fef-9876-2e198b373a44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58edde4b-1f8f-488b-a632-764122b7fa53", "name": "network-vif-plugged", "status": "completed", "tag": "78e6a6b3-f589-42c2-8a9b-76372d32a75f"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:12:48.486185 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9a9d51b5-0ad7-4759-9f1b-50a0da8325ff req-a934d34a-2c8d-4fef-9876-2e198b373a44 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:48.490111 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9a9d51b5-0ad7-4759-9f1b-50a0da8325ff req-a934d34a-2c8d-4fef-9876-2e198b373a44 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:48.507094 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-9a9d51b5-0ad7-4759-9f1b-50a0da8325ff req-a934d34a-2c8d-4fef-9876-2e198b373a44 service nova] Creating event network-vif-plugged:78e6a6b3-f589-42c2-8a9b-76372d32a75f for instance 58edde4b-1f8f-488b-a632-764122b7fa53 on n-h1-master-1 Jun 20 12:12:48.517120 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-9a9d51b5-0ad7-4759-9f1b-50a0da8325ff req-a934d34a-2c8d-4fef-9876-2e198b373a44 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073520 Jun 20 12:12:48.517921 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1710/3484] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:12:48.532688 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-20a41a10-c0bb-4bb2-add3-2c86475ae8b8 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:48.534043 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-20a41a10-c0bb-4bb2-add3-2c86475ae8b8 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: fd56a5df-a994-416e-b1d4-a5a78df871b2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:48.550833 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-20a41a10-c0bb-4bb2-add3-2c86475ae8b8 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:48.553623 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-20a41a10-c0bb-4bb2-add3-2c86475ae8b8 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:48.558761 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-20a41a10-c0bb-4bb2-add3-2c86475ae8b8 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:48.559595 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-20a41a10-c0bb-4bb2-add3-2c86475ae8b8 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:48.577435 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-96aa19e4-dad6-474e-b84c-eed1f22fcfcd tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/491929b5-07b9-4e55-b42c-c1a57698c17f" status: 200 len: 663 microversion: 2.1 time: 0.317585 Jun 20 12:12:48.578099 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1775/3485] 10.222.0.27 () {58 vars in 1268 bytes} [Mon Jun 20 12:12:48 2022] GET /compute/v2.1/os-security-groups/491929b5-07b9-4e55-b42c-c1a57698c17f => generated 663 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:12:48.590604 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1ca5d581-ad24-436f-99ce-4000d139d2c5 tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] Calling method '.version_select at 0x7f60736a60d0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:49.421981 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1ca5d581-ad24-436f-99ce-4000d139d2c5 tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-group-rules/1f5eba24-1b41-419e-9afa-0bbb4df2400f" status: 202 len: 0 microversion: 2.1 time: 0.835737 Jun 20 12:12:49.423482 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1776/3486] 10.222.0.27 () {58 vars in 1286 bytes} [Mon Jun 20 12:12:48 2022] DELETE /compute/v2.1/os-security-group-rules/1f5eba24-1b41-419e-9afa-0bbb4df2400f => generated 0 bytes in 838 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:12:49.432092 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b6aee349-66ef-4662-b158-fa99d68b9196 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:49.434350 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b6aee349-66ef-4662-b158-fa99d68b9196 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] [instance: 1ff38290-9d23-40c5-94be-14608f6e1902] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:49.458904 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b6aee349-66ef-4662-b158-fa99d68b9196 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:49.460847 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b6aee349-66ef-4662-b158-fa99d68b9196 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:49.464535 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b6aee349-66ef-4662-b158-fa99d68b9196 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:49.467617 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b6aee349-66ef-4662-b158-fa99d68b9196 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:49.979519 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b6aee349-66ef-4662-b158-fa99d68b9196 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:49.992843 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b6aee349-66ef-4662-b158-fa99d68b9196 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:49.996886 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b6aee349-66ef-4662-b158-fa99d68b9196 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:49.998095 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b6aee349-66ef-4662-b158-fa99d68b9196 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] 10.222.0.27 "GET /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902" status: 200 len: 1359 microversion: 2.21 time: 0.573220 Jun 20 12:12:50.002940 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1777/3487] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:12:49 2022] GET /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902 => generated 1359 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:12:50.015415 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4008ef14-5ccf-4430-b6cc-a18cde957e5b tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:50.017007 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4008ef14-5ccf-4430-b6cc-a18cde957e5b tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 58edde4b-1f8f-488b-a632-764122b7fa53] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:50.025700 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4008ef14-5ccf-4430-b6cc-a18cde957e5b tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:50.026467 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4008ef14-5ccf-4430-b6cc-a18cde957e5b tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:50.027788 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4008ef14-5ccf-4430-b6cc-a18cde957e5b tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:50.028478 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4008ef14-5ccf-4430-b6cc-a18cde957e5b tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:50.201257 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-20a41a10-c0bb-4bb2-add3-2c86475ae8b8 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4a7cec6b754f4095917bb4cb9ee283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5ce0a299ef4e10be4dccca2ef8b957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:50.209889 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-20a41a10-c0bb-4bb2-add3-2c86475ae8b8 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "GET /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2" status: 200 len: 1324 microversion: 2.1 time: 1.690887 Jun 20 12:12:50.214276 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1711/3488] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:48 2022] GET /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2 => generated 1324 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:12:50.222029 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0c8a5dc8-8112-4265-bef9-4ad7e3250a57 tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] Calling method '.version_select at 0x7f6072c1b8b0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:50.641587 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4008ef14-5ccf-4430-b6cc-a18cde957e5b tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:50.657465 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4008ef14-5ccf-4430-b6cc-a18cde957e5b tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53" status: 200 len: 1314 microversion: 2.1 time: 0.652907 Jun 20 12:12:50.668405 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1778/3489] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:50 2022] GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53 => generated 1314 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:12:50.783953 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0c8a5dc8-8112-4265-bef9-4ad7e3250a57 tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/491929b5-07b9-4e55-b42c-c1a57698c17f" status: 202 len: 0 microversion: 2.1 time: 0.568394 Jun 20 12:12:50.784579 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1712/3490] 10.222.0.27 () {58 vars in 1271 bytes} [Mon Jun 20 12:12:50 2022] DELETE /compute/v2.1/os-security-groups/491929b5-07b9-4e55-b42c-c1a57698c17f => generated 0 bytes in 570 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:12:50.810284 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3d6bd935-108b-4c2a-a8e3-0ab512a2da09 tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] Calling method '.version_select at 0x7f6073b76ca0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:51.004687 n-d-master-1 devstack@n-api.service[119127]: DEBUG neutronclient.v2_0.client [None req-3d6bd935-108b-4c2a-a8e3-0ab512a2da09 tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ec94ac01-63a9-4b09-8e6d-32475e21f482 does not exist", "detail": ""}} {{(pid=119127) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 20 12:12:51.009033 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.security_group_api [None req-3d6bd935-108b-4c2a-a8e3-0ab512a2da09 tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] Neutron security group ec94ac01-63a9-4b09-8e6d-32475e21f482 not found {{(pid=119127) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 20 12:12:51.010525 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-3d6bd935-108b-4c2a-a8e3-0ab512a2da09 tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] HTTP exception thrown: Security group ec94ac01-63a9-4b09-8e6d-32475e21f482 does not exist Jun 20 12:12:51.010525 n-d-master-1 devstack@n-api.service[119127]: Neutron server returns request_ids: ['req-b1787647-9549-40f5-8f09-7b7625bff9fe'] Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3d6bd935-108b-4c2a-a8e3-0ab512a2da09 tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] Request method failure captured: Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/os-security-groups/ec94ac01-63a9-4b09-8e6d-32475e21f482 HTTP/1.1 Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGQnRFeIhOj9AhCkNIGZsuOzSmfBFhkL63Cb4MqN6mboWOuSZdgV9dj8m_uJXluBGa-hDQ_KlMi18D0usByX8RccGT21IwP30Js-XalLU3HtBWIw_L3BdPbSFNwyqqpp__GXyk59dYlliGuBlK9JUwgWcBjsMtMmdN9sJ7VwuKML3hY Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: ff67fb078e8b403ca7093523cc6eb79d Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-442184868 Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ff67fb078e8b403ca7093523cc6eb79d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ff67fb078e8b403ca7093523cc6eb79d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ff67fb078e8b403ca7093523cc6eb79d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ff67fb078e8b403ca7093523cc6eb79d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-SecurityGroupRulesTestJSON-442184868 Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: ff67fb078e8b403ca7093523cc6eb79d Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-442184868 Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-SecurityGroupRulesTestJSON-442184868-project Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 52bb1e4fa768439db8a33ceb00e3faba Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-SecurityGroupRulesTestJSON-442184868-project Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: exception: Security group ec94ac01-63a9-4b09-8e6d-32475e21f482 does not exist Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: Neutron server returns request_ids: ['req-b1787647-9549-40f5-8f09-7b7625bff9fe'] Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'ec94ac01-63a9-4b09-8e6d-32475e21f482'} Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 20 12:12:51.020410 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ec94ac01-63a9-4b09-8e6d-32475e21f482 does not exist Jun 20 12:12:51.024987 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1787647-9549-40f5-8f09-7b7625bff9fe'] Jun 20 12:12:51.024987 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:12:51.024987 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:12:51.024987 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:12:51.024987 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:51.024987 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 20 12:12:51.024987 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 20 12:12:51.024987 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 20 12:12:51.024987 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 20 12:12:51.024987 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ec94ac01-63a9-4b09-8e6d-32475e21f482 does not exist Jun 20 12:12:51.024987 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1787647-9549-40f5-8f09-7b7625bff9fe'] Jun 20 12:12:51.024987 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:12:51.024987 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:12:51.024987 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:12:51.024987 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:51.024987 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:12:51.024987 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:12:51.024987 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:12:51.024987 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:12:51.024987 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:12:51.024987 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:12:51.024987 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:12:51.024987 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:12:51.024987 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 20 12:12:51.024987 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 20 12:12:51.024987 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ec94ac01-63a9-4b09-8e6d-32475e21f482 does not exist Jun 20 12:12:51.024987 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1787647-9549-40f5-8f09-7b7625bff9fe'] Jun 20 12:12:51.024987 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:12:51.024987 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:12:51.024987 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:12:51.024987 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:12:51.024987 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:12:51.024987 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:12:51.024987 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:12:51.024987 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:12:51.024987 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ec94ac01-63a9-4b09-8e6d-32475e21f482 does not exist Jun 20 12:12:51.024987 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1787647-9549-40f5-8f09-7b7625bff9fe'] Jun 20 12:12:51.024987 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:12:51.029867 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3d6bd935-108b-4c2a-a8e3-0ab512a2da09 tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] Returning 404 to user: Security group ec94ac01-63a9-4b09-8e6d-32475e21f482 does not exist Jun 20 12:12:51.029867 n-d-master-1 devstack@n-api.service[119127]: Neutron server returns request_ids: ['req-b1787647-9549-40f5-8f09-7b7625bff9fe'] {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:12:51.029867 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3d6bd935-108b-4c2a-a8e3-0ab512a2da09 tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/ec94ac01-63a9-4b09-8e6d-32475e21f482" status: 404 len: 194 microversion: 2.1 time: 0.238432 Jun 20 12:12:51.029867 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1779/3491] 10.222.0.27 () {58 vars in 1271 bytes} [Mon Jun 20 12:12:50 2022] DELETE /compute/v2.1/os-security-groups/ec94ac01-63a9-4b09-8e6d-32475e21f482 => generated 194 bytes in 241 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:12:51.033652 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-22fb2720-8903-4257-9397-8e1af1eb911b tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:51.034657 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-22fb2720-8903-4257-9397-8e1af1eb911b tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] [instance: 1ff38290-9d23-40c5-94be-14608f6e1902] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:51.047748 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22fb2720-8903-4257-9397-8e1af1eb911b tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:51.048365 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22fb2720-8903-4257-9397-8e1af1eb911b tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:51.050039 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22fb2720-8903-4257-9397-8e1af1eb911b tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:51.050839 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d782f369-d7b7-4b83-855f-ac1a357f0587 tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] Calling method '.version_select at 0x7f607396f280>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:51.052951 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22fb2720-8903-4257-9397-8e1af1eb911b tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:51.664599 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-22fb2720-8903-4257-9397-8e1af1eb911b tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:51.681165 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-22fb2720-8903-4257-9397-8e1af1eb911b tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:51.690238 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-22fb2720-8903-4257-9397-8e1af1eb911b tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:51.694467 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-22fb2720-8903-4257-9397-8e1af1eb911b tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] 10.222.0.27 "GET /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902" status: 200 len: 1359 microversion: 2.21 time: 0.676868 Jun 20 12:12:51.696425 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1713/3492] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:12:51 2022] GET /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902 => generated 1359 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:12:51.711874 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-524e46ea-b698-40b1-b234-a96328c992e1 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:51.734209 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-524e46ea-b698-40b1-b234-a96328c992e1 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: fd56a5df-a994-416e-b1d4-a5a78df871b2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:51.754995 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-524e46ea-b698-40b1-b234-a96328c992e1 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:51.755670 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-524e46ea-b698-40b1-b234-a96328c992e1 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:51.757253 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-524e46ea-b698-40b1-b234-a96328c992e1 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:51.760824 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-524e46ea-b698-40b1-b234-a96328c992e1 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:52.104454 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d782f369-d7b7-4b83-855f-ac1a357f0587 tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/17d6e759-87fe-45a7-9a98-a92b5895033c" status: 202 len: 0 microversion: 2.1 time: 1.070751 Jun 20 12:12:52.106824 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1780/3493] 10.222.0.27 () {58 vars in 1271 bytes} [Mon Jun 20 12:12:51 2022] DELETE /compute/v2.1/os-security-groups/17d6e759-87fe-45a7-9a98-a92b5895033c => generated 0 bytes in 1075 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:12:52.114944 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-27127125-187d-4b8c-bcfd-183341f7122b req-67454192-6f29-419c-ad00-2fcc890dc704 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd56a5df-a994-416e-b1d4-a5a78df871b2", "tag": "c09d88d8-69e4-4159-a104-22eba04fd540"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:12:52.160650 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-27127125-187d-4b8c-bcfd-183341f7122b req-67454192-6f29-419c-ad00-2fcc890dc704 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:52.168666 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-27127125-187d-4b8c-bcfd-183341f7122b req-67454192-6f29-419c-ad00-2fcc890dc704 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:52.173658 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-524e46ea-b698-40b1-b234-a96328c992e1 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4a7cec6b754f4095917bb4cb9ee283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5ce0a299ef4e10be4dccca2ef8b957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:52.183402 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-524e46ea-b698-40b1-b234-a96328c992e1 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "GET /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2" status: 200 len: 1324 microversion: 2.1 time: 0.484903 Jun 20 12:12:52.184513 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1714/3494] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:51 2022] GET /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2 => generated 1324 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:12:52.190042 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b118747d-8136-4412-a95c-92119ff37bbc tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:52.190953 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b118747d-8136-4412-a95c-92119ff37bbc tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 58edde4b-1f8f-488b-a632-764122b7fa53] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:52.198771 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b118747d-8136-4412-a95c-92119ff37bbc tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:52.199625 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b118747d-8136-4412-a95c-92119ff37bbc tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:52.200718 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b118747d-8136-4412-a95c-92119ff37bbc tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:52.201324 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b118747d-8136-4412-a95c-92119ff37bbc tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:52.224795 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-27127125-187d-4b8c-bcfd-183341f7122b req-67454192-6f29-419c-ad00-2fcc890dc704 service nova] Creating event network-changed:c09d88d8-69e4-4159-a104-22eba04fd540 for instance fd56a5df-a994-416e-b1d4-a5a78df871b2 on n-h1-master-1 Jun 20 12:12:52.248119 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-27127125-187d-4b8c-bcfd-183341f7122b req-67454192-6f29-419c-ad00-2fcc890dc704 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139642 Jun 20 12:12:52.254832 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1781/3495] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:12:52.270769 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5d5829b3-f060-4325-8d85-f4b41a39a58e tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] Calling method '.version_select at 0x7f6073b6b4c0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:52.591520 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b118747d-8136-4412-a95c-92119ff37bbc tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:52.601582 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b118747d-8136-4412-a95c-92119ff37bbc tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53" status: 200 len: 1464 microversion: 2.1 time: 0.415636 Jun 20 12:12:52.602367 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1715/3496] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:52 2022] GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53 => generated 1464 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:12:52.635235 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4a6ab42d-1e0a-43a3-b867-4c0dee1e59c2 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:52.637551 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4a6ab42d-1e0a-43a3-b867-4c0dee1e59c2 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:52.646847 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4a6ab42d-1e0a-43a3-b867-4c0dee1e59c2 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:52.647494 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4a6ab42d-1e0a-43a3-b867-4c0dee1e59c2 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:52.648550 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4a6ab42d-1e0a-43a3-b867-4c0dee1e59c2 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:52.649316 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4a6ab42d-1e0a-43a3-b867-4c0dee1e59c2 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:52.848294 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4a6ab42d-1e0a-43a3-b867-4c0dee1e59c2 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:52.859780 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4a6ab42d-1e0a-43a3-b867-4c0dee1e59c2 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1463 microversion: 2.1 time: 0.237435 Jun 20 12:12:52.870683 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1716/3497] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:52 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1463 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:12:52.883884 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7b12828d-9a2d-4045-bddd-33e74115580a tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:52.887631 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7b12828d-9a2d-4045-bddd-33e74115580a tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] [instance: 1ff38290-9d23-40c5-94be-14608f6e1902] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:52.894593 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7b12828d-9a2d-4045-bddd-33e74115580a tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:52.895350 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7b12828d-9a2d-4045-bddd-33e74115580a tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:52.896337 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7b12828d-9a2d-4045-bddd-33e74115580a tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:52.900104 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7b12828d-9a2d-4045-bddd-33e74115580a tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:53.118905 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7b12828d-9a2d-4045-bddd-33e74115580a tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:53.128044 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7b12828d-9a2d-4045-bddd-33e74115580a tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:53.130072 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7b12828d-9a2d-4045-bddd-33e74115580a tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:53.131444 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7b12828d-9a2d-4045-bddd-33e74115580a tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] 10.222.0.27 "GET /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902" status: 200 len: 1359 microversion: 2.21 time: 0.259405 Jun 20 12:12:53.143762 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1717/3498] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:12:52 2022] GET /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902 => generated 1359 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:12:53.149752 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4d7a6595-eba5-465f-8760-e3c2b1fff0ec tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-773547365", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "d5b82c0b-6c6a-4d96-a8b2-437d242334f2"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:12:53.210100 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-4d7a6595-eba5-465f-8760-e3c2b1fff0ec tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] validate_networks() for None {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:12:53.581247 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=4 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:53.960719 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5d5829b3-f060-4325-8d85-f4b41a39a58e tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/28161d8e-6183-4c84-9bd4-21321f90310d" status: 202 len: 0 microversion: 2.1 time: 1.703178 Jun 20 12:12:53.965471 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1782/3499] 10.222.0.27 () {58 vars in 1271 bytes} [Mon Jun 20 12:12:52 2022] DELETE /compute/v2.1/os-security-groups/28161d8e-6183-4c84-9bd4-21321f90310d => generated 0 bytes in 1710 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:12:53.973560 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3aae8b5d-82d6-4343-96ad-f6a78ab31aea tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:53.975786 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3aae8b5d-82d6-4343-96ad-f6a78ab31aea tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: fd56a5df-a994-416e-b1d4-a5a78df871b2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:53.993417 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3aae8b5d-82d6-4343-96ad-f6a78ab31aea tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:53.996505 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3aae8b5d-82d6-4343-96ad-f6a78ab31aea tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:53.998032 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3aae8b5d-82d6-4343-96ad-f6a78ab31aea tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:54.010561 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3aae8b5d-82d6-4343-96ad-f6a78ab31aea tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:54.077232 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-4d7a6595-eba5-465f-8760-e3c2b1fff0ec tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:12:54.079019 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-4d7a6595-eba5-465f-8760-e3c2b1fff0ec tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:12:54.079817 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-4d7a6595-eba5-465f-8760-e3c2b1fff0ec tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:12:54.080481 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-4d7a6595-eba5-465f-8760-e3c2b1fff0ec tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:12:54.081118 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-4d7a6595-eba5-465f-8760-e3c2b1fff0ec tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:12:54.098914 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4d7a6595-eba5-465f-8760-e3c2b1fff0ec tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:54.100523 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4d7a6595-eba5-465f-8760-e3c2b1fff0ec tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:54.101623 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4d7a6595-eba5-465f-8760-e3c2b1fff0ec tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:54.102312 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4d7a6595-eba5-465f-8760-e3c2b1fff0ec tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:54.127933 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-4d7a6595-eba5-465f-8760-e3c2b1fff0ec tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Getting quotas for project df4cb5022443461395424ace464a41e6. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:12:54.135431 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-4d7a6595-eba5-465f-8760-e3c2b1fff0ec tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Getting quotas for user 8267303c2c734c10b081b154a1795b82 and project df4cb5022443461395424ace464a41e6. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:12:54.158594 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4d7a6595-eba5-465f-8760-e3c2b1fff0ec tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:12:54.162620 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4d7a6595-eba5-465f-8760-e3c2b1fff0ec tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 2201b474-c2b7-4b6f-ba8c-b7b6ec3da862] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:12:54.215690 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:12:54.241257 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4d7a6595-eba5-465f-8760-e3c2b1fff0ec tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.095796 Jun 20 12:12:54.242874 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1718/3500] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:12:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:12:54.249434 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-869cc555-d6be-44f4-a2a3-2a9d18eac867 tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] Calling method '.version_select at 0x7f60848ef1f0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:54.565775 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3aae8b5d-82d6-4343-96ad-f6a78ab31aea tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4a7cec6b754f4095917bb4cb9ee283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5ce0a299ef4e10be4dccca2ef8b957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:54.596270 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3aae8b5d-82d6-4343-96ad-f6a78ab31aea tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "GET /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2" status: 200 len: 1324 microversion: 2.1 time: 0.612811 Jun 20 12:12:54.597194 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1783/3501] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:53 2022] GET /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2 => generated 1324 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:12:54.614381 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1f6dbd57-920a-4682-a9c0-24ec5c859334 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:54.615337 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1f6dbd57-920a-4682-a9c0-24ec5c859334 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] [instance: 1ff38290-9d23-40c5-94be-14608f6e1902] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:54.628404 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f6dbd57-920a-4682-a9c0-24ec5c859334 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:54.628862 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f6dbd57-920a-4682-a9c0-24ec5c859334 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:54.629664 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f6dbd57-920a-4682-a9c0-24ec5c859334 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:54.630134 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f6dbd57-920a-4682-a9c0-24ec5c859334 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:55.032670 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1f6dbd57-920a-4682-a9c0-24ec5c859334 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:55.047090 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1f6dbd57-920a-4682-a9c0-24ec5c859334 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:55.059070 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1f6dbd57-920a-4682-a9c0-24ec5c859334 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:55.062221 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1f6dbd57-920a-4682-a9c0-24ec5c859334 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] 10.222.0.27 "GET /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902" status: 200 len: 1359 microversion: 2.21 time: 0.463248 Jun 20 12:12:55.066793 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1784/3502] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:12:54 2022] GET /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902 => generated 1359 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:12:55.079797 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e78cffde-f178-4967-b42e-43ec7ead7889 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:55.082027 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e78cffde-f178-4967-b42e-43ec7ead7889 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 2201b474-c2b7-4b6f-ba8c-b7b6ec3da862] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:55.208883 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e78cffde-f178-4967-b42e-43ec7ead7889 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:55.217613 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e78cffde-f178-4967-b42e-43ec7ead7889 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/2201b474-c2b7-4b6f-ba8c-b7b6ec3da862" status: 200 len: 1213 microversion: 2.1 time: 0.149155 Jun 20 12:12:55.219943 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1785/3503] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:55 2022] GET /compute/v2.1/servers/2201b474-c2b7-4b6f-ba8c-b7b6ec3da862 => generated 1213 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:12:55.338491 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-869cc555-d6be-44f4-a2a3-2a9d18eac867 tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/8dedb4ee-9aa9-4d2c-89f3-3aff2da28527" status: 202 len: 0 microversion: 2.1 time: 1.093829 Jun 20 12:12:55.339826 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1719/3504] 10.222.0.27 () {58 vars in 1271 bytes} [Mon Jun 20 12:12:54 2022] DELETE /compute/v2.1/os-security-groups/8dedb4ee-9aa9-4d2c-89f3-3aff2da28527 => generated 0 bytes in 1096 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:12:55.351790 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e8207154-2ab3-4da1-afd1-101206ce4aa7 tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] Calling method '.version_select at 0x7f6073977670>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:55.617684 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f4d5b635-aec2-4b13-b99d-19c9f01dfb19 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:55.618712 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f4d5b635-aec2-4b13-b99d-19c9f01dfb19 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: fd56a5df-a994-416e-b1d4-a5a78df871b2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:55.634464 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f4d5b635-aec2-4b13-b99d-19c9f01dfb19 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:55.636616 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f4d5b635-aec2-4b13-b99d-19c9f01dfb19 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:55.639166 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f4d5b635-aec2-4b13-b99d-19c9f01dfb19 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:55.640433 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f4d5b635-aec2-4b13-b99d-19c9f01dfb19 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:55.859390 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e8207154-2ab3-4da1-afd1-101206ce4aa7 tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/c52a0f90-4163-4470-98f1-123855b7a643" status: 202 len: 0 microversion: 2.1 time: 0.513653 Jun 20 12:12:55.860079 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1786/3505] 10.222.0.27 () {58 vars in 1271 bytes} [Mon Jun 20 12:12:55 2022] DELETE /compute/v2.1/os-security-groups/c52a0f90-4163-4470-98f1-123855b7a643 => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:12:55.868731 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5d1c820a-87e4-4612-a5a4-3b6e6e961aed tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] Calling method '.version_select at 0x7f6073fb7f70>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:55.915593 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f4d5b635-aec2-4b13-b99d-19c9f01dfb19 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4a7cec6b754f4095917bb4cb9ee283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5ce0a299ef4e10be4dccca2ef8b957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:55.926466 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f4d5b635-aec2-4b13-b99d-19c9f01dfb19 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "GET /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2" status: 200 len: 1324 microversion: 2.1 time: 0.313772 Jun 20 12:12:55.942040 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1720/3506] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:55 2022] GET /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2 => generated 1324 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:12:56.084665 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c9d00f94-825d-4b2a-be7e-cbe8e344cfef tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:56.085310 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c9d00f94-825d-4b2a-be7e-cbe8e344cfef tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] [instance: 1ff38290-9d23-40c5-94be-14608f6e1902] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:56.103590 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c9d00f94-825d-4b2a-be7e-cbe8e344cfef tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:56.104067 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c9d00f94-825d-4b2a-be7e-cbe8e344cfef tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:56.106296 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c9d00f94-825d-4b2a-be7e-cbe8e344cfef tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:56.106746 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c9d00f94-825d-4b2a-be7e-cbe8e344cfef tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:56.456433 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5d1c820a-87e4-4612-a5a4-3b6e6e961aed tempest-SecurityGroupRulesTestJSON-442184868 tempest-SecurityGroupRulesTestJSON-442184868-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/0c8e4823-3384-44e3-96f8-ecbbf8535c33" status: 202 len: 0 microversion: 2.1 time: 0.591558 Jun 20 12:12:56.457179 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1787/3507] 10.222.0.27 () {58 vars in 1271 bytes} [Mon Jun 20 12:12:55 2022] DELETE /compute/v2.1/os-security-groups/0c8e4823-3384-44e3-96f8-ecbbf8535c33 => generated 0 bytes in 593 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:12:56.466223 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c1294fe8-342e-4b3a-bf41-7b9589da4ee5 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:56.467000 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c1294fe8-342e-4b3a-bf41-7b9589da4ee5 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 2201b474-c2b7-4b6f-ba8c-b7b6ec3da862] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:56.498000 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c1294fe8-342e-4b3a-bf41-7b9589da4ee5 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:56.505653 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c1294fe8-342e-4b3a-bf41-7b9589da4ee5 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:56.513576 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c1294fe8-342e-4b3a-bf41-7b9589da4ee5 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:56.522605 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c1294fe8-342e-4b3a-bf41-7b9589da4ee5 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:56.858350 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c1294fe8-342e-4b3a-bf41-7b9589da4ee5 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:56.870041 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c1294fe8-342e-4b3a-bf41-7b9589da4ee5 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/2201b474-c2b7-4b6f-ba8c-b7b6ec3da862" status: 200 len: 1271 microversion: 2.1 time: 0.407672 Jun 20 12:12:56.874309 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1788/3508] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:56 2022] GET /compute/v2.1/servers/2201b474-c2b7-4b6f-ba8c-b7b6ec3da862 => generated 1271 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:12:56.897509 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-bae87d30-c9cc-40f5-ba20-5f52e9cb1990 req-73ed9cfb-454e-4d6e-a307-609e4efd3c48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ff38290-9d23-40c5-94be-14608f6e1902", "name": "network-vif-plugged", "status": "completed", "tag": "40439874-ea15-43be-bbd1-5011939b3c4e"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:12:56.936901 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-bae87d30-c9cc-40f5-ba20-5f52e9cb1990 req-73ed9cfb-454e-4d6e-a307-609e4efd3c48 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:56.937889 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-bae87d30-c9cc-40f5-ba20-5f52e9cb1990 req-73ed9cfb-454e-4d6e-a307-609e4efd3c48 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:57.005896 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-bae87d30-c9cc-40f5-ba20-5f52e9cb1990 req-73ed9cfb-454e-4d6e-a307-609e4efd3c48 service nova] Creating event network-vif-plugged:40439874-ea15-43be-bbd1-5011939b3c4e for instance 1ff38290-9d23-40c5-94be-14608f6e1902 on n-h2-master-1 Jun 20 12:12:57.017715 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c9d00f94-825d-4b2a-be7e-cbe8e344cfef tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:57.022188 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-bae87d30-c9cc-40f5-ba20-5f52e9cb1990 req-73ed9cfb-454e-4d6e-a307-609e4efd3c48 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146256 Jun 20 12:12:57.026093 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1789/3509] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:12:57.037803 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c9d00f94-825d-4b2a-be7e-cbe8e344cfef tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:57.046164 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c9d00f94-825d-4b2a-be7e-cbe8e344cfef tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:57.049194 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-87614a7b-af93-455a-8dbe-30a1702f6761 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:57.050534 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c9d00f94-825d-4b2a-be7e-cbe8e344cfef tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] 10.222.0.27 "GET /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902" status: 200 len: 1359 microversion: 2.21 time: 0.970136 Jun 20 12:12:57.050708 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-87614a7b-af93-455a-8dbe-30a1702f6761 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: fd56a5df-a994-416e-b1d4-a5a78df871b2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:57.051150 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1721/3510] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:12:56 2022] GET /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902 => generated 1359 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:12:57.076790 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-87614a7b-af93-455a-8dbe-30a1702f6761 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:57.077578 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-87614a7b-af93-455a-8dbe-30a1702f6761 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:57.078925 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-87614a7b-af93-455a-8dbe-30a1702f6761 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:57.079832 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-87614a7b-af93-455a-8dbe-30a1702f6761 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:57.852030 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-87614a7b-af93-455a-8dbe-30a1702f6761 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4a7cec6b754f4095917bb4cb9ee283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5ce0a299ef4e10be4dccca2ef8b957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:57.864259 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-87614a7b-af93-455a-8dbe-30a1702f6761 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "GET /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2" status: 200 len: 1324 microversion: 2.1 time: 0.834762 Jun 20 12:12:57.864854 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1790/3511] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:57 2022] GET /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2 => generated 1324 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:12:57.899750 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-515b8bfc-0026-4e64-b8bb-2adb8d909670 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:57.900725 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-515b8bfc-0026-4e64-b8bb-2adb8d909670 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 2201b474-c2b7-4b6f-ba8c-b7b6ec3da862] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:57.930924 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-515b8bfc-0026-4e64-b8bb-2adb8d909670 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:57.931987 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-515b8bfc-0026-4e64-b8bb-2adb8d909670 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:57.936853 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-515b8bfc-0026-4e64-b8bb-2adb8d909670 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:57.939279 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-515b8bfc-0026-4e64-b8bb-2adb8d909670 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:58.073525 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ec5c2a66-58dc-4945-a741-37f9fbd78d66 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:58.074207 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ec5c2a66-58dc-4945-a741-37f9fbd78d66 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] [instance: 1ff38290-9d23-40c5-94be-14608f6e1902] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:58.093694 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ec5c2a66-58dc-4945-a741-37f9fbd78d66 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:58.097488 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ec5c2a66-58dc-4945-a741-37f9fbd78d66 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:58.100485 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ec5c2a66-58dc-4945-a741-37f9fbd78d66 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:58.102847 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ec5c2a66-58dc-4945-a741-37f9fbd78d66 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:58.171584 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-515b8bfc-0026-4e64-b8bb-2adb8d909670 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:58.187465 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-515b8bfc-0026-4e64-b8bb-2adb8d909670 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/2201b474-c2b7-4b6f-ba8c-b7b6ec3da862" status: 200 len: 1271 microversion: 2.1 time: 0.293124 Jun 20 12:12:58.188055 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1722/3512] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:57 2022] GET /compute/v2.1/servers/2201b474-c2b7-4b6f-ba8c-b7b6ec3da862 => generated 1271 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:12:58.888872 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ec43c3f0-184f-467a-bea8-660f97efc59d tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:58.890300 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ec43c3f0-184f-467a-bea8-660f97efc59d tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: fd56a5df-a994-416e-b1d4-a5a78df871b2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:58.914531 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ec43c3f0-184f-467a-bea8-660f97efc59d tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:58.915926 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ec43c3f0-184f-467a-bea8-660f97efc59d tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:58.917029 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ec43c3f0-184f-467a-bea8-660f97efc59d tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:58.918953 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ec43c3f0-184f-467a-bea8-660f97efc59d tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:59.136832 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ec5c2a66-58dc-4945-a741-37f9fbd78d66 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:59.151695 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ec5c2a66-58dc-4945-a741-37f9fbd78d66 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:59.153281 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ec5c2a66-58dc-4945-a741-37f9fbd78d66 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:59.154475 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ec5c2a66-58dc-4945-a741-37f9fbd78d66 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] 10.222.0.27 "GET /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902" status: 200 len: 1359 microversion: 2.21 time: 1.089593 Jun 20 12:12:59.155095 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1791/3513] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:12:58 2022] GET /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902 => generated 1359 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:12:59.205527 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fa3e4d4c-568c-4866-9471-bd24183e4812 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:12:59.206399 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fa3e4d4c-568c-4866-9471-bd24183e4812 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 2201b474-c2b7-4b6f-ba8c-b7b6ec3da862] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:12:59.222232 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fa3e4d4c-568c-4866-9471-bd24183e4812 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:59.226007 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fa3e4d4c-568c-4866-9471-bd24183e4812 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:59.229363 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fa3e4d4c-568c-4866-9471-bd24183e4812 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:12:59.233811 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fa3e4d4c-568c-4866-9471-bd24183e4812 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:12:59.676682 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ec43c3f0-184f-467a-bea8-660f97efc59d tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4a7cec6b754f4095917bb4cb9ee283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5ce0a299ef4e10be4dccca2ef8b957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:59.688576 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ec43c3f0-184f-467a-bea8-660f97efc59d tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "GET /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2" status: 200 len: 1324 microversion: 2.1 time: 0.810061 Jun 20 12:12:59.694621 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1723/3514] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:58 2022] GET /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2 => generated 1324 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:12:59.809076 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fa3e4d4c-568c-4866-9471-bd24183e4812 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:12:59.825432 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fa3e4d4c-568c-4866-9471-bd24183e4812 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/2201b474-c2b7-4b6f-ba8c-b7b6ec3da862" status: 200 len: 1271 microversion: 2.1 time: 0.624126 Jun 20 12:12:59.826505 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1792/3515] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:12:59 2022] GET /compute/v2.1/servers/2201b474-c2b7-4b6f-ba8c-b7b6ec3da862 => generated 1271 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:00.061124 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-50bff28d-f7ee-4412-8a54-75f973bbda01 req-5a7feec4-6a28-4457-9738-22debfb0bb7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd56a5df-a994-416e-b1d4-a5a78df871b2", "name": "network-vif-plugged", "status": "completed", "tag": "c09d88d8-69e4-4159-a104-22eba04fd540"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:13:00.100852 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-50bff28d-f7ee-4412-8a54-75f973bbda01 req-5a7feec4-6a28-4457-9738-22debfb0bb7b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:00.101825 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-50bff28d-f7ee-4412-8a54-75f973bbda01 req-5a7feec4-6a28-4457-9738-22debfb0bb7b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:00.136464 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-50bff28d-f7ee-4412-8a54-75f973bbda01 req-5a7feec4-6a28-4457-9738-22debfb0bb7b service nova] Creating event network-vif-plugged:c09d88d8-69e4-4159-a104-22eba04fd540 for instance fd56a5df-a994-416e-b1d4-a5a78df871b2 on n-h1-master-1 Jun 20 12:13:00.163429 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-50bff28d-f7ee-4412-8a54-75f973bbda01 req-5a7feec4-6a28-4457-9738-22debfb0bb7b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105583 Jun 20 12:13:00.164184 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1793/3516] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:13:00.180492 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f03edd16-6481-4046-b265-41c8147a2a35 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:00.181181 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f03edd16-6481-4046-b265-41c8147a2a35 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] [instance: 1ff38290-9d23-40c5-94be-14608f6e1902] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:00.206223 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f03edd16-6481-4046-b265-41c8147a2a35 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:00.206692 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f03edd16-6481-4046-b265-41c8147a2a35 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:00.207493 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f03edd16-6481-4046-b265-41c8147a2a35 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:00.207934 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f03edd16-6481-4046-b265-41c8147a2a35 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:00.728103 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7a5ce0c2-9197-4cf6-88b5-1f5c113c3566 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Action: 'create', calling method: .version_select at 0x7f6084806c10>, body: {"keypair": {"name": "tempest-keypair-1370486867", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEOJEf0HoiciLSXJdhHiWVaaNQqrHOibGAgzCnCBObOXA3KqSpB1dLcWaiN8LfP3MyiyoH/tY4dlH90PQDDNTLjElu7IuaeS39Nd7l9oGlqLa85xOmsUPzOE5pTbSVFsw=="}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:13:00.753985 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-7a5ce0c2-9197-4cf6-88b5-1f5c113c3566 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Getting quotas for project b0d48009b1164cf3a605b30513636e4d. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:13:00.761418 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-7a5ce0c2-9197-4cf6-88b5-1f5c113c3566 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Getting quotas for user aa6f744fe3e8403ea1960856026abe61 and project b0d48009b1164cf3a605b30513636e4d. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:13:00.808789 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7a5ce0c2-9197-4cf6-88b5-1f5c113c3566 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.857125 Jun 20 12:13:00.817561 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1724/3517] 10.222.0.27 () {62 vars in 1199 bytes} [Mon Jun 20 12:12:59 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 859 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 20 12:13:00.818732 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d3263401-0901-4e39-9bb0-b5d3cb36a1d5 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:00.820060 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d3263401-0901-4e39-9bb0-b5d3cb36a1d5 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: fd56a5df-a994-416e-b1d4-a5a78df871b2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:00.832945 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3263401-0901-4e39-9bb0-b5d3cb36a1d5 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:00.833325 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3263401-0901-4e39-9bb0-b5d3cb36a1d5 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:00.834176 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3263401-0901-4e39-9bb0-b5d3cb36a1d5 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:00.834983 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3263401-0901-4e39-9bb0-b5d3cb36a1d5 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:01.200161 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f03edd16-6481-4046-b265-41c8147a2a35 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:01.213078 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f03edd16-6481-4046-b265-41c8147a2a35 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:01.215414 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f03edd16-6481-4046-b265-41c8147a2a35 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:01.216966 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f03edd16-6481-4046-b265-41c8147a2a35 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] 10.222.0.27 "GET /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902" status: 200 len: 1552 microversion: 2.21 time: 1.041153 Jun 20 12:13:01.230546 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1794/3518] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:00 2022] GET /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902 => generated 1552 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:13:01.237479 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ad92cf62-226b-4b23-8149-176eb31d0dc4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:01.238614 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ad92cf62-226b-4b23-8149-176eb31d0dc4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 2201b474-c2b7-4b6f-ba8c-b7b6ec3da862] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:01.255876 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ad92cf62-226b-4b23-8149-176eb31d0dc4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:01.273088 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ad92cf62-226b-4b23-8149-176eb31d0dc4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:01.275054 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ad92cf62-226b-4b23-8149-176eb31d0dc4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:01.275754 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ad92cf62-226b-4b23-8149-176eb31d0dc4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:01.862470 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d3263401-0901-4e39-9bb0-b5d3cb36a1d5 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4a7cec6b754f4095917bb4cb9ee283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5ce0a299ef4e10be4dccca2ef8b957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:01.889123 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d3263401-0901-4e39-9bb0-b5d3cb36a1d5 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "GET /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2" status: 200 len: 1324 microversion: 2.1 time: 1.077971 Jun 20 12:13:01.894057 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1725/3519] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:00 2022] GET /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2 => generated 1324 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:01.905224 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-234f1f64-2bac-424b-84f7-72df43c0d99d tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:01.906413 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-234f1f64-2bac-424b-84f7-72df43c0d99d tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] [instance: 1ff38290-9d23-40c5-94be-14608f6e1902] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:01.918752 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-234f1f64-2bac-424b-84f7-72df43c0d99d tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:01.919491 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-234f1f64-2bac-424b-84f7-72df43c0d99d tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:01.920392 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-234f1f64-2bac-424b-84f7-72df43c0d99d tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:01.921116 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-234f1f64-2bac-424b-84f7-72df43c0d99d tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:01.951242 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-234f1f64-2bac-424b-84f7-72df43c0d99d tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] [instance: 1ff38290-9d23-40c5-94be-14608f6e1902] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:13:02.073103 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ad92cf62-226b-4b23-8149-176eb31d0dc4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:02.078001 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-234f1f64-2bac-424b-84f7-72df43c0d99d tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902" status: 204 len: 0 microversion: 2.21 time: 0.181568 Jun 20 12:13:02.080158 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1726/3520] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Jun 20 12:13:01 2022] DELETE /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 12:13:02.092534 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ad92cf62-226b-4b23-8149-176eb31d0dc4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/2201b474-c2b7-4b6f-ba8c-b7b6ec3da862" status: 200 len: 1313 microversion: 2.1 time: 0.858667 Jun 20 12:13:02.092534 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1795/3521] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:01 2022] GET /compute/v2.1/servers/2201b474-c2b7-4b6f-ba8c-b7b6ec3da862 => generated 1313 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:02.099463 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2684d699-d57f-4c77-a324-00de9355ec75 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:02.100755 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2684d699-d57f-4c77-a324-00de9355ec75 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] [instance: 1ff38290-9d23-40c5-94be-14608f6e1902] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:02.119476 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2684d699-d57f-4c77-a324-00de9355ec75 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:02.124436 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2684d699-d57f-4c77-a324-00de9355ec75 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:02.125526 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2684d699-d57f-4c77-a324-00de9355ec75 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:02.126430 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2684d699-d57f-4c77-a324-00de9355ec75 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:02.593308 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2684d699-d57f-4c77-a324-00de9355ec75 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:02.620432 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2684d699-d57f-4c77-a324-00de9355ec75 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:02.623100 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2684d699-d57f-4c77-a324-00de9355ec75 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:02.640724 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2684d699-d57f-4c77-a324-00de9355ec75 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] 10.222.0.27 "GET /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902" status: 200 len: 1558 microversion: 2.21 time: 0.545888 Jun 20 12:13:02.650991 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1727/3522] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:02 2022] GET /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902 => generated 1558 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:13:02.919090 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6563d862-831c-4fd7-8a51-a28707af089f tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:02.919630 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6563d862-831c-4fd7-8a51-a28707af089f tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: fd56a5df-a994-416e-b1d4-a5a78df871b2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:02.938398 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6563d862-831c-4fd7-8a51-a28707af089f tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:02.938859 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6563d862-831c-4fd7-8a51-a28707af089f tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:02.939715 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6563d862-831c-4fd7-8a51-a28707af089f tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:02.940457 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6563d862-831c-4fd7-8a51-a28707af089f tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:03.108471 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ae5a4004-cf5b-45c8-b2eb-6bb372c5f067 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:03.109337 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ae5a4004-cf5b-45c8-b2eb-6bb372c5f067 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 2201b474-c2b7-4b6f-ba8c-b7b6ec3da862] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:03.123614 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ae5a4004-cf5b-45c8-b2eb-6bb372c5f067 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:03.124390 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ae5a4004-cf5b-45c8-b2eb-6bb372c5f067 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:03.125265 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ae5a4004-cf5b-45c8-b2eb-6bb372c5f067 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:03.125959 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ae5a4004-cf5b-45c8-b2eb-6bb372c5f067 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:03.637771 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6563d862-831c-4fd7-8a51-a28707af089f tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4a7cec6b754f4095917bb4cb9ee283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5ce0a299ef4e10be4dccca2ef8b957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:03.647367 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ae5a4004-cf5b-45c8-b2eb-6bb372c5f067 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:03.656850 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:13:03.663034 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ae5a4004-cf5b-45c8-b2eb-6bb372c5f067 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/2201b474-c2b7-4b6f-ba8c-b7b6ec3da862" status: 200 len: 1313 microversion: 2.1 time: 0.558458 Jun 20 12:13:03.667293 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6563d862-831c-4fd7-8a51-a28707af089f tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "GET /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2" status: 200 len: 1520 microversion: 2.1 time: 0.751935 Jun 20 12:13:03.670440 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1728/3523] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:03 2022] GET /compute/v2.1/servers/2201b474-c2b7-4b6f-ba8c-b7b6ec3da862 => generated 1313 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:13:03.680770 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1796/3524] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:02 2022] GET /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2 => generated 1520 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:13:03.695717 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3adeb0df-a7e8-40f6-9bda-86d538032199 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:03.697005 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-545242fb-d7c6-4a55-b56d-a5fdbc43a451 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Action: 'create', calling method: .version_select at 0x7f6073b97040>, body: {"pool": null} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:13:03.701086 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3adeb0df-a7e8-40f6-9bda-86d538032199 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] [instance: 1ff38290-9d23-40c5-94be-14608f6e1902] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:03.712878 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3adeb0df-a7e8-40f6-9bda-86d538032199 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:03.713738 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3adeb0df-a7e8-40f6-9bda-86d538032199 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:03.714748 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3adeb0df-a7e8-40f6-9bda-86d538032199 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:03.715407 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3adeb0df-a7e8-40f6-9bda-86d538032199 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:04.116344 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:13:04.823704 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3adeb0df-a7e8-40f6-9bda-86d538032199 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:04.843554 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3adeb0df-a7e8-40f6-9bda-86d538032199 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:04.846164 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3adeb0df-a7e8-40f6-9bda-86d538032199 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:04.847767 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3adeb0df-a7e8-40f6-9bda-86d538032199 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] 10.222.0.27 "GET /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902" status: 200 len: 1558 microversion: 2.21 time: 1.165296 Jun 20 12:13:04.860658 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1729/3525] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:03 2022] GET /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902 => generated 1558 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:13:04.866665 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e043b064-7e21-4035-b18f-4b7a931154b2 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:04.869885 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e043b064-7e21-4035-b18f-4b7a931154b2 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 2201b474-c2b7-4b6f-ba8c-b7b6ec3da862] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:04.892105 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e043b064-7e21-4035-b18f-4b7a931154b2 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:04.892886 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e043b064-7e21-4035-b18f-4b7a931154b2 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:04.896094 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e043b064-7e21-4035-b18f-4b7a931154b2 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:04.897181 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e043b064-7e21-4035-b18f-4b7a931154b2 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:05.219668 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:13:05.299893 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e043b064-7e21-4035-b18f-4b7a931154b2 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:05.310430 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e043b064-7e21-4035-b18f-4b7a931154b2 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/2201b474-c2b7-4b6f-ba8c-b7b6ec3da862" status: 200 len: 1313 microversion: 2.1 time: 0.448037 Jun 20 12:13:05.311152 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1730/3526] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:04 2022] GET /compute/v2.1/servers/2201b474-c2b7-4b6f-ba8c-b7b6ec3da862 => generated 1313 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:05.343717 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-185ccd62-365e-4694-ba9c-f98abfe6c4ee req-d389d275-026a-429b-9ec4-ad952e011379 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2201b474-c2b7-4b6f-ba8c-b7b6ec3da862", "tag": "fdef86ed-bdd1-46e5-9f16-c2ce23d27385"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:13:05.376437 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-185ccd62-365e-4694-ba9c-f98abfe6c4ee req-d389d275-026a-429b-9ec4-ad952e011379 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:05.376878 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-185ccd62-365e-4694-ba9c-f98abfe6c4ee req-d389d275-026a-429b-9ec4-ad952e011379 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:05.429688 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-185ccd62-365e-4694-ba9c-f98abfe6c4ee req-d389d275-026a-429b-9ec4-ad952e011379 service nova] Creating event network-changed:fdef86ed-bdd1-46e5-9f16-c2ce23d27385 for instance 2201b474-c2b7-4b6f-ba8c-b7b6ec3da862 on n-h2-master-1 Jun 20 12:13:05.454552 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-185ccd62-365e-4694-ba9c-f98abfe6c4ee req-d389d275-026a-429b-9ec4-ad952e011379 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115143 Jun 20 12:13:05.455436 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1731/3527] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:13:05.873717 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-75bd98e9-4953-4553-bb02-35cb498f2685 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:05.874649 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-75bd98e9-4953-4553-bb02-35cb498f2685 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] [instance: 1ff38290-9d23-40c5-94be-14608f6e1902] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:05.887035 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-75bd98e9-4953-4553-bb02-35cb498f2685 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:05.887479 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-75bd98e9-4953-4553-bb02-35cb498f2685 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:05.888292 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-75bd98e9-4953-4553-bb02-35cb498f2685 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:05.888866 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-75bd98e9-4953-4553-bb02-35cb498f2685 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:06.844119 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-75bd98e9-4953-4553-bb02-35cb498f2685 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:06.871139 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-75bd98e9-4953-4553-bb02-35cb498f2685 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:06.876333 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-75bd98e9-4953-4553-bb02-35cb498f2685 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:06.878163 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-75bd98e9-4953-4553-bb02-35cb498f2685 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] 10.222.0.27 "GET /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902" status: 200 len: 1558 microversion: 2.21 time: 1.008987 Jun 20 12:13:06.881118 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1732/3528] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:05 2022] GET /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902 => generated 1558 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:13:06.909268 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-970deada-f79d-40e7-8321-e400ff185b51 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:06.918155 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-970deada-f79d-40e7-8321-e400ff185b51 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 2201b474-c2b7-4b6f-ba8c-b7b6ec3da862] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:06.930507 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-970deada-f79d-40e7-8321-e400ff185b51 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:06.932732 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-970deada-f79d-40e7-8321-e400ff185b51 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:06.935308 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-970deada-f79d-40e7-8321-e400ff185b51 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:06.936110 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-970deada-f79d-40e7-8321-e400ff185b51 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:07.770058 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-970deada-f79d-40e7-8321-e400ff185b51 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:07.804695 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-970deada-f79d-40e7-8321-e400ff185b51 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/2201b474-c2b7-4b6f-ba8c-b7b6ec3da862" status: 200 len: 1313 microversion: 2.1 time: 0.921323 Jun 20 12:13:07.810830 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1733/3529] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:06 2022] GET /compute/v2.1/servers/2201b474-c2b7-4b6f-ba8c-b7b6ec3da862 => generated 1313 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:07.822680 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-a08f49aa-8916-4028-84bd-0138ab96ebbf req-db0113f6-a478-4313-ad5d-4f95f8ec9631 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ff38290-9d23-40c5-94be-14608f6e1902", "name": "network-vif-deleted", "tag": "40439874-ea15-43be-bbd1-5011939b3c4e"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:13:07.848485 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-a08f49aa-8916-4028-84bd-0138ab96ebbf req-db0113f6-a478-4313-ad5d-4f95f8ec9631 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:07.849632 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-a08f49aa-8916-4028-84bd-0138ab96ebbf req-db0113f6-a478-4313-ad5d-4f95f8ec9631 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:07.886842 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-a08f49aa-8916-4028-84bd-0138ab96ebbf req-db0113f6-a478-4313-ad5d-4f95f8ec9631 service nova] Creating event network-vif-deleted:40439874-ea15-43be-bbd1-5011939b3c4e for instance 1ff38290-9d23-40c5-94be-14608f6e1902 on n-h2-master-1 Jun 20 12:13:07.892729 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-a08f49aa-8916-4028-84bd-0138ab96ebbf req-db0113f6-a478-4313-ad5d-4f95f8ec9631 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079614 Jun 20 12:13:07.893672 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1734/3530] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:13:07.914101 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-916edd12-238f-4ad1-8967-4441d0fbbcbb tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:07.914939 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-916edd12-238f-4ad1-8967-4441d0fbbcbb tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] [instance: 1ff38290-9d23-40c5-94be-14608f6e1902] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:07.928124 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-916edd12-238f-4ad1-8967-4441d0fbbcbb tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:07.928620 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-916edd12-238f-4ad1-8967-4441d0fbbcbb tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:07.929426 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-916edd12-238f-4ad1-8967-4441d0fbbcbb tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:07.929863 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-916edd12-238f-4ad1-8967-4441d0fbbcbb tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:08.190985 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-916edd12-238f-4ad1-8967-4441d0fbbcbb tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:08.203633 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-916edd12-238f-4ad1-8967-4441d0fbbcbb tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:08.205220 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-916edd12-238f-4ad1-8967-4441d0fbbcbb tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18485f98265e4c4abfc8b6da093d3a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604fcdefd2244bdbaa79919d2bb49ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:08.206459 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-916edd12-238f-4ad1-8967-4441d0fbbcbb tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] 10.222.0.27 "GET /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902" status: 200 len: 1516 microversion: 2.21 time: 0.297848 Jun 20 12:13:08.207050 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1735/3531] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:07 2022] GET /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902 => generated 1516 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:13:08.617593 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-42dc327d-12e4-48fa-9fe9-06defec4bc77 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1920431572", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c2371ae1-6eb5-4e87-803d-d1b094865120"}], "security_groups": [{"name": "tempest-securitygroup--172770801"}], "key_name": "tempest-keypair-1370486867", "user_data": "}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:13:09.527062 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-545242fb-d7c6-4a55-b56d-a5fdbc43a451 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.838797 Jun 20 12:13:09.528742 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1797/3532] 10.222.0.27 () {60 vars in 1169 bytes} [Mon Jun 20 12:13:03 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5841 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:13:09.534279 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fe55a6c6-17e3-40a7-9584-ecb00c90dcce tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:09.535351 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fe55a6c6-17e3-40a7-9584-ecb00c90dcce tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 2201b474-c2b7-4b6f-ba8c-b7b6ec3da862] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:09.538335 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=38 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:13:09.546131 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fe55a6c6-17e3-40a7-9584-ecb00c90dcce tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:09.547665 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fe55a6c6-17e3-40a7-9584-ecb00c90dcce tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:09.548674 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fe55a6c6-17e3-40a7-9584-ecb00c90dcce tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:09.549508 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fe55a6c6-17e3-40a7-9584-ecb00c90dcce tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:09.907548 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-42dc327d-12e4-48fa-9fe9-06defec4bc77 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] validate_networks() for [('c2371ae1-6eb5-4e87-803d-d1b094865120', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:13:10.027933 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fe55a6c6-17e3-40a7-9584-ecb00c90dcce tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:10.041200 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fe55a6c6-17e3-40a7-9584-ecb00c90dcce tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/2201b474-c2b7-4b6f-ba8c-b7b6ec3da862" status: 200 len: 1313 microversion: 2.1 time: 0.510876 Jun 20 12:13:10.065346 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1798/3533] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:09 2022] GET /compute/v2.1/servers/2201b474-c2b7-4b6f-ba8c-b7b6ec3da862 => generated 1313 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:10.135588 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bad858d9-28e4-4717-80e1-a1bb2c46bea6 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:10.141693 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bad858d9-28e4-4717-80e1-a1bb2c46bea6 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] [instance: 1ff38290-9d23-40c5-94be-14608f6e1902] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:10.174465 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bad858d9-28e4-4717-80e1-a1bb2c46bea6 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:10.177779 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bad858d9-28e4-4717-80e1-a1bb2c46bea6 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:10.181461 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bad858d9-28e4-4717-80e1-a1bb2c46bea6 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:10.182039 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bad858d9-28e4-4717-80e1-a1bb2c46bea6 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:10.232560 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-bad858d9-28e4-4717-80e1-a1bb2c46bea6 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] HTTP exception thrown: Instance 1ff38290-9d23-40c5-94be-14608f6e1902 could not be found. Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bad858d9-28e4-4717-80e1-a1bb2c46bea6 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Request method failure captured: Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902 HTTP/1.1 Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGQ09s6MXA5FSipPqmRmofz_2WYrGx-lFwdh-afhvAStv8gAq5iLf9xLPJLDaKNMp8hriwH2OnCY3NtQVtdgkXGwnTDGHxS-nIMq40hkd_QZUUzoMOu5BUBFxdQSm378F6m9oCjOVA5fi2n2ttjol0nNej65RD1JbCIRu930BWOdxBg Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: X-Openstack-Nova-Api-Version: 2.21 Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 604fcdefd2244bdbaa79919d2bb49ed9 Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-InstanceActionsV221TestJSON-618012033 Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/604fcdefd2244bdbaa79919d2bb49ed9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/604fcdefd2244bdbaa79919d2bb49ed9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/604fcdefd2244bdbaa79919d2bb49ed9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_604fcdefd2244bdbaa79919d2bb49ed9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-InstanceActionsV221TestJSON-618012033 Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 604fcdefd2244bdbaa79919d2bb49ed9 Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-618012033 Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-InstanceActionsV221TestJSON-618012033-project Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 18485f98265e4c4abfc8b6da093d3a0c Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-InstanceActionsV221TestJSON-618012033-project Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 1ff38290-9d23-40c5-94be-14608f6e1902 could not be found. Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '1ff38290-9d23-40c5-94be-14608f6e1902'} Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ff38290-9d23-40c5-94be-14608f6e1902 could not be found. Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ff38290-9d23-40c5-94be-14608f6e1902 could not be found. Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:13:10.234718 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:13:10.241797 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:13:10.241797 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:13:10.241797 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:13:10.241797 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:13:10.241797 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:13:10.241797 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:13:10.241797 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ff38290-9d23-40c5-94be-14608f6e1902 could not be found. Jun 20 12:13:10.241797 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:13:10.241797 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bad858d9-28e4-4717-80e1-a1bb2c46bea6 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Returning 404 to user: Instance 1ff38290-9d23-40c5-94be-14608f6e1902 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:13:10.244755 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bad858d9-28e4-4717-80e1-a1bb2c46bea6 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] 10.222.0.27 "GET /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902" status: 404 len: 111 microversion: 2.21 time: 0.177143 Jun 20 12:13:10.244755 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1799/3534] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:10 2022] GET /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902 => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:13:10.253756 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0446c305-59d6-4d2c-a06c-ca3115b7fb46 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-2124336064", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "e52cf695-08a7-4228-8afa-64520bdba860"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:13:10.387118 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-0446c305-59d6-4d2c-a06c-ca3115b7fb46 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] validate_networks() for [('e52cf695-08a7-4228-8afa-64520bdba860', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:13:10.773340 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=26 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:13:11.695086 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-0446c305-59d6-4d2c-a06c-ca3115b7fb46 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:13:11.695841 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-0446c305-59d6-4d2c-a06c-ca3115b7fb46 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:13:11.696133 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-0446c305-59d6-4d2c-a06c-ca3115b7fb46 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:13:11.696784 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-0446c305-59d6-4d2c-a06c-ca3115b7fb46 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:13:11.697434 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-0446c305-59d6-4d2c-a06c-ca3115b7fb46 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:13:11.721074 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0446c305-59d6-4d2c-a06c-ca3115b7fb46 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:11.722191 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0446c305-59d6-4d2c-a06c-ca3115b7fb46 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:11.728344 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0446c305-59d6-4d2c-a06c-ca3115b7fb46 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:11.730238 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0446c305-59d6-4d2c-a06c-ca3115b7fb46 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:11.791407 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-42dc327d-12e4-48fa-9fe9-06defec4bc77 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:13:11.792116 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-42dc327d-12e4-48fa-9fe9-06defec4bc77 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:13:11.793367 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-42dc327d-12e4-48fa-9fe9-06defec4bc77 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:13:11.795033 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-42dc327d-12e4-48fa-9fe9-06defec4bc77 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:13:11.795899 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-42dc327d-12e4-48fa-9fe9-06defec4bc77 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:13:11.816731 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-0446c305-59d6-4d2c-a06c-ca3115b7fb46 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Getting quotas for project 6b5ce0a299ef4e10be4dccca2ef8b957. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:13:11.831260 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-0446c305-59d6-4d2c-a06c-ca3115b7fb46 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Getting quotas for user 0e4a7cec6b754f4095917bb4cb9ee283 and project 6b5ce0a299ef4e10be4dccca2ef8b957. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:13:11.838468 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-42dc327d-12e4-48fa-9fe9-06defec4bc77 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:11.841015 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-42dc327d-12e4-48fa-9fe9-06defec4bc77 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:11.843152 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-42dc327d-12e4-48fa-9fe9-06defec4bc77 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:11.849298 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-42dc327d-12e4-48fa-9fe9-06defec4bc77 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:11.875370 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0446c305-59d6-4d2c-a06c-ca3115b7fb46 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:13:11.884441 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0446c305-59d6-4d2c-a06c-ca3115b7fb46 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: 71b51f0c-5366-4aa8-86dc-753f55c21590] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:13:11.932086 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-42dc327d-12e4-48fa-9fe9-06defec4bc77 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Getting quotas for project b0d48009b1164cf3a605b30513636e4d. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:13:11.944912 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-42dc327d-12e4-48fa-9fe9-06defec4bc77 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Getting quotas for user aa6f744fe3e8403ea1960856026abe61 and project b0d48009b1164cf3a605b30513636e4d. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:13:11.997868 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-42dc327d-12e4-48fa-9fe9-06defec4bc77 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:13:12.004390 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-42dc327d-12e4-48fa-9fe9-06defec4bc77 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:13:12.048217 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0446c305-59d6-4d2c-a06c-ca3115b7fb46 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.801389 Jun 20 12:13:12.053440 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1800/3535] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:13:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:13:12.066021 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-103e2190-952a-406d-889b-46a85336a131 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Calling method '.version_select at 0x7f60736df8b0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:12.066980 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-103e2190-952a-406d-889b-46a85336a131 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] [instance: 1ff38290-9d23-40c5-94be-14608f6e1902] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:12.075241 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-103e2190-952a-406d-889b-46a85336a131 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:12.075713 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-103e2190-952a-406d-889b-46a85336a131 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:12.076634 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-103e2190-952a-406d-889b-46a85336a131 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:12.077079 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-103e2190-952a-406d-889b-46a85336a131 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:12.130934 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-42dc327d-12e4-48fa-9fe9-06defec4bc77 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.517913 Jun 20 12:13:12.133077 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1736/3536] 10.222.0.27 () {62 vars in 1187 bytes} [Mon Jun 20 12:13:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 3530 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 20 12:13:12.144166 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-44007f55-117e-4841-8de1-ca6091d87de0 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:12.156905 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-44007f55-117e-4841-8de1-ca6091d87de0 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 2201b474-c2b7-4b6f-ba8c-b7b6ec3da862] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:12.167700 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-103e2190-952a-406d-889b-46a85336a131 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] 10.222.0.27 "GET /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.113058 Jun 20 12:13:12.168644 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1801/3537] 10.222.0.27 () {60 vars in 1336 bytes} [Mon Jun 20 12:13:12 2022] GET /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902/os-instance-actions => generated 611 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:13:12.179837 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-44007f55-117e-4841-8de1-ca6091d87de0 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:12.184646 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-44007f55-117e-4841-8de1-ca6091d87de0 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:12.187120 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-44007f55-117e-4841-8de1-ca6091d87de0 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:12.188076 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-44007f55-117e-4841-8de1-ca6091d87de0 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:12.192038 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2397a751-efd4-4261-a38f-9e345361e9df tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:12.201143 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2397a751-efd4-4261-a38f-9e345361e9df tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: 71b51f0c-5366-4aa8-86dc-753f55c21590] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:12.367099 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2397a751-efd4-4261-a38f-9e345361e9df tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4a7cec6b754f4095917bb4cb9ee283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5ce0a299ef4e10be4dccca2ef8b957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:12.394665 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2397a751-efd4-4261-a38f-9e345361e9df tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "GET /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590" status: 200 len: 1224 microversion: 2.1 time: 0.215778 Jun 20 12:13:12.422637 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1802/3538] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:12 2022] GET /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590 => generated 1224 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:12.460249 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-75c11469-9c0b-41f9-99da-2664588a0d27 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:12.464459 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-75c11469-9c0b-41f9-99da-2664588a0d27 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:12.726105 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-44007f55-117e-4841-8de1-ca6091d87de0 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:12.743356 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-44007f55-117e-4841-8de1-ca6091d87de0 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/2201b474-c2b7-4b6f-ba8c-b7b6ec3da862" status: 200 len: 1313 microversion: 2.1 time: 0.604761 Jun 20 12:13:12.749599 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1737/3539] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:12 2022] GET /compute/v2.1/servers/2201b474-c2b7-4b6f-ba8c-b7b6ec3da862 => generated 1313 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:12.762557 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0a8bb195-4042-48e7-9149-5af15f3ea7f9 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:12.763395 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0a8bb195-4042-48e7-9149-5af15f3ea7f9 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] [instance: 1ff38290-9d23-40c5-94be-14608f6e1902] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:12.799288 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a8bb195-4042-48e7-9149-5af15f3ea7f9 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:12.801206 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a8bb195-4042-48e7-9149-5af15f3ea7f9 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:12.802693 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a8bb195-4042-48e7-9149-5af15f3ea7f9 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:12.803674 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a8bb195-4042-48e7-9149-5af15f3ea7f9 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:12.805839 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-75c11469-9c0b-41f9-99da-2664588a0d27 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:12.845669 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-75c11469-9c0b-41f9-99da-2664588a0d27 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:12.852105 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-0a8bb195-4042-48e7-9149-5af15f3ea7f9 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] HTTP exception thrown: Instance 1ff38290-9d23-40c5-94be-14608f6e1902 could not be found. Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0a8bb195-4042-48e7-9149-5af15f3ea7f9 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Request method failure captured: Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902 HTTP/1.1 Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGQ09s6MXA5FSipPqmRmofz_2WYrGx-lFwdh-afhvAStv8gAq5iLf9xLPJLDaKNMp8hriwH2OnCY3NtQVtdgkXGwnTDGHxS-nIMq40hkd_QZUUzoMOu5BUBFxdQSm378F6m9oCjOVA5fi2n2ttjol0nNej65RD1JbCIRu930BWOdxBg Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: X-Openstack-Nova-Api-Version: 2.21 Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 604fcdefd2244bdbaa79919d2bb49ed9 Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-InstanceActionsV221TestJSON-618012033 Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/604fcdefd2244bdbaa79919d2bb49ed9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/604fcdefd2244bdbaa79919d2bb49ed9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/604fcdefd2244bdbaa79919d2bb49ed9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_604fcdefd2244bdbaa79919d2bb49ed9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-InstanceActionsV221TestJSON-618012033 Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 604fcdefd2244bdbaa79919d2bb49ed9 Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-618012033 Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-InstanceActionsV221TestJSON-618012033-project Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 18485f98265e4c4abfc8b6da093d3a0c Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-InstanceActionsV221TestJSON-618012033-project Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 1ff38290-9d23-40c5-94be-14608f6e1902 could not be found. Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '1ff38290-9d23-40c5-94be-14608f6e1902'} Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ff38290-9d23-40c5-94be-14608f6e1902 could not be found. Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:13:12.854069 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:13:12.860897 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ff38290-9d23-40c5-94be-14608f6e1902 could not be found. Jun 20 12:13:12.860897 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:13:12.860897 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:13:12.860897 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:13:12.860897 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:13:12.860897 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:13:12.860897 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:13:12.860897 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:13:12.860897 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:13:12.860897 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ff38290-9d23-40c5-94be-14608f6e1902 could not be found. Jun 20 12:13:12.860897 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:13:12.863072 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-75c11469-9c0b-41f9-99da-2664588a0d27 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:12.864244 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-75c11469-9c0b-41f9-99da-2664588a0d27 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1282 microversion: 2.20 time: 0.435575 Jun 20 12:13:12.865936 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0a8bb195-4042-48e7-9149-5af15f3ea7f9 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Returning 404 to user: Instance 1ff38290-9d23-40c5-94be-14608f6e1902 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:13:12.867786 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0a8bb195-4042-48e7-9149-5af15f3ea7f9 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902" status: 404 len: 111 microversion: 2.21 time: 0.114489 Jun 20 12:13:12.869110 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1738/3540] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Jun 20 12:13:12 2022] DELETE /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:13:12.882236 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1803/3541] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:12 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1282 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:13:12.885251 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4ee824cc-e1d0-4a80-add0-c36568cc6ab4 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:12.886214 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4ee824cc-e1d0-4a80-add0-c36568cc6ab4 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] [instance: 1ff38290-9d23-40c5-94be-14608f6e1902] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:12.922550 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ee824cc-e1d0-4a80-add0-c36568cc6ab4 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:12.923819 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ee824cc-e1d0-4a80-add0-c36568cc6ab4 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:12.928617 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ee824cc-e1d0-4a80-add0-c36568cc6ab4 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:12.930495 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ee824cc-e1d0-4a80-add0-c36568cc6ab4 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:12.961219 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-4ee824cc-e1d0-4a80-add0-c36568cc6ab4 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] HTTP exception thrown: Instance 1ff38290-9d23-40c5-94be-14608f6e1902 could not be found. Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4ee824cc-e1d0-4a80-add0-c36568cc6ab4 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Request method failure captured: Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902 HTTP/1.1 Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGQ09s6MXA5FSipPqmRmofz_2WYrGx-lFwdh-afhvAStv8gAq5iLf9xLPJLDaKNMp8hriwH2OnCY3NtQVtdgkXGwnTDGHxS-nIMq40hkd_QZUUzoMOu5BUBFxdQSm378F6m9oCjOVA5fi2n2ttjol0nNej65RD1JbCIRu930BWOdxBg Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: X-Openstack-Nova-Api-Version: 2.21 Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 604fcdefd2244bdbaa79919d2bb49ed9 Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-InstanceActionsV221TestJSON-618012033 Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/604fcdefd2244bdbaa79919d2bb49ed9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/604fcdefd2244bdbaa79919d2bb49ed9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/604fcdefd2244bdbaa79919d2bb49ed9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_604fcdefd2244bdbaa79919d2bb49ed9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-InstanceActionsV221TestJSON-618012033 Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 604fcdefd2244bdbaa79919d2bb49ed9 Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-618012033 Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-InstanceActionsV221TestJSON-618012033-project Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 18485f98265e4c4abfc8b6da093d3a0c Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-InstanceActionsV221TestJSON-618012033-project Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 1ff38290-9d23-40c5-94be-14608f6e1902 could not be found. Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '1ff38290-9d23-40c5-94be-14608f6e1902'} Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ff38290-9d23-40c5-94be-14608f6e1902 could not be found. Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ff38290-9d23-40c5-94be-14608f6e1902 could not be found. Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:13:12.966681 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:13:12.985338 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:13:12.985338 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:13:12.985338 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:13:12.985338 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:13:12.985338 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:13:12.985338 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:13:12.985338 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ff38290-9d23-40c5-94be-14608f6e1902 could not be found. Jun 20 12:13:12.985338 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:13:12.989831 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4ee824cc-e1d0-4a80-add0-c36568cc6ab4 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] Returning 404 to user: Instance 1ff38290-9d23-40c5-94be-14608f6e1902 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:13:12.992117 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4ee824cc-e1d0-4a80-add0-c36568cc6ab4 tempest-InstanceActionsV221TestJSON-618012033 tempest-InstanceActionsV221TestJSON-618012033-project] 10.222.0.27 "GET /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902" status: 404 len: 111 microversion: 2.21 time: 0.115963 Jun 20 12:13:12.994358 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1739/3542] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:12 2022] GET /compute/v2.1/servers/1ff38290-9d23-40c5-94be-14608f6e1902 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 20 12:13:13.415287 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-990b427a-e86d-417d-8729-3f98855a8058 req-fafecc02-0322-4ea1-b374-2c2a7288852f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2201b474-c2b7-4b6f-ba8c-b7b6ec3da862", "name": "network-vif-plugged", "status": "completed", "tag": "fdef86ed-bdd1-46e5-9f16-c2ce23d27385"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:13:13.431088 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9c9e1c15-1e57-4bc8-bc4e-7bdf12499e0d tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:13.431720 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9c9e1c15-1e57-4bc8-bc4e-7bdf12499e0d tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: 71b51f0c-5366-4aa8-86dc-753f55c21590] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:13.471836 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-990b427a-e86d-417d-8729-3f98855a8058 req-fafecc02-0322-4ea1-b374-2c2a7288852f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:13.474048 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-990b427a-e86d-417d-8729-3f98855a8058 req-fafecc02-0322-4ea1-b374-2c2a7288852f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:13.524224 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-990b427a-e86d-417d-8729-3f98855a8058 req-fafecc02-0322-4ea1-b374-2c2a7288852f service nova] Creating event network-vif-plugged:fdef86ed-bdd1-46e5-9f16-c2ce23d27385 for instance 2201b474-c2b7-4b6f-ba8c-b7b6ec3da862 on n-h2-master-1 Jun 20 12:13:13.534128 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-990b427a-e86d-417d-8729-3f98855a8058 req-fafecc02-0322-4ea1-b374-2c2a7288852f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127584 Jun 20 12:13:13.535491 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1804/3543] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:13:13.781702 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dad8ab1e-0a9a-420b-91f0-9e4997b242bd tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:13.782702 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dad8ab1e-0a9a-420b-91f0-9e4997b242bd tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 2201b474-c2b7-4b6f-ba8c-b7b6ec3da862] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:13.807841 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dad8ab1e-0a9a-420b-91f0-9e4997b242bd tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:13.814919 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dad8ab1e-0a9a-420b-91f0-9e4997b242bd tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:13.819962 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dad8ab1e-0a9a-420b-91f0-9e4997b242bd tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:13.826190 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dad8ab1e-0a9a-420b-91f0-9e4997b242bd tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:13.895444 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9c9e1c15-1e57-4bc8-bc4e-7bdf12499e0d tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4a7cec6b754f4095917bb4cb9ee283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5ce0a299ef4e10be4dccca2ef8b957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:13.937636 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9c9e1c15-1e57-4bc8-bc4e-7bdf12499e0d tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "GET /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590" status: 200 len: 1224 microversion: 2.1 time: 0.505961 Jun 20 12:13:13.954993 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1740/3544] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:13 2022] GET /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590 => generated 1224 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:13.968604 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-48e729d8-4c1b-4962-ab95-51d18f535b10 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:13.971026 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-48e729d8-4c1b-4962-ab95-51d18f535b10 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:13.998626 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-48e729d8-4c1b-4962-ab95-51d18f535b10 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:13.999476 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-48e729d8-4c1b-4962-ab95-51d18f535b10 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:14.005588 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-48e729d8-4c1b-4962-ab95-51d18f535b10 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:14.007492 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-48e729d8-4c1b-4962-ab95-51d18f535b10 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:14.195684 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-48e729d8-4c1b-4962-ab95-51d18f535b10 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:14.238052 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-48e729d8-4c1b-4962-ab95-51d18f535b10 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:14.245016 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-48e729d8-4c1b-4962-ab95-51d18f535b10 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:14.249108 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-48e729d8-4c1b-4962-ab95-51d18f535b10 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1334 microversion: 2.20 time: 0.294737 Jun 20 12:13:14.251447 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1741/3545] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:13 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1334 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:13:14.543217 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dad8ab1e-0a9a-420b-91f0-9e4997b242bd tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:14.546588 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:13:14.562525 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dad8ab1e-0a9a-420b-91f0-9e4997b242bd tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/2201b474-c2b7-4b6f-ba8c-b7b6ec3da862" status: 200 len: 1313 microversion: 2.1 time: 0.787970 Jun 20 12:13:14.567055 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1805/3546] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:13 2022] GET /compute/v2.1/servers/2201b474-c2b7-4b6f-ba8c-b7b6ec3da862 => generated 1313 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:14.964023 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-36a916b6-22be-4c01-9712-38cc203df17d tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:14.972566 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-36a916b6-22be-4c01-9712-38cc203df17d tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: 71b51f0c-5366-4aa8-86dc-753f55c21590] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:14.996374 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-36a916b6-22be-4c01-9712-38cc203df17d tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:14.997547 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-36a916b6-22be-4c01-9712-38cc203df17d tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:15.004288 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-36a916b6-22be-4c01-9712-38cc203df17d tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:15.010397 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-36a916b6-22be-4c01-9712-38cc203df17d tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:15.268347 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-36a916b6-22be-4c01-9712-38cc203df17d tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4a7cec6b754f4095917bb4cb9ee283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5ce0a299ef4e10be4dccca2ef8b957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:15.274538 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-603d24d2-efd0-4990-aa87-6e8bf6b0cb39 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:15.276538 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-603d24d2-efd0-4990-aa87-6e8bf6b0cb39 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:15.278495 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-36a916b6-22be-4c01-9712-38cc203df17d tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "GET /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590" status: 200 len: 1294 microversion: 2.1 time: 0.320283 Jun 20 12:13:15.291554 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1742/3547] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:14 2022] GET /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590 => generated 1294 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:15.294633 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-603d24d2-efd0-4990-aa87-6e8bf6b0cb39 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:15.295117 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-603d24d2-efd0-4990-aa87-6e8bf6b0cb39 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:15.296096 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-603d24d2-efd0-4990-aa87-6e8bf6b0cb39 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:15.296837 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-603d24d2-efd0-4990-aa87-6e8bf6b0cb39 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:15.472906 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-603d24d2-efd0-4990-aa87-6e8bf6b0cb39 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:15.490578 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-603d24d2-efd0-4990-aa87-6e8bf6b0cb39 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:15.495345 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-603d24d2-efd0-4990-aa87-6e8bf6b0cb39 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:15.500251 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-603d24d2-efd0-4990-aa87-6e8bf6b0cb39 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1340 microversion: 2.20 time: 0.229224 Jun 20 12:13:15.503463 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1806/3548] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:15 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1340 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:13:15.584332 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b5f2065d-6afc-4bb8-b245-c8bcf7d4a2d3 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:15.586619 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b5f2065d-6afc-4bb8-b245-c8bcf7d4a2d3 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 2201b474-c2b7-4b6f-ba8c-b7b6ec3da862] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:15.594707 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b5f2065d-6afc-4bb8-b245-c8bcf7d4a2d3 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:15.595392 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b5f2065d-6afc-4bb8-b245-c8bcf7d4a2d3 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:15.596267 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b5f2065d-6afc-4bb8-b245-c8bcf7d4a2d3 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:15.596912 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b5f2065d-6afc-4bb8-b245-c8bcf7d4a2d3 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:16.297748 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6a52aaf8-3763-4b6a-a906-44dbcc571c43 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:16.298502 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6a52aaf8-3763-4b6a-a906-44dbcc571c43 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: 71b51f0c-5366-4aa8-86dc-753f55c21590] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:16.305450 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6a52aaf8-3763-4b6a-a906-44dbcc571c43 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:16.306057 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6a52aaf8-3763-4b6a-a906-44dbcc571c43 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:16.307010 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6a52aaf8-3763-4b6a-a906-44dbcc571c43 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:16.307465 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6a52aaf8-3763-4b6a-a906-44dbcc571c43 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:16.531045 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b5f2065d-6afc-4bb8-b245-c8bcf7d4a2d3 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:16.542147 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b5f2065d-6afc-4bb8-b245-c8bcf7d4a2d3 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/2201b474-c2b7-4b6f-ba8c-b7b6ec3da862" status: 200 len: 1313 microversion: 2.1 time: 0.962514 Jun 20 12:13:16.544470 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1743/3549] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:15 2022] GET /compute/v2.1/servers/2201b474-c2b7-4b6f-ba8c-b7b6ec3da862 => generated 1313 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:16.557026 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6a52aaf8-3763-4b6a-a906-44dbcc571c43 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4a7cec6b754f4095917bb4cb9ee283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5ce0a299ef4e10be4dccca2ef8b957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:16.557997 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-870491e3-cd5a-49a2-bc20-046440ba7afb tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:16.558877 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-870491e3-cd5a-49a2-bc20-046440ba7afb tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:16.577036 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-870491e3-cd5a-49a2-bc20-046440ba7afb tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:16.578214 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-870491e3-cd5a-49a2-bc20-046440ba7afb tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:16.579135 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6a52aaf8-3763-4b6a-a906-44dbcc571c43 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "GET /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590" status: 200 len: 1282 microversion: 2.1 time: 0.285447 Jun 20 12:13:16.580254 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-870491e3-cd5a-49a2-bc20-046440ba7afb tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:16.581407 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-870491e3-cd5a-49a2-bc20-046440ba7afb tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:16.584975 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1807/3550] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:16 2022] GET /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590 => generated 1282 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:13:16.779386 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-870491e3-cd5a-49a2-bc20-046440ba7afb tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:16.795579 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-870491e3-cd5a-49a2-bc20-046440ba7afb tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:16.797720 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-870491e3-cd5a-49a2-bc20-046440ba7afb tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:16.810078 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-870491e3-cd5a-49a2-bc20-046440ba7afb tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1340 microversion: 2.20 time: 0.262194 Jun 20 12:13:16.811677 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1744/3551] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:16 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1340 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:13:17.564573 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-441dfaf7-3eb6-4ab3-aa79-c18c3ea76989 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:17.566198 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-441dfaf7-3eb6-4ab3-aa79-c18c3ea76989 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 2201b474-c2b7-4b6f-ba8c-b7b6ec3da862] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:17.581694 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-441dfaf7-3eb6-4ab3-aa79-c18c3ea76989 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:17.585355 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-441dfaf7-3eb6-4ab3-aa79-c18c3ea76989 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:17.588238 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-441dfaf7-3eb6-4ab3-aa79-c18c3ea76989 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:17.592327 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-441dfaf7-3eb6-4ab3-aa79-c18c3ea76989 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:17.606652 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-97484d6f-3790-4758-ac9e-a2c28cfcc00f tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:17.611074 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-97484d6f-3790-4758-ac9e-a2c28cfcc00f tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: 71b51f0c-5366-4aa8-86dc-753f55c21590] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:17.628286 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-97484d6f-3790-4758-ac9e-a2c28cfcc00f tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:17.629441 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-97484d6f-3790-4758-ac9e-a2c28cfcc00f tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:17.634658 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-97484d6f-3790-4758-ac9e-a2c28cfcc00f tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:17.639715 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-97484d6f-3790-4758-ac9e-a2c28cfcc00f tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:17.973728 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-97484d6f-3790-4758-ac9e-a2c28cfcc00f tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4a7cec6b754f4095917bb4cb9ee283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5ce0a299ef4e10be4dccca2ef8b957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:18.001882 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-97484d6f-3790-4758-ac9e-a2c28cfcc00f tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "GET /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590" status: 200 len: 1282 microversion: 2.1 time: 0.401701 Jun 20 12:13:18.021658 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1745/3552] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:17 2022] GET /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590 => generated 1282 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:18.031109 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7c27da68-16e7-4ad9-ba07-ea04e243efe9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:18.038106 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7c27da68-16e7-4ad9-ba07-ea04e243efe9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:18.067408 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7c27da68-16e7-4ad9-ba07-ea04e243efe9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:18.069717 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7c27da68-16e7-4ad9-ba07-ea04e243efe9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:18.071333 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7c27da68-16e7-4ad9-ba07-ea04e243efe9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:18.072342 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7c27da68-16e7-4ad9-ba07-ea04e243efe9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:18.106400 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-441dfaf7-3eb6-4ab3-aa79-c18c3ea76989 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:18.153231 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-441dfaf7-3eb6-4ab3-aa79-c18c3ea76989 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/2201b474-c2b7-4b6f-ba8c-b7b6ec3da862" status: 200 len: 1463 microversion: 2.1 time: 0.591212 Jun 20 12:13:18.156163 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1808/3553] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:17 2022] GET /compute/v2.1/servers/2201b474-c2b7-4b6f-ba8c-b7b6ec3da862 => generated 1463 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:18.518580 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9472bfd4-1a9f-48e2-8473-a49f348f0f52 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:18.526219 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9472bfd4-1a9f-48e2-8473-a49f348f0f52 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Searching by: {'deleted': False, 'project_id': '598295307b8b4391a9afb3f1544a79d0'} {{(pid=119127) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:13:18.538500 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7c27da68-16e7-4ad9-ba07-ea04e243efe9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:18.546752 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9472bfd4-1a9f-48e2-8473-a49f348f0f52 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:18.548757 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9472bfd4-1a9f-48e2-8473-a49f348f0f52 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:18.550502 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7c27da68-16e7-4ad9-ba07-ea04e243efe9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:18.551317 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9472bfd4-1a9f-48e2-8473-a49f348f0f52 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:18.551827 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9472bfd4-1a9f-48e2-8473-a49f348f0f52 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:18.552081 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7c27da68-16e7-4ad9-ba07-ea04e243efe9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:18.574834 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7c27da68-16e7-4ad9-ba07-ea04e243efe9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1340 microversion: 2.20 time: 0.550178 Jun 20 12:13:18.582087 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1746/3554] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:18 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1340 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:13:18.624816 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9472bfd4-1a9f-48e2-8473-a49f348f0f52 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.449100 Jun 20 12:13:18.627539 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1809/3555] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 12:13:18 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:13:18.644393 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0cc420a5-8cca-4e41-9258-b9ebf7ff7a89 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:18.653787 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0cc420a5-8cca-4e41-9258-b9ebf7ff7a89 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Searching by: {'deleted': False} {{(pid=119128) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:13:18.670562 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cc420a5-8cca-4e41-9258-b9ebf7ff7a89 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:18.671559 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cc420a5-8cca-4e41-9258-b9ebf7ff7a89 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:18.676550 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cc420a5-8cca-4e41-9258-b9ebf7ff7a89 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:18.677866 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cc420a5-8cca-4e41-9258-b9ebf7ff7a89 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:18.987077 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.multi_cell_list [None req-0cc420a5-8cca-4e41-9258-b9ebf7ff7a89 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=119128) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 12:13:19.052156 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0faa0c25-946e-4dad-93cb-0f587e8cbb81 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:19.053150 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0faa0c25-946e-4dad-93cb-0f587e8cbb81 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: 71b51f0c-5366-4aa8-86dc-753f55c21590] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:19.099785 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0faa0c25-946e-4dad-93cb-0f587e8cbb81 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:19.101918 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0faa0c25-946e-4dad-93cb-0f587e8cbb81 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:19.105550 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0faa0c25-946e-4dad-93cb-0f587e8cbb81 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:19.108767 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0faa0c25-946e-4dad-93cb-0f587e8cbb81 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:19.355415 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cc420a5-8cca-4e41-9258-b9ebf7ff7a89 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:19.355782 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cc420a5-8cca-4e41-9258-b9ebf7ff7a89 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:19.466899 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0faa0c25-946e-4dad-93cb-0f587e8cbb81 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4a7cec6b754f4095917bb4cb9ee283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5ce0a299ef4e10be4dccca2ef8b957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:19.479070 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0faa0c25-946e-4dad-93cb-0f587e8cbb81 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "GET /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590" status: 200 len: 1324 microversion: 2.1 time: 0.443938 Jun 20 12:13:19.479748 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1810/3556] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:19 2022] GET /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590 => generated 1324 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:19.594262 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-597cbeee-5075-41be-8806-fd8029ceb4d0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:19.594872 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-597cbeee-5075-41be-8806-fd8029ceb4d0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:19.613443 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-597cbeee-5075-41be-8806-fd8029ceb4d0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:19.613903 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-597cbeee-5075-41be-8806-fd8029ceb4d0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:19.614731 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-597cbeee-5075-41be-8806-fd8029ceb4d0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:19.615174 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-597cbeee-5075-41be-8806-fd8029ceb4d0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:19.926108 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-597cbeee-5075-41be-8806-fd8029ceb4d0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:19.937081 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-597cbeee-5075-41be-8806-fd8029ceb4d0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:19.938900 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-597cbeee-5075-41be-8806-fd8029ceb4d0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:19.940376 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-597cbeee-5075-41be-8806-fd8029ceb4d0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1407 microversion: 2.20 time: 0.350191 Jun 20 12:13:19.941467 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1811/3557] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:19 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1407 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:13:20.149132 n-d-master-1 devstack@n-api.service[119127]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 12:13:20.149759 n-d-master-1 devstack@n-api.service[119127]: Mon Jun 20 12:13:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 12:13:20.498211 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e5adc54f-68c0-49cf-8db1-6c9fe2c0ca26 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:20.499293 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e5adc54f-68c0-49cf-8db1-6c9fe2c0ca26 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: 71b51f0c-5366-4aa8-86dc-753f55c21590] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:20.512422 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e5adc54f-68c0-49cf-8db1-6c9fe2c0ca26 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:20.513875 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e5adc54f-68c0-49cf-8db1-6c9fe2c0ca26 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:20.516549 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e5adc54f-68c0-49cf-8db1-6c9fe2c0ca26 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:20.517214 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e5adc54f-68c0-49cf-8db1-6c9fe2c0ca26 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:20.897256 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e5adc54f-68c0-49cf-8db1-6c9fe2c0ca26 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4a7cec6b754f4095917bb4cb9ee283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5ce0a299ef4e10be4dccca2ef8b957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:20.907920 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e5adc54f-68c0-49cf-8db1-6c9fe2c0ca26 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "GET /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590" status: 200 len: 1324 microversion: 2.1 time: 0.414076 Jun 20 12:13:20.918381 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1812/3558] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:20 2022] GET /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590 => generated 1324 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:13:20.960880 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-222192e8-4b4d-45e7-8595-65ee9b5439dc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:20.961597 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-222192e8-4b4d-45e7-8595-65ee9b5439dc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:20.982740 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-222192e8-4b4d-45e7-8595-65ee9b5439dc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:20.983245 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-222192e8-4b4d-45e7-8595-65ee9b5439dc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:20.985675 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-222192e8-4b4d-45e7-8595-65ee9b5439dc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:20.986889 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-222192e8-4b4d-45e7-8595-65ee9b5439dc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:21.383208 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-222192e8-4b4d-45e7-8595-65ee9b5439dc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:21.396220 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-222192e8-4b4d-45e7-8595-65ee9b5439dc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:21.401381 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-222192e8-4b4d-45e7-8595-65ee9b5439dc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:21.404494 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-222192e8-4b4d-45e7-8595-65ee9b5439dc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1407 microversion: 2.20 time: 0.449393 Jun 20 12:13:21.416600 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1813/3559] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:20 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1407 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:13:21.926823 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-06d7bd79-4796-4c47-8e2a-cad3ef235da2 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:21.933286 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-06d7bd79-4796-4c47-8e2a-cad3ef235da2 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: 71b51f0c-5366-4aa8-86dc-753f55c21590] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:21.948664 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06d7bd79-4796-4c47-8e2a-cad3ef235da2 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:21.949949 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06d7bd79-4796-4c47-8e2a-cad3ef235da2 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:21.952040 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06d7bd79-4796-4c47-8e2a-cad3ef235da2 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:21.952731 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06d7bd79-4796-4c47-8e2a-cad3ef235da2 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:22.292080 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-06d7bd79-4796-4c47-8e2a-cad3ef235da2 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4a7cec6b754f4095917bb4cb9ee283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5ce0a299ef4e10be4dccca2ef8b957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:22.307245 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-06d7bd79-4796-4c47-8e2a-cad3ef235da2 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "GET /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590" status: 200 len: 1324 microversion: 2.1 time: 0.385472 Jun 20 12:13:22.308154 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1814/3560] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:21 2022] GET /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590 => generated 1324 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:22.423955 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-61a987dd-cf41-4093-bf06-8a393f139233 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:22.425081 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-61a987dd-cf41-4093-bf06-8a393f139233 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:22.438268 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-61a987dd-cf41-4093-bf06-8a393f139233 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:22.442384 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-61a987dd-cf41-4093-bf06-8a393f139233 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:22.446630 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-61a987dd-cf41-4093-bf06-8a393f139233 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:22.447113 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-61a987dd-cf41-4093-bf06-8a393f139233 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:22.747579 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-61a987dd-cf41-4093-bf06-8a393f139233 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:22.765780 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-61a987dd-cf41-4093-bf06-8a393f139233 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:22.768878 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-61a987dd-cf41-4093-bf06-8a393f139233 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:22.771178 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-61a987dd-cf41-4093-bf06-8a393f139233 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1407 microversion: 2.20 time: 0.351890 Jun 20 12:13:22.772112 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1815/3561] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:22 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1407 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:13:22.787177 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0cc420a5-8cca-4e41-9258-b9ebf7ff7a89 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 12403 microversion: 2.1 time: 4.147387 Jun 20 12:13:22.794077 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1747/3562] 10.222.0.27 () {58 vars in 1170 bytes} [Mon Jun 20 12:13:18 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 12403 bytes in 4155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 12:13:22.815992 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f2842e8b-ba7e-4e94-93c1-096b38b8ec67 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:22.820514 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f2842e8b-ba7e-4e94-93c1-096b38b8ec67 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Searching by: {'deleted': False, 'project_id': '598295307b8b4391a9afb3f1544a79d0'} {{(pid=119127) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:13:22.823266 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=10 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:13:22.831486 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f2842e8b-ba7e-4e94-93c1-096b38b8ec67 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:22.831947 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f2842e8b-ba7e-4e94-93c1-096b38b8ec67 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:22.832788 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f2842e8b-ba7e-4e94-93c1-096b38b8ec67 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:22.833226 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f2842e8b-ba7e-4e94-93c1-096b38b8ec67 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:22.901005 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f2842e8b-ba7e-4e94-93c1-096b38b8ec67 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?tenant_id=df4cb5022443461395424ace464a41e6" status: 200 len: 15 microversion: 2.1 time: 0.088947 Jun 20 12:13:22.902227 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1816/3563] 10.222.0.27 () {58 vars in 1230 bytes} [Mon Jun 20 12:13:22 2022] GET /compute/v2.1/servers/detail?tenant_id=df4cb5022443461395424ace464a41e6 => generated 15 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:13:22.918727 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9f7c001d-ad9f-4ff7-999e-c8a1709fcbf6 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:22.923430 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9f7c001d-ad9f-4ff7-999e-c8a1709fcbf6 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Searching by: {'tenant_id': 'df4cb5022443461395424ace464a41e6', 'deleted': False} {{(pid=119128) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:13:22.937994 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9f7c001d-ad9f-4ff7-999e-c8a1709fcbf6 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:22.938444 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9f7c001d-ad9f-4ff7-999e-c8a1709fcbf6 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:22.939257 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9f7c001d-ad9f-4ff7-999e-c8a1709fcbf6 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:22.939930 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9f7c001d-ad9f-4ff7-999e-c8a1709fcbf6 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:23.298875 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.multi_cell_list [None req-9f7c001d-ad9f-4ff7-999e-c8a1709fcbf6 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119128) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 12:13:23.327435 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-917d682a-cfc4-4810-9570-3d4e6608b049 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:23.328466 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-917d682a-cfc4-4810-9570-3d4e6608b049 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: 71b51f0c-5366-4aa8-86dc-753f55c21590] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:23.340359 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-917d682a-cfc4-4810-9570-3d4e6608b049 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:23.340817 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-917d682a-cfc4-4810-9570-3d4e6608b049 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:23.341677 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-917d682a-cfc4-4810-9570-3d4e6608b049 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:23.342137 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-917d682a-cfc4-4810-9570-3d4e6608b049 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:23.454503 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:13:23.502224 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9f7c001d-ad9f-4ff7-999e-c8a1709fcbf6 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:23.504304 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9f7c001d-ad9f-4ff7-999e-c8a1709fcbf6 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:23.801490 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-917d682a-cfc4-4810-9570-3d4e6608b049 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4a7cec6b754f4095917bb4cb9ee283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5ce0a299ef4e10be4dccca2ef8b957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:23.812595 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-917d682a-cfc4-4810-9570-3d4e6608b049 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "GET /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590" status: 200 len: 1324 microversion: 2.1 time: 0.490545 Jun 20 12:13:23.814107 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1817/3564] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:23 2022] GET /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590 => generated 1324 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:23.829256 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1cd3fbb0-9273-4803-8ace-da3b8fc7e472 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:23.830146 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1cd3fbb0-9273-4803-8ace-da3b8fc7e472 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:23.848094 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1cd3fbb0-9273-4803-8ace-da3b8fc7e472 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:23.848921 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1cd3fbb0-9273-4803-8ace-da3b8fc7e472 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:23.849907 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1cd3fbb0-9273-4803-8ace-da3b8fc7e472 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:23.852133 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1cd3fbb0-9273-4803-8ace-da3b8fc7e472 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:24.195901 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1cd3fbb0-9273-4803-8ace-da3b8fc7e472 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:24.215815 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1cd3fbb0-9273-4803-8ace-da3b8fc7e472 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:24.225983 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1cd3fbb0-9273-4803-8ace-da3b8fc7e472 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:24.229372 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1cd3fbb0-9273-4803-8ace-da3b8fc7e472 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1407 microversion: 2.20 time: 0.413607 Jun 20 12:13:24.244278 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1818/3565] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:23 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1407 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:13:24.252809 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9f7c001d-ad9f-4ff7-999e-c8a1709fcbf6 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=df4cb5022443461395424ace464a41e6" status: 200 len: 4826 microversion: 2.1 time: 1.338592 Jun 20 12:13:24.253907 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1748/3566] 10.222.0.27 () {58 vars in 1256 bytes} [Mon Jun 20 12:13:22 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=df4cb5022443461395424ace464a41e6 => generated 4826 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:24.282913 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-23d4faa3-c5f5-442d-b26d-8ab936804a0f tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:24.288831 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-23d4faa3-c5f5-442d-b26d-8ab936804a0f tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Searching by: {'tenant_id': '598295307b8b4391a9afb3f1544a79d0', 'deleted': False} {{(pid=119127) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:13:24.296047 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-23d4faa3-c5f5-442d-b26d-8ab936804a0f tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:24.300060 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-23d4faa3-c5f5-442d-b26d-8ab936804a0f tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:24.301480 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-23d4faa3-c5f5-442d-b26d-8ab936804a0f tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:24.304371 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-23d4faa3-c5f5-442d-b26d-8ab936804a0f tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:24.386317 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-23d4faa3-c5f5-442d-b26d-8ab936804a0f tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=598295307b8b4391a9afb3f1544a79d0" status: 200 len: 15 microversion: 2.1 time: 0.108243 Jun 20 12:13:24.395915 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1819/3567] 10.222.0.27 () {58 vars in 1256 bytes} [Mon Jun 20 12:13:24 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=598295307b8b4391a9afb3f1544a79d0 => generated 15 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 20 12:13:24.421344 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0e4f7543-b567-4c93-880b-7e83f26fd36e tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:24.438143 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0e4f7543-b567-4c93-880b-7e83f26fd36e tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.021218 Jun 20 12:13:24.439044 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1749/3568] 10.222.0.27 () {58 vars in 1188 bytes} [Mon Jun 20 12:13:24 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:13:24.455410 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-67a723fc-3f12-4d17-b94a-9debed21fedf tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:13:24.456527 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-67a723fc-3f12-4d17-b94a-9debed21fedf tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:24.471722 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-67a723fc-3f12-4d17-b94a-9debed21fedf tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:24.472078 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-67a723fc-3f12-4d17-b94a-9debed21fedf tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:24.473113 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-67a723fc-3f12-4d17-b94a-9debed21fedf tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:24.473567 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-67a723fc-3f12-4d17-b94a-9debed21fedf tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:24.682533 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-67a723fc-3f12-4d17-b94a-9debed21fedf tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2/action" status: 202 len: 0 microversion: 2.1 time: 0.230957 Jun 20 12:13:24.683143 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1820/3569] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:13:24 2022] POST /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:13:24.695634 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7fdd1081-4b77-40a4-a8ff-cde98450615f tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:24.701677 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7fdd1081-4b77-40a4-a8ff-cde98450615f tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:24.702448 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7fdd1081-4b77-40a4-a8ff-cde98450615f tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'df4cb5022443461395424ace464a41e6'} {{(pid=119128) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:13:24.718337 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:13:24.742555 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7fdd1081-4b77-40a4-a8ff-cde98450615f tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:24.743010 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7fdd1081-4b77-40a4-a8ff-cde98450615f tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:24.743828 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7fdd1081-4b77-40a4-a8ff-cde98450615f tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:24.744294 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7fdd1081-4b77-40a4-a8ff-cde98450615f tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:24.842284 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-96cbe677-4ed9-446e-8818-d90272dc3806 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:24.842931 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-96cbe677-4ed9-446e-8818-d90272dc3806 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: 71b51f0c-5366-4aa8-86dc-753f55c21590] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:24.869499 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-96cbe677-4ed9-446e-8818-d90272dc3806 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:24.882640 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-96cbe677-4ed9-446e-8818-d90272dc3806 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:24.883569 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-96cbe677-4ed9-446e-8818-d90272dc3806 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:24.884027 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-96cbe677-4ed9-446e-8818-d90272dc3806 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:24.974509 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.multi_cell_list [None req-7fdd1081-4b77-40a4-a8ff-cde98450615f tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119128) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 12:13:25.089914 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7fdd1081-4b77-40a4-a8ff-cde98450615f tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.401649 Jun 20 12:13:25.090980 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1750/3570] 10.222.0.27 () {58 vars in 1149 bytes} [Mon Jun 20 12:13:24 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:13:25.103820 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-53db7a09-ad89-420b-81cb-821e1448704e tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:13:25.105156 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-53db7a09-ad89-420b-81cb-821e1448704e tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:25.117359 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-53db7a09-ad89-420b-81cb-821e1448704e tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:25.118269 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-53db7a09-ad89-420b-81cb-821e1448704e tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:25.119326 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-53db7a09-ad89-420b-81cb-821e1448704e tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:25.119970 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-53db7a09-ad89-420b-81cb-821e1448704e tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:25.319850 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-53db7a09-ad89-420b-81cb-821e1448704e tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2/action" status: 202 len: 0 microversion: 2.1 time: 0.221252 Jun 20 12:13:25.325152 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1751/3571] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:13:25 2022] POST /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:13:25.333999 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-27a369da-0167-4d9b-8ef6-f22659c7314d req-1fd16b7a-2597-4302-a04d-9a36e236d839 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71b51f0c-5366-4aa8-86dc-753f55c21590", "tag": "626fc638-ecf6-445b-92f4-0487f1f80338"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:13:25.344329 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-27a369da-0167-4d9b-8ef6-f22659c7314d req-1fd16b7a-2597-4302-a04d-9a36e236d839 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:25.346796 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-27a369da-0167-4d9b-8ef6-f22659c7314d req-1fd16b7a-2597-4302-a04d-9a36e236d839 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:25.387354 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-27a369da-0167-4d9b-8ef6-f22659c7314d req-1fd16b7a-2597-4302-a04d-9a36e236d839 service nova] Creating event network-changed:626fc638-ecf6-445b-92f4-0487f1f80338 for instance 71b51f0c-5366-4aa8-86dc-753f55c21590 on n-h1-master-1 Jun 20 12:13:25.396557 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-27a369da-0167-4d9b-8ef6-f22659c7314d req-1fd16b7a-2597-4302-a04d-9a36e236d839 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069285 Jun 20 12:13:25.398537 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1752/3572] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:13:25.409522 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-81b75852-96f4-4ceb-a2c7-c5030b3e5e28 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:25.421994 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-81b75852-96f4-4ceb-a2c7-c5030b3e5e28 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:25.439948 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-81b75852-96f4-4ceb-a2c7-c5030b3e5e28 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:25.442708 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-81b75852-96f4-4ceb-a2c7-c5030b3e5e28 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:25.445022 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-81b75852-96f4-4ceb-a2c7-c5030b3e5e28 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:25.446245 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-81b75852-96f4-4ceb-a2c7-c5030b3e5e28 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:25.516499 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-96cbe677-4ed9-446e-8818-d90272dc3806 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4a7cec6b754f4095917bb4cb9ee283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5ce0a299ef4e10be4dccca2ef8b957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:25.538821 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-96cbe677-4ed9-446e-8818-d90272dc3806 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "GET /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590" status: 200 len: 1324 microversion: 2.1 time: 0.708968 Jun 20 12:13:25.539627 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1821/3573] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:24 2022] GET /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590 => generated 1324 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:25.549872 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e9a70835-7ca1-4ea6-b49e-de169901689c tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:25.550793 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e9a70835-7ca1-4ea6-b49e-de169901689c tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:25.567211 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e9a70835-7ca1-4ea6-b49e-de169901689c tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:25.567759 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e9a70835-7ca1-4ea6-b49e-de169901689c tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:25.571687 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e9a70835-7ca1-4ea6-b49e-de169901689c tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:25.572929 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e9a70835-7ca1-4ea6-b49e-de169901689c tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:25.860351 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:13:25.866249 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e9a70835-7ca1-4ea6-b49e-de169901689c tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1614 microversion: 2.1 time: 0.325241 Jun 20 12:13:25.866945 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1822/3574] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:25 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1614 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:25.885082 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-72299ecc-198e-4bb7-96ff-9cccdda6cbdf tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:25.885973 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-72299ecc-198e-4bb7-96ff-9cccdda6cbdf tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:25.899516 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-72299ecc-198e-4bb7-96ff-9cccdda6cbdf tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:25.900305 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-72299ecc-198e-4bb7-96ff-9cccdda6cbdf tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:25.901518 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-72299ecc-198e-4bb7-96ff-9cccdda6cbdf tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:25.902158 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-72299ecc-198e-4bb7-96ff-9cccdda6cbdf tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:26.192733 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-72299ecc-198e-4bb7-96ff-9cccdda6cbdf tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1614 microversion: 2.1 time: 0.312919 Jun 20 12:13:26.194101 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1823/3575] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:25 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1614 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:26.210970 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2d75f36e-176a-46e9-a084-5ebeacceedeb tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:26.216525 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2d75f36e-176a-46e9-a084-5ebeacceedeb tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Searching by: {'host': 'n-h2-master-1', 'deleted': False} {{(pid=119127) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:13:26.222355 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2d75f36e-176a-46e9-a084-5ebeacceedeb tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:26.223802 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2d75f36e-176a-46e9-a084-5ebeacceedeb tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:26.224869 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2d75f36e-176a-46e9-a084-5ebeacceedeb tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:26.225624 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2d75f36e-176a-46e9-a084-5ebeacceedeb tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:26.339995 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.multi_cell_list [None req-2d75f36e-176a-46e9-a084-5ebeacceedeb tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119127) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 12:13:26.409003 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2d75f36e-176a-46e9-a084-5ebeacceedeb tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] 10.222.0.27 "GET /compute/v2.1/servers?host=n-h2-master-1&all_tenants=1" status: 200 len: 663 microversion: 2.1 time: 0.202042 Jun 20 12:13:26.415047 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1824/3576] 10.222.0.27 () {58 vars in 1189 bytes} [Mon Jun 20 12:13:26 2022] GET /compute/v2.1/servers?host=n-h2-master-1&all_tenants=1 => generated 663 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:13:26.421349 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-13a660fd-a875-4591-8048-3eccf743dade tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:26.426503 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-13a660fd-a875-4591-8048-3eccf743dade tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=119127) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:13:26.432621 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-13a660fd-a875-4591-8048-3eccf743dade tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:26.433266 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-13a660fd-a875-4591-8048-3eccf743dade tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:26.434287 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-13a660fd-a875-4591-8048-3eccf743dade tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:26.435059 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-13a660fd-a875-4591-8048-3eccf743dade tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:26.485447 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-13a660fd-a875-4591-8048-3eccf743dade tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] 10.222.0.27 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.067184 Jun 20 12:13:26.489660 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1825/3577] 10.222.0.27 () {58 vars in 1195 bytes} [Mon Jun 20 12:13:26 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:13:26.507007 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-11b8e605-3aa1-4059-9e4a-28b891d032f9 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:13:26.508905 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-11b8e605-3aa1-4059-9e4a-28b891d032f9 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:26.521164 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11b8e605-3aa1-4059-9e4a-28b891d032f9 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:26.522394 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11b8e605-3aa1-4059-9e4a-28b891d032f9 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:26.523435 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11b8e605-3aa1-4059-9e4a-28b891d032f9 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:26.533931 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11b8e605-3aa1-4059-9e4a-28b891d032f9 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:26.672626 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-81b75852-96f4-4ceb-a2c7-c5030b3e5e28 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:26.692778 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-11b8e605-3aa1-4059-9e4a-28b891d032f9 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2/action" status: 202 len: 0 microversion: 2.1 time: 0.195608 Jun 20 12:13:26.693430 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-81b75852-96f4-4ceb-a2c7-c5030b3e5e28 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:26.693615 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1826/3578] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:13:26 2022] POST /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:13:26.697432 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-81b75852-96f4-4ceb-a2c7-c5030b3e5e28 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:26.697432 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-81b75852-96f4-4ceb-a2c7-c5030b3e5e28 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1407 microversion: 2.20 time: 1.297004 Jun 20 12:13:26.708102 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1753/3579] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:25 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1407 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:13:26.712458 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-85e21b68-15a5-40d0-9ecb-89725a75b889 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:26.713580 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-85e21b68-15a5-40d0-9ecb-89725a75b889 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: 71b51f0c-5366-4aa8-86dc-753f55c21590] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:26.725022 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-85e21b68-15a5-40d0-9ecb-89725a75b889 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:26.726994 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-85e21b68-15a5-40d0-9ecb-89725a75b889 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:26.728151 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-85e21b68-15a5-40d0-9ecb-89725a75b889 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:26.728847 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-85e21b68-15a5-40d0-9ecb-89725a75b889 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:26.729893 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-94b67703-cd77-463a-ba6f-fb5729890f35 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:13:26.733081 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-94b67703-cd77-463a-ba6f-fb5729890f35 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:26.753078 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94b67703-cd77-463a-ba6f-fb5729890f35 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:26.756371 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94b67703-cd77-463a-ba6f-fb5729890f35 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:26.765240 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94b67703-cd77-463a-ba6f-fb5729890f35 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:26.766096 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94b67703-cd77-463a-ba6f-fb5729890f35 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:26.925359 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-94b67703-cd77-463a-ba6f-fb5729890f35 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:13:26.951636 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-94b67703-cd77-463a-ba6f-fb5729890f35 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:13:26.955119 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-94b67703-cd77-463a-ba6f-fb5729890f35 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:13:26.960492 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-94b67703-cd77-463a-ba6f-fb5729890f35 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:13:26.962543 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-94b67703-cd77-463a-ba6f-fb5729890f35 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:13:27.145525 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-94b67703-cd77-463a-ba6f-fb5729890f35 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:27.150500 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-85e21b68-15a5-40d0-9ecb-89725a75b889 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4a7cec6b754f4095917bb4cb9ee283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5ce0a299ef4e10be4dccca2ef8b957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:27.151864 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94b67703-cd77-463a-ba6f-fb5729890f35 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:27.152360 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94b67703-cd77-463a-ba6f-fb5729890f35 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:27.153180 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94b67703-cd77-463a-ba6f-fb5729890f35 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:27.153696 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94b67703-cd77-463a-ba6f-fb5729890f35 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:27.164647 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-85e21b68-15a5-40d0-9ecb-89725a75b889 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "GET /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590" status: 200 len: 1324 microversion: 2.1 time: 0.463757 Jun 20 12:13:27.166603 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1827/3580] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:26 2022] GET /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590 => generated 1324 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:27.254041 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-94b67703-cd77-463a-ba6f-fb5729890f35 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "POST /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2/action" status: 202 len: 1067 microversion: 2.1 time: 0.542293 Jun 20 12:13:27.256868 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1754/3581] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:13:26 2022] POST /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2/action => generated 1067 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jun 20 12:13:27.270336 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7109fd70-7461-4830-a3b4-a79cbb812559 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:27.271219 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7109fd70-7461-4830-a3b4-a79cbb812559 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:27.285048 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7109fd70-7461-4830-a3b4-a79cbb812559 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:27.285778 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7109fd70-7461-4830-a3b4-a79cbb812559 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:27.289805 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7109fd70-7461-4830-a3b4-a79cbb812559 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:27.290142 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7109fd70-7461-4830-a3b4-a79cbb812559 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:27.435573 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-abdfb8c7-229b-4ceb-96fb-b94db1ecdb56 req-29885dcf-8762-4894-9350-fd06e5c0c11c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc", "tag": "4b0b8cf9-ff46-4970-9b45-8795ce12a358"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:13:27.444374 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-abdfb8c7-229b-4ceb-96fb-b94db1ecdb56 req-29885dcf-8762-4894-9350-fd06e5c0c11c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:27.444853 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-abdfb8c7-229b-4ceb-96fb-b94db1ecdb56 req-29885dcf-8762-4894-9350-fd06e5c0c11c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:27.477215 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-abdfb8c7-229b-4ceb-96fb-b94db1ecdb56 req-29885dcf-8762-4894-9350-fd06e5c0c11c service nova] Creating event network-changed:4b0b8cf9-ff46-4970-9b45-8795ce12a358 for instance 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc on n-h1-master-1 Jun 20 12:13:27.490949 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-abdfb8c7-229b-4ceb-96fb-b94db1ecdb56 req-29885dcf-8762-4894-9350-fd06e5c0c11c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058978 Jun 20 12:13:27.491535 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1755/3582] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:13:27.650225 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7109fd70-7461-4830-a3b4-a79cbb812559 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:27.665464 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7109fd70-7461-4830-a3b4-a79cbb812559 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1471 microversion: 2.1 time: 0.399911 Jun 20 12:13:27.690730 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1828/3583] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:27 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1471 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:27.715511 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-410ab7ff-d34d-49e1-b0e7-edd12b8317e6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:27.716372 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-410ab7ff-d34d-49e1-b0e7-edd12b8317e6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:27.730255 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-410ab7ff-d34d-49e1-b0e7-edd12b8317e6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:27.731467 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-410ab7ff-d34d-49e1-b0e7-edd12b8317e6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:27.732897 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-410ab7ff-d34d-49e1-b0e7-edd12b8317e6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:27.733578 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-410ab7ff-d34d-49e1-b0e7-edd12b8317e6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:27.961667 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-410ab7ff-d34d-49e1-b0e7-edd12b8317e6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:27.972868 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-410ab7ff-d34d-49e1-b0e7-edd12b8317e6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:27.975425 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-410ab7ff-d34d-49e1-b0e7-edd12b8317e6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:27.982366 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-410ab7ff-d34d-49e1-b0e7-edd12b8317e6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1407 microversion: 2.20 time: 0.265430 Jun 20 12:13:27.983338 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1756/3584] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:27 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1407 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:13:28.184093 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9c03a911-7b65-4cd6-ae53-049e4ca8134e tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:28.185440 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9c03a911-7b65-4cd6-ae53-049e4ca8134e tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: 71b51f0c-5366-4aa8-86dc-753f55c21590] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:28.195717 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9c03a911-7b65-4cd6-ae53-049e4ca8134e tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:28.196174 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9c03a911-7b65-4cd6-ae53-049e4ca8134e tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:28.196984 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9c03a911-7b65-4cd6-ae53-049e4ca8134e tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:28.197423 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9c03a911-7b65-4cd6-ae53-049e4ca8134e tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:28.641099 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9c03a911-7b65-4cd6-ae53-049e4ca8134e tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4a7cec6b754f4095917bb4cb9ee283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5ce0a299ef4e10be4dccca2ef8b957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:28.649056 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9c03a911-7b65-4cd6-ae53-049e4ca8134e tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "GET /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590" status: 200 len: 1324 microversion: 2.1 time: 0.469881 Jun 20 12:13:28.652929 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1829/3585] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:28 2022] GET /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590 => generated 1324 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:28.706212 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c0a5f7dc-b62f-4888-b368-49503828efd8 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:28.707139 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c0a5f7dc-b62f-4888-b368-49503828efd8 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:28.722656 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c0a5f7dc-b62f-4888-b368-49503828efd8 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:28.723405 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c0a5f7dc-b62f-4888-b368-49503828efd8 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:28.725032 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c0a5f7dc-b62f-4888-b368-49503828efd8 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:28.725657 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c0a5f7dc-b62f-4888-b368-49503828efd8 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:28.920229 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-81769aab-4409-4ada-8e2a-8af852ae24d7 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1679755901", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": "none"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:13:29.032341 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-81769aab-4409-4ada-8e2a-8af852ae24d7 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:13:29.032864 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-81769aab-4409-4ada-8e2a-8af852ae24d7 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:13:29.033363 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-81769aab-4409-4ada-8e2a-8af852ae24d7 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:13:29.033776 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-81769aab-4409-4ada-8e2a-8af852ae24d7 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:13:29.034192 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-81769aab-4409-4ada-8e2a-8af852ae24d7 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:13:29.059922 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-81769aab-4409-4ada-8e2a-8af852ae24d7 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:29.060566 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-81769aab-4409-4ada-8e2a-8af852ae24d7 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:29.061384 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-81769aab-4409-4ada-8e2a-8af852ae24d7 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:29.061821 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-81769aab-4409-4ada-8e2a-8af852ae24d7 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:29.104805 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-81769aab-4409-4ada-8e2a-8af852ae24d7 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Getting quotas for project 1bff15252e5e43a7ad7fa9b7ff18e3ec. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:13:29.115060 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-81769aab-4409-4ada-8e2a-8af852ae24d7 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Getting quotas for user 471c796d72d1484085c542aa2518f6ac and project 1bff15252e5e43a7ad7fa9b7ff18e3ec. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:13:29.143526 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-81769aab-4409-4ada-8e2a-8af852ae24d7 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:13:29.145856 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-81769aab-4409-4ada-8e2a-8af852ae24d7 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: e2cbf353-b613-4a89-8864-0e5b2ae7c323] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:13:29.278159 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-81769aab-4409-4ada-8e2a-8af852ae24d7 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.000166 Jun 20 12:13:29.280372 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1757/3586] 10.222.0.27 () {62 vars in 1187 bytes} [Mon Jun 20 12:13:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 20 12:13:29.289515 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-420114ce-53db-403d-a768-108e305ce054 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:29.290674 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-420114ce-53db-403d-a768-108e305ce054 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:29.314203 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-420114ce-53db-403d-a768-108e305ce054 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:29.315072 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-420114ce-53db-403d-a768-108e305ce054 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:29.316159 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-420114ce-53db-403d-a768-108e305ce054 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:29.317661 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-420114ce-53db-403d-a768-108e305ce054 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:29.486881 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c0a5f7dc-b62f-4888-b368-49503828efd8 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:29.516942 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c0a5f7dc-b62f-4888-b368-49503828efd8 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1471 microversion: 2.1 time: 0.805628 Jun 20 12:13:29.517708 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1830/3587] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:28 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1471 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:13:29.528116 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-df68786e-a546-4e5c-bd28-a978bbe60b79 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:29.529770 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-df68786e-a546-4e5c-bd28-a978bbe60b79 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: e2cbf353-b613-4a89-8864-0e5b2ae7c323] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:29.648146 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-420114ce-53db-403d-a768-108e305ce054 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:29.665472 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-420114ce-53db-403d-a768-108e305ce054 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:29.669486 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-420114ce-53db-403d-a768-108e305ce054 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:29.677521 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-420114ce-53db-403d-a768-108e305ce054 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1407 microversion: 2.20 time: 0.389923 Jun 20 12:13:29.678568 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1758/3588] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:29 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1407 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:13:29.688642 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a3b50de8-468a-46e1-bc64-46b01c2d51d4 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:29.692742 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a3b50de8-468a-46e1-bc64-46b01c2d51d4 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: 71b51f0c-5366-4aa8-86dc-753f55c21590] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:29.702037 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3b50de8-468a-46e1-bc64-46b01c2d51d4 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:29.702817 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-df68786e-a546-4e5c-bd28-a978bbe60b79 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:29.703554 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3b50de8-468a-46e1-bc64-46b01c2d51d4 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:29.704566 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3b50de8-468a-46e1-bc64-46b01c2d51d4 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:29.705280 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3b50de8-468a-46e1-bc64-46b01c2d51d4 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:29.720962 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-df68786e-a546-4e5c-bd28-a978bbe60b79 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:29.723007 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-df68786e-a546-4e5c-bd28-a978bbe60b79 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:29.724265 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-df68786e-a546-4e5c-bd28-a978bbe60b79 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/e2cbf353-b613-4a89-8864-0e5b2ae7c323" status: 200 len: 1278 microversion: 2.47 time: 0.204085 Jun 20 12:13:29.732743 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1831/3589] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:29 2022] GET /compute/v2.1/servers/e2cbf353-b613-4a89-8864-0e5b2ae7c323 => generated 1278 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:13:29.870367 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6232f7a3-d7b4-4854-945f-524d77a79c3d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-196230224", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": "none"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:13:29.985268 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-6232f7a3-d7b4-4854-945f-524d77a79c3d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:13:29.986340 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-6232f7a3-d7b4-4854-945f-524d77a79c3d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:13:29.990416 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-6232f7a3-d7b4-4854-945f-524d77a79c3d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:13:29.991702 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-6232f7a3-d7b4-4854-945f-524d77a79c3d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:13:29.992527 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-6232f7a3-d7b4-4854-945f-524d77a79c3d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:13:30.038829 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6232f7a3-d7b4-4854-945f-524d77a79c3d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:30.039809 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6232f7a3-d7b4-4854-945f-524d77a79c3d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:30.041886 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6232f7a3-d7b4-4854-945f-524d77a79c3d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:30.042606 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6232f7a3-d7b4-4854-945f-524d77a79c3d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:30.073649 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-6232f7a3-d7b4-4854-945f-524d77a79c3d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Getting quotas for project 1bff15252e5e43a7ad7fa9b7ff18e3ec. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:13:30.084420 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:13:30.087024 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-6232f7a3-d7b4-4854-945f-524d77a79c3d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Getting quotas for user 471c796d72d1484085c542aa2518f6ac and project 1bff15252e5e43a7ad7fa9b7ff18e3ec. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:13:30.099211 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a3b50de8-468a-46e1-bc64-46b01c2d51d4 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4a7cec6b754f4095917bb4cb9ee283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5ce0a299ef4e10be4dccca2ef8b957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:30.118049 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a3b50de8-468a-46e1-bc64-46b01c2d51d4 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "GET /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590" status: 200 len: 1324 microversion: 2.1 time: 0.432928 Jun 20 12:13:30.119493 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1759/3590] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:29 2022] GET /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590 => generated 1324 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:30.148990 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6232f7a3-d7b4-4854-945f-524d77a79c3d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:13:30.158401 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6232f7a3-d7b4-4854-945f-524d77a79c3d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:13:30.257137 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6232f7a3-d7b4-4854-945f-524d77a79c3d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.406281 Jun 20 12:13:30.262967 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1832/3591] 10.222.0.27 () {62 vars in 1187 bytes} [Mon Jun 20 12:13:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 411 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 20 12:13:30.270016 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3a7ed485-5875-4275-8599-c753ed3b1f67 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:13:30.271399 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3a7ed485-5875-4275-8599-c753ed3b1f67 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:30.405241 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3a7ed485-5875-4275-8599-c753ed3b1f67 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "PUT /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 991 microversion: 2.47 time: 0.134325 Jun 20 12:13:30.406553 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1760/3592] 10.222.0.27 () {62 vars in 1296 bytes} [Mon Jun 20 12:13:30 2022] PUT /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 991 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 12:13:30.423558 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6dc528cb-93da-4370-bd17-cea0aeb1cd93 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:30.424372 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6dc528cb-93da-4370-bd17-cea0aeb1cd93 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:30.537568 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f623955c-d101-4d0a-a1be-2843daf39e39 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:30.538421 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f623955c-d101-4d0a-a1be-2843daf39e39 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:30.553411 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f623955c-d101-4d0a-a1be-2843daf39e39 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:30.553884 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f623955c-d101-4d0a-a1be-2843daf39e39 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:30.555597 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f623955c-d101-4d0a-a1be-2843daf39e39 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:30.555926 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6dc528cb-93da-4370-bd17-cea0aeb1cd93 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:30.556073 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f623955c-d101-4d0a-a1be-2843daf39e39 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:30.570945 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6dc528cb-93da-4370-bd17-cea0aeb1cd93 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:30.571910 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6dc528cb-93da-4370-bd17-cea0aeb1cd93 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:30.573226 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6dc528cb-93da-4370-bd17-cea0aeb1cd93 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1277 microversion: 2.47 time: 0.156329 Jun 20 12:13:30.574406 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1833/3593] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:30 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1277 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:13:30.697906 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b261e2e0-9b91-48ba-9dcd-0e38a8b5adc1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:30.698668 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b261e2e0-9b91-48ba-9dcd-0e38a8b5adc1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:30.706983 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b261e2e0-9b91-48ba-9dcd-0e38a8b5adc1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:30.709418 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b261e2e0-9b91-48ba-9dcd-0e38a8b5adc1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:30.710622 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b261e2e0-9b91-48ba-9dcd-0e38a8b5adc1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:30.711291 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b261e2e0-9b91-48ba-9dcd-0e38a8b5adc1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:30.822430 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f623955c-d101-4d0a-a1be-2843daf39e39 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:30.831582 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f623955c-d101-4d0a-a1be-2843daf39e39 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1471 microversion: 2.1 time: 0.299905 Jun 20 12:13:30.835410 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1761/3594] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:30 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1471 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:13:31.136700 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3c190388-38b3-486d-ae03-fd757f2b8204 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:31.137420 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3c190388-38b3-486d-ae03-fd757f2b8204 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: 71b51f0c-5366-4aa8-86dc-753f55c21590] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:31.149798 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3c190388-38b3-486d-ae03-fd757f2b8204 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:31.150250 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3c190388-38b3-486d-ae03-fd757f2b8204 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:31.151229 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3c190388-38b3-486d-ae03-fd757f2b8204 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:31.151843 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3c190388-38b3-486d-ae03-fd757f2b8204 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:31.255462 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b261e2e0-9b91-48ba-9dcd-0e38a8b5adc1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:31.272408 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b261e2e0-9b91-48ba-9dcd-0e38a8b5adc1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:31.273986 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b261e2e0-9b91-48ba-9dcd-0e38a8b5adc1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:31.297099 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b261e2e0-9b91-48ba-9dcd-0e38a8b5adc1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1407 microversion: 2.20 time: 0.582302 Jun 20 12:13:31.308008 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1834/3595] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:30 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1407 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:13:31.382684 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3c190388-38b3-486d-ae03-fd757f2b8204 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4a7cec6b754f4095917bb4cb9ee283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5ce0a299ef4e10be4dccca2ef8b957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:31.395456 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3c190388-38b3-486d-ae03-fd757f2b8204 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "GET /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590" status: 200 len: 1324 microversion: 2.1 time: 0.262598 Jun 20 12:13:31.397079 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1762/3596] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:31 2022] GET /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590 => generated 1324 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:31.596016 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dc4903ae-2e7d-4c8b-ab32-ed88333c883e tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:31.596896 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dc4903ae-2e7d-4c8b-ab32-ed88333c883e tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:31.607232 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc4903ae-2e7d-4c8b-ab32-ed88333c883e tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:31.608183 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc4903ae-2e7d-4c8b-ab32-ed88333c883e tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:31.610009 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc4903ae-2e7d-4c8b-ab32-ed88333c883e tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:31.610707 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc4903ae-2e7d-4c8b-ab32-ed88333c883e tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:31.852663 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d0ea6991-e6eb-4488-aa9c-bce55cbb1dde tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:31.853271 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d0ea6991-e6eb-4488-aa9c-bce55cbb1dde tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:31.861150 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d0ea6991-e6eb-4488-aa9c-bce55cbb1dde tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:31.861602 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d0ea6991-e6eb-4488-aa9c-bce55cbb1dde tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:31.863169 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d0ea6991-e6eb-4488-aa9c-bce55cbb1dde tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:31.863836 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d0ea6991-e6eb-4488-aa9c-bce55cbb1dde tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:31.935177 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dc4903ae-2e7d-4c8b-ab32-ed88333c883e tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:31.945879 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dc4903ae-2e7d-4c8b-ab32-ed88333c883e tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:31.953286 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dc4903ae-2e7d-4c8b-ab32-ed88333c883e tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:31.954788 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dc4903ae-2e7d-4c8b-ab32-ed88333c883e tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1329 microversion: 2.47 time: 0.366339 Jun 20 12:13:31.965459 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1835/3597] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:31 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1329 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:13:32.111574 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d0ea6991-e6eb-4488-aa9c-bce55cbb1dde tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:32.125727 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d0ea6991-e6eb-4488-aa9c-bce55cbb1dde tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1471 microversion: 2.1 time: 0.275063 Jun 20 12:13:32.125727 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1763/3598] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:31 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1471 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:32.315744 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1bd95c7a-941c-402a-b6dc-788f2fc539fc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:32.316468 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1bd95c7a-941c-402a-b6dc-788f2fc539fc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:32.323852 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1bd95c7a-941c-402a-b6dc-788f2fc539fc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:32.324338 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1bd95c7a-941c-402a-b6dc-788f2fc539fc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:32.325122 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1bd95c7a-941c-402a-b6dc-788f2fc539fc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:32.325609 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1bd95c7a-941c-402a-b6dc-788f2fc539fc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:32.415207 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4b06b4ea-cef1-4a2a-b833-ed34adce21b1 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:32.416717 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4b06b4ea-cef1-4a2a-b833-ed34adce21b1 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: 71b51f0c-5366-4aa8-86dc-753f55c21590] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:32.427338 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4b06b4ea-cef1-4a2a-b833-ed34adce21b1 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:32.428320 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4b06b4ea-cef1-4a2a-b833-ed34adce21b1 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:32.429375 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4b06b4ea-cef1-4a2a-b833-ed34adce21b1 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:32.430776 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4b06b4ea-cef1-4a2a-b833-ed34adce21b1 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:32.556976 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1bd95c7a-941c-402a-b6dc-788f2fc539fc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:32.565900 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1bd95c7a-941c-402a-b6dc-788f2fc539fc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:32.573963 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1bd95c7a-941c-402a-b6dc-788f2fc539fc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:32.576871 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1bd95c7a-941c-402a-b6dc-788f2fc539fc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1407 microversion: 2.20 time: 0.265002 Jun 20 12:13:32.592116 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1836/3599] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:32 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1407 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:13:32.714202 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4b06b4ea-cef1-4a2a-b833-ed34adce21b1 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4a7cec6b754f4095917bb4cb9ee283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5ce0a299ef4e10be4dccca2ef8b957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:32.724711 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4b06b4ea-cef1-4a2a-b833-ed34adce21b1 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "GET /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590" status: 200 len: 1324 microversion: 2.1 time: 0.315619 Jun 20 12:13:32.733900 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1764/3600] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:32 2022] GET /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590 => generated 1324 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:32.798297 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7aa70ce1-0e15-44d1-9dce-e17a373fec17 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Action: 'create', calling method: .version_select at 0x7f608299e1f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1267476535", "description": "tempest-description-681948217"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:13:32.987277 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-82aa0e46-850b-4de9-887e-bbc59c290bad tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:32.988071 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-82aa0e46-850b-4de9-887e-bbc59c290bad tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:32.995244 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7aa70ce1-0e15-44d1-9dce-e17a373fec17 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.259342 Jun 20 12:13:32.996464 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1837/3601] 10.222.0.27 () {60 vars in 1179 bytes} [Mon Jun 20 12:13:32 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:13:33.008064 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bfb45c34-f316-438e-b877-dbbb8cdd6eec tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Action: 'create', calling method: .version_select at 0x7f6073df05e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1023999509", "description": "tempest-description-1635032385"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:13:33.013217 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-82aa0e46-850b-4de9-887e-bbc59c290bad tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:33.016406 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-82aa0e46-850b-4de9-887e-bbc59c290bad tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:33.017319 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-82aa0e46-850b-4de9-887e-bbc59c290bad tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:33.017836 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-82aa0e46-850b-4de9-887e-bbc59c290bad tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:33.067598 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:13:33.120969 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-82aa0e46-850b-4de9-887e-bbc59c290bad tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:33.142094 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-82aa0e46-850b-4de9-887e-bbc59c290bad tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:33.146065 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-82aa0e46-850b-4de9-887e-bbc59c290bad tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:33.154304 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-82aa0e46-850b-4de9-887e-bbc59c290bad tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1337 microversion: 2.47 time: 0.167263 Jun 20 12:13:33.155043 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1765/3602] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:32 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1337 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:13:33.161094 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f6e5c375-f5a2-4fd5-8293-65342a79e2ef tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:33.161717 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f6e5c375-f5a2-4fd5-8293-65342a79e2ef tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:33.183985 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6e5c375-f5a2-4fd5-8293-65342a79e2ef tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:33.184923 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6e5c375-f5a2-4fd5-8293-65342a79e2ef tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:33.187238 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6e5c375-f5a2-4fd5-8293-65342a79e2ef tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:33.188562 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6e5c375-f5a2-4fd5-8293-65342a79e2ef tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:33.278293 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bfb45c34-f316-438e-b877-dbbb8cdd6eec tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.274544 Jun 20 12:13:33.279020 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1838/3603] 10.222.0.27 () {60 vars in 1179 bytes} [Mon Jun 20 12:13:33 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:13:33.331210 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3ae4e4c0-1e77-44e9-9ab7-2e38183c0b8c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1960766836", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "bc732c96-f822-4316-9285-6dad12be4a9e"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:13:33.392493 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-3ae4e4c0-1e77-44e9-9ab7-2e38183c0b8c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] validate_networks() for [('bc732c96-f822-4316-9285-6dad12be4a9e', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:13:33.611683 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f6e5c375-f5a2-4fd5-8293-65342a79e2ef tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:33.628897 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f6e5c375-f5a2-4fd5-8293-65342a79e2ef tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1471 microversion: 2.1 time: 0.468283 Jun 20 12:13:33.638604 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1766/3604] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:33 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1471 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:33.667241 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d54cdab7-5fee-49e6-a5db-82ac4cf4f0ef tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:33.668042 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d54cdab7-5fee-49e6-a5db-82ac4cf4f0ef tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:33.684677 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d54cdab7-5fee-49e6-a5db-82ac4cf4f0ef tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:33.685149 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d54cdab7-5fee-49e6-a5db-82ac4cf4f0ef tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:33.686036 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d54cdab7-5fee-49e6-a5db-82ac4cf4f0ef tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:33.686459 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d54cdab7-5fee-49e6-a5db-82ac4cf4f0ef tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:33.954775 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-3ae4e4c0-1e77-44e9-9ab7-2e38183c0b8c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:13:33.955571 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-3ae4e4c0-1e77-44e9-9ab7-2e38183c0b8c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:13:33.956755 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-3ae4e4c0-1e77-44e9-9ab7-2e38183c0b8c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:13:33.957175 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-3ae4e4c0-1e77-44e9-9ab7-2e38183c0b8c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:13:33.957753 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-3ae4e4c0-1e77-44e9-9ab7-2e38183c0b8c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:13:33.973284 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d54cdab7-5fee-49e6-a5db-82ac4cf4f0ef tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:33.983581 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3ae4e4c0-1e77-44e9-9ab7-2e38183c0b8c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:33.984030 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3ae4e4c0-1e77-44e9-9ab7-2e38183c0b8c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:33.984872 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3ae4e4c0-1e77-44e9-9ab7-2e38183c0b8c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:33.985312 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3ae4e4c0-1e77-44e9-9ab7-2e38183c0b8c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:33.990196 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d54cdab7-5fee-49e6-a5db-82ac4cf4f0ef tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:33.993027 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d54cdab7-5fee-49e6-a5db-82ac4cf4f0ef tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:33.994465 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d54cdab7-5fee-49e6-a5db-82ac4cf4f0ef tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1407 microversion: 2.20 time: 0.344210 Jun 20 12:13:33.995550 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1767/3605] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:33 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1407 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:13:34.002780 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ecb110cd-6cbf-43b0-b4f3-34ef6bafbf50 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:34.003586 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ecb110cd-6cbf-43b0-b4f3-34ef6bafbf50 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: 71b51f0c-5366-4aa8-86dc-753f55c21590] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:34.011443 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ecb110cd-6cbf-43b0-b4f3-34ef6bafbf50 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:34.012168 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ecb110cd-6cbf-43b0-b4f3-34ef6bafbf50 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:34.013268 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ecb110cd-6cbf-43b0-b4f3-34ef6bafbf50 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:34.013898 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ecb110cd-6cbf-43b0-b4f3-34ef6bafbf50 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:34.031478 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-3ae4e4c0-1e77-44e9-9ab7-2e38183c0b8c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Getting quotas for project b3edd75428794ea2b1cbd1b8413072cd. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:13:34.042603 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-3ae4e4c0-1e77-44e9-9ab7-2e38183c0b8c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Getting quotas for user e8878b2fbb4b429288856159a644382f and project b3edd75428794ea2b1cbd1b8413072cd. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:13:34.082011 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3ae4e4c0-1e77-44e9-9ab7-2e38183c0b8c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:13:34.084086 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3ae4e4c0-1e77-44e9-9ab7-2e38183c0b8c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: b0df0320-6a60-433c-bfe9-8011cd85e631] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:13:34.211821 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3ae4e4c0-1e77-44e9-9ab7-2e38183c0b8c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.882787 Jun 20 12:13:34.219148 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1839/3606] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:13:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:13:34.228699 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0ccf92db-7161-460c-901f-337353e441e5 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:34.231236 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0ccf92db-7161-460c-901f-337353e441e5 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:34.275143 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0ccf92db-7161-460c-901f-337353e441e5 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:34.276497 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0ccf92db-7161-460c-901f-337353e441e5 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:34.277626 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0ccf92db-7161-460c-901f-337353e441e5 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:34.281158 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0ccf92db-7161-460c-901f-337353e441e5 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:34.296361 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ecb110cd-6cbf-43b0-b4f3-34ef6bafbf50 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4a7cec6b754f4095917bb4cb9ee283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5ce0a299ef4e10be4dccca2ef8b957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:34.310667 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ecb110cd-6cbf-43b0-b4f3-34ef6bafbf50 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "GET /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590" status: 200 len: 1324 microversion: 2.1 time: 0.313468 Jun 20 12:13:34.319777 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1768/3607] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:33 2022] GET /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590 => generated 1324 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:34.319777 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b3e24a84-7344-4afa-97d5-ad6287d45579 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:34.319777 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b3e24a84-7344-4afa-97d5-ad6287d45579 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: b0df0320-6a60-433c-bfe9-8011cd85e631] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:34.439857 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0ccf92db-7161-460c-901f-337353e441e5 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:34.451055 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0ccf92db-7161-460c-901f-337353e441e5 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:34.452756 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0ccf92db-7161-460c-901f-337353e441e5 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:34.453960 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0ccf92db-7161-460c-901f-337353e441e5 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1347 microversion: 2.47 time: 0.239558 Jun 20 12:13:34.467114 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1840/3608] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:34 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1347 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:13:34.488298 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b3e24a84-7344-4afa-97d5-ad6287d45579 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:34.517668 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b3e24a84-7344-4afa-97d5-ad6287d45579 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631" status: 200 len: 1216 microversion: 2.1 time: 0.203796 Jun 20 12:13:34.529370 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1769/3609] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:34 2022] GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631 => generated 1216 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:34.533800 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-d4c28021-09d4-4cb4-b67f-d4969f4675c7 req-136869ec-5e00-496f-898e-495a5fd1a2f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b51f0c-5366-4aa8-86dc-753f55c21590", "name": "network-vif-plugged", "status": "completed", "tag": "626fc638-ecf6-445b-92f4-0487f1f80338"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:13:34.562493 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-d4c28021-09d4-4cb4-b67f-d4969f4675c7 req-136869ec-5e00-496f-898e-495a5fd1a2f8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:34.567707 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-d4c28021-09d4-4cb4-b67f-d4969f4675c7 req-136869ec-5e00-496f-898e-495a5fd1a2f8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:34.617763 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-d4c28021-09d4-4cb4-b67f-d4969f4675c7 req-136869ec-5e00-496f-898e-495a5fd1a2f8 service nova] Creating event network-vif-plugged:626fc638-ecf6-445b-92f4-0487f1f80338 for instance 71b51f0c-5366-4aa8-86dc-753f55c21590 on n-h1-master-1 Jun 20 12:13:34.624624 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-d4c28021-09d4-4cb4-b67f-d4969f4675c7 req-136869ec-5e00-496f-898e-495a5fd1a2f8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101395 Jun 20 12:13:34.626063 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1841/3610] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:13:34.656179 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-06d773fa-567c-4799-a2f5-927516e588a7 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:34.656883 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-06d773fa-567c-4799-a2f5-927516e588a7 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:34.668150 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-06d773fa-567c-4799-a2f5-927516e588a7 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:34.669201 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-06d773fa-567c-4799-a2f5-927516e588a7 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:34.672044 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-06d773fa-567c-4799-a2f5-927516e588a7 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:34.673295 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-06d773fa-567c-4799-a2f5-927516e588a7 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:35.015067 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dca2c0da-d1bf-4dab-b648-3ce771b358f2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:35.015990 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dca2c0da-d1bf-4dab-b648-3ce771b358f2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:35.032511 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dca2c0da-d1bf-4dab-b648-3ce771b358f2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:35.034068 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dca2c0da-d1bf-4dab-b648-3ce771b358f2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:35.035089 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dca2c0da-d1bf-4dab-b648-3ce771b358f2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:35.035717 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dca2c0da-d1bf-4dab-b648-3ce771b358f2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:35.273921 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-06d773fa-567c-4799-a2f5-927516e588a7 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:35.301829 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-06d773fa-567c-4799-a2f5-927516e588a7 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1471 microversion: 2.1 time: 0.648772 Jun 20 12:13:35.308585 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1770/3611] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:34 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1471 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:35.329501 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4413f205-5497-4301-aaac-2af1f3eb78b4 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:35.330134 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4413f205-5497-4301-aaac-2af1f3eb78b4 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: 71b51f0c-5366-4aa8-86dc-753f55c21590] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:35.344707 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4413f205-5497-4301-aaac-2af1f3eb78b4 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:35.345162 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4413f205-5497-4301-aaac-2af1f3eb78b4 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:35.345952 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4413f205-5497-4301-aaac-2af1f3eb78b4 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:35.346392 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4413f205-5497-4301-aaac-2af1f3eb78b4 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:35.363811 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dca2c0da-d1bf-4dab-b648-3ce771b358f2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:35.378950 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dca2c0da-d1bf-4dab-b648-3ce771b358f2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:35.380883 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dca2c0da-d1bf-4dab-b648-3ce771b358f2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:35.382325 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dca2c0da-d1bf-4dab-b648-3ce771b358f2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1407 microversion: 2.20 time: 0.372919 Jun 20 12:13:35.383173 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1842/3612] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:35 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1407 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:13:35.491643 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d5852ce7-6435-4fb7-ab71-f35e7e6ae6dd tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:35.492544 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d5852ce7-6435-4fb7-ab71-f35e7e6ae6dd tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:35.505227 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d5852ce7-6435-4fb7-ab71-f35e7e6ae6dd tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:35.505682 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d5852ce7-6435-4fb7-ab71-f35e7e6ae6dd tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:35.511633 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d5852ce7-6435-4fb7-ab71-f35e7e6ae6dd tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:35.512108 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d5852ce7-6435-4fb7-ab71-f35e7e6ae6dd tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:35.650825 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4413f205-5497-4301-aaac-2af1f3eb78b4 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4a7cec6b754f4095917bb4cb9ee283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5ce0a299ef4e10be4dccca2ef8b957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:35.665842 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4413f205-5497-4301-aaac-2af1f3eb78b4 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "GET /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590" status: 200 len: 1324 microversion: 2.1 time: 0.340878 Jun 20 12:13:35.668058 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1771/3613] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:35 2022] GET /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590 => generated 1324 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:35.680970 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7e81a99d-f5e3-49dd-aa6e-88f3e259ef4a tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:35.682550 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7e81a99d-f5e3-49dd-aa6e-88f3e259ef4a tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: b0df0320-6a60-433c-bfe9-8011cd85e631] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:35.691426 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7e81a99d-f5e3-49dd-aa6e-88f3e259ef4a tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:35.692471 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7e81a99d-f5e3-49dd-aa6e-88f3e259ef4a tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:35.694685 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7e81a99d-f5e3-49dd-aa6e-88f3e259ef4a tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:35.696880 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7e81a99d-f5e3-49dd-aa6e-88f3e259ef4a tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:35.763080 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d5852ce7-6435-4fb7-ab71-f35e7e6ae6dd tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:35.817464 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d5852ce7-6435-4fb7-ab71-f35e7e6ae6dd tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:35.819327 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d5852ce7-6435-4fb7-ab71-f35e7e6ae6dd tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:35.822452 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d5852ce7-6435-4fb7-ab71-f35e7e6ae6dd tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1335 microversion: 2.47 time: 0.335058 Jun 20 12:13:35.823693 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1843/3614] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:35 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1335 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:13:35.961006 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7e81a99d-f5e3-49dd-aa6e-88f3e259ef4a tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:35.971491 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7e81a99d-f5e3-49dd-aa6e-88f3e259ef4a tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631" status: 200 len: 1212 microversion: 2.1 time: 0.301814 Jun 20 12:13:35.975089 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1772/3615] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:35 2022] GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631 => generated 1212 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:36.333234 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7a40c316-58a0-476b-a477-bd94ee48dd49 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:36.334986 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7a40c316-58a0-476b-a477-bd94ee48dd49 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:36.345048 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7a40c316-58a0-476b-a477-bd94ee48dd49 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:36.345565 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7a40c316-58a0-476b-a477-bd94ee48dd49 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:36.346402 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7a40c316-58a0-476b-a477-bd94ee48dd49 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:36.348527 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7a40c316-58a0-476b-a477-bd94ee48dd49 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:36.391899 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:13:36.402119 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-864c0f77-9681-4138-8480-fb9aefe34ccd tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:36.403183 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-864c0f77-9681-4138-8480-fb9aefe34ccd tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:36.418314 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-864c0f77-9681-4138-8480-fb9aefe34ccd tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:36.420396 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-864c0f77-9681-4138-8480-fb9aefe34ccd tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:36.420396 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-864c0f77-9681-4138-8480-fb9aefe34ccd tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:36.420396 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-864c0f77-9681-4138-8480-fb9aefe34ccd tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:36.647210 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7a40c316-58a0-476b-a477-bd94ee48dd49 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:36.660509 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7a40c316-58a0-476b-a477-bd94ee48dd49 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1471 microversion: 2.1 time: 0.338468 Jun 20 12:13:36.661421 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1844/3616] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:36 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1471 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:36.688256 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6d628af4-ea1c-49db-b766-3e3d4173f36b tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:36.689110 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6d628af4-ea1c-49db-b766-3e3d4173f36b tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: 71b51f0c-5366-4aa8-86dc-753f55c21590] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:36.701733 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-864c0f77-9681-4138-8480-fb9aefe34ccd tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:36.706141 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6d628af4-ea1c-49db-b766-3e3d4173f36b tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:36.706814 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6d628af4-ea1c-49db-b766-3e3d4173f36b tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:36.708589 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6d628af4-ea1c-49db-b766-3e3d4173f36b tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:36.709213 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6d628af4-ea1c-49db-b766-3e3d4173f36b tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:36.714235 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-864c0f77-9681-4138-8480-fb9aefe34ccd tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:36.716095 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-864c0f77-9681-4138-8480-fb9aefe34ccd tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:36.723704 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-864c0f77-9681-4138-8480-fb9aefe34ccd tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1407 microversion: 2.20 time: 0.320287 Jun 20 12:13:36.734453 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1773/3617] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:36 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1407 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:13:36.844893 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-95aa6b9c-8d98-424e-b7a7-97366c7b6420 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:36.846111 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-95aa6b9c-8d98-424e-b7a7-97366c7b6420 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:36.864824 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95aa6b9c-8d98-424e-b7a7-97366c7b6420 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:36.865796 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95aa6b9c-8d98-424e-b7a7-97366c7b6420 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:36.872565 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95aa6b9c-8d98-424e-b7a7-97366c7b6420 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:36.873456 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95aa6b9c-8d98-424e-b7a7-97366c7b6420 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:36.908493 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6d628af4-ea1c-49db-b766-3e3d4173f36b tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4a7cec6b754f4095917bb4cb9ee283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5ce0a299ef4e10be4dccca2ef8b957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:36.920294 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6d628af4-ea1c-49db-b766-3e3d4173f36b tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "GET /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590" status: 200 len: 1520 microversion: 2.1 time: 0.238696 Jun 20 12:13:36.932398 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1845/3618] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:36 2022] GET /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590 => generated 1520 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:36.944926 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-458f563f-1816-4ad4-a849-37cd3d53dca8 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.2.247"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:13:36.946190 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-458f563f-1816-4ad4-a849-37cd3d53dca8 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: fd56a5df-a994-416e-b1d4-a5a78df871b2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:36.954192 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-458f563f-1816-4ad4-a849-37cd3d53dca8 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:36.954691 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-458f563f-1816-4ad4-a849-37cd3d53dca8 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:36.955984 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-458f563f-1816-4ad4-a849-37cd3d53dca8 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:36.956732 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-458f563f-1816-4ad4-a849-37cd3d53dca8 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:37.005436 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-458f563f-1816-4ad4-a849-37cd3d53dca8 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Acquired lock "refresh_cache-fd56a5df-a994-416e-b1d4-a5a78df871b2" {{(pid=119127) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 20 12:13:37.029633 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-95aa6b9c-8d98-424e-b7a7-97366c7b6420 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:37.039846 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-95aa6b9c-8d98-424e-b7a7-97366c7b6420 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:37.041977 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-95aa6b9c-8d98-424e-b7a7-97366c7b6420 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:37.043448 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-95aa6b9c-8d98-424e-b7a7-97366c7b6420 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1335 microversion: 2.47 time: 0.205239 Jun 20 12:13:37.046151 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1774/3619] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:36 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1335 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:13:37.051563 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-09f694f9-67da-4d1b-899f-e7b0cc13939c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:37.052179 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-09f694f9-67da-4d1b-899f-e7b0cc13939c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: b0df0320-6a60-433c-bfe9-8011cd85e631] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:37.059018 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-09f694f9-67da-4d1b-899f-e7b0cc13939c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:37.059540 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-09f694f9-67da-4d1b-899f-e7b0cc13939c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:37.060590 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-09f694f9-67da-4d1b-899f-e7b0cc13939c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:37.061081 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-09f694f9-67da-4d1b-899f-e7b0cc13939c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:37.177746 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-09f694f9-67da-4d1b-899f-e7b0cc13939c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:37.190084 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-09f694f9-67da-4d1b-899f-e7b0cc13939c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631" status: 200 len: 1276 microversion: 2.1 time: 0.142449 Jun 20 12:13:37.191028 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1775/3620] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:37 2022] GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631 => generated 1276 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:37.566725 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-b500d6ce-4964-45e6-a52d-7bd9477e7925 req-aa333cc2-0ffb-4084-9274-4ebc55a28d53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc", "name": "network-vif-plugged", "status": "completed", "tag": "4b0b8cf9-ff46-4970-9b45-8795ce12a358"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:13:37.586007 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-b500d6ce-4964-45e6-a52d-7bd9477e7925 req-aa333cc2-0ffb-4084-9274-4ebc55a28d53 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:37.586499 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-b500d6ce-4964-45e6-a52d-7bd9477e7925 req-aa333cc2-0ffb-4084-9274-4ebc55a28d53 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:37.625775 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-b500d6ce-4964-45e6-a52d-7bd9477e7925 req-aa333cc2-0ffb-4084-9274-4ebc55a28d53 service nova] Creating event network-vif-plugged:4b0b8cf9-ff46-4970-9b45-8795ce12a358 for instance 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc on n-h1-master-1 Jun 20 12:13:37.641843 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-b500d6ce-4964-45e6-a52d-7bd9477e7925 req-aa333cc2-0ffb-4084-9274-4ebc55a28d53 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078921 Jun 20 12:13:37.642795 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1776/3621] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:13:37.718027 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6ce2dabd-92bc-4753-9585-4a9320d8a171 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:37.720723 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6ce2dabd-92bc-4753-9585-4a9320d8a171 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:37.732759 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ce2dabd-92bc-4753-9585-4a9320d8a171 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:37.733436 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ce2dabd-92bc-4753-9585-4a9320d8a171 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:37.734626 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ce2dabd-92bc-4753-9585-4a9320d8a171 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:37.735233 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ce2dabd-92bc-4753-9585-4a9320d8a171 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:38.055766 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6ce2dabd-92bc-4753-9585-4a9320d8a171 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:38.067294 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6ce2dabd-92bc-4753-9585-4a9320d8a171 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1471 microversion: 2.1 time: 0.362747 Jun 20 12:13:38.073452 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1777/3622] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:37 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1471 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:38.094689 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-00b0c522-089e-48e7-a48a-078a0022a82b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:38.095451 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-00b0c522-089e-48e7-a48a-078a0022a82b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:38.106919 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-00b0c522-089e-48e7-a48a-078a0022a82b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:38.106919 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-00b0c522-089e-48e7-a48a-078a0022a82b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:38.109816 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-00b0c522-089e-48e7-a48a-078a0022a82b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:38.110378 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-00b0c522-089e-48e7-a48a-078a0022a82b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:38.280443 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-00b0c522-089e-48e7-a48a-078a0022a82b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:38.289636 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-00b0c522-089e-48e7-a48a-078a0022a82b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:38.291583 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-00b0c522-089e-48e7-a48a-078a0022a82b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:38.293041 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-00b0c522-089e-48e7-a48a-078a0022a82b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1407 microversion: 2.20 time: 0.218598 Jun 20 12:13:38.294218 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1778/3623] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:38 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:13:38.299485 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6a738c99-4d13-48e6-bdd7-92e654886caa tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:38.300453 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6a738c99-4d13-48e6-bdd7-92e654886caa tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:38.310860 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a738c99-4d13-48e6-bdd7-92e654886caa tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:38.311478 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a738c99-4d13-48e6-bdd7-92e654886caa tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:38.312788 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a738c99-4d13-48e6-bdd7-92e654886caa tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:38.313382 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a738c99-4d13-48e6-bdd7-92e654886caa tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:38.448423 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6a738c99-4d13-48e6-bdd7-92e654886caa tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:38.463202 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6a738c99-4d13-48e6-bdd7-92e654886caa tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:38.468794 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6a738c99-4d13-48e6-bdd7-92e654886caa tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:38.472735 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6a738c99-4d13-48e6-bdd7-92e654886caa tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1335 microversion: 2.47 time: 0.176215 Jun 20 12:13:38.474967 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1779/3624] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:38 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1335 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:13:38.483015 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1a6e45c6-8ec9-4084-a484-634286bc1e1c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:38.484286 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1a6e45c6-8ec9-4084-a484-634286bc1e1c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: b0df0320-6a60-433c-bfe9-8011cd85e631] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:38.494725 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a6e45c6-8ec9-4084-a484-634286bc1e1c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:38.495902 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a6e45c6-8ec9-4084-a484-634286bc1e1c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:38.498329 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a6e45c6-8ec9-4084-a484-634286bc1e1c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:38.499134 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a6e45c6-8ec9-4084-a484-634286bc1e1c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:38.571051 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1a6e45c6-8ec9-4084-a484-634286bc1e1c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:38.579241 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1a6e45c6-8ec9-4084-a484-634286bc1e1c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631" status: 200 len: 1276 microversion: 2.1 time: 0.102581 Jun 20 12:13:38.580149 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1780/3625] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:38 2022] GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631 => generated 1276 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:38.802150 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5b0d3d23-b6ad-486d-9784-0b542e0278a8 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Action: 'create', calling method: .version_select at 0x7f60848065e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2020908636", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMF98b17z5knUfo5s4x2SMJqeim06AMdx0PDLoTDO7Y0z8oL82VNV3hqEi2/+FjOj4aPX4PLkaRIJOjUhitMHR9Sq5fG9DUi12IGSbvFeGTbqSsrM+Ert3vGLyjmcPpiDA=="}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:13:38.818636 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-5b0d3d23-b6ad-486d-9784-0b542e0278a8 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Getting quotas for project 9e9e481852fe4e6ebdc15ec343a741f2. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:13:38.824886 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-5b0d3d23-b6ad-486d-9784-0b542e0278a8 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Getting quotas for user cd27c8696f7147e18054b26ebbae7045 and project 9e9e481852fe4e6ebdc15ec343a741f2. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:13:38.855941 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5b0d3d23-b6ad-486d-9784-0b542e0278a8 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.274550 Jun 20 12:13:38.857840 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1781/3626] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 12:13:38 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:13:39.094920 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5c95ad9d-5693-4175-80e2-b5ab3a974a6d tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:39.097416 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5c95ad9d-5693-4175-80e2-b5ab3a974a6d tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:39.131577 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=10 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:13:39.141831 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:13:39.146133 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5c95ad9d-5693-4175-80e2-b5ab3a974a6d tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:39.146940 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5c95ad9d-5693-4175-80e2-b5ab3a974a6d tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:39.148348 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5c95ad9d-5693-4175-80e2-b5ab3a974a6d tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:39.149114 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5c95ad9d-5693-4175-80e2-b5ab3a974a6d tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:39.279353 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-458f563f-1816-4ad4-a849-37cd3d53dca8 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: fd56a5df-a994-416e-b1d4-a5a78df871b2] Building network info cache for instance {{(pid=119127) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 20 12:13:39.522783 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5c95ad9d-5693-4175-80e2-b5ab3a974a6d tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:39.535003 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5c95ad9d-5693-4175-80e2-b5ab3a974a6d tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1471 microversion: 2.1 time: 0.448448 Jun 20 12:13:39.536299 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1782/3627] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:39 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1471 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:39.549760 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-fd165165-0246-4092-9764-77d7edee2617 req-ccfd660e-78fe-464b-b56c-30e68aa06dbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd56a5df-a994-416e-b1d4-a5a78df871b2", "tag": "c09d88d8-69e4-4159-a104-22eba04fd540"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:13:39.559918 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-fd165165-0246-4092-9764-77d7edee2617 req-ccfd660e-78fe-464b-b56c-30e68aa06dbe service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:39.560945 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-fd165165-0246-4092-9764-77d7edee2617 req-ccfd660e-78fe-464b-b56c-30e68aa06dbe service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:39.575904 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-fd165165-0246-4092-9764-77d7edee2617 req-ccfd660e-78fe-464b-b56c-30e68aa06dbe service nova] Creating event network-changed:c09d88d8-69e4-4159-a104-22eba04fd540 for instance fd56a5df-a994-416e-b1d4-a5a78df871b2 on n-h1-master-1 Jun 20 12:13:39.589784 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-fd165165-0246-4092-9764-77d7edee2617 req-ccfd660e-78fe-464b-b56c-30e68aa06dbe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050846 Jun 20 12:13:39.591532 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1783/3628] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:13:39.604289 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c51e448f-6b80-4dcd-9ed0-bed80b1f0752 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:39.605431 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c51e448f-6b80-4dcd-9ed0-bed80b1f0752 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:39.628397 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c51e448f-6b80-4dcd-9ed0-bed80b1f0752 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:39.629008 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c51e448f-6b80-4dcd-9ed0-bed80b1f0752 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:39.629905 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c51e448f-6b80-4dcd-9ed0-bed80b1f0752 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:39.630418 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c51e448f-6b80-4dcd-9ed0-bed80b1f0752 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:40.470713 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c51e448f-6b80-4dcd-9ed0-bed80b1f0752 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:40.488393 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c51e448f-6b80-4dcd-9ed0-bed80b1f0752 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:40.490594 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c51e448f-6b80-4dcd-9ed0-bed80b1f0752 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:40.492465 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c51e448f-6b80-4dcd-9ed0-bed80b1f0752 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1599 microversion: 2.20 time: 0.892428 Jun 20 12:13:40.493692 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1784/3629] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:39 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1599 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:13:40.498912 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1a9c61d9-0ecc-4537-be1d-6c91d785318c tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:40.500362 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1a9c61d9-0ecc-4537-be1d-6c91d785318c tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:40.506757 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a9c61d9-0ecc-4537-be1d-6c91d785318c tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:40.507543 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a9c61d9-0ecc-4537-be1d-6c91d785318c tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:40.508610 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a9c61d9-0ecc-4537-be1d-6c91d785318c tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:40.510002 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a9c61d9-0ecc-4537-be1d-6c91d785318c tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:40.530496 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:13:40.634911 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1a9c61d9-0ecc-4537-be1d-6c91d785318c tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:40.651190 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1a9c61d9-0ecc-4537-be1d-6c91d785318c tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:40.653349 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1a9c61d9-0ecc-4537-be1d-6c91d785318c tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:40.654889 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1a9c61d9-0ecc-4537-be1d-6c91d785318c tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1335 microversion: 2.47 time: 0.159983 Jun 20 12:13:40.656176 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1785/3630] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:40 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1335 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:13:40.669207 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f96e96f0-ea1b-4d7f-8634-9551eaabc7ba tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:40.672095 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f96e96f0-ea1b-4d7f-8634-9551eaabc7ba tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: b0df0320-6a60-433c-bfe9-8011cd85e631] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:40.688718 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f96e96f0-ea1b-4d7f-8634-9551eaabc7ba tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:40.689435 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f96e96f0-ea1b-4d7f-8634-9551eaabc7ba tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:40.693723 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f96e96f0-ea1b-4d7f-8634-9551eaabc7ba tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:40.694132 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-458f563f-1816-4ad4-a849-37cd3d53dca8 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: fd56a5df-a994-416e-b1d4-a5a78df871b2] Updating instance_info_cache with network_info: [{"id": "c09d88d8-69e4-4159-a104-22eba04fd540", "address": "fa:16:3e:7c:ef:fa", "network": {"id": "e52cf695-08a7-4228-8afa-64520bdba860", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1069428594-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.2.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6b5ce0a299ef4e10be4dccca2ef8b957", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc09d88d8-69", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119127) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 20 12:13:40.694623 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f96e96f0-ea1b-4d7f-8634-9551eaabc7ba tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:40.718156 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-458f563f-1816-4ad4-a849-37cd3d53dca8 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Releasing lock "refresh_cache-fd56a5df-a994-416e-b1d4-a5a78df871b2" {{(pid=119127) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 20 12:13:40.719380 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-458f563f-1816-4ad4-a849-37cd3d53dca8 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "POST /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2/action" status: 202 len: 0 microversion: 2.1 time: 3.781981 Jun 20 12:13:40.720616 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1846/3631] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:13:36 2022] POST /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2/action => generated 0 bytes in 3784 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 20 12:13:40.726119 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8b0aeb29-3ffd-4102-aa23-6adfb48b4175 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:40.727224 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8b0aeb29-3ffd-4102-aa23-6adfb48b4175 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:40.734835 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b0aeb29-3ffd-4102-aa23-6adfb48b4175 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:40.735864 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b0aeb29-3ffd-4102-aa23-6adfb48b4175 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:40.737376 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b0aeb29-3ffd-4102-aa23-6adfb48b4175 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:40.738286 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b0aeb29-3ffd-4102-aa23-6adfb48b4175 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:40.835382 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f96e96f0-ea1b-4d7f-8634-9551eaabc7ba tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:40.844992 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f96e96f0-ea1b-4d7f-8634-9551eaabc7ba tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631" status: 200 len: 1274 microversion: 2.1 time: 0.186183 Jun 20 12:13:40.846962 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1786/3632] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:40 2022] GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631 => generated 1274 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:40.853417 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a23442f4-ae9e-471b-b2ac-a5e359837c40 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:40.854341 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a23442f4-ae9e-471b-b2ac-a5e359837c40 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:40.863690 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a23442f4-ae9e-471b-b2ac-a5e359837c40 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:40.864486 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a23442f4-ae9e-471b-b2ac-a5e359837c40 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:40.865428 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a23442f4-ae9e-471b-b2ac-a5e359837c40 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:40.866054 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a23442f4-ae9e-471b-b2ac-a5e359837c40 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:41.100141 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8b0aeb29-3ffd-4102-aa23-6adfb48b4175 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.378181 Jun 20 12:13:41.101068 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1847/3633] 10.222.0.27 () {60 vars in 1315 bytes} [Mon Jun 20 12:13:40 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc/os-interface => generated 284 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:13:41.107118 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-871a0a90-d455-4a63-aac7-1b7a051bac7f tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.2.247"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:13:41.109031 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-871a0a90-d455-4a63-aac7-1b7a051bac7f tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: 71b51f0c-5366-4aa8-86dc-753f55c21590] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:41.115990 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-871a0a90-d455-4a63-aac7-1b7a051bac7f tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:41.116461 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-871a0a90-d455-4a63-aac7-1b7a051bac7f tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:41.117602 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-871a0a90-d455-4a63-aac7-1b7a051bac7f tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:41.117941 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-871a0a90-d455-4a63-aac7-1b7a051bac7f tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:41.169818 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-871a0a90-d455-4a63-aac7-1b7a051bac7f tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Acquired lock "refresh_cache-71b51f0c-5366-4aa8-86dc-753f55c21590" {{(pid=119127) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 20 12:13:41.222795 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a23442f4-ae9e-471b-b2ac-a5e359837c40 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:41.231545 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a23442f4-ae9e-471b-b2ac-a5e359837c40 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1477 microversion: 2.1 time: 0.382626 Jun 20 12:13:41.232155 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1787/3634] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:40 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1477 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:41.674309 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e555270d-9289-4906-a4a2-69ad34ec05fa tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:41.675048 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e555270d-9289-4906-a4a2-69ad34ec05fa tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:41.681549 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e555270d-9289-4906-a4a2-69ad34ec05fa tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:41.681995 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e555270d-9289-4906-a4a2-69ad34ec05fa tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:41.684585 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e555270d-9289-4906-a4a2-69ad34ec05fa tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:41.685415 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e555270d-9289-4906-a4a2-69ad34ec05fa tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:41.758961 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e555270d-9289-4906-a4a2-69ad34ec05fa tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:41.768878 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e555270d-9289-4906-a4a2-69ad34ec05fa tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:41.770513 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e555270d-9289-4906-a4a2-69ad34ec05fa tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:41.771825 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e555270d-9289-4906-a4a2-69ad34ec05fa tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1356 microversion: 2.47 time: 0.101580 Jun 20 12:13:41.772856 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1788/3635] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:41 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1356 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:13:41.797353 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bae8c78e-e514-49fb-85fb-f845e1b5691a tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:13:41.799693 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bae8c78e-e514-49fb-85fb-f845e1b5691a tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:41.808001 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bae8c78e-e514-49fb-85fb-f845e1b5691a tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:41.808640 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bae8c78e-e514-49fb-85fb-f845e1b5691a tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:41.809649 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bae8c78e-e514-49fb-85fb-f845e1b5691a tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:41.810525 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bae8c78e-e514-49fb-85fb-f845e1b5691a tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:41.905765 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-bae8c78e-e514-49fb-85fb-f845e1b5691a tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:13:41.906283 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-bae8c78e-e514-49fb-85fb-f845e1b5691a tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:13:41.907582 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-bae8c78e-e514-49fb-85fb-f845e1b5691a tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:13:41.908178 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-bae8c78e-e514-49fb-85fb-f845e1b5691a tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:13:41.908791 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-bae8c78e-e514-49fb-85fb-f845e1b5691a tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:13:41.984910 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bae8c78e-e514-49fb-85fb-f845e1b5691a tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:41.994296 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bae8c78e-e514-49fb-85fb-f845e1b5691a tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:41.995189 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bae8c78e-e514-49fb-85fb-f845e1b5691a tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:41.996157 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bae8c78e-e514-49fb-85fb-f845e1b5691a tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:41.996816 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bae8c78e-e514-49fb-85fb-f845e1b5691a tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:42.032710 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bae8c78e-e514-49fb-85fb-f845e1b5691a tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "POST /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd/action" status: 202 len: 1078 microversion: 2.47 time: 0.241120 Jun 20 12:13:42.034069 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1789/3636] 10.222.0.27 () {62 vars in 1318 bytes} [Mon Jun 20 12:13:41 2022] POST /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd/action => generated 1078 bytes in 244 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jun 20 12:13:42.039390 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2724b299-4aa3-4b57-b331-83daf42b4567 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:42.040313 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2724b299-4aa3-4b57-b331-83daf42b4567 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: b0df0320-6a60-433c-bfe9-8011cd85e631] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:42.047115 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2724b299-4aa3-4b57-b331-83daf42b4567 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:42.047854 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2724b299-4aa3-4b57-b331-83daf42b4567 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:42.048919 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2724b299-4aa3-4b57-b331-83daf42b4567 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:42.049527 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2724b299-4aa3-4b57-b331-83daf42b4567 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:42.424365 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2724b299-4aa3-4b57-b331-83daf42b4567 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:42.453331 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2724b299-4aa3-4b57-b331-83daf42b4567 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631" status: 200 len: 1316 microversion: 2.1 time: 0.417699 Jun 20 12:13:42.454296 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1790/3637] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:42 2022] GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631 => generated 1316 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:42.464410 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-425face4-b142-4aaa-9957-b5c078cce2e5 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:42.465321 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-425face4-b142-4aaa-9957-b5c078cce2e5 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:42.472156 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-425face4-b142-4aaa-9957-b5c078cce2e5 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:42.473531 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-425face4-b142-4aaa-9957-b5c078cce2e5 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:42.474513 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-425face4-b142-4aaa-9957-b5c078cce2e5 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:42.475106 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-425face4-b142-4aaa-9957-b5c078cce2e5 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:42.619052 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-425face4-b142-4aaa-9957-b5c078cce2e5 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:42.632936 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-425face4-b142-4aaa-9957-b5c078cce2e5 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:42.636130 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-425face4-b142-4aaa-9957-b5c078cce2e5 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:42.637695 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-425face4-b142-4aaa-9957-b5c078cce2e5 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1365 microversion: 2.47 time: 0.182069 Jun 20 12:13:42.650534 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1791/3638] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:42 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1365 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:13:42.668255 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e08439c3-2d27-426f-9c58-fb2975472ca3 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:42.668886 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e08439c3-2d27-426f-9c58-fb2975472ca3 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:42.676794 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e08439c3-2d27-426f-9c58-fb2975472ca3 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:42.677494 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e08439c3-2d27-426f-9c58-fb2975472ca3 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:42.678026 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e08439c3-2d27-426f-9c58-fb2975472ca3 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:42.678469 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e08439c3-2d27-426f-9c58-fb2975472ca3 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:42.889437 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e08439c3-2d27-426f-9c58-fb2975472ca3 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:42.898642 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e08439c3-2d27-426f-9c58-fb2975472ca3 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1477 microversion: 2.1 time: 0.246106 Jun 20 12:13:42.899382 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1792/3639] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:42 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1477 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:43.050028 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-3728748a-eb5b-4292-84b8-8a1b8c7d0e00 req-fd56306e-f6e5-46fd-9c8a-a8607b52e98d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5b82c0b-6c6a-4d96-a8b2-437d242334f2", "name": "network-vif-unplugged", "status": "completed", "tag": "37e16ff5-1455-4eef-bf70-355b74b7eff3"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:13:43.060310 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-3728748a-eb5b-4292-84b8-8a1b8c7d0e00 req-fd56306e-f6e5-46fd-9c8a-a8607b52e98d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:43.060869 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-3728748a-eb5b-4292-84b8-8a1b8c7d0e00 req-fd56306e-f6e5-46fd-9c8a-a8607b52e98d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:43.074446 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-3728748a-eb5b-4292-84b8-8a1b8c7d0e00 req-fd56306e-f6e5-46fd-9c8a-a8607b52e98d service nova] Creating event network-vif-unplugged:37e16ff5-1455-4eef-bf70-355b74b7eff3 for instance d5b82c0b-6c6a-4d96-a8b2-437d242334f2 on n-h2-master-1 Jun 20 12:13:43.079668 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-3728748a-eb5b-4292-84b8-8a1b8c7d0e00 req-fd56306e-f6e5-46fd-9c8a-a8607b52e98d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033628 Jun 20 12:13:43.080394 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1793/3640] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:13:43.471878 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1e330afe-b65d-40b3-8bec-1761da31317c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:43.472824 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1e330afe-b65d-40b3-8bec-1761da31317c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: b0df0320-6a60-433c-bfe9-8011cd85e631] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:43.480553 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e330afe-b65d-40b3-8bec-1761da31317c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:43.480729 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e330afe-b65d-40b3-8bec-1761da31317c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:43.481467 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e330afe-b65d-40b3-8bec-1761da31317c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:43.481906 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e330afe-b65d-40b3-8bec-1761da31317c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:43.650666 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1e330afe-b65d-40b3-8bec-1761da31317c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:43.662636 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1e330afe-b65d-40b3-8bec-1761da31317c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631" status: 200 len: 1316 microversion: 2.1 time: 0.194997 Jun 20 12:13:43.663232 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1794/3641] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:43 2022] GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631 => generated 1316 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:43.681311 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9f8399b1-857f-45c7-bfd7-5e477840c538 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:43.682058 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9f8399b1-857f-45c7-bfd7-5e477840c538 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:43.688696 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9f8399b1-857f-45c7-bfd7-5e477840c538 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:43.689144 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9f8399b1-857f-45c7-bfd7-5e477840c538 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:43.689907 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9f8399b1-857f-45c7-bfd7-5e477840c538 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:43.690339 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9f8399b1-857f-45c7-bfd7-5e477840c538 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:43.780715 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9f8399b1-857f-45c7-bfd7-5e477840c538 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:43.797118 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9f8399b1-857f-45c7-bfd7-5e477840c538 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:43.800500 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9f8399b1-857f-45c7-bfd7-5e477840c538 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:43.802860 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9f8399b1-857f-45c7-bfd7-5e477840c538 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1365 microversion: 2.47 time: 0.125506 Jun 20 12:13:43.804147 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1795/3642] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:43 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1365 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:13:43.916442 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a917370a-aab4-454a-979e-8599fcb31f96 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:43.917204 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a917370a-aab4-454a-979e-8599fcb31f96 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:43.929139 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a917370a-aab4-454a-979e-8599fcb31f96 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:43.930380 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a917370a-aab4-454a-979e-8599fcb31f96 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:43.931624 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a917370a-aab4-454a-979e-8599fcb31f96 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:43.932171 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a917370a-aab4-454a-979e-8599fcb31f96 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:43.998419 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=16 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:13:44.063841 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=16 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:13:44.098206 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a917370a-aab4-454a-979e-8599fcb31f96 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:44.108387 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a917370a-aab4-454a-979e-8599fcb31f96 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1477 microversion: 2.1 time: 0.195962 Jun 20 12:13:44.109162 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1796/3643] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:43 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1477 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:13:44.682420 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-39e624dc-a41b-4442-b022-a69582f344cf tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:44.683148 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-39e624dc-a41b-4442-b022-a69582f344cf tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: b0df0320-6a60-433c-bfe9-8011cd85e631] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:44.689214 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-39e624dc-a41b-4442-b022-a69582f344cf tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:44.689671 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-39e624dc-a41b-4442-b022-a69582f344cf tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:44.690452 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-39e624dc-a41b-4442-b022-a69582f344cf tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:44.690893 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-39e624dc-a41b-4442-b022-a69582f344cf tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:44.844135 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-39e624dc-a41b-4442-b022-a69582f344cf tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:44.853682 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-39e624dc-a41b-4442-b022-a69582f344cf tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631" status: 200 len: 1316 microversion: 2.1 time: 0.177136 Jun 20 12:13:44.863736 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1797/3644] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:44 2022] GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631 => generated 1316 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:13:44.864168 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4678da0c-e1f1-4d67-94b8-54db60f6061d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:44.864700 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4678da0c-e1f1-4d67-94b8-54db60f6061d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:44.874759 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4678da0c-e1f1-4d67-94b8-54db60f6061d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:44.875216 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4678da0c-e1f1-4d67-94b8-54db60f6061d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:44.876111 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4678da0c-e1f1-4d67-94b8-54db60f6061d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:44.876678 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4678da0c-e1f1-4d67-94b8-54db60f6061d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:44.965336 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4678da0c-e1f1-4d67-94b8-54db60f6061d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:44.978458 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4678da0c-e1f1-4d67-94b8-54db60f6061d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:44.984854 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4678da0c-e1f1-4d67-94b8-54db60f6061d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:44.990832 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4678da0c-e1f1-4d67-94b8-54db60f6061d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1365 microversion: 2.47 time: 0.134990 Jun 20 12:13:44.991914 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1798/3645] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:44 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1365 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:13:45.126373 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ad3f17dc-c4a7-4124-9fee-6dded79bba6d tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:45.127093 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ad3f17dc-c4a7-4124-9fee-6dded79bba6d tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:45.138627 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ad3f17dc-c4a7-4124-9fee-6dded79bba6d tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:45.139336 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ad3f17dc-c4a7-4124-9fee-6dded79bba6d tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:45.140554 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ad3f17dc-c4a7-4124-9fee-6dded79bba6d tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:45.141825 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ad3f17dc-c4a7-4124-9fee-6dded79bba6d tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:45.376157 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ad3f17dc-c4a7-4124-9fee-6dded79bba6d tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:45.384836 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ad3f17dc-c4a7-4124-9fee-6dded79bba6d tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1477 microversion: 2.1 time: 0.263257 Jun 20 12:13:45.385867 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1799/3646] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:45 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1477 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:13:45.754248 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-09cefcf3-4a7f-4a46-b791-2ee286a12f80 req-9f8e3246-84d9-409f-ae2e-d39eafc63c53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc", "tag": "4b0b8cf9-ff46-4970-9b45-8795ce12a358"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:13:45.800577 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-09cefcf3-4a7f-4a46-b791-2ee286a12f80 req-9f8e3246-84d9-409f-ae2e-d39eafc63c53 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:45.801380 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-09cefcf3-4a7f-4a46-b791-2ee286a12f80 req-9f8e3246-84d9-409f-ae2e-d39eafc63c53 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:45.846824 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-09cefcf3-4a7f-4a46-b791-2ee286a12f80 req-9f8e3246-84d9-409f-ae2e-d39eafc63c53 service nova] Creating event network-changed:4b0b8cf9-ff46-4970-9b45-8795ce12a358 for instance 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc on n-h1-master-1 Jun 20 12:13:45.879372 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-09cefcf3-4a7f-4a46-b791-2ee286a12f80 req-9f8e3246-84d9-409f-ae2e-d39eafc63c53 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135767 Jun 20 12:13:45.881313 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1800/3647] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:13:45.891263 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-869f42ad-10c8-4553-910d-e84c8d340f60 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:45.900243 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-869f42ad-10c8-4553-910d-e84c8d340f60 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: b0df0320-6a60-433c-bfe9-8011cd85e631] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:45.928538 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-869f42ad-10c8-4553-910d-e84c8d340f60 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:45.929438 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-869f42ad-10c8-4553-910d-e84c8d340f60 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:45.932287 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-869f42ad-10c8-4553-910d-e84c8d340f60 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:45.934064 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-869f42ad-10c8-4553-910d-e84c8d340f60 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:45.976179 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:13:46.338563 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-869f42ad-10c8-4553-910d-e84c8d340f60 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:46.352579 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-869f42ad-10c8-4553-910d-e84c8d340f60 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631" status: 200 len: 1316 microversion: 2.1 time: 0.469120 Jun 20 12:13:46.353345 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1801/3648] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:45 2022] GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631 => generated 1316 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:46.368772 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3d36f464-08a2-4ade-8475-6226b8280c12 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:46.370292 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3d36f464-08a2-4ade-8475-6226b8280c12 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:46.391851 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3d36f464-08a2-4ade-8475-6226b8280c12 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:46.392428 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3d36f464-08a2-4ade-8475-6226b8280c12 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:46.393206 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3d36f464-08a2-4ade-8475-6226b8280c12 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:46.393642 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3d36f464-08a2-4ade-8475-6226b8280c12 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:46.549040 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3d36f464-08a2-4ade-8475-6226b8280c12 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:46.559167 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3d36f464-08a2-4ade-8475-6226b8280c12 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:46.565340 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3d36f464-08a2-4ade-8475-6226b8280c12 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:46.567870 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3d36f464-08a2-4ade-8475-6226b8280c12 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1365 microversion: 2.47 time: 0.213112 Jun 20 12:13:46.573279 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1802/3649] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:46 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:13:46.585188 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c9eb18b4-bca4-4629-b2d6-b0a66b0cddd0 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:46.587750 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c9eb18b4-bca4-4629-b2d6-b0a66b0cddd0 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:46.601928 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c9eb18b4-bca4-4629-b2d6-b0a66b0cddd0 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:46.608040 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c9eb18b4-bca4-4629-b2d6-b0a66b0cddd0 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:46.609248 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c9eb18b4-bca4-4629-b2d6-b0a66b0cddd0 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:46.609891 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c9eb18b4-bca4-4629-b2d6-b0a66b0cddd0 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:47.021820 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c9eb18b4-bca4-4629-b2d6-b0a66b0cddd0 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:47.034720 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c9eb18b4-bca4-4629-b2d6-b0a66b0cddd0 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1463 microversion: 2.1 time: 0.459594 Jun 20 12:13:47.035613 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1803/3650] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:46 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1463 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:47.052366 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3c7fc55d-5ad7-4905-a469-a69f1a9574e0 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:47.053407 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3c7fc55d-5ad7-4905-a469-a69f1a9574e0 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:47.070340 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3c7fc55d-5ad7-4905-a469-a69f1a9574e0 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:47.071351 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3c7fc55d-5ad7-4905-a469-a69f1a9574e0 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:47.074296 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3c7fc55d-5ad7-4905-a469-a69f1a9574e0 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:47.076546 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3c7fc55d-5ad7-4905-a469-a69f1a9574e0 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:47.406982 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3c7fc55d-5ad7-4905-a469-a69f1a9574e0 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:47.422570 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3c7fc55d-5ad7-4905-a469-a69f1a9574e0 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1463 microversion: 2.1 time: 0.368648 Jun 20 12:13:47.423782 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1804/3651] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:47 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1463 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:47.439477 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-844985c6-bbed-4490-9f4f-2cf7b43893a1 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:47.440341 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-844985c6-bbed-4490-9f4f-2cf7b43893a1 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: b0df0320-6a60-433c-bfe9-8011cd85e631] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:47.447991 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-844985c6-bbed-4490-9f4f-2cf7b43893a1 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:47.452259 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-844985c6-bbed-4490-9f4f-2cf7b43893a1 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:47.453673 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-844985c6-bbed-4490-9f4f-2cf7b43893a1 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:47.454943 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-844985c6-bbed-4490-9f4f-2cf7b43893a1 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:47.721556 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-844985c6-bbed-4490-9f4f-2cf7b43893a1 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:47.736709 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-844985c6-bbed-4490-9f4f-2cf7b43893a1 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631" status: 200 len: 1316 microversion: 2.1 time: 0.311019 Jun 20 12:13:47.737941 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1805/3652] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:47 2022] GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631 => generated 1316 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:47.744379 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cb003f4a-d4b0-4296-8aea-375bdcccf4a2 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:13:47.746513 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cb003f4a-d4b0-4296-8aea-375bdcccf4a2 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:47.754400 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb003f4a-d4b0-4296-8aea-375bdcccf4a2 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:47.755525 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb003f4a-d4b0-4296-8aea-375bdcccf4a2 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:47.756791 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb003f4a-d4b0-4296-8aea-375bdcccf4a2 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:47.757424 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb003f4a-d4b0-4296-8aea-375bdcccf4a2 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:47.869249 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-cb003f4a-d4b0-4296-8aea-375bdcccf4a2 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:13:47.871516 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-cb003f4a-d4b0-4296-8aea-375bdcccf4a2 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:13:47.872857 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-cb003f4a-d4b0-4296-8aea-375bdcccf4a2 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:13:47.873287 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-cb003f4a-d4b0-4296-8aea-375bdcccf4a2 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:13:47.874367 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-cb003f4a-d4b0-4296-8aea-375bdcccf4a2 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:13:47.944048 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cb003f4a-d4b0-4296-8aea-375bdcccf4a2 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:47.950975 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb003f4a-d4b0-4296-8aea-375bdcccf4a2 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:47.951363 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb003f4a-d4b0-4296-8aea-375bdcccf4a2 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:47.952148 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb003f4a-d4b0-4296-8aea-375bdcccf4a2 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:47.952602 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb003f4a-d4b0-4296-8aea-375bdcccf4a2 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:47.987434 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cb003f4a-d4b0-4296-8aea-375bdcccf4a2 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "POST /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2/action" status: 202 len: 1067 microversion: 2.1 time: 0.243489 Jun 20 12:13:47.990085 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1806/3653] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:13:47 2022] POST /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2/action => generated 1067 bytes in 251 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jun 20 12:13:47.995070 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-97ef8bff-2465-4f11-b60b-2c169cdc31dd tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:47.995688 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-97ef8bff-2465-4f11-b60b-2c169cdc31dd tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:48.010005 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-97ef8bff-2465-4f11-b60b-2c169cdc31dd tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:48.010460 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-97ef8bff-2465-4f11-b60b-2c169cdc31dd tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:48.011892 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-97ef8bff-2465-4f11-b60b-2c169cdc31dd tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:48.012486 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-97ef8bff-2465-4f11-b60b-2c169cdc31dd tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:48.109168 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-97ef8bff-2465-4f11-b60b-2c169cdc31dd tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:48.118404 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-97ef8bff-2465-4f11-b60b-2c169cdc31dd tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:48.119971 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-97ef8bff-2465-4f11-b60b-2c169cdc31dd tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:48.121326 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-97ef8bff-2465-4f11-b60b-2c169cdc31dd tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1365 microversion: 2.47 time: 0.130065 Jun 20 12:13:48.122280 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1807/3654] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:47 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1365 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:13:48.126957 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7be505f8-55d5-4807-956c-d924d9725257 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:48.127632 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7be505f8-55d5-4807-956c-d924d9725257 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:48.134118 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7be505f8-55d5-4807-956c-d924d9725257 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:48.134839 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7be505f8-55d5-4807-956c-d924d9725257 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:48.139423 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7be505f8-55d5-4807-956c-d924d9725257 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:48.139891 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7be505f8-55d5-4807-956c-d924d9725257 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:48.376907 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7be505f8-55d5-4807-956c-d924d9725257 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:48.390220 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7be505f8-55d5-4807-956c-d924d9725257 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1472 microversion: 2.1 time: 0.266868 Jun 20 12:13:48.396156 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1808/3655] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:48 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1472 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:48.411275 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-71d735c1-01db-4919-b81b-78b11e73c020 req-68982d27-efc3-4dac-8bdd-1392a3779df1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0df0320-6a60-433c-bfe9-8011cd85e631", "tag": "dfcb1b26-b9d9-45b4-9427-41b6b2493277"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:13:48.427610 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-71d735c1-01db-4919-b81b-78b11e73c020 req-68982d27-efc3-4dac-8bdd-1392a3779df1 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:48.428053 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-71d735c1-01db-4919-b81b-78b11e73c020 req-68982d27-efc3-4dac-8bdd-1392a3779df1 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:48.455392 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-71d735c1-01db-4919-b81b-78b11e73c020 req-68982d27-efc3-4dac-8bdd-1392a3779df1 service nova] Creating event network-changed:dfcb1b26-b9d9-45b4-9427-41b6b2493277 for instance b0df0320-6a60-433c-bfe9-8011cd85e631 on n-h2-master-1 Jun 20 12:13:48.462261 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-71d735c1-01db-4919-b81b-78b11e73c020 req-68982d27-efc3-4dac-8bdd-1392a3779df1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054597 Jun 20 12:13:48.466311 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1809/3656] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:13:48.680042 n-d-master-1 devstack@n-api.service[119127]: INFO nova.network.neutron [None req-871a0a90-d455-4a63-aac7-1b7a051bac7f tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: 71b51f0c-5366-4aa8-86dc-753f55c21590] re-assign floating IP 172.35.2.247 from instance fd56a5df-a994-416e-b1d4-a5a78df871b2 Jun 20 12:13:48.749062 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-871a0a90-d455-4a63-aac7-1b7a051bac7f tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: fd56a5df-a994-416e-b1d4-a5a78df871b2] Building network info cache for instance {{(pid=119127) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 20 12:13:48.754941 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1574275d-d5fe-4464-a15c-6b7b59099600 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:48.755924 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1574275d-d5fe-4464-a15c-6b7b59099600 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: b0df0320-6a60-433c-bfe9-8011cd85e631] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:48.764497 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1574275d-d5fe-4464-a15c-6b7b59099600 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:48.769535 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1574275d-d5fe-4464-a15c-6b7b59099600 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:48.770638 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1574275d-d5fe-4464-a15c-6b7b59099600 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:48.772851 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1574275d-d5fe-4464-a15c-6b7b59099600 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:48.845185 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=24 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:13:49.027714 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1574275d-d5fe-4464-a15c-6b7b59099600 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:49.040999 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1574275d-d5fe-4464-a15c-6b7b59099600 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631" status: 200 len: 1316 microversion: 2.1 time: 0.290208 Jun 20 12:13:49.055022 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1810/3657] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:48 2022] GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631 => generated 1316 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:49.256362 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1dc916b8-3e71-4908-b9da-31cbae3c3f8d tempest-PortsAdminExtendedAttrsTestJSON-238555535 tempest-PortsAdminExtendedAttrsTestJSON-238555535-project-admin] Calling method '.version_select at 0x7f6073523b80>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:49.258771 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:13:49.258771 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 12:13:49.260662 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1dc916b8-3e71-4908-b9da-31cbae3c3f8d tempest-PortsAdminExtendedAttrsTestJSON-238555535 tempest-PortsAdminExtendedAttrsTestJSON-238555535-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:49.261312 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1dc916b8-3e71-4908-b9da-31cbae3c3f8d tempest-PortsAdminExtendedAttrsTestJSON-238555535 tempest-PortsAdminExtendedAttrsTestJSON-238555535-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:49.277553 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1dc916b8-3e71-4908-b9da-31cbae3c3f8d tempest-PortsAdminExtendedAttrsTestJSON-238555535 tempest-PortsAdminExtendedAttrsTestJSON-238555535-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:49.278160 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1dc916b8-3e71-4908-b9da-31cbae3c3f8d tempest-PortsAdminExtendedAttrsTestJSON-238555535 tempest-PortsAdminExtendedAttrsTestJSON-238555535-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:49.290784 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1dc916b8-3e71-4908-b9da-31cbae3c3f8d tempest-PortsAdminExtendedAttrsTestJSON-238555535 tempest-PortsAdminExtendedAttrsTestJSON-238555535-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:49.291451 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1dc916b8-3e71-4908-b9da-31cbae3c3f8d tempest-PortsAdminExtendedAttrsTestJSON-238555535 tempest-PortsAdminExtendedAttrsTestJSON-238555535-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:49.302775 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1dc916b8-3e71-4908-b9da-31cbae3c3f8d tempest-PortsAdminExtendedAttrsTestJSON-238555535 tempest-PortsAdminExtendedAttrsTestJSON-238555535-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.246169 Jun 20 12:13:49.304362 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1811/3658] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 12:13:49 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:13:49.310797 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f410ddc2-b365-4fbe-9de7-884584e8aeb0 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:49.311766 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f410ddc2-b365-4fbe-9de7-884584e8aeb0 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:49.322014 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f410ddc2-b365-4fbe-9de7-884584e8aeb0 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:49.322743 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f410ddc2-b365-4fbe-9de7-884584e8aeb0 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:49.323781 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f410ddc2-b365-4fbe-9de7-884584e8aeb0 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:49.324851 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f410ddc2-b365-4fbe-9de7-884584e8aeb0 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:49.426203 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f410ddc2-b365-4fbe-9de7-884584e8aeb0 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:49.443913 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f410ddc2-b365-4fbe-9de7-884584e8aeb0 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:49.453938 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f410ddc2-b365-4fbe-9de7-884584e8aeb0 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:49.455302 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f410ddc2-b365-4fbe-9de7-884584e8aeb0 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1365 microversion: 2.47 time: 0.149429 Jun 20 12:13:49.456986 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1812/3659] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:49 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:13:49.470437 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-1a4df403-5bd4-49fe-8c97-2032953e5a65 req-06ec21ba-a967-4f4d-87a0-e2fe7a1e7d7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5b82c0b-6c6a-4d96-a8b2-437d242334f2", "name": "network-vif-plugged", "status": "completed", "tag": "37e16ff5-1455-4eef-bf70-355b74b7eff3"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:13:49.494887 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-1a4df403-5bd4-49fe-8c97-2032953e5a65 req-06ec21ba-a967-4f4d-87a0-e2fe7a1e7d7f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:49.496916 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-1a4df403-5bd4-49fe-8c97-2032953e5a65 req-06ec21ba-a967-4f4d-87a0-e2fe7a1e7d7f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:49.525597 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-1a4df403-5bd4-49fe-8c97-2032953e5a65 req-06ec21ba-a967-4f4d-87a0-e2fe7a1e7d7f service nova] Creating event network-vif-plugged:37e16ff5-1455-4eef-bf70-355b74b7eff3 for instance d5b82c0b-6c6a-4d96-a8b2-437d242334f2 on n-h2-master-1 Jun 20 12:13:49.540846 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-1a4df403-5bd4-49fe-8c97-2032953e5a65 req-06ec21ba-a967-4f4d-87a0-e2fe7a1e7d7f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080975 Jun 20 12:13:49.542675 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1813/3660] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:13:49.557383 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-feaf9cfe-63b4-4660-9440-147b3f002f9e tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:49.558111 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-feaf9cfe-63b4-4660-9440-147b3f002f9e tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:49.569002 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-feaf9cfe-63b4-4660-9440-147b3f002f9e tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:49.570601 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-feaf9cfe-63b4-4660-9440-147b3f002f9e tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:49.575701 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-feaf9cfe-63b4-4660-9440-147b3f002f9e tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:49.577058 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-feaf9cfe-63b4-4660-9440-147b3f002f9e tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:49.985396 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-feaf9cfe-63b4-4660-9440-147b3f002f9e tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:49.996388 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-feaf9cfe-63b4-4660-9440-147b3f002f9e tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1472 microversion: 2.1 time: 0.449378 Jun 20 12:13:49.998360 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1814/3661] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:49 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1472 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:50.062249 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0f13a869-5b66-4def-95cb-1ffe28b118c9 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:50.063313 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0f13a869-5b66-4def-95cb-1ffe28b118c9 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: b0df0320-6a60-433c-bfe9-8011cd85e631] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:50.070726 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f13a869-5b66-4def-95cb-1ffe28b118c9 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:50.071476 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f13a869-5b66-4def-95cb-1ffe28b118c9 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:50.072530 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f13a869-5b66-4def-95cb-1ffe28b118c9 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:50.073604 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f13a869-5b66-4def-95cb-1ffe28b118c9 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:50.077992 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-871a0a90-d455-4a63-aac7-1b7a051bac7f tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: fd56a5df-a994-416e-b1d4-a5a78df871b2] Updating instance_info_cache with network_info: [{"id": "c09d88d8-69e4-4159-a104-22eba04fd540", "address": "fa:16:3e:7c:ef:fa", "network": {"id": "e52cf695-08a7-4228-8afa-64520bdba860", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1069428594-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6b5ce0a299ef4e10be4dccca2ef8b957", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc09d88d8-69", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119127) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 20 12:13:50.103769 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-871a0a90-d455-4a63-aac7-1b7a051bac7f tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: 71b51f0c-5366-4aa8-86dc-753f55c21590] Building network info cache for instance {{(pid=119127) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 20 12:13:50.401644 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0f13a869-5b66-4def-95cb-1ffe28b118c9 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:50.418015 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0f13a869-5b66-4def-95cb-1ffe28b118c9 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631" status: 200 len: 1316 microversion: 2.1 time: 0.359803 Jun 20 12:13:50.419934 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1815/3662] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:50 2022] GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631 => generated 1316 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:13:50.477545 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-87f1d3c2-2398-41eb-beff-06c234833298 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:50.479194 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-87f1d3c2-2398-41eb-beff-06c234833298 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:50.488796 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-87f1d3c2-2398-41eb-beff-06c234833298 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:50.489679 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-87f1d3c2-2398-41eb-beff-06c234833298 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:50.491172 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-87f1d3c2-2398-41eb-beff-06c234833298 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:50.492044 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-87f1d3c2-2398-41eb-beff-06c234833298 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:50.608861 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-87f1d3c2-2398-41eb-beff-06c234833298 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:50.620360 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-87f1d3c2-2398-41eb-beff-06c234833298 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:50.622697 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-87f1d3c2-2398-41eb-beff-06c234833298 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:50.624542 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-87f1d3c2-2398-41eb-beff-06c234833298 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1365 microversion: 2.47 time: 0.152797 Jun 20 12:13:50.638252 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1816/3663] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:50 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:13:50.647065 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-89b105fc-90aa-4b7d-83a5-836d73680dd2 req-62194a9c-21ff-4d59-be8f-56b1ba0e803e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd56a5df-a994-416e-b1d4-a5a78df871b2", "tag": "c09d88d8-69e4-4159-a104-22eba04fd540"}, {"name": "network-changed", "server_uuid": "71b51f0c-5366-4aa8-86dc-753f55c21590", "tag": "626fc638-ecf6-445b-92f4-0487f1f80338"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:13:50.662510 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-89b105fc-90aa-4b7d-83a5-836d73680dd2 req-62194a9c-21ff-4d59-be8f-56b1ba0e803e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:50.663331 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-89b105fc-90aa-4b7d-83a5-836d73680dd2 req-62194a9c-21ff-4d59-be8f-56b1ba0e803e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:50.682164 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-89b105fc-90aa-4b7d-83a5-836d73680dd2 req-62194a9c-21ff-4d59-be8f-56b1ba0e803e service nova] Creating event network-changed:c09d88d8-69e4-4159-a104-22eba04fd540 for instance fd56a5df-a994-416e-b1d4-a5a78df871b2 on n-h1-master-1 Jun 20 12:13:50.683007 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-89b105fc-90aa-4b7d-83a5-836d73680dd2 req-62194a9c-21ff-4d59-be8f-56b1ba0e803e service nova] Creating event network-changed:626fc638-ecf6-445b-92f4-0487f1f80338 for instance 71b51f0c-5366-4aa8-86dc-753f55c21590 on n-h1-master-1 Jun 20 12:13:50.691914 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-89b105fc-90aa-4b7d-83a5-836d73680dd2 req-62194a9c-21ff-4d59-be8f-56b1ba0e803e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.051054 Jun 20 12:13:50.693366 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1817/3664] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:13:50.829355 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-871a0a90-d455-4a63-aac7-1b7a051bac7f tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: 71b51f0c-5366-4aa8-86dc-753f55c21590] Updating instance_info_cache with network_info: [{"id": "626fc638-ecf6-445b-92f4-0487f1f80338", "address": "fa:16:3e:45:2d:97", "network": {"id": "e52cf695-08a7-4228-8afa-64520bdba860", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1069428594-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.2.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6b5ce0a299ef4e10be4dccca2ef8b957", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap626fc638-ec", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119127) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 20 12:13:50.847855 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-871a0a90-d455-4a63-aac7-1b7a051bac7f tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Releasing lock "refresh_cache-71b51f0c-5366-4aa8-86dc-753f55c21590" {{(pid=119127) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 20 12:13:50.849012 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-871a0a90-d455-4a63-aac7-1b7a051bac7f tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "POST /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590/action" status: 202 len: 0 microversion: 2.1 time: 9.746950 Jun 20 12:13:50.850346 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1848/3665] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:13:41 2022] POST /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590/action => generated 0 bytes in 9749 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 20 12:13:50.862032 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6cccc7a2-d240-4715-84b1-da858d2b0dc7 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.2.247"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:13:51.018269 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cb0042f9-9ad2-44f7-9756-17118157e52e tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:51.018845 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cb0042f9-9ad2-44f7-9756-17118157e52e tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:51.029841 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cb0042f9-9ad2-44f7-9756-17118157e52e tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:51.030614 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cb0042f9-9ad2-44f7-9756-17118157e52e tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:51.032275 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cb0042f9-9ad2-44f7-9756-17118157e52e tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:51.032739 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cb0042f9-9ad2-44f7-9756-17118157e52e tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:51.219557 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cb0042f9-9ad2-44f7-9756-17118157e52e tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:51.229040 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cb0042f9-9ad2-44f7-9756-17118157e52e tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1472 microversion: 2.1 time: 0.216847 Jun 20 12:13:51.230384 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1849/3666] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:51 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1472 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:51.436664 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ff0b69b1-f247-4fd5-b219-0c255fe2ffdf tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:51.438144 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ff0b69b1-f247-4fd5-b219-0c255fe2ffdf tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: b0df0320-6a60-433c-bfe9-8011cd85e631] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:51.451188 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff0b69b1-f247-4fd5-b219-0c255fe2ffdf tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:51.469301 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff0b69b1-f247-4fd5-b219-0c255fe2ffdf tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:51.470180 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff0b69b1-f247-4fd5-b219-0c255fe2ffdf tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:51.472996 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff0b69b1-f247-4fd5-b219-0c255fe2ffdf tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:51.618150 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6cccc7a2-d240-4715-84b1-da858d2b0dc7 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: 71b51f0c-5366-4aa8-86dc-753f55c21590] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:51.634505 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6cccc7a2-d240-4715-84b1-da858d2b0dc7 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:51.635271 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6cccc7a2-d240-4715-84b1-da858d2b0dc7 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:51.636461 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6cccc7a2-d240-4715-84b1-da858d2b0dc7 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:51.637145 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6cccc7a2-d240-4715-84b1-da858d2b0dc7 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:51.640696 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:13:51.794747 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ff0b69b1-f247-4fd5-b219-0c255fe2ffdf tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:51.807411 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ff0b69b1-f247-4fd5-b219-0c255fe2ffdf tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631" status: 200 len: 1316 microversion: 2.1 time: 0.374673 Jun 20 12:13:51.808783 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1850/3667] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:51 2022] GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631 => generated 1316 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:51.814625 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5df437a9-9aaa-42e1-bbd5-8299297edcf6 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:51.815489 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5df437a9-9aaa-42e1-bbd5-8299297edcf6 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:51.825179 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5df437a9-9aaa-42e1-bbd5-8299297edcf6 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:51.826224 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5df437a9-9aaa-42e1-bbd5-8299297edcf6 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:51.827388 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5df437a9-9aaa-42e1-bbd5-8299297edcf6 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:51.828048 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5df437a9-9aaa-42e1-bbd5-8299297edcf6 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:51.962190 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5df437a9-9aaa-42e1-bbd5-8299297edcf6 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:51.983889 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5df437a9-9aaa-42e1-bbd5-8299297edcf6 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:51.988244 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5df437a9-9aaa-42e1-bbd5-8299297edcf6 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:51.989760 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5df437a9-9aaa-42e1-bbd5-8299297edcf6 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1365 microversion: 2.47 time: 0.179732 Jun 20 12:13:51.990944 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1851/3668] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:51 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:13:52.256731 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-afd6e642-d0d2-4c3f-8e75-1ae4887ecfd8 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:52.258139 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-afd6e642-d0d2-4c3f-8e75-1ae4887ecfd8 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:52.268857 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-afd6e642-d0d2-4c3f-8e75-1ae4887ecfd8 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:52.269612 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-afd6e642-d0d2-4c3f-8e75-1ae4887ecfd8 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:52.271060 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-afd6e642-d0d2-4c3f-8e75-1ae4887ecfd8 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:52.272804 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-afd6e642-d0d2-4c3f-8e75-1ae4887ecfd8 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:52.397415 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-6cccc7a2-d240-4715-84b1-da858d2b0dc7 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] HTTP exception thrown: Floating IP 172.35.2.247 is not associated with instance fd56a5df-a994-416e-b1d4-a5a78df871b2. Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6cccc7a2-d240-4715-84b1-da858d2b0dc7 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Request method failure captured: Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2/action HTTP/1.1 Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 49 Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGQ5nfCNxCSTubPQFZpKI5xLw-Lk21qmc_3O5k9yVdyL-RLjlR7ZaeB2VN02txLyeyqQY0UHamkIqRQ64yM2zNc6pb1nFMGr0zQu9ybKCrplgVvAdT4JN0rT1A5u0bGN-i5bqvt61Y89ouL5Y3ZdVAMMjKFTV74EmmQ_oPv_k9Bh-aI Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 6b5ce0a299ef4e10be4dccca2ef8b957 Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1009548493 Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b5ce0a299ef4e10be4dccca2ef8b957"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b5ce0a299ef4e10be4dccca2ef8b957"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b5ce0a299ef4e10be4dccca2ef8b957"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b5ce0a299ef4e10be4dccca2ef8b957"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1009548493 Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 6b5ce0a299ef4e10be4dccca2ef8b957 Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1009548493 Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-FloatingIPsAssociationTestJSON-1009548493-project Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 0e4a7cec6b754f4095917bb4cb9ee283 Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1009548493-project Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: {"removeFloatingIp": {"address": "172.35.2.247"}} Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: exception: Floating IP 172.35.2.247 is not associated with instance fd56a5df-a994-416e-b1d4-a5a78df871b2. Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'fd56a5df-a994-416e-b1d4-a5a78df871b2', 'body': {'removeFloatingIp': {'address': '172.35.2.247'}}} Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.35.2.247 is not associated with instance fd56a5df-a994-416e-b1d4-a5a78df871b2. Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.35.2.247 is not associated with instance fd56a5df-a994-416e-b1d4-a5a78df871b2. Jun 20 12:13:52.399677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:13:52.405790 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6cccc7a2-d240-4715-84b1-da858d2b0dc7 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Returning 409 to user: Floating IP 172.35.2.247 is not associated with instance fd56a5df-a994-416e-b1d4-a5a78df871b2. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:13:52.405790 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6cccc7a2-d240-4715-84b1-da858d2b0dc7 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "POST /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2/action" status: 409 len: 146 microversion: 2.1 time: 1.548615 Jun 20 12:13:52.406316 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1818/3669] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:13:50 2022] POST /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2/action => generated 146 bytes in 1551 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:13:52.414967 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cfae25da-bdcc-4f12-beb3-24a7bb7b3347 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.2.247"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:13:52.741232 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cfae25da-bdcc-4f12-beb3-24a7bb7b3347 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: 71b51f0c-5366-4aa8-86dc-753f55c21590] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:52.756744 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cfae25da-bdcc-4f12-beb3-24a7bb7b3347 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:52.757836 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cfae25da-bdcc-4f12-beb3-24a7bb7b3347 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:52.759181 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cfae25da-bdcc-4f12-beb3-24a7bb7b3347 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:52.760147 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cfae25da-bdcc-4f12-beb3-24a7bb7b3347 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:52.821667 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-afd6e642-d0d2-4c3f-8e75-1ae4887ecfd8 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:52.832303 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-afd6e642-d0d2-4c3f-8e75-1ae4887ecfd8 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1472 microversion: 2.1 time: 0.586185 Jun 20 12:13:52.844123 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1852/3670] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:52 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1472 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:52.850400 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a544a13d-cbd3-462f-9b2b-3e797dcae156 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:52.851375 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a544a13d-cbd3-462f-9b2b-3e797dcae156 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: b0df0320-6a60-433c-bfe9-8011cd85e631] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:52.866497 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a544a13d-cbd3-462f-9b2b-3e797dcae156 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:52.869686 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a544a13d-cbd3-462f-9b2b-3e797dcae156 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:52.870832 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a544a13d-cbd3-462f-9b2b-3e797dcae156 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:52.871575 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a544a13d-cbd3-462f-9b2b-3e797dcae156 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:53.368557 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cfae25da-bdcc-4f12-beb3-24a7bb7b3347 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Acquired lock "refresh_cache-71b51f0c-5366-4aa8-86dc-753f55c21590" {{(pid=119128) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 20 12:13:53.748720 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a544a13d-cbd3-462f-9b2b-3e797dcae156 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:53.781893 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a544a13d-cbd3-462f-9b2b-3e797dcae156 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631" status: 200 len: 1316 microversion: 2.1 time: 0.935414 Jun 20 12:13:53.782962 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1853/3671] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:52 2022] GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631 => generated 1316 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:53.797314 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bae428cf-2987-4fd9-b803-bafffcc5d142 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:53.809600 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bae428cf-2987-4fd9-b803-bafffcc5d142 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:53.816803 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bae428cf-2987-4fd9-b803-bafffcc5d142 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:53.817496 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bae428cf-2987-4fd9-b803-bafffcc5d142 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:53.818443 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bae428cf-2987-4fd9-b803-bafffcc5d142 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:53.819036 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bae428cf-2987-4fd9-b803-bafffcc5d142 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:53.993416 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bae428cf-2987-4fd9-b803-bafffcc5d142 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:54.010125 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bae428cf-2987-4fd9-b803-bafffcc5d142 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:54.017850 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bae428cf-2987-4fd9-b803-bafffcc5d142 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:54.027121 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bae428cf-2987-4fd9-b803-bafffcc5d142 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1365 microversion: 2.47 time: 0.241084 Jun 20 12:13:54.047335 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1854/3672] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:53 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1365 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:13:54.059224 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-672b42e1-d6c9-406b-a90b-cd2bfb0c6536 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:54.060380 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-672b42e1-d6c9-406b-a90b-cd2bfb0c6536 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:54.069052 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-672b42e1-d6c9-406b-a90b-cd2bfb0c6536 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:54.069897 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-672b42e1-d6c9-406b-a90b-cd2bfb0c6536 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:54.071001 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-672b42e1-d6c9-406b-a90b-cd2bfb0c6536 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:54.071799 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-672b42e1-d6c9-406b-a90b-cd2bfb0c6536 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:54.550145 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-672b42e1-d6c9-406b-a90b-cd2bfb0c6536 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:54.560921 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-672b42e1-d6c9-406b-a90b-cd2bfb0c6536 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1472 microversion: 2.1 time: 0.521268 Jun 20 12:13:54.576913 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1855/3673] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:54 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1472 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:54.803836 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b67353ec-b8e8-4b33-864a-de1bd8812298 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:54.805702 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b67353ec-b8e8-4b33-864a-de1bd8812298 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: b0df0320-6a60-433c-bfe9-8011cd85e631] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:54.823778 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-cfae25da-bdcc-4f12-beb3-24a7bb7b3347 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: 71b51f0c-5366-4aa8-86dc-753f55c21590] Building network info cache for instance {{(pid=119128) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 20 12:13:54.825219 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b67353ec-b8e8-4b33-864a-de1bd8812298 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:54.826052 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b67353ec-b8e8-4b33-864a-de1bd8812298 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:54.827601 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b67353ec-b8e8-4b33-864a-de1bd8812298 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:54.828239 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b67353ec-b8e8-4b33-864a-de1bd8812298 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:55.144878 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b67353ec-b8e8-4b33-864a-de1bd8812298 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:55.158242 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b67353ec-b8e8-4b33-864a-de1bd8812298 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631" status: 200 len: 1316 microversion: 2.1 time: 0.358086 Jun 20 12:13:55.159407 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1856/3674] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:54 2022] GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631 => generated 1316 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:13:55.168551 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-e1c6d34d-2fe6-4012-a5d8-d1a422e580de req-d26271de-a92d-476f-bf6f-532e01f78b97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71b51f0c-5366-4aa8-86dc-753f55c21590", "tag": "626fc638-ecf6-445b-92f4-0487f1f80338"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:13:55.196407 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-e1c6d34d-2fe6-4012-a5d8-d1a422e580de req-d26271de-a92d-476f-bf6f-532e01f78b97 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:55.204940 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-e1c6d34d-2fe6-4012-a5d8-d1a422e580de req-d26271de-a92d-476f-bf6f-532e01f78b97 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:55.226591 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-e1c6d34d-2fe6-4012-a5d8-d1a422e580de req-d26271de-a92d-476f-bf6f-532e01f78b97 service nova] Creating event network-changed:626fc638-ecf6-445b-92f4-0487f1f80338 for instance 71b51f0c-5366-4aa8-86dc-753f55c21590 on n-h1-master-1 Jun 20 12:13:55.245767 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-e1c6d34d-2fe6-4012-a5d8-d1a422e580de req-d26271de-a92d-476f-bf6f-532e01f78b97 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084917 Jun 20 12:13:55.247704 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1857/3675] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:13:55.253470 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-65c9f72c-15a3-4466-9cd6-a749cadd972d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:55.255131 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-65c9f72c-15a3-4466-9cd6-a749cadd972d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:55.264325 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-65c9f72c-15a3-4466-9cd6-a749cadd972d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:55.265944 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-65c9f72c-15a3-4466-9cd6-a749cadd972d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:55.267693 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-65c9f72c-15a3-4466-9cd6-a749cadd972d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:55.269468 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-65c9f72c-15a3-4466-9cd6-a749cadd972d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:55.433671 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-65c9f72c-15a3-4466-9cd6-a749cadd972d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:55.437728 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=3,nova_cell1:RELEASE=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:13:55.450769 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-65c9f72c-15a3-4466-9cd6-a749cadd972d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:55.454567 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-65c9f72c-15a3-4466-9cd6-a749cadd972d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:55.456461 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-65c9f72c-15a3-4466-9cd6-a749cadd972d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1365 microversion: 2.47 time: 0.207248 Jun 20 12:13:55.460935 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1858/3676] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:55 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1365 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:13:55.467798 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-de599e65-257b-448b-8ce4-1c59dc83c5a3 req-85d99865-8dd6-4317-b3ea-5c80f01b39ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0df0320-6a60-433c-bfe9-8011cd85e631", "name": "network-vif-plugged", "status": "completed", "tag": "dfcb1b26-b9d9-45b4-9427-41b6b2493277"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:13:55.492823 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-de599e65-257b-448b-8ce4-1c59dc83c5a3 req-85d99865-8dd6-4317-b3ea-5c80f01b39ab service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:55.499779 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-de599e65-257b-448b-8ce4-1c59dc83c5a3 req-85d99865-8dd6-4317-b3ea-5c80f01b39ab service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:55.533774 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-de599e65-257b-448b-8ce4-1c59dc83c5a3 req-85d99865-8dd6-4317-b3ea-5c80f01b39ab service nova] Creating event network-vif-plugged:dfcb1b26-b9d9-45b4-9427-41b6b2493277 for instance b0df0320-6a60-433c-bfe9-8011cd85e631 on n-h2-master-1 Jun 20 12:13:55.552735 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-de599e65-257b-448b-8ce4-1c59dc83c5a3 req-85d99865-8dd6-4317-b3ea-5c80f01b39ab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089650 Jun 20 12:13:55.560531 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1859/3677] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:13:55.590271 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-66818aad-2295-4ff4-8ab0-393c39db5c07 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:55.592856 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-66818aad-2295-4ff4-8ab0-393c39db5c07 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:55.627962 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66818aad-2295-4ff4-8ab0-393c39db5c07 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:55.630732 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66818aad-2295-4ff4-8ab0-393c39db5c07 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:55.633337 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66818aad-2295-4ff4-8ab0-393c39db5c07 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:55.647116 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66818aad-2295-4ff4-8ab0-393c39db5c07 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:56.237994 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-66818aad-2295-4ff4-8ab0-393c39db5c07 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:56.265108 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-66818aad-2295-4ff4-8ab0-393c39db5c07 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1472 microversion: 2.1 time: 0.684902 Jun 20 12:13:56.266640 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1860/3678] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:55 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1472 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:56.275069 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0fe863b3-0505-4a4c-849a-0a054b8c399b tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:56.286578 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0fe863b3-0505-4a4c-849a-0a054b8c399b tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: b0df0320-6a60-433c-bfe9-8011cd85e631] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:56.306384 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0fe863b3-0505-4a4c-849a-0a054b8c399b tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:56.306384 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0fe863b3-0505-4a4c-849a-0a054b8c399b tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:56.307000 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0fe863b3-0505-4a4c-849a-0a054b8c399b tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:56.313494 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0fe863b3-0505-4a4c-849a-0a054b8c399b tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:56.659911 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0fe863b3-0505-4a4c-849a-0a054b8c399b tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:56.669581 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0fe863b3-0505-4a4c-849a-0a054b8c399b tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631" status: 200 len: 1316 microversion: 2.1 time: 0.400558 Jun 20 12:13:56.671669 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1861/3679] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:56 2022] GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631 => generated 1316 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:56.686181 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d9ae77e7-a16b-43e7-b981-9c958f9926c8 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:56.687212 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d9ae77e7-a16b-43e7-b981-9c958f9926c8 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:56.700621 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9ae77e7-a16b-43e7-b981-9c958f9926c8 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:56.701362 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9ae77e7-a16b-43e7-b981-9c958f9926c8 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:56.702516 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9ae77e7-a16b-43e7-b981-9c958f9926c8 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:56.703146 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9ae77e7-a16b-43e7-b981-9c958f9926c8 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:56.827748 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d9ae77e7-a16b-43e7-b981-9c958f9926c8 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:56.838632 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d9ae77e7-a16b-43e7-b981-9c958f9926c8 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:56.841525 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d9ae77e7-a16b-43e7-b981-9c958f9926c8 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:56.843148 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d9ae77e7-a16b-43e7-b981-9c958f9926c8 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1365 microversion: 2.47 time: 0.170274 Jun 20 12:13:56.843980 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1862/3680] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:56 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:13:57.234753 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-cfae25da-bdcc-4f12-beb3-24a7bb7b3347 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: 71b51f0c-5366-4aa8-86dc-753f55c21590] Updating instance_info_cache with network_info: [{"id": "626fc638-ecf6-445b-92f4-0487f1f80338", "address": "fa:16:3e:45:2d:97", "network": {"id": "e52cf695-08a7-4228-8afa-64520bdba860", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1069428594-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6b5ce0a299ef4e10be4dccca2ef8b957", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap626fc638-ec", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119128) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 20 12:13:57.254159 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cfae25da-bdcc-4f12-beb3-24a7bb7b3347 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Releasing lock "refresh_cache-71b51f0c-5366-4aa8-86dc-753f55c21590" {{(pid=119128) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 20 12:13:57.255895 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cfae25da-bdcc-4f12-beb3-24a7bb7b3347 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "POST /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590/action" status: 202 len: 0 microversion: 2.1 time: 4.844731 Jun 20 12:13:57.257992 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1819/3681] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:13:52 2022] POST /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590/action => generated 0 bytes in 4848 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Jun 20 12:13:57.271597 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-aebaceaf-5c61-40f5-bf36-789fde574281 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:57.272401 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-aebaceaf-5c61-40f5-bf36-789fde574281 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: 71b51f0c-5366-4aa8-86dc-753f55c21590] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:57.292597 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4e0fb931-b029-476a-aeea-019dbdf50d07 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:57.295482 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4e0fb931-b029-476a-aeea-019dbdf50d07 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:57.303616 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aebaceaf-5c61-40f5-bf36-789fde574281 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:57.304179 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aebaceaf-5c61-40f5-bf36-789fde574281 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:57.305495 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aebaceaf-5c61-40f5-bf36-789fde574281 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:57.310236 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4e0fb931-b029-476a-aeea-019dbdf50d07 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:57.311621 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4e0fb931-b029-476a-aeea-019dbdf50d07 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:57.312310 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aebaceaf-5c61-40f5-bf36-789fde574281 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:57.312913 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4e0fb931-b029-476a-aeea-019dbdf50d07 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:57.313806 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4e0fb931-b029-476a-aeea-019dbdf50d07 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:57.383220 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-aebaceaf-5c61-40f5-bf36-789fde574281 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: 71b51f0c-5366-4aa8-86dc-753f55c21590] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:13:57.566832 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-aebaceaf-5c61-40f5-bf36-789fde574281 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "DELETE /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590" status: 204 len: 0 microversion: 2.1 time: 0.300754 Jun 20 12:13:57.568109 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1863/3682] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:13:57 2022] DELETE /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:13:57.583407 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-292bda6d-1123-4c8c-a954-4732f7ce8441 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2031719003", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "a47eb1f5-60b7-4466-a406-e78e49d8fe29"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2020908636", "security_groups": [{"name": "tempest-secgroup-smoke-829322673"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:13:57.602101 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4e0fb931-b029-476a-aeea-019dbdf50d07 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:57.631953 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4e0fb931-b029-476a-aeea-019dbdf50d07 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1472 microversion: 2.1 time: 0.350362 Jun 20 12:13:57.632932 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1820/3683] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:57 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1472 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:57.650613 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1a8c911b-1a31-43cc-b78d-be62d4ef0065 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.2.247"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:13:57.653894 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1a8c911b-1a31-43cc-b78d-be62d4ef0065 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: fd56a5df-a994-416e-b1d4-a5a78df871b2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:57.671658 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a8c911b-1a31-43cc-b78d-be62d4ef0065 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:57.672498 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a8c911b-1a31-43cc-b78d-be62d4ef0065 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:57.673497 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a8c911b-1a31-43cc-b78d-be62d4ef0065 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:57.674291 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a8c911b-1a31-43cc-b78d-be62d4ef0065 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:57.704574 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a8c911b-1a31-43cc-b78d-be62d4ef0065 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Acquired lock "refresh_cache-fd56a5df-a994-416e-b1d4-a5a78df871b2" {{(pid=119128) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 20 12:13:57.818689 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-292bda6d-1123-4c8c-a954-4732f7ce8441 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] validate_networks() for [('a47eb1f5-60b7-4466-a406-e78e49d8fe29', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:13:58.377465 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-292bda6d-1123-4c8c-a954-4732f7ce8441 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:13:58.378658 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-292bda6d-1123-4c8c-a954-4732f7ce8441 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:13:58.379578 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-292bda6d-1123-4c8c-a954-4732f7ce8441 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:13:58.380377 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-292bda6d-1123-4c8c-a954-4732f7ce8441 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:13:58.380992 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-292bda6d-1123-4c8c-a954-4732f7ce8441 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:13:58.399491 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-292bda6d-1123-4c8c-a954-4732f7ce8441 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:58.399976 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-292bda6d-1123-4c8c-a954-4732f7ce8441 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:58.402459 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-292bda6d-1123-4c8c-a954-4732f7ce8441 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:58.403130 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-292bda6d-1123-4c8c-a954-4732f7ce8441 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:58.437609 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-292bda6d-1123-4c8c-a954-4732f7ce8441 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Getting quotas for project 9e9e481852fe4e6ebdc15ec343a741f2. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:13:58.451296 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-292bda6d-1123-4c8c-a954-4732f7ce8441 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Getting quotas for user cd27c8696f7147e18054b26ebbae7045 and project 9e9e481852fe4e6ebdc15ec343a741f2. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:13:58.453273 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:13:58.470077 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-292bda6d-1123-4c8c-a954-4732f7ce8441 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:13:58.472815 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-292bda6d-1123-4c8c-a954-4732f7ce8441 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:13:58.557443 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-292bda6d-1123-4c8c-a954-4732f7ce8441 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.986895 Jun 20 12:13:58.566733 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1864/3684] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:13:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:13:58.572610 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c67ba944-f28e-4596-9cf0-022f2edb07f2 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:58.573346 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c67ba944-f28e-4596-9cf0-022f2edb07f2 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: b0df0320-6a60-433c-bfe9-8011cd85e631] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:58.584402 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c67ba944-f28e-4596-9cf0-022f2edb07f2 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:58.584752 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c67ba944-f28e-4596-9cf0-022f2edb07f2 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:58.587092 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c67ba944-f28e-4596-9cf0-022f2edb07f2 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:58.587768 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c67ba944-f28e-4596-9cf0-022f2edb07f2 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:58.890010 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c67ba944-f28e-4596-9cf0-022f2edb07f2 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:58.908884 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c67ba944-f28e-4596-9cf0-022f2edb07f2 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631" status: 200 len: 1505 microversion: 2.1 time: 0.343183 Jun 20 12:13:58.909615 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1865/3685] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:58 2022] GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631 => generated 1505 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:58.925615 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-91b05723-0596-4990-bafc-0134fd084c11 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:58.927858 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-91b05723-0596-4990-bafc-0134fd084c11 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:58.942024 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91b05723-0596-4990-bafc-0134fd084c11 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:58.944249 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91b05723-0596-4990-bafc-0134fd084c11 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:58.946029 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91b05723-0596-4990-bafc-0134fd084c11 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:58.947208 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91b05723-0596-4990-bafc-0134fd084c11 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:59.186536 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-91b05723-0596-4990-bafc-0134fd084c11 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:59.205776 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-91b05723-0596-4990-bafc-0134fd084c11 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:59.208561 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-91b05723-0596-4990-bafc-0134fd084c11 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:59.210043 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-91b05723-0596-4990-bafc-0134fd084c11 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1365 microversion: 2.47 time: 0.298375 Jun 20 12:13:59.211396 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1866/3686] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:13:58 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1365 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:13:59.219261 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5b5fff49-cb24-4de9-b235-102b640fcad4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:59.221139 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5b5fff49-cb24-4de9-b235-102b640fcad4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:59.345686 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5b5fff49-cb24-4de9-b235-102b640fcad4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:13:59.379726 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5b5fff49-cb24-4de9-b235-102b640fcad4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1267 microversion: 2.1 time: 0.154968 Jun 20 12:13:59.399770 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1867/3687] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:59 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:13:59.406485 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7be01c0d-3467-43cd-9271-7ca1b8e3e032 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:13:59.407156 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7be01c0d-3467-43cd-9271-7ca1b8e3e032 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:13:59.424323 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7be01c0d-3467-43cd-9271-7ca1b8e3e032 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:59.424777 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7be01c0d-3467-43cd-9271-7ca1b8e3e032 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:59.429881 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7be01c0d-3467-43cd-9271-7ca1b8e3e032 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:13:59.430717 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7be01c0d-3467-43cd-9271-7ca1b8e3e032 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:13:59.966431 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7be01c0d-3467-43cd-9271-7ca1b8e3e032 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:00.014897 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7be01c0d-3467-43cd-9271-7ca1b8e3e032 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1472 microversion: 2.1 time: 0.610791 Jun 20 12:14:00.015814 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1868/3688] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:13:59 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1472 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:00.049657 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1fc5d7ed-efb4-454d-8891-3a6716a45ef4 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1267476535"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:00.053124 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1fc5d7ed-efb4-454d-8891-3a6716a45ef4 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: b0df0320-6a60-433c-bfe9-8011cd85e631] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:00.098306 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1fc5d7ed-efb4-454d-8891-3a6716a45ef4 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:00.098770 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1fc5d7ed-efb4-454d-8891-3a6716a45ef4 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:00.099580 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1fc5d7ed-efb4-454d-8891-3a6716a45ef4 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:00.100017 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1fc5d7ed-efb4-454d-8891-3a6716a45ef4 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:00.779890 n-d-master-1 devstack@n-api.service[119127]: INFO nova.network.security_group_api [None req-1fc5d7ed-efb4-454d-8891-3a6716a45ef4 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Adding security group b2af0449-e138-4d37-ad72-5b7c486918d3 to port dfcb1b26-b9d9-45b4-9427-41b6b2493277 Jun 20 12:14:01.275752 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-1a8c911b-1a31-43cc-b78d-be62d4ef0065 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: fd56a5df-a994-416e-b1d4-a5a78df871b2] Building network info cache for instance {{(pid=119128) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 20 12:14:01.745886 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1fc5d7ed-efb4-454d-8891-3a6716a45ef4 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "POST /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631/action" status: 202 len: 0 microversion: 2.1 time: 1.724337 Jun 20 12:14:01.746670 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1869/3689] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:14:00 2022] POST /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631/action => generated 0 bytes in 1728 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:14:01.751827 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c91feacf-4731-47bc-9d07-5568416a4f3d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:01.752610 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c91feacf-4731-47bc-9d07-5568416a4f3d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:01.764011 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c91feacf-4731-47bc-9d07-5568416a4f3d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:01.774729 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c91feacf-4731-47bc-9d07-5568416a4f3d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:01.775893 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c91feacf-4731-47bc-9d07-5568416a4f3d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:01.776678 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c91feacf-4731-47bc-9d07-5568416a4f3d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:01.962823 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c91feacf-4731-47bc-9d07-5568416a4f3d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:01.975270 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c91feacf-4731-47bc-9d07-5568416a4f3d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:01.977308 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c91feacf-4731-47bc-9d07-5568416a4f3d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:01.978621 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c91feacf-4731-47bc-9d07-5568416a4f3d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1365 microversion: 2.47 time: 0.230985 Jun 20 12:14:01.991522 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1870/3690] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:01 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1365 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:01.994677 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0a678fa3-c8a1-43ed-98db-bb582df511d8 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:01.995594 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0a678fa3-c8a1-43ed-98db-bb582df511d8 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:02.027241 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a678fa3-c8a1-43ed-98db-bb582df511d8 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:02.028154 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a678fa3-c8a1-43ed-98db-bb582df511d8 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:02.029296 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a678fa3-c8a1-43ed-98db-bb582df511d8 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:02.029811 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a678fa3-c8a1-43ed-98db-bb582df511d8 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:02.150765 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0a678fa3-c8a1-43ed-98db-bb582df511d8 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:02.162713 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0a678fa3-c8a1-43ed-98db-bb582df511d8 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1325 microversion: 2.1 time: 0.172872 Jun 20 12:14:02.165196 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1871/3691] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:01 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1325 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:02.175623 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5f282cad-9a36-4be3-abea-450dc252ae19 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:02.176305 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5f282cad-9a36-4be3-abea-450dc252ae19 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:02.190774 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f282cad-9a36-4be3-abea-450dc252ae19 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:02.191454 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f282cad-9a36-4be3-abea-450dc252ae19 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:02.192471 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f282cad-9a36-4be3-abea-450dc252ae19 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:02.193073 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f282cad-9a36-4be3-abea-450dc252ae19 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:02.516824 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5f282cad-9a36-4be3-abea-450dc252ae19 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:02.532800 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5f282cad-9a36-4be3-abea-450dc252ae19 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1472 microversion: 2.1 time: 0.366155 Jun 20 12:14:02.533418 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1872/3692] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:02 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1472 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:02.562375 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-238d1d96-baf5-4e53-99f0-5aaae503b77d req-ebb1aaf0-8d46-4656-933a-155ce923f05a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b51f0c-5366-4aa8-86dc-753f55c21590", "name": "network-vif-deleted", "tag": "626fc638-ecf6-445b-92f4-0487f1f80338"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:02.578129 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-238d1d96-baf5-4e53-99f0-5aaae503b77d req-ebb1aaf0-8d46-4656-933a-155ce923f05a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:02.578586 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-238d1d96-baf5-4e53-99f0-5aaae503b77d req-ebb1aaf0-8d46-4656-933a-155ce923f05a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:02.601785 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-238d1d96-baf5-4e53-99f0-5aaae503b77d req-ebb1aaf0-8d46-4656-933a-155ce923f05a service nova] Creating event network-vif-deleted:626fc638-ecf6-445b-92f4-0487f1f80338 for instance 71b51f0c-5366-4aa8-86dc-753f55c21590 on n-h1-master-1 Jun 20 12:14:02.604222 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-1a8c911b-1a31-43cc-b78d-be62d4ef0065 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: fd56a5df-a994-416e-b1d4-a5a78df871b2] Updating instance_info_cache with network_info: [{"id": "c09d88d8-69e4-4159-a104-22eba04fd540", "address": "fa:16:3e:7c:ef:fa", "network": {"id": "e52cf695-08a7-4228-8afa-64520bdba860", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1069428594-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.2.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6b5ce0a299ef4e10be4dccca2ef8b957", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc09d88d8-69", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119128) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 20 12:14:02.614185 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-238d1d96-baf5-4e53-99f0-5aaae503b77d req-ebb1aaf0-8d46-4656-933a-155ce923f05a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069823 Jun 20 12:14:02.615122 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1873/3693] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:14:02.621746 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a8c911b-1a31-43cc-b78d-be62d4ef0065 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Releasing lock "refresh_cache-fd56a5df-a994-416e-b1d4-a5a78df871b2" {{(pid=119128) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 20 12:14:02.625914 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1a8c911b-1a31-43cc-b78d-be62d4ef0065 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "POST /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2/action" status: 202 len: 0 microversion: 2.1 time: 4.988856 Jun 20 12:14:02.630361 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1821/3694] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:13:57 2022] POST /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2/action => generated 0 bytes in 4996 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 20 12:14:02.630625 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ec575c58-c408-4ad7-b981-61e8e953ae5a tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1023999509"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:02.631268 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ec575c58-c408-4ad7-b981-61e8e953ae5a tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: b0df0320-6a60-433c-bfe9-8011cd85e631] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:02.641660 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ec575c58-c408-4ad7-b981-61e8e953ae5a tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:02.642116 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ec575c58-c408-4ad7-b981-61e8e953ae5a tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:02.642898 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ec575c58-c408-4ad7-b981-61e8e953ae5a tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:02.643613 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-515ef083-dc95-4dfa-a37e-8cdcaf76c29e req-c7d68b69-f1cc-4fbf-a22c-60b47fc830ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0df0320-6a60-433c-bfe9-8011cd85e631", "tag": "dfcb1b26-b9d9-45b4-9427-41b6b2493277"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:02.647834 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ec575c58-c408-4ad7-b981-61e8e953ae5a tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:02.671968 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-515ef083-dc95-4dfa-a37e-8cdcaf76c29e req-c7d68b69-f1cc-4fbf-a22c-60b47fc830ae service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:02.672449 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-515ef083-dc95-4dfa-a37e-8cdcaf76c29e req-c7d68b69-f1cc-4fbf-a22c-60b47fc830ae service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:02.705475 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-515ef083-dc95-4dfa-a37e-8cdcaf76c29e req-c7d68b69-f1cc-4fbf-a22c-60b47fc830ae service nova] Creating event network-changed:dfcb1b26-b9d9-45b4-9427-41b6b2493277 for instance b0df0320-6a60-433c-bfe9-8011cd85e631 on n-h2-master-1 Jun 20 12:14:02.718240 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-515ef083-dc95-4dfa-a37e-8cdcaf76c29e req-c7d68b69-f1cc-4fbf-a22c-60b47fc830ae service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084742 Jun 20 12:14:02.721916 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1822/3695] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:14:02.736573 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7805a3b1-56a2-40ac-8e4e-792680d0e43c tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Calling method '.version_select at 0x7f60735e2ee0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:02.967758 n-d-master-1 devstack@n-api.service[119127]: INFO nova.network.security_group_api [None req-ec575c58-c408-4ad7-b981-61e8e953ae5a tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Adding security group f8e160e6-109c-435a-baf1-0a84a47fa2fa to port dfcb1b26-b9d9-45b4-9427-41b6b2493277 Jun 20 12:14:03.190985 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7805a3b1-56a2-40ac-8e4e-792680d0e43c tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/bd4041b8-e25e-4a82-877e-ee546a7d1176" status: 200 len: 184 microversion: 2.1 time: 0.467145 Jun 20 12:14:03.191590 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1823/3696] 10.222.0.27 () {58 vars in 1259 bytes} [Mon Jun 20 12:14:02 2022] GET /compute/v2.1/os-floating-ips/bd4041b8-e25e-4a82-877e-ee546a7d1176 => generated 184 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:14:03.196848 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2e01717c-159e-4002-b1fa-36dd65a3e7b6 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:03.199300 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2e01717c-159e-4002-b1fa-36dd65a3e7b6 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:03.213046 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2e01717c-159e-4002-b1fa-36dd65a3e7b6 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:03.213261 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2e01717c-159e-4002-b1fa-36dd65a3e7b6 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:03.217540 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2e01717c-159e-4002-b1fa-36dd65a3e7b6 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:03.221228 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2e01717c-159e-4002-b1fa-36dd65a3e7b6 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:03.456227 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2e01717c-159e-4002-b1fa-36dd65a3e7b6 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:03.472077 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2e01717c-159e-4002-b1fa-36dd65a3e7b6 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:03.474659 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2e01717c-159e-4002-b1fa-36dd65a3e7b6 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:03.476165 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2e01717c-159e-4002-b1fa-36dd65a3e7b6 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1365 microversion: 2.47 time: 0.283631 Jun 20 12:14:03.476940 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1824/3697] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:03 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1365 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:03.486089 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1c98041f-8eba-41a3-90e8-61d65d751690 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:03.487334 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1c98041f-8eba-41a3-90e8-61d65d751690 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:03.544768 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1c98041f-8eba-41a3-90e8-61d65d751690 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:03.546025 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1c98041f-8eba-41a3-90e8-61d65d751690 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:03.547558 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1c98041f-8eba-41a3-90e8-61d65d751690 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:03.549247 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1c98041f-8eba-41a3-90e8-61d65d751690 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:03.986076 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1c98041f-8eba-41a3-90e8-61d65d751690 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:04.001398 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1c98041f-8eba-41a3-90e8-61d65d751690 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1392 microversion: 2.1 time: 0.523105 Jun 20 12:14:04.013399 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1825/3698] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:03 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1392 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:04.029091 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d62564d5-1115-4a07-9cb5-d2c8a0e86bf5 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.2.247"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:04.147622 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ec575c58-c408-4ad7-b981-61e8e953ae5a tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "POST /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631/action" status: 202 len: 0 microversion: 2.1 time: 1.530708 Jun 20 12:14:04.150751 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1874/3699] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:14:02 2022] POST /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631/action => generated 0 bytes in 1535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:14:04.165969 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-21e90972-99d6-4ca7-8a55-2f2a760c08ec tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:04.176626 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-21e90972-99d6-4ca7-8a55-2f2a760c08ec tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:04.184437 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21e90972-99d6-4ca7-8a55-2f2a760c08ec tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:04.185197 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21e90972-99d6-4ca7-8a55-2f2a760c08ec tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:04.186245 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21e90972-99d6-4ca7-8a55-2f2a760c08ec tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:04.188090 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21e90972-99d6-4ca7-8a55-2f2a760c08ec tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:04.706392 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d62564d5-1115-4a07-9cb5-d2c8a0e86bf5 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: fd56a5df-a994-416e-b1d4-a5a78df871b2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:04.713858 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d62564d5-1115-4a07-9cb5-d2c8a0e86bf5 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:04.717096 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d62564d5-1115-4a07-9cb5-d2c8a0e86bf5 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:04.718253 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d62564d5-1115-4a07-9cb5-d2c8a0e86bf5 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:04.725049 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d62564d5-1115-4a07-9cb5-d2c8a0e86bf5 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:04.947814 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-21e90972-99d6-4ca7-8a55-2f2a760c08ec tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:04.959541 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-21e90972-99d6-4ca7-8a55-2f2a760c08ec tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1472 microversion: 2.1 time: 0.806393 Jun 20 12:14:04.974350 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1875/3700] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:04 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1472 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:04.988757 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-49863ee7-8efc-4b6e-9740-1bebe7775564 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:04.989769 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-49863ee7-8efc-4b6e-9740-1bebe7775564 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: b0df0320-6a60-433c-bfe9-8011cd85e631] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:05.013204 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-49863ee7-8efc-4b6e-9740-1bebe7775564 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:05.016043 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-49863ee7-8efc-4b6e-9740-1bebe7775564 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:05.017583 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-49863ee7-8efc-4b6e-9740-1bebe7775564 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:05.018367 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-49863ee7-8efc-4b6e-9740-1bebe7775564 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:05.410095 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-49863ee7-8efc-4b6e-9740-1bebe7775564 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.432718 Jun 20 12:14:05.410759 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1876/3701] 10.222.0.27 () {58 vars in 1292 bytes} [Mon Jun 20 12:14:04 2022] GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631/os-security-groups => generated 1158 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:05.421763 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2dd76d5b-9ceb-4aa0-8478-e4140b8e1707 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:05.424747 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2dd76d5b-9ceb-4aa0-8478-e4140b8e1707 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:05.433375 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d62564d5-1115-4a07-9cb5-d2c8a0e86bf5 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Acquired lock "refresh_cache-fd56a5df-a994-416e-b1d4-a5a78df871b2" {{(pid=119128) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 20 12:14:05.434379 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2dd76d5b-9ceb-4aa0-8478-e4140b8e1707 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:05.435274 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2dd76d5b-9ceb-4aa0-8478-e4140b8e1707 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:05.436699 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2dd76d5b-9ceb-4aa0-8478-e4140b8e1707 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:05.437375 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2dd76d5b-9ceb-4aa0-8478-e4140b8e1707 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:05.521931 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2dd76d5b-9ceb-4aa0-8478-e4140b8e1707 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:05.528157 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:05.537290 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2dd76d5b-9ceb-4aa0-8478-e4140b8e1707 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:05.539455 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2dd76d5b-9ceb-4aa0-8478-e4140b8e1707 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:05.541035 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2dd76d5b-9ceb-4aa0-8478-e4140b8e1707 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1365 microversion: 2.47 time: 0.124721 Jun 20 12:14:05.552741 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1877/3702] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:05 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1365 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:05.552741 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-be440844-3207-4b42-a3b3-6827bcef55b5 req-383bbaec-f547-4d4a-a965-6a667ec6bdec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd56a5df-a994-416e-b1d4-a5a78df871b2", "tag": "c09d88d8-69e4-4159-a104-22eba04fd540"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:05.564912 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-be440844-3207-4b42-a3b3-6827bcef55b5 req-383bbaec-f547-4d4a-a965-6a667ec6bdec service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:05.565374 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-be440844-3207-4b42-a3b3-6827bcef55b5 req-383bbaec-f547-4d4a-a965-6a667ec6bdec service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:05.583137 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-be440844-3207-4b42-a3b3-6827bcef55b5 req-383bbaec-f547-4d4a-a965-6a667ec6bdec service nova] Creating event network-changed:c09d88d8-69e4-4159-a104-22eba04fd540 for instance fd56a5df-a994-416e-b1d4-a5a78df871b2 on n-h1-master-1 Jun 20 12:14:05.591794 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-be440844-3207-4b42-a3b3-6827bcef55b5 req-383bbaec-f547-4d4a-a965-6a667ec6bdec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048189 Jun 20 12:14:05.593437 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1878/3703] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:14:05.599850 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-952ba9d9-8a8b-4ea0-b3c4-852742665da0 req-54fcdcf9-f1a3-4972-8348-6ca407f0024e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0df0320-6a60-433c-bfe9-8011cd85e631", "tag": "dfcb1b26-b9d9-45b4-9427-41b6b2493277"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:05.611087 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-952ba9d9-8a8b-4ea0-b3c4-852742665da0 req-54fcdcf9-f1a3-4972-8348-6ca407f0024e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:05.611880 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-952ba9d9-8a8b-4ea0-b3c4-852742665da0 req-54fcdcf9-f1a3-4972-8348-6ca407f0024e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:05.626600 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-952ba9d9-8a8b-4ea0-b3c4-852742665da0 req-54fcdcf9-f1a3-4972-8348-6ca407f0024e service nova] Creating event network-changed:dfcb1b26-b9d9-45b4-9427-41b6b2493277 for instance b0df0320-6a60-433c-bfe9-8011cd85e631 on n-h2-master-1 Jun 20 12:14:05.632523 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-952ba9d9-8a8b-4ea0-b3c4-852742665da0 req-54fcdcf9-f1a3-4972-8348-6ca407f0024e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037335 Jun 20 12:14:05.633976 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1879/3704] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:14:05.643059 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b6c1efd8-df78-4a71-8565-2a5d2911a16e tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:05.643960 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b6c1efd8-df78-4a71-8565-2a5d2911a16e tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:05.652044 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b6c1efd8-df78-4a71-8565-2a5d2911a16e tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:05.652747 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b6c1efd8-df78-4a71-8565-2a5d2911a16e tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:05.653949 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b6c1efd8-df78-4a71-8565-2a5d2911a16e tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:05.654506 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b6c1efd8-df78-4a71-8565-2a5d2911a16e tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:05.958659 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b6c1efd8-df78-4a71-8565-2a5d2911a16e tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:05.972053 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b6c1efd8-df78-4a71-8565-2a5d2911a16e tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1392 microversion: 2.1 time: 0.336435 Jun 20 12:14:05.973814 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1880/3705] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:05 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1392 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:05.987225 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7c2afd80-4b53-4290-acd8-b9409eec5718 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Action: 'create', calling method: .version_select at 0x7f60732bbf70>, body: {"security_group": {"name": " tempest-securitygroup -1969896701 ", "description": "tempest-description-561662711"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:06.375330 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7c2afd80-4b53-4290-acd8-b9409eec5718 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.394743 Jun 20 12:14:06.376222 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1881/3706] 10.222.0.27 () {60 vars in 1179 bytes} [Mon Jun 20 12:14:05 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:14:06.382145 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-17226a6a-caf2-461d-abc4-a4039c3c0258 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:06.383265 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-17226a6a-caf2-461d-abc4-a4039c3c0258 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:06.392065 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17226a6a-caf2-461d-abc4-a4039c3c0258 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:06.392587 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17226a6a-caf2-461d-abc4-a4039c3c0258 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:06.393381 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17226a6a-caf2-461d-abc4-a4039c3c0258 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:06.393822 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17226a6a-caf2-461d-abc4-a4039c3c0258 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:06.692105 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-17226a6a-caf2-461d-abc4-a4039c3c0258 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:06.703903 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-17226a6a-caf2-461d-abc4-a4039c3c0258 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1472 microversion: 2.1 time: 0.326359 Jun 20 12:14:06.705026 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1882/3707] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:06 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1472 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:06.719465 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-478414f7-7510-4d62-a942-10dab1ac121c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '.version_select at 0x7f6073ab6e50>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:06.793454 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-478414f7-7510-4d62-a942-10dab1ac121c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/73bc215f-9e8f-43f3-9faf-9e7c8805b434" status: 200 len: 223 microversion: 2.1 time: 0.078531 Jun 20 12:14:06.800281 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1883/3708] 10.222.0.27 () {58 vars in 1268 bytes} [Mon Jun 20 12:14:06 2022] GET /compute/v2.1/os-security-groups/73bc215f-9e8f-43f3-9faf-9e7c8805b434 => generated 223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:14:06.809038 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-790d3159-dd56-4e64-b9c8-d690b2ebb004 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:06.809730 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-790d3159-dd56-4e64-b9c8-d690b2ebb004 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:06.819569 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-790d3159-dd56-4e64-b9c8-d690b2ebb004 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:06.820285 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-790d3159-dd56-4e64-b9c8-d690b2ebb004 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:06.821501 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-790d3159-dd56-4e64-b9c8-d690b2ebb004 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:06.822120 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-790d3159-dd56-4e64-b9c8-d690b2ebb004 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:06.905953 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-790d3159-dd56-4e64-b9c8-d690b2ebb004 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:06.914076 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-790d3159-dd56-4e64-b9c8-d690b2ebb004 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:06.915502 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-790d3159-dd56-4e64-b9c8-d690b2ebb004 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:06.917055 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-790d3159-dd56-4e64-b9c8-d690b2ebb004 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1365 microversion: 2.47 time: 0.113130 Jun 20 12:14:06.918201 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1884/3709] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:06 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1365 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:06.923964 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fc87fca8-8927-4f3d-9a06-98e4d2535f88 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '.version_select at 0x7f60732bbe50>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:06.975184 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-d62564d5-1115-4a07-9cb5-d2c8a0e86bf5 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: fd56a5df-a994-416e-b1d4-a5a78df871b2] Building network info cache for instance {{(pid=119128) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 20 12:14:07.165995 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fc87fca8-8927-4f3d-9a06-98e4d2535f88 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/73bc215f-9e8f-43f3-9faf-9e7c8805b434" status: 202 len: 0 microversion: 2.1 time: 0.246173 Jun 20 12:14:07.167374 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1885/3710] 10.222.0.27 () {58 vars in 1271 bytes} [Mon Jun 20 12:14:06 2022] DELETE /compute/v2.1/os-security-groups/73bc215f-9e8f-43f3-9faf-9e7c8805b434 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:14:07.175688 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d0fa6f76-518d-4c5b-b712-3150a9400e85 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:07.177355 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d0fa6f76-518d-4c5b-b712-3150a9400e85 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:07.192035 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d0fa6f76-518d-4c5b-b712-3150a9400e85 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:07.193365 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d0fa6f76-518d-4c5b-b712-3150a9400e85 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:07.195251 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d0fa6f76-518d-4c5b-b712-3150a9400e85 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:07.196303 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d0fa6f76-518d-4c5b-b712-3150a9400e85 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:07.448832 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d0fa6f76-518d-4c5b-b712-3150a9400e85 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:07.457492 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d0fa6f76-518d-4c5b-b712-3150a9400e85 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1392 microversion: 2.1 time: 0.288936 Jun 20 12:14:07.468496 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1886/3711] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:07 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1392 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:07.476320 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3eda96c0-9fd4-4bc0-a6e5-0a5597ca75e7 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '.version_select at 0x7f60732ab5e0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:07.522363 n-d-master-1 devstack@n-api.service[119127]: DEBUG neutronclient.v2_0.client [None req-3eda96c0-9fd4-4bc0-a6e5-0a5597ca75e7 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 73bc215f-9e8f-43f3-9faf-9e7c8805b434 does not exist", "detail": ""}} {{(pid=119127) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 20 12:14:07.523433 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.security_group_api [None req-3eda96c0-9fd4-4bc0-a6e5-0a5597ca75e7 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Neutron security group 73bc215f-9e8f-43f3-9faf-9e7c8805b434 not found {{(pid=119127) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 20 12:14:07.523594 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-3eda96c0-9fd4-4bc0-a6e5-0a5597ca75e7 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] HTTP exception thrown: Security group 73bc215f-9e8f-43f3-9faf-9e7c8805b434 does not exist Jun 20 12:14:07.523594 n-d-master-1 devstack@n-api.service[119127]: Neutron server returns request_ids: ['req-5cb5a3de-1f0d-479d-a98a-b2194002faa8'] Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3eda96c0-9fd4-4bc0-a6e5-0a5597ca75e7 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Request method failure captured: Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/os-security-groups/73bc215f-9e8f-43f3-9faf-9e7c8805b434 HTTP/1.1 Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGRspEjgKJLgDEMUB1oxj39OHwxpAdW28qHUXtVohoyOClCgJsgd03GdT2hoi3BapXye_C7q25Fmx52K1II73Nmx91JaNXbL0TFFBm3DxndH_-8RQjkZz-YTJGFJgzzOjcuFROsmxi41ZdE0CTcrcS_WNFOPfY38q9VTNDmwM1zWfjI Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: b3edd75428794ea2b1cbd1b8413072cd Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: b3edd75428794ea2b1cbd1b8413072cd Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-SecurityGroupsTestJSON-1959389845-project Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: e8878b2fbb4b429288856159a644382f Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-SecurityGroupsTestJSON-1959389845-project Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: exception: Security group 73bc215f-9e8f-43f3-9faf-9e7c8805b434 does not exist Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: Neutron server returns request_ids: ['req-5cb5a3de-1f0d-479d-a98a-b2194002faa8'] Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '73bc215f-9e8f-43f3-9faf-9e7c8805b434'} Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 20 12:14:07.525876 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 73bc215f-9e8f-43f3-9faf-9e7c8805b434 does not exist Jun 20 12:14:07.531611 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5cb5a3de-1f0d-479d-a98a-b2194002faa8'] Jun 20 12:14:07.531611 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:07.531611 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:14:07.531611 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:07.531611 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:07.531611 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jun 20 12:14:07.531611 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 20 12:14:07.531611 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 20 12:14:07.531611 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 20 12:14:07.531611 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 73bc215f-9e8f-43f3-9faf-9e7c8805b434 does not exist Jun 20 12:14:07.531611 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5cb5a3de-1f0d-479d-a98a-b2194002faa8'] Jun 20 12:14:07.531611 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:07.531611 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:14:07.531611 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:07.531611 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:07.531611 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:14:07.531611 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:14:07.531611 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:14:07.531611 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:14:07.531611 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:14:07.531611 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:14:07.531611 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:14:07.531611 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:14:07.531611 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jun 20 12:14:07.531611 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 20 12:14:07.531611 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 73bc215f-9e8f-43f3-9faf-9e7c8805b434 does not exist Jun 20 12:14:07.531611 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5cb5a3de-1f0d-479d-a98a-b2194002faa8'] Jun 20 12:14:07.531611 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:07.531611 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:14:07.531611 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:07.531611 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:07.531611 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:14:07.531611 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:14:07.531611 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:14:07.531611 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:14:07.531611 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 73bc215f-9e8f-43f3-9faf-9e7c8805b434 does not exist Jun 20 12:14:07.531611 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5cb5a3de-1f0d-479d-a98a-b2194002faa8'] Jun 20 12:14:07.531611 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:07.549974 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3eda96c0-9fd4-4bc0-a6e5-0a5597ca75e7 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Returning 404 to user: Security group 73bc215f-9e8f-43f3-9faf-9e7c8805b434 does not exist Jun 20 12:14:07.549974 n-d-master-1 devstack@n-api.service[119127]: Neutron server returns request_ids: ['req-5cb5a3de-1f0d-479d-a98a-b2194002faa8'] {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:14:07.553547 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3eda96c0-9fd4-4bc0-a6e5-0a5597ca75e7 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/73bc215f-9e8f-43f3-9faf-9e7c8805b434" status: 404 len: 194 microversion: 2.1 time: 0.081279 Jun 20 12:14:07.561989 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1887/3712] 10.222.0.27 () {58 vars in 1268 bytes} [Mon Jun 20 12:14:07 2022] GET /compute/v2.1/os-security-groups/73bc215f-9e8f-43f3-9faf-9e7c8805b434 => generated 194 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:14:07.575145 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-aeee84a3-5321-4667-b249-b95c97dadf87 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Action: 'create', calling method: .version_select at 0x7f60732bbf70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-133966586", "description": "tempest-description-1568034842"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:07.712460 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-d62564d5-1115-4a07-9cb5-d2c8a0e86bf5 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: fd56a5df-a994-416e-b1d4-a5a78df871b2] Updating instance_info_cache with network_info: [{"id": "c09d88d8-69e4-4159-a104-22eba04fd540", "address": "fa:16:3e:7c:ef:fa", "network": {"id": "e52cf695-08a7-4228-8afa-64520bdba860", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1069428594-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6b5ce0a299ef4e10be4dccca2ef8b957", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc09d88d8-69", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119128) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 20 12:14:07.734644 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d62564d5-1115-4a07-9cb5-d2c8a0e86bf5 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Releasing lock "refresh_cache-fd56a5df-a994-416e-b1d4-a5a78df871b2" {{(pid=119128) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 20 12:14:07.735825 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d62564d5-1115-4a07-9cb5-d2c8a0e86bf5 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "POST /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2/action" status: 202 len: 0 microversion: 2.1 time: 3.720906 Jun 20 12:14:07.737677 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1826/3713] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:14:04 2022] POST /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2/action => generated 0 bytes in 3723 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 20 12:14:07.749988 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fda8eec0-e373-41d3-9f53-836f39ca3380 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:07.751017 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fda8eec0-e373-41d3-9f53-836f39ca3380 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:07.778007 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fda8eec0-e373-41d3-9f53-836f39ca3380 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:07.779943 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fda8eec0-e373-41d3-9f53-836f39ca3380 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:07.781832 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fda8eec0-e373-41d3-9f53-836f39ca3380 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:07.782900 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fda8eec0-e373-41d3-9f53-836f39ca3380 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:07.816830 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-aeee84a3-5321-4667-b249-b95c97dadf87 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.253348 Jun 20 12:14:07.819108 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1888/3714] 10.222.0.27 () {60 vars in 1179 bytes} [Mon Jun 20 12:14:07 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:14:07.830178 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dde9f586-49db-4d3b-a79d-a22b2dfae2c5 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:07.830738 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dde9f586-49db-4d3b-a79d-a22b2dfae2c5 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: 71b51f0c-5366-4aa8-86dc-753f55c21590] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:07.839553 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dde9f586-49db-4d3b-a79d-a22b2dfae2c5 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:07.840257 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dde9f586-49db-4d3b-a79d-a22b2dfae2c5 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:07.841066 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dde9f586-49db-4d3b-a79d-a22b2dfae2c5 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:07.841630 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dde9f586-49db-4d3b-a79d-a22b2dfae2c5 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:07.863007 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-dde9f586-49db-4d3b-a79d-a22b2dfae2c5 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] HTTP exception thrown: Instance 71b51f0c-5366-4aa8-86dc-753f55c21590 could not be found. Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dde9f586-49db-4d3b-a79d-a22b2dfae2c5 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Request method failure captured: Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590 HTTP/1.1 Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGQ5nfCNxCSTubPQFZpKI5xLw-Lk21qmc_3O5k9yVdyL-RLjlR7ZaeB2VN02txLyeyqQY0UHamkIqRQ64yM2zNc6pb1nFMGr0zQu9ybKCrplgVvAdT4JN0rT1A5u0bGN-i5bqvt61Y89ouL5Y3ZdVAMMjKFTV74EmmQ_oPv_k9Bh-aI Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 6b5ce0a299ef4e10be4dccca2ef8b957 Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1009548493 Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b5ce0a299ef4e10be4dccca2ef8b957"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b5ce0a299ef4e10be4dccca2ef8b957"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b5ce0a299ef4e10be4dccca2ef8b957"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b5ce0a299ef4e10be4dccca2ef8b957"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1009548493 Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 6b5ce0a299ef4e10be4dccca2ef8b957 Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1009548493 Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-FloatingIPsAssociationTestJSON-1009548493-project Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 0e4a7cec6b754f4095917bb4cb9ee283 Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1009548493-project Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 71b51f0c-5366-4aa8-86dc-753f55c21590 could not be found. Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '71b51f0c-5366-4aa8-86dc-753f55c21590'} Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71b51f0c-5366-4aa8-86dc-753f55c21590 could not be found. Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:14:07.864953 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:14:07.869897 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71b51f0c-5366-4aa8-86dc-753f55c21590 could not be found. Jun 20 12:14:07.869897 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:07.869897 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:14:07.869897 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:07.869897 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:07.869897 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:14:07.869897 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:14:07.869897 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:14:07.869897 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:14:07.869897 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71b51f0c-5366-4aa8-86dc-753f55c21590 could not be found. Jun 20 12:14:07.869897 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:07.869897 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dde9f586-49db-4d3b-a79d-a22b2dfae2c5 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Returning 404 to user: Instance 71b51f0c-5366-4aa8-86dc-753f55c21590 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:14:07.869897 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dde9f586-49db-4d3b-a79d-a22b2dfae2c5 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "DELETE /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590" status: 404 len: 111 microversion: 2.1 time: 0.045967 Jun 20 12:14:07.869897 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1889/3715] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:14:07 2022] DELETE /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:14:07.878117 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-b1789615-ed77-4676-aed1-667b327b426d req-3e6db464-c276-4960-a7ab-2093889d55b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d", "tag": "ce10fc86-e544-41be-9e96-7780fa2e39cc"}, {"name": "network-changed", "server_uuid": "fd56a5df-a994-416e-b1d4-a5a78df871b2", "tag": "c09d88d8-69e4-4159-a104-22eba04fd540"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:07.896158 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b1789615-ed77-4676-aed1-667b327b426d req-3e6db464-c276-4960-a7ab-2093889d55b6 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:07.897071 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b1789615-ed77-4676-aed1-667b327b426d req-3e6db464-c276-4960-a7ab-2093889d55b6 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:07.912822 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-b1789615-ed77-4676-aed1-667b327b426d req-3e6db464-c276-4960-a7ab-2093889d55b6 service nova] Creating event network-changed:ce10fc86-e544-41be-9e96-7780fa2e39cc for instance f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d on n-h1-master-1 Jun 20 12:14:07.913340 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-b1789615-ed77-4676-aed1-667b327b426d req-3e6db464-c276-4960-a7ab-2093889d55b6 service nova] Creating event network-changed:c09d88d8-69e4-4159-a104-22eba04fd540 for instance fd56a5df-a994-416e-b1d4-a5a78df871b2 on n-h1-master-1 Jun 20 12:14:07.921817 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-b1789615-ed77-4676-aed1-667b327b426d req-3e6db464-c276-4960-a7ab-2093889d55b6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.051817 Jun 20 12:14:07.923551 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1890/3716] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:14:07.932711 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7b63a3aa-3ed7-4ee8-a64f-f64e9387f1a4 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Action: 'create', calling method: .version_select at 0x7f6072d44f70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-426937912", "description": "tempest-description-1119745700"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:08.149428 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7b63a3aa-3ed7-4ee8-a64f-f64e9387f1a4 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.224375 Jun 20 12:14:08.150266 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1891/3717] 10.222.0.27 () {60 vars in 1179 bytes} [Mon Jun 20 12:14:07 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:14:08.156526 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d906b60f-79a5-403d-b1aa-f09562722056 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:08.164653 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d906b60f-79a5-403d-b1aa-f09562722056 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: 71b51f0c-5366-4aa8-86dc-753f55c21590] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:08.186438 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d906b60f-79a5-403d-b1aa-f09562722056 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:08.186961 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d906b60f-79a5-403d-b1aa-f09562722056 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:08.187847 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d906b60f-79a5-403d-b1aa-f09562722056 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:08.188442 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d906b60f-79a5-403d-b1aa-f09562722056 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:08.205311 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-d906b60f-79a5-403d-b1aa-f09562722056 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] HTTP exception thrown: Instance 71b51f0c-5366-4aa8-86dc-753f55c21590 could not be found. Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d906b60f-79a5-403d-b1aa-f09562722056 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Request method failure captured: Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590 HTTP/1.1 Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGQ5nfCNxCSTubPQFZpKI5xLw-Lk21qmc_3O5k9yVdyL-RLjlR7ZaeB2VN02txLyeyqQY0UHamkIqRQ64yM2zNc6pb1nFMGr0zQu9ybKCrplgVvAdT4JN0rT1A5u0bGN-i5bqvt61Y89ouL5Y3ZdVAMMjKFTV74EmmQ_oPv_k9Bh-aI Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 6b5ce0a299ef4e10be4dccca2ef8b957 Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1009548493 Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b5ce0a299ef4e10be4dccca2ef8b957"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b5ce0a299ef4e10be4dccca2ef8b957"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b5ce0a299ef4e10be4dccca2ef8b957"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b5ce0a299ef4e10be4dccca2ef8b957"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1009548493 Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 6b5ce0a299ef4e10be4dccca2ef8b957 Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1009548493 Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-FloatingIPsAssociationTestJSON-1009548493-project Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 0e4a7cec6b754f4095917bb4cb9ee283 Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1009548493-project Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 71b51f0c-5366-4aa8-86dc-753f55c21590 could not be found. Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '71b51f0c-5366-4aa8-86dc-753f55c21590'} Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71b51f0c-5366-4aa8-86dc-753f55c21590 could not be found. Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71b51f0c-5366-4aa8-86dc-753f55c21590 could not be found. Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:08.207142 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:14:08.211803 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:08.211803 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:08.211803 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:14:08.211803 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:14:08.211803 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:14:08.211803 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:14:08.211803 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71b51f0c-5366-4aa8-86dc-753f55c21590 could not be found. Jun 20 12:14:08.211803 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:08.211803 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d906b60f-79a5-403d-b1aa-f09562722056 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Returning 404 to user: Instance 71b51f0c-5366-4aa8-86dc-753f55c21590 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:14:08.211803 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d906b60f-79a5-403d-b1aa-f09562722056 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "GET /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590" status: 404 len: 111 microversion: 2.1 time: 0.057279 Jun 20 12:14:08.211803 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1892/3718] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:08 2022] GET /compute/v2.1/servers/71b51f0c-5366-4aa8-86dc-753f55c21590 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:14:08.216143 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-62a1cb16-f109-4ac8-9f2b-b5c4fb88363b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:08.216795 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-62a1cb16-f109-4ac8-9f2b-b5c4fb88363b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:08.223653 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-62a1cb16-f109-4ac8-9f2b-b5c4fb88363b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:08.224467 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-62a1cb16-f109-4ac8-9f2b-b5c4fb88363b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:08.226246 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-62a1cb16-f109-4ac8-9f2b-b5c4fb88363b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:08.226885 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-62a1cb16-f109-4ac8-9f2b-b5c4fb88363b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:08.320663 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-62a1cb16-f109-4ac8-9f2b-b5c4fb88363b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:08.332316 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-62a1cb16-f109-4ac8-9f2b-b5c4fb88363b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:08.334036 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-62a1cb16-f109-4ac8-9f2b-b5c4fb88363b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:08.336016 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-62a1cb16-f109-4ac8-9f2b-b5c4fb88363b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1365 microversion: 2.47 time: 0.124952 Jun 20 12:14:08.337266 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1893/3719] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:08 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1365 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:08.342446 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-62cccb5c-5c7a-4ff4-ab30-911ced8c1606 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Action: 'create', calling method: .version_select at 0x7f60849e18b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-879893884", "description": "tempest-description-1514150183"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:08.425740 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:08.558301 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fda8eec0-e373-41d3-9f53-836f39ca3380 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:08.573404 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fda8eec0-e373-41d3-9f53-836f39ca3380 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1472 microversion: 2.1 time: 0.833754 Jun 20 12:14:08.575995 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1827/3720] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:07 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1472 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:08.611857 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8d54062b-ec6d-4b46-9e6a-b125119953db tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Calling method '.version_select at 0x7f6073b43160>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:08.962382 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-62cccb5c-5c7a-4ff4-ab30-911ced8c1606 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.623613 Jun 20 12:14:08.964605 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1894/3721] 10.222.0.27 () {60 vars in 1179 bytes} [Mon Jun 20 12:14:08 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:14:08.972410 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7462eebf-a9a9-4dce-8864-de986e2d08e0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:08.979631 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7462eebf-a9a9-4dce-8864-de986e2d08e0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:08.994112 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7462eebf-a9a9-4dce-8864-de986e2d08e0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:08.994559 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7462eebf-a9a9-4dce-8864-de986e2d08e0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:08.998026 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7462eebf-a9a9-4dce-8864-de986e2d08e0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:09.000961 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7462eebf-a9a9-4dce-8864-de986e2d08e0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:09.201753 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7462eebf-a9a9-4dce-8864-de986e2d08e0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:09.209216 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7462eebf-a9a9-4dce-8864-de986e2d08e0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1392 microversion: 2.1 time: 0.243305 Jun 20 12:14:09.209812 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1895/3722] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:08 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1392 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:09.216620 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-260eb0b2-99c9-4625-88e0-2fdcc7089164 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '.version_select at 0x7f6073977670>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:09.351720 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=8 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:09.457516 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-260eb0b2-99c9-4625-88e0-2fdcc7089164 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 0.246233 Jun 20 12:14:09.458125 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1896/3723] 10.222.0.27 () {58 vars in 1157 bytes} [Mon Jun 20 12:14:09 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:09.462785 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ab4c6886-c028-44d7-b0dc-1916d68fefe7 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:09.463668 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ab4c6886-c028-44d7-b0dc-1916d68fefe7 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:09.471359 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ab4c6886-c028-44d7-b0dc-1916d68fefe7 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:09.471812 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ab4c6886-c028-44d7-b0dc-1916d68fefe7 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:09.472625 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ab4c6886-c028-44d7-b0dc-1916d68fefe7 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:09.473066 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ab4c6886-c028-44d7-b0dc-1916d68fefe7 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:09.543859 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ab4c6886-c028-44d7-b0dc-1916d68fefe7 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:09.552549 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ab4c6886-c028-44d7-b0dc-1916d68fefe7 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:09.554061 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ab4c6886-c028-44d7-b0dc-1916d68fefe7 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:09.555592 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ab4c6886-c028-44d7-b0dc-1916d68fefe7 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1365 microversion: 2.47 time: 0.096533 Jun 20 12:14:09.563396 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1897/3724] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:09 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1365 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:09.568591 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-670d338d-3f2b-4e9a-8a64-1956d6c20bed tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '.version_select at 0x7f60849e1b80>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:09.802716 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-670d338d-3f2b-4e9a-8a64-1956d6c20bed tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/68405aaa-9dda-45fe-ba56-cc5bef46a391" status: 202 len: 0 microversion: 2.1 time: 0.237315 Jun 20 12:14:09.803804 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1898/3725] 10.222.0.27 () {58 vars in 1271 bytes} [Mon Jun 20 12:14:09 2022] DELETE /compute/v2.1/os-security-groups/68405aaa-9dda-45fe-ba56-cc5bef46a391 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:14:09.810004 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-982f779a-408c-45af-84d7-76ccce80074a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:09.815087 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-982f779a-408c-45af-84d7-76ccce80074a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:09.822071 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-982f779a-408c-45af-84d7-76ccce80074a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:09.822899 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-982f779a-408c-45af-84d7-76ccce80074a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:09.824256 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-982f779a-408c-45af-84d7-76ccce80074a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:09.825368 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-982f779a-408c-45af-84d7-76ccce80074a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:10.025174 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-982f779a-408c-45af-84d7-76ccce80074a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:10.035797 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-982f779a-408c-45af-84d7-76ccce80074a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1472 microversion: 2.1 time: 0.230164 Jun 20 12:14:10.036438 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1899/3726] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:09 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1472 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:10.041004 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-390c40da-d766-4bd3-a4dc-cec42310b77f tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '.version_select at 0x7f60849e10d0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:10.069860 n-d-master-1 devstack@n-api.service[119127]: DEBUG neutronclient.v2_0.client [None req-390c40da-d766-4bd3-a4dc-cec42310b77f tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 68405aaa-9dda-45fe-ba56-cc5bef46a391 does not exist", "detail": ""}} {{(pid=119127) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 20 12:14:10.070799 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.security_group_api [None req-390c40da-d766-4bd3-a4dc-cec42310b77f tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Neutron security group 68405aaa-9dda-45fe-ba56-cc5bef46a391 not found {{(pid=119127) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 20 12:14:10.071511 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-390c40da-d766-4bd3-a4dc-cec42310b77f tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] HTTP exception thrown: Security group 68405aaa-9dda-45fe-ba56-cc5bef46a391 does not exist Jun 20 12:14:10.071511 n-d-master-1 devstack@n-api.service[119127]: Neutron server returns request_ids: ['req-f9b4df25-e54a-48ec-a70d-73bc1ed9b320'] Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-390c40da-d766-4bd3-a4dc-cec42310b77f tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Request method failure captured: Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/os-security-groups/68405aaa-9dda-45fe-ba56-cc5bef46a391 HTTP/1.1 Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGRspEjgKJLgDEMUB1oxj39OHwxpAdW28qHUXtVohoyOClCgJsgd03GdT2hoi3BapXye_C7q25Fmx52K1II73Nmx91JaNXbL0TFFBm3DxndH_-8RQjkZz-YTJGFJgzzOjcuFROsmxi41ZdE0CTcrcS_WNFOPfY38q9VTNDmwM1zWfjI Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: b3edd75428794ea2b1cbd1b8413072cd Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: b3edd75428794ea2b1cbd1b8413072cd Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-SecurityGroupsTestJSON-1959389845-project Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: e8878b2fbb4b429288856159a644382f Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-SecurityGroupsTestJSON-1959389845-project Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: exception: Security group 68405aaa-9dda-45fe-ba56-cc5bef46a391 does not exist Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: Neutron server returns request_ids: ['req-f9b4df25-e54a-48ec-a70d-73bc1ed9b320'] Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '68405aaa-9dda-45fe-ba56-cc5bef46a391'} Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 20 12:14:10.073748 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 68405aaa-9dda-45fe-ba56-cc5bef46a391 does not exist Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9b4df25-e54a-48ec-a70d-73bc1ed9b320'] Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 68405aaa-9dda-45fe-ba56-cc5bef46a391 does not exist Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9b4df25-e54a-48ec-a70d-73bc1ed9b320'] Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 68405aaa-9dda-45fe-ba56-cc5bef46a391 does not exist Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9b4df25-e54a-48ec-a70d-73bc1ed9b320'] Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 68405aaa-9dda-45fe-ba56-cc5bef46a391 does not exist Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9b4df25-e54a-48ec-a70d-73bc1ed9b320'] Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-390c40da-d766-4bd3-a4dc-cec42310b77f tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Returning 404 to user: Security group 68405aaa-9dda-45fe-ba56-cc5bef46a391 does not exist Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: Neutron server returns request_ids: ['req-f9b4df25-e54a-48ec-a70d-73bc1ed9b320'] {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-390c40da-d766-4bd3-a4dc-cec42310b77f tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/68405aaa-9dda-45fe-ba56-cc5bef46a391" status: 404 len: 194 microversion: 2.1 time: 0.038228 Jun 20 12:14:10.081102 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1900/3727] 10.222.0.27 () {58 vars in 1268 bytes} [Mon Jun 20 12:14:10 2022] GET /compute/v2.1/os-security-groups/68405aaa-9dda-45fe-ba56-cc5bef46a391 => generated 194 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:14:10.085343 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0fe10123-fef6-4d25-b6a7-13a16ad4cd76 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '.version_select at 0x7f6073bc2160>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:10.315111 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0fe10123-fef6-4d25-b6a7-13a16ad4cd76 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/d8f02ef8-48d6-46e0-b060-7d991b58d50d" status: 202 len: 0 microversion: 2.1 time: 0.234455 Jun 20 12:14:10.315700 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1901/3728] 10.222.0.27 () {58 vars in 1271 bytes} [Mon Jun 20 12:14:10 2022] DELETE /compute/v2.1/os-security-groups/d8f02ef8-48d6-46e0-b060-7d991b58d50d => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:14:10.321347 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4ecdc439-b8c0-4a13-b80a-827aa98f3e85 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:10.322225 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4ecdc439-b8c0-4a13-b80a-827aa98f3e85 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:10.330375 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4ecdc439-b8c0-4a13-b80a-827aa98f3e85 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:10.331490 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4ecdc439-b8c0-4a13-b80a-827aa98f3e85 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:10.332585 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4ecdc439-b8c0-4a13-b80a-827aa98f3e85 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:10.333906 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4ecdc439-b8c0-4a13-b80a-827aa98f3e85 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:10.518727 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4ecdc439-b8c0-4a13-b80a-827aa98f3e85 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:10.530779 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4ecdc439-b8c0-4a13-b80a-827aa98f3e85 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1392 microversion: 2.1 time: 0.213597 Jun 20 12:14:10.540464 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1902/3729] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:10 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1392 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:10.540464 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6793e5d7-48db-4231-bf9d-ee0e83fd0647 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '.version_select at 0x7f60849d15e0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:10.559311 n-d-master-1 devstack@n-api.service[119127]: DEBUG neutronclient.v2_0.client [None req-6793e5d7-48db-4231-bf9d-ee0e83fd0647 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d8f02ef8-48d6-46e0-b060-7d991b58d50d does not exist", "detail": ""}} {{(pid=119127) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 20 12:14:10.559891 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.security_group_api [None req-6793e5d7-48db-4231-bf9d-ee0e83fd0647 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Neutron security group d8f02ef8-48d6-46e0-b060-7d991b58d50d not found {{(pid=119127) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 20 12:14:10.560451 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-6793e5d7-48db-4231-bf9d-ee0e83fd0647 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] HTTP exception thrown: Security group d8f02ef8-48d6-46e0-b060-7d991b58d50d does not exist Jun 20 12:14:10.560451 n-d-master-1 devstack@n-api.service[119127]: Neutron server returns request_ids: ['req-99642186-eece-40cf-9be2-66befed51921'] Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6793e5d7-48db-4231-bf9d-ee0e83fd0647 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Request method failure captured: Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/os-security-groups/d8f02ef8-48d6-46e0-b060-7d991b58d50d HTTP/1.1 Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGRspEjgKJLgDEMUB1oxj39OHwxpAdW28qHUXtVohoyOClCgJsgd03GdT2hoi3BapXye_C7q25Fmx52K1II73Nmx91JaNXbL0TFFBm3DxndH_-8RQjkZz-YTJGFJgzzOjcuFROsmxi41ZdE0CTcrcS_WNFOPfY38q9VTNDmwM1zWfjI Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: b3edd75428794ea2b1cbd1b8413072cd Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: b3edd75428794ea2b1cbd1b8413072cd Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-SecurityGroupsTestJSON-1959389845-project Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: e8878b2fbb4b429288856159a644382f Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-SecurityGroupsTestJSON-1959389845-project Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: exception: Security group d8f02ef8-48d6-46e0-b060-7d991b58d50d does not exist Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: Neutron server returns request_ids: ['req-99642186-eece-40cf-9be2-66befed51921'] Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'd8f02ef8-48d6-46e0-b060-7d991b58d50d'} Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 20 12:14:10.562572 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d8f02ef8-48d6-46e0-b060-7d991b58d50d does not exist Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-99642186-eece-40cf-9be2-66befed51921'] Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d8f02ef8-48d6-46e0-b060-7d991b58d50d does not exist Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-99642186-eece-40cf-9be2-66befed51921'] Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d8f02ef8-48d6-46e0-b060-7d991b58d50d does not exist Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-99642186-eece-40cf-9be2-66befed51921'] Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d8f02ef8-48d6-46e0-b060-7d991b58d50d does not exist Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-99642186-eece-40cf-9be2-66befed51921'] Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6793e5d7-48db-4231-bf9d-ee0e83fd0647 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Returning 404 to user: Security group d8f02ef8-48d6-46e0-b060-7d991b58d50d does not exist Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: Neutron server returns request_ids: ['req-99642186-eece-40cf-9be2-66befed51921'] {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6793e5d7-48db-4231-bf9d-ee0e83fd0647 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/d8f02ef8-48d6-46e0-b060-7d991b58d50d" status: 404 len: 194 microversion: 2.1 time: 0.031853 Jun 20 12:14:10.567577 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1903/3730] 10.222.0.27 () {58 vars in 1268 bytes} [Mon Jun 20 12:14:10 2022] GET /compute/v2.1/os-security-groups/d8f02ef8-48d6-46e0-b060-7d991b58d50d => generated 194 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:14:10.578268 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-afc65d7d-8d24-4c29-9a3f-844e3d27ed7c tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:10.578889 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-afc65d7d-8d24-4c29-9a3f-844e3d27ed7c tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:10.586602 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-afc65d7d-8d24-4c29-9a3f-844e3d27ed7c tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:10.587051 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-afc65d7d-8d24-4c29-9a3f-844e3d27ed7c tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:10.587832 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-afc65d7d-8d24-4c29-9a3f-844e3d27ed7c tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:10.588312 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-afc65d7d-8d24-4c29-9a3f-844e3d27ed7c tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:10.656256 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-afc65d7d-8d24-4c29-9a3f-844e3d27ed7c tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:10.665348 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-afc65d7d-8d24-4c29-9a3f-844e3d27ed7c tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:10.667096 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-afc65d7d-8d24-4c29-9a3f-844e3d27ed7c tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:10.668352 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-afc65d7d-8d24-4c29-9a3f-844e3d27ed7c tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1365 microversion: 2.47 time: 0.097926 Jun 20 12:14:10.669281 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1904/3731] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:10 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1365 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:10.674667 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5e055bd1-fa87-4fb6-a520-5139f5928b04 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '.version_select at 0x7f607329b9d0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:10.897838 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5e055bd1-fa87-4fb6-a520-5139f5928b04 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/0f994e73-34c9-4198-a50f-24797d6592ed" status: 202 len: 0 microversion: 2.1 time: 0.227536 Jun 20 12:14:10.901496 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1905/3732] 10.222.0.27 () {58 vars in 1271 bytes} [Mon Jun 20 12:14:10 2022] DELETE /compute/v2.1/os-security-groups/0f994e73-34c9-4198-a50f-24797d6592ed => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:14:10.909644 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e8be7d4c-8c72-4edf-a5d1-b1d914ae51da tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '.version_select at 0x7f6080bf7310>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:10.949368 n-d-master-1 devstack@n-api.service[119127]: DEBUG neutronclient.v2_0.client [None req-e8be7d4c-8c72-4edf-a5d1-b1d914ae51da tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0f994e73-34c9-4198-a50f-24797d6592ed does not exist", "detail": ""}} {{(pid=119127) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 20 12:14:10.949368 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.security_group_api [None req-e8be7d4c-8c72-4edf-a5d1-b1d914ae51da tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Neutron security group 0f994e73-34c9-4198-a50f-24797d6592ed not found {{(pid=119127) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 20 12:14:10.949909 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-e8be7d4c-8c72-4edf-a5d1-b1d914ae51da tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] HTTP exception thrown: Security group 0f994e73-34c9-4198-a50f-24797d6592ed does not exist Jun 20 12:14:10.949909 n-d-master-1 devstack@n-api.service[119127]: Neutron server returns request_ids: ['req-8e318252-7670-418e-b64f-040acfa73c53'] Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e8be7d4c-8c72-4edf-a5d1-b1d914ae51da tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Request method failure captured: Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/os-security-groups/0f994e73-34c9-4198-a50f-24797d6592ed HTTP/1.1 Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGRspEjgKJLgDEMUB1oxj39OHwxpAdW28qHUXtVohoyOClCgJsgd03GdT2hoi3BapXye_C7q25Fmx52K1II73Nmx91JaNXbL0TFFBm3DxndH_-8RQjkZz-YTJGFJgzzOjcuFROsmxi41ZdE0CTcrcS_WNFOPfY38q9VTNDmwM1zWfjI Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: b3edd75428794ea2b1cbd1b8413072cd Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: b3edd75428794ea2b1cbd1b8413072cd Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-SecurityGroupsTestJSON-1959389845-project Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: e8878b2fbb4b429288856159a644382f Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-SecurityGroupsTestJSON-1959389845-project Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: exception: Security group 0f994e73-34c9-4198-a50f-24797d6592ed does not exist Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: Neutron server returns request_ids: ['req-8e318252-7670-418e-b64f-040acfa73c53'] Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '0f994e73-34c9-4198-a50f-24797d6592ed'} Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 20 12:14:10.952122 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0f994e73-34c9-4198-a50f-24797d6592ed does not exist Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e318252-7670-418e-b64f-040acfa73c53'] Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0f994e73-34c9-4198-a50f-24797d6592ed does not exist Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e318252-7670-418e-b64f-040acfa73c53'] Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0f994e73-34c9-4198-a50f-24797d6592ed does not exist Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e318252-7670-418e-b64f-040acfa73c53'] Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0f994e73-34c9-4198-a50f-24797d6592ed does not exist Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e318252-7670-418e-b64f-040acfa73c53'] Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e8be7d4c-8c72-4edf-a5d1-b1d914ae51da tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Returning 404 to user: Security group 0f994e73-34c9-4198-a50f-24797d6592ed does not exist Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: Neutron server returns request_ids: ['req-8e318252-7670-418e-b64f-040acfa73c53'] {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e8be7d4c-8c72-4edf-a5d1-b1d914ae51da tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/0f994e73-34c9-4198-a50f-24797d6592ed" status: 404 len: 194 microversion: 2.1 time: 0.049199 Jun 20 12:14:10.960569 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1906/3733] 10.222.0.27 () {58 vars in 1268 bytes} [Mon Jun 20 12:14:10 2022] GET /compute/v2.1/os-security-groups/0f994e73-34c9-4198-a50f-24797d6592ed => generated 194 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:14:10.967956 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3868d694-8c3b-4873-a9fb-4a0c23ccbbc9 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '.version_select at 0x7f6072c3cc10>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:11.163147 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3868d694-8c3b-4873-a9fb-4a0c23ccbbc9 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.202360 Jun 20 12:14:11.164447 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1907/3734] 10.222.0.27 () {58 vars in 1157 bytes} [Mon Jun 20 12:14:10 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:14:11.179894 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e1fa5db9-747f-4479-98ff-27cace2f6775 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:11.180849 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e1fa5db9-747f-4479-98ff-27cace2f6775 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:11.188040 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1fa5db9-747f-4479-98ff-27cace2f6775 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:11.188748 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1fa5db9-747f-4479-98ff-27cace2f6775 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:11.189534 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1fa5db9-747f-4479-98ff-27cace2f6775 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:11.190124 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1fa5db9-747f-4479-98ff-27cace2f6775 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:11.260750 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8d54062b-ec6d-4b46-9e6a-b125119953db tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/bd4041b8-e25e-4a82-877e-ee546a7d1176" status: 202 len: 0 microversion: 2.1 time: 2.683056 Jun 20 12:14:11.261456 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1828/3735] 10.222.0.27 () {58 vars in 1262 bytes} [Mon Jun 20 12:14:08 2022] DELETE /compute/v2.1/os-floating-ips/bd4041b8-e25e-4a82-877e-ee546a7d1176 => generated 0 bytes in 2684 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:14:11.266584 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1c45cd59-afa8-45f1-b937-5d9c00d170f4 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Action: 'create', calling method: .version_select at 0x7f6073410f70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-441359876", "description": "tempest-description-2027868480"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:11.354643 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e1fa5db9-747f-4479-98ff-27cace2f6775 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:11.363430 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e1fa5db9-747f-4479-98ff-27cace2f6775 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1472 microversion: 2.1 time: 0.188084 Jun 20 12:14:11.364028 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1908/3736] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:11 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1472 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:11.369706 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d8223a7e-d25f-4fe2-8d0a-47c1cf656cc2 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:11.370472 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d8223a7e-d25f-4fe2-8d0a-47c1cf656cc2 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: fd56a5df-a994-416e-b1d4-a5a78df871b2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:11.377651 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d8223a7e-d25f-4fe2-8d0a-47c1cf656cc2 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:11.378104 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d8223a7e-d25f-4fe2-8d0a-47c1cf656cc2 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:11.378883 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d8223a7e-d25f-4fe2-8d0a-47c1cf656cc2 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:11.379474 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d8223a7e-d25f-4fe2-8d0a-47c1cf656cc2 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:11.413418 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d8223a7e-d25f-4fe2-8d0a-47c1cf656cc2 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: fd56a5df-a994-416e-b1d4-a5a78df871b2] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:14:11.515770 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d8223a7e-d25f-4fe2-8d0a-47c1cf656cc2 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2" status: 204 len: 0 microversion: 2.1 time: 0.149966 Jun 20 12:14:11.516687 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1909/3737] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:14:11 2022] DELETE /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:14:11.531885 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1dee481e-205b-4a34-9f9e-19208eba7fb9 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:11.533425 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1dee481e-205b-4a34-9f9e-19208eba7fb9 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: fd56a5df-a994-416e-b1d4-a5a78df871b2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:11.544554 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1dee481e-205b-4a34-9f9e-19208eba7fb9 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:11.545608 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1dee481e-205b-4a34-9f9e-19208eba7fb9 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:11.547441 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1dee481e-205b-4a34-9f9e-19208eba7fb9 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:11.548115 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1dee481e-205b-4a34-9f9e-19208eba7fb9 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:11.766615 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1c45cd59-afa8-45f1-b937-5d9c00d170f4 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.503759 Jun 20 12:14:11.767970 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1829/3738] 10.222.0.27 () {60 vars in 1179 bytes} [Mon Jun 20 12:14:11 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:14:11.780326 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fe120965-7fae-4915-9ecd-fe97867d9863 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:11.781411 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fe120965-7fae-4915-9ecd-fe97867d9863 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:11.786804 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:11.796079 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe120965-7fae-4915-9ecd-fe97867d9863 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:11.796608 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe120965-7fae-4915-9ecd-fe97867d9863 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:11.797428 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe120965-7fae-4915-9ecd-fe97867d9863 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:11.798247 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe120965-7fae-4915-9ecd-fe97867d9863 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:11.819870 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1dee481e-205b-4a34-9f9e-19208eba7fb9 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4a7cec6b754f4095917bb4cb9ee283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5ce0a299ef4e10be4dccca2ef8b957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:11.829086 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1dee481e-205b-4a34-9f9e-19208eba7fb9 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "GET /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2" status: 200 len: 1645 microversion: 2.1 time: 0.305548 Jun 20 12:14:11.833632 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1910/3739] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:11 2022] GET /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2 => generated 1645 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:11.838884 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b9d4a3bb-7f21-46a0-9a2b-4cecbc75338d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:11.839913 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b9d4a3bb-7f21-46a0-9a2b-4cecbc75338d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:11.855430 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b9d4a3bb-7f21-46a0-9a2b-4cecbc75338d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:11.856315 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b9d4a3bb-7f21-46a0-9a2b-4cecbc75338d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:11.858426 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b9d4a3bb-7f21-46a0-9a2b-4cecbc75338d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:11.859069 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b9d4a3bb-7f21-46a0-9a2b-4cecbc75338d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:11.866985 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:11.969446 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b9d4a3bb-7f21-46a0-9a2b-4cecbc75338d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:11.980326 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b9d4a3bb-7f21-46a0-9a2b-4cecbc75338d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:11.980326 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b9d4a3bb-7f21-46a0-9a2b-4cecbc75338d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:11.982524 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b9d4a3bb-7f21-46a0-9a2b-4cecbc75338d tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1365 microversion: 2.47 time: 0.146082 Jun 20 12:14:11.982524 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1911/3740] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:11 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:11.997443 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d6868f6e-cc5a-4c38-a7a2-0c69ee27b115 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Action: 'create', calling method: .version_select at 0x7f60849fedc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1438609780", "description": "tempest-description-1901232539"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:12.014319 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fe120965-7fae-4915-9ecd-fe97867d9863 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:12.023303 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fe120965-7fae-4915-9ecd-fe97867d9863 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1392 microversion: 2.1 time: 0.254026 Jun 20 12:14:12.023893 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1830/3741] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:11 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1392 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:12.032551 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-82d128b1-2d38-44d8-a110-f581ac3a529d req-33a18e16-4b4d-4d09-8fa9-ff4638b9990c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d", "name": "network-vif-plugged", "status": "completed", "tag": "ce10fc86-e544-41be-9e96-7780fa2e39cc"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:12.044194 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-82d128b1-2d38-44d8-a110-f581ac3a529d req-33a18e16-4b4d-4d09-8fa9-ff4638b9990c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:12.044716 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-82d128b1-2d38-44d8-a110-f581ac3a529d req-33a18e16-4b4d-4d09-8fa9-ff4638b9990c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:12.060019 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-82d128b1-2d38-44d8-a110-f581ac3a529d req-33a18e16-4b4d-4d09-8fa9-ff4638b9990c service nova] Creating event network-vif-plugged:ce10fc86-e544-41be-9e96-7780fa2e39cc for instance f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d on n-h1-master-1 Jun 20 12:14:12.066828 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-82d128b1-2d38-44d8-a110-f581ac3a529d req-33a18e16-4b4d-4d09-8fa9-ff4638b9990c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041700 Jun 20 12:14:12.067982 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1831/3742] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:14:12.294952 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d6868f6e-cc5a-4c38-a7a2-0c69ee27b115 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.311587 Jun 20 12:14:12.308995 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1912/3743] 10.222.0.27 () {60 vars in 1179 bytes} [Mon Jun 20 12:14:11 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:14:12.383725 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-42766335-7b1a-4315-a15f-e7a461771e9e tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:12.384465 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-42766335-7b1a-4315-a15f-e7a461771e9e tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:12.391624 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-42766335-7b1a-4315-a15f-e7a461771e9e tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:12.392259 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-42766335-7b1a-4315-a15f-e7a461771e9e tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:12.393296 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-42766335-7b1a-4315-a15f-e7a461771e9e tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:12.393962 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-42766335-7b1a-4315-a15f-e7a461771e9e tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:12.415756 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a9f9f41d-5daa-4638-90bf-07908b5e7c83 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-651705680", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "bc732c96-f822-4316-9285-6dad12be4a9e"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:12.474904 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-a9f9f41d-5daa-4638-90bf-07908b5e7c83 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] validate_networks() for [('bc732c96-f822-4316-9285-6dad12be4a9e', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:14:12.535897 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-42766335-7b1a-4315-a15f-e7a461771e9e tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:12.546297 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-42766335-7b1a-4315-a15f-e7a461771e9e tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1472 microversion: 2.1 time: 0.166952 Jun 20 12:14:12.547237 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1832/3744] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:12 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1472 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:12.856194 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6ed544fd-9d48-4dee-81de-f775b1013899 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:12.857442 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6ed544fd-9d48-4dee-81de-f775b1013899 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: fd56a5df-a994-416e-b1d4-a5a78df871b2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:12.865409 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ed544fd-9d48-4dee-81de-f775b1013899 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:12.865890 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ed544fd-9d48-4dee-81de-f775b1013899 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:12.866927 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ed544fd-9d48-4dee-81de-f775b1013899 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:12.867915 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ed544fd-9d48-4dee-81de-f775b1013899 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:12.968587 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-a9f9f41d-5daa-4638-90bf-07908b5e7c83 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:14:12.969019 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-a9f9f41d-5daa-4638-90bf-07908b5e7c83 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:14:12.970033 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-a9f9f41d-5daa-4638-90bf-07908b5e7c83 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:14:12.970472 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-a9f9f41d-5daa-4638-90bf-07908b5e7c83 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:14:12.971072 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-a9f9f41d-5daa-4638-90bf-07908b5e7c83 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:14:12.982076 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a9f9f41d-5daa-4638-90bf-07908b5e7c83 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:12.982683 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a9f9f41d-5daa-4638-90bf-07908b5e7c83 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:12.983924 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a9f9f41d-5daa-4638-90bf-07908b5e7c83 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:12.984419 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a9f9f41d-5daa-4638-90bf-07908b5e7c83 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:13.003504 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-a9f9f41d-5daa-4638-90bf-07908b5e7c83 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Getting quotas for project b3edd75428794ea2b1cbd1b8413072cd. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:14:13.009610 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-a9f9f41d-5daa-4638-90bf-07908b5e7c83 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Getting quotas for user e8878b2fbb4b429288856159a644382f and project b3edd75428794ea2b1cbd1b8413072cd. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:14:13.024446 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a9f9f41d-5daa-4638-90bf-07908b5e7c83 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:14:13.026824 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a9f9f41d-5daa-4638-90bf-07908b5e7c83 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: a48784f9-f5d9-4379-b2ce-ba044db399cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:14:13.075468 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a9f9f41d-5daa-4638-90bf-07908b5e7c83 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.663810 Jun 20 12:14:13.076356 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1913/3745] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:14:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:14:13.081337 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ae939fb4-033a-494f-ba6c-cebf7e8ecb89 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:13.081796 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ae939fb4-033a-494f-ba6c-cebf7e8ecb89 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:13.090667 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ae939fb4-033a-494f-ba6c-cebf7e8ecb89 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:13.091242 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ae939fb4-033a-494f-ba6c-cebf7e8ecb89 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:13.094117 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ae939fb4-033a-494f-ba6c-cebf7e8ecb89 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:13.094117 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ae939fb4-033a-494f-ba6c-cebf7e8ecb89 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:13.169567 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ae939fb4-033a-494f-ba6c-cebf7e8ecb89 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:13.177881 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ae939fb4-033a-494f-ba6c-cebf7e8ecb89 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:13.179725 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ae939fb4-033a-494f-ba6c-cebf7e8ecb89 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:13.181211 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ae939fb4-033a-494f-ba6c-cebf7e8ecb89 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1365 microversion: 2.47 time: 0.103986 Jun 20 12:14:13.181782 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1914/3746] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:13 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1365 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:13.198373 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a5b6886d-258f-453e-bc4d-7c18f5b8515c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:13.199334 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a5b6886d-258f-453e-bc4d-7c18f5b8515c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:13.207982 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5b6886d-258f-453e-bc4d-7c18f5b8515c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:13.208401 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5b6886d-258f-453e-bc4d-7c18f5b8515c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:13.209579 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5b6886d-258f-453e-bc4d-7c18f5b8515c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:13.209741 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5b6886d-258f-453e-bc4d-7c18f5b8515c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:13.354638 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6ed544fd-9d48-4dee-81de-f775b1013899 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4a7cec6b754f4095917bb4cb9ee283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5ce0a299ef4e10be4dccca2ef8b957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:13.376624 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a5b6886d-258f-453e-bc4d-7c18f5b8515c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:13.379950 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6ed544fd-9d48-4dee-81de-f775b1013899 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "GET /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2" status: 200 len: 1526 microversion: 2.1 time: 0.528184 Jun 20 12:14:13.390620 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a5b6886d-258f-453e-bc4d-7c18f5b8515c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1392 microversion: 2.1 time: 0.192696 Jun 20 12:14:13.391845 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1833/3747] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:12 2022] GET /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2 => generated 1526 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:13.396783 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1915/3748] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:13 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1392 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:13.399363 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3ca934ce-c89f-4a2f-b825-f9fc9e17e7b6 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:13.400241 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3ca934ce-c89f-4a2f-b825-f9fc9e17e7b6 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: a48784f9-f5d9-4379-b2ce-ba044db399cf] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:13.401654 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-973cc4cc-8706-47ca-83c8-60238225b4ff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:13.402325 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-973cc4cc-8706-47ca-83c8-60238225b4ff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:13.408680 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:13.410544 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-973cc4cc-8706-47ca-83c8-60238225b4ff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:13.411200 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-973cc4cc-8706-47ca-83c8-60238225b4ff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:13.412231 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-973cc4cc-8706-47ca-83c8-60238225b4ff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:13.412858 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-973cc4cc-8706-47ca-83c8-60238225b4ff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:13.447801 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-973cc4cc-8706-47ca-83c8-60238225b4ff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc/ips" status: 200 len: 152 microversion: 2.20 time: 0.049831 Jun 20 12:14:13.448625 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1916/3749] 10.222.0.27 () {60 vars in 1288 bytes} [Mon Jun 20 12:14:13 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc/ips => generated 152 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:14:13.565519 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c581097d-aabb-42c5-8abb-8f99fa72fe6b tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:13.566878 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c581097d-aabb-42c5-8abb-8f99fa72fe6b tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:13.576430 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c581097d-aabb-42c5-8abb-8f99fa72fe6b tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:13.577512 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c581097d-aabb-42c5-8abb-8f99fa72fe6b tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:13.578522 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c581097d-aabb-42c5-8abb-8f99fa72fe6b tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:13.579686 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c581097d-aabb-42c5-8abb-8f99fa72fe6b tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:13.589530 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3ca934ce-c89f-4a2f-b825-f9fc9e17e7b6 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:13.612919 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3ca934ce-c89f-4a2f-b825-f9fc9e17e7b6 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf" status: 200 len: 1215 microversion: 2.1 time: 0.218616 Jun 20 12:14:13.614472 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1834/3750] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:13 2022] GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf => generated 1215 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:13.751600 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c581097d-aabb-42c5-8abb-8f99fa72fe6b tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:13.763667 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c581097d-aabb-42c5-8abb-8f99fa72fe6b tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1472 microversion: 2.1 time: 0.203004 Jun 20 12:14:13.775242 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1917/3751] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:13 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1472 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:14.201586 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-baf89ddd-a903-4787-ba7e-a877ef49b768 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:14.202201 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-baf89ddd-a903-4787-ba7e-a877ef49b768 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:14.217136 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-baf89ddd-a903-4787-ba7e-a877ef49b768 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:14.217908 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-baf89ddd-a903-4787-ba7e-a877ef49b768 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:14.218883 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-baf89ddd-a903-4787-ba7e-a877ef49b768 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:14.219471 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-baf89ddd-a903-4787-ba7e-a877ef49b768 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:14.401792 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-36eb4702-15cc-4bf3-ab98-d733c9e47048 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:14.402664 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-36eb4702-15cc-4bf3-ab98-d733c9e47048 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: fd56a5df-a994-416e-b1d4-a5a78df871b2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:14.415882 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36eb4702-15cc-4bf3-ab98-d733c9e47048 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:14.416367 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36eb4702-15cc-4bf3-ab98-d733c9e47048 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:14.417158 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36eb4702-15cc-4bf3-ab98-d733c9e47048 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:14.417591 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36eb4702-15cc-4bf3-ab98-d733c9e47048 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:14.444838 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-baf89ddd-a903-4787-ba7e-a877ef49b768 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:14.456857 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-baf89ddd-a903-4787-ba7e-a877ef49b768 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:14.458370 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-baf89ddd-a903-4787-ba7e-a877ef49b768 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:14.459586 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-baf89ddd-a903-4787-ba7e-a877ef49b768 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1365 microversion: 2.47 time: 0.262233 Jun 20 12:14:14.460164 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1835/3752] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:14 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1365 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:14.489820 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5beeb9be-b782-4ae7-8b96-fea06e5bff9c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:14.490560 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5beeb9be-b782-4ae7-8b96-fea06e5bff9c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:14.508008 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5beeb9be-b782-4ae7-8b96-fea06e5bff9c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:14.509114 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5beeb9be-b782-4ae7-8b96-fea06e5bff9c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:14.512571 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5beeb9be-b782-4ae7-8b96-fea06e5bff9c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:14.513532 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5beeb9be-b782-4ae7-8b96-fea06e5bff9c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:14.586553 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-36eb4702-15cc-4bf3-ab98-d733c9e47048 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e4a7cec6b754f4095917bb4cb9ee283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5ce0a299ef4e10be4dccca2ef8b957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:14.597787 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-36eb4702-15cc-4bf3-ab98-d733c9e47048 tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "GET /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2" status: 200 len: 1484 microversion: 2.1 time: 0.203393 Jun 20 12:14:14.611997 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1918/3753] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:14 2022] GET /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2 => generated 1484 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:14.623717 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-62b375b3-ab09-437e-a6a1-b15db8ba0042 req-ea9f6a19-6d0b-406d-9816-d914390b171b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd56a5df-a994-416e-b1d4-a5a78df871b2", "name": "network-vif-deleted", "tag": "c09d88d8-69e4-4159-a104-22eba04fd540"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:14.646394 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-62b375b3-ab09-437e-a6a1-b15db8ba0042 req-ea9f6a19-6d0b-406d-9816-d914390b171b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:14.648602 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-62b375b3-ab09-437e-a6a1-b15db8ba0042 req-ea9f6a19-6d0b-406d-9816-d914390b171b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:14.689657 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-62b375b3-ab09-437e-a6a1-b15db8ba0042 req-ea9f6a19-6d0b-406d-9816-d914390b171b service nova] Creating event network-vif-deleted:c09d88d8-69e4-4159-a104-22eba04fd540 for instance fd56a5df-a994-416e-b1d4-a5a78df871b2 on n-h1-master-1 Jun 20 12:14:14.697169 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-62b375b3-ab09-437e-a6a1-b15db8ba0042 req-ea9f6a19-6d0b-406d-9816-d914390b171b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083416 Jun 20 12:14:14.700501 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1919/3754] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:14:14.706803 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1b8f6c37-d6f2-4454-a6a6-dd63eb57e211 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:14.707857 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1b8f6c37-d6f2-4454-a6a6-dd63eb57e211 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: a48784f9-f5d9-4379-b2ce-ba044db399cf] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:14.719831 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1b8f6c37-d6f2-4454-a6a6-dd63eb57e211 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:14.727561 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1b8f6c37-d6f2-4454-a6a6-dd63eb57e211 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:14.729042 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1b8f6c37-d6f2-4454-a6a6-dd63eb57e211 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:14.729667 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1b8f6c37-d6f2-4454-a6a6-dd63eb57e211 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:14.966623 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1b8f6c37-d6f2-4454-a6a6-dd63eb57e211 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:14.979945 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1b8f6c37-d6f2-4454-a6a6-dd63eb57e211 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf" status: 200 len: 1275 microversion: 2.1 time: 0.277081 Jun 20 12:14:14.984039 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1920/3755] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:14 2022] GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf => generated 1275 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:14.991992 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-923eb84a-0f71-49a1-a9e3-b097d3415985 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:14.993001 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-923eb84a-0f71-49a1-a9e3-b097d3415985 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:15.013560 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-923eb84a-0f71-49a1-a9e3-b097d3415985 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:15.013560 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-923eb84a-0f71-49a1-a9e3-b097d3415985 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:15.014308 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-923eb84a-0f71-49a1-a9e3-b097d3415985 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:15.014854 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-923eb84a-0f71-49a1-a9e3-b097d3415985 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:15.050447 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5beeb9be-b782-4ae7-8b96-fea06e5bff9c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:15.067684 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5beeb9be-b782-4ae7-8b96-fea06e5bff9c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1562 microversion: 2.1 time: 0.591604 Jun 20 12:14:15.071670 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1836/3756] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:14 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1562 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:15.095298 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-111b06f9-4d59-4f2a-be47-c8b242f48ed5 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:15.096077 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-111b06f9-4d59-4f2a-be47-c8b242f48ed5 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:15.103859 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-111b06f9-4d59-4f2a-be47-c8b242f48ed5 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:15.104740 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-111b06f9-4d59-4f2a-be47-c8b242f48ed5 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:15.105850 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-111b06f9-4d59-4f2a-be47-c8b242f48ed5 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:15.106549 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-111b06f9-4d59-4f2a-be47-c8b242f48ed5 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:15.355444 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-923eb84a-0f71-49a1-a9e3-b097d3415985 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:15.367640 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-923eb84a-0f71-49a1-a9e3-b097d3415985 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1472 microversion: 2.1 time: 0.381428 Jun 20 12:14:15.368762 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1921/3757] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:14 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1472 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:15.451659 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-111b06f9-4d59-4f2a-be47-c8b242f48ed5 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:15.461094 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-111b06f9-4d59-4f2a-be47-c8b242f48ed5 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1562 microversion: 2.1 time: 0.375835 Jun 20 12:14:15.461692 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1837/3758] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:15 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1562 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:15.478356 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6a068d4d-9b98-4381-86c5-083e6216084b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:15.479044 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6a068d4d-9b98-4381-86c5-083e6216084b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:15.486313 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6a068d4d-9b98-4381-86c5-083e6216084b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:15.486784 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6a068d4d-9b98-4381-86c5-083e6216084b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:15.487834 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6a068d4d-9b98-4381-86c5-083e6216084b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:15.488311 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6a068d4d-9b98-4381-86c5-083e6216084b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:15.616104 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6a068d4d-9b98-4381-86c5-083e6216084b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:15.617780 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-16c77773-046b-4871-b346-86cc0bde24fc tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:15.618332 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-16c77773-046b-4871-b346-86cc0bde24fc tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] [instance: fd56a5df-a994-416e-b1d4-a5a78df871b2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:15.632326 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-16c77773-046b-4871-b346-86cc0bde24fc tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:15.632852 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-16c77773-046b-4871-b346-86cc0bde24fc tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:15.633124 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6a068d4d-9b98-4381-86c5-083e6216084b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:15.633393 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-16c77773-046b-4871-b346-86cc0bde24fc tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:15.633945 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-16c77773-046b-4871-b346-86cc0bde24fc tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:15.641086 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6a068d4d-9b98-4381-86c5-083e6216084b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:15.642792 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6a068d4d-9b98-4381-86c5-083e6216084b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1365 microversion: 2.47 time: 0.168324 Jun 20 12:14:15.643974 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1922/3759] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:15 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:15.661500 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=3,nova_cell1:RELEASE=3,nova_cell1:UPDATE=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:15.662958 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-16c77773-046b-4871-b346-86cc0bde24fc tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] HTTP exception thrown: Instance fd56a5df-a994-416e-b1d4-a5a78df871b2 could not be found. Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-16c77773-046b-4871-b346-86cc0bde24fc tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Request method failure captured: Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2 HTTP/1.1 Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGQ5nfCNxCSTubPQFZpKI5xLw-Lk21qmc_3O5k9yVdyL-RLjlR7ZaeB2VN02txLyeyqQY0UHamkIqRQ64yM2zNc6pb1nFMGr0zQu9ybKCrplgVvAdT4JN0rT1A5u0bGN-i5bqvt61Y89ouL5Y3ZdVAMMjKFTV74EmmQ_oPv_k9Bh-aI Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 6b5ce0a299ef4e10be4dccca2ef8b957 Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1009548493 Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b5ce0a299ef4e10be4dccca2ef8b957"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b5ce0a299ef4e10be4dccca2ef8b957"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b5ce0a299ef4e10be4dccca2ef8b957"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b5ce0a299ef4e10be4dccca2ef8b957"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1009548493 Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 6b5ce0a299ef4e10be4dccca2ef8b957 Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1009548493 Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-FloatingIPsAssociationTestJSON-1009548493-project Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 0e4a7cec6b754f4095917bb4cb9ee283 Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1009548493-project Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: exception: Instance fd56a5df-a994-416e-b1d4-a5a78df871b2 could not be found. Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'fd56a5df-a994-416e-b1d4-a5a78df871b2'} Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd56a5df-a994-416e-b1d4-a5a78df871b2 could not be found. Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd56a5df-a994-416e-b1d4-a5a78df871b2 could not be found. Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:14:15.664718 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:14:15.670778 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:14:15.670778 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:15.670778 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:14:15.670778 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:14:15.670778 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:14:15.670778 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:14:15.670778 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd56a5df-a994-416e-b1d4-a5a78df871b2 could not be found. Jun 20 12:14:15.670778 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:14:15.670778 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-16c77773-046b-4871-b346-86cc0bde24fc tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] Returning 404 to user: Instance fd56a5df-a994-416e-b1d4-a5a78df871b2 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:14:15.670778 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-16c77773-046b-4871-b346-86cc0bde24fc tempest-FloatingIPsAssociationTestJSON-1009548493 tempest-FloatingIPsAssociationTestJSON-1009548493-project] 10.222.0.27 "GET /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2" status: 404 len: 111 microversion: 2.1 time: 0.052606 Jun 20 12:14:15.671851 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1838/3760] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:15 2022] GET /compute/v2.1/servers/fd56a5df-a994-416e-b1d4-a5a78df871b2 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:14:16.022308 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b65f8fbb-a363-4b51-bb32-4bbd2fecc174 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:16.023479 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b65f8fbb-a363-4b51-bb32-4bbd2fecc174 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: a48784f9-f5d9-4379-b2ce-ba044db399cf] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:16.031838 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b65f8fbb-a363-4b51-bb32-4bbd2fecc174 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:16.032637 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b65f8fbb-a363-4b51-bb32-4bbd2fecc174 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:16.033416 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b65f8fbb-a363-4b51-bb32-4bbd2fecc174 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:16.033847 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b65f8fbb-a363-4b51-bb32-4bbd2fecc174 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:16.161917 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b65f8fbb-a363-4b51-bb32-4bbd2fecc174 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:16.172078 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b65f8fbb-a363-4b51-bb32-4bbd2fecc174 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf" status: 200 len: 1273 microversion: 2.1 time: 0.156157 Jun 20 12:14:16.173136 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1923/3761] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:16 2022] GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf => generated 1273 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:16.392961 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1d269401-3baa-4bd7-b7f5-02a1242a0ae4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:16.394714 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1d269401-3baa-4bd7-b7f5-02a1242a0ae4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:16.410120 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d269401-3baa-4bd7-b7f5-02a1242a0ae4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:16.410835 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d269401-3baa-4bd7-b7f5-02a1242a0ae4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:16.411845 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d269401-3baa-4bd7-b7f5-02a1242a0ae4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:16.413044 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d269401-3baa-4bd7-b7f5-02a1242a0ae4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:16.623467 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a3feb1ae-b64f-4354-979c-375999a53154 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:16.624818 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a3feb1ae-b64f-4354-979c-375999a53154 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:16.632360 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a3feb1ae-b64f-4354-979c-375999a53154 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:16.633186 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a3feb1ae-b64f-4354-979c-375999a53154 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:16.634466 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a3feb1ae-b64f-4354-979c-375999a53154 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:16.636173 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a3feb1ae-b64f-4354-979c-375999a53154 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:16.678960 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-a3feb1ae-b64f-4354-979c-375999a53154 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lazy-loading 'flavor' on Instance uuid 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:14:17.051439 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a3feb1ae-b64f-4354-979c-375999a53154 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "POST /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc/action" status: 202 len: 0 microversion: 2.20 time: 0.430497 Jun 20 12:14:17.057312 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1924/3762] 10.222.0.27 () {62 vars in 1318 bytes} [Mon Jun 20 12:14:16 2022] POST /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc/action => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:14:17.065420 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0b26418b-0e53-499e-bc65-06d98fe7487f tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:17.066291 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0b26418b-0e53-499e-bc65-06d98fe7487f tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:17.098271 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0b26418b-0e53-499e-bc65-06d98fe7487f tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:17.100472 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0b26418b-0e53-499e-bc65-06d98fe7487f tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:17.103079 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0b26418b-0e53-499e-bc65-06d98fe7487f tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:17.104473 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0b26418b-0e53-499e-bc65-06d98fe7487f tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:17.221932 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0b26418b-0e53-499e-bc65-06d98fe7487f tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:17.236404 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0b26418b-0e53-499e-bc65-06d98fe7487f tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:17.237920 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0b26418b-0e53-499e-bc65-06d98fe7487f tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:17.239105 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0b26418b-0e53-499e-bc65-06d98fe7487f tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1371 microversion: 2.47 time: 0.179250 Jun 20 12:14:17.240004 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1925/3763] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:17 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:17.244909 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b69fd58f-eb79-4678-9fc5-a4b0c2d0034b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:17.245551 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b69fd58f-eb79-4678-9fc5-a4b0c2d0034b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:17.253314 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b69fd58f-eb79-4678-9fc5-a4b0c2d0034b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:17.253798 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b69fd58f-eb79-4678-9fc5-a4b0c2d0034b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:17.254581 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b69fd58f-eb79-4678-9fc5-a4b0c2d0034b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:17.255018 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b69fd58f-eb79-4678-9fc5-a4b0c2d0034b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:17.258766 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1d269401-3baa-4bd7-b7f5-02a1242a0ae4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:17.267739 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1d269401-3baa-4bd7-b7f5-02a1242a0ae4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1472 microversion: 2.1 time: 0.881262 Jun 20 12:14:17.268339 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1839/3764] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:16 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1472 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:17.272976 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c70e7415-88d0-4685-8c3d-df958e351419 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:17.273795 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c70e7415-88d0-4685-8c3d-df958e351419 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: a48784f9-f5d9-4379-b2ce-ba044db399cf] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:17.281148 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c70e7415-88d0-4685-8c3d-df958e351419 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:17.281843 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c70e7415-88d0-4685-8c3d-df958e351419 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:17.282768 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c70e7415-88d0-4685-8c3d-df958e351419 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:17.283847 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c70e7415-88d0-4685-8c3d-df958e351419 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:17.647433 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b69fd58f-eb79-4678-9fc5-a4b0c2d0034b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:17.658302 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b69fd58f-eb79-4678-9fc5-a4b0c2d0034b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:17.660234 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b69fd58f-eb79-4678-9fc5-a4b0c2d0034b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:17.662329 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b69fd58f-eb79-4678-9fc5-a4b0c2d0034b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1724 microversion: 2.20 time: 0.421613 Jun 20 12:14:17.677240 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1926/3765] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:17 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1724 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:17.793286 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c70e7415-88d0-4685-8c3d-df958e351419 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:17.804047 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c70e7415-88d0-4685-8c3d-df958e351419 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf" status: 200 len: 1315 microversion: 2.1 time: 0.534431 Jun 20 12:14:17.814872 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1840/3766] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:17 2022] GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf => generated 1315 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:17.957870 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7d1e55e8-2202-4533-a5a1-096b44c4ac1e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:17.958540 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7d1e55e8-2202-4533-a5a1-096b44c4ac1e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:17.966284 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7d1e55e8-2202-4533-a5a1-096b44c4ac1e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:17.966657 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7d1e55e8-2202-4533-a5a1-096b44c4ac1e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:17.967829 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7d1e55e8-2202-4533-a5a1-096b44c4ac1e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:17.969113 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7d1e55e8-2202-4533-a5a1-096b44c4ac1e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:18.017526 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7d1e55e8-2202-4533-a5a1-096b44c4ac1e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:14:18.061010 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:18.150013 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7d1e55e8-2202-4533-a5a1-096b44c4ac1e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "DELETE /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 204 len: 0 microversion: 2.32 time: 0.468629 Jun 20 12:14:18.156850 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1927/3767] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Jun 20 12:14:17 2022] DELETE /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 12:14:18.162028 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f04b4006-68b1-4512-9dac-2b6eb4bf9870 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:18.162649 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f04b4006-68b1-4512-9dac-2b6eb4bf9870 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:18.180322 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f04b4006-68b1-4512-9dac-2b6eb4bf9870 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:18.180691 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f04b4006-68b1-4512-9dac-2b6eb4bf9870 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:18.181690 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f04b4006-68b1-4512-9dac-2b6eb4bf9870 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:18.182301 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f04b4006-68b1-4512-9dac-2b6eb4bf9870 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:18.258603 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-601170f7-82cb-4c66-9c76-ad7c752d35ce tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:18.259493 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-601170f7-82cb-4c66-9c76-ad7c752d35ce tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:18.286439 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-601170f7-82cb-4c66-9c76-ad7c752d35ce tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:18.287998 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-601170f7-82cb-4c66-9c76-ad7c752d35ce tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:18.290177 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-601170f7-82cb-4c66-9c76-ad7c752d35ce tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:18.291232 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-601170f7-82cb-4c66-9c76-ad7c752d35ce tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:18.405302 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-601170f7-82cb-4c66-9c76-ad7c752d35ce tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:18.415491 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-601170f7-82cb-4c66-9c76-ad7c752d35ce tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:18.418354 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-601170f7-82cb-4c66-9c76-ad7c752d35ce tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:18.419348 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-601170f7-82cb-4c66-9c76-ad7c752d35ce tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1371 microversion: 2.47 time: 0.164940 Jun 20 12:14:18.439075 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1928/3768] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:18 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1371 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:18.445412 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b2c286c7-1fd9-42ff-bdeb-519e1e08448f tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:18.446032 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b2c286c7-1fd9-42ff-bdeb-519e1e08448f tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:18.455365 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b2c286c7-1fd9-42ff-bdeb-519e1e08448f tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:18.455858 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b2c286c7-1fd9-42ff-bdeb-519e1e08448f tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:18.456705 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b2c286c7-1fd9-42ff-bdeb-519e1e08448f tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:18.457137 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b2c286c7-1fd9-42ff-bdeb-519e1e08448f tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:18.653385 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f04b4006-68b1-4512-9dac-2b6eb4bf9870 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:18.671075 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f04b4006-68b1-4512-9dac-2b6eb4bf9870 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:18.673103 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f04b4006-68b1-4512-9dac-2b6eb4bf9870 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:18.676320 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f04b4006-68b1-4512-9dac-2b6eb4bf9870 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 2952 microversion: 2.32 time: 0.517874 Jun 20 12:14:18.696404 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1841/3769] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:18 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 2952 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:18.706505 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d372152f-3afc-4903-8b32-d94f4b53a8c5 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:18.707337 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d372152f-3afc-4903-8b32-d94f4b53a8c5 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:18.720837 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d372152f-3afc-4903-8b32-d94f4b53a8c5 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:18.721569 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d372152f-3afc-4903-8b32-d94f4b53a8c5 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:18.723215 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d372152f-3afc-4903-8b32-d94f4b53a8c5 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:18.723664 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d372152f-3afc-4903-8b32-d94f4b53a8c5 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:18.849739 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b2c286c7-1fd9-42ff-bdeb-519e1e08448f tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:18.875038 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b2c286c7-1fd9-42ff-bdeb-519e1e08448f tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1472 microversion: 2.1 time: 0.434723 Jun 20 12:14:18.876551 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1929/3770] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:18 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1472 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:18.889078 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f93e122a-a6f9-446f-abde-1d60117bc62c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:18.890725 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f93e122a-a6f9-446f-abde-1d60117bc62c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: a48784f9-f5d9-4379-b2ce-ba044db399cf] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:18.897807 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f93e122a-a6f9-446f-abde-1d60117bc62c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:18.898659 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f93e122a-a6f9-446f-abde-1d60117bc62c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:18.900787 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f93e122a-a6f9-446f-abde-1d60117bc62c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:18.901504 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f93e122a-a6f9-446f-abde-1d60117bc62c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:19.210285 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f93e122a-a6f9-446f-abde-1d60117bc62c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:19.226146 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f93e122a-a6f9-446f-abde-1d60117bc62c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf" status: 200 len: 1315 microversion: 2.1 time: 0.344800 Jun 20 12:14:19.227281 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1930/3771] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:18 2022] GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:19.322889 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1e7dd3c6-0d77-4051-b60d-8ec3e4970c80 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:19.323947 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1e7dd3c6-0d77-4051-b60d-8ec3e4970c80 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:19.331364 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1e7dd3c6-0d77-4051-b60d-8ec3e4970c80 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:19.332188 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1e7dd3c6-0d77-4051-b60d-8ec3e4970c80 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:19.333211 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1e7dd3c6-0d77-4051-b60d-8ec3e4970c80 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:19.334251 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1e7dd3c6-0d77-4051-b60d-8ec3e4970c80 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:19.491211 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d372152f-3afc-4903-8b32-d94f4b53a8c5 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:19.519328 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d372152f-3afc-4903-8b32-d94f4b53a8c5 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:19.526570 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d372152f-3afc-4903-8b32-d94f4b53a8c5 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:19.529002 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d372152f-3afc-4903-8b32-d94f4b53a8c5 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1724 microversion: 2.20 time: 0.829527 Jun 20 12:14:19.538791 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1842/3772] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:18 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1724 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:19.547872 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-d769613a-b138-41ad-b060-4e9f9c3a113f req-0da7a0d3-dfa7-4b92-ba12-bf60cb5b9a65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d", "tag": "ce10fc86-e544-41be-9e96-7780fa2e39cc"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:19.603431 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-d769613a-b138-41ad-b060-4e9f9c3a113f req-0da7a0d3-dfa7-4b92-ba12-bf60cb5b9a65 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:19.604262 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-d769613a-b138-41ad-b060-4e9f9c3a113f req-0da7a0d3-dfa7-4b92-ba12-bf60cb5b9a65 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:19.654432 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-d769613a-b138-41ad-b060-4e9f9c3a113f req-0da7a0d3-dfa7-4b92-ba12-bf60cb5b9a65 service nova] Creating event network-changed:ce10fc86-e544-41be-9e96-7780fa2e39cc for instance f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d on n-h1-master-1 Jun 20 12:14:19.662174 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1e7dd3c6-0d77-4051-b60d-8ec3e4970c80 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:19.662677 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-d769613a-b138-41ad-b060-4e9f9c3a113f req-0da7a0d3-dfa7-4b92-ba12-bf60cb5b9a65 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121757 Jun 20 12:14:19.664081 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1843/3773] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:14:19.674256 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b6baedab-0ed6-4e68-a4c0-ace47bf8656f tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:19.675404 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b6baedab-0ed6-4e68-a4c0-ace47bf8656f tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:19.684003 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1e7dd3c6-0d77-4051-b60d-8ec3e4970c80 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1562 microversion: 2.1 time: 0.366437 Jun 20 12:14:19.686887 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b6baedab-0ed6-4e68-a4c0-ace47bf8656f tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:19.687717 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b6baedab-0ed6-4e68-a4c0-ace47bf8656f tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:19.689238 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b6baedab-0ed6-4e68-a4c0-ace47bf8656f tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:19.689857 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b6baedab-0ed6-4e68-a4c0-ace47bf8656f tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:19.694837 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1931/3774] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:19 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1562 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:19.735630 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c8d4c9cf-25ed-4bd6-8e7a-c6a43f4f4724 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:19.737732 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c8d4c9cf-25ed-4bd6-8e7a-c6a43f4f4724 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:19.775278 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c8d4c9cf-25ed-4bd6-8e7a-c6a43f4f4724 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:19.781929 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c8d4c9cf-25ed-4bd6-8e7a-c6a43f4f4724 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:19.783882 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c8d4c9cf-25ed-4bd6-8e7a-c6a43f4f4724 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:19.786172 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c8d4c9cf-25ed-4bd6-8e7a-c6a43f4f4724 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:19.941720 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b6baedab-0ed6-4e68-a4c0-ace47bf8656f tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:19.952979 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b6baedab-0ed6-4e68-a4c0-ace47bf8656f tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:19.954716 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b6baedab-0ed6-4e68-a4c0-ace47bf8656f tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:19.956473 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b6baedab-0ed6-4e68-a4c0-ace47bf8656f tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1371 microversion: 2.47 time: 0.290552 Jun 20 12:14:19.969220 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1844/3775] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:19 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1371 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:19.974831 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-10672853-7fa4-4843-bf44-780d9b572df4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:19.975767 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-10672853-7fa4-4843-bf44-780d9b572df4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:19.985269 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-10672853-7fa4-4843-bf44-780d9b572df4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:19.986849 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-10672853-7fa4-4843-bf44-780d9b572df4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:19.988369 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-10672853-7fa4-4843-bf44-780d9b572df4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:19.988989 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-10672853-7fa4-4843-bf44-780d9b572df4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:20.114623 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c8d4c9cf-25ed-4bd6-8e7a-c6a43f4f4724 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:20.125196 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c8d4c9cf-25ed-4bd6-8e7a-c6a43f4f4724 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:20.127103 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c8d4c9cf-25ed-4bd6-8e7a-c6a43f4f4724 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:20.128845 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c8d4c9cf-25ed-4bd6-8e7a-c6a43f4f4724 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 2952 microversion: 2.32 time: 0.428207 Jun 20 12:14:20.140936 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1932/3776] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:19 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 2952 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:20.251190 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ec9a0fcb-6541-4807-a7ea-7adaa37a54b6 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:20.255782 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ec9a0fcb-6541-4807-a7ea-7adaa37a54b6 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: a48784f9-f5d9-4379-b2ce-ba044db399cf] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:20.271828 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ec9a0fcb-6541-4807-a7ea-7adaa37a54b6 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:20.273457 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ec9a0fcb-6541-4807-a7ea-7adaa37a54b6 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:20.274431 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ec9a0fcb-6541-4807-a7ea-7adaa37a54b6 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:20.275043 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ec9a0fcb-6541-4807-a7ea-7adaa37a54b6 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:20.494367 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ec9a0fcb-6541-4807-a7ea-7adaa37a54b6 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:20.505002 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ec9a0fcb-6541-4807-a7ea-7adaa37a54b6 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf" status: 200 len: 1315 microversion: 2.1 time: 0.264504 Jun 20 12:14:20.515008 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1933/3777] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:20 2022] GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:14:20.515008 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-00d72e8a-0210-4051-8093-a05d205a6296 req-942d395f-d4c9-40de-805a-fdcd18f4f2ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a48784f9-f5d9-4379-b2ce-ba044db399cf", "tag": "e38fa345-839c-4384-9b05-edcedcb38cb6"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:20.523930 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-00d72e8a-0210-4051-8093-a05d205a6296 req-942d395f-d4c9-40de-805a-fdcd18f4f2ea service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:20.524529 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-00d72e8a-0210-4051-8093-a05d205a6296 req-942d395f-d4c9-40de-805a-fdcd18f4f2ea service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:20.541548 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-00d72e8a-0210-4051-8093-a05d205a6296 req-942d395f-d4c9-40de-805a-fdcd18f4f2ea service nova] Creating event network-changed:e38fa345-839c-4384-9b05-edcedcb38cb6 for instance a48784f9-f5d9-4379-b2ce-ba044db399cf on n-h1-master-1 Jun 20 12:14:20.548475 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-00d72e8a-0210-4051-8093-a05d205a6296 req-942d395f-d4c9-40de-805a-fdcd18f4f2ea service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039683 Jun 20 12:14:20.549724 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1934/3778] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:14:20.556071 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ac1f1a13-6c36-4281-84ed-b9a6cc6e9280 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:20.556946 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ac1f1a13-6c36-4281-84ed-b9a6cc6e9280 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:20.567314 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac1f1a13-6c36-4281-84ed-b9a6cc6e9280 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:20.567961 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac1f1a13-6c36-4281-84ed-b9a6cc6e9280 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:20.569056 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac1f1a13-6c36-4281-84ed-b9a6cc6e9280 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:20.569940 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac1f1a13-6c36-4281-84ed-b9a6cc6e9280 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:20.711078 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-10672853-7fa4-4843-bf44-780d9b572df4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:20.720657 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-10672853-7fa4-4843-bf44-780d9b572df4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1472 microversion: 2.1 time: 0.749995 Jun 20 12:14:20.721238 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1845/3779] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:19 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1472 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:20.781202 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ac1f1a13-6c36-4281-84ed-b9a6cc6e9280 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:20.796883 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ac1f1a13-6c36-4281-84ed-b9a6cc6e9280 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:20.799051 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ac1f1a13-6c36-4281-84ed-b9a6cc6e9280 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:20.800693 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ac1f1a13-6c36-4281-84ed-b9a6cc6e9280 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1724 microversion: 2.20 time: 0.249421 Jun 20 12:14:20.801247 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1935/3780] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:20 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:20.975721 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1af2fdb3-821d-4c20-8330-adf963301aba tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:20.976373 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1af2fdb3-821d-4c20-8330-adf963301aba tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:20.983852 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1af2fdb3-821d-4c20-8330-adf963301aba tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:20.984441 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1af2fdb3-821d-4c20-8330-adf963301aba tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:20.985336 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1af2fdb3-821d-4c20-8330-adf963301aba tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:20.985987 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1af2fdb3-821d-4c20-8330-adf963301aba tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:21.154998 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b83ea071-d97d-4752-a9c6-bd3bbdc81443 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:21.155603 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b83ea071-d97d-4752-a9c6-bd3bbdc81443 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:21.163462 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b83ea071-d97d-4752-a9c6-bd3bbdc81443 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:21.163998 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b83ea071-d97d-4752-a9c6-bd3bbdc81443 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:21.164850 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b83ea071-d97d-4752-a9c6-bd3bbdc81443 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:21.165291 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b83ea071-d97d-4752-a9c6-bd3bbdc81443 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:21.277177 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1af2fdb3-821d-4c20-8330-adf963301aba tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:21.291415 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1af2fdb3-821d-4c20-8330-adf963301aba tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:21.293609 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1af2fdb3-821d-4c20-8330-adf963301aba tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:21.294941 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1af2fdb3-821d-4c20-8330-adf963301aba tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1371 microversion: 2.47 time: 0.323388 Jun 20 12:14:21.295933 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1846/3781] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:20 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1371 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:14:21.475214 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b83ea071-d97d-4752-a9c6-bd3bbdc81443 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:21.492246 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b83ea071-d97d-4752-a9c6-bd3bbdc81443 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:21.495745 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b83ea071-d97d-4752-a9c6-bd3bbdc81443 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:21.497874 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b83ea071-d97d-4752-a9c6-bd3bbdc81443 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 2952 microversion: 2.32 time: 0.346744 Jun 20 12:14:21.498780 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1936/3782] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:21 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 2952 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:21.524898 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7d9d5502-e085-47f6-bf96-42326cb434b7 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:21.525857 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7d9d5502-e085-47f6-bf96-42326cb434b7 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: a48784f9-f5d9-4379-b2ce-ba044db399cf] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:21.533454 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7d9d5502-e085-47f6-bf96-42326cb434b7 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:21.534220 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7d9d5502-e085-47f6-bf96-42326cb434b7 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:21.535554 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7d9d5502-e085-47f6-bf96-42326cb434b7 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:21.536599 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7d9d5502-e085-47f6-bf96-42326cb434b7 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:21.739257 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-004de548-b7a2-4be9-86c8-f32568a03ecc tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:21.739856 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-004de548-b7a2-4be9-86c8-f32568a03ecc tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:21.748391 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-004de548-b7a2-4be9-86c8-f32568a03ecc tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:21.749151 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-004de548-b7a2-4be9-86c8-f32568a03ecc tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:21.750122 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-004de548-b7a2-4be9-86c8-f32568a03ecc tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:21.750737 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-004de548-b7a2-4be9-86c8-f32568a03ecc tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:22.054567 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-004de548-b7a2-4be9-86c8-f32568a03ecc tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:22.086868 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-004de548-b7a2-4be9-86c8-f32568a03ecc tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1478 microversion: 2.1 time: 0.338335 Jun 20 12:14:22.089943 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1937/3783] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:21 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1478 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:22.096345 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b5143d83-7dbf-4be7-b3ae-6f14805481bd tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:22.099645 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b5143d83-7dbf-4be7-b3ae-6f14805481bd tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:22.114145 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5143d83-7dbf-4be7-b3ae-6f14805481bd tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:22.115003 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5143d83-7dbf-4be7-b3ae-6f14805481bd tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:22.117418 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5143d83-7dbf-4be7-b3ae-6f14805481bd tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:22.119780 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5143d83-7dbf-4be7-b3ae-6f14805481bd tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:22.386056 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b5143d83-7dbf-4be7-b3ae-6f14805481bd tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:22.399631 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b5143d83-7dbf-4be7-b3ae-6f14805481bd tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:22.401596 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b5143d83-7dbf-4be7-b3ae-6f14805481bd tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:22.406370 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b5143d83-7dbf-4be7-b3ae-6f14805481bd tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1724 microversion: 2.20 time: 0.313335 Jun 20 12:14:22.407688 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1938/3784] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:22 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1724 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:22.415089 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-548f3ff5-931a-4f08-a003-3aad2d4d4733 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:22.421184 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-548f3ff5-931a-4f08-a003-3aad2d4d4733 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:22.437328 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-548f3ff5-931a-4f08-a003-3aad2d4d4733 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:22.440750 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-548f3ff5-931a-4f08-a003-3aad2d4d4733 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:22.444903 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-548f3ff5-931a-4f08-a003-3aad2d4d4733 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:22.445396 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-548f3ff5-931a-4f08-a003-3aad2d4d4733 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:22.509833 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7d9d5502-e085-47f6-bf96-42326cb434b7 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:22.522753 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7d9d5502-e085-47f6-bf96-42326cb434b7 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf" status: 200 len: 1315 microversion: 2.1 time: 1.003835 Jun 20 12:14:22.523914 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1847/3785] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:21 2022] GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf => generated 1315 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:22.540594 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-be386054-55b6-4b7c-b159-f3c7f377f889 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:22.551068 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-be386054-55b6-4b7c-b159-f3c7f377f889 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:22.559422 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-be386054-55b6-4b7c-b159-f3c7f377f889 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:22.563569 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-be386054-55b6-4b7c-b159-f3c7f377f889 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:22.564692 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-be386054-55b6-4b7c-b159-f3c7f377f889 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:22.565352 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-be386054-55b6-4b7c-b159-f3c7f377f889 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:22.747590 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-548f3ff5-931a-4f08-a003-3aad2d4d4733 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:22.760689 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-548f3ff5-931a-4f08-a003-3aad2d4d4733 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:22.763067 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-548f3ff5-931a-4f08-a003-3aad2d4d4733 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:22.764598 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-548f3ff5-931a-4f08-a003-3aad2d4d4733 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1356 microversion: 2.47 time: 0.355544 Jun 20 12:14:22.765874 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1939/3786] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:22 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1356 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:22.783588 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-11a3dca8-bded-4943-a9b3-281262f3797b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:22.787771 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-11a3dca8-bded-4943-a9b3-281262f3797b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:22.789183 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-11a3dca8-bded-4943-a9b3-281262f3797b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Searching by: {'deleted': False, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec'} {{(pid=119127) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:14:22.796265 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11a3dca8-bded-4943-a9b3-281262f3797b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:22.797204 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11a3dca8-bded-4943-a9b3-281262f3797b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:22.798255 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11a3dca8-bded-4943-a9b3-281262f3797b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:22.799023 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11a3dca8-bded-4943-a9b3-281262f3797b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:22.961766 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.multi_cell_list [None req-11a3dca8-bded-4943-a9b3-281262f3797b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119127) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 12:14:23.089756 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:23.122733 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-11a3dca8-bded-4943-a9b3-281262f3797b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:23.131690 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11a3dca8-bded-4943-a9b3-281262f3797b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:23.132624 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11a3dca8-bded-4943-a9b3-281262f3797b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:23.146499 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-11a3dca8-bded-4943-a9b3-281262f3797b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:23.149526 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-11a3dca8-bded-4943-a9b3-281262f3797b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:23.200612 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-11a3dca8-bded-4943-a9b3-281262f3797b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.420837 Jun 20 12:14:23.219568 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1940/3787] 10.222.0.27 () {60 vars in 1186 bytes} [Mon Jun 20 12:14:22 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:23.220916 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-17da65d9-b0df-41f5-8908-b6426b67495c tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:23.226002 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-17da65d9-b0df-41f5-8908-b6426b67495c tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:23.240726 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17da65d9-b0df-41f5-8908-b6426b67495c tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:23.241484 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17da65d9-b0df-41f5-8908-b6426b67495c tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:23.243091 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17da65d9-b0df-41f5-8908-b6426b67495c tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:23.244120 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17da65d9-b0df-41f5-8908-b6426b67495c tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:23.344895 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-be386054-55b6-4b7c-b159-f3c7f377f889 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:23.395609 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-be386054-55b6-4b7c-b159-f3c7f377f889 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:23.401646 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-be386054-55b6-4b7c-b159-f3c7f377f889 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:23.404740 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-be386054-55b6-4b7c-b159-f3c7f377f889 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 2952 microversion: 2.32 time: 0.879202 Jun 20 12:14:23.406178 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1848/3788] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:22 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 2952 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:23.426530 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-90857c87-e795-4855-bafd-3c3de55ebd50 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:23.427791 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-90857c87-e795-4855-bafd-3c3de55ebd50 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:23.448256 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-90857c87-e795-4855-bafd-3c3de55ebd50 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:23.451741 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-90857c87-e795-4855-bafd-3c3de55ebd50 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:23.457547 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-90857c87-e795-4855-bafd-3c3de55ebd50 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:23.459655 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-90857c87-e795-4855-bafd-3c3de55ebd50 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:23.566753 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-90857c87-e795-4855-bafd-3c3de55ebd50 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:14:23.599103 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:23.764226 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-90857c87-e795-4855-bafd-3c3de55ebd50 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "DELETE /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 204 len: 0 microversion: 2.47 time: 0.354536 Jun 20 12:14:23.770283 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1849/3789] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Jun 20 12:14:23 2022] DELETE /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 12:14:23.796840 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-16cc7fa4-982b-42a0-9185-7a5942988cad req-12fb684d-ed5a-4f44-9b54-0c736c836128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5b82c0b-6c6a-4d96-a8b2-437d242334f2", "name": "network-vif-unplugged", "status": "completed", "tag": "37e16ff5-1455-4eef-bf70-355b74b7eff3"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:23.811833 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-16cc7fa4-982b-42a0-9185-7a5942988cad req-12fb684d-ed5a-4f44-9b54-0c736c836128 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:23.812566 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-16cc7fa4-982b-42a0-9185-7a5942988cad req-12fb684d-ed5a-4f44-9b54-0c736c836128 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:23.843885 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-16cc7fa4-982b-42a0-9185-7a5942988cad req-12fb684d-ed5a-4f44-9b54-0c736c836128 service nova] Creating event network-vif-unplugged:37e16ff5-1455-4eef-bf70-355b74b7eff3 for instance d5b82c0b-6c6a-4d96-a8b2-437d242334f2 on n-h2-master-1 Jun 20 12:14:23.853479 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-16cc7fa4-982b-42a0-9185-7a5942988cad req-12fb684d-ed5a-4f44-9b54-0c736c836128 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080257 Jun 20 12:14:23.858224 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1850/3790] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:14:23.866103 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-28bbeb26-18a2-4d83-9ab6-bbf9d3e0c7bc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:23.866966 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-28bbeb26-18a2-4d83-9ab6-bbf9d3e0c7bc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:23.877708 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-28bbeb26-18a2-4d83-9ab6-bbf9d3e0c7bc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:23.894601 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-28bbeb26-18a2-4d83-9ab6-bbf9d3e0c7bc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:23.896396 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-28bbeb26-18a2-4d83-9ab6-bbf9d3e0c7bc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:23.897179 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-28bbeb26-18a2-4d83-9ab6-bbf9d3e0c7bc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:24.205254 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-17da65d9-b0df-41f5-8908-b6426b67495c tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:24.215018 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-17da65d9-b0df-41f5-8908-b6426b67495c tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1478 microversion: 2.1 time: 0.999307 Jun 20 12:14:24.215694 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1941/3791] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:23 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1478 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:24.222842 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-36fd2096-758d-4af5-8fcf-f0c5284fafc2 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:24.224022 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-36fd2096-758d-4af5-8fcf-f0c5284fafc2 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: a48784f9-f5d9-4379-b2ce-ba044db399cf] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:24.244945 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36fd2096-758d-4af5-8fcf-f0c5284fafc2 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:24.245732 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36fd2096-758d-4af5-8fcf-f0c5284fafc2 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:24.246827 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36fd2096-758d-4af5-8fcf-f0c5284fafc2 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:24.247256 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36fd2096-758d-4af5-8fcf-f0c5284fafc2 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:24.423082 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-28bbeb26-18a2-4d83-9ab6-bbf9d3e0c7bc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:24.432538 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-28bbeb26-18a2-4d83-9ab6-bbf9d3e0c7bc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:24.434736 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-28bbeb26-18a2-4d83-9ab6-bbf9d3e0c7bc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:24.435886 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-28bbeb26-18a2-4d83-9ab6-bbf9d3e0c7bc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1724 microversion: 2.20 time: 0.576057 Jun 20 12:14:24.436521 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1851/3792] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:23 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1724 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:24.458146 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0a4f6c52-0cab-4e73-9c9c-314533e16ab1 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:24.460551 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0a4f6c52-0cab-4e73-9c9c-314533e16ab1 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:24.468748 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a4f6c52-0cab-4e73-9c9c-314533e16ab1 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:24.470032 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a4f6c52-0cab-4e73-9c9c-314533e16ab1 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:24.474309 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a4f6c52-0cab-4e73-9c9c-314533e16ab1 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:24.474767 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a4f6c52-0cab-4e73-9c9c-314533e16ab1 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:24.549708 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-36fd2096-758d-4af5-8fcf-f0c5284fafc2 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:24.565217 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-36fd2096-758d-4af5-8fcf-f0c5284fafc2 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf" status: 200 len: 1315 microversion: 2.1 time: 0.347751 Jun 20 12:14:24.566173 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1942/3793] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:24 2022] GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:24.572679 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ddf9fd21-edc7-4377-b5f5-211cf380d82e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:24.574177 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ddf9fd21-edc7-4377-b5f5-211cf380d82e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:24.586001 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ddf9fd21-edc7-4377-b5f5-211cf380d82e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:24.586835 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ddf9fd21-edc7-4377-b5f5-211cf380d82e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:24.588007 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ddf9fd21-edc7-4377-b5f5-211cf380d82e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:24.589547 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ddf9fd21-edc7-4377-b5f5-211cf380d82e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:24.616840 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:24.894442 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ddf9fd21-edc7-4377-b5f5-211cf380d82e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:24.906639 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ddf9fd21-edc7-4377-b5f5-211cf380d82e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:24.908967 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ddf9fd21-edc7-4377-b5f5-211cf380d82e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:24.910449 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ddf9fd21-edc7-4377-b5f5-211cf380d82e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 2931 microversion: 2.32 time: 0.342660 Jun 20 12:14:24.911263 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1943/3794] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:24 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 2931 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:24.934806 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0a4f6c52-0cab-4e73-9c9c-314533e16ab1 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:24.951308 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0a4f6c52-0cab-4e73-9c9c-314533e16ab1 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:24.955703 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0a4f6c52-0cab-4e73-9c9c-314533e16ab1 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:24.957275 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0a4f6c52-0cab-4e73-9c9c-314533e16ab1 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1362 microversion: 2.47 time: 0.503059 Jun 20 12:14:24.958158 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1852/3795] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:24 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1362 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:25.240038 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-344e438c-3027-44ab-9a1d-85597e84f1fb tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:25.243506 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-344e438c-3027-44ab-9a1d-85597e84f1fb tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:25.271158 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-344e438c-3027-44ab-9a1d-85597e84f1fb tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:25.271376 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-344e438c-3027-44ab-9a1d-85597e84f1fb tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:25.278373 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-344e438c-3027-44ab-9a1d-85597e84f1fb tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:25.278373 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-344e438c-3027-44ab-9a1d-85597e84f1fb tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:25.466109 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-135e0f92-d94c-425e-b70a-3b110804770d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:25.467768 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-135e0f92-d94c-425e-b70a-3b110804770d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:25.493662 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-135e0f92-d94c-425e-b70a-3b110804770d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:25.497107 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-135e0f92-d94c-425e-b70a-3b110804770d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:25.498186 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-135e0f92-d94c-425e-b70a-3b110804770d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:25.499081 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-135e0f92-d94c-425e-b70a-3b110804770d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:25.723336 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-344e438c-3027-44ab-9a1d-85597e84f1fb tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:25.732784 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-344e438c-3027-44ab-9a1d-85597e84f1fb tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1478 microversion: 2.1 time: 0.503224 Jun 20 12:14:25.744966 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1944/3796] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:25 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1478 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:25.750329 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4cebc27a-2d5e-4a7d-a120-e1505b1124de tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:25.751779 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4cebc27a-2d5e-4a7d-a120-e1505b1124de tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: a48784f9-f5d9-4379-b2ce-ba044db399cf] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:25.760392 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4cebc27a-2d5e-4a7d-a120-e1505b1124de tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:25.760392 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4cebc27a-2d5e-4a7d-a120-e1505b1124de tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:25.762467 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4cebc27a-2d5e-4a7d-a120-e1505b1124de tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:25.763031 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4cebc27a-2d5e-4a7d-a120-e1505b1124de tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:26.106232 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-135e0f92-d94c-425e-b70a-3b110804770d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:26.119423 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-135e0f92-d94c-425e-b70a-3b110804770d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:26.128612 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-135e0f92-d94c-425e-b70a-3b110804770d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:26.130131 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-135e0f92-d94c-425e-b70a-3b110804770d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1724 microversion: 2.20 time: 0.676466 Jun 20 12:14:26.131308 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1853/3797] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:25 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1724 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:14:26.136594 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-9a0ea1cd-789a-483c-b56f-2649d44fbef3 req-ca6e7024-6476-43c0-ad8f-371e8b60a852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36218945-42bd-45a4-889b-b411acdd4155", "name": "network-vif-unplugged", "status": "completed", "tag": "85f1809d-90f7-4c54-9391-f68911c003bb"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:26.146510 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9a0ea1cd-789a-483c-b56f-2649d44fbef3 req-ca6e7024-6476-43c0-ad8f-371e8b60a852 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:26.147151 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9a0ea1cd-789a-483c-b56f-2649d44fbef3 req-ca6e7024-6476-43c0-ad8f-371e8b60a852 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:26.160721 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-9a0ea1cd-789a-483c-b56f-2649d44fbef3 req-ca6e7024-6476-43c0-ad8f-371e8b60a852 service nova] Creating event network-vif-unplugged:85f1809d-90f7-4c54-9391-f68911c003bb for instance 36218945-42bd-45a4-889b-b411acdd4155 on n-h1-master-1 Jun 20 12:14:26.167560 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-9a0ea1cd-789a-483c-b56f-2649d44fbef3 req-ca6e7024-6476-43c0-ad8f-371e8b60a852 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034581 Jun 20 12:14:26.173536 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1854/3798] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:14:26.179082 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-82956a24-c075-48a7-9cd6-79a72ffb6dcc tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:26.180113 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-82956a24-c075-48a7-9cd6-79a72ffb6dcc tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:26.188437 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-82956a24-c075-48a7-9cd6-79a72ffb6dcc tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:26.188895 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-82956a24-c075-48a7-9cd6-79a72ffb6dcc tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:26.189737 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-82956a24-c075-48a7-9cd6-79a72ffb6dcc tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:26.190182 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-82956a24-c075-48a7-9cd6-79a72ffb6dcc tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:26.233257 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4cebc27a-2d5e-4a7d-a120-e1505b1124de tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:26.245834 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4cebc27a-2d5e-4a7d-a120-e1505b1124de tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf" status: 200 len: 1315 microversion: 2.1 time: 0.499730 Jun 20 12:14:26.246890 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1945/3799] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:25 2022] GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf => generated 1315 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:26.255607 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-061f9d1d-aa58-4311-89f0-fbf8b2f6218a tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:26.257150 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-061f9d1d-aa58-4311-89f0-fbf8b2f6218a tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:26.274272 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-061f9d1d-aa58-4311-89f0-fbf8b2f6218a tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:26.274980 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-061f9d1d-aa58-4311-89f0-fbf8b2f6218a tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:26.276077 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-061f9d1d-aa58-4311-89f0-fbf8b2f6218a tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:26.277417 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-061f9d1d-aa58-4311-89f0-fbf8b2f6218a tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:26.431345 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-061f9d1d-aa58-4311-89f0-fbf8b2f6218a tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:26.440143 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-061f9d1d-aa58-4311-89f0-fbf8b2f6218a tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:26.441902 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-061f9d1d-aa58-4311-89f0-fbf8b2f6218a tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:26.443372 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-061f9d1d-aa58-4311-89f0-fbf8b2f6218a tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1362 microversion: 2.47 time: 0.195424 Jun 20 12:14:26.456304 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1946/3800] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:26 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:26.562605 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-82956a24-c075-48a7-9cd6-79a72ffb6dcc tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:26.564940 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:26.573844 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-82956a24-c075-48a7-9cd6-79a72ffb6dcc tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:26.575925 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-82956a24-c075-48a7-9cd6-79a72ffb6dcc tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:26.577506 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-82956a24-c075-48a7-9cd6-79a72ffb6dcc tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 2910 microversion: 2.32 time: 0.402707 Jun 20 12:14:26.578323 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1855/3801] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:26 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 2910 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:26.751598 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-610eaede-bde1-4138-8517-e4f3709cdcf0 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:26.752313 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-610eaede-bde1-4138-8517-e4f3709cdcf0 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:26.774485 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-610eaede-bde1-4138-8517-e4f3709cdcf0 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:26.774950 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-610eaede-bde1-4138-8517-e4f3709cdcf0 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:26.776020 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-610eaede-bde1-4138-8517-e4f3709cdcf0 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:26.776544 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-610eaede-bde1-4138-8517-e4f3709cdcf0 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:27.151089 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f3855a49-c8dd-4163-8572-f8cdfce7fd35 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:27.151889 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f3855a49-c8dd-4163-8572-f8cdfce7fd35 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:27.160510 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f3855a49-c8dd-4163-8572-f8cdfce7fd35 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:27.161132 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f3855a49-c8dd-4163-8572-f8cdfce7fd35 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:27.163213 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f3855a49-c8dd-4163-8572-f8cdfce7fd35 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:27.163213 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f3855a49-c8dd-4163-8572-f8cdfce7fd35 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:27.363440 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-610eaede-bde1-4138-8517-e4f3709cdcf0 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:27.378308 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-610eaede-bde1-4138-8517-e4f3709cdcf0 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1478 microversion: 2.1 time: 0.631341 Jun 20 12:14:27.379206 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1947/3802] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:26 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1478 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:27.384243 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5fbcd272-21bc-4f74-b1e8-336841e64e8c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:27.401321 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5fbcd272-21bc-4f74-b1e8-336841e64e8c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: a48784f9-f5d9-4379-b2ce-ba044db399cf] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:27.408248 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5fbcd272-21bc-4f74-b1e8-336841e64e8c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:27.408749 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5fbcd272-21bc-4f74-b1e8-336841e64e8c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:27.409542 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5fbcd272-21bc-4f74-b1e8-336841e64e8c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:27.409983 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5fbcd272-21bc-4f74-b1e8-336841e64e8c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:27.676072 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f3855a49-c8dd-4163-8572-f8cdfce7fd35 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:27.689429 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f3855a49-c8dd-4163-8572-f8cdfce7fd35 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:27.690949 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f3855a49-c8dd-4163-8572-f8cdfce7fd35 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:27.694324 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f3855a49-c8dd-4163-8572-f8cdfce7fd35 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1724 microversion: 2.20 time: 0.549417 Jun 20 12:14:27.701710 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1856/3803] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:27 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1724 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:14:27.706923 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-410e0f18-f0c6-4378-9afa-038598d6e1a0 req-2cefef60-8421-4725-b793-71c34d16ce08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36218945-42bd-45a4-889b-b411acdd4155", "name": "network-vif-deleted", "tag": "c92e56c8-a1a7-41dc-b4c8-8b2e57dae74e"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:27.728353 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-410e0f18-f0c6-4378-9afa-038598d6e1a0 req-2cefef60-8421-4725-b793-71c34d16ce08 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:27.729112 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-410e0f18-f0c6-4378-9afa-038598d6e1a0 req-2cefef60-8421-4725-b793-71c34d16ce08 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:27.732809 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5fbcd272-21bc-4f74-b1e8-336841e64e8c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:27.744514 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5fbcd272-21bc-4f74-b1e8-336841e64e8c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf" status: 200 len: 1315 microversion: 2.1 time: 0.364005 Jun 20 12:14:27.749104 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1948/3804] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:27 2022] GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:27.766150 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3378a475-2bd2-4200-868c-ee0261d04e1f tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:27.775617 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3378a475-2bd2-4200-868c-ee0261d04e1f tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:27.782332 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-410e0f18-f0c6-4378-9afa-038598d6e1a0 req-2cefef60-8421-4725-b793-71c34d16ce08 service nova] Creating event network-vif-deleted:c92e56c8-a1a7-41dc-b4c8-8b2e57dae74e for instance 36218945-42bd-45a4-889b-b411acdd4155 on n-h1-master-1 Jun 20 12:14:27.795442 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3378a475-2bd2-4200-868c-ee0261d04e1f tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:27.799581 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3378a475-2bd2-4200-868c-ee0261d04e1f tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:27.800718 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3378a475-2bd2-4200-868c-ee0261d04e1f tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:27.802439 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-410e0f18-f0c6-4378-9afa-038598d6e1a0 req-2cefef60-8421-4725-b793-71c34d16ce08 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099220 Jun 20 12:14:27.803591 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3378a475-2bd2-4200-868c-ee0261d04e1f tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:27.806519 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1857/3805] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:14:27.826015 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-51120aa7-f204-4bd5-abe5-d0b255f585cb tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:27.833152 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-51120aa7-f204-4bd5-abe5-d0b255f585cb tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:27.846366 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-51120aa7-f204-4bd5-abe5-d0b255f585cb tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:27.847177 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-51120aa7-f204-4bd5-abe5-d0b255f585cb tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:27.848317 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-51120aa7-f204-4bd5-abe5-d0b255f585cb tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:27.849115 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-51120aa7-f204-4bd5-abe5-d0b255f585cb tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:27.951834 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3378a475-2bd2-4200-868c-ee0261d04e1f tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:27.960634 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3378a475-2bd2-4200-868c-ee0261d04e1f tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:27.962548 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3378a475-2bd2-4200-868c-ee0261d04e1f tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:27.963988 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3378a475-2bd2-4200-868c-ee0261d04e1f tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1362 microversion: 2.47 time: 0.213578 Jun 20 12:14:27.965263 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1949/3806] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:27 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:28.338218 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-54eca857-7f62-4b5d-a833-08ea5b7f3b60 req-4372ba02-3668-43c4-af5b-46f5ba7401c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36218945-42bd-45a4-889b-b411acdd4155", "name": "network-vif-unplugged", "status": "completed", "tag": "e18c6fa7-dd45-494c-a0a7-a1e50521794b"}, {"server_uuid": "36218945-42bd-45a4-889b-b411acdd4155", "name": "network-vif-unplugged", "status": "completed", "tag": "9df2cf8c-5928-405e-ac7c-65c330f2acbf"}, {"server_uuid": "36218945-42bd-45a4-889b-b411acdd4155", "name": "network-vif-unplugged", "status": "completed", "tag": "a3f0416b-e069-41e8-9db8-7e848d1875ab"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:28.353149 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-54eca857-7f62-4b5d-a833-08ea5b7f3b60 req-4372ba02-3668-43c4-af5b-46f5ba7401c5 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:28.353753 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-54eca857-7f62-4b5d-a833-08ea5b7f3b60 req-4372ba02-3668-43c4-af5b-46f5ba7401c5 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:28.366810 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-54eca857-7f62-4b5d-a833-08ea5b7f3b60 req-4372ba02-3668-43c4-af5b-46f5ba7401c5 service nova] Creating event network-vif-unplugged:e18c6fa7-dd45-494c-a0a7-a1e50521794b for instance 36218945-42bd-45a4-889b-b411acdd4155 on n-h1-master-1 Jun 20 12:14:28.368234 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-54eca857-7f62-4b5d-a833-08ea5b7f3b60 req-4372ba02-3668-43c4-af5b-46f5ba7401c5 service nova] Creating event network-vif-unplugged:9df2cf8c-5928-405e-ac7c-65c330f2acbf for instance 36218945-42bd-45a4-889b-b411acdd4155 on n-h1-master-1 Jun 20 12:14:28.368975 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-54eca857-7f62-4b5d-a833-08ea5b7f3b60 req-4372ba02-3668-43c4-af5b-46f5ba7401c5 service nova] Creating event network-vif-unplugged:a3f0416b-e069-41e8-9db8-7e848d1875ab for instance 36218945-42bd-45a4-889b-b411acdd4155 on n-h1-master-1 Jun 20 12:14:28.375653 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-54eca857-7f62-4b5d-a833-08ea5b7f3b60 req-4372ba02-3668-43c4-af5b-46f5ba7401c5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.041078 Jun 20 12:14:28.382105 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1950/3807] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:14:28.398190 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b4788f9e-21aa-4563-8014-43b7ef921220 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:28.399459 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b4788f9e-21aa-4563-8014-43b7ef921220 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:28.407548 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b4788f9e-21aa-4563-8014-43b7ef921220 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:28.408462 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b4788f9e-21aa-4563-8014-43b7ef921220 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:28.409709 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b4788f9e-21aa-4563-8014-43b7ef921220 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:28.410385 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b4788f9e-21aa-4563-8014-43b7ef921220 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:28.542455 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-51120aa7-f204-4bd5-abe5-d0b255f585cb tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:28.571239 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-51120aa7-f204-4bd5-abe5-d0b255f585cb tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:28.579386 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-51120aa7-f204-4bd5-abe5-d0b255f585cb tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:28.580738 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-51120aa7-f204-4bd5-abe5-d0b255f585cb tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 2750 microversion: 2.32 time: 0.768131 Jun 20 12:14:28.581308 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1858/3808] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:27 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 2750 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:28.721967 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5adf2293-e844-4126-86ae-59b213c08ee4 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:28.723322 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5adf2293-e844-4126-86ae-59b213c08ee4 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:28.732603 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5adf2293-e844-4126-86ae-59b213c08ee4 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:28.733516 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5adf2293-e844-4126-86ae-59b213c08ee4 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:28.734725 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5adf2293-e844-4126-86ae-59b213c08ee4 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:28.735560 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5adf2293-e844-4126-86ae-59b213c08ee4 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:28.911123 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b4788f9e-21aa-4563-8014-43b7ef921220 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:28.922350 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b4788f9e-21aa-4563-8014-43b7ef921220 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1478 microversion: 2.1 time: 0.528970 Jun 20 12:14:28.933809 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1951/3809] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:28 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1478 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:14:28.939033 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a4f44f39-1b98-4176-8414-62b051776275 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:28.940007 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a4f44f39-1b98-4176-8414-62b051776275 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: a48784f9-f5d9-4379-b2ce-ba044db399cf] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:28.946705 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a4f44f39-1b98-4176-8414-62b051776275 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:28.947299 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a4f44f39-1b98-4176-8414-62b051776275 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:28.948191 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a4f44f39-1b98-4176-8414-62b051776275 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:28.948849 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a4f44f39-1b98-4176-8414-62b051776275 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:29.056397 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5adf2293-e844-4126-86ae-59b213c08ee4 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:29.065724 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5adf2293-e844-4126-86ae-59b213c08ee4 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:29.067414 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5adf2293-e844-4126-86ae-59b213c08ee4 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:29.068761 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5adf2293-e844-4126-86ae-59b213c08ee4 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1724 microversion: 2.20 time: 0.353407 Jun 20 12:14:29.079356 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1859/3810] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:28 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1724 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:14:29.086075 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c292f5f3-4d24-4813-8653-50df161c2aac tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:29.087508 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c292f5f3-4d24-4813-8653-50df161c2aac tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:29.097034 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c292f5f3-4d24-4813-8653-50df161c2aac tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:29.098011 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c292f5f3-4d24-4813-8653-50df161c2aac tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:29.099883 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c292f5f3-4d24-4813-8653-50df161c2aac tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:29.100829 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c292f5f3-4d24-4813-8653-50df161c2aac tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:29.192649 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c292f5f3-4d24-4813-8653-50df161c2aac tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:29.193256 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c292f5f3-4d24-4813-8653-50df161c2aac tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:29.195346 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-c292f5f3-4d24-4813-8653-50df161c2aac tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lazy-loading 'fault' on Instance uuid 41757e12-95d7-433f-8a5d-f56cc547b1cd {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:14:29.344580 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c292f5f3-4d24-4813-8653-50df161c2aac tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:29.357992 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c292f5f3-4d24-4813-8653-50df161c2aac tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:29.360006 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c292f5f3-4d24-4813-8653-50df161c2aac tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:29.369898 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c292f5f3-4d24-4813-8653-50df161c2aac tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 200 len: 1367 microversion: 2.47 time: 0.288995 Jun 20 12:14:29.370594 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1860/3811] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:29 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 1367 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:29.423086 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a4f44f39-1b98-4176-8414-62b051776275 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:29.432037 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a4f44f39-1b98-4176-8414-62b051776275 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf" status: 200 len: 1315 microversion: 2.1 time: 0.496872 Jun 20 12:14:29.433228 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1952/3812] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:28 2022] GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf => generated 1315 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:29.601614 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-05d65d4c-d88f-4f0d-88ca-12fb2694f4f7 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:29.602171 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-05d65d4c-d88f-4f0d-88ca-12fb2694f4f7 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:29.608646 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05d65d4c-d88f-4f0d-88ca-12fb2694f4f7 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:29.609369 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05d65d4c-d88f-4f0d-88ca-12fb2694f4f7 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:29.610311 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05d65d4c-d88f-4f0d-88ca-12fb2694f4f7 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:29.610910 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05d65d4c-d88f-4f0d-88ca-12fb2694f4f7 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:29.893240 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-05d65d4c-d88f-4f0d-88ca-12fb2694f4f7 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:29.911306 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-05d65d4c-d88f-4f0d-88ca-12fb2694f4f7 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:29.913658 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-05d65d4c-d88f-4f0d-88ca-12fb2694f4f7 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:29.914961 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-05d65d4c-d88f-4f0d-88ca-12fb2694f4f7 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 2658 microversion: 2.32 time: 0.317344 Jun 20 12:14:29.917517 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1861/3813] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:29 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 2658 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:29.953715 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dbcb792a-0db9-4de1-b092-bbc48531b290 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:29.954532 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dbcb792a-0db9-4de1-b092-bbc48531b290 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:29.967895 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dbcb792a-0db9-4de1-b092-bbc48531b290 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:29.969336 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dbcb792a-0db9-4de1-b092-bbc48531b290 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:29.972353 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dbcb792a-0db9-4de1-b092-bbc48531b290 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:29.972952 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dbcb792a-0db9-4de1-b092-bbc48531b290 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:29.979196 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-17582570-1c48-491b-bff0-f9ce4eab6e76 req-03242ca6-2c45-4404-9bab-fdc4a06c0d8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36218945-42bd-45a4-889b-b411acdd4155", "name": "network-vif-deleted", "tag": "85f1809d-90f7-4c54-9391-f68911c003bb"}, {"server_uuid": "36218945-42bd-45a4-889b-b411acdd4155", "name": "network-vif-deleted", "tag": "9df2cf8c-5928-405e-ac7c-65c330f2acbf"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:30.005181 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-17582570-1c48-491b-bff0-f9ce4eab6e76 req-03242ca6-2c45-4404-9bab-fdc4a06c0d8a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:30.005628 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-17582570-1c48-491b-bff0-f9ce4eab6e76 req-03242ca6-2c45-4404-9bab-fdc4a06c0d8a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:30.041872 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-17582570-1c48-491b-bff0-f9ce4eab6e76 req-03242ca6-2c45-4404-9bab-fdc4a06c0d8a service nova] Creating event network-vif-deleted:85f1809d-90f7-4c54-9391-f68911c003bb for instance 36218945-42bd-45a4-889b-b411acdd4155 on n-h1-master-1 Jun 20 12:14:30.043125 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-17582570-1c48-491b-bff0-f9ce4eab6e76 req-03242ca6-2c45-4404-9bab-fdc4a06c0d8a service nova] Creating event network-vif-deleted:9df2cf8c-5928-405e-ac7c-65c330f2acbf for instance 36218945-42bd-45a4-889b-b411acdd4155 on n-h1-master-1 Jun 20 12:14:30.052523 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-17582570-1c48-491b-bff0-f9ce4eab6e76 req-03242ca6-2c45-4404-9bab-fdc4a06c0d8a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.077621 Jun 20 12:14:30.056816 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1862/3814] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:14:30.089706 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8877379b-d97c-4e65-9c58-013c8e81c939 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:30.094289 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8877379b-d97c-4e65-9c58-013c8e81c939 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:30.122967 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8877379b-d97c-4e65-9c58-013c8e81c939 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:30.126303 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8877379b-d97c-4e65-9c58-013c8e81c939 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:30.130133 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8877379b-d97c-4e65-9c58-013c8e81c939 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:30.130681 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8877379b-d97c-4e65-9c58-013c8e81c939 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:30.387193 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dbcb792a-0db9-4de1-b092-bbc48531b290 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:30.399152 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dbcb792a-0db9-4de1-b092-bbc48531b290 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1463 microversion: 2.1 time: 0.460575 Jun 20 12:14:30.402801 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1953/3815] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:29 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1463 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:30.408150 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b6eb3d8c-60e4-4210-92f4-f9f40bafff48 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:30.409246 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b6eb3d8c-60e4-4210-92f4-f9f40bafff48 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: 41757e12-95d7-433f-8a5d-f56cc547b1cd] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:30.426496 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b6eb3d8c-60e4-4210-92f4-f9f40bafff48 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:30.427804 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b6eb3d8c-60e4-4210-92f4-f9f40bafff48 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:30.428817 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b6eb3d8c-60e4-4210-92f4-f9f40bafff48 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:30.429585 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b6eb3d8c-60e4-4210-92f4-f9f40bafff48 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:30.468618 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-b6eb3d8c-60e4-4210-92f4-f9f40bafff48 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] HTTP exception thrown: Instance 41757e12-95d7-433f-8a5d-f56cc547b1cd could not be found. Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b6eb3d8c-60e4-4210-92f4-f9f40bafff48 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Request method failure captured: Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd HTTP/1.1 Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGRoNW9yEtmmiVmNOAHZh1QzKg6_qMVUJVIt_lNNE4Yt5qUoZym7Vfqf1o2jOhTereNILUIJJ32Y5p9OSBWL7ISLMlPoMJQqr0MPYzpgcue2wGboRjGyrwJ_u0MpFrcyUcL62U6LaUC3d-S1jI65faj6FqhBpA7zT7YMlskbzeVDuKU Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: X-Openstack-Nova-Api-Version: 2.47 Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 1bff15252e5e43a7ad7fa9b7ff18e3ec Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServerShowV247Test-1950328883 Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1bff15252e5e43a7ad7fa9b7ff18e3ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1bff15252e5e43a7ad7fa9b7ff18e3ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1bff15252e5e43a7ad7fa9b7ff18e3ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1bff15252e5e43a7ad7fa9b7ff18e3ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServerShowV247Test-1950328883 Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 1bff15252e5e43a7ad7fa9b7ff18e3ec Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServerShowV247Test-1950328883 Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServerShowV247Test-1950328883-project Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 471c796d72d1484085c542aa2518f6ac Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServerShowV247Test-1950328883-project Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 41757e12-95d7-433f-8a5d-f56cc547b1cd could not be found. Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '41757e12-95d7-433f-8a5d-f56cc547b1cd'} Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41757e12-95d7-433f-8a5d-f56cc547b1cd could not be found. Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41757e12-95d7-433f-8a5d-f56cc547b1cd could not be found. Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:14:30.471573 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:30.477917 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:30.477917 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:14:30.477917 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:14:30.477917 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:14:30.477917 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:14:30.477917 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41757e12-95d7-433f-8a5d-f56cc547b1cd could not be found. Jun 20 12:14:30.477917 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:30.477917 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b6eb3d8c-60e4-4210-92f4-f9f40bafff48 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Returning 404 to user: Instance 41757e12-95d7-433f-8a5d-f56cc547b1cd could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:14:30.477917 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b6eb3d8c-60e4-4210-92f4-f9f40bafff48 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd" status: 404 len: 111 microversion: 2.47 time: 0.068981 Jun 20 12:14:30.484926 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1954/3816] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:30 2022] GET /compute/v2.1/servers/41757e12-95d7-433f-8a5d-f56cc547b1cd => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:14:30.489939 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-c1804683-1bef-4201-84dc-9610f4b7bb1e req-73a45d54-5c5c-4f77-9e28-401af5ac0071 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a48784f9-f5d9-4379-b2ce-ba044db399cf", "name": "network-vif-plugged", "status": "completed", "tag": "e38fa345-839c-4384-9b05-edcedcb38cb6"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:30.506443 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-c1804683-1bef-4201-84dc-9610f4b7bb1e req-73a45d54-5c5c-4f77-9e28-401af5ac0071 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:30.507275 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-c1804683-1bef-4201-84dc-9610f4b7bb1e req-73a45d54-5c5c-4f77-9e28-401af5ac0071 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:30.522719 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-c1804683-1bef-4201-84dc-9610f4b7bb1e req-73a45d54-5c5c-4f77-9e28-401af5ac0071 service nova] Creating event network-vif-plugged:e38fa345-839c-4384-9b05-edcedcb38cb6 for instance a48784f9-f5d9-4379-b2ce-ba044db399cf on n-h1-master-1 Jun 20 12:14:30.529303 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-c1804683-1bef-4201-84dc-9610f4b7bb1e req-73a45d54-5c5c-4f77-9e28-401af5ac0071 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042755 Jun 20 12:14:30.531231 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1955/3817] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:14:30.550190 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2889d909-2579-4de6-babb-3cd1c18177a0 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:30.568573 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2889d909-2579-4de6-babb-3cd1c18177a0 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:30.591003 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2889d909-2579-4de6-babb-3cd1c18177a0 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:30.591460 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2889d909-2579-4de6-babb-3cd1c18177a0 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:30.592278 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2889d909-2579-4de6-babb-3cd1c18177a0 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:30.592720 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2889d909-2579-4de6-babb-3cd1c18177a0 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:30.657098 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8877379b-d97c-4e65-9c58-013c8e81c939 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:30.675435 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8877379b-d97c-4e65-9c58-013c8e81c939 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:30.676978 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8877379b-d97c-4e65-9c58-013c8e81c939 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:30.678171 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8877379b-d97c-4e65-9c58-013c8e81c939 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1724 microversion: 2.20 time: 0.594873 Jun 20 12:14:30.679596 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1863/3818] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:30 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1724 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:14:30.693663 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-52e38881-962c-4b9a-8df3-f0ed05b64dbe tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:30.694686 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-52e38881-962c-4b9a-8df3-f0ed05b64dbe tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: a48784f9-f5d9-4379-b2ce-ba044db399cf] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:30.701740 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-52e38881-962c-4b9a-8df3-f0ed05b64dbe tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:30.708910 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-52e38881-962c-4b9a-8df3-f0ed05b64dbe tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:30.710051 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-52e38881-962c-4b9a-8df3-f0ed05b64dbe tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:30.710686 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-52e38881-962c-4b9a-8df3-f0ed05b64dbe tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:30.786847 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2889d909-2579-4de6-babb-3cd1c18177a0 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2/action" status: 202 len: 0 microversion: 2.1 time: 0.253328 Jun 20 12:14:30.787717 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1956/3819] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:14:30 2022] POST /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:14:30.794848 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3c31f139-36a0-41b6-9e14-b3ac1ac55b91 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:30.796643 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3c31f139-36a0-41b6-9e14-b3ac1ac55b91 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: e2cbf353-b613-4a89-8864-0e5b2ae7c323] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:30.814662 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c31f139-36a0-41b6-9e14-b3ac1ac55b91 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:30.816229 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c31f139-36a0-41b6-9e14-b3ac1ac55b91 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:30.818167 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c31f139-36a0-41b6-9e14-b3ac1ac55b91 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:30.818878 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c31f139-36a0-41b6-9e14-b3ac1ac55b91 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:30.869161 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3c31f139-36a0-41b6-9e14-b3ac1ac55b91 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: e2cbf353-b613-4a89-8864-0e5b2ae7c323] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:14:31.061743 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3c31f139-36a0-41b6-9e14-b3ac1ac55b91 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e2cbf353-b613-4a89-8864-0e5b2ae7c323" status: 204 len: 0 microversion: 2.47 time: 0.272253 Jun 20 12:14:31.065416 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1957/3820] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Jun 20 12:14:30 2022] DELETE /compute/v2.1/servers/e2cbf353-b613-4a89-8864-0e5b2ae7c323 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 12:14:31.068843 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-610020c2-7183-40ef-8822-3e31537ddc48 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:31.069858 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-610020c2-7183-40ef-8822-3e31537ddc48 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:31.077176 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-610020c2-7183-40ef-8822-3e31537ddc48 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:31.077782 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-610020c2-7183-40ef-8822-3e31537ddc48 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:31.078687 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-610020c2-7183-40ef-8822-3e31537ddc48 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:31.079398 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-610020c2-7183-40ef-8822-3e31537ddc48 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:31.115830 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:31.121583 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-610020c2-7183-40ef-8822-3e31537ddc48 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:31.122440 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-610020c2-7183-40ef-8822-3e31537ddc48 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:31.123523 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-610020c2-7183-40ef-8822-3e31537ddc48 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lazy-loading 'fault' on Instance uuid d5b82c0b-6c6a-4d96-a8b2-437d242334f2 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:14:31.158347 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-52e38881-962c-4b9a-8df3-f0ed05b64dbe tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:31.167175 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-52e38881-962c-4b9a-8df3-f0ed05b64dbe tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf" status: 200 len: 1315 microversion: 2.1 time: 0.486061 Jun 20 12:14:31.173854 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1864/3821] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:30 2022] GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf => generated 1315 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:31.181940 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5dbfea06-ea3c-4bc3-8705-8f8228ecc51f tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:31.189571 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5dbfea06-ea3c-4bc3-8705-8f8228ecc51f tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:31.204721 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5dbfea06-ea3c-4bc3-8705-8f8228ecc51f tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:31.205583 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5dbfea06-ea3c-4bc3-8705-8f8228ecc51f tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:31.206637 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5dbfea06-ea3c-4bc3-8705-8f8228ecc51f tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:31.210120 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5dbfea06-ea3c-4bc3-8705-8f8228ecc51f tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:31.442410 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5dbfea06-ea3c-4bc3-8705-8f8228ecc51f tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:31.457371 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5dbfea06-ea3c-4bc3-8705-8f8228ecc51f tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:31.459860 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5dbfea06-ea3c-4bc3-8705-8f8228ecc51f tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:31.461952 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5dbfea06-ea3c-4bc3-8705-8f8228ecc51f tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 2340 microversion: 2.32 time: 0.286834 Jun 20 12:14:31.473439 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1865/3822] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:31 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 2340 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:31.481269 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8ae63c4e-b91b-45a5-8883-e1bd74cf8726 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:31.482037 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8ae63c4e-b91b-45a5-8883-e1bd74cf8726 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: e2cbf353-b613-4a89-8864-0e5b2ae7c323] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:31.488606 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ae63c4e-b91b-45a5-8883-e1bd74cf8726 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:31.489453 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ae63c4e-b91b-45a5-8883-e1bd74cf8726 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:31.490464 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ae63c4e-b91b-45a5-8883-e1bd74cf8726 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:31.491394 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ae63c4e-b91b-45a5-8883-e1bd74cf8726 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:31.539572 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:31.559564 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-610020c2-7183-40ef-8822-3e31537ddc48 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1597 microversion: 2.1 time: 0.495328 Jun 20 12:14:31.562607 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1958/3823] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:31 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1597 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:31.594153 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8ae63c4e-b91b-45a5-8883-e1bd74cf8726 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:31.607789 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8ae63c4e-b91b-45a5-8883-e1bd74cf8726 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:31.610214 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8ae63c4e-b91b-45a5-8883-e1bd74cf8726 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:31.611476 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8ae63c4e-b91b-45a5-8883-e1bd74cf8726 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/e2cbf353-b613-4a89-8864-0e5b2ae7c323" status: 200 len: 1363 microversion: 2.47 time: 0.134183 Jun 20 12:14:31.623461 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1866/3824] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:31 2022] GET /compute/v2.1/servers/e2cbf353-b613-4a89-8864-0e5b2ae7c323 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:31.629043 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0d0cfbef-d16f-4ff4-8055-0c6d85f932c6 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:31.630127 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0d0cfbef-d16f-4ff4-8055-0c6d85f932c6 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:31.637736 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d0cfbef-d16f-4ff4-8055-0c6d85f932c6 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:31.638672 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d0cfbef-d16f-4ff4-8055-0c6d85f932c6 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:31.639700 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d0cfbef-d16f-4ff4-8055-0c6d85f932c6 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:31.640390 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d0cfbef-d16f-4ff4-8055-0c6d85f932c6 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:31.723665 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d66ef641-e3d3-473f-89d0-071923fdd74a tempest-ListImageFiltersNegativeTestJSON-421916569 tempest-ListImageFiltersNegativeTestJSON-421916569-project] Calling method '.version_select at 0x7f6072d0ee50>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:31.755103 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0d0cfbef-d16f-4ff4-8055-0c6d85f932c6 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2/action" status: 202 len: 0 microversion: 2.1 time: 0.129969 Jun 20 12:14:31.760902 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-d66ef641-e3d3-473f-89d0-071923fdd74a tempest-ListImageFiltersNegativeTestJSON-421916569 tempest-ListImageFiltersNegativeTestJSON-421916569-project] HTTP exception thrown: Image not found. Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d66ef641-e3d3-473f-89d0-071923fdd74a tempest-ListImageFiltersNegativeTestJSON-421916569 tempest-ListImageFiltersNegativeTestJSON-421916569-project] Request method failure captured: Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/images/19e52de9-88c9-47ef-84fe-e5fff17a5163 HTTP/1.1 Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGSniyuBENAZgGjLV7RKIBAu5lJR5VG7vO00oc0q2jHk9Q-8ZTuPAY2NuLvxyqifFGZxJSWw-xtKZW35poXfedRL2hEzDf8pR_YA2dK7ujt8yd4Pj55Tv1pjFeCniOpIlGBwsnBnesT4as7-jZOJ3w84kNfZGaZzz4t1mGRww0Ye_oI Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 48ef2f4190c24f068068fc72192a1599 Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-421916569 Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/48ef2f4190c24f068068fc72192a1599"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/48ef2f4190c24f068068fc72192a1599"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/48ef2f4190c24f068068fc72192a1599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_48ef2f4190c24f068068fc72192a1599"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-421916569 Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 48ef2f4190c24f068068fc72192a1599 Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-421916569 Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ListImageFiltersNegativeTestJSON-421916569-project Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 4d00cc61942140659eab796dc1c82c46 Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-421916569-project Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: exception: Image not found. Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '19e52de9-88c9-47ef-84fe-e5fff17a5163'} Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 19e52de9-88c9-47ef-84fe-e5fff17a5163 Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 20 12:14:31.763385 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 19e52de9-88c9-47ef-84fe-e5fff17a5163 could not be found. Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d66ef641-e3d3-473f-89d0-071923fdd74a tempest-ListImageFiltersNegativeTestJSON-421916569 tempest-ListImageFiltersNegativeTestJSON-421916569-project] Returning 404 to user: Image not found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d66ef641-e3d3-473f-89d0-071923fdd74a tempest-ListImageFiltersNegativeTestJSON-421916569 tempest-ListImageFiltersNegativeTestJSON-421916569-project] 10.222.0.27 "GET /compute/v2.1/images/19e52de9-88c9-47ef-84fe-e5fff17a5163" status: 404 len: 62 microversion: 2.1 time: 0.200792 Jun 20 12:14:31.775459 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1959/3825] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jun 20 12:14:31 2022] GET /compute/v2.1/images/19e52de9-88c9-47ef-84fe-e5fff17a5163 => generated 62 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:14:31.784288 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1867/3826] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:14:31 2022] POST /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:14:31.792195 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1c3c4f99-fe8d-4d3a-ab4f-fa9da539758e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:31.793418 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9d4eb2e0-f838-4e42-a6e8-9cec5c3bc910 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:31.793563 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9d4eb2e0-f838-4e42-a6e8-9cec5c3bc910 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:31.797452 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1c3c4f99-fe8d-4d3a-ab4f-fa9da539758e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:31.806846 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c3c4f99-fe8d-4d3a-ab4f-fa9da539758e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:31.807295 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c3c4f99-fe8d-4d3a-ab4f-fa9da539758e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:31.808177 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c3c4f99-fe8d-4d3a-ab4f-fa9da539758e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:31.809833 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d4eb2e0-f838-4e42-a6e8-9cec5c3bc910 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:31.810373 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d4eb2e0-f838-4e42-a6e8-9cec5c3bc910 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:31.810916 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d4eb2e0-f838-4e42-a6e8-9cec5c3bc910 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:31.811536 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d4eb2e0-f838-4e42-a6e8-9cec5c3bc910 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:31.816577 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c3c4f99-fe8d-4d3a-ab4f-fa9da539758e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:32.210510 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1c3c4f99-fe8d-4d3a-ab4f-fa9da539758e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:32.211702 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9d4eb2e0-f838-4e42-a6e8-9cec5c3bc910 tempest-ServersAdminTestJSON-1614095784 tempest-ServersAdminTestJSON-1614095784-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1614 microversion: 2.1 time: 0.441619 Jun 20 12:14:32.212579 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1868/3827] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:31 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1614 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:32.227268 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-2c935c06-559b-4b82-bd0f-b4d9399d9135 req-7688f987-5d35-4f07-9132-ace85a10e512 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36218945-42bd-45a4-889b-b411acdd4155", "name": "network-vif-deleted", "tag": "e18c6fa7-dd45-494c-a0a7-a1e50521794b"}, {"server_uuid": "36218945-42bd-45a4-889b-b411acdd4155", "name": "network-vif-deleted", "tag": "a3f0416b-e069-41e8-9db8-7e848d1875ab"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:32.231357 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1c3c4f99-fe8d-4d3a-ab4f-fa9da539758e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:32.232924 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1c3c4f99-fe8d-4d3a-ab4f-fa9da539758e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:32.234159 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1c3c4f99-fe8d-4d3a-ab4f-fa9da539758e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1724 microversion: 2.20 time: 0.467290 Jun 20 12:14:32.235037 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1960/3828] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:31 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1724 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:32.239590 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-177048fb-8f8b-4ea9-8943-6de95de4a02a tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:32.240210 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-177048fb-8f8b-4ea9-8943-6de95de4a02a tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: a48784f9-f5d9-4379-b2ce-ba044db399cf] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:32.259306 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-2c935c06-559b-4b82-bd0f-b4d9399d9135 req-7688f987-5d35-4f07-9132-ace85a10e512 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:32.260449 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-2c935c06-559b-4b82-bd0f-b4d9399d9135 req-7688f987-5d35-4f07-9132-ace85a10e512 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:32.277154 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-177048fb-8f8b-4ea9-8943-6de95de4a02a tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:32.277742 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-177048fb-8f8b-4ea9-8943-6de95de4a02a tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:32.279802 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-177048fb-8f8b-4ea9-8943-6de95de4a02a tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:32.281742 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-177048fb-8f8b-4ea9-8943-6de95de4a02a tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:32.289345 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-2c935c06-559b-4b82-bd0f-b4d9399d9135 req-7688f987-5d35-4f07-9132-ace85a10e512 service nova] Creating event network-vif-deleted:e18c6fa7-dd45-494c-a0a7-a1e50521794b for instance 36218945-42bd-45a4-889b-b411acdd4155 on n-h1-master-1 Jun 20 12:14:32.295095 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-2c935c06-559b-4b82-bd0f-b4d9399d9135 req-7688f987-5d35-4f07-9132-ace85a10e512 service nova] Creating event network-vif-deleted:a3f0416b-e069-41e8-9db8-7e848d1875ab for instance 36218945-42bd-45a4-889b-b411acdd4155 on n-h1-master-1 Jun 20 12:14:32.315035 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-2c935c06-559b-4b82-bd0f-b4d9399d9135 req-7688f987-5d35-4f07-9132-ace85a10e512 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.100529 Jun 20 12:14:32.318221 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1869/3829] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:14:32.335157 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5ea90a65-ddb1-4feb-8b56-fdef14f4e03c tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:32.342907 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5ea90a65-ddb1-4feb-8b56-fdef14f4e03c tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 2201b474-c2b7-4b6f-ba8c-b7b6ec3da862] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:32.367667 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5ea90a65-ddb1-4feb-8b56-fdef14f4e03c tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:32.369841 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5ea90a65-ddb1-4feb-8b56-fdef14f4e03c tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:32.371671 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5ea90a65-ddb1-4feb-8b56-fdef14f4e03c tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:32.372393 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5ea90a65-ddb1-4feb-8b56-fdef14f4e03c tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:32.472144 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5ea90a65-ddb1-4feb-8b56-fdef14f4e03c tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 2201b474-c2b7-4b6f-ba8c-b7b6ec3da862] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:14:32.648901 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:32.740134 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5ea90a65-ddb1-4feb-8b56-fdef14f4e03c tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2201b474-c2b7-4b6f-ba8c-b7b6ec3da862" status: 204 len: 0 microversion: 2.1 time: 0.416027 Jun 20 12:14:32.741596 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1870/3830] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:14:32 2022] DELETE /compute/v2.1/servers/2201b474-c2b7-4b6f-ba8c-b7b6ec3da862 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:14:32.756243 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3f784282-a988-4982-a0bf-c6346adeb629 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:32.757741 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3f784282-a988-4982-a0bf-c6346adeb629 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:32.769771 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3f784282-a988-4982-a0bf-c6346adeb629 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:32.772534 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3f784282-a988-4982-a0bf-c6346adeb629 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:32.773526 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3f784282-a988-4982-a0bf-c6346adeb629 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:32.774944 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3f784282-a988-4982-a0bf-c6346adeb629 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:32.846218 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-177048fb-8f8b-4ea9-8943-6de95de4a02a tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:32.855973 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-177048fb-8f8b-4ea9-8943-6de95de4a02a tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf" status: 200 len: 1503 microversion: 2.1 time: 0.619531 Jun 20 12:14:32.860341 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1961/3831] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:32 2022] GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf => generated 1503 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:32.868028 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-1ed743de-e309-4d80-a3bc-75c6eed80d06 req-e6be26a2-d321-4736-a571-b0417f1ab416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5b82c0b-6c6a-4d96-a8b2-437d242334f2", "name": "network-vif-plugged", "status": "completed", "tag": "37e16ff5-1455-4eef-bf70-355b74b7eff3"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:32.887010 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-1ed743de-e309-4d80-a3bc-75c6eed80d06 req-e6be26a2-d321-4736-a571-b0417f1ab416 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:32.889106 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-1ed743de-e309-4d80-a3bc-75c6eed80d06 req-e6be26a2-d321-4736-a571-b0417f1ab416 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:32.894984 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=4 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:32.907995 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-1ed743de-e309-4d80-a3bc-75c6eed80d06 req-e6be26a2-d321-4736-a571-b0417f1ab416 service nova] Creating event network-vif-plugged:37e16ff5-1455-4eef-bf70-355b74b7eff3 for instance d5b82c0b-6c6a-4d96-a8b2-437d242334f2 on n-h2-master-1 Jun 20 12:14:32.930091 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-1ed743de-e309-4d80-a3bc-75c6eed80d06 req-e6be26a2-d321-4736-a571-b0417f1ab416 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061512 Jun 20 12:14:32.931359 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1962/3832] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:14:32.937280 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b6713af8-38aa-4e19-81c4-4754a5ecb478 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:32.941016 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b6713af8-38aa-4e19-81c4-4754a5ecb478 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: e2cbf353-b613-4a89-8864-0e5b2ae7c323] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:32.955385 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b6713af8-38aa-4e19-81c4-4754a5ecb478 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:32.957713 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b6713af8-38aa-4e19-81c4-4754a5ecb478 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:32.960634 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b6713af8-38aa-4e19-81c4-4754a5ecb478 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:32.964885 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b6713af8-38aa-4e19-81c4-4754a5ecb478 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:32.971169 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3f784282-a988-4982-a0bf-c6346adeb629 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:32.981919 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3f784282-a988-4982-a0bf-c6346adeb629 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:32.992498 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3f784282-a988-4982-a0bf-c6346adeb629 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:32.997945 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3f784282-a988-4982-a0bf-c6346adeb629 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1605 microversion: 2.32 time: 0.254150 Jun 20 12:14:33.008577 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1871/3833] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:32 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1605 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:33.013541 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e0973147-b8b0-4564-a866-74bd783e092d tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:33.014136 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e0973147-b8b0-4564-a866-74bd783e092d tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 2201b474-c2b7-4b6f-ba8c-b7b6ec3da862] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:33.016218 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:33.040360 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e0973147-b8b0-4564-a866-74bd783e092d tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:33.040972 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e0973147-b8b0-4564-a866-74bd783e092d tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:33.041762 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e0973147-b8b0-4564-a866-74bd783e092d tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:33.042393 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e0973147-b8b0-4564-a866-74bd783e092d tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:33.125200 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:33.211283 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b6713af8-38aa-4e19-81c4-4754a5ecb478 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:33.223809 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b6713af8-38aa-4e19-81c4-4754a5ecb478 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:33.225358 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b6713af8-38aa-4e19-81c4-4754a5ecb478 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:33.229093 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b6713af8-38aa-4e19-81c4-4754a5ecb478 tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/e2cbf353-b613-4a89-8864-0e5b2ae7c323" status: 200 len: 1363 microversion: 2.47 time: 0.296375 Jun 20 12:14:33.229816 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1963/3834] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:32 2022] GET /compute/v2.1/servers/e2cbf353-b613-4a89-8864-0e5b2ae7c323 => generated 1363 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:33.239795 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1a68100d-f268-44a8-8518-287b34baf803 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-441359876"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:33.248561 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1a68100d-f268-44a8-8518-287b34baf803 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: a48784f9-f5d9-4379-b2ce-ba044db399cf] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:33.255022 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a68100d-f268-44a8-8518-287b34baf803 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:33.255753 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a68100d-f268-44a8-8518-287b34baf803 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:33.265069 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a68100d-f268-44a8-8518-287b34baf803 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:33.265773 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a68100d-f268-44a8-8518-287b34baf803 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:33.479253 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e0973147-b8b0-4564-a866-74bd783e092d tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:33.497132 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e0973147-b8b0-4564-a866-74bd783e092d tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/2201b474-c2b7-4b6f-ba8c-b7b6ec3da862" status: 200 len: 1469 microversion: 2.1 time: 0.487123 Jun 20 12:14:33.508094 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1872/3835] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:33 2022] GET /compute/v2.1/servers/2201b474-c2b7-4b6f-ba8c-b7b6ec3da862 => generated 1469 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:33.521209 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-da744cf3-46f7-4503-b31d-e8da82514ea3 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:33.521831 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-da744cf3-46f7-4503-b31d-e8da82514ea3 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:33.530307 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-da744cf3-46f7-4503-b31d-e8da82514ea3 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:33.531932 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-da744cf3-46f7-4503-b31d-e8da82514ea3 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:33.532825 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-da744cf3-46f7-4503-b31d-e8da82514ea3 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:33.533266 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-da744cf3-46f7-4503-b31d-e8da82514ea3 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:33.783890 n-d-master-1 devstack@n-api.service[119127]: INFO nova.network.security_group_api [None req-1a68100d-f268-44a8-8518-287b34baf803 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Adding security group 6758fb01-190a-4735-a508-abaf71742ac4 to port e38fa345-839c-4384-9b05-edcedcb38cb6 Jun 20 12:14:34.120392 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-da744cf3-46f7-4503-b31d-e8da82514ea3 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:34.133689 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-da744cf3-46f7-4503-b31d-e8da82514ea3 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:34.135540 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-da744cf3-46f7-4503-b31d-e8da82514ea3 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:34.138691 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-da744cf3-46f7-4503-b31d-e8da82514ea3 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1745 microversion: 2.20 time: 0.627213 Jun 20 12:14:34.142390 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1873/3836] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:33 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1745 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:34.147320 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f6313624-6b03-42fa-ab8f-2c527eccdd8e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:34.150316 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f6313624-6b03-42fa-ab8f-2c527eccdd8e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:34.167244 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6313624-6b03-42fa-ab8f-2c527eccdd8e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:34.168581 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6313624-6b03-42fa-ab8f-2c527eccdd8e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:34.172613 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6313624-6b03-42fa-ab8f-2c527eccdd8e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:34.173715 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6313624-6b03-42fa-ab8f-2c527eccdd8e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:34.308530 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f6313624-6b03-42fa-ab8f-2c527eccdd8e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:34.323373 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f6313624-6b03-42fa-ab8f-2c527eccdd8e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:34.328978 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f6313624-6b03-42fa-ab8f-2c527eccdd8e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:34.330357 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f6313624-6b03-42fa-ab8f-2c527eccdd8e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1605 microversion: 2.32 time: 0.186744 Jun 20 12:14:34.334049 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1874/3837] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:34 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1605 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:34.339670 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b7a3157f-2f39-4e82-afde-2ed1199ce84b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:34.343083 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b7a3157f-2f39-4e82-afde-2ed1199ce84b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: e2cbf353-b613-4a89-8864-0e5b2ae7c323] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:34.350263 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b7a3157f-2f39-4e82-afde-2ed1199ce84b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:34.351042 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b7a3157f-2f39-4e82-afde-2ed1199ce84b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:34.353207 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b7a3157f-2f39-4e82-afde-2ed1199ce84b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:34.357917 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b7a3157f-2f39-4e82-afde-2ed1199ce84b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:34.468720 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b7a3157f-2f39-4e82-afde-2ed1199ce84b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:34.486272 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b7a3157f-2f39-4e82-afde-2ed1199ce84b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:34.491668 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b7a3157f-2f39-4e82-afde-2ed1199ce84b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '471c796d72d1484085c542aa2518f6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bff15252e5e43a7ad7fa9b7ff18e3ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:34.506155 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b7a3157f-2f39-4e82-afde-2ed1199ce84b tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/e2cbf353-b613-4a89-8864-0e5b2ae7c323" status: 200 len: 1363 microversion: 2.47 time: 0.170530 Jun 20 12:14:34.507318 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1875/3838] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:34 2022] GET /compute/v2.1/servers/e2cbf353-b613-4a89-8864-0e5b2ae7c323 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:34.514722 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0e04d374-be00-481f-a0b9-81df0613da52 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:34.515633 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0e04d374-be00-481f-a0b9-81df0613da52 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 2201b474-c2b7-4b6f-ba8c-b7b6ec3da862] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:34.534306 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0e04d374-be00-481f-a0b9-81df0613da52 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:34.535020 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0e04d374-be00-481f-a0b9-81df0613da52 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:34.537675 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0e04d374-be00-481f-a0b9-81df0613da52 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:34.540703 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0e04d374-be00-481f-a0b9-81df0613da52 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:34.681061 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1a68100d-f268-44a8-8518-287b34baf803 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "POST /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf/action" status: 202 len: 0 microversion: 2.1 time: 1.450124 Jun 20 12:14:34.682682 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1964/3839] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:14:33 2022] POST /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf/action => generated 0 bytes in 1452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:14:34.694275 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5aa1d9a7-84aa-4f99-ae75-aa1c64e14c41 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '.version_select at 0x7f607373b790>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:35.100851 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0e04d374-be00-481f-a0b9-81df0613da52 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:35.114668 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0e04d374-be00-481f-a0b9-81df0613da52 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/2201b474-c2b7-4b6f-ba8c-b7b6ec3da862" status: 200 len: 1469 microversion: 2.1 time: 0.603724 Jun 20 12:14:35.116889 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1876/3840] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:34 2022] GET /compute/v2.1/servers/2201b474-c2b7-4b6f-ba8c-b7b6ec3da862 => generated 1469 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:14:35.128996 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-742e2634-9b9a-43a7-a898-3aa54ccbb348 req-c2c3ca2f-db43-45de-801d-2a3d5028baf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a48784f9-f5d9-4379-b2ce-ba044db399cf", "tag": "e38fa345-839c-4384-9b05-edcedcb38cb6"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:35.157715 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-742e2634-9b9a-43a7-a898-3aa54ccbb348 req-c2c3ca2f-db43-45de-801d-2a3d5028baf9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:35.158810 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-742e2634-9b9a-43a7-a898-3aa54ccbb348 req-c2c3ca2f-db43-45de-801d-2a3d5028baf9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:35.189903 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-742e2634-9b9a-43a7-a898-3aa54ccbb348 req-c2c3ca2f-db43-45de-801d-2a3d5028baf9 service nova] Creating event network-changed:e38fa345-839c-4384-9b05-edcedcb38cb6 for instance a48784f9-f5d9-4379-b2ce-ba044db399cf on n-h1-master-1 Jun 20 12:14:35.222307 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-742e2634-9b9a-43a7-a898-3aa54ccbb348 req-c2c3ca2f-db43-45de-801d-2a3d5028baf9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103901 Jun 20 12:14:35.223673 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1877/3841] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:14:35.235816 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7cd8094c-5166-4c5d-93b4-3b58ef791829 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:35.237007 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7cd8094c-5166-4c5d-93b4-3b58ef791829 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:35.250219 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7cd8094c-5166-4c5d-93b4-3b58ef791829 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:35.250993 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7cd8094c-5166-4c5d-93b4-3b58ef791829 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:35.251956 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7cd8094c-5166-4c5d-93b4-3b58ef791829 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:35.252756 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7cd8094c-5166-4c5d-93b4-3b58ef791829 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:35.443898 n-d-master-1 devstack@n-api.service[119127]: DEBUG neutronclient.v2_0.client [None req-5aa1d9a7-84aa-4f99-ae75-aa1c64e14c41 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 6758fb01-190a-4735-a508-abaf71742ac4 in use.", "detail": ""}} {{(pid=119127) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 20 12:14:35.444634 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-5aa1d9a7-84aa-4f99-ae75-aa1c64e14c41 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] HTTP exception thrown: Security Group 6758fb01-190a-4735-a508-abaf71742ac4 in use. Jun 20 12:14:35.444634 n-d-master-1 devstack@n-api.service[119127]: Neutron server returns request_ids: ['req-c2705267-88cc-4101-aa81-8f151f2521ac'] Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5aa1d9a7-84aa-4f99-ae75-aa1c64e14c41 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Request method failure captured: Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/os-security-groups/6758fb01-190a-4735-a508-abaf71742ac4 HTTP/1.1 Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGRspEjgKJLgDEMUB1oxj39OHwxpAdW28qHUXtVohoyOClCgJsgd03GdT2hoi3BapXye_C7q25Fmx52K1II73Nmx91JaNXbL0TFFBm3DxndH_-8RQjkZz-YTJGFJgzzOjcuFROsmxi41ZdE0CTcrcS_WNFOPfY38q9VTNDmwM1zWfjI Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: b3edd75428794ea2b1cbd1b8413072cd Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: b3edd75428794ea2b1cbd1b8413072cd Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-SecurityGroupsTestJSON-1959389845-project Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: e8878b2fbb4b429288856159a644382f Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-SecurityGroupsTestJSON-1959389845-project Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: exception: Security Group 6758fb01-190a-4735-a508-abaf71742ac4 in use. Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: Neutron server returns request_ids: ['req-c2705267-88cc-4101-aa81-8f151f2521ac'] Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '6758fb01-190a-4735-a508-abaf71742ac4'} Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 20 12:14:35.447066 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 6758fb01-190a-4735-a508-abaf71742ac4 in use. Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c2705267-88cc-4101-aa81-8f151f2521ac'] Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 6758fb01-190a-4735-a508-abaf71742ac4 in use. Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c2705267-88cc-4101-aa81-8f151f2521ac'] Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 6758fb01-190a-4735-a508-abaf71742ac4 in use. Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c2705267-88cc-4101-aa81-8f151f2521ac'] Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 6758fb01-190a-4735-a508-abaf71742ac4 in use. Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c2705267-88cc-4101-aa81-8f151f2521ac'] Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5aa1d9a7-84aa-4f99-ae75-aa1c64e14c41 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Returning 400 to user: Security Group 6758fb01-190a-4735-a508-abaf71742ac4 in use. Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: Neutron server returns request_ids: ['req-c2705267-88cc-4101-aa81-8f151f2521ac'] {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:14:35.453020 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5aa1d9a7-84aa-4f99-ae75-aa1c64e14c41 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/6758fb01-190a-4735-a508-abaf71742ac4" status: 400 len: 185 microversion: 2.1 time: 0.759132 Jun 20 12:14:35.457033 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1965/3842] 10.222.0.27 () {58 vars in 1271 bytes} [Mon Jun 20 12:14:34 2022] DELETE /compute/v2.1/os-security-groups/6758fb01-190a-4735-a508-abaf71742ac4 => generated 185 bytes in 764 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 20 12:14:35.468852 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-df6edc87-4bc1-4b93-94c1-c96775e2f95d tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:35.470379 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-df6edc87-4bc1-4b93-94c1-c96775e2f95d tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:35.479061 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df6edc87-4bc1-4b93-94c1-c96775e2f95d tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:35.479863 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df6edc87-4bc1-4b93-94c1-c96775e2f95d tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:35.480865 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df6edc87-4bc1-4b93-94c1-c96775e2f95d tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:35.481480 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df6edc87-4bc1-4b93-94c1-c96775e2f95d tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:35.798401 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-df6edc87-4bc1-4b93-94c1-c96775e2f95d tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:35.831587 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-df6edc87-4bc1-4b93-94c1-c96775e2f95d tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:35.841942 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-df6edc87-4bc1-4b93-94c1-c96775e2f95d tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:35.844133 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-df6edc87-4bc1-4b93-94c1-c96775e2f95d tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1605 microversion: 2.32 time: 0.388875 Jun 20 12:14:35.845770 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1966/3843] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:35 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1605 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:35.853364 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1cc94ce1-ea97-4565-b0d3-aeeeae67b86d tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:35.854841 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1cc94ce1-ea97-4565-b0d3-aeeeae67b86d tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: a48784f9-f5d9-4379-b2ce-ba044db399cf] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:35.863741 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1cc94ce1-ea97-4565-b0d3-aeeeae67b86d tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:35.864533 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1cc94ce1-ea97-4565-b0d3-aeeeae67b86d tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:35.866533 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1cc94ce1-ea97-4565-b0d3-aeeeae67b86d tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:35.879624 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1cc94ce1-ea97-4565-b0d3-aeeeae67b86d tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:36.080015 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1cc94ce1-ea97-4565-b0d3-aeeeae67b86d tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "POST /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf/action" status: 202 len: 0 microversion: 2.1 time: 0.230816 Jun 20 12:14:36.084351 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1967/3844] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:14:35 2022] POST /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:14:36.093741 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4fd03c6d-e23d-4ea7-a042-b295eef542ea tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:36.111284 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4fd03c6d-e23d-4ea7-a042-b295eef542ea tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] [instance: e2cbf353-b613-4a89-8864-0e5b2ae7c323] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:36.152953 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4fd03c6d-e23d-4ea7-a042-b295eef542ea tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:36.153417 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4fd03c6d-e23d-4ea7-a042-b295eef542ea tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:36.168550 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4fd03c6d-e23d-4ea7-a042-b295eef542ea tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:36.168790 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4fd03c6d-e23d-4ea7-a042-b295eef542ea tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:36.208901 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7cd8094c-5166-4c5d-93b4-3b58ef791829 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:36.221643 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-4fd03c6d-e23d-4ea7-a042-b295eef542ea tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] HTTP exception thrown: Instance e2cbf353-b613-4a89-8864-0e5b2ae7c323 could not be found. Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4fd03c6d-e23d-4ea7-a042-b295eef542ea tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Request method failure captured: Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/e2cbf353-b613-4a89-8864-0e5b2ae7c323 HTTP/1.1 Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGRoNW9yEtmmiVmNOAHZh1QzKg6_qMVUJVIt_lNNE4Yt5qUoZym7Vfqf1o2jOhTereNILUIJJ32Y5p9OSBWL7ISLMlPoMJQqr0MPYzpgcue2wGboRjGyrwJ_u0MpFrcyUcL62U6LaUC3d-S1jI65faj6FqhBpA7zT7YMlskbzeVDuKU Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: X-Openstack-Nova-Api-Version: 2.47 Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 1bff15252e5e43a7ad7fa9b7ff18e3ec Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServerShowV247Test-1950328883 Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1bff15252e5e43a7ad7fa9b7ff18e3ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1bff15252e5e43a7ad7fa9b7ff18e3ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1bff15252e5e43a7ad7fa9b7ff18e3ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1bff15252e5e43a7ad7fa9b7ff18e3ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServerShowV247Test-1950328883 Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 1bff15252e5e43a7ad7fa9b7ff18e3ec Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServerShowV247Test-1950328883 Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServerShowV247Test-1950328883-project Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 471c796d72d1484085c542aa2518f6ac Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServerShowV247Test-1950328883-project Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: exception: Instance e2cbf353-b613-4a89-8864-0e5b2ae7c323 could not be found. Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'e2cbf353-b613-4a89-8864-0e5b2ae7c323'} Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2cbf353-b613-4a89-8864-0e5b2ae7c323 could not be found. Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2cbf353-b613-4a89-8864-0e5b2ae7c323 could not be found. Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:14:36.231949 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:36.237638 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:36.237638 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:14:36.237638 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:14:36.237638 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:14:36.237638 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:14:36.237638 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2cbf353-b613-4a89-8864-0e5b2ae7c323 could not be found. Jun 20 12:14:36.237638 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:36.238237 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7cd8094c-5166-4c5d-93b4-3b58ef791829 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:36.239633 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4fd03c6d-e23d-4ea7-a042-b295eef542ea tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] Returning 404 to user: Instance e2cbf353-b613-4a89-8864-0e5b2ae7c323 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:14:36.240782 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7cd8094c-5166-4c5d-93b4-3b58ef791829 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:36.241893 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4fd03c6d-e23d-4ea7-a042-b295eef542ea tempest-ServerShowV247Test-1950328883 tempest-ServerShowV247Test-1950328883-project] 10.222.0.27 "GET /compute/v2.1/servers/e2cbf353-b613-4a89-8864-0e5b2ae7c323" status: 404 len: 111 microversion: 2.47 time: 0.155884 Jun 20 12:14:36.243781 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1968/3845] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:36 2022] GET /compute/v2.1/servers/e2cbf353-b613-4a89-8864-0e5b2ae7c323 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:14:36.247925 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7cd8094c-5166-4c5d-93b4-3b58ef791829 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1745 microversion: 2.20 time: 1.020152 Jun 20 12:14:36.251755 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1878/3846] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:35 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1745 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:36.283709 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-efcc2dbb-f1f6-4a60-b24e-ac42f8ab25c2 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:36.284677 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-efcc2dbb-f1f6-4a60-b24e-ac42f8ab25c2 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: a48784f9-f5d9-4379-b2ce-ba044db399cf] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:36.286537 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fc600ed4-b480-429b-9706-ac3ee7acce23 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:36.293202 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fc600ed4-b480-429b-9706-ac3ee7acce23 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 2201b474-c2b7-4b6f-ba8c-b7b6ec3da862] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:36.307645 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-efcc2dbb-f1f6-4a60-b24e-ac42f8ab25c2 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:36.308108 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-efcc2dbb-f1f6-4a60-b24e-ac42f8ab25c2 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:36.308935 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-efcc2dbb-f1f6-4a60-b24e-ac42f8ab25c2 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:36.309377 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-efcc2dbb-f1f6-4a60-b24e-ac42f8ab25c2 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:36.311190 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fc600ed4-b480-429b-9706-ac3ee7acce23 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:36.315165 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fc600ed4-b480-429b-9706-ac3ee7acce23 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:36.316357 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fc600ed4-b480-429b-9706-ac3ee7acce23 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:36.318666 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fc600ed4-b480-429b-9706-ac3ee7acce23 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:36.624121 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fc600ed4-b480-429b-9706-ac3ee7acce23 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:36.638583 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fc600ed4-b480-429b-9706-ac3ee7acce23 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/2201b474-c2b7-4b6f-ba8c-b7b6ec3da862" status: 200 len: 1298 microversion: 2.1 time: 0.384046 Jun 20 12:14:36.642063 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1879/3847] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:36 2022] GET /compute/v2.1/servers/2201b474-c2b7-4b6f-ba8c-b7b6ec3da862 => generated 1298 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:36.863453 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3744620d-5d2c-4521-916d-bb2407b83650 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:36.865379 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3744620d-5d2c-4521-916d-bb2407b83650 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:36.878386 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3744620d-5d2c-4521-916d-bb2407b83650 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:36.879254 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3744620d-5d2c-4521-916d-bb2407b83650 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:36.880328 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3744620d-5d2c-4521-916d-bb2407b83650 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:36.884419 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3744620d-5d2c-4521-916d-bb2407b83650 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:37.186435 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3744620d-5d2c-4521-916d-bb2407b83650 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:37.211159 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3744620d-5d2c-4521-916d-bb2407b83650 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:37.212909 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3744620d-5d2c-4521-916d-bb2407b83650 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:37.247972 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3744620d-5d2c-4521-916d-bb2407b83650 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1605 microversion: 2.32 time: 0.377350 Jun 20 12:14:37.253420 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1880/3848] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:36 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1605 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:14:37.270306 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-47eaec4f-ad34-4118-806b-971973290774 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:37.270935 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-47eaec4f-ad34-4118-806b-971973290774 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:37.317110 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-47eaec4f-ad34-4118-806b-971973290774 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:37.317754 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-47eaec4f-ad34-4118-806b-971973290774 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:37.319343 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-47eaec4f-ad34-4118-806b-971973290774 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:37.319813 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-47eaec4f-ad34-4118-806b-971973290774 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:37.888271 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-efcc2dbb-f1f6-4a60-b24e-ac42f8ab25c2 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:37.910377 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-efcc2dbb-f1f6-4a60-b24e-ac42f8ab25c2 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf" status: 200 len: 1573 microversion: 2.1 time: 1.662379 Jun 20 12:14:37.922679 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1969/3849] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:36 2022] GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf => generated 1573 bytes in 1675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:37.927858 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1d0193be-7559-42cb-ac78-019846e60680 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:37.928757 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1d0193be-7559-42cb-ac78-019846e60680 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 2201b474-c2b7-4b6f-ba8c-b7b6ec3da862] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:37.950629 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1d0193be-7559-42cb-ac78-019846e60680 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:37.951950 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1d0193be-7559-42cb-ac78-019846e60680 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:37.953002 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1d0193be-7559-42cb-ac78-019846e60680 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:37.953638 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1d0193be-7559-42cb-ac78-019846e60680 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:37.984835 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-1d0193be-7559-42cb-ac78-019846e60680 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] HTTP exception thrown: Instance 2201b474-c2b7-4b6f-ba8c-b7b6ec3da862 could not be found. Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1d0193be-7559-42cb-ac78-019846e60680 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Request method failure captured: Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/2201b474-c2b7-4b6f-ba8c-b7b6ec3da862 HTTP/1.1 Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGQfUFkRaZpx8Ervf8tFFTi2rPHeTz5yp3P6AALlFBL-AS-NRly_auvcOw6IF4GA2M26wePfcpwKJY19SpfodQNtJmjAOcJHRFlaYl_4nZ2XB0tg54sAqT66Vh_hj4JwrzIqBQLC6ThoYtsNslwWvjf_S_CfwZoC79uDpp91MzXU5FI Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: df4cb5022443461395424ace464a41e6 Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersAdminTestJSON-476267513 Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/df4cb5022443461395424ace464a41e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/df4cb5022443461395424ace464a41e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/df4cb5022443461395424ace464a41e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_df4cb5022443461395424ace464a41e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersAdminTestJSON-476267513 Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: df4cb5022443461395424ace464a41e6 Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersAdminTestJSON-476267513 Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersAdminTestJSON-476267513-project Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 8267303c2c734c10b081b154a1795b82 Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersAdminTestJSON-476267513-project Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 2201b474-c2b7-4b6f-ba8c-b7b6ec3da862 could not be found. Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '2201b474-c2b7-4b6f-ba8c-b7b6ec3da862'} Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2201b474-c2b7-4b6f-ba8c-b7b6ec3da862 could not be found. Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2201b474-c2b7-4b6f-ba8c-b7b6ec3da862 could not be found. Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:14:37.988126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:37.992744 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:37.992744 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:14:37.992744 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:14:37.992744 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:14:37.992744 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:14:37.992744 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2201b474-c2b7-4b6f-ba8c-b7b6ec3da862 could not be found. Jun 20 12:14:37.992744 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:37.996476 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1d0193be-7559-42cb-ac78-019846e60680 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Returning 404 to user: Instance 2201b474-c2b7-4b6f-ba8c-b7b6ec3da862 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:14:37.997685 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1d0193be-7559-42cb-ac78-019846e60680 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/2201b474-c2b7-4b6f-ba8c-b7b6ec3da862" status: 404 len: 111 microversion: 2.1 time: 0.073783 Jun 20 12:14:38.005287 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1970/3850] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:37 2022] GET /compute/v2.1/servers/2201b474-c2b7-4b6f-ba8c-b7b6ec3da862 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:14:38.011336 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-9d1e57db-7d38-4442-a681-cb0d267843cd req-dd6ae2d0-d38d-4bfa-a76a-569d4451d298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2201b474-c2b7-4b6f-ba8c-b7b6ec3da862", "name": "network-vif-deleted", "tag": "fdef86ed-bdd1-46e5-9f16-c2ce23d27385"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:38.037190 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-9d1e57db-7d38-4442-a681-cb0d267843cd req-dd6ae2d0-d38d-4bfa-a76a-569d4451d298 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:38.049005 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-9d1e57db-7d38-4442-a681-cb0d267843cd req-dd6ae2d0-d38d-4bfa-a76a-569d4451d298 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:38.078796 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-9d1e57db-7d38-4442-a681-cb0d267843cd req-dd6ae2d0-d38d-4bfa-a76a-569d4451d298 service nova] Creating event network-vif-deleted:fdef86ed-bdd1-46e5-9f16-c2ce23d27385 for instance 2201b474-c2b7-4b6f-ba8c-b7b6ec3da862 on n-h2-master-1 Jun 20 12:14:38.094138 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-9d1e57db-7d38-4442-a681-cb0d267843cd req-dd6ae2d0-d38d-4bfa-a76a-569d4451d298 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087071 Jun 20 12:14:38.095158 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1971/3851] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:14:38.100934 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7bb2806f-1797-4482-9a48-c402776e1b5a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:38.106338 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7bb2806f-1797-4482-9a48-c402776e1b5a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 58edde4b-1f8f-488b-a632-764122b7fa53] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:38.113995 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7bb2806f-1797-4482-9a48-c402776e1b5a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:38.122859 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7bb2806f-1797-4482-9a48-c402776e1b5a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:38.124428 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7bb2806f-1797-4482-9a48-c402776e1b5a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:38.125421 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7bb2806f-1797-4482-9a48-c402776e1b5a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:38.198043 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7bb2806f-1797-4482-9a48-c402776e1b5a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 58edde4b-1f8f-488b-a632-764122b7fa53] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:14:38.207241 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-47eaec4f-ad34-4118-806b-971973290774 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:38.223172 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-47eaec4f-ad34-4118-806b-971973290774 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:38.226050 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-47eaec4f-ad34-4118-806b-971973290774 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:38.233393 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-47eaec4f-ad34-4118-806b-971973290774 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1740 microversion: 2.20 time: 0.964908 Jun 20 12:14:38.235330 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1881/3852] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:37 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1740 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:14:38.269416 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-509ee6cb-c5c6-4c1c-a13b-9eda3037712d tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:38.270792 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-509ee6cb-c5c6-4c1c-a13b-9eda3037712d tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:38.290135 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-509ee6cb-c5c6-4c1c-a13b-9eda3037712d tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:38.291945 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-509ee6cb-c5c6-4c1c-a13b-9eda3037712d tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:38.293144 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-509ee6cb-c5c6-4c1c-a13b-9eda3037712d tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:38.298340 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-509ee6cb-c5c6-4c1c-a13b-9eda3037712d tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:38.385272 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7bb2806f-1797-4482-9a48-c402776e1b5a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "DELETE /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53" status: 204 len: 0 microversion: 2.1 time: 0.288192 Jun 20 12:14:38.386393 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1972/3853] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:14:38 2022] DELETE /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:14:38.395560 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f147f887-31f1-4c77-a104-dd8c6f6813c1 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:38.396305 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f147f887-31f1-4c77-a104-dd8c6f6813c1 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 58edde4b-1f8f-488b-a632-764122b7fa53] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:38.410462 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f147f887-31f1-4c77-a104-dd8c6f6813c1 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:38.412544 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f147f887-31f1-4c77-a104-dd8c6f6813c1 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:38.413457 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f147f887-31f1-4c77-a104-dd8c6f6813c1 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:38.413926 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f147f887-31f1-4c77-a104-dd8c6f6813c1 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:38.673417 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-509ee6cb-c5c6-4c1c-a13b-9eda3037712d tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:38.701744 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-509ee6cb-c5c6-4c1c-a13b-9eda3037712d tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:38.714498 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-509ee6cb-c5c6-4c1c-a13b-9eda3037712d tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:38.723065 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-509ee6cb-c5c6-4c1c-a13b-9eda3037712d tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1605 microversion: 2.32 time: 0.459065 Jun 20 12:14:38.731797 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1882/3854] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:38 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1605 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:38.807496 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f147f887-31f1-4c77-a104-dd8c6f6813c1 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:38.816240 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f147f887-31f1-4c77-a104-dd8c6f6813c1 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53" status: 200 len: 1470 microversion: 2.1 time: 0.425114 Jun 20 12:14:38.823887 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1973/3855] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:38 2022] GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53 => generated 1470 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:38.931100 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f7b91bfd-d1e6-4cd0-9916-771eddcb6938 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:38.931839 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f7b91bfd-d1e6-4cd0-9916-771eddcb6938 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: a48784f9-f5d9-4379-b2ce-ba044db399cf] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:38.956472 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7b91bfd-d1e6-4cd0-9916-771eddcb6938 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:38.957067 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7b91bfd-d1e6-4cd0-9916-771eddcb6938 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:38.961323 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7b91bfd-d1e6-4cd0-9916-771eddcb6938 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:38.961764 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7b91bfd-d1e6-4cd0-9916-771eddcb6938 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:39.256982 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d6196ecd-fd90-49c3-823f-03250e7a7755 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:39.257785 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d6196ecd-fd90-49c3-823f-03250e7a7755 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:39.284540 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d6196ecd-fd90-49c3-823f-03250e7a7755 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:39.294509 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d6196ecd-fd90-49c3-823f-03250e7a7755 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:39.299750 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d6196ecd-fd90-49c3-823f-03250e7a7755 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:39.304542 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d6196ecd-fd90-49c3-823f-03250e7a7755 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:39.328124 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f7b91bfd-d1e6-4cd0-9916-771eddcb6938 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:39.340907 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f7b91bfd-d1e6-4cd0-9916-771eddcb6938 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf" status: 200 len: 1573 microversion: 2.1 time: 0.415779 Jun 20 12:14:39.348683 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1883/3856] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:38 2022] GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf => generated 1573 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:39.757537 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b5b181c7-1f8b-43a1-a1b1-09fa67bbf9f3 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:39.758161 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b5b181c7-1f8b-43a1-a1b1-09fa67bbf9f3 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:39.766827 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b5b181c7-1f8b-43a1-a1b1-09fa67bbf9f3 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:39.767281 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b5b181c7-1f8b-43a1-a1b1-09fa67bbf9f3 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:39.768061 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b5b181c7-1f8b-43a1-a1b1-09fa67bbf9f3 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:39.771496 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b5b181c7-1f8b-43a1-a1b1-09fa67bbf9f3 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:39.922074 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d6196ecd-fd90-49c3-823f-03250e7a7755 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:39.936879 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d6196ecd-fd90-49c3-823f-03250e7a7755 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:39.941236 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d6196ecd-fd90-49c3-823f-03250e7a7755 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:39.952919 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d6196ecd-fd90-49c3-823f-03250e7a7755 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1740 microversion: 2.20 time: 0.699176 Jun 20 12:14:39.956863 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1974/3857] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:39 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1740 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:39.967904 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-70be72b4-9e54-4ac1-85cf-85d72bb98c00 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:39.969021 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-70be72b4-9e54-4ac1-85cf-85d72bb98c00 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 58edde4b-1f8f-488b-a632-764122b7fa53] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:39.986982 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-70be72b4-9e54-4ac1-85cf-85d72bb98c00 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:39.989474 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-70be72b4-9e54-4ac1-85cf-85d72bb98c00 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:39.991901 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-70be72b4-9e54-4ac1-85cf-85d72bb98c00 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:39.993580 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-70be72b4-9e54-4ac1-85cf-85d72bb98c00 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:40.326320 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-70be72b4-9e54-4ac1-85cf-85d72bb98c00 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:40.340108 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-70be72b4-9e54-4ac1-85cf-85d72bb98c00 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53" status: 200 len: 1470 microversion: 2.1 time: 0.380395 Jun 20 12:14:40.341115 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1975/3858] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:39 2022] GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53 => generated 1470 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:40.366960 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1b0ae285-b3ff-498c-9561-2ecb955bd054 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:40.368117 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1b0ae285-b3ff-498c-9561-2ecb955bd054 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: a48784f9-f5d9-4379-b2ce-ba044db399cf] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:40.388673 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1b0ae285-b3ff-498c-9561-2ecb955bd054 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:40.390889 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1b0ae285-b3ff-498c-9561-2ecb955bd054 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:40.393212 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1b0ae285-b3ff-498c-9561-2ecb955bd054 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:40.396847 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1b0ae285-b3ff-498c-9561-2ecb955bd054 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:40.410233 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b5b181c7-1f8b-43a1-a1b1-09fa67bbf9f3 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:40.427342 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b5b181c7-1f8b-43a1-a1b1-09fa67bbf9f3 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:40.428960 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b5b181c7-1f8b-43a1-a1b1-09fa67bbf9f3 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:40.430603 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b5b181c7-1f8b-43a1-a1b1-09fa67bbf9f3 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1605 microversion: 2.32 time: 0.683576 Jun 20 12:14:40.446154 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1884/3859] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:39 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1605 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:40.823632 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-b1d0df0a-c93e-4745-a216-0a180a1106a7 req-59818b95-8054-4ba2-a5b9-33a4f27ffd87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc", "name": "network-vif-plugged", "status": "completed", "tag": "4b0b8cf9-ff46-4970-9b45-8795ce12a358"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:40.840620 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-b1d0df0a-c93e-4745-a216-0a180a1106a7 req-59818b95-8054-4ba2-a5b9-33a4f27ffd87 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:40.843513 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-b1d0df0a-c93e-4745-a216-0a180a1106a7 req-59818b95-8054-4ba2-a5b9-33a4f27ffd87 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:40.876458 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-b1d0df0a-c93e-4745-a216-0a180a1106a7 req-59818b95-8054-4ba2-a5b9-33a4f27ffd87 service nova] Creating event network-vif-plugged:4b0b8cf9-ff46-4970-9b45-8795ce12a358 for instance 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc on n-h1-master-1 Jun 20 12:14:40.891385 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-b1d0df0a-c93e-4745-a216-0a180a1106a7 req-59818b95-8054-4ba2-a5b9-33a4f27ffd87 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071678 Jun 20 12:14:40.893712 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1885/3860] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:14:40.979694 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c05a8730-6d93-40df-b7b8-d714ac915a0f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:40.981094 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c05a8730-6d93-40df-b7b8-d714ac915a0f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:40.998553 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c05a8730-6d93-40df-b7b8-d714ac915a0f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:41.001004 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c05a8730-6d93-40df-b7b8-d714ac915a0f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:41.002637 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c05a8730-6d93-40df-b7b8-d714ac915a0f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:41.005075 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c05a8730-6d93-40df-b7b8-d714ac915a0f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:41.058805 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1b0ae285-b3ff-498c-9561-2ecb955bd054 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:41.070888 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1b0ae285-b3ff-498c-9561-2ecb955bd054 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf" status: 200 len: 1573 microversion: 2.1 time: 0.708225 Jun 20 12:14:41.073101 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1976/3861] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:40 2022] GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf => generated 1573 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:41.288109 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-63c89da7-36fe-4a4e-a41d-189b8160b0a8 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-745992129", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": "none"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:41.383079 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-63c89da7-36fe-4a4e-a41d-189b8160b0a8 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:14:41.383745 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-63c89da7-36fe-4a4e-a41d-189b8160b0a8 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:14:41.383975 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-63c89da7-36fe-4a4e-a41d-189b8160b0a8 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:14:41.384424 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-63c89da7-36fe-4a4e-a41d-189b8160b0a8 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:14:41.384849 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-63c89da7-36fe-4a4e-a41d-189b8160b0a8 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:14:41.419441 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63c89da7-36fe-4a4e-a41d-189b8160b0a8 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:41.420140 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63c89da7-36fe-4a4e-a41d-189b8160b0a8 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:41.421178 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63c89da7-36fe-4a4e-a41d-189b8160b0a8 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:41.421740 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63c89da7-36fe-4a4e-a41d-189b8160b0a8 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:41.456525 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-63c89da7-36fe-4a4e-a41d-189b8160b0a8 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Getting quotas for project 72bf68532fcb4a3a972cae865bd3182a. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:14:41.462676 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-63c89da7-36fe-4a4e-a41d-189b8160b0a8 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Getting quotas for user e330d65b44774feb92acd16e2edc1bc0 and project 72bf68532fcb4a3a972cae865bd3182a. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:14:41.481430 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-63c89da7-36fe-4a4e-a41d-189b8160b0a8 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:14:41.484217 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-63c89da7-36fe-4a4e-a41d-189b8160b0a8 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] [instance: 1618debb-4bee-4c67-81b1-ef82968ac330] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:14:41.579225 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-63c89da7-36fe-4a4e-a41d-189b8160b0a8 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.471141 Jun 20 12:14:41.587877 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1977/3862] 10.222.0.27 () {62 vars in 1187 bytes} [Mon Jun 20 12:14:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 481 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 20 12:14:41.681705 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-08c0560a-61a8-4fcc-a8c0-526ae8b76d62 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:41.682690 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-08c0560a-61a8-4fcc-a8c0-526ae8b76d62 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 58edde4b-1f8f-488b-a632-764122b7fa53] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:41.706759 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-08c0560a-61a8-4fcc-a8c0-526ae8b76d62 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:41.720606 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-08c0560a-61a8-4fcc-a8c0-526ae8b76d62 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:41.722225 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-08c0560a-61a8-4fcc-a8c0-526ae8b76d62 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:41.732048 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-08c0560a-61a8-4fcc-a8c0-526ae8b76d62 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:41.768518 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:41.993151 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c05a8730-6d93-40df-b7b8-d714ac915a0f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:42.030121 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c05a8730-6d93-40df-b7b8-d714ac915a0f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:42.033466 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c05a8730-6d93-40df-b7b8-d714ac915a0f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:42.036805 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c05a8730-6d93-40df-b7b8-d714ac915a0f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1740 microversion: 2.20 time: 1.063729 Jun 20 12:14:42.037968 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1886/3863] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:40 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1740 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:42.063145 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-27315bf9-fc7c-494e-b6b6-8ec25bbefe96 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:42.067314 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-27315bf9-fc7c-494e-b6b6-8ec25bbefe96 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:42.089148 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-27315bf9-fc7c-494e-b6b6-8ec25bbefe96 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:42.090204 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-27315bf9-fc7c-494e-b6b6-8ec25bbefe96 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:42.091556 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-27315bf9-fc7c-494e-b6b6-8ec25bbefe96 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:42.095908 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-27315bf9-fc7c-494e-b6b6-8ec25bbefe96 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:42.242717 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-08c0560a-61a8-4fcc-a8c0-526ae8b76d62 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:42.254745 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-08c0560a-61a8-4fcc-a8c0-526ae8b76d62 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53" status: 200 len: 1470 microversion: 2.1 time: 0.663700 Jun 20 12:14:42.256021 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1978/3864] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:41 2022] GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53 => generated 1470 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:42.261479 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3846f446-7c55-4c35-a051-16347d8392c3 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:42.262389 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3846f446-7c55-4c35-a051-16347d8392c3 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] [instance: 1618debb-4bee-4c67-81b1-ef82968ac330] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:42.400782 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3846f446-7c55-4c35-a051-16347d8392c3 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:42.419987 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3846f446-7c55-4c35-a051-16347d8392c3 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:42.421697 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3846f446-7c55-4c35-a051-16347d8392c3 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:42.435843 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3846f446-7c55-4c35-a051-16347d8392c3 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] 10.222.0.27 "GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330" status: 200 len: 1277 microversion: 2.57 time: 0.178155 Jun 20 12:14:42.436537 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1979/3865] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:42 2022] GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330 => generated 1277 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:42.466292 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b05f05e2-9de7-4806-873c-7d25d15a89f0 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:42.466849 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b05f05e2-9de7-4806-873c-7d25d15a89f0 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: a48784f9-f5d9-4379-b2ce-ba044db399cf] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:42.490128 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b05f05e2-9de7-4806-873c-7d25d15a89f0 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:42.490844 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b05f05e2-9de7-4806-873c-7d25d15a89f0 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:42.491624 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b05f05e2-9de7-4806-873c-7d25d15a89f0 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:42.492058 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b05f05e2-9de7-4806-873c-7d25d15a89f0 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:42.524565 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-27315bf9-fc7c-494e-b6b6-8ec25bbefe96 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:42.566467 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-27315bf9-fc7c-494e-b6b6-8ec25bbefe96 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:42.572046 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-27315bf9-fc7c-494e-b6b6-8ec25bbefe96 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:42.575601 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-27315bf9-fc7c-494e-b6b6-8ec25bbefe96 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1605 microversion: 2.32 time: 0.534966 Jun 20 12:14:42.577260 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1887/3866] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:42 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1605 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:42.594164 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-93ec4fbe-510a-4a97-b038-9949eadd42f2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:42.596148 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-93ec4fbe-510a-4a97-b038-9949eadd42f2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:42.611628 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-93ec4fbe-510a-4a97-b038-9949eadd42f2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:42.613087 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-93ec4fbe-510a-4a97-b038-9949eadd42f2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:42.614320 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-93ec4fbe-510a-4a97-b038-9949eadd42f2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:42.614941 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-93ec4fbe-510a-4a97-b038-9949eadd42f2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:42.799597 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-93ec4fbe-510a-4a97-b038-9949eadd42f2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "POST /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d/action" status: 200 len: 24566 microversion: 2.1 time: 0.220663 Jun 20 12:14:42.802556 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1888/3867] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:14:42 2022] POST /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d/action => generated 24566 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:14:42.931499 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b05f05e2-9de7-4806-873c-7d25d15a89f0 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:42.966092 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b05f05e2-9de7-4806-873c-7d25d15a89f0 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf" status: 200 len: 1578 microversion: 2.1 time: 0.526943 Jun 20 12:14:42.966711 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1980/3868] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:42 2022] GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf => generated 1578 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:43.056342 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-853eaa62-211f-4910-8612-441f5e40d57b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:43.057810 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-853eaa62-211f-4910-8612-441f5e40d57b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:43.110804 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-853eaa62-211f-4910-8612-441f5e40d57b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:43.111727 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-853eaa62-211f-4910-8612-441f5e40d57b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:43.112834 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-853eaa62-211f-4910-8612-441f5e40d57b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:43.113452 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-853eaa62-211f-4910-8612-441f5e40d57b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:43.142671 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:43.272548 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a64e3b4c-6478-4e7d-a8a5-e4ce7c742cc1 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:43.273505 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a64e3b4c-6478-4e7d-a8a5-e4ce7c742cc1 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 58edde4b-1f8f-488b-a632-764122b7fa53] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:43.302789 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a64e3b4c-6478-4e7d-a8a5-e4ce7c742cc1 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:43.303573 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a64e3b4c-6478-4e7d-a8a5-e4ce7c742cc1 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:43.305443 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a64e3b4c-6478-4e7d-a8a5-e4ce7c742cc1 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:43.306097 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a64e3b4c-6478-4e7d-a8a5-e4ce7c742cc1 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:43.477174 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a64e3b4c-6478-4e7d-a8a5-e4ce7c742cc1 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:43.520120 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a64e3b4c-6478-4e7d-a8a5-e4ce7c742cc1 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53" status: 200 len: 1428 microversion: 2.1 time: 0.251612 Jun 20 12:14:43.532099 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1981/3869] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:43 2022] GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53 => generated 1428 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:43.547340 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-09a18e01-a346-48a2-8426-cf39a6982c83 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:43.548634 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-09a18e01-a346-48a2-8426-cf39a6982c83 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] [instance: 1618debb-4bee-4c67-81b1-ef82968ac330] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:43.569293 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-09a18e01-a346-48a2-8426-cf39a6982c83 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:43.572393 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-09a18e01-a346-48a2-8426-cf39a6982c83 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:43.573532 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-09a18e01-a346-48a2-8426-cf39a6982c83 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:43.578080 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-09a18e01-a346-48a2-8426-cf39a6982c83 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:43.777022 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-09a18e01-a346-48a2-8426-cf39a6982c83 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:43.800281 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-09a18e01-a346-48a2-8426-cf39a6982c83 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:43.801825 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-09a18e01-a346-48a2-8426-cf39a6982c83 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:43.803160 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-09a18e01-a346-48a2-8426-cf39a6982c83 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] 10.222.0.27 "GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330" status: 200 len: 1329 microversion: 2.57 time: 0.269631 Jun 20 12:14:43.811663 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1982/3870] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:43 2022] GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330 => generated 1329 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:43.823335 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4ed13310-3982-4923-abdc-0c24eb473faf tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:43.825978 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4ed13310-3982-4923-abdc-0c24eb473faf tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:43.836674 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4ed13310-3982-4923-abdc-0c24eb473faf tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:43.843199 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4ed13310-3982-4923-abdc-0c24eb473faf tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:43.845684 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4ed13310-3982-4923-abdc-0c24eb473faf tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:43.847145 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4ed13310-3982-4923-abdc-0c24eb473faf tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:44.001131 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4ed13310-3982-4923-abdc-0c24eb473faf tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:44.016990 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4ed13310-3982-4923-abdc-0c24eb473faf tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:44.019254 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4ed13310-3982-4923-abdc-0c24eb473faf tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:44.021441 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4ed13310-3982-4923-abdc-0c24eb473faf tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1605 microversion: 2.32 time: 0.207981 Jun 20 12:14:44.028765 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1983/3871] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:43 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1605 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:44.034219 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-de857bfd-bde9-409f-bcfc-2327b160c820 req-24d55cb1-a0ea-48f7-be5a-644a7c9107ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58edde4b-1f8f-488b-a632-764122b7fa53", "name": "network-vif-deleted", "tag": "78e6a6b3-f589-42c2-8a9b-76372d32a75f"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:44.055020 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-de857bfd-bde9-409f-bcfc-2327b160c820 req-24d55cb1-a0ea-48f7-be5a-644a7c9107ba service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:44.060596 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-de857bfd-bde9-409f-bcfc-2327b160c820 req-24d55cb1-a0ea-48f7-be5a-644a7c9107ba service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:44.096676 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-de857bfd-bde9-409f-bcfc-2327b160c820 req-24d55cb1-a0ea-48f7-be5a-644a7c9107ba service nova] Creating event network-vif-deleted:78e6a6b3-f589-42c2-8a9b-76372d32a75f for instance 58edde4b-1f8f-488b-a632-764122b7fa53 on n-h1-master-1 Jun 20 12:14:44.108686 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-de857bfd-bde9-409f-bcfc-2327b160c820 req-24d55cb1-a0ea-48f7-be5a-644a7c9107ba service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078000 Jun 20 12:14:44.109036 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1984/3872] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:14:44.118841 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dda8e96e-99b8-447a-9a33-e232822e0995 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:44.127577 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dda8e96e-99b8-447a-9a33-e232822e0995 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: a48784f9-f5d9-4379-b2ce-ba044db399cf] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:44.136402 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dda8e96e-99b8-447a-9a33-e232822e0995 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:44.137550 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dda8e96e-99b8-447a-9a33-e232822e0995 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:44.138611 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dda8e96e-99b8-447a-9a33-e232822e0995 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:44.139278 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dda8e96e-99b8-447a-9a33-e232822e0995 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:44.233502 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-853eaa62-211f-4910-8612-441f5e40d57b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:44.251571 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-853eaa62-211f-4910-8612-441f5e40d57b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:44.255540 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-853eaa62-211f-4910-8612-441f5e40d57b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:44.262828 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-853eaa62-211f-4910-8612-441f5e40d57b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1740 microversion: 2.20 time: 1.209713 Jun 20 12:14:44.282717 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1889/3873] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:43 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1740 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:44.507171 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dda8e96e-99b8-447a-9a33-e232822e0995 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:44.521571 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dda8e96e-99b8-447a-9a33-e232822e0995 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf" status: 200 len: 1571 microversion: 2.1 time: 0.410525 Jun 20 12:14:44.522947 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1985/3874] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:44 2022] GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf => generated 1571 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:44.553721 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-caf53065-9278-48ee-acb7-8013260e38b4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:44.557509 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-caf53065-9278-48ee-acb7-8013260e38b4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: 58edde4b-1f8f-488b-a632-764122b7fa53] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:44.568182 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-01d62815-e7a9-4bbe-8dfd-cadc7ca5cffe tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1438609780"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:44.573238 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-01d62815-e7a9-4bbe-8dfd-cadc7ca5cffe tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: a48784f9-f5d9-4379-b2ce-ba044db399cf] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:44.583524 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-caf53065-9278-48ee-acb7-8013260e38b4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:44.584875 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-caf53065-9278-48ee-acb7-8013260e38b4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:44.590977 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-caf53065-9278-48ee-acb7-8013260e38b4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:44.591990 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01d62815-e7a9-4bbe-8dfd-cadc7ca5cffe tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:44.592719 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-caf53065-9278-48ee-acb7-8013260e38b4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:44.594231 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01d62815-e7a9-4bbe-8dfd-cadc7ca5cffe tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:44.599275 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01d62815-e7a9-4bbe-8dfd-cadc7ca5cffe tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:44.599989 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01d62815-e7a9-4bbe-8dfd-cadc7ca5cffe tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:44.636764 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-caf53065-9278-48ee-acb7-8013260e38b4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] HTTP exception thrown: Instance 58edde4b-1f8f-488b-a632-764122b7fa53 could not be found. Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-caf53065-9278-48ee-acb7-8013260e38b4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Request method failure captured: Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53 HTTP/1.1 Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGQfUFkRaZpx8Ervf8tFFTi2rPHeTz5yp3P6AALlFBL-AS-NRly_auvcOw6IF4GA2M26wePfcpwKJY19SpfodQNtJmjAOcJHRFlaYl_4nZ2XB0tg54sAqT66Vh_hj4JwrzIqBQLC6ThoYtsNslwWvjf_S_CfwZoC79uDpp91MzXU5FI Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: df4cb5022443461395424ace464a41e6 Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersAdminTestJSON-476267513 Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/df4cb5022443461395424ace464a41e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/df4cb5022443461395424ace464a41e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/df4cb5022443461395424ace464a41e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_df4cb5022443461395424ace464a41e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersAdminTestJSON-476267513 Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: df4cb5022443461395424ace464a41e6 Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersAdminTestJSON-476267513 Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersAdminTestJSON-476267513-project Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 8267303c2c734c10b081b154a1795b82 Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersAdminTestJSON-476267513-project Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 58edde4b-1f8f-488b-a632-764122b7fa53 could not be found. Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '58edde4b-1f8f-488b-a632-764122b7fa53'} Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58edde4b-1f8f-488b-a632-764122b7fa53 could not be found. Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58edde4b-1f8f-488b-a632-764122b7fa53 could not be found. Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:14:44.641981 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:14:44.656989 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:44.656989 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:14:44.656989 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:14:44.656989 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:14:44.656989 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:14:44.656989 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58edde4b-1f8f-488b-a632-764122b7fa53 could not be found. Jun 20 12:14:44.656989 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:14:44.660165 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-caf53065-9278-48ee-acb7-8013260e38b4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Returning 404 to user: Instance 58edde4b-1f8f-488b-a632-764122b7fa53 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:14:44.662088 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-caf53065-9278-48ee-acb7-8013260e38b4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53" status: 404 len: 111 microversion: 2.1 time: 0.125279 Jun 20 12:14:44.670582 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1890/3875] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:44 2022] GET /compute/v2.1/servers/58edde4b-1f8f-488b-a632-764122b7fa53 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:14:44.687649 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-864defd4-fce8-4bf1-a668-590678b50c65 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:44.689060 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-864defd4-fce8-4bf1-a668-590678b50c65 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:44.710143 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-864defd4-fce8-4bf1-a668-590678b50c65 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:44.711876 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-864defd4-fce8-4bf1-a668-590678b50c65 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:44.713740 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-864defd4-fce8-4bf1-a668-590678b50c65 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:44.715803 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-864defd4-fce8-4bf1-a668-590678b50c65 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:44.800539 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-864defd4-fce8-4bf1-a668-590678b50c65 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:14:44.978370 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-864defd4-fce8-4bf1-a668-590678b50c65 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 204 len: 0 microversion: 2.1 time: 0.304351 Jun 20 12:14:44.981727 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1891/3876] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:14:44 2022] DELETE /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:14:45.003066 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-261c3add-f705-4932-98a0-5b68abe549b7 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:45.015748 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-261c3add-f705-4932-98a0-5b68abe549b7 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] [instance: 1618debb-4bee-4c67-81b1-ef82968ac330] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:45.029983 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-261c3add-f705-4932-98a0-5b68abe549b7 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:45.031001 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-261c3add-f705-4932-98a0-5b68abe549b7 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:45.032065 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-261c3add-f705-4932-98a0-5b68abe549b7 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:45.038948 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-261c3add-f705-4932-98a0-5b68abe549b7 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:45.134641 n-d-master-1 devstack@n-api.service[119127]: INFO nova.network.security_group_api [None req-01d62815-e7a9-4bbe-8dfd-cadc7ca5cffe tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Adding security group 28c0eb35-8305-4659-a535-ec77f79ee581 to port e38fa345-839c-4384-9b05-edcedcb38cb6 Jun 20 12:14:45.295850 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-261c3add-f705-4932-98a0-5b68abe549b7 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:45.313188 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-261c3add-f705-4932-98a0-5b68abe549b7 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:45.318580 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-261c3add-f705-4932-98a0-5b68abe549b7 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:45.320591 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-261c3add-f705-4932-98a0-5b68abe549b7 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] 10.222.0.27 "GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330" status: 200 len: 1335 microversion: 2.57 time: 0.336320 Jun 20 12:14:45.323913 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1892/3877] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:44 2022] GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330 => generated 1335 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:45.336047 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-80e12eb3-ae12-4db3-8e5a-8b4e239b56c4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:45.339647 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-80e12eb3-ae12-4db3-8e5a-8b4e239b56c4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:45.352813 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80e12eb3-ae12-4db3-8e5a-8b4e239b56c4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:45.360647 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80e12eb3-ae12-4db3-8e5a-8b4e239b56c4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:45.363031 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80e12eb3-ae12-4db3-8e5a-8b4e239b56c4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:45.363488 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80e12eb3-ae12-4db3-8e5a-8b4e239b56c4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:45.933173 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-01d62815-e7a9-4bbe-8dfd-cadc7ca5cffe tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "POST /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf/action" status: 202 len: 0 microversion: 2.1 time: 1.383433 Jun 20 12:14:45.934206 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1986/3878] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:14:44 2022] POST /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf/action => generated 0 bytes in 1385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:14:45.939641 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0baa7a8d-e272-4fd2-a791-b384992c2271 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:45.940565 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0baa7a8d-e272-4fd2-a791-b384992c2271 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:45.959516 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0baa7a8d-e272-4fd2-a791-b384992c2271 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:45.966368 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0baa7a8d-e272-4fd2-a791-b384992c2271 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:45.971012 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0baa7a8d-e272-4fd2-a791-b384992c2271 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:45.971838 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0baa7a8d-e272-4fd2-a791-b384992c2271 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:46.142532 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0baa7a8d-e272-4fd2-a791-b384992c2271 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:46.152612 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0baa7a8d-e272-4fd2-a791-b384992c2271 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:46.170516 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0baa7a8d-e272-4fd2-a791-b384992c2271 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:46.179866 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0baa7a8d-e272-4fd2-a791-b384992c2271 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1605 microversion: 2.32 time: 0.244084 Jun 20 12:14:46.185051 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1987/3879] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:45 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1605 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:46.205095 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8b672e21-bd35-4c6b-b9e8-d5d63c533c3d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:46.205751 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8b672e21-bd35-4c6b-b9e8-d5d63c533c3d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:46.234397 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b672e21-bd35-4c6b-b9e8-d5d63c533c3d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:46.234877 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b672e21-bd35-4c6b-b9e8-d5d63c533c3d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:46.235705 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b672e21-bd35-4c6b-b9e8-d5d63c533c3d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:46.236154 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b672e21-bd35-4c6b-b9e8-d5d63c533c3d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:46.262392 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-80e12eb3-ae12-4db3-8e5a-8b4e239b56c4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:46.281556 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-80e12eb3-ae12-4db3-8e5a-8b4e239b56c4 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1469 microversion: 2.1 time: 0.953611 Jun 20 12:14:46.282390 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1893/3880] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:45 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1469 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:46.300002 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-292152ca-61ec-4d8f-9239-10d6744a998c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '.version_select at 0x7f607323aee0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:46.530668 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8b672e21-bd35-4c6b-b9e8-d5d63c533c3d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:46.542051 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8b672e21-bd35-4c6b-b9e8-d5d63c533c3d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:46.544285 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8b672e21-bd35-4c6b-b9e8-d5d63c533c3d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:46.545743 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8b672e21-bd35-4c6b-b9e8-d5d63c533c3d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1740 microversion: 2.20 time: 0.359654 Jun 20 12:14:46.546495 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1988/3881] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:46 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1740 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:46.551265 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-6ee531da-b78b-45f2-9be4-fb82b166c7b9 req-caacd08e-c2e9-4dbe-9804-57ee75121836 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a48784f9-f5d9-4379-b2ce-ba044db399cf", "tag": "e38fa345-839c-4384-9b05-edcedcb38cb6"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:46.560975 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-6ee531da-b78b-45f2-9be4-fb82b166c7b9 req-caacd08e-c2e9-4dbe-9804-57ee75121836 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:46.561624 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-6ee531da-b78b-45f2-9be4-fb82b166c7b9 req-caacd08e-c2e9-4dbe-9804-57ee75121836 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:46.580475 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-6ee531da-b78b-45f2-9be4-fb82b166c7b9 req-caacd08e-c2e9-4dbe-9804-57ee75121836 service nova] Creating event network-changed:e38fa345-839c-4384-9b05-edcedcb38cb6 for instance a48784f9-f5d9-4379-b2ce-ba044db399cf on n-h1-master-1 Jun 20 12:14:46.634414 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-6ee531da-b78b-45f2-9be4-fb82b166c7b9 req-caacd08e-c2e9-4dbe-9804-57ee75121836 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074376 Jun 20 12:14:46.647275 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1989/3882] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:14:46.667130 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bad33070-4414-460c-bbb2-6fa82c450fe3 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:46.667932 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bad33070-4414-460c-bbb2-6fa82c450fe3 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] [instance: 1618debb-4bee-4c67-81b1-ef82968ac330] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:46.686908 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bad33070-4414-460c-bbb2-6fa82c450fe3 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:46.689539 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bad33070-4414-460c-bbb2-6fa82c450fe3 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:46.690392 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bad33070-4414-460c-bbb2-6fa82c450fe3 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:46.694287 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bad33070-4414-460c-bbb2-6fa82c450fe3 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:46.811420 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bad33070-4414-460c-bbb2-6fa82c450fe3 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:46.813255 n-d-master-1 devstack@n-api.service[119128]: DEBUG neutronclient.v2_0.client [None req-292152ca-61ec-4d8f-9239-10d6744a998c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 28c0eb35-8305-4659-a535-ec77f79ee581 in use.", "detail": ""}} {{(pid=119128) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 20 12:14:46.814195 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-292152ca-61ec-4d8f-9239-10d6744a998c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] HTTP exception thrown: Security Group 28c0eb35-8305-4659-a535-ec77f79ee581 in use. Jun 20 12:14:46.814195 n-d-master-1 devstack@n-api.service[119128]: Neutron server returns request_ids: ['req-b63cf6fd-7c66-4cdb-8fcc-d7f9908c0fa3'] Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-292152ca-61ec-4d8f-9239-10d6744a998c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Request method failure captured: Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/os-security-groups/28c0eb35-8305-4659-a535-ec77f79ee581 HTTP/1.1 Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGRspEjgKJLgDEMUB1oxj39OHwxpAdW28qHUXtVohoyOClCgJsgd03GdT2hoi3BapXye_C7q25Fmx52K1II73Nmx91JaNXbL0TFFBm3DxndH_-8RQjkZz-YTJGFJgzzOjcuFROsmxi41ZdE0CTcrcS_WNFOPfY38q9VTNDmwM1zWfjI Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: b3edd75428794ea2b1cbd1b8413072cd Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: b3edd75428794ea2b1cbd1b8413072cd Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-SecurityGroupsTestJSON-1959389845-project Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: e8878b2fbb4b429288856159a644382f Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-SecurityGroupsTestJSON-1959389845-project Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: exception: Security Group 28c0eb35-8305-4659-a535-ec77f79ee581 in use. Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: Neutron server returns request_ids: ['req-b63cf6fd-7c66-4cdb-8fcc-d7f9908c0fa3'] Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '28c0eb35-8305-4659-a535-ec77f79ee581'} Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 20 12:14:46.816759 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 28c0eb35-8305-4659-a535-ec77f79ee581 in use. Jun 20 12:14:46.822653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b63cf6fd-7c66-4cdb-8fcc-d7f9908c0fa3'] Jun 20 12:14:46.822653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:14:46.822653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:14:46.822653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:14:46.822653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:46.822653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jun 20 12:14:46.822653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jun 20 12:14:46.822653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jun 20 12:14:46.822653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jun 20 12:14:46.822653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 28c0eb35-8305-4659-a535-ec77f79ee581 in use. Jun 20 12:14:46.822653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b63cf6fd-7c66-4cdb-8fcc-d7f9908c0fa3'] Jun 20 12:14:46.822653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:14:46.822653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:14:46.822653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:14:46.822653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:46.822653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:14:46.822653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:14:46.822653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:14:46.822653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:14:46.822653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:14:46.822653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:14:46.822653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:14:46.822653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:14:46.822653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jun 20 12:14:46.822653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 20 12:14:46.822653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 28c0eb35-8305-4659-a535-ec77f79ee581 in use. Jun 20 12:14:46.822653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b63cf6fd-7c66-4cdb-8fcc-d7f9908c0fa3'] Jun 20 12:14:46.822653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:14:46.822653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:14:46.822653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:14:46.822653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:46.822653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:14:46.822653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:14:46.822653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:14:46.822653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:14:46.822653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 28c0eb35-8305-4659-a535-ec77f79ee581 in use. Jun 20 12:14:46.822653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b63cf6fd-7c66-4cdb-8fcc-d7f9908c0fa3'] Jun 20 12:14:46.822653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:14:46.825759 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bad33070-4414-460c-bbb2-6fa82c450fe3 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:46.825759 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bad33070-4414-460c-bbb2-6fa82c450fe3 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:46.825759 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bad33070-4414-460c-bbb2-6fa82c450fe3 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] 10.222.0.27 "GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330" status: 200 len: 1335 microversion: 2.57 time: 0.174479 Jun 20 12:14:46.828236 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-292152ca-61ec-4d8f-9239-10d6744a998c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Returning 400 to user: Security Group 28c0eb35-8305-4659-a535-ec77f79ee581 in use. Jun 20 12:14:46.828236 n-d-master-1 devstack@n-api.service[119128]: Neutron server returns request_ids: ['req-b63cf6fd-7c66-4cdb-8fcc-d7f9908c0fa3'] {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:14:46.828236 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-292152ca-61ec-4d8f-9239-10d6744a998c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/28c0eb35-8305-4659-a535-ec77f79ee581" status: 400 len: 185 microversion: 2.1 time: 0.544801 Jun 20 12:14:46.832306 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1894/3883] 10.222.0.27 () {58 vars in 1271 bytes} [Mon Jun 20 12:14:46 2022] DELETE /compute/v2.1/os-security-groups/28c0eb35-8305-4659-a535-ec77f79ee581 => generated 185 bytes in 549 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:14:46.835163 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1990/3884] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:46 2022] GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330 => generated 1335 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:46.838626 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1ed9faa6-ff3a-459c-bc71-41e9ff0086ea tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:46.845090 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1ed9faa6-ff3a-459c-bc71-41e9ff0086ea tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: a48784f9-f5d9-4379-b2ce-ba044db399cf] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:46.866357 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1ed9faa6-ff3a-459c-bc71-41e9ff0086ea tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:46.867273 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1ed9faa6-ff3a-459c-bc71-41e9ff0086ea tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:46.868267 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1ed9faa6-ff3a-459c-bc71-41e9ff0086ea tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:46.868870 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1ed9faa6-ff3a-459c-bc71-41e9ff0086ea tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:46.922232 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1ed9faa6-ff3a-459c-bc71-41e9ff0086ea tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: a48784f9-f5d9-4379-b2ce-ba044db399cf] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:14:47.129800 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1ed9faa6-ff3a-459c-bc71-41e9ff0086ea tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf" status: 204 len: 0 microversion: 2.1 time: 0.296012 Jun 20 12:14:47.133810 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1895/3885] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:14:46 2022] DELETE /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:14:47.141028 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4ad06b9a-dec2-417a-b951-aad80e591c49 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:47.141776 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4ad06b9a-dec2-417a-b951-aad80e591c49 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: a48784f9-f5d9-4379-b2ce-ba044db399cf] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:47.159930 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4ad06b9a-dec2-417a-b951-aad80e591c49 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:47.160427 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4ad06b9a-dec2-417a-b951-aad80e591c49 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:47.167134 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4ad06b9a-dec2-417a-b951-aad80e591c49 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:47.170080 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4ad06b9a-dec2-417a-b951-aad80e591c49 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:47.207007 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f7af96d6-f52c-4b6e-a2da-2ca0c34894a5 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:47.208107 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f7af96d6-f52c-4b6e-a2da-2ca0c34894a5 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:47.236540 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7af96d6-f52c-4b6e-a2da-2ca0c34894a5 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:47.237209 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7af96d6-f52c-4b6e-a2da-2ca0c34894a5 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:47.238496 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7af96d6-f52c-4b6e-a2da-2ca0c34894a5 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:47.256525 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7af96d6-f52c-4b6e-a2da-2ca0c34894a5 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:47.435961 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f7af96d6-f52c-4b6e-a2da-2ca0c34894a5 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:47.445425 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f7af96d6-f52c-4b6e-a2da-2ca0c34894a5 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:47.446919 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f7af96d6-f52c-4b6e-a2da-2ca0c34894a5 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:47.448413 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f7af96d6-f52c-4b6e-a2da-2ca0c34894a5 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1605 microversion: 2.32 time: 0.248144 Jun 20 12:14:47.472650 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1896/3886] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:47 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1605 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:14:47.479506 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2a89d1dc-eb5c-4a20-98cc-c178b5867017 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:47.480777 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2a89d1dc-eb5c-4a20-98cc-c178b5867017 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:47.500573 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a89d1dc-eb5c-4a20-98cc-c178b5867017 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:47.501303 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a89d1dc-eb5c-4a20-98cc-c178b5867017 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:47.502248 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a89d1dc-eb5c-4a20-98cc-c178b5867017 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:47.502848 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a89d1dc-eb5c-4a20-98cc-c178b5867017 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:47.516324 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4ad06b9a-dec2-417a-b951-aad80e591c49 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:47.526671 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4ad06b9a-dec2-417a-b951-aad80e591c49 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf" status: 200 len: 1646 microversion: 2.1 time: 0.390986 Jun 20 12:14:47.532812 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1991/3887] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:47 2022] GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf => generated 1646 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:47.565047 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-30fecf8b-c285-4fc9-9871-b9fca8560274 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:47.565721 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-30fecf8b-c285-4fc9-9871-b9fca8560274 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:47.582518 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-30fecf8b-c285-4fc9-9871-b9fca8560274 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:47.582983 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-30fecf8b-c285-4fc9-9871-b9fca8560274 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:47.583796 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-30fecf8b-c285-4fc9-9871-b9fca8560274 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:47.584252 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-30fecf8b-c285-4fc9-9871-b9fca8560274 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:47.889902 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-30fecf8b-c285-4fc9-9871-b9fca8560274 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:47.904594 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-30fecf8b-c285-4fc9-9871-b9fca8560274 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:47.908190 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-30fecf8b-c285-4fc9-9871-b9fca8560274 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:47.911775 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-30fecf8b-c285-4fc9-9871-b9fca8560274 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1740 microversion: 2.20 time: 0.350855 Jun 20 12:14:47.916275 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1992/3888] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:47 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1740 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:47.925347 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-97d24114-f31a-413f-a149-207a4d4491f1 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:47.926065 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-97d24114-f31a-413f-a149-207a4d4491f1 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] [instance: 1618debb-4bee-4c67-81b1-ef82968ac330] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:47.941600 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-97d24114-f31a-413f-a149-207a4d4491f1 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:47.949424 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-97d24114-f31a-413f-a149-207a4d4491f1 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:47.949906 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-97d24114-f31a-413f-a149-207a4d4491f1 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:47.954771 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-97d24114-f31a-413f-a149-207a4d4491f1 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:48.020152 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2a89d1dc-eb5c-4a20-98cc-c178b5867017 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:48.030007 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2a89d1dc-eb5c-4a20-98cc-c178b5867017 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1469 microversion: 2.1 time: 0.556100 Jun 20 12:14:48.048311 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1897/3889] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:47 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1469 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:48.085013 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-97d24114-f31a-413f-a149-207a4d4491f1 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:48.100572 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-97d24114-f31a-413f-a149-207a4d4491f1 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:48.102404 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-97d24114-f31a-413f-a149-207a4d4491f1 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:48.106278 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-97d24114-f31a-413f-a149-207a4d4491f1 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] 10.222.0.27 "GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330" status: 200 len: 1335 microversion: 2.57 time: 0.192299 Jun 20 12:14:48.110271 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1993/3890] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:47 2022] GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330 => generated 1335 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:48.467477 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2fb01a1a-db15-4e67-85c4-ff59d955b358 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:48.468174 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2fb01a1a-db15-4e67-85c4-ff59d955b358 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:48.480285 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2fb01a1a-db15-4e67-85c4-ff59d955b358 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:48.485578 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2fb01a1a-db15-4e67-85c4-ff59d955b358 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:48.486555 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2fb01a1a-db15-4e67-85c4-ff59d955b358 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:48.487068 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2fb01a1a-db15-4e67-85c4-ff59d955b358 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:48.546676 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7f88038b-e754-4de1-a38e-3bcf198e08fa tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:48.547542 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7f88038b-e754-4de1-a38e-3bcf198e08fa tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: a48784f9-f5d9-4379-b2ce-ba044db399cf] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:48.557739 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7f88038b-e754-4de1-a38e-3bcf198e08fa tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:48.564967 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7f88038b-e754-4de1-a38e-3bcf198e08fa tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:48.566218 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7f88038b-e754-4de1-a38e-3bcf198e08fa tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:48.566900 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7f88038b-e754-4de1-a38e-3bcf198e08fa tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:48.736544 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7f88038b-e754-4de1-a38e-3bcf198e08fa tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:48.745258 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7f88038b-e754-4de1-a38e-3bcf198e08fa tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf" status: 200 len: 1646 microversion: 2.1 time: 0.202904 Jun 20 12:14:48.751340 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1994/3891] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:48 2022] GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf => generated 1646 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:48.877575 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2fb01a1a-db15-4e67-85c4-ff59d955b358 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:48.898908 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2fb01a1a-db15-4e67-85c4-ff59d955b358 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:48.903107 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2fb01a1a-db15-4e67-85c4-ff59d955b358 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:48.904714 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2fb01a1a-db15-4e67-85c4-ff59d955b358 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1605 microversion: 2.32 time: 0.441454 Jun 20 12:14:48.906824 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1898/3892] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:48 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1605 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:48.935423 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3f09dea0-15a2-48c8-8031-2056368adc32 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:48.936060 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3f09dea0-15a2-48c8-8031-2056368adc32 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:48.949132 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3f09dea0-15a2-48c8-8031-2056368adc32 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:48.949850 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3f09dea0-15a2-48c8-8031-2056368adc32 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:48.965473 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3f09dea0-15a2-48c8-8031-2056368adc32 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:48.965934 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3f09dea0-15a2-48c8-8031-2056368adc32 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:49.055510 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8e6684e2-a197-4b8c-b7dd-c165088fcbd3 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:49.056123 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8e6684e2-a197-4b8c-b7dd-c165088fcbd3 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:49.065641 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e6684e2-a197-4b8c-b7dd-c165088fcbd3 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:49.066110 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e6684e2-a197-4b8c-b7dd-c165088fcbd3 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:49.066926 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e6684e2-a197-4b8c-b7dd-c165088fcbd3 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:49.067346 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e6684e2-a197-4b8c-b7dd-c165088fcbd3 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:49.195922 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3f09dea0-15a2-48c8-8031-2056368adc32 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:49.208338 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3f09dea0-15a2-48c8-8031-2056368adc32 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:49.211269 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3f09dea0-15a2-48c8-8031-2056368adc32 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:49.213138 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3f09dea0-15a2-48c8-8031-2056368adc32 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1740 microversion: 2.20 time: 0.281696 Jun 20 12:14:49.214365 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1995/3893] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:48 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1740 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:49.220671 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9ecd0612-270a-4b87-9863-f48bd1c8befc tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:49.221700 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9ecd0612-270a-4b87-9863-f48bd1c8befc tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] [instance: 1618debb-4bee-4c67-81b1-ef82968ac330] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:49.229463 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ecd0612-270a-4b87-9863-f48bd1c8befc tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:49.230307 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ecd0612-270a-4b87-9863-f48bd1c8befc tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:49.231392 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ecd0612-270a-4b87-9863-f48bd1c8befc tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:49.232068 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ecd0612-270a-4b87-9863-f48bd1c8befc tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:49.306238 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9ecd0612-270a-4b87-9863-f48bd1c8befc tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:49.317244 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9ecd0612-270a-4b87-9863-f48bd1c8befc tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:49.319247 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9ecd0612-270a-4b87-9863-f48bd1c8befc tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:49.320834 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9ecd0612-270a-4b87-9863-f48bd1c8befc tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] 10.222.0.27 "GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330" status: 200 len: 1335 microversion: 2.57 time: 0.105033 Jun 20 12:14:49.321992 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1996/3894] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:49 2022] GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330 => generated 1335 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:49.346793 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1515c538-b346-44ef-84b5-beafe88dc52a tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:49.348581 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1515c538-b346-44ef-84b5-beafe88dc52a tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:49.363553 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1515c538-b346-44ef-84b5-beafe88dc52a tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:49.364265 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1515c538-b346-44ef-84b5-beafe88dc52a tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:49.365102 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1515c538-b346-44ef-84b5-beafe88dc52a tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:49.366642 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1515c538-b346-44ef-84b5-beafe88dc52a tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:49.802294 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8e6684e2-a197-4b8c-b7dd-c165088fcbd3 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8267303c2c734c10b081b154a1795b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4cb5022443461395424ace464a41e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:49.818871 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8e6684e2-a197-4b8c-b7dd-c165088fcbd3 tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 200 len: 1469 microversion: 2.1 time: 0.767801 Jun 20 12:14:49.821006 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1899/3895] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:49 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 1469 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:14:49.841521 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dcd97c7e-1093-4060-a54e-3fcaae3ad967 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:49.842442 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-dcd97c7e-1093-4060-a54e-3fcaae3ad967 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: a48784f9-f5d9-4379-b2ce-ba044db399cf] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:49.849319 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dcd97c7e-1093-4060-a54e-3fcaae3ad967 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:49.850081 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dcd97c7e-1093-4060-a54e-3fcaae3ad967 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:49.851100 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dcd97c7e-1093-4060-a54e-3fcaae3ad967 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:49.851697 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dcd97c7e-1093-4060-a54e-3fcaae3ad967 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:50.654650 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:50.657899 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1515c538-b346-44ef-84b5-beafe88dc52a tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1832 microversion: 2.1 time: 1.334436 Jun 20 12:14:50.664780 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1997/3896] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:49 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1832 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:50.691188 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4a96a261-6ae9-4ee8-943b-27b145572c21 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:50.692374 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4a96a261-6ae9-4ee8-943b-27b145572c21 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:50.708852 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4a96a261-6ae9-4ee8-943b-27b145572c21 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:50.720831 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4a96a261-6ae9-4ee8-943b-27b145572c21 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:50.722223 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4a96a261-6ae9-4ee8-943b-27b145572c21 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:50.722915 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4a96a261-6ae9-4ee8-943b-27b145572c21 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:51.042504 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4a96a261-6ae9-4ee8-943b-27b145572c21 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:51.056769 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4a96a261-6ae9-4ee8-943b-27b145572c21 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:51.058608 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4a96a261-6ae9-4ee8-943b-27b145572c21 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:51.059841 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4a96a261-6ae9-4ee8-943b-27b145572c21 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1605 microversion: 2.32 time: 0.379998 Jun 20 12:14:51.082685 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1998/3897] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:50 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1605 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:51.087945 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c771e1f4-8cc6-4710-a947-249d86121337 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:51.092513 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c771e1f4-8cc6-4710-a947-249d86121337 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:51.094621 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:51.103766 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c771e1f4-8cc6-4710-a947-249d86121337 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:51.105691 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c771e1f4-8cc6-4710-a947-249d86121337 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:51.106685 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c771e1f4-8cc6-4710-a947-249d86121337 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:51.107131 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c771e1f4-8cc6-4710-a947-249d86121337 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:51.121713 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-dcd97c7e-1093-4060-a54e-3fcaae3ad967 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:51.130691 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dcd97c7e-1093-4060-a54e-3fcaae3ad967 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf" status: 200 len: 1646 microversion: 2.1 time: 1.294128 Jun 20 12:14:51.147606 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1900/3898] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:49 2022] GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf => generated 1646 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:51.160686 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8aa47b29-a887-44c4-8cd3-ab44bfe65945 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:51.164405 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8aa47b29-a887-44c4-8cd3-ab44bfe65945 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] [instance: 1618debb-4bee-4c67-81b1-ef82968ac330] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:51.180032 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8aa47b29-a887-44c4-8cd3-ab44bfe65945 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:51.182875 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8aa47b29-a887-44c4-8cd3-ab44bfe65945 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:51.187214 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8aa47b29-a887-44c4-8cd3-ab44bfe65945 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:51.188617 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8aa47b29-a887-44c4-8cd3-ab44bfe65945 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:51.351705 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8aa47b29-a887-44c4-8cd3-ab44bfe65945 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:51.368189 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8aa47b29-a887-44c4-8cd3-ab44bfe65945 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:51.370649 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8aa47b29-a887-44c4-8cd3-ab44bfe65945 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:51.386184 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8aa47b29-a887-44c4-8cd3-ab44bfe65945 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] 10.222.0.27 "GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330" status: 200 len: 1356 microversion: 2.57 time: 0.236342 Jun 20 12:14:51.394816 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1901/3899] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:51 2022] GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330 => generated 1356 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:51.399586 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-2c5ac82b-23b9-4273-8e04-14ce4b78c881 req-8a0836fc-ce09-48a4-884c-e8f441081463 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5b82c0b-6c6a-4d96-a8b2-437d242334f2", "name": "network-vif-deleted", "tag": "37e16ff5-1455-4eef-bf70-355b74b7eff3"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:51.418263 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-2c5ac82b-23b9-4273-8e04-14ce4b78c881 req-8a0836fc-ce09-48a4-884c-e8f441081463 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:51.418607 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-2c5ac82b-23b9-4273-8e04-14ce4b78c881 req-8a0836fc-ce09-48a4-884c-e8f441081463 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:51.440556 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:51.446174 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-2c5ac82b-23b9-4273-8e04-14ce4b78c881 req-8a0836fc-ce09-48a4-884c-e8f441081463 service nova] Creating event network-vif-deleted:37e16ff5-1455-4eef-bf70-355b74b7eff3 for instance d5b82c0b-6c6a-4d96-a8b2-437d242334f2 on n-h2-master-1 Jun 20 12:14:51.458261 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-2c5ac82b-23b9-4273-8e04-14ce4b78c881 req-8a0836fc-ce09-48a4-884c-e8f441081463 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062155 Jun 20 12:14:51.465204 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1902/3900] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:14:51.492194 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8b188bf2-7cef-4a7d-9ce9-110b241ea69b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:51.493067 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8b188bf2-7cef-4a7d-9ce9-110b241ea69b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:51.507022 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8b188bf2-7cef-4a7d-9ce9-110b241ea69b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:51.508331 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8b188bf2-7cef-4a7d-9ce9-110b241ea69b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:51.510036 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8b188bf2-7cef-4a7d-9ce9-110b241ea69b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:51.510778 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8b188bf2-7cef-4a7d-9ce9-110b241ea69b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:51.580509 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c771e1f4-8cc6-4710-a947-249d86121337 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:51.594746 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c771e1f4-8cc6-4710-a947-249d86121337 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:51.604808 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c771e1f4-8cc6-4710-a947-249d86121337 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:51.634758 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c771e1f4-8cc6-4710-a947-249d86121337 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1740 microversion: 2.20 time: 0.535198 Jun 20 12:14:51.636560 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1999/3901] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:51 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1740 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:51.643227 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0e258ca1-ec46-461e-96e3-044e5efd143a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:51.644725 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0e258ca1-ec46-461e-96e3-044e5efd143a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] [instance: d5b82c0b-6c6a-4d96-a8b2-437d242334f2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:51.652340 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0e258ca1-ec46-461e-96e3-044e5efd143a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:51.653202 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0e258ca1-ec46-461e-96e3-044e5efd143a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:51.655132 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0e258ca1-ec46-461e-96e3-044e5efd143a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:51.657186 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0e258ca1-ec46-461e-96e3-044e5efd143a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:51.702542 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-0e258ca1-ec46-461e-96e3-044e5efd143a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] HTTP exception thrown: Instance d5b82c0b-6c6a-4d96-a8b2-437d242334f2 could not be found. Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0e258ca1-ec46-461e-96e3-044e5efd143a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Request method failure captured: Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 HTTP/1.1 Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGQfUFkRaZpx8Ervf8tFFTi2rPHeTz5yp3P6AALlFBL-AS-NRly_auvcOw6IF4GA2M26wePfcpwKJY19SpfodQNtJmjAOcJHRFlaYl_4nZ2XB0tg54sAqT66Vh_hj4JwrzIqBQLC6ThoYtsNslwWvjf_S_CfwZoC79uDpp91MzXU5FI Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: df4cb5022443461395424ace464a41e6 Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersAdminTestJSON-476267513 Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/df4cb5022443461395424ace464a41e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/df4cb5022443461395424ace464a41e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/df4cb5022443461395424ace464a41e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_df4cb5022443461395424ace464a41e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersAdminTestJSON-476267513 Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: df4cb5022443461395424ace464a41e6 Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersAdminTestJSON-476267513 Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersAdminTestJSON-476267513-project Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 8267303c2c734c10b081b154a1795b82 Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersAdminTestJSON-476267513-project Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: exception: Instance d5b82c0b-6c6a-4d96-a8b2-437d242334f2 could not be found. Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'd5b82c0b-6c6a-4d96-a8b2-437d242334f2'} Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5b82c0b-6c6a-4d96-a8b2-437d242334f2 could not be found. Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5b82c0b-6c6a-4d96-a8b2-437d242334f2 could not be found. Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:14:51.705867 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:51.710969 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:51.710969 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:14:51.710969 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:14:51.710969 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:14:51.710969 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:14:51.710969 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5b82c0b-6c6a-4d96-a8b2-437d242334f2 could not be found. Jun 20 12:14:51.710969 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:51.714621 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0e258ca1-ec46-461e-96e3-044e5efd143a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] Returning 404 to user: Instance d5b82c0b-6c6a-4d96-a8b2-437d242334f2 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:14:51.717311 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0e258ca1-ec46-461e-96e3-044e5efd143a tempest-ServersAdminTestJSON-476267513 tempest-ServersAdminTestJSON-476267513-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2" status: 404 len: 111 microversion: 2.1 time: 0.079232 Jun 20 12:14:51.724549 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2000/3902] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:51 2022] GET /compute/v2.1/servers/d5b82c0b-6c6a-4d96-a8b2-437d242334f2 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:14:51.732780 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9212a045-d5ad-4c0d-97b5-7190d2d162a2 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:51.745229 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9212a045-d5ad-4c0d-97b5-7190d2d162a2 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] [instance: 1618debb-4bee-4c67-81b1-ef82968ac330] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:51.776125 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9212a045-d5ad-4c0d-97b5-7190d2d162a2 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:51.776634 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9212a045-d5ad-4c0d-97b5-7190d2d162a2 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:51.777434 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9212a045-d5ad-4c0d-97b5-7190d2d162a2 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:51.780858 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9212a045-d5ad-4c0d-97b5-7190d2d162a2 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:51.961273 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-9212a045-d5ad-4c0d-97b5-7190d2d162a2 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:14:51.962010 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-9212a045-d5ad-4c0d-97b5-7190d2d162a2 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:14:51.962601 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-9212a045-d5ad-4c0d-97b5-7190d2d162a2 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:14:51.964728 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-9212a045-d5ad-4c0d-97b5-7190d2d162a2 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:14:51.965282 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-9212a045-d5ad-4c0d-97b5-7190d2d162a2 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:14:52.110421 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9212a045-d5ad-4c0d-97b5-7190d2d162a2 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] [instance: 1618debb-4bee-4c67-81b1-ef82968ac330] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:52.135390 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9212a045-d5ad-4c0d-97b5-7190d2d162a2 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:52.140744 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9212a045-d5ad-4c0d-97b5-7190d2d162a2 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:52.141751 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9212a045-d5ad-4c0d-97b5-7190d2d162a2 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:52.144560 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9212a045-d5ad-4c0d-97b5-7190d2d162a2 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:52.208188 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9212a045-d5ad-4c0d-97b5-7190d2d162a2 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] 10.222.0.27 "POST /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330/action" status: 202 len: 1137 microversion: 2.57 time: 0.481898 Jun 20 12:14:52.209378 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2001/3903] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Jun 20 12:14:51 2022] POST /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330/action => generated 1137 bytes in 484 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jun 20 12:14:52.214516 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ea3644e1-bef0-4845-a91a-7d5817fb51bc tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:52.218167 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ea3644e1-bef0-4845-a91a-7d5817fb51bc tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:52.230155 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea3644e1-bef0-4845-a91a-7d5817fb51bc tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:52.236864 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea3644e1-bef0-4845-a91a-7d5817fb51bc tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:52.239714 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea3644e1-bef0-4845-a91a-7d5817fb51bc tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:52.240604 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea3644e1-bef0-4845-a91a-7d5817fb51bc tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:52.408472 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=8 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:52.495328 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ea3644e1-bef0-4845-a91a-7d5817fb51bc tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:52.514705 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ea3644e1-bef0-4845-a91a-7d5817fb51bc tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:52.523110 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ea3644e1-bef0-4845-a91a-7d5817fb51bc tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:52.532666 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ea3644e1-bef0-4845-a91a-7d5817fb51bc tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1605 microversion: 2.32 time: 0.321756 Jun 20 12:14:52.548636 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2002/3904] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:52 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1605 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:52.553735 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8a6075fe-a714-4559-ad6c-0e1974749be4 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:52.565023 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8a6075fe-a714-4559-ad6c-0e1974749be4 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: a48784f9-f5d9-4379-b2ce-ba044db399cf] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:52.602908 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a6075fe-a714-4559-ad6c-0e1974749be4 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:52.603564 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a6075fe-a714-4559-ad6c-0e1974749be4 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:52.608855 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a6075fe-a714-4559-ad6c-0e1974749be4 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:52.609326 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a6075fe-a714-4559-ad6c-0e1974749be4 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:52.818059 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8b188bf2-7cef-4a7d-9ce9-110b241ea69b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:52.850756 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8b188bf2-7cef-4a7d-9ce9-110b241ea69b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1681 microversion: 2.1 time: 1.384607 Jun 20 12:14:52.858002 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1903/3905] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:51 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1681 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:52.877748 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a3a447ab-757a-4f92-90e6-69fb466ed148 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:52.878784 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a3a447ab-757a-4f92-90e6-69fb466ed148 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] [instance: 1618debb-4bee-4c67-81b1-ef82968ac330] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:52.902167 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3a447ab-757a-4f92-90e6-69fb466ed148 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:52.903062 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3a447ab-757a-4f92-90e6-69fb466ed148 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:52.904112 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3a447ab-757a-4f92-90e6-69fb466ed148 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:52.908419 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3a447ab-757a-4f92-90e6-69fb466ed148 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:52.979839 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8a6075fe-a714-4559-ad6c-0e1974749be4 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:53.000584 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8a6075fe-a714-4559-ad6c-0e1974749be4 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf" status: 200 len: 1467 microversion: 2.1 time: 0.460006 Jun 20 12:14:53.006549 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2003/3906] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:52 2022] GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf => generated 1467 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:53.012411 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-afb4a185-cecb-48e2-bf08-8526490cbcc6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:53.022734 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-afb4a185-cecb-48e2-bf08-8526490cbcc6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:53.042187 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-afb4a185-cecb-48e2-bf08-8526490cbcc6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:53.051110 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-afb4a185-cecb-48e2-bf08-8526490cbcc6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:53.052266 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-afb4a185-cecb-48e2-bf08-8526490cbcc6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:53.052840 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-afb4a185-cecb-48e2-bf08-8526490cbcc6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:53.153858 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a3a447ab-757a-4f92-90e6-69fb466ed148 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:53.163529 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:53.187412 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a3a447ab-757a-4f92-90e6-69fb466ed148 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:53.190144 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a3a447ab-757a-4f92-90e6-69fb466ed148 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:53.196994 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a3a447ab-757a-4f92-90e6-69fb466ed148 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] 10.222.0.27 "GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330" status: 200 len: 1365 microversion: 2.57 time: 0.334884 Jun 20 12:14:53.198873 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1904/3907] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:52 2022] GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330 => generated 1365 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:53.205720 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a6548d56-120d-4c90-9769-695298489f7b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:53.207300 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a6548d56-120d-4c90-9769-695298489f7b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:53.225749 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6548d56-120d-4c90-9769-695298489f7b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:53.226382 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6548d56-120d-4c90-9769-695298489f7b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:53.227370 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6548d56-120d-4c90-9769-695298489f7b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:53.228549 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6548d56-120d-4c90-9769-695298489f7b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:53.372899 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a6548d56-120d-4c90-9769-695298489f7b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "POST /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d/action" status: 200 len: 32641 microversion: 2.1 time: 0.145259 Jun 20 12:14:53.378354 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1905/3908] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:14:53 2022] POST /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d/action => generated 32641 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:14:53.449487 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-95896f24-4872-437f-9234-1acb2c281912 req-ce632785-0d41-4543-b9ba-fdc1a4a102f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a48784f9-f5d9-4379-b2ce-ba044db399cf", "name": "network-vif-deleted", "tag": "e38fa345-839c-4384-9b05-edcedcb38cb6"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:53.486374 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-95896f24-4872-437f-9234-1acb2c281912 req-ce632785-0d41-4543-b9ba-fdc1a4a102f8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:53.497432 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-95896f24-4872-437f-9234-1acb2c281912 req-ce632785-0d41-4543-b9ba-fdc1a4a102f8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:53.539931 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-95896f24-4872-437f-9234-1acb2c281912 req-ce632785-0d41-4543-b9ba-fdc1a4a102f8 service nova] Creating event network-vif-deleted:e38fa345-839c-4384-9b05-edcedcb38cb6 for instance a48784f9-f5d9-4379-b2ce-ba044db399cf on n-h1-master-1 Jun 20 12:14:53.567184 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-95896f24-4872-437f-9234-1acb2c281912 req-ce632785-0d41-4543-b9ba-fdc1a4a102f8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122627 Jun 20 12:14:53.573581 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1906/3909] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:14:53.583423 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3e9be037-51d2-480e-8a97-49c6e4063726 tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:53.593306 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3e9be037-51d2-480e-8a97-49c6e4063726 tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:53.619203 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3e9be037-51d2-480e-8a97-49c6e4063726 tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:53.620500 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3e9be037-51d2-480e-8a97-49c6e4063726 tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:53.624745 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3e9be037-51d2-480e-8a97-49c6e4063726 tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:53.628241 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3e9be037-51d2-480e-8a97-49c6e4063726 tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:53.735489 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3e9be037-51d2-480e-8a97-49c6e4063726 tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '00aa0441206b44f4804596a9a318ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74d89ecbb8d40f5b131e71d2701dded', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:53.736121 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3e9be037-51d2-480e-8a97-49c6e4063726 tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] flavor_id is None. Assuming migration. {{(pid=119128) resize /opt/stack/nova/nova/compute/api.py:4142}} Jun 20 12:14:53.736629 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3e9be037-51d2-480e-8a97-49c6e4063726 tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119128) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 20 12:14:54.202544 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-afb4a185-cecb-48e2-bf08-8526490cbcc6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:54.215680 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-afb4a185-cecb-48e2-bf08-8526490cbcc6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:54.220289 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-afb4a185-cecb-48e2-bf08-8526490cbcc6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:54.223578 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-afb4a185-cecb-48e2-bf08-8526490cbcc6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1740 microversion: 2.20 time: 1.215716 Jun 20 12:14:54.232659 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2004/3910] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:53 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1740 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:54.245654 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9777ae5c-95e1-4aa4-82a8-d71e9a97fb8f tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:54.246968 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9777ae5c-95e1-4aa4-82a8-d71e9a97fb8f tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:54.263083 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9777ae5c-95e1-4aa4-82a8-d71e9a97fb8f tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:54.263853 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9777ae5c-95e1-4aa4-82a8-d71e9a97fb8f tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:54.265599 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9777ae5c-95e1-4aa4-82a8-d71e9a97fb8f tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:54.267727 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9777ae5c-95e1-4aa4-82a8-d71e9a97fb8f tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:54.547869 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9777ae5c-95e1-4aa4-82a8-d71e9a97fb8f tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:54.570073 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9777ae5c-95e1-4aa4-82a8-d71e9a97fb8f tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:54.572458 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9777ae5c-95e1-4aa4-82a8-d71e9a97fb8f tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:54.576250 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9777ae5c-95e1-4aa4-82a8-d71e9a97fb8f tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1605 microversion: 2.32 time: 0.342067 Jun 20 12:14:54.594029 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2005/3911] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:54 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1605 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:54.611631 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f076fd42-72b6-4631-86b3-e8cf4f64df71 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:54.613257 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f076fd42-72b6-4631-86b3-e8cf4f64df71 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: a48784f9-f5d9-4379-b2ce-ba044db399cf] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:54.621381 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f076fd42-72b6-4631-86b3-e8cf4f64df71 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:54.622750 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f076fd42-72b6-4631-86b3-e8cf4f64df71 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:54.624033 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f076fd42-72b6-4631-86b3-e8cf4f64df71 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:54.624757 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f076fd42-72b6-4631-86b3-e8cf4f64df71 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:54.670274 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-f076fd42-72b6-4631-86b3-e8cf4f64df71 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] HTTP exception thrown: Instance a48784f9-f5d9-4379-b2ce-ba044db399cf could not be found. Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f076fd42-72b6-4631-86b3-e8cf4f64df71 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Request method failure captured: Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf HTTP/1.1 Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGRspEjgKJLgDEMUB1oxj39OHwxpAdW28qHUXtVohoyOClCgJsgd03GdT2hoi3BapXye_C7q25Fmx52K1II73Nmx91JaNXbL0TFFBm3DxndH_-8RQjkZz-YTJGFJgzzOjcuFROsmxi41ZdE0CTcrcS_WNFOPfY38q9VTNDmwM1zWfjI Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: b3edd75428794ea2b1cbd1b8413072cd Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: b3edd75428794ea2b1cbd1b8413072cd Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-SecurityGroupsTestJSON-1959389845-project Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: e8878b2fbb4b429288856159a644382f Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-SecurityGroupsTestJSON-1959389845-project Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: exception: Instance a48784f9-f5d9-4379-b2ce-ba044db399cf could not be found. Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'a48784f9-f5d9-4379-b2ce-ba044db399cf'} Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a48784f9-f5d9-4379-b2ce-ba044db399cf could not be found. Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a48784f9-f5d9-4379-b2ce-ba044db399cf could not be found. Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:14:54.672412 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:54.677945 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:14:54.677945 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:14:54.677945 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:14:54.677945 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:14:54.677945 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:14:54.677945 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a48784f9-f5d9-4379-b2ce-ba044db399cf could not be found. Jun 20 12:14:54.677945 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:14:54.680467 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f076fd42-72b6-4631-86b3-e8cf4f64df71 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Returning 404 to user: Instance a48784f9-f5d9-4379-b2ce-ba044db399cf could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:14:54.681739 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f076fd42-72b6-4631-86b3-e8cf4f64df71 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf" status: 404 len: 111 microversion: 2.1 time: 0.086052 Jun 20 12:14:54.683308 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2006/3912] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:54 2022] GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:14:54.690876 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-537f46f6-7889-4d34-81f2-e85500969bf6 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:54.691810 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-537f46f6-7889-4d34-81f2-e85500969bf6 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] [instance: 1618debb-4bee-4c67-81b1-ef82968ac330] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:54.731848 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-537f46f6-7889-4d34-81f2-e85500969bf6 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:54.732854 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-537f46f6-7889-4d34-81f2-e85500969bf6 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:54.735481 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-537f46f6-7889-4d34-81f2-e85500969bf6 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:54.736226 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-537f46f6-7889-4d34-81f2-e85500969bf6 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:54.919117 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3e9be037-51d2-480e-8a97-49c6e4063726 tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d/action" status: 202 len: 0 microversion: 2.1 time: 1.340543 Jun 20 12:14:54.930719 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1907/3913] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:14:53 2022] POST /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d/action => generated 0 bytes in 1356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:14:54.939547 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c4bd82ed-4fe3-4e16-ae6f-404656da5258 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '.version_select at 0x7f6073c31f70>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:55.083632 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-537f46f6-7889-4d34-81f2-e85500969bf6 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:55.096737 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-537f46f6-7889-4d34-81f2-e85500969bf6 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:55.101588 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-537f46f6-7889-4d34-81f2-e85500969bf6 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:55.103160 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-537f46f6-7889-4d34-81f2-e85500969bf6 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] 10.222.0.27 "GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330" status: 200 len: 1365 microversion: 2.57 time: 0.418429 Jun 20 12:14:55.103893 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2007/3914] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:54 2022] GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330 => generated 1365 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:55.120582 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c5ccfb8b-b723-476e-8ce6-cbddd8303f0f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:55.121713 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c5ccfb8b-b723-476e-8ce6-cbddd8303f0f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:55.134411 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c5ccfb8b-b723-476e-8ce6-cbddd8303f0f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:55.141125 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c5ccfb8b-b723-476e-8ce6-cbddd8303f0f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:55.142241 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c5ccfb8b-b723-476e-8ce6-cbddd8303f0f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:55.142927 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c5ccfb8b-b723-476e-8ce6-cbddd8303f0f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:55.495851 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c5ccfb8b-b723-476e-8ce6-cbddd8303f0f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:55.510268 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c5ccfb8b-b723-476e-8ce6-cbddd8303f0f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1690 microversion: 2.1 time: 0.404345 Jun 20 12:14:55.512502 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2008/3915] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:55 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1690 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:55.517715 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b83792bf-5dcd-488d-b182-9c680316579c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:55.523941 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b83792bf-5dcd-488d-b182-9c680316579c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:55.542640 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b83792bf-5dcd-488d-b182-9c680316579c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:55.544775 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b83792bf-5dcd-488d-b182-9c680316579c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:55.545892 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b83792bf-5dcd-488d-b182-9c680316579c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:55.548822 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b83792bf-5dcd-488d-b182-9c680316579c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:56.260937 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c4bd82ed-4fe3-4e16-ae6f-404656da5258 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/6758fb01-190a-4735-a508-abaf71742ac4" status: 202 len: 0 microversion: 2.1 time: 1.327073 Jun 20 12:14:56.262465 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1908/3916] 10.222.0.27 () {58 vars in 1271 bytes} [Mon Jun 20 12:14:54 2022] DELETE /compute/v2.1/os-security-groups/6758fb01-190a-4735-a508-abaf71742ac4 => generated 0 bytes in 1331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:14:56.268651 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4d9f5574-254e-4454-908e-ae092a4a830e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:56.269690 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4d9f5574-254e-4454-908e-ae092a4a830e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:56.291445 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4d9f5574-254e-4454-908e-ae092a4a830e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:56.294901 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4d9f5574-254e-4454-908e-ae092a4a830e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:56.296478 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4d9f5574-254e-4454-908e-ae092a4a830e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:56.299993 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4d9f5574-254e-4454-908e-ae092a4a830e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:56.499323 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b83792bf-5dcd-488d-b182-9c680316579c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:56.509790 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4d9f5574-254e-4454-908e-ae092a4a830e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:56.515375 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b83792bf-5dcd-488d-b182-9c680316579c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:56.519524 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4d9f5574-254e-4454-908e-ae092a4a830e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:56.521068 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4d9f5574-254e-4454-908e-ae092a4a830e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:56.522172 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b83792bf-5dcd-488d-b182-9c680316579c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:56.526702 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b83792bf-5dcd-488d-b182-9c680316579c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1740 microversion: 2.20 time: 1.009982 Jun 20 12:14:56.528044 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2009/3917] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:55 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1740 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:56.541051 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2dd75e9e-5aaf-436a-8947-d664ca102123 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:56.542291 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2dd75e9e-5aaf-436a-8947-d664ca102123 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] [instance: 1618debb-4bee-4c67-81b1-ef82968ac330] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:56.551847 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4d9f5574-254e-4454-908e-ae092a4a830e tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1605 microversion: 2.32 time: 0.288045 Jun 20 12:14:56.552494 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1909/3918] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:56 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1605 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:56.561944 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2dd75e9e-5aaf-436a-8947-d664ca102123 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:56.562789 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2dd75e9e-5aaf-436a-8947-d664ca102123 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:56.564558 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2dd75e9e-5aaf-436a-8947-d664ca102123 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:56.567264 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2dd75e9e-5aaf-436a-8947-d664ca102123 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:56.570748 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9ffa3b8e-c6bc-45a4-8a0b-08c2d2ffd35c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '.version_select at 0x7f60731b3700>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:56.715506 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2dd75e9e-5aaf-436a-8947-d664ca102123 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:56.724135 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2dd75e9e-5aaf-436a-8947-d664ca102123 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:56.736580 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2dd75e9e-5aaf-436a-8947-d664ca102123 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:56.738882 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2dd75e9e-5aaf-436a-8947-d664ca102123 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] 10.222.0.27 "GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330" status: 200 len: 1365 microversion: 2.57 time: 0.208821 Jun 20 12:14:56.739942 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2010/3919] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:56 2022] GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330 => generated 1365 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:56.755456 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-30b9e761-e043-4c8e-ac3a-f3d086a36cdc tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:56.756460 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-30b9e761-e043-4c8e-ac3a-f3d086a36cdc tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:56.778209 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-30b9e761-e043-4c8e-ac3a-f3d086a36cdc tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:56.778981 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-30b9e761-e043-4c8e-ac3a-f3d086a36cdc tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:56.781639 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-30b9e761-e043-4c8e-ac3a-f3d086a36cdc tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:56.782332 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-30b9e761-e043-4c8e-ac3a-f3d086a36cdc tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:57.368859 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-30b9e761-e043-4c8e-ac3a-f3d086a36cdc tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:57.381544 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-30b9e761-e043-4c8e-ac3a-f3d086a36cdc tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1690 microversion: 2.1 time: 0.639718 Jun 20 12:14:57.390552 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2011/3920] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:56 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1690 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:14:57.593527 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9ffa3b8e-c6bc-45a4-8a0b-08c2d2ffd35c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/28c0eb35-8305-4659-a535-ec77f79ee581" status: 202 len: 0 microversion: 2.1 time: 1.027302 Jun 20 12:14:57.595183 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1910/3921] 10.222.0.27 () {58 vars in 1271 bytes} [Mon Jun 20 12:14:56 2022] DELETE /compute/v2.1/os-security-groups/28c0eb35-8305-4659-a535-ec77f79ee581 => generated 0 bytes in 1042 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:14:57.602076 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6868cd54-949b-47a6-aa65-b27f0a58a666 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:57.603038 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6868cd54-949b-47a6-aa65-b27f0a58a666 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:57.653772 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6868cd54-949b-47a6-aa65-b27f0a58a666 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:57.654288 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6868cd54-949b-47a6-aa65-b27f0a58a666 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:57.655116 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6868cd54-949b-47a6-aa65-b27f0a58a666 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:57.655564 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6868cd54-949b-47a6-aa65-b27f0a58a666 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:58.234440 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2d6fb26e-0724-486b-bfcf-af9b0d5486a5 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Action: 'create', calling method: .version_select at 0x7f60739619d0>, body: {"keypair": {"name": "tempest-keypair-2065009109", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/zJcQRpJCQKw8v66wP/S1DqhsomVehHDfsPT8nUzh1iVklh6ytAGu4jgbweavMtGA1RwTOJaXWeWgMl8snvC3IG2+hAAyjfkbT4yeO96lNyf2dHsd4j26ZqTK2ALWfrQ=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:58.276445 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-2d6fb26e-0724-486b-bfcf-af9b0d5486a5 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Getting quotas for project 90924e1b14d448668fa43d6845ff3e05. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:14:58.314943 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-2d6fb26e-0724-486b-bfcf-af9b0d5486a5 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Getting quotas for user c58864ab3af344f180e02cc95e5cd9ee and project 90924e1b14d448668fa43d6845ff3e05. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:14:58.440888 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2d6fb26e-0724-486b-bfcf-af9b0d5486a5 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.048654 Jun 20 12:14:58.441544 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2012/3922] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 12:14:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:14:58.454597 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c45dd672-450b-407a-80dd-8f752a80ad72 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:58.476531 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c45dd672-450b-407a-80dd-8f752a80ad72 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:58.521347 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c45dd672-450b-407a-80dd-8f752a80ad72 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:58.524919 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c45dd672-450b-407a-80dd-8f752a80ad72 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:58.531095 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6868cd54-949b-47a6-aa65-b27f0a58a666 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:58.562355 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c45dd672-450b-407a-80dd-8f752a80ad72 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:58.566844 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c45dd672-450b-407a-80dd-8f752a80ad72 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:58.571767 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6868cd54-949b-47a6-aa65-b27f0a58a666 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:58.587274 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6868cd54-949b-47a6-aa65-b27f0a58a666 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:58.591208 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6868cd54-949b-47a6-aa65-b27f0a58a666 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1740 microversion: 2.20 time: 0.994700 Jun 20 12:14:58.597039 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1911/3923] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:57 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1740 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:58.615835 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-75982d78-09e9-44a5-a2c6-3bc35f4c4481 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Action: 'create', calling method: .version_select at 0x7f60731fb9d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-686125844", "description": "tempest-description-541307148"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:58.978212 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c45dd672-450b-407a-80dd-8f752a80ad72 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:59.001600 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c45dd672-450b-407a-80dd-8f752a80ad72 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:59.005830 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c45dd672-450b-407a-80dd-8f752a80ad72 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76416b44294f4adb8320be6c3032cf35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fb9d01363f47cb9b0e019ad014de68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:59.009869 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c45dd672-450b-407a-80dd-8f752a80ad72 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 200 len: 1605 microversion: 2.32 time: 0.566274 Jun 20 12:14:59.029222 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2013/3924] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:58 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 1605 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:59.048611 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-16c3d6d7-b429-44fa-8cbe-b50e46ba8d89 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:59.049251 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-16c3d6d7-b429-44fa-8cbe-b50e46ba8d89 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] [instance: 1618debb-4bee-4c67-81b1-ef82968ac330] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:59.068821 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-16c3d6d7-b429-44fa-8cbe-b50e46ba8d89 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:59.069291 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-16c3d6d7-b429-44fa-8cbe-b50e46ba8d89 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:59.070139 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-16c3d6d7-b429-44fa-8cbe-b50e46ba8d89 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:59.083300 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-16c3d6d7-b429-44fa-8cbe-b50e46ba8d89 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:59.336581 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-75982d78-09e9-44a5-a2c6-3bc35f4c4481 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.736969 Jun 20 12:14:59.337196 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1912/3925] 10.222.0.27 () {60 vars in 1179 bytes} [Mon Jun 20 12:14:58 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:14:59.342873 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-15f3f656-5ad6-4afb-8fd0-c5cca5d41ab4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:59.343850 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-15f3f656-5ad6-4afb-8fd0-c5cca5d41ab4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:14:59.353591 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-16c3d6d7-b429-44fa-8cbe-b50e46ba8d89 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:59.356572 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:59.368730 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-15f3f656-5ad6-4afb-8fd0-c5cca5d41ab4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:59.369224 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-15f3f656-5ad6-4afb-8fd0-c5cca5d41ab4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:59.370294 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-15f3f656-5ad6-4afb-8fd0-c5cca5d41ab4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:59.380599 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-16c3d6d7-b429-44fa-8cbe-b50e46ba8d89 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:59.382592 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-15f3f656-5ad6-4afb-8fd0-c5cca5d41ab4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:59.386607 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-16c3d6d7-b429-44fa-8cbe-b50e46ba8d89 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:59.397953 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-16c3d6d7-b429-44fa-8cbe-b50e46ba8d89 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] 10.222.0.27 "GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330" status: 200 len: 1365 microversion: 2.57 time: 0.365735 Jun 20 12:14:59.414474 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2014/3926] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:59 2022] GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330 => generated 1365 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:14:59.456080 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-40841f3c-6fdb-4ac7-8f03-236574f43c4f tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Action: 'update', calling method: .version_select at 0x7f6073a8e4c0>, body: {"security_group": {"name": "tempest-sg-hth-1877693549", "description": "tempest-description-hth-2137067011"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:14:59.974362 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-15f3f656-5ad6-4afb-8fd0-c5cca5d41ab4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:14:59.985975 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-15f3f656-5ad6-4afb-8fd0-c5cca5d41ab4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1690 microversion: 2.1 time: 0.646811 Jun 20 12:14:59.989324 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1913/3927] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:14:59 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1690 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:00.011264 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-08fab605-4440-4219-b64a-5f6e67fa67e1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:00.011982 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-08fab605-4440-4219-b64a-5f6e67fa67e1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:00.029707 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-08fab605-4440-4219-b64a-5f6e67fa67e1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:00.030129 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-08fab605-4440-4219-b64a-5f6e67fa67e1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:00.031051 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-08fab605-4440-4219-b64a-5f6e67fa67e1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:00.031866 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-08fab605-4440-4219-b64a-5f6e67fa67e1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:00.351233 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-40841f3c-6fdb-4ac7-8f03-236574f43c4f tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "PUT /compute/v2.1/os-security-groups/959e5191-f917-456d-96a0-26ccf6d92046" status: 200 len: 218 microversion: 2.1 time: 0.934039 Jun 20 12:15:00.352453 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2015/3928] 10.222.0.27 () {60 vars in 1289 bytes} [Mon Jun 20 12:14:59 2022] PUT /compute/v2.1/os-security-groups/959e5191-f917-456d-96a0-26ccf6d92046 => generated 218 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:15:00.357562 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cf0bd437-86c7-4a19-a237-ff279db97218 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:00.359086 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cf0bd437-86c7-4a19-a237-ff279db97218 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:00.372696 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cf0bd437-86c7-4a19-a237-ff279db97218 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:00.373157 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cf0bd437-86c7-4a19-a237-ff279db97218 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:00.373953 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cf0bd437-86c7-4a19-a237-ff279db97218 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:00.374395 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cf0bd437-86c7-4a19-a237-ff279db97218 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:00.437604 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-cf0bd437-86c7-4a19-a237-ff279db97218 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] HTTP exception thrown: Instance 36218945-42bd-45a4-889b-b411acdd4155 could not be found. Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cf0bd437-86c7-4a19-a237-ff279db97218 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Request method failure captured: Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 HTTP/1.1 Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGMtImrJbHndLBVoYOWoM3-V65gwaM_b_SzGPFkbszHqcLiFATjdW7DICvq4pkpgFYkMuCfhOGTLkBEfmLHGcQuUe69QWj9nbWfBGNnLxsZxvGdf_4HabUKas7EJzbQact9Y0ylsnVFlMkidmReSXTiLL3q1d65kobbcwpxem_TmW9M Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: X-Openstack-Nova-Api-Version: 2.32 Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 82fb9d01363f47cb9b0e019ad014de68 Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-TaggedBootDevicesTest-347005369 Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/82fb9d01363f47cb9b0e019ad014de68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/82fb9d01363f47cb9b0e019ad014de68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/82fb9d01363f47cb9b0e019ad014de68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_82fb9d01363f47cb9b0e019ad014de68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-TaggedBootDevicesTest-347005369 Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 82fb9d01363f47cb9b0e019ad014de68 Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-TaggedBootDevicesTest-347005369 Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-TaggedBootDevicesTest-347005369-project Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 76416b44294f4adb8320be6c3032cf35 Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-TaggedBootDevicesTest-347005369-project Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 36218945-42bd-45a4-889b-b411acdd4155 could not be found. Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '36218945-42bd-45a4-889b-b411acdd4155'} Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36218945-42bd-45a4-889b-b411acdd4155 could not be found. Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36218945-42bd-45a4-889b-b411acdd4155 could not be found. Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:15:00.445506 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:15:00.455314 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:00.455314 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:15:00.455314 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:15:00.455314 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:15:00.455314 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:15:00.455314 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36218945-42bd-45a4-889b-b411acdd4155 could not be found. Jun 20 12:15:00.455314 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:15:00.455314 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cf0bd437-86c7-4a19-a237-ff279db97218 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Returning 404 to user: Instance 36218945-42bd-45a4-889b-b411acdd4155 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:15:00.470134 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cf0bd437-86c7-4a19-a237-ff279db97218 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 404 len: 111 microversion: 2.32 time: 0.102459 Jun 20 12:15:00.470134 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2016/3929] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:00 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:15:00.470134 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f66abaee-b189-449b-a954-7a118b3d3af6 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '.version_select at 0x7f6073a8e9d0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:00.534413 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-08fab605-4440-4219-b64a-5f6e67fa67e1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:00.549113 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-08fab605-4440-4219-b64a-5f6e67fa67e1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:00.555398 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-08fab605-4440-4219-b64a-5f6e67fa67e1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:00.558364 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-08fab605-4440-4219-b64a-5f6e67fa67e1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1740 microversion: 2.20 time: 0.567882 Jun 20 12:15:00.561819 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1914/3930] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:14:59 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1740 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:00.578019 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3811bcb2-e44d-4937-959a-43f31ff33eb1 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:00.581105 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3811bcb2-e44d-4937-959a-43f31ff33eb1 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] [instance: 1618debb-4bee-4c67-81b1-ef82968ac330] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:00.608017 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3811bcb2-e44d-4937-959a-43f31ff33eb1 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:00.610693 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3811bcb2-e44d-4937-959a-43f31ff33eb1 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:00.612652 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3811bcb2-e44d-4937-959a-43f31ff33eb1 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:00.613723 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3811bcb2-e44d-4937-959a-43f31ff33eb1 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:00.731654 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3811bcb2-e44d-4937-959a-43f31ff33eb1 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:00.744175 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f66abaee-b189-449b-a954-7a118b3d3af6 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/959e5191-f917-456d-96a0-26ccf6d92046" status: 200 len: 218 microversion: 2.1 time: 0.278785 Jun 20 12:15:00.745273 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2017/3931] 10.222.0.27 () {58 vars in 1268 bytes} [Mon Jun 20 12:15:00 2022] GET /compute/v2.1/os-security-groups/959e5191-f917-456d-96a0-26ccf6d92046 => generated 218 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:15:00.748619 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3811bcb2-e44d-4937-959a-43f31ff33eb1 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:00.750129 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3811bcb2-e44d-4937-959a-43f31ff33eb1 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:00.750615 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8982ffe9-6ac4-4fa1-acf9-6390a2e69335 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '.version_select at 0x7f60728c3c10>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:00.751305 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3811bcb2-e44d-4937-959a-43f31ff33eb1 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] 10.222.0.27 "GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330" status: 200 len: 1365 microversion: 2.57 time: 0.186591 Jun 20 12:15:00.768497 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1915/3932] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:00 2022] GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330 => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:00.783628 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-51e5d233-fb7b-427a-bcfd-5b3539504d9b tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '.version_select at 0x7f60849121f0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:00.800898 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8982ffe9-6ac4-4fa1-acf9-6390a2e69335 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1188036854" status: 204 len: 0 microversion: 2.32 time: 0.053012 Jun 20 12:15:00.803721 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2018/3933] 10.222.0.27 () {60 vars in 1261 bytes} [Mon Jun 20 12:15:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1188036854 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 12:15:01.011395 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6ac382a9-ef1e-4306-84dd-6a82d9ce9c1b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:01.013237 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6ac382a9-ef1e-4306-84dd-6a82d9ce9c1b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:01.021986 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6ac382a9-ef1e-4306-84dd-6a82d9ce9c1b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:01.023489 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6ac382a9-ef1e-4306-84dd-6a82d9ce9c1b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:01.025388 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6ac382a9-ef1e-4306-84dd-6a82d9ce9c1b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:01.026111 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6ac382a9-ef1e-4306-84dd-6a82d9ce9c1b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:01.089343 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-51e5d233-fb7b-427a-bcfd-5b3539504d9b tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/959e5191-f917-456d-96a0-26ccf6d92046" status: 202 len: 0 microversion: 2.1 time: 0.319532 Jun 20 12:15:01.091360 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1916/3934] 10.222.0.27 () {58 vars in 1271 bytes} [Mon Jun 20 12:15:00 2022] DELETE /compute/v2.1/os-security-groups/959e5191-f917-456d-96a0-26ccf6d92046 => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:15:01.100761 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7380857f-09a4-4549-b041-abc11fb87206 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:01.101681 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7380857f-09a4-4549-b041-abc11fb87206 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: a48784f9-f5d9-4379-b2ce-ba044db399cf] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:01.113289 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7380857f-09a4-4549-b041-abc11fb87206 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:01.114092 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7380857f-09a4-4549-b041-abc11fb87206 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:01.116856 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7380857f-09a4-4549-b041-abc11fb87206 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:01.117475 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7380857f-09a4-4549-b041-abc11fb87206 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:01.140226 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-7380857f-09a4-4549-b041-abc11fb87206 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] HTTP exception thrown: Instance a48784f9-f5d9-4379-b2ce-ba044db399cf could not be found. Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7380857f-09a4-4549-b041-abc11fb87206 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Request method failure captured: Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf HTTP/1.1 Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGRspEjgKJLgDEMUB1oxj39OHwxpAdW28qHUXtVohoyOClCgJsgd03GdT2hoi3BapXye_C7q25Fmx52K1II73Nmx91JaNXbL0TFFBm3DxndH_-8RQjkZz-YTJGFJgzzOjcuFROsmxi41ZdE0CTcrcS_WNFOPfY38q9VTNDmwM1zWfjI Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: b3edd75428794ea2b1cbd1b8413072cd Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: b3edd75428794ea2b1cbd1b8413072cd Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-SecurityGroupsTestJSON-1959389845-project Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: e8878b2fbb4b429288856159a644382f Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-SecurityGroupsTestJSON-1959389845-project Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: exception: Instance a48784f9-f5d9-4379-b2ce-ba044db399cf could not be found. Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'a48784f9-f5d9-4379-b2ce-ba044db399cf'} Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a48784f9-f5d9-4379-b2ce-ba044db399cf could not be found. Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:15:01.142354 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:15:01.148797 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a48784f9-f5d9-4379-b2ce-ba044db399cf could not be found. Jun 20 12:15:01.148797 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:15:01.148797 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:15:01.148797 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:15:01.148797 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:01.148797 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:15:01.148797 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:15:01.148797 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:15:01.148797 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:15:01.148797 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a48784f9-f5d9-4379-b2ce-ba044db399cf could not be found. Jun 20 12:15:01.148797 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:15:01.151558 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7380857f-09a4-4549-b041-abc11fb87206 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Returning 404 to user: Instance a48784f9-f5d9-4379-b2ce-ba044db399cf could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:15:01.152910 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7380857f-09a4-4549-b041-abc11fb87206 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf" status: 404 len: 111 microversion: 2.1 time: 0.057266 Jun 20 12:15:01.156989 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1917/3935] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:15:01 2022] DELETE /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:15:01.163102 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ccec080d-7cd3-45f0-814c-9fd631444ef8 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:01.164004 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ccec080d-7cd3-45f0-814c-9fd631444ef8 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: a48784f9-f5d9-4379-b2ce-ba044db399cf] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:01.181211 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ccec080d-7cd3-45f0-814c-9fd631444ef8 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:01.182325 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ccec080d-7cd3-45f0-814c-9fd631444ef8 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:01.184407 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ccec080d-7cd3-45f0-814c-9fd631444ef8 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:01.185084 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ccec080d-7cd3-45f0-814c-9fd631444ef8 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:01.208421 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-ccec080d-7cd3-45f0-814c-9fd631444ef8 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] HTTP exception thrown: Instance a48784f9-f5d9-4379-b2ce-ba044db399cf could not be found. Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ccec080d-7cd3-45f0-814c-9fd631444ef8 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Request method failure captured: Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf HTTP/1.1 Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGRspEjgKJLgDEMUB1oxj39OHwxpAdW28qHUXtVohoyOClCgJsgd03GdT2hoi3BapXye_C7q25Fmx52K1II73Nmx91JaNXbL0TFFBm3DxndH_-8RQjkZz-YTJGFJgzzOjcuFROsmxi41ZdE0CTcrcS_WNFOPfY38q9VTNDmwM1zWfjI Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: b3edd75428794ea2b1cbd1b8413072cd Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: b3edd75428794ea2b1cbd1b8413072cd Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-SecurityGroupsTestJSON-1959389845-project Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: e8878b2fbb4b429288856159a644382f Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-SecurityGroupsTestJSON-1959389845-project Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: exception: Instance a48784f9-f5d9-4379-b2ce-ba044db399cf could not be found. Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'a48784f9-f5d9-4379-b2ce-ba044db399cf'} Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a48784f9-f5d9-4379-b2ce-ba044db399cf could not be found. Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a48784f9-f5d9-4379-b2ce-ba044db399cf could not be found. Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:15:01.211481 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:15:01.216919 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:01.216919 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:15:01.216919 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:15:01.216919 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:15:01.216919 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:15:01.216919 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a48784f9-f5d9-4379-b2ce-ba044db399cf could not be found. Jun 20 12:15:01.216919 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:15:01.219165 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ccec080d-7cd3-45f0-814c-9fd631444ef8 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Returning 404 to user: Instance a48784f9-f5d9-4379-b2ce-ba044db399cf could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:15:01.220498 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ccec080d-7cd3-45f0-814c-9fd631444ef8 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf" status: 404 len: 111 microversion: 2.1 time: 0.062220 Jun 20 12:15:01.225564 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1918/3936] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:01 2022] GET /compute/v2.1/servers/a48784f9-f5d9-4379-b2ce-ba044db399cf => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:15:01.231874 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b91a5db7-ee24-40f3-8d98-b7d49b314907 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '.version_select at 0x7f607318ef70>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:01.262961 n-d-master-1 devstack@n-api.service[119128]: DEBUG neutronclient.v2_0.client [None req-b91a5db7-ee24-40f3-8d98-b7d49b314907 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 28c0eb35-8305-4659-a535-ec77f79ee581 does not exist", "detail": ""}} {{(pid=119128) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 20 12:15:01.263967 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.security_group_api [None req-b91a5db7-ee24-40f3-8d98-b7d49b314907 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Neutron security group 28c0eb35-8305-4659-a535-ec77f79ee581 not found {{(pid=119128) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 20 12:15:01.264800 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-b91a5db7-ee24-40f3-8d98-b7d49b314907 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] HTTP exception thrown: Security group 28c0eb35-8305-4659-a535-ec77f79ee581 does not exist Jun 20 12:15:01.264800 n-d-master-1 devstack@n-api.service[119128]: Neutron server returns request_ids: ['req-442d9e96-4218-4cbc-a875-ade19b0547ca'] Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b91a5db7-ee24-40f3-8d98-b7d49b314907 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Request method failure captured: Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/os-security-groups/28c0eb35-8305-4659-a535-ec77f79ee581 HTTP/1.1 Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGRspEjgKJLgDEMUB1oxj39OHwxpAdW28qHUXtVohoyOClCgJsgd03GdT2hoi3BapXye_C7q25Fmx52K1II73Nmx91JaNXbL0TFFBm3DxndH_-8RQjkZz-YTJGFJgzzOjcuFROsmxi41ZdE0CTcrcS_WNFOPfY38q9VTNDmwM1zWfjI Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: b3edd75428794ea2b1cbd1b8413072cd Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: b3edd75428794ea2b1cbd1b8413072cd Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-SecurityGroupsTestJSON-1959389845-project Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: e8878b2fbb4b429288856159a644382f Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-SecurityGroupsTestJSON-1959389845-project Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: exception: Security group 28c0eb35-8305-4659-a535-ec77f79ee581 does not exist Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: Neutron server returns request_ids: ['req-442d9e96-4218-4cbc-a875-ade19b0547ca'] Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '28c0eb35-8305-4659-a535-ec77f79ee581'} Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 20 12:15:01.267143 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 28c0eb35-8305-4659-a535-ec77f79ee581 does not exist Jun 20 12:15:01.272650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-442d9e96-4218-4cbc-a875-ade19b0547ca'] Jun 20 12:15:01.272650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:15:01.272650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:15:01.272650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:15:01.272650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:01.272650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 20 12:15:01.272650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 20 12:15:01.272650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 20 12:15:01.272650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 20 12:15:01.272650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 28c0eb35-8305-4659-a535-ec77f79ee581 does not exist Jun 20 12:15:01.272650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-442d9e96-4218-4cbc-a875-ade19b0547ca'] Jun 20 12:15:01.272650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:15:01.272650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:15:01.272650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:15:01.272650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:01.272650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:15:01.272650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:15:01.272650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:15:01.272650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:15:01.272650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:15:01.272650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:15:01.272650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:15:01.272650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:15:01.272650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 20 12:15:01.272650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 20 12:15:01.272650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 28c0eb35-8305-4659-a535-ec77f79ee581 does not exist Jun 20 12:15:01.272650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-442d9e96-4218-4cbc-a875-ade19b0547ca'] Jun 20 12:15:01.272650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:15:01.272650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:15:01.272650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:15:01.272650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:01.272650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:15:01.272650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:15:01.272650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:15:01.272650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:15:01.272650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 28c0eb35-8305-4659-a535-ec77f79ee581 does not exist Jun 20 12:15:01.272650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-442d9e96-4218-4cbc-a875-ade19b0547ca'] Jun 20 12:15:01.272650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:15:01.279937 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b91a5db7-ee24-40f3-8d98-b7d49b314907 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Returning 404 to user: Security group 28c0eb35-8305-4659-a535-ec77f79ee581 does not exist Jun 20 12:15:01.279937 n-d-master-1 devstack@n-api.service[119128]: Neutron server returns request_ids: ['req-442d9e96-4218-4cbc-a875-ade19b0547ca'] {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:15:01.281229 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b91a5db7-ee24-40f3-8d98-b7d49b314907 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/28c0eb35-8305-4659-a535-ec77f79ee581" status: 404 len: 194 microversion: 2.1 time: 0.054392 Jun 20 12:15:01.282474 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1919/3937] 10.222.0.27 () {58 vars in 1271 bytes} [Mon Jun 20 12:15:01 2022] DELETE /compute/v2.1/os-security-groups/28c0eb35-8305-4659-a535-ec77f79ee581 => generated 194 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:15:01.296529 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ebac6c6f-af54-4e1f-8b67-9f3ce84ec63f tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '.version_select at 0x7f60731baca0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:01.357888 n-d-master-1 devstack@n-api.service[119128]: DEBUG neutronclient.v2_0.client [None req-ebac6c6f-af54-4e1f-8b67-9f3ce84ec63f tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6758fb01-190a-4735-a508-abaf71742ac4 does not exist", "detail": ""}} {{(pid=119128) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 20 12:15:01.359012 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.security_group_api [None req-ebac6c6f-af54-4e1f-8b67-9f3ce84ec63f tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Neutron security group 6758fb01-190a-4735-a508-abaf71742ac4 not found {{(pid=119128) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 20 12:15:01.360842 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-ebac6c6f-af54-4e1f-8b67-9f3ce84ec63f tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] HTTP exception thrown: Security group 6758fb01-190a-4735-a508-abaf71742ac4 does not exist Jun 20 12:15:01.360842 n-d-master-1 devstack@n-api.service[119128]: Neutron server returns request_ids: ['req-d7e64ece-d66a-4574-9f43-08ffe76813a5'] Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ebac6c6f-af54-4e1f-8b67-9f3ce84ec63f tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Request method failure captured: Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/os-security-groups/6758fb01-190a-4735-a508-abaf71742ac4 HTTP/1.1 Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGRspEjgKJLgDEMUB1oxj39OHwxpAdW28qHUXtVohoyOClCgJsgd03GdT2hoi3BapXye_C7q25Fmx52K1II73Nmx91JaNXbL0TFFBm3DxndH_-8RQjkZz-YTJGFJgzzOjcuFROsmxi41ZdE0CTcrcS_WNFOPfY38q9VTNDmwM1zWfjI Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: b3edd75428794ea2b1cbd1b8413072cd Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: b3edd75428794ea2b1cbd1b8413072cd Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-SecurityGroupsTestJSON-1959389845-project Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: e8878b2fbb4b429288856159a644382f Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-SecurityGroupsTestJSON-1959389845-project Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: exception: Security group 6758fb01-190a-4735-a508-abaf71742ac4 does not exist Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: Neutron server returns request_ids: ['req-d7e64ece-d66a-4574-9f43-08ffe76813a5'] Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '6758fb01-190a-4735-a508-abaf71742ac4'} Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 20 12:15:01.362849 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6758fb01-190a-4735-a508-abaf71742ac4 does not exist Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d7e64ece-d66a-4574-9f43-08ffe76813a5'] Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6758fb01-190a-4735-a508-abaf71742ac4 does not exist Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d7e64ece-d66a-4574-9f43-08ffe76813a5'] Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6758fb01-190a-4735-a508-abaf71742ac4 does not exist Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d7e64ece-d66a-4574-9f43-08ffe76813a5'] Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6758fb01-190a-4735-a508-abaf71742ac4 does not exist Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d7e64ece-d66a-4574-9f43-08ffe76813a5'] Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ebac6c6f-af54-4e1f-8b67-9f3ce84ec63f tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Returning 404 to user: Security group 6758fb01-190a-4735-a508-abaf71742ac4 does not exist Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: Neutron server returns request_ids: ['req-d7e64ece-d66a-4574-9f43-08ffe76813a5'] {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ebac6c6f-af54-4e1f-8b67-9f3ce84ec63f tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/6758fb01-190a-4735-a508-abaf71742ac4" status: 404 len: 194 microversion: 2.1 time: 0.073265 Jun 20 12:15:01.371503 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1920/3938] 10.222.0.27 () {58 vars in 1271 bytes} [Mon Jun 20 12:15:01 2022] DELETE /compute/v2.1/os-security-groups/6758fb01-190a-4735-a508-abaf71742ac4 => generated 194 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:15:01.382676 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-980e8cc4-0bc9-4792-a722-d7371822cc6c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '.version_select at 0x7f60731fbca0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:01.477009 n-d-master-1 devstack@n-api.service[119128]: DEBUG neutronclient.v2_0.client [None req-980e8cc4-0bc9-4792-a722-d7371822cc6c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0f994e73-34c9-4198-a50f-24797d6592ed does not exist", "detail": ""}} {{(pid=119128) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 20 12:15:01.477723 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.security_group_api [None req-980e8cc4-0bc9-4792-a722-d7371822cc6c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Neutron security group 0f994e73-34c9-4198-a50f-24797d6592ed not found {{(pid=119128) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 20 12:15:01.478279 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-980e8cc4-0bc9-4792-a722-d7371822cc6c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] HTTP exception thrown: Security group 0f994e73-34c9-4198-a50f-24797d6592ed does not exist Jun 20 12:15:01.478279 n-d-master-1 devstack@n-api.service[119128]: Neutron server returns request_ids: ['req-e583c89c-dbe2-4054-8f65-43cf00feb897'] Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-980e8cc4-0bc9-4792-a722-d7371822cc6c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Request method failure captured: Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/os-security-groups/0f994e73-34c9-4198-a50f-24797d6592ed HTTP/1.1 Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGRspEjgKJLgDEMUB1oxj39OHwxpAdW28qHUXtVohoyOClCgJsgd03GdT2hoi3BapXye_C7q25Fmx52K1II73Nmx91JaNXbL0TFFBm3DxndH_-8RQjkZz-YTJGFJgzzOjcuFROsmxi41ZdE0CTcrcS_WNFOPfY38q9VTNDmwM1zWfjI Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: b3edd75428794ea2b1cbd1b8413072cd Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: b3edd75428794ea2b1cbd1b8413072cd Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-SecurityGroupsTestJSON-1959389845-project Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: e8878b2fbb4b429288856159a644382f Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-SecurityGroupsTestJSON-1959389845-project Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: exception: Security group 0f994e73-34c9-4198-a50f-24797d6592ed does not exist Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: Neutron server returns request_ids: ['req-e583c89c-dbe2-4054-8f65-43cf00feb897'] Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '0f994e73-34c9-4198-a50f-24797d6592ed'} Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 20 12:15:01.481183 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0f994e73-34c9-4198-a50f-24797d6592ed does not exist Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e583c89c-dbe2-4054-8f65-43cf00feb897'] Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0f994e73-34c9-4198-a50f-24797d6592ed does not exist Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e583c89c-dbe2-4054-8f65-43cf00feb897'] Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0f994e73-34c9-4198-a50f-24797d6592ed does not exist Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e583c89c-dbe2-4054-8f65-43cf00feb897'] Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0f994e73-34c9-4198-a50f-24797d6592ed does not exist Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e583c89c-dbe2-4054-8f65-43cf00feb897'] Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-980e8cc4-0bc9-4792-a722-d7371822cc6c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Returning 404 to user: Security group 0f994e73-34c9-4198-a50f-24797d6592ed does not exist Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: Neutron server returns request_ids: ['req-e583c89c-dbe2-4054-8f65-43cf00feb897'] {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:15:01.486437 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-980e8cc4-0bc9-4792-a722-d7371822cc6c tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/0f994e73-34c9-4198-a50f-24797d6592ed" status: 404 len: 194 microversion: 2.1 time: 0.113026 Jun 20 12:15:01.489936 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1921/3939] 10.222.0.27 () {58 vars in 1271 bytes} [Mon Jun 20 12:15:01 2022] DELETE /compute/v2.1/os-security-groups/0f994e73-34c9-4198-a50f-24797d6592ed => generated 194 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:15:01.496838 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c7735dea-24e6-4bd9-8ad0-3851005ed7e7 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '.version_select at 0x7f60731ba820>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:01.569608 n-d-master-1 devstack@n-api.service[119128]: DEBUG neutronclient.v2_0.client [None req-c7735dea-24e6-4bd9-8ad0-3851005ed7e7 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d8f02ef8-48d6-46e0-b060-7d991b58d50d does not exist", "detail": ""}} {{(pid=119128) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 20 12:15:01.570631 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.security_group_api [None req-c7735dea-24e6-4bd9-8ad0-3851005ed7e7 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Neutron security group d8f02ef8-48d6-46e0-b060-7d991b58d50d not found {{(pid=119128) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 20 12:15:01.570756 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-c7735dea-24e6-4bd9-8ad0-3851005ed7e7 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] HTTP exception thrown: Security group d8f02ef8-48d6-46e0-b060-7d991b58d50d does not exist Jun 20 12:15:01.570756 n-d-master-1 devstack@n-api.service[119128]: Neutron server returns request_ids: ['req-0a73c6da-f8fd-45da-adae-7331caf9a071'] Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c7735dea-24e6-4bd9-8ad0-3851005ed7e7 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Request method failure captured: Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/os-security-groups/d8f02ef8-48d6-46e0-b060-7d991b58d50d HTTP/1.1 Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGRspEjgKJLgDEMUB1oxj39OHwxpAdW28qHUXtVohoyOClCgJsgd03GdT2hoi3BapXye_C7q25Fmx52K1II73Nmx91JaNXbL0TFFBm3DxndH_-8RQjkZz-YTJGFJgzzOjcuFROsmxi41ZdE0CTcrcS_WNFOPfY38q9VTNDmwM1zWfjI Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: b3edd75428794ea2b1cbd1b8413072cd Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: b3edd75428794ea2b1cbd1b8413072cd Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-SecurityGroupsTestJSON-1959389845-project Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: e8878b2fbb4b429288856159a644382f Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-SecurityGroupsTestJSON-1959389845-project Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: method: Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: exception: Security group d8f02ef8-48d6-46e0-b060-7d991b58d50d does not exist Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: Neutron server returns request_ids: ['req-0a73c6da-f8fd-45da-adae-7331caf9a071'] Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'd8f02ef8-48d6-46e0-b060-7d991b58d50d'} Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 20 12:15:01.574154 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d8f02ef8-48d6-46e0-b060-7d991b58d50d does not exist Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a73c6da-f8fd-45da-adae-7331caf9a071'] Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d8f02ef8-48d6-46e0-b060-7d991b58d50d does not exist Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a73c6da-f8fd-45da-adae-7331caf9a071'] Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d8f02ef8-48d6-46e0-b060-7d991b58d50d does not exist Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a73c6da-f8fd-45da-adae-7331caf9a071'] Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d8f02ef8-48d6-46e0-b060-7d991b58d50d does not exist Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a73c6da-f8fd-45da-adae-7331caf9a071'] Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c7735dea-24e6-4bd9-8ad0-3851005ed7e7 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Returning 404 to user: Security group d8f02ef8-48d6-46e0-b060-7d991b58d50d does not exist Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: Neutron server returns request_ids: ['req-0a73c6da-f8fd-45da-adae-7331caf9a071'] {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:15:01.579822 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c7735dea-24e6-4bd9-8ad0-3851005ed7e7 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/d8f02ef8-48d6-46e0-b060-7d991b58d50d" status: 404 len: 194 microversion: 2.1 time: 0.088125 Jun 20 12:15:01.583011 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1922/3940] 10.222.0.27 () {58 vars in 1271 bytes} [Mon Jun 20 12:15:01 2022] DELETE /compute/v2.1/os-security-groups/d8f02ef8-48d6-46e0-b060-7d991b58d50d => generated 194 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:15:01.593731 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0cf7d1cc-963d-4175-8cb9-f5b028a252c9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:01.595497 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0cf7d1cc-963d-4175-8cb9-f5b028a252c9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:01.609978 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cf7d1cc-963d-4175-8cb9-f5b028a252c9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:01.610441 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cf7d1cc-963d-4175-8cb9-f5b028a252c9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:01.614624 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cf7d1cc-963d-4175-8cb9-f5b028a252c9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:01.617376 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cf7d1cc-963d-4175-8cb9-f5b028a252c9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:01.885808 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6ac382a9-ef1e-4306-84dd-6a82d9ce9c1b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:01.900223 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6ac382a9-ef1e-4306-84dd-6a82d9ce9c1b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1695 microversion: 2.1 time: 0.895456 Jun 20 12:15:01.913244 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2019/3941] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:01 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1695 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:15:01.933637 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-786bdf60-74c5-4eb1-b07d-6a8cd17efdf2 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '.version_select at 0x7f6073be9310>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:02.097697 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0cf7d1cc-963d-4175-8cb9-f5b028a252c9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:02.111634 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0cf7d1cc-963d-4175-8cb9-f5b028a252c9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:02.114525 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0cf7d1cc-963d-4175-8cb9-f5b028a252c9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:02.121804 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0cf7d1cc-963d-4175-8cb9-f5b028a252c9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1740 microversion: 2.20 time: 0.540661 Jun 20 12:15:02.128033 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1923/3942] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:01 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1740 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:02.143000 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-375d6d25-cc84-494a-9b4c-70814a9f662c tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:02.143888 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-375d6d25-cc84-494a-9b4c-70814a9f662c tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] [instance: 1618debb-4bee-4c67-81b1-ef82968ac330] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:02.145002 n-d-master-1 devstack@n-api.service[119127]: DEBUG neutronclient.v2_0.client [None req-786bdf60-74c5-4eb1-b07d-6a8cd17efdf2 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 68405aaa-9dda-45fe-ba56-cc5bef46a391 does not exist", "detail": ""}} {{(pid=119127) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 20 12:15:02.145625 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.security_group_api [None req-786bdf60-74c5-4eb1-b07d-6a8cd17efdf2 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Neutron security group 68405aaa-9dda-45fe-ba56-cc5bef46a391 not found {{(pid=119127) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 20 12:15:02.146156 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-786bdf60-74c5-4eb1-b07d-6a8cd17efdf2 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] HTTP exception thrown: Security group 68405aaa-9dda-45fe-ba56-cc5bef46a391 does not exist Jun 20 12:15:02.146156 n-d-master-1 devstack@n-api.service[119127]: Neutron server returns request_ids: ['req-c5dc29d2-a3a4-4f20-9034-41c5d4390f71'] Jun 20 12:15:02.147321 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-786bdf60-74c5-4eb1-b07d-6a8cd17efdf2 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Request method failure captured: Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/os-security-groups/68405aaa-9dda-45fe-ba56-cc5bef46a391 HTTP/1.1 Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGRspEjgKJLgDEMUB1oxj39OHwxpAdW28qHUXtVohoyOClCgJsgd03GdT2hoi3BapXye_C7q25Fmx52K1II73Nmx91JaNXbL0TFFBm3DxndH_-8RQjkZz-YTJGFJgzzOjcuFROsmxi41ZdE0CTcrcS_WNFOPfY38q9VTNDmwM1zWfjI Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: b3edd75428794ea2b1cbd1b8413072cd Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: b3edd75428794ea2b1cbd1b8413072cd Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-SecurityGroupsTestJSON-1959389845-project Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: e8878b2fbb4b429288856159a644382f Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-SecurityGroupsTestJSON-1959389845-project Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: exception: Security group 68405aaa-9dda-45fe-ba56-cc5bef46a391 does not exist Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: Neutron server returns request_ids: ['req-c5dc29d2-a3a4-4f20-9034-41c5d4390f71'] Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '68405aaa-9dda-45fe-ba56-cc5bef46a391'} Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 20 12:15:02.150163 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 68405aaa-9dda-45fe-ba56-cc5bef46a391 does not exist Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5dc29d2-a3a4-4f20-9034-41c5d4390f71'] Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 68405aaa-9dda-45fe-ba56-cc5bef46a391 does not exist Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5dc29d2-a3a4-4f20-9034-41c5d4390f71'] Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 68405aaa-9dda-45fe-ba56-cc5bef46a391 does not exist Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5dc29d2-a3a4-4f20-9034-41c5d4390f71'] Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 68405aaa-9dda-45fe-ba56-cc5bef46a391 does not exist Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5dc29d2-a3a4-4f20-9034-41c5d4390f71'] Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-786bdf60-74c5-4eb1-b07d-6a8cd17efdf2 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Returning 404 to user: Security group 68405aaa-9dda-45fe-ba56-cc5bef46a391 does not exist Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: Neutron server returns request_ids: ['req-c5dc29d2-a3a4-4f20-9034-41c5d4390f71'] {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-786bdf60-74c5-4eb1-b07d-6a8cd17efdf2 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/68405aaa-9dda-45fe-ba56-cc5bef46a391" status: 404 len: 194 microversion: 2.1 time: 0.235067 Jun 20 12:15:02.156182 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2020/3943] 10.222.0.27 () {58 vars in 1271 bytes} [Mon Jun 20 12:15:01 2022] DELETE /compute/v2.1/os-security-groups/68405aaa-9dda-45fe-ba56-cc5bef46a391 => generated 194 bytes in 237 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:15:02.166899 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-375d6d25-cc84-494a-9b4c-70814a9f662c tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:02.171607 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-375d6d25-cc84-494a-9b4c-70814a9f662c tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:02.175771 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8e4f2cf6-20b8-4d3f-954b-1245c3e5d2cb tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '.version_select at 0x7f6073a8e700>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:02.177313 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-375d6d25-cc84-494a-9b4c-70814a9f662c tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:02.178089 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-375d6d25-cc84-494a-9b4c-70814a9f662c tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:02.356264 n-d-master-1 devstack@n-api.service[119127]: DEBUG neutronclient.v2_0.client [None req-8e4f2cf6-20b8-4d3f-954b-1245c3e5d2cb tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 73bc215f-9e8f-43f3-9faf-9e7c8805b434 does not exist", "detail": ""}} {{(pid=119127) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 20 12:15:02.357152 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.security_group_api [None req-8e4f2cf6-20b8-4d3f-954b-1245c3e5d2cb tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Neutron security group 73bc215f-9e8f-43f3-9faf-9e7c8805b434 not found {{(pid=119127) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 20 12:15:02.359950 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-8e4f2cf6-20b8-4d3f-954b-1245c3e5d2cb tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] HTTP exception thrown: Security group 73bc215f-9e8f-43f3-9faf-9e7c8805b434 does not exist Jun 20 12:15:02.359950 n-d-master-1 devstack@n-api.service[119127]: Neutron server returns request_ids: ['req-c6b5d708-6168-4fb8-a71d-bb9b64eb792d'] Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8e4f2cf6-20b8-4d3f-954b-1245c3e5d2cb tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Request method failure captured: Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/os-security-groups/73bc215f-9e8f-43f3-9faf-9e7c8805b434 HTTP/1.1 Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGRspEjgKJLgDEMUB1oxj39OHwxpAdW28qHUXtVohoyOClCgJsgd03GdT2hoi3BapXye_C7q25Fmx52K1II73Nmx91JaNXbL0TFFBm3DxndH_-8RQjkZz-YTJGFJgzzOjcuFROsmxi41ZdE0CTcrcS_WNFOPfY38q9VTNDmwM1zWfjI Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: b3edd75428794ea2b1cbd1b8413072cd Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: b3edd75428794ea2b1cbd1b8413072cd Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-SecurityGroupsTestJSON-1959389845-project Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: e8878b2fbb4b429288856159a644382f Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-SecurityGroupsTestJSON-1959389845-project Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: method: Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: exception: Security group 73bc215f-9e8f-43f3-9faf-9e7c8805b434 does not exist Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: Neutron server returns request_ids: ['req-c6b5d708-6168-4fb8-a71d-bb9b64eb792d'] Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '73bc215f-9e8f-43f3-9faf-9e7c8805b434'} Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 20 12:15:02.362793 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 73bc215f-9e8f-43f3-9faf-9e7c8805b434 does not exist Jun 20 12:15:02.369761 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6b5d708-6168-4fb8-a71d-bb9b64eb792d'] Jun 20 12:15:02.369761 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:15:02.369761 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:15:02.369761 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:15:02.369761 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:02.369761 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 20 12:15:02.369761 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 20 12:15:02.369761 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 20 12:15:02.369761 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 20 12:15:02.369761 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 73bc215f-9e8f-43f3-9faf-9e7c8805b434 does not exist Jun 20 12:15:02.369761 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6b5d708-6168-4fb8-a71d-bb9b64eb792d'] Jun 20 12:15:02.369761 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:15:02.369761 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:15:02.369761 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:15:02.369761 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:02.369761 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:15:02.369761 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:15:02.369761 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:15:02.369761 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:15:02.369761 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:15:02.369761 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:15:02.369761 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:15:02.369761 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:15:02.369761 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 20 12:15:02.369761 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 20 12:15:02.369761 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 73bc215f-9e8f-43f3-9faf-9e7c8805b434 does not exist Jun 20 12:15:02.369761 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6b5d708-6168-4fb8-a71d-bb9b64eb792d'] Jun 20 12:15:02.369761 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:15:02.369761 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:15:02.369761 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:15:02.369761 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:02.369761 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:15:02.369761 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:15:02.369761 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:15:02.369761 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:15:02.369761 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 73bc215f-9e8f-43f3-9faf-9e7c8805b434 does not exist Jun 20 12:15:02.369761 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6b5d708-6168-4fb8-a71d-bb9b64eb792d'] Jun 20 12:15:02.369761 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:15:02.377613 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8e4f2cf6-20b8-4d3f-954b-1245c3e5d2cb tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Returning 404 to user: Security group 73bc215f-9e8f-43f3-9faf-9e7c8805b434 does not exist Jun 20 12:15:02.377613 n-d-master-1 devstack@n-api.service[119127]: Neutron server returns request_ids: ['req-c6b5d708-6168-4fb8-a71d-bb9b64eb792d'] {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:15:02.378403 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8e4f2cf6-20b8-4d3f-954b-1245c3e5d2cb tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/73bc215f-9e8f-43f3-9faf-9e7c8805b434" status: 404 len: 194 microversion: 2.1 time: 0.214932 Jun 20 12:15:02.380754 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2021/3944] 10.222.0.27 () {58 vars in 1271 bytes} [Mon Jun 20 12:15:02 2022] DELETE /compute/v2.1/os-security-groups/73bc215f-9e8f-43f3-9faf-9e7c8805b434 => generated 194 bytes in 218 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:15:02.401588 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1de6d240-6238-4128-babf-743c4d1caee1 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:02.406734 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1de6d240-6238-4128-babf-743c4d1caee1 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: b0df0320-6a60-433c-bfe9-8011cd85e631] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:02.422015 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1de6d240-6238-4128-babf-743c4d1caee1 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:02.423464 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1de6d240-6238-4128-babf-743c4d1caee1 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:02.427035 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1de6d240-6238-4128-babf-743c4d1caee1 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:02.427720 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1de6d240-6238-4128-babf-743c4d1caee1 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:02.494754 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1de6d240-6238-4128-babf-743c4d1caee1 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: b0df0320-6a60-433c-bfe9-8011cd85e631] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:15:02.578931 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-375d6d25-cc84-494a-9b4c-70814a9f662c tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:02.593249 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-375d6d25-cc84-494a-9b4c-70814a9f662c tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:02.598754 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-375d6d25-cc84-494a-9b4c-70814a9f662c tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:02.600171 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-375d6d25-cc84-494a-9b4c-70814a9f662c tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] 10.222.0.27 "GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330" status: 200 len: 1365 microversion: 2.57 time: 0.470741 Jun 20 12:15:02.613940 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1924/3945] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:02 2022] GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330 => generated 1365 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:02.687611 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1de6d240-6238-4128-babf-743c4d1caee1 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631" status: 204 len: 0 microversion: 2.1 time: 0.301574 Jun 20 12:15:02.689823 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2022/3946] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:15:02 2022] DELETE /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:15:02.698336 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6b997440-656c-42e1-9223-bb0b7ff1679d tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:02.698968 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6b997440-656c-42e1-9223-bb0b7ff1679d tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: b0df0320-6a60-433c-bfe9-8011cd85e631] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:02.710598 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6b997440-656c-42e1-9223-bb0b7ff1679d tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:02.711056 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6b997440-656c-42e1-9223-bb0b7ff1679d tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:02.711842 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6b997440-656c-42e1-9223-bb0b7ff1679d tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:02.716905 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6b997440-656c-42e1-9223-bb0b7ff1679d tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:02.933341 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-696a2342-b125-46a1-9aa3-d73aecd49307 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:02.934279 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-696a2342-b125-46a1-9aa3-d73aecd49307 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:02.953357 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-696a2342-b125-46a1-9aa3-d73aecd49307 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:02.956989 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-696a2342-b125-46a1-9aa3-d73aecd49307 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:02.958316 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-696a2342-b125-46a1-9aa3-d73aecd49307 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:02.960101 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-696a2342-b125-46a1-9aa3-d73aecd49307 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:03.411641 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-696a2342-b125-46a1-9aa3-d73aecd49307 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:03.424869 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-696a2342-b125-46a1-9aa3-d73aecd49307 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1695 microversion: 2.1 time: 0.493544 Jun 20 12:15:03.425854 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2023/3947] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:02 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1695 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:03.432221 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-55ed0f56-e309-4a16-a042-0e5f3b532b32 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:03.433742 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-55ed0f56-e309-4a16-a042-0e5f3b532b32 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:03.464553 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-55ed0f56-e309-4a16-a042-0e5f3b532b32 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:03.465396 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-55ed0f56-e309-4a16-a042-0e5f3b532b32 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:03.467532 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-55ed0f56-e309-4a16-a042-0e5f3b532b32 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:03.469024 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-55ed0f56-e309-4a16-a042-0e5f3b532b32 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:03.572114 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6b997440-656c-42e1-9223-bb0b7ff1679d tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:03.580488 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6b997440-656c-42e1-9223-bb0b7ff1679d tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631" status: 200 len: 1649 microversion: 2.1 time: 0.886198 Jun 20 12:15:03.593510 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1925/3948] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:02 2022] GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631 => generated 1649 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:03.622341 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fa8764c5-7b98-4479-8120-4b611aab5633 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:03.623284 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fa8764c5-7b98-4479-8120-4b611aab5633 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] [instance: 1618debb-4bee-4c67-81b1-ef82968ac330] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:03.634835 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fa8764c5-7b98-4479-8120-4b611aab5633 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:03.643908 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fa8764c5-7b98-4479-8120-4b611aab5633 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:03.644841 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fa8764c5-7b98-4479-8120-4b611aab5633 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:03.652607 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fa8764c5-7b98-4479-8120-4b611aab5633 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:03.960609 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fa8764c5-7b98-4479-8120-4b611aab5633 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:03.977757 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fa8764c5-7b98-4479-8120-4b611aab5633 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:03.980049 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fa8764c5-7b98-4479-8120-4b611aab5633 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:03.981940 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fa8764c5-7b98-4479-8120-4b611aab5633 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] 10.222.0.27 "GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330" status: 200 len: 1365 microversion: 2.57 time: 0.364825 Jun 20 12:15:03.983891 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1926/3949] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:03 2022] GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330 => generated 1365 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:15:04.027116 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-55ed0f56-e309-4a16-a042-0e5f3b532b32 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:04.039986 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-55ed0f56-e309-4a16-a042-0e5f3b532b32 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:04.041945 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-55ed0f56-e309-4a16-a042-0e5f3b532b32 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:04.043454 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-55ed0f56-e309-4a16-a042-0e5f3b532b32 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1740 microversion: 2.20 time: 0.616564 Jun 20 12:15:04.055242 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2024/3950] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:03 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1740 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:04.442002 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-80f6475e-fe00-4f33-b90a-e47b5d006017 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:04.443042 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-80f6475e-fe00-4f33-b90a-e47b5d006017 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:04.459968 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80f6475e-fe00-4f33-b90a-e47b5d006017 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:04.460765 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80f6475e-fe00-4f33-b90a-e47b5d006017 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:04.461716 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80f6475e-fe00-4f33-b90a-e47b5d006017 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:04.462323 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80f6475e-fe00-4f33-b90a-e47b5d006017 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:04.599250 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a009789f-12b0-4a02-bd2c-8c673141da60 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:04.600405 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a009789f-12b0-4a02-bd2c-8c673141da60 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: b0df0320-6a60-433c-bfe9-8011cd85e631] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:04.611936 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a009789f-12b0-4a02-bd2c-8c673141da60 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:04.615643 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a009789f-12b0-4a02-bd2c-8c673141da60 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:04.618342 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a009789f-12b0-4a02-bd2c-8c673141da60 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:04.622951 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a009789f-12b0-4a02-bd2c-8c673141da60 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:05.271603 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a009789f-12b0-4a02-bd2c-8c673141da60 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:05.281882 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a009789f-12b0-4a02-bd2c-8c673141da60 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631" status: 200 len: 1649 microversion: 2.1 time: 0.687829 Jun 20 12:15:05.282828 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2025/3951] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:04 2022] GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631 => generated 1649 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:05.288082 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b34f0f04-b4ff-4a5a-bcf8-70e1d2976b59 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:05.288921 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b34f0f04-b4ff-4a5a-bcf8-70e1d2976b59 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] [instance: 1618debb-4bee-4c67-81b1-ef82968ac330] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:05.296956 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b34f0f04-b4ff-4a5a-bcf8-70e1d2976b59 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:05.297719 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b34f0f04-b4ff-4a5a-bcf8-70e1d2976b59 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:05.298693 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b34f0f04-b4ff-4a5a-bcf8-70e1d2976b59 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:05.299311 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b34f0f04-b4ff-4a5a-bcf8-70e1d2976b59 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:05.348531 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-80f6475e-fe00-4f33-b90a-e47b5d006017 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:05.390197 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-80f6475e-fe00-4f33-b90a-e47b5d006017 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1695 microversion: 2.1 time: 0.949588 Jun 20 12:15:05.390197 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1927/3952] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:04 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1695 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:05.398702 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-adb744bb-8796-4776-8307-2b797f08de90 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:05.399612 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-adb744bb-8796-4776-8307-2b797f08de90 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:05.408798 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-adb744bb-8796-4776-8307-2b797f08de90 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:05.409173 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-adb744bb-8796-4776-8307-2b797f08de90 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:05.410212 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-adb744bb-8796-4776-8307-2b797f08de90 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:05.411037 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-adb744bb-8796-4776-8307-2b797f08de90 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:05.461246 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b34f0f04-b4ff-4a5a-bcf8-70e1d2976b59 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:05.475135 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b34f0f04-b4ff-4a5a-bcf8-70e1d2976b59 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:05.476958 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b34f0f04-b4ff-4a5a-bcf8-70e1d2976b59 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:05.478196 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b34f0f04-b4ff-4a5a-bcf8-70e1d2976b59 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] 10.222.0.27 "GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330" status: 200 len: 1365 microversion: 2.57 time: 0.194061 Jun 20 12:15:05.479791 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2026/3953] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:05 2022] GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330 => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:05.488504 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-67a56aca-3320-4203-9eb7-287ea2dd774a tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "a26605c8-dfcd-4afb-aebc-86ab1ab6a77c"}], "security_groups": [{"name": "tempest-securitygroup--355792919"}], "key_name": "tempest-keypair-2065009109", "user_data": "}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:15:05.654549 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-67a56aca-3320-4203-9eb7-287ea2dd774a tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] validate_networks() for [('a26605c8-dfcd-4afb-aebc-86ab1ab6a77c', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:15:05.853620 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-adb744bb-8796-4776-8307-2b797f08de90 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:05.865779 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-adb744bb-8796-4776-8307-2b797f08de90 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:05.867829 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-adb744bb-8796-4776-8307-2b797f08de90 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:05.869212 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-adb744bb-8796-4776-8307-2b797f08de90 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1740 microversion: 2.20 time: 0.479499 Jun 20 12:15:05.874606 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1928/3954] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:05 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1740 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:06.108222 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-83dad8f0-41ba-4107-91a8-7ce046deba5b req-ee2da776-0e0c-4b0e-9d16-10f34b72d0bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0df0320-6a60-433c-bfe9-8011cd85e631", "name": "network-vif-deleted", "tag": "dfcb1b26-b9d9-45b4-9427-41b6b2493277"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:15:06.125594 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-83dad8f0-41ba-4107-91a8-7ce046deba5b req-ee2da776-0e0c-4b0e-9d16-10f34b72d0bd service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:06.126037 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-83dad8f0-41ba-4107-91a8-7ce046deba5b req-ee2da776-0e0c-4b0e-9d16-10f34b72d0bd service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:06.157715 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-83dad8f0-41ba-4107-91a8-7ce046deba5b req-ee2da776-0e0c-4b0e-9d16-10f34b72d0bd service nova] Creating event network-vif-deleted:dfcb1b26-b9d9-45b4-9427-41b6b2493277 for instance b0df0320-6a60-433c-bfe9-8011cd85e631 on n-h2-master-1 Jun 20 12:15:06.172493 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-83dad8f0-41ba-4107-91a8-7ce046deba5b req-ee2da776-0e0c-4b0e-9d16-10f34b72d0bd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071775 Jun 20 12:15:06.173317 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1929/3955] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:15:06.299518 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b7778772-89c3-409c-8c70-8ed8a3902cb5 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:06.300571 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b7778772-89c3-409c-8c70-8ed8a3902cb5 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: b0df0320-6a60-433c-bfe9-8011cd85e631] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:06.328726 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b7778772-89c3-409c-8c70-8ed8a3902cb5 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:06.330372 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b7778772-89c3-409c-8c70-8ed8a3902cb5 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:06.331372 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b7778772-89c3-409c-8c70-8ed8a3902cb5 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:06.332011 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b7778772-89c3-409c-8c70-8ed8a3902cb5 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:06.350622 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-67a56aca-3320-4203-9eb7-287ea2dd774a tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:15:06.351121 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-67a56aca-3320-4203-9eb7-287ea2dd774a tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:15:06.351504 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-67a56aca-3320-4203-9eb7-287ea2dd774a tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:15:06.352251 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-67a56aca-3320-4203-9eb7-287ea2dd774a tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:15:06.352979 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-67a56aca-3320-4203-9eb7-287ea2dd774a tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:15:06.365206 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-67a56aca-3320-4203-9eb7-287ea2dd774a tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:06.365932 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-67a56aca-3320-4203-9eb7-287ea2dd774a tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:06.366983 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-67a56aca-3320-4203-9eb7-287ea2dd774a tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:06.367666 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-67a56aca-3320-4203-9eb7-287ea2dd774a tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:06.389836 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-67a56aca-3320-4203-9eb7-287ea2dd774a tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Getting quotas for project 90924e1b14d448668fa43d6845ff3e05. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:15:06.396805 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-67a56aca-3320-4203-9eb7-287ea2dd774a tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Getting quotas for user c58864ab3af344f180e02cc95e5cd9ee and project 90924e1b14d448668fa43d6845ff3e05. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:15:06.413898 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-67a56aca-3320-4203-9eb7-287ea2dd774a tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:15:06.417774 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-67a56aca-3320-4203-9eb7-287ea2dd774a tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] [instance: 193a5cec-91b5-4080-a798-0af9d9c09ce2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:15:06.432899 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b7778772-89c3-409c-8c70-8ed8a3902cb5 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:06.433735 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b7778772-89c3-409c-8c70-8ed8a3902cb5 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:06.433890 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-b7778772-89c3-409c-8c70-8ed8a3902cb5 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lazy-loading 'fault' on Instance uuid b0df0320-6a60-433c-bfe9-8011cd85e631 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:15:06.437225 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:15:06.496669 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-67a56aca-3320-4203-9eb7-287ea2dd774a tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.011724 Jun 20 12:15:06.500978 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2027/3956] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:15:05 2022] POST /compute/v2.1/servers => generated 408 bytes in 1020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:15:06.509149 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7e1a4be0-4bbc-409d-b982-8f51f131fa91 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:06.511193 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7e1a4be0-4bbc-409d-b982-8f51f131fa91 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:06.528699 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7e1a4be0-4bbc-409d-b982-8f51f131fa91 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:06.529480 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7e1a4be0-4bbc-409d-b982-8f51f131fa91 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:06.531229 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7e1a4be0-4bbc-409d-b982-8f51f131fa91 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:06.531850 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7e1a4be0-4bbc-409d-b982-8f51f131fa91 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:06.741516 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7e1a4be0-4bbc-409d-b982-8f51f131fa91 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:06.755678 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7e1a4be0-4bbc-409d-b982-8f51f131fa91 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1695 microversion: 2.1 time: 0.252923 Jun 20 12:15:06.757319 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2028/3957] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:06 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1695 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:06.764848 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6389afb8-4d2e-4ec4-be98-95fd8d1ecef9 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:06.766440 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6389afb8-4d2e-4ec4-be98-95fd8d1ecef9 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] [instance: 1618debb-4bee-4c67-81b1-ef82968ac330] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:06.776938 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6389afb8-4d2e-4ec4-be98-95fd8d1ecef9 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:06.777938 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6389afb8-4d2e-4ec4-be98-95fd8d1ecef9 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:06.778971 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6389afb8-4d2e-4ec4-be98-95fd8d1ecef9 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:06.779706 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6389afb8-4d2e-4ec4-be98-95fd8d1ecef9 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:06.877712 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6389afb8-4d2e-4ec4-be98-95fd8d1ecef9 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:06.891145 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6389afb8-4d2e-4ec4-be98-95fd8d1ecef9 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:06.893175 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6389afb8-4d2e-4ec4-be98-95fd8d1ecef9 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:06.895158 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6389afb8-4d2e-4ec4-be98-95fd8d1ecef9 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] 10.222.0.27 "GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330" status: 200 len: 1365 microversion: 2.57 time: 0.136488 Jun 20 12:15:06.896518 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2029/3958] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:06 2022] GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330 => generated 1365 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:06.903262 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8d18b8e7-343d-4663-a075-baa821e4eab7 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:06.904530 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8d18b8e7-343d-4663-a075-baa821e4eab7 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] [instance: 193a5cec-91b5-4080-a798-0af9d9c09ce2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:06.980419 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8d18b8e7-343d-4663-a075-baa821e4eab7 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58864ab3af344f180e02cc95e5cd9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90924e1b14d448668fa43d6845ff3e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:06.990656 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8d18b8e7-343d-4663-a075-baa821e4eab7 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] 10.222.0.27 "GET /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2" status: 200 len: 1226 microversion: 2.1 time: 0.091549 Jun 20 12:15:06.992660 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2030/3959] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:06 2022] GET /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:06.998188 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c725352c-9bf0-436c-81b1-b11a65ce1098 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:06.998829 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b7778772-89c3-409c-8c70-8ed8a3902cb5 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8878b2fbb4b429288856159a644382f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3edd75428794ea2b1cbd1b8413072cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:06.999473 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c725352c-9bf0-436c-81b1-b11a65ce1098 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:07.020149 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c725352c-9bf0-436c-81b1-b11a65ce1098 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:07.020777 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c725352c-9bf0-436c-81b1-b11a65ce1098 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:07.023102 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c725352c-9bf0-436c-81b1-b11a65ce1098 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:07.024934 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c725352c-9bf0-436c-81b1-b11a65ce1098 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:07.034101 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b7778772-89c3-409c-8c70-8ed8a3902cb5 tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631" status: 200 len: 1306 microversion: 2.1 time: 0.738730 Jun 20 12:15:07.047727 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1930/3960] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:06 2022] GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631 => generated 1306 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:15:07.207351 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c725352c-9bf0-436c-81b1-b11a65ce1098 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:07.218669 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c725352c-9bf0-436c-81b1-b11a65ce1098 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:07.220304 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c725352c-9bf0-436c-81b1-b11a65ce1098 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:07.221561 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c725352c-9bf0-436c-81b1-b11a65ce1098 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1722 microversion: 2.20 time: 0.227823 Jun 20 12:15:07.222173 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2031/3961] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:06 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:07.783068 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6ab5ead1-f71b-4827-a045-195e3a117dba tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:07.784532 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6ab5ead1-f71b-4827-a045-195e3a117dba tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:07.793890 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ab5ead1-f71b-4827-a045-195e3a117dba tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:07.794679 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ab5ead1-f71b-4827-a045-195e3a117dba tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:07.796016 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ab5ead1-f71b-4827-a045-195e3a117dba tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:07.796715 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ab5ead1-f71b-4827-a045-195e3a117dba tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:07.920011 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1bd1c538-f73a-478e-a350-cb5dcacafb5f tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:07.921310 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1bd1c538-f73a-478e-a350-cb5dcacafb5f tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] [instance: 1618debb-4bee-4c67-81b1-ef82968ac330] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:07.929240 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1bd1c538-f73a-478e-a350-cb5dcacafb5f tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:07.930013 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1bd1c538-f73a-478e-a350-cb5dcacafb5f tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:07.938752 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1bd1c538-f73a-478e-a350-cb5dcacafb5f tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:07.939628 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1bd1c538-f73a-478e-a350-cb5dcacafb5f tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:08.047996 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1bd1c538-f73a-478e-a350-cb5dcacafb5f tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:08.064401 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1bd1c538-f73a-478e-a350-cb5dcacafb5f tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:08.065971 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1bd1c538-f73a-478e-a350-cb5dcacafb5f tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:08.067441 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1bd1c538-f73a-478e-a350-cb5dcacafb5f tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] 10.222.0.27 "GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330" status: 200 len: 1365 microversion: 2.57 time: 0.156414 Jun 20 12:15:08.072463 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2032/3962] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:07 2022] GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:15:08.074364 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-00675882-508c-49d9-b8cd-bd539ee260cf tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:08.075631 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-00675882-508c-49d9-b8cd-bd539ee260cf tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] [instance: 193a5cec-91b5-4080-a798-0af9d9c09ce2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:08.081298 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:15:08.086806 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-00675882-508c-49d9-b8cd-bd539ee260cf tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:08.087265 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-00675882-508c-49d9-b8cd-bd539ee260cf tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:08.088159 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-00675882-508c-49d9-b8cd-bd539ee260cf tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:08.088835 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-00675882-508c-49d9-b8cd-bd539ee260cf tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:08.215401 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-00675882-508c-49d9-b8cd-bd539ee260cf tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58864ab3af344f180e02cc95e5cd9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90924e1b14d448668fa43d6845ff3e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:08.229262 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-00675882-508c-49d9-b8cd-bd539ee260cf tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] 10.222.0.27 "GET /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2" status: 200 len: 1284 microversion: 2.1 time: 0.159266 Jun 20 12:15:08.238930 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2033/3963] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:08 2022] GET /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2 => generated 1284 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:08.238930 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-055bd929-7db4-4255-ade4-1bca2c8ada3f tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:08.238930 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-055bd929-7db4-4255-ade4-1bca2c8ada3f tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] [instance: b0df0320-6a60-433c-bfe9-8011cd85e631] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:08.246175 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-055bd929-7db4-4255-ade4-1bca2c8ada3f tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:08.246631 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-055bd929-7db4-4255-ade4-1bca2c8ada3f tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:08.247422 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-055bd929-7db4-4255-ade4-1bca2c8ada3f tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:08.247858 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-055bd929-7db4-4255-ade4-1bca2c8ada3f tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:08.265217 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-055bd929-7db4-4255-ade4-1bca2c8ada3f tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] HTTP exception thrown: Instance b0df0320-6a60-433c-bfe9-8011cd85e631 could not be found. Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-055bd929-7db4-4255-ade4-1bca2c8ada3f tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Request method failure captured: Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631 HTTP/1.1 Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGRspEjgKJLgDEMUB1oxj39OHwxpAdW28qHUXtVohoyOClCgJsgd03GdT2hoi3BapXye_C7q25Fmx52K1II73Nmx91JaNXbL0TFFBm3DxndH_-8RQjkZz-YTJGFJgzzOjcuFROsmxi41ZdE0CTcrcS_WNFOPfY38q9VTNDmwM1zWfjI Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: b3edd75428794ea2b1cbd1b8413072cd Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b3edd75428794ea2b1cbd1b8413072cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: b3edd75428794ea2b1cbd1b8413072cd Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1959389845 Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-SecurityGroupsTestJSON-1959389845-project Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: e8878b2fbb4b429288856159a644382f Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-SecurityGroupsTestJSON-1959389845-project Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: exception: Instance b0df0320-6a60-433c-bfe9-8011cd85e631 could not be found. Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'b0df0320-6a60-433c-bfe9-8011cd85e631'} Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0df0320-6a60-433c-bfe9-8011cd85e631 could not be found. Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0df0320-6a60-433c-bfe9-8011cd85e631 could not be found. Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:15:08.266971 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:15:08.276320 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:08.276320 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:15:08.276320 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:15:08.276320 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:15:08.276320 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:15:08.276320 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0df0320-6a60-433c-bfe9-8011cd85e631 could not be found. Jun 20 12:15:08.276320 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:15:08.276320 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-055bd929-7db4-4255-ade4-1bca2c8ada3f tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Returning 404 to user: Instance b0df0320-6a60-433c-bfe9-8011cd85e631 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:15:08.276320 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-055bd929-7db4-4255-ade4-1bca2c8ada3f tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631" status: 404 len: 111 microversion: 2.1 time: 0.037042 Jun 20 12:15:08.276320 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2034/3964] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:08 2022] GET /compute/v2.1/servers/b0df0320-6a60-433c-bfe9-8011cd85e631 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:15:08.278150 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cc85bd98-9322-473d-a306-1350437b313b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:08.278150 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cc85bd98-9322-473d-a306-1350437b313b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:08.285104 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cc85bd98-9322-473d-a306-1350437b313b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:08.286163 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cc85bd98-9322-473d-a306-1350437b313b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:08.286319 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cc85bd98-9322-473d-a306-1350437b313b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:08.286740 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cc85bd98-9322-473d-a306-1350437b313b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:08.406319 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6ab5ead1-f71b-4827-a045-195e3a117dba tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:08.422358 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6ab5ead1-f71b-4827-a045-195e3a117dba tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1695 microversion: 2.1 time: 0.651175 Jun 20 12:15:08.428268 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1931/3965] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:07 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1695 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:08.435723 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4afa13cb-b6e9-472a-abb7-d693cf595fbf tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '.version_select at 0x7f607385e940>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:08.555352 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cc85bd98-9322-473d-a306-1350437b313b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:08.565732 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cc85bd98-9322-473d-a306-1350437b313b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:08.567296 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cc85bd98-9322-473d-a306-1350437b313b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:08.568446 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cc85bd98-9322-473d-a306-1350437b313b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1722 microversion: 2.20 time: 0.298188 Jun 20 12:15:08.578747 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2035/3966] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:08 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1722 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:09.088992 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b17a8822-e602-4443-8ecd-feb255287194 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:09.090441 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b17a8822-e602-4443-8ecd-feb255287194 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] [instance: 1618debb-4bee-4c67-81b1-ef82968ac330] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:09.098417 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b17a8822-e602-4443-8ecd-feb255287194 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:09.099330 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b17a8822-e602-4443-8ecd-feb255287194 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:09.100571 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b17a8822-e602-4443-8ecd-feb255287194 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:09.101232 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b17a8822-e602-4443-8ecd-feb255287194 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:09.211082 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b17a8822-e602-4443-8ecd-feb255287194 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:09.222247 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b17a8822-e602-4443-8ecd-feb255287194 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:09.224460 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b17a8822-e602-4443-8ecd-feb255287194 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:09.225686 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b17a8822-e602-4443-8ecd-feb255287194 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] 10.222.0.27 "GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330" status: 200 len: 1365 microversion: 2.57 time: 0.143126 Jun 20 12:15:09.226746 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2036/3967] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:09 2022] GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330 => generated 1365 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:15:09.247728 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-192baa56-a487-4c9f-b93d-b191d8357048 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:09.248000 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-192baa56-a487-4c9f-b93d-b191d8357048 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] [instance: 193a5cec-91b5-4080-a798-0af9d9c09ce2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:09.254387 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-192baa56-a487-4c9f-b93d-b191d8357048 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:09.254909 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-192baa56-a487-4c9f-b93d-b191d8357048 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:09.255601 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-192baa56-a487-4c9f-b93d-b191d8357048 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:09.256463 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-192baa56-a487-4c9f-b93d-b191d8357048 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:09.358707 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-192baa56-a487-4c9f-b93d-b191d8357048 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58864ab3af344f180e02cc95e5cd9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90924e1b14d448668fa43d6845ff3e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:09.361548 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:15:09.368686 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-192baa56-a487-4c9f-b93d-b191d8357048 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] 10.222.0.27 "GET /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2" status: 200 len: 1284 microversion: 2.1 time: 0.126374 Jun 20 12:15:09.376358 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2037/3968] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:09 2022] GET /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2 => generated 1284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:09.449752 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-14a0f0b3-bd91-4a2f-8fc0-c23b0e9d91f7 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:09.449752 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-14a0f0b3-bd91-4a2f-8fc0-c23b0e9d91f7 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:09.457048 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-14a0f0b3-bd91-4a2f-8fc0-c23b0e9d91f7 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:09.458084 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-14a0f0b3-bd91-4a2f-8fc0-c23b0e9d91f7 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:09.458993 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-14a0f0b3-bd91-4a2f-8fc0-c23b0e9d91f7 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:09.460103 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-14a0f0b3-bd91-4a2f-8fc0-c23b0e9d91f7 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:09.475322 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4afa13cb-b6e9-472a-abb7-d693cf595fbf tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/f8e160e6-109c-435a-baf1-0a84a47fa2fa" status: 202 len: 0 microversion: 2.1 time: 1.045198 Jun 20 12:15:09.479445 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1932/3969] 10.222.0.27 () {58 vars in 1271 bytes} [Mon Jun 20 12:15:08 2022] DELETE /compute/v2.1/os-security-groups/f8e160e6-109c-435a-baf1-0a84a47fa2fa => generated 0 bytes in 1050 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:15:09.485218 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-095456e4-f12f-4613-b0c1-ac0134a4b7ff tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] Calling method '.version_select at 0x7f60847d9940>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:09.636405 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-14a0f0b3-bd91-4a2f-8fc0-c23b0e9d91f7 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:09.644818 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-14a0f0b3-bd91-4a2f-8fc0-c23b0e9d91f7 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1695 microversion: 2.1 time: 0.202888 Jun 20 12:15:09.645766 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2038/3970] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:09 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1695 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:09.652140 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2662a8b4-7678-436a-82ce-66e219416a4b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:09.652927 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2662a8b4-7678-436a-82ce-66e219416a4b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:09.659231 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2662a8b4-7678-436a-82ce-66e219416a4b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:09.659686 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2662a8b4-7678-436a-82ce-66e219416a4b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:09.660500 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2662a8b4-7678-436a-82ce-66e219416a4b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:09.660949 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2662a8b4-7678-436a-82ce-66e219416a4b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:09.676318 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-2662a8b4-7678-436a-82ce-66e219416a4b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] HTTP exception thrown: Instance 36218945-42bd-45a4-889b-b411acdd4155 could not be found. Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2662a8b4-7678-436a-82ce-66e219416a4b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Request method failure captured: Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 HTTP/1.1 Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGMtImrJbHndLBVoYOWoM3-V65gwaM_b_SzGPFkbszHqcLiFATjdW7DICvq4pkpgFYkMuCfhOGTLkBEfmLHGcQuUe69QWj9nbWfBGNnLxsZxvGdf_4HabUKas7EJzbQact9Y0ylsnVFlMkidmReSXTiLL3q1d65kobbcwpxem_TmW9M Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: X-Openstack-Nova-Api-Version: 2.32 Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 82fb9d01363f47cb9b0e019ad014de68 Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-TaggedBootDevicesTest-347005369 Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/82fb9d01363f47cb9b0e019ad014de68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/82fb9d01363f47cb9b0e019ad014de68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/82fb9d01363f47cb9b0e019ad014de68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_82fb9d01363f47cb9b0e019ad014de68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-TaggedBootDevicesTest-347005369 Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 82fb9d01363f47cb9b0e019ad014de68 Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-TaggedBootDevicesTest-347005369 Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-TaggedBootDevicesTest-347005369-project Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 76416b44294f4adb8320be6c3032cf35 Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-TaggedBootDevicesTest-347005369-project Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 36218945-42bd-45a4-889b-b411acdd4155 could not be found. Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '36218945-42bd-45a4-889b-b411acdd4155'} Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36218945-42bd-45a4-889b-b411acdd4155 could not be found. Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:15:09.677951 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:15:09.687891 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36218945-42bd-45a4-889b-b411acdd4155 could not be found. Jun 20 12:15:09.687891 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:15:09.687891 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:15:09.687891 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:15:09.687891 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:09.687891 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:15:09.687891 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:15:09.687891 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:15:09.687891 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:15:09.687891 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36218945-42bd-45a4-889b-b411acdd4155 could not be found. Jun 20 12:15:09.687891 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:15:09.687891 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2662a8b4-7678-436a-82ce-66e219416a4b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Returning 404 to user: Instance 36218945-42bd-45a4-889b-b411acdd4155 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:15:09.687891 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2662a8b4-7678-436a-82ce-66e219416a4b tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "DELETE /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 404 len: 111 microversion: 2.32 time: 0.032799 Jun 20 12:15:09.687891 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2039/3971] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Jun 20 12:15:09 2022] DELETE /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:15:09.687891 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-41dbc920-1cfc-4aac-9d44-6d2436cddfd3 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:09.687891 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-41dbc920-1cfc-4aac-9d44-6d2436cddfd3 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:09.693022 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-41dbc920-1cfc-4aac-9d44-6d2436cddfd3 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:09.693479 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-41dbc920-1cfc-4aac-9d44-6d2436cddfd3 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:09.694251 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-41dbc920-1cfc-4aac-9d44-6d2436cddfd3 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:09.694698 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-41dbc920-1cfc-4aac-9d44-6d2436cddfd3 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:09.837509 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-41dbc920-1cfc-4aac-9d44-6d2436cddfd3 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:09.847376 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-41dbc920-1cfc-4aac-9d44-6d2436cddfd3 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:09.848949 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-41dbc920-1cfc-4aac-9d44-6d2436cddfd3 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:09.850161 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-41dbc920-1cfc-4aac-9d44-6d2436cddfd3 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1722 microversion: 2.20 time: 0.168457 Jun 20 12:15:09.850733 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2040/3972] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:09 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:09.858305 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8a93b92a-0ebc-4e65-b2d5-6d858dcca795 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:09.859692 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8a93b92a-0ebc-4e65-b2d5-6d858dcca795 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] [instance: 36218945-42bd-45a4-889b-b411acdd4155] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:09.867301 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a93b92a-0ebc-4e65-b2d5-6d858dcca795 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:09.868422 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a93b92a-0ebc-4e65-b2d5-6d858dcca795 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:09.869676 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a93b92a-0ebc-4e65-b2d5-6d858dcca795 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:09.870433 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a93b92a-0ebc-4e65-b2d5-6d858dcca795 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:09.885336 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-8a93b92a-0ebc-4e65-b2d5-6d858dcca795 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] HTTP exception thrown: Instance 36218945-42bd-45a4-889b-b411acdd4155 could not be found. Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8a93b92a-0ebc-4e65-b2d5-6d858dcca795 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Request method failure captured: Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 HTTP/1.1 Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGMtImrJbHndLBVoYOWoM3-V65gwaM_b_SzGPFkbszHqcLiFATjdW7DICvq4pkpgFYkMuCfhOGTLkBEfmLHGcQuUe69QWj9nbWfBGNnLxsZxvGdf_4HabUKas7EJzbQact9Y0ylsnVFlMkidmReSXTiLL3q1d65kobbcwpxem_TmW9M Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: X-Openstack-Nova-Api-Version: 2.32 Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 82fb9d01363f47cb9b0e019ad014de68 Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-TaggedBootDevicesTest-347005369 Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/82fb9d01363f47cb9b0e019ad014de68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/82fb9d01363f47cb9b0e019ad014de68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/82fb9d01363f47cb9b0e019ad014de68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_82fb9d01363f47cb9b0e019ad014de68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-TaggedBootDevicesTest-347005369 Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 82fb9d01363f47cb9b0e019ad014de68 Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-TaggedBootDevicesTest-347005369 Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-TaggedBootDevicesTest-347005369-project Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 76416b44294f4adb8320be6c3032cf35 Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-TaggedBootDevicesTest-347005369-project Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 36218945-42bd-45a4-889b-b411acdd4155 could not be found. Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '36218945-42bd-45a4-889b-b411acdd4155'} Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36218945-42bd-45a4-889b-b411acdd4155 could not be found. Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36218945-42bd-45a4-889b-b411acdd4155 could not be found. Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:15:09.887022 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:15:09.892783 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:09.892783 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:15:09.892783 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:15:09.892783 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:15:09.892783 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:15:09.892783 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36218945-42bd-45a4-889b-b411acdd4155 could not be found. Jun 20 12:15:09.892783 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:15:09.892783 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8a93b92a-0ebc-4e65-b2d5-6d858dcca795 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] Returning 404 to user: Instance 36218945-42bd-45a4-889b-b411acdd4155 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:15:09.892783 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8a93b92a-0ebc-4e65-b2d5-6d858dcca795 tempest-TaggedBootDevicesTest-347005369 tempest-TaggedBootDevicesTest-347005369-project] 10.222.0.27 "GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155" status: 404 len: 111 microversion: 2.32 time: 0.036603 Jun 20 12:15:09.892783 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2041/3973] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:09 2022] GET /compute/v2.1/servers/36218945-42bd-45a4-889b-b411acdd4155 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:15:10.229292 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-095456e4-f12f-4613-b0c1-ac0134a4b7ff tempest-SecurityGroupsTestJSON-1959389845 tempest-SecurityGroupsTestJSON-1959389845-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/b2af0449-e138-4d37-ad72-5b7c486918d3" status: 202 len: 0 microversion: 2.1 time: 0.748016 Jun 20 12:15:10.230201 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1933/3974] 10.222.0.27 () {58 vars in 1271 bytes} [Mon Jun 20 12:15:09 2022] DELETE /compute/v2.1/os-security-groups/b2af0449-e138-4d37-ad72-5b7c486918d3 => generated 0 bytes in 750 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 12:15:10.245469 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2b9268fd-cc15-4958-b39e-0b660365c7e7 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:10.246297 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2b9268fd-cc15-4958-b39e-0b660365c7e7 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] [instance: 1618debb-4bee-4c67-81b1-ef82968ac330] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:10.269930 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2b9268fd-cc15-4958-b39e-0b660365c7e7 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:10.270395 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2b9268fd-cc15-4958-b39e-0b660365c7e7 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:10.275779 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2b9268fd-cc15-4958-b39e-0b660365c7e7 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:10.276534 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2b9268fd-cc15-4958-b39e-0b660365c7e7 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:10.352568 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-bec6afa4-552a-48a9-9c04-c5743730a181 req-75fef61f-c595-4807-84e9-20efd89a5d05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc", "name": "network-vif-unplugged", "status": "completed", "tag": "4b0b8cf9-ff46-4970-9b45-8795ce12a358"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:15:10.370587 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-bec6afa4-552a-48a9-9c04-c5743730a181 req-75fef61f-c595-4807-84e9-20efd89a5d05 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:10.372534 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-bec6afa4-552a-48a9-9c04-c5743730a181 req-75fef61f-c595-4807-84e9-20efd89a5d05 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:10.406201 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-bec6afa4-552a-48a9-9c04-c5743730a181 req-75fef61f-c595-4807-84e9-20efd89a5d05 service nova] Creating event network-vif-unplugged:4b0b8cf9-ff46-4970-9b45-8795ce12a358 for instance 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc on n-h1-master-1 Jun 20 12:15:10.412602 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-bec6afa4-552a-48a9-9c04-c5743730a181 req-75fef61f-c595-4807-84e9-20efd89a5d05 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063547 Jun 20 12:15:10.415219 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1934/3975] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:15:10.422005 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dd40b037-f5ea-478e-ad32-e57eb608309b tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:10.426217 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-dd40b037-f5ea-478e-ad32-e57eb608309b tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] [instance: 193a5cec-91b5-4080-a798-0af9d9c09ce2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:10.434414 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dd40b037-f5ea-478e-ad32-e57eb608309b tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:10.435319 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dd40b037-f5ea-478e-ad32-e57eb608309b tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:10.437538 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dd40b037-f5ea-478e-ad32-e57eb608309b tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:10.438743 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dd40b037-f5ea-478e-ad32-e57eb608309b tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:10.457915 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2b9268fd-cc15-4958-b39e-0b660365c7e7 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:10.473901 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2b9268fd-cc15-4958-b39e-0b660365c7e7 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:10.477805 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2b9268fd-cc15-4958-b39e-0b660365c7e7 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:10.482089 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2b9268fd-cc15-4958-b39e-0b660365c7e7 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] 10.222.0.27 "GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330" status: 200 len: 1365 microversion: 2.57 time: 0.241690 Jun 20 12:15:10.482955 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2042/3976] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:10 2022] GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330 => generated 1365 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:10.598940 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-dd40b037-f5ea-478e-ad32-e57eb608309b tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58864ab3af344f180e02cc95e5cd9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90924e1b14d448668fa43d6845ff3e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:10.610305 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dd40b037-f5ea-478e-ad32-e57eb608309b tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] 10.222.0.27 "GET /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2" status: 200 len: 1284 microversion: 2.1 time: 0.193358 Jun 20 12:15:10.613119 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1935/3977] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:10 2022] GET /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2 => generated 1284 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:10.663279 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fbb0c698-ceca-46ba-8aa0-36f04b8893af tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:10.664464 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fbb0c698-ceca-46ba-8aa0-36f04b8893af tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:10.672589 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fbb0c698-ceca-46ba-8aa0-36f04b8893af tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:10.673302 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fbb0c698-ceca-46ba-8aa0-36f04b8893af tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:10.674523 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fbb0c698-ceca-46ba-8aa0-36f04b8893af tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:10.675142 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fbb0c698-ceca-46ba-8aa0-36f04b8893af tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:10.892640 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8ad9fdf1-63f3-45b2-a538-16439420054c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:10.893450 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8ad9fdf1-63f3-45b2-a538-16439420054c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:10.908240 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ad9fdf1-63f3-45b2-a538-16439420054c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:10.910899 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ad9fdf1-63f3-45b2-a538-16439420054c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:10.915638 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ad9fdf1-63f3-45b2-a538-16439420054c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:10.916778 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ad9fdf1-63f3-45b2-a538-16439420054c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:11.644679 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fbb0c698-ceca-46ba-8aa0-36f04b8893af tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:11.645722 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8ad9fdf1-63f3-45b2-a538-16439420054c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:11.655277 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fbb0c698-ceca-46ba-8aa0-36f04b8893af tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1695 microversion: 2.1 time: 0.996765 Jun 20 12:15:11.658906 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8ad9fdf1-63f3-45b2-a538-16439420054c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:11.659278 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2043/3978] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:10 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1695 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:11.660733 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8ad9fdf1-63f3-45b2-a538-16439420054c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:11.661931 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8ad9fdf1-63f3-45b2-a538-16439420054c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1665 microversion: 2.20 time: 0.796571 Jun 20 12:15:11.674409 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d9604805-df34-4fad-a6b2-b64e92977826 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:11.675327 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d9604805-df34-4fad-a6b2-b64e92977826 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] [instance: 1618debb-4bee-4c67-81b1-ef82968ac330] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:11.678539 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1936/3979] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:10 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1665 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:11.686373 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9604805-df34-4fad-a6b2-b64e92977826 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:11.687529 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d90756d5-46e3-4907-9b9d-6e1c573f2654 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:11.688155 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d90756d5-46e3-4907-9b9d-6e1c573f2654 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] [instance: 193a5cec-91b5-4080-a798-0af9d9c09ce2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:11.689806 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9604805-df34-4fad-a6b2-b64e92977826 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:11.690900 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9604805-df34-4fad-a6b2-b64e92977826 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:11.695442 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9604805-df34-4fad-a6b2-b64e92977826 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:11.710301 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d90756d5-46e3-4907-9b9d-6e1c573f2654 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:11.710757 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d90756d5-46e3-4907-9b9d-6e1c573f2654 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:11.711546 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d90756d5-46e3-4907-9b9d-6e1c573f2654 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:11.712657 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d90756d5-46e3-4907-9b9d-6e1c573f2654 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:11.829331 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d9604805-df34-4fad-a6b2-b64e92977826 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:11.839791 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d9604805-df34-4fad-a6b2-b64e92977826 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:11.846588 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d90756d5-46e3-4907-9b9d-6e1c573f2654 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58864ab3af344f180e02cc95e5cd9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90924e1b14d448668fa43d6845ff3e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:11.857438 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d90756d5-46e3-4907-9b9d-6e1c573f2654 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] 10.222.0.27 "GET /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2" status: 200 len: 1284 microversion: 2.1 time: 0.177407 Jun 20 12:15:11.860053 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d9604805-df34-4fad-a6b2-b64e92977826 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:11.863175 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d9604805-df34-4fad-a6b2-b64e92977826 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] 10.222.0.27 "GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330" status: 200 len: 1365 microversion: 2.57 time: 0.202138 Jun 20 12:15:11.865732 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1937/3980] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:11 2022] GET /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2 => generated 1284 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:11.873040 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2044/3981] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:11 2022] GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330 => generated 1365 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:11.877435 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8cdc140c-1440-436a-94f1-e2a3890da545 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf058668-5cb2-48d9-abd4-5a66a1ebafd1"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:15:11.887680 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8cdc140c-1440-436a-94f1-e2a3890da545 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:11.906113 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8cdc140c-1440-436a-94f1-e2a3890da545 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:11.908513 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8cdc140c-1440-436a-94f1-e2a3890da545 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:11.909463 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8cdc140c-1440-436a-94f1-e2a3890da545 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:11.912230 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8cdc140c-1440-436a-94f1-e2a3890da545 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:12.570602 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8cdc140c-1440-436a-94f1-e2a3890da545 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "POST /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.702874 Jun 20 12:15:12.572238 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1938/3982] 10.222.0.27 () {62 vars in 1363 bytes} [Mon Jun 20 12:15:11 2022] POST /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc/os-volume_attachments => generated 188 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:15:12.675985 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-057422f4-1a1b-404d-ad13-941fceb83e75 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:12.677298 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-057422f4-1a1b-404d-ad13-941fceb83e75 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:12.693408 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-057422f4-1a1b-404d-ad13-941fceb83e75 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:12.694130 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-057422f4-1a1b-404d-ad13-941fceb83e75 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:12.695137 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-057422f4-1a1b-404d-ad13-941fceb83e75 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:12.695756 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-057422f4-1a1b-404d-ad13-941fceb83e75 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:12.773909 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-22338359-c2c9-40b6-bf3e-653b7f6d8a1e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:15:12.775110 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-22338359-c2c9-40b6-bf3e-653b7f6d8a1e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:12.787638 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22338359-c2c9-40b6-bf3e-653b7f6d8a1e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:12.788768 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22338359-c2c9-40b6-bf3e-653b7f6d8a1e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:12.792980 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22338359-c2c9-40b6-bf3e-653b7f6d8a1e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:12.793692 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22338359-c2c9-40b6-bf3e-653b7f6d8a1e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:12.910388 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-22338359-c2c9-40b6-bf3e-653b7f6d8a1e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "POST /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc/action" status: 202 len: 0 microversion: 2.20 time: 0.140854 Jun 20 12:15:12.914870 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1939/3983] 10.222.0.27 () {62 vars in 1318 bytes} [Mon Jun 20 12:15:12 2022] POST /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 20 12:15:12.923718 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4e462c0d-df35-4f1e-90ad-340ebef36dc4 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:12.925104 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4e462c0d-df35-4f1e-90ad-340ebef36dc4 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] [instance: 193a5cec-91b5-4080-a798-0af9d9c09ce2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:12.933405 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4e462c0d-df35-4f1e-90ad-340ebef36dc4 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:12.934332 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4e462c0d-df35-4f1e-90ad-340ebef36dc4 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:12.935667 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4e462c0d-df35-4f1e-90ad-340ebef36dc4 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:12.936383 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4e462c0d-df35-4f1e-90ad-340ebef36dc4 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:13.212621 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4e462c0d-df35-4f1e-90ad-340ebef36dc4 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58864ab3af344f180e02cc95e5cd9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90924e1b14d448668fa43d6845ff3e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:13.222458 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4e462c0d-df35-4f1e-90ad-340ebef36dc4 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] 10.222.0.27 "GET /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2" status: 200 len: 1351 microversion: 2.1 time: 0.305939 Jun 20 12:15:13.231869 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1940/3984] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:12 2022] GET /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2 => generated 1351 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:13.231869 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6ba3327b-703a-4995-8cf2-99dfd0bac9e7 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:13.231869 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6ba3327b-703a-4995-8cf2-99dfd0bac9e7 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] [instance: 1618debb-4bee-4c67-81b1-ef82968ac330] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:13.236606 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ba3327b-703a-4995-8cf2-99dfd0bac9e7 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:13.237073 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ba3327b-703a-4995-8cf2-99dfd0bac9e7 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:13.237897 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ba3327b-703a-4995-8cf2-99dfd0bac9e7 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:13.238337 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ba3327b-703a-4995-8cf2-99dfd0bac9e7 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:13.362538 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6ba3327b-703a-4995-8cf2-99dfd0bac9e7 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:13.382057 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6ba3327b-703a-4995-8cf2-99dfd0bac9e7 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:13.384029 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6ba3327b-703a-4995-8cf2-99dfd0bac9e7 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:13.385399 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6ba3327b-703a-4995-8cf2-99dfd0bac9e7 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] 10.222.0.27 "GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330" status: 200 len: 1365 microversion: 2.57 time: 0.161010 Jun 20 12:15:13.396389 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1941/3985] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:13 2022] GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:13.396389 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f9f95429-a35b-46ad-bdc6-08be77938346 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:13.396389 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f9f95429-a35b-46ad-bdc6-08be77938346 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:13.410698 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f9f95429-a35b-46ad-bdc6-08be77938346 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:13.411721 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f9f95429-a35b-46ad-bdc6-08be77938346 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:13.419384 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f9f95429-a35b-46ad-bdc6-08be77938346 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:13.423843 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f9f95429-a35b-46ad-bdc6-08be77938346 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:13.723693 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f9f95429-a35b-46ad-bdc6-08be77938346 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:13.739937 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f9f95429-a35b-46ad-bdc6-08be77938346 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:13.741632 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f9f95429-a35b-46ad-bdc6-08be77938346 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:13.742866 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f9f95429-a35b-46ad-bdc6-08be77938346 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1751 microversion: 2.20 time: 0.353375 Jun 20 12:15:13.743440 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1942/3986] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:13 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1751 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:13.841501 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-057422f4-1a1b-404d-ad13-941fceb83e75 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:13.851132 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-057422f4-1a1b-404d-ad13-941fceb83e75 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1695 microversion: 2.1 time: 1.178921 Jun 20 12:15:13.852373 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2045/3987] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:12 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1695 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:14.010478 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-025a8c7e-4ab3-4754-b112-3be2dc8780c5 req-bf7a120b-739f-4029-9e13-217ede98b828 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "193a5cec-91b5-4080-a798-0af9d9c09ce2", "tag": "965c65dd-7240-49f5-ac76-9e0b96eec749"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:15:14.031723 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-025a8c7e-4ab3-4754-b112-3be2dc8780c5 req-bf7a120b-739f-4029-9e13-217ede98b828 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:14.032412 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-025a8c7e-4ab3-4754-b112-3be2dc8780c5 req-bf7a120b-739f-4029-9e13-217ede98b828 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:14.057575 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-025a8c7e-4ab3-4754-b112-3be2dc8780c5 req-bf7a120b-739f-4029-9e13-217ede98b828 service nova] Creating event network-changed:965c65dd-7240-49f5-ac76-9e0b96eec749 for instance 193a5cec-91b5-4080-a798-0af9d9c09ce2 on n-h1-master-1 Jun 20 12:15:14.072515 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-025a8c7e-4ab3-4754-b112-3be2dc8780c5 req-bf7a120b-739f-4029-9e13-217ede98b828 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066260 Jun 20 12:15:14.073535 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1943/3988] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:15:14.239610 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3a7ba336-200f-4899-bda2-a3f3a9f4ee0d tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:14.240255 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3a7ba336-200f-4899-bda2-a3f3a9f4ee0d tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] [instance: 193a5cec-91b5-4080-a798-0af9d9c09ce2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:14.263716 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a7ba336-200f-4899-bda2-a3f3a9f4ee0d tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:14.264856 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a7ba336-200f-4899-bda2-a3f3a9f4ee0d tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:14.270238 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a7ba336-200f-4899-bda2-a3f3a9f4ee0d tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:14.270665 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a7ba336-200f-4899-bda2-a3f3a9f4ee0d tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:14.417429 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-816640aa-d13b-464a-add5-f1f99492adcc tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:14.418168 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-816640aa-d13b-464a-add5-f1f99492adcc tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] [instance: 1618debb-4bee-4c67-81b1-ef82968ac330] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:14.438303 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-816640aa-d13b-464a-add5-f1f99492adcc tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:14.438756 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-816640aa-d13b-464a-add5-f1f99492adcc tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:14.440247 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-816640aa-d13b-464a-add5-f1f99492adcc tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:14.440247 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-816640aa-d13b-464a-add5-f1f99492adcc tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:14.640924 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-816640aa-d13b-464a-add5-f1f99492adcc tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:14.654867 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-816640aa-d13b-464a-add5-f1f99492adcc tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:14.656741 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-816640aa-d13b-464a-add5-f1f99492adcc tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:14.658043 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-816640aa-d13b-464a-add5-f1f99492adcc tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] 10.222.0.27 "GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330" status: 200 len: 1365 microversion: 2.57 time: 0.252241 Jun 20 12:15:14.663560 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1944/3989] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:14 2022] GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330 => generated 1365 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:14.762787 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-05654277-699f-47f3-9019-7cf59d362982 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:14.763471 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-05654277-699f-47f3-9019-7cf59d362982 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:14.773840 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05654277-699f-47f3-9019-7cf59d362982 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:14.775616 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05654277-699f-47f3-9019-7cf59d362982 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:14.778961 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05654277-699f-47f3-9019-7cf59d362982 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:14.779660 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05654277-699f-47f3-9019-7cf59d362982 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:15.226385 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-05654277-699f-47f3-9019-7cf59d362982 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:15.247166 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-05654277-699f-47f3-9019-7cf59d362982 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:15.252674 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-05654277-699f-47f3-9019-7cf59d362982 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:15.257163 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-05654277-699f-47f3-9019-7cf59d362982 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1751 microversion: 2.20 time: 0.498537 Jun 20 12:15:15.261850 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1945/3990] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:14 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1751 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:15.297671 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f44e1dd9-287d-42d7-9353-ceceaefb6ee9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:15.303397 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f44e1dd9-287d-42d7-9353-ceceaefb6ee9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:15.344186 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f44e1dd9-287d-42d7-9353-ceceaefb6ee9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:15.344993 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f44e1dd9-287d-42d7-9353-ceceaefb6ee9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:15.347083 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f44e1dd9-287d-42d7-9353-ceceaefb6ee9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:15.354288 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f44e1dd9-287d-42d7-9353-ceceaefb6ee9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:15.520546 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3a7ba336-200f-4899-bda2-a3f3a9f4ee0d tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58864ab3af344f180e02cc95e5cd9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90924e1b14d448668fa43d6845ff3e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:15.532312 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3a7ba336-200f-4899-bda2-a3f3a9f4ee0d tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] 10.222.0.27 "GET /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2" status: 200 len: 1351 microversion: 2.1 time: 1.297081 Jun 20 12:15:15.533730 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2046/3991] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:14 2022] GET /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2 => generated 1351 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:15.593656 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f44e1dd9-287d-42d7-9353-ceceaefb6ee9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:15.603400 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:15:15.612483 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f44e1dd9-287d-42d7-9353-ceceaefb6ee9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1694 microversion: 2.1 time: 0.349239 Jun 20 12:15:15.618239 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1946/3992] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:15 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1694 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:15.682603 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-27c77fdc-2731-4af2-8bac-c312f4932ff4 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:15.683550 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-27c77fdc-2731-4af2-8bac-c312f4932ff4 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] [instance: 1618debb-4bee-4c67-81b1-ef82968ac330] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:15.694337 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-27c77fdc-2731-4af2-8bac-c312f4932ff4 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:15.695093 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-27c77fdc-2731-4af2-8bac-c312f4932ff4 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:15.695889 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-27c77fdc-2731-4af2-8bac-c312f4932ff4 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:15.696368 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-27c77fdc-2731-4af2-8bac-c312f4932ff4 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:16.247347 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-27c77fdc-2731-4af2-8bac-c312f4932ff4 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:16.272290 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-27c77fdc-2731-4af2-8bac-c312f4932ff4 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:16.280551 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3816b743-4bba-4d25-ad44-706f97f7c9e6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:16.281809 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3816b743-4bba-4d25-ad44-706f97f7c9e6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:16.291917 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-27c77fdc-2731-4af2-8bac-c312f4932ff4 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:16.295049 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-27c77fdc-2731-4af2-8bac-c312f4932ff4 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] 10.222.0.27 "GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330" status: 200 len: 1365 microversion: 2.57 time: 0.617615 Jun 20 12:15:16.301750 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2047/3993] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:15 2022] GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330 => generated 1365 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:16.305364 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3816b743-4bba-4d25-ad44-706f97f7c9e6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:16.306406 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3816b743-4bba-4d25-ad44-706f97f7c9e6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:16.307632 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3816b743-4bba-4d25-ad44-706f97f7c9e6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:16.308265 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3816b743-4bba-4d25-ad44-706f97f7c9e6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:16.457352 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-eb91e72c-53fe-42df-8fe6-fd7ed39c58ef req-a95397a3-120f-45dd-a24f-b1a92e67925e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d", "name": "network-vif-unplugged", "status": "completed", "tag": "ce10fc86-e544-41be-9e96-7780fa2e39cc"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:15:16.475117 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:15:16.481441 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-eb91e72c-53fe-42df-8fe6-fd7ed39c58ef req-a95397a3-120f-45dd-a24f-b1a92e67925e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:16.537563 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-eb91e72c-53fe-42df-8fe6-fd7ed39c58ef req-a95397a3-120f-45dd-a24f-b1a92e67925e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:16.537563 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-eb91e72c-53fe-42df-8fe6-fd7ed39c58ef req-a95397a3-120f-45dd-a24f-b1a92e67925e service nova] Creating event network-vif-unplugged:ce10fc86-e544-41be-9e96-7780fa2e39cc for instance f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d on n-h2-master-1 Jun 20 12:15:16.561907 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [req-eb91e72c-53fe-42df-8fe6-fd7ed39c58ef req-a95397a3-120f-45dd-a24f-b1a92e67925e service nova] Instance f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119127) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:15:16.607920 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-eb91e72c-53fe-42df-8fe6-fd7ed39c58ef req-a95397a3-120f-45dd-a24f-b1a92e67925e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.152860 Jun 20 12:15:16.609161 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2048/3994] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:15:16.622809 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f9249798-f189-45ea-9dc1-09088312a5ab tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:16.623538 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f9249798-f189-45ea-9dc1-09088312a5ab tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] [instance: 193a5cec-91b5-4080-a798-0af9d9c09ce2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:16.660274 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9249798-f189-45ea-9dc1-09088312a5ab tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:16.660769 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9249798-f189-45ea-9dc1-09088312a5ab tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:16.666395 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9249798-f189-45ea-9dc1-09088312a5ab tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:16.666868 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9249798-f189-45ea-9dc1-09088312a5ab tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:16.738834 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3816b743-4bba-4d25-ad44-706f97f7c9e6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:16.751314 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3816b743-4bba-4d25-ad44-706f97f7c9e6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:16.760685 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3816b743-4bba-4d25-ad44-706f97f7c9e6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:16.764094 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3816b743-4bba-4d25-ad44-706f97f7c9e6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1753 microversion: 2.20 time: 0.488230 Jun 20 12:15:16.768738 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1947/3995] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:16 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1753 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:16.778674 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-62605a46-23a7-4f07-88b6-857018e0b9ba tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:16.780113 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-62605a46-23a7-4f07-88b6-857018e0b9ba tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:16.795038 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-62605a46-23a7-4f07-88b6-857018e0b9ba tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:16.804845 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-62605a46-23a7-4f07-88b6-857018e0b9ba tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:16.804845 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-62605a46-23a7-4f07-88b6-857018e0b9ba tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:16.804845 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-62605a46-23a7-4f07-88b6-857018e0b9ba tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:16.989375 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=12 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:15:17.155804 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-62605a46-23a7-4f07-88b6-857018e0b9ba tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:17.164656 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-62605a46-23a7-4f07-88b6-857018e0b9ba tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1694 microversion: 2.1 time: 0.394476 Jun 20 12:15:17.168727 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1948/3996] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:16 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1694 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:17.317464 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-59a09341-e2a0-4a83-aae7-ee922f3837fc tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:17.329063 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-59a09341-e2a0-4a83-aae7-ee922f3837fc tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] [instance: 1618debb-4bee-4c67-81b1-ef82968ac330] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:17.345081 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-59a09341-e2a0-4a83-aae7-ee922f3837fc tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:17.356556 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-59a09341-e2a0-4a83-aae7-ee922f3837fc tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:17.357746 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-59a09341-e2a0-4a83-aae7-ee922f3837fc tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:17.358380 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-59a09341-e2a0-4a83-aae7-ee922f3837fc tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:17.466563 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-59a09341-e2a0-4a83-aae7-ee922f3837fc tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:17.474921 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-59a09341-e2a0-4a83-aae7-ee922f3837fc tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:17.476697 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-59a09341-e2a0-4a83-aae7-ee922f3837fc tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:17.478432 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-59a09341-e2a0-4a83-aae7-ee922f3837fc tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] 10.222.0.27 "GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330" status: 200 len: 1365 microversion: 2.57 time: 0.164703 Jun 20 12:15:17.479587 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1949/3997] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:17 2022] GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:15:17.787719 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d2d60d73-e55f-483e-9582-15e5641c7488 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:17.789161 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d2d60d73-e55f-483e-9582-15e5641c7488 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:17.798003 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d2d60d73-e55f-483e-9582-15e5641c7488 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:17.798646 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d2d60d73-e55f-483e-9582-15e5641c7488 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:17.799812 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d2d60d73-e55f-483e-9582-15e5641c7488 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:17.800360 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d2d60d73-e55f-483e-9582-15e5641c7488 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:17.903179 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f9249798-f189-45ea-9dc1-09088312a5ab tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58864ab3af344f180e02cc95e5cd9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90924e1b14d448668fa43d6845ff3e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:17.915817 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f9249798-f189-45ea-9dc1-09088312a5ab tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] 10.222.0.27 "GET /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2" status: 200 len: 1351 microversion: 2.1 time: 1.303129 Jun 20 12:15:17.925191 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2049/3998] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:16 2022] GET /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2 => generated 1351 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:17.999703 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d2d60d73-e55f-483e-9582-15e5641c7488 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:18.012797 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d2d60d73-e55f-483e-9582-15e5641c7488 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:18.014723 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d2d60d73-e55f-483e-9582-15e5641c7488 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:18.016088 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d2d60d73-e55f-483e-9582-15e5641c7488 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1753 microversion: 2.20 time: 0.233263 Jun 20 12:15:18.017398 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1950/3999] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:17 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1753 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:18.187506 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-aa9b4139-e03c-4943-870a-2e23adfe5e06 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:18.188532 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-aa9b4139-e03c-4943-870a-2e23adfe5e06 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:18.200236 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa9b4139-e03c-4943-870a-2e23adfe5e06 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:18.200622 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa9b4139-e03c-4943-870a-2e23adfe5e06 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:18.201426 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa9b4139-e03c-4943-870a-2e23adfe5e06 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:18.201871 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa9b4139-e03c-4943-870a-2e23adfe5e06 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:18.498264 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f080584b-a3c3-4fd3-a52c-9099ff661615 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:18.499796 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f080584b-a3c3-4fd3-a52c-9099ff661615 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] [instance: 1618debb-4bee-4c67-81b1-ef82968ac330] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:18.514171 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f080584b-a3c3-4fd3-a52c-9099ff661615 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:18.516903 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f080584b-a3c3-4fd3-a52c-9099ff661615 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:18.524613 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f080584b-a3c3-4fd3-a52c-9099ff661615 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:18.525319 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f080584b-a3c3-4fd3-a52c-9099ff661615 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:18.638372 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f080584b-a3c3-4fd3-a52c-9099ff661615 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:18.652224 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f080584b-a3c3-4fd3-a52c-9099ff661615 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:18.654970 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f080584b-a3c3-4fd3-a52c-9099ff661615 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:18.656536 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f080584b-a3c3-4fd3-a52c-9099ff661615 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] 10.222.0.27 "GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330" status: 200 len: 1365 microversion: 2.57 time: 0.163109 Jun 20 12:15:18.657879 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1951/4000] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:18 2022] GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:15:18.934390 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-09cc29af-906b-4353-a9db-1d63425ab183 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:18.935011 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-09cc29af-906b-4353-a9db-1d63425ab183 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] [instance: 193a5cec-91b5-4080-a798-0af9d9c09ce2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:18.947405 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-09cc29af-906b-4353-a9db-1d63425ab183 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:18.951095 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-09cc29af-906b-4353-a9db-1d63425ab183 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:18.953254 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-09cc29af-906b-4353-a9db-1d63425ab183 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:18.954713 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-09cc29af-906b-4353-a9db-1d63425ab183 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:19.170506 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-09cc29af-906b-4353-a9db-1d63425ab183 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58864ab3af344f180e02cc95e5cd9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90924e1b14d448668fa43d6845ff3e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:19.179570 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-09cc29af-906b-4353-a9db-1d63425ab183 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] 10.222.0.27 "GET /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2" status: 200 len: 1351 microversion: 2.1 time: 0.250740 Jun 20 12:15:19.180163 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1952/4001] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:18 2022] GET /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2 => generated 1351 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:19.187274 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-72ccacee-07fe-4d69-a4c1-27fb05654dfc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:19.187898 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-72ccacee-07fe-4d69-a4c1-27fb05654dfc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:19.195717 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-72ccacee-07fe-4d69-a4c1-27fb05654dfc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:19.196172 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-72ccacee-07fe-4d69-a4c1-27fb05654dfc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:19.197049 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-72ccacee-07fe-4d69-a4c1-27fb05654dfc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:19.197484 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-72ccacee-07fe-4d69-a4c1-27fb05654dfc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:19.375681 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-aa9b4139-e03c-4943-870a-2e23adfe5e06 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:19.392647 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-aa9b4139-e03c-4943-870a-2e23adfe5e06 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1694 microversion: 2.1 time: 1.211358 Jun 20 12:15:19.393537 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2050/4002] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:18 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1694 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:19.406442 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-72ccacee-07fe-4d69-a4c1-27fb05654dfc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:19.421774 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-72ccacee-07fe-4d69-a4c1-27fb05654dfc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:19.430778 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-72ccacee-07fe-4d69-a4c1-27fb05654dfc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:19.434619 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-72ccacee-07fe-4d69-a4c1-27fb05654dfc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1753 microversion: 2.20 time: 0.251838 Jun 20 12:15:19.435386 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1953/4003] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:19 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1753 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:19.470635 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-9f48f25c-375e-42f9-9314-a991ac9cac83 req-cd5d44dc-166e-4ff8-aecc-285c6ba39f06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d", "tag": "ce10fc86-e544-41be-9e96-7780fa2e39cc"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:15:19.479758 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-9f48f25c-375e-42f9-9314-a991ac9cac83 req-cd5d44dc-166e-4ff8-aecc-285c6ba39f06 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:19.480234 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-9f48f25c-375e-42f9-9314-a991ac9cac83 req-cd5d44dc-166e-4ff8-aecc-285c6ba39f06 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:19.501413 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-9f48f25c-375e-42f9-9314-a991ac9cac83 req-cd5d44dc-166e-4ff8-aecc-285c6ba39f06 service nova] Creating event network-changed:ce10fc86-e544-41be-9e96-7780fa2e39cc for instance f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d on n-h2-master-1 Jun 20 12:15:19.509516 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [req-9f48f25c-375e-42f9-9314-a991ac9cac83 req-cd5d44dc-166e-4ff8-aecc-285c6ba39f06 service nova] Instance f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119127) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:15:19.533192 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-9f48f25c-375e-42f9-9314-a991ac9cac83 req-cd5d44dc-166e-4ff8-aecc-285c6ba39f06 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066175 Jun 20 12:15:19.534363 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2051/4004] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:15:19.675863 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5cb017fc-b267-476b-9206-bff5e556ac05 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:19.676512 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5cb017fc-b267-476b-9206-bff5e556ac05 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] [instance: 1618debb-4bee-4c67-81b1-ef82968ac330] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:19.688229 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5cb017fc-b267-476b-9206-bff5e556ac05 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:19.688701 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5cb017fc-b267-476b-9206-bff5e556ac05 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:19.689486 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5cb017fc-b267-476b-9206-bff5e556ac05 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:19.689919 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5cb017fc-b267-476b-9206-bff5e556ac05 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:19.895610 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5cb017fc-b267-476b-9206-bff5e556ac05 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:19.911609 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5cb017fc-b267-476b-9206-bff5e556ac05 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:19.914824 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5cb017fc-b267-476b-9206-bff5e556ac05 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:19.920337 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5cb017fc-b267-476b-9206-bff5e556ac05 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] 10.222.0.27 "GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330" status: 200 len: 1365 microversion: 2.57 time: 0.248835 Jun 20 12:15:19.926576 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1954/4005] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:19 2022] GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330 => generated 1365 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:20.043987 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cf04130e-26e0-446c-b49f-a38ca117609a tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Action: 'create', calling method: .version_select at 0x7f607397e280>, body: {"keypair": {"name": "tempest-keypair-1870774164", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnjrmlr9YXGgdtVRY+ATth75VZg4oZb7i1l1368wrrNUrIslXpAZ2cCt8npDAfr3vxWZVDTnmEvDOeW3m7Inuzh6KKJ5cruf/ynqtc8El0a+bIF2F06JNyR/CLvGhNemQ=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:15:20.082300 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-cf04130e-26e0-446c-b49f-a38ca117609a tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Getting quotas for project bfe714415c9e4c9b8cd739c5a9b1c8b7. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:15:20.097673 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-cf04130e-26e0-446c-b49f-a38ca117609a tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Getting quotas for user 8919a400a671422593e94e0390c3d949 and project bfe714415c9e4c9b8cd739c5a9b1c8b7. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:15:20.178994 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cf04130e-26e0-446c-b49f-a38ca117609a tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.283247 Jun 20 12:15:20.181244 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2052/4006] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 12:15:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:15:20.196656 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2aff0848-9909-4ad8-8e01-4716bd710df7 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:20.197535 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2aff0848-9909-4ad8-8e01-4716bd710df7 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] [instance: 193a5cec-91b5-4080-a798-0af9d9c09ce2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:20.208694 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2aff0848-9909-4ad8-8e01-4716bd710df7 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:20.209375 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2aff0848-9909-4ad8-8e01-4716bd710df7 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:20.210323 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2aff0848-9909-4ad8-8e01-4716bd710df7 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:20.210907 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2aff0848-9909-4ad8-8e01-4716bd710df7 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:20.412743 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-763a3931-1684-4dcc-98e7-5a92039186d4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:20.413651 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-763a3931-1684-4dcc-98e7-5a92039186d4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:20.435433 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-763a3931-1684-4dcc-98e7-5a92039186d4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:20.439215 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-763a3931-1684-4dcc-98e7-5a92039186d4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:20.441383 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-763a3931-1684-4dcc-98e7-5a92039186d4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:20.443396 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-763a3931-1684-4dcc-98e7-5a92039186d4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:20.939396 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2aff0848-9909-4ad8-8e01-4716bd710df7 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58864ab3af344f180e02cc95e5cd9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90924e1b14d448668fa43d6845ff3e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:20.961737 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2aff0848-9909-4ad8-8e01-4716bd710df7 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] 10.222.0.27 "GET /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2" status: 200 len: 1351 microversion: 2.1 time: 0.769097 Jun 20 12:15:20.964003 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1955/4007] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:20 2022] GET /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2 => generated 1351 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:20.976487 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3e9db9fa-2acf-46f4-a3db-2d599dfc0fa4 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:20.980076 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3e9db9fa-2acf-46f4-a3db-2d599dfc0fa4 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:21.000495 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3e9db9fa-2acf-46f4-a3db-2d599dfc0fa4 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:21.001307 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3e9db9fa-2acf-46f4-a3db-2d599dfc0fa4 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:21.013436 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3e9db9fa-2acf-46f4-a3db-2d599dfc0fa4 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:21.014433 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3e9db9fa-2acf-46f4-a3db-2d599dfc0fa4 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:21.044976 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-763a3931-1684-4dcc-98e7-5a92039186d4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:21.059801 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-763a3931-1684-4dcc-98e7-5a92039186d4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1694 microversion: 2.1 time: 0.651816 Jun 20 12:15:21.073675 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2053/4008] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:20 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1694 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:21.079313 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-97cb8000-0b2a-45a8-b5ad-4fa21ae60fd6 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:21.080095 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-97cb8000-0b2a-45a8-b5ad-4fa21ae60fd6 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] [instance: 1618debb-4bee-4c67-81b1-ef82968ac330] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:21.088760 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-97cb8000-0b2a-45a8-b5ad-4fa21ae60fd6 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:21.089441 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-97cb8000-0b2a-45a8-b5ad-4fa21ae60fd6 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:21.090350 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-97cb8000-0b2a-45a8-b5ad-4fa21ae60fd6 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:21.090952 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-97cb8000-0b2a-45a8-b5ad-4fa21ae60fd6 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:21.198789 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-97cb8000-0b2a-45a8-b5ad-4fa21ae60fd6 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:21.214153 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-97cb8000-0b2a-45a8-b5ad-4fa21ae60fd6 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:21.216009 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-97cb8000-0b2a-45a8-b5ad-4fa21ae60fd6 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:21.217294 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-97cb8000-0b2a-45a8-b5ad-4fa21ae60fd6 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] 10.222.0.27 "GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330" status: 200 len: 1371 microversion: 2.57 time: 0.142241 Jun 20 12:15:21.227117 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2054/4009] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:21 2022] GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:21.690835 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-c0a00c44-6026-4498-bacd-936b2076384d req-980c7d03-afaa-4936-bfa8-69971434d6e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "193a5cec-91b5-4080-a798-0af9d9c09ce2", "name": "network-vif-plugged", "status": "completed", "tag": "965c65dd-7240-49f5-ac76-9e0b96eec749"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:15:21.707316 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-c0a00c44-6026-4498-bacd-936b2076384d req-980c7d03-afaa-4936-bfa8-69971434d6e2 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:21.709138 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-c0a00c44-6026-4498-bacd-936b2076384d req-980c7d03-afaa-4936-bfa8-69971434d6e2 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:21.723416 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-c0a00c44-6026-4498-bacd-936b2076384d req-980c7d03-afaa-4936-bfa8-69971434d6e2 service nova] Creating event network-vif-plugged:965c65dd-7240-49f5-ac76-9e0b96eec749 for instance 193a5cec-91b5-4080-a798-0af9d9c09ce2 on n-h1-master-1 Jun 20 12:15:21.731143 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-c0a00c44-6026-4498-bacd-936b2076384d req-980c7d03-afaa-4936-bfa8-69971434d6e2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047766 Jun 20 12:15:21.732580 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2055/4010] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:15:21.982391 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-384ebf9a-7bd0-4e6d-a5d7-c73dba3da4b9 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:21.983174 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-384ebf9a-7bd0-4e6d-a5d7-c73dba3da4b9 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] [instance: 193a5cec-91b5-4080-a798-0af9d9c09ce2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:22.001367 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-384ebf9a-7bd0-4e6d-a5d7-c73dba3da4b9 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:22.002009 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-384ebf9a-7bd0-4e6d-a5d7-c73dba3da4b9 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:22.002989 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-384ebf9a-7bd0-4e6d-a5d7-c73dba3da4b9 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:22.004016 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-384ebf9a-7bd0-4e6d-a5d7-c73dba3da4b9 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:22.319575 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3e9db9fa-2acf-46f4-a3db-2d599dfc0fa4 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:22.330667 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3e9db9fa-2acf-46f4-a3db-2d599dfc0fa4 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:22.332255 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3e9db9fa-2acf-46f4-a3db-2d599dfc0fa4 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:22.333545 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3e9db9fa-2acf-46f4-a3db-2d599dfc0fa4 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1753 microversion: 2.20 time: 1.368283 Jun 20 12:15:22.334442 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1956/4011] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:20 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1753 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:22.371859 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-50ea6547-1b63-40aa-9b1b-3faf5aa82004 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:22.372514 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-50ea6547-1b63-40aa-9b1b-3faf5aa82004 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:22.392178 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-50ea6547-1b63-40aa-9b1b-3faf5aa82004 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:22.392861 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-50ea6547-1b63-40aa-9b1b-3faf5aa82004 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:22.394619 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-50ea6547-1b63-40aa-9b1b-3faf5aa82004 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:22.397375 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-50ea6547-1b63-40aa-9b1b-3faf5aa82004 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:22.491586 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-384ebf9a-7bd0-4e6d-a5d7-c73dba3da4b9 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58864ab3af344f180e02cc95e5cd9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90924e1b14d448668fa43d6845ff3e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:22.503060 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-384ebf9a-7bd0-4e6d-a5d7-c73dba3da4b9 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] 10.222.0.27 "GET /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2" status: 200 len: 1351 microversion: 2.1 time: 0.525316 Jun 20 12:15:22.511779 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2056/4012] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:21 2022] GET /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2 => generated 1351 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:15:22.517429 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b222c808-5e79-42ed-b926-d098fff9e77b tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:22.525639 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b222c808-5e79-42ed-b926-d098fff9e77b tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] [instance: 1618debb-4bee-4c67-81b1-ef82968ac330] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:22.550166 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b222c808-5e79-42ed-b926-d098fff9e77b tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:22.550880 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b222c808-5e79-42ed-b926-d098fff9e77b tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:22.551692 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b222c808-5e79-42ed-b926-d098fff9e77b tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:22.552139 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b222c808-5e79-42ed-b926-d098fff9e77b tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:22.869821 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b222c808-5e79-42ed-b926-d098fff9e77b tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:22.887377 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b222c808-5e79-42ed-b926-d098fff9e77b tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:22.889247 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b222c808-5e79-42ed-b926-d098fff9e77b tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:22.892508 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b222c808-5e79-42ed-b926-d098fff9e77b tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] 10.222.0.27 "GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330" status: 200 len: 1371 microversion: 2.57 time: 0.377163 Jun 20 12:15:22.895313 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2057/4013] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:22 2022] GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330 => generated 1371 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:23.356280 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-52bbbb67-0a37-4f27-9a5e-0a9be5239d96 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:23.356907 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-52bbbb67-0a37-4f27-9a5e-0a9be5239d96 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:23.366722 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52bbbb67-0a37-4f27-9a5e-0a9be5239d96 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:23.367316 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52bbbb67-0a37-4f27-9a5e-0a9be5239d96 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:23.368601 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52bbbb67-0a37-4f27-9a5e-0a9be5239d96 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:23.369057 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52bbbb67-0a37-4f27-9a5e-0a9be5239d96 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:23.374913 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:15:23.501241 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-50ea6547-1b63-40aa-9b1b-3faf5aa82004 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:23.510045 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-50ea6547-1b63-40aa-9b1b-3faf5aa82004 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1694 microversion: 2.1 time: 1.174703 Jun 20 12:15:23.519670 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1957/4014] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:22 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1694 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:23.535469 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-113dcef4-833b-485c-9764-9fdd23e0b1eb tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:23.536296 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-113dcef4-833b-485c-9764-9fdd23e0b1eb tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] [instance: 193a5cec-91b5-4080-a798-0af9d9c09ce2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:23.549801 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-113dcef4-833b-485c-9764-9fdd23e0b1eb tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:23.550288 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-113dcef4-833b-485c-9764-9fdd23e0b1eb tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:23.554680 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-113dcef4-833b-485c-9764-9fdd23e0b1eb tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:23.555221 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-113dcef4-833b-485c-9764-9fdd23e0b1eb tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:23.991236 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-52bbbb67-0a37-4f27-9a5e-0a9be5239d96 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:24.032243 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-52bbbb67-0a37-4f27-9a5e-0a9be5239d96 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:24.042108 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-52bbbb67-0a37-4f27-9a5e-0a9be5239d96 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:24.045111 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-52bbbb67-0a37-4f27-9a5e-0a9be5239d96 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1753 microversion: 2.20 time: 0.692704 Jun 20 12:15:24.075468 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2058/4015] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:23 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1753 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:24.086879 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-75ba75bc-486c-4833-86d5-da6a0c2c488f tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:24.093522 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-75ba75bc-486c-4833-86d5-da6a0c2c488f tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] [instance: 1618debb-4bee-4c67-81b1-ef82968ac330] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:24.116966 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-75ba75bc-486c-4833-86d5-da6a0c2c488f tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:24.117787 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-75ba75bc-486c-4833-86d5-da6a0c2c488f tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:24.136880 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-75ba75bc-486c-4833-86d5-da6a0c2c488f tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:24.150823 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-75ba75bc-486c-4833-86d5-da6a0c2c488f tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:24.229542 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-113dcef4-833b-485c-9764-9fdd23e0b1eb tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58864ab3af344f180e02cc95e5cd9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90924e1b14d448668fa43d6845ff3e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:24.267104 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-113dcef4-833b-485c-9764-9fdd23e0b1eb tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] 10.222.0.27 "GET /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2" status: 200 len: 1351 microversion: 2.1 time: 0.735189 Jun 20 12:15:24.277788 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1958/4016] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:23 2022] GET /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2 => generated 1351 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:15:24.538380 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4faa2249-066f-4331-92ba-b574e5aaea0f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:24.539428 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4faa2249-066f-4331-92ba-b574e5aaea0f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:24.564906 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4faa2249-066f-4331-92ba-b574e5aaea0f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:24.565703 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4faa2249-066f-4331-92ba-b574e5aaea0f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:24.566698 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4faa2249-066f-4331-92ba-b574e5aaea0f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:24.567328 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4faa2249-066f-4331-92ba-b574e5aaea0f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:25.038503 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-75ba75bc-486c-4833-86d5-da6a0c2c488f tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:25.053278 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-75ba75bc-486c-4833-86d5-da6a0c2c488f tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:25.055500 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-75ba75bc-486c-4833-86d5-da6a0c2c488f tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:25.062701 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-75ba75bc-486c-4833-86d5-da6a0c2c488f tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] 10.222.0.27 "GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330" status: 200 len: 1371 microversion: 2.57 time: 0.985203 Jun 20 12:15:25.063781 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2059/4017] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:24 2022] GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330 => generated 1371 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:25.084940 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a59efce8-a636-46fd-90dc-b5dd40a0a67c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:25.086413 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a59efce8-a636-46fd-90dc-b5dd40a0a67c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:25.094043 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a59efce8-a636-46fd-90dc-b5dd40a0a67c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:25.094704 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a59efce8-a636-46fd-90dc-b5dd40a0a67c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:25.095670 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a59efce8-a636-46fd-90dc-b5dd40a0a67c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:25.096276 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a59efce8-a636-46fd-90dc-b5dd40a0a67c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:25.400387 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4faa2249-066f-4331-92ba-b574e5aaea0f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:25.411617 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4faa2249-066f-4331-92ba-b574e5aaea0f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1694 microversion: 2.1 time: 0.877738 Jun 20 12:15:25.412235 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1959/4018] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:24 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1694 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:15:25.425498 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d652676b-d18e-4802-b8e3-5e4b46c92bc0 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:25.426374 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d652676b-d18e-4802-b8e3-5e4b46c92bc0 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] [instance: 193a5cec-91b5-4080-a798-0af9d9c09ce2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:25.441390 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d652676b-d18e-4802-b8e3-5e4b46c92bc0 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:25.442064 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d652676b-d18e-4802-b8e3-5e4b46c92bc0 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:25.446028 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d652676b-d18e-4802-b8e3-5e4b46c92bc0 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:25.446935 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d652676b-d18e-4802-b8e3-5e4b46c92bc0 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:25.520420 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a59efce8-a636-46fd-90dc-b5dd40a0a67c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:25.537959 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a59efce8-a636-46fd-90dc-b5dd40a0a67c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:25.543473 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a59efce8-a636-46fd-90dc-b5dd40a0a67c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:25.552507 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a59efce8-a636-46fd-90dc-b5dd40a0a67c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1753 microversion: 2.20 time: 0.470889 Jun 20 12:15:25.554571 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2060/4019] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:25 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1753 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:25.791865 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d652676b-d18e-4802-b8e3-5e4b46c92bc0 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58864ab3af344f180e02cc95e5cd9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90924e1b14d448668fa43d6845ff3e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:25.800286 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d652676b-d18e-4802-b8e3-5e4b46c92bc0 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] 10.222.0.27 "GET /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2" status: 200 len: 1542 microversion: 2.1 time: 0.386944 Jun 20 12:15:25.804022 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1960/4020] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:25 2022] GET /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2 => generated 1542 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:25.820644 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e90e7fbe-dc4d-4c4c-b71d-87b59c393ddf tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:25.821144 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e90e7fbe-dc4d-4c4c-b71d-87b59c393ddf tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] [instance: 193a5cec-91b5-4080-a798-0af9d9c09ce2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:25.828500 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e90e7fbe-dc4d-4c4c-b71d-87b59c393ddf tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:25.828941 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e90e7fbe-dc4d-4c4c-b71d-87b59c393ddf tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:25.829717 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e90e7fbe-dc4d-4c4c-b71d-87b59c393ddf tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:25.857096 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e90e7fbe-dc4d-4c4c-b71d-87b59c393ddf tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:26.083539 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4217c35f-ffc9-4347-9ccd-5dc18c37dc12 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:26.085724 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4217c35f-ffc9-4347-9ccd-5dc18c37dc12 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] [instance: 1618debb-4bee-4c67-81b1-ef82968ac330] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:26.102133 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4217c35f-ffc9-4347-9ccd-5dc18c37dc12 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:26.102598 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4217c35f-ffc9-4347-9ccd-5dc18c37dc12 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:26.103524 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4217c35f-ffc9-4347-9ccd-5dc18c37dc12 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:26.103970 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4217c35f-ffc9-4347-9ccd-5dc18c37dc12 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:26.299280 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e90e7fbe-dc4d-4c4c-b71d-87b59c393ddf tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] 10.222.0.27 "GET /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.483103 Jun 20 12:15:26.300374 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2061/4021] 10.222.0.27 () {58 vars in 1274 bytes} [Mon Jun 20 12:15:25 2022] GET /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2/os-interface => generated 285 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:15:26.315800 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4217c35f-ffc9-4347-9ccd-5dc18c37dc12 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:26.331894 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4217c35f-ffc9-4347-9ccd-5dc18c37dc12 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:26.338477 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4217c35f-ffc9-4347-9ccd-5dc18c37dc12 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:26.342935 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4217c35f-ffc9-4347-9ccd-5dc18c37dc12 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] 10.222.0.27 "GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330" status: 200 len: 1356 microversion: 2.57 time: 0.264025 Jun 20 12:15:26.345974 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1961/4022] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:26 2022] GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330 => generated 1356 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:15:26.372627 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-85da6d62-6e78-4ac2-a626-d6189ec373de tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:26.373230 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-85da6d62-6e78-4ac2-a626-d6189ec373de tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] [instance: 1618debb-4bee-4c67-81b1-ef82968ac330] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:26.386824 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-85da6d62-6e78-4ac2-a626-d6189ec373de tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:26.388915 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-85da6d62-6e78-4ac2-a626-d6189ec373de tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:26.389787 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-85da6d62-6e78-4ac2-a626-d6189ec373de tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:26.393475 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-85da6d62-6e78-4ac2-a626-d6189ec373de tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:26.430525 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-23e34dec-c0dd-4c69-86bd-833f96338a94 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:26.431516 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-23e34dec-c0dd-4c69-86bd-833f96338a94 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:26.442531 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23e34dec-c0dd-4c69-86bd-833f96338a94 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:26.446653 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23e34dec-c0dd-4c69-86bd-833f96338a94 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:26.447976 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23e34dec-c0dd-4c69-86bd-833f96338a94 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:26.448785 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23e34dec-c0dd-4c69-86bd-833f96338a94 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:26.463910 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-85da6d62-6e78-4ac2-a626-d6189ec373de tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] [instance: 1618debb-4bee-4c67-81b1-ef82968ac330] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:15:26.617958 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-85da6d62-6e78-4ac2-a626-d6189ec373de tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330" status: 204 len: 0 microversion: 2.57 time: 0.252019 Jun 20 12:15:26.619935 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2062/4023] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Jun 20 12:15:26 2022] DELETE /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 12:15:26.628412 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5f3c5b82-248b-4196-bce8-585566f9aff7 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:26.629483 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5f3c5b82-248b-4196-bce8-585566f9aff7 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:26.638950 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f3c5b82-248b-4196-bce8-585566f9aff7 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:26.639792 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f3c5b82-248b-4196-bce8-585566f9aff7 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:26.640807 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f3c5b82-248b-4196-bce8-585566f9aff7 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:26.641589 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f3c5b82-248b-4196-bce8-585566f9aff7 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:26.926368 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5f3c5b82-248b-4196-bce8-585566f9aff7 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:26.937755 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5f3c5b82-248b-4196-bce8-585566f9aff7 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:26.940060 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5f3c5b82-248b-4196-bce8-585566f9aff7 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:26.944935 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5f3c5b82-248b-4196-bce8-585566f9aff7 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1753 microversion: 2.20 time: 0.323248 Jun 20 12:15:26.945803 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2063/4024] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:26 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1753 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:26.957732 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-58a9afbc-dce3-4c11-9964-8b72eb915981 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:26.958465 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-58a9afbc-dce3-4c11-9964-8b72eb915981 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] [instance: 1618debb-4bee-4c67-81b1-ef82968ac330] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:26.974028 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-58a9afbc-dce3-4c11-9964-8b72eb915981 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:26.974503 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-58a9afbc-dce3-4c11-9964-8b72eb915981 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:26.975302 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-58a9afbc-dce3-4c11-9964-8b72eb915981 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:26.975811 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-58a9afbc-dce3-4c11-9964-8b72eb915981 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:27.168161 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-58a9afbc-dce3-4c11-9964-8b72eb915981 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:27.183806 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-58a9afbc-dce3-4c11-9964-8b72eb915981 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:27.186407 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-58a9afbc-dce3-4c11-9964-8b72eb915981 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:27.187959 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-58a9afbc-dce3-4c11-9964-8b72eb915981 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] 10.222.0.27 "GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330" status: 200 len: 1362 microversion: 2.57 time: 0.241296 Jun 20 12:15:27.188727 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2064/4025] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:26 2022] GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330 => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:27.412783 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-23e34dec-c0dd-4c69-86bd-833f96338a94 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:27.430898 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-23e34dec-c0dd-4c69-86bd-833f96338a94 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1692 microversion: 2.1 time: 1.003564 Jun 20 12:15:27.445957 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1962/4026] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:26 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1692 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:27.963567 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-91700102-383a-49a9-acb5-f89f4baef8c2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:27.966795 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-91700102-383a-49a9-acb5-f89f4baef8c2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:27.987564 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91700102-383a-49a9-acb5-f89f4baef8c2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:27.993254 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91700102-383a-49a9-acb5-f89f4baef8c2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:27.996288 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91700102-383a-49a9-acb5-f89f4baef8c2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:28.000657 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91700102-383a-49a9-acb5-f89f4baef8c2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:28.207409 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-45c747b5-de43-4d5c-acfa-e51ac79bebfd tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:28.208843 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-45c747b5-de43-4d5c-acfa-e51ac79bebfd tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] [instance: 1618debb-4bee-4c67-81b1-ef82968ac330] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:28.221269 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-45c747b5-de43-4d5c-acfa-e51ac79bebfd tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:28.224059 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-45c747b5-de43-4d5c-acfa-e51ac79bebfd tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:28.225050 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-45c747b5-de43-4d5c-acfa-e51ac79bebfd tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:28.227659 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-45c747b5-de43-4d5c-acfa-e51ac79bebfd tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:28.253314 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:15:28.359721 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-91700102-383a-49a9-acb5-f89f4baef8c2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:28.374271 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-91700102-383a-49a9-acb5-f89f4baef8c2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:28.377635 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-91700102-383a-49a9-acb5-f89f4baef8c2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:28.382066 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-91700102-383a-49a9-acb5-f89f4baef8c2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1753 microversion: 2.20 time: 0.422999 Jun 20 12:15:28.383249 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2065/4027] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:27 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1753 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:28.451706 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e64ace3e-60f8-4889-9b87-9f804bc7486f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:28.452734 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e64ace3e-60f8-4889-9b87-9f804bc7486f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:28.460562 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e64ace3e-60f8-4889-9b87-9f804bc7486f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:28.461372 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e64ace3e-60f8-4889-9b87-9f804bc7486f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:28.462708 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e64ace3e-60f8-4889-9b87-9f804bc7486f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:28.463494 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e64ace3e-60f8-4889-9b87-9f804bc7486f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:28.577360 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-45c747b5-de43-4d5c-acfa-e51ac79bebfd tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:28.590675 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-45c747b5-de43-4d5c-acfa-e51ac79bebfd tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:28.592727 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-45c747b5-de43-4d5c-acfa-e51ac79bebfd tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:28.598513 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-45c747b5-de43-4d5c-acfa-e51ac79bebfd tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] 10.222.0.27 "GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330" status: 200 len: 1362 microversion: 2.57 time: 0.392958 Jun 20 12:15:28.602370 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1963/4028] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:28 2022] GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330 => generated 1362 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:15:29.025148 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e64ace3e-60f8-4889-9b87-9f804bc7486f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:29.042502 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e64ace3e-60f8-4889-9b87-9f804bc7486f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1689 microversion: 2.1 time: 0.594548 Jun 20 12:15:29.043975 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2066/4029] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:28 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1689 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:29.064687 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-77d0d89f-1b31-4305-90ee-173b727b198f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:15:29.066008 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-77d0d89f-1b31-4305-90ee-173b727b198f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:29.081754 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-77d0d89f-1b31-4305-90ee-173b727b198f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:29.083249 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-77d0d89f-1b31-4305-90ee-173b727b198f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:29.084755 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-77d0d89f-1b31-4305-90ee-173b727b198f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:29.085468 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-77d0d89f-1b31-4305-90ee-173b727b198f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:29.181884 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-77d0d89f-1b31-4305-90ee-173b727b198f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "POST /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d/action" status: 204 len: 0 microversion: 2.1 time: 0.124319 Jun 20 12:15:29.183343 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1964/4030] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:15:29 2022] POST /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d/action => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:15:29.196076 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3eb18a8f-7c4b-4044-8adb-59d915e20386 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:29.197662 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3eb18a8f-7c4b-4044-8adb-59d915e20386 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:29.220353 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3eb18a8f-7c4b-4044-8adb-59d915e20386 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:29.222583 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3eb18a8f-7c4b-4044-8adb-59d915e20386 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:29.222825 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3eb18a8f-7c4b-4044-8adb-59d915e20386 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:29.225260 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3eb18a8f-7c4b-4044-8adb-59d915e20386 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:29.403402 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-985f8264-6a04-47f1-8747-fced9305d9b2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:29.404556 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-985f8264-6a04-47f1-8747-fced9305d9b2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:29.414454 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-985f8264-6a04-47f1-8747-fced9305d9b2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:29.415926 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-985f8264-6a04-47f1-8747-fced9305d9b2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:29.417242 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-985f8264-6a04-47f1-8747-fced9305d9b2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:29.418098 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-985f8264-6a04-47f1-8747-fced9305d9b2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:30.047352 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3eb18a8f-7c4b-4044-8adb-59d915e20386 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:30.094818 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3eb18a8f-7c4b-4044-8adb-59d915e20386 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1689 microversion: 2.1 time: 0.904166 Jun 20 12:15:30.097779 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2067/4031] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:29 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1689 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:30.105766 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a1a7638e-d46b-44c0-8cfb-2e864434c1a6 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:30.107117 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a1a7638e-d46b-44c0-8cfb-2e864434c1a6 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] [instance: 1618debb-4bee-4c67-81b1-ef82968ac330] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:30.129541 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a1a7638e-d46b-44c0-8cfb-2e864434c1a6 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:30.131354 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a1a7638e-d46b-44c0-8cfb-2e864434c1a6 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:30.132231 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a1a7638e-d46b-44c0-8cfb-2e864434c1a6 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:30.132954 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a1a7638e-d46b-44c0-8cfb-2e864434c1a6 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:30.138379 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=4 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:15:30.191172 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-985f8264-6a04-47f1-8747-fced9305d9b2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:30.203327 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-985f8264-6a04-47f1-8747-fced9305d9b2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:30.204882 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-985f8264-6a04-47f1-8747-fced9305d9b2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:30.209828 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-985f8264-6a04-47f1-8747-fced9305d9b2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1809 microversion: 2.20 time: 0.811877 Jun 20 12:15:30.210605 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1965/4032] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:29 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1809 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:15:30.242074 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a1a7638e-d46b-44c0-8cfb-2e864434c1a6 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:30.254317 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a1a7638e-d46b-44c0-8cfb-2e864434c1a6 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:30.259542 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a1a7638e-d46b-44c0-8cfb-2e864434c1a6 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e330d65b44774feb92acd16e2edc1bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72bf68532fcb4a3a972cae865bd3182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:30.261738 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a1a7638e-d46b-44c0-8cfb-2e864434c1a6 tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] 10.222.0.27 "GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330" status: 200 len: 1362 microversion: 2.57 time: 0.161206 Jun 20 12:15:30.263481 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2068/4033] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:30 2022] GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:30.940908 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-88aeaccc-9aac-4e89-8c6e-60ee21f57900 req-a5d8dcd7-f639-4ca6-9443-eb2672d29ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "193a5cec-91b5-4080-a798-0af9d9c09ce2", "tag": "965c65dd-7240-49f5-ac76-9e0b96eec749"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:15:30.965705 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-88aeaccc-9aac-4e89-8c6e-60ee21f57900 req-a5d8dcd7-f639-4ca6-9443-eb2672d29ec1 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:30.966390 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-88aeaccc-9aac-4e89-8c6e-60ee21f57900 req-a5d8dcd7-f639-4ca6-9443-eb2672d29ec1 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:30.978986 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-88aeaccc-9aac-4e89-8c6e-60ee21f57900 req-a5d8dcd7-f639-4ca6-9443-eb2672d29ec1 service nova] Creating event network-changed:965c65dd-7240-49f5-ac76-9e0b96eec749 for instance 193a5cec-91b5-4080-a798-0af9d9c09ce2 on n-h1-master-1 Jun 20 12:15:30.994238 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-88aeaccc-9aac-4e89-8c6e-60ee21f57900 req-a5d8dcd7-f639-4ca6-9443-eb2672d29ec1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056744 Jun 20 12:15:30.998421 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1966/4034] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:15:31.117721 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2729925e-e531-40cd-9d90-e3f6ac20a5c9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:31.119734 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2729925e-e531-40cd-9d90-e3f6ac20a5c9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:31.131028 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2729925e-e531-40cd-9d90-e3f6ac20a5c9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:31.131847 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2729925e-e531-40cd-9d90-e3f6ac20a5c9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:31.133215 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2729925e-e531-40cd-9d90-e3f6ac20a5c9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:31.133951 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2729925e-e531-40cd-9d90-e3f6ac20a5c9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:31.230415 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-01e37618-71f8-4036-9c6e-a8c510870750 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:31.231434 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-01e37618-71f8-4036-9c6e-a8c510870750 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:31.246360 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-01e37618-71f8-4036-9c6e-a8c510870750 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:31.247849 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-01e37618-71f8-4036-9c6e-a8c510870750 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:31.250138 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-01e37618-71f8-4036-9c6e-a8c510870750 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:31.251941 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-01e37618-71f8-4036-9c6e-a8c510870750 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:32.084324 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2729925e-e531-40cd-9d90-e3f6ac20a5c9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:32.097244 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2729925e-e531-40cd-9d90-e3f6ac20a5c9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1689 microversion: 2.1 time: 0.983481 Jun 20 12:15:32.099803 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2069/4035] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:31 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1689 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:32.112021 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9b982bad-3d68-4ad9-aad2-3b42e766d63e tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:32.115440 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9b982bad-3d68-4ad9-aad2-3b42e766d63e tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] [instance: 1618debb-4bee-4c67-81b1-ef82968ac330] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:32.137435 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b982bad-3d68-4ad9-aad2-3b42e766d63e tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:32.138707 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b982bad-3d68-4ad9-aad2-3b42e766d63e tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:32.139720 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b982bad-3d68-4ad9-aad2-3b42e766d63e tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:32.142071 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b982bad-3d68-4ad9-aad2-3b42e766d63e tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:32.174236 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-9b982bad-3d68-4ad9-aad2-3b42e766d63e tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] HTTP exception thrown: Instance 1618debb-4bee-4c67-81b1-ef82968ac330 could not be found. Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9b982bad-3d68-4ad9-aad2-3b42e766d63e tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Request method failure captured: Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330 HTTP/1.1 Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGSwZ0lvmtkHYofslKWIsUTmvFdeHS-K9HG5TV4KDuA_XdbdTGz4OWs5ZvBaEQODu_KJvGbDNzf0LR15Pzx2pvIv0ZXfOtO4dsm7jNvE-ddaiJpKeKt_RnVfHfhOIYPjE_iS9yQB3LIoHDEhn9fxz16fNELlH4fHB89Lojn9DuasXUM Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: X-Openstack-Nova-Api-Version: 2.57 Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 72bf68532fcb4a3a972cae865bd3182a Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServerShowV257Test-1276079659 Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/72bf68532fcb4a3a972cae865bd3182a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/72bf68532fcb4a3a972cae865bd3182a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/72bf68532fcb4a3a972cae865bd3182a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_72bf68532fcb4a3a972cae865bd3182a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServerShowV257Test-1276079659 Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 72bf68532fcb4a3a972cae865bd3182a Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServerShowV257Test-1276079659 Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServerShowV257Test-1276079659-project Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: e330d65b44774feb92acd16e2edc1bc0 Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServerShowV257Test-1276079659-project Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 1618debb-4bee-4c67-81b1-ef82968ac330 could not be found. Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '1618debb-4bee-4c67-81b1-ef82968ac330'} Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1618debb-4bee-4c67-81b1-ef82968ac330 could not be found. Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1618debb-4bee-4c67-81b1-ef82968ac330 could not be found. Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:15:32.176538 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:15:32.180063 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:15:32.180063 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:15:32.180063 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:15:32.180063 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:15:32.180063 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:15:32.180063 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1618debb-4bee-4c67-81b1-ef82968ac330 could not be found. Jun 20 12:15:32.180063 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:15:32.182283 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9b982bad-3d68-4ad9-aad2-3b42e766d63e tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] Returning 404 to user: Instance 1618debb-4bee-4c67-81b1-ef82968ac330 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:15:32.183853 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9b982bad-3d68-4ad9-aad2-3b42e766d63e tempest-ServerShowV257Test-1276079659 tempest-ServerShowV257Test-1276079659-project] 10.222.0.27 "GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330" status: 404 len: 111 microversion: 2.57 time: 0.080113 Jun 20 12:15:32.184676 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2070/4036] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:32 2022] GET /compute/v2.1/servers/1618debb-4bee-4c67-81b1-ef82968ac330 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:15:32.196717 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-7c6fce9a-5a71-478d-b040-98dc7373d01b req-5228298e-066d-41b2-8531-e33d2e7f8591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d", "name": "network-vif-plugged", "status": "completed", "tag": "ce10fc86-e544-41be-9e96-7780fa2e39cc"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:15:32.214911 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-7c6fce9a-5a71-478d-b040-98dc7373d01b req-5228298e-066d-41b2-8531-e33d2e7f8591 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:32.215422 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-7c6fce9a-5a71-478d-b040-98dc7373d01b req-5228298e-066d-41b2-8531-e33d2e7f8591 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:32.226993 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-01e37618-71f8-4036-9c6e-a8c510870750 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:32.244084 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-01e37618-71f8-4036-9c6e-a8c510870750 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:32.246588 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-7c6fce9a-5a71-478d-b040-98dc7373d01b req-5228298e-066d-41b2-8531-e33d2e7f8591 service nova] Creating event network-vif-plugged:ce10fc86-e544-41be-9e96-7780fa2e39cc for instance f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d on n-h2-master-1 Jun 20 12:15:32.247750 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-01e37618-71f8-4036-9c6e-a8c510870750 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:32.252232 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-01e37618-71f8-4036-9c6e-a8c510870750 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1809 microversion: 2.20 time: 1.025940 Jun 20 12:15:32.267107 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [req-7c6fce9a-5a71-478d-b040-98dc7373d01b req-5228298e-066d-41b2-8531-e33d2e7f8591 service nova] Instance f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119127) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:15:32.268169 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1967/4037] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:31 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1809 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:15:32.274477 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-216dfc7c-f188-4037-9650-b8ab6635560d req-dfd1ba3a-7280-44dd-bce4-73a5f80e0ad6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc", "tag": "4b0b8cf9-ff46-4970-9b45-8795ce12a358"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:15:32.286980 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=88 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:15:32.292080 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-216dfc7c-f188-4037-9650-b8ab6635560d req-dfd1ba3a-7280-44dd-bce4-73a5f80e0ad6 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:32.292895 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-216dfc7c-f188-4037-9650-b8ab6635560d req-dfd1ba3a-7280-44dd-bce4-73a5f80e0ad6 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:32.313254 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-216dfc7c-f188-4037-9650-b8ab6635560d req-dfd1ba3a-7280-44dd-bce4-73a5f80e0ad6 service nova] Creating event network-changed:4b0b8cf9-ff46-4970-9b45-8795ce12a358 for instance 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc on n-h2-master-1 Jun 20 12:15:32.314986 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-7c6fce9a-5a71-478d-b040-98dc7373d01b req-5228298e-066d-41b2-8531-e33d2e7f8591 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119291 Jun 20 12:15:32.322572 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2071/4038] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:15:32.330740 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-216dfc7c-f188-4037-9650-b8ab6635560d req-dfd1ba3a-7280-44dd-bce4-73a5f80e0ad6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058463 Jun 20 12:15:32.332430 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1968/4039] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:15:33.119851 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f66f9717-d45b-4d1f-af6d-321198b2ab70 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:33.121253 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f66f9717-d45b-4d1f-af6d-321198b2ab70 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:33.130452 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f66f9717-d45b-4d1f-af6d-321198b2ab70 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:33.135251 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f66f9717-d45b-4d1f-af6d-321198b2ab70 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:33.136257 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f66f9717-d45b-4d1f-af6d-321198b2ab70 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:33.136874 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f66f9717-d45b-4d1f-af6d-321198b2ab70 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:33.273385 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e12ed851-1e04-4497-bd8b-d4725baef7c9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:33.276807 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e12ed851-1e04-4497-bd8b-d4725baef7c9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:33.286222 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e12ed851-1e04-4497-bd8b-d4725baef7c9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:33.286938 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e12ed851-1e04-4497-bd8b-d4725baef7c9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:33.287856 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e12ed851-1e04-4497-bd8b-d4725baef7c9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:33.288460 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e12ed851-1e04-4497-bd8b-d4725baef7c9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:33.495642 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f66f9717-d45b-4d1f-af6d-321198b2ab70 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:33.512390 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f66f9717-d45b-4d1f-af6d-321198b2ab70 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1689 microversion: 2.1 time: 0.398335 Jun 20 12:15:33.513825 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2072/4040] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:33 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1689 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:34.158656 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e12ed851-1e04-4497-bd8b-d4725baef7c9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:34.170571 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e12ed851-1e04-4497-bd8b-d4725baef7c9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:34.172967 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e12ed851-1e04-4497-bd8b-d4725baef7c9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:34.174668 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e12ed851-1e04-4497-bd8b-d4725baef7c9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1809 microversion: 2.20 time: 0.905729 Jun 20 12:15:34.175945 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1969/4041] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:33 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1809 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:15:34.532329 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-845b5755-1116-4914-b294-781f258b07b1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:34.534239 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-845b5755-1116-4914-b294-781f258b07b1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:34.551753 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-845b5755-1116-4914-b294-781f258b07b1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:34.557223 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-845b5755-1116-4914-b294-781f258b07b1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:34.559943 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-845b5755-1116-4914-b294-781f258b07b1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:34.561041 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-845b5755-1116-4914-b294-781f258b07b1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:35.183464 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-845b5755-1116-4914-b294-781f258b07b1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:35.198458 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-babe1a74-fe1b-47d1-a9a4-3a4f203b6334 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:35.199078 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-babe1a74-fe1b-47d1-a9a4-3a4f203b6334 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:35.211551 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-845b5755-1116-4914-b294-781f258b07b1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1689 microversion: 2.1 time: 0.684532 Jun 20 12:15:35.220654 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2073/4042] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:34 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1689 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:35.224104 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-babe1a74-fe1b-47d1-a9a4-3a4f203b6334 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:35.229989 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-babe1a74-fe1b-47d1-a9a4-3a4f203b6334 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:35.249392 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-babe1a74-fe1b-47d1-a9a4-3a4f203b6334 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:35.249859 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-babe1a74-fe1b-47d1-a9a4-3a4f203b6334 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:36.241577 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-83bff2fd-8857-4a12-84bd-d0f7247c9181 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:36.242781 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-83bff2fd-8857-4a12-84bd-d0f7247c9181 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:36.247061 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-babe1a74-fe1b-47d1-a9a4-3a4f203b6334 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:36.261201 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-83bff2fd-8857-4a12-84bd-d0f7247c9181 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:36.263042 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-83bff2fd-8857-4a12-84bd-d0f7247c9181 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:36.265770 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-83bff2fd-8857-4a12-84bd-d0f7247c9181 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:36.266454 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-83bff2fd-8857-4a12-84bd-d0f7247c9181 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:36.267548 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-babe1a74-fe1b-47d1-a9a4-3a4f203b6334 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:36.301876 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-babe1a74-fe1b-47d1-a9a4-3a4f203b6334 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:36.303193 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-babe1a74-fe1b-47d1-a9a4-3a4f203b6334 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1809 microversion: 2.20 time: 1.113126 Jun 20 12:15:36.304103 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1970/4043] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:35 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1809 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:36.344169 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:15:37.102807 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-83bff2fd-8857-4a12-84bd-d0f7247c9181 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:37.115566 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-83bff2fd-8857-4a12-84bd-d0f7247c9181 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1681 microversion: 2.1 time: 0.876912 Jun 20 12:15:37.118513 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2074/4044] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:36 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1681 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:37.327886 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7729d698-19db-41e3-a5dd-c44fd1f8d9e1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:37.328529 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7729d698-19db-41e3-a5dd-c44fd1f8d9e1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:37.358445 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7729d698-19db-41e3-a5dd-c44fd1f8d9e1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:37.361798 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7729d698-19db-41e3-a5dd-c44fd1f8d9e1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:37.365951 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7729d698-19db-41e3-a5dd-c44fd1f8d9e1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:37.367155 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7729d698-19db-41e3-a5dd-c44fd1f8d9e1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:38.133376 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7729d698-19db-41e3-a5dd-c44fd1f8d9e1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:38.155975 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7729d698-19db-41e3-a5dd-c44fd1f8d9e1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:38.158073 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7729d698-19db-41e3-a5dd-c44fd1f8d9e1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:38.169210 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7729d698-19db-41e3-a5dd-c44fd1f8d9e1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1809 microversion: 2.20 time: 0.847532 Jun 20 12:15:38.170168 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1971/4045] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:37 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1809 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:15:39.194316 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-21554b46-7edd-444f-a681-8d18c5c2f41b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:39.195147 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-21554b46-7edd-444f-a681-8d18c5c2f41b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:39.214763 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:15:39.222663 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21554b46-7edd-444f-a681-8d18c5c2f41b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:39.223189 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21554b46-7edd-444f-a681-8d18c5c2f41b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:39.224114 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21554b46-7edd-444f-a681-8d18c5c2f41b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:39.235833 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21554b46-7edd-444f-a681-8d18c5c2f41b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:40.885755 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-21554b46-7edd-444f-a681-8d18c5c2f41b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:40.909117 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-21554b46-7edd-444f-a681-8d18c5c2f41b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:40.913453 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-21554b46-7edd-444f-a681-8d18c5c2f41b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:40.915080 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-21554b46-7edd-444f-a681-8d18c5c2f41b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1809 microversion: 2.20 time: 1.730486 Jun 20 12:15:40.927932 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2075/4046] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:39 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1809 bytes in 1744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:41.950250 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5fd77323-5a9c-4b8e-9106-a5e0412f9af0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:41.952070 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5fd77323-5a9c-4b8e-9106-a5e0412f9af0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:41.984602 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5fd77323-5a9c-4b8e-9106-a5e0412f9af0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:41.989947 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5fd77323-5a9c-4b8e-9106-a5e0412f9af0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:41.990918 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5fd77323-5a9c-4b8e-9106-a5e0412f9af0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:41.998579 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5fd77323-5a9c-4b8e-9106-a5e0412f9af0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:42.647825 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5fd77323-5a9c-4b8e-9106-a5e0412f9af0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:42.669711 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5fd77323-5a9c-4b8e-9106-a5e0412f9af0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:42.681023 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5fd77323-5a9c-4b8e-9106-a5e0412f9af0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:42.681023 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5fd77323-5a9c-4b8e-9106-a5e0412f9af0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1809 microversion: 2.20 time: 0.736152 Jun 20 12:15:42.692632 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1972/4047] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:41 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1809 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:43.701271 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c23a53c2-c085-4f7e-9e87-cdea44bb3641 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:43.703654 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c23a53c2-c085-4f7e-9e87-cdea44bb3641 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:43.742149 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c23a53c2-c085-4f7e-9e87-cdea44bb3641 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:43.745069 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c23a53c2-c085-4f7e-9e87-cdea44bb3641 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:43.747810 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c23a53c2-c085-4f7e-9e87-cdea44bb3641 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:43.751193 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c23a53c2-c085-4f7e-9e87-cdea44bb3641 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:44.552742 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c23a53c2-c085-4f7e-9e87-cdea44bb3641 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:44.574580 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c23a53c2-c085-4f7e-9e87-cdea44bb3641 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:44.578146 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c23a53c2-c085-4f7e-9e87-cdea44bb3641 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:44.585126 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c23a53c2-c085-4f7e-9e87-cdea44bb3641 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1809 microversion: 2.20 time: 0.888106 Jun 20 12:15:44.591612 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2076/4048] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:43 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1809 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:45.609924 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fa50100b-41cf-4985-ae87-483e20308039 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:45.612044 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fa50100b-41cf-4985-ae87-483e20308039 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:45.620331 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fa50100b-41cf-4985-ae87-483e20308039 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:45.621040 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fa50100b-41cf-4985-ae87-483e20308039 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:45.622245 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fa50100b-41cf-4985-ae87-483e20308039 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:45.622822 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fa50100b-41cf-4985-ae87-483e20308039 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:46.325654 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fa50100b-41cf-4985-ae87-483e20308039 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:46.341800 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fa50100b-41cf-4985-ae87-483e20308039 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:46.374626 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fa50100b-41cf-4985-ae87-483e20308039 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:46.381324 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fa50100b-41cf-4985-ae87-483e20308039 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1809 microversion: 2.20 time: 0.778363 Jun 20 12:15:46.388233 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1973/4049] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:45 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1809 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:47.403255 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f8c78472-68bd-4420-803d-ad25ab8a35da tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:47.403879 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f8c78472-68bd-4420-803d-ad25ab8a35da tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:47.418365 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f8c78472-68bd-4420-803d-ad25ab8a35da tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:47.419076 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f8c78472-68bd-4420-803d-ad25ab8a35da tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:47.420021 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f8c78472-68bd-4420-803d-ad25ab8a35da tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:47.420628 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f8c78472-68bd-4420-803d-ad25ab8a35da tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:47.797395 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f8c78472-68bd-4420-803d-ad25ab8a35da tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:47.821526 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f8c78472-68bd-4420-803d-ad25ab8a35da tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:47.828380 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f8c78472-68bd-4420-803d-ad25ab8a35da tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:47.831463 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f8c78472-68bd-4420-803d-ad25ab8a35da tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1809 microversion: 2.20 time: 0.433771 Jun 20 12:15:47.831903 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2077/4050] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:47 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1809 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:15:48.850823 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-57fafe4b-08a8-4eb7-8198-413136ffc2a7 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:48.854101 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-57fafe4b-08a8-4eb7-8198-413136ffc2a7 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:48.877065 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-57fafe4b-08a8-4eb7-8198-413136ffc2a7 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:48.880468 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-57fafe4b-08a8-4eb7-8198-413136ffc2a7 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:48.881440 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-57fafe4b-08a8-4eb7-8198-413136ffc2a7 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:48.884906 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-57fafe4b-08a8-4eb7-8198-413136ffc2a7 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:49.421641 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-57fafe4b-08a8-4eb7-8198-413136ffc2a7 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:49.473345 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-57fafe4b-08a8-4eb7-8198-413136ffc2a7 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:49.475124 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-57fafe4b-08a8-4eb7-8198-413136ffc2a7 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:49.484590 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-57fafe4b-08a8-4eb7-8198-413136ffc2a7 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1809 microversion: 2.20 time: 0.630969 Jun 20 12:15:49.485680 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1974/4051] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:48 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1809 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:50.502706 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d5c1c1fe-dc45-4dab-bb91-b069bf2df7be tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:50.503317 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d5c1c1fe-dc45-4dab-bb91-b069bf2df7be tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:50.510829 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d5c1c1fe-dc45-4dab-bb91-b069bf2df7be tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:50.511272 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d5c1c1fe-dc45-4dab-bb91-b069bf2df7be tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:50.517817 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d5c1c1fe-dc45-4dab-bb91-b069bf2df7be tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:50.518419 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d5c1c1fe-dc45-4dab-bb91-b069bf2df7be tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:51.057263 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d5c1c1fe-dc45-4dab-bb91-b069bf2df7be tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:51.073094 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d5c1c1fe-dc45-4dab-bb91-b069bf2df7be tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:51.074846 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d5c1c1fe-dc45-4dab-bb91-b069bf2df7be tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:51.076243 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d5c1c1fe-dc45-4dab-bb91-b069bf2df7be tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1809 microversion: 2.20 time: 0.577633 Jun 20 12:15:51.081257 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2078/4052] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:50 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1809 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:52.100344 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-827234aa-e1a0-450f-a1c1-7cb9c672c15b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:52.101591 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-827234aa-e1a0-450f-a1c1-7cb9c672c15b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:52.119330 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-827234aa-e1a0-450f-a1c1-7cb9c672c15b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:52.120127 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-827234aa-e1a0-450f-a1c1-7cb9c672c15b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:52.121411 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-827234aa-e1a0-450f-a1c1-7cb9c672c15b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:52.122052 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-827234aa-e1a0-450f-a1c1-7cb9c672c15b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:52.506538 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-827234aa-e1a0-450f-a1c1-7cb9c672c15b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:52.527794 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-827234aa-e1a0-450f-a1c1-7cb9c672c15b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:52.530192 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-827234aa-e1a0-450f-a1c1-7cb9c672c15b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:52.536794 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-827234aa-e1a0-450f-a1c1-7cb9c672c15b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1809 microversion: 2.20 time: 0.440148 Jun 20 12:15:52.540637 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1975/4053] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:52 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1809 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:53.500048 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-28ee12d7-748c-4dd8-9922-791f5e6e467a tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-658264979", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "9451ed42-f58d-4583-9720-694b48e581b9"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:15:53.567316 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3da72aec-16b8-479f-ba0e-6d05d54c8037 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:53.569322 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3da72aec-16b8-479f-ba0e-6d05d54c8037 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:53.592761 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3da72aec-16b8-479f-ba0e-6d05d54c8037 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:53.596012 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3da72aec-16b8-479f-ba0e-6d05d54c8037 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:53.598023 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3da72aec-16b8-479f-ba0e-6d05d54c8037 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:53.610516 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3da72aec-16b8-479f-ba0e-6d05d54c8037 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:53.648100 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-28ee12d7-748c-4dd8-9922-791f5e6e467a tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] validate_networks() for [('9451ed42-f58d-4583-9720-694b48e581b9', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:15:54.378801 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3da72aec-16b8-479f-ba0e-6d05d54c8037 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:54.399947 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3da72aec-16b8-479f-ba0e-6d05d54c8037 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:54.406485 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3da72aec-16b8-479f-ba0e-6d05d54c8037 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:54.411538 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3da72aec-16b8-479f-ba0e-6d05d54c8037 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1809 microversion: 2.20 time: 0.856483 Jun 20 12:15:54.415770 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1976/4054] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:53 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1809 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:54.976189 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-28ee12d7-748c-4dd8-9922-791f5e6e467a tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:15:54.977536 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-28ee12d7-748c-4dd8-9922-791f5e6e467a tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:15:54.978421 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-28ee12d7-748c-4dd8-9922-791f5e6e467a tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:15:54.979032 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-28ee12d7-748c-4dd8-9922-791f5e6e467a tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:15:54.979661 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-28ee12d7-748c-4dd8-9922-791f5e6e467a tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:15:54.991475 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28ee12d7-748c-4dd8-9922-791f5e6e467a tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:54.994777 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28ee12d7-748c-4dd8-9922-791f5e6e467a tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:54.997803 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28ee12d7-748c-4dd8-9922-791f5e6e467a tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:55.001773 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28ee12d7-748c-4dd8-9922-791f5e6e467a tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:55.049756 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-28ee12d7-748c-4dd8-9922-791f5e6e467a tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Getting quotas for project fbfe7e4e3ca845c08a651a5698adab56. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:15:55.064778 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-28ee12d7-748c-4dd8-9922-791f5e6e467a tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Getting quotas for user 01ffca09c8434630996a51a079cabc57 and project fbfe7e4e3ca845c08a651a5698adab56. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:15:55.072317 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3da72aec-16b8-479f-ba0e-6d05d54c8037 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:55.074411 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3da72aec-16b8-479f-ba0e-6d05d54c8037 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002266 Jun 20 12:15:55.087145 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1977/4055] 10.222.0.27 () {56 vars in 885 bytes} [Mon Jun 20 12:15:55 2022] GET /compute/ => generated 377 bytes in 15 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jun 20 12:15:55.093233 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-28ee12d7-748c-4dd8-9922-791f5e6e467a tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:15:55.101111 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-28ee12d7-748c-4dd8-9922-791f5e6e467a tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] [instance: d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:15:55.226794 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-28ee12d7-748c-4dd8-9922-791f5e6e467a tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.438254 Jun 20 12:15:55.247678 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2079/4056] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:15:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2464 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:15:55.258794 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5012a74b-2686-4ed2-b65e-d4243850584c tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:55.260336 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5012a74b-2686-4ed2-b65e-d4243850584c tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] [instance: d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:55.435005 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cb6d7992-4e2e-46b5-b929-4d0b18547490 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:55.436052 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cb6d7992-4e2e-46b5-b929-4d0b18547490 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:55.444032 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cb6d7992-4e2e-46b5-b929-4d0b18547490 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:55.445079 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cb6d7992-4e2e-46b5-b929-4d0b18547490 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:55.446214 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cb6d7992-4e2e-46b5-b929-4d0b18547490 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:55.446932 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cb6d7992-4e2e-46b5-b929-4d0b18547490 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:55.529057 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5012a74b-2686-4ed2-b65e-d4243850584c tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ffca09c8434630996a51a079cabc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbfe7e4e3ca845c08a651a5698adab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:55.537589 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5012a74b-2686-4ed2-b65e-d4243850584c tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] 10.222.0.27 "GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3" status: 200 len: 1216 microversion: 2.1 time: 0.283873 Jun 20 12:15:55.554636 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1978/4057] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:55 2022] GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3 => generated 1216 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:15:56.560434 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-24e06512-4fb5-4cee-9ac4-ce22cd1cf6fc tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:56.562479 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-24e06512-4fb5-4cee-9ac4-ce22cd1cf6fc tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] [instance: d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:56.580690 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-24e06512-4fb5-4cee-9ac4-ce22cd1cf6fc tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:56.581288 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-24e06512-4fb5-4cee-9ac4-ce22cd1cf6fc tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:56.585208 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-24e06512-4fb5-4cee-9ac4-ce22cd1cf6fc tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:56.585694 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-24e06512-4fb5-4cee-9ac4-ce22cd1cf6fc tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:56.855743 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-24e06512-4fb5-4cee-9ac4-ce22cd1cf6fc tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ffca09c8434630996a51a079cabc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbfe7e4e3ca845c08a651a5698adab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:56.858697 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cb6d7992-4e2e-46b5-b929-4d0b18547490 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:56.864376 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-24e06512-4fb5-4cee-9ac4-ce22cd1cf6fc tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] 10.222.0.27 "GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3" status: 200 len: 1212 microversion: 2.1 time: 0.308526 Jun 20 12:15:56.865065 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1979/4058] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:56 2022] GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3 => generated 1212 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:15:56.870251 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cb6d7992-4e2e-46b5-b929-4d0b18547490 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:56.878162 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cb6d7992-4e2e-46b5-b929-4d0b18547490 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:56.879442 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cb6d7992-4e2e-46b5-b929-4d0b18547490 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1809 microversion: 2.20 time: 1.451834 Jun 20 12:15:56.890604 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2080/4059] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:55 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1809 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:57.905882 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d758a091-f9a6-41cb-ba89-c0d72b3c9dd0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:57.906924 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d758a091-f9a6-41cb-ba89-c0d72b3c9dd0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:57.908539 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4bceaf26-f158-47f5-9871-42b4881bbe86 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:57.921302 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4bceaf26-f158-47f5-9871-42b4881bbe86 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] [instance: d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:57.964609 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d758a091-f9a6-41cb-ba89-c0d72b3c9dd0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:57.970045 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d758a091-f9a6-41cb-ba89-c0d72b3c9dd0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:57.973463 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d758a091-f9a6-41cb-ba89-c0d72b3c9dd0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:57.975697 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d758a091-f9a6-41cb-ba89-c0d72b3c9dd0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:57.978987 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4bceaf26-f158-47f5-9871-42b4881bbe86 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:57.979835 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4bceaf26-f158-47f5-9871-42b4881bbe86 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:57.987575 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4bceaf26-f158-47f5-9871-42b4881bbe86 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:57.991325 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4bceaf26-f158-47f5-9871-42b4881bbe86 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:58.247306 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4bceaf26-f158-47f5-9871-42b4881bbe86 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ffca09c8434630996a51a079cabc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbfe7e4e3ca845c08a651a5698adab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:58.268577 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4bceaf26-f158-47f5-9871-42b4881bbe86 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] 10.222.0.27 "GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3" status: 200 len: 1268 microversion: 2.1 time: 0.380625 Jun 20 12:15:58.271296 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1980/4060] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:57 2022] GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3 => generated 1268 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:58.684599 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-59cc72ce-c240-40c8-9d0a-1f785460ac3a tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:58.685113 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-59cc72ce-c240-40c8-9d0a-1f785460ac3a tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] [instance: 193a5cec-91b5-4080-a798-0af9d9c09ce2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:58.700463 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-59cc72ce-c240-40c8-9d0a-1f785460ac3a tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:58.701106 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-59cc72ce-c240-40c8-9d0a-1f785460ac3a tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:58.702032 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-59cc72ce-c240-40c8-9d0a-1f785460ac3a tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:58.702606 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-59cc72ce-c240-40c8-9d0a-1f785460ac3a tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:58.778367 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d758a091-f9a6-41cb-ba89-c0d72b3c9dd0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:58.779246 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:15:58.791090 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-59cc72ce-c240-40c8-9d0a-1f785460ac3a tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] [instance: 193a5cec-91b5-4080-a798-0af9d9c09ce2] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:15:58.799199 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d758a091-f9a6-41cb-ba89-c0d72b3c9dd0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:58.806559 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d758a091-f9a6-41cb-ba89-c0d72b3c9dd0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:58.808105 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d758a091-f9a6-41cb-ba89-c0d72b3c9dd0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1809 microversion: 2.20 time: 0.913748 Jun 20 12:15:58.811570 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2081/4061] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:57 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1809 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:59.089410 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-59cc72ce-c240-40c8-9d0a-1f785460ac3a tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] 10.222.0.27 "DELETE /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2" status: 204 len: 0 microversion: 2.1 time: 0.408732 Jun 20 12:15:59.091116 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1981/4062] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:15:58 2022] DELETE /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:15:59.101207 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8464d917-19dc-44d1-8c16-02f78f6cafb0 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:59.102787 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8464d917-19dc-44d1-8c16-02f78f6cafb0 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] [instance: 193a5cec-91b5-4080-a798-0af9d9c09ce2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:59.118853 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8464d917-19dc-44d1-8c16-02f78f6cafb0 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:59.120163 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8464d917-19dc-44d1-8c16-02f78f6cafb0 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:59.122863 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8464d917-19dc-44d1-8c16-02f78f6cafb0 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:59.125123 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8464d917-19dc-44d1-8c16-02f78f6cafb0 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:59.290943 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-967005c3-99e4-47d9-acee-f54a814ca225 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:59.291767 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-967005c3-99e4-47d9-acee-f54a814ca225 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] [instance: d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:59.314982 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-967005c3-99e4-47d9-acee-f54a814ca225 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:59.316920 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-967005c3-99e4-47d9-acee-f54a814ca225 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:59.319621 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-967005c3-99e4-47d9-acee-f54a814ca225 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:59.326608 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-967005c3-99e4-47d9-acee-f54a814ca225 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:59.415465 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8464d917-19dc-44d1-8c16-02f78f6cafb0 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58864ab3af344f180e02cc95e5cd9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90924e1b14d448668fa43d6845ff3e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:59.433646 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8464d917-19dc-44d1-8c16-02f78f6cafb0 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] 10.222.0.27 "GET /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2" status: 200 len: 1667 microversion: 2.1 time: 0.337533 Jun 20 12:15:59.446621 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2082/4063] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:59 2022] GET /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2 => generated 1667 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:59.700650 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-967005c3-99e4-47d9-acee-f54a814ca225 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ffca09c8434630996a51a079cabc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbfe7e4e3ca845c08a651a5698adab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:15:59.710904 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-967005c3-99e4-47d9-acee-f54a814ca225 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] 10.222.0.27 "GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3" status: 200 len: 1274 microversion: 2.1 time: 0.423790 Jun 20 12:15:59.712147 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1982/4064] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:15:59 2022] GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3 => generated 1274 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:59.832460 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f83c29bc-184f-44b4-bd1f-37662d8a5611 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:59.833320 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f83c29bc-184f-44b4-bd1f-37662d8a5611 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:15:59.850188 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f83c29bc-184f-44b4-bd1f-37662d8a5611 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:59.850882 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f83c29bc-184f-44b4-bd1f-37662d8a5611 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:15:59.852423 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f83c29bc-184f-44b4-bd1f-37662d8a5611 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:15:59.855659 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f83c29bc-184f-44b4-bd1f-37662d8a5611 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:00.455177 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-98323dbf-23d3-40c2-8002-c515f68e7339 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:00.455801 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-98323dbf-23d3-40c2-8002-c515f68e7339 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] [instance: 193a5cec-91b5-4080-a798-0af9d9c09ce2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:00.467974 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-98323dbf-23d3-40c2-8002-c515f68e7339 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:00.468479 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-98323dbf-23d3-40c2-8002-c515f68e7339 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:00.469299 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-98323dbf-23d3-40c2-8002-c515f68e7339 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:00.469724 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-98323dbf-23d3-40c2-8002-c515f68e7339 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:00.536916 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f83c29bc-184f-44b4-bd1f-37662d8a5611 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:00.551862 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f83c29bc-184f-44b4-bd1f-37662d8a5611 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:00.554545 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f83c29bc-184f-44b4-bd1f-37662d8a5611 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:00.556139 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f83c29bc-184f-44b4-bd1f-37662d8a5611 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1809 microversion: 2.20 time: 0.729286 Jun 20 12:16:00.556936 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2083/4065] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:15:59 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1809 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:16:00.730118 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3070f50f-611a-48b1-bb17-00225ebd05b4 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:00.731001 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3070f50f-611a-48b1-bb17-00225ebd05b4 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] [instance: d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:00.746074 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3070f50f-611a-48b1-bb17-00225ebd05b4 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:00.746596 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3070f50f-611a-48b1-bb17-00225ebd05b4 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:00.747400 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3070f50f-611a-48b1-bb17-00225ebd05b4 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:00.747963 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3070f50f-611a-48b1-bb17-00225ebd05b4 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:00.776647 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-98323dbf-23d3-40c2-8002-c515f68e7339 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58864ab3af344f180e02cc95e5cd9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90924e1b14d448668fa43d6845ff3e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:00.788372 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-98323dbf-23d3-40c2-8002-c515f68e7339 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] 10.222.0.27 "GET /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2" status: 200 len: 1667 microversion: 2.1 time: 0.335470 Jun 20 12:16:00.789683 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1983/4066] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:00 2022] GET /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2 => generated 1667 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:00.919514 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3a984a5d-3cb6-4ee7-ba66-ac5e8f682b6c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1808560062", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "47445bdc-5236-4568-ba87-1bd8b1933085"}], "security_groups": [{"name": "tempest-securitygroup--1839851273"}], "key_name": "tempest-keypair-1870774164", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "3aa8b478-92df-4560-9369-609c423f210b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:16:01.183085 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-3a984a5d-3cb6-4ee7-ba66-ac5e8f682b6c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] validate_networks() for [('47445bdc-5236-4568-ba87-1bd8b1933085', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:16:01.236731 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3070f50f-611a-48b1-bb17-00225ebd05b4 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ffca09c8434630996a51a079cabc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbfe7e4e3ca845c08a651a5698adab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:01.295168 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3070f50f-611a-48b1-bb17-00225ebd05b4 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] 10.222.0.27 "GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3" status: 200 len: 1316 microversion: 2.1 time: 0.569990 Jun 20 12:16:01.296521 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2084/4067] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:00 2022] GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3 => generated 1316 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:16:01.576446 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c4b1cdd1-b501-4f40-972c-eac7203ce8ca tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:01.577096 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c4b1cdd1-b501-4f40-972c-eac7203ce8ca tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:01.584320 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c4b1cdd1-b501-4f40-972c-eac7203ce8ca tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:01.585015 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c4b1cdd1-b501-4f40-972c-eac7203ce8ca tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:01.586050 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c4b1cdd1-b501-4f40-972c-eac7203ce8ca tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:01.586819 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c4b1cdd1-b501-4f40-972c-eac7203ce8ca tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:02.585499 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c4b1cdd1-b501-4f40-972c-eac7203ce8ca tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:02.595780 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c4b1cdd1-b501-4f40-972c-eac7203ce8ca tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:02.597361 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c4b1cdd1-b501-4f40-972c-eac7203ce8ca tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:02.607746 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c4b1cdd1-b501-4f40-972c-eac7203ce8ca tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1809 microversion: 2.20 time: 1.027524 Jun 20 12:16:02.617813 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2085/4068] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:16:01 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1809 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:16:02.626452 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-adf8a568-c52f-47b1-bc88-6f9ff82bbf68 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:02.627594 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-adf8a568-c52f-47b1-bc88-6f9ff82bbf68 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] [instance: 193a5cec-91b5-4080-a798-0af9d9c09ce2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:02.637198 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-adf8a568-c52f-47b1-bc88-6f9ff82bbf68 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:02.638200 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-adf8a568-c52f-47b1-bc88-6f9ff82bbf68 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:02.639166 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-adf8a568-c52f-47b1-bc88-6f9ff82bbf68 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:02.639767 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-adf8a568-c52f-47b1-bc88-6f9ff82bbf68 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:02.957278 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-adf8a568-c52f-47b1-bc88-6f9ff82bbf68 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58864ab3af344f180e02cc95e5cd9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90924e1b14d448668fa43d6845ff3e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:02.976625 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-adf8a568-c52f-47b1-bc88-6f9ff82bbf68 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] 10.222.0.27 "GET /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2" status: 200 len: 1600 microversion: 2.1 time: 0.353289 Jun 20 12:16:02.977206 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2086/4069] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:02 2022] GET /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2 => generated 1600 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:03.014521 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-b940b0dc-e747-4d9b-9f77-27b1742009e2 req-5835089c-71d2-4de4-821d-1346a07e0c7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc", "name": "network-vif-plugged", "status": "completed", "tag": "4b0b8cf9-ff46-4970-9b45-8795ce12a358"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:16:03.039700 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b940b0dc-e747-4d9b-9f77-27b1742009e2 req-5835089c-71d2-4de4-821d-1346a07e0c7f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:03.040459 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b940b0dc-e747-4d9b-9f77-27b1742009e2 req-5835089c-71d2-4de4-821d-1346a07e0c7f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:03.062917 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-b940b0dc-e747-4d9b-9f77-27b1742009e2 req-5835089c-71d2-4de4-821d-1346a07e0c7f service nova] Creating event network-vif-plugged:4b0b8cf9-ff46-4970-9b45-8795ce12a358 for instance 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc on n-h2-master-1 Jun 20 12:16:03.081374 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-b940b0dc-e747-4d9b-9f77-27b1742009e2 req-5835089c-71d2-4de4-821d-1346a07e0c7f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089373 Jun 20 12:16:03.082350 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2087/4070] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:16:03.091335 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b75b8a2c-8cb1-4e8d-8de7-47a7feb9221d tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:03.096576 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b75b8a2c-8cb1-4e8d-8de7-47a7feb9221d tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] [instance: d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:03.120634 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b75b8a2c-8cb1-4e8d-8de7-47a7feb9221d tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:03.121439 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b75b8a2c-8cb1-4e8d-8de7-47a7feb9221d tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:03.122521 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b75b8a2c-8cb1-4e8d-8de7-47a7feb9221d tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:03.123100 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b75b8a2c-8cb1-4e8d-8de7-47a7feb9221d tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:03.371042 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:16:03.389513 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-3a984a5d-3cb6-4ee7-ba66-ac5e8f682b6c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Getting quotas for project bfe714415c9e4c9b8cd739c5a9b1c8b7. Resources: dict_keys(['metadata_items']) {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:16:03.405726 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-3a984a5d-3cb6-4ee7-ba66-ac5e8f682b6c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Getting quotas for user 8919a400a671422593e94e0390c3d949 and project bfe714415c9e4c9b8cd739c5a9b1c8b7. Resources: dict_keys(['metadata_items']) {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:16:03.454317 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-3a984a5d-3cb6-4ee7-ba66-ac5e8f682b6c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:16:03.454983 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-3a984a5d-3cb6-4ee7-ba66-ac5e8f682b6c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:16:03.455599 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-3a984a5d-3cb6-4ee7-ba66-ac5e8f682b6c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:16:03.456173 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-3a984a5d-3cb6-4ee7-ba66-ac5e8f682b6c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:16:03.457346 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-3a984a5d-3cb6-4ee7-ba66-ac5e8f682b6c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:16:03.482416 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3a984a5d-3cb6-4ee7-ba66-ac5e8f682b6c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:03.483117 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3a984a5d-3cb6-4ee7-ba66-ac5e8f682b6c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:03.484056 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3a984a5d-3cb6-4ee7-ba66-ac5e8f682b6c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:03.484656 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3a984a5d-3cb6-4ee7-ba66-ac5e8f682b6c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:03.529545 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-3a984a5d-3cb6-4ee7-ba66-ac5e8f682b6c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Getting quotas for project bfe714415c9e4c9b8cd739c5a9b1c8b7. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:16:03.547555 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-3a984a5d-3cb6-4ee7-ba66-ac5e8f682b6c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Getting quotas for user 8919a400a671422593e94e0390c3d949 and project bfe714415c9e4c9b8cd739c5a9b1c8b7. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:16:03.687285 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3a984a5d-3cb6-4ee7-ba66-ac5e8f682b6c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:16:03.690178 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3a984a5d-3cb6-4ee7-ba66-ac5e8f682b6c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] [instance: ce950356-da51-4847-96ba-76f575f7d9ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3aa8b478-92df-4560-9369-609c423f210b',volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:16:03.822655 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b75b8a2c-8cb1-4e8d-8de7-47a7feb9221d tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ffca09c8434630996a51a079cabc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbfe7e4e3ca845c08a651a5698adab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:03.837574 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b75b8a2c-8cb1-4e8d-8de7-47a7feb9221d tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] 10.222.0.27 "GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3" status: 200 len: 1316 microversion: 2.1 time: 0.753636 Jun 20 12:16:03.838433 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2088/4071] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:03 2022] GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3 => generated 1316 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:03.851620 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b5c8b7c6-9a75-403d-807a-b3b45e540541 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:16:03.853560 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b5c8b7c6-9a75-403d-807a-b3b45e540541 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:03.864560 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5c8b7c6-9a75-403d-807a-b3b45e540541 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:03.865191 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5c8b7c6-9a75-403d-807a-b3b45e540541 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:03.866331 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5c8b7c6-9a75-403d-807a-b3b45e540541 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:03.866876 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5c8b7c6-9a75-403d-807a-b3b45e540541 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:04.013736 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b5c8b7c6-9a75-403d-807a-b3b45e540541 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "POST /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d/action" status: 200 len: 24557 microversion: 2.1 time: 0.168457 Jun 20 12:16:04.020759 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2089/4072] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:16:03 2022] POST /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d/action => generated 24557 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:16:04.021274 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3a984a5d-3cb6-4ee7-ba66-ac5e8f682b6c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.102047 Jun 20 12:16:04.022235 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1984/4073] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:16:00 2022] POST /compute/v2.1/servers => generated 407 bytes in 3109 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 12:16:04.040816 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8b1f49ef-bfdb-4e1c-a646-5b95729fcf43 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:04.043672 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d97391a3-847c-4cd7-8f23-4cbdc06eb956 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:04.045289 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8b1f49ef-bfdb-4e1c-a646-5b95729fcf43 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] [instance: 193a5cec-91b5-4080-a798-0af9d9c09ce2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:04.049946 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d97391a3-847c-4cd7-8f23-4cbdc06eb956 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:04.078383 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d97391a3-847c-4cd7-8f23-4cbdc06eb956 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:04.081571 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d97391a3-847c-4cd7-8f23-4cbdc06eb956 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:04.082595 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d97391a3-847c-4cd7-8f23-4cbdc06eb956 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:04.087708 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d97391a3-847c-4cd7-8f23-4cbdc06eb956 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:04.094137 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8b1f49ef-bfdb-4e1c-a646-5b95729fcf43 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:04.094614 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8b1f49ef-bfdb-4e1c-a646-5b95729fcf43 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:04.095515 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8b1f49ef-bfdb-4e1c-a646-5b95729fcf43 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:04.095961 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8b1f49ef-bfdb-4e1c-a646-5b95729fcf43 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:04.477256 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8b1f49ef-bfdb-4e1c-a646-5b95729fcf43 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58864ab3af344f180e02cc95e5cd9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90924e1b14d448668fa43d6845ff3e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:04.496170 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8b1f49ef-bfdb-4e1c-a646-5b95729fcf43 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] 10.222.0.27 "GET /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2" status: 200 len: 1600 microversion: 2.1 time: 0.467826 Jun 20 12:16:04.497564 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1985/4074] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:04 2022] GET /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2 => generated 1600 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:04.509988 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-db10fc2e-925b-4525-9c82-bd3491d8035c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:04.513327 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-db10fc2e-925b-4525-9c82-bd3491d8035c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] [instance: ce950356-da51-4847-96ba-76f575f7d9ab] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:04.806392 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-db10fc2e-925b-4525-9c82-bd3491d8035c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8919a400a671422593e94e0390c3d949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe714415c9e4c9b8cd739c5a9b1c8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:04.820173 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-db10fc2e-925b-4525-9c82-bd3491d8035c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] 10.222.0.27 "GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab" status: 200 len: 1122 microversion: 2.1 time: 0.319440 Jun 20 12:16:04.832089 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1986/4075] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:04 2022] GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab => generated 1122 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:04.846589 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-87fdc633-d27c-474c-a6d7-967e1c1b5e8d req-d01a785a-377d-4278-b427-35d2ccb2eae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "193a5cec-91b5-4080-a798-0af9d9c09ce2", "name": "network-vif-deleted", "tag": "965c65dd-7240-49f5-ac76-9e0b96eec749"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:16:04.885578 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-87fdc633-d27c-474c-a6d7-967e1c1b5e8d req-d01a785a-377d-4278-b427-35d2ccb2eae5 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:04.886206 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-87fdc633-d27c-474c-a6d7-967e1c1b5e8d req-d01a785a-377d-4278-b427-35d2ccb2eae5 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:04.896655 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d97391a3-847c-4cd7-8f23-4cbdc06eb956 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:04.918404 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d97391a3-847c-4cd7-8f23-4cbdc06eb956 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:04.920289 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-87fdc633-d27c-474c-a6d7-967e1c1b5e8d req-d01a785a-377d-4278-b427-35d2ccb2eae5 service nova] Creating event network-vif-deleted:965c65dd-7240-49f5-ac76-9e0b96eec749 for instance 193a5cec-91b5-4080-a798-0af9d9c09ce2 on n-h1-master-1 Jun 20 12:16:04.926119 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d97391a3-847c-4cd7-8f23-4cbdc06eb956 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:04.928388 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d97391a3-847c-4cd7-8f23-4cbdc06eb956 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1809 microversion: 2.20 time: 0.898952 Jun 20 12:16:04.928572 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-87fdc633-d27c-474c-a6d7-967e1c1b5e8d req-d01a785a-377d-4278-b427-35d2ccb2eae5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092866 Jun 20 12:16:04.939324 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2090/4076] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:16:04 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1809 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:16:04.939645 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-85473f23-ab53-44c5-bed5-0823a4ab5cc4 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:04.940620 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1987/4077] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:16:04.940908 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-85473f23-ab53-44c5-bed5-0823a4ab5cc4 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] [instance: d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:04.957367 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-85473f23-ab53-44c5-bed5-0823a4ab5cc4 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:04.957835 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-85473f23-ab53-44c5-bed5-0823a4ab5cc4 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:04.962142 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-85473f23-ab53-44c5-bed5-0823a4ab5cc4 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:04.962551 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-85473f23-ab53-44c5-bed5-0823a4ab5cc4 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:05.041865 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:16:05.089211 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:16:05.251346 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f07852b8-9b3e-446c-933d-bd7d29a51f7d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-723687177", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "3660d580-dd5a-447c-80d3-5b71f66ce4d4"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:16:05.338214 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-85473f23-ab53-44c5-bed5-0823a4ab5cc4 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ffca09c8434630996a51a079cabc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbfe7e4e3ca845c08a651a5698adab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:05.355733 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-85473f23-ab53-44c5-bed5-0823a4ab5cc4 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] 10.222.0.27 "GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3" status: 200 len: 1316 microversion: 2.1 time: 0.416101 Jun 20 12:16:05.356996 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2091/4078] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:04 2022] GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3 => generated 1316 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:05.381355 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-91d764a2-0b4b-4965-b571-0ea047555274 req-35d780b6-79f8-410c-ae73-6eaa50b23e36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3", "tag": "90423145-1f90-4631-b690-42818c30d4c4"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:16:05.399361 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-f07852b8-9b3e-446c-933d-bd7d29a51f7d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] validate_networks() for [('3660d580-dd5a-447c-80d3-5b71f66ce4d4', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:16:05.409800 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-91d764a2-0b4b-4965-b571-0ea047555274 req-35d780b6-79f8-410c-ae73-6eaa50b23e36 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:05.417527 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-91d764a2-0b4b-4965-b571-0ea047555274 req-35d780b6-79f8-410c-ae73-6eaa50b23e36 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:05.434665 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-91d764a2-0b4b-4965-b571-0ea047555274 req-35d780b6-79f8-410c-ae73-6eaa50b23e36 service nova] Creating event network-changed:90423145-1f90-4631-b690-42818c30d4c4 for instance d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3 on n-h2-master-1 Jun 20 12:16:05.441134 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-91d764a2-0b4b-4965-b571-0ea047555274 req-35d780b6-79f8-410c-ae73-6eaa50b23e36 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080557 Jun 20 12:16:05.442737 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2092/4079] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:16:05.515160 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9d1ece16-b578-4e94-b5d8-fcbce3294aa2 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:05.516191 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9d1ece16-b578-4e94-b5d8-fcbce3294aa2 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] [instance: 193a5cec-91b5-4080-a798-0af9d9c09ce2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:05.525635 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9d1ece16-b578-4e94-b5d8-fcbce3294aa2 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:05.526410 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9d1ece16-b578-4e94-b5d8-fcbce3294aa2 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:05.527431 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9d1ece16-b578-4e94-b5d8-fcbce3294aa2 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:05.528515 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9d1ece16-b578-4e94-b5d8-fcbce3294aa2 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:05.546746 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-9d1ece16-b578-4e94-b5d8-fcbce3294aa2 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] HTTP exception thrown: Instance 193a5cec-91b5-4080-a798-0af9d9c09ce2 could not be found. Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9d1ece16-b578-4e94-b5d8-fcbce3294aa2 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Request method failure captured: Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2 HTTP/1.1 Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGTAELORbWBH7ucwwJhivsW6IrGihY1I68aHGmESRL3oHaozBfdk_RyzB88WkJhjYrlyAzYvnJO2btGYG2bhAbEJ8VsvzwoPQ1ByzUzC21mje6laWWl6Ll7U5xTB0lZAslx-bdcwHQ5rlSix3gf5wm0ZKgQWmA5K5ZUMHYOx3Tf1ZPQ Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 90924e1b14d448668fa43d6845ff3e05 Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersTestFqdnHostnames-1669423579 Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/90924e1b14d448668fa43d6845ff3e05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/90924e1b14d448668fa43d6845ff3e05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/90924e1b14d448668fa43d6845ff3e05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_90924e1b14d448668fa43d6845ff3e05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersTestFqdnHostnames-1669423579 Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 90924e1b14d448668fa43d6845ff3e05 Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1669423579 Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersTestFqdnHostnames-1669423579-project Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: c58864ab3af344f180e02cc95e5cd9ee Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersTestFqdnHostnames-1669423579-project Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 193a5cec-91b5-4080-a798-0af9d9c09ce2 could not be found. Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '193a5cec-91b5-4080-a798-0af9d9c09ce2'} Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 193a5cec-91b5-4080-a798-0af9d9c09ce2 could not be found. Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 193a5cec-91b5-4080-a798-0af9d9c09ce2 could not be found. Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:16:05.549359 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:16:05.552584 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:16:05.552584 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:16:05.552584 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:16:05.552584 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:16:05.552584 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:16:05.552584 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 193a5cec-91b5-4080-a798-0af9d9c09ce2 could not be found. Jun 20 12:16:05.552584 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:16:05.556678 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9d1ece16-b578-4e94-b5d8-fcbce3294aa2 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Returning 404 to user: Instance 193a5cec-91b5-4080-a798-0af9d9c09ce2 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:16:05.557738 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9d1ece16-b578-4e94-b5d8-fcbce3294aa2 tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] 10.222.0.27 "GET /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2" status: 404 len: 111 microversion: 2.1 time: 0.047440 Jun 20 12:16:05.559399 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2093/4080] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:05 2022] GET /compute/v2.1/servers/193a5cec-91b5-4080-a798-0af9d9c09ce2 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:16:05.567552 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c93cb02b-a87c-4d02-9c27-8e3ed963492a tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] Calling method '.version_select at 0x7f60736f3040>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:05.605026 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c93cb02b-a87c-4d02-9c27-8e3ed963492a tempest-ServersTestFqdnHostnames-1669423579 tempest-ServersTestFqdnHostnames-1669423579-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2065009109" status: 202 len: 0 microversion: 2.1 time: 0.040478 Jun 20 12:16:05.609518 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2094/4081] 10.222.0.27 () {58 vars in 1220 bytes} [Mon Jun 20 12:16:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2065009109 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:16:05.842576 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1c5639ab-875e-4788-8757-c327a53d496a tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:05.843414 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1c5639ab-875e-4788-8757-c327a53d496a tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] [instance: ce950356-da51-4847-96ba-76f575f7d9ab] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:05.873909 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c5639ab-875e-4788-8757-c327a53d496a tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:05.874444 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c5639ab-875e-4788-8757-c327a53d496a tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:05.881562 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c5639ab-875e-4788-8757-c327a53d496a tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:05.883974 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c5639ab-875e-4788-8757-c327a53d496a tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:05.903060 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:16:06.205865 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1c5639ab-875e-4788-8757-c327a53d496a tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8919a400a671422593e94e0390c3d949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe714415c9e4c9b8cd739c5a9b1c8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:06.221166 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1c5639ab-875e-4788-8757-c327a53d496a tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] 10.222.0.27 "GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab" status: 200 len: 1220 microversion: 2.1 time: 0.385830 Jun 20 12:16:06.224598 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2095/4082] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:05 2022] GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab => generated 1220 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:06.235403 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a0763497-d68a-42cc-94ef-6cf9e9f718e8 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:06.236593 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a0763497-d68a-42cc-94ef-6cf9e9f718e8 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:06.253859 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a0763497-d68a-42cc-94ef-6cf9e9f718e8 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:06.254703 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a0763497-d68a-42cc-94ef-6cf9e9f718e8 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:06.257284 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a0763497-d68a-42cc-94ef-6cf9e9f718e8 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:06.258132 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a0763497-d68a-42cc-94ef-6cf9e9f718e8 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:07.098852 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a0763497-d68a-42cc-94ef-6cf9e9f718e8 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:07.118289 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a0763497-d68a-42cc-94ef-6cf9e9f718e8 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:07.123046 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a0763497-d68a-42cc-94ef-6cf9e9f718e8 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:07.127584 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a0763497-d68a-42cc-94ef-6cf9e9f718e8 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1809 microversion: 2.20 time: 0.900529 Jun 20 12:16:07.128832 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2096/4083] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:16:06 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1809 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:16:07.141317 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-48b205c6-c57d-4965-872e-ec71b96702d5 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:07.142221 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-48b205c6-c57d-4965-872e-ec71b96702d5 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] [instance: d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:07.158828 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-48b205c6-c57d-4965-872e-ec71b96702d5 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:07.160950 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-48b205c6-c57d-4965-872e-ec71b96702d5 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:07.163311 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-48b205c6-c57d-4965-872e-ec71b96702d5 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:07.165858 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-48b205c6-c57d-4965-872e-ec71b96702d5 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:07.193056 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-f07852b8-9b3e-446c-933d-bd7d29a51f7d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:16:07.194468 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-f07852b8-9b3e-446c-933d-bd7d29a51f7d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:16:07.195380 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-f07852b8-9b3e-446c-933d-bd7d29a51f7d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:16:07.196278 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-f07852b8-9b3e-446c-933d-bd7d29a51f7d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:16:07.196925 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-f07852b8-9b3e-446c-933d-bd7d29a51f7d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:16:07.215774 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f07852b8-9b3e-446c-933d-bd7d29a51f7d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:07.216650 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f07852b8-9b3e-446c-933d-bd7d29a51f7d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:07.225530 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f07852b8-9b3e-446c-933d-bd7d29a51f7d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:07.227162 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f07852b8-9b3e-446c-933d-bd7d29a51f7d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:07.279023 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-f07852b8-9b3e-446c-933d-bd7d29a51f7d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Getting quotas for project 3103ed818db8417b8625af13e7176910. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:16:07.298565 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-f07852b8-9b3e-446c-933d-bd7d29a51f7d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Getting quotas for user 0c8324eb1db74653853a415b56b43fce and project 3103ed818db8417b8625af13e7176910. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:16:07.329208 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f07852b8-9b3e-446c-933d-bd7d29a51f7d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:16:07.332041 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f07852b8-9b3e-446c-933d-bd7d29a51f7d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 1e05048b-621f-4819-a11a-e0d077f7d563] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:16:07.438526 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f07852b8-9b3e-446c-933d-bd7d29a51f7d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.496295 Jun 20 12:16:07.444695 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1988/4084] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:16:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:16:07.456567 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8e078661-ef77-4038-a40a-690bc0401b01 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:07.457383 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8e078661-ef77-4038-a40a-690bc0401b01 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] [instance: ce950356-da51-4847-96ba-76f575f7d9ab] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:07.477680 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e078661-ef77-4038-a40a-690bc0401b01 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:07.478274 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e078661-ef77-4038-a40a-690bc0401b01 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:07.479402 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e078661-ef77-4038-a40a-690bc0401b01 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:07.479914 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e078661-ef77-4038-a40a-690bc0401b01 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:07.761048 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8e078661-ef77-4038-a40a-690bc0401b01 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8919a400a671422593e94e0390c3d949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe714415c9e4c9b8cd739c5a9b1c8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:07.777660 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8e078661-ef77-4038-a40a-690bc0401b01 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] 10.222.0.27 "GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab" status: 200 len: 1238 microversion: 2.1 time: 0.331412 Jun 20 12:16:07.778242 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1989/4085] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:07 2022] GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab => generated 1238 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:07.800373 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7448cc2d-7faf-4eab-8bf8-5e40eae006b0 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-386061974", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "3660d580-dd5a-447c-80d3-5b71f66ce4d4"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:16:07.944093 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-7448cc2d-7faf-4eab-8bf8-5e40eae006b0 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] validate_networks() for [('3660d580-dd5a-447c-80d3-5b71f66ce4d4', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:16:08.129827 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-48b205c6-c57d-4965-872e-ec71b96702d5 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ffca09c8434630996a51a079cabc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbfe7e4e3ca845c08a651a5698adab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:08.144951 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-48b205c6-c57d-4965-872e-ec71b96702d5 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] 10.222.0.27 "GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3" status: 200 len: 1316 microversion: 2.1 time: 1.014311 Jun 20 12:16:08.169623 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2097/4086] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:07 2022] GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3 => generated 1316 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:08.181458 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c3393887-ef8f-4b72-98c4-6ef46cb1f9b0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:08.185376 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c3393887-ef8f-4b72-98c4-6ef46cb1f9b0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:08.207624 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c3393887-ef8f-4b72-98c4-6ef46cb1f9b0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:08.213360 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c3393887-ef8f-4b72-98c4-6ef46cb1f9b0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:08.214827 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c3393887-ef8f-4b72-98c4-6ef46cb1f9b0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:08.215150 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c3393887-ef8f-4b72-98c4-6ef46cb1f9b0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:08.750362 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c3393887-ef8f-4b72-98c4-6ef46cb1f9b0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:08.770269 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c3393887-ef8f-4b72-98c4-6ef46cb1f9b0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:08.781159 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c3393887-ef8f-4b72-98c4-6ef46cb1f9b0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:08.790552 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c3393887-ef8f-4b72-98c4-6ef46cb1f9b0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1796 microversion: 2.20 time: 0.616063 Jun 20 12:16:08.824186 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2098/4087] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:16:08 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1796 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:16:08.838646 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cdc9e45b-9802-4c95-9d45-52ee3946c8b5 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:08.839637 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cdc9e45b-9802-4c95-9d45-52ee3946c8b5 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] [instance: ce950356-da51-4847-96ba-76f575f7d9ab] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:08.857835 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cdc9e45b-9802-4c95-9d45-52ee3946c8b5 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:08.861314 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cdc9e45b-9802-4c95-9d45-52ee3946c8b5 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:08.863561 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cdc9e45b-9802-4c95-9d45-52ee3946c8b5 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:08.864390 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cdc9e45b-9802-4c95-9d45-52ee3946c8b5 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:09.144923 n-d-master-1 devstack@n-api.service[119128]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 12:16:09.145404 n-d-master-1 devstack@n-api.service[119128]: Mon Jun 20 12:16:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.27) !!! Jun 20 12:16:09.300411 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cdc9e45b-9802-4c95-9d45-52ee3946c8b5 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8919a400a671422593e94e0390c3d949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe714415c9e4c9b8cd739c5a9b1c8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:09.313760 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cdc9e45b-9802-4c95-9d45-52ee3946c8b5 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] 10.222.0.27 "GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab" status: 200 len: 1238 microversion: 2.1 time: 0.485564 Jun 20 12:16:09.314409 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2099/4088] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:08 2022] GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab => generated 1238 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:09.322584 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9ad1e889-92e6-4911-a1fb-32e5a39f2dcd tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:09.323617 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9ad1e889-92e6-4911-a1fb-32e5a39f2dcd tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] [instance: d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:09.334465 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:16:09.350844 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ad1e889-92e6-4911-a1fb-32e5a39f2dcd tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:09.351365 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ad1e889-92e6-4911-a1fb-32e5a39f2dcd tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:09.352193 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ad1e889-92e6-4911-a1fb-32e5a39f2dcd tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:09.352678 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ad1e889-92e6-4911-a1fb-32e5a39f2dcd tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:09.740529 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9ad1e889-92e6-4911-a1fb-32e5a39f2dcd tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ffca09c8434630996a51a079cabc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbfe7e4e3ca845c08a651a5698adab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:09.753271 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9ad1e889-92e6-4911-a1fb-32e5a39f2dcd tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] 10.222.0.27 "GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3" status: 200 len: 1316 microversion: 2.1 time: 0.433741 Jun 20 12:16:09.755548 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2100/4089] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:09 2022] GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3 => generated 1316 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:10.276478 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-7448cc2d-7faf-4eab-8bf8-5e40eae006b0 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:16:10.277450 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-7448cc2d-7faf-4eab-8bf8-5e40eae006b0 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:16:10.278699 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-7448cc2d-7faf-4eab-8bf8-5e40eae006b0 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:16:10.279304 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-7448cc2d-7faf-4eab-8bf8-5e40eae006b0 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:16:10.279899 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-7448cc2d-7faf-4eab-8bf8-5e40eae006b0 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:16:10.301630 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7448cc2d-7faf-4eab-8bf8-5e40eae006b0 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:10.302359 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7448cc2d-7faf-4eab-8bf8-5e40eae006b0 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:10.305534 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7448cc2d-7faf-4eab-8bf8-5e40eae006b0 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:10.310203 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7448cc2d-7faf-4eab-8bf8-5e40eae006b0 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:10.331689 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5b6718c3-5fd1-4d15-821c-e9f588f51fca tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:10.332452 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5b6718c3-5fd1-4d15-821c-e9f588f51fca tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] [instance: ce950356-da51-4847-96ba-76f575f7d9ab] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:10.345216 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b6718c3-5fd1-4d15-821c-e9f588f51fca tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:10.346033 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b6718c3-5fd1-4d15-821c-e9f588f51fca tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:10.347809 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b6718c3-5fd1-4d15-821c-e9f588f51fca tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:10.349549 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b6718c3-5fd1-4d15-821c-e9f588f51fca tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:10.384192 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-7448cc2d-7faf-4eab-8bf8-5e40eae006b0 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Getting quotas for project 3103ed818db8417b8625af13e7176910. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:16:10.396312 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-7448cc2d-7faf-4eab-8bf8-5e40eae006b0 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Getting quotas for user 0c8324eb1db74653853a415b56b43fce and project 3103ed818db8417b8625af13e7176910. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:16:10.452848 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7448cc2d-7faf-4eab-8bf8-5e40eae006b0 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:16:10.455418 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7448cc2d-7faf-4eab-8bf8-5e40eae006b0 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:16:10.552667 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5b6718c3-5fd1-4d15-821c-e9f588f51fca tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8919a400a671422593e94e0390c3d949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe714415c9e4c9b8cd739c5a9b1c8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:10.558592 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7448cc2d-7faf-4eab-8bf8-5e40eae006b0 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.767763 Jun 20 12:16:10.559283 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1990/4090] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:16:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:16:10.574862 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5b6718c3-5fd1-4d15-821c-e9f588f51fca tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] 10.222.0.27 "GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab" status: 200 len: 1238 microversion: 2.1 time: 0.246445 Jun 20 12:16:10.586334 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2101/4091] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:10 2022] GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab => generated 1238 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:16:10.771259 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dadfeb92-6f43-4f82-a2e3-a777b974186d tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:10.772339 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-dadfeb92-6f43-4f82-a2e3-a777b974186d tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] [instance: d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:10.786515 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dadfeb92-6f43-4f82-a2e3-a777b974186d tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:10.794510 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dadfeb92-6f43-4f82-a2e3-a777b974186d tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:10.795540 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dadfeb92-6f43-4f82-a2e3-a777b974186d tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:10.795978 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dadfeb92-6f43-4f82-a2e3-a777b974186d tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:11.111381 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8a5a69cd-4a66-4c58-82d2-eb21f5d1c540 tempest-ExtensionsTest-833897912 tempest-ExtensionsTest-833897912-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:11.113187 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8a5a69cd-4a66-4c58-82d2-eb21f5d1c540 tempest-ExtensionsTest-833897912 tempest-ExtensionsTest-833897912-project] 10.222.0.27 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.302572 Jun 20 12:16:11.114473 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2102/4092] 10.222.0.27 () {58 vars in 1169 bytes} [Mon Jun 20 12:16:10 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:16:11.129924 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-125b21ef-a200-4344-99a5-2de2a12eccf2 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-729913147", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "451", "networks": [{"uuid": "3660d580-dd5a-447c-80d3-5b71f66ce4d4"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:16:11.395767 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-dadfeb92-6f43-4f82-a2e3-a777b974186d tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ffca09c8434630996a51a079cabc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbfe7e4e3ca845c08a651a5698adab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:11.405300 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dadfeb92-6f43-4f82-a2e3-a777b974186d tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] 10.222.0.27 "GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3" status: 200 len: 1316 microversion: 2.1 time: 0.638981 Jun 20 12:16:11.409836 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1991/4093] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:10 2022] GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3 => generated 1316 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:11.437420 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bbc6e5dd-c1d5-4984-9ad5-83bb8de9696a tempest-ExtensionsTest-833897912 tempest-ExtensionsTest-833897912-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:11.439564 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bbc6e5dd-c1d5-4984-9ad5-83bb8de9696a tempest-ExtensionsTest-833897912 tempest-ExtensionsTest-833897912-project] 10.222.0.27 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.008248 Jun 20 12:16:11.457024 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1992/4094] 10.222.0.27 () {58 vars in 1133 bytes} [Mon Jun 20 12:16:11 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:16:11.501952 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-125b21ef-a200-4344-99a5-2de2a12eccf2 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] validate_networks() for [('3660d580-dd5a-447c-80d3-5b71f66ce4d4', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:16:11.600742 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a41be034-b0f4-47bc-8d87-1cbfeddef8c3 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:11.600947 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a41be034-b0f4-47bc-8d87-1cbfeddef8c3 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] [instance: ce950356-da51-4847-96ba-76f575f7d9ab] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:11.620472 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a41be034-b0f4-47bc-8d87-1cbfeddef8c3 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:11.620930 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a41be034-b0f4-47bc-8d87-1cbfeddef8c3 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:11.621757 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a41be034-b0f4-47bc-8d87-1cbfeddef8c3 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:11.622198 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a41be034-b0f4-47bc-8d87-1cbfeddef8c3 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:11.841066 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a41be034-b0f4-47bc-8d87-1cbfeddef8c3 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8919a400a671422593e94e0390c3d949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe714415c9e4c9b8cd739c5a9b1c8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:11.859752 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a41be034-b0f4-47bc-8d87-1cbfeddef8c3 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] 10.222.0.27 "GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab" status: 200 len: 1238 microversion: 2.1 time: 0.269915 Jun 20 12:16:11.861091 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1993/4095] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:11 2022] GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab => generated 1238 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:16:12.426991 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d7e36b03-ab81-4dc7-aeb6-0554db78c73d tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:12.427612 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d7e36b03-ab81-4dc7-aeb6-0554db78c73d tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] [instance: d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:12.442454 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d7e36b03-ab81-4dc7-aeb6-0554db78c73d tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:12.443152 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d7e36b03-ab81-4dc7-aeb6-0554db78c73d tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:12.444185 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d7e36b03-ab81-4dc7-aeb6-0554db78c73d tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:12.446374 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d7e36b03-ab81-4dc7-aeb6-0554db78c73d tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:13.589015 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-125b21ef-a200-4344-99a5-2de2a12eccf2 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:16:13.589520 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-125b21ef-a200-4344-99a5-2de2a12eccf2 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:16:13.590675 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-125b21ef-a200-4344-99a5-2de2a12eccf2 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:16:13.591152 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-125b21ef-a200-4344-99a5-2de2a12eccf2 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:16:13.592449 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-125b21ef-a200-4344-99a5-2de2a12eccf2 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:16:13.612606 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-125b21ef-a200-4344-99a5-2de2a12eccf2 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:13.613050 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-125b21ef-a200-4344-99a5-2de2a12eccf2 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:13.614094 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-125b21ef-a200-4344-99a5-2de2a12eccf2 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:13.614741 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-125b21ef-a200-4344-99a5-2de2a12eccf2 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:13.654370 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-125b21ef-a200-4344-99a5-2de2a12eccf2 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Getting quotas for project 3103ed818db8417b8625af13e7176910. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:16:13.667273 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-125b21ef-a200-4344-99a5-2de2a12eccf2 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Getting quotas for user 0c8324eb1db74653853a415b56b43fce and project 3103ed818db8417b8625af13e7176910. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:16:13.700181 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-125b21ef-a200-4344-99a5-2de2a12eccf2 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:16:13.706855 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-125b21ef-a200-4344-99a5-2de2a12eccf2 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 46c93bae-77c3-4fce-b4c3-bee3526049eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:16:13.805014 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-125b21ef-a200-4344-99a5-2de2a12eccf2 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.689221 Jun 20 12:16:13.805759 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2103/4096] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:16:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:16:13.816688 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-652f4627-367e-4c5e-a0d0-a826186ba858 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:13.817304 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-652f4627-367e-4c5e-a0d0-a826186ba858 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] [instance: ce950356-da51-4847-96ba-76f575f7d9ab] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:13.826972 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-652f4627-367e-4c5e-a0d0-a826186ba858 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:13.827425 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-652f4627-367e-4c5e-a0d0-a826186ba858 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:13.828315 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-652f4627-367e-4c5e-a0d0-a826186ba858 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:13.828757 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-652f4627-367e-4c5e-a0d0-a826186ba858 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:14.153804 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d7e36b03-ab81-4dc7-aeb6-0554db78c73d tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ffca09c8434630996a51a079cabc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbfe7e4e3ca845c08a651a5698adab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:14.167585 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d7e36b03-ab81-4dc7-aeb6-0554db78c73d tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] 10.222.0.27 "GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3" status: 200 len: 1316 microversion: 2.1 time: 1.744625 Jun 20 12:16:14.171876 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1994/4097] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:12 2022] GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3 => generated 1316 bytes in 1749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:16:14.187881 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ca4e15a9-8442-4d3c-902c-e23035d43a4d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:14.189464 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ca4e15a9-8442-4d3c-902c-e23035d43a4d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 46c93bae-77c3-4fce-b4c3-bee3526049eb] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:14.323585 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ca4e15a9-8442-4d3c-902c-e23035d43a4d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:14.332431 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ca4e15a9-8442-4d3c-902c-e23035d43a4d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/46c93bae-77c3-4fce-b4c3-bee3526049eb" status: 200 len: 1220 microversion: 2.1 time: 0.159272 Jun 20 12:16:14.335390 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1995/4098] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:14 2022] GET /compute/v2.1/servers/46c93bae-77c3-4fce-b4c3-bee3526049eb => generated 1220 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:14.829066 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-70c632ab-6ba5-4a49-b503-8872844207f3 req-93a206a8-0d16-492e-adaa-48b04682bff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3", "name": "network-vif-plugged", "status": "completed", "tag": "90423145-1f90-4631-b690-42818c30d4c4"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:16:14.851385 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-70c632ab-6ba5-4a49-b503-8872844207f3 req-93a206a8-0d16-492e-adaa-48b04682bff6 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:14.851835 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-70c632ab-6ba5-4a49-b503-8872844207f3 req-93a206a8-0d16-492e-adaa-48b04682bff6 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:14.881024 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-70c632ab-6ba5-4a49-b503-8872844207f3 req-93a206a8-0d16-492e-adaa-48b04682bff6 service nova] Creating event network-vif-plugged:90423145-1f90-4631-b690-42818c30d4c4 for instance d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3 on n-h2-master-1 Jun 20 12:16:14.895821 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-70c632ab-6ba5-4a49-b503-8872844207f3 req-93a206a8-0d16-492e-adaa-48b04682bff6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073856 Jun 20 12:16:14.899084 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1996/4099] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:16:14.916744 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-fe69265f-e1aa-49b6-9513-c227e7c2840a req-00a315dc-bc0e-4f7f-8f1b-ac2f494b30bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e05048b-621f-4819-a11a-e0d077f7d563", "tag": "eaa70fe1-2667-4b98-9bf5-4a0d37bc56f2"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:16:14.932005 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-fe69265f-e1aa-49b6-9513-c227e7c2840a req-00a315dc-bc0e-4f7f-8f1b-ac2f494b30bb service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:14.937246 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-fe69265f-e1aa-49b6-9513-c227e7c2840a req-00a315dc-bc0e-4f7f-8f1b-ac2f494b30bb service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:14.976919 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-fe69265f-e1aa-49b6-9513-c227e7c2840a req-00a315dc-bc0e-4f7f-8f1b-ac2f494b30bb service nova] Creating event network-changed:eaa70fe1-2667-4b98-9bf5-4a0d37bc56f2 for instance 1e05048b-621f-4819-a11a-e0d077f7d563 on n-h1-master-1 Jun 20 12:16:14.989032 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-fe69265f-e1aa-49b6-9513-c227e7c2840a req-00a315dc-bc0e-4f7f-8f1b-ac2f494b30bb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082546 Jun 20 12:16:14.990394 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1997/4100] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:16:15.192521 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-474ab742-76b3-4f92-bce5-70e4f8c80bcd tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:15.194427 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-474ab742-76b3-4f92-bce5-70e4f8c80bcd tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] [instance: d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:15.210898 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-474ab742-76b3-4f92-bce5-70e4f8c80bcd tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:15.215708 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-474ab742-76b3-4f92-bce5-70e4f8c80bcd tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:15.216734 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-474ab742-76b3-4f92-bce5-70e4f8c80bcd tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:15.217177 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-474ab742-76b3-4f92-bce5-70e4f8c80bcd tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:15.588083 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-652f4627-367e-4c5e-a0d0-a826186ba858 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8919a400a671422593e94e0390c3d949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe714415c9e4c9b8cd739c5a9b1c8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:15.597481 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-652f4627-367e-4c5e-a0d0-a826186ba858 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] 10.222.0.27 "GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab" status: 200 len: 1306 microversion: 2.1 time: 1.785550 Jun 20 12:16:15.598082 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2104/4101] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:13 2022] GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab => generated 1306 bytes in 1792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:15.613513 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fd464067-f3ac-4632-8bb5-515c643d16c0 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:15.616981 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fd464067-f3ac-4632-8bb5-515c643d16c0 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 46c93bae-77c3-4fce-b4c3-bee3526049eb] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:15.625650 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fd464067-f3ac-4632-8bb5-515c643d16c0 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:15.627572 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fd464067-f3ac-4632-8bb5-515c643d16c0 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:15.628940 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fd464067-f3ac-4632-8bb5-515c643d16c0 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:15.629736 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fd464067-f3ac-4632-8bb5-515c643d16c0 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:15.862898 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fd464067-f3ac-4632-8bb5-515c643d16c0 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:15.875553 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-474ab742-76b3-4f92-bce5-70e4f8c80bcd tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ffca09c8434630996a51a079cabc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbfe7e4e3ca845c08a651a5698adab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:15.887401 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fd464067-f3ac-4632-8bb5-515c643d16c0 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/46c93bae-77c3-4fce-b4c3-bee3526049eb" status: 200 len: 1290 microversion: 2.1 time: 0.283125 Jun 20 12:16:15.893560 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-474ab742-76b3-4f92-bce5-70e4f8c80bcd tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] 10.222.0.27 "GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3" status: 200 len: 1316 microversion: 2.1 time: 0.712546 Jun 20 12:16:15.894962 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2105/4102] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:15 2022] GET /compute/v2.1/servers/46c93bae-77c3-4fce-b4c3-bee3526049eb => generated 1290 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:15.907632 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1998/4103] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:15 2022] GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3 => generated 1316 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:16.615848 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-291e26b1-9773-41bf-848f-bfb034c6529b tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:16.616566 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-291e26b1-9773-41bf-848f-bfb034c6529b tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] [instance: ce950356-da51-4847-96ba-76f575f7d9ab] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:16.625304 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-291e26b1-9773-41bf-848f-bfb034c6529b tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:16.625763 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-291e26b1-9773-41bf-848f-bfb034c6529b tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:16.626802 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-291e26b1-9773-41bf-848f-bfb034c6529b tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:16.627428 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-291e26b1-9773-41bf-848f-bfb034c6529b tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:16.913462 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0bd377c0-166c-4357-a6d0-a078ef8616a7 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:16.914447 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0bd377c0-166c-4357-a6d0-a078ef8616a7 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 46c93bae-77c3-4fce-b4c3-bee3526049eb] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:16.924604 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0bd377c0-166c-4357-a6d0-a078ef8616a7 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:16.930883 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0bd377c0-166c-4357-a6d0-a078ef8616a7 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:16.931757 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0bd377c0-166c-4357-a6d0-a078ef8616a7 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:16.932714 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0bd377c0-166c-4357-a6d0-a078ef8616a7 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:17.009367 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-291e26b1-9773-41bf-848f-bfb034c6529b tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8919a400a671422593e94e0390c3d949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe714415c9e4c9b8cd739c5a9b1c8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:17.021299 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-291e26b1-9773-41bf-848f-bfb034c6529b tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] 10.222.0.27 "GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab" status: 200 len: 1294 microversion: 2.1 time: 0.410466 Jun 20 12:16:17.021920 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2106/4104] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:16 2022] GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab => generated 1294 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:17.031577 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dfff6cd6-632c-4f9c-94e5-c5a149313a6c tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:17.032240 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dfff6cd6-632c-4f9c-94e5-c5a149313a6c tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] [instance: d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:17.045614 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dfff6cd6-632c-4f9c-94e5-c5a149313a6c tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:17.046385 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dfff6cd6-632c-4f9c-94e5-c5a149313a6c tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:17.047844 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dfff6cd6-632c-4f9c-94e5-c5a149313a6c tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:17.048153 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dfff6cd6-632c-4f9c-94e5-c5a149313a6c tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:17.098578 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0bd377c0-166c-4357-a6d0-a078ef8616a7 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:17.116673 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0bd377c0-166c-4357-a6d0-a078ef8616a7 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/46c93bae-77c3-4fce-b4c3-bee3526049eb" status: 200 len: 1278 microversion: 2.1 time: 0.205481 Jun 20 12:16:17.120014 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1999/4105] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:16 2022] GET /compute/v2.1/servers/46c93bae-77c3-4fce-b4c3-bee3526049eb => generated 1278 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:17.158386 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-70bdad78-8cd8-4f12-9c5c-de99ff8a3074 req-3c50a051-2497-4556-aaa6-d8d177bf380f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce950356-da51-4847-96ba-76f575f7d9ab", "tag": "1bcf3d27-a159-49aa-8893-b16ec015ede0"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:16:17.176388 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-70bdad78-8cd8-4f12-9c5c-de99ff8a3074 req-3c50a051-2497-4556-aaa6-d8d177bf380f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:17.176841 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-70bdad78-8cd8-4f12-9c5c-de99ff8a3074 req-3c50a051-2497-4556-aaa6-d8d177bf380f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:17.203975 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-70bdad78-8cd8-4f12-9c5c-de99ff8a3074 req-3c50a051-2497-4556-aaa6-d8d177bf380f service nova] Creating event network-changed:1bcf3d27-a159-49aa-8893-b16ec015ede0 for instance ce950356-da51-4847-96ba-76f575f7d9ab on n-h2-master-1 Jun 20 12:16:17.210258 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-70bdad78-8cd8-4f12-9c5c-de99ff8a3074 req-3c50a051-2497-4556-aaa6-d8d177bf380f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057336 Jun 20 12:16:17.211100 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2000/4106] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:16:17.525063 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-6f95c352-3d62-4f9c-8822-df5f2a89e865 req-ce1e7b41-e6f6-4bd9-9c97-a92f89438e64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81", "tag": "bf346bca-5104-4d7c-bbcf-71f586401f26"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:16:17.539298 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-6f95c352-3d62-4f9c-8822-df5f2a89e865 req-ce1e7b41-e6f6-4bd9-9c97-a92f89438e64 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:17.542581 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-6f95c352-3d62-4f9c-8822-df5f2a89e865 req-ce1e7b41-e6f6-4bd9-9c97-a92f89438e64 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:17.575521 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-6f95c352-3d62-4f9c-8822-df5f2a89e865 req-ce1e7b41-e6f6-4bd9-9c97-a92f89438e64 service nova] Creating event network-changed:bf346bca-5104-4d7c-bbcf-71f586401f26 for instance d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81 on n-h1-master-1 Jun 20 12:16:17.598149 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-6f95c352-3d62-4f9c-8822-df5f2a89e865 req-ce1e7b41-e6f6-4bd9-9c97-a92f89438e64 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076996 Jun 20 12:16:17.599092 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2001/4107] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:16:17.763655 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dfff6cd6-632c-4f9c-94e5-c5a149313a6c tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ffca09c8434630996a51a079cabc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbfe7e4e3ca845c08a651a5698adab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:17.772764 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dfff6cd6-632c-4f9c-94e5-c5a149313a6c tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] 10.222.0.27 "GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3" status: 200 len: 1316 microversion: 2.1 time: 0.749660 Jun 20 12:16:17.773906 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2107/4108] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:17 2022] GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3 => generated 1316 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:18.040110 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ef00ba90-a35a-41b9-a4c4-32053c35f8f5 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:18.041837 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ef00ba90-a35a-41b9-a4c4-32053c35f8f5 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] [instance: ce950356-da51-4847-96ba-76f575f7d9ab] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:18.057752 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef00ba90-a35a-41b9-a4c4-32053c35f8f5 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:18.058515 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef00ba90-a35a-41b9-a4c4-32053c35f8f5 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:18.059518 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef00ba90-a35a-41b9-a4c4-32053c35f8f5 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:18.060173 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef00ba90-a35a-41b9-a4c4-32053c35f8f5 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:18.151249 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-53917384-6cbf-43ac-9bf9-bb504090738e tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:18.152953 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-53917384-6cbf-43ac-9bf9-bb504090738e tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 46c93bae-77c3-4fce-b4c3-bee3526049eb] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:18.176018 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-53917384-6cbf-43ac-9bf9-bb504090738e tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:18.176527 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-53917384-6cbf-43ac-9bf9-bb504090738e tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:18.177335 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-53917384-6cbf-43ac-9bf9-bb504090738e tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:18.177778 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-53917384-6cbf-43ac-9bf9-bb504090738e tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:18.693648 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ef00ba90-a35a-41b9-a4c4-32053c35f8f5 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8919a400a671422593e94e0390c3d949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe714415c9e4c9b8cd739c5a9b1c8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:18.695675 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-53917384-6cbf-43ac-9bf9-bb504090738e tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:18.707810 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ef00ba90-a35a-41b9-a4c4-32053c35f8f5 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] 10.222.0.27 "GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab" status: 200 len: 1294 microversion: 2.1 time: 0.670468 Jun 20 12:16:18.709189 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2002/4109] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:18 2022] GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab => generated 1294 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:18.710561 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-53917384-6cbf-43ac-9bf9-bb504090738e tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/46c93bae-77c3-4fce-b4c3-bee3526049eb" status: 200 len: 1320 microversion: 2.1 time: 0.574865 Jun 20 12:16:18.719437 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2108/4110] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:18 2022] GET /compute/v2.1/servers/46c93bae-77c3-4fce-b4c3-bee3526049eb => generated 1320 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:18.792008 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2bbd43d8-0473-4e69-8483-a017dbf9967e tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:18.792977 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2bbd43d8-0473-4e69-8483-a017dbf9967e tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] [instance: d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:18.803123 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2bbd43d8-0473-4e69-8483-a017dbf9967e tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:18.803583 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2bbd43d8-0473-4e69-8483-a017dbf9967e tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:18.804540 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2bbd43d8-0473-4e69-8483-a017dbf9967e tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:18.804978 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2bbd43d8-0473-4e69-8483-a017dbf9967e tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:19.326045 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2bbd43d8-0473-4e69-8483-a017dbf9967e tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ffca09c8434630996a51a079cabc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbfe7e4e3ca845c08a651a5698adab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:19.336278 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2bbd43d8-0473-4e69-8483-a017dbf9967e tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] 10.222.0.27 "GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3" status: 200 len: 1505 microversion: 2.1 time: 0.550104 Jun 20 12:16:19.339955 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2003/4111] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:18 2022] GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3 => generated 1505 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:19.368543 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5f6f7f45-a601-4210-82ae-7cb8943ff53e tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:19.370437 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5f6f7f45-a601-4210-82ae-7cb8943ff53e tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] [instance: d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:19.396366 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f6f7f45-a601-4210-82ae-7cb8943ff53e tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:19.397115 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f6f7f45-a601-4210-82ae-7cb8943ff53e tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:19.398124 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f6f7f45-a601-4210-82ae-7cb8943ff53e tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:19.399805 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f6f7f45-a601-4210-82ae-7cb8943ff53e tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:19.483118 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5f6f7f45-a601-4210-82ae-7cb8943ff53e tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '01ffca09c8434630996a51a079cabc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbfe7e4e3ca845c08a651a5698adab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:19.484767 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5f6f7f45-a601-4210-82ae-7cb8943ff53e tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] 10.222.0.27 "GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3/os-instance-actions/req-28ee12d7-748c-4dd8-9922-791f5e6e467a" status: 200 len: 313 microversion: 2.1 time: 0.130847 Jun 20 12:16:19.486226 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2109/4112] 10.222.0.27 () {58 vars in 1418 bytes} [Mon Jun 20 12:16:19 2022] GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3/os-instance-actions/req-28ee12d7-748c-4dd8-9922-791f5e6e467a => generated 313 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:16:19.498829 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6ae6d263-08cc-439c-9166-e678c5fe20ca tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:16:19.500021 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6ae6d263-08cc-439c-9166-e678c5fe20ca tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] [instance: d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:19.520399 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ae6d263-08cc-439c-9166-e678c5fe20ca tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:19.521158 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ae6d263-08cc-439c-9166-e678c5fe20ca tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:19.522054 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ae6d263-08cc-439c-9166-e678c5fe20ca tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:19.522573 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ae6d263-08cc-439c-9166-e678c5fe20ca tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:19.562010 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:16:19.627416 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6ae6d263-08cc-439c-9166-e678c5fe20ca tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] 10.222.0.27 "POST /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3/action" status: 202 len: 0 microversion: 2.1 time: 0.132331 Jun 20 12:16:19.632246 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2004/4113] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:16:19 2022] POST /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:16:19.637010 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b0966723-b62d-4838-9e95-cc0206df3c97 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:19.637635 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b0966723-b62d-4838-9e95-cc0206df3c97 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] [instance: d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:19.645123 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b0966723-b62d-4838-9e95-cc0206df3c97 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:19.645567 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b0966723-b62d-4838-9e95-cc0206df3c97 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:19.646508 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b0966723-b62d-4838-9e95-cc0206df3c97 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:19.646952 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b0966723-b62d-4838-9e95-cc0206df3c97 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:19.728836 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2c139f22-3159-49ed-a1dd-5f8de632f6d0 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:19.731450 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2c139f22-3159-49ed-a1dd-5f8de632f6d0 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] [instance: ce950356-da51-4847-96ba-76f575f7d9ab] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:19.740494 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2c139f22-3159-49ed-a1dd-5f8de632f6d0 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:19.742594 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2c139f22-3159-49ed-a1dd-5f8de632f6d0 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:19.747685 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2c139f22-3159-49ed-a1dd-5f8de632f6d0 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:19.748539 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2c139f22-3159-49ed-a1dd-5f8de632f6d0 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:19.975135 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b0966723-b62d-4838-9e95-cc0206df3c97 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ffca09c8434630996a51a079cabc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbfe7e4e3ca845c08a651a5698adab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:19.990311 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b0966723-b62d-4838-9e95-cc0206df3c97 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] 10.222.0.27 "GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3" status: 200 len: 1507 microversion: 2.1 time: 0.358004 Jun 20 12:16:19.990975 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2110/4114] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:19 2022] GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3 => generated 1507 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:20.015642 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ec31cab1-dcd8-44d7-97cb-57fe2d50d57c tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:20.016746 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ec31cab1-dcd8-44d7-97cb-57fe2d50d57c tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 46c93bae-77c3-4fce-b4c3-bee3526049eb] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:20.027674 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ec31cab1-dcd8-44d7-97cb-57fe2d50d57c tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:20.028493 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ec31cab1-dcd8-44d7-97cb-57fe2d50d57c tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:20.029503 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ec31cab1-dcd8-44d7-97cb-57fe2d50d57c tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:20.030118 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ec31cab1-dcd8-44d7-97cb-57fe2d50d57c tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:20.186902 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2c139f22-3159-49ed-a1dd-5f8de632f6d0 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8919a400a671422593e94e0390c3d949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe714415c9e4c9b8cd739c5a9b1c8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:20.195002 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2c139f22-3159-49ed-a1dd-5f8de632f6d0 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] 10.222.0.27 "GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab" status: 200 len: 1294 microversion: 2.1 time: 0.472597 Jun 20 12:16:20.200589 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2005/4115] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:19 2022] GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab => generated 1294 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:16:20.213210 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f9861074-cf8f-4b61-9437-cbe9d2831a9b tempest-VolumesTestJSON-1783663690 tempest-VolumesTestJSON-1783663690-project] Calling method '.version_select at 0x7f60737c69d0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:20.280409 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f9861074-cf8f-4b61-9437-cbe9d2831a9b tempest-VolumesTestJSON-1783663690 tempest-VolumesTestJSON-1783663690-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/140c8bef-abf6-4cf5-947b-7e13f780b76a" status: 200 len: 351 microversion: 2.1 time: 0.078341 Jun 20 12:16:20.281846 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2006/4116] 10.222.0.27 () {58 vars in 1244 bytes} [Mon Jun 20 12:16:20 2022] GET /compute/v2.1/os-volumes/140c8bef-abf6-4cf5-947b-7e13f780b76a => generated 351 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:16:20.287031 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ec31cab1-dcd8-44d7-97cb-57fe2d50d57c tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:20.310431 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ec31cab1-dcd8-44d7-97cb-57fe2d50d57c tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/46c93bae-77c3-4fce-b4c3-bee3526049eb" status: 200 len: 1320 microversion: 2.1 time: 0.300339 Jun 20 12:16:20.313702 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2111/4117] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:20 2022] GET /compute/v2.1/servers/46c93bae-77c3-4fce-b4c3-bee3526049eb => generated 1320 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:20.627869 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:16:20.637704 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-9aa44171-1b11-4a2f-be68-9c8e73afc908 req-ad05d1a0-1da3-4702-84d8-eac1306c83bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46c93bae-77c3-4fce-b4c3-bee3526049eb", "tag": "6c68338b-5e26-4278-a97b-8972e7783ccd"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:16:20.674192 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9aa44171-1b11-4a2f-be68-9c8e73afc908 req-ad05d1a0-1da3-4702-84d8-eac1306c83bd service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:20.674939 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9aa44171-1b11-4a2f-be68-9c8e73afc908 req-ad05d1a0-1da3-4702-84d8-eac1306c83bd service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:20.690836 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-9aa44171-1b11-4a2f-be68-9c8e73afc908 req-ad05d1a0-1da3-4702-84d8-eac1306c83bd service nova] Creating event network-changed:6c68338b-5e26-4278-a97b-8972e7783ccd for instance 46c93bae-77c3-4fce-b4c3-bee3526049eb on n-h1-master-1 Jun 20 12:16:20.707638 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-9aa44171-1b11-4a2f-be68-9c8e73afc908 req-ad05d1a0-1da3-4702-84d8-eac1306c83bd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077249 Jun 20 12:16:20.711204 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2007/4118] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:16:21.014661 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1472bf65-5118-4c4d-99cf-97e4f649d2a3 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:21.015887 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1472bf65-5118-4c4d-99cf-97e4f649d2a3 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] [instance: d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:21.025734 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1472bf65-5118-4c4d-99cf-97e4f649d2a3 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:21.026198 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1472bf65-5118-4c4d-99cf-97e4f649d2a3 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:21.032077 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1472bf65-5118-4c4d-99cf-97e4f649d2a3 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:21.032895 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1472bf65-5118-4c4d-99cf-97e4f649d2a3 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:21.218847 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3b388460-028b-484d-bb78-7fa13c6e0772 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:21.219913 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3b388460-028b-484d-bb78-7fa13c6e0772 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] [instance: ce950356-da51-4847-96ba-76f575f7d9ab] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:21.228193 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b388460-028b-484d-bb78-7fa13c6e0772 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:21.228934 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b388460-028b-484d-bb78-7fa13c6e0772 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:21.229940 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b388460-028b-484d-bb78-7fa13c6e0772 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:21.230562 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b388460-028b-484d-bb78-7fa13c6e0772 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:21.779924 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3b388460-028b-484d-bb78-7fa13c6e0772 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8919a400a671422593e94e0390c3d949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe714415c9e4c9b8cd739c5a9b1c8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:21.793227 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3b388460-028b-484d-bb78-7fa13c6e0772 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] 10.222.0.27 "GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab" status: 200 len: 1294 microversion: 2.1 time: 0.579806 Jun 20 12:16:21.797139 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2008/4119] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:21 2022] GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab => generated 1294 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:16:21.804046 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0d76a66f-1b06-4f21-ba7e-f11c03a43905 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:21.805426 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0d76a66f-1b06-4f21-ba7e-f11c03a43905 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 46c93bae-77c3-4fce-b4c3-bee3526049eb] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:21.813450 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d76a66f-1b06-4f21-ba7e-f11c03a43905 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:21.819401 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d76a66f-1b06-4f21-ba7e-f11c03a43905 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:21.828356 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d76a66f-1b06-4f21-ba7e-f11c03a43905 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:21.828356 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d76a66f-1b06-4f21-ba7e-f11c03a43905 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:22.031100 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1472bf65-5118-4c4d-99cf-97e4f649d2a3 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ffca09c8434630996a51a079cabc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbfe7e4e3ca845c08a651a5698adab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:22.040487 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1472bf65-5118-4c4d-99cf-97e4f649d2a3 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] 10.222.0.27 "GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3" status: 200 len: 1507 microversion: 2.1 time: 1.030411 Jun 20 12:16:22.041496 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2112/4120] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:21 2022] GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3 => generated 1507 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:22.249255 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0d76a66f-1b06-4f21-ba7e-f11c03a43905 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:22.261749 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0d76a66f-1b06-4f21-ba7e-f11c03a43905 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/46c93bae-77c3-4fce-b4c3-bee3526049eb" status: 200 len: 1320 microversion: 2.1 time: 0.462995 Jun 20 12:16:22.262864 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2009/4121] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:21 2022] GET /compute/v2.1/servers/46c93bae-77c3-4fce-b4c3-bee3526049eb => generated 1320 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:22.814283 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7ce724cd-e5b7-42e6-8a2b-166e64052b83 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:22.814908 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7ce724cd-e5b7-42e6-8a2b-166e64052b83 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] [instance: ce950356-da51-4847-96ba-76f575f7d9ab] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:22.826993 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-73df06d4-53da-420d-ba41-195cef3cb36b req-0eb57235-8302-42f9-bede-b3e1606af953 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e05048b-621f-4819-a11a-e0d077f7d563", "name": "network-vif-plugged", "status": "completed", "tag": "eaa70fe1-2667-4b98-9bf5-4a0d37bc56f2"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:16:22.829811 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ce724cd-e5b7-42e6-8a2b-166e64052b83 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:22.832568 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ce724cd-e5b7-42e6-8a2b-166e64052b83 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:22.834495 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ce724cd-e5b7-42e6-8a2b-166e64052b83 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:22.835952 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:16:22.836673 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ce724cd-e5b7-42e6-8a2b-166e64052b83 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:22.849223 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-73df06d4-53da-420d-ba41-195cef3cb36b req-0eb57235-8302-42f9-bede-b3e1606af953 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:22.849683 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-73df06d4-53da-420d-ba41-195cef3cb36b req-0eb57235-8302-42f9-bede-b3e1606af953 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:22.872928 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-73df06d4-53da-420d-ba41-195cef3cb36b req-0eb57235-8302-42f9-bede-b3e1606af953 service nova] Creating event network-vif-plugged:eaa70fe1-2667-4b98-9bf5-4a0d37bc56f2 for instance 1e05048b-621f-4819-a11a-e0d077f7d563 on n-h1-master-1 Jun 20 12:16:22.878796 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-73df06d4-53da-420d-ba41-195cef3cb36b req-0eb57235-8302-42f9-bede-b3e1606af953 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056269 Jun 20 12:16:22.879638 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2010/4122] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:16:22.882610 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:16:22.996168 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-47a998a4-3e2f-4f41-9ba6-f3f1ad0c07b3 tempest-VolumesTestJSON-1783663690 tempest-VolumesTestJSON-1783663690-project] Calling method '.version_select at 0x7f607299c310>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:23.083532 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-47a998a4-3e2f-4f41-9ba6-f3f1ad0c07b3 tempest-VolumesTestJSON-1783663690 tempest-VolumesTestJSON-1783663690-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/8c4aedf4-6315-47f6-850e-746f82914971" status: 200 len: 351 microversion: 2.1 time: 0.091769 Jun 20 12:16:23.084334 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2011/4123] 10.222.0.27 () {58 vars in 1244 bytes} [Mon Jun 20 12:16:22 2022] GET /compute/v2.1/os-volumes/8c4aedf4-6315-47f6-850e-746f82914971 => generated 351 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:16:23.089264 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ed358d56-5d2f-44b0-bbfa-c257d213e381 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:23.090002 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ed358d56-5d2f-44b0-bbfa-c257d213e381 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] [instance: d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:23.132856 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed358d56-5d2f-44b0-bbfa-c257d213e381 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:23.136538 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed358d56-5d2f-44b0-bbfa-c257d213e381 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:23.137630 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed358d56-5d2f-44b0-bbfa-c257d213e381 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:23.138726 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed358d56-5d2f-44b0-bbfa-c257d213e381 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:23.280948 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7ce724cd-e5b7-42e6-8a2b-166e64052b83 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8919a400a671422593e94e0390c3d949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe714415c9e4c9b8cd739c5a9b1c8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:23.297696 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7ce724cd-e5b7-42e6-8a2b-166e64052b83 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] 10.222.0.27 "GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab" status: 200 len: 1294 microversion: 2.1 time: 0.487166 Jun 20 12:16:23.298486 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2113/4124] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:22 2022] GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab => generated 1294 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:23.305737 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-698b1392-fca7-4e8a-8a9a-e33073c28002 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:23.306674 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-698b1392-fca7-4e8a-8a9a-e33073c28002 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 46c93bae-77c3-4fce-b4c3-bee3526049eb] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:23.330599 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-698b1392-fca7-4e8a-8a9a-e33073c28002 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:23.333211 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-698b1392-fca7-4e8a-8a9a-e33073c28002 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:23.335612 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-698b1392-fca7-4e8a-8a9a-e33073c28002 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:23.337016 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-698b1392-fca7-4e8a-8a9a-e33073c28002 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:23.392945 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ed358d56-5d2f-44b0-bbfa-c257d213e381 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ffca09c8434630996a51a079cabc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbfe7e4e3ca845c08a651a5698adab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:23.403893 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ed358d56-5d2f-44b0-bbfa-c257d213e381 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] 10.222.0.27 "GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3" status: 200 len: 1512 microversion: 2.1 time: 0.318105 Jun 20 12:16:23.404527 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2012/4125] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:23 2022] GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3 => generated 1512 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:23.629297 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:16:23.683817 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:16:23.694273 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-698b1392-fca7-4e8a-8a9a-e33073c28002 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:23.714182 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-698b1392-fca7-4e8a-8a9a-e33073c28002 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/46c93bae-77c3-4fce-b4c3-bee3526049eb" status: 200 len: 1320 microversion: 2.1 time: 0.413834 Jun 20 12:16:23.718249 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2114/4126] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:23 2022] GET /compute/v2.1/servers/46c93bae-77c3-4fce-b4c3-bee3526049eb => generated 1320 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:24.317000 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8706b973-9286-48e6-b2fe-6184e609d905 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:24.318316 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8706b973-9286-48e6-b2fe-6184e609d905 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] [instance: ce950356-da51-4847-96ba-76f575f7d9ab] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:24.330679 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8706b973-9286-48e6-b2fe-6184e609d905 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:24.331379 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8706b973-9286-48e6-b2fe-6184e609d905 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:24.332415 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8706b973-9286-48e6-b2fe-6184e609d905 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:24.333007 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8706b973-9286-48e6-b2fe-6184e609d905 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:24.340971 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=28 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:16:24.423213 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fe52991a-fdeb-4d2f-a626-db46a959ad6a tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:24.424371 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fe52991a-fdeb-4d2f-a626-db46a959ad6a tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] [instance: d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:24.445086 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fe52991a-fdeb-4d2f-a626-db46a959ad6a tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:24.445641 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fe52991a-fdeb-4d2f-a626-db46a959ad6a tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:24.446669 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fe52991a-fdeb-4d2f-a626-db46a959ad6a tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:24.447843 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fe52991a-fdeb-4d2f-a626-db46a959ad6a tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:24.647114 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8706b973-9286-48e6-b2fe-6184e609d905 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8919a400a671422593e94e0390c3d949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe714415c9e4c9b8cd739c5a9b1c8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:24.670505 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8706b973-9286-48e6-b2fe-6184e609d905 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] 10.222.0.27 "GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab" status: 200 len: 1294 microversion: 2.1 time: 0.358104 Jun 20 12:16:24.671280 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2013/4127] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:24 2022] GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab => generated 1294 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:24.738397 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d481b633-62c6-48e0-bdf5-7ecaccebe462 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:24.739021 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d481b633-62c6-48e0-bdf5-7ecaccebe462 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 46c93bae-77c3-4fce-b4c3-bee3526049eb] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:24.759641 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d481b633-62c6-48e0-bdf5-7ecaccebe462 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:24.760103 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d481b633-62c6-48e0-bdf5-7ecaccebe462 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:24.767356 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d481b633-62c6-48e0-bdf5-7ecaccebe462 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:24.767825 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d481b633-62c6-48e0-bdf5-7ecaccebe462 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:24.899974 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fe52991a-fdeb-4d2f-a626-db46a959ad6a tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ffca09c8434630996a51a079cabc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbfe7e4e3ca845c08a651a5698adab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:24.912291 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fe52991a-fdeb-4d2f-a626-db46a959ad6a tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] 10.222.0.27 "GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3" status: 200 len: 1505 microversion: 2.1 time: 0.493874 Jun 20 12:16:24.914296 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2115/4128] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:24 2022] GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3 => generated 1505 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:16:24.919211 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-3cbc7e9a-8948-4a94-9c19-cf514b185803 req-c505d319-0a71-458f-9a96-fae8364fa0a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81", "name": "network-vif-plugged", "status": "completed", "tag": "bf346bca-5104-4d7c-bbcf-71f586401f26"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:16:24.929600 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-3cbc7e9a-8948-4a94-9c19-cf514b185803 req-c505d319-0a71-458f-9a96-fae8364fa0a6 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:24.930434 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-3cbc7e9a-8948-4a94-9c19-cf514b185803 req-c505d319-0a71-458f-9a96-fae8364fa0a6 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:24.947873 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-3cbc7e9a-8948-4a94-9c19-cf514b185803 req-c505d319-0a71-458f-9a96-fae8364fa0a6 service nova] Creating event network-vif-plugged:bf346bca-5104-4d7c-bbcf-71f586401f26 for instance d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81 on n-h1-master-1 Jun 20 12:16:24.954875 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-3cbc7e9a-8948-4a94-9c19-cf514b185803 req-c505d319-0a71-458f-9a96-fae8364fa0a6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039140 Jun 20 12:16:24.956300 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2116/4129] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:16:24.962790 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3cf9248c-fa11-498c-bf30-2bb82f0ee001 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Calling method '.version_select at 0x7f60802510d0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:24.963629 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3cf9248c-fa11-498c-bf30-2bb82f0ee001 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] [instance: d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:24.972228 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3cf9248c-fa11-498c-bf30-2bb82f0ee001 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:24.972950 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3cf9248c-fa11-498c-bf30-2bb82f0ee001 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:24.974147 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3cf9248c-fa11-498c-bf30-2bb82f0ee001 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:24.974743 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3cf9248c-fa11-498c-bf30-2bb82f0ee001 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:25.014719 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3cf9248c-fa11-498c-bf30-2bb82f0ee001 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] 10.222.0.27 "GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.056956 Jun 20 12:16:25.015942 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2117/4130] 10.222.0.27 () {58 vars in 1295 bytes} [Mon Jun 20 12:16:24 2022] GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3/os-instance-actions => generated 611 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:16:25.029770 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7bf6fe8f-33fe-4853-85d9-cb1b1d0de1a6 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:25.031812 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7bf6fe8f-33fe-4853-85d9-cb1b1d0de1a6 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] [instance: d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:25.041193 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7bf6fe8f-33fe-4853-85d9-cb1b1d0de1a6 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:25.042202 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7bf6fe8f-33fe-4853-85d9-cb1b1d0de1a6 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:25.043350 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7bf6fe8f-33fe-4853-85d9-cb1b1d0de1a6 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:25.044772 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7bf6fe8f-33fe-4853-85d9-cb1b1d0de1a6 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:25.086035 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7bf6fe8f-33fe-4853-85d9-cb1b1d0de1a6 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] [instance: d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:16:25.118275 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d481b633-62c6-48e0-bdf5-7ecaccebe462 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:25.128661 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d481b633-62c6-48e0-bdf5-7ecaccebe462 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/46c93bae-77c3-4fce-b4c3-bee3526049eb" status: 200 len: 1320 microversion: 2.1 time: 0.394757 Jun 20 12:16:25.129274 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2014/4131] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:24 2022] GET /compute/v2.1/servers/46c93bae-77c3-4fce-b4c3-bee3526049eb => generated 1320 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:16:25.196036 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7bf6fe8f-33fe-4853-85d9-cb1b1d0de1a6 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3" status: 204 len: 0 microversion: 2.1 time: 0.170887 Jun 20 12:16:25.197515 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2118/4132] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:16:25 2022] DELETE /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:16:25.208555 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d4492f20-0fbb-421c-9bf0-82f916ebfad3 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:25.209739 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d4492f20-0fbb-421c-9bf0-82f916ebfad3 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] [instance: d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:25.218942 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4492f20-0fbb-421c-9bf0-82f916ebfad3 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:25.219953 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4492f20-0fbb-421c-9bf0-82f916ebfad3 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:25.221090 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4492f20-0fbb-421c-9bf0-82f916ebfad3 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:25.221999 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4492f20-0fbb-421c-9bf0-82f916ebfad3 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:25.537122 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d4492f20-0fbb-421c-9bf0-82f916ebfad3 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ffca09c8434630996a51a079cabc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbfe7e4e3ca845c08a651a5698adab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:25.548152 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d4492f20-0fbb-421c-9bf0-82f916ebfad3 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] 10.222.0.27 "GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3" status: 200 len: 1511 microversion: 2.1 time: 0.345758 Jun 20 12:16:25.548974 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2015/4133] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:25 2022] GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3 => generated 1511 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:25.698736 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8cb392ba-418e-45d0-acbf-69259bcae962 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:25.699471 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8cb392ba-418e-45d0-acbf-69259bcae962 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] [instance: ce950356-da51-4847-96ba-76f575f7d9ab] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:25.707051 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8cb392ba-418e-45d0-acbf-69259bcae962 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:25.707473 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8cb392ba-418e-45d0-acbf-69259bcae962 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:25.708601 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8cb392ba-418e-45d0-acbf-69259bcae962 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:25.709190 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8cb392ba-418e-45d0-acbf-69259bcae962 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:25.766176 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ef0a014f-f177-4b14-b62b-3f6c78b9ccaa tempest-VolumesTestJSON-1783663690 tempest-VolumesTestJSON-1783663690-project] Calling method '.version_select at 0x7f6072c333a0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:25.838932 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ef0a014f-f177-4b14-b62b-3f6c78b9ccaa tempest-VolumesTestJSON-1783663690 tempest-VolumesTestJSON-1783663690-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/347f2d6b-fc66-43d3-8eb3-5c7625238fc4" status: 200 len: 350 microversion: 2.1 time: 0.081312 Jun 20 12:16:25.839540 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2016/4134] 10.222.0.27 () {58 vars in 1244 bytes} [Mon Jun 20 12:16:25 2022] GET /compute/v2.1/os-volumes/347f2d6b-fc66-43d3-8eb3-5c7625238fc4 => generated 350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:16:25.854368 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3a980d43-7e0b-41a0-9ed9-83e074442139 tempest-VolumesTestJSON-1783663690 tempest-VolumesTestJSON-1783663690-project] Calling method '.version_select at 0x7f6072949160>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:25.932626 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8cb392ba-418e-45d0-acbf-69259bcae962 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8919a400a671422593e94e0390c3d949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe714415c9e4c9b8cd739c5a9b1c8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:25.962909 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8cb392ba-418e-45d0-acbf-69259bcae962 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] 10.222.0.27 "GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab" status: 200 len: 1294 microversion: 2.1 time: 0.278619 Jun 20 12:16:25.963896 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2119/4135] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:25 2022] GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab => generated 1294 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:26.014279 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3a980d43-7e0b-41a0-9ed9-83e074442139 tempest-VolumesTestJSON-1783663690 tempest-VolumesTestJSON-1783663690-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.165810 Jun 20 12:16:26.014937 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2017/4136] 10.222.0.27 () {58 vars in 1133 bytes} [Mon Jun 20 12:16:25 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:16:26.029214 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6a06fddd-de0d-456f-a5d5-d8b8c2f017cb tempest-VolumesTestJSON-1783663690 tempest-VolumesTestJSON-1783663690-project] Calling method '.version_select at 0x7f6073495b80>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:26.151877 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-07772316-bdfa-4b50-90d4-52d2984d943d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:26.152626 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-07772316-bdfa-4b50-90d4-52d2984d943d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 46c93bae-77c3-4fce-b4c3-bee3526049eb] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:26.159354 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6a06fddd-de0d-456f-a5d5-d8b8c2f017cb tempest-VolumesTestJSON-1783663690 tempest-VolumesTestJSON-1783663690-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.133897 Jun 20 12:16:26.160186 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2120/4137] 10.222.0.27 () {58 vars in 1148 bytes} [Mon Jun 20 12:16:26 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:16:26.187172 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-97d294e2-dc27-470a-be1b-bb333325c4d1 tempest-VolumesTestJSON-1783663690 tempest-VolumesTestJSON-1783663690-project] Calling method '.version_select at 0x7f6073542670>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:26.197649 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-07772316-bdfa-4b50-90d4-52d2984d943d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:26.199815 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-07772316-bdfa-4b50-90d4-52d2984d943d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:26.201474 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-07772316-bdfa-4b50-90d4-52d2984d943d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:26.203211 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-07772316-bdfa-4b50-90d4-52d2984d943d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:26.354410 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-97d294e2-dc27-470a-be1b-bb333325c4d1 tempest-VolumesTestJSON-1783663690 tempest-VolumesTestJSON-1783663690-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.179517 Jun 20 12:16:26.356481 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2121/4138] 10.222.0.27 () {58 vars in 1133 bytes} [Mon Jun 20 12:16:26 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:16:26.375181 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-19bf98c7-f04f-45c3-992f-e06d7198ee68 tempest-VolumesTestJSON-1783663690 tempest-VolumesTestJSON-1783663690-project] Calling method '.version_select at 0x7f6073457280>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:26.517774 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-19bf98c7-f04f-45c3-992f-e06d7198ee68 tempest-VolumesTestJSON-1783663690 tempest-VolumesTestJSON-1783663690-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.151984 Jun 20 12:16:26.522788 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2122/4139] 10.222.0.27 () {58 vars in 1166 bytes} [Mon Jun 20 12:16:26 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:16:26.538100 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ba0d8597-e791-46d9-8340-2b54c5ed8662 tempest-VolumesTestJSON-1783663690 tempest-VolumesTestJSON-1783663690-project] Calling method '.version_select at 0x7f6073457550>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:26.714657 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-07772316-bdfa-4b50-90d4-52d2984d943d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:26.728999 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ba0d8597-e791-46d9-8340-2b54c5ed8662 tempest-VolumesTestJSON-1783663690 tempest-VolumesTestJSON-1783663690-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.195990 Jun 20 12:16:26.730292 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2123/4140] 10.222.0.27 () {58 vars in 1169 bytes} [Mon Jun 20 12:16:26 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:16:26.734285 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-07772316-bdfa-4b50-90d4-52d2984d943d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/46c93bae-77c3-4fce-b4c3-bee3526049eb" status: 200 len: 1320 microversion: 2.1 time: 0.582782 Jun 20 12:16:26.734931 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2018/4141] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:26 2022] GET /compute/v2.1/servers/46c93bae-77c3-4fce-b4c3-bee3526049eb => generated 1320 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:16:26.748164 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ecfa657c-81ae-4b63-884e-fede4fa33df6 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:26.749739 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ecfa657c-81ae-4b63-884e-fede4fa33df6 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] [instance: d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:26.752268 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a84d5b05-3bbf-49cf-9771-c514dbb7d75c tempest-VolumesTestJSON-1783663690 tempest-VolumesTestJSON-1783663690-project] Calling method '.version_select at 0x7f607294b9d0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:26.779975 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ecfa657c-81ae-4b63-884e-fede4fa33df6 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:26.779975 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ecfa657c-81ae-4b63-884e-fede4fa33df6 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:26.794805 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ecfa657c-81ae-4b63-884e-fede4fa33df6 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:26.795721 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ecfa657c-81ae-4b63-884e-fede4fa33df6 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:26.921874 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a84d5b05-3bbf-49cf-9771-c514dbb7d75c tempest-VolumesTestJSON-1783663690 tempest-VolumesTestJSON-1783663690-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.173314 Jun 20 12:16:26.922887 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2019/4142] 10.222.0.27 () {58 vars in 1154 bytes} [Mon Jun 20 12:16:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:16:26.933821 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4e4dba53-378a-49b7-b35f-6158a36ebde5 tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:26.935283 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4e4dba53-378a-49b7-b35f-6158a36ebde5 tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:26.946368 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4e4dba53-378a-49b7-b35f-6158a36ebde5 tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:26.951900 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4e4dba53-378a-49b7-b35f-6158a36ebde5 tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:26.953096 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4e4dba53-378a-49b7-b35f-6158a36ebde5 tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:26.954577 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4e4dba53-378a-49b7-b35f-6158a36ebde5 tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:27.113709 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ecfa657c-81ae-4b63-884e-fede4fa33df6 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ffca09c8434630996a51a079cabc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbfe7e4e3ca845c08a651a5698adab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:27.127843 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ecfa657c-81ae-4b63-884e-fede4fa33df6 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] 10.222.0.27 "GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3" status: 200 len: 1511 microversion: 2.1 time: 0.396219 Jun 20 12:16:27.131100 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2124/4143] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:26 2022] GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3 => generated 1511 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:27.136164 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fa0cc253-0f24-4871-bd4a-86b5dd5333c5 tempest-VolumesTestJSON-1783663690 tempest-VolumesTestJSON-1783663690-project] Calling method '.version_select at 0x7f60801acf70>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:27.268027 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fa0cc253-0f24-4871-bd4a-86b5dd5333c5 tempest-VolumesTestJSON-1783663690 tempest-VolumesTestJSON-1783663690-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.134648 Jun 20 12:16:27.270764 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2125/4144] 10.222.0.27 () {58 vars in 1187 bytes} [Mon Jun 20 12:16:27 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:16:27.280926 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d9fde81d-c049-4702-8ed4-9f0e8797a520 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:27.294679 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d9fde81d-c049-4702-8ed4-9f0e8797a520 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] [instance: ce950356-da51-4847-96ba-76f575f7d9ab] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:27.302024 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9fde81d-c049-4702-8ed4-9f0e8797a520 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:27.303335 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9fde81d-c049-4702-8ed4-9f0e8797a520 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:27.304932 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9fde81d-c049-4702-8ed4-9f0e8797a520 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:27.305596 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9fde81d-c049-4702-8ed4-9f0e8797a520 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:27.344336 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4e4dba53-378a-49b7-b35f-6158a36ebde5 tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1832 microversion: 2.1 time: 0.419617 Jun 20 12:16:27.344984 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2020/4145] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:26 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1832 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:27.357985 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0ec89a28-83db-47ae-bcfd-ccb0d1a3cdf7 tempest-VolumesTestJSON-1783663690 tempest-VolumesTestJSON-1783663690-project] Calling method '.version_select at 0x7f6073193040>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:27.519679 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0ec89a28-83db-47ae-bcfd-ccb0d1a3cdf7 tempest-VolumesTestJSON-1783663690 tempest-VolumesTestJSON-1783663690-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.173443 Jun 20 12:16:27.533949 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2021/4146] 10.222.0.27 () {58 vars in 1154 bytes} [Mon Jun 20 12:16:27 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:27.567609 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d9fde81d-c049-4702-8ed4-9f0e8797a520 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8919a400a671422593e94e0390c3d949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe714415c9e4c9b8cd739c5a9b1c8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:27.577591 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d9fde81d-c049-4702-8ed4-9f0e8797a520 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] 10.222.0.27 "GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab" status: 200 len: 1294 microversion: 2.1 time: 0.303895 Jun 20 12:16:27.581020 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2126/4147] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:27 2022] GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab => generated 1294 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:27.761414 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-669a1b22-99d8-4141-b4dc-71ce268dc0c2 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:27.762589 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-669a1b22-99d8-4141-b4dc-71ce268dc0c2 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 46c93bae-77c3-4fce-b4c3-bee3526049eb] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:27.782882 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-669a1b22-99d8-4141-b4dc-71ce268dc0c2 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:27.783738 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-669a1b22-99d8-4141-b4dc-71ce268dc0c2 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:27.784838 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-669a1b22-99d8-4141-b4dc-71ce268dc0c2 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:27.785433 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-669a1b22-99d8-4141-b4dc-71ce268dc0c2 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:28.147551 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1f2e337a-3220-4aa1-a7d7-10f1ee56927d tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:28.148309 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1f2e337a-3220-4aa1-a7d7-10f1ee56927d tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] [instance: d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:28.165146 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f2e337a-3220-4aa1-a7d7-10f1ee56927d tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:28.165609 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f2e337a-3220-4aa1-a7d7-10f1ee56927d tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:28.178439 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f2e337a-3220-4aa1-a7d7-10f1ee56927d tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:28.178978 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f2e337a-3220-4aa1-a7d7-10f1ee56927d tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:28.537798 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1f2e337a-3220-4aa1-a7d7-10f1ee56927d tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ffca09c8434630996a51a079cabc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbfe7e4e3ca845c08a651a5698adab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:28.550931 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1f2e337a-3220-4aa1-a7d7-10f1ee56927d tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] 10.222.0.27 "GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3" status: 200 len: 1511 microversion: 2.1 time: 0.407302 Jun 20 12:16:28.551548 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2127/4148] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:28 2022] GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3 => generated 1511 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:28.597394 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-52c23025-6088-4b6b-a744-2134440803b9 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:28.598456 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-52c23025-6088-4b6b-a744-2134440803b9 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] [instance: ce950356-da51-4847-96ba-76f575f7d9ab] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:28.608391 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52c23025-6088-4b6b-a744-2134440803b9 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:28.609299 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52c23025-6088-4b6b-a744-2134440803b9 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:28.610598 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52c23025-6088-4b6b-a744-2134440803b9 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:28.611276 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52c23025-6088-4b6b-a744-2134440803b9 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:28.740438 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-669a1b22-99d8-4141-b4dc-71ce268dc0c2 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:28.753047 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-669a1b22-99d8-4141-b4dc-71ce268dc0c2 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/46c93bae-77c3-4fce-b4c3-bee3526049eb" status: 200 len: 1320 microversion: 2.1 time: 0.996186 Jun 20 12:16:28.762344 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2022/4149] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:27 2022] GET /compute/v2.1/servers/46c93bae-77c3-4fce-b4c3-bee3526049eb => generated 1320 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:28.855806 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-a89e88e9-2ee6-45b7-a40d-41e74828f42d req-850fd22c-9647-4d64-a494-abbfc73c0d35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46c93bae-77c3-4fce-b4c3-bee3526049eb", "name": "network-vif-plugged", "status": "completed", "tag": "6c68338b-5e26-4278-a97b-8972e7783ccd"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:16:28.871130 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-a89e88e9-2ee6-45b7-a40d-41e74828f42d req-850fd22c-9647-4d64-a494-abbfc73c0d35 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:28.877077 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-a89e88e9-2ee6-45b7-a40d-41e74828f42d req-850fd22c-9647-4d64-a494-abbfc73c0d35 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:28.914419 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-a89e88e9-2ee6-45b7-a40d-41e74828f42d req-850fd22c-9647-4d64-a494-abbfc73c0d35 service nova] Creating event network-vif-plugged:6c68338b-5e26-4278-a97b-8972e7783ccd for instance 46c93bae-77c3-4fce-b4c3-bee3526049eb on n-h1-master-1 Jun 20 12:16:28.929606 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-a89e88e9-2ee6-45b7-a40d-41e74828f42d req-850fd22c-9647-4d64-a494-abbfc73c0d35 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078589 Jun 20 12:16:28.932824 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2023/4150] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:16:29.574311 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-52c23025-6088-4b6b-a744-2134440803b9 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8919a400a671422593e94e0390c3d949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe714415c9e4c9b8cd739c5a9b1c8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:29.605884 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6d8f1702-aef2-49eb-b9dc-512a0324ce8c tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:29.608910 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6d8f1702-aef2-49eb-b9dc-512a0324ce8c tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] [instance: d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:29.626830 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-52c23025-6088-4b6b-a744-2134440803b9 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] 10.222.0.27 "GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab" status: 200 len: 1294 microversion: 2.1 time: 1.035358 Jun 20 12:16:29.645444 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2128/4151] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:28 2022] GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab => generated 1294 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:29.650556 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6d8f1702-aef2-49eb-b9dc-512a0324ce8c tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:29.658545 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6d8f1702-aef2-49eb-b9dc-512a0324ce8c tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:29.659619 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6d8f1702-aef2-49eb-b9dc-512a0324ce8c tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:29.660245 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6d8f1702-aef2-49eb-b9dc-512a0324ce8c tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:29.750903 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-b9ea2bfa-ecef-42b1-bead-98c62b859fd4 req-49a0bdab-3d34-4f41-bbf8-fce50d43f1df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3", "name": "network-vif-deleted", "tag": "90423145-1f90-4631-b690-42818c30d4c4"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:16:29.775260 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b9ea2bfa-ecef-42b1-bead-98c62b859fd4 req-49a0bdab-3d34-4f41-bbf8-fce50d43f1df service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:29.780549 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b9ea2bfa-ecef-42b1-bead-98c62b859fd4 req-49a0bdab-3d34-4f41-bbf8-fce50d43f1df service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:29.817318 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-b9ea2bfa-ecef-42b1-bead-98c62b859fd4 req-49a0bdab-3d34-4f41-bbf8-fce50d43f1df service nova] Creating event network-vif-deleted:90423145-1f90-4631-b690-42818c30d4c4 for instance d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3 on n-h2-master-1 Jun 20 12:16:29.832857 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-b9ea2bfa-ecef-42b1-bead-98c62b859fd4 req-49a0bdab-3d34-4f41-bbf8-fce50d43f1df service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083990 Jun 20 12:16:29.837468 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2129/4152] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:16:29.855100 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-73debc1d-70d0-41f7-aefe-be63693e8bf9 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:29.857154 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-73debc1d-70d0-41f7-aefe-be63693e8bf9 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 46c93bae-77c3-4fce-b4c3-bee3526049eb] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:29.878774 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-73debc1d-70d0-41f7-aefe-be63693e8bf9 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:29.880408 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-73debc1d-70d0-41f7-aefe-be63693e8bf9 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:29.883439 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-73debc1d-70d0-41f7-aefe-be63693e8bf9 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:29.886912 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-73debc1d-70d0-41f7-aefe-be63693e8bf9 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:29.903554 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6d8f1702-aef2-49eb-b9dc-512a0324ce8c tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ffca09c8434630996a51a079cabc57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbfe7e4e3ca845c08a651a5698adab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:29.923600 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6d8f1702-aef2-49eb-b9dc-512a0324ce8c tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] 10.222.0.27 "GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3" status: 200 len: 1469 microversion: 2.1 time: 0.358413 Jun 20 12:16:29.937728 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2024/4153] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:29 2022] GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3 => generated 1469 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:16:30.403000 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-73debc1d-70d0-41f7-aefe-be63693e8bf9 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:30.441655 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-73debc1d-70d0-41f7-aefe-be63693e8bf9 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/46c93bae-77c3-4fce-b4c3-bee3526049eb" status: 200 len: 1320 microversion: 2.1 time: 0.589899 Jun 20 12:16:30.444325 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2130/4154] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:29 2022] GET /compute/v2.1/servers/46c93bae-77c3-4fce-b4c3-bee3526049eb => generated 1320 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:30.650619 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bfecd07d-737a-47b2-80f6-fc95277c810f tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:30.651767 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bfecd07d-737a-47b2-80f6-fc95277c810f tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] [instance: ce950356-da51-4847-96ba-76f575f7d9ab] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:30.663606 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bfecd07d-737a-47b2-80f6-fc95277c810f tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:30.664579 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bfecd07d-737a-47b2-80f6-fc95277c810f tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:30.668143 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bfecd07d-737a-47b2-80f6-fc95277c810f tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:30.669302 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bfecd07d-737a-47b2-80f6-fc95277c810f tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:30.953582 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d09aba7f-6f22-419e-aaa2-15e68dd55c40 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:30.954213 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d09aba7f-6f22-419e-aaa2-15e68dd55c40 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] [instance: d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:30.970229 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d09aba7f-6f22-419e-aaa2-15e68dd55c40 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:30.970649 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d09aba7f-6f22-419e-aaa2-15e68dd55c40 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:30.971463 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d09aba7f-6f22-419e-aaa2-15e68dd55c40 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:30.972450 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d09aba7f-6f22-419e-aaa2-15e68dd55c40 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:30.993546 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-d09aba7f-6f22-419e-aaa2-15e68dd55c40 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] HTTP exception thrown: Instance d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3 could not be found. Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d09aba7f-6f22-419e-aaa2-15e68dd55c40 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Request method failure captured: Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3 HTTP/1.1 Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGT4HQ9MjBqosHeJSrd7TzVz2dsRcQaxCJcyWqKj6w6qLxiSihGoprRseStD_E2lNwqfjDR0bvY0GEfbX-MtGlnlG4JaY-YY8YYSMnY1O8sMO-ueu0QrZQCvorsaFgkPmLbUdort73ZG0mg8-wILIsTVdgq3KQ-soIRbXL7lfHsXeWg Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: fbfe7e4e3ca845c08a651a5698adab56 Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-InstanceActionsTestJSON-1892352333 Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fbfe7e4e3ca845c08a651a5698adab56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fbfe7e4e3ca845c08a651a5698adab56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fbfe7e4e3ca845c08a651a5698adab56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fbfe7e4e3ca845c08a651a5698adab56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-InstanceActionsTestJSON-1892352333 Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: fbfe7e4e3ca845c08a651a5698adab56 Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1892352333 Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-InstanceActionsTestJSON-1892352333-project Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 01ffca09c8434630996a51a079cabc57 Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-InstanceActionsTestJSON-1892352333-project Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: exception: Instance d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3 could not be found. Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'd03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3'} Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3 could not be found. Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3 could not be found. Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:16:30.995994 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:16:31.001456 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:16:31.001456 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:16:31.001456 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:16:31.001456 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:16:31.001456 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:16:31.001456 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3 could not be found. Jun 20 12:16:31.001456 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:16:31.003757 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d09aba7f-6f22-419e-aaa2-15e68dd55c40 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] Returning 404 to user: Instance d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:16:31.005172 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d09aba7f-6f22-419e-aaa2-15e68dd55c40 tempest-InstanceActionsTestJSON-1892352333 tempest-InstanceActionsTestJSON-1892352333-project] 10.222.0.27 "GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3" status: 404 len: 111 microversion: 2.1 time: 0.058069 Jun 20 12:16:31.010678 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2131/4155] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:30 2022] GET /compute/v2.1/servers/d03dd8e6-44dd-4aa8-9c3f-a666ffeff0c3 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:16:31.184068 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a7fe16f8-8079-4db6-97e9-82095b62e2a5 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:31.186216 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a7fe16f8-8079-4db6-97e9-82095b62e2a5 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:31.221419 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a7fe16f8-8079-4db6-97e9-82095b62e2a5 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:31.221798 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a7fe16f8-8079-4db6-97e9-82095b62e2a5 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:31.223661 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a7fe16f8-8079-4db6-97e9-82095b62e2a5 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:31.225428 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a7fe16f8-8079-4db6-97e9-82095b62e2a5 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:31.281554 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-bfecd07d-737a-47b2-80f6-fc95277c810f tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8919a400a671422593e94e0390c3d949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe714415c9e4c9b8cd739c5a9b1c8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:31.294216 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bfecd07d-737a-47b2-80f6-fc95277c810f tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] 10.222.0.27 "GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab" status: 200 len: 1294 microversion: 2.1 time: 0.648929 Jun 20 12:16:31.295093 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2025/4156] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:30 2022] GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab => generated 1294 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:31.303442 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-55c6b0e7-7e3b-4ab6-9e0f-32ef790478d8 req-42481bc3-4d9a-40a0-bf68-74b59e16912a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d", "tag": "ce10fc86-e544-41be-9e96-7780fa2e39cc"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:16:31.307500 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a7fe16f8-8079-4db6-97e9-82095b62e2a5 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:16:31.328244 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-55c6b0e7-7e3b-4ab6-9e0f-32ef790478d8 req-42481bc3-4d9a-40a0-bf68-74b59e16912a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:31.328711 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-55c6b0e7-7e3b-4ab6-9e0f-32ef790478d8 req-42481bc3-4d9a-40a0-bf68-74b59e16912a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:31.361238 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-55c6b0e7-7e3b-4ab6-9e0f-32ef790478d8 req-42481bc3-4d9a-40a0-bf68-74b59e16912a service nova] Creating event network-changed:ce10fc86-e544-41be-9e96-7780fa2e39cc for instance f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d on n-h2-master-1 Jun 20 12:16:31.373448 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-55c6b0e7-7e3b-4ab6-9e0f-32ef790478d8 req-42481bc3-4d9a-40a0-bf68-74b59e16912a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074102 Jun 20 12:16:31.378106 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2026/4157] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:16:31.465252 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-19705a08-2cad-4ed5-a508-ff55cf734253 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:31.465973 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-19705a08-2cad-4ed5-a508-ff55cf734253 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 46c93bae-77c3-4fce-b4c3-bee3526049eb] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:31.477847 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-19705a08-2cad-4ed5-a508-ff55cf734253 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:31.478524 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-19705a08-2cad-4ed5-a508-ff55cf734253 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:31.479480 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-19705a08-2cad-4ed5-a508-ff55cf734253 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:31.480078 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-19705a08-2cad-4ed5-a508-ff55cf734253 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:31.631912 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a7fe16f8-8079-4db6-97e9-82095b62e2a5 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 204 len: 0 microversion: 2.1 time: 0.454349 Jun 20 12:16:31.638626 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2132/4158] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:16:31 2022] DELETE /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:16:31.657482 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0a77ae81-1358-4e9f-b303-4189dd8cc398 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:31.668744 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0a77ae81-1358-4e9f-b303-4189dd8cc398 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:31.697617 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a77ae81-1358-4e9f-b303-4189dd8cc398 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:31.698382 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a77ae81-1358-4e9f-b303-4189dd8cc398 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:31.702654 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a77ae81-1358-4e9f-b303-4189dd8cc398 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:31.704711 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a77ae81-1358-4e9f-b303-4189dd8cc398 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:31.842403 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-19705a08-2cad-4ed5-a508-ff55cf734253 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:31.852288 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-19705a08-2cad-4ed5-a508-ff55cf734253 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/46c93bae-77c3-4fce-b4c3-bee3526049eb" status: 200 len: 1512 microversion: 2.1 time: 0.394613 Jun 20 12:16:31.865827 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2027/4159] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:31 2022] GET /compute/v2.1/servers/46c93bae-77c3-4fce-b4c3-bee3526049eb => generated 1512 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:31.872106 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c5b48ddb-31d1-4189-9a8d-41e4cb652a46 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:31.872758 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c5b48ddb-31d1-4189-9a8d-41e4cb652a46 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 1e05048b-621f-4819-a11a-e0d077f7d563] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:31.888860 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c5b48ddb-31d1-4189-9a8d-41e4cb652a46 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:31.889316 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c5b48ddb-31d1-4189-9a8d-41e4cb652a46 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:31.890110 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c5b48ddb-31d1-4189-9a8d-41e4cb652a46 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:31.890548 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c5b48ddb-31d1-4189-9a8d-41e4cb652a46 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:32.239782 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c5b48ddb-31d1-4189-9a8d-41e4cb652a46 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:32.247732 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:16:32.255474 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c5b48ddb-31d1-4189-9a8d-41e4cb652a46 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563" status: 200 len: 1511 microversion: 2.1 time: 0.383692 Jun 20 12:16:32.257955 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2028/4160] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:31 2022] GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563 => generated 1511 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:32.275864 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7e2a2583-1515-4c65-ab17-7ba71bb16e82 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:32.276574 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7e2a2583-1515-4c65-ab17-7ba71bb16e82 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:32.308072 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7e2a2583-1515-4c65-ab17-7ba71bb16e82 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:32.308787 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7e2a2583-1515-4c65-ab17-7ba71bb16e82 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:32.309593 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7e2a2583-1515-4c65-ab17-7ba71bb16e82 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:32.310043 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7e2a2583-1515-4c65-ab17-7ba71bb16e82 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:32.353486 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0a77ae81-1358-4e9f-b303-4189dd8cc398 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:32.367113 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:16:32.376759 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0a77ae81-1358-4e9f-b303-4189dd8cc398 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1687 microversion: 2.1 time: 0.731924 Jun 20 12:16:32.388369 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2133/4161] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:31 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1687 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:32.398508 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f7ffab2f-76e0-4036-a3d5-84cea19aaf0c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:32.403835 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f7ffab2f-76e0-4036-a3d5-84cea19aaf0c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] [instance: ce950356-da51-4847-96ba-76f575f7d9ab] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:32.432055 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f7ffab2f-76e0-4036-a3d5-84cea19aaf0c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:32.438142 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f7ffab2f-76e0-4036-a3d5-84cea19aaf0c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:32.439264 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f7ffab2f-76e0-4036-a3d5-84cea19aaf0c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:32.440097 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f7ffab2f-76e0-4036-a3d5-84cea19aaf0c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:32.701346 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7e2a2583-1515-4c65-ab17-7ba71bb16e82 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:32.719011 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7e2a2583-1515-4c65-ab17-7ba71bb16e82 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81" status: 200 len: 1511 microversion: 2.1 time: 0.447623 Jun 20 12:16:32.724265 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2029/4162] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:32 2022] GET /compute/v2.1/servers/d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81 => generated 1511 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:16:32.740707 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9bff995d-53c8-4f24-8172-8ab35f41b9fa tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:32.752566 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9bff995d-53c8-4f24-8172-8ab35f41b9fa tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:32.754617 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9bff995d-53c8-4f24-8172-8ab35f41b9fa tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '3103ed818db8417b8625af13e7176910'} {{(pid=119128) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:16:32.786483 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9bff995d-53c8-4f24-8172-8ab35f41b9fa tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:32.788284 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9bff995d-53c8-4f24-8172-8ab35f41b9fa tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:32.792949 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9bff995d-53c8-4f24-8172-8ab35f41b9fa tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:32.793619 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9bff995d-53c8-4f24-8172-8ab35f41b9fa tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:32.974008 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f7ffab2f-76e0-4036-a3d5-84cea19aaf0c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8919a400a671422593e94e0390c3d949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe714415c9e4c9b8cd739c5a9b1c8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:32.984961 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f7ffab2f-76e0-4036-a3d5-84cea19aaf0c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] 10.222.0.27 "GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab" status: 200 len: 1294 microversion: 2.1 time: 0.603045 Jun 20 12:16:32.992571 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2134/4163] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:32 2022] GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab => generated 1294 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:33.162535 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.multi_cell_list [None req-9bff995d-53c8-4f24-8172-8ab35f41b9fa tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119128) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 12:16:33.304677 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-2e767b09-1b42-4769-830e-81d4a9fb81b7 req-752adb94-810a-4128-b1c9-7f36c33343c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce950356-da51-4847-96ba-76f575f7d9ab", "name": "network-vif-plugged", "status": "completed", "tag": "1bcf3d27-a159-49aa-8893-b16ec015ede0"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:16:33.329121 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-2e767b09-1b42-4769-830e-81d4a9fb81b7 req-752adb94-810a-4128-b1c9-7f36c33343c2 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:33.330631 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-2e767b09-1b42-4769-830e-81d4a9fb81b7 req-752adb94-810a-4128-b1c9-7f36c33343c2 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:33.371952 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-2e767b09-1b42-4769-830e-81d4a9fb81b7 req-752adb94-810a-4128-b1c9-7f36c33343c2 service nova] Creating event network-vif-plugged:1bcf3d27-a159-49aa-8893-b16ec015ede0 for instance ce950356-da51-4847-96ba-76f575f7d9ab on n-h2-master-1 Jun 20 12:16:33.387348 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-2e767b09-1b42-4769-830e-81d4a9fb81b7 req-752adb94-810a-4128-b1c9-7f36c33343c2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086652 Jun 20 12:16:33.388658 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2135/4164] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:16:33.402644 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9ffe8548-e330-4e29-a4af-e0068a8c7593 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:33.403565 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9ffe8548-e330-4e29-a4af-e0068a8c7593 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:33.410526 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ffe8548-e330-4e29-a4af-e0068a8c7593 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:33.411285 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ffe8548-e330-4e29-a4af-e0068a8c7593 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:33.412306 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ffe8548-e330-4e29-a4af-e0068a8c7593 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:33.413023 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ffe8548-e330-4e29-a4af-e0068a8c7593 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:34.097714 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9bff995d-53c8-4f24-8172-8ab35f41b9fa tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:34.104390 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9bff995d-53c8-4f24-8172-8ab35f41b9fa tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:34.104834 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9bff995d-53c8-4f24-8172-8ab35f41b9fa tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:34.283368 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9ffe8548-e330-4e29-a4af-e0068a8c7593 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:34.303627 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9ffe8548-e330-4e29-a4af-e0068a8c7593 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1687 microversion: 2.1 time: 0.905717 Jun 20 12:16:34.309033 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2136/4165] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:33 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1687 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:16:34.327340 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9bff995d-53c8-4f24-8172-8ab35f41b9fa tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 1.593712 Jun 20 12:16:34.328543 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2030/4166] 10.222.0.27 () {58 vars in 1166 bytes} [Mon Jun 20 12:16:32 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:34.332085 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e180cb50-b059-4993-8f06-84e666f1081f tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:34.332754 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e180cb50-b059-4993-8f06-84e666f1081f tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] [instance: ce950356-da51-4847-96ba-76f575f7d9ab] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:34.340849 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e180cb50-b059-4993-8f06-84e666f1081f tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:34.341302 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e180cb50-b059-4993-8f06-84e666f1081f tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:34.342129 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e180cb50-b059-4993-8f06-84e666f1081f tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:34.342563 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e180cb50-b059-4993-8f06-84e666f1081f tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:34.348788 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-63705830-c988-45ee-b57e-e93ffdd76a58 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:34.354941 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-63705830-c988-45ee-b57e-e93ffdd76a58 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:34.357020 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-63705830-c988-45ee-b57e-e93ffdd76a58 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-723687177', 'deleted': False, 'project_id': '3103ed818db8417b8625af13e7176910'} {{(pid=119128) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:16:34.374983 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-63705830-c988-45ee-b57e-e93ffdd76a58 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:34.375434 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-63705830-c988-45ee-b57e-e93ffdd76a58 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:34.376273 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-63705830-c988-45ee-b57e-e93ffdd76a58 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:34.381315 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-63705830-c988-45ee-b57e-e93ffdd76a58 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:34.505168 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.multi_cell_list [None req-63705830-c988-45ee-b57e-e93ffdd76a58 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119128) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 12:16:34.607124 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-63705830-c988-45ee-b57e-e93ffdd76a58 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:34.614438 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-63705830-c988-45ee-b57e-e93ffdd76a58 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:34.615242 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-63705830-c988-45ee-b57e-e93ffdd76a58 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:34.846144 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-63705830-c988-45ee-b57e-e93ffdd76a58 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-723687177" status: 200 len: 1514 microversion: 2.1 time: 0.502901 Jun 20 12:16:34.858311 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2031/4167] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Jun 20 12:16:34 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-723687177 => generated 1514 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:34.870166 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9c46ee86-834b-4f63-b539-710b3272a9f4 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:34.879859 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9c46ee86-834b-4f63-b539-710b3272a9f4 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:34.884379 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9c46ee86-834b-4f63-b539-710b3272a9f4 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '3103ed818db8417b8625af13e7176910'} {{(pid=119128) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:16:34.894913 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c46ee86-834b-4f63-b539-710b3272a9f4 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:34.895648 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c46ee86-834b-4f63-b539-710b3272a9f4 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:34.896715 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c46ee86-834b-4f63-b539-710b3272a9f4 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:34.897694 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c46ee86-834b-4f63-b539-710b3272a9f4 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:35.051883 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.multi_cell_list [None req-9c46ee86-834b-4f63-b539-710b3272a9f4 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119128) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 12:16:35.171570 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9c46ee86-834b-4f63-b539-710b3272a9f4 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:35.195811 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c46ee86-834b-4f63-b539-710b3272a9f4 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:35.196596 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c46ee86-834b-4f63-b539-710b3272a9f4 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:35.479572 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9c46ee86-834b-4f63-b539-710b3272a9f4 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4517 microversion: 2.1 time: 0.616173 Jun 20 12:16:35.492243 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2032/4168] 10.222.0.27 () {58 vars in 1172 bytes} [Mon Jun 20 12:16:34 2022] GET /compute/v2.1/servers/detail?status=active => generated 4517 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:16:35.492243 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-08f1a835-e341-411f-b671-6eebd89b71e9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:35.492243 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-08f1a835-e341-411f-b671-6eebd89b71e9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:35.503634 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-08f1a835-e341-411f-b671-6eebd89b71e9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:35.504085 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-08f1a835-e341-411f-b671-6eebd89b71e9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:35.504893 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-08f1a835-e341-411f-b671-6eebd89b71e9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:35.505334 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-08f1a835-e341-411f-b671-6eebd89b71e9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:35.646347 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e180cb50-b059-4993-8f06-84e666f1081f tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8919a400a671422593e94e0390c3d949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe714415c9e4c9b8cd739c5a9b1c8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:35.657537 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e180cb50-b059-4993-8f06-84e666f1081f tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] 10.222.0.27 "GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab" status: 200 len: 1294 microversion: 2.1 time: 1.337013 Jun 20 12:16:35.660277 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2137/4169] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:34 2022] GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab => generated 1294 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:35.677249 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d087a41d-3331-43c7-89f2-92ea3c71c7e2 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:35.681295 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d087a41d-3331-43c7-89f2-92ea3c71c7e2 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:35.693115 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.compute.servers [None req-d087a41d-3331-43c7-89f2-92ea3c71c7e2 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Removing options 'limit' from query {{(pid=119127) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jun 20 12:16:35.696255 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d087a41d-3331-43c7-89f2-92ea3c71c7e2 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Searching by: {'deleted': False, 'project_id': '3103ed818db8417b8625af13e7176910'} {{(pid=119127) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:16:35.702330 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d087a41d-3331-43c7-89f2-92ea3c71c7e2 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:35.703373 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d087a41d-3331-43c7-89f2-92ea3c71c7e2 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:35.703670 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d087a41d-3331-43c7-89f2-92ea3c71c7e2 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:35.704113 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d087a41d-3331-43c7-89f2-92ea3c71c7e2 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:35.778902 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d087a41d-3331-43c7-89f2-92ea3c71c7e2 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:35.792624 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d087a41d-3331-43c7-89f2-92ea3c71c7e2 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:35.794450 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d087a41d-3331-43c7-89f2-92ea3c71c7e2 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:36.439080 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-08f1a835-e341-411f-b671-6eebd89b71e9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:36.451272 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-08f1a835-e341-411f-b671-6eebd89b71e9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1687 microversion: 2.1 time: 0.966009 Jun 20 12:16:36.452438 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2033/4170] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:35 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1687 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:36.551029 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d087a41d-3331-43c7-89f2-92ea3c71c7e2 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.889546 Jun 20 12:16:36.551646 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2138/4171] 10.222.0.27 () {58 vars in 1160 bytes} [Mon Jun 20 12:16:35 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:36.572479 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5b61c75c-79a1-4d1a-bcf9-f709b279653a tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:36.580832 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5b61c75c-79a1-4d1a-bcf9-f709b279653a tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:36.581987 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5b61c75c-79a1-4d1a-bcf9-f709b279653a tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '3103ed818db8417b8625af13e7176910'} {{(pid=119128) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:16:36.595893 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5b61c75c-79a1-4d1a-bcf9-f709b279653a tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:36.596610 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5b61c75c-79a1-4d1a-bcf9-f709b279653a tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:36.597853 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5b61c75c-79a1-4d1a-bcf9-f709b279653a tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:36.598567 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5b61c75c-79a1-4d1a-bcf9-f709b279653a tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:36.660093 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.multi_cell_list [None req-5b61c75c-79a1-4d1a-bcf9-f709b279653a tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119128) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 12:16:36.677524 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bf98410c-8a07-439e-b322-a3be8633e0aa tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:36.678542 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bf98410c-8a07-439e-b322-a3be8633e0aa tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] [instance: ce950356-da51-4847-96ba-76f575f7d9ab] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:36.695706 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf98410c-8a07-439e-b322-a3be8633e0aa tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:36.696181 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf98410c-8a07-439e-b322-a3be8633e0aa tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:36.697055 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf98410c-8a07-439e-b322-a3be8633e0aa tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:36.697496 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf98410c-8a07-439e-b322-a3be8633e0aa tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:36.774418 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5b61c75c-79a1-4d1a-bcf9-f709b279653a tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers?status=active" status: 200 len: 1009 microversion: 2.1 time: 0.205452 Jun 20 12:16:36.783811 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2034/4172] 10.222.0.27 () {58 vars in 1151 bytes} [Mon Jun 20 12:16:36 2022] GET /compute/v2.1/servers?status=active => generated 1009 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:36.815861 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a3730d7e-83e8-4fb6-8e2d-e3cb28a93650 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:36.829033 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a3730d7e-83e8-4fb6-8e2d-e3cb28a93650 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:36.830066 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.compute.servers [None req-a3730d7e-83e8-4fb6-8e2d-e3cb28a93650 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Removing options 'limit' from query {{(pid=119128) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jun 20 12:16:36.831203 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a3730d7e-83e8-4fb6-8e2d-e3cb28a93650 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Searching by: {'deleted': False, 'project_id': '3103ed818db8417b8625af13e7176910'} {{(pid=119128) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:16:36.847112 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3730d7e-83e8-4fb6-8e2d-e3cb28a93650 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:36.847893 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3730d7e-83e8-4fb6-8e2d-e3cb28a93650 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:36.849050 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3730d7e-83e8-4fb6-8e2d-e3cb28a93650 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:36.849880 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3730d7e-83e8-4fb6-8e2d-e3cb28a93650 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:36.920783 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.multi_cell_list [None req-a3730d7e-83e8-4fb6-8e2d-e3cb28a93650 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119128) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 12:16:36.993663 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a3730d7e-83e8-4fb6-8e2d-e3cb28a93650 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1009 microversion: 2.1 time: 0.204042 Jun 20 12:16:37.002104 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2035/4173] 10.222.0.27 () {58 vars in 1149 bytes} [Mon Jun 20 12:16:36 2022] GET /compute/v2.1/servers?limit=100000 => generated 1009 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:37.015632 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fc0fe3cd-ae29-4643-b085-e2a604cec54e tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:37.024077 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fc0fe3cd-ae29-4643-b085-e2a604cec54e tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:37.026718 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fc0fe3cd-ae29-4643-b085-e2a604cec54e tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Searching by: {'deleted': False, 'project_id': '3103ed818db8417b8625af13e7176910'} {{(pid=119128) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:16:37.040236 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fc0fe3cd-ae29-4643-b085-e2a604cec54e tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:37.040772 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fc0fe3cd-ae29-4643-b085-e2a604cec54e tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:37.042469 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fc0fe3cd-ae29-4643-b085-e2a604cec54e tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:37.042916 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fc0fe3cd-ae29-4643-b085-e2a604cec54e tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:37.110961 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.multi_cell_list [None req-fc0fe3cd-ae29-4643-b085-e2a604cec54e tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119128) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 12:16:37.184448 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fc0fe3cd-ae29-4643-b085-e2a604cec54e tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1009 microversion: 2.1 time: 0.180459 Jun 20 12:16:37.202345 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2036/4174] 10.222.0.27 () {58 vars in 1124 bytes} [Mon Jun 20 12:16:37 2022] GET /compute/v2.1/servers => generated 1009 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:37.207445 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-baa4da14-8b09-4fe4-92c9-3e4935eb1a80 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:37.215572 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-baa4da14-8b09-4fe4-92c9-3e4935eb1a80 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:37.216296 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-baa4da14-8b09-4fe4-92c9-3e4935eb1a80 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '3103ed818db8417b8625af13e7176910'} {{(pid=119128) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:16:37.245469 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-baa4da14-8b09-4fe4-92c9-3e4935eb1a80 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:37.245469 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-baa4da14-8b09-4fe4-92c9-3e4935eb1a80 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:37.250950 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-baa4da14-8b09-4fe4-92c9-3e4935eb1a80 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:37.251668 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-baa4da14-8b09-4fe4-92c9-3e4935eb1a80 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:37.393249 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.multi_cell_list [None req-baa4da14-8b09-4fe4-92c9-3e4935eb1a80 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119128) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 12:16:37.412894 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bf98410c-8a07-439e-b322-a3be8633e0aa tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8919a400a671422593e94e0390c3d949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe714415c9e4c9b8cd739c5a9b1c8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:37.429513 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bf98410c-8a07-439e-b322-a3be8633e0aa tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] 10.222.0.27 "GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab" status: 200 len: 1485 microversion: 2.1 time: 0.748879 Jun 20 12:16:37.430483 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2139/4175] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:36 2022] GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab => generated 1485 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:16:37.449149 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d92a789e-0c4b-4e67-9508-f3ac0a63c880 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:37.450000 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d92a789e-0c4b-4e67-9508-f3ac0a63c880 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] [instance: ce950356-da51-4847-96ba-76f575f7d9ab] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:37.462655 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d92a789e-0c4b-4e67-9508-f3ac0a63c880 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:37.463371 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d92a789e-0c4b-4e67-9508-f3ac0a63c880 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:37.466247 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d92a789e-0c4b-4e67-9508-f3ac0a63c880 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:37.474441 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d92a789e-0c4b-4e67-9508-f3ac0a63c880 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:37.575404 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-baa4da14-8b09-4fe4-92c9-3e4935eb1a80 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.371777 Jun 20 12:16:37.576834 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2037/4176] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 12:16:37 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:16:37.587751 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-4601afd6-fc2e-499e-b085-825f3a25d445 req-5db3b619-1e49-4b3f-a655-867a1f20031d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d", "name": "network-vif-deleted", "tag": "ce10fc86-e544-41be-9e96-7780fa2e39cc"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:16:37.602598 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-4601afd6-fc2e-499e-b085-825f3a25d445 req-5db3b619-1e49-4b3f-a655-867a1f20031d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:37.603283 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-4601afd6-fc2e-499e-b085-825f3a25d445 req-5db3b619-1e49-4b3f-a655-867a1f20031d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:37.615989 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-4601afd6-fc2e-499e-b085-825f3a25d445 req-5db3b619-1e49-4b3f-a655-867a1f20031d service nova] Creating event network-vif-deleted:ce10fc86-e544-41be-9e96-7780fa2e39cc for instance f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d on n-h2-master-1 Jun 20 12:16:37.627098 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-4601afd6-fc2e-499e-b085-825f3a25d445 req-5db3b619-1e49-4b3f-a655-867a1f20031d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048748 Jun 20 12:16:37.632308 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2038/4177] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:16:37.640866 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5f221c93-bdcc-4ec3-a736-674db9626785 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:37.641459 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5f221c93-bdcc-4ec3-a736-674db9626785 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:37.669256 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5f221c93-bdcc-4ec3-a736-674db9626785 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:37.669901 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5f221c93-bdcc-4ec3-a736-674db9626785 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:37.670794 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5f221c93-bdcc-4ec3-a736-674db9626785 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:37.671241 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5f221c93-bdcc-4ec3-a736-674db9626785 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:37.763502 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5f221c93-bdcc-4ec3-a736-674db9626785 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:37.763962 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5f221c93-bdcc-4ec3-a736-674db9626785 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:37.764452 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-5f221c93-bdcc-4ec3-a736-674db9626785 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lazy-loading 'fault' on Instance uuid f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:16:37.934009 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5f221c93-bdcc-4ec3-a736-674db9626785 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:37.951237 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5f221c93-bdcc-4ec3-a736-674db9626785 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 200 len: 1357 microversion: 2.1 time: 0.316844 Jun 20 12:16:37.956963 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2039/4178] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:37 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 1357 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:37.961972 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-99eeebfb-581e-40cd-9335-cfe650b7a256 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:37.972186 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-99eeebfb-581e-40cd-9335-cfe650b7a256 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:37.976704 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.compute.servers [None req-99eeebfb-581e-40cd-9335-cfe650b7a256 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Removing options 'limit' from query {{(pid=119128) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jun 20 12:16:37.977771 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-99eeebfb-581e-40cd-9335-cfe650b7a256 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Searching by: {'deleted': False, 'project_id': '3103ed818db8417b8625af13e7176910'} {{(pid=119128) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:16:37.992391 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-99eeebfb-581e-40cd-9335-cfe650b7a256 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:37.993004 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-99eeebfb-581e-40cd-9335-cfe650b7a256 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:37.993951 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-99eeebfb-581e-40cd-9335-cfe650b7a256 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:37.994541 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-99eeebfb-581e-40cd-9335-cfe650b7a256 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:38.044454 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-99eeebfb-581e-40cd-9335-cfe650b7a256 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.086130 Jun 20 12:16:38.046450 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2040/4179] 10.222.0.27 () {58 vars in 1139 bytes} [Mon Jun 20 12:16:37 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:16:38.058832 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d92a789e-0c4b-4e67-9508-f3ac0a63c880 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] 10.222.0.27 "GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.613599 Jun 20 12:16:38.059452 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2140/4180] 10.222.0.27 () {58 vars in 1274 bytes} [Mon Jun 20 12:16:37 2022] GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab/os-interface => generated 284 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:16:38.060557 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0cf64e40-65f8-488b-94cb-66c76a2ea06a tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:38.066720 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0cf64e40-65f8-488b-94cb-66c76a2ea06a tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:38.068294 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0cf64e40-65f8-488b-94cb-66c76a2ea06a tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-723687177', 'deleted': False, 'project_id': '3103ed818db8417b8625af13e7176910'} {{(pid=119128) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:16:38.077644 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cf64e40-65f8-488b-94cb-66c76a2ea06a tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:38.078339 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cf64e40-65f8-488b-94cb-66c76a2ea06a tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:38.079949 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cf64e40-65f8-488b-94cb-66c76a2ea06a tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:38.080496 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cf64e40-65f8-488b-94cb-66c76a2ea06a tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:38.202438 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.multi_cell_list [None req-0cf64e40-65f8-488b-94cb-66c76a2ea06a tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119128) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 12:16:38.287939 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0cf64e40-65f8-488b-94cb-66c76a2ea06a tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-723687177" status: 200 len: 345 microversion: 2.1 time: 0.232715 Jun 20 12:16:38.289176 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2041/4181] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Jun 20 12:16:38 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-723687177 => generated 345 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:16:38.304079 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-32d0f29f-5adb-43d9-9d21-dd7c241cebb9 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:16:38.316304 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-32d0f29f-5adb-43d9-9d21-dd7c241cebb9 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:38.318105 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-32d0f29f-5adb-43d9-9d21-dd7c241cebb9 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:38.379993 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-32d0f29f-5adb-43d9-9d21-dd7c241cebb9 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 1e05048b-621f-4819-a11a-e0d077f7d563] Going to try to stop instance {{(pid=119127) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 20 12:16:38.473943 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-32d0f29f-5adb-43d9-9d21-dd7c241cebb9 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "POST /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563/action" status: 202 len: 0 microversion: 2.1 time: 0.175816 Jun 20 12:16:38.479016 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2141/4182] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:16:38 2022] POST /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 12:16:38.492708 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f211d1b8-9693-41b2-b4cf-39abf97cca34 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:38.494656 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f211d1b8-9693-41b2-b4cf-39abf97cca34 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 1e05048b-621f-4819-a11a-e0d077f7d563] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:38.511356 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f211d1b8-9693-41b2-b4cf-39abf97cca34 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:38.512210 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f211d1b8-9693-41b2-b4cf-39abf97cca34 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:38.513248 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f211d1b8-9693-41b2-b4cf-39abf97cca34 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:38.513983 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f211d1b8-9693-41b2-b4cf-39abf97cca34 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:38.539230 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:16:38.782833 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f211d1b8-9693-41b2-b4cf-39abf97cca34 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:38.794122 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f211d1b8-9693-41b2-b4cf-39abf97cca34 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563" status: 200 len: 1521 microversion: 2.1 time: 0.311990 Jun 20 12:16:38.797343 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2042/4183] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:38 2022] GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563 => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:38.920377 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d519f0e9-fa04-4285-a912-c50c9b5cae71 tempest-ServerGroup264TestJSON-1468915547 tempest-ServerGroup264TestJSON-1468915547-project] Action: 'create', calling method: .version_select at 0x7f607370e1f0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:16:38.932253 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:16:38.957202 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-d519f0e9-fa04-4285-a912-c50c9b5cae71 tempest-ServerGroup264TestJSON-1468915547 tempest-ServerGroup264TestJSON-1468915547-project] Getting quotas for project 61a6498819d44c6bab9de2740e094a7f. Resources: {'server_groups'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:16:38.975681 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1cc37c3a-edc3-451e-8983-82f48be0e2f9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:38.976600 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1cc37c3a-edc3-451e-8983-82f48be0e2f9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:38.979009 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-d519f0e9-fa04-4285-a912-c50c9b5cae71 tempest-ServerGroup264TestJSON-1468915547 tempest-ServerGroup264TestJSON-1468915547-project] Getting quotas for user 338f2294884d4bf4819b7e60471860ba and project 61a6498819d44c6bab9de2740e094a7f. Resources: {'server_groups'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:16:38.993665 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1cc37c3a-edc3-451e-8983-82f48be0e2f9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:38.999668 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1cc37c3a-edc3-451e-8983-82f48be0e2f9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:39.001858 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1cc37c3a-edc3-451e-8983-82f48be0e2f9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:39.005674 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1cc37c3a-edc3-451e-8983-82f48be0e2f9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:39.074014 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-1cc37c3a-edc3-451e-8983-82f48be0e2f9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] HTTP exception thrown: Instance f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d could not be found. Jun 20 12:16:39.078716 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-d519f0e9-fa04-4285-a912-c50c9b5cae71 tempest-ServerGroup264TestJSON-1468915547 tempest-ServerGroup264TestJSON-1468915547-project] Getting quotas for project 61a6498819d44c6bab9de2740e094a7f. Resources: {'server_groups'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1cc37c3a-edc3-451e-8983-82f48be0e2f9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Request method failure captured: Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d HTTP/1.1 Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGRxXwEWVrLndBXp9okenLjyhkdOBOwXRK4Cejibgug0y9gZVb-q35CPxL4ypqyn2D__W7NeZfrt6P6zq_dz_jtM9HHb9YjfilwN-Kw8EltvT9MAEPJplbU2PqTsTUjGeGogBzl7yp09NSZXdDKx25vj0o6ShE6q88hEvQEZpmuKykM Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 9e9e481852fe4e6ebdc15ec343a741f2 Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2045574846 Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9e9e481852fe4e6ebdc15ec343a741f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9e9e481852fe4e6ebdc15ec343a741f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9e9e481852fe4e6ebdc15ec343a741f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9e9e481852fe4e6ebdc15ec343a741f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2045574846 Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 9e9e481852fe4e6ebdc15ec343a741f2 Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2045574846 Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-TestNetworkAdvancedServerOps-2045574846-project Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: cd27c8696f7147e18054b26ebbae7045 Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2045574846-project Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: exception: Instance f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d could not be found. Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d'} Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d could not be found. Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d could not be found. Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:16:39.081132 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:16:39.085107 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:16:39.085107 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:16:39.085107 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:16:39.085107 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:16:39.085107 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:16:39.085107 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:16:39.085107 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d could not be found. Jun 20 12:16:39.085107 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:16:39.085107 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1cc37c3a-edc3-451e-8983-82f48be0e2f9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Returning 404 to user: Instance f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:16:39.085107 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1cc37c3a-edc3-451e-8983-82f48be0e2f9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d" status: 404 len: 111 microversion: 2.1 time: 0.111602 Jun 20 12:16:39.091462 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2043/4184] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:38 2022] GET /compute/v2.1/servers/f9e3ed2b-2ad8-4495-8d59-aa8212e9d88d => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:16:39.097736 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-d519f0e9-fa04-4285-a912-c50c9b5cae71 tempest-ServerGroup264TestJSON-1468915547 tempest-ServerGroup264TestJSON-1468915547-project] Getting quotas for user 338f2294884d4bf4819b7e60471860ba and project 61a6498819d44c6bab9de2740e094a7f. Resources: {'server_groups'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:16:39.138024 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d519f0e9-fa04-4285-a912-c50c9b5cae71 tempest-ServerGroup264TestJSON-1468915547 tempest-ServerGroup264TestJSON-1468915547-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.442220 Jun 20 12:16:39.138686 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2142/4185] 10.222.0.27 () {62 vars in 1213 bytes} [Mon Jun 20 12:16:38 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 12:16:39.149540 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-704e2887-5423-41f9-86c9-b4943740daa3 tempest-ServerGroup264TestJSON-1468915547 tempest-ServerGroup264TestJSON-1468915547-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:39.175494 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-704e2887-5423-41f9-86c9-b4943740daa3 tempest-ServerGroup264TestJSON-1468915547 tempest-ServerGroup264TestJSON-1468915547-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.030561 Jun 20 12:16:39.181246 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2044/4186] 10.222.0.27 () {60 vars in 1192 bytes} [Mon Jun 20 12:16:39 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:16:39.186877 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c13decfb-ffca-4004-8a72-cd24e97ae3df tempest-ServerGroup264TestJSON-1468915547 tempest-ServerGroup264TestJSON-1468915547-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:39.204967 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c13decfb-ffca-4004-8a72-cd24e97ae3df tempest-ServerGroup264TestJSON-1468915547 tempest-ServerGroup264TestJSON-1468915547-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/666301c3-7406-4128-9a6f-065247de4e9c" status: 200 len: 235 microversion: 2.64 time: 0.022300 Jun 20 12:16:39.205529 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2143/4187] 10.222.0.27 () {60 vars in 1303 bytes} [Mon Jun 20 12:16:39 2022] GET /compute/v2.1/os-server-groups/666301c3-7406-4128-9a6f-065247de4e9c => generated 235 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:16:39.217010 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-32d8b1e9-1513-4dfb-9e9b-33110d4f1870 tempest-ServerGroup264TestJSON-1468915547 tempest-ServerGroup264TestJSON-1468915547-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:39.305917 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-32d8b1e9-1513-4dfb-9e9b-33110d4f1870 tempest-ServerGroup264TestJSON-1468915547 tempest-ServerGroup264TestJSON-1468915547-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/666301c3-7406-4128-9a6f-065247de4e9c" status: 204 len: 0 microversion: 2.64 time: 0.092902 Jun 20 12:16:39.310270 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2045/4188] 10.222.0.27 () {60 vars in 1306 bytes} [Mon Jun 20 12:16:39 2022] DELETE /compute/v2.1/os-server-groups/666301c3-7406-4128-9a6f-065247de4e9c => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 12:16:39.315679 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cb1aff96-2de7-40b6-ac1f-57e64d29bd68 tempest-ServerGroup264TestJSON-1468915547 tempest-ServerGroup264TestJSON-1468915547-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:39.329940 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-cb1aff96-2de7-40b6-ac1f-57e64d29bd68 tempest-ServerGroup264TestJSON-1468915547 tempest-ServerGroup264TestJSON-1468915547-project] HTTP exception thrown: Instance group 666301c3-7406-4128-9a6f-065247de4e9c could not be found. Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cb1aff96-2de7-40b6-ac1f-57e64d29bd68 tempest-ServerGroup264TestJSON-1468915547 tempest-ServerGroup264TestJSON-1468915547-project] Request method failure captured: Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/os-server-groups/666301c3-7406-4128-9a6f-065247de4e9c HTTP/1.1 Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGUm_XvUb5tUYyBks6-3H3hJGJNWHsJkBW5MyJjNQCtAVKqPubF8xLnwj8ILJRHu3O6ZgpevycnR1QtvrDNe6uvgrUroxqHp-kESf7UtK-8qlkmNWXcwN6Mkk-T-yUbo5EQ_9CpuOcInVCb1lxBfYhWr9aMDRF38bBTb_u3mQrcKXbU Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: X-Openstack-Nova-Api-Version: 2.64 Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 61a6498819d44c6bab9de2740e094a7f Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServerGroup264TestJSON-1468915547 Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61a6498819d44c6bab9de2740e094a7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61a6498819d44c6bab9de2740e094a7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/61a6498819d44c6bab9de2740e094a7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_61a6498819d44c6bab9de2740e094a7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServerGroup264TestJSON-1468915547 Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 61a6498819d44c6bab9de2740e094a7f Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1468915547 Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServerGroup264TestJSON-1468915547-project Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 338f2294884d4bf4819b7e60471860ba Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServerGroup264TestJSON-1468915547-project Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: exception: Instance group 666301c3-7406-4128-9a6f-065247de4e9c could not be found. Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '666301c3-7406-4128-9a6f-065247de4e9c'} Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 666301c3-7406-4128-9a6f-065247de4e9c could not be found. Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 666301c3-7406-4128-9a6f-065247de4e9c could not be found. Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:16:39.339306 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:16:39.346804 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:16:39.346804 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:16:39.346804 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:16:39.346804 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:16:39.346804 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 666301c3-7406-4128-9a6f-065247de4e9c could not be found. Jun 20 12:16:39.346804 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:16:39.346804 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cb1aff96-2de7-40b6-ac1f-57e64d29bd68 tempest-ServerGroup264TestJSON-1468915547 tempest-ServerGroup264TestJSON-1468915547-project] Returning 404 to user: Instance group 666301c3-7406-4128-9a6f-065247de4e9c could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:16:39.346804 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cb1aff96-2de7-40b6-ac1f-57e64d29bd68 tempest-ServerGroup264TestJSON-1468915547 tempest-ServerGroup264TestJSON-1468915547-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/666301c3-7406-4128-9a6f-065247de4e9c" status: 404 len: 117 microversion: 2.64 time: 0.029433 Jun 20 12:16:39.346804 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2144/4189] 10.222.0.27 () {60 vars in 1306 bytes} [Mon Jun 20 12:16:39 2022] DELETE /compute/v2.1/os-server-groups/666301c3-7406-4128-9a6f-065247de4e9c => generated 117 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:16:39.814297 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d26eae8e-f86d-4072-8b7e-d220087ddf5d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:39.815776 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d26eae8e-f86d-4072-8b7e-d220087ddf5d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 1e05048b-621f-4819-a11a-e0d077f7d563] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:39.836422 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d26eae8e-f86d-4072-8b7e-d220087ddf5d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:39.844994 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d26eae8e-f86d-4072-8b7e-d220087ddf5d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:39.848280 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d26eae8e-f86d-4072-8b7e-d220087ddf5d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:39.855226 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d26eae8e-f86d-4072-8b7e-d220087ddf5d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:40.528059 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d26eae8e-f86d-4072-8b7e-d220087ddf5d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:40.543177 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d26eae8e-f86d-4072-8b7e-d220087ddf5d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563" status: 200 len: 1521 microversion: 2.1 time: 0.732525 Jun 20 12:16:40.544397 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2046/4190] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:39 2022] GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563 => generated 1521 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:41.562788 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dece54d2-a1d3-406c-a2a2-dec9aadf4958 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:41.563691 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dece54d2-a1d3-406c-a2a2-dec9aadf4958 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 1e05048b-621f-4819-a11a-e0d077f7d563] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:41.585959 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dece54d2-a1d3-406c-a2a2-dec9aadf4958 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:41.586348 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dece54d2-a1d3-406c-a2a2-dec9aadf4958 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:41.587156 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dece54d2-a1d3-406c-a2a2-dec9aadf4958 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:41.591516 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dece54d2-a1d3-406c-a2a2-dec9aadf4958 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:42.055790 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4fa65685-8fb0-422a-8ed6-a443f909e8f3 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:42.056714 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4fa65685-8fb0-422a-8ed6-a443f909e8f3 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] [instance: ce950356-da51-4847-96ba-76f575f7d9ab] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:42.090864 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4fa65685-8fb0-422a-8ed6-a443f909e8f3 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:42.092921 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4fa65685-8fb0-422a-8ed6-a443f909e8f3 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:42.095466 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4fa65685-8fb0-422a-8ed6-a443f909e8f3 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:42.098827 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4fa65685-8fb0-422a-8ed6-a443f909e8f3 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:42.186377 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dece54d2-a1d3-406c-a2a2-dec9aadf4958 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:42.200967 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dece54d2-a1d3-406c-a2a2-dec9aadf4958 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563" status: 200 len: 1521 microversion: 2.1 time: 0.643893 Jun 20 12:16:42.202567 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2145/4191] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:41 2022] GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563 => generated 1521 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:42.227659 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-dad01a2f-fd46-4954-b40d-f13b59991408 req-6de27d03-d2fe-4e01-b824-6e10fde7bfd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce950356-da51-4847-96ba-76f575f7d9ab", "tag": "1bcf3d27-a159-49aa-8893-b16ec015ede0"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:16:42.257780 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-dad01a2f-fd46-4954-b40d-f13b59991408 req-6de27d03-d2fe-4e01-b824-6e10fde7bfd3 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:42.259344 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-dad01a2f-fd46-4954-b40d-f13b59991408 req-6de27d03-d2fe-4e01-b824-6e10fde7bfd3 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:42.310619 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-dad01a2f-fd46-4954-b40d-f13b59991408 req-6de27d03-d2fe-4e01-b824-6e10fde7bfd3 service nova] Creating event network-changed:1bcf3d27-a159-49aa-8893-b16ec015ede0 for instance ce950356-da51-4847-96ba-76f575f7d9ab on n-h2-master-1 Jun 20 12:16:42.328092 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-dad01a2f-fd46-4954-b40d-f13b59991408 req-6de27d03-d2fe-4e01-b824-6e10fde7bfd3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124070 Jun 20 12:16:42.329195 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2146/4192] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:16:42.920350 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4fa65685-8fb0-422a-8ed6-a443f909e8f3 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8919a400a671422593e94e0390c3d949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe714415c9e4c9b8cd739c5a9b1c8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:42.933456 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4fa65685-8fb0-422a-8ed6-a443f909e8f3 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] 10.222.0.27 "GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab" status: 200 len: 1485 microversion: 2.1 time: 0.882044 Jun 20 12:16:42.946044 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2047/4193] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:42 2022] GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab => generated 1485 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:43.223127 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c0753475-ccd5-419f-a938-d7b57c49a57f tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:43.224795 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c0753475-ccd5-419f-a938-d7b57c49a57f tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 1e05048b-621f-4819-a11a-e0d077f7d563] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:43.262245 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c0753475-ccd5-419f-a938-d7b57c49a57f tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:43.262245 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c0753475-ccd5-419f-a938-d7b57c49a57f tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:43.268083 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c0753475-ccd5-419f-a938-d7b57c49a57f tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:43.268669 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c0753475-ccd5-419f-a938-d7b57c49a57f tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:44.867727 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c0753475-ccd5-419f-a938-d7b57c49a57f tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:44.877148 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c0753475-ccd5-419f-a938-d7b57c49a57f tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563" status: 200 len: 1521 microversion: 2.1 time: 1.662172 Jun 20 12:16:44.877751 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2147/4194] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:43 2022] GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563 => generated 1521 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:45.895042 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4a56a0f5-961e-443c-bd5d-5905b43c6f8b tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:45.896344 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4a56a0f5-961e-443c-bd5d-5905b43c6f8b tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 1e05048b-621f-4819-a11a-e0d077f7d563] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:45.899937 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:16:45.917684 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4a56a0f5-961e-443c-bd5d-5905b43c6f8b tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:45.920152 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4a56a0f5-961e-443c-bd5d-5905b43c6f8b tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:45.923243 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4a56a0f5-961e-443c-bd5d-5905b43c6f8b tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:45.923900 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4a56a0f5-961e-443c-bd5d-5905b43c6f8b tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:46.381313 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4a56a0f5-961e-443c-bd5d-5905b43c6f8b tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:46.394416 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4a56a0f5-961e-443c-bd5d-5905b43c6f8b tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563" status: 200 len: 1521 microversion: 2.1 time: 0.500904 Jun 20 12:16:46.411521 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2048/4195] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:45 2022] GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563 => generated 1521 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:47.412095 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-880d6259-f0f9-4f0c-93a9-a1835c738993 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:47.413239 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-880d6259-f0f9-4f0c-93a9-a1835c738993 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 1e05048b-621f-4819-a11a-e0d077f7d563] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:47.416690 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:16:47.420664 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-880d6259-f0f9-4f0c-93a9-a1835c738993 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:47.421335 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-880d6259-f0f9-4f0c-93a9-a1835c738993 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:47.422114 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-880d6259-f0f9-4f0c-93a9-a1835c738993 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:47.422555 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-880d6259-f0f9-4f0c-93a9-a1835c738993 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:48.286227 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-880d6259-f0f9-4f0c-93a9-a1835c738993 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:48.297718 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-880d6259-f0f9-4f0c-93a9-a1835c738993 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563" status: 200 len: 1521 microversion: 2.1 time: 0.889361 Jun 20 12:16:48.298329 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2148/4196] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:47 2022] GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563 => generated 1521 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:49.317454 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0bfcf74a-c214-49eb-b2a3-55dee1f59ed9 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:49.321493 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0bfcf74a-c214-49eb-b2a3-55dee1f59ed9 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 1e05048b-621f-4819-a11a-e0d077f7d563] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:49.343390 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=18 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:16:49.364659 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0bfcf74a-c214-49eb-b2a3-55dee1f59ed9 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:49.367161 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0bfcf74a-c214-49eb-b2a3-55dee1f59ed9 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:49.369101 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0bfcf74a-c214-49eb-b2a3-55dee1f59ed9 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:49.371810 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0bfcf74a-c214-49eb-b2a3-55dee1f59ed9 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:49.805741 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0bfcf74a-c214-49eb-b2a3-55dee1f59ed9 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:49.819298 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0bfcf74a-c214-49eb-b2a3-55dee1f59ed9 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563" status: 200 len: 1521 microversion: 2.1 time: 0.507445 Jun 20 12:16:49.821815 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2049/4197] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:49 2022] GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563 => generated 1521 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:50.841155 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-55bab920-5d74-4818-9f3c-10870a418cef tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:50.842557 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-55bab920-5d74-4818-9f3c-10870a418cef tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 1e05048b-621f-4819-a11a-e0d077f7d563] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:50.849310 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=10 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:16:50.864334 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-55bab920-5d74-4818-9f3c-10870a418cef tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:50.865014 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-55bab920-5d74-4818-9f3c-10870a418cef tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:50.866079 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-55bab920-5d74-4818-9f3c-10870a418cef tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:50.866886 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-55bab920-5d74-4818-9f3c-10870a418cef tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:51.288933 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-55bab920-5d74-4818-9f3c-10870a418cef tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:51.317629 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-55bab920-5d74-4818-9f3c-10870a418cef tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563" status: 200 len: 1521 microversion: 2.1 time: 0.481418 Jun 20 12:16:51.320043 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2149/4198] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:50 2022] GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563 => generated 1521 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:51.336502 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e8f18979-6203-4990-ae02-d8d4ac0bcf40 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '.version_select at 0x7f6073a4cf70>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:51.384278 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e8f18979-6203-4990-ae02-d8d4ac0bcf40 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2020908636" status: 202 len: 0 microversion: 2.1 time: 0.052583 Jun 20 12:16:51.385657 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2050/4199] 10.222.0.27 () {58 vars in 1283 bytes} [Mon Jun 20 12:16:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2020908636 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:16:51.424826 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-383fe351-8295-4734-97fe-f821621cfbc8 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Action: 'create', calling method: .version_select at 0x7f6073af1d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-722062693", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmpKyfPh7NNWVonwTe4eb+XejyoP8TlPhe9Od2YS7eFwYuTFbwSNFieQEWrcifcBMJvxRdkQRR9Sceq1UyFF3eG7Rcx/813aekB/hqzPcogwPG8mLJprIonEs8CQpWZbw=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:16:51.461233 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-383fe351-8295-4734-97fe-f821621cfbc8 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Getting quotas for project 9e9e481852fe4e6ebdc15ec343a741f2. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:16:51.468519 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-383fe351-8295-4734-97fe-f821621cfbc8 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Getting quotas for user cd27c8696f7147e18054b26ebbae7045 and project 9e9e481852fe4e6ebdc15ec343a741f2. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:16:51.498201 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-383fe351-8295-4734-97fe-f821621cfbc8 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.077976 Jun 20 12:16:51.499496 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2150/4200] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 12:16:51 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:16:52.338017 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bb7462a5-1e15-4cc1-aa08-cc84abd1eed9 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:52.338622 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bb7462a5-1e15-4cc1-aa08-cc84abd1eed9 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 1e05048b-621f-4819-a11a-e0d077f7d563] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:52.345980 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bb7462a5-1e15-4cc1-aa08-cc84abd1eed9 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:52.346439 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bb7462a5-1e15-4cc1-aa08-cc84abd1eed9 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:52.347187 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bb7462a5-1e15-4cc1-aa08-cc84abd1eed9 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:52.347620 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bb7462a5-1e15-4cc1-aa08-cc84abd1eed9 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:52.669394 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-bb7462a5-1e15-4cc1-aa08-cc84abd1eed9 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:52.680471 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bb7462a5-1e15-4cc1-aa08-cc84abd1eed9 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563" status: 200 len: 1521 microversion: 2.1 time: 0.346560 Jun 20 12:16:52.681070 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2051/4201] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:52 2022] GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563 => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:53.709783 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-781563cc-fabd-4db9-aa8f-7472655fc952 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:53.710758 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-781563cc-fabd-4db9-aa8f-7472655fc952 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 1e05048b-621f-4819-a11a-e0d077f7d563] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:53.727011 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-781563cc-fabd-4db9-aa8f-7472655fc952 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:53.727579 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-781563cc-fabd-4db9-aa8f-7472655fc952 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:53.733724 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-781563cc-fabd-4db9-aa8f-7472655fc952 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:53.734420 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-781563cc-fabd-4db9-aa8f-7472655fc952 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:55.158593 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-781563cc-fabd-4db9-aa8f-7472655fc952 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:55.170597 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-781563cc-fabd-4db9-aa8f-7472655fc952 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563" status: 200 len: 1521 microversion: 2.1 time: 1.476508 Jun 20 12:16:55.184745 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2151/4202] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:53 2022] GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563 => generated 1521 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:56.191301 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ded7c800-7add-4c30-b8cd-03ae28430c73 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:56.192096 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ded7c800-7add-4c30-b8cd-03ae28430c73 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 1e05048b-621f-4819-a11a-e0d077f7d563] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:56.201144 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=4 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:16:56.209476 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ded7c800-7add-4c30-b8cd-03ae28430c73 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:56.211556 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ded7c800-7add-4c30-b8cd-03ae28430c73 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:56.212698 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ded7c800-7add-4c30-b8cd-03ae28430c73 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:56.213410 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ded7c800-7add-4c30-b8cd-03ae28430c73 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:56.431013 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ded7c800-7add-4c30-b8cd-03ae28430c73 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:56.477551 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ded7c800-7add-4c30-b8cd-03ae28430c73 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563" status: 200 len: 1498 microversion: 2.1 time: 0.291484 Jun 20 12:16:56.484912 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2052/4203] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:56 2022] GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563 => generated 1498 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:56.506519 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4076ae68-4c3e-4d15-9ed7-60d860dc99a7 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:56.522944 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4076ae68-4c3e-4d15-9ed7-60d860dc99a7 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:56.525359 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4076ae68-4c3e-4d15-9ed7-60d860dc99a7 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '3103ed818db8417b8625af13e7176910'} {{(pid=119127) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:16:56.554117 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4076ae68-4c3e-4d15-9ed7-60d860dc99a7 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:56.556404 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4076ae68-4c3e-4d15-9ed7-60d860dc99a7 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:56.559679 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4076ae68-4c3e-4d15-9ed7-60d860dc99a7 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:56.561225 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4076ae68-4c3e-4d15-9ed7-60d860dc99a7 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:56.772126 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.multi_cell_list [None req-4076ae68-4c3e-4d15-9ed7-60d860dc99a7 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119127) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 12:16:56.864089 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4076ae68-4c3e-4d15-9ed7-60d860dc99a7 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.366936 Jun 20 12:16:56.865403 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2152/4204] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Jun 20 12:16:56 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:16:56.879092 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-609396b4-0c88-4bbd-9118-08c4438d356f tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:16:56.887798 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-609396b4-0c88-4bbd-9118-08c4438d356f tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:56.888909 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-609396b4-0c88-4bbd-9118-08c4438d356f tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:56.921112 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-609396b4-0c88-4bbd-9118-08c4438d356f tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 1e05048b-621f-4819-a11a-e0d077f7d563] Going to try to start instance {{(pid=119128) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 20 12:16:56.987116 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-609396b4-0c88-4bbd-9118-08c4438d356f tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "POST /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563/action" status: 202 len: 0 microversion: 2.1 time: 0.112592 Jun 20 12:16:56.991831 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2053/4205] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:16:56 2022] POST /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:16:57.002477 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a4ebe720-b7c8-4d55-85f1-829bcd6d2502 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:57.003331 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a4ebe720-b7c8-4d55-85f1-829bcd6d2502 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 1e05048b-621f-4819-a11a-e0d077f7d563] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:57.040874 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a4ebe720-b7c8-4d55-85f1-829bcd6d2502 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:57.045005 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a4ebe720-b7c8-4d55-85f1-829bcd6d2502 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:57.046033 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a4ebe720-b7c8-4d55-85f1-829bcd6d2502 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:57.047621 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a4ebe720-b7c8-4d55-85f1-829bcd6d2502 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:57.949635 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a4ebe720-b7c8-4d55-85f1-829bcd6d2502 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:16:57.962935 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a4ebe720-b7c8-4d55-85f1-829bcd6d2502 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563" status: 200 len: 1507 microversion: 2.1 time: 0.968608 Jun 20 12:16:57.963563 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2153/4206] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:56 2022] GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563 => generated 1507 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:58.984142 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ed76f8f7-7b48-447e-9466-78a4f05daf9b tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:58.987419 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ed76f8f7-7b48-447e-9466-78a4f05daf9b tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 1e05048b-621f-4819-a11a-e0d077f7d563] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:16:58.998272 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed76f8f7-7b48-447e-9466-78a4f05daf9b tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:58.999151 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed76f8f7-7b48-447e-9466-78a4f05daf9b tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:59.013110 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed76f8f7-7b48-447e-9466-78a4f05daf9b tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:16:59.014840 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed76f8f7-7b48-447e-9466-78a4f05daf9b tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:16:59.991142 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ed76f8f7-7b48-447e-9466-78a4f05daf9b tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:00.006267 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ed76f8f7-7b48-447e-9466-78a4f05daf9b tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563" status: 200 len: 1507 microversion: 2.1 time: 1.029878 Jun 20 12:17:00.006987 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2054/4207] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:16:58 2022] GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563 => generated 1507 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:01.028298 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-62aa6f6f-e738-48b9-9caa-0c8bcda59a59 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:01.028850 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-62aa6f6f-e738-48b9-9caa-0c8bcda59a59 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 1e05048b-621f-4819-a11a-e0d077f7d563] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:01.039736 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-62aa6f6f-e738-48b9-9caa-0c8bcda59a59 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:01.040195 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-62aa6f6f-e738-48b9-9caa-0c8bcda59a59 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:01.041013 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-62aa6f6f-e738-48b9-9caa-0c8bcda59a59 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:01.041458 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-62aa6f6f-e738-48b9-9caa-0c8bcda59a59 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:01.444066 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-62aa6f6f-e738-48b9-9caa-0c8bcda59a59 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:01.448120 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:17:01.463193 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-62aa6f6f-e738-48b9-9caa-0c8bcda59a59 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563" status: 200 len: 1511 microversion: 2.1 time: 0.441304 Jun 20 12:17:01.465850 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2154/4208] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:01 2022] GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563 => generated 1511 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:01.482989 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-72cb30c8-4697-4147-aa49-53496d62f118 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:01.487355 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-72cb30c8-4697-4147-aa49-53496d62f118 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:01.488018 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.compute.servers [None req-72cb30c8-4697-4147-aa49-53496d62f118 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Removing options 'limit' from query {{(pid=119128) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jun 20 12:17:01.489554 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-72cb30c8-4697-4147-aa49-53496d62f118 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Searching by: {'deleted': False, 'project_id': '3103ed818db8417b8625af13e7176910'} {{(pid=119128) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:17:01.497201 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-72cb30c8-4697-4147-aa49-53496d62f118 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:01.497981 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-72cb30c8-4697-4147-aa49-53496d62f118 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:01.499019 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-72cb30c8-4697-4147-aa49-53496d62f118 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:01.499643 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-72cb30c8-4697-4147-aa49-53496d62f118 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:01.504647 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-72cb30c8-4697-4147-aa49-53496d62f118 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.025719 Jun 20 12:17:01.507490 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2055/4209] 10.222.0.27 () {58 vars in 1139 bytes} [Mon Jun 20 12:17:01 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:17:01.520876 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5f099762-2423-4bbf-be8c-f2f4e79b9792 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:01.521897 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5f099762-2423-4bbf-be8c-f2f4e79b9792 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 1e05048b-621f-4819-a11a-e0d077f7d563] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:01.524116 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=4 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:17:01.548446 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f099762-2423-4bbf-be8c-f2f4e79b9792 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:01.549172 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f099762-2423-4bbf-be8c-f2f4e79b9792 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:01.550178 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f099762-2423-4bbf-be8c-f2f4e79b9792 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:01.553738 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f099762-2423-4bbf-be8c-f2f4e79b9792 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:02.869953 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5f099762-2423-4bbf-be8c-f2f4e79b9792 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:02.884108 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5f099762-2423-4bbf-be8c-f2f4e79b9792 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563" status: 200 len: 1511 microversion: 2.1 time: 1.369557 Jun 20 12:17:02.888673 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2155/4210] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:01 2022] GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563 => generated 1511 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:17:02.910890 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-68f55932-e5c1-4a91-a76a-2f74185f7f36 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:02.915723 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-68f55932-e5c1-4a91-a76a-2f74185f7f36 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:02.940745 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-68f55932-e5c1-4a91-a76a-2f74185f7f36 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:02.944187 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-68f55932-e5c1-4a91-a76a-2f74185f7f36 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:02.945217 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-68f55932-e5c1-4a91-a76a-2f74185f7f36 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:02.946485 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-68f55932-e5c1-4a91-a76a-2f74185f7f36 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:04.707564 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-68f55932-e5c1-4a91-a76a-2f74185f7f36 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:04.718716 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-68f55932-e5c1-4a91-a76a-2f74185f7f36 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81" status: 200 len: 1511 microversion: 2.1 time: 1.815505 Jun 20 12:17:04.725632 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2056/4211] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:02 2022] GET /compute/v2.1/servers/d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81 => generated 1511 bytes in 1823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:04.746040 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e66ea6a5-c381-42a6-91b9-9e6ec74338a0 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:04.748119 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e66ea6a5-c381-42a6-91b9-9e6ec74338a0 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 46c93bae-77c3-4fce-b4c3-bee3526049eb] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:04.788926 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e66ea6a5-c381-42a6-91b9-9e6ec74338a0 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:04.790567 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e66ea6a5-c381-42a6-91b9-9e6ec74338a0 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:04.792430 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e66ea6a5-c381-42a6-91b9-9e6ec74338a0 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:04.794597 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e66ea6a5-c381-42a6-91b9-9e6ec74338a0 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:05.480021 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e66ea6a5-c381-42a6-91b9-9e6ec74338a0 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:05.496120 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e66ea6a5-c381-42a6-91b9-9e6ec74338a0 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/46c93bae-77c3-4fce-b4c3-bee3526049eb" status: 200 len: 1512 microversion: 2.1 time: 0.758908 Jun 20 12:17:05.511850 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2156/4212] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:04 2022] GET /compute/v2.1/servers/46c93bae-77c3-4fce-b4c3-bee3526049eb => generated 1512 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:05.865818 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-944ceb04-a223-4b32-be8b-01459f443406 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1158518769", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "480b91c2-5307-484e-a555-9e3731238292"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:17:05.992552 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-944ceb04-a223-4b32-be8b-01459f443406 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] validate_networks() for [('480b91c2-5307-484e-a555-9e3731238292', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:17:06.151318 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-647fa77e-61c2-4664-9216-34935ac981d5 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1539605313", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "c5d434f6-3486-4ef8-b926-162e24b6122d"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:17:06.301537 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-647fa77e-61c2-4664-9216-34935ac981d5 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] validate_networks() for [('c5d434f6-3486-4ef8-b926-162e24b6122d', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:17:06.665106 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:17:07.497077 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-944ceb04-a223-4b32-be8b-01459f443406 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:17:07.498401 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-944ceb04-a223-4b32-be8b-01459f443406 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:17:07.499327 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-944ceb04-a223-4b32-be8b-01459f443406 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:17:07.499961 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-944ceb04-a223-4b32-be8b-01459f443406 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:17:07.500625 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-944ceb04-a223-4b32-be8b-01459f443406 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:17:07.518559 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-944ceb04-a223-4b32-be8b-01459f443406 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:07.521831 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-944ceb04-a223-4b32-be8b-01459f443406 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:07.529604 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-944ceb04-a223-4b32-be8b-01459f443406 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:07.532871 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-944ceb04-a223-4b32-be8b-01459f443406 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:07.595292 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-944ceb04-a223-4b32-be8b-01459f443406 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Getting quotas for project 1effa9873ec7488da55676c454c4a1b4. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:17:07.612733 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-944ceb04-a223-4b32-be8b-01459f443406 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Getting quotas for user 0049a642be6340e3b36fa6904fed5529 and project 1effa9873ec7488da55676c454c4a1b4. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:17:07.648439 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-944ceb04-a223-4b32-be8b-01459f443406 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:17:07.661440 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-944ceb04-a223-4b32-be8b-01459f443406 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] [instance: 80a28828-0d45-4c10-83e5-eda1a1d9f7ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:17:07.769105 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-944ceb04-a223-4b32-be8b-01459f443406 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.255790 Jun 20 12:17:07.775308 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2157/4213] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:17:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:17:07.787204 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fbd0b91a-edae-494e-9453-fe739d989e60 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:07.797922 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fbd0b91a-edae-494e-9453-fe739d989e60 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:07.818526 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fbd0b91a-edae-494e-9453-fe739d989e60 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Searching by: {'ip': '172.20.0.12', 'deleted': False, 'project_id': '3103ed818db8417b8625af13e7176910'} {{(pid=119127) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:17:08.175606 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fbd0b91a-edae-494e-9453-fe739d989e60 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:08.176236 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fbd0b91a-edae-494e-9453-fe739d989e60 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:08.177942 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fbd0b91a-edae-494e-9453-fe739d989e60 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:08.179085 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fbd0b91a-edae-494e-9453-fe739d989e60 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:08.315605 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.multi_cell_list [None req-fbd0b91a-edae-494e-9453-fe739d989e60 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119127) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 12:17:08.540670 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fbd0b91a-edae-494e-9453-fe739d989e60 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers?ip=172.20.0.12" status: 200 len: 345 microversion: 2.1 time: 0.762004 Jun 20 12:17:08.546588 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2158/4214] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Jun 20 12:17:07 2022] GET /compute/v2.1/servers?ip=172.20.0.12 => generated 345 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:17:08.566995 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-905507e9-5f77-4394-8eb4-e7c6d1e80646 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:08.571269 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-905507e9-5f77-4394-8eb4-e7c6d1e80646 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] [instance: 80a28828-0d45-4c10-83e5-eda1a1d9f7ab] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:09.130280 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-905507e9-5f77-4394-8eb4-e7c6d1e80646 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0049a642be6340e3b36fa6904fed5529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1effa9873ec7488da55676c454c4a1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:09.144405 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-905507e9-5f77-4394-8eb4-e7c6d1e80646 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] 10.222.0.27 "GET /compute/v2.1/servers/80a28828-0d45-4c10-83e5-eda1a1d9f7ab" status: 200 len: 1224 microversion: 2.1 time: 0.593968 Jun 20 12:17:09.162057 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2159/4215] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:08 2022] GET /compute/v2.1/servers/80a28828-0d45-4c10-83e5-eda1a1d9f7ab => generated 1224 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:09.183898 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e26be95c-899a-45a6-833b-c2487cbbc3ff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:09.185628 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e26be95c-899a-45a6-833b-c2487cbbc3ff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:09.204952 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:17:09.210482 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e26be95c-899a-45a6-833b-c2487cbbc3ff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:09.213816 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e26be95c-899a-45a6-833b-c2487cbbc3ff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:09.214756 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e26be95c-899a-45a6-833b-c2487cbbc3ff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:09.216767 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e26be95c-899a-45a6-833b-c2487cbbc3ff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:09.301304 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e26be95c-899a-45a6-833b-c2487cbbc3ff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc/os-volume_attachments/bf058668-5cb2-48d9-abd4-5a66a1ebafd1" status: 200 len: 194 microversion: 2.20 time: 0.136757 Jun 20 12:17:09.303392 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2160/4216] 10.222.0.27 () {60 vars in 1453 bytes} [Mon Jun 20 12:17:09 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc/os-volume_attachments/bf058668-5cb2-48d9-abd4-5a66a1ebafd1 => generated 194 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:17:09.336859 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a8cdd468-8003-4bf6-b74d-ad563c6184cf tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:09.340810 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a8cdd468-8003-4bf6-b74d-ad563c6184cf tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 1e05048b-621f-4819-a11a-e0d077f7d563] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:09.378077 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a8cdd468-8003-4bf6-b74d-ad563c6184cf tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:09.378524 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a8cdd468-8003-4bf6-b74d-ad563c6184cf tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:09.379316 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a8cdd468-8003-4bf6-b74d-ad563c6184cf tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:09.401149 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a8cdd468-8003-4bf6-b74d-ad563c6184cf tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:09.791040 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-647fa77e-61c2-4664-9216-34935ac981d5 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:17:09.791527 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-647fa77e-61c2-4664-9216-34935ac981d5 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:17:09.792064 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-647fa77e-61c2-4664-9216-34935ac981d5 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:17:09.792530 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-647fa77e-61c2-4664-9216-34935ac981d5 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:17:09.793061 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-647fa77e-61c2-4664-9216-34935ac981d5 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:17:09.834345 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-647fa77e-61c2-4664-9216-34935ac981d5 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:09.839024 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-647fa77e-61c2-4664-9216-34935ac981d5 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:09.842346 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-647fa77e-61c2-4664-9216-34935ac981d5 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:09.846874 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-647fa77e-61c2-4664-9216-34935ac981d5 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:09.893394 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:17:09.991833 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-647fa77e-61c2-4664-9216-34935ac981d5 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Getting quotas for project 6a608c15e7f140e3a1d01fabcf6157e7. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:17:10.024842 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-647fa77e-61c2-4664-9216-34935ac981d5 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Getting quotas for user ce8b1b9bbe634eca989007e998c54271 and project 6a608c15e7f140e3a1d01fabcf6157e7. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:17:10.055614 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-647fa77e-61c2-4664-9216-34935ac981d5 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Going to run 3 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:17:10.058998 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-647fa77e-61c2-4664-9216-34935ac981d5 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: f65e72fa-4e88-44c5-bba1-0dc4f78eea47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:17:10.097731 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a8cdd468-8003-4bf6-b74d-ad563c6184cf tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:10.107635 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a8cdd468-8003-4bf6-b74d-ad563c6184cf tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563" status: 200 len: 1511 microversion: 2.1 time: 0.801808 Jun 20 12:17:10.122279 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2161/4217] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:09 2022] GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563 => generated 1511 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:10.134037 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-647fa77e-61c2-4664-9216-34935ac981d5 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: 8c46b7ac-3373-4ff7-8527-f2800b2ba847] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=f65e72fa-4e88-44c5-bba1-0dc4f78eea47,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:17:10.144025 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-df43806b-6d97-41d0-ab91-d89344762776 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:10.145270 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-df43806b-6d97-41d0-ab91-d89344762776 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:10.168114 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df43806b-6d97-41d0-ab91-d89344762776 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:10.170168 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df43806b-6d97-41d0-ab91-d89344762776 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:10.174061 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df43806b-6d97-41d0-ab91-d89344762776 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:10.175111 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df43806b-6d97-41d0-ab91-d89344762776 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:10.251612 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-647fa77e-61c2-4664-9216-34935ac981d5 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: 9dc75474-7e3c-462c-b704-dd6f9e948190] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=8c46b7ac-3373-4ff7-8527-f2800b2ba847,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:17:10.412655 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-647fa77e-61c2-4664-9216-34935ac981d5 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.157986 Jun 20 12:17:10.422163 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2057/4218] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:17:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 5169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 12:17:10.431199 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a9103977-b206-49b9-a4a2-68f559600aac tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:10.434389 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a9103977-b206-49b9-a4a2-68f559600aac tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:10.456669 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a9103977-b206-49b9-a4a2-68f559600aac tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:10.457512 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a9103977-b206-49b9-a4a2-68f559600aac tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:10.460318 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a9103977-b206-49b9-a4a2-68f559600aac tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:10.461341 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a9103977-b206-49b9-a4a2-68f559600aac tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:10.518853 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-df43806b-6d97-41d0-ab91-d89344762776 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lazy-loading 'services' on Instance uuid 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:17:10.722248 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-df43806b-6d97-41d0-ab91-d89344762776 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc/os-volume_attachments/bf058668-5cb2-48d9-abd4-5a66a1ebafd1" status: 202 len: 0 microversion: 2.20 time: 0.596519 Jun 20 12:17:10.741528 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2162/4219] 10.222.0.27 () {60 vars in 1456 bytes} [Mon Jun 20 12:17:10 2022] DELETE /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc/os-volume_attachments/bf058668-5cb2-48d9-abd4-5a66a1ebafd1 => generated 0 bytes in 618 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:17:10.755664 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-411503f2-9162-43cd-87f9-c346b9234919 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:10.757333 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-411503f2-9162-43cd-87f9-c346b9234919 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] [instance: 80a28828-0d45-4c10-83e5-eda1a1d9f7ab] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:10.769546 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-411503f2-9162-43cd-87f9-c346b9234919 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:10.771485 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-411503f2-9162-43cd-87f9-c346b9234919 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:10.772805 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-411503f2-9162-43cd-87f9-c346b9234919 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:10.773681 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-411503f2-9162-43cd-87f9-c346b9234919 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:10.987747 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-411503f2-9162-43cd-87f9-c346b9234919 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0049a642be6340e3b36fa6904fed5529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1effa9873ec7488da55676c454c4a1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:11.014466 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-411503f2-9162-43cd-87f9-c346b9234919 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] 10.222.0.27 "GET /compute/v2.1/servers/80a28828-0d45-4c10-83e5-eda1a1d9f7ab" status: 200 len: 1282 microversion: 2.1 time: 0.268538 Jun 20 12:17:11.015258 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2163/4220] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:10 2022] GET /compute/v2.1/servers/80a28828-0d45-4c10-83e5-eda1a1d9f7ab => generated 1282 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:11.031087 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-64c77e2c-e1ab-413d-86b3-520e90e14a53 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:11.038690 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-64c77e2c-e1ab-413d-86b3-520e90e14a53 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ce8b1b9bbe634eca989007e998c54271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:11.040070 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-64c77e2c-e1ab-413d-86b3-520e90e14a53 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Searching by: {'deleted': False, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7'} {{(pid=119127) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:17:11.133538 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-64c77e2c-e1ab-413d-86b3-520e90e14a53 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:11.136137 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-64c77e2c-e1ab-413d-86b3-520e90e14a53 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:11.152183 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-64c77e2c-e1ab-413d-86b3-520e90e14a53 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:11.152701 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-64c77e2c-e1ab-413d-86b3-520e90e14a53 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:11.203739 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-64c77e2c-e1ab-413d-86b3-520e90e14a53 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.187263 Jun 20 12:17:11.204602 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2164/4221] 10.222.0.27 () {58 vars in 1124 bytes} [Mon Jun 20 12:17:11 2022] GET /compute/v2.1/servers => generated 1018 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:11.211587 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b477793b-fb31-4506-bbc0-60349ff5c352 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:11.213482 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b477793b-fb31-4506-bbc0-60349ff5c352 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:11.221190 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b477793b-fb31-4506-bbc0-60349ff5c352 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:11.221912 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b477793b-fb31-4506-bbc0-60349ff5c352 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:11.222857 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b477793b-fb31-4506-bbc0-60349ff5c352 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:11.223435 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b477793b-fb31-4506-bbc0-60349ff5c352 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:11.318410 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b477793b-fb31-4506-bbc0-60349ff5c352 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.112181 Jun 20 12:17:11.322620 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2165/4222] 10.222.0.27 () {60 vars in 1342 bytes} [Mon Jun 20 12:17:11 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:17:11.336464 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fe44f305-2c89-4529-9fd0-bb7ed306672d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-140548505", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "5b228717-b654-47c3-97f7-8cfa10a6f1e8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-722062693", "security_groups": [{"name": "tempest-secgroup-smoke-1600550166"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:17:11.519364 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a9103977-b206-49b9-a4a2-68f559600aac tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:11.548814 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a9103977-b206-49b9-a4a2-68f559600aac tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81" status: 200 len: 1511 microversion: 2.1 time: 1.125048 Jun 20 12:17:11.554926 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2058/4223] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:10 2022] GET /compute/v2.1/servers/d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81 => generated 1511 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:11.581613 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f4484e7a-b20f-48a5-825e-51b3b06ebe62 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:11.582192 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f4484e7a-b20f-48a5-825e-51b3b06ebe62 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: 9dc75474-7e3c-462c-b704-dd6f9e948190] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:11.583105 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-fe44f305-2c89-4529-9fd0-bb7ed306672d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] validate_networks() for [('5b228717-b654-47c3-97f7-8cfa10a6f1e8', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:17:11.952233 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f4484e7a-b20f-48a5-825e-51b3b06ebe62 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b1b9bbe634eca989007e998c54271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:11.962910 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f4484e7a-b20f-48a5-825e-51b3b06ebe62 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190" status: 200 len: 1223 microversion: 2.1 time: 0.403083 Jun 20 12:17:11.975144 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2059/4224] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:11 2022] GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190 => generated 1223 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:12.007352 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bfa5a7be-c0c0-44bf-8bc7-4d58aea156a8 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:12.008328 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bfa5a7be-c0c0-44bf-8bc7-4d58aea156a8 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 46c93bae-77c3-4fce-b4c3-bee3526049eb] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:12.050628 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bfa5a7be-c0c0-44bf-8bc7-4d58aea156a8 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:12.051155 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bfa5a7be-c0c0-44bf-8bc7-4d58aea156a8 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:12.053514 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bfa5a7be-c0c0-44bf-8bc7-4d58aea156a8 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:12.053997 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bfa5a7be-c0c0-44bf-8bc7-4d58aea156a8 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:13.180317 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-fe44f305-2c89-4529-9fd0-bb7ed306672d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:17:13.182167 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-fe44f305-2c89-4529-9fd0-bb7ed306672d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:17:13.183011 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-fe44f305-2c89-4529-9fd0-bb7ed306672d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:17:13.184037 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-fe44f305-2c89-4529-9fd0-bb7ed306672d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:17:13.185665 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-fe44f305-2c89-4529-9fd0-bb7ed306672d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:17:13.207945 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fe44f305-2c89-4529-9fd0-bb7ed306672d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:13.209491 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fe44f305-2c89-4529-9fd0-bb7ed306672d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:13.210591 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fe44f305-2c89-4529-9fd0-bb7ed306672d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:13.211276 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fe44f305-2c89-4529-9fd0-bb7ed306672d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:13.245628 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-fe44f305-2c89-4529-9fd0-bb7ed306672d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Getting quotas for project 9e9e481852fe4e6ebdc15ec343a741f2. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:17:13.261680 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-fe44f305-2c89-4529-9fd0-bb7ed306672d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Getting quotas for user cd27c8696f7147e18054b26ebbae7045 and project 9e9e481852fe4e6ebdc15ec343a741f2. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:17:13.323939 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fe44f305-2c89-4529-9fd0-bb7ed306672d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:17:13.350601 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fe44f305-2c89-4529-9fd0-bb7ed306672d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:17:13.475064 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fe44f305-2c89-4529-9fd0-bb7ed306672d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.146743 Jun 20 12:17:13.475748 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2166/4225] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:17:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 2156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:17:13.491120 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f5e6b90b-4cc4-478e-8c9d-93dde9bba3ae tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:13.491743 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f5e6b90b-4cc4-478e-8c9d-93dde9bba3ae tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] [instance: 80a28828-0d45-4c10-83e5-eda1a1d9f7ab] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:13.505583 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5e6b90b-4cc4-478e-8c9d-93dde9bba3ae tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:13.506045 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5e6b90b-4cc4-478e-8c9d-93dde9bba3ae tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:13.511386 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5e6b90b-4cc4-478e-8c9d-93dde9bba3ae tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:13.512085 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5e6b90b-4cc4-478e-8c9d-93dde9bba3ae tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:13.617990 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-bfa5a7be-c0c0-44bf-8bc7-4d58aea156a8 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:13.640266 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bfa5a7be-c0c0-44bf-8bc7-4d58aea156a8 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/46c93bae-77c3-4fce-b4c3-bee3526049eb" status: 200 len: 1512 microversion: 2.1 time: 1.653737 Jun 20 12:17:13.649209 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2060/4226] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:11 2022] GET /compute/v2.1/servers/46c93bae-77c3-4fce-b4c3-bee3526049eb => generated 1512 bytes in 1655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:13.676724 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bf7c3f08-7223-430b-a66b-efb3242dfc4b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:13.680563 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bf7c3f08-7223-430b-a66b-efb3242dfc4b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:13.729796 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bf7c3f08-7223-430b-a66b-efb3242dfc4b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:13.730326 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bf7c3f08-7223-430b-a66b-efb3242dfc4b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:13.738793 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bf7c3f08-7223-430b-a66b-efb3242dfc4b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:13.739266 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bf7c3f08-7223-430b-a66b-efb3242dfc4b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:14.027064 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f5e6b90b-4cc4-478e-8c9d-93dde9bba3ae tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0049a642be6340e3b36fa6904fed5529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1effa9873ec7488da55676c454c4a1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:14.029336 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bf7c3f08-7223-430b-a66b-efb3242dfc4b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.375973 Jun 20 12:17:14.040763 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2061/4227] 10.222.0.27 () {60 vars in 1342 bytes} [Mon Jun 20 12:17:13 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc/os-volume_attachments => generated 197 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:17:14.050746 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f5e6b90b-4cc4-478e-8c9d-93dde9bba3ae tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] 10.222.0.27 "GET /compute/v2.1/servers/80a28828-0d45-4c10-83e5-eda1a1d9f7ab" status: 200 len: 1324 microversion: 2.1 time: 0.570698 Jun 20 12:17:14.054475 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2167/4228] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:13 2022] GET /compute/v2.1/servers/80a28828-0d45-4c10-83e5-eda1a1d9f7ab => generated 1324 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:14.063128 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-aca128e3-001c-479c-a2a6-309b9c9948ff tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:14.070099 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-aca128e3-001c-479c-a2a6-309b9c9948ff tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:14.095624 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-74177942-4a34-422b-b160-88ddc8226bbb tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:14.102786 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-74177942-4a34-422b-b160-88ddc8226bbb tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: 9dc75474-7e3c-462c-b704-dd6f9e948190] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:14.139487 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-74177942-4a34-422b-b160-88ddc8226bbb tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:14.139944 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-74177942-4a34-422b-b160-88ddc8226bbb tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:14.140773 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-74177942-4a34-422b-b160-88ddc8226bbb tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:14.153123 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-74177942-4a34-422b-b160-88ddc8226bbb tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:14.238252 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-aca128e3-001c-479c-a2a6-309b9c9948ff tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:14.247074 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-aca128e3-001c-479c-a2a6-309b9c9948ff tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1265 microversion: 2.1 time: 0.190333 Jun 20 12:17:14.251106 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2168/4229] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:14 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:14.284790 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-85c1ec5e-6f68-4f73-8a22-452d1a48d18c tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:14.304316 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-85c1ec5e-6f68-4f73-8a22-452d1a48d18c tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:14.307019 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-85c1ec5e-6f68-4f73-8a22-452d1a48d18c tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Searching by: {'deleted': False, 'project_id': '3103ed818db8417b8625af13e7176910'} {{(pid=119127) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:17:14.323206 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-85c1ec5e-6f68-4f73-8a22-452d1a48d18c tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:14.341314 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-85c1ec5e-6f68-4f73-8a22-452d1a48d18c tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:14.342457 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-85c1ec5e-6f68-4f73-8a22-452d1a48d18c tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:14.362153 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-85c1ec5e-6f68-4f73-8a22-452d1a48d18c tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:14.504022 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.multi_cell_list [None req-85c1ec5e-6f68-4f73-8a22-452d1a48d18c tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119127) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 12:17:14.748101 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-85c1ec5e-6f68-4f73-8a22-452d1a48d18c tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:14.781706 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-74177942-4a34-422b-b160-88ddc8226bbb tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b1b9bbe634eca989007e998c54271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:14.785273 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-85c1ec5e-6f68-4f73-8a22-452d1a48d18c tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:14.797839 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-85c1ec5e-6f68-4f73-8a22-452d1a48d18c tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:14.815700 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-74177942-4a34-422b-b160-88ddc8226bbb tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190" status: 200 len: 1275 microversion: 2.1 time: 0.770187 Jun 20 12:17:14.819522 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2062/4230] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:14 2022] GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190 => generated 1275 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:15.053869 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9050c2bf-db49-46e6-b516-97ec6219cd69 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:15.055384 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9050c2bf-db49-46e6-b516-97ec6219cd69 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:15.095893 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9050c2bf-db49-46e6-b516-97ec6219cd69 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:15.101242 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9050c2bf-db49-46e6-b516-97ec6219cd69 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:15.105154 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9050c2bf-db49-46e6-b516-97ec6219cd69 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:15.107718 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9050c2bf-db49-46e6-b516-97ec6219cd69 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:15.271183 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9050c2bf-db49-46e6-b516-97ec6219cd69 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.221332 Jun 20 12:17:15.276283 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2063/4231] 10.222.0.27 () {60 vars in 1342 bytes} [Mon Jun 20 12:17:15 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc/os-volume_attachments => generated 197 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:17:15.304815 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-20b01b66-5c8a-4fde-9038-48d8dc204bf2 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:15.311926 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-20b01b66-5c8a-4fde-9038-48d8dc204bf2 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] [instance: 80a28828-0d45-4c10-83e5-eda1a1d9f7ab] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:15.341823 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-20b01b66-5c8a-4fde-9038-48d8dc204bf2 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:15.347032 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-20b01b66-5c8a-4fde-9038-48d8dc204bf2 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:15.351576 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-20b01b66-5c8a-4fde-9038-48d8dc204bf2 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:15.352416 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-20b01b66-5c8a-4fde-9038-48d8dc204bf2 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:16.247737 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-20b01b66-5c8a-4fde-9038-48d8dc204bf2 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0049a642be6340e3b36fa6904fed5529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1effa9873ec7488da55676c454c4a1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:16.259581 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-20b01b66-5c8a-4fde-9038-48d8dc204bf2 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] 10.222.0.27 "GET /compute/v2.1/servers/80a28828-0d45-4c10-83e5-eda1a1d9f7ab" status: 200 len: 1324 microversion: 2.1 time: 0.979473 Jun 20 12:17:16.275063 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2064/4232] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:15 2022] GET /compute/v2.1/servers/80a28828-0d45-4c10-83e5-eda1a1d9f7ab => generated 1324 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:16.288166 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a1866af1-8ed2-4680-997d-595606a09870 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:16.288863 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a1866af1-8ed2-4680-997d-595606a09870 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:16.309162 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a1866af1-8ed2-4680-997d-595606a09870 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:16.311856 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a1866af1-8ed2-4680-997d-595606a09870 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:16.321209 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a1866af1-8ed2-4680-997d-595606a09870 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:16.322701 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a1866af1-8ed2-4680-997d-595606a09870 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:16.951512 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-85c1ec5e-6f68-4f73-8a22-452d1a48d18c tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 4517 microversion: 2.1 time: 2.698471 Jun 20 12:17:16.969009 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2169/4233] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 12:17:14 2022] GET /compute/v2.1/servers/detail => generated 4517 bytes in 2717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:16.974298 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-be2f22ea-127f-4e48-b0a0-f394151dbf04 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:16.981642 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-be2f22ea-127f-4e48-b0a0-f394151dbf04 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8919a400a671422593e94e0390c3d949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe714415c9e4c9b8cd739c5a9b1c8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:16.982623 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-be2f22ea-127f-4e48-b0a0-f394151dbf04 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Searching by: {'deleted': False, 'project_id': 'bfe714415c9e4c9b8cd739c5a9b1c8b7'} {{(pid=119127) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:17:17.015252 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-be2f22ea-127f-4e48-b0a0-f394151dbf04 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:17.016663 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-be2f22ea-127f-4e48-b0a0-f394151dbf04 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:17.019836 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-be2f22ea-127f-4e48-b0a0-f394151dbf04 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:17.021423 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-be2f22ea-127f-4e48-b0a0-f394151dbf04 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:17.101853 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.multi_cell_list [None req-be2f22ea-127f-4e48-b0a0-f394151dbf04 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119127) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 12:17:17.131633 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a1866af1-8ed2-4680-997d-595606a09870 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:17.145193 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a1866af1-8ed2-4680-997d-595606a09870 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1317 microversion: 2.1 time: 0.868367 Jun 20 12:17:17.145911 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2065/4234] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:16 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1317 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:17.165668 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-946170b1-ed62-45c6-a6b9-48f7791935d0 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:17.166315 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-946170b1-ed62-45c6-a6b9-48f7791935d0 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: 9dc75474-7e3c-462c-b704-dd6f9e948190] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:17.181564 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-946170b1-ed62-45c6-a6b9-48f7791935d0 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:17.189297 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-946170b1-ed62-45c6-a6b9-48f7791935d0 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:17.190554 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-946170b1-ed62-45c6-a6b9-48f7791935d0 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:17.191173 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-946170b1-ed62-45c6-a6b9-48f7791935d0 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:17.193741 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-be2f22ea-127f-4e48-b0a0-f394151dbf04 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.219308 Jun 20 12:17:17.196852 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2170/4235] 10.222.0.27 () {58 vars in 1124 bytes} [Mon Jun 20 12:17:16 2022] GET /compute/v2.1/servers => generated 344 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:17:17.217012 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a3e796e5-9fd3-419b-a0e6-764e939685e6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:17.225147 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a3e796e5-9fd3-419b-a0e6-764e939685e6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:17.243024 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a3e796e5-9fd3-419b-a0e6-764e939685e6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:17.243990 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a3e796e5-9fd3-419b-a0e6-764e939685e6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:17.245851 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a3e796e5-9fd3-419b-a0e6-764e939685e6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:17.246710 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a3e796e5-9fd3-419b-a0e6-764e939685e6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:17.324701 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a3e796e5-9fd3-419b-a0e6-764e939685e6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.126633 Jun 20 12:17:17.325719 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2171/4236] 10.222.0.27 () {60 vars in 1342 bytes} [Mon Jun 20 12:17:17 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:17:17.349084 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d5a4055e-e4f9-4636-ba4b-10157a4bed9d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:17.370655 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d5a4055e-e4f9-4636-ba4b-10157a4bed9d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:17.371914 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d5a4055e-e4f9-4636-ba4b-10157a4bed9d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '3103ed818db8417b8625af13e7176910'} {{(pid=119127) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:17:17.840187 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d5a4055e-e4f9-4636-ba4b-10157a4bed9d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:17.840906 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d5a4055e-e4f9-4636-ba4b-10157a4bed9d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:17.841855 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d5a4055e-e4f9-4636-ba4b-10157a4bed9d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:17.843941 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d5a4055e-e4f9-4636-ba4b-10157a4bed9d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:17.910416 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.multi_cell_list [None req-d5a4055e-e4f9-4636-ba4b-10157a4bed9d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119127) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 12:17:17.975020 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d5a4055e-e4f9-4636-ba4b-10157a4bed9d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1009 microversion: 2.1 time: 0.647733 Jun 20 12:17:17.975714 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2172/4237] 10.222.0.27 () {58 vars in 1149 bytes} [Mon Jun 20 12:17:17 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1009 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:17.993246 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-286dedc0-bac0-4ea5-93e6-346ba016b364 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:18.010951 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-286dedc0-bac0-4ea5-93e6-346ba016b364 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8919a400a671422593e94e0390c3d949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe714415c9e4c9b8cd739c5a9b1c8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:18.011709 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-286dedc0-bac0-4ea5-93e6-346ba016b364 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Searching by: {'deleted': False, 'project_id': 'bfe714415c9e4c9b8cd739c5a9b1c8b7'} {{(pid=119127) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:17:18.024091 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-286dedc0-bac0-4ea5-93e6-346ba016b364 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:18.027672 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-286dedc0-bac0-4ea5-93e6-346ba016b364 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:18.028873 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-286dedc0-bac0-4ea5-93e6-346ba016b364 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:18.029484 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-286dedc0-bac0-4ea5-93e6-346ba016b364 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:18.064783 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:17:18.067959 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.multi_cell_list [None req-286dedc0-bac0-4ea5-93e6-346ba016b364 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119127) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 12:17:18.112977 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-286dedc0-bac0-4ea5-93e6-346ba016b364 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8919a400a671422593e94e0390c3d949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe714415c9e4c9b8cd739c5a9b1c8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:18.122171 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-286dedc0-bac0-4ea5-93e6-346ba016b364 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:18.122858 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-286dedc0-bac0-4ea5-93e6-346ba016b364 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:18.202800 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-946170b1-ed62-45c6-a6b9-48f7791935d0 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b1b9bbe634eca989007e998c54271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:18.216380 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-946170b1-ed62-45c6-a6b9-48f7791935d0 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190" status: 200 len: 1281 microversion: 2.1 time: 1.062395 Jun 20 12:17:18.217948 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2066/4238] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:17 2022] GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190 => generated 1281 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:18.235664 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cfedcfff-8de7-48a6-9617-ae60b440df5c tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:18.238062 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cfedcfff-8de7-48a6-9617-ae60b440df5c tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] [instance: 80a28828-0d45-4c10-83e5-eda1a1d9f7ab] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:18.271301 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cfedcfff-8de7-48a6-9617-ae60b440df5c tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:18.271890 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cfedcfff-8de7-48a6-9617-ae60b440df5c tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:18.272774 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cfedcfff-8de7-48a6-9617-ae60b440df5c tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:18.275413 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cfedcfff-8de7-48a6-9617-ae60b440df5c tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:18.553619 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-286dedc0-bac0-4ea5-93e6-346ba016b364 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.564319 Jun 20 12:17:18.554724 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2173/4239] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 12:17:17 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:18.576290 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d051ce5c-9ef3-4d07-844b-bedb97d30a7d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:18.583026 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d051ce5c-9ef3-4d07-844b-bedb97d30a7d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:18.589523 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d051ce5c-9ef3-4d07-844b-bedb97d30a7d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '3103ed818db8417b8625af13e7176910'} {{(pid=119127) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:17:18.604823 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d051ce5c-9ef3-4d07-844b-bedb97d30a7d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:18.605554 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d051ce5c-9ef3-4d07-844b-bedb97d30a7d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:18.606567 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d051ce5c-9ef3-4d07-844b-bedb97d30a7d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:18.607203 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d051ce5c-9ef3-4d07-844b-bedb97d30a7d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:18.800182 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.multi_cell_list [None req-d051ce5c-9ef3-4d07-844b-bedb97d30a7d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119127) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 12:17:18.964874 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d051ce5c-9ef3-4d07-844b-bedb97d30a7d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1009 microversion: 2.1 time: 0.393049 Jun 20 12:17:18.976697 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2174/4240] 10.222.0.27 () {58 vars in 1211 bytes} [Mon Jun 20 12:17:18 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1009 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:18.987045 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9fe60a32-46d6-47f5-b552-5f1de8649d87 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:18.988756 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9fe60a32-46d6-47f5-b552-5f1de8649d87 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:19.005266 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9fe60a32-46d6-47f5-b552-5f1de8649d87 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:19.006180 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9fe60a32-46d6-47f5-b552-5f1de8649d87 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:19.007288 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9fe60a32-46d6-47f5-b552-5f1de8649d87 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:19.008050 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9fe60a32-46d6-47f5-b552-5f1de8649d87 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:19.243052 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-cfedcfff-8de7-48a6-9617-ae60b440df5c tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0049a642be6340e3b36fa6904fed5529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1effa9873ec7488da55676c454c4a1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:19.258716 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cfedcfff-8de7-48a6-9617-ae60b440df5c tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] 10.222.0.27 "GET /compute/v2.1/servers/80a28828-0d45-4c10-83e5-eda1a1d9f7ab" status: 200 len: 1324 microversion: 2.1 time: 1.032612 Jun 20 12:17:19.260525 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2067/4241] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:18 2022] GET /compute/v2.1/servers/80a28828-0d45-4c10-83e5-eda1a1d9f7ab => generated 1324 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:19.283870 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9fe60a32-46d6-47f5-b552-5f1de8649d87 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:19.295234 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-936297ce-a818-4698-9d78-460a85e00e42 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:19.297217 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9fe60a32-46d6-47f5-b552-5f1de8649d87 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1323 microversion: 2.1 time: 0.317772 Jun 20 12:17:19.299182 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-936297ce-a818-4698-9d78-460a85e00e42 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:19.316907 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2175/4242] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:18 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1323 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:19.325490 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-936297ce-a818-4698-9d78-460a85e00e42 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:19.325763 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-335e7819-e0eb-47d1-80d6-e36466fbcf6c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:19.327362 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-936297ce-a818-4698-9d78-460a85e00e42 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:19.329700 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-936297ce-a818-4698-9d78-460a85e00e42 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:19.330368 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-936297ce-a818-4698-9d78-460a85e00e42 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:19.338347 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-335e7819-e0eb-47d1-80d6-e36466fbcf6c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018930 Jun 20 12:17:19.339616 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2176/4243] 10.222.0.27 () {58 vars in 1136 bytes} [Mon Jun 20 12:17:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:17:19.348044 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dd1a4886-248a-470e-b9e1-768ab83411a9 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:19.354005 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dd1a4886-248a-470e-b9e1-768ab83411a9 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:19.358474 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dd1a4886-248a-470e-b9e1-768ab83411a9 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '3103ed818db8417b8625af13e7176910'} {{(pid=119127) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:17:19.374764 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd1a4886-248a-470e-b9e1-768ab83411a9 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:19.379126 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd1a4886-248a-470e-b9e1-768ab83411a9 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:19.385443 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd1a4886-248a-470e-b9e1-768ab83411a9 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:19.386806 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd1a4886-248a-470e-b9e1-768ab83411a9 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:19.432080 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-936297ce-a818-4698-9d78-460a85e00e42 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.169816 Jun 20 12:17:19.436262 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2068/4244] 10.222.0.27 () {60 vars in 1342 bytes} [Mon Jun 20 12:17:19 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc/os-volume_attachments => generated 197 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:17:19.452102 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1c0d2cd3-74d3-4884-8893-bba506720d89 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:19.452829 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1c0d2cd3-74d3-4884-8893-bba506720d89 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: 9dc75474-7e3c-462c-b704-dd6f9e948190] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:19.468576 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1c0d2cd3-74d3-4884-8893-bba506720d89 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:19.470927 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1c0d2cd3-74d3-4884-8893-bba506720d89 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:19.478014 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1c0d2cd3-74d3-4884-8893-bba506720d89 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:19.478500 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1c0d2cd3-74d3-4884-8893-bba506720d89 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:19.685954 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.multi_cell_list [None req-dd1a4886-248a-470e-b9e1-768ab83411a9 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119127) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 12:17:19.850988 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dd1a4886-248a-470e-b9e1-768ab83411a9 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1009 microversion: 2.1 time: 0.509706 Jun 20 12:17:19.852299 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2177/4245] 10.222.0.27 () {58 vars in 1195 bytes} [Mon Jun 20 12:17:19 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1009 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:19.862210 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-52dfe11d-03e6-400e-81cd-db41b3e83547 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:19.865616 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-52dfe11d-03e6-400e-81cd-db41b3e83547 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] [instance: ce950356-da51-4847-96ba-76f575f7d9ab] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:19.885315 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52dfe11d-03e6-400e-81cd-db41b3e83547 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:19.886655 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52dfe11d-03e6-400e-81cd-db41b3e83547 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:19.887729 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52dfe11d-03e6-400e-81cd-db41b3e83547 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:19.888434 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52dfe11d-03e6-400e-81cd-db41b3e83547 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:19.892683 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:17:20.009659 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-52dfe11d-03e6-400e-81cd-db41b3e83547 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] [instance: ce950356-da51-4847-96ba-76f575f7d9ab] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:17:20.229661 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-52dfe11d-03e6-400e-81cd-db41b3e83547 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab" status: 204 len: 0 microversion: 2.1 time: 0.375290 Jun 20 12:17:20.232102 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2178/4246] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:17:19 2022] DELETE /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:17:20.245708 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-28c10f90-bde9-49e7-bb5f-5d7bf7c1cc01 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:20.269376 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-28c10f90-bde9-49e7-bb5f-5d7bf7c1cc01 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:20.272767 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-28c10f90-bde9-49e7-bb5f-5d7bf7c1cc01 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Searching by: {'name': '-723687177', 'deleted': False, 'project_id': '3103ed818db8417b8625af13e7176910'} {{(pid=119127) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:17:20.289993 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28c10f90-bde9-49e7-bb5f-5d7bf7c1cc01 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:20.290939 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28c10f90-bde9-49e7-bb5f-5d7bf7c1cc01 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:20.292051 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28c10f90-bde9-49e7-bb5f-5d7bf7c1cc01 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:20.297416 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28c10f90-bde9-49e7-bb5f-5d7bf7c1cc01 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:20.472943 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.multi_cell_list [None req-28c10f90-bde9-49e7-bb5f-5d7bf7c1cc01 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119127) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 12:17:20.481941 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1c0d2cd3-74d3-4884-8893-bba506720d89 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b1b9bbe634eca989007e998c54271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:20.503448 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1c0d2cd3-74d3-4884-8893-bba506720d89 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190" status: 200 len: 1281 microversion: 2.1 time: 1.053161 Jun 20 12:17:20.515337 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2069/4247] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:19 2022] GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190 => generated 1281 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:20.521786 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-940987dc-2292-4aab-a4af-12cbde5b0340 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:20.522454 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-940987dc-2292-4aab-a4af-12cbde5b0340 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] [instance: ce950356-da51-4847-96ba-76f575f7d9ab] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:20.530576 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-940987dc-2292-4aab-a4af-12cbde5b0340 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:20.531044 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-940987dc-2292-4aab-a4af-12cbde5b0340 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:20.534424 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-940987dc-2292-4aab-a4af-12cbde5b0340 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:20.534934 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-940987dc-2292-4aab-a4af-12cbde5b0340 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:20.609322 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-28c10f90-bde9-49e7-bb5f-5d7bf7c1cc01 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers?name=-723687177" status: 200 len: 345 microversion: 2.1 time: 0.375795 Jun 20 12:17:20.610286 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2179/4248] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Jun 20 12:17:20 2022] GET /compute/v2.1/servers?name=-723687177 => generated 345 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:17:20.619314 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5e2b3867-6fb1-4b90-9479-ea074766595b tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:20.620316 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5e2b3867-6fb1-4b90-9479-ea074766595b tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] [instance: 80a28828-0d45-4c10-83e5-eda1a1d9f7ab] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:20.628028 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5e2b3867-6fb1-4b90-9479-ea074766595b tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:20.629159 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5e2b3867-6fb1-4b90-9479-ea074766595b tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:20.631866 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5e2b3867-6fb1-4b90-9479-ea074766595b tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:20.633081 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5e2b3867-6fb1-4b90-9479-ea074766595b tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:20.870169 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5e2b3867-6fb1-4b90-9479-ea074766595b tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0049a642be6340e3b36fa6904fed5529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1effa9873ec7488da55676c454c4a1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:20.890844 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5e2b3867-6fb1-4b90-9479-ea074766595b tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] 10.222.0.27 "GET /compute/v2.1/servers/80a28828-0d45-4c10-83e5-eda1a1d9f7ab" status: 200 len: 1324 microversion: 2.1 time: 0.279203 Jun 20 12:17:20.891452 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2180/4249] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:20 2022] GET /compute/v2.1/servers/80a28828-0d45-4c10-83e5-eda1a1d9f7ab => generated 1324 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:20.934527 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f67147dd-125d-4683-9313-0a4902c908e1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:20.935823 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f67147dd-125d-4683-9313-0a4902c908e1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:20.953128 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f67147dd-125d-4683-9313-0a4902c908e1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:20.953281 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f67147dd-125d-4683-9313-0a4902c908e1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:20.954411 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f67147dd-125d-4683-9313-0a4902c908e1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:20.954850 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f67147dd-125d-4683-9313-0a4902c908e1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:21.133186 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f67147dd-125d-4683-9313-0a4902c908e1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:21.142634 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f67147dd-125d-4683-9313-0a4902c908e1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1323 microversion: 2.1 time: 0.250077 Jun 20 12:17:21.143366 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2181/4250] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:20 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1323 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:21.161442 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-17560069-05b9-4dfc-9395-1270b07ee16e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:21.162711 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-17560069-05b9-4dfc-9395-1270b07ee16e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:21.178709 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-940987dc-2292-4aab-a4af-12cbde5b0340 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8919a400a671422593e94e0390c3d949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe714415c9e4c9b8cd739c5a9b1c8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:21.180115 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17560069-05b9-4dfc-9395-1270b07ee16e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:21.181726 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17560069-05b9-4dfc-9395-1270b07ee16e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:21.184638 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17560069-05b9-4dfc-9395-1270b07ee16e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:21.187151 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17560069-05b9-4dfc-9395-1270b07ee16e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:21.191492 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-940987dc-2292-4aab-a4af-12cbde5b0340 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] 10.222.0.27 "GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab" status: 200 len: 1608 microversion: 2.1 time: 0.674884 Jun 20 12:17:21.194887 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2070/4251] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:20 2022] GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab => generated 1608 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:21.210147 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-a5b4c201-e9c9-4792-a00e-cedce3a5bbd8 req-c551991b-5417-4112-8a5d-89df5f66e25a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f65e72fa-4e88-44c5-bba1-0dc4f78eea47", "tag": "552383e8-2c45-49dc-8d09-3a702564f66d"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:17:21.231827 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-a5b4c201-e9c9-4792-a00e-cedce3a5bbd8 req-c551991b-5417-4112-8a5d-89df5f66e25a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:21.241664 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-a5b4c201-e9c9-4792-a00e-cedce3a5bbd8 req-c551991b-5417-4112-8a5d-89df5f66e25a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:21.277487 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-a5b4c201-e9c9-4792-a00e-cedce3a5bbd8 req-c551991b-5417-4112-8a5d-89df5f66e25a service nova] Creating event network-changed:552383e8-2c45-49dc-8d09-3a702564f66d for instance f65e72fa-4e88-44c5-bba1-0dc4f78eea47 on n-h2-master-1 Jun 20 12:17:21.278659 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-17560069-05b9-4dfc-9395-1270b07ee16e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.130578 Jun 20 12:17:21.279290 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2182/4252] 10.222.0.27 () {60 vars in 1342 bytes} [Mon Jun 20 12:17:21 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:17:21.286742 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9ca46344-862d-4ff3-93e5-ecd35b083b3a tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:21.298175 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9ca46344-862d-4ff3-93e5-ecd35b083b3a tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:21.298432 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-a5b4c201-e9c9-4792-a00e-cedce3a5bbd8 req-c551991b-5417-4112-8a5d-89df5f66e25a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102248 Jun 20 12:17:21.298862 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9ca46344-862d-4ff3-93e5-ecd35b083b3a tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '3103ed818db8417b8625af13e7176910'} {{(pid=119127) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:17:21.299339 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2071/4253] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:17:21.333153 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ca46344-862d-4ff3-93e5-ecd35b083b3a tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:21.333635 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ca46344-862d-4ff3-93e5-ecd35b083b3a tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:21.334811 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ca46344-862d-4ff3-93e5-ecd35b083b3a tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:21.335067 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ca46344-862d-4ff3-93e5-ecd35b083b3a tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:21.545618 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.multi_cell_list [None req-9ca46344-862d-4ff3-93e5-ecd35b083b3a tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119127) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 12:17:21.698071 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9ca46344-862d-4ff3-93e5-ecd35b083b3a tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1009 microversion: 2.1 time: 0.417427 Jun 20 12:17:21.699435 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2183/4254] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Jun 20 12:17:21 2022] GET /compute/v2.1/servers?name=-instance => generated 1009 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:21.705424 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a6770c6b-05cd-47e5-a552-daac0ccfd2a4 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:21.706249 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a6770c6b-05cd-47e5-a552-daac0ccfd2a4 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: 9dc75474-7e3c-462c-b704-dd6f9e948190] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:21.711891 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-84c22768-ba52-4831-9c77-a7f4773a14db req-b9654777-c074-46b8-8028-1b308b27759c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80a28828-0d45-4c10-83e5-eda1a1d9f7ab", "tag": "d92b40d4-dda8-47a7-9ec9-22b1ff972d6d"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:17:21.717025 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a6770c6b-05cd-47e5-a552-daac0ccfd2a4 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:21.720922 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a6770c6b-05cd-47e5-a552-daac0ccfd2a4 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:21.722031 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a6770c6b-05cd-47e5-a552-daac0ccfd2a4 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:21.722694 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a6770c6b-05cd-47e5-a552-daac0ccfd2a4 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:21.737723 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-84c22768-ba52-4831-9c77-a7f4773a14db req-b9654777-c074-46b8-8028-1b308b27759c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:21.737723 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-84c22768-ba52-4831-9c77-a7f4773a14db req-b9654777-c074-46b8-8028-1b308b27759c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:21.767536 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-84c22768-ba52-4831-9c77-a7f4773a14db req-b9654777-c074-46b8-8028-1b308b27759c service nova] Creating event network-changed:d92b40d4-dda8-47a7-9ec9-22b1ff972d6d for instance 80a28828-0d45-4c10-83e5-eda1a1d9f7ab on n-h1-master-1 Jun 20 12:17:21.789981 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-84c22768-ba52-4831-9c77-a7f4773a14db req-b9654777-c074-46b8-8028-1b308b27759c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.489121 Jun 20 12:17:21.790602 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2072/4255] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:17:21.807362 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2db69476-a7ff-453b-8ee8-b29e53170890 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:21.812724 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2db69476-a7ff-453b-8ee8-b29e53170890 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:21.817410 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2db69476-a7ff-453b-8ee8-b29e53170890 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-72368717', 'deleted': False, 'project_id': '3103ed818db8417b8625af13e7176910'} {{(pid=119128) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:17:21.833716 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2db69476-a7ff-453b-8ee8-b29e53170890 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:21.835395 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2db69476-a7ff-453b-8ee8-b29e53170890 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:21.836605 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2db69476-a7ff-453b-8ee8-b29e53170890 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:21.837519 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2db69476-a7ff-453b-8ee8-b29e53170890 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:21.934520 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a6770c6b-05cd-47e5-a552-daac0ccfd2a4 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b1b9bbe634eca989007e998c54271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:21.960843 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a6770c6b-05cd-47e5-a552-daac0ccfd2a4 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190" status: 200 len: 1281 microversion: 2.1 time: 0.258997 Jun 20 12:17:21.962328 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2184/4256] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:21 2022] GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190 => generated 1281 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:21.968014 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3d663982-ecc1-4980-aa4a-8b3343931c4c tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:21.969377 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3d663982-ecc1-4980-aa4a-8b3343931c4c tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] [instance: 80a28828-0d45-4c10-83e5-eda1a1d9f7ab] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:21.977844 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=8 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:17:21.980773 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3d663982-ecc1-4980-aa4a-8b3343931c4c tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:21.981619 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3d663982-ecc1-4980-aa4a-8b3343931c4c tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:21.982599 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3d663982-ecc1-4980-aa4a-8b3343931c4c tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:21.983837 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3d663982-ecc1-4980-aa4a-8b3343931c4c tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:22.048443 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.multi_cell_list [None req-2db69476-a7ff-453b-8ee8-b29e53170890 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119128) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 12:17:22.123039 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2db69476-a7ff-453b-8ee8-b29e53170890 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-72368717" status: 200 len: 345 microversion: 2.1 time: 0.320933 Jun 20 12:17:22.124322 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2073/4257] 10.222.0.27 () {58 vars in 1225 bytes} [Mon Jun 20 12:17:21 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-72368717 => generated 345 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:17:22.136599 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8143a746-bb01-4c73-b47f-975867e07423 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:22.137699 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8143a746-bb01-4c73-b47f-975867e07423 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 46c93bae-77c3-4fce-b4c3-bee3526049eb] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:22.148505 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8143a746-bb01-4c73-b47f-975867e07423 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:22.149352 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8143a746-bb01-4c73-b47f-975867e07423 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:22.150478 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8143a746-bb01-4c73-b47f-975867e07423 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:22.151136 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8143a746-bb01-4c73-b47f-975867e07423 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:22.186240 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8143a746-bb01-4c73-b47f-975867e07423 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 46c93bae-77c3-4fce-b4c3-bee3526049eb] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:17:22.263835 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:17:22.331068 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8143a746-bb01-4c73-b47f-975867e07423 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "DELETE /compute/v2.1/servers/46c93bae-77c3-4fce-b4c3-bee3526049eb" status: 204 len: 0 microversion: 2.1 time: 0.200003 Jun 20 12:17:22.335063 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2074/4258] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:17:22 2022] DELETE /compute/v2.1/servers/46c93bae-77c3-4fce-b4c3-bee3526049eb => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:17:22.351057 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8baf8c95-b1f2-47c2-8292-4b5a64948120 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:22.351969 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8baf8c95-b1f2-47c2-8292-4b5a64948120 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:22.364944 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8baf8c95-b1f2-47c2-8292-4b5a64948120 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:22.365520 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8baf8c95-b1f2-47c2-8292-4b5a64948120 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:22.366391 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8baf8c95-b1f2-47c2-8292-4b5a64948120 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:22.367019 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8baf8c95-b1f2-47c2-8292-4b5a64948120 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:22.527721 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8baf8c95-b1f2-47c2-8292-4b5a64948120 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:22.566779 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8baf8c95-b1f2-47c2-8292-4b5a64948120 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1323 microversion: 2.1 time: 0.228995 Jun 20 12:17:22.582109 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2075/4259] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:22 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1323 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:22.586613 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-137566c9-15a3-412e-9b32-805e72097b26 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:22.588868 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-137566c9-15a3-412e-9b32-805e72097b26 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] [instance: ce950356-da51-4847-96ba-76f575f7d9ab] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:22.607354 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-137566c9-15a3-412e-9b32-805e72097b26 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:22.609988 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-137566c9-15a3-412e-9b32-805e72097b26 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:22.613764 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-137566c9-15a3-412e-9b32-805e72097b26 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:22.616110 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-137566c9-15a3-412e-9b32-805e72097b26 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:22.950646 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3d663982-ecc1-4980-aa4a-8b3343931c4c tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0049a642be6340e3b36fa6904fed5529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1effa9873ec7488da55676c454c4a1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:22.959872 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3d663982-ecc1-4980-aa4a-8b3343931c4c tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] 10.222.0.27 "GET /compute/v2.1/servers/80a28828-0d45-4c10-83e5-eda1a1d9f7ab" status: 200 len: 1324 microversion: 2.1 time: 0.996181 Jun 20 12:17:22.963581 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2185/4260] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:21 2022] GET /compute/v2.1/servers/80a28828-0d45-4c10-83e5-eda1a1d9f7ab => generated 1324 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:22.966821 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-137566c9-15a3-412e-9b32-805e72097b26 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8919a400a671422593e94e0390c3d949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe714415c9e4c9b8cd739c5a9b1c8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:22.977791 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-89673f4c-ea65-46f0-bd2b-9a2d21b07075 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:22.978800 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-137566c9-15a3-412e-9b32-805e72097b26 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] 10.222.0.27 "GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab" status: 200 len: 1608 microversion: 2.1 time: 0.406948 Jun 20 12:17:22.979063 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-89673f4c-ea65-46f0-bd2b-9a2d21b07075 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:22.980598 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2076/4261] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:22 2022] GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab => generated 1608 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:22.988727 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b1210917-95bd-45e9-8233-345f54e45827 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:22.990993 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b1210917-95bd-45e9-8233-345f54e45827 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 46c93bae-77c3-4fce-b4c3-bee3526049eb] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:23.003389 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-89673f4c-ea65-46f0-bd2b-9a2d21b07075 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:23.003848 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-89673f4c-ea65-46f0-bd2b-9a2d21b07075 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:23.004714 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-89673f4c-ea65-46f0-bd2b-9a2d21b07075 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:23.006983 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-89673f4c-ea65-46f0-bd2b-9a2d21b07075 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:23.016974 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b1210917-95bd-45e9-8233-345f54e45827 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:23.017959 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b1210917-95bd-45e9-8233-345f54e45827 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:23.020419 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b1210917-95bd-45e9-8233-345f54e45827 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:23.021611 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b1210917-95bd-45e9-8233-345f54e45827 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:23.129320 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-89673f4c-ea65-46f0-bd2b-9a2d21b07075 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.163236 Jun 20 12:17:23.149727 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2186/4262] 10.222.0.27 () {60 vars in 1342 bytes} [Mon Jun 20 12:17:22 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc/os-volume_attachments => generated 197 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:17:23.203379 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b2e95daa-096d-4237-ba8e-14bb89fd1f33 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:23.210958 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b2e95daa-096d-4237-ba8e-14bb89fd1f33 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: 9dc75474-7e3c-462c-b704-dd6f9e948190] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:23.245715 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b2e95daa-096d-4237-ba8e-14bb89fd1f33 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:23.253217 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b2e95daa-096d-4237-ba8e-14bb89fd1f33 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:23.255080 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b2e95daa-096d-4237-ba8e-14bb89fd1f33 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:23.260742 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b2e95daa-096d-4237-ba8e-14bb89fd1f33 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:23.277298 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:17:23.503474 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b2e95daa-096d-4237-ba8e-14bb89fd1f33 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b1b9bbe634eca989007e998c54271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:23.515435 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b2e95daa-096d-4237-ba8e-14bb89fd1f33 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190" status: 200 len: 1281 microversion: 2.1 time: 0.362323 Jun 20 12:17:23.527380 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2187/4263] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:23 2022] GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190 => generated 1281 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:23.591151 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d99d9602-ec25-4ba9-a50c-ebdef41a2926 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:23.592291 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d99d9602-ec25-4ba9-a50c-ebdef41a2926 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:23.599856 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d99d9602-ec25-4ba9-a50c-ebdef41a2926 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:23.600355 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d99d9602-ec25-4ba9-a50c-ebdef41a2926 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:23.601153 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d99d9602-ec25-4ba9-a50c-ebdef41a2926 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:23.601656 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d99d9602-ec25-4ba9-a50c-ebdef41a2926 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:23.807606 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b1210917-95bd-45e9-8233-345f54e45827 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:23.826827 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b1210917-95bd-45e9-8233-345f54e45827 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/46c93bae-77c3-4fce-b4c3-bee3526049eb" status: 200 len: 1518 microversion: 2.1 time: 0.843866 Jun 20 12:17:23.828016 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2077/4264] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:22 2022] GET /compute/v2.1/servers/46c93bae-77c3-4fce-b4c3-bee3526049eb => generated 1518 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:23.985027 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1653617f-0b3d-4eb1-a779-35ea01169709 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:23.987481 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1653617f-0b3d-4eb1-a779-35ea01169709 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] [instance: 80a28828-0d45-4c10-83e5-eda1a1d9f7ab] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:23.999914 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1653617f-0b3d-4eb1-a779-35ea01169709 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:24.000940 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1653617f-0b3d-4eb1-a779-35ea01169709 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:24.002400 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1653617f-0b3d-4eb1-a779-35ea01169709 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:24.003007 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1653617f-0b3d-4eb1-a779-35ea01169709 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:24.703141 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d99d9602-ec25-4ba9-a50c-ebdef41a2926 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:24.713062 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d99d9602-ec25-4ba9-a50c-ebdef41a2926 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1391 microversion: 2.1 time: 1.126211 Jun 20 12:17:24.714235 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2188/4265] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:23 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1391 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:24.724691 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e3e07d6d-d15f-4d7f-9690-a29daf4cccc1 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:24.726878 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e3e07d6d-d15f-4d7f-9690-a29daf4cccc1 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] [instance: ce950356-da51-4847-96ba-76f575f7d9ab] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:24.740837 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e3e07d6d-d15f-4d7f-9690-a29daf4cccc1 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:24.742658 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e3e07d6d-d15f-4d7f-9690-a29daf4cccc1 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:24.743641 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e3e07d6d-d15f-4d7f-9690-a29daf4cccc1 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:24.744082 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e3e07d6d-d15f-4d7f-9690-a29daf4cccc1 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:24.878447 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1653617f-0b3d-4eb1-a779-35ea01169709 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0049a642be6340e3b36fa6904fed5529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1effa9873ec7488da55676c454c4a1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:24.887562 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1653617f-0b3d-4eb1-a779-35ea01169709 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] 10.222.0.27 "GET /compute/v2.1/servers/80a28828-0d45-4c10-83e5-eda1a1d9f7ab" status: 200 len: 1324 microversion: 2.1 time: 0.910380 Jun 20 12:17:24.888673 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2078/4266] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:23 2022] GET /compute/v2.1/servers/80a28828-0d45-4c10-83e5-eda1a1d9f7ab => generated 1324 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:24.894008 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-29391a41-2520-4e25-aef4-41e1cba52294 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:24.895358 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-29391a41-2520-4e25-aef4-41e1cba52294 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:24.902898 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-29391a41-2520-4e25-aef4-41e1cba52294 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:24.903642 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-29391a41-2520-4e25-aef4-41e1cba52294 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:24.904629 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-29391a41-2520-4e25-aef4-41e1cba52294 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:24.905225 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-29391a41-2520-4e25-aef4-41e1cba52294 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:24.941518 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-29391a41-2520-4e25-aef4-41e1cba52294 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051184 Jun 20 12:17:24.960711 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2079/4267] 10.222.0.27 () {60 vars in 1342 bytes} [Mon Jun 20 12:17:24 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:24.976666 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7f9a5cd7-9475-4e16-b9c3-d68ef0c0330d tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:24.977540 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7f9a5cd7-9475-4e16-b9c3-d68ef0c0330d tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: 9dc75474-7e3c-462c-b704-dd6f9e948190] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:24.992145 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f9a5cd7-9475-4e16-b9c3-d68ef0c0330d tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:24.995786 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f9a5cd7-9475-4e16-b9c3-d68ef0c0330d tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:24.997291 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f9a5cd7-9475-4e16-b9c3-d68ef0c0330d tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:24.998007 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f9a5cd7-9475-4e16-b9c3-d68ef0c0330d tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:25.180664 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7f9a5cd7-9475-4e16-b9c3-d68ef0c0330d tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b1b9bbe634eca989007e998c54271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:25.204303 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7f9a5cd7-9475-4e16-b9c3-d68ef0c0330d tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190" status: 200 len: 1281 microversion: 2.1 time: 0.235188 Jun 20 12:17:25.205529 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2080/4268] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:24 2022] GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190 => generated 1281 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:25.222266 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f967a484-9f57-488d-a82c-2b2be9ca5da3 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:25.223209 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f967a484-9f57-488d-a82c-2b2be9ca5da3 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 46c93bae-77c3-4fce-b4c3-bee3526049eb] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:25.234448 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f967a484-9f57-488d-a82c-2b2be9ca5da3 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:25.236326 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f967a484-9f57-488d-a82c-2b2be9ca5da3 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:25.237587 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f967a484-9f57-488d-a82c-2b2be9ca5da3 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:25.238432 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f967a484-9f57-488d-a82c-2b2be9ca5da3 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:25.362460 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e3e07d6d-d15f-4d7f-9690-a29daf4cccc1 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8919a400a671422593e94e0390c3d949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe714415c9e4c9b8cd739c5a9b1c8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:25.375831 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e3e07d6d-d15f-4d7f-9690-a29daf4cccc1 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] 10.222.0.27 "GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab" status: 200 len: 1608 microversion: 2.1 time: 0.658392 Jun 20 12:17:25.377320 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2189/4269] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:24 2022] GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab => generated 1608 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:25.396857 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-49dacabe-bf98-40c4-ae2c-140a69d014d1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:25.397352 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-49dacabe-bf98-40c4-ae2c-140a69d014d1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:25.423694 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-49dacabe-bf98-40c4-ae2c-140a69d014d1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:25.424538 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-49dacabe-bf98-40c4-ae2c-140a69d014d1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:25.425933 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-49dacabe-bf98-40c4-ae2c-140a69d014d1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:25.428863 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-49dacabe-bf98-40c4-ae2c-140a69d014d1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:25.467063 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-49dacabe-bf98-40c4-ae2c-140a69d014d1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:17:25.593772 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-49dacabe-bf98-40c4-ae2c-140a69d014d1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 204 len: 0 microversion: 2.20 time: 0.214247 Jun 20 12:17:25.598200 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2190/4270] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Jun 20 12:17:25 2022] DELETE /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 12:17:25.620512 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cb5f019e-a1ba-4c05-ab06-47d280b2e1a6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:25.622912 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cb5f019e-a1ba-4c05-ab06-47d280b2e1a6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:25.630665 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cb5f019e-a1ba-4c05-ab06-47d280b2e1a6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:25.631418 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cb5f019e-a1ba-4c05-ab06-47d280b2e1a6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:25.632271 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cb5f019e-a1ba-4c05-ab06-47d280b2e1a6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:25.633281 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cb5f019e-a1ba-4c05-ab06-47d280b2e1a6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:26.318105 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f967a484-9f57-488d-a82c-2b2be9ca5da3 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:26.326551 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f967a484-9f57-488d-a82c-2b2be9ca5da3 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/46c93bae-77c3-4fce-b4c3-bee3526049eb" status: 200 len: 1518 microversion: 2.1 time: 1.119626 Jun 20 12:17:26.327142 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2081/4271] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:25 2022] GET /compute/v2.1/servers/46c93bae-77c3-4fce-b4c3-bee3526049eb => generated 1518 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:26.342206 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f63d7e4c-88d8-40ad-8f58-af88944a2f71 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:26.343139 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f63d7e4c-88d8-40ad-8f58-af88944a2f71 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:26.349585 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:17:26.381609 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f63d7e4c-88d8-40ad-8f58-af88944a2f71 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:26.382856 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f63d7e4c-88d8-40ad-8f58-af88944a2f71 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:26.385380 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f63d7e4c-88d8-40ad-8f58-af88944a2f71 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:26.385991 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f63d7e4c-88d8-40ad-8f58-af88944a2f71 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:26.401296 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cb5f019e-a1ba-4c05-ab06-47d280b2e1a6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:26.416225 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cb5f019e-a1ba-4c05-ab06-47d280b2e1a6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:26.417821 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cb5f019e-a1ba-4c05-ab06-47d280b2e1a6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:26.422892 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cb5f019e-a1ba-4c05-ab06-47d280b2e1a6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1724 microversion: 2.20 time: 0.819467 Jun 20 12:17:26.433456 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2191/4272] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:17:25 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1724 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:17:26.437641 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-79be7d6e-8e94-4141-a4d1-50fc5f0b48a6 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:26.437641 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-79be7d6e-8e94-4141-a4d1-50fc5f0b48a6 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] [instance: 80a28828-0d45-4c10-83e5-eda1a1d9f7ab] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:26.453042 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-79be7d6e-8e94-4141-a4d1-50fc5f0b48a6 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:26.453505 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-79be7d6e-8e94-4141-a4d1-50fc5f0b48a6 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:26.456156 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-79be7d6e-8e94-4141-a4d1-50fc5f0b48a6 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:26.458435 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-79be7d6e-8e94-4141-a4d1-50fc5f0b48a6 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:27.163310 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f63d7e4c-88d8-40ad-8f58-af88944a2f71 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:27.188962 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f63d7e4c-88d8-40ad-8f58-af88944a2f71 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1391 microversion: 2.1 time: 0.846628 Jun 20 12:17:27.203493 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-79be7d6e-8e94-4141-a4d1-50fc5f0b48a6 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0049a642be6340e3b36fa6904fed5529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1effa9873ec7488da55676c454c4a1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:27.204411 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2082/4273] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:26 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1391 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:27.213676 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-48dd7814-d63e-4e1e-88d4-425aeaa5872c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:27.214960 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-48dd7814-d63e-4e1e-88d4-425aeaa5872c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: 9dc75474-7e3c-462c-b704-dd6f9e948190] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:27.222634 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-48dd7814-d63e-4e1e-88d4-425aeaa5872c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:27.224147 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-48dd7814-d63e-4e1e-88d4-425aeaa5872c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:27.226211 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-48dd7814-d63e-4e1e-88d4-425aeaa5872c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:27.227010 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-48dd7814-d63e-4e1e-88d4-425aeaa5872c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:27.260112 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-79be7d6e-8e94-4141-a4d1-50fc5f0b48a6 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] 10.222.0.27 "GET /compute/v2.1/servers/80a28828-0d45-4c10-83e5-eda1a1d9f7ab" status: 200 len: 1324 microversion: 2.1 time: 0.834378 Jun 20 12:17:27.260794 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2192/4274] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:26 2022] GET /compute/v2.1/servers/80a28828-0d45-4c10-83e5-eda1a1d9f7ab => generated 1324 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:27.295505 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6bc33e54-c5df-40d3-8ac6-a41969d53565 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:27.299294 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6bc33e54-c5df-40d3-8ac6-a41969d53565 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] [instance: ce950356-da51-4847-96ba-76f575f7d9ab] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:27.324111 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6bc33e54-c5df-40d3-8ac6-a41969d53565 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:27.327828 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6bc33e54-c5df-40d3-8ac6-a41969d53565 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:27.332092 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6bc33e54-c5df-40d3-8ac6-a41969d53565 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:27.335586 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6bc33e54-c5df-40d3-8ac6-a41969d53565 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:27.586598 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6bc33e54-c5df-40d3-8ac6-a41969d53565 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8919a400a671422593e94e0390c3d949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe714415c9e4c9b8cd739c5a9b1c8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:27.602271 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6bc33e54-c5df-40d3-8ac6-a41969d53565 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] 10.222.0.27 "GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab" status: 200 len: 1540 microversion: 2.1 time: 0.329101 Jun 20 12:17:27.603519 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2193/4275] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:27 2022] GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab => generated 1540 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:27.641225 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-0bcf3c1f-a09d-4253-93f9-6e3bcf289bbb req-9cbedf96-850b-4ecc-ac8b-32a91e533150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46c93bae-77c3-4fce-b4c3-bee3526049eb", "name": "network-vif-deleted", "tag": "6c68338b-5e26-4278-a97b-8972e7783ccd"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:17:27.665963 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:17:27.698815 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-0bcf3c1f-a09d-4253-93f9-6e3bcf289bbb req-9cbedf96-850b-4ecc-ac8b-32a91e533150 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:27.699934 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-0bcf3c1f-a09d-4253-93f9-6e3bcf289bbb req-9cbedf96-850b-4ecc-ac8b-32a91e533150 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:27.711912 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-48dd7814-d63e-4e1e-88d4-425aeaa5872c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b1b9bbe634eca989007e998c54271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:27.737262 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-48dd7814-d63e-4e1e-88d4-425aeaa5872c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190" status: 200 len: 1323 microversion: 2.1 time: 0.530240 Jun 20 12:17:27.738347 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2083/4276] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:27 2022] GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190 => generated 1323 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:27.759588 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-0bcf3c1f-a09d-4253-93f9-6e3bcf289bbb req-9cbedf96-850b-4ecc-ac8b-32a91e533150 service nova] Creating event network-vif-deleted:6c68338b-5e26-4278-a97b-8972e7783ccd for instance 46c93bae-77c3-4fce-b4c3-bee3526049eb on n-h1-master-1 Jun 20 12:17:27.763894 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a4ea08a3-7fbf-4f2f-978c-c06701b04e74 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:27.778930 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a4ea08a3-7fbf-4f2f-978c-c06701b04e74 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 46c93bae-77c3-4fce-b4c3-bee3526049eb] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:27.787375 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-0bcf3c1f-a09d-4253-93f9-6e3bcf289bbb req-9cbedf96-850b-4ecc-ac8b-32a91e533150 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175964 Jun 20 12:17:27.789164 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2194/4277] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:17:27.802456 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4519d18a-3ea8-4ee6-8a15-0b5f1a65c173 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:27.803591 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4519d18a-3ea8-4ee6-8a15-0b5f1a65c173 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:27.807504 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a4ea08a3-7fbf-4f2f-978c-c06701b04e74 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:27.809693 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a4ea08a3-7fbf-4f2f-978c-c06701b04e74 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:27.810707 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a4ea08a3-7fbf-4f2f-978c-c06701b04e74 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:27.814226 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4519d18a-3ea8-4ee6-8a15-0b5f1a65c173 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:27.815771 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4519d18a-3ea8-4ee6-8a15-0b5f1a65c173 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:27.818499 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4519d18a-3ea8-4ee6-8a15-0b5f1a65c173 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:27.821146 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4519d18a-3ea8-4ee6-8a15-0b5f1a65c173 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:27.823564 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a4ea08a3-7fbf-4f2f-978c-c06701b04e74 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:27.858075 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-a4ea08a3-7fbf-4f2f-978c-c06701b04e74 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] HTTP exception thrown: Instance 46c93bae-77c3-4fce-b4c3-bee3526049eb could not be found. Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a4ea08a3-7fbf-4f2f-978c-c06701b04e74 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Request method failure captured: Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/46c93bae-77c3-4fce-b4c3-bee3526049eb HTTP/1.1 Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGUEJ-D3cMf8np4O7Ms7hRd-YKCdqhmLqICiccL3zHTo-mNHRTE9UAnkQiAFCeKUH7R-BxtEgjFgxhA5ywx9NzsuBVxraIVMNHwokfVvByaZiGuIX4x2kMrBf7DOtYjxgfgFZThIf5DM_iWPYpnzfv3Kba2D0yYjkxvVqYzsldQlRbY Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 3103ed818db8417b8625af13e7176910 Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ListServerFiltersTestJSON-351319595 Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3103ed818db8417b8625af13e7176910"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3103ed818db8417b8625af13e7176910"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3103ed818db8417b8625af13e7176910"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3103ed818db8417b8625af13e7176910"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ListServerFiltersTestJSON-351319595 Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 3103ed818db8417b8625af13e7176910 Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-351319595 Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ListServerFiltersTestJSON-351319595-project Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 0c8324eb1db74653853a415b56b43fce Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ListServerFiltersTestJSON-351319595-project Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 46c93bae-77c3-4fce-b4c3-bee3526049eb could not be found. Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '46c93bae-77c3-4fce-b4c3-bee3526049eb'} Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46c93bae-77c3-4fce-b4c3-bee3526049eb could not be found. Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46c93bae-77c3-4fce-b4c3-bee3526049eb could not be found. Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:27.859815 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:27.864113 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:27.864113 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:27.864113 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:27.864113 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:17:27.864113 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:17:27.864113 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46c93bae-77c3-4fce-b4c3-bee3526049eb could not be found. Jun 20 12:17:27.864113 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:27.864113 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a4ea08a3-7fbf-4f2f-978c-c06701b04e74 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Returning 404 to user: Instance 46c93bae-77c3-4fce-b4c3-bee3526049eb could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:17:27.864113 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a4ea08a3-7fbf-4f2f-978c-c06701b04e74 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/46c93bae-77c3-4fce-b4c3-bee3526049eb" status: 404 len: 111 microversion: 2.1 time: 0.119100 Jun 20 12:17:27.864113 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2084/4278] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:27 2022] GET /compute/v2.1/servers/46c93bae-77c3-4fce-b4c3-bee3526049eb => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:17:27.885762 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a18ab3fe-cf86-4037-8f1d-8b8dc99d0674 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:27.886536 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a18ab3fe-cf86-4037-8f1d-8b8dc99d0674 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:27.906129 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a18ab3fe-cf86-4037-8f1d-8b8dc99d0674 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:27.906888 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a18ab3fe-cf86-4037-8f1d-8b8dc99d0674 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:27.907892 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a18ab3fe-cf86-4037-8f1d-8b8dc99d0674 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:27.908677 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a18ab3fe-cf86-4037-8f1d-8b8dc99d0674 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:27.987551 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a18ab3fe-cf86-4037-8f1d-8b8dc99d0674 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:17:28.113147 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=20 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:17:28.225491 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a18ab3fe-cf86-4037-8f1d-8b8dc99d0674 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81" status: 204 len: 0 microversion: 2.1 time: 0.354927 Jun 20 12:17:28.227407 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2085/4279] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:17:27 2022] DELETE /compute/v2.1/servers/d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:17:28.244479 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9b5e11f0-3ea5-4807-ad4e-87bda52b0a80 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:28.245519 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9b5e11f0-3ea5-4807-ad4e-87bda52b0a80 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:28.257604 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9b5e11f0-3ea5-4807-ad4e-87bda52b0a80 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:28.258511 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9b5e11f0-3ea5-4807-ad4e-87bda52b0a80 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:28.259490 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9b5e11f0-3ea5-4807-ad4e-87bda52b0a80 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:28.260094 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9b5e11f0-3ea5-4807-ad4e-87bda52b0a80 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:28.509620 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9b5e11f0-3ea5-4807-ad4e-87bda52b0a80 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:28.521393 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9b5e11f0-3ea5-4807-ad4e-87bda52b0a80 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1391 microversion: 2.1 time: 0.290291 Jun 20 12:17:28.523922 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2086/4280] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:28 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1391 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:28.529407 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e6de9e5a-21e1-47e9-b567-c559dfa5e58d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:28.530914 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e6de9e5a-21e1-47e9-b567-c559dfa5e58d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:28.542286 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e6de9e5a-21e1-47e9-b567-c559dfa5e58d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:28.543706 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e6de9e5a-21e1-47e9-b567-c559dfa5e58d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:28.545210 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e6de9e5a-21e1-47e9-b567-c559dfa5e58d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:28.545882 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e6de9e5a-21e1-47e9-b567-c559dfa5e58d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:28.809623 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e6de9e5a-21e1-47e9-b567-c559dfa5e58d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:28.823215 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e6de9e5a-21e1-47e9-b567-c559dfa5e58d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81" status: 200 len: 1517 microversion: 2.1 time: 0.297807 Jun 20 12:17:28.824627 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2087/4281] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:28 2022] GET /compute/v2.1/servers/d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81 => generated 1517 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:28.833519 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-95d7b52b-82d2-4963-a640-984419129600 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:28.835112 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-95d7b52b-82d2-4963-a640-984419129600 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] [instance: 80a28828-0d45-4c10-83e5-eda1a1d9f7ab] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:28.844068 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95d7b52b-82d2-4963-a640-984419129600 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:28.845031 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95d7b52b-82d2-4963-a640-984419129600 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:28.846229 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95d7b52b-82d2-4963-a640-984419129600 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:28.846798 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95d7b52b-82d2-4963-a640-984419129600 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:28.890264 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4519d18a-3ea8-4ee6-8a15-0b5f1a65c173 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:28.903554 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4519d18a-3ea8-4ee6-8a15-0b5f1a65c173 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:28.905903 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4519d18a-3ea8-4ee6-8a15-0b5f1a65c173 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:28.907452 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4519d18a-3ea8-4ee6-8a15-0b5f1a65c173 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1724 microversion: 2.20 time: 1.116265 Jun 20 12:17:28.921377 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2195/4282] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:17:27 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1724 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:17:28.930602 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d78eacdb-e262-40de-a76e-f0c2a2e7a99a tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:28.932235 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d78eacdb-e262-40de-a76e-f0c2a2e7a99a tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] [instance: ce950356-da51-4847-96ba-76f575f7d9ab] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:28.939223 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d78eacdb-e262-40de-a76e-f0c2a2e7a99a tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:28.940117 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d78eacdb-e262-40de-a76e-f0c2a2e7a99a tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:28.953863 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d78eacdb-e262-40de-a76e-f0c2a2e7a99a tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:28.954780 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d78eacdb-e262-40de-a76e-f0c2a2e7a99a tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:29.055188 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-95d7b52b-82d2-4963-a640-984419129600 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0049a642be6340e3b36fa6904fed5529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1effa9873ec7488da55676c454c4a1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:29.068030 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-95d7b52b-82d2-4963-a640-984419129600 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] 10.222.0.27 "GET /compute/v2.1/servers/80a28828-0d45-4c10-83e5-eda1a1d9f7ab" status: 200 len: 1324 microversion: 2.1 time: 0.240856 Jun 20 12:17:29.069968 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2088/4283] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:28 2022] GET /compute/v2.1/servers/80a28828-0d45-4c10-83e5-eda1a1d9f7ab => generated 1324 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:29.076362 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6e85ff7e-2e5a-4330-994b-1677fe462c6a tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:29.077941 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6e85ff7e-2e5a-4330-994b-1677fe462c6a tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: 9dc75474-7e3c-462c-b704-dd6f9e948190] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:29.085242 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6e85ff7e-2e5a-4330-994b-1677fe462c6a tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:29.085732 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6e85ff7e-2e5a-4330-994b-1677fe462c6a tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:29.086521 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6e85ff7e-2e5a-4330-994b-1677fe462c6a tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:29.086957 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6e85ff7e-2e5a-4330-994b-1677fe462c6a tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:29.114029 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d78eacdb-e262-40de-a76e-f0c2a2e7a99a tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8919a400a671422593e94e0390c3d949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe714415c9e4c9b8cd739c5a9b1c8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:29.128958 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d78eacdb-e262-40de-a76e-f0c2a2e7a99a tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] 10.222.0.27 "GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab" status: 200 len: 1540 microversion: 2.1 time: 0.201459 Jun 20 12:17:29.129856 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2196/4284] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:28 2022] GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab => generated 1540 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:29.153566 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-55d3a7df-e9d6-4dab-8ce7-9e520f4e2d0d req-9bed84ca-b6dd-4a7f-b1cb-2dc57c71f6a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce950356-da51-4847-96ba-76f575f7d9ab", "name": "network-vif-deleted", "tag": "1bcf3d27-a159-49aa-8893-b16ec015ede0"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:17:29.205952 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-55d3a7df-e9d6-4dab-8ce7-9e520f4e2d0d req-9bed84ca-b6dd-4a7f-b1cb-2dc57c71f6a4 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:29.222021 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-55d3a7df-e9d6-4dab-8ce7-9e520f4e2d0d req-9bed84ca-b6dd-4a7f-b1cb-2dc57c71f6a4 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:29.272426 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-55d3a7df-e9d6-4dab-8ce7-9e520f4e2d0d req-9bed84ca-b6dd-4a7f-b1cb-2dc57c71f6a4 service nova] Creating event network-vif-deleted:1bcf3d27-a159-49aa-8893-b16ec015ede0 for instance ce950356-da51-4847-96ba-76f575f7d9ab on n-h2-master-1 Jun 20 12:17:29.314554 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-55d3a7df-e9d6-4dab-8ce7-9e520f4e2d0d req-9bed84ca-b6dd-4a7f-b1cb-2dc57c71f6a4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181592 Jun 20 12:17:29.337142 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2197/4285] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:17:29.526283 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6e85ff7e-2e5a-4330-994b-1677fe462c6a tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b1b9bbe634eca989007e998c54271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:29.542206 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6e85ff7e-2e5a-4330-994b-1677fe462c6a tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190" status: 200 len: 1323 microversion: 2.1 time: 0.468380 Jun 20 12:17:29.543512 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2089/4286] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:29 2022] GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190 => generated 1323 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:29.567272 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ff87c3f8-38c8-4d5d-b142-58f67ea3c3a5 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:29.572427 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ff87c3f8-38c8-4d5d-b142-58f67ea3c3a5 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:29.598429 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ff87c3f8-38c8-4d5d-b142-58f67ea3c3a5 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:29.599908 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ff87c3f8-38c8-4d5d-b142-58f67ea3c3a5 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:29.602918 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ff87c3f8-38c8-4d5d-b142-58f67ea3c3a5 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:29.603668 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ff87c3f8-38c8-4d5d-b142-58f67ea3c3a5 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:29.654973 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:17:29.937537 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-7c49d4f6-cd76-43e7-b39a-f7aa03876033 req-7183dc21-f5f3-480a-91d3-abdd5032e0c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80a28828-0d45-4c10-83e5-eda1a1d9f7ab", "name": "network-vif-plugged", "status": "completed", "tag": "d92b40d4-dda8-47a7-9ec9-22b1ff972d6d"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:17:29.950649 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-7c49d4f6-cd76-43e7-b39a-f7aa03876033 req-7183dc21-f5f3-480a-91d3-abdd5032e0c4 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:29.957994 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-7c49d4f6-cd76-43e7-b39a-f7aa03876033 req-7183dc21-f5f3-480a-91d3-abdd5032e0c4 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:29.981137 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-7c49d4f6-cd76-43e7-b39a-f7aa03876033 req-7183dc21-f5f3-480a-91d3-abdd5032e0c4 service nova] Creating event network-vif-plugged:d92b40d4-dda8-47a7-9ec9-22b1ff972d6d for instance 80a28828-0d45-4c10-83e5-eda1a1d9f7ab on n-h1-master-1 Jun 20 12:17:29.998687 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-7c49d4f6-cd76-43e7-b39a-f7aa03876033 req-7183dc21-f5f3-480a-91d3-abdd5032e0c4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.659238 Jun 20 12:17:30.000260 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2198/4287] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:17:30.021482 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-50ad2c8f-e2a1-447f-9fe4-c068e8d43ba6 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:30.022163 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-50ad2c8f-e2a1-447f-9fe4-c068e8d43ba6 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:30.051143 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-50ad2c8f-e2a1-447f-9fe4-c068e8d43ba6 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:30.059852 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-50ad2c8f-e2a1-447f-9fe4-c068e8d43ba6 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:30.060796 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-50ad2c8f-e2a1-447f-9fe4-c068e8d43ba6 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:30.061249 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-50ad2c8f-e2a1-447f-9fe4-c068e8d43ba6 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:30.538917 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ff87c3f8-38c8-4d5d-b142-58f67ea3c3a5 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:30.558250 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ff87c3f8-38c8-4d5d-b142-58f67ea3c3a5 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1391 microversion: 2.1 time: 1.013225 Jun 20 12:17:30.558983 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2090/4288] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:29 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1391 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:30.564869 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-060c8bd2-7080-451c-9fb8-748ea743a22d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:30.569811 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-060c8bd2-7080-451c-9fb8-748ea743a22d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:30.580033 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-060c8bd2-7080-451c-9fb8-748ea743a22d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:30.588483 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-060c8bd2-7080-451c-9fb8-748ea743a22d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:30.589823 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-060c8bd2-7080-451c-9fb8-748ea743a22d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:30.590640 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-060c8bd2-7080-451c-9fb8-748ea743a22d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:31.286481 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-50ad2c8f-e2a1-447f-9fe4-c068e8d43ba6 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:31.309948 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-50ad2c8f-e2a1-447f-9fe4-c068e8d43ba6 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81" status: 200 len: 1517 microversion: 2.1 time: 1.304346 Jun 20 12:17:31.311007 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2199/4289] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:30 2022] GET /compute/v2.1/servers/d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81 => generated 1517 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:31.364402 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-eb3f4665-d453-4230-a7da-e2f375a126ad req-444eb2f9-beb2-45c0-b9a7-87b3b6e4017f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1512eb0-4637-49c4-a4d5-cdbbd1398473", "tag": "d7d7973b-595c-4769-80dd-0441a733dbfc"}, {"name": "network-changed", "server_uuid": "8c46b7ac-3373-4ff7-8527-f2800b2ba847", "tag": "f398b629-6b58-4763-9a52-7f13fb752b43"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:17:31.393069 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-eb3f4665-d453-4230-a7da-e2f375a126ad req-444eb2f9-beb2-45c0-b9a7-87b3b6e4017f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:31.393508 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-eb3f4665-d453-4230-a7da-e2f375a126ad req-444eb2f9-beb2-45c0-b9a7-87b3b6e4017f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:31.417164 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-eb3f4665-d453-4230-a7da-e2f375a126ad req-444eb2f9-beb2-45c0-b9a7-87b3b6e4017f service nova] Creating event network-changed:d7d7973b-595c-4769-80dd-0441a733dbfc for instance a1512eb0-4637-49c4-a4d5-cdbbd1398473 on n-h2-master-1 Jun 20 12:17:31.418022 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-eb3f4665-d453-4230-a7da-e2f375a126ad req-444eb2f9-beb2-45c0-b9a7-87b3b6e4017f service nova] Creating event network-changed:f398b629-6b58-4763-9a52-7f13fb752b43 for instance 8c46b7ac-3373-4ff7-8527-f2800b2ba847 on n-h1-master-1 Jun 20 12:17:31.430085 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-eb3f4665-d453-4230-a7da-e2f375a126ad req-444eb2f9-beb2-45c0-b9a7-87b3b6e4017f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.107458 Jun 20 12:17:31.431290 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2200/4290] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:17:31.439431 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7ab28a7e-8d4e-4b81-a1a2-e35184d86c94 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:31.440745 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7ab28a7e-8d4e-4b81-a1a2-e35184d86c94 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] [instance: 80a28828-0d45-4c10-83e5-eda1a1d9f7ab] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:31.449352 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ab28a7e-8d4e-4b81-a1a2-e35184d86c94 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:31.450203 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ab28a7e-8d4e-4b81-a1a2-e35184d86c94 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:31.451189 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ab28a7e-8d4e-4b81-a1a2-e35184d86c94 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:31.452494 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ab28a7e-8d4e-4b81-a1a2-e35184d86c94 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:31.457651 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=24 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:17:31.725949 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-060c8bd2-7080-451c-9fb8-748ea743a22d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:31.740163 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-060c8bd2-7080-451c-9fb8-748ea743a22d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:31.742326 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-060c8bd2-7080-451c-9fb8-748ea743a22d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:31.743771 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-060c8bd2-7080-451c-9fb8-748ea743a22d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1724 microversion: 2.20 time: 1.183517 Jun 20 12:17:31.745145 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2091/4291] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:17:30 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1724 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:17:31.752967 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-83a6604e-33c6-443c-8124-41d86c06c5d8 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:31.753863 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-83a6604e-33c6-443c-8124-41d86c06c5d8 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] [instance: ce950356-da51-4847-96ba-76f575f7d9ab] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:31.764832 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-83a6604e-33c6-443c-8124-41d86c06c5d8 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:31.767657 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-83a6604e-33c6-443c-8124-41d86c06c5d8 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:31.800561 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-83a6604e-33c6-443c-8124-41d86c06c5d8 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:31.802534 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-83a6604e-33c6-443c-8124-41d86c06c5d8 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:31.891414 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:17:32.035985 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7ab28a7e-8d4e-4b81-a1a2-e35184d86c94 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0049a642be6340e3b36fa6904fed5529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1effa9873ec7488da55676c454c4a1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:32.043156 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-83a6604e-33c6-443c-8124-41d86c06c5d8 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8919a400a671422593e94e0390c3d949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe714415c9e4c9b8cd739c5a9b1c8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:32.047757 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7ab28a7e-8d4e-4b81-a1a2-e35184d86c94 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] 10.222.0.27 "GET /compute/v2.1/servers/80a28828-0d45-4c10-83e5-eda1a1d9f7ab" status: 200 len: 1324 microversion: 2.1 time: 0.614643 Jun 20 12:17:32.061030 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2201/4292] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:31 2022] GET /compute/v2.1/servers/80a28828-0d45-4c10-83e5-eda1a1d9f7ab => generated 1324 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:32.067537 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-88c8fe1c-ada6-4649-88f4-3c039ad581ab tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:32.068791 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-88c8fe1c-ada6-4649-88f4-3c039ad581ab tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: 9dc75474-7e3c-462c-b704-dd6f9e948190] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:32.069134 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-83a6604e-33c6-443c-8124-41d86c06c5d8 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] 10.222.0.27 "GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab" status: 200 len: 1253 microversion: 2.1 time: 0.322387 Jun 20 12:17:32.070292 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2092/4293] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:31 2022] GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab => generated 1253 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:32.083906 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-f698b3d8-0ef8-424c-bddf-6340ebc4d5c9 req-f810e59b-3c5a-4b35-8901-6cf2666c5a48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dc75474-7e3c-462c-b704-dd6f9e948190", "tag": "f9ff76df-7bbe-414a-be10-bcadb596d155"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:17:32.091805 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-88c8fe1c-ada6-4649-88f4-3c039ad581ab tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:32.092522 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-88c8fe1c-ada6-4649-88f4-3c039ad581ab tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:32.093651 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-88c8fe1c-ada6-4649-88f4-3c039ad581ab tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:32.094384 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-88c8fe1c-ada6-4649-88f4-3c039ad581ab tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:32.120739 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-f698b3d8-0ef8-424c-bddf-6340ebc4d5c9 req-f810e59b-3c5a-4b35-8901-6cf2666c5a48 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:32.124571 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-f698b3d8-0ef8-424c-bddf-6340ebc4d5c9 req-f810e59b-3c5a-4b35-8901-6cf2666c5a48 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:32.160482 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-f698b3d8-0ef8-424c-bddf-6340ebc4d5c9 req-f810e59b-3c5a-4b35-8901-6cf2666c5a48 service nova] Creating event network-changed:f9ff76df-7bbe-414a-be10-bcadb596d155 for instance 9dc75474-7e3c-462c-b704-dd6f9e948190 on n-h2-master-1 Jun 20 12:17:32.175220 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-f698b3d8-0ef8-424c-bddf-6340ebc4d5c9 req-f810e59b-3c5a-4b35-8901-6cf2666c5a48 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101275 Jun 20 12:17:32.176322 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2093/4294] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:17:32.183645 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2e71c661-877b-497c-815b-af254a7a0033 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:32.184626 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2e71c661-877b-497c-815b-af254a7a0033 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:32.198678 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2e71c661-877b-497c-815b-af254a7a0033 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:32.199429 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2e71c661-877b-497c-815b-af254a7a0033 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:32.210190 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2e71c661-877b-497c-815b-af254a7a0033 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:32.210812 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2e71c661-877b-497c-815b-af254a7a0033 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:32.544756 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2e71c661-877b-497c-815b-af254a7a0033 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:32.593874 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2e71c661-877b-497c-815b-af254a7a0033 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1391 microversion: 2.1 time: 0.414515 Jun 20 12:17:32.597351 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2094/4295] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:32 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1391 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:32.612866 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-355fd072-358c-4ebc-96d5-6b6817ddd957 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:32.615258 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-355fd072-358c-4ebc-96d5-6b6817ddd957 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:32.641311 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-355fd072-358c-4ebc-96d5-6b6817ddd957 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:32.644026 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-355fd072-358c-4ebc-96d5-6b6817ddd957 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:32.644912 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-355fd072-358c-4ebc-96d5-6b6817ddd957 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:32.645458 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-355fd072-358c-4ebc-96d5-6b6817ddd957 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:32.763351 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-355fd072-358c-4ebc-96d5-6b6817ddd957 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:32.771691 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-355fd072-358c-4ebc-96d5-6b6817ddd957 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81" status: 200 len: 1475 microversion: 2.1 time: 0.172700 Jun 20 12:17:32.772613 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2095/4296] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:32 2022] GET /compute/v2.1/servers/d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81 => generated 1475 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:32.777300 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-94686d4f-84b2-47a6-b2e7-8f6c87c265d9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:32.777912 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-94686d4f-84b2-47a6-b2e7-8f6c87c265d9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:32.791708 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94686d4f-84b2-47a6-b2e7-8f6c87c265d9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:32.792152 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94686d4f-84b2-47a6-b2e7-8f6c87c265d9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:32.794843 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94686d4f-84b2-47a6-b2e7-8f6c87c265d9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:32.800489 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94686d4f-84b2-47a6-b2e7-8f6c87c265d9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:33.120027 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-88c8fe1c-ada6-4649-88f4-3c039ad581ab tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b1b9bbe634eca989007e998c54271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:33.147568 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-88c8fe1c-ada6-4649-88f4-3c039ad581ab tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190" status: 200 len: 1323 microversion: 2.1 time: 1.083995 Jun 20 12:17:33.150545 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2202/4297] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:32 2022] GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190 => generated 1323 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:33.168597 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-7b52a51d-2e2e-4aee-b180-6c368954d1d8 req-91ec69bf-ea67-4e32-b477-a3ff2a625fe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f65e72fa-4e88-44c5-bba1-0dc4f78eea47", "name": "network-vif-plugged", "status": "completed", "tag": "552383e8-2c45-49dc-8d09-3a702564f66d"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:17:33.190288 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-94686d4f-84b2-47a6-b2e7-8f6c87c265d9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:33.194728 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-7b52a51d-2e2e-4aee-b180-6c368954d1d8 req-91ec69bf-ea67-4e32-b477-a3ff2a625fe9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:33.195345 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-7b52a51d-2e2e-4aee-b180-6c368954d1d8 req-91ec69bf-ea67-4e32-b477-a3ff2a625fe9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:33.201448 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-94686d4f-84b2-47a6-b2e7-8f6c87c265d9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:33.202948 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-94686d4f-84b2-47a6-b2e7-8f6c87c265d9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:33.204364 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-94686d4f-84b2-47a6-b2e7-8f6c87c265d9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1724 microversion: 2.20 time: 0.430773 Jun 20 12:17:33.204926 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2096/4298] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:17:32 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1724 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:17:33.229394 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d740cd27-1e27-445f-8db3-86349fb9b92e tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:33.230018 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d740cd27-1e27-445f-8db3-86349fb9b92e tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] [instance: 80a28828-0d45-4c10-83e5-eda1a1d9f7ab] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:33.234890 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-7b52a51d-2e2e-4aee-b180-6c368954d1d8 req-91ec69bf-ea67-4e32-b477-a3ff2a625fe9 service nova] Creating event network-vif-plugged:552383e8-2c45-49dc-8d09-3a702564f66d for instance f65e72fa-4e88-44c5-bba1-0dc4f78eea47 on n-h2-master-1 Jun 20 12:17:33.244904 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d740cd27-1e27-445f-8db3-86349fb9b92e tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:33.245049 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d740cd27-1e27-445f-8db3-86349fb9b92e tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:33.245776 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d740cd27-1e27-445f-8db3-86349fb9b92e tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:33.248852 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d740cd27-1e27-445f-8db3-86349fb9b92e tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:33.259654 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-7b52a51d-2e2e-4aee-b180-6c368954d1d8 req-91ec69bf-ea67-4e32-b477-a3ff2a625fe9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103962 Jun 20 12:17:33.262219 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2203/4299] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:17:33.279880 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-55bb685c-547f-478f-b204-a7d4cd73a049 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:33.281755 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-55bb685c-547f-478f-b204-a7d4cd73a049 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] [instance: ce950356-da51-4847-96ba-76f575f7d9ab] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:33.292689 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-55bb685c-547f-478f-b204-a7d4cd73a049 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:33.293555 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-55bb685c-547f-478f-b204-a7d4cd73a049 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:33.294925 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-55bb685c-547f-478f-b204-a7d4cd73a049 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:33.295899 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-55bb685c-547f-478f-b204-a7d4cd73a049 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:33.480784 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d740cd27-1e27-445f-8db3-86349fb9b92e tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0049a642be6340e3b36fa6904fed5529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1effa9873ec7488da55676c454c4a1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:33.497261 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d740cd27-1e27-445f-8db3-86349fb9b92e tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] 10.222.0.27 "GET /compute/v2.1/servers/80a28828-0d45-4c10-83e5-eda1a1d9f7ab" status: 200 len: 1324 microversion: 2.1 time: 0.278061 Jun 20 12:17:33.497855 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2097/4300] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:33 2022] GET /compute/v2.1/servers/80a28828-0d45-4c10-83e5-eda1a1d9f7ab => generated 1324 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:33.509811 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-55bb685c-547f-478f-b204-a7d4cd73a049 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8919a400a671422593e94e0390c3d949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe714415c9e4c9b8cd739c5a9b1c8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:33.534316 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-066ebfa1-8d1e-4ef3-940d-6c47ce4acc01 req-c8132420-a37f-4d2f-84fd-699215823bdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81", "name": "network-vif-deleted", "tag": "bf346bca-5104-4d7c-bbcf-71f586401f26"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:17:33.545782 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-066ebfa1-8d1e-4ef3-940d-6c47ce4acc01 req-c8132420-a37f-4d2f-84fd-699215823bdd service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:33.545874 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-066ebfa1-8d1e-4ef3-940d-6c47ce4acc01 req-c8132420-a37f-4d2f-84fd-699215823bdd service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:33.547646 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-55bb685c-547f-478f-b204-a7d4cd73a049 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] 10.222.0.27 "GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab" status: 200 len: 1253 microversion: 2.1 time: 0.275393 Jun 20 12:17:33.548499 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2204/4301] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:33 2022] GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab => generated 1253 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:33.601088 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-066ebfa1-8d1e-4ef3-940d-6c47ce4acc01 req-c8132420-a37f-4d2f-84fd-699215823bdd service nova] Creating event network-vif-deleted:bf346bca-5104-4d7c-bbcf-71f586401f26 for instance d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81 on n-h1-master-1 Jun 20 12:17:33.614728 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8fffb370-053c-4d40-92bb-5bbeca25cb41 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:33.615634 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8fffb370-053c-4d40-92bb-5bbeca25cb41 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:33.627783 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-066ebfa1-8d1e-4ef3-940d-6c47ce4acc01 req-c8132420-a37f-4d2f-84fd-699215823bdd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096854 Jun 20 12:17:33.629004 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2098/4302] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:17:33.640619 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8fffb370-053c-4d40-92bb-5bbeca25cb41 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:33.643340 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8fffb370-053c-4d40-92bb-5bbeca25cb41 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:33.646508 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8fffb370-053c-4d40-92bb-5bbeca25cb41 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:33.650420 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8fffb370-053c-4d40-92bb-5bbeca25cb41 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:33.745352 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:17:33.790242 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ed081fe8-ff1f-41f5-a9c7-c6ac5f77303a tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:33.791864 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ed081fe8-ff1f-41f5-a9c7-c6ac5f77303a tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:33.804874 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed081fe8-ff1f-41f5-a9c7-c6ac5f77303a tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:33.815433 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed081fe8-ff1f-41f5-a9c7-c6ac5f77303a tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:33.816558 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed081fe8-ff1f-41f5-a9c7-c6ac5f77303a tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:33.819486 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed081fe8-ff1f-41f5-a9c7-c6ac5f77303a tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:33.927717 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed081fe8-ff1f-41f5-a9c7-c6ac5f77303a tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:33.928292 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed081fe8-ff1f-41f5-a9c7-c6ac5f77303a tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:33.928822 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-ed081fe8-ff1f-41f5-a9c7-c6ac5f77303a tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lazy-loading 'fault' on Instance uuid d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:17:34.043936 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ed081fe8-ff1f-41f5-a9c7-c6ac5f77303a tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:34.053535 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ed081fe8-ff1f-41f5-a9c7-c6ac5f77303a tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81" status: 200 len: 1310 microversion: 2.1 time: 0.267545 Jun 20 12:17:34.054124 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2099/4303] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:33 2022] GET /compute/v2.1/servers/d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81 => generated 1310 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:17:34.170559 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2ad44913-558a-491c-927c-f1eab050c522 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:34.171648 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2ad44913-558a-491c-927c-f1eab050c522 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: 9dc75474-7e3c-462c-b704-dd6f9e948190] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:34.180182 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2ad44913-558a-491c-927c-f1eab050c522 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:34.181033 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2ad44913-558a-491c-927c-f1eab050c522 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:34.182002 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2ad44913-558a-491c-927c-f1eab050c522 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:34.182601 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2ad44913-558a-491c-927c-f1eab050c522 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:34.509228 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2ad44913-558a-491c-927c-f1eab050c522 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b1b9bbe634eca989007e998c54271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:34.512156 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8fffb370-053c-4d40-92bb-5bbeca25cb41 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:34.524636 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8fffb370-053c-4d40-92bb-5bbeca25cb41 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1391 microversion: 2.1 time: 0.914020 Jun 20 12:17:34.524854 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2ad44913-558a-491c-927c-f1eab050c522 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190" status: 200 len: 1323 microversion: 2.1 time: 0.361121 Jun 20 12:17:34.534204 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2205/4304] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:33 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1391 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:34.534453 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2100/4305] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:34 2022] GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190 => generated 1323 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:34.538351 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8cfb4de0-3f19-4bed-a1b5-a22d75b8905d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:34.539097 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8cfb4de0-3f19-4bed-a1b5-a22d75b8905d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:34.539401 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cd0ad1c4-ade4-49c8-a1e2-d22b390d5b4c tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:34.540030 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cd0ad1c4-ade4-49c8-a1e2-d22b390d5b4c tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] [instance: 80a28828-0d45-4c10-83e5-eda1a1d9f7ab] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:34.547494 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8cfb4de0-3f19-4bed-a1b5-a22d75b8905d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:34.548046 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8cfb4de0-3f19-4bed-a1b5-a22d75b8905d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:34.549098 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8cfb4de0-3f19-4bed-a1b5-a22d75b8905d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:34.549711 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8cfb4de0-3f19-4bed-a1b5-a22d75b8905d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:34.554331 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cd0ad1c4-ade4-49c8-a1e2-d22b390d5b4c tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:34.554788 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cd0ad1c4-ade4-49c8-a1e2-d22b390d5b4c tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:34.555580 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cd0ad1c4-ade4-49c8-a1e2-d22b390d5b4c tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:34.556023 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cd0ad1c4-ade4-49c8-a1e2-d22b390d5b4c tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:34.822626 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8cfb4de0-3f19-4bed-a1b5-a22d75b8905d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:34.837446 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8cfb4de0-3f19-4bed-a1b5-a22d75b8905d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:34.839413 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8cfb4de0-3f19-4bed-a1b5-a22d75b8905d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:34.840838 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8cfb4de0-3f19-4bed-a1b5-a22d75b8905d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1657 microversion: 2.20 time: 0.309082 Jun 20 12:17:34.845080 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2206/4306] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:17:34 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1657 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:17:34.945992 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-cd0ad1c4-ade4-49c8-a1e2-d22b390d5b4c tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0049a642be6340e3b36fa6904fed5529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1effa9873ec7488da55676c454c4a1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:34.958925 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cd0ad1c4-ade4-49c8-a1e2-d22b390d5b4c tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] 10.222.0.27 "GET /compute/v2.1/servers/80a28828-0d45-4c10-83e5-eda1a1d9f7ab" status: 200 len: 1520 microversion: 2.1 time: 0.423387 Jun 20 12:17:34.979254 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2101/4307] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:34 2022] GET /compute/v2.1/servers/80a28828-0d45-4c10-83e5-eda1a1d9f7ab => generated 1520 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:34.992310 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-15b74f70-df37-4b1c-95be-926b8c4ea3d6 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:34.994494 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-15b74f70-df37-4b1c-95be-926b8c4ea3d6 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] [instance: ce950356-da51-4847-96ba-76f575f7d9ab] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:35.022648 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-15b74f70-df37-4b1c-95be-926b8c4ea3d6 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:35.024144 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-15b74f70-df37-4b1c-95be-926b8c4ea3d6 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:35.027156 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-15b74f70-df37-4b1c-95be-926b8c4ea3d6 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:35.027816 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-15b74f70-df37-4b1c-95be-926b8c4ea3d6 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:35.152822 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-37ed904f-29b0-4a58-be18-8ae9d46d7e3e req-6c22b776-5c72-42c8-b7fa-f0bbc484d2d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc", "name": "network-vif-deleted", "tag": "4b0b8cf9-ff46-4970-9b45-8795ce12a358"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:17:35.199003 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-37ed904f-29b0-4a58-be18-8ae9d46d7e3e req-6c22b776-5c72-42c8-b7fa-f0bbc484d2d5 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:35.199628 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-37ed904f-29b0-4a58-be18-8ae9d46d7e3e req-6c22b776-5c72-42c8-b7fa-f0bbc484d2d5 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:35.245345 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-37ed904f-29b0-4a58-be18-8ae9d46d7e3e req-6c22b776-5c72-42c8-b7fa-f0bbc484d2d5 service nova] Creating event network-vif-deleted:4b0b8cf9-ff46-4970-9b45-8795ce12a358 for instance 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc on n-h2-master-1 Jun 20 12:17:35.263811 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-37ed904f-29b0-4a58-be18-8ae9d46d7e3e req-6c22b776-5c72-42c8-b7fa-f0bbc484d2d5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.416940 Jun 20 12:17:35.264964 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2207/4308] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:17:35.280008 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dca0e725-ec22-4a43-a0a2-aefbff679257 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:35.280758 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dca0e725-ec22-4a43-a0a2-aefbff679257 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:35.297559 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dca0e725-ec22-4a43-a0a2-aefbff679257 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:35.298004 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dca0e725-ec22-4a43-a0a2-aefbff679257 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:35.298814 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dca0e725-ec22-4a43-a0a2-aefbff679257 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:35.299210 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dca0e725-ec22-4a43-a0a2-aefbff679257 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:35.318754 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-15b74f70-df37-4b1c-95be-926b8c4ea3d6 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8919a400a671422593e94e0390c3d949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe714415c9e4c9b8cd739c5a9b1c8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:35.325465 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-dca0e725-ec22-4a43-a0a2-aefbff679257 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] HTTP exception thrown: Instance d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81 could not be found. Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dca0e725-ec22-4a43-a0a2-aefbff679257 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Request method failure captured: Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81 HTTP/1.1 Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGUEJ-D3cMf8np4O7Ms7hRd-YKCdqhmLqICiccL3zHTo-mNHRTE9UAnkQiAFCeKUH7R-BxtEgjFgxhA5ywx9NzsuBVxraIVMNHwokfVvByaZiGuIX4x2kMrBf7DOtYjxgfgFZThIf5DM_iWPYpnzfv3Kba2D0yYjkxvVqYzsldQlRbY Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 3103ed818db8417b8625af13e7176910 Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ListServerFiltersTestJSON-351319595 Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3103ed818db8417b8625af13e7176910"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3103ed818db8417b8625af13e7176910"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3103ed818db8417b8625af13e7176910"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3103ed818db8417b8625af13e7176910"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ListServerFiltersTestJSON-351319595 Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 3103ed818db8417b8625af13e7176910 Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-351319595 Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ListServerFiltersTestJSON-351319595-project Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 0c8324eb1db74653853a415b56b43fce Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ListServerFiltersTestJSON-351319595-project Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: exception: Instance d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81 could not be found. Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'd632d7e4-0eb6-42e6-8c5d-8ec7919bcc81'} Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81 could not be found. Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81 could not be found. Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:35.327208 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:35.333874 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:35.333874 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:35.333874 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:35.333874 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:17:35.333874 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:17:35.333874 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81 could not be found. Jun 20 12:17:35.333874 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:35.333874 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dca0e725-ec22-4a43-a0a2-aefbff679257 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Returning 404 to user: Instance d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:17:35.344512 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dca0e725-ec22-4a43-a0a2-aefbff679257 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81" status: 404 len: 111 microversion: 2.1 time: 0.062297 Jun 20 12:17:35.344512 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2208/4309] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:35 2022] GET /compute/v2.1/servers/d632d7e4-0eb6-42e6-8c5d-8ec7919bcc81 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:17:35.349568 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4758c17d-97ba-4f93-9b4b-0f3910539b96 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-663529625", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "480b91c2-5307-484e-a555-9e3731238292"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4758c17d-97ba-4f93-9b4b-0f3910539b96 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Request method failure captured: Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 242 Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGVAHSHnKJXJcep4ukIs0J20X8LcPFeE8yoKkDwTInucsT-WCJa5zGnLn77QRgr8F0SGiQxc7bxzwnaSdQ5sWpWmbNu7m-65DlJUetexmA7tHMHYpbbbUmWExhok4iFAbEwEmBxSeT2o5qnHRFDQlY3vJjXZp3H2HwtcagLIsmWqhj8 Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 1effa9873ec7488da55676c454c4a1b4 Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-860081247 Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1effa9873ec7488da55676c454c4a1b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1effa9873ec7488da55676c454c4a1b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1effa9873ec7488da55676c454c4a1b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1effa9873ec7488da55676c454c4a1b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-860081247 Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 1effa9873ec7488da55676c454c4a1b4 Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-860081247 Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServerMetadataNegativeTestJSON-860081247-project Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 0049a642be6340e3b36fa6904fed5529 Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-860081247-project Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-663529625", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "480b91c2-5307-484e-a555-9e3731238292"}]}} Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-663529625', 'imageRef': 'f16836cc-4e18-4bd0-b261-3865adf8cb83', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '480b91c2-5307-484e-a555-9e3731238292'}]}}} Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise error Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi {'': 'data1'} Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:17:35.352430 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:17:35.356678 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 12:17:35.356678 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 12:17:35.356678 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 12:17:35.356678 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 12:17:35.356678 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 12:17:35.356678 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 12:17:35.356678 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 20 12:17:35.356678 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:35.356678 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:35.356678 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:35.356678 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:35.356678 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:35.356678 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:35.356678 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 12:17:35.356678 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 12:17:35.356678 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 20 12:17:35.356678 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:35.356678 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4758c17d-97ba-4f93-9b4b-0f3910539b96 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:17:35.356678 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4758c17d-97ba-4f93-9b4b-0f3910539b96 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.008402 Jun 20 12:17:35.356678 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2209/4310] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:17:35 2022] POST /compute/v2.1/servers => generated 175 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:17:35.359076 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-15b74f70-df37-4b1c-95be-926b8c4ea3d6 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] 10.222.0.27 "GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab" status: 200 len: 1253 microversion: 2.1 time: 0.371234 Jun 20 12:17:35.359900 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-41a35c7e-266a-4635-b3d4-01560a0ff41d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:35.361867 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2102/4311] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:34 2022] GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab => generated 1253 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:35.377013 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-41a35c7e-266a-4635-b3d4-01560a0ff41d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 1e05048b-621f-4819-a11a-e0d077f7d563] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:35.378213 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-321cf51f-38d4-49d3-b571-247556dfb3c6 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:35.380058 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-321cf51f-38d4-49d3-b571-247556dfb3c6 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] [instance: b31eb04e-2d63-4949-bdb2-491a49546c95] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:35.386631 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-321cf51f-38d4-49d3-b571-247556dfb3c6 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] HTTP exception thrown: Instance b31eb04e-2d63-4949-bdb2-491a49546c95 could not be found. Jun 20 12:17:35.391386 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-41a35c7e-266a-4635-b3d4-01560a0ff41d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:35.391955 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-41a35c7e-266a-4635-b3d4-01560a0ff41d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:35.392860 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-41a35c7e-266a-4635-b3d4-01560a0ff41d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:35.393522 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-41a35c7e-266a-4635-b3d4-01560a0ff41d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-321cf51f-38d4-49d3-b571-247556dfb3c6 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Request method failure captured: Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/b31eb04e-2d63-4949-bdb2-491a49546c95/metadata HTTP/1.1 Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGVAHSHnKJXJcep4ukIs0J20X8LcPFeE8yoKkDwTInucsT-WCJa5zGnLn77QRgr8F0SGiQxc7bxzwnaSdQ5sWpWmbNu7m-65DlJUetexmA7tHMHYpbbbUmWExhok4iFAbEwEmBxSeT2o5qnHRFDQlY3vJjXZp3H2HwtcagLIsmWqhj8 Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 1effa9873ec7488da55676c454c4a1b4 Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-860081247 Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1effa9873ec7488da55676c454c4a1b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1effa9873ec7488da55676c454c4a1b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1effa9873ec7488da55676c454c4a1b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1effa9873ec7488da55676c454c4a1b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-860081247 Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 1effa9873ec7488da55676c454c4a1b4 Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-860081247 Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServerMetadataNegativeTestJSON-860081247-project Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 0049a642be6340e3b36fa6904fed5529 Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-860081247-project Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: exception: Instance b31eb04e-2d63-4949-bdb2-491a49546c95 could not be found. Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: action_args: {'server_id': 'b31eb04e-2d63-4949-bdb2-491a49546c95'} Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b31eb04e-2d63-4949-bdb2-491a49546c95 could not be found. Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b31eb04e-2d63-4949-bdb2-491a49546c95 could not be found. Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:35.396457 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:35.411590 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:17:35.411590 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:17:35.411590 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b31eb04e-2d63-4949-bdb2-491a49546c95 could not be found. Jun 20 12:17:35.411590 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:35.411590 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-321cf51f-38d4-49d3-b571-247556dfb3c6 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Returning 404 to user: Instance b31eb04e-2d63-4949-bdb2-491a49546c95 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:17:35.411590 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-321cf51f-38d4-49d3-b571-247556dfb3c6 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] 10.222.0.27 "GET /compute/v2.1/servers/b31eb04e-2d63-4949-bdb2-491a49546c95/metadata" status: 404 len: 111 microversion: 2.1 time: 0.027830 Jun 20 12:17:35.411590 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2103/4312] 10.222.0.27 () {58 vars in 1262 bytes} [Mon Jun 20 12:17:35 2022] GET /compute/v2.1/servers/b31eb04e-2d63-4949-bdb2-491a49546c95/metadata => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:17:35.469753 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-41a35c7e-266a-4635-b3d4-01560a0ff41d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 1e05048b-621f-4819-a11a-e0d077f7d563] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:17:35.524768 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bb4bf17c-9972-4561-98db-6016dcead724 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-177982124", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "480b91c2-5307-484e-a555-9e3731238292"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bb4bf17c-9972-4561-98db-6016dcead724 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Request method failure captured: Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 498 Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGVAHSHnKJXJcep4ukIs0J20X8LcPFeE8yoKkDwTInucsT-WCJa5zGnLn77QRgr8F0SGiQxc7bxzwnaSdQ5sWpWmbNu7m-65DlJUetexmA7tHMHYpbbbUmWExhok4iFAbEwEmBxSeT2o5qnHRFDQlY3vJjXZp3H2HwtcagLIsmWqhj8 Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 1effa9873ec7488da55676c454c4a1b4 Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-860081247 Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1effa9873ec7488da55676c454c4a1b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1effa9873ec7488da55676c454c4a1b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1effa9873ec7488da55676c454c4a1b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1effa9873ec7488da55676c454c4a1b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-860081247 Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 1effa9873ec7488da55676c454c4a1b4 Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-860081247 Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServerMetadataNegativeTestJSON-860081247-project Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 0049a642be6340e3b36fa6904fed5529 Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-860081247-project Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-177982124", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "480b91c2-5307-484e-a555-9e3731238292"}]}} Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-177982124', 'imageRef': 'f16836cc-4e18-4bd0-b261-3865adf8cb83', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '480b91c2-5307-484e-a555-9e3731238292'}]}}} Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise error Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 20 12:17:35.528309 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 20 12:17:35.531050 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:35.531050 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 20 12:17:35.531050 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jun 20 12:17:35.531050 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:35.531050 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:35.531050 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:35.531050 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:35.531050 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:35.531050 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:35.531050 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:17:35.531050 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:17:35.531050 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:17:35.531050 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:17:35.531050 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:17:35.531050 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:17:35.531050 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 12:17:35.531050 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 12:17:35.531050 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 12:17:35.531050 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 12:17:35.531050 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 12:17:35.531050 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 12:17:35.531050 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 20 12:17:35.531050 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:35.531050 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:35.531050 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:35.531050 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:35.531050 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:35.531050 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:35.531050 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 12:17:35.531050 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 12:17:35.531050 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 20 12:17:35.531050 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:35.536322 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bb4bf17c-9972-4561-98db-6016dcead724 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:17:35.537748 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bb4bf17c-9972-4561-98db-6016dcead724 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.018400 Jun 20 12:17:35.541492 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2104/4313] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:17:35 2022] POST /compute/v2.1/servers => generated 687 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:17:35.564822 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d7a5e7b8-523b-4008-91e4-286e60a20104 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:35.567826 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d7a5e7b8-523b-4008-91e4-286e60a20104 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: 9dc75474-7e3c-462c-b704-dd6f9e948190] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:35.579441 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d7a5e7b8-523b-4008-91e4-286e60a20104 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:35.580309 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d7a5e7b8-523b-4008-91e4-286e60a20104 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:35.581321 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d7a5e7b8-523b-4008-91e4-286e60a20104 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:35.581979 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d7a5e7b8-523b-4008-91e4-286e60a20104 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:35.718098 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-41a35c7e-266a-4635-b3d4-01560a0ff41d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563" status: 204 len: 0 microversion: 2.1 time: 0.361570 Jun 20 12:17:35.718901 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2210/4314] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:17:35 2022] DELETE /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:17:35.724409 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c6796754-dc58-46cb-a3a4-8b200ddd3b9b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:35.725136 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c6796754-dc58-46cb-a3a4-8b200ddd3b9b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:35.735632 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6796754-dc58-46cb-a3a4-8b200ddd3b9b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:35.737039 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6796754-dc58-46cb-a3a4-8b200ddd3b9b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:35.738194 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6796754-dc58-46cb-a3a4-8b200ddd3b9b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:35.739119 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6796754-dc58-46cb-a3a4-8b200ddd3b9b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:35.833723 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d7a5e7b8-523b-4008-91e4-286e60a20104 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b1b9bbe634eca989007e998c54271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:35.843116 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d7a5e7b8-523b-4008-91e4-286e60a20104 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190" status: 200 len: 1323 microversion: 2.1 time: 0.289405 Jun 20 12:17:35.843750 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2105/4315] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:35 2022] GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190 => generated 1323 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:35.858041 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5f081dd7-23d6-475d-9bd6-04b9d2233d60 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-325937144", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "480b91c2-5307-484e-a555-9e3731238292"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5f081dd7-23d6-475d-9bd6-04b9d2233d60 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Request method failure captured: Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 499 Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGVAHSHnKJXJcep4ukIs0J20X8LcPFeE8yoKkDwTInucsT-WCJa5zGnLn77QRgr8F0SGiQxc7bxzwnaSdQ5sWpWmbNu7m-65DlJUetexmA7tHMHYpbbbUmWExhok4iFAbEwEmBxSeT2o5qnHRFDQlY3vJjXZp3H2HwtcagLIsmWqhj8 Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 1effa9873ec7488da55676c454c4a1b4 Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-860081247 Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1effa9873ec7488da55676c454c4a1b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1effa9873ec7488da55676c454c4a1b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1effa9873ec7488da55676c454c4a1b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1effa9873ec7488da55676c454c4a1b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-860081247 Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 1effa9873ec7488da55676c454c4a1b4 Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-860081247 Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServerMetadataNegativeTestJSON-860081247-project Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 0049a642be6340e3b36fa6904fed5529 Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-860081247-project Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-325937144", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "480b91c2-5307-484e-a555-9e3731238292"}]}} Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-325937144', 'imageRef': 'f16836cc-4e18-4bd0-b261-3865adf8cb83', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '480b91c2-5307-484e-a555-9e3731238292'}]}}} Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise error Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 20 12:17:35.861595 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 20 12:17:35.864560 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:35.864560 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 20 12:17:35.864560 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jun 20 12:17:35.864560 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:35.864560 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:35.864560 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:35.864560 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:35.864560 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:35.864560 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:35.864560 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:17:35.864560 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:17:35.864560 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:17:35.864560 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:17:35.864560 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:17:35.864560 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:17:35.864560 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 12:17:35.864560 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 12:17:35.864560 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 12:17:35.864560 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 12:17:35.864560 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 12:17:35.864560 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 12:17:35.864560 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 20 12:17:35.864560 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:35.864560 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:35.864560 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:35.864560 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:35.864560 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:35.864560 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:35.864560 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 12:17:35.864560 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 12:17:35.864560 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 20 12:17:35.864560 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:35.871000 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5f081dd7-23d6-475d-9bd6-04b9d2233d60 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:17:35.871000 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5f081dd7-23d6-475d-9bd6-04b9d2233d60 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.015305 Jun 20 12:17:35.872772 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2106/4316] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:17:35 2022] POST /compute/v2.1/servers => generated 689 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:17:35.889711 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1a08d562-ed3b-4b09-acd6-49068d33a530 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:35.890335 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1a08d562-ed3b-4b09-acd6-49068d33a530 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 1e05048b-621f-4819-a11a-e0d077f7d563] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:35.899097 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a08d562-ed3b-4b09-acd6-49068d33a530 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:35.899569 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a08d562-ed3b-4b09-acd6-49068d33a530 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:35.900371 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a08d562-ed3b-4b09-acd6-49068d33a530 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:35.901021 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a08d562-ed3b-4b09-acd6-49068d33a530 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:36.078182 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c6796754-dc58-46cb-a3a4-8b200ddd3b9b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:36.098391 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c6796754-dc58-46cb-a3a4-8b200ddd3b9b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1391 microversion: 2.1 time: 0.377893 Jun 20 12:17:36.111542 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2211/4317] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:35 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1391 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:36.118909 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c36f6a35-9c56-4bef-8568-071d5d1bc691 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:36.120637 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c36f6a35-9c56-4bef-8568-071d5d1bc691 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:36.128034 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1a08d562-ed3b-4b09-acd6-49068d33a530 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:36.143148 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1a08d562-ed3b-4b09-acd6-49068d33a530 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563" status: 200 len: 1517 microversion: 2.1 time: 0.268341 Jun 20 12:17:36.144435 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c36f6a35-9c56-4bef-8568-071d5d1bc691 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:36.145454 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c36f6a35-9c56-4bef-8568-071d5d1bc691 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:36.146927 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c36f6a35-9c56-4bef-8568-071d5d1bc691 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:36.150154 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2107/4318] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:35 2022] GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563 => generated 1517 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:36.151108 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c36f6a35-9c56-4bef-8568-071d5d1bc691 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:36.161128 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f8c12e3b-791a-4850-832d-78d2fa3d4f68 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-584729188", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "480b91c2-5307-484e-a555-9e3731238292"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:17:36.165128 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f8c12e3b-791a-4850-832d-78d2fa3d4f68 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Request method failure captured: Jun 20 12:17:36.165128 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 20 12:17:36.165128 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:17:36.165128 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:17:36.165128 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:17:36.165128 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 753 Jun 20 12:17:36.165128 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:17:36.165128 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:17:36.165128 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:17:36.165128 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:17:36.165128 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGVAHSHnKJXJcep4ukIs0J20X8LcPFeE8yoKkDwTInucsT-WCJa5zGnLn77QRgr8F0SGiQxc7bxzwnaSdQ5sWpWmbNu7m-65DlJUetexmA7tHMHYpbbbUmWExhok4iFAbEwEmBxSeT2o5qnHRFDQlY3vJjXZp3H2HwtcagLIsmWqhj8 Jun 20 12:17:36.165128 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:17:36.165128 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:17:36.165128 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:17:36.165128 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:17:36.165128 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:17:36.165128 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:17:36.165128 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 1effa9873ec7488da55676c454c4a1b4 Jun 20 12:17:36.165128 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-860081247 Jun 20 12:17:36.165128 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:17:36.165128 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:17:36.165128 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1effa9873ec7488da55676c454c4a1b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1effa9873ec7488da55676c454c4a1b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1effa9873ec7488da55676c454c4a1b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1effa9873ec7488da55676c454c4a1b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:17:36.165128 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-860081247 Jun 20 12:17:36.165128 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 1effa9873ec7488da55676c454c4a1b4 Jun 20 12:17:36.165128 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-860081247 Jun 20 12:17:36.165128 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServerMetadataNegativeTestJSON-860081247-project Jun 20 12:17:36.165128 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:17:36.165128 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:17:36.165128 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 0049a642be6340e3b36fa6904fed5529 Jun 20 12:17:36.165128 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-860081247-project Jun 20 12:17:36.165128 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:17:36.165128 n-d-master-1 devstack@n-api.service[119128]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-584729188", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "480b91c2-5307-484e-a555-9e3731238292"}]}} Jun 20 12:17:36.165128 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:17:36.165128 n-d-master-1 devstack@n-api.service[119128]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 20 12:17:36.165128 n-d-master-1 devstack@n-api.service[119128]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-584729188', 'imageRef': 'f16836cc-4e18-4bd0-b261-3865adf8cb83', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '480b91c2-5307-484e-a555-9e3731238292'}]}}} Jun 20 12:17:36.165128 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:17:36.165128 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:36.165128 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 12:17:36.165128 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 12:17:36.165128 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 12:17:36.167473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise error Jun 20 12:17:36.167473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 20 12:17:36.167473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:36.167473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jun 20 12:17:36.167473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 20 12:17:36.167473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 20 12:17:36.167473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 20 12:17:36.167473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 20 12:17:36.167473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:36.167473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 20 12:17:36.167473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jun 20 12:17:36.167473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:36.167473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:36.167473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:36.167473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:36.167473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:36.167473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:36.167473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:17:36.167473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:17:36.167473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:17:36.167473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:17:36.167473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:17:36.167473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:17:36.167473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 12:17:36.167473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 12:17:36.167473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 12:17:36.167473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 12:17:36.167473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 12:17:36.167473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 12:17:36.167473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 20 12:17:36.167473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:36.167473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:36.167473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:36.167473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:36.167473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:36.167473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:36.167473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 12:17:36.167473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 12:17:36.171098 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 20 12:17:36.171098 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:36.173026 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f8c12e3b-791a-4850-832d-78d2fa3d4f68 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:17:36.174122 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f8c12e3b-791a-4850-832d-78d2fa3d4f68 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.022912 Jun 20 12:17:36.174920 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2108/4319] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:17:36 2022] POST /compute/v2.1/servers => generated 1197 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jun 20 12:17:36.220123 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c36f6a35-9c56-4bef-8568-071d5d1bc691 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:36.220930 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c36f6a35-9c56-4bef-8568-071d5d1bc691 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:36.221715 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-c36f6a35-9c56-4bef-8568-071d5d1bc691 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lazy-loading 'fault' on Instance uuid 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:17:36.258906 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9d3738b2-6b29-4ec2-884e-c399a6206083 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1684661953", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "480b91c2-5307-484e-a555-9e3731238292"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:17:36.265688 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9d3738b2-6b29-4ec2-884e-c399a6206083 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Request method failure captured: Jun 20 12:17:36.265688 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 20 12:17:36.265688 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:17:36.265688 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:17:36.265688 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:17:36.265688 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 1266 Jun 20 12:17:36.265688 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:17:36.265688 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:17:36.265688 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:17:36.265688 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:17:36.265688 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGVAHSHnKJXJcep4ukIs0J20X8LcPFeE8yoKkDwTInucsT-WCJa5zGnLn77QRgr8F0SGiQxc7bxzwnaSdQ5sWpWmbNu7m-65DlJUetexmA7tHMHYpbbbUmWExhok4iFAbEwEmBxSeT2o5qnHRFDQlY3vJjXZp3H2HwtcagLIsmWqhj8 Jun 20 12:17:36.265688 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:17:36.265688 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:17:36.265688 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:17:36.265688 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:17:36.265688 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:17:36.265688 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:17:36.265688 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 1effa9873ec7488da55676c454c4a1b4 Jun 20 12:17:36.265688 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-860081247 Jun 20 12:17:36.265688 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:17:36.265688 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:17:36.265688 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1effa9873ec7488da55676c454c4a1b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1effa9873ec7488da55676c454c4a1b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1effa9873ec7488da55676c454c4a1b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1effa9873ec7488da55676c454c4a1b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:17:36.265688 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-860081247 Jun 20 12:17:36.265688 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 1effa9873ec7488da55676c454c4a1b4 Jun 20 12:17:36.265688 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-860081247 Jun 20 12:17:36.265688 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServerMetadataNegativeTestJSON-860081247-project Jun 20 12:17:36.265688 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:17:36.265688 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:17:36.265688 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 0049a642be6340e3b36fa6904fed5529 Jun 20 12:17:36.265688 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-860081247-project Jun 20 12:17:36.265688 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:17:36.265688 n-d-master-1 devstack@n-api.service[119128]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1684661953", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "480b91c2-5307-484e-a555-9e3731238292"}]}} Jun 20 12:17:36.265688 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:17:36.269180 n-d-master-1 devstack@n-api.service[119128]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 20 12:17:36.269180 n-d-master-1 devstack@n-api.service[119128]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1684661953', 'imageRef': 'f16836cc-4e18-4bd0-b261-3865adf8cb83', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '480b91c2-5307-484e-a555-9e3731238292'}]}}} Jun 20 12:17:36.269180 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:17:36.269180 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:36.269180 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 12:17:36.269180 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 12:17:36.269180 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 12:17:36.269180 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise error Jun 20 12:17:36.269180 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 20 12:17:36.269180 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:36.269180 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jun 20 12:17:36.269180 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 20 12:17:36.269180 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 20 12:17:36.269180 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 20 12:17:36.269180 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 20 12:17:36.269180 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:36.269180 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 20 12:17:36.271034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jun 20 12:17:36.271034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:36.271034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:36.271034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:36.271034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:36.271034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:36.271034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:36.271034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:17:36.271034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:17:36.271034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:17:36.271034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:17:36.271034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:17:36.271034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:17:36.271034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 12:17:36.271034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 12:17:36.271034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 12:17:36.271034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 12:17:36.271034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 12:17:36.271034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 12:17:36.271034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 20 12:17:36.271034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:36.271034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:36.271034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:36.271034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:36.271034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:36.271034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:36.271034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 12:17:36.271034 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 12:17:36.275170 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 20 12:17:36.275170 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:36.277519 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9d3738b2-6b29-4ec2-884e-c399a6206083 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:17:36.279097 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9d3738b2-6b29-4ec2-884e-c399a6206083 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.027012 Jun 20 12:17:36.285261 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2109/4320] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Jun 20 12:17:36 2022] POST /compute/v2.1/servers => generated 2221 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jun 20 12:17:36.297302 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1967f485-742b-4597-992d-ffec3fd58a33 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:36.298924 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1967f485-742b-4597-992d-ffec3fd58a33 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] [instance: 4f40be1d-14f4-4323-8f38-f002bd2bc75b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:36.306733 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-1967f485-742b-4597-992d-ffec3fd58a33 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] HTTP exception thrown: Instance 4f40be1d-14f4-4323-8f38-f002bd2bc75b could not be found. Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1967f485-742b-4597-992d-ffec3fd58a33 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Request method failure captured: Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/4f40be1d-14f4-4323-8f38-f002bd2bc75b/metadata/test2 HTTP/1.1 Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGVAHSHnKJXJcep4ukIs0J20X8LcPFeE8yoKkDwTInucsT-WCJa5zGnLn77QRgr8F0SGiQxc7bxzwnaSdQ5sWpWmbNu7m-65DlJUetexmA7tHMHYpbbbUmWExhok4iFAbEwEmBxSeT2o5qnHRFDQlY3vJjXZp3H2HwtcagLIsmWqhj8 Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 1effa9873ec7488da55676c454c4a1b4 Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-860081247 Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1effa9873ec7488da55676c454c4a1b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1effa9873ec7488da55676c454c4a1b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1effa9873ec7488da55676c454c4a1b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1effa9873ec7488da55676c454c4a1b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-860081247 Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 1effa9873ec7488da55676c454c4a1b4 Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-860081247 Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServerMetadataNegativeTestJSON-860081247-project Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 0049a642be6340e3b36fa6904fed5529 Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-860081247-project Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 4f40be1d-14f4-4323-8f38-f002bd2bc75b could not be found. Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: action_args: {'server_id': '4f40be1d-14f4-4323-8f38-f002bd2bc75b', 'id': 'test2'} Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f40be1d-14f4-4323-8f38-f002bd2bc75b could not be found. Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f40be1d-14f4-4323-8f38-f002bd2bc75b could not be found. Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:36.309149 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:36.313539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:17:36.313539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:17:36.313539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f40be1d-14f4-4323-8f38-f002bd2bc75b could not be found. Jun 20 12:17:36.313539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:36.313539 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1967f485-742b-4597-992d-ffec3fd58a33 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Returning 404 to user: Instance 4f40be1d-14f4-4323-8f38-f002bd2bc75b could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:17:36.314110 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1967f485-742b-4597-992d-ffec3fd58a33 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] 10.222.0.27 "GET /compute/v2.1/servers/4f40be1d-14f4-4323-8f38-f002bd2bc75b/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.024003 Jun 20 12:17:36.316266 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2110/4321] 10.222.0.27 () {58 vars in 1280 bytes} [Mon Jun 20 12:17:36 2022] GET /compute/v2.1/servers/4f40be1d-14f4-4323-8f38-f002bd2bc75b/metadata/test2 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:17:36.335640 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-528067ab-4761-441c-8cbe-bfd5594a3183 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:36.336448 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-528067ab-4761-441c-8cbe-bfd5594a3183 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] [instance: 80a28828-0d45-4c10-83e5-eda1a1d9f7ab] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:36.347565 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-528067ab-4761-441c-8cbe-bfd5594a3183 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:36.348666 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-528067ab-4761-441c-8cbe-bfd5594a3183 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:36.350850 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-528067ab-4761-441c-8cbe-bfd5594a3183 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:36.351814 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-528067ab-4761-441c-8cbe-bfd5594a3183 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:36.387786 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-528067ab-4761-441c-8cbe-bfd5594a3183 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] [instance: 80a28828-0d45-4c10-83e5-eda1a1d9f7ab] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:17:36.388875 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c36f6a35-9c56-4bef-8568-071d5d1bc691 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:36.417721 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c36f6a35-9c56-4bef-8568-071d5d1bc691 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:36.420759 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c36f6a35-9c56-4bef-8568-071d5d1bc691 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:36.424424 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c36f6a35-9c56-4bef-8568-071d5d1bc691 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1372 microversion: 2.20 time: 0.309164 Jun 20 12:17:36.425246 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2212/4322] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:17:36 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1372 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:17:36.430542 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-86ba3f5f-67ac-47a3-af34-930e9b005961 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:36.431155 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-86ba3f5f-67ac-47a3-af34-930e9b005961 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] [instance: ce950356-da51-4847-96ba-76f575f7d9ab] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:36.452755 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86ba3f5f-67ac-47a3-af34-930e9b005961 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:36.453268 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86ba3f5f-67ac-47a3-af34-930e9b005961 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:36.454161 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86ba3f5f-67ac-47a3-af34-930e9b005961 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:36.454608 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86ba3f5f-67ac-47a3-af34-930e9b005961 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:36.522122 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-528067ab-4761-441c-8cbe-bfd5594a3183 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] 10.222.0.27 "DELETE /compute/v2.1/servers/80a28828-0d45-4c10-83e5-eda1a1d9f7ab" status: 204 len: 0 microversion: 2.1 time: 0.193834 Jun 20 12:17:36.528540 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2111/4323] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:17:36 2022] DELETE /compute/v2.1/servers/80a28828-0d45-4c10-83e5-eda1a1d9f7ab => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:17:36.535591 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-716be8a0-64f6-4651-9341-c6bb00445ecb tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:36.537119 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-716be8a0-64f6-4651-9341-c6bb00445ecb tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] [instance: 80a28828-0d45-4c10-83e5-eda1a1d9f7ab] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:36.546190 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-716be8a0-64f6-4651-9341-c6bb00445ecb tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:36.546731 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-716be8a0-64f6-4651-9341-c6bb00445ecb tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:36.547643 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-716be8a0-64f6-4651-9341-c6bb00445ecb tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:36.548243 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-716be8a0-64f6-4651-9341-c6bb00445ecb tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:36.571909 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:17:36.629254 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-86ba3f5f-67ac-47a3-af34-930e9b005961 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8919a400a671422593e94e0390c3d949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe714415c9e4c9b8cd739c5a9b1c8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:36.641938 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-86ba3f5f-67ac-47a3-af34-930e9b005961 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] 10.222.0.27 "GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab" status: 200 len: 1253 microversion: 2.1 time: 0.215677 Jun 20 12:17:36.643217 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2213/4324] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:36 2022] GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab => generated 1253 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:36.774705 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-716be8a0-64f6-4651-9341-c6bb00445ecb tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0049a642be6340e3b36fa6904fed5529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1effa9873ec7488da55676c454c4a1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:36.818330 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-716be8a0-64f6-4651-9341-c6bb00445ecb tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] 10.222.0.27 "GET /compute/v2.1/servers/80a28828-0d45-4c10-83e5-eda1a1d9f7ab" status: 200 len: 1526 microversion: 2.1 time: 0.287026 Jun 20 12:17:36.819919 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2112/4325] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:36 2022] GET /compute/v2.1/servers/80a28828-0d45-4c10-83e5-eda1a1d9f7ab => generated 1526 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:36.862741 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9f2798f9-7342-4f8a-b081-9d49714291ea tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:36.864950 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9f2798f9-7342-4f8a-b081-9d49714291ea tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: 9dc75474-7e3c-462c-b704-dd6f9e948190] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:36.875135 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9f2798f9-7342-4f8a-b081-9d49714291ea tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:36.876718 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9f2798f9-7342-4f8a-b081-9d49714291ea tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:36.877842 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9f2798f9-7342-4f8a-b081-9d49714291ea tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:36.878560 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9f2798f9-7342-4f8a-b081-9d49714291ea tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:37.129231 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-29d2f662-71f5-4ba4-a8e6-77831b5b3e82 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:37.130436 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-29d2f662-71f5-4ba4-a8e6-77831b5b3e82 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:37.140776 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-29d2f662-71f5-4ba4-a8e6-77831b5b3e82 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:37.141543 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-29d2f662-71f5-4ba4-a8e6-77831b5b3e82 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:37.142874 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-29d2f662-71f5-4ba4-a8e6-77831b5b3e82 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:37.143914 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-29d2f662-71f5-4ba4-a8e6-77831b5b3e82 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:37.229293 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9f2798f9-7342-4f8a-b081-9d49714291ea tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b1b9bbe634eca989007e998c54271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:37.241071 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9f2798f9-7342-4f8a-b081-9d49714291ea tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190" status: 200 len: 1323 microversion: 2.1 time: 0.384005 Jun 20 12:17:37.244335 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2214/4326] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:36 2022] GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190 => generated 1323 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:37.252044 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-aa5ff8d9-8bd1-4d8e-a0a5-7588c7636e3d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:37.254601 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-aa5ff8d9-8bd1-4d8e-a0a5-7588c7636e3d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 1e05048b-621f-4819-a11a-e0d077f7d563] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:37.278490 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa5ff8d9-8bd1-4d8e-a0a5-7588c7636e3d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:37.278933 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa5ff8d9-8bd1-4d8e-a0a5-7588c7636e3d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:37.279889 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa5ff8d9-8bd1-4d8e-a0a5-7588c7636e3d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:37.282091 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa5ff8d9-8bd1-4d8e-a0a5-7588c7636e3d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:37.356021 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-29d2f662-71f5-4ba4-a8e6-77831b5b3e82 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:37.368753 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-29d2f662-71f5-4ba4-a8e6-77831b5b3e82 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1391 microversion: 2.1 time: 0.245220 Jun 20 12:17:37.380643 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2113/4327] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:37 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1391 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:37.451268 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-37f867d2-8d2c-402e-97d1-8738eb204c3f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:37.452777 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-37f867d2-8d2c-402e-97d1-8738eb204c3f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:37.465876 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-37f867d2-8d2c-402e-97d1-8738eb204c3f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:37.466418 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-37f867d2-8d2c-402e-97d1-8738eb204c3f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:37.467358 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-37f867d2-8d2c-402e-97d1-8738eb204c3f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:37.468024 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-37f867d2-8d2c-402e-97d1-8738eb204c3f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:37.589745 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-aa5ff8d9-8bd1-4d8e-a0a5-7588c7636e3d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:37.591197 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-37f867d2-8d2c-402e-97d1-8738eb204c3f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:37.593392 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-37f867d2-8d2c-402e-97d1-8738eb204c3f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:37.594237 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-37f867d2-8d2c-402e-97d1-8738eb204c3f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lazy-loading 'fault' on Instance uuid 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:17:37.599876 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-aa5ff8d9-8bd1-4d8e-a0a5-7588c7636e3d tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563" status: 200 len: 1517 microversion: 2.1 time: 0.353045 Jun 20 12:17:37.611801 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2215/4328] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:37 2022] GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563 => generated 1517 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:37.659822 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7d26d18a-5e26-40a8-9244-185109f63f75 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:37.660664 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7d26d18a-5e26-40a8-9244-185109f63f75 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] [instance: ce950356-da51-4847-96ba-76f575f7d9ab] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:37.662650 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-37f867d2-8d2c-402e-97d1-8738eb204c3f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:37.672491 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7d26d18a-5e26-40a8-9244-185109f63f75 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:37.672704 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-37f867d2-8d2c-402e-97d1-8738eb204c3f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:37.673689 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7d26d18a-5e26-40a8-9244-185109f63f75 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:37.674885 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-37f867d2-8d2c-402e-97d1-8738eb204c3f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:37.675697 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7d26d18a-5e26-40a8-9244-185109f63f75 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:37.676568 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7d26d18a-5e26-40a8-9244-185109f63f75 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:37.677485 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-37f867d2-8d2c-402e-97d1-8738eb204c3f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 200 len: 1372 microversion: 2.20 time: 0.234771 Jun 20 12:17:37.688836 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2114/4329] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:17:37 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 1372 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:17:37.808815 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7d26d18a-5e26-40a8-9244-185109f63f75 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8919a400a671422593e94e0390c3d949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe714415c9e4c9b8cd739c5a9b1c8b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:37.818444 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7d26d18a-5e26-40a8-9244-185109f63f75 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] 10.222.0.27 "GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab" status: 200 len: 1253 microversion: 2.1 time: 0.162752 Jun 20 12:17:37.819460 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2216/4330] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:37 2022] GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab => generated 1253 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:37.839753 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3f68ac38-d85d-4611-b285-502be4a8fdd7 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:37.840756 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3f68ac38-d85d-4611-b285-502be4a8fdd7 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] [instance: 80a28828-0d45-4c10-83e5-eda1a1d9f7ab] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:37.849188 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3f68ac38-d85d-4611-b285-502be4a8fdd7 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:37.850598 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3f68ac38-d85d-4611-b285-502be4a8fdd7 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:37.851593 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3f68ac38-d85d-4611-b285-502be4a8fdd7 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:37.852614 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3f68ac38-d85d-4611-b285-502be4a8fdd7 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:38.032193 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3f68ac38-d85d-4611-b285-502be4a8fdd7 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0049a642be6340e3b36fa6904fed5529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1effa9873ec7488da55676c454c4a1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:38.042319 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3f68ac38-d85d-4611-b285-502be4a8fdd7 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] 10.222.0.27 "GET /compute/v2.1/servers/80a28828-0d45-4c10-83e5-eda1a1d9f7ab" status: 200 len: 1526 microversion: 2.1 time: 0.206605 Jun 20 12:17:38.043773 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2115/4331] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:37 2022] GET /compute/v2.1/servers/80a28828-0d45-4c10-83e5-eda1a1d9f7ab => generated 1526 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:38.261816 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c81a4c96-c5ae-4920-bbf9-509a8ab3560e tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:38.262444 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c81a4c96-c5ae-4920-bbf9-509a8ab3560e tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: 9dc75474-7e3c-462c-b704-dd6f9e948190] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:38.279599 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c81a4c96-c5ae-4920-bbf9-509a8ab3560e tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:38.280362 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c81a4c96-c5ae-4920-bbf9-509a8ab3560e tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:38.281583 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c81a4c96-c5ae-4920-bbf9-509a8ab3560e tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:38.285520 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c81a4c96-c5ae-4920-bbf9-509a8ab3560e tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:38.394255 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-934d3129-ef40-490c-98bc-d8de40fd36d7 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:38.396140 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-934d3129-ef40-490c-98bc-d8de40fd36d7 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:38.414344 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-934d3129-ef40-490c-98bc-d8de40fd36d7 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:38.415025 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-934d3129-ef40-490c-98bc-d8de40fd36d7 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:38.420265 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-934d3129-ef40-490c-98bc-d8de40fd36d7 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:38.420976 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-934d3129-ef40-490c-98bc-d8de40fd36d7 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:39.151815 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c81a4c96-c5ae-4920-bbf9-509a8ab3560e tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b1b9bbe634eca989007e998c54271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:39.165486 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c81a4c96-c5ae-4920-bbf9-509a8ab3560e tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190" status: 200 len: 1323 microversion: 2.1 time: 0.908694 Jun 20 12:17:39.169486 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2217/4332] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:38 2022] GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190 => generated 1323 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:39.180517 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e7a4f0d9-fdeb-41bb-ad13-36c19019c1c0 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:39.181659 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e7a4f0d9-fdeb-41bb-ad13-36c19019c1c0 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 1e05048b-621f-4819-a11a-e0d077f7d563] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:39.198143 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e7a4f0d9-fdeb-41bb-ad13-36c19019c1c0 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:39.201564 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e7a4f0d9-fdeb-41bb-ad13-36c19019c1c0 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:39.202692 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e7a4f0d9-fdeb-41bb-ad13-36c19019c1c0 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:39.203592 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e7a4f0d9-fdeb-41bb-ad13-36c19019c1c0 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:39.363237 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-934d3129-ef40-490c-98bc-d8de40fd36d7 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:39.373759 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e7a4f0d9-fdeb-41bb-ad13-36c19019c1c0 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8324eb1db74653853a415b56b43fce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3103ed818db8417b8625af13e7176910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:39.377163 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-934d3129-ef40-490c-98bc-d8de40fd36d7 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1391 microversion: 2.1 time: 0.988543 Jun 20 12:17:39.378292 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2116/4333] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:38 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1391 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:39.393943 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d3fdcb10-1b8e-4293-9e7c-40db0c996a0e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:39.396760 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d3fdcb10-1b8e-4293-9e7c-40db0c996a0e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:39.414829 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e7a4f0d9-fdeb-41bb-ad13-36c19019c1c0 tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563" status: 200 len: 1475 microversion: 2.1 time: 0.236108 Jun 20 12:17:39.415795 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2218/4334] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:39 2022] GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563 => generated 1475 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:39.420966 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3fdcb10-1b8e-4293-9e7c-40db0c996a0e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:39.421829 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3fdcb10-1b8e-4293-9e7c-40db0c996a0e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:39.423228 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3fdcb10-1b8e-4293-9e7c-40db0c996a0e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:39.424112 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3fdcb10-1b8e-4293-9e7c-40db0c996a0e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:39.444092 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d9e2c399-e1a1-4bac-a3ff-5bd9ebee9c5c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:39.444801 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d9e2c399-e1a1-4bac-a3ff-5bd9ebee9c5c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] [instance: ce950356-da51-4847-96ba-76f575f7d9ab] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:39.462013 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9e2c399-e1a1-4bac-a3ff-5bd9ebee9c5c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:39.462424 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9e2c399-e1a1-4bac-a3ff-5bd9ebee9c5c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:39.465095 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9e2c399-e1a1-4bac-a3ff-5bd9ebee9c5c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:39.465698 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9e2c399-e1a1-4bac-a3ff-5bd9ebee9c5c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:39.469934 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-d3fdcb10-1b8e-4293-9e7c-40db0c996a0e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] HTTP exception thrown: Instance 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc could not be found. Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d3fdcb10-1b8e-4293-9e7c-40db0c996a0e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Request method failure captured: Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc HTTP/1.1 Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGRL3-yc9w7VgM027Nn5pM7xHunUAqMYV50zJh9uejATJS2I3Y1m4etXTZ4Ycc1-aFAv9o8hV9Sxl_uN1jbN_zrnRS7L59uX22_-N52Adkvx-etP85dBB3o5cnIJjvtBXio4iJwEuYkTplhO5vPLS4QKMlfcJCYWaIjlgoPyKfuK7Hk Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: b0d48009b1164cf3a605b30513636e4d Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1619297399 Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b0d48009b1164cf3a605b30513636e4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b0d48009b1164cf3a605b30513636e4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b0d48009b1164cf3a605b30513636e4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b0d48009b1164cf3a605b30513636e4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1619297399 Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: b0d48009b1164cf3a605b30513636e4d Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1619297399 Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-AttachVolumeShelveTestJSON-1619297399-project Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: aa6f744fe3e8403ea1960856026abe61 Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1619297399-project Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc could not be found. Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc'} Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc could not be found. Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc could not be found. Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:39.471653 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:39.477103 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:39.477103 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:39.477103 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:39.477103 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:39.477103 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:17:39.477103 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:17:39.477103 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc could not be found. Jun 20 12:17:39.477103 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:39.477103 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d3fdcb10-1b8e-4293-9e7c-40db0c996a0e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Returning 404 to user: Instance 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:17:39.477103 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d3fdcb10-1b8e-4293-9e7c-40db0c996a0e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 404 len: 111 microversion: 2.20 time: 0.093509 Jun 20 12:17:39.477103 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2117/4335] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:17:39 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:17:39.479302 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-22bdca06-a66e-4e65-8691-e961ba2d9300 req-218648c7-b209-48a0-9db2-2d41efec9f0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1512eb0-4637-49c4-a4d5-cdbbd1398473", "name": "network-vif-plugged", "status": "completed", "tag": "d7d7973b-595c-4769-80dd-0441a733dbfc"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:17:39.513956 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-d9e2c399-e1a1-4bac-a3ff-5bd9ebee9c5c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] HTTP exception thrown: Instance ce950356-da51-4847-96ba-76f575f7d9ab could not be found. Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d9e2c399-e1a1-4bac-a3ff-5bd9ebee9c5c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Request method failure captured: Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab HTTP/1.1 Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGTXRNUDbkmVkGZtqxIAfEyIVsMYrXN1f6lqpqCXTOFYph0dWBVMeirVGEG58Cn7nrxWItXiFnOhLH7sAreu-D2xrxn-XnDthz51v5xDlaVMyoua-mmaD1hMXl332CiCuPMmSwJpkqUsjNUrBeUMJV5e89zbiKkE1ekyeWF15BurUdg Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: bfe714415c9e4c9b8cd739c5a9b1c8b7 Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersTestBootFromVolume-2007960998 Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfe714415c9e4c9b8cd739c5a9b1c8b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bfe714415c9e4c9b8cd739c5a9b1c8b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bfe714415c9e4c9b8cd739c5a9b1c8b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bfe714415c9e4c9b8cd739c5a9b1c8b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersTestBootFromVolume-2007960998 Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: bfe714415c9e4c9b8cd739c5a9b1c8b7 Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersTestBootFromVolume-2007960998 Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersTestBootFromVolume-2007960998-project Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 8919a400a671422593e94e0390c3d949 Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersTestBootFromVolume-2007960998-project Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: exception: Instance ce950356-da51-4847-96ba-76f575f7d9ab could not be found. Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'ce950356-da51-4847-96ba-76f575f7d9ab'} Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce950356-da51-4847-96ba-76f575f7d9ab could not be found. Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce950356-da51-4847-96ba-76f575f7d9ab could not be found. Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:39.518882 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:39.523236 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:39.523236 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:39.523236 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:39.523236 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:17:39.523236 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:17:39.523236 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce950356-da51-4847-96ba-76f575f7d9ab could not be found. Jun 20 12:17:39.523236 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:39.523236 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d9e2c399-e1a1-4bac-a3ff-5bd9ebee9c5c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Returning 404 to user: Instance ce950356-da51-4847-96ba-76f575f7d9ab could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:17:39.523236 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d9e2c399-e1a1-4bac-a3ff-5bd9ebee9c5c tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] 10.222.0.27 "GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab" status: 404 len: 111 microversion: 2.1 time: 0.092456 Jun 20 12:17:39.524380 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2219/4336] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:39 2022] GET /compute/v2.1/servers/ce950356-da51-4847-96ba-76f575f7d9ab => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:17:39.538859 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-214b8f2d-1e81-41bb-a0a8-c57bfb7ac5d0 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:39.539495 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-214b8f2d-1e81-41bb-a0a8-c57bfb7ac5d0 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] [instance: 80a28828-0d45-4c10-83e5-eda1a1d9f7ab] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:39.539723 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-22bdca06-a66e-4e65-8691-e961ba2d9300 req-218648c7-b209-48a0-9db2-2d41efec9f0d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:39.540494 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-22bdca06-a66e-4e65-8691-e961ba2d9300 req-218648c7-b209-48a0-9db2-2d41efec9f0d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:39.556716 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-214b8f2d-1e81-41bb-a0a8-c57bfb7ac5d0 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:39.560250 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-214b8f2d-1e81-41bb-a0a8-c57bfb7ac5d0 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:39.560250 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-214b8f2d-1e81-41bb-a0a8-c57bfb7ac5d0 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:39.560250 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-214b8f2d-1e81-41bb-a0a8-c57bfb7ac5d0 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:39.591558 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-22bdca06-a66e-4e65-8691-e961ba2d9300 req-218648c7-b209-48a0-9db2-2d41efec9f0d service nova] Creating event network-vif-plugged:d7d7973b-595c-4769-80dd-0441a733dbfc for instance a1512eb0-4637-49c4-a4d5-cdbbd1398473 on n-h2-master-1 Jun 20 12:17:39.614335 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-22bdca06-a66e-4e65-8691-e961ba2d9300 req-218648c7-b209-48a0-9db2-2d41efec9f0d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138309 Jun 20 12:17:39.614950 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2118/4337] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:17:39.620414 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-13609b45-2dda-4c90-80d4-6772cfd3c6b1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '.version_select at 0x7f6073b5e700>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:39.678566 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-13609b45-2dda-4c90-80d4-6772cfd3c6b1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1370486867" status: 204 len: 0 microversion: 2.20 time: 0.062205 Jun 20 12:17:39.679206 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2119/4338] 10.222.0.27 () {60 vars in 1261 bytes} [Mon Jun 20 12:17:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1370486867 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 12:17:39.683792 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-513413a8-de01-4a5a-b05a-c5f7c4064f47 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] Calling method '.version_select at 0x7f60733ff550>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:39.734648 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-513413a8-de01-4a5a-b05a-c5f7c4064f47 tempest-ServersTestBootFromVolume-2007960998 tempest-ServersTestBootFromVolume-2007960998-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1870774164" status: 202 len: 0 microversion: 2.1 time: 0.054264 Jun 20 12:17:39.736111 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2120/4339] 10.222.0.27 () {58 vars in 1220 bytes} [Mon Jun 20 12:17:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1870774164 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:17:39.852701 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-67fb80b4-8737-41ea-a961-a2eaa473df5b req-a83619db-df57-45da-9de3-3abf7096f646 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e05048b-621f-4819-a11a-e0d077f7d563", "name": "network-vif-deleted", "tag": "eaa70fe1-2667-4b98-9bf5-4a0d37bc56f2"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:17:39.867732 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-67fb80b4-8737-41ea-a961-a2eaa473df5b req-a83619db-df57-45da-9de3-3abf7096f646 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:39.868551 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-67fb80b4-8737-41ea-a961-a2eaa473df5b req-a83619db-df57-45da-9de3-3abf7096f646 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:39.905587 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-67fb80b4-8737-41ea-a961-a2eaa473df5b req-a83619db-df57-45da-9de3-3abf7096f646 service nova] Creating event network-vif-deleted:eaa70fe1-2667-4b98-9bf5-4a0d37bc56f2 for instance 1e05048b-621f-4819-a11a-e0d077f7d563 on n-h1-master-1 Jun 20 12:17:39.918958 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-67fb80b4-8737-41ea-a961-a2eaa473df5b req-a83619db-df57-45da-9de3-3abf7096f646 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073416 Jun 20 12:17:39.920095 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2121/4340] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:17:40.188728 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-366b865d-99a9-4f0a-883a-5c8c79ad9e86 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:40.189781 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-366b865d-99a9-4f0a-883a-5c8c79ad9e86 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: 9dc75474-7e3c-462c-b704-dd6f9e948190] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:40.203706 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-366b865d-99a9-4f0a-883a-5c8c79ad9e86 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:40.204355 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-366b865d-99a9-4f0a-883a-5c8c79ad9e86 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:40.209490 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-366b865d-99a9-4f0a-883a-5c8c79ad9e86 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:40.210201 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-366b865d-99a9-4f0a-883a-5c8c79ad9e86 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:40.443448 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-214b8f2d-1e81-41bb-a0a8-c57bfb7ac5d0 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0049a642be6340e3b36fa6904fed5529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1effa9873ec7488da55676c454c4a1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:40.464631 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-214b8f2d-1e81-41bb-a0a8-c57bfb7ac5d0 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] 10.222.0.27 "GET /compute/v2.1/servers/80a28828-0d45-4c10-83e5-eda1a1d9f7ab" status: 200 len: 1526 microversion: 2.1 time: 0.938910 Jun 20 12:17:40.466963 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2220/4341] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:39 2022] GET /compute/v2.1/servers/80a28828-0d45-4c10-83e5-eda1a1d9f7ab => generated 1526 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:40.481459 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0af9f0fa-6740-4249-ae7f-01a946ec548d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:40.484549 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0af9f0fa-6740-4249-ae7f-01a946ec548d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:40.501910 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0af9f0fa-6740-4249-ae7f-01a946ec548d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:40.503105 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0af9f0fa-6740-4249-ae7f-01a946ec548d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:40.504242 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0af9f0fa-6740-4249-ae7f-01a946ec548d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:40.505997 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0af9f0fa-6740-4249-ae7f-01a946ec548d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:40.509277 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-366b865d-99a9-4f0a-883a-5c8c79ad9e86 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b1b9bbe634eca989007e998c54271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:40.525435 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-366b865d-99a9-4f0a-883a-5c8c79ad9e86 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190" status: 200 len: 1323 microversion: 2.1 time: 0.338450 Jun 20 12:17:40.527359 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2122/4342] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:40 2022] GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190 => generated 1323 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:40.548807 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-80b43afe-3263-4277-8de6-f7074382076e tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:40.552970 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-80b43afe-3263-4277-8de6-f7074382076e tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] [instance: 1e05048b-621f-4819-a11a-e0d077f7d563] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:40.573307 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80b43afe-3263-4277-8de6-f7074382076e tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:40.574219 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80b43afe-3263-4277-8de6-f7074382076e tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:40.578888 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80b43afe-3263-4277-8de6-f7074382076e tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:40.579690 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80b43afe-3263-4277-8de6-f7074382076e tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:40.628669 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-80b43afe-3263-4277-8de6-f7074382076e tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] HTTP exception thrown: Instance 1e05048b-621f-4819-a11a-e0d077f7d563 could not be found. Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-80b43afe-3263-4277-8de6-f7074382076e tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Request method failure captured: Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563 HTTP/1.1 Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGUEJ-D3cMf8np4O7Ms7hRd-YKCdqhmLqICiccL3zHTo-mNHRTE9UAnkQiAFCeKUH7R-BxtEgjFgxhA5ywx9NzsuBVxraIVMNHwokfVvByaZiGuIX4x2kMrBf7DOtYjxgfgFZThIf5DM_iWPYpnzfv3Kba2D0yYjkxvVqYzsldQlRbY Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 3103ed818db8417b8625af13e7176910 Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ListServerFiltersTestJSON-351319595 Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3103ed818db8417b8625af13e7176910"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3103ed818db8417b8625af13e7176910"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3103ed818db8417b8625af13e7176910"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3103ed818db8417b8625af13e7176910"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ListServerFiltersTestJSON-351319595 Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 3103ed818db8417b8625af13e7176910 Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-351319595 Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ListServerFiltersTestJSON-351319595-project Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 0c8324eb1db74653853a415b56b43fce Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ListServerFiltersTestJSON-351319595-project Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 1e05048b-621f-4819-a11a-e0d077f7d563 could not be found. Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '1e05048b-621f-4819-a11a-e0d077f7d563'} Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e05048b-621f-4819-a11a-e0d077f7d563 could not be found. Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e05048b-621f-4819-a11a-e0d077f7d563 could not be found. Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:40.631264 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:40.635121 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:40.635121 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:40.635121 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:40.635121 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:17:40.635121 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:17:40.635121 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e05048b-621f-4819-a11a-e0d077f7d563 could not be found. Jun 20 12:17:40.635121 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:40.637932 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-80b43afe-3263-4277-8de6-f7074382076e tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] Returning 404 to user: Instance 1e05048b-621f-4819-a11a-e0d077f7d563 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:17:40.639090 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-80b43afe-3263-4277-8de6-f7074382076e tempest-ListServerFiltersTestJSON-351319595 tempest-ListServerFiltersTestJSON-351319595-project] 10.222.0.27 "GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563" status: 404 len: 111 microversion: 2.1 time: 0.108844 Jun 20 12:17:40.640119 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2123/4343] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:40 2022] GET /compute/v2.1/servers/1e05048b-621f-4819-a11a-e0d077f7d563 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:17:40.866562 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0af9f0fa-6740-4249-ae7f-01a946ec548d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:40.880120 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0af9f0fa-6740-4249-ae7f-01a946ec548d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1391 microversion: 2.1 time: 0.411726 Jun 20 12:17:40.881446 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2221/4344] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:40 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1391 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:41.483132 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7c35584a-78dd-4581-b89a-333dafc43553 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:41.483793 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7c35584a-78dd-4581-b89a-333dafc43553 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] [instance: 80a28828-0d45-4c10-83e5-eda1a1d9f7ab] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:41.493969 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7c35584a-78dd-4581-b89a-333dafc43553 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:41.494797 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7c35584a-78dd-4581-b89a-333dafc43553 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:41.495899 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7c35584a-78dd-4581-b89a-333dafc43553 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:41.496525 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7c35584a-78dd-4581-b89a-333dafc43553 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:41.514532 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-7c35584a-78dd-4581-b89a-333dafc43553 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] HTTP exception thrown: Instance 80a28828-0d45-4c10-83e5-eda1a1d9f7ab could not be found. Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7c35584a-78dd-4581-b89a-333dafc43553 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Request method failure captured: Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/80a28828-0d45-4c10-83e5-eda1a1d9f7ab HTTP/1.1 Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGVAHSHnKJXJcep4ukIs0J20X8LcPFeE8yoKkDwTInucsT-WCJa5zGnLn77QRgr8F0SGiQxc7bxzwnaSdQ5sWpWmbNu7m-65DlJUetexmA7tHMHYpbbbUmWExhok4iFAbEwEmBxSeT2o5qnHRFDQlY3vJjXZp3H2HwtcagLIsmWqhj8 Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 1effa9873ec7488da55676c454c4a1b4 Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-860081247 Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1effa9873ec7488da55676c454c4a1b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1effa9873ec7488da55676c454c4a1b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1effa9873ec7488da55676c454c4a1b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1effa9873ec7488da55676c454c4a1b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-860081247 Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 1effa9873ec7488da55676c454c4a1b4 Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-860081247 Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServerMetadataNegativeTestJSON-860081247-project Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 0049a642be6340e3b36fa6904fed5529 Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-860081247-project Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 80a28828-0d45-4c10-83e5-eda1a1d9f7ab could not be found. Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '80a28828-0d45-4c10-83e5-eda1a1d9f7ab'} Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80a28828-0d45-4c10-83e5-eda1a1d9f7ab could not be found. Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80a28828-0d45-4c10-83e5-eda1a1d9f7ab could not be found. Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:41.516854 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:41.520598 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:41.520598 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:41.520598 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:41.520598 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:41.520598 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:17:41.520598 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:17:41.520598 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80a28828-0d45-4c10-83e5-eda1a1d9f7ab could not be found. Jun 20 12:17:41.520598 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:41.525003 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7c35584a-78dd-4581-b89a-333dafc43553 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] Returning 404 to user: Instance 80a28828-0d45-4c10-83e5-eda1a1d9f7ab could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:17:41.526179 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7c35584a-78dd-4581-b89a-333dafc43553 tempest-ServerMetadataNegativeTestJSON-860081247 tempest-ServerMetadataNegativeTestJSON-860081247-project] 10.222.0.27 "GET /compute/v2.1/servers/80a28828-0d45-4c10-83e5-eda1a1d9f7ab" status: 404 len: 111 microversion: 2.1 time: 0.048599 Jun 20 12:17:41.527470 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2124/4345] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:41 2022] GET /compute/v2.1/servers/80a28828-0d45-4c10-83e5-eda1a1d9f7ab => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:17:41.545534 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fb6b1ab6-c18b-4032-a27e-f10e2056be6a tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:41.546148 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fb6b1ab6-c18b-4032-a27e-f10e2056be6a tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: 9dc75474-7e3c-462c-b704-dd6f9e948190] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:41.555441 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fb6b1ab6-c18b-4032-a27e-f10e2056be6a tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:41.555993 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fb6b1ab6-c18b-4032-a27e-f10e2056be6a tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:41.561429 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fb6b1ab6-c18b-4032-a27e-f10e2056be6a tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:41.562248 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fb6b1ab6-c18b-4032-a27e-f10e2056be6a tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:41.652063 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-9663a2b8-d086-4277-8ee2-3b9da13bde1b req-f591ac1d-e668-432d-9770-6a97190a4e21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c46b7ac-3373-4ff7-8527-f2800b2ba847", "name": "network-vif-plugged", "status": "completed", "tag": "f398b629-6b58-4763-9a52-7f13fb752b43"}, {"server_uuid": "9dc75474-7e3c-462c-b704-dd6f9e948190", "name": "network-vif-plugged", "status": "completed", "tag": "f9ff76df-7bbe-414a-be10-bcadb596d155"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:17:41.670513 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9663a2b8-d086-4277-8ee2-3b9da13bde1b req-f591ac1d-e668-432d-9770-6a97190a4e21 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:41.680921 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9663a2b8-d086-4277-8ee2-3b9da13bde1b req-f591ac1d-e668-432d-9770-6a97190a4e21 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:41.710621 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-9663a2b8-d086-4277-8ee2-3b9da13bde1b req-f591ac1d-e668-432d-9770-6a97190a4e21 service nova] Creating event network-vif-plugged:f398b629-6b58-4763-9a52-7f13fb752b43 for instance 8c46b7ac-3373-4ff7-8527-f2800b2ba847 on n-h1-master-1 Jun 20 12:17:41.710938 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-9663a2b8-d086-4277-8ee2-3b9da13bde1b req-f591ac1d-e668-432d-9770-6a97190a4e21 service nova] Creating event network-vif-plugged:f9ff76df-7bbe-414a-be10-bcadb596d155 for instance 9dc75474-7e3c-462c-b704-dd6f9e948190 on n-h2-master-1 Jun 20 12:17:41.731888 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-9663a2b8-d086-4277-8ee2-3b9da13bde1b req-f591ac1d-e668-432d-9770-6a97190a4e21 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.083383 Jun 20 12:17:41.740976 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2125/4346] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:17:41.903014 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3996be10-d3bd-4173-99a2-2958188d4641 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:41.905217 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3996be10-d3bd-4173-99a2-2958188d4641 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:41.921546 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:17:41.924160 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3996be10-d3bd-4173-99a2-2958188d4641 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:41.928862 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3996be10-d3bd-4173-99a2-2958188d4641 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:41.933303 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3996be10-d3bd-4173-99a2-2958188d4641 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:41.934079 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3996be10-d3bd-4173-99a2-2958188d4641 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:42.673720 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fb6b1ab6-c18b-4032-a27e-f10e2056be6a tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b1b9bbe634eca989007e998c54271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:42.696351 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fb6b1ab6-c18b-4032-a27e-f10e2056be6a tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190" status: 200 len: 1323 microversion: 2.1 time: 1.153261 Jun 20 12:17:42.707920 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2222/4347] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:41 2022] GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190 => generated 1323 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:42.721898 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-b9f45cfb-4d93-435d-a0c8-8b1fca358cdd req-df88e412-dd4c-40df-96d9-1b34e03a373b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80a28828-0d45-4c10-83e5-eda1a1d9f7ab", "name": "network-vif-deleted", "tag": "d92b40d4-dda8-47a7-9ec9-22b1ff972d6d"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:17:42.748018 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b9f45cfb-4d93-435d-a0c8-8b1fca358cdd req-df88e412-dd4c-40df-96d9-1b34e03a373b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:42.749530 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b9f45cfb-4d93-435d-a0c8-8b1fca358cdd req-df88e412-dd4c-40df-96d9-1b34e03a373b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:42.762201 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3996be10-d3bd-4173-99a2-2958188d4641 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:42.777224 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:17:42.783608 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3996be10-d3bd-4173-99a2-2958188d4641 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1563 microversion: 2.1 time: 0.888449 Jun 20 12:17:42.796234 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-b9f45cfb-4d93-435d-a0c8-8b1fca358cdd req-df88e412-dd4c-40df-96d9-1b34e03a373b service nova] Creating event network-vif-deleted:d92b40d4-dda8-47a7-9ec9-22b1ff972d6d for instance 80a28828-0d45-4c10-83e5-eda1a1d9f7ab on n-h1-master-1 Jun 20 12:17:42.798827 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2126/4348] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:41 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1563 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:17:42.798827 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7e291ce3-1ae1-4fb1-bc00-59a687b284e2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Action: 'create', calling method: .version_select at 0x7f60738bca60>, body: {"keypair": {"name": "tempest-keypair-1415455535", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNobUBKuV0UgjkFu0ufv5LxhujvjKazBKJIEXMoQReOhQZu14YxVfP9jT7pp8TGAgn6ow3d7n7TtvE2EXoxmNqFOigKKZurMDJEI5icj/lbYD32U+f0P8wluMW9+VlAaUA=="}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:17:42.812071 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-7e291ce3-1ae1-4fb1-bc00-59a687b284e2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Getting quotas for project b0d48009b1164cf3a605b30513636e4d. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:17:42.813658 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-b9f45cfb-4d93-435d-a0c8-8b1fca358cdd req-df88e412-dd4c-40df-96d9-1b34e03a373b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104153 Jun 20 12:17:42.816675 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2223/4349] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:17:42.822518 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-7e291ce3-1ae1-4fb1-bc00-59a687b284e2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Getting quotas for user aa6f744fe3e8403ea1960856026abe61 and project b0d48009b1164cf3a605b30513636e4d. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:17:42.831154 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a87ab4e0-7f9a-48c8-86cc-ff04613c5140 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:42.833068 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a87ab4e0-7f9a-48c8-86cc-ff04613c5140 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:42.854892 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7e291ce3-1ae1-4fb1-bc00-59a687b284e2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.068857 Jun 20 12:17:42.855146 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a87ab4e0-7f9a-48c8-86cc-ff04613c5140 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:42.855523 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a87ab4e0-7f9a-48c8-86cc-ff04613c5140 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:42.861247 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2127/4350] 10.222.0.27 () {62 vars in 1199 bytes} [Mon Jun 20 12:17:42 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 70 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 20 12:17:42.861425 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a87ab4e0-7f9a-48c8-86cc-ff04613c5140 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:42.861425 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a87ab4e0-7f9a-48c8-86cc-ff04613c5140 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:43.208362 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a87ab4e0-7f9a-48c8-86cc-ff04613c5140 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:43.234530 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a87ab4e0-7f9a-48c8-86cc-ff04613c5140 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1563 microversion: 2.1 time: 0.415638 Jun 20 12:17:43.237377 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2224/4351] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:42 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1563 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:43.717034 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ce90adc2-1f41-4b58-aee3-2a2b4c1da55d tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:43.718240 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ce90adc2-1f41-4b58-aee3-2a2b4c1da55d tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: 9dc75474-7e3c-462c-b704-dd6f9e948190] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:43.733810 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce90adc2-1f41-4b58-aee3-2a2b4c1da55d tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:43.736695 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce90adc2-1f41-4b58-aee3-2a2b4c1da55d tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:43.740060 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce90adc2-1f41-4b58-aee3-2a2b4c1da55d tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:43.741927 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce90adc2-1f41-4b58-aee3-2a2b4c1da55d tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:44.115374 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ce90adc2-1f41-4b58-aee3-2a2b4c1da55d tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b1b9bbe634eca989007e998c54271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:44.136390 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ce90adc2-1f41-4b58-aee3-2a2b4c1da55d tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190" status: 200 len: 1323 microversion: 2.1 time: 0.424068 Jun 20 12:17:44.138194 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2128/4352] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:43 2022] GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190 => generated 1323 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:45.154480 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ee6837c7-8825-4f50-b4f2-befdacc7a2ff tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:45.155887 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ee6837c7-8825-4f50-b4f2-befdacc7a2ff tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: 9dc75474-7e3c-462c-b704-dd6f9e948190] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:45.164508 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee6837c7-8825-4f50-b4f2-befdacc7a2ff tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:45.166016 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee6837c7-8825-4f50-b4f2-befdacc7a2ff tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:45.166989 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee6837c7-8825-4f50-b4f2-befdacc7a2ff tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:45.167581 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee6837c7-8825-4f50-b4f2-befdacc7a2ff tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:45.689620 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ee6837c7-8825-4f50-b4f2-befdacc7a2ff tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b1b9bbe634eca989007e998c54271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:45.700869 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ee6837c7-8825-4f50-b4f2-befdacc7a2ff tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190" status: 200 len: 1516 microversion: 2.1 time: 0.549887 Jun 20 12:17:45.729982 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0ff237a5-cea1-414b-9d75-d3567813be42 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:45.731498 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0ff237a5-cea1-414b-9d75-d3567813be42 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: 8c46b7ac-3373-4ff7-8527-f2800b2ba847] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:45.735252 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2225/4353] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:45 2022] GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190 => generated 1516 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:45.742735 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0ff237a5-cea1-414b-9d75-d3567813be42 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:45.745606 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0ff237a5-cea1-414b-9d75-d3567813be42 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:45.746804 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0ff237a5-cea1-414b-9d75-d3567813be42 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:45.747425 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0ff237a5-cea1-414b-9d75-d3567813be42 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:46.291089 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-90e34873-52dd-4bd0-b993-033530f2d7f5 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-514372126", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": "none"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:17:46.337013 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0ff237a5-cea1-414b-9d75-d3567813be42 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b1b9bbe634eca989007e998c54271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:46.352654 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0ff237a5-cea1-414b-9d75-d3567813be42 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers/8c46b7ac-3373-4ff7-8527-f2800b2ba847" status: 200 len: 1516 microversion: 2.1 time: 0.625348 Jun 20 12:17:46.353915 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2129/4354] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:45 2022] GET /compute/v2.1/servers/8c46b7ac-3373-4ff7-8527-f2800b2ba847 => generated 1516 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:46.371936 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a06a9a82-20d1-4a3e-9276-c9b8dd9db25c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:46.372766 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a06a9a82-20d1-4a3e-9276-c9b8dd9db25c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: f65e72fa-4e88-44c5-bba1-0dc4f78eea47] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:46.379339 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-90e34873-52dd-4bd0-b993-033530f2d7f5 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:17:46.379950 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-90e34873-52dd-4bd0-b993-033530f2d7f5 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:17:46.383383 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-90e34873-52dd-4bd0-b993-033530f2d7f5 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:17:46.383968 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-90e34873-52dd-4bd0-b993-033530f2d7f5 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:17:46.384409 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a06a9a82-20d1-4a3e-9276-c9b8dd9db25c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:46.385060 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a06a9a82-20d1-4a3e-9276-c9b8dd9db25c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:46.385432 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-90e34873-52dd-4bd0-b993-033530f2d7f5 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:17:46.386221 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a06a9a82-20d1-4a3e-9276-c9b8dd9db25c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:46.388044 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a06a9a82-20d1-4a3e-9276-c9b8dd9db25c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:46.417315 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-90e34873-52dd-4bd0-b993-033530f2d7f5 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:46.418734 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-90e34873-52dd-4bd0-b993-033530f2d7f5 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:46.421625 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-90e34873-52dd-4bd0-b993-033530f2d7f5 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:46.423190 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-90e34873-52dd-4bd0-b993-033530f2d7f5 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:46.460660 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-90e34873-52dd-4bd0-b993-033530f2d7f5 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Getting quotas for project 6eaf378174574af3b1f734a914a0bf71. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:17:46.468108 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-90e34873-52dd-4bd0-b993-033530f2d7f5 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Getting quotas for user 431bc8d528754011826b568e4f647d4b and project 6eaf378174574af3b1f734a914a0bf71. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:17:46.486489 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-90e34873-52dd-4bd0-b993-033530f2d7f5 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:17:46.489820 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-90e34873-52dd-4bd0-b993-033530f2d7f5 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] [instance: eeb064b6-219f-4308-998b-b0526e80ae79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:17:46.547078 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-90e34873-52dd-4bd0-b993-033530f2d7f5 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.419702 Jun 20 12:17:46.550072 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2226/4355] 10.222.0.27 () {62 vars in 1187 bytes} [Mon Jun 20 12:17:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 423 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 20 12:17:46.563801 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-382f18c8-1966-491c-b51b-87dd0065cad7 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:46.564959 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-382f18c8-1966-491c-b51b-87dd0065cad7 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] [instance: eeb064b6-219f-4308-998b-b0526e80ae79] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:46.756044 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-382f18c8-1966-491c-b51b-87dd0065cad7 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431bc8d528754011826b568e4f647d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaf378174574af3b1f734a914a0bf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:46.774284 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-382f18c8-1966-491c-b51b-87dd0065cad7 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431bc8d528754011826b568e4f647d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaf378174574af3b1f734a914a0bf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:46.776949 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-382f18c8-1966-491c-b51b-87dd0065cad7 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431bc8d528754011826b568e4f647d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaf378174574af3b1f734a914a0bf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:46.808836 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-382f18c8-1966-491c-b51b-87dd0065cad7 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] 10.222.0.27 "GET /compute/v2.1/servers/eeb064b6-219f-4308-998b-b0526e80ae79" status: 200 len: 1280 microversion: 2.47 time: 0.252714 Jun 20 12:17:46.816242 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2227/4356] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:17:46 2022] GET /compute/v2.1/servers/eeb064b6-219f-4308-998b-b0526e80ae79 => generated 1280 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:17:46.837135 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a06a9a82-20d1-4a3e-9276-c9b8dd9db25c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b1b9bbe634eca989007e998c54271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:46.844160 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a06a9a82-20d1-4a3e-9276-c9b8dd9db25c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers/f65e72fa-4e88-44c5-bba1-0dc4f78eea47" status: 200 len: 1517 microversion: 2.1 time: 0.476084 Jun 20 12:17:46.849546 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2130/4357] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:46 2022] GET /compute/v2.1/servers/f65e72fa-4e88-44c5-bba1-0dc4f78eea47 => generated 1517 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:17:46.867241 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1a9c8a27-00ee-42b9-989b-da9cda20f81c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:46.868405 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1a9c8a27-00ee-42b9-989b-da9cda20f81c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: f65e72fa-4e88-44c5-bba1-0dc4f78eea47] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:46.875911 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a9c8a27-00ee-42b9-989b-da9cda20f81c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:46.876402 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a9c8a27-00ee-42b9-989b-da9cda20f81c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:46.877655 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a9c8a27-00ee-42b9-989b-da9cda20f81c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:46.878099 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a9c8a27-00ee-42b9-989b-da9cda20f81c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:46.947416 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1a9c8a27-00ee-42b9-989b-da9cda20f81c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: f65e72fa-4e88-44c5-bba1-0dc4f78eea47] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:17:47.110438 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1a9c8a27-00ee-42b9-989b-da9cda20f81c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f65e72fa-4e88-44c5-bba1-0dc4f78eea47" status: 204 len: 0 microversion: 2.1 time: 0.247478 Jun 20 12:17:47.111262 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2228/4358] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:17:46 2022] DELETE /compute/v2.1/servers/f65e72fa-4e88-44c5-bba1-0dc4f78eea47 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:17:47.121072 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-37c79c71-d3ae-436c-a8ad-25db3e2c6a4c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:47.121954 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-37c79c71-d3ae-436c-a8ad-25db3e2c6a4c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: f65e72fa-4e88-44c5-bba1-0dc4f78eea47] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:47.130774 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-37c79c71-d3ae-436c-a8ad-25db3e2c6a4c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:47.131856 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-37c79c71-d3ae-436c-a8ad-25db3e2c6a4c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:47.134343 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-37c79c71-d3ae-436c-a8ad-25db3e2c6a4c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:47.135127 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-37c79c71-d3ae-436c-a8ad-25db3e2c6a4c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:47.843620 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1ace80a0-c730-455c-8404-875cec9a6dd8 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:47.846078 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1ace80a0-c730-455c-8404-875cec9a6dd8 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] [instance: eeb064b6-219f-4308-998b-b0526e80ae79] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:47.858750 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1ace80a0-c730-455c-8404-875cec9a6dd8 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:47.861912 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1ace80a0-c730-455c-8404-875cec9a6dd8 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:47.863448 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1ace80a0-c730-455c-8404-875cec9a6dd8 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:47.864115 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1ace80a0-c730-455c-8404-875cec9a6dd8 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:48.149112 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1ace80a0-c730-455c-8404-875cec9a6dd8 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431bc8d528754011826b568e4f647d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaf378174574af3b1f734a914a0bf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:48.179984 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1ace80a0-c730-455c-8404-875cec9a6dd8 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431bc8d528754011826b568e4f647d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaf378174574af3b1f734a914a0bf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:48.191212 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1ace80a0-c730-455c-8404-875cec9a6dd8 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431bc8d528754011826b568e4f647d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaf378174574af3b1f734a914a0bf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:48.193639 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1ace80a0-c730-455c-8404-875cec9a6dd8 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] 10.222.0.27 "GET /compute/v2.1/servers/eeb064b6-219f-4308-998b-b0526e80ae79" status: 200 len: 1332 microversion: 2.47 time: 0.360663 Jun 20 12:17:48.194483 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2229/4359] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:17:47 2022] GET /compute/v2.1/servers/eeb064b6-219f-4308-998b-b0526e80ae79 => generated 1332 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:17:48.253580 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-37c79c71-d3ae-436c-a8ad-25db3e2c6a4c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b1b9bbe634eca989007e998c54271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:48.266720 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-37c79c71-d3ae-436c-a8ad-25db3e2c6a4c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers/f65e72fa-4e88-44c5-bba1-0dc4f78eea47" status: 200 len: 1523 microversion: 2.1 time: 1.150534 Jun 20 12:17:48.267651 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2131/4360] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:47 2022] GET /compute/v2.1/servers/f65e72fa-4e88-44c5-bba1-0dc4f78eea47 => generated 1523 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:48.757035 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-db9210a0-cb5b-48a6-98e1-8925e09d6411 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-163010815", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c2371ae1-6eb5-4e87-803d-d1b094865120"}], "security_groups": [{"name": "tempest-securitygroup--844686643"}], "key_name": "tempest-keypair-1415455535", "user_data": "}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:17:48.764147 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:17:49.145445 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-db9210a0-cb5b-48a6-98e1-8925e09d6411 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] validate_networks() for [('c2371ae1-6eb5-4e87-803d-d1b094865120', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:17:49.213859 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f6d5bf1c-241b-425f-abb1-448897c52e52 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:49.214482 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f6d5bf1c-241b-425f-abb1-448897c52e52 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] [instance: eeb064b6-219f-4308-998b-b0526e80ae79] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:49.226474 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6d5bf1c-241b-425f-abb1-448897c52e52 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:49.227349 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6d5bf1c-241b-425f-abb1-448897c52e52 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:49.228781 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6d5bf1c-241b-425f-abb1-448897c52e52 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:49.229226 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6d5bf1c-241b-425f-abb1-448897c52e52 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:49.328596 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f6d5bf1c-241b-425f-abb1-448897c52e52 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431bc8d528754011826b568e4f647d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaf378174574af3b1f734a914a0bf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:49.340052 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f6d5bf1c-241b-425f-abb1-448897c52e52 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431bc8d528754011826b568e4f647d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaf378174574af3b1f734a914a0bf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:49.342970 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f6d5bf1c-241b-425f-abb1-448897c52e52 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431bc8d528754011826b568e4f647d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaf378174574af3b1f734a914a0bf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:49.344403 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f6d5bf1c-241b-425f-abb1-448897c52e52 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] 10.222.0.27 "GET /compute/v2.1/servers/eeb064b6-219f-4308-998b-b0526e80ae79" status: 200 len: 1338 microversion: 2.47 time: 0.134510 Jun 20 12:17:49.345136 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2132/4361] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:17:49 2022] GET /compute/v2.1/servers/eeb064b6-219f-4308-998b-b0526e80ae79 => generated 1338 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:17:49.362929 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-31c11fb2-d4d4-4564-902f-3d239b6f7a03 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:49.363841 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-31c11fb2-d4d4-4564-902f-3d239b6f7a03 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: f65e72fa-4e88-44c5-bba1-0dc4f78eea47] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:49.371144 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-31c11fb2-d4d4-4564-902f-3d239b6f7a03 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:49.371996 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-31c11fb2-d4d4-4564-902f-3d239b6f7a03 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:49.373051 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-31c11fb2-d4d4-4564-902f-3d239b6f7a03 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:49.374325 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-31c11fb2-d4d4-4564-902f-3d239b6f7a03 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:49.620982 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-31c11fb2-d4d4-4564-902f-3d239b6f7a03 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b1b9bbe634eca989007e998c54271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:49.636954 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-31c11fb2-d4d4-4564-902f-3d239b6f7a03 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers/f65e72fa-4e88-44c5-bba1-0dc4f78eea47" status: 200 len: 1523 microversion: 2.1 time: 0.277413 Jun 20 12:17:49.637766 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2133/4362] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:49 2022] GET /compute/v2.1/servers/f65e72fa-4e88-44c5-bba1-0dc4f78eea47 => generated 1523 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:50.131863 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a70ff48d-520c-4cbf-966c-2cf89cf68417 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:50.132648 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a70ff48d-520c-4cbf-966c-2cf89cf68417 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:50.148635 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a70ff48d-520c-4cbf-966c-2cf89cf68417 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:50.151798 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a70ff48d-520c-4cbf-966c-2cf89cf68417 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:50.156837 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a70ff48d-520c-4cbf-966c-2cf89cf68417 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:50.157541 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a70ff48d-520c-4cbf-966c-2cf89cf68417 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:50.620797 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a70ff48d-520c-4cbf-966c-2cf89cf68417 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:50.641470 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a70ff48d-520c-4cbf-966c-2cf89cf68417 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1563 microversion: 2.1 time: 0.514947 Jun 20 12:17:50.642861 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2134/4363] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:50 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1563 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:17:50.652214 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-e6a56561-6c67-4a2a-a8a5-ab33ada365b7 req-dad76434-2f3e-4b93-ab36-f7b9e224cc09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1512eb0-4637-49c4-a4d5-cdbbd1398473", "tag": "d7d7973b-595c-4769-80dd-0441a733dbfc"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:17:50.671993 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e6a56561-6c67-4a2a-a8a5-ab33ada365b7 req-dad76434-2f3e-4b93-ab36-f7b9e224cc09 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:50.672737 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e6a56561-6c67-4a2a-a8a5-ab33ada365b7 req-dad76434-2f3e-4b93-ab36-f7b9e224cc09 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:50.690704 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-e6a56561-6c67-4a2a-a8a5-ab33ada365b7 req-dad76434-2f3e-4b93-ab36-f7b9e224cc09 service nova] Creating event network-changed:d7d7973b-595c-4769-80dd-0441a733dbfc for instance a1512eb0-4637-49c4-a4d5-cdbbd1398473 on n-h2-master-1 Jun 20 12:17:50.717532 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-e6a56561-6c67-4a2a-a8a5-ab33ada365b7 req-dad76434-2f3e-4b93-ab36-f7b9e224cc09 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071933 Jun 20 12:17:50.719684 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2135/4364] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:17:50.725947 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c1f30c9f-ff77-4cd1-b886-3038250a5039 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:50.727573 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c1f30c9f-ff77-4cd1-b886-3038250a5039 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] [instance: eeb064b6-219f-4308-998b-b0526e80ae79] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:50.734720 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c1f30c9f-ff77-4cd1-b886-3038250a5039 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:50.736623 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c1f30c9f-ff77-4cd1-b886-3038250a5039 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:50.737632 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c1f30c9f-ff77-4cd1-b886-3038250a5039 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:50.738403 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c1f30c9f-ff77-4cd1-b886-3038250a5039 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:50.774552 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:17:50.894967 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c1f30c9f-ff77-4cd1-b886-3038250a5039 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431bc8d528754011826b568e4f647d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaf378174574af3b1f734a914a0bf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:50.930438 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c1f30c9f-ff77-4cd1-b886-3038250a5039 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431bc8d528754011826b568e4f647d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaf378174574af3b1f734a914a0bf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:50.935325 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c1f30c9f-ff77-4cd1-b886-3038250a5039 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431bc8d528754011826b568e4f647d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaf378174574af3b1f734a914a0bf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:50.941775 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c1f30c9f-ff77-4cd1-b886-3038250a5039 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] 10.222.0.27 "GET /compute/v2.1/servers/eeb064b6-219f-4308-998b-b0526e80ae79" status: 200 len: 1359 microversion: 2.47 time: 0.220238 Jun 20 12:17:50.966236 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2136/4365] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:17:50 2022] GET /compute/v2.1/servers/eeb064b6-219f-4308-998b-b0526e80ae79 => generated 1359 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:17:50.975134 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8ffaf292-3b3d-4ee4-8ad1-bbc36c541638 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:50.976707 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8ffaf292-3b3d-4ee4-8ad1-bbc36c541638 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: f65e72fa-4e88-44c5-bba1-0dc4f78eea47] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:50.985262 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ffaf292-3b3d-4ee4-8ad1-bbc36c541638 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:50.985871 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ffaf292-3b3d-4ee4-8ad1-bbc36c541638 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:50.986980 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ffaf292-3b3d-4ee4-8ad1-bbc36c541638 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:50.987509 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ffaf292-3b3d-4ee4-8ad1-bbc36c541638 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:51.371025 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8ffaf292-3b3d-4ee4-8ad1-bbc36c541638 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b1b9bbe634eca989007e998c54271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:51.379579 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8ffaf292-3b3d-4ee4-8ad1-bbc36c541638 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers/f65e72fa-4e88-44c5-bba1-0dc4f78eea47" status: 200 len: 1523 microversion: 2.1 time: 0.411765 Jun 20 12:17:51.380238 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2137/4366] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:50 2022] GET /compute/v2.1/servers/f65e72fa-4e88-44c5-bba1-0dc4f78eea47 => generated 1523 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:51.397034 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-db480f0f-0cca-4846-bb4d-f280e009a3f3 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1370621287"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:17:51.398552 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-db480f0f-0cca-4846-bb4d-f280e009a3f3 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] [instance: eeb064b6-219f-4308-998b-b0526e80ae79] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:51.413832 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-db480f0f-0cca-4846-bb4d-f280e009a3f3 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:51.414569 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-db480f0f-0cca-4846-bb4d-f280e009a3f3 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:51.415551 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-db480f0f-0cca-4846-bb4d-f280e009a3f3 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:51.418184 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-db480f0f-0cca-4846-bb4d-f280e009a3f3 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:51.719575 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-db9210a0-cb5b-48a6-98e1-8925e09d6411 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:17:51.720123 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-db9210a0-cb5b-48a6-98e1-8925e09d6411 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:17:51.729039 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-db9210a0-cb5b-48a6-98e1-8925e09d6411 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:17:51.732178 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-db9210a0-cb5b-48a6-98e1-8925e09d6411 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:17:51.733350 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-db9210a0-cb5b-48a6-98e1-8925e09d6411 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:17:51.746260 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-db9210a0-cb5b-48a6-98e1-8925e09d6411 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:51.747125 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-db9210a0-cb5b-48a6-98e1-8925e09d6411 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:51.748408 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-db9210a0-cb5b-48a6-98e1-8925e09d6411 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:51.749413 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-db9210a0-cb5b-48a6-98e1-8925e09d6411 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:51.777391 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-db9210a0-cb5b-48a6-98e1-8925e09d6411 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Getting quotas for project b0d48009b1164cf3a605b30513636e4d. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:17:51.797006 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-db9210a0-cb5b-48a6-98e1-8925e09d6411 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Getting quotas for user aa6f744fe3e8403ea1960856026abe61 and project b0d48009b1164cf3a605b30513636e4d. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:17:51.839694 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-db9210a0-cb5b-48a6-98e1-8925e09d6411 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:17:51.855460 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-db9210a0-cb5b-48a6-98e1-8925e09d6411 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:17:51.997773 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-db9210a0-cb5b-48a6-98e1-8925e09d6411 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.244914 Jun 20 12:17:51.999223 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2230/4367] 10.222.0.27 () {62 vars in 1187 bytes} [Mon Jun 20 12:17:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 3247 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 20 12:17:52.036249 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-db480f0f-0cca-4846-bb4d-f280e009a3f3 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] 10.222.0.27 "POST /compute/v2.1/servers/eeb064b6-219f-4308-998b-b0526e80ae79/action" status: 202 len: 52 microversion: 2.47 time: 0.643492 Jun 20 12:17:52.052708 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2138/4368] 10.222.0.27 () {62 vars in 1318 bytes} [Mon Jun 20 12:17:51 2022] POST /compute/v2.1/servers/eeb064b6-219f-4308-998b-b0526e80ae79/action => generated 52 bytes in 661 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Jun 20 12:17:52.063690 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d71fd955-bc81-43b5-ab41-d98a24a2d0e3 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:52.064314 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d71fd955-bc81-43b5-ab41-d98a24a2d0e3 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] [instance: eeb064b6-219f-4308-998b-b0526e80ae79] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:52.066717 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ff81d655-17ed-4f9b-a487-1454a240ec67 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:52.071119 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ff81d655-17ed-4f9b-a487-1454a240ec67 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:52.095487 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d71fd955-bc81-43b5-ab41-d98a24a2d0e3 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:52.095949 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d71fd955-bc81-43b5-ab41-d98a24a2d0e3 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:52.096776 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d71fd955-bc81-43b5-ab41-d98a24a2d0e3 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:52.097232 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d71fd955-bc81-43b5-ab41-d98a24a2d0e3 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:52.199046 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d71fd955-bc81-43b5-ab41-d98a24a2d0e3 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] [instance: eeb064b6-219f-4308-998b-b0526e80ae79] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:17:52.408484 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d71fd955-bc81-43b5-ab41-d98a24a2d0e3 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] 10.222.0.27 "DELETE /compute/v2.1/servers/eeb064b6-219f-4308-998b-b0526e80ae79" status: 204 len: 0 microversion: 2.47 time: 0.351822 Jun 20 12:17:52.411731 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2139/4369] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Jun 20 12:17:52 2022] DELETE /compute/v2.1/servers/eeb064b6-219f-4308-998b-b0526e80ae79 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 12:17:52.425076 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-723a0acf-22bd-4570-974f-57506aafb251 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:52.432066 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-723a0acf-22bd-4570-974f-57506aafb251 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: f65e72fa-4e88-44c5-bba1-0dc4f78eea47] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:52.435681 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ff81d655-17ed-4f9b-a487-1454a240ec67 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:52.446981 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ff81d655-17ed-4f9b-a487-1454a240ec67 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:52.451614 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ff81d655-17ed-4f9b-a487-1454a240ec67 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:52.453412 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-723a0acf-22bd-4570-974f-57506aafb251 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:52.454185 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-723a0acf-22bd-4570-974f-57506aafb251 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:52.455643 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-723a0acf-22bd-4570-974f-57506aafb251 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:52.456280 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-723a0acf-22bd-4570-974f-57506aafb251 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:52.457200 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ff81d655-17ed-4f9b-a487-1454a240ec67 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1281 microversion: 2.20 time: 0.449927 Jun 20 12:17:52.466395 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2231/4370] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:17:52 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1281 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:17:52.481516 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8eabf294-c01d-45d9-b33f-3124f9ef1cb7 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:52.487579 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8eabf294-c01d-45d9-b33f-3124f9ef1cb7 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] [instance: eeb064b6-219f-4308-998b-b0526e80ae79] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:52.495195 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8eabf294-c01d-45d9-b33f-3124f9ef1cb7 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:52.495879 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8eabf294-c01d-45d9-b33f-3124f9ef1cb7 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:52.509867 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8eabf294-c01d-45d9-b33f-3124f9ef1cb7 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:52.511428 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8eabf294-c01d-45d9-b33f-3124f9ef1cb7 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:52.613914 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-723a0acf-22bd-4570-974f-57506aafb251 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b1b9bbe634eca989007e998c54271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:52.629286 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-723a0acf-22bd-4570-974f-57506aafb251 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers/f65e72fa-4e88-44c5-bba1-0dc4f78eea47" status: 200 len: 1481 microversion: 2.1 time: 0.215795 Jun 20 12:17:52.629887 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2140/4371] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:52 2022] GET /compute/v2.1/servers/f65e72fa-4e88-44c5-bba1-0dc4f78eea47 => generated 1481 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:52.741884 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8eabf294-c01d-45d9-b33f-3124f9ef1cb7 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431bc8d528754011826b568e4f647d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaf378174574af3b1f734a914a0bf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:52.752718 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8eabf294-c01d-45d9-b33f-3124f9ef1cb7 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431bc8d528754011826b568e4f647d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaf378174574af3b1f734a914a0bf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:52.760795 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8eabf294-c01d-45d9-b33f-3124f9ef1cb7 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431bc8d528754011826b568e4f647d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaf378174574af3b1f734a914a0bf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:52.762453 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8eabf294-c01d-45d9-b33f-3124f9ef1cb7 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] 10.222.0.27 "GET /compute/v2.1/servers/eeb064b6-219f-4308-998b-b0526e80ae79" status: 200 len: 1365 microversion: 2.47 time: 0.294867 Jun 20 12:17:52.763331 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2232/4372] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:17:52 2022] GET /compute/v2.1/servers/eeb064b6-219f-4308-998b-b0526e80ae79 => generated 1365 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:17:53.155764 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-106a0b74-422a-462f-bb0e-dff2d0a84179 req-71d7f0a4-ccf6-4412-815b-91f4204855b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f65e72fa-4e88-44c5-bba1-0dc4f78eea47", "name": "network-vif-deleted", "tag": "552383e8-2c45-49dc-8d09-3a702564f66d"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:17:53.161542 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=4 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:17:53.169132 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-106a0b74-422a-462f-bb0e-dff2d0a84179 req-71d7f0a4-ccf6-4412-815b-91f4204855b4 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:53.170918 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-106a0b74-422a-462f-bb0e-dff2d0a84179 req-71d7f0a4-ccf6-4412-815b-91f4204855b4 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:53.187209 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-106a0b74-422a-462f-bb0e-dff2d0a84179 req-71d7f0a4-ccf6-4412-815b-91f4204855b4 service nova] Creating event network-vif-deleted:552383e8-2c45-49dc-8d09-3a702564f66d for instance f65e72fa-4e88-44c5-bba1-0dc4f78eea47 on n-h2-master-1 Jun 20 12:17:53.194447 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-106a0b74-422a-462f-bb0e-dff2d0a84179 req-71d7f0a4-ccf6-4412-815b-91f4204855b4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042141 Jun 20 12:17:53.195748 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2141/4373] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:17:53.477189 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cfbb5689-8632-44a9-b388-3955e1473b77 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:53.478158 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cfbb5689-8632-44a9-b388-3955e1473b77 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:53.485447 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cfbb5689-8632-44a9-b388-3955e1473b77 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:53.486139 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cfbb5689-8632-44a9-b388-3955e1473b77 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:53.487153 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cfbb5689-8632-44a9-b388-3955e1473b77 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:53.487754 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cfbb5689-8632-44a9-b388-3955e1473b77 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:53.612183 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cfbb5689-8632-44a9-b388-3955e1473b77 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:53.626144 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cfbb5689-8632-44a9-b388-3955e1473b77 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:53.628318 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cfbb5689-8632-44a9-b388-3955e1473b77 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:53.630316 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cfbb5689-8632-44a9-b388-3955e1473b77 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1285 microversion: 2.20 time: 0.157520 Jun 20 12:17:53.631802 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2233/4374] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:17:53 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1285 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:17:53.651376 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-063ff3e0-59d1-4bb9-8aa5-99112c11d207 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:53.652467 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-063ff3e0-59d1-4bb9-8aa5-99112c11d207 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: f65e72fa-4e88-44c5-bba1-0dc4f78eea47] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:53.659606 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-063ff3e0-59d1-4bb9-8aa5-99112c11d207 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:53.660169 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-063ff3e0-59d1-4bb9-8aa5-99112c11d207 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:53.661351 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-063ff3e0-59d1-4bb9-8aa5-99112c11d207 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:53.663019 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-063ff3e0-59d1-4bb9-8aa5-99112c11d207 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:53.682225 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-063ff3e0-59d1-4bb9-8aa5-99112c11d207 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] HTTP exception thrown: Instance f65e72fa-4e88-44c5-bba1-0dc4f78eea47 could not be found. Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-063ff3e0-59d1-4bb9-8aa5-99112c11d207 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Request method failure captured: Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/f65e72fa-4e88-44c5-bba1-0dc4f78eea47 HTTP/1.1 Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGVAqKyxVdJIEq-n9iVwEchBpwymieKfVXc90v9XydoJheO0JWlxK0b48_33Cbl_sKhJ2fDc7TuzluU6cB3GdJ6NZWwq6SJAqw-A7GapmZ9SU5AghuMZUOC5cFGyuznBNi2ye2k60xEKPCSzUnqgAZ7Siy7MC1w7LxAqkkKomYTNkIo Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 6a608c15e7f140e3a1d01fabcf6157e7 Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ListServersNegativeTestJSON-284089426 Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a608c15e7f140e3a1d01fabcf6157e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a608c15e7f140e3a1d01fabcf6157e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a608c15e7f140e3a1d01fabcf6157e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a608c15e7f140e3a1d01fabcf6157e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ListServersNegativeTestJSON-284089426 Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 6a608c15e7f140e3a1d01fabcf6157e7 Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-284089426 Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ListServersNegativeTestJSON-284089426-project Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: ce8b1b9bbe634eca989007e998c54271 Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ListServersNegativeTestJSON-284089426-project Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: exception: Instance f65e72fa-4e88-44c5-bba1-0dc4f78eea47 could not be found. Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'f65e72fa-4e88-44c5-bba1-0dc4f78eea47'} Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f65e72fa-4e88-44c5-bba1-0dc4f78eea47 could not be found. Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f65e72fa-4e88-44c5-bba1-0dc4f78eea47 could not be found. Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:53.684302 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:53.689163 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:53.689163 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:53.689163 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:53.689163 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:17:53.689163 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:17:53.689163 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f65e72fa-4e88-44c5-bba1-0dc4f78eea47 could not be found. Jun 20 12:17:53.689163 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:53.691168 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-063ff3e0-59d1-4bb9-8aa5-99112c11d207 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Returning 404 to user: Instance f65e72fa-4e88-44c5-bba1-0dc4f78eea47 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:17:53.692596 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-063ff3e0-59d1-4bb9-8aa5-99112c11d207 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers/f65e72fa-4e88-44c5-bba1-0dc4f78eea47" status: 404 len: 111 microversion: 2.1 time: 0.047580 Jun 20 12:17:53.694482 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2142/4375] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:53 2022] GET /compute/v2.1/servers/f65e72fa-4e88-44c5-bba1-0dc4f78eea47 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:17:53.705378 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-001345ae-095e-4909-acf6-24ef131dd03d tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:53.709702 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-001345ae-095e-4909-acf6-24ef131dd03d tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ce8b1b9bbe634eca989007e998c54271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:53.710706 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-001345ae-095e-4909-acf6-24ef131dd03d tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7'} {{(pid=119127) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:17:53.717244 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-001345ae-095e-4909-acf6-24ef131dd03d tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:53.718047 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-001345ae-095e-4909-acf6-24ef131dd03d tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:53.718962 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-001345ae-095e-4909-acf6-24ef131dd03d tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:53.719533 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-001345ae-095e-4909-acf6-24ef131dd03d tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:53.781534 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7da3bd1b-5303-4bbb-bf58-79bb0438d096 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:53.782176 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7da3bd1b-5303-4bbb-bf58-79bb0438d096 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] [instance: eeb064b6-219f-4308-998b-b0526e80ae79] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:53.789078 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7da3bd1b-5303-4bbb-bf58-79bb0438d096 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:53.789783 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7da3bd1b-5303-4bbb-bf58-79bb0438d096 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:53.791373 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7da3bd1b-5303-4bbb-bf58-79bb0438d096 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:53.791956 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7da3bd1b-5303-4bbb-bf58-79bb0438d096 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:53.831017 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-001345ae-095e-4909-acf6-24ef131dd03d tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.130204 Jun 20 12:17:53.832556 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2234/4376] 10.222.0.27 () {58 vars in 1229 bytes} [Mon Jun 20 12:17:53 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 20 12:17:53.844775 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2f462d14-38f2-4787-91e2-f35d12b13840 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2f462d14-38f2-4787-91e2-f35d12b13840 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Request method failure captured: Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGVAqKyxVdJIEq-n9iVwEchBpwymieKfVXc90v9XydoJheO0JWlxK0b48_33Cbl_sKhJ2fDc7TuzluU6cB3GdJ6NZWwq6SJAqw-A7GapmZ9SU5AghuMZUOC5cFGyuznBNi2ye2k60xEKPCSzUnqgAZ7Siy7MC1w7LxAqkkKomYTNkIo Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 6a608c15e7f140e3a1d01fabcf6157e7 Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ListServersNegativeTestJSON-284089426 Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a608c15e7f140e3a1d01fabcf6157e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a608c15e7f140e3a1d01fabcf6157e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a608c15e7f140e3a1d01fabcf6157e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a608c15e7f140e3a1d01fabcf6157e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ListServersNegativeTestJSON-284089426 Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 6a608c15e7f140e3a1d01fabcf6157e7 Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-284089426 Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ListServersNegativeTestJSON-284089426-project Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: ce8b1b9bbe634eca989007e998c54271 Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ListServersNegativeTestJSON-284089426-project Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: action_args: {} Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise error Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi On instance[0]: Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi '2011/01/01' Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jun 20 12:17:53.848254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 12:17:53.852983 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 12:17:53.852983 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 12:17:53.852983 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 12:17:53.852983 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jun 20 12:17:53.852983 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:53.852983 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:53.852983 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:53.852983 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:53.852983 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:53.852983 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:53.852983 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 12:17:53.852983 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 12:17:53.852983 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jun 20 12:17:53.852983 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:53.852983 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2f462d14-38f2-4787-91e2-f35d12b13840 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:17:53.852983 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2f462d14-38f2-4787-91e2-f35d12b13840 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.010332 Jun 20 12:17:53.857275 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2235/4377] 10.222.0.27 () {58 vars in 1181 bytes} [Mon Jun 20 12:17:53 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 20 12:17:53.862305 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dad819d8-9deb-4507-9b14-f451c0324e1c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:53.866189 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dad819d8-9deb-4507-9b14-f451c0324e1c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ce8b1b9bbe634eca989007e998c54271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:53.867080 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dad819d8-9deb-4507-9b14-f451c0324e1c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Searching by: {'deleted': False, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7'} {{(pid=119127) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:17:53.874218 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dad819d8-9deb-4507-9b14-f451c0324e1c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:53.874949 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dad819d8-9deb-4507-9b14-f451c0324e1c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:53.877125 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dad819d8-9deb-4507-9b14-f451c0324e1c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:53.878359 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dad819d8-9deb-4507-9b14-f451c0324e1c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:53.912873 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.multi_cell_list [None req-dad819d8-9deb-4507-9b14-f451c0324e1c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119127) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 12:17:53.939373 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7da3bd1b-5303-4bbb-bf58-79bb0438d096 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431bc8d528754011826b568e4f647d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaf378174574af3b1f734a914a0bf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:53.954851 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dad819d8-9deb-4507-9b14-f451c0324e1c tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.096024 Jun 20 12:17:53.963906 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2236/4378] 10.222.0.27 () {58 vars in 1124 bytes} [Mon Jun 20 12:17:53 2022] GET /compute/v2.1/servers => generated 683 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:17:53.972517 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-222e6254-1d01-4465-b9b0-3809a65fe18e tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:53.980426 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7da3bd1b-5303-4bbb-bf58-79bb0438d096 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431bc8d528754011826b568e4f647d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaf378174574af3b1f734a914a0bf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:53.981415 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-222e6254-1d01-4465-b9b0-3809a65fe18e tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ce8b1b9bbe634eca989007e998c54271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:53.982088 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.compute.servers [None req-222e6254-1d01-4465-b9b0-3809a65fe18e tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Removing options 'limit' from query {{(pid=119127) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jun 20 12:17:53.983686 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-222e6254-1d01-4465-b9b0-3809a65fe18e tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Searching by: {'deleted': False, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7'} {{(pid=119127) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:17:53.993150 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-222e6254-1d01-4465-b9b0-3809a65fe18e tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:53.993799 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7da3bd1b-5303-4bbb-bf58-79bb0438d096 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431bc8d528754011826b568e4f647d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaf378174574af3b1f734a914a0bf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:53.996979 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-222e6254-1d01-4465-b9b0-3809a65fe18e tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:53.997574 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7da3bd1b-5303-4bbb-bf58-79bb0438d096 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] 10.222.0.27 "GET /compute/v2.1/servers/eeb064b6-219f-4308-998b-b0526e80ae79" status: 200 len: 1365 microversion: 2.47 time: 0.220007 Jun 20 12:17:53.998464 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-222e6254-1d01-4465-b9b0-3809a65fe18e tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:53.999109 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-222e6254-1d01-4465-b9b0-3809a65fe18e tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:54.021296 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2143/4379] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:17:53 2022] GET /compute/v2.1/servers/eeb064b6-219f-4308-998b-b0526e80ae79 => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:17:54.057015 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.multi_cell_list [None req-222e6254-1d01-4465-b9b0-3809a65fe18e tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=119127) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 12:17:54.134851 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-222e6254-1d01-4465-b9b0-3809a65fe18e tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.168682 Jun 20 12:17:54.140357 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2237/4380] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Jun 20 12:17:53 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:17:54.156985 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-54ec45af-bebf-4753-a5b6-7e8a8beec5ca tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-54ec45af-bebf-4753-a5b6-7e8a8beec5ca tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Request method failure captured: Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGVAqKyxVdJIEq-n9iVwEchBpwymieKfVXc90v9XydoJheO0JWlxK0b48_33Cbl_sKhJ2fDc7TuzluU6cB3GdJ6NZWwq6SJAqw-A7GapmZ9SU5AghuMZUOC5cFGyuznBNi2ye2k60xEKPCSzUnqgAZ7Siy7MC1w7LxAqkkKomYTNkIo Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 6a608c15e7f140e3a1d01fabcf6157e7 Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ListServersNegativeTestJSON-284089426 Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a608c15e7f140e3a1d01fabcf6157e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a608c15e7f140e3a1d01fabcf6157e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a608c15e7f140e3a1d01fabcf6157e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a608c15e7f140e3a1d01fabcf6157e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ListServersNegativeTestJSON-284089426 Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 6a608c15e7f140e3a1d01fabcf6157e7 Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-284089426 Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ListServersNegativeTestJSON-284089426-project Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: ce8b1b9bbe634eca989007e998c54271 Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ListServersNegativeTestJSON-284089426-project Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: action_args: {} Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise error Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi On instance[0]: Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi '-1' Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jun 20 12:17:54.160830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jun 20 12:17:54.164709 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 12:17:54.164709 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 12:17:54.164709 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 12:17:54.164709 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 12:17:54.164709 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jun 20 12:17:54.164709 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:54.164709 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:54.164709 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:54.164709 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:54.164709 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:54.164709 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:54.164709 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 12:17:54.164709 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 12:17:54.164709 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jun 20 12:17:54.164709 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:17:54.169096 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-54ec45af-bebf-4753-a5b6-7e8a8beec5ca tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:17:54.170355 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-54ec45af-bebf-4753-a5b6-7e8a8beec5ca tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.020536 Jun 20 12:17:54.172247 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2144/4381] 10.222.0.27 () {58 vars in 1141 bytes} [Mon Jun 20 12:17:54 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:17:54.183689 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5de87ed6-39af-455a-b3a5-3f1aafb30960 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5de87ed6-39af-455a-b3a5-3f1aafb30960 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Request method failure captured: Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGVAqKyxVdJIEq-n9iVwEchBpwymieKfVXc90v9XydoJheO0JWlxK0b48_33Cbl_sKhJ2fDc7TuzluU6cB3GdJ6NZWwq6SJAqw-A7GapmZ9SU5AghuMZUOC5cFGyuznBNi2ye2k60xEKPCSzUnqgAZ7Siy7MC1w7LxAqkkKomYTNkIo Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 6a608c15e7f140e3a1d01fabcf6157e7 Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ListServersNegativeTestJSON-284089426 Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a608c15e7f140e3a1d01fabcf6157e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a608c15e7f140e3a1d01fabcf6157e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a608c15e7f140e3a1d01fabcf6157e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a608c15e7f140e3a1d01fabcf6157e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ListServersNegativeTestJSON-284089426 Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 6a608c15e7f140e3a1d01fabcf6157e7 Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-284089426 Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ListServersNegativeTestJSON-284089426-project Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: ce8b1b9bbe634eca989007e998c54271 Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ListServersNegativeTestJSON-284089426-project Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: action_args: {} Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise error Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi On instance[0]: Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi 'testing' Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jun 20 12:17:54.193877 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jun 20 12:17:54.197834 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 12:17:54.197834 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 12:17:54.197834 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 12:17:54.197834 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 12:17:54.197834 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jun 20 12:17:54.197834 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:54.197834 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:54.197834 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:54.197834 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:54.197834 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:54.197834 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:54.197834 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 12:17:54.197834 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 12:17:54.197834 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jun 20 12:17:54.197834 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:54.197834 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5de87ed6-39af-455a-b3a5-3f1aafb30960 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:17:54.197834 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5de87ed6-39af-455a-b3a5-3f1aafb30960 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.018216 Jun 20 12:17:54.199875 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2238/4382] 10.222.0.27 () {58 vars in 1151 bytes} [Mon Jun 20 12:17:54 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:17:54.214284 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-04a45579-be46-4721-a6e8-3ff36d28718f tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:54.221047 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-04a45579-be46-4721-a6e8-3ff36d28718f tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ce8b1b9bbe634eca989007e998c54271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:54.225803 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-04a45579-be46-4721-a6e8-3ff36d28718f tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7'} {{(pid=119128) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:17:54.234577 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.compute.servers [None req-04a45579-be46-4721-a6e8-3ff36d28718f tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Flavor 'non_existing_flavor' could not be found {{(pid=119128) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Jun 20 12:17:54.235755 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-04a45579-be46-4721-a6e8-3ff36d28718f tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.031482 Jun 20 12:17:54.236750 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2145/4383] 10.222.0.27 () {58 vars in 1177 bytes} [Mon Jun 20 12:17:54 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:17:54.248662 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6f74b432-2a6c-4fe0-98ed-13cd43a34732 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:54.267257 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6f74b432-2a6c-4fe0-98ed-13cd43a34732 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ce8b1b9bbe634eca989007e998c54271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:54.270846 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6f74b432-2a6c-4fe0-98ed-13cd43a34732 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7'} {{(pid=119127) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:17:54.310183 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6f74b432-2a6c-4fe0-98ed-13cd43a34732 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:54.311905 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6f74b432-2a6c-4fe0-98ed-13cd43a34732 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:54.318810 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6f74b432-2a6c-4fe0-98ed-13cd43a34732 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:54.319655 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6f74b432-2a6c-4fe0-98ed-13cd43a34732 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:54.519870 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6f74b432-2a6c-4fe0-98ed-13cd43a34732 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.273594 Jun 20 12:17:54.521117 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2239/4384] 10.222.0.27 () {58 vars in 1173 bytes} [Mon Jun 20 12:17:54 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 20 12:17:54.539518 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5093375c-bdb7-4c06-bd57-0a2c687013ec tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:54.544120 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5093375c-bdb7-4c06-bd57-0a2c687013ec tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ce8b1b9bbe634eca989007e998c54271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:54.545280 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5093375c-bdb7-4c06-bd57-0a2c687013ec tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7'} {{(pid=119127) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:17:54.553150 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5093375c-bdb7-4c06-bd57-0a2c687013ec tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:54.554184 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5093375c-bdb7-4c06-bd57-0a2c687013ec tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:54.555146 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5093375c-bdb7-4c06-bd57-0a2c687013ec tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:54.555734 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5093375c-bdb7-4c06-bd57-0a2c687013ec tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:54.643526 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5093375c-bdb7-4c06-bd57-0a2c687013ec tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.113388 Jun 20 12:17:54.644944 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2240/4385] 10.222.0.27 () {58 vars in 1183 bytes} [Mon Jun 20 12:17:54 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:17:54.655030 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f0c2595b-b703-4140-b7ea-e4b50f4a6420 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:54.656000 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f0c2595b-b703-4140-b7ea-e4b50f4a6420 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:54.663227 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f0c2595b-b703-4140-b7ea-e4b50f4a6420 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:54.664049 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f0c2595b-b703-4140-b7ea-e4b50f4a6420 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:54.665102 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f0c2595b-b703-4140-b7ea-e4b50f4a6420 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:54.665749 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f0c2595b-b703-4140-b7ea-e4b50f4a6420 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:54.810114 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f0c2595b-b703-4140-b7ea-e4b50f4a6420 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:54.818945 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cc94d90f-3a83-48e3-8dd0-0d32d505e888 tempest-ComputeTenantNetworksTest-1137518631 tempest-ComputeTenantNetworksTest-1137518631-project] Calling method '.version_select at 0x7f60738bc160>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:54.828938 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f0c2595b-b703-4140-b7ea-e4b50f4a6420 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:54.845965 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f0c2595b-b703-4140-b7ea-e4b50f4a6420 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:54.847130 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f0c2595b-b703-4140-b7ea-e4b50f4a6420 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1333 microversion: 2.20 time: 0.197588 Jun 20 12:17:54.854342 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2241/4386] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:17:54 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1333 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:17:54.859119 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-027d2f94-adce-4340-a5b3-83516569796e tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:54.862379 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-027d2f94-adce-4340-a5b3-83516569796e tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ce8b1b9bbe634eca989007e998c54271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:54.863186 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-027d2f94-adce-4340-a5b3-83516569796e tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Searching by: {'deleted': False, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7'} {{(pid=119127) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:17:54.893236 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-027d2f94-adce-4340-a5b3-83516569796e tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:54.898183 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-027d2f94-adce-4340-a5b3-83516569796e tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:54.899259 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-027d2f94-adce-4340-a5b3-83516569796e tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:54.901490 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-027d2f94-adce-4340-a5b3-83516569796e tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:54.975692 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.multi_cell_list [None req-027d2f94-adce-4340-a5b3-83516569796e tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119127) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 12:17:55.497834 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cc94d90f-3a83-48e3-8dd0-0d32d505e888 tempest-ComputeTenantNetworksTest-1137518631 tempest-ComputeTenantNetworksTest-1137518631-project] 10.222.0.27 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 1.090569 Jun 20 12:17:55.507793 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2146/4387] 10.222.0.27 () {58 vars in 1157 bytes} [Mon Jun 20 12:17:54 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:17:55.513258 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5d88599e-d0f6-4bb9-86c5-acb3679d2abc tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:55.514165 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5d88599e-d0f6-4bb9-86c5-acb3679d2abc tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] [instance: eeb064b6-219f-4308-998b-b0526e80ae79] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:55.524849 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5d88599e-d0f6-4bb9-86c5-acb3679d2abc tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:55.525565 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5d88599e-d0f6-4bb9-86c5-acb3679d2abc tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:55.526527 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5d88599e-d0f6-4bb9-86c5-acb3679d2abc tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:55.527247 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5d88599e-d0f6-4bb9-86c5-acb3679d2abc tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:55.569634 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5d88599e-d0f6-4bb9-86c5-acb3679d2abc tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:55.573589 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5d88599e-d0f6-4bb9-86c5-acb3679d2abc tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:55.574333 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-5d88599e-d0f6-4bb9-86c5-acb3679d2abc tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lazy-loading 'fault' on Instance uuid eeb064b6-219f-4308-998b-b0526e80ae79 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:17:55.636495 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-027d2f94-adce-4340-a5b3-83516569796e tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b1b9bbe634eca989007e998c54271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:55.653351 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-027d2f94-adce-4340-a5b3-83516569796e tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:55.654006 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-027d2f94-adce-4340-a5b3-83516569796e tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:55.692589 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5d88599e-d0f6-4bb9-86c5-acb3679d2abc tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431bc8d528754011826b568e4f647d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaf378174574af3b1f734a914a0bf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:55.704041 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5d88599e-d0f6-4bb9-86c5-acb3679d2abc tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '431bc8d528754011826b568e4f647d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaf378174574af3b1f734a914a0bf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:55.706126 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5d88599e-d0f6-4bb9-86c5-acb3679d2abc tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '431bc8d528754011826b568e4f647d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eaf378174574af3b1f734a914a0bf71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:55.707710 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5d88599e-d0f6-4bb9-86c5-acb3679d2abc tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] 10.222.0.27 "GET /compute/v2.1/servers/eeb064b6-219f-4308-998b-b0526e80ae79" status: 200 len: 1370 microversion: 2.47 time: 0.198591 Jun 20 12:17:55.708519 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2147/4388] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:17:55 2022] GET /compute/v2.1/servers/eeb064b6-219f-4308-998b-b0526e80ae79 => generated 1370 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:17:55.714244 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e49fe934-07d4-4a35-91e3-9f9db0270433 tempest-ComputeTenantNetworksTest-1137518631 tempest-ComputeTenantNetworksTest-1137518631-project] Calling method '.version_select at 0x7f6072c1bf70>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:55.906964 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-027d2f94-adce-4340-a5b3-83516569796e tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 3025 microversion: 2.1 time: 1.051423 Jun 20 12:17:55.907822 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2242/4389] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 12:17:54 2022] GET /compute/v2.1/servers/detail => generated 3025 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:55.927031 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b60b5ec3-f058-4eb2-9ea2-d1d74ea4ea7e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:55.927703 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b60b5ec3-f058-4eb2-9ea2-d1d74ea4ea7e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:55.934445 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b60b5ec3-f058-4eb2-9ea2-d1d74ea4ea7e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:55.934901 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b60b5ec3-f058-4eb2-9ea2-d1d74ea4ea7e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:55.935681 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b60b5ec3-f058-4eb2-9ea2-d1d74ea4ea7e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:55.936122 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b60b5ec3-f058-4eb2-9ea2-d1d74ea4ea7e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:56.015793 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b60b5ec3-f058-4eb2-9ea2-d1d74ea4ea7e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:56.026846 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b60b5ec3-f058-4eb2-9ea2-d1d74ea4ea7e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:56.028688 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b60b5ec3-f058-4eb2-9ea2-d1d74ea4ea7e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:56.029889 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b60b5ec3-f058-4eb2-9ea2-d1d74ea4ea7e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1339 microversion: 2.20 time: 0.120712 Jun 20 12:17:56.041832 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2243/4390] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:17:55 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1339 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:17:56.041832 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-35617531-bdf3-476c-8b3c-5a8c22cb0d9e tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:56.041832 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-35617531-bdf3-476c-8b3c-5a8c22cb0d9e tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ce8b1b9bbe634eca989007e998c54271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:56.042742 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-35617531-bdf3-476c-8b3c-5a8c22cb0d9e tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.010527 Jun 20 12:17:56.043590 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2244/4391] 10.222.0.27 () {58 vars in 1177 bytes} [Mon Jun 20 12:17:56 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:17:56.062468 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-19118046-e6ae-41bf-9814-3b053f6d2eef tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:56.066955 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-19118046-e6ae-41bf-9814-3b053f6d2eef tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ce8b1b9bbe634eca989007e998c54271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:56.067583 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-19118046-e6ae-41bf-9814-3b053f6d2eef tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Searching by: {'deleted': False, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7'} {{(pid=119127) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:17:56.073249 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-19118046-e6ae-41bf-9814-3b053f6d2eef tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:56.073722 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-19118046-e6ae-41bf-9814-3b053f6d2eef tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:56.074986 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-19118046-e6ae-41bf-9814-3b053f6d2eef tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:56.075792 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-19118046-e6ae-41bf-9814-3b053f6d2eef tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:56.106312 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.multi_cell_list [None req-19118046-e6ae-41bf-9814-3b053f6d2eef tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119127) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 12:17:56.122694 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:17:56.142524 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-19118046-e6ae-41bf-9814-3b053f6d2eef tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.083931 Jun 20 12:17:56.143330 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2245/4392] 10.222.0.27 () {58 vars in 1124 bytes} [Mon Jun 20 12:17:56 2022] GET /compute/v2.1/servers => generated 683 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:17:56.156932 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8242752c-b974-4d71-8f8a-00e5c98fb09d tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:56.157302 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8242752c-b974-4d71-8f8a-00e5c98fb09d tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: f65e72fa-4e88-44c5-bba1-0dc4f78eea47] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:56.168528 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8242752c-b974-4d71-8f8a-00e5c98fb09d tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:56.169519 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8242752c-b974-4d71-8f8a-00e5c98fb09d tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:56.170097 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8242752c-b974-4d71-8f8a-00e5c98fb09d tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:56.170541 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8242752c-b974-4d71-8f8a-00e5c98fb09d tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:56.192555 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-8242752c-b974-4d71-8f8a-00e5c98fb09d tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] HTTP exception thrown: Instance f65e72fa-4e88-44c5-bba1-0dc4f78eea47 could not be found. Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8242752c-b974-4d71-8f8a-00e5c98fb09d tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Request method failure captured: Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/f65e72fa-4e88-44c5-bba1-0dc4f78eea47 HTTP/1.1 Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGVAqKyxVdJIEq-n9iVwEchBpwymieKfVXc90v9XydoJheO0JWlxK0b48_33Cbl_sKhJ2fDc7TuzluU6cB3GdJ6NZWwq6SJAqw-A7GapmZ9SU5AghuMZUOC5cFGyuznBNi2ye2k60xEKPCSzUnqgAZ7Siy7MC1w7LxAqkkKomYTNkIo Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 6a608c15e7f140e3a1d01fabcf6157e7 Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ListServersNegativeTestJSON-284089426 Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a608c15e7f140e3a1d01fabcf6157e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a608c15e7f140e3a1d01fabcf6157e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a608c15e7f140e3a1d01fabcf6157e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a608c15e7f140e3a1d01fabcf6157e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ListServersNegativeTestJSON-284089426 Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 6a608c15e7f140e3a1d01fabcf6157e7 Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-284089426 Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ListServersNegativeTestJSON-284089426-project Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: ce8b1b9bbe634eca989007e998c54271 Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ListServersNegativeTestJSON-284089426-project Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: exception: Instance f65e72fa-4e88-44c5-bba1-0dc4f78eea47 could not be found. Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'f65e72fa-4e88-44c5-bba1-0dc4f78eea47'} Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f65e72fa-4e88-44c5-bba1-0dc4f78eea47 could not be found. Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:17:56.195238 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:17:56.199878 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f65e72fa-4e88-44c5-bba1-0dc4f78eea47 could not be found. Jun 20 12:17:56.199878 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:56.199878 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:56.199878 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:56.199878 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:56.199878 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:56.199878 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:56.199878 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:17:56.199878 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:17:56.199878 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f65e72fa-4e88-44c5-bba1-0dc4f78eea47 could not be found. Jun 20 12:17:56.199878 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:56.201472 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8242752c-b974-4d71-8f8a-00e5c98fb09d tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Returning 404 to user: Instance f65e72fa-4e88-44c5-bba1-0dc4f78eea47 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:17:56.210077 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8242752c-b974-4d71-8f8a-00e5c98fb09d tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f65e72fa-4e88-44c5-bba1-0dc4f78eea47" status: 404 len: 111 microversion: 2.1 time: 0.056998 Jun 20 12:17:56.213855 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2246/4393] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:17:56 2022] DELETE /compute/v2.1/servers/f65e72fa-4e88-44c5-bba1-0dc4f78eea47 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:17:56.219193 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8a6e10ee-d15f-4b66-ab01-99fb3d6e0178 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:56.220305 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8a6e10ee-d15f-4b66-ab01-99fb3d6e0178 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: 8c46b7ac-3373-4ff7-8527-f2800b2ba847] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:56.227187 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a6e10ee-d15f-4b66-ab01-99fb3d6e0178 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:56.227648 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a6e10ee-d15f-4b66-ab01-99fb3d6e0178 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:56.228476 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a6e10ee-d15f-4b66-ab01-99fb3d6e0178 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:56.229490 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a6e10ee-d15f-4b66-ab01-99fb3d6e0178 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:56.262926 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8a6e10ee-d15f-4b66-ab01-99fb3d6e0178 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: 8c46b7ac-3373-4ff7-8527-f2800b2ba847] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:17:56.274105 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e49fe934-07d4-4a35-91e3-9f9db0270433 tempest-ComputeTenantNetworksTest-1137518631 tempest-ComputeTenantNetworksTest-1137518631-project] 10.222.0.27 "GET /compute/v2.1/os-tenant-networks/8f716224-41ff-458a-9413-426863ade11c" status: 200 len: 140 microversion: 2.1 time: 0.564169 Jun 20 12:17:56.275013 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2148/4394] 10.222.0.27 () {58 vars in 1268 bytes} [Mon Jun 20 12:17:55 2022] GET /compute/v2.1/os-tenant-networks/8f716224-41ff-458a-9413-426863ade11c => generated 140 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:17:56.396914 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8a6e10ee-d15f-4b66-ab01-99fb3d6e0178 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8c46b7ac-3373-4ff7-8527-f2800b2ba847" status: 204 len: 0 microversion: 2.1 time: 0.181032 Jun 20 12:17:56.400809 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2247/4395] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:17:56 2022] DELETE /compute/v2.1/servers/8c46b7ac-3373-4ff7-8527-f2800b2ba847 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:17:56.408195 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-afb1d9e5-83a0-46ec-b9e2-99fda1e4a736 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:56.408980 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-afb1d9e5-83a0-46ec-b9e2-99fda1e4a736 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: 9dc75474-7e3c-462c-b704-dd6f9e948190] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:56.425056 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-afb1d9e5-83a0-46ec-b9e2-99fda1e4a736 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:56.425701 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-afb1d9e5-83a0-46ec-b9e2-99fda1e4a736 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:56.428296 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-afb1d9e5-83a0-46ec-b9e2-99fda1e4a736 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:56.429554 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-afb1d9e5-83a0-46ec-b9e2-99fda1e4a736 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:56.483403 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-afb1d9e5-83a0-46ec-b9e2-99fda1e4a736 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: 9dc75474-7e3c-462c-b704-dd6f9e948190] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:17:56.653785 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-afb1d9e5-83a0-46ec-b9e2-99fda1e4a736 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190" status: 204 len: 0 microversion: 2.1 time: 0.251130 Jun 20 12:17:56.654576 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2149/4396] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:17:56 2022] DELETE /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 12:17:56.668354 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-13385f89-e714-4cd1-8ff7-742b4c2b3848 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:56.669390 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-13385f89-e714-4cd1-8ff7-742b4c2b3848 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: f65e72fa-4e88-44c5-bba1-0dc4f78eea47] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:56.683217 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-13385f89-e714-4cd1-8ff7-742b4c2b3848 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:56.684083 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-13385f89-e714-4cd1-8ff7-742b4c2b3848 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:56.685373 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-13385f89-e714-4cd1-8ff7-742b4c2b3848 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:56.686306 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-13385f89-e714-4cd1-8ff7-742b4c2b3848 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:56.706750 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-13385f89-e714-4cd1-8ff7-742b4c2b3848 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] HTTP exception thrown: Instance f65e72fa-4e88-44c5-bba1-0dc4f78eea47 could not be found. Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-13385f89-e714-4cd1-8ff7-742b4c2b3848 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Request method failure captured: Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/f65e72fa-4e88-44c5-bba1-0dc4f78eea47 HTTP/1.1 Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGVAqKyxVdJIEq-n9iVwEchBpwymieKfVXc90v9XydoJheO0JWlxK0b48_33Cbl_sKhJ2fDc7TuzluU6cB3GdJ6NZWwq6SJAqw-A7GapmZ9SU5AghuMZUOC5cFGyuznBNi2ye2k60xEKPCSzUnqgAZ7Siy7MC1w7LxAqkkKomYTNkIo Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 6a608c15e7f140e3a1d01fabcf6157e7 Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ListServersNegativeTestJSON-284089426 Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a608c15e7f140e3a1d01fabcf6157e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a608c15e7f140e3a1d01fabcf6157e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a608c15e7f140e3a1d01fabcf6157e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a608c15e7f140e3a1d01fabcf6157e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ListServersNegativeTestJSON-284089426 Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 6a608c15e7f140e3a1d01fabcf6157e7 Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-284089426 Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ListServersNegativeTestJSON-284089426-project Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: ce8b1b9bbe634eca989007e998c54271 Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ListServersNegativeTestJSON-284089426-project Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: exception: Instance f65e72fa-4e88-44c5-bba1-0dc4f78eea47 could not be found. Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'f65e72fa-4e88-44c5-bba1-0dc4f78eea47'} Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f65e72fa-4e88-44c5-bba1-0dc4f78eea47 could not be found. Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f65e72fa-4e88-44c5-bba1-0dc4f78eea47 could not be found. Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:56.709277 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:56.712962 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:56.712962 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:56.712962 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:56.712962 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:17:56.712962 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:17:56.712962 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f65e72fa-4e88-44c5-bba1-0dc4f78eea47 could not be found. Jun 20 12:17:56.712962 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:56.715012 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-13385f89-e714-4cd1-8ff7-742b4c2b3848 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Returning 404 to user: Instance f65e72fa-4e88-44c5-bba1-0dc4f78eea47 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:17:56.716260 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-13385f89-e714-4cd1-8ff7-742b4c2b3848 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers/f65e72fa-4e88-44c5-bba1-0dc4f78eea47" status: 404 len: 111 microversion: 2.1 time: 0.056844 Jun 20 12:17:56.717505 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2248/4397] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:56 2022] GET /compute/v2.1/servers/f65e72fa-4e88-44c5-bba1-0dc4f78eea47 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:17:56.726391 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e4649a6a-ff46-4b09-84d8-2b4ce558a00a tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:56.727145 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e4649a6a-ff46-4b09-84d8-2b4ce558a00a tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: 8c46b7ac-3373-4ff7-8527-f2800b2ba847] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:56.731428 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e66d0492-c1cf-4c94-93e3-0b7456d75f61 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:56.732294 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e66d0492-c1cf-4c94-93e3-0b7456d75f61 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] [instance: eeb064b6-219f-4308-998b-b0526e80ae79] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:56.736476 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e4649a6a-ff46-4b09-84d8-2b4ce558a00a tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:56.736935 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e4649a6a-ff46-4b09-84d8-2b4ce558a00a tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:56.737705 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e4649a6a-ff46-4b09-84d8-2b4ce558a00a tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:56.738386 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e4649a6a-ff46-4b09-84d8-2b4ce558a00a tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:56.740193 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e66d0492-c1cf-4c94-93e3-0b7456d75f61 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:56.740779 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e66d0492-c1cf-4c94-93e3-0b7456d75f61 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:56.741543 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e66d0492-c1cf-4c94-93e3-0b7456d75f61 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:56.741974 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e66d0492-c1cf-4c94-93e3-0b7456d75f61 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:56.758701 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-e66d0492-c1cf-4c94-93e3-0b7456d75f61 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] HTTP exception thrown: Instance eeb064b6-219f-4308-998b-b0526e80ae79 could not be found. Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e66d0492-c1cf-4c94-93e3-0b7456d75f61 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Request method failure captured: Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/eeb064b6-219f-4308-998b-b0526e80ae79 HTTP/1.1 Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGVpfMnbXYS4d3hJwenafYpBfLZ_kZrSXpm6Yd4oRCysFePtxehPOofspN7bqS-c-FtyCckwboAt_8QcJHtE4MY2o6Vf-nghvSz0sTZT096fPOTvg0xMQ99NffbiUZ0bU1A2NYx49CLAcpjWrWjdOlchKJqcu93pcfCxXmip3qVhXDg Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: X-Openstack-Nova-Api-Version: 2.47 Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 6eaf378174574af3b1f734a914a0bf71 Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersAaction247Test-1839321458 Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6eaf378174574af3b1f734a914a0bf71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6eaf378174574af3b1f734a914a0bf71"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6eaf378174574af3b1f734a914a0bf71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6eaf378174574af3b1f734a914a0bf71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersAaction247Test-1839321458 Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 6eaf378174574af3b1f734a914a0bf71 Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersAaction247Test-1839321458 Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersAaction247Test-1839321458-project Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 431bc8d528754011826b568e4f647d4b Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersAaction247Test-1839321458-project Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: exception: Instance eeb064b6-219f-4308-998b-b0526e80ae79 could not be found. Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'eeb064b6-219f-4308-998b-b0526e80ae79'} Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeb064b6-219f-4308-998b-b0526e80ae79 could not be found. Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeb064b6-219f-4308-998b-b0526e80ae79 could not be found. Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:56.760495 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:56.764113 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:56.764113 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:56.764113 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:56.764113 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:17:56.764113 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:17:56.764113 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeb064b6-219f-4308-998b-b0526e80ae79 could not be found. Jun 20 12:17:56.764113 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:56.764113 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e66d0492-c1cf-4c94-93e3-0b7456d75f61 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] Returning 404 to user: Instance eeb064b6-219f-4308-998b-b0526e80ae79 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:17:56.764113 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e66d0492-c1cf-4c94-93e3-0b7456d75f61 tempest-ServersAaction247Test-1839321458 tempest-ServersAaction247Test-1839321458-project] 10.222.0.27 "GET /compute/v2.1/servers/eeb064b6-219f-4308-998b-b0526e80ae79" status: 404 len: 111 microversion: 2.47 time: 0.038673 Jun 20 12:17:56.765826 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2249/4398] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:17:56 2022] GET /compute/v2.1/servers/eeb064b6-219f-4308-998b-b0526e80ae79 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 20 12:17:57.061345 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c229230b-1fcf-4d64-b909-da5089ca56aa tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:57.061983 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c229230b-1fcf-4d64-b909-da5089ca56aa tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:57.070715 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c229230b-1fcf-4d64-b909-da5089ca56aa tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:57.071129 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c229230b-1fcf-4d64-b909-da5089ca56aa tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:57.072179 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c229230b-1fcf-4d64-b909-da5089ca56aa tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:57.073147 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c229230b-1fcf-4d64-b909-da5089ca56aa tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:57.329023 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e4649a6a-ff46-4b09-84d8-2b4ce558a00a tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b1b9bbe634eca989007e998c54271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:57.339666 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e4649a6a-ff46-4b09-84d8-2b4ce558a00a tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers/8c46b7ac-3373-4ff7-8527-f2800b2ba847" status: 200 len: 1522 microversion: 2.1 time: 0.617323 Jun 20 12:17:57.341102 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2150/4399] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:56 2022] GET /compute/v2.1/servers/8c46b7ac-3373-4ff7-8527-f2800b2ba847 => generated 1522 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:57.944967 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c229230b-1fcf-4d64-b909-da5089ca56aa tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:57.961467 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c229230b-1fcf-4d64-b909-da5089ca56aa tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:57.962971 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c229230b-1fcf-4d64-b909-da5089ca56aa tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:57.964124 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c229230b-1fcf-4d64-b909-da5089ca56aa tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1406 microversion: 2.20 time: 0.918740 Jun 20 12:17:57.964720 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2250/4400] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:17:57 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1406 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:17:58.359103 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3e78fb28-d3ec-4e04-b89d-50055b8963ab tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:58.359842 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3e78fb28-d3ec-4e04-b89d-50055b8963ab tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: 8c46b7ac-3373-4ff7-8527-f2800b2ba847] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:58.369127 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3e78fb28-d3ec-4e04-b89d-50055b8963ab tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:58.369869 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3e78fb28-d3ec-4e04-b89d-50055b8963ab tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:58.370797 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3e78fb28-d3ec-4e04-b89d-50055b8963ab tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:58.371137 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3e78fb28-d3ec-4e04-b89d-50055b8963ab tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:58.718038 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3e78fb28-d3ec-4e04-b89d-50055b8963ab tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b1b9bbe634eca989007e998c54271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:58.731363 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3e78fb28-d3ec-4e04-b89d-50055b8963ab tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers/8c46b7ac-3373-4ff7-8527-f2800b2ba847" status: 200 len: 1522 microversion: 2.1 time: 0.376853 Jun 20 12:17:58.743204 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2151/4401] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:58 2022] GET /compute/v2.1/servers/8c46b7ac-3373-4ff7-8527-f2800b2ba847 => generated 1522 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:58.846594 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-3c7ec39a-8782-48c3-bd4f-3504f1cba73d req-0ce5e5be-2293-420f-831a-4eaea215e2e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c46b7ac-3373-4ff7-8527-f2800b2ba847", "name": "network-vif-deleted", "tag": "f398b629-6b58-4763-9a52-7f13fb752b43"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:17:58.899689 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-3c7ec39a-8782-48c3-bd4f-3504f1cba73d req-0ce5e5be-2293-420f-831a-4eaea215e2e2 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:58.900088 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-3c7ec39a-8782-48c3-bd4f-3504f1cba73d req-0ce5e5be-2293-420f-831a-4eaea215e2e2 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:58.963060 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-3c7ec39a-8782-48c3-bd4f-3504f1cba73d req-0ce5e5be-2293-420f-831a-4eaea215e2e2 service nova] Creating event network-vif-deleted:f398b629-6b58-4763-9a52-7f13fb752b43 for instance 8c46b7ac-3373-4ff7-8527-f2800b2ba847 on n-h1-master-1 Jun 20 12:17:58.983512 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4c9d1353-7212-4147-9681-9c3e257ddf92 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:58.984324 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4c9d1353-7212-4147-9681-9c3e257ddf92 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:58.991515 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4c9d1353-7212-4147-9681-9c3e257ddf92 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:58.993732 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-3c7ec39a-8782-48c3-bd4f-3504f1cba73d req-0ce5e5be-2293-420f-831a-4eaea215e2e2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156666 Jun 20 12:17:59.002596 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2251/4402] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:17:59.008578 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4c9d1353-7212-4147-9681-9c3e257ddf92 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:59.019986 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4c9d1353-7212-4147-9681-9c3e257ddf92 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:59.020379 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4c9d1353-7212-4147-9681-9c3e257ddf92 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:59.731789 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-fb1499f7-7cbf-4ead-b0c2-a1091efab07b req-26001085-9483-4b1e-83eb-b5bbe16bb42d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dc75474-7e3c-462c-b704-dd6f9e948190", "name": "network-vif-deleted", "tag": "f9ff76df-7bbe-414a-be10-bcadb596d155"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:17:59.751220 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-fb1499f7-7cbf-4ead-b0c2-a1091efab07b req-26001085-9483-4b1e-83eb-b5bbe16bb42d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:59.754388 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-fb1499f7-7cbf-4ead-b0c2-a1091efab07b req-26001085-9483-4b1e-83eb-b5bbe16bb42d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:59.791591 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-fb1499f7-7cbf-4ead-b0c2-a1091efab07b req-26001085-9483-4b1e-83eb-b5bbe16bb42d service nova] Creating event network-vif-deleted:f9ff76df-7bbe-414a-be10-bcadb596d155 for instance 9dc75474-7e3c-462c-b704-dd6f9e948190 on n-h2-master-1 Jun 20 12:17:59.812069 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-fb1499f7-7cbf-4ead-b0c2-a1091efab07b req-26001085-9483-4b1e-83eb-b5bbe16bb42d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084689 Jun 20 12:17:59.814839 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2252/4403] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:17:59.822047 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4c9d1353-7212-4147-9681-9c3e257ddf92 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:59.825624 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fd73a933-d89f-4bec-aa7b-09b4b93aa9cf tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:59.828887 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fd73a933-d89f-4bec-aa7b-09b4b93aa9cf tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: 8c46b7ac-3373-4ff7-8527-f2800b2ba847] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:59.837550 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4c9d1353-7212-4147-9681-9c3e257ddf92 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:59.840580 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4c9d1353-7212-4147-9681-9c3e257ddf92 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:17:59.842067 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4c9d1353-7212-4147-9681-9c3e257ddf92 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1406 microversion: 2.20 time: 0.862680 Jun 20 12:17:59.845339 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2152/4404] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:17:58 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1406 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:17:59.862404 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fd73a933-d89f-4bec-aa7b-09b4b93aa9cf tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:59.863286 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fd73a933-d89f-4bec-aa7b-09b4b93aa9cf tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:59.874691 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fd73a933-d89f-4bec-aa7b-09b4b93aa9cf tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:59.878244 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fd73a933-d89f-4bec-aa7b-09b4b93aa9cf tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:59.938560 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-fd73a933-d89f-4bec-aa7b-09b4b93aa9cf tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] HTTP exception thrown: Instance 8c46b7ac-3373-4ff7-8527-f2800b2ba847 could not be found. Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fd73a933-d89f-4bec-aa7b-09b4b93aa9cf tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Request method failure captured: Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/8c46b7ac-3373-4ff7-8527-f2800b2ba847 HTTP/1.1 Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGVAqKyxVdJIEq-n9iVwEchBpwymieKfVXc90v9XydoJheO0JWlxK0b48_33Cbl_sKhJ2fDc7TuzluU6cB3GdJ6NZWwq6SJAqw-A7GapmZ9SU5AghuMZUOC5cFGyuznBNi2ye2k60xEKPCSzUnqgAZ7Siy7MC1w7LxAqkkKomYTNkIo Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 6a608c15e7f140e3a1d01fabcf6157e7 Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ListServersNegativeTestJSON-284089426 Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a608c15e7f140e3a1d01fabcf6157e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a608c15e7f140e3a1d01fabcf6157e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a608c15e7f140e3a1d01fabcf6157e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a608c15e7f140e3a1d01fabcf6157e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ListServersNegativeTestJSON-284089426 Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 6a608c15e7f140e3a1d01fabcf6157e7 Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-284089426 Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ListServersNegativeTestJSON-284089426-project Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: ce8b1b9bbe634eca989007e998c54271 Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ListServersNegativeTestJSON-284089426-project Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 8c46b7ac-3373-4ff7-8527-f2800b2ba847 could not be found. Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '8c46b7ac-3373-4ff7-8527-f2800b2ba847'} Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c46b7ac-3373-4ff7-8527-f2800b2ba847 could not be found. Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c46b7ac-3373-4ff7-8527-f2800b2ba847 could not be found. Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:17:59.945299 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:59.949037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:17:59.949037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:17:59.949037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:17:59.949037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:17:59.949037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:17:59.949037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c46b7ac-3373-4ff7-8527-f2800b2ba847 could not be found. Jun 20 12:17:59.949037 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:17:59.953077 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fd73a933-d89f-4bec-aa7b-09b4b93aa9cf tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Returning 404 to user: Instance 8c46b7ac-3373-4ff7-8527-f2800b2ba847 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:17:59.955814 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fd73a933-d89f-4bec-aa7b-09b4b93aa9cf tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers/8c46b7ac-3373-4ff7-8527-f2800b2ba847" status: 404 len: 111 microversion: 2.1 time: 0.137609 Jun 20 12:17:59.967425 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2253/4405] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:59 2022] GET /compute/v2.1/servers/8c46b7ac-3373-4ff7-8527-f2800b2ba847 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:17:59.975023 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b29d1aac-79bc-41e0-ab92-90ca97a4687a tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:59.975584 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b29d1aac-79bc-41e0-ab92-90ca97a4687a tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: 9dc75474-7e3c-462c-b704-dd6f9e948190] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:17:59.982012 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b29d1aac-79bc-41e0-ab92-90ca97a4687a tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:59.982465 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b29d1aac-79bc-41e0-ab92-90ca97a4687a tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:17:59.983225 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b29d1aac-79bc-41e0-ab92-90ca97a4687a tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:17:59.983665 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b29d1aac-79bc-41e0-ab92-90ca97a4687a tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:00.019194 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:18:00.052917 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b29d1aac-79bc-41e0-ab92-90ca97a4687a tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:00.053691 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b29d1aac-79bc-41e0-ab92-90ca97a4687a tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:00.055364 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-b29d1aac-79bc-41e0-ab92-90ca97a4687a tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lazy-loading 'fault' on Instance uuid 9dc75474-7e3c-462c-b704-dd6f9e948190 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:18:00.261947 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b29d1aac-79bc-41e0-ab92-90ca97a4687a tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b1b9bbe634eca989007e998c54271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a608c15e7f140e3a1d01fabcf6157e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:00.285981 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b29d1aac-79bc-41e0-ab92-90ca97a4687a tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190" status: 200 len: 1313 microversion: 2.1 time: 0.312815 Jun 20 12:18:00.286712 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2153/4406] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:17:59 2022] GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190 => generated 1313 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:01.306727 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-92758bcf-b3f3-4506-aead-068d1c9a66f4 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:01.307485 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-92758bcf-b3f3-4506-aead-068d1c9a66f4 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] [instance: 9dc75474-7e3c-462c-b704-dd6f9e948190] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:01.325698 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-92758bcf-b3f3-4506-aead-068d1c9a66f4 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:01.329398 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-92758bcf-b3f3-4506-aead-068d1c9a66f4 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:01.330410 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-92758bcf-b3f3-4506-aead-068d1c9a66f4 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:01.335289 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-92758bcf-b3f3-4506-aead-068d1c9a66f4 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:01.352785 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bee0360a-0f81-4d15-8a17-69be4d3cd732 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:01.353409 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bee0360a-0f81-4d15-8a17-69be4d3cd732 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:01.375967 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bee0360a-0f81-4d15-8a17-69be4d3cd732 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:01.376547 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bee0360a-0f81-4d15-8a17-69be4d3cd732 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:01.378287 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bee0360a-0f81-4d15-8a17-69be4d3cd732 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:01.378287 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bee0360a-0f81-4d15-8a17-69be4d3cd732 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:01.390434 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-92758bcf-b3f3-4506-aead-068d1c9a66f4 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] HTTP exception thrown: Instance 9dc75474-7e3c-462c-b704-dd6f9e948190 could not be found. Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-92758bcf-b3f3-4506-aead-068d1c9a66f4 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Request method failure captured: Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190 HTTP/1.1 Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGVAqKyxVdJIEq-n9iVwEchBpwymieKfVXc90v9XydoJheO0JWlxK0b48_33Cbl_sKhJ2fDc7TuzluU6cB3GdJ6NZWwq6SJAqw-A7GapmZ9SU5AghuMZUOC5cFGyuznBNi2ye2k60xEKPCSzUnqgAZ7Siy7MC1w7LxAqkkKomYTNkIo Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 6a608c15e7f140e3a1d01fabcf6157e7 Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ListServersNegativeTestJSON-284089426 Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a608c15e7f140e3a1d01fabcf6157e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a608c15e7f140e3a1d01fabcf6157e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a608c15e7f140e3a1d01fabcf6157e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a608c15e7f140e3a1d01fabcf6157e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ListServersNegativeTestJSON-284089426 Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 6a608c15e7f140e3a1d01fabcf6157e7 Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-284089426 Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ListServersNegativeTestJSON-284089426-project Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: ce8b1b9bbe634eca989007e998c54271 Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ListServersNegativeTestJSON-284089426-project Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 9dc75474-7e3c-462c-b704-dd6f9e948190 could not be found. Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '9dc75474-7e3c-462c-b704-dd6f9e948190'} Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dc75474-7e3c-462c-b704-dd6f9e948190 could not be found. Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dc75474-7e3c-462c-b704-dd6f9e948190 could not be found. Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:18:01.400801 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:18:01.405716 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:18:01.405716 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:18:01.405716 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:18:01.405716 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:18:01.405716 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:18:01.405716 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dc75474-7e3c-462c-b704-dd6f9e948190 could not be found. Jun 20 12:18:01.405716 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:18:01.405716 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-92758bcf-b3f3-4506-aead-068d1c9a66f4 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] Returning 404 to user: Instance 9dc75474-7e3c-462c-b704-dd6f9e948190 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:18:01.405716 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-92758bcf-b3f3-4506-aead-068d1c9a66f4 tempest-ListServersNegativeTestJSON-284089426 tempest-ListServersNegativeTestJSON-284089426-project] 10.222.0.27 "GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190" status: 404 len: 111 microversion: 2.1 time: 0.102766 Jun 20 12:18:01.405716 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2154/4407] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:01 2022] GET /compute/v2.1/servers/9dc75474-7e3c-462c-b704-dd6f9e948190 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:18:01.416256 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-ac9588c1-c3a2-48da-9450-9e3793bb2cb9 req-4d13ee55-6253-40ec-839b-cbc1ff4309d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ed20ca4-7f49-4d0a-a590-d2d4274698e3", "tag": "4bb9ec16-a224-4e67-8de4-0415485dde23"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:18:01.439280 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-ac9588c1-c3a2-48da-9450-9e3793bb2cb9 req-4d13ee55-6253-40ec-839b-cbc1ff4309d8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:01.439725 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-ac9588c1-c3a2-48da-9450-9e3793bb2cb9 req-4d13ee55-6253-40ec-839b-cbc1ff4309d8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:01.461258 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-ac9588c1-c3a2-48da-9450-9e3793bb2cb9 req-4d13ee55-6253-40ec-839b-cbc1ff4309d8 service nova] Creating event network-changed:4bb9ec16-a224-4e67-8de4-0415485dde23 for instance 6ed20ca4-7f49-4d0a-a590-d2d4274698e3 on n-h1-master-1 Jun 20 12:18:01.467067 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-ac9588c1-c3a2-48da-9450-9e3793bb2cb9 req-4d13ee55-6253-40ec-839b-cbc1ff4309d8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059295 Jun 20 12:18:01.469141 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2155/4408] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:18:01.961335 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bee0360a-0f81-4d15-8a17-69be4d3cd732 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:01.978767 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bee0360a-0f81-4d15-8a17-69be4d3cd732 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:01.982271 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bee0360a-0f81-4d15-8a17-69be4d3cd732 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:01.989409 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bee0360a-0f81-4d15-8a17-69be4d3cd732 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1406 microversion: 2.20 time: 1.130464 Jun 20 12:18:01.990644 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2254/4409] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:18:00 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1406 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:18:03.009190 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7c3a6942-4f96-4e26-9260-ef544f6844ce tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:03.010116 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7c3a6942-4f96-4e26-9260-ef544f6844ce tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:03.040447 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7c3a6942-4f96-4e26-9260-ef544f6844ce tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:03.040997 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7c3a6942-4f96-4e26-9260-ef544f6844ce tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:03.041926 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7c3a6942-4f96-4e26-9260-ef544f6844ce tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:03.044746 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7c3a6942-4f96-4e26-9260-ef544f6844ce tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:03.673312 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7c3a6942-4f96-4e26-9260-ef544f6844ce tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:03.688730 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7c3a6942-4f96-4e26-9260-ef544f6844ce tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:03.694520 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7c3a6942-4f96-4e26-9260-ef544f6844ce tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:03.699132 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7c3a6942-4f96-4e26-9260-ef544f6844ce tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1406 microversion: 2.20 time: 0.694028 Jun 20 12:18:03.713687 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2156/4410] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:18:03 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1406 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:18:04.719606 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cf499e8f-1c45-4821-ad60-66db361cb921 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:04.720933 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cf499e8f-1c45-4821-ad60-66db361cb921 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:04.743682 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cf499e8f-1c45-4821-ad60-66db361cb921 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:04.744747 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cf499e8f-1c45-4821-ad60-66db361cb921 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:04.748559 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cf499e8f-1c45-4821-ad60-66db361cb921 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:04.749259 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cf499e8f-1c45-4821-ad60-66db361cb921 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:05.596317 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cf499e8f-1c45-4821-ad60-66db361cb921 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:05.605372 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cf499e8f-1c45-4821-ad60-66db361cb921 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:05.615530 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cf499e8f-1c45-4821-ad60-66db361cb921 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:05.617120 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cf499e8f-1c45-4821-ad60-66db361cb921 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1406 microversion: 2.20 time: 0.901870 Jun 20 12:18:05.617926 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2255/4411] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:18:04 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1406 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:18:06.635469 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d4949428-6479-405c-bc3f-3a8713065a15 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:06.636066 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d4949428-6479-405c-bc3f-3a8713065a15 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:06.655638 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4949428-6479-405c-bc3f-3a8713065a15 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:06.656085 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4949428-6479-405c-bc3f-3a8713065a15 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:06.656893 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4949428-6479-405c-bc3f-3a8713065a15 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:06.657322 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4949428-6479-405c-bc3f-3a8713065a15 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:07.031174 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d4949428-6479-405c-bc3f-3a8713065a15 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:07.047961 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d4949428-6479-405c-bc3f-3a8713065a15 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:07.057566 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d4949428-6479-405c-bc3f-3a8713065a15 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:07.061752 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d4949428-6479-405c-bc3f-3a8713065a15 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1406 microversion: 2.20 time: 0.430294 Jun 20 12:18:07.065184 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2157/4412] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:18:06 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1406 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:18:07.673181 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-014ef5b3-9d4c-47e1-bb70-d3264a682fd1 req-7a4a3e3f-d693-4950-be65-216b43a89237 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ed20ca4-7f49-4d0a-a590-d2d4274698e3", "name": "network-vif-plugged", "status": "completed", "tag": "4bb9ec16-a224-4e67-8de4-0415485dde23"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:18:07.681776 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=18 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:18:07.697523 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=18 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:18:07.717225 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-014ef5b3-9d4c-47e1-bb70-d3264a682fd1 req-7a4a3e3f-d693-4950-be65-216b43a89237 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:07.718013 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-014ef5b3-9d4c-47e1-bb70-d3264a682fd1 req-7a4a3e3f-d693-4950-be65-216b43a89237 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:07.734809 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-014ef5b3-9d4c-47e1-bb70-d3264a682fd1 req-7a4a3e3f-d693-4950-be65-216b43a89237 service nova] Creating event network-vif-plugged:4bb9ec16-a224-4e67-8de4-0415485dde23 for instance 6ed20ca4-7f49-4d0a-a590-d2d4274698e3 on n-h1-master-1 Jun 20 12:18:07.743837 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-014ef5b3-9d4c-47e1-bb70-d3264a682fd1 req-7a4a3e3f-d693-4950-be65-216b43a89237 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075575 Jun 20 12:18:07.757875 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2256/4413] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:18:08.095227 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-642bc232-c225-43aa-9fa1-d7fd10990e6e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:08.099595 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-642bc232-c225-43aa-9fa1-d7fd10990e6e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:08.121840 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-642bc232-c225-43aa-9fa1-d7fd10990e6e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:08.123340 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-642bc232-c225-43aa-9fa1-d7fd10990e6e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:08.124903 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-642bc232-c225-43aa-9fa1-d7fd10990e6e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:08.126147 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-642bc232-c225-43aa-9fa1-d7fd10990e6e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:09.021906 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-642bc232-c225-43aa-9fa1-d7fd10990e6e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:09.036125 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-642bc232-c225-43aa-9fa1-d7fd10990e6e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:09.043503 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-642bc232-c225-43aa-9fa1-d7fd10990e6e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:09.045914 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-642bc232-c225-43aa-9fa1-d7fd10990e6e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1406 microversion: 2.20 time: 0.960551 Jun 20 12:18:09.049009 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2158/4414] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:18:08 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1406 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:18:10.073843 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e2cfb33c-15d2-4e25-9b1e-aa8d6ad4b73e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:10.074549 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e2cfb33c-15d2-4e25-9b1e-aa8d6ad4b73e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:10.104175 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2cfb33c-15d2-4e25-9b1e-aa8d6ad4b73e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:10.104734 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2cfb33c-15d2-4e25-9b1e-aa8d6ad4b73e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:10.105561 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2cfb33c-15d2-4e25-9b1e-aa8d6ad4b73e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:10.105994 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2cfb33c-15d2-4e25-9b1e-aa8d6ad4b73e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:10.620903 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e2cfb33c-15d2-4e25-9b1e-aa8d6ad4b73e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:10.634026 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e2cfb33c-15d2-4e25-9b1e-aa8d6ad4b73e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:10.637603 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e2cfb33c-15d2-4e25-9b1e-aa8d6ad4b73e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:10.639623 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e2cfb33c-15d2-4e25-9b1e-aa8d6ad4b73e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1599 microversion: 2.20 time: 0.576305 Jun 20 12:18:10.640492 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2257/4415] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:18:10 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1599 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:18:10.666541 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fcd74559-4b37-4893-94bd-506f6c8089f9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:10.668269 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fcd74559-4b37-4893-94bd-506f6c8089f9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:10.687628 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fcd74559-4b37-4893-94bd-506f6c8089f9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:10.688193 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fcd74559-4b37-4893-94bd-506f6c8089f9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:10.693000 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fcd74559-4b37-4893-94bd-506f6c8089f9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:10.693598 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fcd74559-4b37-4893-94bd-506f6c8089f9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:11.277816 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fcd74559-4b37-4893-94bd-506f6c8089f9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.616779 Jun 20 12:18:11.279425 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2159/4416] 10.222.0.27 () {60 vars in 1315 bytes} [Mon Jun 20 12:18:10 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3/os-interface => generated 285 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:18:13.552481 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1bf871b8-4eee-48fb-9f26-0d779bbc08f7 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Action: 'create', calling method: .version_select at 0x7f6073ae7a60>, body: {"keypair": {"name": "tempest-keypair-499772890", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi1H20qReyvblFU0+aHbFOEWkdcV/ZFw3Umc97PbWVzE4GnfS47kethmwvWOTiacUro3qjylkGCjp0hpst4UDZFLY7yombjHXGr90GCNWY6gMRZpBMcZZqLCXatGpG+3Q=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:18:13.603168 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-1bf871b8-4eee-48fb-9f26-0d779bbc08f7 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Getting quotas for project ca22edf491394f878e14c2b67fb92816. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:18:13.630208 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-1bf871b8-4eee-48fb-9f26-0d779bbc08f7 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Getting quotas for user d640fdee13ca47ae848264ccbc532925 and project ca22edf491394f878e14c2b67fb92816. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:18:13.713357 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1bf871b8-4eee-48fb-9f26-0d779bbc08f7 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.837879 Jun 20 12:18:13.714845 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2258/4417] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 12:18:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:18:17.258426 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-072045a6-30d7-43f7-845c-8264c2465b60 req-631fd811-c347-4f4e-8197-f18aea885db3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ed20ca4-7f49-4d0a-a590-d2d4274698e3", "tag": "4bb9ec16-a224-4e67-8de4-0415485dde23"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:18:17.263569 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:18:17.290649 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-072045a6-30d7-43f7-845c-8264c2465b60 req-631fd811-c347-4f4e-8197-f18aea885db3 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:17.291327 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-072045a6-30d7-43f7-845c-8264c2465b60 req-631fd811-c347-4f4e-8197-f18aea885db3 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:17.318887 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-072045a6-30d7-43f7-845c-8264c2465b60 req-631fd811-c347-4f4e-8197-f18aea885db3 service nova] Creating event network-changed:4bb9ec16-a224-4e67-8de4-0415485dde23 for instance 6ed20ca4-7f49-4d0a-a590-d2d4274698e3 on n-h1-master-1 Jun 20 12:18:17.324220 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-072045a6-30d7-43f7-845c-8264c2465b60 req-631fd811-c347-4f4e-8197-f18aea885db3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069357 Jun 20 12:18:17.337800 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2160/4418] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:18:18.164917 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-eaead186-77cb-40e7-9c0f-936959441077 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:18:18.166784 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-eaead186-77cb-40e7-9c0f-936959441077 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:18.186853 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eaead186-77cb-40e7-9c0f-936959441077 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:18.196036 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eaead186-77cb-40e7-9c0f-936959441077 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:18.197425 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eaead186-77cb-40e7-9c0f-936959441077 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:18.199896 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eaead186-77cb-40e7-9c0f-936959441077 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:18.336803 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-eaead186-77cb-40e7-9c0f-936959441077 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "POST /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473/action" status: 200 len: 24571 microversion: 2.1 time: 0.176068 Jun 20 12:18:18.338112 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a6b243c1-73e1-4c2c-92bf-6f5dbc93d172 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Action: 'create', calling method: .version_select at 0x7f6073f78280>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1995663844", "policies": ["affinity"]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:18:18.340781 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2161/4419] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:18:18 2022] POST /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473/action => generated 24571 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 12:18:18.376013 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-a6b243c1-73e1-4c2c-92bf-6f5dbc93d172 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Getting quotas for project d4dc4c64b72b455ab2aed35f728befc4. Resources: {'server_groups'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:18:18.397846 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-a6b243c1-73e1-4c2c-92bf-6f5dbc93d172 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Getting quotas for user 31fb72c24dab41c8b04e058d6825267f and project d4dc4c64b72b455ab2aed35f728befc4. Resources: {'server_groups'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:18:18.463482 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:18:18.506257 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-a6b243c1-73e1-4c2c-92bf-6f5dbc93d172 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Getting quotas for project d4dc4c64b72b455ab2aed35f728befc4. Resources: {'server_groups'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:18:18.516759 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-a6b243c1-73e1-4c2c-92bf-6f5dbc93d172 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Getting quotas for user 31fb72c24dab41c8b04e058d6825267f and project d4dc4c64b72b455ab2aed35f728befc4. Resources: {'server_groups'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:18:18.539088 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a6b243c1-73e1-4c2c-92bf-6f5dbc93d172 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.532187 Jun 20 12:18:18.544800 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2259/4420] 10.222.0.27 () {60 vars in 1173 bytes} [Mon Jun 20 12:18:18 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:18:18.557033 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b9319677-8242-4411-9d87-383f246a9f5e tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Action: 'create', calling method: .version_select at 0x7f6073328a60>, body: {"server_group": {"name": "tempest-server-group-1870638870", "policies": ["affinity"]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:18:18.586384 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-b9319677-8242-4411-9d87-383f246a9f5e tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Getting quotas for project d4dc4c64b72b455ab2aed35f728befc4. Resources: {'server_groups'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:18:18.611056 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-b9319677-8242-4411-9d87-383f246a9f5e tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Getting quotas for user 31fb72c24dab41c8b04e058d6825267f and project d4dc4c64b72b455ab2aed35f728befc4. Resources: {'server_groups'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:18:18.714272 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-b9319677-8242-4411-9d87-383f246a9f5e tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Getting quotas for project d4dc4c64b72b455ab2aed35f728befc4. Resources: {'server_groups'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:18:18.732092 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-b9319677-8242-4411-9d87-383f246a9f5e tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Getting quotas for user 31fb72c24dab41c8b04e058d6825267f and project d4dc4c64b72b455ab2aed35f728befc4. Resources: {'server_groups'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:18:18.760070 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b9319677-8242-4411-9d87-383f246a9f5e tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.212354 Jun 20 12:18:18.775443 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2162/4421] 10.222.0.27 () {60 vars in 1172 bytes} [Mon Jun 20 12:18:18 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:18:18.779620 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f048b986-6521-48bb-bec2-2ab543272e33 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Action: 'create', calling method: .version_select at 0x7f6072b8a430>, body: {"server_group": {"name": "tempest-server-group-1870638870", "policies": ["affinity"]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:18:18.818454 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-f048b986-6521-48bb-bec2-2ab543272e33 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Getting quotas for project d4dc4c64b72b455ab2aed35f728befc4. Resources: {'server_groups'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:18:18.825879 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-f048b986-6521-48bb-bec2-2ab543272e33 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Getting quotas for user 31fb72c24dab41c8b04e058d6825267f and project d4dc4c64b72b455ab2aed35f728befc4. Resources: {'server_groups'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:18:18.906237 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-f048b986-6521-48bb-bec2-2ab543272e33 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Getting quotas for project d4dc4c64b72b455ab2aed35f728befc4. Resources: {'server_groups'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:18:18.913986 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-f048b986-6521-48bb-bec2-2ab543272e33 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Getting quotas for user 31fb72c24dab41c8b04e058d6825267f and project d4dc4c64b72b455ab2aed35f728befc4. Resources: {'server_groups'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:18:18.984042 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f048b986-6521-48bb-bec2-2ab543272e33 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.208274 Jun 20 12:18:18.987537 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2260/4422] 10.222.0.27 () {60 vars in 1172 bytes} [Mon Jun 20 12:18:18 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:18:18.997640 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-aad20b94-220a-461f-aa18-e4a5ae3bb6fd tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:19.052316 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-aad20b94-220a-461f-aa18-e4a5ae3bb6fd tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/1df39519-b9bd-4a66-bbaf-c20873535e31" status: 204 len: 0 microversion: 2.1 time: 0.058285 Jun 20 12:18:19.053168 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2163/4423] 10.222.0.27 () {58 vars in 1265 bytes} [Mon Jun 20 12:18:18 2022] DELETE /compute/v2.1/os-server-groups/1df39519-b9bd-4a66-bbaf-c20873535e31 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:18:19.062218 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-82088925-f840-4ef2-a5da-302b9a31926d tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:19.078511 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-82088925-f840-4ef2-a5da-302b9a31926d tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.020955 Jun 20 12:18:19.084972 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2261/4424] 10.222.0.27 () {58 vars in 1151 bytes} [Mon Jun 20 12:18:19 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:18:19.091098 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7aac07e1-552c-49f4-9895-c7b0a8f97e2b tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:19.125724 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7aac07e1-552c-49f4-9895-c7b0a8f97e2b tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/dfd83a43-9ca2-466e-9801-924f0c3a716d" status: 204 len: 0 microversion: 2.1 time: 0.039251 Jun 20 12:18:19.126634 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2164/4425] 10.222.0.27 () {58 vars in 1265 bytes} [Mon Jun 20 12:18:19 2022] DELETE /compute/v2.1/os-server-groups/dfd83a43-9ca2-466e-9801-924f0c3a716d => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:18:19.135248 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ba882c43-e1f1-41e1-a88c-a6ddd329fe95 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:19.148874 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ba882c43-e1f1-41e1-a88c-a6ddd329fe95 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.017546 Jun 20 12:18:19.151336 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2262/4426] 10.222.0.27 () {58 vars in 1151 bytes} [Mon Jun 20 12:18:19 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:18:19.162630 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-21bc97af-6288-45c4-8cd8-6889fe4201e3 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Action: 'create', calling method: .version_select at 0x7f60729a35e0>, body: {"server_group": {"name": "tempest-server-group-295393831", "policies": ["affinity"]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:18:19.196483 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-21bc97af-6288-45c4-8cd8-6889fe4201e3 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Getting quotas for project d4dc4c64b72b455ab2aed35f728befc4. Resources: {'server_groups'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:18:19.211935 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-21bc97af-6288-45c4-8cd8-6889fe4201e3 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Getting quotas for user 31fb72c24dab41c8b04e058d6825267f and project d4dc4c64b72b455ab2aed35f728befc4. Resources: {'server_groups'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:18:19.316545 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-21bc97af-6288-45c4-8cd8-6889fe4201e3 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Getting quotas for project d4dc4c64b72b455ab2aed35f728befc4. Resources: {'server_groups'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:18:19.330146 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-21bc97af-6288-45c4-8cd8-6889fe4201e3 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Getting quotas for user 31fb72c24dab41c8b04e058d6825267f and project d4dc4c64b72b455ab2aed35f728befc4. Resources: {'server_groups'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:18:19.361546 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-21bc97af-6288-45c4-8cd8-6889fe4201e3 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.200299 Jun 20 12:18:19.362655 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2165/4427] 10.222.0.27 () {60 vars in 1172 bytes} [Mon Jun 20 12:18:19 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:18:19.373472 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a1444b88-3fdf-414c-9b64-714f33fb2358 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:19.488271 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a1444b88-3fdf-414c-9b64-714f33fb2358 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/02ef50bc-8b54-42ee-90d5-5d31bf9e21d7" status: 204 len: 0 microversion: 2.1 time: 0.117978 Jun 20 12:18:19.489649 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2263/4428] 10.222.0.27 () {58 vars in 1265 bytes} [Mon Jun 20 12:18:19 2022] DELETE /compute/v2.1/os-server-groups/02ef50bc-8b54-42ee-90d5-5d31bf9e21d7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:18:19.498342 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e0a300fc-f01e-4234-8fa2-be8f9e75a5c8 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:19.517771 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e0a300fc-f01e-4234-8fa2-be8f9e75a5c8 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.020131 Jun 20 12:18:19.519407 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2166/4429] 10.222.0.27 () {58 vars in 1151 bytes} [Mon Jun 20 12:18:19 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:18:19.530403 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-883780d9-3429-4efc-bd8a-0f09e8a91e4e tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Action: 'create', calling method: .version_select at 0x7f6072ca0670>, body: {"server_group": {"name": "tempest-server-group-1832276054", "policies": ["anti-affinity"]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:18:19.611828 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-883780d9-3429-4efc-bd8a-0f09e8a91e4e tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Getting quotas for project d4dc4c64b72b455ab2aed35f728befc4. Resources: {'server_groups'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:18:19.647443 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-883780d9-3429-4efc-bd8a-0f09e8a91e4e tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Getting quotas for user 31fb72c24dab41c8b04e058d6825267f and project d4dc4c64b72b455ab2aed35f728befc4. Resources: {'server_groups'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:18:19.831850 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-883780d9-3429-4efc-bd8a-0f09e8a91e4e tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Getting quotas for project d4dc4c64b72b455ab2aed35f728befc4. Resources: {'server_groups'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:18:19.848795 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-883780d9-3429-4efc-bd8a-0f09e8a91e4e tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Getting quotas for user 31fb72c24dab41c8b04e058d6825267f and project d4dc4c64b72b455ab2aed35f728befc4. Resources: {'server_groups'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:18:19.891956 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-883780d9-3429-4efc-bd8a-0f09e8a91e4e tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.363580 Jun 20 12:18:19.893033 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2264/4430] 10.222.0.27 () {60 vars in 1172 bytes} [Mon Jun 20 12:18:19 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:18:19.901141 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b3d5257f-926d-427d-9323-a87b18b865fb tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:19.978726 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b3d5257f-926d-427d-9323-a87b18b865fb tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/7bd1b230-0f2e-46e4-b2db-bda1d2a667b5" status: 204 len: 0 microversion: 2.1 time: 0.082396 Jun 20 12:18:19.980400 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2167/4431] 10.222.0.27 () {58 vars in 1265 bytes} [Mon Jun 20 12:18:19 2022] DELETE /compute/v2.1/os-server-groups/7bd1b230-0f2e-46e4-b2db-bda1d2a667b5 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:18:19.991529 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3ce9af30-fe0c-495f-869b-fc7d5ea9180f tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:20.044851 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3ce9af30-fe0c-495f-869b-fc7d5ea9180f tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.060641 Jun 20 12:18:20.047558 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2168/4432] 10.222.0.27 () {58 vars in 1151 bytes} [Mon Jun 20 12:18:19 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:18:20.361439 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f234b4fc-960f-4a58-a673-17be46653398 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-2125815922", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "6ab633c9-c466-4f45-9b0b-0430941665f5"}]}, "os:scheduler_hints": {"group": "0cd34122-81d6-4934-b02a-352afc257162"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:18:20.481962 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-f234b4fc-960f-4a58-a673-17be46653398 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] validate_networks() for [('6ab633c9-c466-4f45-9b0b-0430941665f5', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:18:20.605043 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-756d2819-9f77-4c98-bfd4-58e05e74a18e tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Action: 'create', calling method: .version_select at 0x7f6072c3c430>, body: {"keypair": {"name": "tempest-keypair-2083230820", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLoxrKUnURHNur82IgaC2udJV11AdPnerbw/O29WIp+T/pnAcUQeGMqYXiwvxQuOdVTp1Bkd3RwEhZJVcorI734Tqb1luitaKq7LHD1+3KGEfAj6jjb5G334+TcIxsv9HA=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:18:20.636599 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:18:20.690420 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-756d2819-9f77-4c98-bfd4-58e05e74a18e tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Getting quotas for project e32e6c9093de44cf932e533ee20b0e31. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:18:20.712553 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-756d2819-9f77-4c98-bfd4-58e05e74a18e tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Getting quotas for user 0174505a4b2b404dbab8c4aaf399e057 and project e32e6c9093de44cf932e533ee20b0e31. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:18:20.802854 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-756d2819-9f77-4c98-bfd4-58e05e74a18e tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.885057 Jun 20 12:18:20.805756 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2265/4433] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 12:18:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:18:21.426600 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-47a4f699-3f32-42f5-a6f9-1c70f6dd0ab7 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1467553642", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "b8cd0011-3774-4503-b68c-67e032c2be21"}], "security_groups": [{"name": "tempest-securitygroup--192386404"}], "key_name": "tempest-keypair-499772890", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:18:21.697125 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-47a4f699-3f32-42f5-a6f9-1c70f6dd0ab7 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] validate_networks() for [('b8cd0011-3774-4503-b68c-67e032c2be21', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:18:21.901846 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-f234b4fc-960f-4a58-a673-17be46653398 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:18:21.902441 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-f234b4fc-960f-4a58-a673-17be46653398 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:18:21.902738 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-f234b4fc-960f-4a58-a673-17be46653398 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:18:21.903150 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-f234b4fc-960f-4a58-a673-17be46653398 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:18:21.903569 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-f234b4fc-960f-4a58-a673-17be46653398 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:18:21.939533 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f234b4fc-960f-4a58-a673-17be46653398 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:21.951362 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f234b4fc-960f-4a58-a673-17be46653398 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:21.955488 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f234b4fc-960f-4a58-a673-17be46653398 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:21.958347 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f234b4fc-960f-4a58-a673-17be46653398 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:21.979880 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-f234b4fc-960f-4a58-a673-17be46653398 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Getting quotas for project d4dc4c64b72b455ab2aed35f728befc4. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:18:21.988948 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-f234b4fc-960f-4a58-a673-17be46653398 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Getting quotas for user 31fb72c24dab41c8b04e058d6825267f and project d4dc4c64b72b455ab2aed35f728befc4. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:18:22.021021 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f234b4fc-960f-4a58-a673-17be46653398 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:18:22.024423 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f234b4fc-960f-4a58-a673-17be46653398 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] [instance: d9af10dd-20fa-44ef-a104-a62b82761ffd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:18:22.050739 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:DELETE=9 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:18:22.117826 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-f234b4fc-960f-4a58-a673-17be46653398 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Getting quotas for project d4dc4c64b72b455ab2aed35f728befc4. Resources: {'server_group_members'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:18:22.133577 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-f234b4fc-960f-4a58-a673-17be46653398 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Getting quotas for user 31fb72c24dab41c8b04e058d6825267f and project d4dc4c64b72b455ab2aed35f728befc4. Resources: {'server_group_members'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:18:22.193293 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-f234b4fc-960f-4a58-a673-17be46653398 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Getting quotas for project d4dc4c64b72b455ab2aed35f728befc4. Resources: {'server_group_members'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:18:22.198714 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-f234b4fc-960f-4a58-a673-17be46653398 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Getting quotas for user 31fb72c24dab41c8b04e058d6825267f and project d4dc4c64b72b455ab2aed35f728befc4. Resources: {'server_group_members'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:18:22.262515 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f234b4fc-960f-4a58-a673-17be46653398 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.907657 Jun 20 12:18:22.264059 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2169/4434] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:18:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:18:22.275779 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c79d9a7e-0690-47e3-887f-8b35a4c6f86d tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:22.276361 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c79d9a7e-0690-47e3-887f-8b35a4c6f86d tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] [instance: d9af10dd-20fa-44ef-a104-a62b82761ffd] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:22.495664 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c79d9a7e-0690-47e3-887f-8b35a4c6f86d tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fb72c24dab41c8b04e058d6825267f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc4c64b72b455ab2aed35f728befc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:22.508174 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c79d9a7e-0690-47e3-887f-8b35a4c6f86d tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] 10.222.0.27 "GET /compute/v2.1/servers/d9af10dd-20fa-44ef-a104-a62b82761ffd" status: 200 len: 1213 microversion: 2.1 time: 0.238071 Jun 20 12:18:22.520239 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2170/4435] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:22 2022] GET /compute/v2.1/servers/d9af10dd-20fa-44ef-a104-a62b82761ffd => generated 1213 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:18:23.529888 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cdc5a377-5b53-4387-af6d-1ab7fa8d87d7 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:23.531296 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cdc5a377-5b53-4387-af6d-1ab7fa8d87d7 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] [instance: d9af10dd-20fa-44ef-a104-a62b82761ffd] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:23.560290 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cdc5a377-5b53-4387-af6d-1ab7fa8d87d7 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:23.563368 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cdc5a377-5b53-4387-af6d-1ab7fa8d87d7 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:23.568597 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cdc5a377-5b53-4387-af6d-1ab7fa8d87d7 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:23.570681 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cdc5a377-5b53-4387-af6d-1ab7fa8d87d7 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:23.993026 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-47a4f699-3f32-42f5-a6f9-1c70f6dd0ab7 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Getting quotas for project ca22edf491394f878e14c2b67fb92816. Resources: dict_keys(['metadata_items']) {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:18:23.996890 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:18:24.002382 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-47a4f699-3f32-42f5-a6f9-1c70f6dd0ab7 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Getting quotas for user d640fdee13ca47ae848264ccbc532925 and project ca22edf491394f878e14c2b67fb92816. Resources: dict_keys(['metadata_items']) {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:18:24.019385 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-47a4f699-3f32-42f5-a6f9-1c70f6dd0ab7 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:18:24.021622 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-47a4f699-3f32-42f5-a6f9-1c70f6dd0ab7 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:18:24.022485 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-47a4f699-3f32-42f5-a6f9-1c70f6dd0ab7 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:18:24.023342 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-47a4f699-3f32-42f5-a6f9-1c70f6dd0ab7 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:18:24.024002 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-47a4f699-3f32-42f5-a6f9-1c70f6dd0ab7 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:18:24.040664 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-47a4f699-3f32-42f5-a6f9-1c70f6dd0ab7 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:24.041397 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-47a4f699-3f32-42f5-a6f9-1c70f6dd0ab7 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:24.042474 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-47a4f699-3f32-42f5-a6f9-1c70f6dd0ab7 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:24.043126 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-47a4f699-3f32-42f5-a6f9-1c70f6dd0ab7 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:24.068980 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-47a4f699-3f32-42f5-a6f9-1c70f6dd0ab7 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Getting quotas for project ca22edf491394f878e14c2b67fb92816. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:18:24.075833 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-47a4f699-3f32-42f5-a6f9-1c70f6dd0ab7 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Getting quotas for user d640fdee13ca47ae848264ccbc532925 and project ca22edf491394f878e14c2b67fb92816. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:18:24.103316 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-47a4f699-3f32-42f5-a6f9-1c70f6dd0ab7 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:18:24.106686 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-47a4f699-3f32-42f5-a6f9-1c70f6dd0ab7 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] [instance: 68b3feb5-3535-4655-a73f-03ce141df427] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:18:24.197198 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-cdc5a377-5b53-4387-af6d-1ab7fa8d87d7 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fb72c24dab41c8b04e058d6825267f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc4c64b72b455ab2aed35f728befc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:24.213048 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cdc5a377-5b53-4387-af6d-1ab7fa8d87d7 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] 10.222.0.27 "GET /compute/v2.1/servers/d9af10dd-20fa-44ef-a104-a62b82761ffd" status: 200 len: 1209 microversion: 2.1 time: 0.684806 Jun 20 12:18:24.215244 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-47a4f699-3f32-42f5-a6f9-1c70f6dd0ab7 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.795675 Jun 20 12:18:24.225444 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2171/4436] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:23 2022] GET /compute/v2.1/servers/d9af10dd-20fa-44ef-a104-a62b82761ffd => generated 1209 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:18:24.225684 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2266/4437] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:18:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 2807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:18:24.235516 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fc505a6e-6f6f-427c-996b-4131f1fe2a15 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:24.236148 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fc505a6e-6f6f-427c-996b-4131f1fe2a15 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] [instance: 68b3feb5-3535-4655-a73f-03ce141df427] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:24.492084 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fc505a6e-6f6f-427c-996b-4131f1fe2a15 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd640fdee13ca47ae848264ccbc532925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca22edf491394f878e14c2b67fb92816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:24.501549 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fc505a6e-6f6f-427c-996b-4131f1fe2a15 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] 10.222.0.27 "GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427" status: 200 len: 1269 microversion: 2.1 time: 0.268899 Jun 20 12:18:24.503091 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2172/4438] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:24 2022] GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427 => generated 1269 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:25.242256 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3f107b0b-8933-4e1b-a917-50ffd9832e12 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:25.244072 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3f107b0b-8933-4e1b-a917-50ffd9832e12 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] [instance: d9af10dd-20fa-44ef-a104-a62b82761ffd] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:25.255048 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3f107b0b-8933-4e1b-a917-50ffd9832e12 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:25.255489 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3f107b0b-8933-4e1b-a917-50ffd9832e12 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:25.256383 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3f107b0b-8933-4e1b-a917-50ffd9832e12 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:25.256826 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3f107b0b-8933-4e1b-a917-50ffd9832e12 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:25.385447 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3f107b0b-8933-4e1b-a917-50ffd9832e12 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fb72c24dab41c8b04e058d6825267f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc4c64b72b455ab2aed35f728befc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:25.393593 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3f107b0b-8933-4e1b-a917-50ffd9832e12 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] 10.222.0.27 "GET /compute/v2.1/servers/d9af10dd-20fa-44ef-a104-a62b82761ffd" status: 200 len: 1271 microversion: 2.1 time: 0.163207 Jun 20 12:18:25.394775 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2267/4439] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:25 2022] GET /compute/v2.1/servers/d9af10dd-20fa-44ef-a104-a62b82761ffd => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:25.519644 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-34439482-7b3a-4ceb-b280-8be1bb22c624 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:25.520415 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-34439482-7b3a-4ceb-b280-8be1bb22c624 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] [instance: 68b3feb5-3535-4655-a73f-03ce141df427] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:25.531684 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-34439482-7b3a-4ceb-b280-8be1bb22c624 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:25.532456 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-34439482-7b3a-4ceb-b280-8be1bb22c624 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:25.533421 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-34439482-7b3a-4ceb-b280-8be1bb22c624 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:25.534385 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-34439482-7b3a-4ceb-b280-8be1bb22c624 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:25.711787 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-34439482-7b3a-4ceb-b280-8be1bb22c624 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd640fdee13ca47ae848264ccbc532925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca22edf491394f878e14c2b67fb92816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:25.721565 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-34439482-7b3a-4ceb-b280-8be1bb22c624 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] 10.222.0.27 "GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427" status: 200 len: 1321 microversion: 2.1 time: 0.205868 Jun 20 12:18:25.727719 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2173/4440] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:25 2022] GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427 => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:18:26.415844 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c19bc6c8-515a-440c-8631-cd9e702248cf tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:26.416519 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c19bc6c8-515a-440c-8631-cd9e702248cf tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] [instance: d9af10dd-20fa-44ef-a104-a62b82761ffd] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:26.431365 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c19bc6c8-515a-440c-8631-cd9e702248cf tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:26.432026 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c19bc6c8-515a-440c-8631-cd9e702248cf tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:26.433011 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c19bc6c8-515a-440c-8631-cd9e702248cf tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:26.434557 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c19bc6c8-515a-440c-8631-cd9e702248cf tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:26.744818 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-144bd43d-2bf8-47f3-bfd7-2150ff084873 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:26.746240 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-144bd43d-2bf8-47f3-bfd7-2150ff084873 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] [instance: 68b3feb5-3535-4655-a73f-03ce141df427] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:26.777684 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-144bd43d-2bf8-47f3-bfd7-2150ff084873 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:26.778721 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-144bd43d-2bf8-47f3-bfd7-2150ff084873 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:26.782913 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-144bd43d-2bf8-47f3-bfd7-2150ff084873 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:26.783640 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-144bd43d-2bf8-47f3-bfd7-2150ff084873 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:26.956380 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-144bd43d-2bf8-47f3-bfd7-2150ff084873 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd640fdee13ca47ae848264ccbc532925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca22edf491394f878e14c2b67fb92816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:26.964495 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-144bd43d-2bf8-47f3-bfd7-2150ff084873 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] 10.222.0.27 "GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427" status: 200 len: 1327 microversion: 2.1 time: 0.223985 Jun 20 12:18:26.978927 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2174/4441] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:26 2022] GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427 => generated 1327 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:26.995035 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-43a43d09-4bae-4b2e-8f5d-bc1988fe477c tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1946042505", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93744e5c-d7f7-4f82-a5ab-ad936f4a3557"}], "security_groups": [{"name": "tempest-securitygroup--945951730"}], "key_name": "tempest-keypair-2083230820", "user_data": "}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:18:27.001559 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c19bc6c8-515a-440c-8631-cd9e702248cf tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fb72c24dab41c8b04e058d6825267f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc4c64b72b455ab2aed35f728befc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:27.012699 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c19bc6c8-515a-440c-8631-cd9e702248cf tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] 10.222.0.27 "GET /compute/v2.1/servers/d9af10dd-20fa-44ef-a104-a62b82761ffd" status: 200 len: 1313 microversion: 2.1 time: 0.605265 Jun 20 12:18:27.031458 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2268/4442] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:26 2022] GET /compute/v2.1/servers/d9af10dd-20fa-44ef-a104-a62b82761ffd => generated 1313 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:27.302489 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-43a43d09-4bae-4b2e-8f5d-bc1988fe477c tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] validate_networks() for [('93744e5c-d7f7-4f82-a5ab-ad936f4a3557', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:18:27.995789 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-95428af2-3d3a-4f8b-a980-8e13a33a800f tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:27.997709 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-95428af2-3d3a-4f8b-a980-8e13a33a800f tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] [instance: 68b3feb5-3535-4655-a73f-03ce141df427] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:28.036979 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-95428af2-3d3a-4f8b-a980-8e13a33a800f tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:28.037699 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-95428af2-3d3a-4f8b-a980-8e13a33a800f tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:28.038967 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-95428af2-3d3a-4f8b-a980-8e13a33a800f tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:28.039691 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-95428af2-3d3a-4f8b-a980-8e13a33a800f tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:28.250898 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-95428af2-3d3a-4f8b-a980-8e13a33a800f tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd640fdee13ca47ae848264ccbc532925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca22edf491394f878e14c2b67fb92816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:28.263180 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-95428af2-3d3a-4f8b-a980-8e13a33a800f tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] 10.222.0.27 "GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427" status: 200 len: 1327 microversion: 2.1 time: 0.269141 Jun 20 12:18:28.263180 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2269/4443] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:27 2022] GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427 => generated 1327 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:18:28.276249 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c1e9fdac-a4f6-4b2f-9995-9ce5eb813488 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:28.281204 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c1e9fdac-a4f6-4b2f-9995-9ce5eb813488 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] [instance: d9af10dd-20fa-44ef-a104-a62b82761ffd] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:28.289923 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c1e9fdac-a4f6-4b2f-9995-9ce5eb813488 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:28.290652 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c1e9fdac-a4f6-4b2f-9995-9ce5eb813488 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:28.291620 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c1e9fdac-a4f6-4b2f-9995-9ce5eb813488 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:28.293782 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c1e9fdac-a4f6-4b2f-9995-9ce5eb813488 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:28.700051 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c1e9fdac-a4f6-4b2f-9995-9ce5eb813488 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fb72c24dab41c8b04e058d6825267f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc4c64b72b455ab2aed35f728befc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:28.712416 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c1e9fdac-a4f6-4b2f-9995-9ce5eb813488 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] 10.222.0.27 "GET /compute/v2.1/servers/d9af10dd-20fa-44ef-a104-a62b82761ffd" status: 200 len: 1313 microversion: 2.1 time: 0.447870 Jun 20 12:18:28.713302 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2270/4444] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:28 2022] GET /compute/v2.1/servers/d9af10dd-20fa-44ef-a104-a62b82761ffd => generated 1313 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:29.084825 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-43a43d09-4bae-4b2e-8f5d-bc1988fe477c tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:18:29.085337 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-43a43d09-4bae-4b2e-8f5d-bc1988fe477c tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:18:29.085892 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-43a43d09-4bae-4b2e-8f5d-bc1988fe477c tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:18:29.086508 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-43a43d09-4bae-4b2e-8f5d-bc1988fe477c tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:18:29.087581 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-43a43d09-4bae-4b2e-8f5d-bc1988fe477c tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:18:29.101093 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-43a43d09-4bae-4b2e-8f5d-bc1988fe477c tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:29.102175 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-43a43d09-4bae-4b2e-8f5d-bc1988fe477c tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:29.103499 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-43a43d09-4bae-4b2e-8f5d-bc1988fe477c tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:29.104179 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-43a43d09-4bae-4b2e-8f5d-bc1988fe477c tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:29.129057 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-43a43d09-4bae-4b2e-8f5d-bc1988fe477c tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Getting quotas for project e32e6c9093de44cf932e533ee20b0e31. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:18:29.138265 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-43a43d09-4bae-4b2e-8f5d-bc1988fe477c tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Getting quotas for user 0174505a4b2b404dbab8c4aaf399e057 and project e32e6c9093de44cf932e533ee20b0e31. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:18:29.161790 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-43a43d09-4bae-4b2e-8f5d-bc1988fe477c tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:18:29.164647 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-43a43d09-4bae-4b2e-8f5d-bc1988fe477c tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:18:29.237714 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-43a43d09-4bae-4b2e-8f5d-bc1988fe477c tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.254292 Jun 20 12:18:29.238491 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2175/4445] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:18:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 2259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:18:29.250556 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ab2c8c33-1891-4bd5-85c3-309aabf63d59 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:29.251941 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ab2c8c33-1891-4bd5-85c3-309aabf63d59 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:29.285465 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7a2d2541-f0b8-41fa-8208-a2810eeaf0db tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:29.286158 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7a2d2541-f0b8-41fa-8208-a2810eeaf0db tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] [instance: 68b3feb5-3535-4655-a73f-03ce141df427] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:29.294294 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7a2d2541-f0b8-41fa-8208-a2810eeaf0db tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:29.294754 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7a2d2541-f0b8-41fa-8208-a2810eeaf0db tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:29.296883 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7a2d2541-f0b8-41fa-8208-a2810eeaf0db tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:29.297382 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7a2d2541-f0b8-41fa-8208-a2810eeaf0db tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:29.694755 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ab2c8c33-1891-4bd5-85c3-309aabf63d59 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:29.732103 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ab2c8c33-1891-4bd5-85c3-309aabf63d59 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1238 microversion: 2.1 time: 0.485857 Jun 20 12:18:29.742553 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2271/4446] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:29 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1238 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:29.755132 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-2003619b-c511-4bcd-b0df-057e554471a0 req-87d34bc9-0487-4cc2-a2fb-5396c0adb335 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9af10dd-20fa-44ef-a104-a62b82761ffd", "tag": "b47658a4-1ca6-4cf6-9203-458c26dc34a0"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:18:29.807804 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-2003619b-c511-4bcd-b0df-057e554471a0 req-87d34bc9-0487-4cc2-a2fb-5396c0adb335 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:29.808268 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-2003619b-c511-4bcd-b0df-057e554471a0 req-87d34bc9-0487-4cc2-a2fb-5396c0adb335 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:29.832710 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-2003619b-c511-4bcd-b0df-057e554471a0 req-87d34bc9-0487-4cc2-a2fb-5396c0adb335 service nova] Creating event network-changed:b47658a4-1ca6-4cf6-9203-458c26dc34a0 for instance d9af10dd-20fa-44ef-a104-a62b82761ffd on n-h1-master-1 Jun 20 12:18:29.842335 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-2003619b-c511-4bcd-b0df-057e554471a0 req-87d34bc9-0487-4cc2-a2fb-5396c0adb335 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106019 Jun 20 12:18:29.847478 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2272/4447] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:18:29.866337 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3a360c5a-6c80-4530-b64a-9f767850a4ab tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:29.867506 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3a360c5a-6c80-4530-b64a-9f767850a4ab tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] [instance: d9af10dd-20fa-44ef-a104-a62b82761ffd] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:29.868810 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7a2d2541-f0b8-41fa-8208-a2810eeaf0db tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd640fdee13ca47ae848264ccbc532925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca22edf491394f878e14c2b67fb92816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:29.881651 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7a2d2541-f0b8-41fa-8208-a2810eeaf0db tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] 10.222.0.27 "GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427" status: 200 len: 1394 microversion: 2.1 time: 0.606178 Jun 20 12:18:29.882588 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2176/4448] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:29 2022] GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427 => generated 1394 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:29.883141 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a360c5a-6c80-4530-b64a-9f767850a4ab tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:29.884160 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a360c5a-6c80-4530-b64a-9f767850a4ab tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:29.885779 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a360c5a-6c80-4530-b64a-9f767850a4ab tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:29.886497 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a360c5a-6c80-4530-b64a-9f767850a4ab tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:30.553829 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3a360c5a-6c80-4530-b64a-9f767850a4ab tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fb72c24dab41c8b04e058d6825267f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc4c64b72b455ab2aed35f728befc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:30.576483 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3a360c5a-6c80-4530-b64a-9f767850a4ab tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] 10.222.0.27 "GET /compute/v2.1/servers/d9af10dd-20fa-44ef-a104-a62b82761ffd" status: 200 len: 1313 microversion: 2.1 time: 0.714025 Jun 20 12:18:30.577215 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2273/4449] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:29 2022] GET /compute/v2.1/servers/d9af10dd-20fa-44ef-a104-a62b82761ffd => generated 1313 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:30.757537 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d978a934-899b-46ab-a886-176c5813cf49 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:30.759142 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d978a934-899b-46ab-a886-176c5813cf49 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:30.771703 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d978a934-899b-46ab-a886-176c5813cf49 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:30.772500 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d978a934-899b-46ab-a886-176c5813cf49 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:30.775150 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d978a934-899b-46ab-a886-176c5813cf49 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:30.776223 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d978a934-899b-46ab-a886-176c5813cf49 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:30.822066 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=66 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:18:30.903781 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4690f469-a0a4-4b5a-a665-9b90a36ea728 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:30.907954 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4690f469-a0a4-4b5a-a665-9b90a36ea728 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] [instance: 68b3feb5-3535-4655-a73f-03ce141df427] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:30.923172 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d978a934-899b-46ab-a886-176c5813cf49 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:30.936733 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4690f469-a0a4-4b5a-a665-9b90a36ea728 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:30.937512 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4690f469-a0a4-4b5a-a665-9b90a36ea728 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:30.938837 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4690f469-a0a4-4b5a-a665-9b90a36ea728 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:30.950804 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4690f469-a0a4-4b5a-a665-9b90a36ea728 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:30.952312 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d978a934-899b-46ab-a886-176c5813cf49 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1290 microversion: 2.1 time: 0.205097 Jun 20 12:18:30.953576 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2177/4450] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:30 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1290 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:18:31.600835 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d40a784f-4357-490e-869d-552d9b9a76a3 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:31.601781 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d40a784f-4357-490e-869d-552d9b9a76a3 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] [instance: d9af10dd-20fa-44ef-a104-a62b82761ffd] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:31.613135 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4690f469-a0a4-4b5a-a665-9b90a36ea728 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd640fdee13ca47ae848264ccbc532925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca22edf491394f878e14c2b67fb92816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:31.614337 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d40a784f-4357-490e-869d-552d9b9a76a3 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:31.614950 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d40a784f-4357-490e-869d-552d9b9a76a3 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:31.616151 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d40a784f-4357-490e-869d-552d9b9a76a3 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:31.616680 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d40a784f-4357-490e-869d-552d9b9a76a3 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:31.624422 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4690f469-a0a4-4b5a-a665-9b90a36ea728 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] 10.222.0.27 "GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427" status: 200 len: 1394 microversion: 2.1 time: 0.728273 Jun 20 12:18:31.625364 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2274/4451] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:30 2022] GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427 => generated 1394 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:31.975128 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d40a784f-4357-490e-869d-552d9b9a76a3 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fb72c24dab41c8b04e058d6825267f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc4c64b72b455ab2aed35f728befc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:31.983035 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-98fd94ad-58a5-47f5-a61e-4e4a8022bdf6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:31.983905 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-98fd94ad-58a5-47f5-a61e-4e4a8022bdf6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:31.986120 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d40a784f-4357-490e-869d-552d9b9a76a3 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] 10.222.0.27 "GET /compute/v2.1/servers/d9af10dd-20fa-44ef-a104-a62b82761ffd" status: 200 len: 1313 microversion: 2.1 time: 0.391950 Jun 20 12:18:31.987819 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2178/4452] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:31 2022] GET /compute/v2.1/servers/d9af10dd-20fa-44ef-a104-a62b82761ffd => generated 1313 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:31.994651 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-98fd94ad-58a5-47f5-a61e-4e4a8022bdf6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:31.996539 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-98fd94ad-58a5-47f5-a61e-4e4a8022bdf6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:31.997721 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-98fd94ad-58a5-47f5-a61e-4e4a8022bdf6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:31.998393 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-98fd94ad-58a5-47f5-a61e-4e4a8022bdf6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:32.131126 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-98fd94ad-58a5-47f5-a61e-4e4a8022bdf6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:32.141901 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-98fd94ad-58a5-47f5-a61e-4e4a8022bdf6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1296 microversion: 2.1 time: 0.165421 Jun 20 12:18:32.143101 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2275/4453] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:31 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1296 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:32.643130 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c86f407f-fc10-41f4-abeb-6f6cebb087e7 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:32.643745 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c86f407f-fc10-41f4-abeb-6f6cebb087e7 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] [instance: 68b3feb5-3535-4655-a73f-03ce141df427] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:32.652567 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c86f407f-fc10-41f4-abeb-6f6cebb087e7 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:32.653403 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c86f407f-fc10-41f4-abeb-6f6cebb087e7 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:32.654383 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c86f407f-fc10-41f4-abeb-6f6cebb087e7 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:32.655126 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c86f407f-fc10-41f4-abeb-6f6cebb087e7 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:33.012817 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3b3cab2c-e21e-4e25-a794-c616006d46f6 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:33.014149 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3b3cab2c-e21e-4e25-a794-c616006d46f6 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] [instance: d9af10dd-20fa-44ef-a104-a62b82761ffd] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:33.022152 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3b3cab2c-e21e-4e25-a794-c616006d46f6 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:33.023084 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3b3cab2c-e21e-4e25-a794-c616006d46f6 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:33.024092 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3b3cab2c-e21e-4e25-a794-c616006d46f6 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:33.025210 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3b3cab2c-e21e-4e25-a794-c616006d46f6 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:33.167575 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c86f407f-fc10-41f4-abeb-6f6cebb087e7 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd640fdee13ca47ae848264ccbc532925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca22edf491394f878e14c2b67fb92816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:33.181630 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c86f407f-fc10-41f4-abeb-6f6cebb087e7 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] 10.222.0.27 "GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427" status: 200 len: 1394 microversion: 2.1 time: 0.542718 Jun 20 12:18:33.192799 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2179/4454] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:32 2022] GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427 => generated 1394 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:33.198094 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-263b19ae-c204-4505-b2af-1e97721efd23 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:33.199064 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-263b19ae-c204-4505-b2af-1e97721efd23 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:33.206654 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-263b19ae-c204-4505-b2af-1e97721efd23 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:33.207530 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-263b19ae-c204-4505-b2af-1e97721efd23 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:33.208888 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-263b19ae-c204-4505-b2af-1e97721efd23 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:33.209572 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-263b19ae-c204-4505-b2af-1e97721efd23 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:33.565644 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3b3cab2c-e21e-4e25-a794-c616006d46f6 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fb72c24dab41c8b04e058d6825267f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc4c64b72b455ab2aed35f728befc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:33.581529 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3b3cab2c-e21e-4e25-a794-c616006d46f6 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] 10.222.0.27 "GET /compute/v2.1/servers/d9af10dd-20fa-44ef-a104-a62b82761ffd" status: 200 len: 1313 microversion: 2.1 time: 0.576141 Jun 20 12:18:33.585484 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2276/4455] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:32 2022] GET /compute/v2.1/servers/d9af10dd-20fa-44ef-a104-a62b82761ffd => generated 1313 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:18:33.597293 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-ddf561a5-89d6-48ed-ac0b-37ea0b9d3e4a req-1f8a6da1-f2d4-4029-84e5-db90a67d8897 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68b3feb5-3535-4655-a73f-03ce141df427", "tag": "c53b45db-bda4-476c-a0e5-8aae6d2e5991"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:18:33.617011 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ddf561a5-89d6-48ed-ac0b-37ea0b9d3e4a req-1f8a6da1-f2d4-4029-84e5-db90a67d8897 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:33.617769 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ddf561a5-89d6-48ed-ac0b-37ea0b9d3e4a req-1f8a6da1-f2d4-4029-84e5-db90a67d8897 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:33.630783 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-ddf561a5-89d6-48ed-ac0b-37ea0b9d3e4a req-1f8a6da1-f2d4-4029-84e5-db90a67d8897 service nova] Creating event network-changed:c53b45db-bda4-476c-a0e5-8aae6d2e5991 for instance 68b3feb5-3535-4655-a73f-03ce141df427 on n-h2-master-1 Jun 20 12:18:33.637472 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-ddf561a5-89d6-48ed-ac0b-37ea0b9d3e4a req-1f8a6da1-f2d4-4029-84e5-db90a67d8897 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050131 Jun 20 12:18:33.638658 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2277/4456] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:18:34.138173 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-263b19ae-c204-4505-b2af-1e97721efd23 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:34.147344 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-263b19ae-c204-4505-b2af-1e97721efd23 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1363 microversion: 2.1 time: 0.953008 Jun 20 12:18:34.156607 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2180/4457] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:33 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1363 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:34.203275 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-462f2569-2a19-4d0d-a782-890dfb721930 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:34.204161 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-462f2569-2a19-4d0d-a782-890dfb721930 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] [instance: 68b3feb5-3535-4655-a73f-03ce141df427] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:34.220839 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:18:34.224973 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-462f2569-2a19-4d0d-a782-890dfb721930 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:34.225735 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-462f2569-2a19-4d0d-a782-890dfb721930 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:34.228489 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-462f2569-2a19-4d0d-a782-890dfb721930 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:34.229302 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-462f2569-2a19-4d0d-a782-890dfb721930 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:34.600397 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a68b17b3-02c6-4c51-92c3-ee8ab76e0bf7 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:34.601117 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a68b17b3-02c6-4c51-92c3-ee8ab76e0bf7 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] [instance: d9af10dd-20fa-44ef-a104-a62b82761ffd] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:34.613198 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a68b17b3-02c6-4c51-92c3-ee8ab76e0bf7 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:34.614085 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a68b17b3-02c6-4c51-92c3-ee8ab76e0bf7 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:34.615891 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a68b17b3-02c6-4c51-92c3-ee8ab76e0bf7 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:34.619191 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a68b17b3-02c6-4c51-92c3-ee8ab76e0bf7 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:34.752855 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-462f2569-2a19-4d0d-a782-890dfb721930 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd640fdee13ca47ae848264ccbc532925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca22edf491394f878e14c2b67fb92816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:34.762705 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-462f2569-2a19-4d0d-a782-890dfb721930 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] 10.222.0.27 "GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427" status: 200 len: 1394 microversion: 2.1 time: 0.564998 Jun 20 12:18:34.764533 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2278/4458] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:34 2022] GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427 => generated 1394 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:35.026200 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-eda8b1b8-5196-4caa-9117-cb8ed43c77ea req-2211d120-7aad-45d1-ab69-52cfa17c60f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "442a5a56-7a8d-4804-ab29-515e6d314b19", "tag": "f2aa724a-10fa-4182-ae95-b075493ddc8c"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:18:35.049111 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-eda8b1b8-5196-4caa-9117-cb8ed43c77ea req-2211d120-7aad-45d1-ab69-52cfa17c60f9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:35.049769 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-eda8b1b8-5196-4caa-9117-cb8ed43c77ea req-2211d120-7aad-45d1-ab69-52cfa17c60f9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:35.074907 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-eda8b1b8-5196-4caa-9117-cb8ed43c77ea req-2211d120-7aad-45d1-ab69-52cfa17c60f9 service nova] Creating event network-changed:f2aa724a-10fa-4182-ae95-b075493ddc8c for instance 442a5a56-7a8d-4804-ab29-515e6d314b19 on n-h2-master-1 Jun 20 12:18:35.088349 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-eda8b1b8-5196-4caa-9117-cb8ed43c77ea req-2211d120-7aad-45d1-ab69-52cfa17c60f9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066505 Jun 20 12:18:35.089160 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2279/4459] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:18:35.164237 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a68b17b3-02c6-4c51-92c3-ee8ab76e0bf7 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fb72c24dab41c8b04e058d6825267f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc4c64b72b455ab2aed35f728befc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:35.180064 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a68b17b3-02c6-4c51-92c3-ee8ab76e0bf7 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] 10.222.0.27 "GET /compute/v2.1/servers/d9af10dd-20fa-44ef-a104-a62b82761ffd" status: 200 len: 1313 microversion: 2.1 time: 0.584157 Jun 20 12:18:35.180893 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-57bd9d21-2719-451a-90ba-2186b4e69ed7 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:35.183105 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-57bd9d21-2719-451a-90ba-2186b4e69ed7 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:35.190555 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2181/4460] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:34 2022] GET /compute/v2.1/servers/d9af10dd-20fa-44ef-a104-a62b82761ffd => generated 1313 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:35.199990 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57bd9d21-2719-451a-90ba-2186b4e69ed7 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:35.200839 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57bd9d21-2719-451a-90ba-2186b4e69ed7 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:35.202422 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57bd9d21-2719-451a-90ba-2186b4e69ed7 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:35.202934 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57bd9d21-2719-451a-90ba-2186b4e69ed7 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:35.452240 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-57bd9d21-2719-451a-90ba-2186b4e69ed7 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:35.473129 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-57bd9d21-2719-451a-90ba-2186b4e69ed7 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1363 microversion: 2.1 time: 0.296988 Jun 20 12:18:35.474016 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2280/4461] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:35 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1363 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:35.762967 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-531ab552-6068-48fb-bfca-dd2eafc95d10 req-bad53f45-d063-42e2-9e76-49ed8ea508f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9af10dd-20fa-44ef-a104-a62b82761ffd", "name": "network-vif-plugged", "status": "completed", "tag": "b47658a4-1ca6-4cf6-9203-458c26dc34a0"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:18:35.784084 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-91b4709c-9144-4e8e-a304-52e843423de9 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:35.786315 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-91b4709c-9144-4e8e-a304-52e843423de9 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] [instance: 68b3feb5-3535-4655-a73f-03ce141df427] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:35.821723 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91b4709c-9144-4e8e-a304-52e843423de9 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:35.822600 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-531ab552-6068-48fb-bfca-dd2eafc95d10 req-bad53f45-d063-42e2-9e76-49ed8ea508f6 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:35.823785 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-531ab552-6068-48fb-bfca-dd2eafc95d10 req-bad53f45-d063-42e2-9e76-49ed8ea508f6 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:35.825281 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91b4709c-9144-4e8e-a304-52e843423de9 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:35.827670 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91b4709c-9144-4e8e-a304-52e843423de9 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:35.836050 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91b4709c-9144-4e8e-a304-52e843423de9 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:35.890237 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-531ab552-6068-48fb-bfca-dd2eafc95d10 req-bad53f45-d063-42e2-9e76-49ed8ea508f6 service nova] Creating event network-vif-plugged:b47658a4-1ca6-4cf6-9203-458c26dc34a0 for instance d9af10dd-20fa-44ef-a104-a62b82761ffd on n-h1-master-1 Jun 20 12:18:35.902768 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-531ab552-6068-48fb-bfca-dd2eafc95d10 req-bad53f45-d063-42e2-9e76-49ed8ea508f6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143866 Jun 20 12:18:35.903399 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2182/4462] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:18:36.197644 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9146f080-f509-4723-9ef6-be83e3ee4067 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:36.198356 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9146f080-f509-4723-9ef6-be83e3ee4067 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] [instance: d9af10dd-20fa-44ef-a104-a62b82761ffd] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:36.226440 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9146f080-f509-4723-9ef6-be83e3ee4067 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:36.227310 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9146f080-f509-4723-9ef6-be83e3ee4067 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:36.228291 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9146f080-f509-4723-9ef6-be83e3ee4067 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:36.228913 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9146f080-f509-4723-9ef6-be83e3ee4067 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:36.616382 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-91b4709c-9144-4e8e-a304-52e843423de9 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd640fdee13ca47ae848264ccbc532925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca22edf491394f878e14c2b67fb92816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:36.652378 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-91b4709c-9144-4e8e-a304-52e843423de9 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] 10.222.0.27 "GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427" status: 200 len: 1394 microversion: 2.1 time: 0.874595 Jun 20 12:18:36.654625 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2281/4463] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:35 2022] GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427 => generated 1394 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:18:36.677276 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-493c61b4-278e-4830-b350-5118e66c0888 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:36.684265 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-493c61b4-278e-4830-b350-5118e66c0888 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:36.707924 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-493c61b4-278e-4830-b350-5118e66c0888 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:36.710508 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-493c61b4-278e-4830-b350-5118e66c0888 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:36.713649 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-493c61b4-278e-4830-b350-5118e66c0888 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:36.718163 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-493c61b4-278e-4830-b350-5118e66c0888 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:36.865544 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9146f080-f509-4723-9ef6-be83e3ee4067 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fb72c24dab41c8b04e058d6825267f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc4c64b72b455ab2aed35f728befc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:36.878341 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9146f080-f509-4723-9ef6-be83e3ee4067 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] 10.222.0.27 "GET /compute/v2.1/servers/d9af10dd-20fa-44ef-a104-a62b82761ffd" status: 200 len: 1313 microversion: 2.1 time: 0.684854 Jun 20 12:18:36.881174 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2183/4464] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:36 2022] GET /compute/v2.1/servers/d9af10dd-20fa-44ef-a104-a62b82761ffd => generated 1313 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:37.091607 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-493c61b4-278e-4830-b350-5118e66c0888 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:37.109261 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-493c61b4-278e-4830-b350-5118e66c0888 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1363 microversion: 2.1 time: 0.452049 Jun 20 12:18:37.124232 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2282/4465] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:36 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1363 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:37.686281 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7e02b2aa-de64-4872-9f79-ebd6015a8313 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:37.687441 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7e02b2aa-de64-4872-9f79-ebd6015a8313 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] [instance: 68b3feb5-3535-4655-a73f-03ce141df427] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:37.704653 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7e02b2aa-de64-4872-9f79-ebd6015a8313 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:37.705515 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7e02b2aa-de64-4872-9f79-ebd6015a8313 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:37.706555 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7e02b2aa-de64-4872-9f79-ebd6015a8313 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:37.707158 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7e02b2aa-de64-4872-9f79-ebd6015a8313 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:37.897361 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-53821b9c-0c54-40cc-b4ec-f397eaf236a9 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:37.897966 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-53821b9c-0c54-40cc-b4ec-f397eaf236a9 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] [instance: d9af10dd-20fa-44ef-a104-a62b82761ffd] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:37.918648 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-53821b9c-0c54-40cc-b4ec-f397eaf236a9 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:37.919107 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-53821b9c-0c54-40cc-b4ec-f397eaf236a9 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:37.919897 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-53821b9c-0c54-40cc-b4ec-f397eaf236a9 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:37.920358 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-53821b9c-0c54-40cc-b4ec-f397eaf236a9 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:38.149455 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7e02b2aa-de64-4872-9f79-ebd6015a8313 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd640fdee13ca47ae848264ccbc532925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca22edf491394f878e14c2b67fb92816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:38.158695 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7e02b2aa-de64-4872-9f79-ebd6015a8313 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] 10.222.0.27 "GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427" status: 200 len: 1394 microversion: 2.1 time: 0.478459 Jun 20 12:18:38.169832 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2184/4466] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:37 2022] GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427 => generated 1394 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:38.175271 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fbc7b4df-82c4-4e75-97ec-16ac0d47abab tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:38.176877 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fbc7b4df-82c4-4e75-97ec-16ac0d47abab tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:38.183535 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fbc7b4df-82c4-4e75-97ec-16ac0d47abab tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:38.184403 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fbc7b4df-82c4-4e75-97ec-16ac0d47abab tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:38.185424 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fbc7b4df-82c4-4e75-97ec-16ac0d47abab tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:38.186099 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fbc7b4df-82c4-4e75-97ec-16ac0d47abab tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:38.504862 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-53821b9c-0c54-40cc-b4ec-f397eaf236a9 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fb72c24dab41c8b04e058d6825267f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc4c64b72b455ab2aed35f728befc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:38.521473 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-53821b9c-0c54-40cc-b4ec-f397eaf236a9 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] 10.222.0.27 "GET /compute/v2.1/servers/d9af10dd-20fa-44ef-a104-a62b82761ffd" status: 200 len: 1499 microversion: 2.1 time: 0.627244 Jun 20 12:18:38.522101 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2283/4467] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:37 2022] GET /compute/v2.1/servers/d9af10dd-20fa-44ef-a104-a62b82761ffd => generated 1499 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:18:38.540830 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3361253c-a1f1-4de7-8449-6a5d3ea4f517 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:38.577565 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.compute.server_groups [None req-3361253c-a1f1-4de7-8449-6a5d3ea4f517 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Querying cell d5df985c-a080-4240-bcef-1787de3aeb9e(cell1) for 1 instances {{(pid=119127) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jun 20 12:18:38.578563 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3361253c-a1f1-4de7-8449-6a5d3ea4f517 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:38.579029 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3361253c-a1f1-4de7-8449-6a5d3ea4f517 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:38.623014 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3361253c-a1f1-4de7-8449-6a5d3ea4f517 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/0cd34122-81d6-4934-b02a-352afc257162" status: 200 len: 222 microversion: 2.1 time: 0.085911 Jun 20 12:18:38.625487 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2284/4468] 10.222.0.27 () {58 vars in 1262 bytes} [Mon Jun 20 12:18:38 2022] GET /compute/v2.1/os-server-groups/0cd34122-81d6-4934-b02a-352afc257162 => generated 222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:18:38.640464 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3da4e394-4aa6-4ae9-b18c-28a4a7d60310 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:38.640984 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3da4e394-4aa6-4ae9-b18c-28a4a7d60310 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] [instance: d9af10dd-20fa-44ef-a104-a62b82761ffd] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:38.649209 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3da4e394-4aa6-4ae9-b18c-28a4a7d60310 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:38.649715 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3da4e394-4aa6-4ae9-b18c-28a4a7d60310 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:38.650690 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3da4e394-4aa6-4ae9-b18c-28a4a7d60310 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:38.651291 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3da4e394-4aa6-4ae9-b18c-28a4a7d60310 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:38.693075 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3da4e394-4aa6-4ae9-b18c-28a4a7d60310 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] [instance: d9af10dd-20fa-44ef-a104-a62b82761ffd] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:18:38.744847 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:18:38.829724 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3da4e394-4aa6-4ae9-b18c-28a4a7d60310 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d9af10dd-20fa-44ef-a104-a62b82761ffd" status: 204 len: 0 microversion: 2.1 time: 0.196801 Jun 20 12:18:38.831424 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2285/4469] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:18:38 2022] DELETE /compute/v2.1/servers/d9af10dd-20fa-44ef-a104-a62b82761ffd => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:18:38.848955 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-45d5fadc-4e81-4bd9-8658-33acdb0bb472 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:38.849670 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-45d5fadc-4e81-4bd9-8658-33acdb0bb472 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] [instance: d9af10dd-20fa-44ef-a104-a62b82761ffd] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:38.874673 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-45d5fadc-4e81-4bd9-8658-33acdb0bb472 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:38.875276 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-45d5fadc-4e81-4bd9-8658-33acdb0bb472 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:38.876089 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-45d5fadc-4e81-4bd9-8658-33acdb0bb472 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:38.876733 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-45d5fadc-4e81-4bd9-8658-33acdb0bb472 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:39.095430 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fbc7b4df-82c4-4e75-97ec-16ac0d47abab tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:39.117511 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fbc7b4df-82c4-4e75-97ec-16ac0d47abab tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1363 microversion: 2.1 time: 0.943935 Jun 20 12:18:39.118172 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2185/4470] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:38 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1363 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:39.178238 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-932130ac-2504-4941-a5cb-719b21c34ce0 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:39.178901 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-932130ac-2504-4941-a5cb-719b21c34ce0 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] [instance: 68b3feb5-3535-4655-a73f-03ce141df427] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:39.181046 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=4 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:18:39.182789 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=40 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:18:39.202678 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-932130ac-2504-4941-a5cb-719b21c34ce0 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:39.203178 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-932130ac-2504-4941-a5cb-719b21c34ce0 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:39.204018 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-932130ac-2504-4941-a5cb-719b21c34ce0 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:39.206307 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-932130ac-2504-4941-a5cb-719b21c34ce0 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:39.399162 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-932130ac-2504-4941-a5cb-719b21c34ce0 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd640fdee13ca47ae848264ccbc532925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca22edf491394f878e14c2b67fb92816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:39.407133 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-932130ac-2504-4941-a5cb-719b21c34ce0 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] 10.222.0.27 "GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427" status: 200 len: 1394 microversion: 2.1 time: 0.234441 Jun 20 12:18:39.416373 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2186/4471] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:39 2022] GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427 => generated 1394 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:39.547319 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cc57ad5b-424c-4447-bc28-4c1e1a5814b4 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Action: 'create', calling method: .version_select at 0x7f6073328040>, body: {"keypair": {"name": "tempest-keypair-1891866882", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDnQdUa3USyif4V5ngxBRSjPptlAR6QNJR6ea+r05v0EY3B8wYYvozDaj5F0neX2FbmDHRUhPPG2o7YUvba9/JNWBMf/hGi1ZCictF9bZBEMgnuC2mH1TGngBJWu2Gj5g=="}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:18:39.563934 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-cc57ad5b-424c-4447-bc28-4c1e1a5814b4 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Getting quotas for project 19236314583142029ffd7a1e04460cab. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:18:39.569860 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-cc57ad5b-424c-4447-bc28-4c1e1a5814b4 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Getting quotas for user 4ccd420e1ff744b99cb7e5650522e983 and project 19236314583142029ffd7a1e04460cab. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:18:39.600692 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cc57ad5b-424c-4447-bc28-4c1e1a5814b4 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.190715 Jun 20 12:18:39.602075 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2187/4472] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 12:18:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:18:39.701966 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=44 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:18:39.740640 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-45d5fadc-4e81-4bd9-8658-33acdb0bb472 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fb72c24dab41c8b04e058d6825267f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc4c64b72b455ab2aed35f728befc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:39.758929 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-45d5fadc-4e81-4bd9-8658-33acdb0bb472 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] 10.222.0.27 "GET /compute/v2.1/servers/d9af10dd-20fa-44ef-a104-a62b82761ffd" status: 200 len: 1505 microversion: 2.1 time: 0.916513 Jun 20 12:18:39.759871 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2286/4473] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:38 2022] GET /compute/v2.1/servers/d9af10dd-20fa-44ef-a104-a62b82761ffd => generated 1505 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:40.145329 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e29be485-f9bd-4720-a7cb-c261da1a6f1c tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:40.146299 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e29be485-f9bd-4720-a7cb-c261da1a6f1c tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:40.168008 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e29be485-f9bd-4720-a7cb-c261da1a6f1c tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:40.169322 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e29be485-f9bd-4720-a7cb-c261da1a6f1c tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:40.170313 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e29be485-f9bd-4720-a7cb-c261da1a6f1c tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:40.170875 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e29be485-f9bd-4720-a7cb-c261da1a6f1c tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:40.425232 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7b4bb995-ca1d-45f4-81db-fc7d58cdbbb5 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:40.426179 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7b4bb995-ca1d-45f4-81db-fc7d58cdbbb5 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] [instance: 68b3feb5-3535-4655-a73f-03ce141df427] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:40.446124 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7b4bb995-ca1d-45f4-81db-fc7d58cdbbb5 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:40.446580 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7b4bb995-ca1d-45f4-81db-fc7d58cdbbb5 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:40.447536 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7b4bb995-ca1d-45f4-81db-fc7d58cdbbb5 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:40.448086 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7b4bb995-ca1d-45f4-81db-fc7d58cdbbb5 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:40.559217 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e29be485-f9bd-4720-a7cb-c261da1a6f1c tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:40.576047 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e29be485-f9bd-4720-a7cb-c261da1a6f1c tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1363 microversion: 2.1 time: 0.435252 Jun 20 12:18:40.577883 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2188/4474] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:40 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1363 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:40.784739 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-33486425-6139-4953-ab4b-74eedbe43cc6 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:40.785383 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-33486425-6139-4953-ab4b-74eedbe43cc6 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] [instance: d9af10dd-20fa-44ef-a104-a62b82761ffd] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:40.801847 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-33486425-6139-4953-ab4b-74eedbe43cc6 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:40.802549 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-33486425-6139-4953-ab4b-74eedbe43cc6 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:40.803512 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-33486425-6139-4953-ab4b-74eedbe43cc6 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:40.804112 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-33486425-6139-4953-ab4b-74eedbe43cc6 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:40.859557 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7b4bb995-ca1d-45f4-81db-fc7d58cdbbb5 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd640fdee13ca47ae848264ccbc532925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca22edf491394f878e14c2b67fb92816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:40.870503 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7b4bb995-ca1d-45f4-81db-fc7d58cdbbb5 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] 10.222.0.27 "GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427" status: 200 len: 1394 microversion: 2.1 time: 0.449502 Jun 20 12:18:40.871116 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2287/4475] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:40 2022] GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427 => generated 1394 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:41.206143 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-33486425-6139-4953-ab4b-74eedbe43cc6 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fb72c24dab41c8b04e058d6825267f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4dc4c64b72b455ab2aed35f728befc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:41.235623 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-33486425-6139-4953-ab4b-74eedbe43cc6 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] 10.222.0.27 "GET /compute/v2.1/servers/d9af10dd-20fa-44ef-a104-a62b82761ffd" status: 200 len: 1505 microversion: 2.1 time: 0.458615 Jun 20 12:18:41.244002 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2189/4476] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:40 2022] GET /compute/v2.1/servers/d9af10dd-20fa-44ef-a104-a62b82761ffd => generated 1505 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:41.598164 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-905ce1d1-6856-4298-84b2-e2e95514e471 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:41.612845 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-905ce1d1-6856-4298-84b2-e2e95514e471 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:41.634278 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-c69b9656-6397-4965-9ff6-221b0003297f req-18f2a646-6e27-4f83-85a7-ad1b3e6b8926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9af10dd-20fa-44ef-a104-a62b82761ffd", "name": "network-vif-deleted", "tag": "b47658a4-1ca6-4cf6-9203-458c26dc34a0"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:18:41.648529 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-905ce1d1-6856-4298-84b2-e2e95514e471 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:41.649364 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-905ce1d1-6856-4298-84b2-e2e95514e471 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:41.652259 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-905ce1d1-6856-4298-84b2-e2e95514e471 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:41.653022 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-905ce1d1-6856-4298-84b2-e2e95514e471 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:41.670324 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-c69b9656-6397-4965-9ff6-221b0003297f req-18f2a646-6e27-4f83-85a7-ad1b3e6b8926 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:41.676170 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-c69b9656-6397-4965-9ff6-221b0003297f req-18f2a646-6e27-4f83-85a7-ad1b3e6b8926 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:41.718869 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-c69b9656-6397-4965-9ff6-221b0003297f req-18f2a646-6e27-4f83-85a7-ad1b3e6b8926 service nova] Creating event network-vif-deleted:b47658a4-1ca6-4cf6-9203-458c26dc34a0 for instance d9af10dd-20fa-44ef-a104-a62b82761ffd on n-h1-master-1 Jun 20 12:18:41.748098 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-c69b9656-6397-4965-9ff6-221b0003297f req-18f2a646-6e27-4f83-85a7-ad1b3e6b8926 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112009 Jun 20 12:18:41.750864 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2190/4477] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:18:41.893318 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7e440d51-cff6-4846-a31f-17923f433a45 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:41.894535 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7e440d51-cff6-4846-a31f-17923f433a45 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] [instance: 68b3feb5-3535-4655-a73f-03ce141df427] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:41.905079 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=92 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:18:41.909536 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7e440d51-cff6-4846-a31f-17923f433a45 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:41.911651 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7e440d51-cff6-4846-a31f-17923f433a45 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:41.917977 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7e440d51-cff6-4846-a31f-17923f433a45 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:41.919167 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7e440d51-cff6-4846-a31f-17923f433a45 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:42.042750 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-905ce1d1-6856-4298-84b2-e2e95514e471 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:42.054171 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-905ce1d1-6856-4298-84b2-e2e95514e471 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1363 microversion: 2.1 time: 0.459854 Jun 20 12:18:42.055195 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2288/4478] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:41 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1363 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:42.263036 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a92c2c0f-20ba-448f-abdc-ef08eae2af2d tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:42.264139 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a92c2c0f-20ba-448f-abdc-ef08eae2af2d tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] [instance: d9af10dd-20fa-44ef-a104-a62b82761ffd] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:42.281629 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a92c2c0f-20ba-448f-abdc-ef08eae2af2d tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:42.282535 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a92c2c0f-20ba-448f-abdc-ef08eae2af2d tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:42.283628 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a92c2c0f-20ba-448f-abdc-ef08eae2af2d tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:42.284296 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a92c2c0f-20ba-448f-abdc-ef08eae2af2d tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:42.297161 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7e440d51-cff6-4846-a31f-17923f433a45 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd640fdee13ca47ae848264ccbc532925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca22edf491394f878e14c2b67fb92816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:42.310288 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7e440d51-cff6-4846-a31f-17923f433a45 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] 10.222.0.27 "GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427" status: 200 len: 1394 microversion: 2.1 time: 0.422773 Jun 20 12:18:42.313070 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2191/4479] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:41 2022] GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427 => generated 1394 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:42.314233 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-a92c2c0f-20ba-448f-abdc-ef08eae2af2d tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] HTTP exception thrown: Instance d9af10dd-20fa-44ef-a104-a62b82761ffd could not be found. Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a92c2c0f-20ba-448f-abdc-ef08eae2af2d tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Request method failure captured: Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/d9af10dd-20fa-44ef-a104-a62b82761ffd HTTP/1.1 Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGWJPIs4CJlc7r7zjuWBoTGHLl_MPBGHa0K6lBL4UPUxY6p8y-i0O8UilY99ma-IdKAxHfv1S_HTpwGw6RDRNyv369Nn5jeSbNZC-tOk8dws9kDZt0TOTYjOPy3vy7WymEPIAzmCg8Qv77zSFdD2KEZmsUwIBSIDfhYE0TwzXfhvct0 Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: d4dc4c64b72b455ab2aed35f728befc4 Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServerGroupTestJSON-361723497 Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d4dc4c64b72b455ab2aed35f728befc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d4dc4c64b72b455ab2aed35f728befc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d4dc4c64b72b455ab2aed35f728befc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d4dc4c64b72b455ab2aed35f728befc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServerGroupTestJSON-361723497 Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: d4dc4c64b72b455ab2aed35f728befc4 Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServerGroupTestJSON-361723497 Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServerGroupTestJSON-361723497-project Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 31fb72c24dab41c8b04e058d6825267f Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServerGroupTestJSON-361723497-project Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: exception: Instance d9af10dd-20fa-44ef-a104-a62b82761ffd could not be found. Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'd9af10dd-20fa-44ef-a104-a62b82761ffd'} Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9af10dd-20fa-44ef-a104-a62b82761ffd could not be found. Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9af10dd-20fa-44ef-a104-a62b82761ffd could not be found. Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:18:42.318919 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:18:42.323768 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:18:42.323768 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:18:42.323768 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:18:42.323768 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:18:42.323768 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:18:42.323768 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9af10dd-20fa-44ef-a104-a62b82761ffd could not be found. Jun 20 12:18:42.323768 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:18:42.324695 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a92c2c0f-20ba-448f-abdc-ef08eae2af2d tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Returning 404 to user: Instance d9af10dd-20fa-44ef-a104-a62b82761ffd could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:18:42.326693 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a92c2c0f-20ba-448f-abdc-ef08eae2af2d tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] 10.222.0.27 "GET /compute/v2.1/servers/d9af10dd-20fa-44ef-a104-a62b82761ffd" status: 404 len: 111 microversion: 2.1 time: 0.069588 Jun 20 12:18:42.327856 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2289/4480] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:42 2022] GET /compute/v2.1/servers/d9af10dd-20fa-44ef-a104-a62b82761ffd => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:18:42.338090 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-50157bab-2e17-4a17-8906-d4edb27457a0 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:42.355908 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.compute.server_groups [None req-50157bab-2e17-4a17-8906-d4edb27457a0 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Querying cell d5df985c-a080-4240-bcef-1787de3aeb9e(cell1) for 1 instances {{(pid=119128) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jun 20 12:18:42.357042 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-50157bab-2e17-4a17-8906-d4edb27457a0 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:42.357796 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-50157bab-2e17-4a17-8906-d4edb27457a0 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:42.387773 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-50157bab-2e17-4a17-8906-d4edb27457a0 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.053891 Jun 20 12:18:42.388662 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2192/4481] 10.222.0.27 () {58 vars in 1151 bytes} [Mon Jun 20 12:18:42 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:18:42.408030 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f22ee8fd-4598-42c8-ace2-bdb728eb9510 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:42.433331 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.compute.server_groups [None req-f22ee8fd-4598-42c8-ace2-bdb728eb9510 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Querying cell d5df985c-a080-4240-bcef-1787de3aeb9e(cell1) for 1 instances {{(pid=119127) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jun 20 12:18:42.434858 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f22ee8fd-4598-42c8-ace2-bdb728eb9510 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:42.435014 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f22ee8fd-4598-42c8-ace2-bdb728eb9510 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:42.458983 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f22ee8fd-4598-42c8-ace2-bdb728eb9510 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/0cd34122-81d6-4934-b02a-352afc257162" status: 200 len: 184 microversion: 2.1 time: 0.061686 Jun 20 12:18:42.460491 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2290/4482] 10.222.0.27 () {58 vars in 1262 bytes} [Mon Jun 20 12:18:42 2022] GET /compute/v2.1/os-server-groups/0cd34122-81d6-4934-b02a-352afc257162 => generated 184 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:18:42.474719 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f7d8c402-58d1-4cef-a162-22daad1b281a tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:42.475579 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f7d8c402-58d1-4cef-a162-22daad1b281a tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] [instance: d9af10dd-20fa-44ef-a104-a62b82761ffd] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:42.489705 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7d8c402-58d1-4cef-a162-22daad1b281a tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:42.490854 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7d8c402-58d1-4cef-a162-22daad1b281a tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:42.493671 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7d8c402-58d1-4cef-a162-22daad1b281a tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:42.496230 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7d8c402-58d1-4cef-a162-22daad1b281a tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:42.526712 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-f7d8c402-58d1-4cef-a162-22daad1b281a tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] HTTP exception thrown: Instance d9af10dd-20fa-44ef-a104-a62b82761ffd could not be found. Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f7d8c402-58d1-4cef-a162-22daad1b281a tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Request method failure captured: Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/servers/d9af10dd-20fa-44ef-a104-a62b82761ffd HTTP/1.1 Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGWJPIs4CJlc7r7zjuWBoTGHLl_MPBGHa0K6lBL4UPUxY6p8y-i0O8UilY99ma-IdKAxHfv1S_HTpwGw6RDRNyv369Nn5jeSbNZC-tOk8dws9kDZt0TOTYjOPy3vy7WymEPIAzmCg8Qv77zSFdD2KEZmsUwIBSIDfhYE0TwzXfhvct0 Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: d4dc4c64b72b455ab2aed35f728befc4 Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServerGroupTestJSON-361723497 Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d4dc4c64b72b455ab2aed35f728befc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d4dc4c64b72b455ab2aed35f728befc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d4dc4c64b72b455ab2aed35f728befc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d4dc4c64b72b455ab2aed35f728befc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServerGroupTestJSON-361723497 Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: d4dc4c64b72b455ab2aed35f728befc4 Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServerGroupTestJSON-361723497 Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServerGroupTestJSON-361723497-project Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 31fb72c24dab41c8b04e058d6825267f Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServerGroupTestJSON-361723497-project Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: exception: Instance d9af10dd-20fa-44ef-a104-a62b82761ffd could not be found. Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'd9af10dd-20fa-44ef-a104-a62b82761ffd'} Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9af10dd-20fa-44ef-a104-a62b82761ffd could not be found. Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:18:42.530566 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9af10dd-20fa-44ef-a104-a62b82761ffd could not be found. Jun 20 12:18:42.534921 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:18:42.534921 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:18:42.534921 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:18:42.534921 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:18:42.534921 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:18:42.534921 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:18:42.534921 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:18:42.534921 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:18:42.534921 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9af10dd-20fa-44ef-a104-a62b82761ffd could not be found. Jun 20 12:18:42.534921 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:18:42.538741 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f7d8c402-58d1-4cef-a162-22daad1b281a tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Returning 404 to user: Instance d9af10dd-20fa-44ef-a104-a62b82761ffd could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:18:42.540607 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f7d8c402-58d1-4cef-a162-22daad1b281a tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d9af10dd-20fa-44ef-a104-a62b82761ffd" status: 404 len: 111 microversion: 2.1 time: 0.073440 Jun 20 12:18:42.542068 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2193/4483] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:18:42 2022] DELETE /compute/v2.1/servers/d9af10dd-20fa-44ef-a104-a62b82761ffd => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:18:42.550242 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-695486c4-2c6a-4059-b5d7-3b189a3ac00f tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:42.553711 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-695486c4-2c6a-4059-b5d7-3b189a3ac00f tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] [instance: d9af10dd-20fa-44ef-a104-a62b82761ffd] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:42.560346 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-695486c4-2c6a-4059-b5d7-3b189a3ac00f tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:42.560814 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-695486c4-2c6a-4059-b5d7-3b189a3ac00f tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:42.561772 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-695486c4-2c6a-4059-b5d7-3b189a3ac00f tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:42.562214 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-695486c4-2c6a-4059-b5d7-3b189a3ac00f tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:42.579650 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-695486c4-2c6a-4059-b5d7-3b189a3ac00f tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] HTTP exception thrown: Instance d9af10dd-20fa-44ef-a104-a62b82761ffd could not be found. Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-695486c4-2c6a-4059-b5d7-3b189a3ac00f tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Request method failure captured: Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/d9af10dd-20fa-44ef-a104-a62b82761ffd HTTP/1.1 Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGWJPIs4CJlc7r7zjuWBoTGHLl_MPBGHa0K6lBL4UPUxY6p8y-i0O8UilY99ma-IdKAxHfv1S_HTpwGw6RDRNyv369Nn5jeSbNZC-tOk8dws9kDZt0TOTYjOPy3vy7WymEPIAzmCg8Qv77zSFdD2KEZmsUwIBSIDfhYE0TwzXfhvct0 Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: d4dc4c64b72b455ab2aed35f728befc4 Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServerGroupTestJSON-361723497 Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d4dc4c64b72b455ab2aed35f728befc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d4dc4c64b72b455ab2aed35f728befc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d4dc4c64b72b455ab2aed35f728befc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d4dc4c64b72b455ab2aed35f728befc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServerGroupTestJSON-361723497 Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: d4dc4c64b72b455ab2aed35f728befc4 Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServerGroupTestJSON-361723497 Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServerGroupTestJSON-361723497-project Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 31fb72c24dab41c8b04e058d6825267f Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServerGroupTestJSON-361723497-project Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: exception: Instance d9af10dd-20fa-44ef-a104-a62b82761ffd could not be found. Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'd9af10dd-20fa-44ef-a104-a62b82761ffd'} Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9af10dd-20fa-44ef-a104-a62b82761ffd could not be found. Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9af10dd-20fa-44ef-a104-a62b82761ffd could not be found. Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:18:42.581401 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:18:42.587411 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:18:42.587411 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:18:42.587411 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:18:42.587411 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:18:42.587411 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:18:42.587411 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9af10dd-20fa-44ef-a104-a62b82761ffd could not be found. Jun 20 12:18:42.587411 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:18:42.587411 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-695486c4-2c6a-4059-b5d7-3b189a3ac00f tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Returning 404 to user: Instance d9af10dd-20fa-44ef-a104-a62b82761ffd could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:18:42.587411 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-695486c4-2c6a-4059-b5d7-3b189a3ac00f tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] 10.222.0.27 "GET /compute/v2.1/servers/d9af10dd-20fa-44ef-a104-a62b82761ffd" status: 404 len: 111 microversion: 2.1 time: 0.037317 Jun 20 12:18:42.587411 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2291/4484] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:42 2022] GET /compute/v2.1/servers/d9af10dd-20fa-44ef-a104-a62b82761ffd => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:18:42.593473 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c6721f67-23c2-42bb-b9d9-dcdb0927d007 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:42.607613 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-c6721f67-23c2-42bb-b9d9-dcdb0927d007 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] HTTP exception thrown: Instance group 7bd1b230-0f2e-46e4-b2db-bda1d2a667b5 could not be found. Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c6721f67-23c2-42bb-b9d9-dcdb0927d007 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Request method failure captured: Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/os-server-groups/7bd1b230-0f2e-46e4-b2db-bda1d2a667b5 HTTP/1.1 Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGWJPIs4CJlc7r7zjuWBoTGHLl_MPBGHa0K6lBL4UPUxY6p8y-i0O8UilY99ma-IdKAxHfv1S_HTpwGw6RDRNyv369Nn5jeSbNZC-tOk8dws9kDZt0TOTYjOPy3vy7WymEPIAzmCg8Qv77zSFdD2KEZmsUwIBSIDfhYE0TwzXfhvct0 Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: d4dc4c64b72b455ab2aed35f728befc4 Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServerGroupTestJSON-361723497 Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d4dc4c64b72b455ab2aed35f728befc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d4dc4c64b72b455ab2aed35f728befc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d4dc4c64b72b455ab2aed35f728befc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d4dc4c64b72b455ab2aed35f728befc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServerGroupTestJSON-361723497 Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: d4dc4c64b72b455ab2aed35f728befc4 Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServerGroupTestJSON-361723497 Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServerGroupTestJSON-361723497-project Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 31fb72c24dab41c8b04e058d6825267f Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServerGroupTestJSON-361723497-project Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: exception: Instance group 7bd1b230-0f2e-46e4-b2db-bda1d2a667b5 could not be found. Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '7bd1b230-0f2e-46e4-b2db-bda1d2a667b5'} Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 7bd1b230-0f2e-46e4-b2db-bda1d2a667b5 could not be found. Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 7bd1b230-0f2e-46e4-b2db-bda1d2a667b5 could not be found. Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:18:42.613414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:18:42.620394 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:18:42.620394 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:18:42.620394 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:18:42.620394 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:18:42.620394 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 7bd1b230-0f2e-46e4-b2db-bda1d2a667b5 could not be found. Jun 20 12:18:42.620394 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:18:42.620394 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c6721f67-23c2-42bb-b9d9-dcdb0927d007 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Returning 404 to user: Instance group 7bd1b230-0f2e-46e4-b2db-bda1d2a667b5 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:18:42.620394 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c6721f67-23c2-42bb-b9d9-dcdb0927d007 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/7bd1b230-0f2e-46e4-b2db-bda1d2a667b5" status: 404 len: 117 microversion: 2.1 time: 0.027077 Jun 20 12:18:42.621316 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2194/4485] 10.222.0.27 () {58 vars in 1265 bytes} [Mon Jun 20 12:18:42 2022] DELETE /compute/v2.1/os-server-groups/7bd1b230-0f2e-46e4-b2db-bda1d2a667b5 => generated 117 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:18:42.625084 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5da77ecd-4888-40fd-a128-31be489aed7c tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:42.633724 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-5da77ecd-4888-40fd-a128-31be489aed7c tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] HTTP exception thrown: Instance group 02ef50bc-8b54-42ee-90d5-5d31bf9e21d7 could not be found. Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5da77ecd-4888-40fd-a128-31be489aed7c tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Request method failure captured: Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/os-server-groups/02ef50bc-8b54-42ee-90d5-5d31bf9e21d7 HTTP/1.1 Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGWJPIs4CJlc7r7zjuWBoTGHLl_MPBGHa0K6lBL4UPUxY6p8y-i0O8UilY99ma-IdKAxHfv1S_HTpwGw6RDRNyv369Nn5jeSbNZC-tOk8dws9kDZt0TOTYjOPy3vy7WymEPIAzmCg8Qv77zSFdD2KEZmsUwIBSIDfhYE0TwzXfhvct0 Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: d4dc4c64b72b455ab2aed35f728befc4 Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServerGroupTestJSON-361723497 Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d4dc4c64b72b455ab2aed35f728befc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d4dc4c64b72b455ab2aed35f728befc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d4dc4c64b72b455ab2aed35f728befc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d4dc4c64b72b455ab2aed35f728befc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServerGroupTestJSON-361723497 Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: d4dc4c64b72b455ab2aed35f728befc4 Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServerGroupTestJSON-361723497 Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServerGroupTestJSON-361723497-project Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 31fb72c24dab41c8b04e058d6825267f Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServerGroupTestJSON-361723497-project Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: exception: Instance group 02ef50bc-8b54-42ee-90d5-5d31bf9e21d7 could not be found. Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '02ef50bc-8b54-42ee-90d5-5d31bf9e21d7'} Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 02ef50bc-8b54-42ee-90d5-5d31bf9e21d7 could not be found. Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 02ef50bc-8b54-42ee-90d5-5d31bf9e21d7 could not be found. Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:18:42.634948 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:18:42.639482 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:18:42.639482 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:18:42.639482 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:18:42.639482 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:18:42.639482 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 02ef50bc-8b54-42ee-90d5-5d31bf9e21d7 could not be found. Jun 20 12:18:42.639482 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:18:42.639482 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5da77ecd-4888-40fd-a128-31be489aed7c tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Returning 404 to user: Instance group 02ef50bc-8b54-42ee-90d5-5d31bf9e21d7 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:18:42.650133 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5da77ecd-4888-40fd-a128-31be489aed7c tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/02ef50bc-8b54-42ee-90d5-5d31bf9e21d7" status: 404 len: 117 microversion: 2.1 time: 0.016098 Jun 20 12:18:42.653833 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2292/4486] 10.222.0.27 () {58 vars in 1265 bytes} [Mon Jun 20 12:18:42 2022] DELETE /compute/v2.1/os-server-groups/02ef50bc-8b54-42ee-90d5-5d31bf9e21d7 => generated 117 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:18:42.659828 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c1ebe3ba-a0ce-4e94-a4f7-8d0ceb2a766a tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:42.673145 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-c1ebe3ba-a0ce-4e94-a4f7-8d0ceb2a766a tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] HTTP exception thrown: Instance group dfd83a43-9ca2-466e-9801-924f0c3a716d could not be found. Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c1ebe3ba-a0ce-4e94-a4f7-8d0ceb2a766a tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Request method failure captured: Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/os-server-groups/dfd83a43-9ca2-466e-9801-924f0c3a716d HTTP/1.1 Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGWJPIs4CJlc7r7zjuWBoTGHLl_MPBGHa0K6lBL4UPUxY6p8y-i0O8UilY99ma-IdKAxHfv1S_HTpwGw6RDRNyv369Nn5jeSbNZC-tOk8dws9kDZt0TOTYjOPy3vy7WymEPIAzmCg8Qv77zSFdD2KEZmsUwIBSIDfhYE0TwzXfhvct0 Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: d4dc4c64b72b455ab2aed35f728befc4 Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServerGroupTestJSON-361723497 Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d4dc4c64b72b455ab2aed35f728befc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d4dc4c64b72b455ab2aed35f728befc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d4dc4c64b72b455ab2aed35f728befc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d4dc4c64b72b455ab2aed35f728befc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServerGroupTestJSON-361723497 Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: d4dc4c64b72b455ab2aed35f728befc4 Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServerGroupTestJSON-361723497 Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServerGroupTestJSON-361723497-project Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 31fb72c24dab41c8b04e058d6825267f Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServerGroupTestJSON-361723497-project Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: exception: Instance group dfd83a43-9ca2-466e-9801-924f0c3a716d could not be found. Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'dfd83a43-9ca2-466e-9801-924f0c3a716d'} Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group dfd83a43-9ca2-466e-9801-924f0c3a716d could not be found. Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group dfd83a43-9ca2-466e-9801-924f0c3a716d could not be found. Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:18:42.677539 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:18:42.682032 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:18:42.682032 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:18:42.682032 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:18:42.682032 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:18:42.682032 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group dfd83a43-9ca2-466e-9801-924f0c3a716d could not be found. Jun 20 12:18:42.682032 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:18:42.682032 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c1ebe3ba-a0ce-4e94-a4f7-8d0ceb2a766a tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Returning 404 to user: Instance group dfd83a43-9ca2-466e-9801-924f0c3a716d could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:18:42.682772 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c1ebe3ba-a0ce-4e94-a4f7-8d0ceb2a766a tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/dfd83a43-9ca2-466e-9801-924f0c3a716d" status: 404 len: 117 microversion: 2.1 time: 0.026767 Jun 20 12:18:42.685322 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2195/4487] 10.222.0.27 () {58 vars in 1265 bytes} [Mon Jun 20 12:18:42 2022] DELETE /compute/v2.1/os-server-groups/dfd83a43-9ca2-466e-9801-924f0c3a716d => generated 117 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:18:42.698122 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-65301cab-c1fb-4678-8773-94c10abfe74d tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:42.724334 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-65301cab-c1fb-4678-8773-94c10abfe74d tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] HTTP exception thrown: Instance group 1df39519-b9bd-4a66-bbaf-c20873535e31 could not be found. Jun 20 12:18:42.734640 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4755a25a-498d-460d-a4e5-c20b807fa7b9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1677244729", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2b5ba955-3292-4f14-a644-c809260e0b34"}], "security_groups": [{"name": "tempest-securitygroup--1186546040"}], "key_name": "tempest-keypair-1891866882", "user_data": "}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-65301cab-c1fb-4678-8773-94c10abfe74d tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Request method failure captured: Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/os-server-groups/1df39519-b9bd-4a66-bbaf-c20873535e31 HTTP/1.1 Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGWJPIs4CJlc7r7zjuWBoTGHLl_MPBGHa0K6lBL4UPUxY6p8y-i0O8UilY99ma-IdKAxHfv1S_HTpwGw6RDRNyv369Nn5jeSbNZC-tOk8dws9kDZt0TOTYjOPy3vy7WymEPIAzmCg8Qv77zSFdD2KEZmsUwIBSIDfhYE0TwzXfhvct0 Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: d4dc4c64b72b455ab2aed35f728befc4 Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServerGroupTestJSON-361723497 Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d4dc4c64b72b455ab2aed35f728befc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d4dc4c64b72b455ab2aed35f728befc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d4dc4c64b72b455ab2aed35f728befc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d4dc4c64b72b455ab2aed35f728befc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServerGroupTestJSON-361723497 Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: d4dc4c64b72b455ab2aed35f728befc4 Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServerGroupTestJSON-361723497 Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServerGroupTestJSON-361723497-project Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 31fb72c24dab41c8b04e058d6825267f Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServerGroupTestJSON-361723497-project Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: exception: Instance group 1df39519-b9bd-4a66-bbaf-c20873535e31 could not be found. Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '1df39519-b9bd-4a66-bbaf-c20873535e31'} Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 1df39519-b9bd-4a66-bbaf-c20873535e31 could not be found. Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 1df39519-b9bd-4a66-bbaf-c20873535e31 could not be found. Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:18:42.734961 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:18:42.745495 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:18:42.745495 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:18:42.745495 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:18:42.745495 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:18:42.745495 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 1df39519-b9bd-4a66-bbaf-c20873535e31 could not be found. Jun 20 12:18:42.745495 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:18:42.745495 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-65301cab-c1fb-4678-8773-94c10abfe74d tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Returning 404 to user: Instance group 1df39519-b9bd-4a66-bbaf-c20873535e31 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:18:42.745495 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-65301cab-c1fb-4678-8773-94c10abfe74d tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/1df39519-b9bd-4a66-bbaf-c20873535e31" status: 404 len: 117 microversion: 2.1 time: 0.046776 Jun 20 12:18:42.750344 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2293/4488] 10.222.0.27 () {58 vars in 1265 bytes} [Mon Jun 20 12:18:42 2022] DELETE /compute/v2.1/os-server-groups/1df39519-b9bd-4a66-bbaf-c20873535e31 => generated 117 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:18:42.764864 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7697b3a1-b6ce-42e5-8d08-b327c95914c4 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:42.807627 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7697b3a1-b6ce-42e5-8d08-b327c95914c4 tempest-ServerGroupTestJSON-361723497 tempest-ServerGroupTestJSON-361723497-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/0cd34122-81d6-4934-b02a-352afc257162" status: 204 len: 0 microversion: 2.1 time: 0.052421 Jun 20 12:18:42.810568 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2294/4489] 10.222.0.27 () {58 vars in 1265 bytes} [Mon Jun 20 12:18:42 2022] DELETE /compute/v2.1/os-server-groups/0cd34122-81d6-4934-b02a-352afc257162 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:18:42.946635 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-4755a25a-498d-460d-a4e5-c20b807fa7b9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] validate_networks() for [('2b5ba955-3292-4f14-a644-c809260e0b34', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:18:43.070601 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-5ab7d904-56f6-4743-9e0c-5bf9eab938ee req-6142c36b-ccc5-4668-a304-68e212e62088 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68b3feb5-3535-4655-a73f-03ce141df427", "name": "network-vif-plugged", "status": "completed", "tag": "c53b45db-bda4-476c-a0e5-8aae6d2e5991"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:18:43.105342 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-5ab7d904-56f6-4743-9e0c-5bf9eab938ee req-6142c36b-ccc5-4668-a304-68e212e62088 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:43.105811 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-5ab7d904-56f6-4743-9e0c-5bf9eab938ee req-6142c36b-ccc5-4668-a304-68e212e62088 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:43.131841 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-5ab7d904-56f6-4743-9e0c-5bf9eab938ee req-6142c36b-ccc5-4668-a304-68e212e62088 service nova] Creating event network-vif-plugged:c53b45db-bda4-476c-a0e5-8aae6d2e5991 for instance 68b3feb5-3535-4655-a73f-03ce141df427 on n-h2-master-1 Jun 20 12:18:43.139123 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-5ab7d904-56f6-4743-9e0c-5bf9eab938ee req-6142c36b-ccc5-4668-a304-68e212e62088 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073387 Jun 20 12:18:43.144653 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2295/4490] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:18:43.150455 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0dd2a962-6928-4b84-a60d-8958a8ab724d tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:43.151074 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0dd2a962-6928-4b84-a60d-8958a8ab724d tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:43.170181 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0dd2a962-6928-4b84-a60d-8958a8ab724d tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:43.173578 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0dd2a962-6928-4b84-a60d-8958a8ab724d tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:43.177876 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0dd2a962-6928-4b84-a60d-8958a8ab724d tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:43.178541 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0dd2a962-6928-4b84-a60d-8958a8ab724d tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:43.494306 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0dd2a962-6928-4b84-a60d-8958a8ab724d tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:43.504176 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0dd2a962-6928-4b84-a60d-8958a8ab724d tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1363 microversion: 2.1 time: 0.358062 Jun 20 12:18:43.505305 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2296/4491] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:43 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1363 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:43.510360 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bf5e6261-ee4d-441a-b96a-eb7195172604 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:43.513245 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bf5e6261-ee4d-441a-b96a-eb7195172604 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] [instance: 68b3feb5-3535-4655-a73f-03ce141df427] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:43.523592 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf5e6261-ee4d-441a-b96a-eb7195172604 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:43.525240 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf5e6261-ee4d-441a-b96a-eb7195172604 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:43.526235 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf5e6261-ee4d-441a-b96a-eb7195172604 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:43.526982 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf5e6261-ee4d-441a-b96a-eb7195172604 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:43.914899 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bf5e6261-ee4d-441a-b96a-eb7195172604 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd640fdee13ca47ae848264ccbc532925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca22edf491394f878e14c2b67fb92816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:43.942487 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bf5e6261-ee4d-441a-b96a-eb7195172604 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] 10.222.0.27 "GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427" status: 200 len: 1394 microversion: 2.1 time: 0.435876 Jun 20 12:18:43.948721 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2297/4492] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:43 2022] GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427 => generated 1394 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:44.135548 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-4755a25a-498d-460d-a4e5-c20b807fa7b9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:18:44.137168 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-4755a25a-498d-460d-a4e5-c20b807fa7b9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:18:44.137745 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-4755a25a-498d-460d-a4e5-c20b807fa7b9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:18:44.138260 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-4755a25a-498d-460d-a4e5-c20b807fa7b9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:18:44.138689 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-4755a25a-498d-460d-a4e5-c20b807fa7b9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:18:44.162455 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4755a25a-498d-460d-a4e5-c20b807fa7b9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:44.166474 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4755a25a-498d-460d-a4e5-c20b807fa7b9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:44.167522 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4755a25a-498d-460d-a4e5-c20b807fa7b9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:44.169029 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4755a25a-498d-460d-a4e5-c20b807fa7b9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:44.219612 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-4755a25a-498d-460d-a4e5-c20b807fa7b9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Getting quotas for project 19236314583142029ffd7a1e04460cab. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:18:44.232595 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-4755a25a-498d-460d-a4e5-c20b807fa7b9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Getting quotas for user 4ccd420e1ff744b99cb7e5650522e983 and project 19236314583142029ffd7a1e04460cab. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:18:44.260860 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4755a25a-498d-460d-a4e5-c20b807fa7b9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:18:44.264554 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4755a25a-498d-460d-a4e5-c20b807fa7b9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:18:44.377414 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4755a25a-498d-460d-a4e5-c20b807fa7b9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.646504 Jun 20 12:18:44.378577 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2196/4493] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:18:42 2022] POST /compute/v2.1/servers => generated 409 bytes in 1649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 12:18:44.389015 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-95406a00-3406-4afa-8005-7bb8f6a951bb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:44.391276 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-95406a00-3406-4afa-8005-7bb8f6a951bb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:44.400080 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:18:44.523708 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-737051f6-0f65-4999-8600-357d588d9db5 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:44.524387 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-737051f6-0f65-4999-8600-357d588d9db5 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:44.537755 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-737051f6-0f65-4999-8600-357d588d9db5 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:44.540702 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-737051f6-0f65-4999-8600-357d588d9db5 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:44.542420 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-737051f6-0f65-4999-8600-357d588d9db5 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:44.542883 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-737051f6-0f65-4999-8600-357d588d9db5 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:44.679264 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-95406a00-3406-4afa-8005-7bb8f6a951bb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:44.694273 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-95406a00-3406-4afa-8005-7bb8f6a951bb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1239 microversion: 2.1 time: 0.309357 Jun 20 12:18:44.698703 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2298/4494] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:44 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1239 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:44.982371 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ee0c9b86-dc39-4fb0-bb32-262230ab05e2 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:44.986079 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ee0c9b86-dc39-4fb0-bb32-262230ab05e2 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] [instance: 68b3feb5-3535-4655-a73f-03ce141df427] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:45.037303 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee0c9b86-dc39-4fb0-bb32-262230ab05e2 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:45.038364 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee0c9b86-dc39-4fb0-bb32-262230ab05e2 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:45.047804 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee0c9b86-dc39-4fb0-bb32-262230ab05e2 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:45.051827 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee0c9b86-dc39-4fb0-bb32-262230ab05e2 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:45.118532 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-737051f6-0f65-4999-8600-357d588d9db5 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:45.126910 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-737051f6-0f65-4999-8600-357d588d9db5 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1363 microversion: 2.1 time: 0.607783 Jun 20 12:18:45.137785 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2197/4495] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:44 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1363 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:45.477935 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ee0c9b86-dc39-4fb0-bb32-262230ab05e2 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd640fdee13ca47ae848264ccbc532925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca22edf491394f878e14c2b67fb92816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:45.488817 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ee0c9b86-dc39-4fb0-bb32-262230ab05e2 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] 10.222.0.27 "GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427" status: 200 len: 1576 microversion: 2.1 time: 0.524895 Jun 20 12:18:45.490816 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2299/4496] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:44 2022] GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427 => generated 1576 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:45.507299 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-16f817da-67ed-4644-861f-fcba3b2e1c80 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:45.508224 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-16f817da-67ed-4644-861f-fcba3b2e1c80 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] [instance: 68b3feb5-3535-4655-a73f-03ce141df427] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:45.516008 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-16f817da-67ed-4644-861f-fcba3b2e1c80 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:45.516856 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-16f817da-67ed-4644-861f-fcba3b2e1c80 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:45.518242 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-16f817da-67ed-4644-861f-fcba3b2e1c80 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:45.518995 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-16f817da-67ed-4644-861f-fcba3b2e1c80 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:45.718249 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-00b83cc8-7923-4b18-bdc8-990e32ba1d8b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:45.719541 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-00b83cc8-7923-4b18-bdc8-990e32ba1d8b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:45.734539 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-00b83cc8-7923-4b18-bdc8-990e32ba1d8b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:45.734539 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-00b83cc8-7923-4b18-bdc8-990e32ba1d8b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:45.743313 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-00b83cc8-7923-4b18-bdc8-990e32ba1d8b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:45.743870 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-00b83cc8-7923-4b18-bdc8-990e32ba1d8b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:45.751213 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-16f817da-67ed-4644-861f-fcba3b2e1c80 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] 10.222.0.27 "GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.247842 Jun 20 12:18:45.752893 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2198/4497] 10.222.0.27 () {58 vars in 1274 bytes} [Mon Jun 20 12:18:45 2022] GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427/os-interface => generated 285 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:18:45.849105 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-00b83cc8-7923-4b18-bdc8-990e32ba1d8b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:45.857274 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-00b83cc8-7923-4b18-bdc8-990e32ba1d8b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1291 microversion: 2.1 time: 0.145462 Jun 20 12:18:45.858516 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2300/4498] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:45 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1291 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:46.147427 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c8fb9760-ed7f-4e3f-8899-3f5c1dc4213f tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:46.148815 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c8fb9760-ed7f-4e3f-8899-3f5c1dc4213f tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:46.159188 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c8fb9760-ed7f-4e3f-8899-3f5c1dc4213f tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:46.166538 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c8fb9760-ed7f-4e3f-8899-3f5c1dc4213f tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:46.167752 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c8fb9760-ed7f-4e3f-8899-3f5c1dc4213f tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:46.168221 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c8fb9760-ed7f-4e3f-8899-3f5c1dc4213f tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:46.629839 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-60c4134e-d19f-4831-9354-0c10a23935c9 req-a9c06d1a-4a32-43ce-81cd-0df870978582 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "442a5a56-7a8d-4804-ab29-515e6d314b19", "name": "network-vif-plugged", "status": "completed", "tag": "f2aa724a-10fa-4182-ae95-b075493ddc8c"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:18:46.642265 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-60c4134e-d19f-4831-9354-0c10a23935c9 req-a9c06d1a-4a32-43ce-81cd-0df870978582 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:46.643561 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-60c4134e-d19f-4831-9354-0c10a23935c9 req-a9c06d1a-4a32-43ce-81cd-0df870978582 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:46.677054 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-60c4134e-d19f-4831-9354-0c10a23935c9 req-a9c06d1a-4a32-43ce-81cd-0df870978582 service nova] Creating event network-vif-plugged:f2aa724a-10fa-4182-ae95-b075493ddc8c for instance 442a5a56-7a8d-4804-ab29-515e6d314b19 on n-h2-master-1 Jun 20 12:18:46.696483 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-60c4134e-d19f-4831-9354-0c10a23935c9 req-a9c06d1a-4a32-43ce-81cd-0df870978582 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067665 Jun 20 12:18:46.697729 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2301/4499] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:18:46.816743 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c8fb9760-ed7f-4e3f-8899-3f5c1dc4213f tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:46.824559 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c8fb9760-ed7f-4e3f-8899-3f5c1dc4213f tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1363 microversion: 2.1 time: 0.683101 Jun 20 12:18:46.834463 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2199/4500] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:46 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1363 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:46.875525 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-22c4b874-cdd8-4606-a15c-ca3f372d61c2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:46.876264 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-22c4b874-cdd8-4606-a15c-ca3f372d61c2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:46.890213 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-22c4b874-cdd8-4606-a15c-ca3f372d61c2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:46.890674 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-22c4b874-cdd8-4606-a15c-ca3f372d61c2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:46.891452 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-22c4b874-cdd8-4606-a15c-ca3f372d61c2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:46.895036 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-22c4b874-cdd8-4606-a15c-ca3f372d61c2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:47.061787 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-22c4b874-cdd8-4606-a15c-ca3f372d61c2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:47.082524 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-22c4b874-cdd8-4606-a15c-ca3f372d61c2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1297 microversion: 2.1 time: 0.210189 Jun 20 12:18:47.085070 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2302/4501] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:46 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1297 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:47.399487 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-053ad376-917e-4c43-b3bc-22559969d0f5 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:47.401096 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-053ad376-917e-4c43-b3bc-22559969d0f5 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:47.410092 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-053ad376-917e-4c43-b3bc-22559969d0f5 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:47.412961 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-053ad376-917e-4c43-b3bc-22559969d0f5 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:47.414909 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-053ad376-917e-4c43-b3bc-22559969d0f5 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:47.417556 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-053ad376-917e-4c43-b3bc-22559969d0f5 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:47.437414 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:18:47.449154 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-053ad376-917e-4c43-b3bc-22559969d0f5 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3/ips" status: 200 len: 153 microversion: 2.20 time: 0.056288 Jun 20 12:18:47.450058 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2200/4502] 10.222.0.27 () {60 vars in 1288 bytes} [Mon Jun 20 12:18:47 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3/ips => generated 153 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:18:47.842944 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-48227428-f337-45f6-834d-543c00785674 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:47.843569 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-48227428-f337-45f6-834d-543c00785674 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:47.859571 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-48227428-f337-45f6-834d-543c00785674 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:47.861351 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-48227428-f337-45f6-834d-543c00785674 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:47.862288 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-48227428-f337-45f6-834d-543c00785674 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:47.862740 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-48227428-f337-45f6-834d-543c00785674 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:48.101593 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f2d0a9c6-bd47-4a3e-9b6e-0ac83ea7f82f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:48.102514 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f2d0a9c6-bd47-4a3e-9b6e-0ac83ea7f82f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:48.118843 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f2d0a9c6-bd47-4a3e-9b6e-0ac83ea7f82f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:48.119399 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f2d0a9c6-bd47-4a3e-9b6e-0ac83ea7f82f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:48.120336 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f2d0a9c6-bd47-4a3e-9b6e-0ac83ea7f82f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:48.120872 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f2d0a9c6-bd47-4a3e-9b6e-0ac83ea7f82f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:48.203397 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-48227428-f337-45f6-834d-543c00785674 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:48.219888 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-48227428-f337-45f6-834d-543c00785674 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1363 microversion: 2.1 time: 0.381151 Jun 20 12:18:48.221406 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2303/4503] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:47 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1363 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:48.696116 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f2d0a9c6-bd47-4a3e-9b6e-0ac83ea7f82f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:48.708160 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f2d0a9c6-bd47-4a3e-9b6e-0ac83ea7f82f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1297 microversion: 2.1 time: 0.608721 Jun 20 12:18:48.708875 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2201/4504] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:48 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1297 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:18:48.796501 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-25307e3b-ebd6-4f46-a36f-fc2a34f76d0f tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:48.797117 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-25307e3b-ebd6-4f46-a36f-fc2a34f76d0f tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:48.804290 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-25307e3b-ebd6-4f46-a36f-fc2a34f76d0f tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:48.805058 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-25307e3b-ebd6-4f46-a36f-fc2a34f76d0f tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:48.806133 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-25307e3b-ebd6-4f46-a36f-fc2a34f76d0f tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:48.806722 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-25307e3b-ebd6-4f46-a36f-fc2a34f76d0f tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:49.237778 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-524c9132-3d82-427c-b092-92383ad96964 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:49.238399 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-524c9132-3d82-427c-b092-92383ad96964 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:49.249688 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-524c9132-3d82-427c-b092-92383ad96964 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:49.250896 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-524c9132-3d82-427c-b092-92383ad96964 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:49.252184 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-524c9132-3d82-427c-b092-92383ad96964 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:49.252934 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-524c9132-3d82-427c-b092-92383ad96964 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:49.489469 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-25307e3b-ebd6-4f46-a36f-fc2a34f76d0f tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1832 microversion: 2.1 time: 0.697078 Jun 20 12:18:49.491078 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2304/4505] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:48 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1832 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:49.716303 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-524c9132-3d82-427c-b092-92383ad96964 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:49.738405 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-524c9132-3d82-427c-b092-92383ad96964 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1549 microversion: 2.1 time: 0.504375 Jun 20 12:18:49.747667 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2202/4506] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:49 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1549 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:18:49.779435 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ce600dee-4d8e-4c9e-bfa0-7fdc9b9fe642 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:49.783153 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ce600dee-4d8e-4c9e-bfa0-7fdc9b9fe642 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:49.811986 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce600dee-4d8e-4c9e-bfa0-7fdc9b9fe642 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:49.814967 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce600dee-4d8e-4c9e-bfa0-7fdc9b9fe642 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:49.818769 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce600dee-4d8e-4c9e-bfa0-7fdc9b9fe642 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:49.819234 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce600dee-4d8e-4c9e-bfa0-7fdc9b9fe642 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:49.962325 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2314d5af-0752-4cb0-8dbf-6974fd3be1b1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:49.962999 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2314d5af-0752-4cb0-8dbf-6974fd3be1b1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:49.972030 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2314d5af-0752-4cb0-8dbf-6974fd3be1b1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:49.972932 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2314d5af-0752-4cb0-8dbf-6974fd3be1b1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:49.973894 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2314d5af-0752-4cb0-8dbf-6974fd3be1b1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:49.974848 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2314d5af-0752-4cb0-8dbf-6974fd3be1b1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:50.366126 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2314d5af-0752-4cb0-8dbf-6974fd3be1b1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:50.384557 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2314d5af-0752-4cb0-8dbf-6974fd3be1b1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1681 microversion: 2.1 time: 0.879016 Jun 20 12:18:50.387166 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2305/4507] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:49 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1681 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:18:50.410452 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2d6a0288-d43e-4eab-8cfb-cec0d4b7dc67 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:50.411240 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2d6a0288-d43e-4eab-8cfb-cec0d4b7dc67 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:50.418080 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ce600dee-4d8e-4c9e-bfa0-7fdc9b9fe642 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:50.421283 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2d6a0288-d43e-4eab-8cfb-cec0d4b7dc67 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:50.428005 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2d6a0288-d43e-4eab-8cfb-cec0d4b7dc67 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:50.432145 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2d6a0288-d43e-4eab-8cfb-cec0d4b7dc67 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:50.432953 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2d6a0288-d43e-4eab-8cfb-cec0d4b7dc67 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:50.442915 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ce600dee-4d8e-4c9e-bfa0-7fdc9b9fe642 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1365 microversion: 2.1 time: 0.680847 Jun 20 12:18:50.444134 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2203/4508] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:49 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1365 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:50.449106 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-689a9c19-88e2-4e4c-ac43-4c8c2b265b91 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:50.449927 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-689a9c19-88e2-4e4c-ac43-4c8c2b265b91 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] [instance: 68b3feb5-3535-4655-a73f-03ce141df427] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:50.461530 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-689a9c19-88e2-4e4c-ac43-4c8c2b265b91 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:50.461983 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-689a9c19-88e2-4e4c-ac43-4c8c2b265b91 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:50.463283 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-689a9c19-88e2-4e4c-ac43-4c8c2b265b91 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:50.463283 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-689a9c19-88e2-4e4c-ac43-4c8c2b265b91 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:50.568630 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2d6a0288-d43e-4eab-8cfb-cec0d4b7dc67 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.179143 Jun 20 12:18:50.577149 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2306/4509] 10.222.0.27 () {58 vars in 1274 bytes} [Mon Jun 20 12:18:50 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19/os-interface => generated 285 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:18:50.578326 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-a0b1cf57-bf23-4d5c-b31c-21984cdb3d05 req-1283590d-0df3-4804-8075-03e25c8ee458 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68b3feb5-3535-4655-a73f-03ce141df427", "tag": "c53b45db-bda4-476c-a0e5-8aae6d2e5991"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:18:50.599208 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-a0b1cf57-bf23-4d5c-b31c-21984cdb3d05 req-1283590d-0df3-4804-8075-03e25c8ee458 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:50.601387 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-a0b1cf57-bf23-4d5c-b31c-21984cdb3d05 req-1283590d-0df3-4804-8075-03e25c8ee458 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:50.621152 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-a0b1cf57-bf23-4d5c-b31c-21984cdb3d05 req-1283590d-0df3-4804-8075-03e25c8ee458 service nova] Creating event network-changed:c53b45db-bda4-476c-a0e5-8aae6d2e5991 for instance 68b3feb5-3535-4655-a73f-03ce141df427 on n-h2-master-1 Jun 20 12:18:50.626822 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-a0b1cf57-bf23-4d5c-b31c-21984cdb3d05 req-1283590d-0df3-4804-8075-03e25c8ee458 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052221 Jun 20 12:18:50.627865 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2307/4510] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:18:50.633742 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-972ae409-b606-4d59-baae-4c211e9938fc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:18:50.635122 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-972ae409-b606-4d59-baae-4c211e9938fc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:50.643807 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-972ae409-b606-4d59-baae-4c211e9938fc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:50.644537 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-972ae409-b606-4d59-baae-4c211e9938fc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:50.645891 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-972ae409-b606-4d59-baae-4c211e9938fc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:50.646601 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-972ae409-b606-4d59-baae-4c211e9938fc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:50.672667 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-972ae409-b606-4d59-baae-4c211e9938fc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lazy-loading 'flavor' on Instance uuid 6ed20ca4-7f49-4d0a-a590-d2d4274698e3 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:18:50.750260 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:18:51.034943 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-689a9c19-88e2-4e4c-ac43-4c8c2b265b91 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd640fdee13ca47ae848264ccbc532925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca22edf491394f878e14c2b67fb92816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:51.046718 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-689a9c19-88e2-4e4c-ac43-4c8c2b265b91 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] 10.222.0.27 "GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427" status: 200 len: 1576 microversion: 2.1 time: 0.601057 Jun 20 12:18:51.048101 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2204/4511] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:50 2022] GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427 => generated 1576 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:51.055676 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f8afa533-210c-4e44-809e-c55e5a58c96d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:18:51.056964 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f8afa533-210c-4e44-809e-c55e5a58c96d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:51.064021 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8afa533-210c-4e44-809e-c55e5a58c96d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:51.065498 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8afa533-210c-4e44-809e-c55e5a58c96d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:51.066476 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8afa533-210c-4e44-809e-c55e5a58c96d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:51.071995 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8afa533-210c-4e44-809e-c55e5a58c96d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:51.077825 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-972ae409-b606-4d59-baae-4c211e9938fc tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "POST /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3/action" status: 202 len: 0 microversion: 2.20 time: 0.448222 Jun 20 12:18:51.078843 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2308/4512] 10.222.0.27 () {62 vars in 1318 bytes} [Mon Jun 20 12:18:50 2022] POST /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3/action => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:18:51.087780 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-60fe534b-0cea-4b35-98ab-0fb24454d11f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:51.094809 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-60fe534b-0cea-4b35-98ab-0fb24454d11f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:51.118751 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-60fe534b-0cea-4b35-98ab-0fb24454d11f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:51.119561 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-60fe534b-0cea-4b35-98ab-0fb24454d11f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:51.120625 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-60fe534b-0cea-4b35-98ab-0fb24454d11f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:51.121292 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-60fe534b-0cea-4b35-98ab-0fb24454d11f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:51.153371 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f8afa533-210c-4e44-809e-c55e5a58c96d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "POST /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473/action" status: 200 len: 32642 microversion: 2.1 time: 0.102972 Jun 20 12:18:51.165231 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2205/4513] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:18:51 2022] POST /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473/action => generated 32642 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:18:51.505905 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-760a2427-6033-4f64-901f-e482ab737dcc tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:18:51.507761 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-760a2427-6033-4f64-901f-e482ab737dcc tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:51.518508 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-760a2427-6033-4f64-901f-e482ab737dcc tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:51.519444 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-760a2427-6033-4f64-901f-e482ab737dcc tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:51.521096 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-760a2427-6033-4f64-901f-e482ab737dcc tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:51.521743 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-760a2427-6033-4f64-901f-e482ab737dcc tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:51.656086 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-60fe534b-0cea-4b35-98ab-0fb24454d11f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:51.674530 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-60fe534b-0cea-4b35-98ab-0fb24454d11f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:51.676565 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-60fe534b-0cea-4b35-98ab-0fb24454d11f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:51.678008 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-60fe534b-0cea-4b35-98ab-0fb24454d11f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1724 microversion: 2.20 time: 0.594559 Jun 20 12:18:51.689644 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2309/4514] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:18:51 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1724 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:18:51.695090 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9057c43f-81cd-4356-b9a8-ab1be612d2f9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:51.696003 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9057c43f-81cd-4356-b9a8-ab1be612d2f9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:51.703592 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9057c43f-81cd-4356-b9a8-ab1be612d2f9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:51.704055 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9057c43f-81cd-4356-b9a8-ab1be612d2f9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:51.705106 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9057c43f-81cd-4356-b9a8-ab1be612d2f9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:51.705833 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9057c43f-81cd-4356-b9a8-ab1be612d2f9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:52.018801 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-760a2427-6033-4f64-901f-e482ab737dcc tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '00aa0441206b44f4804596a9a318ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74d89ecbb8d40f5b131e71d2701dded', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:52.019523 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-760a2427-6033-4f64-901f-e482ab737dcc tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] flavor_id is None. Assuming migration. {{(pid=119128) resize /opt/stack/nova/nova/compute/api.py:4142}} Jun 20 12:18:52.020476 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-760a2427-6033-4f64-901f-e482ab737dcc tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119128) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 20 12:18:52.214163 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-760a2427-6033-4f64-901f-e482ab737dcc tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473/action" status: 202 len: 0 microversion: 2.1 time: 0.913769 Jun 20 12:18:52.217104 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2206/4515] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:18:51 2022] POST /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473/action => generated 0 bytes in 918 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 12:18:52.232540 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-eafe74cd-224c-40a7-b7fd-c26da4db9dbc tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:52.234240 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-eafe74cd-224c-40a7-b7fd-c26da4db9dbc tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:52.262287 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eafe74cd-224c-40a7-b7fd-c26da4db9dbc tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:52.263367 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eafe74cd-224c-40a7-b7fd-c26da4db9dbc tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:52.265785 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eafe74cd-224c-40a7-b7fd-c26da4db9dbc tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:52.267665 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eafe74cd-224c-40a7-b7fd-c26da4db9dbc tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:52.475221 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9057c43f-81cd-4356-b9a8-ab1be612d2f9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:52.492807 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9057c43f-81cd-4356-b9a8-ab1be612d2f9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1365 microversion: 2.1 time: 0.801570 Jun 20 12:18:52.494035 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2310/4516] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:51 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1365 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:52.696730 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-eafe74cd-224c-40a7-b7fd-c26da4db9dbc tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:52.699129 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1df9faeb-5daf-4f83-be58-e5b41cee13a1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:52.699752 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1df9faeb-5daf-4f83-be58-e5b41cee13a1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:52.708509 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-eafe74cd-224c-40a7-b7fd-c26da4db9dbc tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1690 microversion: 2.1 time: 0.486741 Jun 20 12:18:52.709805 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2207/4517] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:52 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1690 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:52.713220 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1df9faeb-5daf-4f83-be58-e5b41cee13a1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:52.713967 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1df9faeb-5daf-4f83-be58-e5b41cee13a1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:52.715868 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1df9faeb-5daf-4f83-be58-e5b41cee13a1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:52.716757 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1df9faeb-5daf-4f83-be58-e5b41cee13a1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:53.046140 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-06681908-b9d3-4d62-bad8-8656096a99f7 req-3f068e7c-adbd-4c5d-8145-db1f2320cd3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21609be7-c3f0-4e24-a093-2f74ce957a35", "tag": "23a9a38f-112e-4e3f-97f4-ae81b6b5af7c"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:18:53.074790 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-06681908-b9d3-4d62-bad8-8656096a99f7 req-3f068e7c-adbd-4c5d-8145-db1f2320cd3d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:53.075303 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-06681908-b9d3-4d62-bad8-8656096a99f7 req-3f068e7c-adbd-4c5d-8145-db1f2320cd3d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:53.096180 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-06681908-b9d3-4d62-bad8-8656096a99f7 req-3f068e7c-adbd-4c5d-8145-db1f2320cd3d service nova] Creating event network-changed:23a9a38f-112e-4e3f-97f4-ae81b6b5af7c for instance 21609be7-c3f0-4e24-a093-2f74ce957a35 on n-h1-master-1 Jun 20 12:18:53.107816 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-06681908-b9d3-4d62-bad8-8656096a99f7 req-3f068e7c-adbd-4c5d-8145-db1f2320cd3d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065599 Jun 20 12:18:53.108816 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2208/4518] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:18:53.172131 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1df9faeb-5daf-4f83-be58-e5b41cee13a1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:53.186147 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1df9faeb-5daf-4f83-be58-e5b41cee13a1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:53.187614 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1df9faeb-5daf-4f83-be58-e5b41cee13a1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:53.198761 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1df9faeb-5daf-4f83-be58-e5b41cee13a1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1724 microversion: 2.20 time: 0.504140 Jun 20 12:18:53.201964 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2311/4519] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:18:52 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1724 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:18:53.513312 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7a4efc79-f57b-4605-add6-3309ef337feb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:53.514813 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7a4efc79-f57b-4605-add6-3309ef337feb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:53.526601 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7a4efc79-f57b-4605-add6-3309ef337feb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:53.529241 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7a4efc79-f57b-4605-add6-3309ef337feb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:53.530343 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7a4efc79-f57b-4605-add6-3309ef337feb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:53.530952 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7a4efc79-f57b-4605-add6-3309ef337feb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:53.732060 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1377351b-e7e5-405f-8ae2-6d9b8b7afd40 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:53.732971 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1377351b-e7e5-405f-8ae2-6d9b8b7afd40 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:53.763674 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1377351b-e7e5-405f-8ae2-6d9b8b7afd40 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:53.764183 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1377351b-e7e5-405f-8ae2-6d9b8b7afd40 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:53.765035 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1377351b-e7e5-405f-8ae2-6d9b8b7afd40 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:53.765523 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1377351b-e7e5-405f-8ae2-6d9b8b7afd40 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:53.826895 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7a4efc79-f57b-4605-add6-3309ef337feb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:53.842687 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7a4efc79-f57b-4605-add6-3309ef337feb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1365 microversion: 2.1 time: 0.334708 Jun 20 12:18:53.853808 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2209/4520] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:53 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1365 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:54.224019 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9f1482fc-e7a8-4d22-a95e-cb3085ce94db tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:54.224827 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9f1482fc-e7a8-4d22-a95e-cb3085ce94db tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:54.235529 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:18:54.244926 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9f1482fc-e7a8-4d22-a95e-cb3085ce94db tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:54.245570 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9f1482fc-e7a8-4d22-a95e-cb3085ce94db tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:54.246443 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9f1482fc-e7a8-4d22-a95e-cb3085ce94db tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:54.246879 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9f1482fc-e7a8-4d22-a95e-cb3085ce94db tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:54.253417 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=10 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:18:54.371110 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1377351b-e7e5-405f-8ae2-6d9b8b7afd40 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:54.384357 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1377351b-e7e5-405f-8ae2-6d9b8b7afd40 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1690 microversion: 2.1 time: 0.661089 Jun 20 12:18:54.387980 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2312/4521] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:53 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1690 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:54.410041 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-c412ed41-43bb-464d-98e7-32fc3aaa314d req-73cac57b-3aba-495f-8b87-c47e444ae2a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "442a5a56-7a8d-4804-ab29-515e6d314b19", "tag": "f2aa724a-10fa-4182-ae95-b075493ddc8c"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:18:54.429802 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-c412ed41-43bb-464d-98e7-32fc3aaa314d req-73cac57b-3aba-495f-8b87-c47e444ae2a2 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:54.430430 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-c412ed41-43bb-464d-98e7-32fc3aaa314d req-73cac57b-3aba-495f-8b87-c47e444ae2a2 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:54.444176 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-c412ed41-43bb-464d-98e7-32fc3aaa314d req-73cac57b-3aba-495f-8b87-c47e444ae2a2 service nova] Creating event network-changed:f2aa724a-10fa-4182-ae95-b075493ddc8c for instance 442a5a56-7a8d-4804-ab29-515e6d314b19 on n-h2-master-1 Jun 20 12:18:54.459363 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-c412ed41-43bb-464d-98e7-32fc3aaa314d req-73cac57b-3aba-495f-8b87-c47e444ae2a2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054614 Jun 20 12:18:54.460642 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2313/4522] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:18:54.665833 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9f1482fc-e7a8-4d22-a95e-cb3085ce94db tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:54.684116 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9f1482fc-e7a8-4d22-a95e-cb3085ce94db tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:54.687758 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9f1482fc-e7a8-4d22-a95e-cb3085ce94db tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:54.690512 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9f1482fc-e7a8-4d22-a95e-cb3085ce94db tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1724 microversion: 2.20 time: 0.470866 Jun 20 12:18:54.691666 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2210/4523] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:18:54 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1724 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:18:54.861195 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:18:54.869198 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-793d5d23-5cec-4e98-a9b1-b286623ad1db tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:54.871608 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-793d5d23-5cec-4e98-a9b1-b286623ad1db tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:54.882715 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-793d5d23-5cec-4e98-a9b1-b286623ad1db tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:54.883765 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-793d5d23-5cec-4e98-a9b1-b286623ad1db tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:54.884775 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-793d5d23-5cec-4e98-a9b1-b286623ad1db tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:54.885392 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-793d5d23-5cec-4e98-a9b1-b286623ad1db tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:55.406354 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-57d2387e-74d5-4228-a5c4-579534b4845d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:55.407366 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-57d2387e-74d5-4228-a5c4-579534b4845d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:55.415277 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-57d2387e-74d5-4228-a5c4-579534b4845d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:55.424613 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-57d2387e-74d5-4228-a5c4-579534b4845d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:55.428543 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-57d2387e-74d5-4228-a5c4-579534b4845d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:55.429330 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-57d2387e-74d5-4228-a5c4-579534b4845d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:55.963322 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-57d2387e-74d5-4228-a5c4-579534b4845d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:55.973142 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-57d2387e-74d5-4228-a5c4-579534b4845d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1690 microversion: 2.1 time: 0.570928 Jun 20 12:18:55.974129 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2211/4524] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:55 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1690 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:18:55.979781 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1a749802-ed36-4796-8005-f862db785a66 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:55.980432 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1a749802-ed36-4796-8005-f862db785a66 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:55.988177 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-793d5d23-5cec-4e98-a9b1-b286623ad1db tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:55.990991 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a749802-ed36-4796-8005-f862db785a66 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:55.991667 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a749802-ed36-4796-8005-f862db785a66 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:55.993048 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a749802-ed36-4796-8005-f862db785a66 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:55.994198 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a749802-ed36-4796-8005-f862db785a66 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:55.997682 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-793d5d23-5cec-4e98-a9b1-b286623ad1db tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1365 microversion: 2.1 time: 1.138423 Jun 20 12:18:56.003619 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2314/4525] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:54 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1365 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:56.991679 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6ac34501-f48f-4533-963f-06cb29d3e3da tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:56.995074 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6ac34501-f48f-4533-963f-06cb29d3e3da tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:57.019396 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6ac34501-f48f-4533-963f-06cb29d3e3da tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:57.020032 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6ac34501-f48f-4533-963f-06cb29d3e3da tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:57.021006 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6ac34501-f48f-4533-963f-06cb29d3e3da tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:57.021605 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6ac34501-f48f-4533-963f-06cb29d3e3da tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:57.118889 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1a749802-ed36-4796-8005-f862db785a66 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:57.134075 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1a749802-ed36-4796-8005-f862db785a66 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:57.136499 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1a749802-ed36-4796-8005-f862db785a66 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:57.138801 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1a749802-ed36-4796-8005-f862db785a66 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1724 microversion: 2.20 time: 1.163684 Jun 20 12:18:57.142309 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2212/4526] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:18:55 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1724 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:18:57.158184 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b9ffb5a6-7812-4dfc-b769-6c175ed90beb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:57.159179 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b9ffb5a6-7812-4dfc-b769-6c175ed90beb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:57.167556 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b9ffb5a6-7812-4dfc-b769-6c175ed90beb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:57.168263 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b9ffb5a6-7812-4dfc-b769-6c175ed90beb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:57.169317 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b9ffb5a6-7812-4dfc-b769-6c175ed90beb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:57.170008 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b9ffb5a6-7812-4dfc-b769-6c175ed90beb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:57.329905 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6ac34501-f48f-4533-963f-06cb29d3e3da tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:57.342671 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6ac34501-f48f-4533-963f-06cb29d3e3da tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1690 microversion: 2.1 time: 0.352370 Jun 20 12:18:57.344549 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2315/4527] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:56 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1690 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:57.463549 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b9ffb5a6-7812-4dfc-b769-6c175ed90beb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:57.479174 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b9ffb5a6-7812-4dfc-b769-6c175ed90beb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1365 microversion: 2.1 time: 0.324308 Jun 20 12:18:57.479789 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2213/4528] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:57 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1365 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:58.171774 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-92e7091a-bae5-4a97-ab6c-ea9476a65b60 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:58.173416 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-92e7091a-bae5-4a97-ab6c-ea9476a65b60 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:58.177577 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7eacb7bf-07ba-48ec-8eaa-951140c31108 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-106801417", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": "none"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:18:58.188170 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-92e7091a-bae5-4a97-ab6c-ea9476a65b60 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:58.188862 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-92e7091a-bae5-4a97-ab6c-ea9476a65b60 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:58.190898 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-92e7091a-bae5-4a97-ab6c-ea9476a65b60 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:58.192135 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-92e7091a-bae5-4a97-ab6c-ea9476a65b60 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:58.301484 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-7eacb7bf-07ba-48ec-8eaa-951140c31108 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:18:58.301906 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-7eacb7bf-07ba-48ec-8eaa-951140c31108 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:18:58.302376 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-7eacb7bf-07ba-48ec-8eaa-951140c31108 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:18:58.302780 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-7eacb7bf-07ba-48ec-8eaa-951140c31108 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:18:58.303197 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-7eacb7bf-07ba-48ec-8eaa-951140c31108 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:18:58.327629 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7eacb7bf-07ba-48ec-8eaa-951140c31108 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:58.328084 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7eacb7bf-07ba-48ec-8eaa-951140c31108 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:58.328947 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7eacb7bf-07ba-48ec-8eaa-951140c31108 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:58.329591 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7eacb7bf-07ba-48ec-8eaa-951140c31108 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:58.374139 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-7eacb7bf-07ba-48ec-8eaa-951140c31108 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Getting quotas for project 3b3e310ab28947569b8dd690bec6d53c. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:18:58.382263 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-7eacb7bf-07ba-48ec-8eaa-951140c31108 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Getting quotas for user 0adb999abcdf41dab8406791ed696f94 and project 3b3e310ab28947569b8dd690bec6d53c. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:18:58.403931 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7eacb7bf-07ba-48ec-8eaa-951140c31108 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:18:58.409387 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7eacb7bf-07ba-48ec-8eaa-951140c31108 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] [instance: 9f436d6d-3f0b-4a5c-af39-05dfebf8da88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:18:58.498056 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7eacb7bf-07ba-48ec-8eaa-951140c31108 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.571201 Jun 20 12:18:58.499197 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2316/4529] 10.222.0.27 () {62 vars in 1187 bytes} [Mon Jun 20 12:18:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 20 12:18:58.506257 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9a9df685-4ffc-4c60-9c47-4633b03da5ab tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:58.506894 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9a9df685-4ffc-4c60-9c47-4633b03da5ab tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:58.525279 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a9df685-4ffc-4c60-9c47-4633b03da5ab tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:58.525954 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a9df685-4ffc-4c60-9c47-4633b03da5ab tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:58.527919 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a9df685-4ffc-4c60-9c47-4633b03da5ab tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:58.529693 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a9df685-4ffc-4c60-9c47-4633b03da5ab tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:58.826502 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-92e7091a-bae5-4a97-ab6c-ea9476a65b60 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:58.836328 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-92e7091a-bae5-4a97-ab6c-ea9476a65b60 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:58.838150 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-92e7091a-bae5-4a97-ab6c-ea9476a65b60 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:58.839597 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-92e7091a-bae5-4a97-ab6c-ea9476a65b60 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1724 microversion: 2.20 time: 0.683790 Jun 20 12:18:58.851365 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2214/4530] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:18:58 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1724 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:18:58.858040 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-43a7f91d-f71d-47c6-818d-e81d6018efa9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:58.858931 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-43a7f91d-f71d-47c6-818d-e81d6018efa9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:58.865974 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-43a7f91d-f71d-47c6-818d-e81d6018efa9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:58.866712 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-43a7f91d-f71d-47c6-818d-e81d6018efa9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:58.867690 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-43a7f91d-f71d-47c6-818d-e81d6018efa9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:58.868330 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-43a7f91d-f71d-47c6-818d-e81d6018efa9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:58.932344 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9a9df685-4ffc-4c60-9c47-4633b03da5ab tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:58.942454 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9a9df685-4ffc-4c60-9c47-4633b03da5ab tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1690 microversion: 2.1 time: 0.441940 Jun 20 12:18:58.955611 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2317/4531] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:58 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1690 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:58.961163 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-78b55465-c193-4e22-888c-08be0da6268b tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:58.961925 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-78b55465-c193-4e22-888c-08be0da6268b tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] [instance: 9f436d6d-3f0b-4a5c-af39-05dfebf8da88] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:59.115782 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-78b55465-c193-4e22-888c-08be0da6268b tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:59.129984 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-78b55465-c193-4e22-888c-08be0da6268b tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:59.134661 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-78b55465-c193-4e22-888c-08be0da6268b tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:59.139617 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-78b55465-c193-4e22-888c-08be0da6268b tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] 10.222.0.27 "GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88" status: 200 len: 1277 microversion: 2.54 time: 0.182440 Jun 20 12:18:59.142973 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2318/4532] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:18:58 2022] GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88 => generated 1277 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:18:59.242773 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-43a7f91d-f71d-47c6-818d-e81d6018efa9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:18:59.256671 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-43a7f91d-f71d-47c6-818d-e81d6018efa9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1365 microversion: 2.1 time: 0.403645 Jun 20 12:18:59.258402 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2215/4533] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:58 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1365 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:18:59.528531 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-56ddb0f0-d889-4558-a058-2feedf8c19e5 req-278c5446-c046-4967-860e-b328e424efbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21609be7-c3f0-4e24-a093-2f74ce957a35", "name": "network-vif-plugged", "status": "completed", "tag": "23a9a38f-112e-4e3f-97f4-ae81b6b5af7c"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:18:59.542763 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-56ddb0f0-d889-4558-a058-2feedf8c19e5 req-278c5446-c046-4967-860e-b328e424efbb service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:59.543342 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-56ddb0f0-d889-4558-a058-2feedf8c19e5 req-278c5446-c046-4967-860e-b328e424efbb service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:59.558662 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-56ddb0f0-d889-4558-a058-2feedf8c19e5 req-278c5446-c046-4967-860e-b328e424efbb service nova] Creating event network-vif-plugged:23a9a38f-112e-4e3f-97f4-ae81b6b5af7c for instance 21609be7-c3f0-4e24-a093-2f74ce957a35 on n-h1-master-1 Jun 20 12:18:59.566146 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-56ddb0f0-d889-4558-a058-2feedf8c19e5 req-278c5446-c046-4967-860e-b328e424efbb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042770 Jun 20 12:18:59.567375 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2319/4534] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:18:59.861182 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e366c59c-6337-4ab1-a578-e5499a66e56f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:59.862524 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e366c59c-6337-4ab1-a578-e5499a66e56f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:59.870375 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e366c59c-6337-4ab1-a578-e5499a66e56f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:59.871509 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e366c59c-6337-4ab1-a578-e5499a66e56f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:59.872595 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e366c59c-6337-4ab1-a578-e5499a66e56f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:59.873231 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e366c59c-6337-4ab1-a578-e5499a66e56f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:59.965572 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5fb4ebdc-6b88-499b-b14c-50b5d7b3cd51 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:18:59.967370 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5fb4ebdc-6b88-499b-b14c-50b5d7b3cd51 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:18:59.974930 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5fb4ebdc-6b88-499b-b14c-50b5d7b3cd51 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:59.976010 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5fb4ebdc-6b88-499b-b14c-50b5d7b3cd51 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:18:59.977572 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5fb4ebdc-6b88-499b-b14c-50b5d7b3cd51 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:18:59.978234 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5fb4ebdc-6b88-499b-b14c-50b5d7b3cd51 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:00.246814 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5fb4ebdc-6b88-499b-b14c-50b5d7b3cd51 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:00.258306 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5fb4ebdc-6b88-499b-b14c-50b5d7b3cd51 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1695 microversion: 2.1 time: 0.299175 Jun 20 12:19:00.259573 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2320/4535] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:18:59 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1695 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:19:00.265225 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-653d9866-1028-4682-9012-7668e24f7e50 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:00.266083 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-653d9866-1028-4682-9012-7668e24f7e50 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] [instance: 9f436d6d-3f0b-4a5c-af39-05dfebf8da88] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:00.275240 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-653d9866-1028-4682-9012-7668e24f7e50 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:00.275699 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-653d9866-1028-4682-9012-7668e24f7e50 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:00.276514 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-653d9866-1028-4682-9012-7668e24f7e50 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:00.276953 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-653d9866-1028-4682-9012-7668e24f7e50 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:00.360312 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-653d9866-1028-4682-9012-7668e24f7e50 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:00.370478 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-653d9866-1028-4682-9012-7668e24f7e50 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:00.372003 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-653d9866-1028-4682-9012-7668e24f7e50 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:00.373241 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-653d9866-1028-4682-9012-7668e24f7e50 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] 10.222.0.27 "GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88" status: 200 len: 1335 microversion: 2.54 time: 0.112328 Jun 20 12:19:00.373816 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2321/4536] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:00 2022] GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88 => generated 1335 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:00.379217 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-16c2cc4d-bffd-4394-ade7-ac5b851562bf tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:00.379908 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-16c2cc4d-bffd-4394-ade7-ac5b851562bf tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:00.386574 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-16c2cc4d-bffd-4394-ade7-ac5b851562bf tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:00.387096 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-16c2cc4d-bffd-4394-ade7-ac5b851562bf tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:00.387805 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-16c2cc4d-bffd-4394-ade7-ac5b851562bf tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:00.388337 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-16c2cc4d-bffd-4394-ade7-ac5b851562bf tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:00.537482 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-16c2cc4d-bffd-4394-ade7-ac5b851562bf tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:00.546657 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-16c2cc4d-bffd-4394-ade7-ac5b851562bf tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1365 microversion: 2.1 time: 0.171618 Jun 20 12:19:00.547247 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2322/4537] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:19:00 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:19:00.582013 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e366c59c-6337-4ab1-a578-e5499a66e56f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:00.584316 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:00.592105 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e366c59c-6337-4ab1-a578-e5499a66e56f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:00.593575 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e366c59c-6337-4ab1-a578-e5499a66e56f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:00.594879 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e366c59c-6337-4ab1-a578-e5499a66e56f tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1724 microversion: 2.20 time: 0.739459 Jun 20 12:19:00.600408 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2216/4538] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:18:59 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1724 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:19:01.280819 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8fb66c60-7318-4cf4-ab6b-b53aacb18259 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:01.282000 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8fb66c60-7318-4cf4-ab6b-b53aacb18259 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:01.291002 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8fb66c60-7318-4cf4-ab6b-b53aacb18259 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:01.291548 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8fb66c60-7318-4cf4-ab6b-b53aacb18259 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:01.292354 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8fb66c60-7318-4cf4-ab6b-b53aacb18259 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:01.292796 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8fb66c60-7318-4cf4-ab6b-b53aacb18259 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:01.395700 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fd9b0649-6bd6-48a9-aef1-49185f59a77c tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:01.400078 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fd9b0649-6bd6-48a9-aef1-49185f59a77c tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] [instance: 9f436d6d-3f0b-4a5c-af39-05dfebf8da88] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:01.410750 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fd9b0649-6bd6-48a9-aef1-49185f59a77c tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:01.411281 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fd9b0649-6bd6-48a9-aef1-49185f59a77c tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:01.412123 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fd9b0649-6bd6-48a9-aef1-49185f59a77c tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:01.412605 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fd9b0649-6bd6-48a9-aef1-49185f59a77c tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:01.471174 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8fb66c60-7318-4cf4-ab6b-b53aacb18259 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:01.479368 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8fb66c60-7318-4cf4-ab6b-b53aacb18259 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1695 microversion: 2.1 time: 0.206082 Jun 20 12:19:01.481861 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2323/4539] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:19:01 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1695 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:19:01.523936 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fd9b0649-6bd6-48a9-aef1-49185f59a77c tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:01.536391 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fd9b0649-6bd6-48a9-aef1-49185f59a77c tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:01.538195 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fd9b0649-6bd6-48a9-aef1-49185f59a77c tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:01.539577 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fd9b0649-6bd6-48a9-aef1-49185f59a77c tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] 10.222.0.27 "GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88" status: 200 len: 1335 microversion: 2.54 time: 0.150029 Jun 20 12:19:01.540888 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2217/4540] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:01 2022] GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88 => generated 1335 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:01.567139 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ee0f12c7-d726-4078-86c5-15c7cc187e70 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:01.567794 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ee0f12c7-d726-4078-86c5-15c7cc187e70 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:01.576286 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee0f12c7-d726-4078-86c5-15c7cc187e70 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:01.576745 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee0f12c7-d726-4078-86c5-15c7cc187e70 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:01.577547 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee0f12c7-d726-4078-86c5-15c7cc187e70 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:01.577985 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee0f12c7-d726-4078-86c5-15c7cc187e70 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:01.617928 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7b7a5e08-bbbb-4be4-9ebd-7f7dd069e2b8 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:01.619066 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7b7a5e08-bbbb-4be4-9ebd-7f7dd069e2b8 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:01.628617 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7b7a5e08-bbbb-4be4-9ebd-7f7dd069e2b8 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:01.629077 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7b7a5e08-bbbb-4be4-9ebd-7f7dd069e2b8 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:01.630374 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7b7a5e08-bbbb-4be4-9ebd-7f7dd069e2b8 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:01.631024 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7b7a5e08-bbbb-4be4-9ebd-7f7dd069e2b8 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:01.806978 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ee0f12c7-d726-4078-86c5-15c7cc187e70 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:01.817866 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ee0f12c7-d726-4078-86c5-15c7cc187e70 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1365 microversion: 2.1 time: 0.255340 Jun 20 12:19:01.827767 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2324/4541] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:19:01 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1365 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:19:01.920189 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7b7a5e08-bbbb-4be4-9ebd-7f7dd069e2b8 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:01.929681 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7b7a5e08-bbbb-4be4-9ebd-7f7dd069e2b8 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:01.931271 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7b7a5e08-bbbb-4be4-9ebd-7f7dd069e2b8 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:01.932493 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7b7a5e08-bbbb-4be4-9ebd-7f7dd069e2b8 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1745 microversion: 2.20 time: 0.322776 Jun 20 12:19:01.941223 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2218/4542] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:01 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1745 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:02.498203 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dd3ed34f-9181-4139-82e4-7c45394c868b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:02.498899 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dd3ed34f-9181-4139-82e4-7c45394c868b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:02.509232 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd3ed34f-9181-4139-82e4-7c45394c868b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:02.509954 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd3ed34f-9181-4139-82e4-7c45394c868b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:02.511112 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd3ed34f-9181-4139-82e4-7c45394c868b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:02.511715 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd3ed34f-9181-4139-82e4-7c45394c868b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:02.561384 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-17555141-0cfc-498c-8bf1-7dfaf5c8eaa6 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:02.562414 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-17555141-0cfc-498c-8bf1-7dfaf5c8eaa6 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] [instance: 9f436d6d-3f0b-4a5c-af39-05dfebf8da88] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:02.570976 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-17555141-0cfc-498c-8bf1-7dfaf5c8eaa6 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:02.571794 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-17555141-0cfc-498c-8bf1-7dfaf5c8eaa6 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:02.572892 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-17555141-0cfc-498c-8bf1-7dfaf5c8eaa6 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:02.573564 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-17555141-0cfc-498c-8bf1-7dfaf5c8eaa6 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:02.681936 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-17555141-0cfc-498c-8bf1-7dfaf5c8eaa6 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:02.692951 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-17555141-0cfc-498c-8bf1-7dfaf5c8eaa6 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:02.695182 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-17555141-0cfc-498c-8bf1-7dfaf5c8eaa6 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:02.696885 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-17555141-0cfc-498c-8bf1-7dfaf5c8eaa6 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] 10.222.0.27 "GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88" status: 200 len: 1335 microversion: 2.54 time: 0.139784 Jun 20 12:19:02.697613 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2219/4543] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:02 2022] GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88 => generated 1335 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:19:02.837267 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c4d668d6-27c6-41ef-928d-c5a59a06767a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:02.838012 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c4d668d6-27c6-41ef-928d-c5a59a06767a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:02.851854 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4d668d6-27c6-41ef-928d-c5a59a06767a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:02.854814 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4d668d6-27c6-41ef-928d-c5a59a06767a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:02.855813 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4d668d6-27c6-41ef-928d-c5a59a06767a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:02.857584 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4d668d6-27c6-41ef-928d-c5a59a06767a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:02.986766 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dd3ed34f-9181-4139-82e4-7c45394c868b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:02.998067 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dd3ed34f-9181-4139-82e4-7c45394c868b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1695 microversion: 2.1 time: 0.503978 Jun 20 12:19:03.015150 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2325/4544] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:19:02 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1695 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:19:03.029560 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7fd040e0-9f44-4dab-904d-d08c680a65db tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:03.030185 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7fd040e0-9f44-4dab-904d-d08c680a65db tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:03.039807 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7fd040e0-9f44-4dab-904d-d08c680a65db tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:03.040707 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7fd040e0-9f44-4dab-904d-d08c680a65db tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:03.042349 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7fd040e0-9f44-4dab-904d-d08c680a65db tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:03.042965 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7fd040e0-9f44-4dab-904d-d08c680a65db tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:03.149477 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c4d668d6-27c6-41ef-928d-c5a59a06767a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:03.158090 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c4d668d6-27c6-41ef-928d-c5a59a06767a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1552 microversion: 2.1 time: 0.326397 Jun 20 12:19:03.177050 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2220/4545] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:19:02 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1552 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:19:03.191698 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-29126ec5-ac4a-4831-bb1f-a2fae5c2c9d3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:03.192445 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-29126ec5-ac4a-4831-bb1f-a2fae5c2c9d3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:03.200399 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-29126ec5-ac4a-4831-bb1f-a2fae5c2c9d3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:03.206836 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-29126ec5-ac4a-4831-bb1f-a2fae5c2c9d3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:03.208352 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-29126ec5-ac4a-4831-bb1f-a2fae5c2c9d3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:03.208956 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-29126ec5-ac4a-4831-bb1f-a2fae5c2c9d3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:03.265510 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7fd040e0-9f44-4dab-904d-d08c680a65db tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:03.277372 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7fd040e0-9f44-4dab-904d-d08c680a65db tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:03.280569 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7fd040e0-9f44-4dab-904d-d08c680a65db tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:03.281818 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7fd040e0-9f44-4dab-904d-d08c680a65db tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1745 microversion: 2.20 time: 0.258856 Jun 20 12:19:03.282543 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2326/4546] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:03 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1745 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:03.414732 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-29126ec5-ac4a-4831-bb1f-a2fae5c2c9d3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.236153 Jun 20 12:19:03.421827 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2221/4547] 10.222.0.27 () {58 vars in 1274 bytes} [Mon Jun 20 12:19:03 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/os-interface => generated 284 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:19:03.716590 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a14cb972-e1b4-48ee-a2c8-0c1af83e2401 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:03.717531 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a14cb972-e1b4-48ee-a2c8-0c1af83e2401 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] [instance: 9f436d6d-3f0b-4a5c-af39-05dfebf8da88] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:03.735245 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a14cb972-e1b4-48ee-a2c8-0c1af83e2401 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:03.736301 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a14cb972-e1b4-48ee-a2c8-0c1af83e2401 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:03.738540 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a14cb972-e1b4-48ee-a2c8-0c1af83e2401 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:03.740939 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a14cb972-e1b4-48ee-a2c8-0c1af83e2401 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:03.806508 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:03.911372 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a14cb972-e1b4-48ee-a2c8-0c1af83e2401 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:03.928341 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a14cb972-e1b4-48ee-a2c8-0c1af83e2401 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:03.930950 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a14cb972-e1b4-48ee-a2c8-0c1af83e2401 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:03.933162 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a14cb972-e1b4-48ee-a2c8-0c1af83e2401 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] 10.222.0.27 "GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88" status: 200 len: 1356 microversion: 2.54 time: 0.220717 Jun 20 12:19:03.934884 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2327/4548] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:03 2022] GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88 => generated 1356 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:03.955608 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fba43491-4b64-462e-83bd-b5c2be7de1cb tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Action: 'create', calling method: .version_select at 0x7f60725531f0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1585141552", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwjjt6v+wwgV3RwFh5HMbXo10SLliZKkgXhVmMhxOaDTItVCy3z4AephyYjDr6aYsFdB6+1YcYIUokNqSxbtotJQVMuCHFPlzL7zTf6v4SKX6uHuXnm7eaaDa46URyjVA=="}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:19:03.980594 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-fba43491-4b64-462e-83bd-b5c2be7de1cb tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Getting quotas for project 3b3e310ab28947569b8dd690bec6d53c. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:19:03.986151 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-fba43491-4b64-462e-83bd-b5c2be7de1cb tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Getting quotas for user 0adb999abcdf41dab8406791ed696f94 and project 3b3e310ab28947569b8dd690bec6d53c. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:19:04.018927 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6979a61c-bd5c-40b5-ae5b-058716bfa27c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:04.020178 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6979a61c-bd5c-40b5-ae5b-058716bfa27c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:04.024370 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fba43491-4b64-462e-83bd-b5c2be7de1cb tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.070323 Jun 20 12:19:04.025115 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2222/4549] 10.222.0.27 () {62 vars in 1199 bytes} [Mon Jun 20 12:19:03 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 74 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 20 12:19:04.033262 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6979a61c-bd5c-40b5-ae5b-058716bfa27c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:04.033919 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6979a61c-bd5c-40b5-ae5b-058716bfa27c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:04.034867 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6979a61c-bd5c-40b5-ae5b-058716bfa27c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:04.035465 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6979a61c-bd5c-40b5-ae5b-058716bfa27c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:04.036291 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8fe5383a-67b3-4191-a78d-8f52ac52a038 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1585141552", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:19:04.038262 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8fe5383a-67b3-4191-a78d-8f52ac52a038 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] [instance: 9f436d6d-3f0b-4a5c-af39-05dfebf8da88] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:04.046105 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8fe5383a-67b3-4191-a78d-8f52ac52a038 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:04.046487 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8fe5383a-67b3-4191-a78d-8f52ac52a038 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:04.047420 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8fe5383a-67b3-4191-a78d-8f52ac52a038 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:04.047975 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8fe5383a-67b3-4191-a78d-8f52ac52a038 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:04.139723 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-8fe5383a-67b3-4191-a78d-8f52ac52a038 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:19:04.140152 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-8fe5383a-67b3-4191-a78d-8f52ac52a038 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:19:04.140872 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-8fe5383a-67b3-4191-a78d-8f52ac52a038 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:19:04.141282 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-8fe5383a-67b3-4191-a78d-8f52ac52a038 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:19:04.141733 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-8fe5383a-67b3-4191-a78d-8f52ac52a038 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:19:04.231236 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8fe5383a-67b3-4191-a78d-8f52ac52a038 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] [instance: 9f436d6d-3f0b-4a5c-af39-05dfebf8da88] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:04.233394 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:04.242791 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8fe5383a-67b3-4191-a78d-8f52ac52a038 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:04.243710 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8fe5383a-67b3-4191-a78d-8f52ac52a038 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:04.244703 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8fe5383a-67b3-4191-a78d-8f52ac52a038 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:04.245920 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8fe5383a-67b3-4191-a78d-8f52ac52a038 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:04.283716 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8fe5383a-67b3-4191-a78d-8f52ac52a038 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] 10.222.0.27 "POST /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88/action" status: 202 len: 1139 microversion: 2.54 time: 0.251003 Jun 20 12:19:04.285122 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2223/4550] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Jun 20 12:19:04 2022] POST /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88/action => generated 1139 bytes in 254 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jun 20 12:19:04.300965 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1daf4f0d-f6cd-4f67-bb57-e8e4b4c3e7a2 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:04.301697 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1daf4f0d-f6cd-4f67-bb57-e8e4b4c3e7a2 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] [instance: 9f436d6d-3f0b-4a5c-af39-05dfebf8da88] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:04.309135 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1daf4f0d-f6cd-4f67-bb57-e8e4b4c3e7a2 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:04.309702 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1daf4f0d-f6cd-4f67-bb57-e8e4b4c3e7a2 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:04.310755 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1daf4f0d-f6cd-4f67-bb57-e8e4b4c3e7a2 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:04.312383 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1daf4f0d-f6cd-4f67-bb57-e8e4b4c3e7a2 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:04.415851 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1daf4f0d-f6cd-4f67-bb57-e8e4b4c3e7a2 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:04.427428 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1daf4f0d-f6cd-4f67-bb57-e8e4b4c3e7a2 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:04.429740 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1daf4f0d-f6cd-4f67-bb57-e8e4b4c3e7a2 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:04.431047 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1daf4f0d-f6cd-4f67-bb57-e8e4b4c3e7a2 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] 10.222.0.27 "GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88" status: 200 len: 1408 microversion: 2.54 time: 0.134833 Jun 20 12:19:04.442787 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2224/4551] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:04 2022] GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88 => generated 1408 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:04.448847 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-77c97266-3114-4c8a-98a5-882a2f8e579b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:04.449748 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-77c97266-3114-4c8a-98a5-882a2f8e579b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:04.457042 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-77c97266-3114-4c8a-98a5-882a2f8e579b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:04.458066 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-77c97266-3114-4c8a-98a5-882a2f8e579b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:04.461389 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-77c97266-3114-4c8a-98a5-882a2f8e579b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:04.461851 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-77c97266-3114-4c8a-98a5-882a2f8e579b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:04.520706 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6979a61c-bd5c-40b5-ae5b-058716bfa27c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:04.535497 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6979a61c-bd5c-40b5-ae5b-058716bfa27c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1695 microversion: 2.1 time: 0.521773 Jun 20 12:19:04.539458 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2328/4552] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:19:04 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1695 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:19:04.825342 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-77c97266-3114-4c8a-98a5-882a2f8e579b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:04.839654 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-77c97266-3114-4c8a-98a5-882a2f8e579b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:04.842902 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-77c97266-3114-4c8a-98a5-882a2f8e579b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:04.844781 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-77c97266-3114-4c8a-98a5-882a2f8e579b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1745 microversion: 2.20 time: 0.400395 Jun 20 12:19:04.850809 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2225/4553] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:04 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1745 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:05.305872 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-50ea3374-3dc2-465f-8fac-db54a31e48ec req-00db40ff-d6a0-4dd7-9baa-3cfe00086c9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ed20ca4-7f49-4d0a-a590-d2d4274698e3", "name": "network-vif-plugged", "status": "completed", "tag": "4bb9ec16-a224-4e67-8de4-0415485dde23"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:19:05.323540 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-50ea3374-3dc2-465f-8fac-db54a31e48ec req-00db40ff-d6a0-4dd7-9baa-3cfe00086c9a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:05.324003 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-50ea3374-3dc2-465f-8fac-db54a31e48ec req-00db40ff-d6a0-4dd7-9baa-3cfe00086c9a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:05.350602 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-50ea3374-3dc2-465f-8fac-db54a31e48ec req-00db40ff-d6a0-4dd7-9baa-3cfe00086c9a service nova] Creating event network-vif-plugged:4bb9ec16-a224-4e67-8de4-0415485dde23 for instance 6ed20ca4-7f49-4d0a-a590-d2d4274698e3 on n-h1-master-1 Jun 20 12:19:05.359750 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-50ea3374-3dc2-465f-8fac-db54a31e48ec req-00db40ff-d6a0-4dd7-9baa-3cfe00086c9a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065613 Jun 20 12:19:05.363255 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2329/4554] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:19:05.450221 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d8743779-215e-423b-9dcd-4adfbc07c9ae tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:05.451006 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d8743779-215e-423b-9dcd-4adfbc07c9ae tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] [instance: 9f436d6d-3f0b-4a5c-af39-05dfebf8da88] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:05.470021 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d8743779-215e-423b-9dcd-4adfbc07c9ae tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:05.471000 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d8743779-215e-423b-9dcd-4adfbc07c9ae tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:05.471900 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d8743779-215e-423b-9dcd-4adfbc07c9ae tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:05.472414 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d8743779-215e-423b-9dcd-4adfbc07c9ae tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:05.557565 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-32e68821-7882-486f-9185-5ed5d3f970d0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:05.558541 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-32e68821-7882-486f-9185-5ed5d3f970d0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:05.578684 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-32e68821-7882-486f-9185-5ed5d3f970d0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:05.580138 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-32e68821-7882-486f-9185-5ed5d3f970d0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:05.583804 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-32e68821-7882-486f-9185-5ed5d3f970d0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:05.584607 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-32e68821-7882-486f-9185-5ed5d3f970d0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:05.768101 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d8743779-215e-423b-9dcd-4adfbc07c9ae tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:05.779436 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d8743779-215e-423b-9dcd-4adfbc07c9ae tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:05.781112 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d8743779-215e-423b-9dcd-4adfbc07c9ae tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:05.782798 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d8743779-215e-423b-9dcd-4adfbc07c9ae tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] 10.222.0.27 "GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88" status: 200 len: 1408 microversion: 2.54 time: 0.336946 Jun 20 12:19:05.796445 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2226/4555] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:05 2022] GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88 => generated 1408 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:05.868593 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b228cb81-d896-4be1-a898-07bae16683bf tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:05.869514 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b228cb81-d896-4be1-a898-07bae16683bf tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:05.881789 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b228cb81-d896-4be1-a898-07bae16683bf tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:05.883644 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b228cb81-d896-4be1-a898-07bae16683bf tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:05.884945 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b228cb81-d896-4be1-a898-07bae16683bf tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:05.889326 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b228cb81-d896-4be1-a898-07bae16683bf tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:06.159848 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b228cb81-d896-4be1-a898-07bae16683bf tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:06.169000 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b228cb81-d896-4be1-a898-07bae16683bf tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:06.176723 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b228cb81-d896-4be1-a898-07bae16683bf tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:06.180348 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b228cb81-d896-4be1-a898-07bae16683bf tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1740 microversion: 2.20 time: 0.313663 Jun 20 12:19:06.192038 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2227/4556] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:05 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1740 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:19:06.248779 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-32e68821-7882-486f-9185-5ed5d3f970d0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:06.261583 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-32e68821-7882-486f-9185-5ed5d3f970d0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1695 microversion: 2.1 time: 0.709899 Jun 20 12:19:06.273822 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2330/4557] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:19:05 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1695 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:19:06.451268 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-f177a305-4bc0-4f73-9632-a334dc2c50fd req-4376628a-5f07-4c69-a840-82f60cdd7cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21609be7-c3f0-4e24-a093-2f74ce957a35", "tag": "23a9a38f-112e-4e3f-97f4-ae81b6b5af7c"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:19:06.463052 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-f177a305-4bc0-4f73-9632-a334dc2c50fd req-4376628a-5f07-4c69-a840-82f60cdd7cd5 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:06.463448 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-f177a305-4bc0-4f73-9632-a334dc2c50fd req-4376628a-5f07-4c69-a840-82f60cdd7cd5 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:06.494565 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-f177a305-4bc0-4f73-9632-a334dc2c50fd req-4376628a-5f07-4c69-a840-82f60cdd7cd5 service nova] Creating event network-changed:23a9a38f-112e-4e3f-97f4-ae81b6b5af7c for instance 21609be7-c3f0-4e24-a093-2f74ce957a35 on n-h1-master-1 Jun 20 12:19:06.510448 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-f177a305-4bc0-4f73-9632-a334dc2c50fd req-4376628a-5f07-4c69-a840-82f60cdd7cd5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062833 Jun 20 12:19:06.511342 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2228/4558] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:19:06.809468 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-24374c9b-83d5-41b5-8e44-ab8700338e0c tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:06.810527 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-24374c9b-83d5-41b5-8e44-ab8700338e0c tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] [instance: 9f436d6d-3f0b-4a5c-af39-05dfebf8da88] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:06.832487 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-24374c9b-83d5-41b5-8e44-ab8700338e0c tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:06.833426 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-24374c9b-83d5-41b5-8e44-ab8700338e0c tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:06.834842 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-24374c9b-83d5-41b5-8e44-ab8700338e0c tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:06.835293 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-24374c9b-83d5-41b5-8e44-ab8700338e0c tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:06.974022 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-24374c9b-83d5-41b5-8e44-ab8700338e0c tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:06.992657 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-24374c9b-83d5-41b5-8e44-ab8700338e0c tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:06.995291 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-24374c9b-83d5-41b5-8e44-ab8700338e0c tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:06.998139 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-24374c9b-83d5-41b5-8e44-ab8700338e0c tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] 10.222.0.27 "GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88" status: 200 len: 1408 microversion: 2.54 time: 0.192671 Jun 20 12:19:07.020401 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2331/4559] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:06 2022] GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88 => generated 1408 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:07.199967 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-02c788cb-4e01-4e37-9cf5-5dc3e041a6e7 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:07.200994 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-02c788cb-4e01-4e37-9cf5-5dc3e041a6e7 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:07.209963 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-02c788cb-4e01-4e37-9cf5-5dc3e041a6e7 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:07.217993 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-02c788cb-4e01-4e37-9cf5-5dc3e041a6e7 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:07.219801 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-02c788cb-4e01-4e37-9cf5-5dc3e041a6e7 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:07.222345 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-02c788cb-4e01-4e37-9cf5-5dc3e041a6e7 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:07.281453 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-225a8351-d8ee-42d6-a83e-c8533db61d3f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:07.282835 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-225a8351-d8ee-42d6-a83e-c8533db61d3f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:07.296480 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-225a8351-d8ee-42d6-a83e-c8533db61d3f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:07.297087 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-225a8351-d8ee-42d6-a83e-c8533db61d3f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:07.298419 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-225a8351-d8ee-42d6-a83e-c8533db61d3f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:07.299080 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-225a8351-d8ee-42d6-a83e-c8533db61d3f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:07.672079 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-225a8351-d8ee-42d6-a83e-c8533db61d3f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:07.696013 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-225a8351-d8ee-42d6-a83e-c8533db61d3f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1695 microversion: 2.1 time: 0.418396 Jun 20 12:19:07.697197 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2332/4560] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:19:07 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1695 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:19:08.028111 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3f80ad43-d192-4078-8a47-f07e9917efc8 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:08.028856 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3f80ad43-d192-4078-8a47-f07e9917efc8 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] [instance: 9f436d6d-3f0b-4a5c-af39-05dfebf8da88] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:08.042430 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3f80ad43-d192-4078-8a47-f07e9917efc8 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:08.045873 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3f80ad43-d192-4078-8a47-f07e9917efc8 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:08.056696 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3f80ad43-d192-4078-8a47-f07e9917efc8 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:08.057406 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3f80ad43-d192-4078-8a47-f07e9917efc8 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:08.158504 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-02c788cb-4e01-4e37-9cf5-5dc3e041a6e7 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:08.167655 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-02c788cb-4e01-4e37-9cf5-5dc3e041a6e7 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:08.172324 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-02c788cb-4e01-4e37-9cf5-5dc3e041a6e7 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:08.175078 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-02c788cb-4e01-4e37-9cf5-5dc3e041a6e7 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1740 microversion: 2.20 time: 0.979605 Jun 20 12:19:08.179852 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2229/4561] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:07 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1740 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:08.184374 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3f80ad43-d192-4078-8a47-f07e9917efc8 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:08.199908 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3f80ad43-d192-4078-8a47-f07e9917efc8 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:08.202055 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3f80ad43-d192-4078-8a47-f07e9917efc8 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:08.203326 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3f80ad43-d192-4078-8a47-f07e9917efc8 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] 10.222.0.27 "GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88" status: 200 len: 1408 microversion: 2.54 time: 0.180285 Jun 20 12:19:08.203979 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2333/4562] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:08 2022] GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88 => generated 1408 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:08.716501 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8fb178a0-ab95-4fb6-9c5e-a8f4f8ec5558 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:08.718055 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8fb178a0-ab95-4fb6-9c5e-a8f4f8ec5558 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:08.732686 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8fb178a0-ab95-4fb6-9c5e-a8f4f8ec5558 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:08.734771 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8fb178a0-ab95-4fb6-9c5e-a8f4f8ec5558 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:08.739935 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8fb178a0-ab95-4fb6-9c5e-a8f4f8ec5558 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:08.747446 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8fb178a0-ab95-4fb6-9c5e-a8f4f8ec5558 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:08.995070 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8fb178a0-ab95-4fb6-9c5e-a8f4f8ec5558 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:09.013192 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8fb178a0-ab95-4fb6-9c5e-a8f4f8ec5558 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1695 microversion: 2.1 time: 0.302018 Jun 20 12:19:09.014507 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2230/4563] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:19:08 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1695 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:19:09.203734 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2b21a7b2-4e15-4804-99af-e0dd06a964b2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:09.205263 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2b21a7b2-4e15-4804-99af-e0dd06a964b2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:09.211641 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:09.217946 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=8 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:09.224369 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a2926eaf-9469-4928-a012-b41d9e0f1529 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:09.225937 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a2926eaf-9469-4928-a012-b41d9e0f1529 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] [instance: 9f436d6d-3f0b-4a5c-af39-05dfebf8da88] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:09.228153 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2b21a7b2-4e15-4804-99af-e0dd06a964b2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:09.230223 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2b21a7b2-4e15-4804-99af-e0dd06a964b2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:09.231537 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2b21a7b2-4e15-4804-99af-e0dd06a964b2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:09.232019 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2b21a7b2-4e15-4804-99af-e0dd06a964b2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:09.233865 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a2926eaf-9469-4928-a012-b41d9e0f1529 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:09.234573 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a2926eaf-9469-4928-a012-b41d9e0f1529 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:09.235771 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a2926eaf-9469-4928-a012-b41d9e0f1529 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:09.236767 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a2926eaf-9469-4928-a012-b41d9e0f1529 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:09.403876 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a2926eaf-9469-4928-a012-b41d9e0f1529 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:09.429814 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a2926eaf-9469-4928-a012-b41d9e0f1529 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:09.432697 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a2926eaf-9469-4928-a012-b41d9e0f1529 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:09.437272 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a2926eaf-9469-4928-a012-b41d9e0f1529 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] 10.222.0.27 "GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88" status: 200 len: 1408 microversion: 2.54 time: 0.216427 Jun 20 12:19:09.451940 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2231/4564] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:09 2022] GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88 => generated 1408 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:09.540773 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2b21a7b2-4e15-4804-99af-e0dd06a964b2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:09.552679 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2b21a7b2-4e15-4804-99af-e0dd06a964b2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:09.554190 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2b21a7b2-4e15-4804-99af-e0dd06a964b2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:09.555405 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2b21a7b2-4e15-4804-99af-e0dd06a964b2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1740 microversion: 2.20 time: 0.361104 Jun 20 12:19:09.555987 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2334/4565] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:09 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1740 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:10.049718 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2736f4a3-8446-452e-8944-54f72a21687a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:10.049718 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2736f4a3-8446-452e-8944-54f72a21687a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:10.063318 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2736f4a3-8446-452e-8944-54f72a21687a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:10.064113 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2736f4a3-8446-452e-8944-54f72a21687a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:10.064975 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2736f4a3-8446-452e-8944-54f72a21687a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:10.067989 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2736f4a3-8446-452e-8944-54f72a21687a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:10.408871 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2736f4a3-8446-452e-8944-54f72a21687a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:10.420291 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2736f4a3-8446-452e-8944-54f72a21687a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1695 microversion: 2.1 time: 0.393021 Jun 20 12:19:10.430081 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2232/4566] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:19:10 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1695 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:19:10.459934 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-828c59e6-4484-4e83-8d99-7387d5244ba8 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:10.460742 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-828c59e6-4484-4e83-8d99-7387d5244ba8 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] [instance: 9f436d6d-3f0b-4a5c-af39-05dfebf8da88] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:10.471398 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-828c59e6-4484-4e83-8d99-7387d5244ba8 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:10.472307 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-828c59e6-4484-4e83-8d99-7387d5244ba8 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:10.473488 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-828c59e6-4484-4e83-8d99-7387d5244ba8 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:10.474140 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-828c59e6-4484-4e83-8d99-7387d5244ba8 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:10.566369 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-828c59e6-4484-4e83-8d99-7387d5244ba8 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:10.579098 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8ffd91a8-3792-4252-ae84-962ba160ca11 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:10.579715 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8ffd91a8-3792-4252-ae84-962ba160ca11 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:10.583114 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-828c59e6-4484-4e83-8d99-7387d5244ba8 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:10.585666 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-828c59e6-4484-4e83-8d99-7387d5244ba8 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:10.587213 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-828c59e6-4484-4e83-8d99-7387d5244ba8 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] 10.222.0.27 "GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88" status: 200 len: 1408 microversion: 2.54 time: 0.131806 Jun 20 12:19:10.591816 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ffd91a8-3792-4252-ae84-962ba160ca11 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:10.592503 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ffd91a8-3792-4252-ae84-962ba160ca11 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:10.593466 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ffd91a8-3792-4252-ae84-962ba160ca11 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:10.594051 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ffd91a8-3792-4252-ae84-962ba160ca11 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:10.599098 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:10.599999 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2335/4567] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:10 2022] GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88 => generated 1408 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:10.989685 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8ffd91a8-3792-4252-ae84-962ba160ca11 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:11.020896 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8ffd91a8-3792-4252-ae84-962ba160ca11 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:11.024004 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8ffd91a8-3792-4252-ae84-962ba160ca11 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:11.025465 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8ffd91a8-3792-4252-ae84-962ba160ca11 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1740 microversion: 2.20 time: 0.450384 Jun 20 12:19:11.038407 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2233/4568] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:10 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1740 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:19:11.454692 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-31cf30e4-2401-4cad-8bfa-a6ffb03eac93 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:11.459254 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-31cf30e4-2401-4cad-8bfa-a6ffb03eac93 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:11.478905 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-31cf30e4-2401-4cad-8bfa-a6ffb03eac93 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:11.480928 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-31cf30e4-2401-4cad-8bfa-a6ffb03eac93 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:11.481741 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-31cf30e4-2401-4cad-8bfa-a6ffb03eac93 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:11.484341 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-31cf30e4-2401-4cad-8bfa-a6ffb03eac93 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:11.608664 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-33e23549-c59c-42d6-991d-1df7f9e9d979 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:11.609289 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-33e23549-c59c-42d6-991d-1df7f9e9d979 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] [instance: 9f436d6d-3f0b-4a5c-af39-05dfebf8da88] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:11.621575 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-33e23549-c59c-42d6-991d-1df7f9e9d979 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:11.622124 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-33e23549-c59c-42d6-991d-1df7f9e9d979 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:11.622684 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-33e23549-c59c-42d6-991d-1df7f9e9d979 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:11.623241 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-33e23549-c59c-42d6-991d-1df7f9e9d979 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:11.763544 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-33e23549-c59c-42d6-991d-1df7f9e9d979 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:11.779868 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-33e23549-c59c-42d6-991d-1df7f9e9d979 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:11.782492 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-33e23549-c59c-42d6-991d-1df7f9e9d979 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:11.784794 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-33e23549-c59c-42d6-991d-1df7f9e9d979 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] 10.222.0.27 "GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88" status: 200 len: 1408 microversion: 2.54 time: 0.180911 Jun 20 12:19:11.786140 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2234/4569] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:11 2022] GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88 => generated 1408 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:12.061689 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f45b5d4a-4873-4333-bf5e-4a220e6eb114 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:12.065426 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f45b5d4a-4873-4333-bf5e-4a220e6eb114 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:12.082364 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f45b5d4a-4873-4333-bf5e-4a220e6eb114 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:12.082911 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f45b5d4a-4873-4333-bf5e-4a220e6eb114 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:12.083742 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f45b5d4a-4873-4333-bf5e-4a220e6eb114 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:12.084191 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f45b5d4a-4873-4333-bf5e-4a220e6eb114 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:12.296113 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f45b5d4a-4873-4333-bf5e-4a220e6eb114 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:12.297969 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-31cf30e4-2401-4cad-8bfa-a6ffb03eac93 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:12.306809 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f45b5d4a-4873-4333-bf5e-4a220e6eb114 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:12.308332 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f45b5d4a-4873-4333-bf5e-4a220e6eb114 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:12.308640 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-31cf30e4-2401-4cad-8bfa-a6ffb03eac93 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1695 microversion: 2.1 time: 0.860158 Jun 20 12:19:12.309921 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f45b5d4a-4873-4333-bf5e-4a220e6eb114 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1740 microversion: 2.20 time: 0.256323 Jun 20 12:19:12.321875 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2235/4570] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:12 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1740 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:12.322130 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2336/4571] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:19:11 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1695 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:19:12.810891 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a0bb6edd-538d-4e95-be50-d92d7e494585 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:12.820732 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a0bb6edd-538d-4e95-be50-d92d7e494585 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] [instance: 9f436d6d-3f0b-4a5c-af39-05dfebf8da88] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:12.839614 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a0bb6edd-538d-4e95-be50-d92d7e494585 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:12.840061 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a0bb6edd-538d-4e95-be50-d92d7e494585 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:12.840894 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a0bb6edd-538d-4e95-be50-d92d7e494585 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:12.841333 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a0bb6edd-538d-4e95-be50-d92d7e494585 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:12.924532 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a0bb6edd-538d-4e95-be50-d92d7e494585 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:12.934891 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a0bb6edd-538d-4e95-be50-d92d7e494585 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:12.936907 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a0bb6edd-538d-4e95-be50-d92d7e494585 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:12.938689 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a0bb6edd-538d-4e95-be50-d92d7e494585 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] 10.222.0.27 "GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88" status: 200 len: 1408 microversion: 2.54 time: 0.137450 Jun 20 12:19:12.939788 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2236/4572] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:12 2022] GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88 => generated 1408 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:13.333863 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5904fe3f-770a-49a5-9f7e-d10070e26b6d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:13.334589 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-02c5dad0-9e58-40fc-8985-5d8cb5ae2830 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:13.335708 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5904fe3f-770a-49a5-9f7e-d10070e26b6d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:13.336052 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-02c5dad0-9e58-40fc-8985-5d8cb5ae2830 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:13.348924 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5904fe3f-770a-49a5-9f7e-d10070e26b6d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:13.349862 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5904fe3f-770a-49a5-9f7e-d10070e26b6d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:13.350915 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5904fe3f-770a-49a5-9f7e-d10070e26b6d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:13.351569 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5904fe3f-770a-49a5-9f7e-d10070e26b6d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:13.353673 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02c5dad0-9e58-40fc-8985-5d8cb5ae2830 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:13.354450 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02c5dad0-9e58-40fc-8985-5d8cb5ae2830 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:13.356747 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02c5dad0-9e58-40fc-8985-5d8cb5ae2830 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:13.357204 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02c5dad0-9e58-40fc-8985-5d8cb5ae2830 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:13.672490 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-02c5dad0-9e58-40fc-8985-5d8cb5ae2830 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:13.691128 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-02c5dad0-9e58-40fc-8985-5d8cb5ae2830 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1695 microversion: 2.1 time: 0.368409 Jun 20 12:19:13.703385 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2337/4573] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:19:13 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1695 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:19:13.721722 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5904fe3f-770a-49a5-9f7e-d10070e26b6d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:13.738439 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5904fe3f-770a-49a5-9f7e-d10070e26b6d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:13.747393 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5904fe3f-770a-49a5-9f7e-d10070e26b6d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:13.749071 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5904fe3f-770a-49a5-9f7e-d10070e26b6d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1740 microversion: 2.20 time: 0.423647 Jun 20 12:19:13.749909 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2237/4574] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:13 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1740 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:13.978407 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f03b35aa-1df7-4e36-9cf1-d473fe98ed98 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:13.979963 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f03b35aa-1df7-4e36-9cf1-d473fe98ed98 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] [instance: 9f436d6d-3f0b-4a5c-af39-05dfebf8da88] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:13.996504 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f03b35aa-1df7-4e36-9cf1-d473fe98ed98 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:14.004313 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f03b35aa-1df7-4e36-9cf1-d473fe98ed98 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:14.005700 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f03b35aa-1df7-4e36-9cf1-d473fe98ed98 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:14.006385 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f03b35aa-1df7-4e36-9cf1-d473fe98ed98 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:14.131321 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f03b35aa-1df7-4e36-9cf1-d473fe98ed98 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:14.157174 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f03b35aa-1df7-4e36-9cf1-d473fe98ed98 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:14.163057 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f03b35aa-1df7-4e36-9cf1-d473fe98ed98 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:14.165579 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f03b35aa-1df7-4e36-9cf1-d473fe98ed98 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] 10.222.0.27 "GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88" status: 200 len: 1408 microversion: 2.54 time: 0.205385 Jun 20 12:19:14.167857 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2338/4575] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:13 2022] GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88 => generated 1408 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:14.710795 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0f69f8ac-9e82-43db-8eb8-5eb621a555dd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:14.712241 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0f69f8ac-9e82-43db-8eb8-5eb621a555dd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:14.725089 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=4 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:14.730352 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f69f8ac-9e82-43db-8eb8-5eb621a555dd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:14.730890 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f69f8ac-9e82-43db-8eb8-5eb621a555dd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:14.731661 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f69f8ac-9e82-43db-8eb8-5eb621a555dd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:14.732108 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f69f8ac-9e82-43db-8eb8-5eb621a555dd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:14.771763 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3d09329d-e967-45fe-afbc-879f09b409a0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:14.773172 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3d09329d-e967-45fe-afbc-879f09b409a0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:14.783762 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:14.786976 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3d09329d-e967-45fe-afbc-879f09b409a0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:14.787572 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3d09329d-e967-45fe-afbc-879f09b409a0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:14.788487 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3d09329d-e967-45fe-afbc-879f09b409a0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:14.789156 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3d09329d-e967-45fe-afbc-879f09b409a0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:14.935354 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0f69f8ac-9e82-43db-8eb8-5eb621a555dd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:14.949799 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0f69f8ac-9e82-43db-8eb8-5eb621a555dd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1695 microversion: 2.1 time: 0.243699 Jun 20 12:19:14.961915 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2238/4576] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:19:14 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1695 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:19:15.180810 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3d09329d-e967-45fe-afbc-879f09b409a0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:15.188392 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6149b152-9e46-45f2-96e4-465d6f13c35d tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:15.188897 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6149b152-9e46-45f2-96e4-465d6f13c35d tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] [instance: 9f436d6d-3f0b-4a5c-af39-05dfebf8da88] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:15.199341 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3d09329d-e967-45fe-afbc-879f09b409a0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:15.199617 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6149b152-9e46-45f2-96e4-465d6f13c35d tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:15.199917 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6149b152-9e46-45f2-96e4-465d6f13c35d tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:15.200735 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6149b152-9e46-45f2-96e4-465d6f13c35d tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:15.201191 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6149b152-9e46-45f2-96e4-465d6f13c35d tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:15.213965 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3d09329d-e967-45fe-afbc-879f09b409a0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:15.217052 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3d09329d-e967-45fe-afbc-879f09b409a0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1740 microversion: 2.20 time: 0.448471 Jun 20 12:19:15.217052 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2339/4577] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:14 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1740 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:15.375008 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6149b152-9e46-45f2-96e4-465d6f13c35d tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:15.384613 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6149b152-9e46-45f2-96e4-465d6f13c35d tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:15.388553 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6149b152-9e46-45f2-96e4-465d6f13c35d tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:15.394295 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6149b152-9e46-45f2-96e4-465d6f13c35d tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] 10.222.0.27 "GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88" status: 200 len: 1408 microversion: 2.54 time: 0.211985 Jun 20 12:19:15.405990 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2239/4578] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:15 2022] GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88 => generated 1408 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:19:15.968456 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-298712c0-0671-4c54-bb79-27a1bf507b2c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:15.969071 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-298712c0-0671-4c54-bb79-27a1bf507b2c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:15.977167 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-298712c0-0671-4c54-bb79-27a1bf507b2c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:15.977664 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-298712c0-0671-4c54-bb79-27a1bf507b2c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:15.978408 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-298712c0-0671-4c54-bb79-27a1bf507b2c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:15.978852 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-298712c0-0671-4c54-bb79-27a1bf507b2c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:16.236754 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1e3ced6a-f588-495a-bf58-819f1476ac26 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:16.238010 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1e3ced6a-f588-495a-bf58-819f1476ac26 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:16.248292 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e3ced6a-f588-495a-bf58-819f1476ac26 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:16.248754 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e3ced6a-f588-495a-bf58-819f1476ac26 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:16.249548 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e3ced6a-f588-495a-bf58-819f1476ac26 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:16.249968 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e3ced6a-f588-495a-bf58-819f1476ac26 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:16.344101 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-298712c0-0671-4c54-bb79-27a1bf507b2c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:16.370831 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-298712c0-0671-4c54-bb79-27a1bf507b2c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1695 microversion: 2.1 time: 0.401673 Jun 20 12:19:16.371836 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2340/4579] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:19:15 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1695 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:19:16.430608 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2904587e-06cd-45f1-b35c-c541fa83bc81 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:16.436023 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2904587e-06cd-45f1-b35c-c541fa83bc81 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] [instance: 9f436d6d-3f0b-4a5c-af39-05dfebf8da88] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:16.451041 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2904587e-06cd-45f1-b35c-c541fa83bc81 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:16.456080 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2904587e-06cd-45f1-b35c-c541fa83bc81 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:16.457947 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2904587e-06cd-45f1-b35c-c541fa83bc81 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:16.460777 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2904587e-06cd-45f1-b35c-c541fa83bc81 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:16.632326 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2904587e-06cd-45f1-b35c-c541fa83bc81 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:16.642802 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2904587e-06cd-45f1-b35c-c541fa83bc81 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:16.644813 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2904587e-06cd-45f1-b35c-c541fa83bc81 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:16.646214 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2904587e-06cd-45f1-b35c-c541fa83bc81 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] 10.222.0.27 "GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88" status: 200 len: 1408 microversion: 2.54 time: 0.236302 Jun 20 12:19:16.648566 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2341/4580] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:16 2022] GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88 => generated 1408 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:17.023258 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1e3ced6a-f588-495a-bf58-819f1476ac26 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:17.036657 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1e3ced6a-f588-495a-bf58-819f1476ac26 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:17.040539 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1e3ced6a-f588-495a-bf58-819f1476ac26 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:17.045194 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1e3ced6a-f588-495a-bf58-819f1476ac26 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1740 microversion: 2.20 time: 0.813406 Jun 20 12:19:17.046289 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2240/4581] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:16 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1740 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:17.390243 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f56ea58f-91a0-4213-8ac5-de2af200765a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:17.391836 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f56ea58f-91a0-4213-8ac5-de2af200765a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:17.418158 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f56ea58f-91a0-4213-8ac5-de2af200765a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:17.419009 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f56ea58f-91a0-4213-8ac5-de2af200765a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:17.420026 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f56ea58f-91a0-4213-8ac5-de2af200765a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:17.420665 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f56ea58f-91a0-4213-8ac5-de2af200765a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:17.666698 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-960159d3-cc5b-43f9-b4c5-8c9c9a31e90b tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:17.667398 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-960159d3-cc5b-43f9-b4c5-8c9c9a31e90b tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] [instance: 9f436d6d-3f0b-4a5c-af39-05dfebf8da88] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:17.696503 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-960159d3-cc5b-43f9-b4c5-8c9c9a31e90b tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:17.698702 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-960159d3-cc5b-43f9-b4c5-8c9c9a31e90b tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:17.701806 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-960159d3-cc5b-43f9-b4c5-8c9c9a31e90b tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:17.702441 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-960159d3-cc5b-43f9-b4c5-8c9c9a31e90b tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:17.749672 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f56ea58f-91a0-4213-8ac5-de2af200765a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:17.778659 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f56ea58f-91a0-4213-8ac5-de2af200765a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1694 microversion: 2.1 time: 0.393485 Jun 20 12:19:17.783094 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2342/4582] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:19:17 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1694 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:19:17.863967 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-960159d3-cc5b-43f9-b4c5-8c9c9a31e90b tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:17.880563 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-960159d3-cc5b-43f9-b4c5-8c9c9a31e90b tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:17.882588 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-960159d3-cc5b-43f9-b4c5-8c9c9a31e90b tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:17.884060 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-960159d3-cc5b-43f9-b4c5-8c9c9a31e90b tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] 10.222.0.27 "GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88" status: 200 len: 1408 microversion: 2.54 time: 0.221778 Jun 20 12:19:17.885957 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2241/4583] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:17 2022] GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88 => generated 1408 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:19:18.065079 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e548fca4-e5e2-4a2a-a752-89044d2339af tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:18.065881 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e548fca4-e5e2-4a2a-a752-89044d2339af tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:18.082679 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e548fca4-e5e2-4a2a-a752-89044d2339af tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:18.083722 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e548fca4-e5e2-4a2a-a752-89044d2339af tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:18.084932 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e548fca4-e5e2-4a2a-a752-89044d2339af tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:18.085378 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e548fca4-e5e2-4a2a-a752-89044d2339af tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:18.292819 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-fe6701af-6b0e-4cb6-ac2e-3b1598bdb765 req-1b37f73e-4648-4e4e-a338-fd16bac7df85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1512eb0-4637-49c4-a4d5-cdbbd1398473", "name": "network-vif-unplugged", "status": "completed", "tag": "d7d7973b-595c-4769-80dd-0441a733dbfc"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:19:18.305190 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-fe6701af-6b0e-4cb6-ac2e-3b1598bdb765 req-1b37f73e-4648-4e4e-a338-fd16bac7df85 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:18.306417 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-fe6701af-6b0e-4cb6-ac2e-3b1598bdb765 req-1b37f73e-4648-4e4e-a338-fd16bac7df85 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:18.337334 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-fe6701af-6b0e-4cb6-ac2e-3b1598bdb765 req-1b37f73e-4648-4e4e-a338-fd16bac7df85 service nova] Creating event network-vif-unplugged:d7d7973b-595c-4769-80dd-0441a733dbfc for instance a1512eb0-4637-49c4-a4d5-cdbbd1398473 on n-h1-master-1 Jun 20 12:19:18.345909 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [req-fe6701af-6b0e-4cb6-ac2e-3b1598bdb765 req-1b37f73e-4648-4e4e-a338-fd16bac7df85 service nova] Instance a1512eb0-4637-49c4-a4d5-cdbbd1398473 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:19:18.360346 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-fe6701af-6b0e-4cb6-ac2e-3b1598bdb765 req-1b37f73e-4648-4e4e-a338-fd16bac7df85 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073228 Jun 20 12:19:18.362759 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2242/4584] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:19:18.382836 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e548fca4-e5e2-4a2a-a752-89044d2339af tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:18.395265 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e548fca4-e5e2-4a2a-a752-89044d2339af tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:18.400511 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e548fca4-e5e2-4a2a-a752-89044d2339af tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:18.401768 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e548fca4-e5e2-4a2a-a752-89044d2339af tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1740 microversion: 2.20 time: 0.340935 Jun 20 12:19:18.415700 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2343/4585] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:18 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1740 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:18.803727 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8d64ed65-029e-4108-9406-6e0966533872 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:18.805458 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8d64ed65-029e-4108-9406-6e0966533872 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:18.815040 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8d64ed65-029e-4108-9406-6e0966533872 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:18.815725 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8d64ed65-029e-4108-9406-6e0966533872 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:18.817100 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8d64ed65-029e-4108-9406-6e0966533872 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:18.817864 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8d64ed65-029e-4108-9406-6e0966533872 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:18.904040 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1f324256-57f7-4e95-a320-4749307ec063 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:18.904714 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1f324256-57f7-4e95-a320-4749307ec063 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] [instance: 9f436d6d-3f0b-4a5c-af39-05dfebf8da88] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:18.922925 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f324256-57f7-4e95-a320-4749307ec063 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:18.925240 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f324256-57f7-4e95-a320-4749307ec063 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:18.926608 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f324256-57f7-4e95-a320-4749307ec063 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:18.928768 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f324256-57f7-4e95-a320-4749307ec063 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:19.067564 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8d64ed65-029e-4108-9406-6e0966533872 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:19.088013 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8d64ed65-029e-4108-9406-6e0966533872 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1694 microversion: 2.1 time: 0.291785 Jun 20 12:19:19.090336 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2243/4586] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:19:18 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1694 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:19:19.302097 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1f324256-57f7-4e95-a320-4749307ec063 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:19.306554 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:19.321142 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1f324256-57f7-4e95-a320-4749307ec063 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:19.329488 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1f324256-57f7-4e95-a320-4749307ec063 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:19.331869 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1f324256-57f7-4e95-a320-4749307ec063 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] 10.222.0.27 "GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88" status: 200 len: 1408 microversion: 2.54 time: 0.431838 Jun 20 12:19:19.333020 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2344/4587] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:18 2022] GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88 => generated 1408 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:19.420577 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a9c962f2-ed3e-46fa-aead-c91a4e31a95c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:19.421184 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a9c962f2-ed3e-46fa-aead-c91a4e31a95c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:19.442589 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a9c962f2-ed3e-46fa-aead-c91a4e31a95c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:19.443183 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a9c962f2-ed3e-46fa-aead-c91a4e31a95c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:19.444518 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a9c962f2-ed3e-46fa-aead-c91a4e31a95c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:19.445248 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a9c962f2-ed3e-46fa-aead-c91a4e31a95c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:19.845949 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a9c962f2-ed3e-46fa-aead-c91a4e31a95c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:19.867399 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a9c962f2-ed3e-46fa-aead-c91a4e31a95c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:19.869405 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a9c962f2-ed3e-46fa-aead-c91a4e31a95c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:19.870645 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a9c962f2-ed3e-46fa-aead-c91a4e31a95c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1740 microversion: 2.20 time: 0.454028 Jun 20 12:19:19.871234 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2244/4588] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:19 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1740 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:20.106665 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f35d2024-4657-4637-9646-f83da78c1bf2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:20.108521 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f35d2024-4657-4637-9646-f83da78c1bf2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:20.123005 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f35d2024-4657-4637-9646-f83da78c1bf2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:20.123771 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f35d2024-4657-4637-9646-f83da78c1bf2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:20.124790 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f35d2024-4657-4637-9646-f83da78c1bf2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:20.125858 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f35d2024-4657-4637-9646-f83da78c1bf2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:20.351873 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-acd4aeb8-8953-45b5-9924-ba50f9ea0d89 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:20.351873 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-acd4aeb8-8953-45b5-9924-ba50f9ea0d89 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] [instance: 9f436d6d-3f0b-4a5c-af39-05dfebf8da88] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:20.361048 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-acd4aeb8-8953-45b5-9924-ba50f9ea0d89 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:20.361584 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-acd4aeb8-8953-45b5-9924-ba50f9ea0d89 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:20.362826 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-acd4aeb8-8953-45b5-9924-ba50f9ea0d89 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:20.363755 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-acd4aeb8-8953-45b5-9924-ba50f9ea0d89 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:20.459353 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-acd4aeb8-8953-45b5-9924-ba50f9ea0d89 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:20.469960 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-acd4aeb8-8953-45b5-9924-ba50f9ea0d89 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:20.471925 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-acd4aeb8-8953-45b5-9924-ba50f9ea0d89 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:20.475234 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-acd4aeb8-8953-45b5-9924-ba50f9ea0d89 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] 10.222.0.27 "GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88" status: 200 len: 1408 microversion: 2.54 time: 0.125819 Jun 20 12:19:20.476434 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2245/4589] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:20 2022] GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88 => generated 1408 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:20.481715 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-0149f813-5727-4bfc-bde1-2a7787e40f35 req-1d84b902-084a-40b5-b580-825da33c485f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1512eb0-4637-49c4-a4d5-cdbbd1398473", "tag": "d7d7973b-595c-4769-80dd-0441a733dbfc"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:19:20.481908 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f35d2024-4657-4637-9646-f83da78c1bf2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:20.490499 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f35d2024-4657-4637-9646-f83da78c1bf2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1694 microversion: 2.1 time: 0.388146 Jun 20 12:19:20.497709 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-0149f813-5727-4bfc-bde1-2a7787e40f35 req-1d84b902-084a-40b5-b580-825da33c485f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:20.498404 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-0149f813-5727-4bfc-bde1-2a7787e40f35 req-1d84b902-084a-40b5-b580-825da33c485f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:20.503574 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2345/4590] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:19:20 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1694 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:19:20.513887 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-0149f813-5727-4bfc-bde1-2a7787e40f35 req-1d84b902-084a-40b5-b580-825da33c485f service nova] Creating event network-changed:d7d7973b-595c-4769-80dd-0441a733dbfc for instance a1512eb0-4637-49c4-a4d5-cdbbd1398473 on n-h1-master-1 Jun 20 12:19:20.520442 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [req-0149f813-5727-4bfc-bde1-2a7787e40f35 req-1d84b902-084a-40b5-b580-825da33c485f service nova] Instance a1512eb0-4637-49c4-a4d5-cdbbd1398473 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:19:20.531997 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-0149f813-5727-4bfc-bde1-2a7787e40f35 req-1d84b902-084a-40b5-b580-825da33c485f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053904 Jun 20 12:19:20.532892 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2246/4591] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:19:20.894714 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c6d4125f-ca3c-420f-b92c-67336fb68ec6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:20.896103 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c6d4125f-ca3c-420f-b92c-67336fb68ec6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:20.906529 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6d4125f-ca3c-420f-b92c-67336fb68ec6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:20.907388 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6d4125f-ca3c-420f-b92c-67336fb68ec6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:20.908300 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6d4125f-ca3c-420f-b92c-67336fb68ec6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:20.908711 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6d4125f-ca3c-420f-b92c-67336fb68ec6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:21.358098 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c6d4125f-ca3c-420f-b92c-67336fb68ec6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:21.368457 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c6d4125f-ca3c-420f-b92c-67336fb68ec6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:21.370136 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c6d4125f-ca3c-420f-b92c-67336fb68ec6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:21.371700 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c6d4125f-ca3c-420f-b92c-67336fb68ec6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1722 microversion: 2.20 time: 0.485752 Jun 20 12:19:21.380081 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2346/4592] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:20 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1722 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:21.496725 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f123da93-8c2f-40cb-be58-1e775c316a4d tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:21.497616 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f123da93-8c2f-40cb-be58-1e775c316a4d tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] [instance: 9f436d6d-3f0b-4a5c-af39-05dfebf8da88] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:21.507386 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f123da93-8c2f-40cb-be58-1e775c316a4d tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:21.508045 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f123da93-8c2f-40cb-be58-1e775c316a4d tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:21.509094 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f123da93-8c2f-40cb-be58-1e775c316a4d tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:21.509902 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-502ad06b-7c06-4f16-bf66-6058f701aabf tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:21.510057 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f123da93-8c2f-40cb-be58-1e775c316a4d tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:21.512058 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-502ad06b-7c06-4f16-bf66-6058f701aabf tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:21.522360 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-502ad06b-7c06-4f16-bf66-6058f701aabf tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:21.523154 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-502ad06b-7c06-4f16-bf66-6058f701aabf tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:21.524494 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-502ad06b-7c06-4f16-bf66-6058f701aabf tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:21.525107 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-502ad06b-7c06-4f16-bf66-6058f701aabf tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:21.701265 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f123da93-8c2f-40cb-be58-1e775c316a4d tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:21.710515 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f123da93-8c2f-40cb-be58-1e775c316a4d tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:21.712536 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f123da93-8c2f-40cb-be58-1e775c316a4d tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:21.714108 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f123da93-8c2f-40cb-be58-1e775c316a4d tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] 10.222.0.27 "GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88" status: 200 len: 1408 microversion: 2.54 time: 0.222417 Jun 20 12:19:21.725783 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2247/4593] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:21 2022] GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88 => generated 1408 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:21.754611 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-502ad06b-7c06-4f16-bf66-6058f701aabf tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:21.770961 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-502ad06b-7c06-4f16-bf66-6058f701aabf tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1694 microversion: 2.1 time: 0.265960 Jun 20 12:19:21.772147 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2347/4594] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:19:21 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1694 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:19:22.390465 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-53b5f3c3-fa7a-4e86-b051-0924e2685793 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:22.391527 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-53b5f3c3-fa7a-4e86-b051-0924e2685793 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:22.398504 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-53b5f3c3-fa7a-4e86-b051-0924e2685793 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:22.398911 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-53b5f3c3-fa7a-4e86-b051-0924e2685793 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:22.399720 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-53b5f3c3-fa7a-4e86-b051-0924e2685793 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:22.400178 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-53b5f3c3-fa7a-4e86-b051-0924e2685793 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:22.577993 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-53b5f3c3-fa7a-4e86-b051-0924e2685793 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:22.611815 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-53b5f3c3-fa7a-4e86-b051-0924e2685793 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:22.613565 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-53b5f3c3-fa7a-4e86-b051-0924e2685793 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:22.617637 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-53b5f3c3-fa7a-4e86-b051-0924e2685793 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1722 microversion: 2.20 time: 0.231154 Jun 20 12:19:22.619222 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2248/4595] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:22 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:22.737309 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f6e1fc1e-2414-4bd8-a60c-8fdaecceaa61 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:22.739006 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f6e1fc1e-2414-4bd8-a60c-8fdaecceaa61 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] [instance: 9f436d6d-3f0b-4a5c-af39-05dfebf8da88] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:22.752433 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f6e1fc1e-2414-4bd8-a60c-8fdaecceaa61 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:22.753661 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f6e1fc1e-2414-4bd8-a60c-8fdaecceaa61 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:22.769676 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f6e1fc1e-2414-4bd8-a60c-8fdaecceaa61 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:22.771603 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f6e1fc1e-2414-4bd8-a60c-8fdaecceaa61 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:22.789401 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-17bfd69e-d6d5-44c4-b365-efd7ed86b330 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:22.790413 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-17bfd69e-d6d5-44c4-b365-efd7ed86b330 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:22.796747 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-17bfd69e-d6d5-44c4-b365-efd7ed86b330 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:22.805432 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-17bfd69e-d6d5-44c4-b365-efd7ed86b330 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:22.806657 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-17bfd69e-d6d5-44c4-b365-efd7ed86b330 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:22.807312 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-17bfd69e-d6d5-44c4-b365-efd7ed86b330 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:22.877495 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f6e1fc1e-2414-4bd8-a60c-8fdaecceaa61 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:22.894758 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f6e1fc1e-2414-4bd8-a60c-8fdaecceaa61 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:22.896177 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f6e1fc1e-2414-4bd8-a60c-8fdaecceaa61 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:22.901997 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f6e1fc1e-2414-4bd8-a60c-8fdaecceaa61 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] 10.222.0.27 "GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88" status: 200 len: 1408 microversion: 2.54 time: 0.171767 Jun 20 12:19:22.917081 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2348/4596] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:22 2022] GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88 => generated 1408 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:23.025831 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-17bfd69e-d6d5-44c4-b365-efd7ed86b330 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:23.034529 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-17bfd69e-d6d5-44c4-b365-efd7ed86b330 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1692 microversion: 2.1 time: 0.249246 Jun 20 12:19:23.035523 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2249/4597] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:19:22 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1692 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:19:23.639969 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cbc5db1a-89ed-43dc-b698-e215e0c2f2e9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:23.641176 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cbc5db1a-89ed-43dc-b698-e215e0c2f2e9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:23.650661 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cbc5db1a-89ed-43dc-b698-e215e0c2f2e9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:23.655435 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cbc5db1a-89ed-43dc-b698-e215e0c2f2e9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:23.657294 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cbc5db1a-89ed-43dc-b698-e215e0c2f2e9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:23.657980 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cbc5db1a-89ed-43dc-b698-e215e0c2f2e9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:23.831087 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cbc5db1a-89ed-43dc-b698-e215e0c2f2e9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:23.841047 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cbc5db1a-89ed-43dc-b698-e215e0c2f2e9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:23.843706 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cbc5db1a-89ed-43dc-b698-e215e0c2f2e9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:23.845640 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cbc5db1a-89ed-43dc-b698-e215e0c2f2e9 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1722 microversion: 2.20 time: 0.212104 Jun 20 12:19:23.854650 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2349/4598] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:23 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:23.927023 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-12200e29-f602-434e-a8c2-7b60c53f7f79 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:23.927628 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-12200e29-f602-434e-a8c2-7b60c53f7f79 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] [instance: 9f436d6d-3f0b-4a5c-af39-05dfebf8da88] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:23.935018 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-12200e29-f602-434e-a8c2-7b60c53f7f79 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:23.935902 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-12200e29-f602-434e-a8c2-7b60c53f7f79 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:23.936704 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-12200e29-f602-434e-a8c2-7b60c53f7f79 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:23.937133 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-12200e29-f602-434e-a8c2-7b60c53f7f79 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:23.952916 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:24.021231 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-12200e29-f602-434e-a8c2-7b60c53f7f79 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:24.029373 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-12200e29-f602-434e-a8c2-7b60c53f7f79 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:24.030879 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-12200e29-f602-434e-a8c2-7b60c53f7f79 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:24.032669 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-12200e29-f602-434e-a8c2-7b60c53f7f79 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] 10.222.0.27 "GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88" status: 200 len: 1408 microversion: 2.54 time: 0.110236 Jun 20 12:19:24.033464 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2250/4599] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:23 2022] GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88 => generated 1408 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:24.058995 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-47f43907-c298-418c-aee6-5fa369409e0e tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:24.059885 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-47f43907-c298-418c-aee6-5fa369409e0e tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:24.067879 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-47f43907-c298-418c-aee6-5fa369409e0e tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:24.068601 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-47f43907-c298-418c-aee6-5fa369409e0e tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:24.069751 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-47f43907-c298-418c-aee6-5fa369409e0e tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:24.070381 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-47f43907-c298-418c-aee6-5fa369409e0e tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:24.225939 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-47f43907-c298-418c-aee6-5fa369409e0e tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:24.236005 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-47f43907-c298-418c-aee6-5fa369409e0e tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1692 microversion: 2.1 time: 0.183645 Jun 20 12:19:24.236614 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2350/4600] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:19:24 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1692 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:19:24.866627 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-15aaa33b-01d6-4b6b-8a41-1760c53d95d2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:24.867733 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-15aaa33b-01d6-4b6b-8a41-1760c53d95d2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:24.879074 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-15aaa33b-01d6-4b6b-8a41-1760c53d95d2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:24.879831 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-15aaa33b-01d6-4b6b-8a41-1760c53d95d2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:24.882489 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-15aaa33b-01d6-4b6b-8a41-1760c53d95d2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:24.883132 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-15aaa33b-01d6-4b6b-8a41-1760c53d95d2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:25.053798 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a453e2b7-2d26-4b74-a184-6704f6ba0526 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:25.054410 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a453e2b7-2d26-4b74-a184-6704f6ba0526 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] [instance: 9f436d6d-3f0b-4a5c-af39-05dfebf8da88] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:25.078077 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a453e2b7-2d26-4b74-a184-6704f6ba0526 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:25.078684 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a453e2b7-2d26-4b74-a184-6704f6ba0526 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:25.079645 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a453e2b7-2d26-4b74-a184-6704f6ba0526 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:25.080161 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a453e2b7-2d26-4b74-a184-6704f6ba0526 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:25.188302 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-15aaa33b-01d6-4b6b-8a41-1760c53d95d2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:25.202360 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-15aaa33b-01d6-4b6b-8a41-1760c53d95d2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:25.210535 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-15aaa33b-01d6-4b6b-8a41-1760c53d95d2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:25.212187 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-15aaa33b-01d6-4b6b-8a41-1760c53d95d2 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1722 microversion: 2.20 time: 0.350447 Jun 20 12:19:25.225063 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2251/4601] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:24 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1722 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:19:25.255199 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b812a44b-28ea-4eb9-aadd-0fa36efcb62a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:25.256228 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b812a44b-28ea-4eb9-aadd-0fa36efcb62a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:25.270925 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b812a44b-28ea-4eb9-aadd-0fa36efcb62a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:25.271797 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b812a44b-28ea-4eb9-aadd-0fa36efcb62a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:25.276150 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b812a44b-28ea-4eb9-aadd-0fa36efcb62a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:25.277734 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b812a44b-28ea-4eb9-aadd-0fa36efcb62a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:25.658512 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a453e2b7-2d26-4b74-a184-6704f6ba0526 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:25.677849 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a453e2b7-2d26-4b74-a184-6704f6ba0526 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:25.685153 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a453e2b7-2d26-4b74-a184-6704f6ba0526 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:25.686545 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a453e2b7-2d26-4b74-a184-6704f6ba0526 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] 10.222.0.27 "GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88" status: 200 len: 1408 microversion: 2.54 time: 0.637254 Jun 20 12:19:25.697756 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2351/4602] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:25 2022] GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88 => generated 1408 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:25.704552 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-8ed8aeb3-746f-4e4b-a2f1-c375a068533a req-ef911245-4de3-4831-91ae-7d7151519214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ed20ca4-7f49-4d0a-a590-d2d4274698e3", "name": "network-vif-unplugged", "status": "completed", "tag": "4bb9ec16-a224-4e67-8de4-0415485dde23"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:19:25.715617 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-8ed8aeb3-746f-4e4b-a2f1-c375a068533a req-ef911245-4de3-4831-91ae-7d7151519214 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:25.716452 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-8ed8aeb3-746f-4e4b-a2f1-c375a068533a req-ef911245-4de3-4831-91ae-7d7151519214 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:25.732885 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-8ed8aeb3-746f-4e4b-a2f1-c375a068533a req-ef911245-4de3-4831-91ae-7d7151519214 service nova] Creating event network-vif-unplugged:4bb9ec16-a224-4e67-8de4-0415485dde23 for instance 6ed20ca4-7f49-4d0a-a590-d2d4274698e3 on n-h1-master-1 Jun 20 12:19:25.742918 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-8ed8aeb3-746f-4e4b-a2f1-c375a068533a req-ef911245-4de3-4831-91ae-7d7151519214 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041420 Jun 20 12:19:25.743920 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2352/4603] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:19:25.798095 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b812a44b-28ea-4eb9-aadd-0fa36efcb62a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:25.815893 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b812a44b-28ea-4eb9-aadd-0fa36efcb62a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1692 microversion: 2.1 time: 0.566458 Jun 20 12:19:25.817121 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2252/4604] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:19:25 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1692 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:19:26.248959 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8bb09f7c-f02c-4874-8a15-a7976529687a tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:26.250770 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8bb09f7c-f02c-4874-8a15-a7976529687a tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:26.266638 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bb09f7c-f02c-4874-8a15-a7976529687a tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:26.267883 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bb09f7c-f02c-4874-8a15-a7976529687a tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:26.269756 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bb09f7c-f02c-4874-8a15-a7976529687a tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:26.270410 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bb09f7c-f02c-4874-8a15-a7976529687a tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:26.463163 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8bb09f7c-f02c-4874-8a15-a7976529687a tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:26.472368 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8bb09f7c-f02c-4874-8a15-a7976529687a tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:26.473903 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8bb09f7c-f02c-4874-8a15-a7976529687a tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:26.475115 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8bb09f7c-f02c-4874-8a15-a7976529687a tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1665 microversion: 2.20 time: 0.234533 Jun 20 12:19:26.475711 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2353/4605] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:26 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1665 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:26.493355 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-36cfd604-8535-48e6-bbfd-ef73f0df58d0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20e83371-2a55-4991-9e10-be465c93d394"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:19:26.494663 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-36cfd604-8535-48e6-bbfd-ef73f0df58d0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:26.502160 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-36cfd604-8535-48e6-bbfd-ef73f0df58d0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:26.503421 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-36cfd604-8535-48e6-bbfd-ef73f0df58d0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:26.503421 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-36cfd604-8535-48e6-bbfd-ef73f0df58d0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:26.503680 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-36cfd604-8535-48e6-bbfd-ef73f0df58d0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:26.707601 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-955aa302-0f7f-4346-950e-819f6ae6c083 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:26.708384 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-955aa302-0f7f-4346-950e-819f6ae6c083 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] [instance: 9f436d6d-3f0b-4a5c-af39-05dfebf8da88] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:26.716299 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-955aa302-0f7f-4346-950e-819f6ae6c083 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:26.716681 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-955aa302-0f7f-4346-950e-819f6ae6c083 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:26.717456 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-955aa302-0f7f-4346-950e-819f6ae6c083 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:26.720801 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-955aa302-0f7f-4346-950e-819f6ae6c083 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:26.803447 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-955aa302-0f7f-4346-950e-819f6ae6c083 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:26.817308 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-955aa302-0f7f-4346-950e-819f6ae6c083 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:26.818958 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-955aa302-0f7f-4346-950e-819f6ae6c083 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:26.820558 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-955aa302-0f7f-4346-950e-819f6ae6c083 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] 10.222.0.27 "GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88" status: 200 len: 1408 microversion: 2.54 time: 0.118582 Jun 20 12:19:26.821684 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2354/4606] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:26 2022] GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88 => generated 1408 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:19:26.834050 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e92ff9e5-c39a-4281-b835-611e0083af36 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:26.835801 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e92ff9e5-c39a-4281-b835-611e0083af36 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:26.845010 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e92ff9e5-c39a-4281-b835-611e0083af36 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:26.845783 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e92ff9e5-c39a-4281-b835-611e0083af36 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:26.846776 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e92ff9e5-c39a-4281-b835-611e0083af36 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:26.847308 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e92ff9e5-c39a-4281-b835-611e0083af36 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:26.921438 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-36cfd604-8535-48e6-bbfd-ef73f0df58d0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "POST /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.431294 Jun 20 12:19:26.922160 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2253/4607] 10.222.0.27 () {62 vars in 1363 bytes} [Mon Jun 20 12:19:26 2022] POST /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3/os-volume_attachments => generated 188 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:19:27.023698 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e92ff9e5-c39a-4281-b835-611e0083af36 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:27.033965 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e92ff9e5-c39a-4281-b835-611e0083af36 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1689 microversion: 2.1 time: 0.204119 Jun 20 12:19:27.035278 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2355/4608] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:19:26 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1689 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:19:27.051704 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-75e9c17e-2dcc-40f7-b7a0-4c0293458fd0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:19:27.052417 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-75e9c17e-2dcc-40f7-b7a0-4c0293458fd0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:27.075702 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-75e9c17e-2dcc-40f7-b7a0-4c0293458fd0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:27.076850 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-75e9c17e-2dcc-40f7-b7a0-4c0293458fd0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:27.085726 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-75e9c17e-2dcc-40f7-b7a0-4c0293458fd0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:27.086301 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-75e9c17e-2dcc-40f7-b7a0-4c0293458fd0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:27.141843 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-26b72364-d78c-4291-87c3-ec32c1800aa5 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:27.142986 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-26b72364-d78c-4291-87c3-ec32c1800aa5 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:27.149876 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-26b72364-d78c-4291-87c3-ec32c1800aa5 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:27.150653 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-26b72364-d78c-4291-87c3-ec32c1800aa5 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:27.151654 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-26b72364-d78c-4291-87c3-ec32c1800aa5 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:27.152364 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-26b72364-d78c-4291-87c3-ec32c1800aa5 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:27.331496 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-75e9c17e-2dcc-40f7-b7a0-4c0293458fd0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "POST /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473/action" status: 202 len: 0 microversion: 2.1 time: 0.284254 Jun 20 12:19:27.336085 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2254/4609] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:19:27 2022] POST /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:19:27.345097 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d974d799-267e-4959-a9ee-6810fb948340 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:27.346503 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d974d799-267e-4959-a9ee-6810fb948340 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:27.353803 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d974d799-267e-4959-a9ee-6810fb948340 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:27.354574 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d974d799-267e-4959-a9ee-6810fb948340 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:27.355554 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d974d799-267e-4959-a9ee-6810fb948340 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:27.356165 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d974d799-267e-4959-a9ee-6810fb948340 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:27.609572 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-26b72364-d78c-4291-87c3-ec32c1800aa5 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3/os-volume_attachments/20e83371-2a55-4991-9e10-be465c93d394" status: 202 len: 0 microversion: 2.20 time: 0.472284 Jun 20 12:19:27.613619 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2356/4610] 10.222.0.27 () {60 vars in 1456 bytes} [Mon Jun 20 12:19:27 2022] DELETE /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3/os-volume_attachments/20e83371-2a55-4991-9e10-be465c93d394 => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:19:27.664043 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d974d799-267e-4959-a9ee-6810fb948340 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:27.673032 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d974d799-267e-4959-a9ee-6810fb948340 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1688 microversion: 2.1 time: 0.334857 Jun 20 12:19:27.676162 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2255/4611] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:19:27 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1688 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:19:27.718758 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-057f3c52-76e6-4c4c-878f-4e5f6ec765c6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:19:27.719610 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-057f3c52-76e6-4c4c-878f-4e5f6ec765c6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:27.730338 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-057f3c52-76e6-4c4c-878f-4e5f6ec765c6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:27.731008 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-057f3c52-76e6-4c4c-878f-4e5f6ec765c6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:27.731983 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-057f3c52-76e6-4c4c-878f-4e5f6ec765c6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:27.732613 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-057f3c52-76e6-4c4c-878f-4e5f6ec765c6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:27.839152 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fcec5191-ef7e-4ecb-a96b-3ffc64a575b8 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:27.839760 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fcec5191-ef7e-4ecb-a96b-3ffc64a575b8 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] [instance: 9f436d6d-3f0b-4a5c-af39-05dfebf8da88] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:27.848029 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fcec5191-ef7e-4ecb-a96b-3ffc64a575b8 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:27.857251 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fcec5191-ef7e-4ecb-a96b-3ffc64a575b8 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:27.858232 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fcec5191-ef7e-4ecb-a96b-3ffc64a575b8 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:27.858685 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fcec5191-ef7e-4ecb-a96b-3ffc64a575b8 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:27.905119 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-057f3c52-76e6-4c4c-878f-4e5f6ec765c6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "POST /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3/action" status: 202 len: 0 microversion: 2.20 time: 0.190543 Jun 20 12:19:27.910136 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2357/4612] 10.222.0.27 () {62 vars in 1318 bytes} [Mon Jun 20 12:19:27 2022] POST /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:19:27.921317 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-cabcc550-1bcf-411f-835f-59719d0d7bcf req-67f515ed-3bbb-4ffe-9944-0ef598e80914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1512eb0-4637-49c4-a4d5-cdbbd1398473", "name": "network-vif-plugged", "status": "completed", "tag": "d7d7973b-595c-4769-80dd-0441a733dbfc"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:19:27.939263 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-cabcc550-1bcf-411f-835f-59719d0d7bcf req-67f515ed-3bbb-4ffe-9944-0ef598e80914 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:27.942462 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-cabcc550-1bcf-411f-835f-59719d0d7bcf req-67f515ed-3bbb-4ffe-9944-0ef598e80914 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:27.979718 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-cabcc550-1bcf-411f-835f-59719d0d7bcf req-67f515ed-3bbb-4ffe-9944-0ef598e80914 service nova] Creating event network-vif-plugged:d7d7973b-595c-4769-80dd-0441a733dbfc for instance a1512eb0-4637-49c4-a4d5-cdbbd1398473 on n-h1-master-1 Jun 20 12:19:27.990935 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [req-cabcc550-1bcf-411f-835f-59719d0d7bcf req-67f515ed-3bbb-4ffe-9944-0ef598e80914 service nova] Instance a1512eb0-4637-49c4-a4d5-cdbbd1398473 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119127) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:19:28.066716 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-cabcc550-1bcf-411f-835f-59719d0d7bcf req-67f515ed-3bbb-4ffe-9944-0ef598e80914 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149242 Jun 20 12:19:28.071218 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2358/4613] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:19:28.097084 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-756363b2-6714-4fb5-bdb5-77c8a58c63ce tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:28.101099 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-756363b2-6714-4fb5-bdb5-77c8a58c63ce tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:28.143077 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-756363b2-6714-4fb5-bdb5-77c8a58c63ce tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:28.143549 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-756363b2-6714-4fb5-bdb5-77c8a58c63ce tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:28.146891 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-756363b2-6714-4fb5-bdb5-77c8a58c63ce tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:28.147368 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-756363b2-6714-4fb5-bdb5-77c8a58c63ce tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:28.234233 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:28.469101 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fcec5191-ef7e-4ecb-a96b-3ffc64a575b8 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:28.481866 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fcec5191-ef7e-4ecb-a96b-3ffc64a575b8 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:28.485505 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fcec5191-ef7e-4ecb-a96b-3ffc64a575b8 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:28.487527 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fcec5191-ef7e-4ecb-a96b-3ffc64a575b8 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] 10.222.0.27 "GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88" status: 200 len: 1408 microversion: 2.54 time: 0.652538 Jun 20 12:19:28.489162 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2256/4614] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:27 2022] GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88 => generated 1408 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:19:28.693137 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-578b1540-1ed8-4072-ad44-7e2a4e64e9ee tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:28.693875 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-578b1540-1ed8-4072-ad44-7e2a4e64e9ee tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:28.707493 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-756363b2-6714-4fb5-bdb5-77c8a58c63ce tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:28.717785 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-578b1540-1ed8-4072-ad44-7e2a4e64e9ee tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:28.718255 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-578b1540-1ed8-4072-ad44-7e2a4e64e9ee tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:28.719136 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-578b1540-1ed8-4072-ad44-7e2a4e64e9ee tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:28.719733 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-578b1540-1ed8-4072-ad44-7e2a4e64e9ee tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:28.730050 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-756363b2-6714-4fb5-bdb5-77c8a58c63ce tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:28.732570 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-756363b2-6714-4fb5-bdb5-77c8a58c63ce tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:28.733811 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-756363b2-6714-4fb5-bdb5-77c8a58c63ce tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1673 microversion: 2.20 time: 0.657465 Jun 20 12:19:28.734384 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2359/4615] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:28 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1673 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:29.088373 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-578b1540-1ed8-4072-ad44-7e2a4e64e9ee tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:29.098292 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-578b1540-1ed8-4072-ad44-7e2a4e64e9ee tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1688 microversion: 2.1 time: 0.409611 Jun 20 12:19:29.098885 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2257/4616] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:19:28 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1688 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:19:29.522616 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2e16cc0a-19ed-42d9-9152-5477c6ea8c25 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:29.525245 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2e16cc0a-19ed-42d9-9152-5477c6ea8c25 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] [instance: 9f436d6d-3f0b-4a5c-af39-05dfebf8da88] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:29.534312 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2e16cc0a-19ed-42d9-9152-5477c6ea8c25 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:29.534821 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2e16cc0a-19ed-42d9-9152-5477c6ea8c25 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:29.535660 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2e16cc0a-19ed-42d9-9152-5477c6ea8c25 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:29.536098 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2e16cc0a-19ed-42d9-9152-5477c6ea8c25 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:29.694397 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2e16cc0a-19ed-42d9-9152-5477c6ea8c25 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:29.706825 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2e16cc0a-19ed-42d9-9152-5477c6ea8c25 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:29.708666 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2e16cc0a-19ed-42d9-9152-5477c6ea8c25 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:29.710756 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2e16cc0a-19ed-42d9-9152-5477c6ea8c25 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] 10.222.0.27 "GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88" status: 200 len: 1408 microversion: 2.54 time: 0.202398 Jun 20 12:19:29.711878 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2360/4617] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:29 2022] GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88 => generated 1408 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:29.754420 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3b66b8b1-79b0-47fb-9316-324552ba0370 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:29.755998 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3b66b8b1-79b0-47fb-9316-324552ba0370 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:29.765522 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b66b8b1-79b0-47fb-9316-324552ba0370 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:29.767139 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b66b8b1-79b0-47fb-9316-324552ba0370 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:29.768992 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b66b8b1-79b0-47fb-9316-324552ba0370 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:29.772148 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b66b8b1-79b0-47fb-9316-324552ba0370 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:30.116902 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-28a6b029-a267-4b79-b0ed-2684fcfa3f4d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:30.119216 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-28a6b029-a267-4b79-b0ed-2684fcfa3f4d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:30.128123 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28a6b029-a267-4b79-b0ed-2684fcfa3f4d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:30.128973 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28a6b029-a267-4b79-b0ed-2684fcfa3f4d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:30.129972 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28a6b029-a267-4b79-b0ed-2684fcfa3f4d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:30.130599 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28a6b029-a267-4b79-b0ed-2684fcfa3f4d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:30.209393 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3b66b8b1-79b0-47fb-9316-324552ba0370 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:30.222567 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3b66b8b1-79b0-47fb-9316-324552ba0370 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:30.224631 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3b66b8b1-79b0-47fb-9316-324552ba0370 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:30.226208 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3b66b8b1-79b0-47fb-9316-324552ba0370 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1731 microversion: 2.20 time: 0.476367 Jun 20 12:19:30.231420 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2258/4618] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:29 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1731 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:30.351011 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-28a6b029-a267-4b79-b0ed-2684fcfa3f4d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:30.361553 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-28a6b029-a267-4b79-b0ed-2684fcfa3f4d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1688 microversion: 2.1 time: 0.249770 Jun 20 12:19:30.373260 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2361/4619] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:19:30 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1688 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:19:30.732294 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ee40146d-ab30-42fe-94f8-4aae307490ae tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:30.732294 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ee40146d-ab30-42fe-94f8-4aae307490ae tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] [instance: 9f436d6d-3f0b-4a5c-af39-05dfebf8da88] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:30.762395 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ee40146d-ab30-42fe-94f8-4aae307490ae tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:30.763635 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ee40146d-ab30-42fe-94f8-4aae307490ae tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:30.769386 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ee40146d-ab30-42fe-94f8-4aae307490ae tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:30.770087 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ee40146d-ab30-42fe-94f8-4aae307490ae tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:30.912172 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ee40146d-ab30-42fe-94f8-4aae307490ae tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:30.924720 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ee40146d-ab30-42fe-94f8-4aae307490ae tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:30.927099 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ee40146d-ab30-42fe-94f8-4aae307490ae tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:30.928295 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ee40146d-ab30-42fe-94f8-4aae307490ae tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] 10.222.0.27 "GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88" status: 200 len: 1408 microversion: 2.54 time: 0.202769 Jun 20 12:19:30.929041 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2259/4620] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:30 2022] GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88 => generated 1408 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:31.253076 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8a2b95e2-dfeb-415e-9aa1-ce46c2fdd204 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:31.253710 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8a2b95e2-dfeb-415e-9aa1-ce46c2fdd204 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:31.264530 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a2b95e2-dfeb-415e-9aa1-ce46c2fdd204 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:31.265426 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a2b95e2-dfeb-415e-9aa1-ce46c2fdd204 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:31.267410 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a2b95e2-dfeb-415e-9aa1-ce46c2fdd204 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:31.268049 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a2b95e2-dfeb-415e-9aa1-ce46c2fdd204 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:31.380982 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-17315813-26de-4ee7-a926-22093ee6f4bd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:31.382730 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-17315813-26de-4ee7-a926-22093ee6f4bd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:31.394967 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-17315813-26de-4ee7-a926-22093ee6f4bd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:31.400659 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-17315813-26de-4ee7-a926-22093ee6f4bd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:31.405211 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-17315813-26de-4ee7-a926-22093ee6f4bd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:31.406375 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-17315813-26de-4ee7-a926-22093ee6f4bd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:31.663734 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8a2b95e2-dfeb-415e-9aa1-ce46c2fdd204 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:31.673560 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8a2b95e2-dfeb-415e-9aa1-ce46c2fdd204 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:31.678554 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8a2b95e2-dfeb-415e-9aa1-ce46c2fdd204 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:31.685604 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8a2b95e2-dfeb-415e-9aa1-ce46c2fdd204 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1731 microversion: 2.20 time: 0.434629 Jun 20 12:19:31.686434 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2362/4621] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:31 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1731 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:31.691866 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-56247595-7c1f-4128-85b7-318c1622011b req-ab64c698-3789-4423-ba6b-77b16dd71142 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ed20ca4-7f49-4d0a-a590-d2d4274698e3", "tag": "4bb9ec16-a224-4e67-8de4-0415485dde23"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:19:31.717574 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-56247595-7c1f-4128-85b7-318c1622011b req-ab64c698-3789-4423-ba6b-77b16dd71142 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:31.718048 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-56247595-7c1f-4128-85b7-318c1622011b req-ab64c698-3789-4423-ba6b-77b16dd71142 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:31.736580 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-17315813-26de-4ee7-a926-22093ee6f4bd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:31.742377 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-56247595-7c1f-4128-85b7-318c1622011b req-ab64c698-3789-4423-ba6b-77b16dd71142 service nova] Creating event network-changed:4bb9ec16-a224-4e67-8de4-0415485dde23 for instance 6ed20ca4-7f49-4d0a-a590-d2d4274698e3 on n-h2-master-1 Jun 20 12:19:31.749063 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-56247595-7c1f-4128-85b7-318c1622011b req-ab64c698-3789-4423-ba6b-77b16dd71142 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060886 Jun 20 12:19:31.749285 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-17315813-26de-4ee7-a926-22093ee6f4bd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1688 microversion: 2.1 time: 0.372396 Jun 20 12:19:31.750176 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2363/4623] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:19:31.768284 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2260/4623] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:19:31 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1688 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:19:31.952971 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9f827bec-6283-4ea2-a7f8-2c9dc4642257 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:31.953955 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9f827bec-6283-4ea2-a7f8-2c9dc4642257 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] [instance: 9f436d6d-3f0b-4a5c-af39-05dfebf8da88] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:31.964538 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9f827bec-6283-4ea2-a7f8-2c9dc4642257 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:31.965272 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9f827bec-6283-4ea2-a7f8-2c9dc4642257 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:31.966298 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9f827bec-6283-4ea2-a7f8-2c9dc4642257 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:31.966887 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9f827bec-6283-4ea2-a7f8-2c9dc4642257 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:32.110311 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9f827bec-6283-4ea2-a7f8-2c9dc4642257 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:32.119007 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9f827bec-6283-4ea2-a7f8-2c9dc4642257 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:32.121091 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9f827bec-6283-4ea2-a7f8-2c9dc4642257 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:32.122587 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9f827bec-6283-4ea2-a7f8-2c9dc4642257 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] 10.222.0.27 "GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88" status: 200 len: 1414 microversion: 2.54 time: 0.177265 Jun 20 12:19:32.123406 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2364/4624] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:31 2022] GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88 => generated 1414 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:32.707458 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-eed86d44-6e72-4d2e-900e-147950f4d46a tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:32.708993 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-eed86d44-6e72-4d2e-900e-147950f4d46a tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:32.723542 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eed86d44-6e72-4d2e-900e-147950f4d46a tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:32.724743 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eed86d44-6e72-4d2e-900e-147950f4d46a tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:32.725814 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eed86d44-6e72-4d2e-900e-147950f4d46a tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:32.726432 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eed86d44-6e72-4d2e-900e-147950f4d46a tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:32.767651 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e76df27f-29c1-4380-bbbf-81ca5dcd2f37 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:32.769023 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e76df27f-29c1-4380-bbbf-81ca5dcd2f37 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:32.782913 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e76df27f-29c1-4380-bbbf-81ca5dcd2f37 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:32.786583 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e76df27f-29c1-4380-bbbf-81ca5dcd2f37 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:32.787725 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e76df27f-29c1-4380-bbbf-81ca5dcd2f37 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:32.799904 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e76df27f-29c1-4380-bbbf-81ca5dcd2f37 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:33.060071 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e76df27f-29c1-4380-bbbf-81ca5dcd2f37 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:33.072438 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e76df27f-29c1-4380-bbbf-81ca5dcd2f37 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1688 microversion: 2.1 time: 0.309291 Jun 20 12:19:33.076625 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2365/4625] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:19:32 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1688 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:19:33.146215 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0bab0b07-b819-4be3-a87a-8da596e2832a tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:33.149018 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0bab0b07-b819-4be3-a87a-8da596e2832a tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] [instance: 9f436d6d-3f0b-4a5c-af39-05dfebf8da88] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:33.160030 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0bab0b07-b819-4be3-a87a-8da596e2832a tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:33.161704 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0bab0b07-b819-4be3-a87a-8da596e2832a tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:33.162808 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0bab0b07-b819-4be3-a87a-8da596e2832a tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:33.163467 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0bab0b07-b819-4be3-a87a-8da596e2832a tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:33.302387 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-eed86d44-6e72-4d2e-900e-147950f4d46a tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:33.318470 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-eed86d44-6e72-4d2e-900e-147950f4d46a tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:33.325794 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-eed86d44-6e72-4d2e-900e-147950f4d46a tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:33.329540 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-eed86d44-6e72-4d2e-900e-147950f4d46a tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1731 microversion: 2.20 time: 0.628484 Jun 20 12:19:33.336239 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2261/4626] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:32 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1731 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:33.393744 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0bab0b07-b819-4be3-a87a-8da596e2832a tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:33.403753 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0bab0b07-b819-4be3-a87a-8da596e2832a tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:33.410596 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0bab0b07-b819-4be3-a87a-8da596e2832a tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:33.415242 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0bab0b07-b819-4be3-a87a-8da596e2832a tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] 10.222.0.27 "GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88" status: 200 len: 1414 microversion: 2.54 time: 0.274827 Jun 20 12:19:33.433501 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2366/4627] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:33 2022] GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88 => generated 1414 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:33.912475 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-543085a3-de78-4f35-8676-6ebde15b2a67 req-8741209d-61ce-4592-93b4-0030c0e35c40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1512eb0-4637-49c4-a4d5-cdbbd1398473", "name": "network-vif-unplugged", "status": "completed", "tag": "d7d7973b-595c-4769-80dd-0441a733dbfc"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:19:33.934179 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-543085a3-de78-4f35-8676-6ebde15b2a67 req-8741209d-61ce-4592-93b4-0030c0e35c40 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:33.934620 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-543085a3-de78-4f35-8676-6ebde15b2a67 req-8741209d-61ce-4592-93b4-0030c0e35c40 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:33.978374 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-543085a3-de78-4f35-8676-6ebde15b2a67 req-8741209d-61ce-4592-93b4-0030c0e35c40 service nova] Creating event network-vif-unplugged:d7d7973b-595c-4769-80dd-0441a733dbfc for instance a1512eb0-4637-49c4-a4d5-cdbbd1398473 on n-h2-master-1 Jun 20 12:19:33.993435 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:34.017583 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [req-543085a3-de78-4f35-8676-6ebde15b2a67 req-8741209d-61ce-4592-93b4-0030c0e35c40 service nova] Instance a1512eb0-4637-49c4-a4d5-cdbbd1398473 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:19:34.046999 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-543085a3-de78-4f35-8676-6ebde15b2a67 req-8741209d-61ce-4592-93b4-0030c0e35c40 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.138350 Jun 20 12:19:34.054202 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2262/4628] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:19:34.092138 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-30a43a1d-4bda-4966-aca4-edf583c9bc71 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:34.093916 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-30a43a1d-4bda-4966-aca4-edf583c9bc71 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:34.107635 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-30a43a1d-4bda-4966-aca4-edf583c9bc71 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:34.108523 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-30a43a1d-4bda-4966-aca4-edf583c9bc71 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:34.109710 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-30a43a1d-4bda-4966-aca4-edf583c9bc71 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:34.110438 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-30a43a1d-4bda-4966-aca4-edf583c9bc71 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:34.364027 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-970e81ef-25d2-4ca1-b821-954e2f1ae9d8 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:34.373332 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-970e81ef-25d2-4ca1-b821-954e2f1ae9d8 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:34.376139 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=84 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:34.425625 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-970e81ef-25d2-4ca1-b821-954e2f1ae9d8 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:34.426411 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-970e81ef-25d2-4ca1-b821-954e2f1ae9d8 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:34.430691 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-970e81ef-25d2-4ca1-b821-954e2f1ae9d8 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:34.432575 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-970e81ef-25d2-4ca1-b821-954e2f1ae9d8 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:34.517789 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-30a43a1d-4bda-4966-aca4-edf583c9bc71 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:34.529596 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-30a43a1d-4bda-4966-aca4-edf583c9bc71 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1688 microversion: 2.1 time: 0.442310 Jun 20 12:19:34.540623 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2367/4629] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:19:34 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1688 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:19:34.553777 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e61895f4-9e43-47e8-9068-317e841a67b3 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:34.554473 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e61895f4-9e43-47e8-9068-317e841a67b3 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] [instance: 9f436d6d-3f0b-4a5c-af39-05dfebf8da88] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:34.569280 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e61895f4-9e43-47e8-9068-317e841a67b3 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:34.570205 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e61895f4-9e43-47e8-9068-317e841a67b3 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:34.571246 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e61895f4-9e43-47e8-9068-317e841a67b3 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:34.571880 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e61895f4-9e43-47e8-9068-317e841a67b3 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:34.714941 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e61895f4-9e43-47e8-9068-317e841a67b3 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:34.743727 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e61895f4-9e43-47e8-9068-317e841a67b3 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:34.751277 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e61895f4-9e43-47e8-9068-317e841a67b3 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:34.756507 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e61895f4-9e43-47e8-9068-317e841a67b3 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] 10.222.0.27 "GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88" status: 200 len: 1414 microversion: 2.54 time: 0.211806 Jun 20 12:19:34.757558 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2368/4630] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:34 2022] GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88 => generated 1414 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:35.552292 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9a62ce93-2fc4-44c2-8cb6-6228108c91d3 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:35.555171 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9a62ce93-2fc4-44c2-8cb6-6228108c91d3 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:35.581813 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a62ce93-2fc4-44c2-8cb6-6228108c91d3 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:35.583106 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a62ce93-2fc4-44c2-8cb6-6228108c91d3 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:35.586352 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a62ce93-2fc4-44c2-8cb6-6228108c91d3 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:35.587108 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a62ce93-2fc4-44c2-8cb6-6228108c91d3 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:35.799379 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-970e81ef-25d2-4ca1-b821-954e2f1ae9d8 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:35.809189 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-970e81ef-25d2-4ca1-b821-954e2f1ae9d8 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:35.810575 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-970e81ef-25d2-4ca1-b821-954e2f1ae9d8 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:35.811794 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-970e81ef-25d2-4ca1-b821-954e2f1ae9d8 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1731 microversion: 2.20 time: 1.462103 Jun 20 12:19:35.832728 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2263/4631] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:34 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1731 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:19:35.846917 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1f920309-079e-47f5-ae03-be0ecdfa43ab tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:35.851433 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1f920309-079e-47f5-ae03-be0ecdfa43ab tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] [instance: 9f436d6d-3f0b-4a5c-af39-05dfebf8da88] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:35.858408 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f920309-079e-47f5-ae03-be0ecdfa43ab tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:35.859198 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f920309-079e-47f5-ae03-be0ecdfa43ab tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:35.860400 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f920309-079e-47f5-ae03-be0ecdfa43ab tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:35.861105 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f920309-079e-47f5-ae03-be0ecdfa43ab tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:36.002048 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1f920309-079e-47f5-ae03-be0ecdfa43ab tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:36.010923 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1f920309-079e-47f5-ae03-be0ecdfa43ab tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:36.022319 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1f920309-079e-47f5-ae03-be0ecdfa43ab tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:36.023600 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1f920309-079e-47f5-ae03-be0ecdfa43ab tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] 10.222.0.27 "GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88" status: 200 len: 1399 microversion: 2.54 time: 0.189660 Jun 20 12:19:36.024192 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2264/4632] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:35 2022] GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88 => generated 1399 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:36.047079 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e01a6906-c28e-412e-84f1-d01428597be8 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Calling method '.version_select at 0x7f6072525790>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:36.102001 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e01a6906-c28e-412e-84f1-d01428597be8 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1585141552" status: 204 len: 0 microversion: 2.54 time: 0.059468 Jun 20 12:19:36.103019 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2265/4633] 10.222.0.27 () {60 vars in 1318 bytes} [Mon Jun 20 12:19:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1585141552 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 12:19:36.121343 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-0c8650d8-03d2-4398-b7f0-44a034c800e5 req-c5481dac-37ef-4f45-a40a-6200c89320a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1512eb0-4637-49c4-a4d5-cdbbd1398473", "tag": "d7d7973b-595c-4769-80dd-0441a733dbfc"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:19:36.146386 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-0c8650d8-03d2-4398-b7f0-44a034c800e5 req-c5481dac-37ef-4f45-a40a-6200c89320a8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:36.148025 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-0c8650d8-03d2-4398-b7f0-44a034c800e5 req-c5481dac-37ef-4f45-a40a-6200c89320a8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:36.180010 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-0c8650d8-03d2-4398-b7f0-44a034c800e5 req-c5481dac-37ef-4f45-a40a-6200c89320a8 service nova] Creating event network-changed:d7d7973b-595c-4769-80dd-0441a733dbfc for instance a1512eb0-4637-49c4-a4d5-cdbbd1398473 on n-h2-master-1 Jun 20 12:19:36.206646 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [req-0c8650d8-03d2-4398-b7f0-44a034c800e5 req-c5481dac-37ef-4f45-a40a-6200c89320a8 service nova] Instance a1512eb0-4637-49c4-a4d5-cdbbd1398473 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:19:36.232156 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-0c8650d8-03d2-4398-b7f0-44a034c800e5 req-c5481dac-37ef-4f45-a40a-6200c89320a8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127358 Jun 20 12:19:36.236161 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2266/4634] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:19:36.246509 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-aa953cfd-ea20-47ee-b519-abbc40e349c8 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:36.251574 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-aa953cfd-ea20-47ee-b519-abbc40e349c8 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] [instance: 9f436d6d-3f0b-4a5c-af39-05dfebf8da88] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:36.275744 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aa953cfd-ea20-47ee-b519-abbc40e349c8 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:36.276621 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aa953cfd-ea20-47ee-b519-abbc40e349c8 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:36.278036 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aa953cfd-ea20-47ee-b519-abbc40e349c8 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:36.278490 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aa953cfd-ea20-47ee-b519-abbc40e349c8 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:36.357080 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-aa953cfd-ea20-47ee-b519-abbc40e349c8 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] [instance: 9f436d6d-3f0b-4a5c-af39-05dfebf8da88] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:19:36.454449 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9a62ce93-2fc4-44c2-8cb6-6228108c91d3 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:36.474067 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9a62ce93-2fc4-44c2-8cb6-6228108c91d3 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1688 microversion: 2.1 time: 0.930497 Jun 20 12:19:36.477757 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2369/4635] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:19:35 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1688 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:19:36.551359 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-aa953cfd-ea20-47ee-b519-abbc40e349c8 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88" status: 204 len: 0 microversion: 2.54 time: 0.312139 Jun 20 12:19:36.554332 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2267/4636] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Jun 20 12:19:36 2022] DELETE /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 12:19:36.564315 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a61716f0-dd56-4871-935e-061a6a7dca9e tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:36.566476 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a61716f0-dd56-4871-935e-061a6a7dca9e tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] [instance: 9f436d6d-3f0b-4a5c-af39-05dfebf8da88] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:36.581196 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a61716f0-dd56-4871-935e-061a6a7dca9e tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:36.581884 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a61716f0-dd56-4871-935e-061a6a7dca9e tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:36.583021 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a61716f0-dd56-4871-935e-061a6a7dca9e tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:36.585938 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a61716f0-dd56-4871-935e-061a6a7dca9e tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:36.818631 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a61716f0-dd56-4871-935e-061a6a7dca9e tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:36.841207 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a61716f0-dd56-4871-935e-061a6a7dca9e tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:36.849563 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a61716f0-dd56-4871-935e-061a6a7dca9e tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:36.850855 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a61716f0-dd56-4871-935e-061a6a7dca9e tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] 10.222.0.27 "GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88" status: 200 len: 1405 microversion: 2.54 time: 0.293449 Jun 20 12:19:36.851449 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2370/4637] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:36 2022] GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88 => generated 1405 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:36.865729 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4169ae18-2f5a-4dda-8b6f-95214b23f848 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:36.866467 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4169ae18-2f5a-4dda-8b6f-95214b23f848 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:36.882701 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4169ae18-2f5a-4dda-8b6f-95214b23f848 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:36.885047 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4169ae18-2f5a-4dda-8b6f-95214b23f848 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:36.918092 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4169ae18-2f5a-4dda-8b6f-95214b23f848 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:36.920423 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4169ae18-2f5a-4dda-8b6f-95214b23f848 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:37.495192 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a6a6e1e7-54f8-4fde-be19-eaf998e134bd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:37.496050 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a6a6e1e7-54f8-4fde-be19-eaf998e134bd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:37.510041 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a6a6e1e7-54f8-4fde-be19-eaf998e134bd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:37.510508 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a6a6e1e7-54f8-4fde-be19-eaf998e134bd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:37.511313 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a6a6e1e7-54f8-4fde-be19-eaf998e134bd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:37.511756 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a6a6e1e7-54f8-4fde-be19-eaf998e134bd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:37.657357 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4169ae18-2f5a-4dda-8b6f-95214b23f848 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:37.669128 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4169ae18-2f5a-4dda-8b6f-95214b23f848 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:37.676640 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4169ae18-2f5a-4dda-8b6f-95214b23f848 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:37.680862 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4169ae18-2f5a-4dda-8b6f-95214b23f848 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1731 microversion: 2.20 time: 0.832781 Jun 20 12:19:37.682209 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2268/4638] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:36 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1731 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:37.876557 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6e55f37c-0405-40a4-9515-ded664802989 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:37.877200 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6e55f37c-0405-40a4-9515-ded664802989 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] [instance: 9f436d6d-3f0b-4a5c-af39-05dfebf8da88] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:37.890739 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6e55f37c-0405-40a4-9515-ded664802989 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:37.891272 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6e55f37c-0405-40a4-9515-ded664802989 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:37.892363 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6e55f37c-0405-40a4-9515-ded664802989 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:37.897005 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6e55f37c-0405-40a4-9515-ded664802989 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:38.110493 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6e55f37c-0405-40a4-9515-ded664802989 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:38.126971 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6e55f37c-0405-40a4-9515-ded664802989 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:38.129955 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6e55f37c-0405-40a4-9515-ded664802989 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0adb999abcdf41dab8406791ed696f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3e310ab28947569b8dd690bec6d53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:38.136055 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6e55f37c-0405-40a4-9515-ded664802989 tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] 10.222.0.27 "GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88" status: 200 len: 1405 microversion: 2.54 time: 0.269385 Jun 20 12:19:38.150767 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2269/4639] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:37 2022] GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88 => generated 1405 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:19:38.700456 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fe5d0230-16d3-49d7-9d51-8a3f503c0800 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:38.705343 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fe5d0230-16d3-49d7-9d51-8a3f503c0800 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:38.738135 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe5d0230-16d3-49d7-9d51-8a3f503c0800 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:38.739101 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe5d0230-16d3-49d7-9d51-8a3f503c0800 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:38.740649 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe5d0230-16d3-49d7-9d51-8a3f503c0800 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:38.741265 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe5d0230-16d3-49d7-9d51-8a3f503c0800 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:38.807005 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a6a6e1e7-54f8-4fde-be19-eaf998e134bd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:38.821334 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a6a6e1e7-54f8-4fde-be19-eaf998e134bd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1688 microversion: 2.1 time: 1.331131 Jun 20 12:19:38.838119 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2371/4640] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:19:37 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1688 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:19:38.992447 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fe5d0230-16d3-49d7-9d51-8a3f503c0800 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:39.013628 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fe5d0230-16d3-49d7-9d51-8a3f503c0800 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:39.016025 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fe5d0230-16d3-49d7-9d51-8a3f503c0800 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:39.017520 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fe5d0230-16d3-49d7-9d51-8a3f503c0800 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1731 microversion: 2.20 time: 0.321695 Jun 20 12:19:39.018985 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2270/4641] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:38 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1731 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:19:39.167689 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6b861254-6267-479c-a84f-f2aff1b4289b tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:39.168662 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6b861254-6267-479c-a84f-f2aff1b4289b tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] [instance: 9f436d6d-3f0b-4a5c-af39-05dfebf8da88] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:39.202032 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6b861254-6267-479c-a84f-f2aff1b4289b tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:39.204103 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6b861254-6267-479c-a84f-f2aff1b4289b tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:39.208701 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6b861254-6267-479c-a84f-f2aff1b4289b tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:39.209429 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6b861254-6267-479c-a84f-f2aff1b4289b tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:39.233742 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-6b861254-6267-479c-a84f-f2aff1b4289b tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] HTTP exception thrown: Instance 9f436d6d-3f0b-4a5c-af39-05dfebf8da88 could not be found. Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6b861254-6267-479c-a84f-f2aff1b4289b tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Request method failure captured: Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88 HTTP/1.1 Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGWxk1fiHMCqBoLou3J2Bo4CsVKWzrNYmJeuuHXsfhEy1rm1vn4GmyiJBs1osuOsRR-axRWc3Z9ljoLcCUk0p6w4eOYEwDLqV_Jpp_tb_F87CPOO43iVG66FWM6eBhR21-0vo-lb1ZsjLyP4Z17s4uFCUM5keiNMjtvWuFid7Vt9ybU Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: X-Openstack-Nova-Api-Version: 2.54 Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 3b3e310ab28947569b8dd690bec6d53c Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServerShowV254Test-735822708 Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3b3e310ab28947569b8dd690bec6d53c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3b3e310ab28947569b8dd690bec6d53c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3b3e310ab28947569b8dd690bec6d53c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3b3e310ab28947569b8dd690bec6d53c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServerShowV254Test-735822708 Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 3b3e310ab28947569b8dd690bec6d53c Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServerShowV254Test-735822708 Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServerShowV254Test-735822708-project Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 0adb999abcdf41dab8406791ed696f94 Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServerShowV254Test-735822708-project Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 9f436d6d-3f0b-4a5c-af39-05dfebf8da88 could not be found. Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '9f436d6d-3f0b-4a5c-af39-05dfebf8da88'} Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f436d6d-3f0b-4a5c-af39-05dfebf8da88 could not be found. Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f436d6d-3f0b-4a5c-af39-05dfebf8da88 could not be found. Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:19:39.237360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:19:39.243577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:19:39.243577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:19:39.243577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:19:39.243577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:19:39.243577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:19:39.243577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f436d6d-3f0b-4a5c-af39-05dfebf8da88 could not be found. Jun 20 12:19:39.243577 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:19:39.245217 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6b861254-6267-479c-a84f-f2aff1b4289b tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] Returning 404 to user: Instance 9f436d6d-3f0b-4a5c-af39-05dfebf8da88 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:19:39.249384 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6b861254-6267-479c-a84f-f2aff1b4289b tempest-ServerShowV254Test-735822708 tempest-ServerShowV254Test-735822708-project] 10.222.0.27 "GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88" status: 404 len: 111 microversion: 2.54 time: 0.085696 Jun 20 12:19:39.250534 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2372/4642] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:39 2022] GET /compute/v2.1/servers/9f436d6d-3f0b-4a5c-af39-05dfebf8da88 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:19:39.849967 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-21be43bd-cf95-46af-9d4d-ae2368258608 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:39.852312 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-21be43bd-cf95-46af-9d4d-ae2368258608 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:39.860092 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-21be43bd-cf95-46af-9d4d-ae2368258608 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:39.860578 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-21be43bd-cf95-46af-9d4d-ae2368258608 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:39.861365 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-21be43bd-cf95-46af-9d4d-ae2368258608 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:39.861806 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-21be43bd-cf95-46af-9d4d-ae2368258608 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:40.040644 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b824ff17-b29d-4b5b-9718-e036fdd4ecaa tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:40.041296 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b824ff17-b29d-4b5b-9718-e036fdd4ecaa tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:40.044608 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-21be43bd-cf95-46af-9d4d-ae2368258608 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:40.052083 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b824ff17-b29d-4b5b-9718-e036fdd4ecaa tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:40.052643 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b824ff17-b29d-4b5b-9718-e036fdd4ecaa tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:40.053778 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b824ff17-b29d-4b5b-9718-e036fdd4ecaa tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:40.054658 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b824ff17-b29d-4b5b-9718-e036fdd4ecaa tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:40.055164 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-21be43bd-cf95-46af-9d4d-ae2368258608 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1688 microversion: 2.1 time: 0.212781 Jun 20 12:19:40.067271 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2271/4643] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:19:39 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1688 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:19:40.365271 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b824ff17-b29d-4b5b-9718-e036fdd4ecaa tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:40.380132 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b824ff17-b29d-4b5b-9718-e036fdd4ecaa tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:40.396091 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b824ff17-b29d-4b5b-9718-e036fdd4ecaa tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:40.401683 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b824ff17-b29d-4b5b-9718-e036fdd4ecaa tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1731 microversion: 2.20 time: 0.368323 Jun 20 12:19:40.403030 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2373/4644] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:40 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1731 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:41.081874 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1de4b7ab-fa9f-436a-913d-ea424ee5c577 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:41.086029 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1de4b7ab-fa9f-436a-913d-ea424ee5c577 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:41.101432 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1de4b7ab-fa9f-436a-913d-ea424ee5c577 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:41.102275 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1de4b7ab-fa9f-436a-913d-ea424ee5c577 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:41.103212 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1de4b7ab-fa9f-436a-913d-ea424ee5c577 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:41.103815 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1de4b7ab-fa9f-436a-913d-ea424ee5c577 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:41.189961 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-753d7163-597d-4211-82da-1e80edd15a70 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:41.190490 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-753d7163-597d-4211-82da-1e80edd15a70 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:41.203775 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-753d7163-597d-4211-82da-1e80edd15a70 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:41.209606 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-753d7163-597d-4211-82da-1e80edd15a70 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:41.210632 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-753d7163-597d-4211-82da-1e80edd15a70 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:41.221008 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-753d7163-597d-4211-82da-1e80edd15a70 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:41.560803 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-753d7163-597d-4211-82da-1e80edd15a70 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:41.573360 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-753d7163-597d-4211-82da-1e80edd15a70 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.388183 Jun 20 12:19:41.600746 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2374/4645] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:19:41 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:19:41.628907 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-87b81d46-0aab-4f51-ae48-fa1f3df400c1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:41.633427 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-87b81d46-0aab-4f51-ae48-fa1f3df400c1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:41.641795 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-87b81d46-0aab-4f51-ae48-fa1f3df400c1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:41.642678 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-87b81d46-0aab-4f51-ae48-fa1f3df400c1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:41.643908 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-87b81d46-0aab-4f51-ae48-fa1f3df400c1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:41.644620 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-87b81d46-0aab-4f51-ae48-fa1f3df400c1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:41.744967 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1de4b7ab-fa9f-436a-913d-ea424ee5c577 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:41.754603 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1de4b7ab-fa9f-436a-913d-ea424ee5c577 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1688 microversion: 2.1 time: 0.684667 Jun 20 12:19:41.761493 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2272/4646] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:19:41 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1688 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:19:41.768527 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c7f81973-ac39-49cd-93a1-26b8fd34baa8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:41.773746 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c7f81973-ac39-49cd-93a1-26b8fd34baa8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:41.784032 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c7f81973-ac39-49cd-93a1-26b8fd34baa8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:41.784552 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c7f81973-ac39-49cd-93a1-26b8fd34baa8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:41.788277 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c7f81973-ac39-49cd-93a1-26b8fd34baa8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:41.788788 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c7f81973-ac39-49cd-93a1-26b8fd34baa8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:42.104499 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-87b81d46-0aab-4f51-ae48-fa1f3df400c1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:42.126744 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-87b81d46-0aab-4f51-ae48-fa1f3df400c1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:42.130548 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-87b81d46-0aab-4f51-ae48-fa1f3df400c1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:42.132100 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-87b81d46-0aab-4f51-ae48-fa1f3df400c1 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1731 microversion: 2.20 time: 0.507903 Jun 20 12:19:42.133471 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2375/4647] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:41 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1731 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:42.138307 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c7f81973-ac39-49cd-93a1-26b8fd34baa8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:42.147681 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c7f81973-ac39-49cd-93a1-26b8fd34baa8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.385009 Jun 20 12:19:42.153034 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2273/4648] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:19:41 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:19:42.168081 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9f9ce9e0-d41e-4b56-863d-12025be6bf93 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:42.169106 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9f9ce9e0-d41e-4b56-863d-12025be6bf93 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:42.178432 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9f9ce9e0-d41e-4b56-863d-12025be6bf93 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:42.180900 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9f9ce9e0-d41e-4b56-863d-12025be6bf93 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:42.181733 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9f9ce9e0-d41e-4b56-863d-12025be6bf93 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:42.182190 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9f9ce9e0-d41e-4b56-863d-12025be6bf93 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:42.712712 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9f9ce9e0-d41e-4b56-863d-12025be6bf93 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:42.729300 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9f9ce9e0-d41e-4b56-863d-12025be6bf93 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.566469 Jun 20 12:19:42.740273 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2376/4649] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:19:42 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:19:42.751588 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9f6e686a-f1d5-46aa-8e9d-af2271aee5ca tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1345801766"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:19:42.753635 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9f6e686a-f1d5-46aa-8e9d-af2271aee5ca tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:42.771353 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9f6e686a-f1d5-46aa-8e9d-af2271aee5ca tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:42.771965 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9f6e686a-f1d5-46aa-8e9d-af2271aee5ca tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:42.775667 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9f6e686a-f1d5-46aa-8e9d-af2271aee5ca tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:42.776620 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9f6e686a-f1d5-46aa-8e9d-af2271aee5ca tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:42.778986 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c895071e-9793-4c28-a2de-1cf4ca9f06f9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:42.780297 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c895071e-9793-4c28-a2de-1cf4ca9f06f9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:42.807440 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c895071e-9793-4c28-a2de-1cf4ca9f06f9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:42.807941 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c895071e-9793-4c28-a2de-1cf4ca9f06f9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:42.808773 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c895071e-9793-4c28-a2de-1cf4ca9f06f9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:42.809221 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c895071e-9793-4c28-a2de-1cf4ca9f06f9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:42.839389 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:43.331809 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c895071e-9793-4c28-a2de-1cf4ca9f06f9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:43.347378 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c895071e-9793-4c28-a2de-1cf4ca9f06f9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1688 microversion: 2.1 time: 0.577198 Jun 20 12:19:43.349723 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2377/4650] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:19:42 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1688 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:19:43.357379 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-61c2c714-0ccb-4f56-99ef-4bb139170f43 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:43.371904 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-61c2c714-0ccb-4f56-99ef-4bb139170f43 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:43.380869 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-61c2c714-0ccb-4f56-99ef-4bb139170f43 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:43.381704 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-61c2c714-0ccb-4f56-99ef-4bb139170f43 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:43.383398 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-61c2c714-0ccb-4f56-99ef-4bb139170f43 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:43.387047 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-61c2c714-0ccb-4f56-99ef-4bb139170f43 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:43.702547 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9f6e686a-f1d5-46aa-8e9d-af2271aee5ca tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "POST /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/action" status: 202 len: 0 microversion: 2.1 time: 0.953235 Jun 20 12:19:43.731157 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2274/4651] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:19:42 2022] POST /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/action => generated 0 bytes in 985 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jun 20 12:19:44.373156 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1940b11b-ac88-4f22-99bd-04391b8d5de9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:44.379578 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1940b11b-ac88-4f22-99bd-04391b8d5de9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:44.423720 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1940b11b-ac88-4f22-99bd-04391b8d5de9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:44.431137 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1940b11b-ac88-4f22-99bd-04391b8d5de9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:44.434248 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1940b11b-ac88-4f22-99bd-04391b8d5de9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:44.436276 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1940b11b-ac88-4f22-99bd-04391b8d5de9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:45.025196 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1940b11b-ac88-4f22-99bd-04391b8d5de9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:45.044626 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1940b11b-ac88-4f22-99bd-04391b8d5de9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1681 microversion: 2.1 time: 0.681021 Jun 20 12:19:45.062216 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2275/4652] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:19:44 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1681 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:19:45.309317 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-61c2c714-0ccb-4f56-99ef-4bb139170f43 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:45.355642 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-61c2c714-0ccb-4f56-99ef-4bb139170f43 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:45.363759 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-61c2c714-0ccb-4f56-99ef-4bb139170f43 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:45.377383 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-61c2c714-0ccb-4f56-99ef-4bb139170f43 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1731 microversion: 2.20 time: 2.023740 Jun 20 12:19:45.379271 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2378/4653] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:43 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1731 bytes in 2029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:46.398235 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f2196e31-f885-4777-a21a-8ef220a9e405 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:46.399586 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f2196e31-f885-4777-a21a-8ef220a9e405 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:46.416260 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f2196e31-f885-4777-a21a-8ef220a9e405 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:46.416723 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f2196e31-f885-4777-a21a-8ef220a9e405 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:46.422599 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f2196e31-f885-4777-a21a-8ef220a9e405 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:46.423351 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f2196e31-f885-4777-a21a-8ef220a9e405 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:47.676491 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f2196e31-f885-4777-a21a-8ef220a9e405 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:47.695131 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f2196e31-f885-4777-a21a-8ef220a9e405 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:47.701500 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f2196e31-f885-4777-a21a-8ef220a9e405 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:47.705379 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f2196e31-f885-4777-a21a-8ef220a9e405 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1731 microversion: 2.20 time: 1.309419 Jun 20 12:19:47.719249 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2276/4654] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:46 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1731 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:48.666069 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-5197d838-e714-4aae-849f-3b4a34924906 req-227988cc-7c7c-4b66-a58e-264ca1f0fc51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1512eb0-4637-49c4-a4d5-cdbbd1398473", "name": "network-vif-plugged", "status": "completed", "tag": "d7d7973b-595c-4769-80dd-0441a733dbfc"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:19:48.671776 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=82 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:48.709725 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-5197d838-e714-4aae-849f-3b4a34924906 req-227988cc-7c7c-4b66-a58e-264ca1f0fc51 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:48.710599 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-5197d838-e714-4aae-849f-3b4a34924906 req-227988cc-7c7c-4b66-a58e-264ca1f0fc51 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:48.738326 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2961f2b3-9cae-459d-a448-71d1762ee30d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:48.739428 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2961f2b3-9cae-459d-a448-71d1762ee30d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:48.786241 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-5197d838-e714-4aae-849f-3b4a34924906 req-227988cc-7c7c-4b66-a58e-264ca1f0fc51 service nova] Creating event network-vif-plugged:d7d7973b-595c-4769-80dd-0441a733dbfc for instance a1512eb0-4637-49c4-a4d5-cdbbd1398473 on n-h2-master-1 Jun 20 12:19:48.792413 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2961f2b3-9cae-459d-a448-71d1762ee30d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:48.793788 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2961f2b3-9cae-459d-a448-71d1762ee30d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:48.794966 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2961f2b3-9cae-459d-a448-71d1762ee30d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:48.795436 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2961f2b3-9cae-459d-a448-71d1762ee30d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:48.815910 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-5197d838-e714-4aae-849f-3b4a34924906 req-227988cc-7c7c-4b66-a58e-264ca1f0fc51 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153990 Jun 20 12:19:48.819987 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2379/4655] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:19:49.199788 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2961f2b3-9cae-459d-a448-71d1762ee30d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:49.205308 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:49.217644 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2961f2b3-9cae-459d-a448-71d1762ee30d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:49.228603 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2961f2b3-9cae-459d-a448-71d1762ee30d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:49.242027 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2961f2b3-9cae-459d-a448-71d1762ee30d tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1731 microversion: 2.20 time: 0.517715 Jun 20 12:19:49.242755 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2277/4656] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:48 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1731 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:50.262593 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bd69bf03-45d2-4425-b492-e5e164896f22 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:50.263218 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bd69bf03-45d2-4425-b492-e5e164896f22 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:50.276024 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bd69bf03-45d2-4425-b492-e5e164896f22 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:50.276743 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bd69bf03-45d2-4425-b492-e5e164896f22 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:50.281141 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bd69bf03-45d2-4425-b492-e5e164896f22 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:50.281603 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bd69bf03-45d2-4425-b492-e5e164896f22 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:50.769384 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bd69bf03-45d2-4425-b492-e5e164896f22 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:50.785863 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bd69bf03-45d2-4425-b492-e5e164896f22 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:50.787853 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bd69bf03-45d2-4425-b492-e5e164896f22 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:50.789382 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bd69bf03-45d2-4425-b492-e5e164896f22 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1731 microversion: 2.20 time: 0.532338 Jun 20 12:19:50.813269 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2380/4657] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:50 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1731 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:51.823167 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-628fd0a7-39c7-495a-9c4e-dd141fb2e337 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:51.824250 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-628fd0a7-39c7-495a-9c4e-dd141fb2e337 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:51.839394 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-628fd0a7-39c7-495a-9c4e-dd141fb2e337 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:51.841124 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-628fd0a7-39c7-495a-9c4e-dd141fb2e337 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:51.844303 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-628fd0a7-39c7-495a-9c4e-dd141fb2e337 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:51.844945 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-628fd0a7-39c7-495a-9c4e-dd141fb2e337 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:51.991962 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-8de44b3b-10e7-4df5-ae96-8b94fe60a009 req-628411ad-bb25-4f25-a331-6740ba5813c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21609be7-c3f0-4e24-a093-2f74ce957a35", "name": "network-vif-plugged", "status": "completed", "tag": "23a9a38f-112e-4e3f-97f4-ae81b6b5af7c"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:19:52.006888 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-8de44b3b-10e7-4df5-ae96-8b94fe60a009 req-628411ad-bb25-4f25-a331-6740ba5813c1 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:52.007336 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-8de44b3b-10e7-4df5-ae96-8b94fe60a009 req-628411ad-bb25-4f25-a331-6740ba5813c1 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:52.059359 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-8de44b3b-10e7-4df5-ae96-8b94fe60a009 req-628411ad-bb25-4f25-a331-6740ba5813c1 service nova] Creating event network-vif-plugged:23a9a38f-112e-4e3f-97f4-ae81b6b5af7c for instance 21609be7-c3f0-4e24-a093-2f74ce957a35 on n-h1-master-1 Jun 20 12:19:52.070353 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-8de44b3b-10e7-4df5-ae96-8b94fe60a009 req-628411ad-bb25-4f25-a331-6740ba5813c1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082249 Jun 20 12:19:52.071580 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2381/4658] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:19:52.514540 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-628fd0a7-39c7-495a-9c4e-dd141fb2e337 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:52.550271 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-628fd0a7-39c7-495a-9c4e-dd141fb2e337 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:52.555747 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-628fd0a7-39c7-495a-9c4e-dd141fb2e337 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:52.560151 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-628fd0a7-39c7-495a-9c4e-dd141fb2e337 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1731 microversion: 2.20 time: 0.743330 Jun 20 12:19:52.562125 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2278/4659] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:51 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1731 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:53.585407 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d4aa8d6d-63cd-4372-bb27-af9e33dff710 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:53.587498 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d4aa8d6d-63cd-4372-bb27-af9e33dff710 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:53.614696 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d4aa8d6d-63cd-4372-bb27-af9e33dff710 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:53.615428 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d4aa8d6d-63cd-4372-bb27-af9e33dff710 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:53.617352 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d4aa8d6d-63cd-4372-bb27-af9e33dff710 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:53.621411 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d4aa8d6d-63cd-4372-bb27-af9e33dff710 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:54.841106 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d4aa8d6d-63cd-4372-bb27-af9e33dff710 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:54.853677 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d4aa8d6d-63cd-4372-bb27-af9e33dff710 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:54.859952 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d4aa8d6d-63cd-4372-bb27-af9e33dff710 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:54.863041 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d4aa8d6d-63cd-4372-bb27-af9e33dff710 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1731 microversion: 2.20 time: 1.285019 Jun 20 12:19:54.883980 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2382/4660] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:53 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1731 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:55.892588 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-02aa8724-8cd5-4959-a570-d9c1a71d489b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:55.893829 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-02aa8724-8cd5-4959-a570-d9c1a71d489b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:55.911868 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-02aa8724-8cd5-4959-a570-d9c1a71d489b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:55.912875 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-02aa8724-8cd5-4959-a570-d9c1a71d489b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:55.926199 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-02aa8724-8cd5-4959-a570-d9c1a71d489b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:55.929981 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-02aa8724-8cd5-4959-a570-d9c1a71d489b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:56.540112 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-02aa8724-8cd5-4959-a570-d9c1a71d489b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:56.555620 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-02aa8724-8cd5-4959-a570-d9c1a71d489b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:56.559259 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-02aa8724-8cd5-4959-a570-d9c1a71d489b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:56.563143 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-02aa8724-8cd5-4959-a570-d9c1a71d489b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1731 microversion: 2.20 time: 0.675908 Jun 20 12:19:56.566516 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2279/4661] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:55 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1731 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:57.582844 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-61d2066b-87fd-4bb4-b9eb-fe300bb50a8b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:57.583465 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-61d2066b-87fd-4bb4-b9eb-fe300bb50a8b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:57.601028 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-61d2066b-87fd-4bb4-b9eb-fe300bb50a8b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:57.601741 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-61d2066b-87fd-4bb4-b9eb-fe300bb50a8b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:57.602718 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-61d2066b-87fd-4bb4-b9eb-fe300bb50a8b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:57.605883 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-61d2066b-87fd-4bb4-b9eb-fe300bb50a8b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:57.969320 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-61d2066b-87fd-4bb4-b9eb-fe300bb50a8b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:57.988361 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-61d2066b-87fd-4bb4-b9eb-fe300bb50a8b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:57.994878 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-61d2066b-87fd-4bb4-b9eb-fe300bb50a8b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:57.996895 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-61d2066b-87fd-4bb4-b9eb-fe300bb50a8b tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1731 microversion: 2.20 time: 0.418280 Jun 20 12:19:58.000252 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2383/4662] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:57 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1731 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:19:59.021740 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f747a270-65a3-49b9-9584-2134b81067ff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:19:59.024324 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f747a270-65a3-49b9-9584-2134b81067ff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:19:59.053797 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f747a270-65a3-49b9-9584-2134b81067ff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:59.057239 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f747a270-65a3-49b9-9584-2134b81067ff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:59.061595 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f747a270-65a3-49b9-9584-2134b81067ff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:19:59.064843 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f747a270-65a3-49b9-9584-2134b81067ff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:19:59.771934 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f747a270-65a3-49b9-9584-2134b81067ff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:59.787051 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f747a270-65a3-49b9-9584-2134b81067ff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:59.792505 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f747a270-65a3-49b9-9584-2134b81067ff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:19:59.796586 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f747a270-65a3-49b9-9584-2134b81067ff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1731 microversion: 2.20 time: 0.780847 Jun 20 12:19:59.799543 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2280/4663] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:19:59 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1731 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:20:00.820356 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e19f0060-f753-489d-ac8e-cf426b7c84c8 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:00.821743 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e19f0060-f753-489d-ac8e-cf426b7c84c8 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:00.844461 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e19f0060-f753-489d-ac8e-cf426b7c84c8 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:00.845324 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e19f0060-f753-489d-ac8e-cf426b7c84c8 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:00.846807 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e19f0060-f753-489d-ac8e-cf426b7c84c8 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:00.847493 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e19f0060-f753-489d-ac8e-cf426b7c84c8 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:01.017971 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-f13ca076-ef24-4fee-b3dc-295eb2d67f4a req-1256ce6e-9a90-4974-89d4-8d719cc25963 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ed20ca4-7f49-4d0a-a590-d2d4274698e3", "name": "network-vif-plugged", "status": "completed", "tag": "4bb9ec16-a224-4e67-8de4-0415485dde23"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:20:01.037040 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-f13ca076-ef24-4fee-b3dc-295eb2d67f4a req-1256ce6e-9a90-4974-89d4-8d719cc25963 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:01.043637 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-f13ca076-ef24-4fee-b3dc-295eb2d67f4a req-1256ce6e-9a90-4974-89d4-8d719cc25963 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:01.078083 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-f13ca076-ef24-4fee-b3dc-295eb2d67f4a req-1256ce6e-9a90-4974-89d4-8d719cc25963 service nova] Creating event network-vif-plugged:4bb9ec16-a224-4e67-8de4-0415485dde23 for instance 6ed20ca4-7f49-4d0a-a590-d2d4274698e3 on n-h2-master-1 Jun 20 12:20:01.096188 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-f13ca076-ef24-4fee-b3dc-295eb2d67f4a req-1256ce6e-9a90-4974-89d4-8d719cc25963 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095384 Jun 20 12:20:01.097324 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2281/4664] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:20:01.908480 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e19f0060-f753-489d-ac8e-cf426b7c84c8 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:01.942176 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e19f0060-f753-489d-ac8e-cf426b7c84c8 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:01.955715 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e19f0060-f753-489d-ac8e-cf426b7c84c8 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:01.962715 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e19f0060-f753-489d-ac8e-cf426b7c84c8 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1731 microversion: 2.20 time: 1.147164 Jun 20 12:20:01.974334 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2384/4665] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:20:00 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1731 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:20:02.985078 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-269bfff8-64cc-4836-b3fe-8df440288f2c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:02.986387 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-269bfff8-64cc-4836-b3fe-8df440288f2c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:03.018859 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-269bfff8-64cc-4836-b3fe-8df440288f2c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:03.022799 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-269bfff8-64cc-4836-b3fe-8df440288f2c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:03.030682 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-269bfff8-64cc-4836-b3fe-8df440288f2c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:03.032065 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-269bfff8-64cc-4836-b3fe-8df440288f2c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:03.697944 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-269bfff8-64cc-4836-b3fe-8df440288f2c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:03.764016 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-269bfff8-64cc-4836-b3fe-8df440288f2c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:03.765902 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-269bfff8-64cc-4836-b3fe-8df440288f2c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:03.772752 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-269bfff8-64cc-4836-b3fe-8df440288f2c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1731 microversion: 2.20 time: 0.794909 Jun 20 12:20:03.783893 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2282/4666] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:20:02 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1731 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:20:04.801101 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-15d927b1-41ad-4fc0-bf0c-b87fda5d5dff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:04.802500 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-15d927b1-41ad-4fc0-bf0c-b87fda5d5dff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:04.834208 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-15d927b1-41ad-4fc0-bf0c-b87fda5d5dff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:04.838191 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-15d927b1-41ad-4fc0-bf0c-b87fda5d5dff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:04.840851 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-15d927b1-41ad-4fc0-bf0c-b87fda5d5dff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:04.844532 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-15d927b1-41ad-4fc0-bf0c-b87fda5d5dff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:05.675740 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-15d927b1-41ad-4fc0-bf0c-b87fda5d5dff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:05.703847 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-15d927b1-41ad-4fc0-bf0c-b87fda5d5dff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:05.722229 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-15d927b1-41ad-4fc0-bf0c-b87fda5d5dff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:05.725602 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-15d927b1-41ad-4fc0-bf0c-b87fda5d5dff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1731 microversion: 2.20 time: 0.930213 Jun 20 12:20:05.742176 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2385/4667] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:20:04 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1731 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:20:06.753942 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0a52bd41-ef17-464a-84ea-f8b7c5530e3a tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:06.756506 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0a52bd41-ef17-464a-84ea-f8b7c5530e3a tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:06.765871 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:20:06.783934 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a52bd41-ef17-464a-84ea-f8b7c5530e3a tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:06.793393 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a52bd41-ef17-464a-84ea-f8b7c5530e3a tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:06.794547 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a52bd41-ef17-464a-84ea-f8b7c5530e3a tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:06.797777 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a52bd41-ef17-464a-84ea-f8b7c5530e3a tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:07.710069 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0a52bd41-ef17-464a-84ea-f8b7c5530e3a tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:07.727522 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0a52bd41-ef17-464a-84ea-f8b7c5530e3a tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:07.733910 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0a52bd41-ef17-464a-84ea-f8b7c5530e3a tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:07.741912 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0a52bd41-ef17-464a-84ea-f8b7c5530e3a tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1718 microversion: 2.20 time: 0.991758 Jun 20 12:20:07.758389 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2283/4668] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:20:06 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1718 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:20:07.896146 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-63bb77ac-ee25-4ef6-b9b1-fc540b35c704 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:07.902464 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-63bb77ac-ee25-4ef6-b9b1-fc540b35c704 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd640fdee13ca47ae848264ccbc532925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca22edf491394f878e14c2b67fb92816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:07.903376 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-63bb77ac-ee25-4ef6-b9b1-fc540b35c704 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Searching by: {'deleted': False, 'project_id': 'ca22edf491394f878e14c2b67fb92816'} {{(pid=119127) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:20:07.919938 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63bb77ac-ee25-4ef6-b9b1-fc540b35c704 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:07.932616 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63bb77ac-ee25-4ef6-b9b1-fc540b35c704 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:07.935772 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63bb77ac-ee25-4ef6-b9b1-fc540b35c704 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:07.936970 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63bb77ac-ee25-4ef6-b9b1-fc540b35c704 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:08.001266 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.multi_cell_list [None req-63bb77ac-ee25-4ef6-b9b1-fc540b35c704 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119127) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 12:20:08.066492 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-63bb77ac-ee25-4ef6-b9b1-fc540b35c704 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.164717 Jun 20 12:20:08.078045 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2386/4669] 10.222.0.27 () {58 vars in 1124 bytes} [Mon Jun 20 12:20:07 2022] GET /compute/v2.1/servers => generated 334 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:20:08.080846 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a9d0d23f-a4de-4699-8982-844ea36c9061 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:08.084244 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a9d0d23f-a4de-4699-8982-844ea36c9061 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd640fdee13ca47ae848264ccbc532925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca22edf491394f878e14c2b67fb92816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:08.086118 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a9d0d23f-a4de-4699-8982-844ea36c9061 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Searching by: {'deleted': False, 'project_id': 'ca22edf491394f878e14c2b67fb92816'} {{(pid=119128) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:20:08.111521 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a9d0d23f-a4de-4699-8982-844ea36c9061 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:08.112434 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a9d0d23f-a4de-4699-8982-844ea36c9061 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:08.113362 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a9d0d23f-a4de-4699-8982-844ea36c9061 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:08.113808 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a9d0d23f-a4de-4699-8982-844ea36c9061 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:08.210672 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.multi_cell_list [None req-a9d0d23f-a4de-4699-8982-844ea36c9061 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119128) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 12:20:08.321980 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a9d0d23f-a4de-4699-8982-844ea36c9061 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd640fdee13ca47ae848264ccbc532925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca22edf491394f878e14c2b67fb92816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:08.334105 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a9d0d23f-a4de-4699-8982-844ea36c9061 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:08.334574 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a9d0d23f-a4de-4699-8982-844ea36c9061 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:09.126204 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a9d0d23f-a4de-4699-8982-844ea36c9061 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 1.049356 Jun 20 12:20:09.126865 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2284/4670] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 12:20:08 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:20:09.147466 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b4a43a60-8a8c-4c15-8437-2e531cfb2b3a tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:09.169565 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b4a43a60-8a8c-4c15-8437-2e531cfb2b3a tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025625 Jun 20 12:20:09.183721 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2387/4671] 10.222.0.27 () {58 vars in 1136 bytes} [Mon Jun 20 12:20:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:20:09.590815 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-49a926df-5937-445a-8fae-950d4b832c51 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:09.591466 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-49a926df-5937-445a-8fae-950d4b832c51 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] [instance: 68b3feb5-3535-4655-a73f-03ce141df427] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:09.603767 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-49a926df-5937-445a-8fae-950d4b832c51 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:09.605986 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-49a926df-5937-445a-8fae-950d4b832c51 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:09.606696 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-49a926df-5937-445a-8fae-950d4b832c51 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:09.607138 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-49a926df-5937-445a-8fae-950d4b832c51 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:09.679061 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-49a926df-5937-445a-8fae-950d4b832c51 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] [instance: 68b3feb5-3535-4655-a73f-03ce141df427] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:20:09.907955 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-49a926df-5937-445a-8fae-950d4b832c51 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] 10.222.0.27 "DELETE /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427" status: 204 len: 0 microversion: 2.1 time: 0.321206 Jun 20 12:20:09.908917 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2285/4672] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:20:09 2022] DELETE /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:20:09.918142 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4b1f21ba-6272-40d8-b210-3ad7223b0327 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:09.919228 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4b1f21ba-6272-40d8-b210-3ad7223b0327 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] [instance: 68b3feb5-3535-4655-a73f-03ce141df427] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:09.930377 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4b1f21ba-6272-40d8-b210-3ad7223b0327 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:09.932758 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4b1f21ba-6272-40d8-b210-3ad7223b0327 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:09.935395 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4b1f21ba-6272-40d8-b210-3ad7223b0327 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:09.936591 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4b1f21ba-6272-40d8-b210-3ad7223b0327 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:10.135775 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8582905f-b57d-4067-873d-3cca69c78dbd tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:10.136984 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8582905f-b57d-4067-873d-3cca69c78dbd tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:10.152535 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8582905f-b57d-4067-873d-3cca69c78dbd tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:10.153351 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8582905f-b57d-4067-873d-3cca69c78dbd tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:10.154412 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8582905f-b57d-4067-873d-3cca69c78dbd tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:10.160332 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8582905f-b57d-4067-873d-3cca69c78dbd tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:10.215801 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8582905f-b57d-4067-873d-3cca69c78dbd tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19/ips" status: 200 len: 146 microversion: 2.1 time: 0.084894 Jun 20 12:20:10.224228 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2286/4673] 10.222.0.27 () {58 vars in 1247 bytes} [Mon Jun 20 12:20:10 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19/ips => generated 146 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:20:11.077034 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4b1f21ba-6272-40d8-b210-3ad7223b0327 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd640fdee13ca47ae848264ccbc532925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca22edf491394f878e14c2b67fb92816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:11.093849 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4b1f21ba-6272-40d8-b210-3ad7223b0327 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] 10.222.0.27 "GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427" status: 200 len: 1701 microversion: 2.1 time: 1.178767 Jun 20 12:20:11.097085 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2388/4674] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:09 2022] GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427 => generated 1701 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:12.119109 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d215fca6-423d-4eed-825a-b17447dca541 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:12.119865 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d215fca6-423d-4eed-825a-b17447dca541 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] [instance: 68b3feb5-3535-4655-a73f-03ce141df427] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:12.151893 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d215fca6-423d-4eed-825a-b17447dca541 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:12.152861 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d215fca6-423d-4eed-825a-b17447dca541 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:12.153864 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d215fca6-423d-4eed-825a-b17447dca541 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:12.154781 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d215fca6-423d-4eed-825a-b17447dca541 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:13.328675 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d215fca6-423d-4eed-825a-b17447dca541 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd640fdee13ca47ae848264ccbc532925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca22edf491394f878e14c2b67fb92816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:13.339551 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d215fca6-423d-4eed-825a-b17447dca541 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] 10.222.0.27 "GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427" status: 200 len: 1634 microversion: 2.1 time: 1.229019 Jun 20 12:20:13.349702 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2287/4675] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:12 2022] GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427 => generated 1634 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:13.844150 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0b634578-b539-4f25-b4f8-ba3f69a0b401 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-900155794", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "87228ccc-9558-4c21-a085-f217c91ff048"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:20:13.989572 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-0b634578-b539-4f25-b4f8-ba3f69a0b401 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] validate_networks() for [('87228ccc-9558-4c21-a085-f217c91ff048', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:20:14.368518 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3fc905eb-2218-4a9f-bd97-1b2e6ddaa473 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:14.371259 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3fc905eb-2218-4a9f-bd97-1b2e6ddaa473 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] [instance: 68b3feb5-3535-4655-a73f-03ce141df427] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:14.387667 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3fc905eb-2218-4a9f-bd97-1b2e6ddaa473 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:14.388684 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3fc905eb-2218-4a9f-bd97-1b2e6ddaa473 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:14.401918 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3fc905eb-2218-4a9f-bd97-1b2e6ddaa473 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:14.402993 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3fc905eb-2218-4a9f-bd97-1b2e6ddaa473 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:15.325425 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3fc905eb-2218-4a9f-bd97-1b2e6ddaa473 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd640fdee13ca47ae848264ccbc532925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca22edf491394f878e14c2b67fb92816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:15.339884 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3fc905eb-2218-4a9f-bd97-1b2e6ddaa473 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] 10.222.0.27 "GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427" status: 200 len: 1634 microversion: 2.1 time: 0.980672 Jun 20 12:20:15.350583 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2288/4676] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:14 2022] GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427 => generated 1634 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:15.509079 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-8a114b87-52b3-42b6-a1fe-54e01919fa84 req-d1786694-83f1-4de4-8573-cee6ca2e7ebc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68b3feb5-3535-4655-a73f-03ce141df427", "name": "network-vif-deleted", "tag": "c53b45db-bda4-476c-a0e5-8aae6d2e5991"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:20:15.603644 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-0b634578-b539-4f25-b4f8-ba3f69a0b401 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:20:15.604641 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-0b634578-b539-4f25-b4f8-ba3f69a0b401 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:20:15.605352 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-0b634578-b539-4f25-b4f8-ba3f69a0b401 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:20:15.606922 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-0b634578-b539-4f25-b4f8-ba3f69a0b401 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:20:15.608155 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-0b634578-b539-4f25-b4f8-ba3f69a0b401 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:20:15.618344 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-8a114b87-52b3-42b6-a1fe-54e01919fa84 req-d1786694-83f1-4de4-8573-cee6ca2e7ebc service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:15.618812 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-8a114b87-52b3-42b6-a1fe-54e01919fa84 req-d1786694-83f1-4de4-8573-cee6ca2e7ebc service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:15.647493 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0b634578-b539-4f25-b4f8-ba3f69a0b401 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:15.651643 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0b634578-b539-4f25-b4f8-ba3f69a0b401 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:15.655633 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0b634578-b539-4f25-b4f8-ba3f69a0b401 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:15.661966 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0b634578-b539-4f25-b4f8-ba3f69a0b401 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:15.690873 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-8a114b87-52b3-42b6-a1fe-54e01919fa84 req-d1786694-83f1-4de4-8573-cee6ca2e7ebc service nova] Creating event network-vif-deleted:c53b45db-bda4-476c-a0e5-8aae6d2e5991 for instance 68b3feb5-3535-4655-a73f-03ce141df427 on n-h2-master-1 Jun 20 12:20:15.696818 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=60 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:20:15.720338 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-8a114b87-52b3-42b6-a1fe-54e01919fa84 req-d1786694-83f1-4de4-8573-cee6ca2e7ebc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.227458 Jun 20 12:20:15.728339 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2289/4677] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:20:15.739261 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-0b634578-b539-4f25-b4f8-ba3f69a0b401 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Getting quotas for project f4b74ef125db4100a0a8fe5c4805a60d. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:20:15.763407 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ae2b7054-cbc9-4151-81fc-32300bb68d13 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2cf50a6c-49bb-403f-9909-1b252f383c79"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:20:15.770874 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-0b634578-b539-4f25-b4f8-ba3f69a0b401 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Getting quotas for user f626b1f030f04b65b6b83b79de36a1c2 and project f4b74ef125db4100a0a8fe5c4805a60d. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:20:15.771170 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ae2b7054-cbc9-4151-81fc-32300bb68d13 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:15.811801 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0b634578-b539-4f25-b4f8-ba3f69a0b401 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:20:15.814442 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0b634578-b539-4f25-b4f8-ba3f69a0b401 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] [instance: c442c1c6-9d65-4978-81d8-6e8a4dfb46f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:20:15.823298 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ae2b7054-cbc9-4151-81fc-32300bb68d13 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:15.829198 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ae2b7054-cbc9-4151-81fc-32300bb68d13 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:15.830167 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ae2b7054-cbc9-4151-81fc-32300bb68d13 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:15.830627 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ae2b7054-cbc9-4151-81fc-32300bb68d13 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:16.020545 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0b634578-b539-4f25-b4f8-ba3f69a0b401 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.499490 Jun 20 12:20:16.028414 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2389/4678] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:20:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:20:16.034031 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8997ff2f-b990-4931-97d2-06120a253563 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:16.035012 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8997ff2f-b990-4931-97d2-06120a253563 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] [instance: c442c1c6-9d65-4978-81d8-6e8a4dfb46f5] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:16.180180 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8997ff2f-b990-4931-97d2-06120a253563 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f626b1f030f04b65b6b83b79de36a1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b74ef125db4100a0a8fe5c4805a60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:16.187794 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8997ff2f-b990-4931-97d2-06120a253563 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] 10.222.0.27 "GET /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5" status: 200 len: 1227 microversion: 2.1 time: 0.157872 Jun 20 12:20:16.190339 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2390/4679] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:16 2022] GET /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 => generated 1227 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:16.369987 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-eb1a396a-d081-4e3c-950f-4fe108827952 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:16.371018 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-eb1a396a-d081-4e3c-950f-4fe108827952 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] [instance: 68b3feb5-3535-4655-a73f-03ce141df427] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:16.393499 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb1a396a-d081-4e3c-950f-4fe108827952 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:16.398974 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb1a396a-d081-4e3c-950f-4fe108827952 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:16.407085 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb1a396a-d081-4e3c-950f-4fe108827952 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:16.412829 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb1a396a-d081-4e3c-950f-4fe108827952 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:16.547544 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb1a396a-d081-4e3c-950f-4fe108827952 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:16.552320 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb1a396a-d081-4e3c-950f-4fe108827952 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:16.552909 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-eb1a396a-d081-4e3c-950f-4fe108827952 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lazy-loading 'fault' on Instance uuid 68b3feb5-3535-4655-a73f-03ce141df427 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:20:16.718751 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ae2b7054-cbc9-4151-81fc-32300bb68d13 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "POST /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.960303 Jun 20 12:20:16.719614 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2290/4680] 10.222.0.27 () {60 vars in 1322 bytes} [Mon Jun 20 12:20:15 2022] POST /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19/os-volume_attachments => generated 194 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:20:17.110620 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-eb1a396a-d081-4e3c-950f-4fe108827952 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd640fdee13ca47ae848264ccbc532925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca22edf491394f878e14c2b67fb92816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:17.144409 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-eb1a396a-d081-4e3c-950f-4fe108827952 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] 10.222.0.27 "GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427" status: 200 len: 1359 microversion: 2.1 time: 0.786203 Jun 20 12:20:17.149443 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2391/4681] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:16 2022] GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427 => generated 1359 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:17.207978 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9478bb7e-68c5-491a-b93c-74afb292f9b1 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:17.208756 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9478bb7e-68c5-491a-b93c-74afb292f9b1 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] [instance: c442c1c6-9d65-4978-81d8-6e8a4dfb46f5] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:17.315114 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-80a12987-1dee-4bed-b4a7-5e8edc146465 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:17.315733 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-80a12987-1dee-4bed-b4a7-5e8edc146465 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:17.333265 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-80a12987-1dee-4bed-b4a7-5e8edc146465 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:17.337829 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-80a12987-1dee-4bed-b4a7-5e8edc146465 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:17.340617 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-80a12987-1dee-4bed-b4a7-5e8edc146465 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:17.351846 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-80a12987-1dee-4bed-b4a7-5e8edc146465 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:17.427317 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9478bb7e-68c5-491a-b93c-74afb292f9b1 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f626b1f030f04b65b6b83b79de36a1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b74ef125db4100a0a8fe5c4805a60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:17.440404 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9478bb7e-68c5-491a-b93c-74afb292f9b1 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] 10.222.0.27 "GET /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5" status: 200 len: 1227 microversion: 2.1 time: 0.236102 Jun 20 12:20:17.441725 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2291/4682] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:17 2022] GET /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 => generated 1227 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:18.103140 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-80a12987-1dee-4bed-b4a7-5e8edc146465 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:18.129684 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-80a12987-1dee-4bed-b4a7-5e8edc146465 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1684 microversion: 2.1 time: 0.818350 Jun 20 12:20:18.146970 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2392/4683] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:17 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1684 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:18.166494 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b4115796-a41a-440d-b33f-7d9aefecfce4 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:18.167175 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b4115796-a41a-440d-b33f-7d9aefecfce4 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] [instance: 68b3feb5-3535-4655-a73f-03ce141df427] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:18.181558 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:20:18.190595 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b4115796-a41a-440d-b33f-7d9aefecfce4 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:18.191428 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b4115796-a41a-440d-b33f-7d9aefecfce4 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:18.192487 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b4115796-a41a-440d-b33f-7d9aefecfce4 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:18.193154 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b4115796-a41a-440d-b33f-7d9aefecfce4 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:18.227547 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-b4115796-a41a-440d-b33f-7d9aefecfce4 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] HTTP exception thrown: Instance 68b3feb5-3535-4655-a73f-03ce141df427 could not be found. Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b4115796-a41a-440d-b33f-7d9aefecfce4 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Request method failure captured: Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427 HTTP/1.1 Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGWECWaAaMTWz-Nvk2unri8hMVWxOn116cfM5I5cICJem3W4W_dlOSQZA4ehCj_qmpsKfltoR8GgCEUmipYLj4PXgwFP050eZKOmeXFOmLlnVm0G6kdCJ39KBku_ZYj52nV6JG40xzdIuRr59Mdq2na_o248oKB2_YuoSFxYVwmlj8o Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: ca22edf491394f878e14c2b67fb92816 Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersTestJSON-1175713809 Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ca22edf491394f878e14c2b67fb92816"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ca22edf491394f878e14c2b67fb92816"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ca22edf491394f878e14c2b67fb92816"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ca22edf491394f878e14c2b67fb92816"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersTestJSON-1175713809 Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: ca22edf491394f878e14c2b67fb92816 Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersTestJSON-1175713809 Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersTestJSON-1175713809-project Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: d640fdee13ca47ae848264ccbc532925 Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersTestJSON-1175713809-project Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 68b3feb5-3535-4655-a73f-03ce141df427 could not be found. Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '68b3feb5-3535-4655-a73f-03ce141df427'} Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68b3feb5-3535-4655-a73f-03ce141df427 could not be found. Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68b3feb5-3535-4655-a73f-03ce141df427 could not be found. Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:20:18.232306 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:20:18.236541 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:20:18.236541 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:20:18.236541 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:20:18.236541 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:20:18.236541 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68b3feb5-3535-4655-a73f-03ce141df427 could not be found. Jun 20 12:20:18.236541 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:20:18.241188 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b4115796-a41a-440d-b33f-7d9aefecfce4 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Returning 404 to user: Instance 68b3feb5-3535-4655-a73f-03ce141df427 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:20:18.244381 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b4115796-a41a-440d-b33f-7d9aefecfce4 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] 10.222.0.27 "GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427" status: 404 len: 111 microversion: 2.1 time: 0.082292 Jun 20 12:20:18.245072 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2292/4684] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:18 2022] GET /compute/v2.1/servers/68b3feb5-3535-4655-a73f-03ce141df427 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:20:18.253893 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5e9e7dfa-e48f-4a93-adeb-a9ba14ca9121 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] Calling method '.version_select at 0x7f60848f08b0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:18.288510 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5e9e7dfa-e48f-4a93-adeb-a9ba14ca9121 tempest-ServersTestJSON-1175713809 tempest-ServersTestJSON-1175713809-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-499772890" status: 202 len: 0 microversion: 2.1 time: 0.038372 Jun 20 12:20:18.290418 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2393/4685] 10.222.0.27 () {58 vars in 1217 bytes} [Mon Jun 20 12:20:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-499772890 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:20:18.464493 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2270515e-98e4-4645-9693-8fc7be83cad3 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:18.470948 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2270515e-98e4-4645-9693-8fc7be83cad3 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] [instance: c442c1c6-9d65-4978-81d8-6e8a4dfb46f5] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:18.485377 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2270515e-98e4-4645-9693-8fc7be83cad3 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:18.486028 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2270515e-98e4-4645-9693-8fc7be83cad3 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:18.486939 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2270515e-98e4-4645-9693-8fc7be83cad3 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:18.487488 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2270515e-98e4-4645-9693-8fc7be83cad3 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:18.657123 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2270515e-98e4-4645-9693-8fc7be83cad3 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f626b1f030f04b65b6b83b79de36a1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b74ef125db4100a0a8fe5c4805a60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:18.666391 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2270515e-98e4-4645-9693-8fc7be83cad3 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] 10.222.0.27 "GET /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5" status: 200 len: 1279 microversion: 2.1 time: 0.211833 Jun 20 12:20:18.669704 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2293/4686] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:18 2022] GET /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 => generated 1279 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:19.151160 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c055210b-f116-4af1-ae71-8a1b6dce643d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:19.151782 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c055210b-f116-4af1-ae71-8a1b6dce643d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:19.154974 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:20:19.169397 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c055210b-f116-4af1-ae71-8a1b6dce643d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:19.170194 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c055210b-f116-4af1-ae71-8a1b6dce643d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:19.170779 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c055210b-f116-4af1-ae71-8a1b6dce643d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:19.171216 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c055210b-f116-4af1-ae71-8a1b6dce643d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:19.590700 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c055210b-f116-4af1-ae71-8a1b6dce643d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:19.602789 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c055210b-f116-4af1-ae71-8a1b6dce643d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.456389 Jun 20 12:20:19.604587 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2394/4687] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:19 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:19.624385 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d31a78c4-3d89-4fbc-8bd4-f49913b34876 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1647341811"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:20:19.626172 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d31a78c4-3d89-4fbc-8bd4-f49913b34876 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:19.642579 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d31a78c4-3d89-4fbc-8bd4-f49913b34876 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:19.643325 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d31a78c4-3d89-4fbc-8bd4-f49913b34876 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:19.644432 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d31a78c4-3d89-4fbc-8bd4-f49913b34876 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:19.645043 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d31a78c4-3d89-4fbc-8bd4-f49913b34876 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:19.694973 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-53ec6c7e-6a8e-41b1-a61b-3e9cd27c187a tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:19.695999 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-53ec6c7e-6a8e-41b1-a61b-3e9cd27c187a tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] [instance: c442c1c6-9d65-4978-81d8-6e8a4dfb46f5] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:19.702967 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:20:19.704990 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-53ec6c7e-6a8e-41b1-a61b-3e9cd27c187a tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:19.705846 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-53ec6c7e-6a8e-41b1-a61b-3e9cd27c187a tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:19.706823 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-53ec6c7e-6a8e-41b1-a61b-3e9cd27c187a tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:19.708645 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-53ec6c7e-6a8e-41b1-a61b-3e9cd27c187a tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:20.167013 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d31a78c4-3d89-4fbc-8bd4-f49913b34876 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "POST /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/action" status: 202 len: 0 microversion: 2.1 time: 0.549104 Jun 20 12:20:20.168551 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2294/4688] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:20:19 2022] POST /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/action => generated 0 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jun 20 12:20:20.210128 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-53ec6c7e-6a8e-41b1-a61b-3e9cd27c187a tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f626b1f030f04b65b6b83b79de36a1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b74ef125db4100a0a8fe5c4805a60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:20.226200 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-53ec6c7e-6a8e-41b1-a61b-3e9cd27c187a tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] 10.222.0.27 "GET /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5" status: 200 len: 1285 microversion: 2.1 time: 0.533012 Jun 20 12:20:20.228093 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2395/4689] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:19 2022] GET /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 => generated 1285 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:21.247170 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-131e79df-0bab-4f3e-96e0-1c4dc89fcdc3 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:21.259581 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-131e79df-0bab-4f3e-96e0-1c4dc89fcdc3 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] [instance: c442c1c6-9d65-4978-81d8-6e8a4dfb46f5] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:21.278779 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-131e79df-0bab-4f3e-96e0-1c4dc89fcdc3 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:21.286951 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-131e79df-0bab-4f3e-96e0-1c4dc89fcdc3 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:21.288276 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-131e79df-0bab-4f3e-96e0-1c4dc89fcdc3 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:21.296685 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-131e79df-0bab-4f3e-96e0-1c4dc89fcdc3 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:21.459720 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7541ae1a-fb73-4708-acdb-e76dd6421460 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:20:21.460844 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7541ae1a-fb73-4708-acdb-e76dd6421460 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:21.474091 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7541ae1a-fb73-4708-acdb-e76dd6421460 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:21.474851 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7541ae1a-fb73-4708-acdb-e76dd6421460 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:21.479997 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7541ae1a-fb73-4708-acdb-e76dd6421460 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:21.480803 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7541ae1a-fb73-4708-acdb-e76dd6421460 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:21.602103 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7541ae1a-fb73-4708-acdb-e76dd6421460 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "POST /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473/action" status: 200 len: 63240 microversion: 2.1 time: 0.146176 Jun 20 12:20:21.603130 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2396/4690] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:20:21 2022] POST /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473/action => generated 63240 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 12:20:21.807189 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-909a2e5c-3546-4e17-b61c-c37a49dfb10c req-7e358b51-56b0-4f7d-8448-6b69c145e5e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21609be7-c3f0-4e24-a093-2f74ce957a35", "name": "network-vif-unplugged", "status": "completed", "tag": "23a9a38f-112e-4e3f-97f4-ae81b6b5af7c"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:20:21.831156 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-909a2e5c-3546-4e17-b61c-c37a49dfb10c req-7e358b51-56b0-4f7d-8448-6b69c145e5e8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:21.832318 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-909a2e5c-3546-4e17-b61c-c37a49dfb10c req-7e358b51-56b0-4f7d-8448-6b69c145e5e8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:21.867136 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-909a2e5c-3546-4e17-b61c-c37a49dfb10c req-7e358b51-56b0-4f7d-8448-6b69c145e5e8 service nova] Creating event network-vif-unplugged:23a9a38f-112e-4e3f-97f4-ae81b6b5af7c for instance 21609be7-c3f0-4e24-a093-2f74ce957a35 on n-h1-master-1 Jun 20 12:20:21.885347 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-909a2e5c-3546-4e17-b61c-c37a49dfb10c req-7e358b51-56b0-4f7d-8448-6b69c145e5e8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080065 Jun 20 12:20:21.888747 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2397/4691] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:20:22.375546 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-131e79df-0bab-4f3e-96e0-1c4dc89fcdc3 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f626b1f030f04b65b6b83b79de36a1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b74ef125db4100a0a8fe5c4805a60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:22.387627 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-131e79df-0bab-4f3e-96e0-1c4dc89fcdc3 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] 10.222.0.27 "GET /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5" status: 200 len: 1327 microversion: 2.1 time: 1.145679 Jun 20 12:20:22.396480 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2295/4692] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:21 2022] GET /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 => generated 1327 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:22.993483 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-555fed3d-6d1f-4bb4-85f8-4e4a5dd26dfa req-015672e0-65e1-4e5d-a388-e6cd486b51f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c442c1c6-9d65-4978-81d8-6e8a4dfb46f5", "tag": "9bd7da5e-3a27-4666-81a0-b605e512d8f6"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:20:23.024412 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-555fed3d-6d1f-4bb4-85f8-4e4a5dd26dfa req-015672e0-65e1-4e5d-a388-e6cd486b51f4 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:23.025221 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-555fed3d-6d1f-4bb4-85f8-4e4a5dd26dfa req-015672e0-65e1-4e5d-a388-e6cd486b51f4 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:23.074387 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-555fed3d-6d1f-4bb4-85f8-4e4a5dd26dfa req-015672e0-65e1-4e5d-a388-e6cd486b51f4 service nova] Creating event network-changed:9bd7da5e-3a27-4666-81a0-b605e512d8f6 for instance c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 on n-h1-master-1 Jun 20 12:20:23.099090 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-555fed3d-6d1f-4bb4-85f8-4e4a5dd26dfa req-015672e0-65e1-4e5d-a388-e6cd486b51f4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115045 Jun 20 12:20:23.101109 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2398/4693] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:20:23.417652 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a73a1ff8-9a8a-4ad1-b655-96b73e2750b4 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:23.419112 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a73a1ff8-9a8a-4ad1-b655-96b73e2750b4 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] [instance: c442c1c6-9d65-4978-81d8-6e8a4dfb46f5] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:23.438981 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a73a1ff8-9a8a-4ad1-b655-96b73e2750b4 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:23.448059 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a73a1ff8-9a8a-4ad1-b655-96b73e2750b4 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:23.449312 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a73a1ff8-9a8a-4ad1-b655-96b73e2750b4 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:23.449925 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a73a1ff8-9a8a-4ad1-b655-96b73e2750b4 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:23.822431 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a73a1ff8-9a8a-4ad1-b655-96b73e2750b4 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f626b1f030f04b65b6b83b79de36a1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b74ef125db4100a0a8fe5c4805a60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:23.837006 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a73a1ff8-9a8a-4ad1-b655-96b73e2750b4 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] 10.222.0.27 "GET /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5" status: 200 len: 1327 microversion: 2.1 time: 0.418842 Jun 20 12:20:23.838382 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2296/4694] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:23 2022] GET /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 => generated 1327 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:24.856360 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2f491d37-38e0-4c07-bfba-c4b04d9daf66 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:24.858014 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2f491d37-38e0-4c07-bfba-c4b04d9daf66 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] [instance: c442c1c6-9d65-4978-81d8-6e8a4dfb46f5] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:24.879866 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2f491d37-38e0-4c07-bfba-c4b04d9daf66 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:24.880400 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2f491d37-38e0-4c07-bfba-c4b04d9daf66 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:24.881211 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2f491d37-38e0-4c07-bfba-c4b04d9daf66 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:24.881633 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2f491d37-38e0-4c07-bfba-c4b04d9daf66 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:25.543482 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2f491d37-38e0-4c07-bfba-c4b04d9daf66 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f626b1f030f04b65b6b83b79de36a1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b74ef125db4100a0a8fe5c4805a60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:25.569378 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2f491d37-38e0-4c07-bfba-c4b04d9daf66 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] 10.222.0.27 "GET /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5" status: 200 len: 1327 microversion: 2.1 time: 0.717530 Jun 20 12:20:25.569999 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2399/4695] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:24 2022] GET /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 => generated 1327 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:26.039952 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-b25f9c1e-ff4c-483e-b20e-d31279431269 req-b715dfee-3539-4af4-a190-7da437783a2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21609be7-c3f0-4e24-a093-2f74ce957a35", "name": "network-vif-plugged", "status": "completed", "tag": "23a9a38f-112e-4e3f-97f4-ae81b6b5af7c"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:20:26.069546 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-b25f9c1e-ff4c-483e-b20e-d31279431269 req-b715dfee-3539-4af4-a190-7da437783a2d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:26.070286 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-b25f9c1e-ff4c-483e-b20e-d31279431269 req-b715dfee-3539-4af4-a190-7da437783a2d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:26.092626 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-b25f9c1e-ff4c-483e-b20e-d31279431269 req-b715dfee-3539-4af4-a190-7da437783a2d service nova] Creating event network-vif-plugged:23a9a38f-112e-4e3f-97f4-ae81b6b5af7c for instance 21609be7-c3f0-4e24-a093-2f74ce957a35 on n-h1-master-1 Jun 20 12:20:26.110505 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-b25f9c1e-ff4c-483e-b20e-d31279431269 req-b715dfee-3539-4af4-a190-7da437783a2d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074130 Jun 20 12:20:26.111777 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2297/4696] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:20:26.590253 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ec4e95be-098a-451f-aefc-f345f5d7f608 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:26.590877 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ec4e95be-098a-451f-aefc-f345f5d7f608 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] [instance: c442c1c6-9d65-4978-81d8-6e8a4dfb46f5] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:26.605000 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=4 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:20:26.618403 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=8 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:20:26.636121 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ec4e95be-098a-451f-aefc-f345f5d7f608 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:26.651800 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ec4e95be-098a-451f-aefc-f345f5d7f608 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:26.653202 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ec4e95be-098a-451f-aefc-f345f5d7f608 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:26.653897 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ec4e95be-098a-451f-aefc-f345f5d7f608 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:27.236236 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ec4e95be-098a-451f-aefc-f345f5d7f608 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f626b1f030f04b65b6b83b79de36a1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b74ef125db4100a0a8fe5c4805a60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:27.261642 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ec4e95be-098a-451f-aefc-f345f5d7f608 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] 10.222.0.27 "GET /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5" status: 200 len: 1327 microversion: 2.1 time: 0.664653 Jun 20 12:20:27.263005 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2400/4697] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:26 2022] GET /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 => generated 1327 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:28.281218 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-19a70c0d-eb2c-4c93-bb68-0a3ca03a336c tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:28.281932 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-19a70c0d-eb2c-4c93-bb68-0a3ca03a336c tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] [instance: c442c1c6-9d65-4978-81d8-6e8a4dfb46f5] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:28.284840 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=4 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:20:28.305584 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-19a70c0d-eb2c-4c93-bb68-0a3ca03a336c tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:28.306051 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-19a70c0d-eb2c-4c93-bb68-0a3ca03a336c tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:28.306825 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-19a70c0d-eb2c-4c93-bb68-0a3ca03a336c tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:28.307257 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-19a70c0d-eb2c-4c93-bb68-0a3ca03a336c tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:29.157046 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-19a70c0d-eb2c-4c93-bb68-0a3ca03a336c tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f626b1f030f04b65b6b83b79de36a1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b74ef125db4100a0a8fe5c4805a60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:29.168465 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-19a70c0d-eb2c-4c93-bb68-0a3ca03a336c tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] 10.222.0.27 "GET /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5" status: 200 len: 1327 microversion: 2.1 time: 0.891819 Jun 20 12:20:29.176951 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2298/4698] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:28 2022] GET /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 => generated 1327 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:30.197622 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-051582f0-7ba0-4f2d-921b-ae9aa853d966 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:30.198646 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-051582f0-7ba0-4f2d-921b-ae9aa853d966 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] [instance: c442c1c6-9d65-4978-81d8-6e8a4dfb46f5] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:30.212418 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-051582f0-7ba0-4f2d-921b-ae9aa853d966 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:30.213103 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-051582f0-7ba0-4f2d-921b-ae9aa853d966 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:30.215653 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-051582f0-7ba0-4f2d-921b-ae9aa853d966 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:30.217371 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-051582f0-7ba0-4f2d-921b-ae9aa853d966 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:30.437876 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-051582f0-7ba0-4f2d-921b-ae9aa853d966 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f626b1f030f04b65b6b83b79de36a1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b74ef125db4100a0a8fe5c4805a60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:30.454344 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-051582f0-7ba0-4f2d-921b-ae9aa853d966 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] 10.222.0.27 "GET /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5" status: 200 len: 1327 microversion: 2.1 time: 0.262373 Jun 20 12:20:30.456266 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2401/4699] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:30 2022] GET /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 => generated 1327 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:31.486376 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ab45cac6-7062-44f1-910d-bdab6c5c714f tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:31.487759 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ab45cac6-7062-44f1-910d-bdab6c5c714f tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] [instance: c442c1c6-9d65-4978-81d8-6e8a4dfb46f5] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:31.505631 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ab45cac6-7062-44f1-910d-bdab6c5c714f tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:31.506731 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ab45cac6-7062-44f1-910d-bdab6c5c714f tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:31.509512 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ab45cac6-7062-44f1-910d-bdab6c5c714f tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:31.510244 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ab45cac6-7062-44f1-910d-bdab6c5c714f tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:31.778868 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ab45cac6-7062-44f1-910d-bdab6c5c714f tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f626b1f030f04b65b6b83b79de36a1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b74ef125db4100a0a8fe5c4805a60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:31.793275 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ab45cac6-7062-44f1-910d-bdab6c5c714f tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] 10.222.0.27 "GET /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5" status: 200 len: 1327 microversion: 2.1 time: 0.313429 Jun 20 12:20:31.801410 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2299/4700] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:31 2022] GET /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 => generated 1327 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:32.632078 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-4d0917fa-cc37-4a2d-9d5c-ceecb7d6dc7b req-ab889f20-69a3-4476-9f1c-cb036c5fdc8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c442c1c6-9d65-4978-81d8-6e8a4dfb46f5", "name": "network-vif-plugged", "status": "completed", "tag": "9bd7da5e-3a27-4666-81a0-b605e512d8f6"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:20:32.651107 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-4d0917fa-cc37-4a2d-9d5c-ceecb7d6dc7b req-ab889f20-69a3-4476-9f1c-cb036c5fdc8e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:32.651596 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-4d0917fa-cc37-4a2d-9d5c-ceecb7d6dc7b req-ab889f20-69a3-4476-9f1c-cb036c5fdc8e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:32.685771 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-4d0917fa-cc37-4a2d-9d5c-ceecb7d6dc7b req-ab889f20-69a3-4476-9f1c-cb036c5fdc8e service nova] Creating event network-vif-plugged:9bd7da5e-3a27-4666-81a0-b605e512d8f6 for instance c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 on n-h1-master-1 Jun 20 12:20:32.712030 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-4d0917fa-cc37-4a2d-9d5c-ceecb7d6dc7b req-ab889f20-69a3-4476-9f1c-cb036c5fdc8e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083835 Jun 20 12:20:32.713842 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2402/4701] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:20:32.817551 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3cd8bb36-6860-4a2d-bfa3-9817f9cb84c7 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:32.818177 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3cd8bb36-6860-4a2d-bfa3-9817f9cb84c7 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] [instance: c442c1c6-9d65-4978-81d8-6e8a4dfb46f5] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:32.833173 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3cd8bb36-6860-4a2d-bfa3-9817f9cb84c7 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:32.833938 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3cd8bb36-6860-4a2d-bfa3-9817f9cb84c7 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:32.834926 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3cd8bb36-6860-4a2d-bfa3-9817f9cb84c7 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:32.835524 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3cd8bb36-6860-4a2d-bfa3-9817f9cb84c7 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:33.158541 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3cd8bb36-6860-4a2d-bfa3-9817f9cb84c7 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f626b1f030f04b65b6b83b79de36a1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b74ef125db4100a0a8fe5c4805a60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:33.175056 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3cd8bb36-6860-4a2d-bfa3-9817f9cb84c7 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] 10.222.0.27 "GET /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5" status: 200 len: 1327 microversion: 2.1 time: 0.355125 Jun 20 12:20:33.179563 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2300/4702] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:32 2022] GET /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 => generated 1327 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:34.115456 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d59bd5ad-13f4-4c2b-a9e7-47c256907d35 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:20:34.129522 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d59bd5ad-13f4-4c2b-a9e7-47c256907d35 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:34.131490 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d59bd5ad-13f4-4c2b-a9e7-47c256907d35 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:34.162739 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d59bd5ad-13f4-4c2b-a9e7-47c256907d35 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Going to try to stop instance {{(pid=119127) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 20 12:20:34.195049 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1d66f097-ae34-416c-83b7-80b26179239e tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:34.196747 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1d66f097-ae34-416c-83b7-80b26179239e tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] [instance: c442c1c6-9d65-4978-81d8-6e8a4dfb46f5] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:34.212679 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d66f097-ae34-416c-83b7-80b26179239e tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:34.215582 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d66f097-ae34-416c-83b7-80b26179239e tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:34.218961 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d66f097-ae34-416c-83b7-80b26179239e tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:34.219911 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d66f097-ae34-416c-83b7-80b26179239e tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:34.238466 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d59bd5ad-13f4-4c2b-a9e7-47c256907d35 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "POST /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19/action" status: 202 len: 0 microversion: 2.1 time: 0.127338 Jun 20 12:20:34.241621 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2403/4703] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:20:34 2022] POST /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:20:34.280656 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9229fd09-efe5-4a14-af66-715e106c1cb5 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:34.281521 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9229fd09-efe5-4a14-af66-715e106c1cb5 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:34.304573 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9229fd09-efe5-4a14-af66-715e106c1cb5 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:34.305030 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9229fd09-efe5-4a14-af66-715e106c1cb5 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:34.305813 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9229fd09-efe5-4a14-af66-715e106c1cb5 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:34.306256 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9229fd09-efe5-4a14-af66-715e106c1cb5 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:34.692768 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1d66f097-ae34-416c-83b7-80b26179239e tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f626b1f030f04b65b6b83b79de36a1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b74ef125db4100a0a8fe5c4805a60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:34.699880 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1d66f097-ae34-416c-83b7-80b26179239e tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] 10.222.0.27 "GET /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5" status: 200 len: 1327 microversion: 2.1 time: 0.509472 Jun 20 12:20:34.704942 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2301/4704] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:34 2022] GET /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 => generated 1327 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:34.750001 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9229fd09-efe5-4a14-af66-715e106c1cb5 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:34.762142 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9229fd09-efe5-4a14-af66-715e106c1cb5 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1724 microversion: 2.1 time: 0.516206 Jun 20 12:20:34.767614 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2404/4705] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:34 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1724 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:35.726109 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-65e5b9c2-d2c3-48f7-b646-73a4bd0b5f4e tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:35.727297 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-65e5b9c2-d2c3-48f7-b646-73a4bd0b5f4e tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] [instance: c442c1c6-9d65-4978-81d8-6e8a4dfb46f5] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:35.740930 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65e5b9c2-d2c3-48f7-b646-73a4bd0b5f4e tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:35.742292 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65e5b9c2-d2c3-48f7-b646-73a4bd0b5f4e tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:35.743769 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65e5b9c2-d2c3-48f7-b646-73a4bd0b5f4e tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:35.745356 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65e5b9c2-d2c3-48f7-b646-73a4bd0b5f4e tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:35.785758 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-24e0ec7b-0353-4210-81a7-db763950a12e tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:35.787916 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-24e0ec7b-0353-4210-81a7-db763950a12e tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:35.796490 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-24e0ec7b-0353-4210-81a7-db763950a12e tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:35.797979 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-24e0ec7b-0353-4210-81a7-db763950a12e tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:35.799535 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-24e0ec7b-0353-4210-81a7-db763950a12e tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:35.800146 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-24e0ec7b-0353-4210-81a7-db763950a12e tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:36.024166 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-65e5b9c2-d2c3-48f7-b646-73a4bd0b5f4e tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f626b1f030f04b65b6b83b79de36a1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b74ef125db4100a0a8fe5c4805a60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:36.059329 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-65e5b9c2-d2c3-48f7-b646-73a4bd0b5f4e tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] 10.222.0.27 "GET /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5" status: 200 len: 1528 microversion: 2.1 time: 0.340331 Jun 20 12:20:36.064789 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2302/4706] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:35 2022] GET /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 => generated 1528 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:36.084737 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-64d8fcc4-534d-4fc6-a853-7d88c464cb88 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:36.085626 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-64d8fcc4-534d-4fc6-a853-7d88c464cb88 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] [instance: c442c1c6-9d65-4978-81d8-6e8a4dfb46f5] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:36.100097 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64d8fcc4-534d-4fc6-a853-7d88c464cb88 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:36.101211 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64d8fcc4-534d-4fc6-a853-7d88c464cb88 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:36.102232 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64d8fcc4-534d-4fc6-a853-7d88c464cb88 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:36.102905 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64d8fcc4-534d-4fc6-a853-7d88c464cb88 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:36.286303 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-24e0ec7b-0353-4210-81a7-db763950a12e tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:36.308868 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-24e0ec7b-0353-4210-81a7-db763950a12e tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1724 microversion: 2.1 time: 0.518371 Jun 20 12:20:36.311959 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2405/4707] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:35 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1724 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:20:36.594472 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-64d8fcc4-534d-4fc6-a853-7d88c464cb88 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f626b1f030f04b65b6b83b79de36a1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b74ef125db4100a0a8fe5c4805a60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:36.627542 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-64d8fcc4-534d-4fc6-a853-7d88c464cb88 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] 10.222.0.27 "GET /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5" status: 200 len: 1528 microversion: 2.1 time: 0.540551 Jun 20 12:20:36.629963 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2303/4708] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:36 2022] GET /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 => generated 1528 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:36.989970 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ebac621a-3716-4b05-8487-dc7e1cbb03b2 tempest-ServersNegativeTestMultiTenantJSON-525500959 tempest-ServersNegativeTestMultiTenantJSON-525500959-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:36.991011 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ebac621a-3716-4b05-8487-dc7e1cbb03b2 tempest-ServersNegativeTestMultiTenantJSON-525500959 tempest-ServersNegativeTestMultiTenantJSON-525500959-project] [instance: c442c1c6-9d65-4978-81d8-6e8a4dfb46f5] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:37.004783 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebac621a-3716-4b05-8487-dc7e1cbb03b2 tempest-ServersNegativeTestMultiTenantJSON-525500959 tempest-ServersNegativeTestMultiTenantJSON-525500959-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:37.005959 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebac621a-3716-4b05-8487-dc7e1cbb03b2 tempest-ServersNegativeTestMultiTenantJSON-525500959 tempest-ServersNegativeTestMultiTenantJSON-525500959-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:37.007012 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebac621a-3716-4b05-8487-dc7e1cbb03b2 tempest-ServersNegativeTestMultiTenantJSON-525500959 tempest-ServersNegativeTestMultiTenantJSON-525500959-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:37.016280 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebac621a-3716-4b05-8487-dc7e1cbb03b2 tempest-ServersNegativeTestMultiTenantJSON-525500959 tempest-ServersNegativeTestMultiTenantJSON-525500959-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:37.041284 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-ebac621a-3716-4b05-8487-dc7e1cbb03b2 tempest-ServersNegativeTestMultiTenantJSON-525500959 tempest-ServersNegativeTestMultiTenantJSON-525500959-project] HTTP exception thrown: Instance c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 could not be found. Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ebac621a-3716-4b05-8487-dc7e1cbb03b2 tempest-ServersNegativeTestMultiTenantJSON-525500959 tempest-ServersNegativeTestMultiTenantJSON-525500959-project] Request method failure captured: Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 HTTP/1.1 Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGX8gMQkZklZ0sRp4UMXkYrGMdSwISBhwg56sjs1jZ8z0s24xZAQ2S0tv90AZ3OXVNeuYmkG8gXmOXhpD8lUSyeBO3fYgzg0IJGb-iQb3IVBn-Hi4cNOKiQ-pfVVi9PvsvUrqtZeQc8FME7OXO_t3WqW7ont797zv7HjhTFu9T5B3WE Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: d9311b7af8fb4e55a8ae1ad42871f059 Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-525500959 Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d9311b7af8fb4e55a8ae1ad42871f059"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d9311b7af8fb4e55a8ae1ad42871f059"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d9311b7af8fb4e55a8ae1ad42871f059"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d9311b7af8fb4e55a8ae1ad42871f059"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-525500959 Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: d9311b7af8fb4e55a8ae1ad42871f059 Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-525500959 Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersNegativeTestMultiTenantJSON-525500959-project Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 523906cf888a41148a73755df89a9b0f Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-525500959-project Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: exception: Instance c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 could not be found. Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'c442c1c6-9d65-4978-81d8-6e8a4dfb46f5'} Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 could not be found. Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:20:37.044267 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:20:37.050482 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 could not be found. Jun 20 12:20:37.050482 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:20:37.050482 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:20:37.050482 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:20:37.050482 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:20:37.050482 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:20:37.050482 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:20:37.050482 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:20:37.050482 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:20:37.050482 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 could not be found. Jun 20 12:20:37.050482 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:20:37.054457 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ebac621a-3716-4b05-8487-dc7e1cbb03b2 tempest-ServersNegativeTestMultiTenantJSON-525500959 tempest-ServersNegativeTestMultiTenantJSON-525500959-project] Returning 404 to user: Instance c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:20:37.055650 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ebac621a-3716-4b05-8487-dc7e1cbb03b2 tempest-ServersNegativeTestMultiTenantJSON-525500959 tempest-ServersNegativeTestMultiTenantJSON-525500959-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5" status: 404 len: 111 microversion: 2.1 time: 0.408934 Jun 20 12:20:37.057098 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2406/4709] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:20:36 2022] DELETE /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 => generated 111 bytes in 412 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:20:37.088541 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bbe3a5b7-e059-45b8-9d82-ff128443c429 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:37.095438 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bbe3a5b7-e059-45b8-9d82-ff128443c429 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] [instance: c442c1c6-9d65-4978-81d8-6e8a4dfb46f5] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:37.122465 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:20:37.127929 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bbe3a5b7-e059-45b8-9d82-ff128443c429 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:37.128420 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bbe3a5b7-e059-45b8-9d82-ff128443c429 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:37.131726 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bbe3a5b7-e059-45b8-9d82-ff128443c429 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:37.132187 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bbe3a5b7-e059-45b8-9d82-ff128443c429 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:37.331713 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-52c43379-ce03-4548-bfc7-4b56dca9b500 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:37.332896 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-52c43379-ce03-4548-bfc7-4b56dca9b500 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:37.344949 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52c43379-ce03-4548-bfc7-4b56dca9b500 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:37.350029 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52c43379-ce03-4548-bfc7-4b56dca9b500 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:37.356627 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52c43379-ce03-4548-bfc7-4b56dca9b500 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:37.358375 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52c43379-ce03-4548-bfc7-4b56dca9b500 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:37.607653 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-bbe3a5b7-e059-45b8-9d82-ff128443c429 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f626b1f030f04b65b6b83b79de36a1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b74ef125db4100a0a8fe5c4805a60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:37.624259 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bbe3a5b7-e059-45b8-9d82-ff128443c429 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] 10.222.0.27 "GET /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5" status: 200 len: 1528 microversion: 2.1 time: 0.558768 Jun 20 12:20:37.635319 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2304/4710] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:37 2022] GET /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 => generated 1528 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:37.645943 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9ccb80c3-4b33-456d-a19b-04b0c6a71a11 tempest-ServersNegativeTestMultiTenantJSON-525500959 tempest-ServersNegativeTestMultiTenantJSON-525500959-project] Action: 'update', calling method: >, body: {"server": {"name": "c442c1c6-9d65-4978-81d8-6e8a4dfb46f5_new"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:20:37.647252 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9ccb80c3-4b33-456d-a19b-04b0c6a71a11 tempest-ServersNegativeTestMultiTenantJSON-525500959 tempest-ServersNegativeTestMultiTenantJSON-525500959-project] [instance: c442c1c6-9d65-4978-81d8-6e8a4dfb46f5] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:37.659250 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9ccb80c3-4b33-456d-a19b-04b0c6a71a11 tempest-ServersNegativeTestMultiTenantJSON-525500959 tempest-ServersNegativeTestMultiTenantJSON-525500959-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:37.659844 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9ccb80c3-4b33-456d-a19b-04b0c6a71a11 tempest-ServersNegativeTestMultiTenantJSON-525500959 tempest-ServersNegativeTestMultiTenantJSON-525500959-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:37.660752 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9ccb80c3-4b33-456d-a19b-04b0c6a71a11 tempest-ServersNegativeTestMultiTenantJSON-525500959 tempest-ServersNegativeTestMultiTenantJSON-525500959-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:37.666153 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9ccb80c3-4b33-456d-a19b-04b0c6a71a11 tempest-ServersNegativeTestMultiTenantJSON-525500959 tempest-ServersNegativeTestMultiTenantJSON-525500959-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:37.697640 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-9ccb80c3-4b33-456d-a19b-04b0c6a71a11 tempest-ServersNegativeTestMultiTenantJSON-525500959 tempest-ServersNegativeTestMultiTenantJSON-525500959-project] HTTP exception thrown: Instance c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 could not be found. Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9ccb80c3-4b33-456d-a19b-04b0c6a71a11 tempest-ServersNegativeTestMultiTenantJSON-525500959 tempest-ServersNegativeTestMultiTenantJSON-525500959-project] Request method failure captured: Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: request: PUT /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 HTTP/1.1 Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 64 Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGX8gMQkZklZ0sRp4UMXkYrGMdSwISBhwg56sjs1jZ8z0s24xZAQ2S0tv90AZ3OXVNeuYmkG8gXmOXhpD8lUSyeBO3fYgzg0IJGb-iQb3IVBn-Hi4cNOKiQ-pfVVi9PvsvUrqtZeQc8FME7OXO_t3WqW7ont797zv7HjhTFu9T5B3WE Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: d9311b7af8fb4e55a8ae1ad42871f059 Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-525500959 Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d9311b7af8fb4e55a8ae1ad42871f059"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d9311b7af8fb4e55a8ae1ad42871f059"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d9311b7af8fb4e55a8ae1ad42871f059"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d9311b7af8fb4e55a8ae1ad42871f059"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-525500959 Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: d9311b7af8fb4e55a8ae1ad42871f059 Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-525500959 Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersNegativeTestMultiTenantJSON-525500959-project Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 523906cf888a41148a73755df89a9b0f Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-525500959-project Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: {"server": {"name": "c442c1c6-9d65-4978-81d8-6e8a4dfb46f5_new"}} Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: exception: Instance c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 could not be found. Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'c442c1c6-9d65-4978-81d8-6e8a4dfb46f5', 'body': {'server': {'name': 'c442c1c6-9d65-4978-81d8-6e8a4dfb46f5_new'}}} Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 could not be found. Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 20 12:20:37.699625 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jun 20 12:20:37.711524 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jun 20 12:20:37.711524 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:20:37.711524 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:20:37.711524 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:20:37.711524 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:20:37.711524 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 could not be found. Jun 20 12:20:37.711524 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:20:37.711524 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:20:37.711524 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:20:37.711524 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:20:37.711524 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:20:37.711524 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:20:37.711524 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:20:37.711524 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:20:37.711524 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 could not be found. Jun 20 12:20:37.711524 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:20:37.711524 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9ccb80c3-4b33-456d-a19b-04b0c6a71a11 tempest-ServersNegativeTestMultiTenantJSON-525500959 tempest-ServersNegativeTestMultiTenantJSON-525500959-project] Returning 404 to user: Instance c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:20:37.711524 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9ccb80c3-4b33-456d-a19b-04b0c6a71a11 tempest-ServersNegativeTestMultiTenantJSON-525500959 tempest-ServersNegativeTestMultiTenantJSON-525500959-project] 10.222.0.27 "PUT /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5" status: 404 len: 111 microversion: 2.1 time: 0.060375 Jun 20 12:20:37.711524 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2305/4711] 10.222.0.27 () {60 vars in 1255 bytes} [Mon Jun 20 12:20:37 2022] PUT /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:20:37.715811 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-484c91f9-1afe-45fe-804f-f3db264e01c2 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:37.716403 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-484c91f9-1afe-45fe-804f-f3db264e01c2 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] [instance: c442c1c6-9d65-4978-81d8-6e8a4dfb46f5] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:37.734671 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-484c91f9-1afe-45fe-804f-f3db264e01c2 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:37.735261 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-484c91f9-1afe-45fe-804f-f3db264e01c2 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:37.736138 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-484c91f9-1afe-45fe-804f-f3db264e01c2 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:37.737017 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-484c91f9-1afe-45fe-804f-f3db264e01c2 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:37.758448 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-52c43379-ce03-4548-bfc7-4b56dca9b500 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:37.771305 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-52c43379-ce03-4548-bfc7-4b56dca9b500 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1724 microversion: 2.1 time: 0.443763 Jun 20 12:20:37.771918 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2407/4712] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:37 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1724 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:37.800838 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-484c91f9-1afe-45fe-804f-f3db264e01c2 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] [instance: c442c1c6-9d65-4978-81d8-6e8a4dfb46f5] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:20:37.977431 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-484c91f9-1afe-45fe-804f-f3db264e01c2 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5" status: 204 len: 0 microversion: 2.1 time: 0.267151 Jun 20 12:20:37.978290 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2306/4713] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:20:37 2022] DELETE /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 12:20:37.987368 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-14fd76ad-69c6-4c76-9108-98a060ffd561 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:37.988040 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-14fd76ad-69c6-4c76-9108-98a060ffd561 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] [instance: c442c1c6-9d65-4978-81d8-6e8a4dfb46f5] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:37.998671 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-14fd76ad-69c6-4c76-9108-98a060ffd561 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:37.999342 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-14fd76ad-69c6-4c76-9108-98a060ffd561 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:37.999887 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-14fd76ad-69c6-4c76-9108-98a060ffd561 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:38.000573 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-14fd76ad-69c6-4c76-9108-98a060ffd561 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:38.685617 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-14fd76ad-69c6-4c76-9108-98a060ffd561 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f626b1f030f04b65b6b83b79de36a1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b74ef125db4100a0a8fe5c4805a60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:38.700499 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-14fd76ad-69c6-4c76-9108-98a060ffd561 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] 10.222.0.27 "GET /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5" status: 200 len: 1534 microversion: 2.1 time: 0.717230 Jun 20 12:20:38.716776 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2408/4714] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:37 2022] GET /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 => generated 1534 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:38.793063 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ed71b84e-0b42-40b4-b923-50b87932bc43 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:38.793996 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ed71b84e-0b42-40b4-b923-50b87932bc43 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:38.813072 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed71b84e-0b42-40b4-b923-50b87932bc43 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:38.817198 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed71b84e-0b42-40b4-b923-50b87932bc43 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:38.821086 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed71b84e-0b42-40b4-b923-50b87932bc43 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:38.821901 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed71b84e-0b42-40b4-b923-50b87932bc43 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:39.252229 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ed71b84e-0b42-40b4-b923-50b87932bc43 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:39.286868 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ed71b84e-0b42-40b4-b923-50b87932bc43 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1724 microversion: 2.1 time: 0.499270 Jun 20 12:20:39.287940 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2307/4715] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:38 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1724 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:39.726667 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-62c6f786-5341-4419-b372-107892b6b553 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:39.727991 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-62c6f786-5341-4419-b372-107892b6b553 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] [instance: c442c1c6-9d65-4978-81d8-6e8a4dfb46f5] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:39.763918 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-62c6f786-5341-4419-b372-107892b6b553 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:39.768234 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-62c6f786-5341-4419-b372-107892b6b553 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:39.769507 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-62c6f786-5341-4419-b372-107892b6b553 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:39.782487 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-62c6f786-5341-4419-b372-107892b6b553 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:40.198092 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-6562895f-8c1f-4749-a58c-e1a5966dca7a req-0d3f30ef-c1c4-40ab-b95b-2ea622ec17ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c442c1c6-9d65-4978-81d8-6e8a4dfb46f5", "name": "network-vif-deleted", "tag": "9bd7da5e-3a27-4666-81a0-b605e512d8f6"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:20:40.243156 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-6562895f-8c1f-4749-a58c-e1a5966dca7a req-0d3f30ef-c1c4-40ab-b95b-2ea622ec17ae service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:40.246874 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-6562895f-8c1f-4749-a58c-e1a5966dca7a req-0d3f30ef-c1c4-40ab-b95b-2ea622ec17ae service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:40.278135 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-6562895f-8c1f-4749-a58c-e1a5966dca7a req-0d3f30ef-c1c4-40ab-b95b-2ea622ec17ae service nova] Creating event network-vif-deleted:9bd7da5e-3a27-4666-81a0-b605e512d8f6 for instance c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 on n-h1-master-1 Jun 20 12:20:40.292584 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-6562895f-8c1f-4749-a58c-e1a5966dca7a req-0d3f30ef-c1c4-40ab-b95b-2ea622ec17ae service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111315 Jun 20 12:20:40.295490 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2308/4716] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jun 20 12:20:40.331162 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-457199a7-9462-47e2-a879-80807944573b tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:40.333055 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-457199a7-9462-47e2-a879-80807944573b tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:40.351469 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-457199a7-9462-47e2-a879-80807944573b tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:40.357732 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-457199a7-9462-47e2-a879-80807944573b tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:40.362118 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-457199a7-9462-47e2-a879-80807944573b tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:40.363277 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-457199a7-9462-47e2-a879-80807944573b tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:40.538420 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-62c6f786-5341-4419-b372-107892b6b553 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f626b1f030f04b65b6b83b79de36a1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b74ef125db4100a0a8fe5c4805a60d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:40.559426 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-62c6f786-5341-4419-b372-107892b6b553 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] 10.222.0.27 "GET /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5" status: 200 len: 1534 microversion: 2.1 time: 0.839477 Jun 20 12:20:40.562343 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2409/4717] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:39 2022] GET /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 => generated 1534 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:41.132936 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-457199a7-9462-47e2-a879-80807944573b tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:41.138722 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:20:41.156777 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-457199a7-9462-47e2-a879-80807944573b tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1724 microversion: 2.1 time: 0.847507 Jun 20 12:20:41.169362 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2309/4718] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:40 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1724 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:41.584191 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b5af8e89-36d1-4cc2-a15d-6ffedd90ad76 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:41.594702 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b5af8e89-36d1-4cc2-a15d-6ffedd90ad76 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] [instance: c442c1c6-9d65-4978-81d8-6e8a4dfb46f5] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:41.633190 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5af8e89-36d1-4cc2-a15d-6ffedd90ad76 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:41.633645 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5af8e89-36d1-4cc2-a15d-6ffedd90ad76 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:41.634444 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5af8e89-36d1-4cc2-a15d-6ffedd90ad76 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:41.643020 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5af8e89-36d1-4cc2-a15d-6ffedd90ad76 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:41.651798 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:20:41.719025 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-b5af8e89-36d1-4cc2-a15d-6ffedd90ad76 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] HTTP exception thrown: Instance c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 could not be found. Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b5af8e89-36d1-4cc2-a15d-6ffedd90ad76 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Request method failure captured: Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 HTTP/1.1 Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGXsBVb2FCl5pfBlYeNhCRgJYAONn62OyzIG9W1T7-GvU6itFGCqSWkV7gb6wXoOx-I4rXInL_utWtsk32iAzklhWwrIrEwyvB6NAuVABPG-OskSCYJMt_knJulkt1_MDTPtl68F7l8lsFgffF5pvgtaV9q6iT-iAnwbgBKQ9tAydp4 Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: f4b74ef125db4100a0a8fe5c4805a60d Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-347785498 Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4b74ef125db4100a0a8fe5c4805a60d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4b74ef125db4100a0a8fe5c4805a60d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4b74ef125db4100a0a8fe5c4805a60d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4b74ef125db4100a0a8fe5c4805a60d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-347785498 Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: f4b74ef125db4100a0a8fe5c4805a60d Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-347785498 Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersNegativeTestMultiTenantJSON-347785498-project Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: f626b1f030f04b65b6b83b79de36a1c2 Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-347785498-project Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: exception: Instance c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 could not be found. Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'c442c1c6-9d65-4978-81d8-6e8a4dfb46f5'} Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 could not be found. Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 could not be found. Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:20:41.721535 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:20:41.728098 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:20:41.728098 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:20:41.728098 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:20:41.728098 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:20:41.728098 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:20:41.728098 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:20:41.728098 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 could not be found. Jun 20 12:20:41.728098 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:20:41.741736 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b5af8e89-36d1-4cc2-a15d-6ffedd90ad76 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] Returning 404 to user: Instance c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:20:41.744715 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b5af8e89-36d1-4cc2-a15d-6ffedd90ad76 tempest-ServersNegativeTestMultiTenantJSON-347785498 tempest-ServersNegativeTestMultiTenantJSON-347785498-project] 10.222.0.27 "GET /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5" status: 404 len: 111 microversion: 2.1 time: 0.166409 Jun 20 12:20:41.751567 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2410/4719] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:41 2022] GET /compute/v2.1/servers/c442c1c6-9d65-4978-81d8-6e8a4dfb46f5 => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:20:42.179974 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1ffc48dd-2f94-4733-9cc9-d2fb0eb7567b tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:42.192693 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1ffc48dd-2f94-4733-9cc9-d2fb0eb7567b tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:42.202211 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1ffc48dd-2f94-4733-9cc9-d2fb0eb7567b tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:42.203179 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1ffc48dd-2f94-4733-9cc9-d2fb0eb7567b tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:42.204506 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1ffc48dd-2f94-4733-9cc9-d2fb0eb7567b tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:42.205506 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1ffc48dd-2f94-4733-9cc9-d2fb0eb7567b tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:42.907438 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1ffc48dd-2f94-4733-9cc9-d2fb0eb7567b tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:42.916456 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1ffc48dd-2f94-4733-9cc9-d2fb0eb7567b tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1724 microversion: 2.1 time: 0.744486 Jun 20 12:20:42.917631 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2310/4720] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:42 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1724 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:43.935639 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9448c9e8-2267-46e6-994e-490254e6bdbb tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:43.936368 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9448c9e8-2267-46e6-994e-490254e6bdbb tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:43.958110 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9448c9e8-2267-46e6-994e-490254e6bdbb tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:43.969584 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9448c9e8-2267-46e6-994e-490254e6bdbb tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:43.976630 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9448c9e8-2267-46e6-994e-490254e6bdbb tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:43.977318 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9448c9e8-2267-46e6-994e-490254e6bdbb tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:44.367937 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f351e890-e489-490f-aed5-9c444db82730 tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:44.368643 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f351e890-e489-490f-aed5-9c444db82730 tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:44.384141 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f351e890-e489-490f-aed5-9c444db82730 tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:44.384615 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f351e890-e489-490f-aed5-9c444db82730 tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:44.394382 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f351e890-e489-490f-aed5-9c444db82730 tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:44.395150 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f351e890-e489-490f-aed5-9c444db82730 tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:44.527180 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9448c9e8-2267-46e6-994e-490254e6bdbb tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:44.556649 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9448c9e8-2267-46e6-994e-490254e6bdbb tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1724 microversion: 2.1 time: 0.622092 Jun 20 12:20:44.578067 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2411/4721] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:43 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1724 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:44.909269 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f351e890-e489-490f-aed5-9c444db82730 tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1832 microversion: 2.1 time: 0.545025 Jun 20 12:20:44.926015 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2311/4722] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:44 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1832 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:45.583120 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-52d472b4-8635-4a28-ae09-b560ff044f78 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:45.583750 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-52d472b4-8635-4a28-ae09-b560ff044f78 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:45.608683 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52d472b4-8635-4a28-ae09-b560ff044f78 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:45.609144 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52d472b4-8635-4a28-ae09-b560ff044f78 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:45.609955 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52d472b4-8635-4a28-ae09-b560ff044f78 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:45.610405 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52d472b4-8635-4a28-ae09-b560ff044f78 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:46.156509 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-52d472b4-8635-4a28-ae09-b560ff044f78 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:46.175733 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-52d472b4-8635-4a28-ae09-b560ff044f78 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1724 microversion: 2.1 time: 0.596480 Jun 20 12:20:46.177484 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2412/4723] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:45 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1724 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:47.196239 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-820d52de-0a1c-49b2-8e11-cad1f5c651ab tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:47.197691 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-820d52de-0a1c-49b2-8e11-cad1f5c651ab tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:47.217189 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-820d52de-0a1c-49b2-8e11-cad1f5c651ab tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:47.218024 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-820d52de-0a1c-49b2-8e11-cad1f5c651ab tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:47.219702 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-820d52de-0a1c-49b2-8e11-cad1f5c651ab tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:47.220799 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-820d52de-0a1c-49b2-8e11-cad1f5c651ab tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:48.035595 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-92898775-823d-44a4-972c-8cd47597ba82 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:48.036105 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-92898775-823d-44a4-972c-8cd47597ba82 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:48.061338 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-92898775-823d-44a4-972c-8cd47597ba82 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:48.062306 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-92898775-823d-44a4-972c-8cd47597ba82 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:48.063275 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-92898775-823d-44a4-972c-8cd47597ba82 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:48.063874 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-92898775-823d-44a4-972c-8cd47597ba82 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:48.118354 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-92898775-823d-44a4-972c-8cd47597ba82 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:20:48.305618 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-92898775-823d-44a4-972c-8cd47597ba82 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 204 len: 0 microversion: 2.1 time: 0.274852 Jun 20 12:20:48.319925 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2413/4724] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:20:48 2022] DELETE /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:20:48.323320 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-dfa47a65-dc55-4457-86b3-87e6817ff25c req-f9e51a59-a129-4063-b897-d746bf515c63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1512eb0-4637-49c4-a4d5-cdbbd1398473", "tag": "d7d7973b-595c-4769-80dd-0441a733dbfc"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:20:48.350202 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-dfa47a65-dc55-4457-86b3-87e6817ff25c req-f9e51a59-a129-4063-b897-d746bf515c63 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:48.350641 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-dfa47a65-dc55-4457-86b3-87e6817ff25c req-f9e51a59-a129-4063-b897-d746bf515c63 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:48.393051 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-dfa47a65-dc55-4457-86b3-87e6817ff25c req-f9e51a59-a129-4063-b897-d746bf515c63 service nova] Creating event network-changed:d7d7973b-595c-4769-80dd-0441a733dbfc for instance a1512eb0-4637-49c4-a4d5-cdbbd1398473 on n-h2-master-1 Jun 20 12:20:48.406868 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-dfa47a65-dc55-4457-86b3-87e6817ff25c req-f9e51a59-a129-4063-b897-d746bf515c63 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087793 Jun 20 12:20:48.408804 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2414/4725] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:20:48.416015 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d90c445a-ec52-4704-ad5f-0cc0f4145346 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:48.417407 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d90c445a-ec52-4704-ad5f-0cc0f4145346 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:48.446739 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d90c445a-ec52-4704-ad5f-0cc0f4145346 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:48.452330 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d90c445a-ec52-4704-ad5f-0cc0f4145346 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:48.453465 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d90c445a-ec52-4704-ad5f-0cc0f4145346 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:48.456726 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d90c445a-ec52-4704-ad5f-0cc0f4145346 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:48.825445 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-820d52de-0a1c-49b2-8e11-cad1f5c651ab tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:48.850161 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-820d52de-0a1c-49b2-8e11-cad1f5c651ab tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1724 microversion: 2.1 time: 1.655159 Jun 20 12:20:48.852529 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2312/4726] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:47 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1724 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:20:48.853278 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d90c445a-ec52-4704-ad5f-0cc0f4145346 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:48.863706 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d90c445a-ec52-4704-ad5f-0cc0f4145346 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1687 microversion: 2.1 time: 0.453064 Jun 20 12:20:48.864172 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-376b608e-ba3e-41bb-aac9-de794da73693 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:48.864988 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-376b608e-ba3e-41bb-aac9-de794da73693 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:48.867941 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2415/4727] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:48 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1687 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:48.883347 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-376b608e-ba3e-41bb-aac9-de794da73693 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:48.886112 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-376b608e-ba3e-41bb-aac9-de794da73693 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:48.886941 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-376b608e-ba3e-41bb-aac9-de794da73693 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:48.887378 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-376b608e-ba3e-41bb-aac9-de794da73693 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:49.390851 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-376b608e-ba3e-41bb-aac9-de794da73693 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:49.414661 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-376b608e-ba3e-41bb-aac9-de794da73693 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1684 microversion: 2.1 time: 0.560648 Jun 20 12:20:49.426185 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2313/4728] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:48 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1684 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:49.870791 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ff0e9242-1f36-495f-bbdc-bb2cac27eed6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:49.873989 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ff0e9242-1f36-495f-bbdc-bb2cac27eed6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:49.887242 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:20:49.890820 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff0e9242-1f36-495f-bbdc-bb2cac27eed6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:49.891836 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff0e9242-1f36-495f-bbdc-bb2cac27eed6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:49.893565 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff0e9242-1f36-495f-bbdc-bb2cac27eed6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:49.894883 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff0e9242-1f36-495f-bbdc-bb2cac27eed6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:49.899766 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-da293ef2-028e-4501-9e62-82556b7ef9ef tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:49.900835 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-da293ef2-028e-4501-9e62-82556b7ef9ef tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:49.916020 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-da293ef2-028e-4501-9e62-82556b7ef9ef tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:49.918019 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-da293ef2-028e-4501-9e62-82556b7ef9ef tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:49.921151 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-da293ef2-028e-4501-9e62-82556b7ef9ef tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:49.922494 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-da293ef2-028e-4501-9e62-82556b7ef9ef tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:50.708970 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-da293ef2-028e-4501-9e62-82556b7ef9ef tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:50.724344 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-da293ef2-028e-4501-9e62-82556b7ef9ef tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1687 microversion: 2.1 time: 0.840971 Jun 20 12:20:50.726015 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2314/4729] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:49 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1687 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:20:50.734543 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c12a8b42-65da-4237-9fe3-d9de88f93e20 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:50.736284 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c12a8b42-65da-4237-9fe3-d9de88f93e20 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:50.746555 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c12a8b42-65da-4237-9fe3-d9de88f93e20 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:50.748242 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c12a8b42-65da-4237-9fe3-d9de88f93e20 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:50.749328 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c12a8b42-65da-4237-9fe3-d9de88f93e20 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:50.750226 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c12a8b42-65da-4237-9fe3-d9de88f93e20 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:50.786420 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ff0e9242-1f36-495f-bbdc-bb2cac27eed6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:50.801823 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ff0e9242-1f36-495f-bbdc-bb2cac27eed6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1701 microversion: 2.1 time: 0.935586 Jun 20 12:20:50.802454 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2416/4730] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:49 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1701 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:50.830010 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e74745b5-5736-457a-a9ef-9488e4e0d3c8 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:20:50.848312 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e74745b5-5736-457a-a9ef-9488e4e0d3c8 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:50.848840 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e74745b5-5736-457a-a9ef-9488e4e0d3c8 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:50.894572 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e74745b5-5736-457a-a9ef-9488e4e0d3c8 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Going to try to start instance {{(pid=119127) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 20 12:20:50.965450 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e74745b5-5736-457a-a9ef-9488e4e0d3c8 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "POST /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19/action" status: 202 len: 0 microversion: 2.1 time: 0.143001 Jun 20 12:20:50.972630 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2417/4731] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:20:50 2022] POST /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:20:50.996010 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-eb0a6d88-7e93-469f-9971-b4bfad4f5597 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:51.002783 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-eb0a6d88-7e93-469f-9971-b4bfad4f5597 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:51.025713 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb0a6d88-7e93-469f-9971-b4bfad4f5597 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:51.026711 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb0a6d88-7e93-469f-9971-b4bfad4f5597 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:51.031863 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb0a6d88-7e93-469f-9971-b4bfad4f5597 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:51.033780 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb0a6d88-7e93-469f-9971-b4bfad4f5597 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:51.280934 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c12a8b42-65da-4237-9fe3-d9de88f93e20 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:51.309852 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c12a8b42-65da-4237-9fe3-d9de88f93e20 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.581455 Jun 20 12:20:51.317033 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2315/4732] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:50 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:51.334415 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-07022c07-72cc-4a84-9260-7e4dae8dcdd8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1656536871"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:20:51.337695 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-07022c07-72cc-4a84-9260-7e4dae8dcdd8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:51.358983 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-07022c07-72cc-4a84-9260-7e4dae8dcdd8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:51.362396 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-07022c07-72cc-4a84-9260-7e4dae8dcdd8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:51.366339 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-07022c07-72cc-4a84-9260-7e4dae8dcdd8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:51.367470 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-07022c07-72cc-4a84-9260-7e4dae8dcdd8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:51.885687 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-07022c07-72cc-4a84-9260-7e4dae8dcdd8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "POST /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/action" status: 202 len: 0 microversion: 2.1 time: 0.555098 Jun 20 12:20:51.888133 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2316/4733] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:20:51 2022] POST /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/action => generated 0 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jun 20 12:20:51.900139 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4af71e0f-f6e6-4b7d-9d4c-9e214ebb392c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:51.901517 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4af71e0f-f6e6-4b7d-9d4c-9e214ebb392c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:51.922888 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4af71e0f-f6e6-4b7d-9d4c-9e214ebb392c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:51.923331 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4af71e0f-f6e6-4b7d-9d4c-9e214ebb392c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:51.927358 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4af71e0f-f6e6-4b7d-9d4c-9e214ebb392c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:51.927856 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4af71e0f-f6e6-4b7d-9d4c-9e214ebb392c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:52.017305 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-eb0a6d88-7e93-469f-9971-b4bfad4f5597 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:52.037151 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-eb0a6d88-7e93-469f-9971-b4bfad4f5597 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1710 microversion: 2.1 time: 1.061659 Jun 20 12:20:52.038453 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2418/4734] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:50 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1710 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:52.051437 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b05da930-8e00-4988-9bb4-26b3c12880e5 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:52.052058 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b05da930-8e00-4988-9bb4-26b3c12880e5 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:52.059004 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b05da930-8e00-4988-9bb4-26b3c12880e5 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:52.059727 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b05da930-8e00-4988-9bb4-26b3c12880e5 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:52.060768 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b05da930-8e00-4988-9bb4-26b3c12880e5 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:52.061390 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b05da930-8e00-4988-9bb4-26b3c12880e5 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:52.221042 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4af71e0f-f6e6-4b7d-9d4c-9e214ebb392c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:52.245784 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4af71e0f-f6e6-4b7d-9d4c-9e214ebb392c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1569 microversion: 2.1 time: 0.354250 Jun 20 12:20:52.247303 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2317/4735] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:51 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1569 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:52.721735 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b05da930-8e00-4988-9bb4-26b3c12880e5 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:52.740544 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b05da930-8e00-4988-9bb4-26b3c12880e5 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1681 microversion: 2.1 time: 0.699664 Jun 20 12:20:52.741616 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2419/4736] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:52 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1681 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:53.056440 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-06d05b20-0db0-42d8-83d5-386d685e33a6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:53.057316 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-06d05b20-0db0-42d8-83d5-386d685e33a6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:53.082109 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-06d05b20-0db0-42d8-83d5-386d685e33a6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:53.083203 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-06d05b20-0db0-42d8-83d5-386d685e33a6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:53.084375 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-81c42a2e-d1d2-4463-b389-b88d5ea0c854 req-f593e8b6-4969-4684-aa1f-e0f71cf202ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1512eb0-4637-49c4-a4d5-cdbbd1398473", "name": "network-vif-deleted", "tag": "d7d7973b-595c-4769-80dd-0441a733dbfc"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:20:53.085347 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-06d05b20-0db0-42d8-83d5-386d685e33a6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:53.086820 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-06d05b20-0db0-42d8-83d5-386d685e33a6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:53.114344 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-81c42a2e-d1d2-4463-b389-b88d5ea0c854 req-f593e8b6-4969-4684-aa1f-e0f71cf202ef service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:53.123917 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-81c42a2e-d1d2-4463-b389-b88d5ea0c854 req-f593e8b6-4969-4684-aa1f-e0f71cf202ef service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:53.155518 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-81c42a2e-d1d2-4463-b389-b88d5ea0c854 req-f593e8b6-4969-4684-aa1f-e0f71cf202ef service nova] Creating event network-vif-deleted:d7d7973b-595c-4769-80dd-0441a733dbfc for instance a1512eb0-4637-49c4-a4d5-cdbbd1398473 on n-h2-master-1 Jun 20 12:20:53.171150 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-81c42a2e-d1d2-4463-b389-b88d5ea0c854 req-f593e8b6-4969-4684-aa1f-e0f71cf202ef service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091752 Jun 20 12:20:53.204602 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2420/4737] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:20:53.265810 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f70bbbb2-909c-408d-85c3-add3afdf7c54 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:53.266718 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f70bbbb2-909c-408d-85c3-add3afdf7c54 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:53.279451 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f70bbbb2-909c-408d-85c3-add3afdf7c54 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:53.279986 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f70bbbb2-909c-408d-85c3-add3afdf7c54 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:53.280824 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f70bbbb2-909c-408d-85c3-add3afdf7c54 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:53.296392 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f70bbbb2-909c-408d-85c3-add3afdf7c54 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:53.384854 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f70bbbb2-909c-408d-85c3-add3afdf7c54 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:53.385433 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f70bbbb2-909c-408d-85c3-add3afdf7c54 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:53.385909 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-f70bbbb2-909c-408d-85c3-add3afdf7c54 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lazy-loading 'fault' on Instance uuid a1512eb0-4637-49c4-a4d5-cdbbd1398473 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:20:53.760572 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-06d05b20-0db0-42d8-83d5-386d685e33a6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:53.769231 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-06d05b20-0db0-42d8-83d5-386d685e33a6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1710 microversion: 2.1 time: 0.717483 Jun 20 12:20:53.776541 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2318/4738] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:53 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1710 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:53.782397 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9d7c97ab-c0be-4679-b42b-61d0800f438c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:53.783009 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9d7c97ab-c0be-4679-b42b-61d0800f438c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:53.804451 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d7c97ab-c0be-4679-b42b-61d0800f438c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:53.804908 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d7c97ab-c0be-4679-b42b-61d0800f438c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:53.805749 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d7c97ab-c0be-4679-b42b-61d0800f438c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:53.806183 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d7c97ab-c0be-4679-b42b-61d0800f438c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:54.094422 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f70bbbb2-909c-408d-85c3-add3afdf7c54 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:54.106761 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f70bbbb2-909c-408d-85c3-add3afdf7c54 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 200 len: 1355 microversion: 2.1 time: 0.845812 Jun 20 12:20:54.111836 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2421/4739] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:53 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 1355 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:54.377942 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9d7c97ab-c0be-4679-b42b-61d0800f438c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:54.386130 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9d7c97ab-c0be-4679-b42b-61d0800f438c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1689 microversion: 2.1 time: 0.607991 Jun 20 12:20:54.386731 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2319/4740] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:53 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1689 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:54.616821 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-51bfb613-591a-4d70-b644-5c469ef35f5e req-c6448bc7-f8a2-4f1b-bfae-12df547e8005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21609be7-c3f0-4e24-a093-2f74ce957a35", "name": "network-vif-unplugged", "status": "completed", "tag": "23a9a38f-112e-4e3f-97f4-ae81b6b5af7c"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:20:54.626746 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-51bfb613-591a-4d70-b644-5c469ef35f5e req-c6448bc7-f8a2-4f1b-bfae-12df547e8005 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:54.627747 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-51bfb613-591a-4d70-b644-5c469ef35f5e req-c6448bc7-f8a2-4f1b-bfae-12df547e8005 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:54.656056 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-51bfb613-591a-4d70-b644-5c469ef35f5e req-c6448bc7-f8a2-4f1b-bfae-12df547e8005 service nova] Creating event network-vif-unplugged:23a9a38f-112e-4e3f-97f4-ae81b6b5af7c for instance 21609be7-c3f0-4e24-a093-2f74ce957a35 on n-h1-master-1 Jun 20 12:20:54.683810 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-51bfb613-591a-4d70-b644-5c469ef35f5e req-c6448bc7-f8a2-4f1b-bfae-12df547e8005 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071025 Jun 20 12:20:54.684787 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2422/4741] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:20:54.795033 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8c7af588-81a3-4c03-8af2-ac2472541a02 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:54.796098 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8c7af588-81a3-4c03-8af2-ac2472541a02 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:54.810725 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8c7af588-81a3-4c03-8af2-ac2472541a02 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:54.814533 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8c7af588-81a3-4c03-8af2-ac2472541a02 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:54.816011 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8c7af588-81a3-4c03-8af2-ac2472541a02 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:54.816973 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8c7af588-81a3-4c03-8af2-ac2472541a02 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:54.864771 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f89635ce-b99e-45af-9d80-d821dcc3c256 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1425691536", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "f20320c6-bd56-42ec-b1ed-225d2dcd7b5e"}, {"uuid": "4bfffca3-5bac-4094-aabc-5aeaaab35a56"}, {"uuid": "f20320c6-bd56-42ec-b1ed-225d2dcd7b5e"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:20:54.975878 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-f89635ce-b99e-45af-9d80-d821dcc3c256 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] validate_networks() for [('f20320c6-bd56-42ec-b1ed-225d2dcd7b5e', None, None, None, None, None), ('4bfffca3-5bac-4094-aabc-5aeaaab35a56', None, None, None, None, None), ('f20320c6-bd56-42ec-b1ed-225d2dcd7b5e', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:20:55.536514 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8c7af588-81a3-4c03-8af2-ac2472541a02 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:55.552006 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8c7af588-81a3-4c03-8af2-ac2472541a02 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1710 microversion: 2.1 time: 0.762232 Jun 20 12:20:55.553098 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2320/4742] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:54 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1710 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:55.559214 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-acef9416-8fdb-4396-adc2-62059b55cf39 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:55.561687 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-acef9416-8fdb-4396-adc2-62059b55cf39 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: a1512eb0-4637-49c4-a4d5-cdbbd1398473] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:55.579240 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-acef9416-8fdb-4396-adc2-62059b55cf39 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:55.582343 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-acef9416-8fdb-4396-adc2-62059b55cf39 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:55.583325 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-acef9416-8fdb-4396-adc2-62059b55cf39 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:55.583896 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-acef9416-8fdb-4396-adc2-62059b55cf39 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:55.629922 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-acef9416-8fdb-4396-adc2-62059b55cf39 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] HTTP exception thrown: Instance a1512eb0-4637-49c4-a4d5-cdbbd1398473 could not be found. Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-acef9416-8fdb-4396-adc2-62059b55cf39 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Request method failure captured: Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 HTTP/1.1 Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGRxXwEWVrLndBXp9okenLjyhkdOBOwXRK4Cejibgug0y9gZVb-q35CPxL4ypqyn2D__W7NeZfrt6P6zq_dz_jtM9HHb9YjfilwN-Kw8EltvT9MAEPJplbU2PqTsTUjGeGogBzl7yp09NSZXdDKx25vj0o6ShE6q88hEvQEZpmuKykM Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 9e9e481852fe4e6ebdc15ec343a741f2 Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2045574846 Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9e9e481852fe4e6ebdc15ec343a741f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9e9e481852fe4e6ebdc15ec343a741f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9e9e481852fe4e6ebdc15ec343a741f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9e9e481852fe4e6ebdc15ec343a741f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2045574846 Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 9e9e481852fe4e6ebdc15ec343a741f2 Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2045574846 Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-TestNetworkAdvancedServerOps-2045574846-project Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: cd27c8696f7147e18054b26ebbae7045 Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2045574846-project Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: exception: Instance a1512eb0-4637-49c4-a4d5-cdbbd1398473 could not be found. Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'a1512eb0-4637-49c4-a4d5-cdbbd1398473'} Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1512eb0-4637-49c4-a4d5-cdbbd1398473 could not be found. Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1512eb0-4637-49c4-a4d5-cdbbd1398473 could not be found. Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:20:55.631991 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:20:55.639886 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:20:55.639886 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:20:55.639886 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:20:55.639886 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:20:55.639886 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:20:55.639886 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:20:55.639886 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1512eb0-4637-49c4-a4d5-cdbbd1398473 could not be found. Jun 20 12:20:55.639886 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:20:55.639886 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-acef9416-8fdb-4396-adc2-62059b55cf39 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Returning 404 to user: Instance a1512eb0-4637-49c4-a4d5-cdbbd1398473 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:20:55.642312 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-acef9416-8fdb-4396-adc2-62059b55cf39 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473" status: 404 len: 111 microversion: 2.1 time: 0.087986 Jun 20 12:20:55.643684 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2321/4743] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:55 2022] GET /compute/v2.1/servers/a1512eb0-4637-49c4-a4d5-cdbbd1398473 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:20:55.657231 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3eb86770-d566-4591-b5d5-cd5bc57c7ae7 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:55.657992 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3eb86770-d566-4591-b5d5-cd5bc57c7ae7 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:55.668337 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3eb86770-d566-4591-b5d5-cd5bc57c7ae7 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:55.669474 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3eb86770-d566-4591-b5d5-cd5bc57c7ae7 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:55.670451 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3eb86770-d566-4591-b5d5-cd5bc57c7ae7 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:55.670997 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3eb86770-d566-4591-b5d5-cd5bc57c7ae7 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:56.280748 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3eb86770-d566-4591-b5d5-cd5bc57c7ae7 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:56.301115 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3eb86770-d566-4591-b5d5-cd5bc57c7ae7 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1689 microversion: 2.1 time: 0.653212 Jun 20 12:20:56.303092 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2322/4744] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:55 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1689 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:56.569378 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-95ca3bf7-b002-4f68-8e05-e3d7ac0103c6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:56.570694 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-95ca3bf7-b002-4f68-8e05-e3d7ac0103c6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:56.579207 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95ca3bf7-b002-4f68-8e05-e3d7ac0103c6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:56.579668 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95ca3bf7-b002-4f68-8e05-e3d7ac0103c6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:56.582632 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95ca3bf7-b002-4f68-8e05-e3d7ac0103c6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:56.583121 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95ca3bf7-b002-4f68-8e05-e3d7ac0103c6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:57.915582 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-95ca3bf7-b002-4f68-8e05-e3d7ac0103c6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:57.932837 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-95ca3bf7-b002-4f68-8e05-e3d7ac0103c6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1714 microversion: 2.1 time: 1.367547 Jun 20 12:20:57.937340 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2323/4745] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:56 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1714 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:20:57.951311 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ceff9ddd-4a5c-4ef8-a655-9070d8424aed tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:57.954544 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ceff9ddd-4a5c-4ef8-a655-9070d8424aed tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:57.980347 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ceff9ddd-4a5c-4ef8-a655-9070d8424aed tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:57.980809 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ceff9ddd-4a5c-4ef8-a655-9070d8424aed tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:57.984240 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ceff9ddd-4a5c-4ef8-a655-9070d8424aed tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:57.984715 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ceff9ddd-4a5c-4ef8-a655-9070d8424aed tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:58.629740 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-f89635ce-b99e-45af-9d80-d821dcc3c256 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:20:58.630784 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-f89635ce-b99e-45af-9d80-d821dcc3c256 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:20:58.631453 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-f89635ce-b99e-45af-9d80-d821dcc3c256 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:20:58.632042 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-f89635ce-b99e-45af-9d80-d821dcc3c256 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:20:58.632678 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-f89635ce-b99e-45af-9d80-d821dcc3c256 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:20:58.667009 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f89635ce-b99e-45af-9d80-d821dcc3c256 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:58.667478 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f89635ce-b99e-45af-9d80-d821dcc3c256 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:58.668416 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f89635ce-b99e-45af-9d80-d821dcc3c256 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:58.669137 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f89635ce-b99e-45af-9d80-d821dcc3c256 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:58.726322 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-f89635ce-b99e-45af-9d80-d821dcc3c256 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Getting quotas for project 0953197109e44d0496000c9535c8c583. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:20:58.733940 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-f89635ce-b99e-45af-9d80-d821dcc3c256 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Getting quotas for user a8fa09acee6e4f9cb99c6e78e5b85589 and project 0953197109e44d0496000c9535c8c583. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:20:58.764774 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ceff9ddd-4a5c-4ef8-a655-9070d8424aed tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:58.768439 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f89635ce-b99e-45af-9d80-d821dcc3c256 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:20:58.770919 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f89635ce-b99e-45af-9d80-d821dcc3c256 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: 9ddb525a-a112-4b08-829e-406a30d2fb32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:20:58.780553 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ceff9ddd-4a5c-4ef8-a655-9070d8424aed tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1684 microversion: 2.1 time: 0.838043 Jun 20 12:20:58.783184 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2324/4746] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:57 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1684 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:58.894790 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f89635ce-b99e-45af-9d80-d821dcc3c256 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.066219 Jun 20 12:20:58.902429 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2423/4747] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:20:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 4075 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:20:58.906375 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5163e248-f375-4b56-879a-76b6b2730d2e tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:58.907001 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5163e248-f375-4b56-879a-76b6b2730d2e tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: 9ddb525a-a112-4b08-829e-406a30d2fb32] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:59.242384 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5163e248-f375-4b56-879a-76b6b2730d2e tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:20:59.258626 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5163e248-f375-4b56-879a-76b6b2730d2e tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32" status: 200 len: 1213 microversion: 2.1 time: 0.356310 Jun 20 12:20:59.272166 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2325/4748] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:58 2022] GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32 => generated 1213 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:20:59.802913 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-585283e4-6c19-4e42-8bcd-b42b0e1d0619 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:59.811241 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-585283e4-6c19-4e42-8bcd-b42b0e1d0619 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:20:59.829611 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-585283e4-6c19-4e42-8bcd-b42b0e1d0619 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:59.830022 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-585283e4-6c19-4e42-8bcd-b42b0e1d0619 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:59.831907 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-585283e4-6c19-4e42-8bcd-b42b0e1d0619 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:59.832466 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-585283e4-6c19-4e42-8bcd-b42b0e1d0619 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:00.276512 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7f828640-ea8d-44f3-8832-b2df14eb5af1 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:00.277139 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7f828640-ea8d-44f3-8832-b2df14eb5af1 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: 9ddb525a-a112-4b08-829e-406a30d2fb32] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:00.290575 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f828640-ea8d-44f3-8832-b2df14eb5af1 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:00.294389 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f828640-ea8d-44f3-8832-b2df14eb5af1 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:00.297550 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f828640-ea8d-44f3-8832-b2df14eb5af1 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:00.298215 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f828640-ea8d-44f3-8832-b2df14eb5af1 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:00.483665 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7f828640-ea8d-44f3-8832-b2df14eb5af1 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:00.492182 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:21:00.511235 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7f828640-ea8d-44f3-8832-b2df14eb5af1 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32" status: 200 len: 1265 microversion: 2.1 time: 0.238985 Jun 20 12:21:00.526113 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2326/4749] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:00 2022] GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32 => generated 1265 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:00.554248 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-585283e4-6c19-4e42-8bcd-b42b0e1d0619 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:00.567209 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-585283e4-6c19-4e42-8bcd-b42b0e1d0619 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1684 microversion: 2.1 time: 0.770582 Jun 20 12:21:00.568445 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2424/4750] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:20:59 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1684 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:01.534525 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-579c192e-1afd-405a-93b9-63e38eacbfae tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:01.535047 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-579c192e-1afd-405a-93b9-63e38eacbfae tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: 9ddb525a-a112-4b08-829e-406a30d2fb32] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:01.556168 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-579c192e-1afd-405a-93b9-63e38eacbfae tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:01.561060 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-579c192e-1afd-405a-93b9-63e38eacbfae tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:01.561952 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-579c192e-1afd-405a-93b9-63e38eacbfae tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:01.562394 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-579c192e-1afd-405a-93b9-63e38eacbfae tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:01.616561 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7b54d19d-ac71-4eaf-b77a-10dd02093c02 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:01.617226 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7b54d19d-ac71-4eaf-b77a-10dd02093c02 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:01.643449 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7b54d19d-ac71-4eaf-b77a-10dd02093c02 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:01.643920 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7b54d19d-ac71-4eaf-b77a-10dd02093c02 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:01.644755 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7b54d19d-ac71-4eaf-b77a-10dd02093c02 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:01.656788 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7b54d19d-ac71-4eaf-b77a-10dd02093c02 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:01.869763 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-579c192e-1afd-405a-93b9-63e38eacbfae tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:01.878002 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-579c192e-1afd-405a-93b9-63e38eacbfae tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32" status: 200 len: 1271 microversion: 2.1 time: 0.348030 Jun 20 12:21:01.886955 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2327/4751] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:01 2022] GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32 => generated 1271 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:02.345321 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7b54d19d-ac71-4eaf-b77a-10dd02093c02 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:02.360268 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7b54d19d-ac71-4eaf-b77a-10dd02093c02 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1684 microversion: 2.1 time: 0.773107 Jun 20 12:21:02.364850 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2425/4752] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:01 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1684 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:02.902514 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2cecc37f-7395-4706-8480-c20df63fc018 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:02.903935 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2cecc37f-7395-4706-8480-c20df63fc018 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: 9ddb525a-a112-4b08-829e-406a30d2fb32] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:02.913535 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2cecc37f-7395-4706-8480-c20df63fc018 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:02.916989 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2cecc37f-7395-4706-8480-c20df63fc018 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:02.920886 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2cecc37f-7395-4706-8480-c20df63fc018 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:02.921621 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2cecc37f-7395-4706-8480-c20df63fc018 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:03.374323 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2cecc37f-7395-4706-8480-c20df63fc018 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:03.381882 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9c370182-5c11-4f91-a179-4a7368557f29 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:03.383116 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9c370182-5c11-4f91-a179-4a7368557f29 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:03.386169 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2cecc37f-7395-4706-8480-c20df63fc018 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32" status: 200 len: 1271 microversion: 2.1 time: 0.485851 Jun 20 12:21:03.397149 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2328/4753] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:02 2022] GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32 => generated 1271 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:03.421904 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9c370182-5c11-4f91-a179-4a7368557f29 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:03.422678 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9c370182-5c11-4f91-a179-4a7368557f29 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:03.424614 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9c370182-5c11-4f91-a179-4a7368557f29 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:03.425273 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9c370182-5c11-4f91-a179-4a7368557f29 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:04.011174 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9c370182-5c11-4f91-a179-4a7368557f29 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:04.028255 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9c370182-5c11-4f91-a179-4a7368557f29 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1684 microversion: 2.1 time: 0.650968 Jun 20 12:21:04.030465 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2426/4754] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:03 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1684 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:21:04.420264 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3638d687-ede4-4a87-82d3-848596264a9c tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:04.422936 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3638d687-ede4-4a87-82d3-848596264a9c tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: 9ddb525a-a112-4b08-829e-406a30d2fb32] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:04.438644 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3638d687-ede4-4a87-82d3-848596264a9c tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:04.439096 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3638d687-ede4-4a87-82d3-848596264a9c tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:04.452382 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3638d687-ede4-4a87-82d3-848596264a9c tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:04.452844 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3638d687-ede4-4a87-82d3-848596264a9c tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:05.047613 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e6f4dbc4-ca84-4a0d-abc3-ee03d14a7901 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:05.048529 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e6f4dbc4-ca84-4a0d-abc3-ee03d14a7901 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:05.070368 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e6f4dbc4-ca84-4a0d-abc3-ee03d14a7901 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:05.079026 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e6f4dbc4-ca84-4a0d-abc3-ee03d14a7901 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:05.080342 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e6f4dbc4-ca84-4a0d-abc3-ee03d14a7901 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:05.083584 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e6f4dbc4-ca84-4a0d-abc3-ee03d14a7901 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:05.137297 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:21:05.631321 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e6f4dbc4-ca84-4a0d-abc3-ee03d14a7901 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:05.649352 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e6f4dbc4-ca84-4a0d-abc3-ee03d14a7901 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1684 microversion: 2.1 time: 0.605696 Jun 20 12:21:05.660702 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2427/4755] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:05 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1684 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:05.696418 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3638d687-ede4-4a87-82d3-848596264a9c tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:05.714429 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3638d687-ede4-4a87-82d3-848596264a9c tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32" status: 200 len: 1271 microversion: 2.1 time: 1.302578 Jun 20 12:21:05.733210 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2329/4756] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:04 2022] GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32 => generated 1271 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:05.900872 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-2d565800-97c1-4f45-9ed3-a2a8fd3a88f4 req-da27dc56-48aa-4fc1-9d73-35579a095192 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21609be7-c3f0-4e24-a093-2f74ce957a35", "name": "network-vif-plugged", "status": "completed", "tag": "23a9a38f-112e-4e3f-97f4-ae81b6b5af7c"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:21:05.900872 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-2d565800-97c1-4f45-9ed3-a2a8fd3a88f4 req-da27dc56-48aa-4fc1-9d73-35579a095192 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:05.900872 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-2d565800-97c1-4f45-9ed3-a2a8fd3a88f4 req-da27dc56-48aa-4fc1-9d73-35579a095192 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:05.900872 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-2d565800-97c1-4f45-9ed3-a2a8fd3a88f4 req-da27dc56-48aa-4fc1-9d73-35579a095192 service nova] Creating event network-vif-plugged:23a9a38f-112e-4e3f-97f4-ae81b6b5af7c for instance 21609be7-c3f0-4e24-a093-2f74ce957a35 on n-h1-master-1 Jun 20 12:21:05.900872 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-2d565800-97c1-4f45-9ed3-a2a8fd3a88f4 req-da27dc56-48aa-4fc1-9d73-35579a095192 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043167 Jun 20 12:21:05.900872 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2428/4757] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:21:06.667845 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5bd70e76-0c6d-4d8d-a7db-7f2204b4a3e0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:06.668478 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5bd70e76-0c6d-4d8d-a7db-7f2204b4a3e0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:06.687020 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5bd70e76-0c6d-4d8d-a7db-7f2204b4a3e0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:06.687499 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5bd70e76-0c6d-4d8d-a7db-7f2204b4a3e0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:06.688304 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5bd70e76-0c6d-4d8d-a7db-7f2204b4a3e0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:06.688826 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5bd70e76-0c6d-4d8d-a7db-7f2204b4a3e0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:06.742353 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ffcc8df8-5057-4b4f-8815-55de4cd9d71d tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:06.744161 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ffcc8df8-5057-4b4f-8815-55de4cd9d71d tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: 9ddb525a-a112-4b08-829e-406a30d2fb32] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:06.765403 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ffcc8df8-5057-4b4f-8815-55de4cd9d71d tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:06.768062 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ffcc8df8-5057-4b4f-8815-55de4cd9d71d tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:06.771048 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ffcc8df8-5057-4b4f-8815-55de4cd9d71d tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:06.771605 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ffcc8df8-5057-4b4f-8815-55de4cd9d71d tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:07.319355 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5bd70e76-0c6d-4d8d-a7db-7f2204b4a3e0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:07.343799 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5bd70e76-0c6d-4d8d-a7db-7f2204b4a3e0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1684 microversion: 2.1 time: 0.681012 Jun 20 12:21:07.347519 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2330/4758] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:06 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1684 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:07.581494 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ffcc8df8-5057-4b4f-8815-55de4cd9d71d tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:07.600303 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ffcc8df8-5057-4b4f-8815-55de4cd9d71d tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32" status: 200 len: 1313 microversion: 2.1 time: 0.868644 Jun 20 12:21:07.603406 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2429/4759] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:06 2022] GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32 => generated 1313 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:08.367957 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f38630da-98f9-4f20-b710-48457450040d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:08.367957 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f38630da-98f9-4f20-b710-48457450040d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:08.379990 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:21:08.390158 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f38630da-98f9-4f20-b710-48457450040d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:08.391801 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f38630da-98f9-4f20-b710-48457450040d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:08.397832 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f38630da-98f9-4f20-b710-48457450040d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:08.398436 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f38630da-98f9-4f20-b710-48457450040d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:08.622797 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ef0edda7-85d6-41d4-ae18-3b26dca4f8af tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:08.623419 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ef0edda7-85d6-41d4-ae18-3b26dca4f8af tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: 9ddb525a-a112-4b08-829e-406a30d2fb32] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:08.654780 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef0edda7-85d6-41d4-ae18-3b26dca4f8af tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:08.657996 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef0edda7-85d6-41d4-ae18-3b26dca4f8af tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:08.667677 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef0edda7-85d6-41d4-ae18-3b26dca4f8af tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:08.668235 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef0edda7-85d6-41d4-ae18-3b26dca4f8af tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:08.718668 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f38630da-98f9-4f20-b710-48457450040d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:08.735758 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f38630da-98f9-4f20-b710-48457450040d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1684 microversion: 2.1 time: 0.365163 Jun 20 12:21:08.736461 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2331/4760] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:08 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1684 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:08.748534 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:21:08.754994 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:21:09.754498 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c8de97ad-24e1-4f8e-9e08-e14a13c2a9d9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:09.755695 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c8de97ad-24e1-4f8e-9e08-e14a13c2a9d9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:09.765219 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:21:09.772715 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c8de97ad-24e1-4f8e-9e08-e14a13c2a9d9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:09.774212 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c8de97ad-24e1-4f8e-9e08-e14a13c2a9d9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:09.777773 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c8de97ad-24e1-4f8e-9e08-e14a13c2a9d9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:09.778515 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c8de97ad-24e1-4f8e-9e08-e14a13c2a9d9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:09.850603 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ef0edda7-85d6-41d4-ae18-3b26dca4f8af tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:09.863997 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ef0edda7-85d6-41d4-ae18-3b26dca4f8af tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32" status: 200 len: 1334 microversion: 2.1 time: 1.243865 Jun 20 12:21:09.864650 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2430/4761] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:08 2022] GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32 => generated 1334 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:10.454630 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c8de97ad-24e1-4f8e-9e08-e14a13c2a9d9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:10.468108 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c8de97ad-24e1-4f8e-9e08-e14a13c2a9d9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1684 microversion: 2.1 time: 0.713048 Jun 20 12:21:10.469072 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2332/4762] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:09 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1684 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:21:10.882057 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-86347718-6dc5-49e3-81e2-42a82080439e tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:10.884107 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-86347718-6dc5-49e3-81e2-42a82080439e tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: 9ddb525a-a112-4b08-829e-406a30d2fb32] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:10.898498 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86347718-6dc5-49e3-81e2-42a82080439e tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:10.900804 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86347718-6dc5-49e3-81e2-42a82080439e tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:10.901884 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86347718-6dc5-49e3-81e2-42a82080439e tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:10.902906 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86347718-6dc5-49e3-81e2-42a82080439e tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:11.404369 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-86347718-6dc5-49e3-81e2-42a82080439e tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:11.428807 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-86347718-6dc5-49e3-81e2-42a82080439e tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32" status: 200 len: 1355 microversion: 2.1 time: 0.551520 Jun 20 12:21:11.435503 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2431/4763] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:10 2022] GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32 => generated 1355 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:11.491144 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-22cf22bb-d760-4fac-acdb-3efa855cfaba tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:11.491763 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-22cf22bb-d760-4fac-acdb-3efa855cfaba tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:11.517847 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22cf22bb-d760-4fac-acdb-3efa855cfaba tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:11.518997 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22cf22bb-d760-4fac-acdb-3efa855cfaba tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:11.520011 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22cf22bb-d760-4fac-acdb-3efa855cfaba tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:11.520856 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22cf22bb-d760-4fac-acdb-3efa855cfaba tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:12.375367 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-22cf22bb-d760-4fac-acdb-3efa855cfaba tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:12.390952 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-22cf22bb-d760-4fac-acdb-3efa855cfaba tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1684 microversion: 2.1 time: 0.908415 Jun 20 12:21:12.391551 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2333/4764] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:11 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1684 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:12.455019 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-710e6c08-7c68-4c12-85bf-c67dad9aec8e tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:12.455019 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-710e6c08-7c68-4c12-85bf-c67dad9aec8e tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: 9ddb525a-a112-4b08-829e-406a30d2fb32] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:12.487452 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-710e6c08-7c68-4c12-85bf-c67dad9aec8e tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:12.488051 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-710e6c08-7c68-4c12-85bf-c67dad9aec8e tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:12.493163 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-710e6c08-7c68-4c12-85bf-c67dad9aec8e tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:12.496953 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-710e6c08-7c68-4c12-85bf-c67dad9aec8e tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:12.697636 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0c9aa3cf-4ebb-4974-a826-25af2b0f78a6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:12.699384 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0c9aa3cf-4ebb-4974-a826-25af2b0f78a6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:12.710425 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c9aa3cf-4ebb-4974-a826-25af2b0f78a6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:12.713590 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c9aa3cf-4ebb-4974-a826-25af2b0f78a6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:12.718143 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c9aa3cf-4ebb-4974-a826-25af2b0f78a6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:12.718928 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c9aa3cf-4ebb-4974-a826-25af2b0f78a6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:12.808927 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0c9aa3cf-4ebb-4974-a826-25af2b0f78a6 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.112021 Jun 20 12:21:12.811784 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2334/4765] 10.222.0.27 () {60 vars in 1342 bytes} [Mon Jun 20 12:21:12 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3/os-volume_attachments => generated 25 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:12.986445 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-980c2ff3-6ba2-45e4-9511-1014c14dc274 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:12.987238 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-980c2ff3-6ba2-45e4-9511-1014c14dc274 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:12.999674 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-980c2ff3-6ba2-45e4-9511-1014c14dc274 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:13.000573 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-980c2ff3-6ba2-45e4-9511-1014c14dc274 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:13.005874 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-980c2ff3-6ba2-45e4-9511-1014c14dc274 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:13.006601 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-980c2ff3-6ba2-45e4-9511-1014c14dc274 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:13.101661 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-980c2ff3-6ba2-45e4-9511-1014c14dc274 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:21:13.329002 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-980c2ff3-6ba2-45e4-9511-1014c14dc274 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 204 len: 0 microversion: 2.20 time: 0.348158 Jun 20 12:21:13.330326 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2335/4766] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Jun 20 12:21:12 2022] DELETE /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 12:21:13.343336 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-8746ae6c-28b8-4f28-a009-680b25581fca req-4fb5a84a-0039-4bbc-9200-29ae2792a66e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ddb525a-a112-4b08-829e-406a30d2fb32", "tag": "b72ff8fb-8380-4bad-a4a2-c753c1e34b09"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:21:13.367088 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-8746ae6c-28b8-4f28-a009-680b25581fca req-4fb5a84a-0039-4bbc-9200-29ae2792a66e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:13.367999 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-8746ae6c-28b8-4f28-a009-680b25581fca req-4fb5a84a-0039-4bbc-9200-29ae2792a66e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:13.405106 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-8746ae6c-28b8-4f28-a009-680b25581fca req-4fb5a84a-0039-4bbc-9200-29ae2792a66e service nova] Creating event network-changed:b72ff8fb-8380-4bad-a4a2-c753c1e34b09 for instance 9ddb525a-a112-4b08-829e-406a30d2fb32 on n-h1-master-1 Jun 20 12:21:13.413310 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-8746ae6c-28b8-4f28-a009-680b25581fca req-4fb5a84a-0039-4bbc-9200-29ae2792a66e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074940 Jun 20 12:21:13.414894 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2336/4767] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:21:13.421348 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-676c9ff6-c4a7-411d-bb42-f0fbb4f6be6c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:13.422781 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-676c9ff6-c4a7-411d-bb42-f0fbb4f6be6c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:13.433307 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-676c9ff6-c4a7-411d-bb42-f0fbb4f6be6c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:13.434213 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-676c9ff6-c4a7-411d-bb42-f0fbb4f6be6c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:13.435227 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-676c9ff6-c4a7-411d-bb42-f0fbb4f6be6c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:13.435931 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-676c9ff6-c4a7-411d-bb42-f0fbb4f6be6c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:13.537598 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-710e6c08-7c68-4c12-85bf-c67dad9aec8e tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:13.546558 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-710e6c08-7c68-4c12-85bf-c67dad9aec8e tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32" status: 200 len: 1355 microversion: 2.1 time: 1.098017 Jun 20 12:21:13.564117 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2432/4768] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:12 2022] GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32 => generated 1355 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:13.584744 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8bf833d7-800d-409b-a0dd-395a91b00f96 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:13.595348 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8bf833d7-800d-409b-a0dd-395a91b00f96 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:13.603124 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bf833d7-800d-409b-a0dd-395a91b00f96 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:13.607226 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bf833d7-800d-409b-a0dd-395a91b00f96 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:13.608662 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bf833d7-800d-409b-a0dd-395a91b00f96 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:13.614945 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bf833d7-800d-409b-a0dd-395a91b00f96 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:14.062429 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8bf833d7-800d-409b-a0dd-395a91b00f96 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:14.084540 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8bf833d7-800d-409b-a0dd-395a91b00f96 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1684 microversion: 2.1 time: 0.518486 Jun 20 12:21:14.086238 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2433/4769] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:13 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1684 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:14.565989 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bbc52872-8c66-40bd-8833-19e78e2de006 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:14.567369 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bbc52872-8c66-40bd-8833-19e78e2de006 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: 9ddb525a-a112-4b08-829e-406a30d2fb32] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:14.579707 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bbc52872-8c66-40bd-8833-19e78e2de006 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:14.583827 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bbc52872-8c66-40bd-8833-19e78e2de006 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:14.584919 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bbc52872-8c66-40bd-8833-19e78e2de006 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:14.585528 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bbc52872-8c66-40bd-8833-19e78e2de006 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:14.916709 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bbc52872-8c66-40bd-8833-19e78e2de006 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:14.931685 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bbc52872-8c66-40bd-8833-19e78e2de006 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32" status: 200 len: 1355 microversion: 2.1 time: 0.369715 Jun 20 12:21:14.936673 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2434/4770] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:14 2022] GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32 => generated 1355 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:21:15.121438 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-259d2bf9-f1c5-477a-81f3-f631d804893c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:15.125146 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-259d2bf9-f1c5-477a-81f3-f631d804893c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:15.138100 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-259d2bf9-f1c5-477a-81f3-f631d804893c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:15.140814 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-259d2bf9-f1c5-477a-81f3-f631d804893c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:15.141810 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-259d2bf9-f1c5-477a-81f3-f631d804893c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:15.142792 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-259d2bf9-f1c5-477a-81f3-f631d804893c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:15.311333 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-676c9ff6-c4a7-411d-bb42-f0fbb4f6be6c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:15.325276 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-676c9ff6-c4a7-411d-bb42-f0fbb4f6be6c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:15.333168 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-676c9ff6-c4a7-411d-bb42-f0fbb4f6be6c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:15.334660 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-676c9ff6-c4a7-411d-bb42-f0fbb4f6be6c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1724 microversion: 2.20 time: 1.918492 Jun 20 12:21:15.335705 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2337/4771] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:21:13 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1724 bytes in 1920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:21:15.361927 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-94378b7e-2b72-4de7-8169-aa20df8832a6 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '.version_select at 0x7f60724889d0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:15.396660 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-94378b7e-2b72-4de7-8169-aa20df8832a6 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-722062693" status: 202 len: 0 microversion: 2.1 time: 0.038320 Jun 20 12:21:15.405633 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2338/4772] 10.222.0.27 () {58 vars in 1280 bytes} [Mon Jun 20 12:21:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-722062693 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 12:21:15.443790 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a78afe8e-e7fc-433f-b3db-6d7d21cc1209 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Action: 'create', calling method: .version_select at 0x7f60725be940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1955254088", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIczC7W7mtpIrvN7EB0bmGJiz/5olhms3wMc/VOwXajL2Dm+xnBnzLn/S/4ZSgjek5Nzfz2yb1iKWOrzEA2EBRkc93ssUjzgWanZFapLTXgHa/0XarUzRfegA6bky3ShA=="}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:21:15.490108 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-a78afe8e-e7fc-433f-b3db-6d7d21cc1209 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Getting quotas for project 9e9e481852fe4e6ebdc15ec343a741f2. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:21:15.501527 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-a78afe8e-e7fc-433f-b3db-6d7d21cc1209 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Getting quotas for user cd27c8696f7147e18054b26ebbae7045 and project 9e9e481852fe4e6ebdc15ec343a741f2. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:21:15.560971 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a78afe8e-e7fc-433f-b3db-6d7d21cc1209 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.116575 Jun 20 12:21:15.566696 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2339/4773] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 12:21:15 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:21:15.666073 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-259d2bf9-f1c5-477a-81f3-f631d804893c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:15.681651 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-259d2bf9-f1c5-477a-81f3-f631d804893c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1684 microversion: 2.1 time: 0.568501 Jun 20 12:21:15.687769 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2435/4774] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:15 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1684 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:15.961434 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dadc9c16-99ab-4019-88ad-da839be6e143 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:15.962662 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-dadc9c16-99ab-4019-88ad-da839be6e143 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: 9ddb525a-a112-4b08-829e-406a30d2fb32] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:15.997433 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dadc9c16-99ab-4019-88ad-da839be6e143 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:15.998075 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dadc9c16-99ab-4019-88ad-da839be6e143 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:15.999873 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dadc9c16-99ab-4019-88ad-da839be6e143 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:16.000376 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dadc9c16-99ab-4019-88ad-da839be6e143 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:16.357597 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-512ce385-b09a-4100-8a1f-3e1f246ee4fa tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:16.361656 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-512ce385-b09a-4100-8a1f-3e1f246ee4fa tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:16.387517 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-512ce385-b09a-4100-8a1f-3e1f246ee4fa tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:16.392384 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-512ce385-b09a-4100-8a1f-3e1f246ee4fa tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:16.393656 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-512ce385-b09a-4100-8a1f-3e1f246ee4fa tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:16.394601 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-512ce385-b09a-4100-8a1f-3e1f246ee4fa tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:16.917063 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-512ce385-b09a-4100-8a1f-3e1f246ee4fa tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:16.944034 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-512ce385-b09a-4100-8a1f-3e1f246ee4fa tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:16.956360 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-512ce385-b09a-4100-8a1f-3e1f246ee4fa tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:16.958485 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-512ce385-b09a-4100-8a1f-3e1f246ee4fa tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1724 microversion: 2.20 time: 0.606288 Jun 20 12:21:16.959586 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2436/4775] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:21:16 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1724 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:21:17.015217 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e5b2abb9-f4fe-476b-adc4-365155c82b4e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:17.015856 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e5b2abb9-f4fe-476b-adc4-365155c82b4e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:17.047240 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e5b2abb9-f4fe-476b-adc4-365155c82b4e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:17.047240 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e5b2abb9-f4fe-476b-adc4-365155c82b4e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:17.050458 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e5b2abb9-f4fe-476b-adc4-365155c82b4e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:17.054450 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e5b2abb9-f4fe-476b-adc4-365155c82b4e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:17.213630 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-dadc9c16-99ab-4019-88ad-da839be6e143 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:17.222578 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dadc9c16-99ab-4019-88ad-da839be6e143 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32" status: 200 len: 1355 microversion: 2.1 time: 1.272309 Jun 20 12:21:17.223189 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2340/4776] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:15 2022] GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32 => generated 1355 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:17.749259 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e5b2abb9-f4fe-476b-adc4-365155c82b4e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:17.763763 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e5b2abb9-f4fe-476b-adc4-365155c82b4e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1684 microversion: 2.1 time: 0.784536 Jun 20 12:21:17.777785 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2437/4777] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:16 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1684 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:17.815895 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-5510d193-75a2-473b-bfbd-90bcc97dc752 req-039c5b73-b07a-4473-98de-702de6637681 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ed20ca4-7f49-4d0a-a590-d2d4274698e3", "name": "network-vif-deleted", "tag": "4bb9ec16-a224-4e67-8de4-0415485dde23"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:21:17.833227 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-5510d193-75a2-473b-bfbd-90bcc97dc752 req-039c5b73-b07a-4473-98de-702de6637681 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:17.844155 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-5510d193-75a2-473b-bfbd-90bcc97dc752 req-039c5b73-b07a-4473-98de-702de6637681 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:17.880462 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-5510d193-75a2-473b-bfbd-90bcc97dc752 req-039c5b73-b07a-4473-98de-702de6637681 service nova] Creating event network-vif-deleted:4bb9ec16-a224-4e67-8de4-0415485dde23 for instance 6ed20ca4-7f49-4d0a-a590-d2d4274698e3 on n-h2-master-1 Jun 20 12:21:17.911630 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-5510d193-75a2-473b-bfbd-90bcc97dc752 req-039c5b73-b07a-4473-98de-702de6637681 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101176 Jun 20 12:21:17.922903 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2341/4778] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:21:17.979552 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ef110cdc-549d-4262-944b-069ddb2e858c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:17.981167 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ef110cdc-549d-4262-944b-069ddb2e858c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:18.007618 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef110cdc-549d-4262-944b-069ddb2e858c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:18.009662 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef110cdc-549d-4262-944b-069ddb2e858c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:18.014348 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef110cdc-549d-4262-944b-069ddb2e858c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:18.016270 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef110cdc-549d-4262-944b-069ddb2e858c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:18.102669 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-94b0a958-660b-4255-abc6-684a60e44272 req-75b99714-8265-4366-a5c3-363c3c046f9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ddb525a-a112-4b08-829e-406a30d2fb32", "tag": "923a7ccd-f077-4c2b-b165-e851039b1c4d"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:21:18.135743 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-94b0a958-660b-4255-abc6-684a60e44272 req-75b99714-8265-4366-a5c3-363c3c046f9e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:18.136187 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-94b0a958-660b-4255-abc6-684a60e44272 req-75b99714-8265-4366-a5c3-363c3c046f9e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:18.138759 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef110cdc-549d-4262-944b-069ddb2e858c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:18.139233 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef110cdc-549d-4262-944b-069ddb2e858c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:18.141373 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-ef110cdc-549d-4262-944b-069ddb2e858c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lazy-loading 'fault' on Instance uuid 6ed20ca4-7f49-4d0a-a590-d2d4274698e3 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:21:18.194713 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-94b0a958-660b-4255-abc6-684a60e44272 req-75b99714-8265-4366-a5c3-363c3c046f9e service nova] Creating event network-changed:923a7ccd-f077-4c2b-b165-e851039b1c4d for instance 9ddb525a-a112-4b08-829e-406a30d2fb32 on n-h1-master-1 Jun 20 12:21:18.205917 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-94b0a958-660b-4255-abc6-684a60e44272 req-75b99714-8265-4366-a5c3-363c3c046f9e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108001 Jun 20 12:21:18.210909 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2342/4779] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:21:18.242366 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-792954a5-636a-499f-acd1-c2ecc684436e tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:18.244935 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-792954a5-636a-499f-acd1-c2ecc684436e tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: 9ddb525a-a112-4b08-829e-406a30d2fb32] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:18.265006 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-792954a5-636a-499f-acd1-c2ecc684436e tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:18.265476 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-792954a5-636a-499f-acd1-c2ecc684436e tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:18.281290 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-792954a5-636a-499f-acd1-c2ecc684436e tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:18.283466 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-792954a5-636a-499f-acd1-c2ecc684436e tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:18.650443 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ef110cdc-549d-4262-944b-069ddb2e858c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:18.659924 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ef110cdc-549d-4262-944b-069ddb2e858c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:18.674516 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ef110cdc-549d-4262-944b-069ddb2e858c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa6f744fe3e8403ea1960856026abe61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d48009b1164cf3a605b30513636e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:18.675792 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ef110cdc-549d-4262-944b-069ddb2e858c tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 200 len: 1371 microversion: 2.20 time: 0.701237 Jun 20 12:21:18.676410 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2438/4780] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:21:17 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 1371 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:21:18.782591 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ede4952a-6e14-49b7-9e74-62fdc7d1bd82 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:18.783052 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ede4952a-6e14-49b7-9e74-62fdc7d1bd82 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:18.793395 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ede4952a-6e14-49b7-9e74-62fdc7d1bd82 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:18.794131 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ede4952a-6e14-49b7-9e74-62fdc7d1bd82 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:18.801751 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ede4952a-6e14-49b7-9e74-62fdc7d1bd82 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:18.802418 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ede4952a-6e14-49b7-9e74-62fdc7d1bd82 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:18.933273 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-792954a5-636a-499f-acd1-c2ecc684436e tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:18.948135 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-792954a5-636a-499f-acd1-c2ecc684436e tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32" status: 200 len: 1355 microversion: 2.1 time: 0.710924 Jun 20 12:21:18.950405 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2343/4781] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:18 2022] GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32 => generated 1355 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:19.323569 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ede4952a-6e14-49b7-9e74-62fdc7d1bd82 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:19.337770 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ede4952a-6e14-49b7-9e74-62fdc7d1bd82 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1684 microversion: 2.1 time: 0.560025 Jun 20 12:21:19.341447 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2439/4782] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:18 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1684 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:21:19.699945 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c7d144a4-b045-4eb4-b113-38b7d0e631e0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:19.700947 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c7d144a4-b045-4eb4-b113-38b7d0e631e0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:19.724830 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c7d144a4-b045-4eb4-b113-38b7d0e631e0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:19.725574 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c7d144a4-b045-4eb4-b113-38b7d0e631e0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:19.726552 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c7d144a4-b045-4eb4-b113-38b7d0e631e0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:19.727622 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c7d144a4-b045-4eb4-b113-38b7d0e631e0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:19.759148 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-c7d144a4-b045-4eb4-b113-38b7d0e631e0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] HTTP exception thrown: Instance 6ed20ca4-7f49-4d0a-a590-d2d4274698e3 could not be found. Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c7d144a4-b045-4eb4-b113-38b7d0e631e0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Request method failure captured: Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 HTTP/1.1 Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGRL3-yc9w7VgM027Nn5pM7xHunUAqMYV50zJh9uejATJS2I3Y1m4etXTZ4Ycc1-aFAv9o8hV9Sxl_uN1jbN_zrnRS7L59uX22_-N52Adkvx-etP85dBB3o5cnIJjvtBXio4iJwEuYkTplhO5vPLS4QKMlfcJCYWaIjlgoPyKfuK7Hk Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: b0d48009b1164cf3a605b30513636e4d Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1619297399 Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b0d48009b1164cf3a605b30513636e4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b0d48009b1164cf3a605b30513636e4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b0d48009b1164cf3a605b30513636e4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b0d48009b1164cf3a605b30513636e4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1619297399 Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: b0d48009b1164cf3a605b30513636e4d Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1619297399 Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-AttachVolumeShelveTestJSON-1619297399-project Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: aa6f744fe3e8403ea1960856026abe61 Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1619297399-project Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 6ed20ca4-7f49-4d0a-a590-d2d4274698e3 could not be found. Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '6ed20ca4-7f49-4d0a-a590-d2d4274698e3'} Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ed20ca4-7f49-4d0a-a590-d2d4274698e3 could not be found. Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ed20ca4-7f49-4d0a-a590-d2d4274698e3 could not be found. Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:21:19.772079 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:21:19.776887 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:21:19.776887 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:21:19.776887 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:21:19.776887 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:21:19.776887 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:21:19.776887 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:21:19.776887 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ed20ca4-7f49-4d0a-a590-d2d4274698e3 could not be found. Jun 20 12:21:19.776887 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:21:19.776887 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c7d144a4-b045-4eb4-b113-38b7d0e631e0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Returning 404 to user: Instance 6ed20ca4-7f49-4d0a-a590-d2d4274698e3 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:21:19.776887 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c7d144a4-b045-4eb4-b113-38b7d0e631e0 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 404 len: 111 microversion: 2.20 time: 0.083802 Jun 20 12:21:19.780497 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2344/4783] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:21:19 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:21:19.784179 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e3f74ea0-48d0-44a4-b356-fbafa32eaf7e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '.version_select at 0x7f6073e985e0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:19.839624 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e3f74ea0-48d0-44a4-b356-fbafa32eaf7e tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1415455535" status: 204 len: 0 microversion: 2.20 time: 0.057254 Jun 20 12:21:19.845990 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2440/4784] 10.222.0.27 () {60 vars in 1261 bytes} [Mon Jun 20 12:21:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1415455535 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 12:21:19.972402 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-85d4d877-6a00-424f-b2b3-b25e88e9a2d3 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:19.973532 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-85d4d877-6a00-424f-b2b3-b25e88e9a2d3 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: 9ddb525a-a112-4b08-829e-406a30d2fb32] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:19.987869 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-85d4d877-6a00-424f-b2b3-b25e88e9a2d3 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:19.990073 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-85d4d877-6a00-424f-b2b3-b25e88e9a2d3 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:19.993353 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-85d4d877-6a00-424f-b2b3-b25e88e9a2d3 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:19.995505 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-85d4d877-6a00-424f-b2b3-b25e88e9a2d3 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:20.368600 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fe682d66-cda3-42a9-a487-b7b3e3fbd2d9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:20.369486 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fe682d66-cda3-42a9-a487-b7b3e3fbd2d9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:20.371820 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:21:20.391478 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fe682d66-cda3-42a9-a487-b7b3e3fbd2d9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:20.393928 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fe682d66-cda3-42a9-a487-b7b3e3fbd2d9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:20.396169 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fe682d66-cda3-42a9-a487-b7b3e3fbd2d9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:20.397283 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fe682d66-cda3-42a9-a487-b7b3e3fbd2d9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:20.843914 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-85d4d877-6a00-424f-b2b3-b25e88e9a2d3 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:20.862470 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-85d4d877-6a00-424f-b2b3-b25e88e9a2d3 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32" status: 200 len: 1355 microversion: 2.1 time: 0.897882 Jun 20 12:21:20.867532 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2345/4785] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:19 2022] GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32 => generated 1355 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:20.888665 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fe682d66-cda3-42a9-a487-b7b3e3fbd2d9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:20.904885 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fe682d66-cda3-42a9-a487-b7b3e3fbd2d9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1684 microversion: 2.1 time: 0.544546 Jun 20 12:21:20.915557 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2441/4786] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:20 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1684 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:21.648236 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-05ac3e36-8450-4f10-b1a8-94e31e235d66 req-37a710c0-b367-4054-9269-14231b6dd695 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ddb525a-a112-4b08-829e-406a30d2fb32", "tag": "3d0f5bc1-1c4b-4e0a-b9b3-e7a3495fb280"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:21:21.662272 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-05ac3e36-8450-4f10-b1a8-94e31e235d66 req-37a710c0-b367-4054-9269-14231b6dd695 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:21.665512 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-05ac3e36-8450-4f10-b1a8-94e31e235d66 req-37a710c0-b367-4054-9269-14231b6dd695 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:21.704672 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-05ac3e36-8450-4f10-b1a8-94e31e235d66 req-37a710c0-b367-4054-9269-14231b6dd695 service nova] Creating event network-changed:3d0f5bc1-1c4b-4e0a-b9b3-e7a3495fb280 for instance 9ddb525a-a112-4b08-829e-406a30d2fb32 on n-h1-master-1 Jun 20 12:21:21.720279 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-05ac3e36-8450-4f10-b1a8-94e31e235d66 req-37a710c0-b367-4054-9269-14231b6dd695 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067549 Jun 20 12:21:21.721937 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2346/4787] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:21:21.888668 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7c05233f-d83c-44dc-bcad-4cc5030aa92f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:21.889735 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7c05233f-d83c-44dc-bcad-4cc5030aa92f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: 9ddb525a-a112-4b08-829e-406a30d2fb32] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:21.920964 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c05233f-d83c-44dc-bcad-4cc5030aa92f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:21.921322 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c05233f-d83c-44dc-bcad-4cc5030aa92f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:21.927530 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c05233f-d83c-44dc-bcad-4cc5030aa92f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:21.928361 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c05233f-d83c-44dc-bcad-4cc5030aa92f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:21.930482 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d574aadc-09f4-43b2-89a4-c5013126d0fd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:21.931818 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d574aadc-09f4-43b2-89a4-c5013126d0fd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:21.946498 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d574aadc-09f4-43b2-89a4-c5013126d0fd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:21.959003 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d574aadc-09f4-43b2-89a4-c5013126d0fd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:21.960078 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d574aadc-09f4-43b2-89a4-c5013126d0fd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:21.967158 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d574aadc-09f4-43b2-89a4-c5013126d0fd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:21.972258 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:21:22.771936 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7c05233f-d83c-44dc-bcad-4cc5030aa92f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:22.796274 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7c05233f-d83c-44dc-bcad-4cc5030aa92f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32" status: 200 len: 1355 microversion: 2.1 time: 0.913787 Jun 20 12:21:22.797488 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2442/4788] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:21 2022] GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32 => generated 1355 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:23.131610 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d574aadc-09f4-43b2-89a4-c5013126d0fd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:23.143704 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d574aadc-09f4-43b2-89a4-c5013126d0fd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1684 microversion: 2.1 time: 1.224202 Jun 20 12:21:23.146272 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2347/4789] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:21 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1684 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:23.814495 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9e565fa4-b013-4957-85e6-2d493d09ae29 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:23.815800 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9e565fa4-b013-4957-85e6-2d493d09ae29 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: 9ddb525a-a112-4b08-829e-406a30d2fb32] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:23.834419 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9e565fa4-b013-4957-85e6-2d493d09ae29 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:23.834879 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9e565fa4-b013-4957-85e6-2d493d09ae29 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:23.835680 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9e565fa4-b013-4957-85e6-2d493d09ae29 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:23.836327 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9e565fa4-b013-4957-85e6-2d493d09ae29 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:24.164224 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-67ac50d3-2a5a-4aba-b9f5-2b93787037ed tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:24.165581 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-67ac50d3-2a5a-4aba-b9f5-2b93787037ed tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:24.183006 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-67ac50d3-2a5a-4aba-b9f5-2b93787037ed tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:24.183846 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-67ac50d3-2a5a-4aba-b9f5-2b93787037ed tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:24.188662 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-67ac50d3-2a5a-4aba-b9f5-2b93787037ed tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:24.189436 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-67ac50d3-2a5a-4aba-b9f5-2b93787037ed tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:24.633357 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9e565fa4-b013-4957-85e6-2d493d09ae29 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:24.653115 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9e565fa4-b013-4957-85e6-2d493d09ae29 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32" status: 200 len: 1355 microversion: 2.1 time: 0.842342 Jun 20 12:21:24.673906 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2443/4790] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:23 2022] GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32 => generated 1355 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:21:24.792471 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-67ac50d3-2a5a-4aba-b9f5-2b93787037ed tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:24.807159 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-67ac50d3-2a5a-4aba-b9f5-2b93787037ed tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.647580 Jun 20 12:21:24.833472 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2348/4791] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:24 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:21:25.681766 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9184d6db-dfa6-435a-9139-a86b90d62927 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:25.682319 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9184d6db-dfa6-435a-9139-a86b90d62927 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: 9ddb525a-a112-4b08-829e-406a30d2fb32] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:25.701871 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9184d6db-dfa6-435a-9139-a86b90d62927 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:25.702827 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9184d6db-dfa6-435a-9139-a86b90d62927 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:25.703880 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9184d6db-dfa6-435a-9139-a86b90d62927 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:25.704729 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9184d6db-dfa6-435a-9139-a86b90d62927 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:26.077239 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c8e37994-c33c-4b25-9d80-6fa08cd96863 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:26.078604 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c8e37994-c33c-4b25-9d80-6fa08cd96863 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:26.092764 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=4 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:21:26.098568 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c8e37994-c33c-4b25-9d80-6fa08cd96863 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:26.099105 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c8e37994-c33c-4b25-9d80-6fa08cd96863 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:26.100374 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c8e37994-c33c-4b25-9d80-6fa08cd96863 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:26.103107 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c8e37994-c33c-4b25-9d80-6fa08cd96863 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:26.484378 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9184d6db-dfa6-435a-9139-a86b90d62927 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:26.494793 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9184d6db-dfa6-435a-9139-a86b90d62927 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32" status: 200 len: 1355 microversion: 2.1 time: 0.817909 Jun 20 12:21:26.496981 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2444/4792] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:25 2022] GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32 => generated 1355 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:26.499972 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c8e37994-c33c-4b25-9d80-6fa08cd96863 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:26.509757 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c8e37994-c33c-4b25-9d80-6fa08cd96863 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.441377 Jun 20 12:21:26.522033 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2349/4793] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:26 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:21:26.978670 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7c35c1bc-0941-42b1-8024-3dbe345fa612 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:26.980239 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7c35c1bc-0941-42b1-8024-3dbe345fa612 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:26.994964 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c35c1bc-0941-42b1-8024-3dbe345fa612 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:27.004873 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c35c1bc-0941-42b1-8024-3dbe345fa612 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:27.006685 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c35c1bc-0941-42b1-8024-3dbe345fa612 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:27.008593 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c35c1bc-0941-42b1-8024-3dbe345fa612 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:27.026873 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:21:27.061614 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-7c35c1bc-0941-42b1-8024-3dbe345fa612 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] HTTP exception thrown: Instance 6ed20ca4-7f49-4d0a-a590-d2d4274698e3 could not be found. Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7c35c1bc-0941-42b1-8024-3dbe345fa612 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Request method failure captured: Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 HTTP/1.1 Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGRL3-yc9w7VgM027Nn5pM7xHunUAqMYV50zJh9uejATJS2I3Y1m4etXTZ4Ycc1-aFAv9o8hV9Sxl_uN1jbN_zrnRS7L59uX22_-N52Adkvx-etP85dBB3o5cnIJjvtBXio4iJwEuYkTplhO5vPLS4QKMlfcJCYWaIjlgoPyKfuK7Hk Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: b0d48009b1164cf3a605b30513636e4d Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1619297399 Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b0d48009b1164cf3a605b30513636e4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b0d48009b1164cf3a605b30513636e4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b0d48009b1164cf3a605b30513636e4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b0d48009b1164cf3a605b30513636e4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1619297399 Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: b0d48009b1164cf3a605b30513636e4d Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1619297399 Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-AttachVolumeShelveTestJSON-1619297399-project Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: aa6f744fe3e8403ea1960856026abe61 Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1619297399-project Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 6ed20ca4-7f49-4d0a-a590-d2d4274698e3 could not be found. Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '6ed20ca4-7f49-4d0a-a590-d2d4274698e3'} Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ed20ca4-7f49-4d0a-a590-d2d4274698e3 could not be found. Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:21:27.074295 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:21:27.079282 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ed20ca4-7f49-4d0a-a590-d2d4274698e3 could not be found. Jun 20 12:21:27.079282 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:21:27.079282 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:21:27.079282 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:21:27.079282 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:21:27.079282 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:21:27.079282 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:21:27.079282 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:21:27.079282 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:21:27.079282 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ed20ca4-7f49-4d0a-a590-d2d4274698e3 could not be found. Jun 20 12:21:27.079282 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:21:27.082681 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7c35c1bc-0941-42b1-8024-3dbe345fa612 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Returning 404 to user: Instance 6ed20ca4-7f49-4d0a-a590-d2d4274698e3 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:21:27.086769 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7c35c1bc-0941-42b1-8024-3dbe345fa612 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 404 len: 111 microversion: 2.20 time: 0.110173 Jun 20 12:21:27.091054 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2445/4794] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Jun 20 12:21:26 2022] DELETE /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:21:27.099728 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-35ed30ef-cd80-4959-9d38-86f75d54e47a tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:27.100522 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-35ed30ef-cd80-4959-9d38-86f75d54e47a tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 6ed20ca4-7f49-4d0a-a590-d2d4274698e3] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:27.111716 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-35ed30ef-cd80-4959-9d38-86f75d54e47a tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:27.115551 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-35ed30ef-cd80-4959-9d38-86f75d54e47a tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:27.116709 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-35ed30ef-cd80-4959-9d38-86f75d54e47a tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:27.119743 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-35ed30ef-cd80-4959-9d38-86f75d54e47a tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:27.151027 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-35ed30ef-cd80-4959-9d38-86f75d54e47a tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] HTTP exception thrown: Instance 6ed20ca4-7f49-4d0a-a590-d2d4274698e3 could not be found. Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-35ed30ef-cd80-4959-9d38-86f75d54e47a tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Request method failure captured: Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 HTTP/1.1 Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGRL3-yc9w7VgM027Nn5pM7xHunUAqMYV50zJh9uejATJS2I3Y1m4etXTZ4Ycc1-aFAv9o8hV9Sxl_uN1jbN_zrnRS7L59uX22_-N52Adkvx-etP85dBB3o5cnIJjvtBXio4iJwEuYkTplhO5vPLS4QKMlfcJCYWaIjlgoPyKfuK7Hk Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: b0d48009b1164cf3a605b30513636e4d Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1619297399 Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b0d48009b1164cf3a605b30513636e4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b0d48009b1164cf3a605b30513636e4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b0d48009b1164cf3a605b30513636e4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b0d48009b1164cf3a605b30513636e4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1619297399 Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: b0d48009b1164cf3a605b30513636e4d Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1619297399 Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-AttachVolumeShelveTestJSON-1619297399-project Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: aa6f744fe3e8403ea1960856026abe61 Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1619297399-project Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 6ed20ca4-7f49-4d0a-a590-d2d4274698e3 could not be found. Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '6ed20ca4-7f49-4d0a-a590-d2d4274698e3'} Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ed20ca4-7f49-4d0a-a590-d2d4274698e3 could not be found. Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ed20ca4-7f49-4d0a-a590-d2d4274698e3 could not be found. Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:21:27.162585 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:21:27.167146 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:21:27.167146 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:21:27.167146 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:21:27.167146 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:21:27.167146 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:21:27.167146 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:21:27.167146 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ed20ca4-7f49-4d0a-a590-d2d4274698e3 could not be found. Jun 20 12:21:27.167146 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:21:27.170965 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-35ed30ef-cd80-4959-9d38-86f75d54e47a tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Returning 404 to user: Instance 6ed20ca4-7f49-4d0a-a590-d2d4274698e3 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:21:27.172112 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-35ed30ef-cd80-4959-9d38-86f75d54e47a tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3" status: 404 len: 111 microversion: 2.20 time: 0.076389 Jun 20 12:21:27.177271 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2350/4795] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:21:27 2022] GET /compute/v2.1/servers/6ed20ca4-7f49-4d0a-a590-d2d4274698e3 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:21:27.513129 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-29957dea-a1f0-4eef-9f3e-253157979f4f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:27.513756 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-29957dea-a1f0-4eef-9f3e-253157979f4f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: 9ddb525a-a112-4b08-829e-406a30d2fb32] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:27.541079 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-29957dea-a1f0-4eef-9f3e-253157979f4f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:27.542251 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-29957dea-a1f0-4eef-9f3e-253157979f4f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:27.548856 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-29957dea-a1f0-4eef-9f3e-253157979f4f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:27.552310 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-29957dea-a1f0-4eef-9f3e-253157979f4f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:27.573916 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-ae6512a6-6035-4a0d-9b31-43a92d048882 req-cc6726d8-df4b-49ad-8c88-1f2935e0bbea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21609be7-c3f0-4e24-a093-2f74ce957a35", "name": "network-vif-unplugged", "status": "completed", "tag": "23a9a38f-112e-4e3f-97f4-ae81b6b5af7c"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:21:27.633387 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-ae6512a6-6035-4a0d-9b31-43a92d048882 req-cc6726d8-df4b-49ad-8c88-1f2935e0bbea service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:27.633967 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-ae6512a6-6035-4a0d-9b31-43a92d048882 req-cc6726d8-df4b-49ad-8c88-1f2935e0bbea service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:27.708086 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-ae6512a6-6035-4a0d-9b31-43a92d048882 req-cc6726d8-df4b-49ad-8c88-1f2935e0bbea service nova] Creating event network-vif-unplugged:23a9a38f-112e-4e3f-97f4-ae81b6b5af7c for instance 21609be7-c3f0-4e24-a093-2f74ce957a35 on n-h1-master-1 Jun 20 12:21:27.735306 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-ae6512a6-6035-4a0d-9b31-43a92d048882 req-cc6726d8-df4b-49ad-8c88-1f2935e0bbea service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.168637 Jun 20 12:21:27.756300 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2351/4796] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:21:29.341950 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-29957dea-a1f0-4eef-9f3e-253157979f4f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:29.371454 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-29957dea-a1f0-4eef-9f3e-253157979f4f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32" status: 200 len: 1355 microversion: 2.1 time: 1.862571 Jun 20 12:21:29.379552 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2446/4797] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:27 2022] GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32 => generated 1355 bytes in 1872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:29.624952 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0532951d-6ff7-47a0-b611-4debbe4d8d07 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:29.625783 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0532951d-6ff7-47a0-b611-4debbe4d8d07 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:29.634825 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0532951d-6ff7-47a0-b611-4debbe4d8d07 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:29.635341 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0532951d-6ff7-47a0-b611-4debbe4d8d07 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:29.636723 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0532951d-6ff7-47a0-b611-4debbe4d8d07 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:29.637378 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0532951d-6ff7-47a0-b611-4debbe4d8d07 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:30.210368 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0532951d-6ff7-47a0-b611-4debbe4d8d07 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:30.219014 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0532951d-6ff7-47a0-b611-4debbe4d8d07 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.602028 Jun 20 12:21:30.225276 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2352/4798] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:29 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:30.241858 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cca571b7-afad-4569-9392-9916c330ffed tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:30.242867 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cca571b7-afad-4569-9392-9916c330ffed tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:30.256225 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cca571b7-afad-4569-9392-9916c330ffed tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:30.257109 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cca571b7-afad-4569-9392-9916c330ffed tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:30.260120 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cca571b7-afad-4569-9392-9916c330ffed tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:30.260888 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cca571b7-afad-4569-9392-9916c330ffed tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:30.399390 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cac9b5e0-b5a4-411b-a1b2-15616f6b2ef5 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:30.400224 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cac9b5e0-b5a4-411b-a1b2-15616f6b2ef5 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: 9ddb525a-a112-4b08-829e-406a30d2fb32] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:30.436180 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cac9b5e0-b5a4-411b-a1b2-15616f6b2ef5 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:30.436687 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cac9b5e0-b5a4-411b-a1b2-15616f6b2ef5 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:30.437513 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cac9b5e0-b5a4-411b-a1b2-15616f6b2ef5 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:30.441442 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cac9b5e0-b5a4-411b-a1b2-15616f6b2ef5 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:30.484993 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cca571b7-afad-4569-9392-9916c330ffed tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:30.495373 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cca571b7-afad-4569-9392-9916c330ffed tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.258109 Jun 20 12:21:30.500764 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2447/4799] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:30 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:30.518148 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-65bafba3-a6f1-4820-a2f5-466949402caa tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:30.519144 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-65bafba3-a6f1-4820-a2f5-466949402caa tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:30.529544 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-65bafba3-a6f1-4820-a2f5-466949402caa tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:30.532877 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-65bafba3-a6f1-4820-a2f5-466949402caa tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:30.533972 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-65bafba3-a6f1-4820-a2f5-466949402caa tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:30.534589 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-65bafba3-a6f1-4820-a2f5-466949402caa tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:31.075168 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-65bafba3-a6f1-4820-a2f5-466949402caa tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:31.089301 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-65bafba3-a6f1-4820-a2f5-466949402caa tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.575003 Jun 20 12:21:31.090232 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2448/4800] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:30 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:21:31.107099 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c5ea0abd-2f20-4e01-bfe1-c39242c82142 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:21:31.108679 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c5ea0abd-2f20-4e01-bfe1-c39242c82142 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:31.120625 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c5ea0abd-2f20-4e01-bfe1-c39242c82142 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:31.122851 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c5ea0abd-2f20-4e01-bfe1-c39242c82142 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:31.125759 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c5ea0abd-2f20-4e01-bfe1-c39242c82142 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:31.126606 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c5ea0abd-2f20-4e01-bfe1-c39242c82142 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:31.161437 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-cac9b5e0-b5a4-411b-a1b2-15616f6b2ef5 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:31.174828 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cac9b5e0-b5a4-411b-a1b2-15616f6b2ef5 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32" status: 200 len: 1355 microversion: 2.1 time: 0.783902 Jun 20 12:21:31.186238 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2353/4801] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:30 2022] GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32 => generated 1355 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:31.310896 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c5ea0abd-2f20-4e01-bfe1-c39242c82142 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "POST /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/action" status: 202 len: 0 microversion: 2.1 time: 0.206908 Jun 20 12:21:31.312641 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2449/4802] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:21:31 2022] POST /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:21:31.328060 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b2e92984-56db-4a8e-9b87-4a863a73680b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:31.329142 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b2e92984-56db-4a8e-9b87-4a863a73680b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:31.347946 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2e92984-56db-4a8e-9b87-4a863a73680b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:31.348710 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2e92984-56db-4a8e-9b87-4a863a73680b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:31.357988 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2e92984-56db-4a8e-9b87-4a863a73680b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:31.358751 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2e92984-56db-4a8e-9b87-4a863a73680b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:32.198587 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7ab9cb6d-f050-4b86-8b37-f64568206a31 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:32.210220 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7ab9cb6d-f050-4b86-8b37-f64568206a31 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: 9ddb525a-a112-4b08-829e-406a30d2fb32] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:32.232108 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ab9cb6d-f050-4b86-8b37-f64568206a31 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:32.245247 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ab9cb6d-f050-4b86-8b37-f64568206a31 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:32.247503 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ab9cb6d-f050-4b86-8b37-f64568206a31 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:32.248008 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ab9cb6d-f050-4b86-8b37-f64568206a31 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:32.642111 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b2e92984-56db-4a8e-9b87-4a863a73680b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:32.680124 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b2e92984-56db-4a8e-9b87-4a863a73680b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1673 microversion: 2.1 time: 1.359099 Jun 20 12:21:32.683385 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2354/4803] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:31 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1673 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:32.838468 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7ab9cb6d-f050-4b86-8b37-f64568206a31 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:32.853038 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7ab9cb6d-f050-4b86-8b37-f64568206a31 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32" status: 200 len: 1355 microversion: 2.1 time: 0.663699 Jun 20 12:21:32.855590 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2450/4804] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:32 2022] GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32 => generated 1355 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:32.993668 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1f08a0ac-de7f-438c-bdb4-37151045c3ff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:32.994178 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1f08a0ac-de7f-438c-bdb4-37151045c3ff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:33.015391 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f08a0ac-de7f-438c-bdb4-37151045c3ff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:33.016100 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f08a0ac-de7f-438c-bdb4-37151045c3ff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:33.017501 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f08a0ac-de7f-438c-bdb4-37151045c3ff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:33.023249 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f08a0ac-de7f-438c-bdb4-37151045c3ff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:33.042118 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-1f08a0ac-de7f-438c-bdb4-37151045c3ff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] HTTP exception thrown: Instance 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc could not be found. Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1f08a0ac-de7f-438c-bdb4-37151045c3ff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Request method failure captured: Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc HTTP/1.1 Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGRL3-yc9w7VgM027Nn5pM7xHunUAqMYV50zJh9uejATJS2I3Y1m4etXTZ4Ycc1-aFAv9o8hV9Sxl_uN1jbN_zrnRS7L59uX22_-N52Adkvx-etP85dBB3o5cnIJjvtBXio4iJwEuYkTplhO5vPLS4QKMlfcJCYWaIjlgoPyKfuK7Hk Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: b0d48009b1164cf3a605b30513636e4d Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1619297399 Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b0d48009b1164cf3a605b30513636e4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b0d48009b1164cf3a605b30513636e4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b0d48009b1164cf3a605b30513636e4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b0d48009b1164cf3a605b30513636e4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1619297399 Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: b0d48009b1164cf3a605b30513636e4d Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1619297399 Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-AttachVolumeShelveTestJSON-1619297399-project Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: aa6f744fe3e8403ea1960856026abe61 Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1619297399-project Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc could not be found. Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc'} Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc could not be found. Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:21:33.055051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:21:33.060101 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc could not be found. Jun 20 12:21:33.060101 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:21:33.060101 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:21:33.060101 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:21:33.060101 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:21:33.060101 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:21:33.060101 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:21:33.060101 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:21:33.060101 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:21:33.060101 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc could not be found. Jun 20 12:21:33.060101 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:21:33.063638 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1f08a0ac-de7f-438c-bdb4-37151045c3ff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Returning 404 to user: Instance 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:21:33.067871 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1f08a0ac-de7f-438c-bdb4-37151045c3ff tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 404 len: 111 microversion: 2.20 time: 0.079130 Jun 20 12:21:33.068500 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2355/4805] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Jun 20 12:21:32 2022] DELETE /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:21:33.077963 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-da0c01b6-be55-4aa0-9598-52062dffe7d7 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:33.078862 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-da0c01b6-be55-4aa0-9598-52062dffe7d7 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] [instance: 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:33.094375 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da0c01b6-be55-4aa0-9598-52062dffe7d7 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:33.094748 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da0c01b6-be55-4aa0-9598-52062dffe7d7 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:33.095557 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da0c01b6-be55-4aa0-9598-52062dffe7d7 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:33.096005 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da0c01b6-be55-4aa0-9598-52062dffe7d7 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:33.132591 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-da0c01b6-be55-4aa0-9598-52062dffe7d7 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] HTTP exception thrown: Instance 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc could not be found. Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-da0c01b6-be55-4aa0-9598-52062dffe7d7 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Request method failure captured: Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc HTTP/1.1 Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGRL3-yc9w7VgM027Nn5pM7xHunUAqMYV50zJh9uejATJS2I3Y1m4etXTZ4Ycc1-aFAv9o8hV9Sxl_uN1jbN_zrnRS7L59uX22_-N52Adkvx-etP85dBB3o5cnIJjvtBXio4iJwEuYkTplhO5vPLS4QKMlfcJCYWaIjlgoPyKfuK7Hk Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: b0d48009b1164cf3a605b30513636e4d Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1619297399 Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b0d48009b1164cf3a605b30513636e4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b0d48009b1164cf3a605b30513636e4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b0d48009b1164cf3a605b30513636e4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b0d48009b1164cf3a605b30513636e4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1619297399 Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: b0d48009b1164cf3a605b30513636e4d Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1619297399 Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-AttachVolumeShelveTestJSON-1619297399-project Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: aa6f744fe3e8403ea1960856026abe61 Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1619297399-project Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc could not be found. Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc'} Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc could not be found. Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc could not be found. Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:21:33.134560 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:21:33.139932 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:21:33.139932 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:21:33.139932 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:21:33.139932 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:21:33.139932 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:21:33.139932 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:21:33.139932 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc could not be found. Jun 20 12:21:33.139932 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:21:33.141673 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-da0c01b6-be55-4aa0-9598-52062dffe7d7 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] Returning 404 to user: Instance 2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:21:33.142712 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-da0c01b6-be55-4aa0-9598-52062dffe7d7 tempest-AttachVolumeShelveTestJSON-1619297399 tempest-AttachVolumeShelveTestJSON-1619297399-project] 10.222.0.27 "GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc" status: 404 len: 111 microversion: 2.20 time: 0.069755 Jun 20 12:21:33.144395 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2451/4806] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 20 12:21:33 2022] GET /compute/v2.1/servers/2dbbc9cb-35ca-4e02-a7e5-7be3e4f37ccc => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 20 12:21:33.700613 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b2f9aff8-a593-4681-8a0c-c231daed64dd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:33.701316 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b2f9aff8-a593-4681-8a0c-c231daed64dd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:33.719953 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2f9aff8-a593-4681-8a0c-c231daed64dd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:33.720436 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2f9aff8-a593-4681-8a0c-c231daed64dd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:33.721230 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2f9aff8-a593-4681-8a0c-c231daed64dd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:33.721669 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2f9aff8-a593-4681-8a0c-c231daed64dd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:33.880253 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5035c4b1-a387-47e0-b789-810fe97f494b tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:33.881404 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5035c4b1-a387-47e0-b789-810fe97f494b tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: 9ddb525a-a112-4b08-829e-406a30d2fb32] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:33.889149 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5035c4b1-a387-47e0-b789-810fe97f494b tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:33.890012 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5035c4b1-a387-47e0-b789-810fe97f494b tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:33.891293 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5035c4b1-a387-47e0-b789-810fe97f494b tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:33.891901 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5035c4b1-a387-47e0-b789-810fe97f494b tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:34.399543 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5035c4b1-a387-47e0-b789-810fe97f494b tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:34.414960 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5035c4b1-a387-47e0-b789-810fe97f494b tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32" status: 200 len: 1355 microversion: 2.1 time: 0.538586 Jun 20 12:21:34.424614 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2452/4807] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:33 2022] GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32 => generated 1355 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:21:34.453493 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b2f9aff8-a593-4681-8a0c-c231daed64dd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:34.463257 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b2f9aff8-a593-4681-8a0c-c231daed64dd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1673 microversion: 2.1 time: 0.766711 Jun 20 12:21:34.486728 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2356/4808] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:33 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1673 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:35.194554 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-d583ad82-9998-4472-895b-4ac7bd5a2a1f req-263c566f-2ce3-4d71-a419-c4bcea6cbd9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ddb525a-a112-4b08-829e-406a30d2fb32", "name": "network-vif-plugged", "status": "completed", "tag": "3d0f5bc1-1c4b-4e0a-b9b3-e7a3495fb280"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:21:35.218161 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-d583ad82-9998-4472-895b-4ac7bd5a2a1f req-263c566f-2ce3-4d71-a419-c4bcea6cbd9c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:35.221150 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-d583ad82-9998-4472-895b-4ac7bd5a2a1f req-263c566f-2ce3-4d71-a419-c4bcea6cbd9c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:35.270415 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-d583ad82-9998-4472-895b-4ac7bd5a2a1f req-263c566f-2ce3-4d71-a419-c4bcea6cbd9c service nova] Creating event network-vif-plugged:3d0f5bc1-1c4b-4e0a-b9b3-e7a3495fb280 for instance 9ddb525a-a112-4b08-829e-406a30d2fb32 on n-h1-master-1 Jun 20 12:21:35.287707 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-d583ad82-9998-4472-895b-4ac7bd5a2a1f req-263c566f-2ce3-4d71-a419-c4bcea6cbd9c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098584 Jun 20 12:21:35.292824 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2453/4809] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:21:35.459334 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4266db67-7cfb-4857-a6a5-80e651f3f518 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:35.461159 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4266db67-7cfb-4857-a6a5-80e651f3f518 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: 9ddb525a-a112-4b08-829e-406a30d2fb32] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:35.479274 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4266db67-7cfb-4857-a6a5-80e651f3f518 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:35.479979 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4266db67-7cfb-4857-a6a5-80e651f3f518 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:35.483689 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4266db67-7cfb-4857-a6a5-80e651f3f518 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:35.484522 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4266db67-7cfb-4857-a6a5-80e651f3f518 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:35.485748 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-11af80ba-02f0-4511-bd07-e397ee8e0d62 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:35.486621 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-11af80ba-02f0-4511-bd07-e397ee8e0d62 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:35.500964 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11af80ba-02f0-4511-bd07-e397ee8e0d62 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:35.505603 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11af80ba-02f0-4511-bd07-e397ee8e0d62 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:35.508849 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11af80ba-02f0-4511-bd07-e397ee8e0d62 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:35.510887 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11af80ba-02f0-4511-bd07-e397ee8e0d62 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:36.228162 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4266db67-7cfb-4857-a6a5-80e651f3f518 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:36.243477 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4266db67-7cfb-4857-a6a5-80e651f3f518 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32" status: 200 len: 1355 microversion: 2.1 time: 0.800540 Jun 20 12:21:36.244658 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2357/4810] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:35 2022] GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32 => generated 1355 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:36.716107 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-11af80ba-02f0-4511-bd07-e397ee8e0d62 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:36.737535 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-11af80ba-02f0-4511-bd07-e397ee8e0d62 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1673 microversion: 2.1 time: 1.256104 Jun 20 12:21:36.738559 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2454/4811] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:35 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1673 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:37.264377 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3b931bef-8be3-4706-9bf7-7fe7dee54235 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:37.265589 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3b931bef-8be3-4706-9bf7-7fe7dee54235 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: 9ddb525a-a112-4b08-829e-406a30d2fb32] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:37.277720 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b931bef-8be3-4706-9bf7-7fe7dee54235 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:37.278427 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b931bef-8be3-4706-9bf7-7fe7dee54235 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:37.279486 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b931bef-8be3-4706-9bf7-7fe7dee54235 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:37.295348 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b931bef-8be3-4706-9bf7-7fe7dee54235 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:37.370019 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-e3f16870-4f86-48a4-9ebe-517531cf01c4 req-cc688e39-4ca2-48fe-a2f5-38be454b768d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ddb525a-a112-4b08-829e-406a30d2fb32", "name": "network-vif-plugged", "status": "completed", "tag": "b72ff8fb-8380-4bad-a4a2-c753c1e34b09"}, {"server_uuid": "9ddb525a-a112-4b08-829e-406a30d2fb32", "name": "network-vif-plugged", "status": "completed", "tag": "923a7ccd-f077-4c2b-b165-e851039b1c4d"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:21:37.385424 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-e3f16870-4f86-48a4-9ebe-517531cf01c4 req-cc688e39-4ca2-48fe-a2f5-38be454b768d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:37.388535 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-e3f16870-4f86-48a4-9ebe-517531cf01c4 req-cc688e39-4ca2-48fe-a2f5-38be454b768d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:37.403063 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-e3f16870-4f86-48a4-9ebe-517531cf01c4 req-cc688e39-4ca2-48fe-a2f5-38be454b768d service nova] Creating event network-vif-plugged:b72ff8fb-8380-4bad-a4a2-c753c1e34b09 for instance 9ddb525a-a112-4b08-829e-406a30d2fb32 on n-h1-master-1 Jun 20 12:21:37.403877 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-e3f16870-4f86-48a4-9ebe-517531cf01c4 req-cc688e39-4ca2-48fe-a2f5-38be454b768d service nova] Creating event network-vif-plugged:923a7ccd-f077-4c2b-b165-e851039b1c4d for instance 9ddb525a-a112-4b08-829e-406a30d2fb32 on n-h1-master-1 Jun 20 12:21:37.409803 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-e3f16870-4f86-48a4-9ebe-517531cf01c4 req-cc688e39-4ca2-48fe-a2f5-38be454b768d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046936 Jun 20 12:21:37.415135 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2455/4812] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:21:37.774226 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-adef4098-f833-44ca-a81d-c5b2a3992971 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:37.774909 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-adef4098-f833-44ca-a81d-c5b2a3992971 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:37.805639 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-adef4098-f833-44ca-a81d-c5b2a3992971 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:37.806105 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-adef4098-f833-44ca-a81d-c5b2a3992971 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:37.809534 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-adef4098-f833-44ca-a81d-c5b2a3992971 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:37.810008 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-adef4098-f833-44ca-a81d-c5b2a3992971 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:38.218876 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3b931bef-8be3-4706-9bf7-7fe7dee54235 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:38.228906 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3b931bef-8be3-4706-9bf7-7fe7dee54235 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32" status: 200 len: 1355 microversion: 2.1 time: 0.971570 Jun 20 12:21:38.234268 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2358/4813] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:37 2022] GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32 => generated 1355 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:38.459479 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-adef4098-f833-44ca-a81d-c5b2a3992971 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:38.476385 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-adef4098-f833-44ca-a81d-c5b2a3992971 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.716774 Jun 20 12:21:38.478785 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2456/4814] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:37 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:38.495322 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7a929324-5c8c-493e-af69-07e13b763402 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:21:38.496653 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7a929324-5c8c-493e-af69-07e13b763402 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:38.514114 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:21:38.516118 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7a929324-5c8c-493e-af69-07e13b763402 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:38.516665 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7a929324-5c8c-493e-af69-07e13b763402 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:38.517585 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7a929324-5c8c-493e-af69-07e13b763402 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:38.518080 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7a929324-5c8c-493e-af69-07e13b763402 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:38.602374 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7a929324-5c8c-493e-af69-07e13b763402 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "POST /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/action" status: 200 len: 322 microversion: 2.1 time: 0.111234 Jun 20 12:21:38.603962 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2359/4815] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:21:38 2022] POST /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/action => generated 322 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:21:38.613563 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f083123f-0280-49ab-8a06-4f8d5989dc54 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:38.614273 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f083123f-0280-49ab-8a06-4f8d5989dc54 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:38.625901 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f083123f-0280-49ab-8a06-4f8d5989dc54 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:38.628718 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f083123f-0280-49ab-8a06-4f8d5989dc54 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:38.629676 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f083123f-0280-49ab-8a06-4f8d5989dc54 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:38.631662 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f083123f-0280-49ab-8a06-4f8d5989dc54 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:39.261800 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-00008a38-9cae-4408-8f1a-01461615d6be tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:39.264412 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-00008a38-9cae-4408-8f1a-01461615d6be tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: 9ddb525a-a112-4b08-829e-406a30d2fb32] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:39.287851 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-00008a38-9cae-4408-8f1a-01461615d6be tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:39.288620 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-00008a38-9cae-4408-8f1a-01461615d6be tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:39.290537 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-00008a38-9cae-4408-8f1a-01461615d6be tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:39.291313 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-00008a38-9cae-4408-8f1a-01461615d6be tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:39.594211 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f083123f-0280-49ab-8a06-4f8d5989dc54 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:39.603063 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f083123f-0280-49ab-8a06-4f8d5989dc54 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.993777 Jun 20 12:21:39.604384 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2457/4816] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:38 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:39.625079 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-abe47544-e2bf-4dea-a56e-7f7fbbfd2582 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:39.626448 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-abe47544-e2bf-4dea-a56e-7f7fbbfd2582 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:39.633584 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-abe47544-e2bf-4dea-a56e-7f7fbbfd2582 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:39.634040 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-abe47544-e2bf-4dea-a56e-7f7fbbfd2582 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:39.634824 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-abe47544-e2bf-4dea-a56e-7f7fbbfd2582 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:39.635438 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-abe47544-e2bf-4dea-a56e-7f7fbbfd2582 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:39.937420 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-abe47544-e2bf-4dea-a56e-7f7fbbfd2582 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:39.955567 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-abe47544-e2bf-4dea-a56e-7f7fbbfd2582 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.334587 Jun 20 12:21:39.956456 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2458/4817] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:39 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:39.974818 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-973f8238-c2ee-45b8-9b21-a0a5ef6229e0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:39.975819 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-973f8238-c2ee-45b8-9b21-a0a5ef6229e0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:39.989242 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-973f8238-c2ee-45b8-9b21-a0a5ef6229e0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:39.990321 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-973f8238-c2ee-45b8-9b21-a0a5ef6229e0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:39.991261 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-973f8238-c2ee-45b8-9b21-a0a5ef6229e0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:39.992179 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-973f8238-c2ee-45b8-9b21-a0a5ef6229e0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:40.376370 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-00008a38-9cae-4408-8f1a-01461615d6be tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:40.389593 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-00008a38-9cae-4408-8f1a-01461615d6be tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32" status: 200 len: 1355 microversion: 2.1 time: 1.146996 Jun 20 12:21:40.404327 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2360/4818] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:39 2022] GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32 => generated 1355 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:21:40.419912 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-973f8238-c2ee-45b8-9b21-a0a5ef6229e0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:40.429432 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-973f8238-c2ee-45b8-9b21-a0a5ef6229e0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.459672 Jun 20 12:21:40.435012 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2459/4819] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:39 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:40.452470 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9e552556-9f89-4cf5-ac65-2faf322a884a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:40.453234 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9e552556-9f89-4cf5-ac65-2faf322a884a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:40.461472 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9e552556-9f89-4cf5-ac65-2faf322a884a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:40.461931 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9e552556-9f89-4cf5-ac65-2faf322a884a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:40.462794 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9e552556-9f89-4cf5-ac65-2faf322a884a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:40.463234 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9e552556-9f89-4cf5-ac65-2faf322a884a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:40.865703 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9e552556-9f89-4cf5-ac65-2faf322a884a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:40.883351 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9e552556-9f89-4cf5-ac65-2faf322a884a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.434763 Jun 20 12:21:40.885719 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2361/4820] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:40 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:41.148895 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c13ddf37-7f62-4c34-bcf7-d340cc9a1ddc tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1952984560", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "2b5ba955-3292-4f14-a644-c809260e0b34"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:21:41.299674 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-c13ddf37-7f62-4c34-bcf7-d340cc9a1ddc tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] validate_networks() for [('2b5ba955-3292-4f14-a644-c809260e0b34', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:21:41.408049 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6a01b679-6ed5-4ddc-b8ea-f12194857a8f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:41.408049 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6a01b679-6ed5-4ddc-b8ea-f12194857a8f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: 9ddb525a-a112-4b08-829e-406a30d2fb32] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:41.417086 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a01b679-6ed5-4ddc-b8ea-f12194857a8f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:41.417536 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a01b679-6ed5-4ddc-b8ea-f12194857a8f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:41.418474 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a01b679-6ed5-4ddc-b8ea-f12194857a8f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:41.418908 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a01b679-6ed5-4ddc-b8ea-f12194857a8f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:41.836893 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6a01b679-6ed5-4ddc-b8ea-f12194857a8f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:41.852499 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6a01b679-6ed5-4ddc-b8ea-f12194857a8f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32" status: 200 len: 1803 microversion: 2.1 time: 0.446540 Jun 20 12:21:41.856482 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2362/4821] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:41 2022] GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32 => generated 1803 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:21:41.879397 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0ac909cc-847c-4f87-860e-c95bf1116c17 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:41.879900 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0ac909cc-847c-4f87-860e-c95bf1116c17 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: 9ddb525a-a112-4b08-829e-406a30d2fb32] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:41.890771 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0ac909cc-847c-4f87-860e-c95bf1116c17 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:41.891324 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0ac909cc-847c-4f87-860e-c95bf1116c17 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:41.892029 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0ac909cc-847c-4f87-860e-c95bf1116c17 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:41.892530 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0ac909cc-847c-4f87-860e-c95bf1116c17 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:41.931796 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0ac909cc-847c-4f87-860e-c95bf1116c17 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32/ips" status: 200 len: 216 microversion: 2.1 time: 0.056951 Jun 20 12:21:41.932873 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2363/4822] 10.222.0.27 () {58 vars in 1247 bytes} [Mon Jun 20 12:21:41 2022] GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32/ips => generated 216 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:21:41.964394 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-727536de-8871-4e3c-be07-e78f4ce261ea tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:41.968068 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-727536de-8871-4e3c-be07-e78f4ce261ea tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: 9ddb525a-a112-4b08-829e-406a30d2fb32] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:41.983614 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-727536de-8871-4e3c-be07-e78f4ce261ea tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:41.985504 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-727536de-8871-4e3c-be07-e78f4ce261ea tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:41.986525 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-727536de-8871-4e3c-be07-e78f4ce261ea tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:41.986980 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-727536de-8871-4e3c-be07-e78f4ce261ea tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:42.077794 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-727536de-8871-4e3c-be07-e78f4ce261ea tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: 9ddb525a-a112-4b08-829e-406a30d2fb32] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:21:42.186810 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:21:42.224289 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-727536de-8871-4e3c-be07-e78f4ce261ea tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32" status: 204 len: 0 microversion: 2.1 time: 0.284306 Jun 20 12:21:42.225848 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2364/4823] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:21:41 2022] DELETE /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 12:21:42.234038 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-953f5232-cde4-428a-a38d-3f7030660ceb tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1333916410", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "3b9d0786-28be-4738-8121-fd993f9e6701"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1955254088", "security_groups": [{"name": "tempest-secgroup-smoke-92511162"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:21:42.482130 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-953f5232-cde4-428a-a38d-3f7030660ceb tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] validate_networks() for [('3b9d0786-28be-4738-8121-fd993f9e6701', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:21:42.873367 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-c13ddf37-7f62-4c34-bcf7-d340cc9a1ddc tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:21:42.874368 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-c13ddf37-7f62-4c34-bcf7-d340cc9a1ddc tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:21:42.875581 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-c13ddf37-7f62-4c34-bcf7-d340cc9a1ddc tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:21:42.876009 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-c13ddf37-7f62-4c34-bcf7-d340cc9a1ddc tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:21:42.876657 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-c13ddf37-7f62-4c34-bcf7-d340cc9a1ddc tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:21:42.889795 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c13ddf37-7f62-4c34-bcf7-d340cc9a1ddc tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:42.891428 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c13ddf37-7f62-4c34-bcf7-d340cc9a1ddc tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:42.893207 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c13ddf37-7f62-4c34-bcf7-d340cc9a1ddc tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:42.894014 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c13ddf37-7f62-4c34-bcf7-d340cc9a1ddc tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:42.937665 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-c13ddf37-7f62-4c34-bcf7-d340cc9a1ddc tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Getting quotas for project 19236314583142029ffd7a1e04460cab. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:21:42.947670 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-c13ddf37-7f62-4c34-bcf7-d340cc9a1ddc tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Getting quotas for user 4ccd420e1ff744b99cb7e5650522e983 and project 19236314583142029ffd7a1e04460cab. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:21:42.972112 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c13ddf37-7f62-4c34-bcf7-d340cc9a1ddc tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:21:42.975905 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c13ddf37-7f62-4c34-bcf7-d340cc9a1ddc tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: f6cb9020-dfc5-4942-b757-10d3806dfdd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:21:43.052561 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c13ddf37-7f62-4c34-bcf7-d340cc9a1ddc tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.906476 Jun 20 12:21:43.054115 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2460/4824] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:21:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:21:43.062151 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-21b561e7-b27a-4e79-92f5-c96cbccb380f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:43.065357 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-21b561e7-b27a-4e79-92f5-c96cbccb380f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: 9ddb525a-a112-4b08-829e-406a30d2fb32] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:43.078076 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21b561e7-b27a-4e79-92f5-c96cbccb380f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:43.078769 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21b561e7-b27a-4e79-92f5-c96cbccb380f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:43.079832 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21b561e7-b27a-4e79-92f5-c96cbccb380f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:43.080709 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21b561e7-b27a-4e79-92f5-c96cbccb380f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:43.420157 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-21b561e7-b27a-4e79-92f5-c96cbccb380f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:43.435958 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-21b561e7-b27a-4e79-92f5-c96cbccb380f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32" status: 200 len: 1809 microversion: 2.1 time: 0.380399 Jun 20 12:21:43.436598 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2461/4825] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:43 2022] GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32 => generated 1809 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:43.449028 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0a160563-2ef0-4728-aaef-9e1b6d4a4dda tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:43.492172 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0a160563-2ef0-4728-aaef-9e1b6d4a4dda tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: f6cb9020-dfc5-4942-b757-10d3806dfdd2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:43.729528 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0a160563-2ef0-4728-aaef-9e1b6d4a4dda tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:43.742888 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0a160563-2ef0-4728-aaef-9e1b6d4a4dda tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2" status: 200 len: 1215 microversion: 2.1 time: 0.301942 Jun 20 12:21:43.745752 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2462/4826] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:43 2022] GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2 => generated 1215 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:44.093113 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-953f5232-cde4-428a-a38d-3f7030660ceb tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:21:44.093656 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-953f5232-cde4-428a-a38d-3f7030660ceb tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:21:44.094000 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-953f5232-cde4-428a-a38d-3f7030660ceb tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:21:44.094598 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-953f5232-cde4-428a-a38d-3f7030660ceb tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:21:44.095189 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-953f5232-cde4-428a-a38d-3f7030660ceb tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:21:44.119016 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-953f5232-cde4-428a-a38d-3f7030660ceb tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:44.123726 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-953f5232-cde4-428a-a38d-3f7030660ceb tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:44.127850 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-953f5232-cde4-428a-a38d-3f7030660ceb tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:44.128655 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-953f5232-cde4-428a-a38d-3f7030660ceb tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:44.454349 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d532ac6f-9335-4c96-9f77-acd165bba0ef tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:44.455008 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d532ac6f-9335-4c96-9f77-acd165bba0ef tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: 9ddb525a-a112-4b08-829e-406a30d2fb32] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:44.473917 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d532ac6f-9335-4c96-9f77-acd165bba0ef tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:44.475488 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d532ac6f-9335-4c96-9f77-acd165bba0ef tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:44.477169 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d532ac6f-9335-4c96-9f77-acd165bba0ef tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:44.479171 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d532ac6f-9335-4c96-9f77-acd165bba0ef tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:44.734055 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-953f5232-cde4-428a-a38d-3f7030660ceb tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Getting quotas for project 9e9e481852fe4e6ebdc15ec343a741f2. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:21:44.751514 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-953f5232-cde4-428a-a38d-3f7030660ceb tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Getting quotas for user cd27c8696f7147e18054b26ebbae7045 and project 9e9e481852fe4e6ebdc15ec343a741f2. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:21:44.827029 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-953f5232-cde4-428a-a38d-3f7030660ceb tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:21:44.841098 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-953f5232-cde4-428a-a38d-3f7030660ceb tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:21:44.972092 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-953f5232-cde4-428a-a38d-3f7030660ceb tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.743839 Jun 20 12:21:44.973189 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2365/4827] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:21:42 2022] POST /compute/v2.1/servers => generated 404 bytes in 2747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:21:44.986675 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-07661de2-bfeb-4deb-bffe-6cca1b87e0e2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:44.986675 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-07661de2-bfeb-4deb-bffe-6cca1b87e0e2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: f6cb9020-dfc5-4942-b757-10d3806dfdd2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:45.013611 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-07661de2-bfeb-4deb-bffe-6cca1b87e0e2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:45.015090 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-07661de2-bfeb-4deb-bffe-6cca1b87e0e2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:45.017222 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-07661de2-bfeb-4deb-bffe-6cca1b87e0e2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:45.018178 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-07661de2-bfeb-4deb-bffe-6cca1b87e0e2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:45.115497 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d532ac6f-9335-4c96-9f77-acd165bba0ef tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:45.134149 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d532ac6f-9335-4c96-9f77-acd165bba0ef tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32" status: 200 len: 1809 microversion: 2.1 time: 0.679133 Jun 20 12:21:45.139733 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2463/4828] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:44 2022] GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32 => generated 1809 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:21:45.172561 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c1c53114-6542-40c6-85e7-7eb69d149f84 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:45.191669 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c1c53114-6542-40c6-85e7-7eb69d149f84 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:45.368812 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-07661de2-bfeb-4deb-bffe-6cca1b87e0e2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:45.400519 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-07661de2-bfeb-4deb-bffe-6cca1b87e0e2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2" status: 200 len: 1285 microversion: 2.1 time: 0.424409 Jun 20 12:21:45.402484 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2366/4829] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:44 2022] GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2 => generated 1285 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:45.573236 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c1c53114-6542-40c6-85e7-7eb69d149f84 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:45.590920 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c1c53114-6542-40c6-85e7-7eb69d149f84 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 200 len: 1267 microversion: 2.1 time: 0.447855 Jun 20 12:21:45.594594 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2464/4830] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:45 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 1267 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:46.163324 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-041cb73b-413f-464f-b1e6-0cbec13a2100 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:46.172068 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-041cb73b-413f-464f-b1e6-0cbec13a2100 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: 9ddb525a-a112-4b08-829e-406a30d2fb32] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:46.193620 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-041cb73b-413f-464f-b1e6-0cbec13a2100 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:46.194671 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-041cb73b-413f-464f-b1e6-0cbec13a2100 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:46.201025 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-041cb73b-413f-464f-b1e6-0cbec13a2100 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:46.201785 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-041cb73b-413f-464f-b1e6-0cbec13a2100 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:46.419309 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-10d11a27-bcd6-41d5-bb15-c045fb4a3500 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:46.420077 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-10d11a27-bcd6-41d5-bb15-c045fb4a3500 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: f6cb9020-dfc5-4942-b757-10d3806dfdd2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:46.437171 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-10d11a27-bcd6-41d5-bb15-c045fb4a3500 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:46.441211 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-10d11a27-bcd6-41d5-bb15-c045fb4a3500 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:46.442369 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-10d11a27-bcd6-41d5-bb15-c045fb4a3500 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:46.444971 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-10d11a27-bcd6-41d5-bb15-c045fb4a3500 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:46.855860 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-10d11a27-bcd6-41d5-bb15-c045fb4a3500 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:46.867477 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-10d11a27-bcd6-41d5-bb15-c045fb4a3500 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2" status: 200 len: 1273 microversion: 2.1 time: 0.452409 Jun 20 12:21:46.882017 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2465/4831] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:46 2022] GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2 => generated 1273 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:21:46.893233 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-d8bae6d9-56b9-4d58-b4b2-f17bf5aedf6a req-11458ccf-dd14-499c-b126-9af907952649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ddb525a-a112-4b08-829e-406a30d2fb32", "name": "network-vif-deleted", "tag": "923a7ccd-f077-4c2b-b165-e851039b1c4d"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:21:46.914871 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-d8bae6d9-56b9-4d58-b4b2-f17bf5aedf6a req-11458ccf-dd14-499c-b126-9af907952649 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:46.921325 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-d8bae6d9-56b9-4d58-b4b2-f17bf5aedf6a req-11458ccf-dd14-499c-b126-9af907952649 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:46.937588 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:21:46.965789 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-d8bae6d9-56b9-4d58-b4b2-f17bf5aedf6a req-11458ccf-dd14-499c-b126-9af907952649 service nova] Creating event network-vif-deleted:923a7ccd-f077-4c2b-b165-e851039b1c4d for instance 9ddb525a-a112-4b08-829e-406a30d2fb32 on n-h1-master-1 Jun 20 12:21:46.977095 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-d8bae6d9-56b9-4d58-b4b2-f17bf5aedf6a req-11458ccf-dd14-499c-b126-9af907952649 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093360 Jun 20 12:21:46.991936 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2466/4832] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:21:47.018855 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1c613f2a-1bff-4afa-88d7-572fc1031557 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:47.025988 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1c613f2a-1bff-4afa-88d7-572fc1031557 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:47.076656 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c613f2a-1bff-4afa-88d7-572fc1031557 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:47.077737 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c613f2a-1bff-4afa-88d7-572fc1031557 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:47.081569 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c613f2a-1bff-4afa-88d7-572fc1031557 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:47.082453 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c613f2a-1bff-4afa-88d7-572fc1031557 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:47.434797 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1c613f2a-1bff-4afa-88d7-572fc1031557 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:47.449378 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1c613f2a-1bff-4afa-88d7-572fc1031557 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 200 len: 1327 microversion: 2.1 time: 0.455054 Jun 20 12:21:47.459401 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2467/4833] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:46 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 1327 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:47.576180 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-041cb73b-413f-464f-b1e6-0cbec13a2100 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:47.586620 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-041cb73b-413f-464f-b1e6-0cbec13a2100 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32" status: 200 len: 1788 microversion: 2.1 time: 1.432080 Jun 20 12:21:47.590581 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2367/4834] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:46 2022] GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32 => generated 1788 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:47.888974 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-994205f7-177b-4c75-a6c0-fe1047cc3ea0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:47.889597 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-994205f7-177b-4c75-a6c0-fe1047cc3ea0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: f6cb9020-dfc5-4942-b757-10d3806dfdd2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:47.910490 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-994205f7-177b-4c75-a6c0-fe1047cc3ea0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:47.910896 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-994205f7-177b-4c75-a6c0-fe1047cc3ea0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:47.911700 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-994205f7-177b-4c75-a6c0-fe1047cc3ea0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:47.912135 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-994205f7-177b-4c75-a6c0-fe1047cc3ea0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:48.436486 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-e25b54a3-a338-4312-b646-d5e33cc66753 req-f3c255e1-6e86-4d68-bb5c-89da36cb2be8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ddb525a-a112-4b08-829e-406a30d2fb32", "name": "network-vif-unplugged", "status": "completed", "tag": "3d0f5bc1-1c4b-4e0a-b9b3-e7a3495fb280"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:21:48.469836 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e25b54a3-a338-4312-b646-d5e33cc66753 req-f3c255e1-6e86-4d68-bb5c-89da36cb2be8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:48.474882 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e25b54a3-a338-4312-b646-d5e33cc66753 req-f3c255e1-6e86-4d68-bb5c-89da36cb2be8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:48.502129 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-e25b54a3-a338-4312-b646-d5e33cc66753 req-f3c255e1-6e86-4d68-bb5c-89da36cb2be8 service nova] Creating event network-vif-unplugged:3d0f5bc1-1c4b-4e0a-b9b3-e7a3495fb280 for instance 9ddb525a-a112-4b08-829e-406a30d2fb32 on n-h1-master-1 Jun 20 12:21:48.515282 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-e25b54a3-a338-4312-b646-d5e33cc66753 req-f3c255e1-6e86-4d68-bb5c-89da36cb2be8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084095 Jun 20 12:21:48.516136 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2368/4835] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:21:48.546024 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4bb20b57-103d-4a8b-ba70-d621e9398936 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:48.546744 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4bb20b57-103d-4a8b-ba70-d621e9398936 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:48.574830 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4bb20b57-103d-4a8b-ba70-d621e9398936 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:48.575298 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4bb20b57-103d-4a8b-ba70-d621e9398936 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:48.576111 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4bb20b57-103d-4a8b-ba70-d621e9398936 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:48.576580 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4bb20b57-103d-4a8b-ba70-d621e9398936 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:48.769183 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4bb20b57-103d-4a8b-ba70-d621e9398936 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:48.777754 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4bb20b57-103d-4a8b-ba70-d621e9398936 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 200 len: 1325 microversion: 2.1 time: 0.260398 Jun 20 12:21:48.790618 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2369/4836] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:48 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 1325 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:48.796506 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9a545358-e8cf-440a-92b3-2218b53ec2b5 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:48.797334 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9a545358-e8cf-440a-92b3-2218b53ec2b5 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: 9ddb525a-a112-4b08-829e-406a30d2fb32] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:48.806192 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9a545358-e8cf-440a-92b3-2218b53ec2b5 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:48.806617 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9a545358-e8cf-440a-92b3-2218b53ec2b5 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:48.808232 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9a545358-e8cf-440a-92b3-2218b53ec2b5 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:48.808802 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9a545358-e8cf-440a-92b3-2218b53ec2b5 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:49.040477 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-994205f7-177b-4c75-a6c0-fe1047cc3ea0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:49.049596 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-994205f7-177b-4c75-a6c0-fe1047cc3ea0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2" status: 200 len: 1315 microversion: 2.1 time: 1.166006 Jun 20 12:21:49.059796 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2468/4837] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:47 2022] GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2 => generated 1315 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:49.236022 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-01501575-d26f-491a-96d8-a3d2903a7490 req-98a3d0d0-7910-40f7-9921-dc82850513f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ddb525a-a112-4b08-829e-406a30d2fb32", "name": "network-vif-deleted", "tag": "b72ff8fb-8380-4bad-a4a2-c753c1e34b09"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:21:49.251613 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-01501575-d26f-491a-96d8-a3d2903a7490 req-98a3d0d0-7910-40f7-9921-dc82850513f8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:49.253068 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-01501575-d26f-491a-96d8-a3d2903a7490 req-98a3d0d0-7910-40f7-9921-dc82850513f8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:49.269351 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-01501575-d26f-491a-96d8-a3d2903a7490 req-98a3d0d0-7910-40f7-9921-dc82850513f8 service nova] Creating event network-vif-deleted:b72ff8fb-8380-4bad-a4a2-c753c1e34b09 for instance 9ddb525a-a112-4b08-829e-406a30d2fb32 on n-h1-master-1 Jun 20 12:21:49.277558 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-01501575-d26f-491a-96d8-a3d2903a7490 req-98a3d0d0-7910-40f7-9921-dc82850513f8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046717 Jun 20 12:21:49.279009 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2469/4838] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:21:49.310661 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9a545358-e8cf-440a-92b3-2218b53ec2b5 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:49.320422 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9a545358-e8cf-440a-92b3-2218b53ec2b5 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32" status: 200 len: 1609 microversion: 2.1 time: 0.537490 Jun 20 12:21:49.331221 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2370/4839] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:48 2022] GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32 => generated 1609 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:49.804262 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-de332392-573c-46b1-92a7-1836d8ac9614 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:49.817587 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-de332392-573c-46b1-92a7-1836d8ac9614 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:49.833392 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-de332392-573c-46b1-92a7-1836d8ac9614 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:49.834145 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-de332392-573c-46b1-92a7-1836d8ac9614 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:49.835642 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-de332392-573c-46b1-92a7-1836d8ac9614 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:49.836166 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-de332392-573c-46b1-92a7-1836d8ac9614 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:49.977679 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-de332392-573c-46b1-92a7-1836d8ac9614 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:49.990048 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-de332392-573c-46b1-92a7-1836d8ac9614 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 200 len: 1325 microversion: 2.1 time: 0.191678 Jun 20 12:21:49.990949 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2470/4840] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:49 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 1325 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:50.073735 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e96a7a20-b390-4629-ac34-a95e27ebe859 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:50.075895 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e96a7a20-b390-4629-ac34-a95e27ebe859 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: f6cb9020-dfc5-4942-b757-10d3806dfdd2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:50.086823 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e96a7a20-b390-4629-ac34-a95e27ebe859 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:50.087875 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e96a7a20-b390-4629-ac34-a95e27ebe859 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:50.090040 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e96a7a20-b390-4629-ac34-a95e27ebe859 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:50.090762 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e96a7a20-b390-4629-ac34-a95e27ebe859 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:50.349666 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4da64702-a613-4ba9-b735-2fbbb3828dd8 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:50.351134 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4da64702-a613-4ba9-b735-2fbbb3828dd8 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: 9ddb525a-a112-4b08-829e-406a30d2fb32] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:50.362651 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4da64702-a613-4ba9-b735-2fbbb3828dd8 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:50.363359 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4da64702-a613-4ba9-b735-2fbbb3828dd8 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:50.364601 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4da64702-a613-4ba9-b735-2fbbb3828dd8 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:50.365811 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4da64702-a613-4ba9-b735-2fbbb3828dd8 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:50.412875 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4da64702-a613-4ba9-b735-2fbbb3828dd8 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:50.413372 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4da64702-a613-4ba9-b735-2fbbb3828dd8 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:50.414691 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-4da64702-a613-4ba9-b735-2fbbb3828dd8 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lazy-loading 'fault' on Instance uuid 9ddb525a-a112-4b08-829e-406a30d2fb32 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:21:50.594873 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4da64702-a613-4ba9-b735-2fbbb3828dd8 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:50.611386 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4da64702-a613-4ba9-b735-2fbbb3828dd8 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32" status: 200 len: 1303 microversion: 2.1 time: 0.271498 Jun 20 12:21:50.622802 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2471/4841] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:50 2022] GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32 => generated 1303 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:50.924685 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e96a7a20-b390-4629-ac34-a95e27ebe859 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:50.936722 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e96a7a20-b390-4629-ac34-a95e27ebe859 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2" status: 200 len: 1315 microversion: 2.1 time: 0.872972 Jun 20 12:21:50.939661 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2371/4842] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:50 2022] GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2 => generated 1315 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:51.007825 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-63487424-2aa9-4299-ba5f-76f5404743c3 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:51.008480 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-63487424-2aa9-4299-ba5f-76f5404743c3 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:51.017684 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:21:51.020649 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63487424-2aa9-4299-ba5f-76f5404743c3 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:51.021359 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63487424-2aa9-4299-ba5f-76f5404743c3 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:51.022972 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63487424-2aa9-4299-ba5f-76f5404743c3 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:51.023585 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63487424-2aa9-4299-ba5f-76f5404743c3 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:51.136110 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-a79fa6aa-16ca-4b15-9b56-3afd1ef25403 req-26898e7a-9a04-4994-a14d-a0359c37263f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6cb9020-dfc5-4942-b757-10d3806dfdd2", "tag": "ff214df1-96aa-4e43-9f1f-688753119e08"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:21:51.171914 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-a79fa6aa-16ca-4b15-9b56-3afd1ef25403 req-26898e7a-9a04-4994-a14d-a0359c37263f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:51.184763 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-a79fa6aa-16ca-4b15-9b56-3afd1ef25403 req-26898e7a-9a04-4994-a14d-a0359c37263f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:51.231499 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-a79fa6aa-16ca-4b15-9b56-3afd1ef25403 req-26898e7a-9a04-4994-a14d-a0359c37263f service nova] Creating event network-changed:ff214df1-96aa-4e43-9f1f-688753119e08 for instance f6cb9020-dfc5-4942-b757-10d3806dfdd2 on n-h2-master-1 Jun 20 12:21:51.252293 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-a79fa6aa-16ca-4b15-9b56-3afd1ef25403 req-26898e7a-9a04-4994-a14d-a0359c37263f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122940 Jun 20 12:21:51.254018 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2372/4843] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:21:51.380600 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-63487424-2aa9-4299-ba5f-76f5404743c3 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:51.392933 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-63487424-2aa9-4299-ba5f-76f5404743c3 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 200 len: 1391 microversion: 2.1 time: 0.388959 Jun 20 12:21:51.394478 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2472/4844] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:51 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 1391 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:21:51.474828 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-3d983662-8bc7-4411-b8ff-a410c31cb1df req-daeb65e6-e13d-4476-91bd-1549f0fe6248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ddb525a-a112-4b08-829e-406a30d2fb32", "name": "network-vif-deleted", "tag": "3d0f5bc1-1c4b-4e0a-b9b3-e7a3495fb280"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:21:51.508558 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-3d983662-8bc7-4411-b8ff-a410c31cb1df req-daeb65e6-e13d-4476-91bd-1549f0fe6248 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:51.509325 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-3d983662-8bc7-4411-b8ff-a410c31cb1df req-daeb65e6-e13d-4476-91bd-1549f0fe6248 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:51.527376 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-3d983662-8bc7-4411-b8ff-a410c31cb1df req-daeb65e6-e13d-4476-91bd-1549f0fe6248 service nova] Creating event network-vif-deleted:3d0f5bc1-1c4b-4e0a-b9b3-e7a3495fb280 for instance 9ddb525a-a112-4b08-829e-406a30d2fb32 on n-h1-master-1 Jun 20 12:21:51.533556 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-3d983662-8bc7-4411-b8ff-a410c31cb1df req-daeb65e6-e13d-4476-91bd-1549f0fe6248 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062981 Jun 20 12:21:51.534508 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2373/4845] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:21:51.630683 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0112cdd7-6d02-47d7-b389-55160565dde9 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:51.631411 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0112cdd7-6d02-47d7-b389-55160565dde9 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: 9ddb525a-a112-4b08-829e-406a30d2fb32] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:51.640687 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0112cdd7-6d02-47d7-b389-55160565dde9 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:51.641507 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0112cdd7-6d02-47d7-b389-55160565dde9 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:51.642493 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0112cdd7-6d02-47d7-b389-55160565dde9 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:51.643112 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0112cdd7-6d02-47d7-b389-55160565dde9 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:51.659430 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-0112cdd7-6d02-47d7-b389-55160565dde9 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] HTTP exception thrown: Instance 9ddb525a-a112-4b08-829e-406a30d2fb32 could not be found. Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0112cdd7-6d02-47d7-b389-55160565dde9 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Request method failure captured: Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32 HTTP/1.1 Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGYeoDCzSdXnAhbu37zieEBq01kcYOFYUIttikx00ee5xscSvPVcezLf3hcujSpSzVtib_YHINtSJa9dC6m6rwQGS7WQFUPUEPw46T1ErPigEOlrVg_uSnsnnnC5XdDLSs4vJ_xpDtx1AVPdT4p6t7LOR_BPD7OYPUaJY249UPvAw7A Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 0953197109e44d0496000c9535c8c583 Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersTestMultiNic-1921807450 Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0953197109e44d0496000c9535c8c583"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0953197109e44d0496000c9535c8c583"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0953197109e44d0496000c9535c8c583"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0953197109e44d0496000c9535c8c583"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersTestMultiNic-1921807450 Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 0953197109e44d0496000c9535c8c583 Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersTestMultiNic-1921807450 Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersTestMultiNic-1921807450-project Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: a8fa09acee6e4f9cb99c6e78e5b85589 Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersTestMultiNic-1921807450-project Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 9ddb525a-a112-4b08-829e-406a30d2fb32 could not be found. Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '9ddb525a-a112-4b08-829e-406a30d2fb32'} Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ddb525a-a112-4b08-829e-406a30d2fb32 could not be found. Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ddb525a-a112-4b08-829e-406a30d2fb32 could not be found. Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:21:51.661266 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:21:51.669684 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:21:51.669684 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:21:51.669684 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:21:51.669684 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:21:51.669684 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:21:51.669684 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ddb525a-a112-4b08-829e-406a30d2fb32 could not be found. Jun 20 12:21:51.669684 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:21:51.669684 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0112cdd7-6d02-47d7-b389-55160565dde9 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Returning 404 to user: Instance 9ddb525a-a112-4b08-829e-406a30d2fb32 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:21:51.669684 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0112cdd7-6d02-47d7-b389-55160565dde9 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32" status: 404 len: 111 microversion: 2.1 time: 0.037799 Jun 20 12:21:51.669684 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2473/4846] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:51 2022] GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:21:51.959340 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-32cfd7a9-9911-4bb0-9b27-388a19024634 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:51.960482 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-32cfd7a9-9911-4bb0-9b27-388a19024634 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: f6cb9020-dfc5-4942-b757-10d3806dfdd2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:51.967932 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-32cfd7a9-9911-4bb0-9b27-388a19024634 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:51.968774 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-32cfd7a9-9911-4bb0-9b27-388a19024634 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:51.969790 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-32cfd7a9-9911-4bb0-9b27-388a19024634 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:51.970440 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-32cfd7a9-9911-4bb0-9b27-388a19024634 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:52.412760 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2c492196-a676-4aa9-b7ec-4a3d2d19985d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:52.413608 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2c492196-a676-4aa9-b7ec-4a3d2d19985d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:52.426837 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2c492196-a676-4aa9-b7ec-4a3d2d19985d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:52.427301 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2c492196-a676-4aa9-b7ec-4a3d2d19985d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:52.428104 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2c492196-a676-4aa9-b7ec-4a3d2d19985d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:52.429665 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2c492196-a676-4aa9-b7ec-4a3d2d19985d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:52.540912 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-32cfd7a9-9911-4bb0-9b27-388a19024634 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:52.556037 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-32cfd7a9-9911-4bb0-9b27-388a19024634 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2" status: 200 len: 1315 microversion: 2.1 time: 0.601230 Jun 20 12:21:52.557113 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2374/4847] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:51 2022] GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2 => generated 1315 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:52.902703 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:21:53.172359 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2c492196-a676-4aa9-b7ec-4a3d2d19985d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:53.200393 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2c492196-a676-4aa9-b7ec-4a3d2d19985d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 200 len: 1391 microversion: 2.1 time: 0.792917 Jun 20 12:21:53.206384 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2474/4848] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:52 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 1391 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:53.307239 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d9c09360-0e19-468d-8ef5-52e90506cfbe tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:53.308054 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d9c09360-0e19-468d-8ef5-52e90506cfbe tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:53.316898 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d9c09360-0e19-468d-8ef5-52e90506cfbe tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:53.317629 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d9c09360-0e19-468d-8ef5-52e90506cfbe tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:53.318772 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d9c09360-0e19-468d-8ef5-52e90506cfbe tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:53.319431 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d9c09360-0e19-468d-8ef5-52e90506cfbe tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:53.422474 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-d9c09360-0e19-468d-8ef5-52e90506cfbe tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lazy-loading 'services' on Instance uuid 442a5a56-7a8d-4804-ab29-515e6d314b19 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:21:53.551363 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d9c09360-0e19-468d-8ef5-52e90506cfbe tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "DELETE /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19/os-volume_attachments/2cf50a6c-49bb-403f-9909-1b252f383c79" status: 202 len: 0 microversion: 2.1 time: 0.247942 Jun 20 12:21:53.551973 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2375/4849] 10.222.0.27 () {58 vars in 1415 bytes} [Mon Jun 20 12:21:53 2022] DELETE /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19/os-volume_attachments/2cf50a6c-49bb-403f-9909-1b252f383c79 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:21:53.575627 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-70f93923-6e81-4ef9-a356-a0adefe90dde tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:53.577318 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-70f93923-6e81-4ef9-a356-a0adefe90dde tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: f6cb9020-dfc5-4942-b757-10d3806dfdd2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:53.594912 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-70f93923-6e81-4ef9-a356-a0adefe90dde tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:53.598231 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-70f93923-6e81-4ef9-a356-a0adefe90dde tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:53.600588 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-70f93923-6e81-4ef9-a356-a0adefe90dde tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:53.602391 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-70f93923-6e81-4ef9-a356-a0adefe90dde tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:53.736352 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-6060255c-8abd-4c75-b69d-acac151d175b req-35a71551-c1ee-4109-a919-dd1fc9195882 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25476e5c-8f10-449a-881b-2e9d9d1b2bfe", "tag": "d4cffb2a-b881-48b3-9739-58fc13501c0e"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:21:53.761856 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-6060255c-8abd-4c75-b69d-acac151d175b req-35a71551-c1ee-4109-a919-dd1fc9195882 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:53.762357 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-6060255c-8abd-4c75-b69d-acac151d175b req-35a71551-c1ee-4109-a919-dd1fc9195882 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:53.784650 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-6060255c-8abd-4c75-b69d-acac151d175b req-35a71551-c1ee-4109-a919-dd1fc9195882 service nova] Creating event network-changed:d4cffb2a-b881-48b3-9739-58fc13501c0e for instance 25476e5c-8f10-449a-881b-2e9d9d1b2bfe on n-h1-master-1 Jun 20 12:21:53.798702 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-6060255c-8abd-4c75-b69d-acac151d175b req-35a71551-c1ee-4109-a919-dd1fc9195882 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068766 Jun 20 12:21:53.805022 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2376/4850] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:21:54.091669 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-70f93923-6e81-4ef9-a356-a0adefe90dde tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:54.103869 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-70f93923-6e81-4ef9-a356-a0adefe90dde tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2" status: 200 len: 1315 microversion: 2.1 time: 0.532209 Jun 20 12:21:54.105530 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2475/4851] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:53 2022] GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2 => generated 1315 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:54.233678 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f5c60026-69bc-4273-b543-a56ffa8e075a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:54.249107 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f5c60026-69bc-4273-b543-a56ffa8e075a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:54.272599 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f5c60026-69bc-4273-b543-a56ffa8e075a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:54.286753 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f5c60026-69bc-4273-b543-a56ffa8e075a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:54.289383 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f5c60026-69bc-4273-b543-a56ffa8e075a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:54.295304 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f5c60026-69bc-4273-b543-a56ffa8e075a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:54.713929 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f5c60026-69bc-4273-b543-a56ffa8e075a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:54.719384 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:21:54.740784 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f5c60026-69bc-4273-b543-a56ffa8e075a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 200 len: 1391 microversion: 2.1 time: 0.521230 Jun 20 12:21:54.741526 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2377/4852] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:54 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 1391 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:55.121463 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c0b08641-7dab-4a1d-b2e8-df9d2dcdce63 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:55.128564 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c0b08641-7dab-4a1d-b2e8-df9d2dcdce63 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: f6cb9020-dfc5-4942-b757-10d3806dfdd2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:55.142400 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c0b08641-7dab-4a1d-b2e8-df9d2dcdce63 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:55.144523 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c0b08641-7dab-4a1d-b2e8-df9d2dcdce63 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:55.145384 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c0b08641-7dab-4a1d-b2e8-df9d2dcdce63 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:55.148715 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c0b08641-7dab-4a1d-b2e8-df9d2dcdce63 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:55.571212 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c0b08641-7dab-4a1d-b2e8-df9d2dcdce63 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:55.585687 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c0b08641-7dab-4a1d-b2e8-df9d2dcdce63 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2" status: 200 len: 1315 microversion: 2.1 time: 0.468310 Jun 20 12:21:55.587394 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2476/4853] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:55 2022] GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2 => generated 1315 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:55.765069 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5b834d08-25f7-48b0-be54-5e39c77e172d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:55.766407 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5b834d08-25f7-48b0-be54-5e39c77e172d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:55.784329 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:21:55.801142 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5b834d08-25f7-48b0-be54-5e39c77e172d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:55.805588 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5b834d08-25f7-48b0-be54-5e39c77e172d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:55.825796 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5b834d08-25f7-48b0-be54-5e39c77e172d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:55.827397 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5b834d08-25f7-48b0-be54-5e39c77e172d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:56.357231 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5b834d08-25f7-48b0-be54-5e39c77e172d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:56.366717 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5b834d08-25f7-48b0-be54-5e39c77e172d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 200 len: 1391 microversion: 2.1 time: 0.613070 Jun 20 12:21:56.377021 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2378/4854] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:55 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 1391 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:56.608469 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d9af7aa8-f37f-48e6-80e8-2881ad6a039b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:56.609818 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d9af7aa8-f37f-48e6-80e8-2881ad6a039b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: f6cb9020-dfc5-4942-b757-10d3806dfdd2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:56.623362 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=10 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:21:56.629833 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9af7aa8-f37f-48e6-80e8-2881ad6a039b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:56.630780 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9af7aa8-f37f-48e6-80e8-2881ad6a039b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:56.632185 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9af7aa8-f37f-48e6-80e8-2881ad6a039b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:56.635542 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9af7aa8-f37f-48e6-80e8-2881ad6a039b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:56.990103 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d9af7aa8-f37f-48e6-80e8-2881ad6a039b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:57.005060 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d9af7aa8-f37f-48e6-80e8-2881ad6a039b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2" status: 200 len: 1315 microversion: 2.1 time: 0.401511 Jun 20 12:21:57.021384 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2477/4855] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:56 2022] GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2 => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:57.395111 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d4daeafe-5b2f-465a-b0ec-645ad3def704 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:57.395721 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d4daeafe-5b2f-465a-b0ec-645ad3def704 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:57.408664 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4daeafe-5b2f-465a-b0ec-645ad3def704 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:57.412086 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4daeafe-5b2f-465a-b0ec-645ad3def704 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:57.413114 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4daeafe-5b2f-465a-b0ec-645ad3def704 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:57.413836 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4daeafe-5b2f-465a-b0ec-645ad3def704 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:57.768642 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d4daeafe-5b2f-465a-b0ec-645ad3def704 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:57.778571 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d4daeafe-5b2f-465a-b0ec-645ad3def704 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 200 len: 1391 microversion: 2.1 time: 0.387687 Jun 20 12:21:57.781346 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2379/4856] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:57 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 1391 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:58.038237 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-71fd55e2-2387-4339-952d-edb696f7e550 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:58.038847 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-71fd55e2-2387-4339-952d-edb696f7e550 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: f6cb9020-dfc5-4942-b757-10d3806dfdd2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:58.052504 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-71fd55e2-2387-4339-952d-edb696f7e550 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:58.058697 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-71fd55e2-2387-4339-952d-edb696f7e550 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:58.059590 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-71fd55e2-2387-4339-952d-edb696f7e550 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:58.060049 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-71fd55e2-2387-4339-952d-edb696f7e550 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:58.808182 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-774f66a0-dc5d-4b79-b321-f0a0a7678dfb tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:58.809105 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-774f66a0-dc5d-4b79-b321-f0a0a7678dfb tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:58.822235 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-774f66a0-dc5d-4b79-b321-f0a0a7678dfb tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:58.825067 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-774f66a0-dc5d-4b79-b321-f0a0a7678dfb tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:58.827068 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-774f66a0-dc5d-4b79-b321-f0a0a7678dfb tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:58.828647 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-774f66a0-dc5d-4b79-b321-f0a0a7678dfb tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:58.873086 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-71fd55e2-2387-4339-952d-edb696f7e550 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:58.881130 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-71fd55e2-2387-4339-952d-edb696f7e550 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2" status: 200 len: 1315 microversion: 2.1 time: 0.846763 Jun 20 12:21:58.894218 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2478/4857] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:58 2022] GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2 => generated 1315 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:59.127911 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-774f66a0-dc5d-4b79-b321-f0a0a7678dfb tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:21:59.137634 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-774f66a0-dc5d-4b79-b321-f0a0a7678dfb tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 200 len: 1391 microversion: 2.1 time: 0.335500 Jun 20 12:21:59.139822 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2380/4858] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:58 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 1391 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:21:59.898828 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-af9d4112-4b58-4f94-8e23-25df0d42eebe tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:59.900703 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-af9d4112-4b58-4f94-8e23-25df0d42eebe tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: f6cb9020-dfc5-4942-b757-10d3806dfdd2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:21:59.910974 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-af9d4112-4b58-4f94-8e23-25df0d42eebe tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:59.916621 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-af9d4112-4b58-4f94-8e23-25df0d42eebe tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:59.918293 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-af9d4112-4b58-4f94-8e23-25df0d42eebe tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:59.918914 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-af9d4112-4b58-4f94-8e23-25df0d42eebe tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:00.156432 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d6d76cb7-ccbd-4faf-960b-a1f79a12ba32 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:00.157116 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d6d76cb7-ccbd-4faf-960b-a1f79a12ba32 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:00.168590 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6d76cb7-ccbd-4faf-960b-a1f79a12ba32 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:00.193902 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6d76cb7-ccbd-4faf-960b-a1f79a12ba32 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:00.196130 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6d76cb7-ccbd-4faf-960b-a1f79a12ba32 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:00.200879 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6d76cb7-ccbd-4faf-960b-a1f79a12ba32 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:00.223464 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-af9d4112-4b58-4f94-8e23-25df0d42eebe tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:00.232226 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-af9d4112-4b58-4f94-8e23-25df0d42eebe tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2" status: 200 len: 1315 microversion: 2.1 time: 0.338055 Jun 20 12:22:00.241976 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2479/4859] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:21:59 2022] GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2 => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:00.529789 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a2ce5e41-3e71-459c-8489-927dfe58e901 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1105390230", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "c41c98c8-8c7f-4ac2-a964-a11e7e6c31ce"}, {"uuid": "5a786032-c616-4191-bf2a-ee3b6aab754a"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:22:00.565855 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d6d76cb7-ccbd-4faf-960b-a1f79a12ba32 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:00.574822 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d6d76cb7-ccbd-4faf-960b-a1f79a12ba32 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 200 len: 1391 microversion: 2.1 time: 0.422240 Jun 20 12:22:00.580650 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2381/4860] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:00 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 1391 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:00.663493 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-a2ce5e41-3e71-459c-8489-927dfe58e901 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] validate_networks() for [('c41c98c8-8c7f-4ac2-a964-a11e7e6c31ce', None, None, None, None, None), ('5a786032-c616-4191-bf2a-ee3b6aab754a', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:22:00.981493 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-5b134afb-afa2-449c-a875-187dd92e2729 req-1bbbaa6f-ce81-4afc-8fe3-36d0fd660a55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6cb9020-dfc5-4942-b757-10d3806dfdd2", "name": "network-vif-plugged", "status": "completed", "tag": "ff214df1-96aa-4e43-9f1f-688753119e08"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:22:01.005711 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-5b134afb-afa2-449c-a875-187dd92e2729 req-1bbbaa6f-ce81-4afc-8fe3-36d0fd660a55 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:01.009874 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-5b134afb-afa2-449c-a875-187dd92e2729 req-1bbbaa6f-ce81-4afc-8fe3-36d0fd660a55 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:01.062915 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-5b134afb-afa2-449c-a875-187dd92e2729 req-1bbbaa6f-ce81-4afc-8fe3-36d0fd660a55 service nova] Creating event network-vif-plugged:ff214df1-96aa-4e43-9f1f-688753119e08 for instance f6cb9020-dfc5-4942-b757-10d3806dfdd2 on n-h2-master-1 Jun 20 12:22:01.072389 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-5b134afb-afa2-449c-a875-187dd92e2729 req-1bbbaa6f-ce81-4afc-8fe3-36d0fd660a55 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094457 Jun 20 12:22:01.080249 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2382/4861] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:22:01.258887 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6b609230-f4dc-4d28-88bc-ea6b35caedf6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:01.261136 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6b609230-f4dc-4d28-88bc-ea6b35caedf6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: f6cb9020-dfc5-4942-b757-10d3806dfdd2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:01.270806 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6b609230-f4dc-4d28-88bc-ea6b35caedf6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:01.271860 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6b609230-f4dc-4d28-88bc-ea6b35caedf6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:01.272969 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6b609230-f4dc-4d28-88bc-ea6b35caedf6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:01.273665 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6b609230-f4dc-4d28-88bc-ea6b35caedf6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:01.689520 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6b609230-f4dc-4d28-88bc-ea6b35caedf6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:01.700816 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6b609230-f4dc-4d28-88bc-ea6b35caedf6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2" status: 200 len: 1315 microversion: 2.1 time: 0.449229 Jun 20 12:22:01.702857 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2383/4862] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:01 2022] GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2 => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:22:01.711106 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-648c0864-8cba-4c1e-ac99-4a27ca734fca tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:01.718601 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-648c0864-8cba-4c1e-ac99-4a27ca734fca tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:01.727617 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-648c0864-8cba-4c1e-ac99-4a27ca734fca tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:01.734015 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-648c0864-8cba-4c1e-ac99-4a27ca734fca tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:01.739956 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-648c0864-8cba-4c1e-ac99-4a27ca734fca tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:01.740891 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-648c0864-8cba-4c1e-ac99-4a27ca734fca tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:02.097707 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-648c0864-8cba-4c1e-ac99-4a27ca734fca tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:02.104720 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:02.112803 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-648c0864-8cba-4c1e-ac99-4a27ca734fca tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 200 len: 1391 microversion: 2.1 time: 0.405817 Jun 20 12:22:02.124861 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2384/4863] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:01 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 1391 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:02.364915 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-a2ce5e41-3e71-459c-8489-927dfe58e901 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:22:02.365460 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-a2ce5e41-3e71-459c-8489-927dfe58e901 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:22:02.366236 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-a2ce5e41-3e71-459c-8489-927dfe58e901 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:22:02.366767 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-a2ce5e41-3e71-459c-8489-927dfe58e901 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:22:02.367342 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-a2ce5e41-3e71-459c-8489-927dfe58e901 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:22:02.387393 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a2ce5e41-3e71-459c-8489-927dfe58e901 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:02.387984 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a2ce5e41-3e71-459c-8489-927dfe58e901 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:02.389285 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a2ce5e41-3e71-459c-8489-927dfe58e901 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:02.392716 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a2ce5e41-3e71-459c-8489-927dfe58e901 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:02.443221 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-a2ce5e41-3e71-459c-8489-927dfe58e901 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Getting quotas for project 0953197109e44d0496000c9535c8c583. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:22:02.473259 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-a2ce5e41-3e71-459c-8489-927dfe58e901 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Getting quotas for user a8fa09acee6e4f9cb99c6e78e5b85589 and project 0953197109e44d0496000c9535c8c583. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:22:02.537800 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a2ce5e41-3e71-459c-8489-927dfe58e901 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:22:02.549577 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a2ce5e41-3e71-459c-8489-927dfe58e901 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: e54387d9-1cd6-4e8b-beb5-8011c1dcb19b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:22:02.702678 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a2ce5e41-3e71-459c-8489-927dfe58e901 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.187443 Jun 20 12:22:02.705027 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2480/4864] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:22:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2192 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:22:02.717062 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-02e004c2-e6b7-4b04-9c71-2947aa0713df tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:02.717757 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-02e004c2-e6b7-4b04-9c71-2947aa0713df tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: e54387d9-1cd6-4e8b-beb5-8011c1dcb19b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:02.725189 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bdd6f245-df3f-4757-a83e-a02eb71a9dfe tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:02.728938 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bdd6f245-df3f-4757-a83e-a02eb71a9dfe tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: f6cb9020-dfc5-4942-b757-10d3806dfdd2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:02.741759 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bdd6f245-df3f-4757-a83e-a02eb71a9dfe tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:02.752258 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bdd6f245-df3f-4757-a83e-a02eb71a9dfe tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:02.753488 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bdd6f245-df3f-4757-a83e-a02eb71a9dfe tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:02.754358 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bdd6f245-df3f-4757-a83e-a02eb71a9dfe tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:02.848151 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-02e004c2-e6b7-4b04-9c71-2947aa0713df tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:02.857653 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-02e004c2-e6b7-4b04-9c71-2947aa0713df tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b" status: 200 len: 1213 microversion: 2.1 time: 0.146700 Jun 20 12:22:02.858923 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2385/4865] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:02 2022] GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b => generated 1213 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:03.129996 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3849cfeb-bdeb-4209-8546-bcc6a232d1d9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:03.130621 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3849cfeb-bdeb-4209-8546-bcc6a232d1d9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:03.147204 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3849cfeb-bdeb-4209-8546-bcc6a232d1d9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:03.147673 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3849cfeb-bdeb-4209-8546-bcc6a232d1d9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:03.148512 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3849cfeb-bdeb-4209-8546-bcc6a232d1d9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:03.148980 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3849cfeb-bdeb-4209-8546-bcc6a232d1d9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:03.279544 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bdd6f245-df3f-4757-a83e-a02eb71a9dfe tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:03.301553 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bdd6f245-df3f-4757-a83e-a02eb71a9dfe tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2" status: 200 len: 1315 microversion: 2.1 time: 0.577234 Jun 20 12:22:03.302440 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2481/4866] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:02 2022] GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2 => generated 1315 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:03.878076 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9bddfabb-259e-42a7-8a5e-9f0bc3399d3c tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:03.878893 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9bddfabb-259e-42a7-8a5e-9f0bc3399d3c tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: e54387d9-1cd6-4e8b-beb5-8011c1dcb19b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:03.887905 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9bddfabb-259e-42a7-8a5e-9f0bc3399d3c tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:03.888532 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9bddfabb-259e-42a7-8a5e-9f0bc3399d3c tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:03.896477 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9bddfabb-259e-42a7-8a5e-9f0bc3399d3c tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:03.900140 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9bddfabb-259e-42a7-8a5e-9f0bc3399d3c tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:04.288448 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3849cfeb-bdeb-4209-8546-bcc6a232d1d9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:04.301586 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3849cfeb-bdeb-4209-8546-bcc6a232d1d9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 200 len: 1391 microversion: 2.1 time: 1.175155 Jun 20 12:22:04.312797 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2386/4867] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:03 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 1391 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:04.319906 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c7438ace-b973-4f4b-921d-f4fb23026fab tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:04.321658 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c7438ace-b973-4f4b-921d-f4fb23026fab tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: f6cb9020-dfc5-4942-b757-10d3806dfdd2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:04.324105 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9bddfabb-259e-42a7-8a5e-9f0bc3399d3c tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:04.339812 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9bddfabb-259e-42a7-8a5e-9f0bc3399d3c tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b" status: 200 len: 1217 microversion: 2.1 time: 0.467063 Jun 20 12:22:04.342863 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2482/4868] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:03 2022] GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b => generated 1217 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:22:04.356010 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c7438ace-b973-4f4b-921d-f4fb23026fab tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:04.366238 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c7438ace-b973-4f4b-921d-f4fb23026fab tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:04.367173 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c7438ace-b973-4f4b-921d-f4fb23026fab tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:04.367627 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c7438ace-b973-4f4b-921d-f4fb23026fab tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:05.179118 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-e4e68413-7639-4aef-98c9-ebde1677d0f6 req-c7ff7f54-e4c0-419d-8b73-509afe124bac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25476e5c-8f10-449a-881b-2e9d9d1b2bfe", "name": "network-vif-plugged", "status": "completed", "tag": "d4cffb2a-b881-48b3-9739-58fc13501c0e"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:22:05.219562 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-e4e68413-7639-4aef-98c9-ebde1677d0f6 req-c7ff7f54-e4c0-419d-8b73-509afe124bac service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:05.219929 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-e4e68413-7639-4aef-98c9-ebde1677d0f6 req-c7ff7f54-e4c0-419d-8b73-509afe124bac service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:05.256457 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-e4e68413-7639-4aef-98c9-ebde1677d0f6 req-c7ff7f54-e4c0-419d-8b73-509afe124bac service nova] Creating event network-vif-plugged:d4cffb2a-b881-48b3-9739-58fc13501c0e for instance 25476e5c-8f10-449a-881b-2e9d9d1b2bfe on n-h1-master-1 Jun 20 12:22:05.272402 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-e4e68413-7639-4aef-98c9-ebde1677d0f6 req-c7ff7f54-e4c0-419d-8b73-509afe124bac service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095433 Jun 20 12:22:05.274780 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2483/4869] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:22:05.316524 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a527d321-5d99-49bb-ae62-b3bd75e82146 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:22:05.342243 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a527d321-5d99-49bb-ae62-b3bd75e82146 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:05.342243 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a527d321-5d99-49bb-ae62-b3bd75e82146 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:05.396484 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a527d321-5d99-49bb-ae62-b3bd75e82146 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Going to try to stop instance {{(pid=119127) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 20 12:22:05.453987 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:05.468363 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a527d321-5d99-49bb-ae62-b3bd75e82146 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "POST /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19/action" status: 202 len: 0 microversion: 2.1 time: 0.156870 Jun 20 12:22:05.470837 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2484/4870] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:22:05 2022] POST /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:22:05.486349 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-abe9f5d0-8e6a-4258-b239-819620853399 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:05.488417 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-abe9f5d0-8e6a-4258-b239-819620853399 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:05.503826 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-abe9f5d0-8e6a-4258-b239-819620853399 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:05.505538 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-abe9f5d0-8e6a-4258-b239-819620853399 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:05.506702 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-abe9f5d0-8e6a-4258-b239-819620853399 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:05.507453 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-abe9f5d0-8e6a-4258-b239-819620853399 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:05.512049 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c7438ace-b973-4f4b-921d-f4fb23026fab tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:05.542005 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c7438ace-b973-4f4b-921d-f4fb23026fab tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2" status: 200 len: 1502 microversion: 2.1 time: 1.226789 Jun 20 12:22:05.552578 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2387/4871] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:04 2022] GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2 => generated 1502 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:05.561915 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-367af188-6c65-439d-87c8-6fb83ac89346 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:05.562475 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-367af188-6c65-439d-87c8-6fb83ac89346 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: e54387d9-1cd6-4e8b-beb5-8011c1dcb19b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:05.605986 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-367af188-6c65-439d-87c8-6fb83ac89346 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:05.606507 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-367af188-6c65-439d-87c8-6fb83ac89346 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:05.607352 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-367af188-6c65-439d-87c8-6fb83ac89346 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:05.607789 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-367af188-6c65-439d-87c8-6fb83ac89346 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:05.884567 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-abe9f5d0-8e6a-4258-b239-819620853399 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:05.898508 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-abe9f5d0-8e6a-4258-b239-819620853399 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 200 len: 1391 microversion: 2.1 time: 0.423875 Jun 20 12:22:05.904911 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2485/4872] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:05 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 1391 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:05.918418 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e3adcc03-6f16-454f-9a52-4de74ce4ace7 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:05.933039 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e3adcc03-6f16-454f-9a52-4de74ce4ace7 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:05.955118 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e3adcc03-6f16-454f-9a52-4de74ce4ace7 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:05.957069 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e3adcc03-6f16-454f-9a52-4de74ce4ace7 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:05.958440 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e3adcc03-6f16-454f-9a52-4de74ce4ace7 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:05.960382 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e3adcc03-6f16-454f-9a52-4de74ce4ace7 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:05.990598 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-367af188-6c65-439d-87c8-6fb83ac89346 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:05.999919 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-367af188-6c65-439d-87c8-6fb83ac89346 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b" status: 200 len: 1271 microversion: 2.1 time: 0.445846 Jun 20 12:22:06.015096 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2388/4873] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:05 2022] GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b => generated 1271 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:06.036529 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-07b04d73-535d-41d8-9372-00fa9be9270d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:22:06.061323 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-07b04d73-535d-41d8-9372-00fa9be9270d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:06.062379 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-07b04d73-535d-41d8-9372-00fa9be9270d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:06.115880 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-07b04d73-535d-41d8-9372-00fa9be9270d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: f6cb9020-dfc5-4942-b757-10d3806dfdd2] Going to try to stop instance {{(pid=119128) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 20 12:22:06.269817 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-07b04d73-535d-41d8-9372-00fa9be9270d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "POST /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2/action" status: 202 len: 0 microversion: 2.1 time: 0.251241 Jun 20 12:22:06.273612 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2389/4874] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:22:06 2022] POST /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:22:06.323077 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fe324c5c-aa7c-4942-adb8-b8cc10d7d1b6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:06.323824 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fe324c5c-aa7c-4942-adb8-b8cc10d7d1b6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: f6cb9020-dfc5-4942-b757-10d3806dfdd2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:06.345813 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe324c5c-aa7c-4942-adb8-b8cc10d7d1b6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:06.349091 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe324c5c-aa7c-4942-adb8-b8cc10d7d1b6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:06.350667 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe324c5c-aa7c-4942-adb8-b8cc10d7d1b6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:06.351134 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe324c5c-aa7c-4942-adb8-b8cc10d7d1b6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:06.438246 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e3adcc03-6f16-454f-9a52-4de74ce4ace7 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:06.447876 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e3adcc03-6f16-454f-9a52-4de74ce4ace7 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1678 microversion: 2.1 time: 0.541411 Jun 20 12:22:06.461104 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2486/4875] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:05 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1678 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:06.851242 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fe324c5c-aa7c-4942-adb8-b8cc10d7d1b6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:06.859635 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fe324c5c-aa7c-4942-adb8-b8cc10d7d1b6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2" status: 200 len: 1512 microversion: 2.1 time: 0.553830 Jun 20 12:22:06.870533 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2390/4876] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:06 2022] GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2 => generated 1512 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:06.929954 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2d16aa7e-a924-4057-815d-414562b4f159 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:06.935296 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2d16aa7e-a924-4057-815d-414562b4f159 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:06.970190 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2d16aa7e-a924-4057-815d-414562b4f159 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:06.970674 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2d16aa7e-a924-4057-815d-414562b4f159 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:06.978608 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2d16aa7e-a924-4057-815d-414562b4f159 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:06.980899 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2d16aa7e-a924-4057-815d-414562b4f159 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:07.034621 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cedc310f-1352-4b0b-b83c-632e17bc9d86 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:07.035402 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cedc310f-1352-4b0b-b83c-632e17bc9d86 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: e54387d9-1cd6-4e8b-beb5-8011c1dcb19b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:07.049270 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cedc310f-1352-4b0b-b83c-632e17bc9d86 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:07.051358 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cedc310f-1352-4b0b-b83c-632e17bc9d86 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:07.054438 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cedc310f-1352-4b0b-b83c-632e17bc9d86 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:07.055164 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cedc310f-1352-4b0b-b83c-632e17bc9d86 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:07.542164 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2d16aa7e-a924-4057-815d-414562b4f159 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:07.555363 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2d16aa7e-a924-4057-815d-414562b4f159 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 200 len: 1391 microversion: 2.1 time: 0.640610 Jun 20 12:22:07.569793 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2487/4877] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:06 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 1391 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:07.573657 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-50e6f494-4b1e-479b-9d56-fcaba29e99d8 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:07.574486 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-50e6f494-4b1e-479b-9d56-fcaba29e99d8 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:07.594253 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-50e6f494-4b1e-479b-9d56-fcaba29e99d8 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:07.595093 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-50e6f494-4b1e-479b-9d56-fcaba29e99d8 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:07.603624 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-50e6f494-4b1e-479b-9d56-fcaba29e99d8 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:07.604665 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-50e6f494-4b1e-479b-9d56-fcaba29e99d8 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:08.037832 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-cedc310f-1352-4b0b-b83c-632e17bc9d86 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:08.055361 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cedc310f-1352-4b0b-b83c-632e17bc9d86 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b" status: 200 len: 1313 microversion: 2.1 time: 1.027571 Jun 20 12:22:08.069142 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2391/4878] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:07 2022] GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b => generated 1313 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:22:08.090450 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6c9e764a-3bfa-485b-985f-1a524d849ca3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:08.094745 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6c9e764a-3bfa-485b-985f-1a524d849ca3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: f6cb9020-dfc5-4942-b757-10d3806dfdd2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:08.111277 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-50e6f494-4b1e-479b-9d56-fcaba29e99d8 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:08.117663 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6c9e764a-3bfa-485b-985f-1a524d849ca3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:08.118401 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6c9e764a-3bfa-485b-985f-1a524d849ca3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:08.120158 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6c9e764a-3bfa-485b-985f-1a524d849ca3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:08.120969 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6c9e764a-3bfa-485b-985f-1a524d849ca3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:08.124776 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-50e6f494-4b1e-479b-9d56-fcaba29e99d8 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1678 microversion: 2.1 time: 0.563337 Jun 20 12:22:08.139608 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2488/4879] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:07 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1678 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:08.578421 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-12b0d949-8676-4dfe-97b5-c587af27e65a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:08.579523 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-12b0d949-8676-4dfe-97b5-c587af27e65a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:08.593951 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-12b0d949-8676-4dfe-97b5-c587af27e65a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:08.594515 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-12b0d949-8676-4dfe-97b5-c587af27e65a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:08.595955 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-12b0d949-8676-4dfe-97b5-c587af27e65a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:08.596455 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-12b0d949-8676-4dfe-97b5-c587af27e65a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:08.794777 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6c9e764a-3bfa-485b-985f-1a524d849ca3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:08.806849 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6c9e764a-3bfa-485b-985f-1a524d849ca3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2" status: 200 len: 1512 microversion: 2.1 time: 0.735006 Jun 20 12:22:08.808546 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2392/4880] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:08 2022] GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2 => generated 1512 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:08.872300 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-12b0d949-8676-4dfe-97b5-c587af27e65a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:08.891461 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-12b0d949-8676-4dfe-97b5-c587af27e65a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 200 len: 1562 microversion: 2.1 time: 0.316817 Jun 20 12:22:08.892815 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2489/4881] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:08 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 1562 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:22:08.933294 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-12c9ea8d-52b9-424c-8add-d30381f6771f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:08.934110 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-12c9ea8d-52b9-424c-8add-d30381f6771f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:08.948973 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:08.952738 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-12c9ea8d-52b9-424c-8add-d30381f6771f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:08.968712 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-12c9ea8d-52b9-424c-8add-d30381f6771f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:08.981420 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-12c9ea8d-52b9-424c-8add-d30381f6771f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:08.982609 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-12c9ea8d-52b9-424c-8add-d30381f6771f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:09.096760 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-aa0ce1f7-1e04-4d0b-8e39-5cdd5213d6d3 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:09.097557 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-aa0ce1f7-1e04-4d0b-8e39-5cdd5213d6d3 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: e54387d9-1cd6-4e8b-beb5-8011c1dcb19b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:09.120136 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa0ce1f7-1e04-4d0b-8e39-5cdd5213d6d3 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:09.120643 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa0ce1f7-1e04-4d0b-8e39-5cdd5213d6d3 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:09.121455 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa0ce1f7-1e04-4d0b-8e39-5cdd5213d6d3 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:09.121991 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa0ce1f7-1e04-4d0b-8e39-5cdd5213d6d3 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:09.785587 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-12c9ea8d-52b9-424c-8add-d30381f6771f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:09.802361 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-12c9ea8d-52b9-424c-8add-d30381f6771f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 200 len: 1562 microversion: 2.1 time: 0.895617 Jun 20 12:22:09.815617 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2393/4882] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:08 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 1562 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:09.821296 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e02de835-7b77-4f56-a618-ec4dc1154570 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:09.822122 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e02de835-7b77-4f56-a618-ec4dc1154570 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:09.830604 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e02de835-7b77-4f56-a618-ec4dc1154570 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:09.831192 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e02de835-7b77-4f56-a618-ec4dc1154570 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:09.832311 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e02de835-7b77-4f56-a618-ec4dc1154570 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:09.832974 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e02de835-7b77-4f56-a618-ec4dc1154570 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:09.876742 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-aa0ce1f7-1e04-4d0b-8e39-5cdd5213d6d3 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:09.888490 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-aa0ce1f7-1e04-4d0b-8e39-5cdd5213d6d3 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b" status: 200 len: 1334 microversion: 2.1 time: 0.806671 Jun 20 12:22:09.889105 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2490/4883] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:09 2022] GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b => generated 1334 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:09.895068 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-78c411e6-a2a8-44eb-9a42-63f0e7c340fb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:09.896968 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-78c411e6-a2a8-44eb-9a42-63f0e7c340fb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: f6cb9020-dfc5-4942-b757-10d3806dfdd2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:09.909797 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-78c411e6-a2a8-44eb-9a42-63f0e7c340fb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:09.910524 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-78c411e6-a2a8-44eb-9a42-63f0e7c340fb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:09.911962 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-78c411e6-a2a8-44eb-9a42-63f0e7c340fb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:09.912617 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-78c411e6-a2a8-44eb-9a42-63f0e7c340fb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:10.171051 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-78c411e6-a2a8-44eb-9a42-63f0e7c340fb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:10.180254 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-78c411e6-a2a8-44eb-9a42-63f0e7c340fb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2" status: 200 len: 1512 microversion: 2.1 time: 0.289728 Jun 20 12:22:10.181332 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2491/4884] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:09 2022] GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2 => generated 1512 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:10.242992 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e02de835-7b77-4f56-a618-ec4dc1154570 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:10.257672 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e02de835-7b77-4f56-a618-ec4dc1154570 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1678 microversion: 2.1 time: 0.440531 Jun 20 12:22:10.258864 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2394/4885] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:09 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1678 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:10.906353 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d380fb49-d4d3-4567-bc54-4e9161da10d0 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:10.907234 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d380fb49-d4d3-4567-bc54-4e9161da10d0 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: e54387d9-1cd6-4e8b-beb5-8011c1dcb19b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:10.915123 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d380fb49-d4d3-4567-bc54-4e9161da10d0 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:10.926189 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d380fb49-d4d3-4567-bc54-4e9161da10d0 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:10.927240 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d380fb49-d4d3-4567-bc54-4e9161da10d0 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:10.934032 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d380fb49-d4d3-4567-bc54-4e9161da10d0 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:11.207077 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-26b8e67b-3916-4816-9f2f-d3cb77ebf363 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:11.208110 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-26b8e67b-3916-4816-9f2f-d3cb77ebf363 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: f6cb9020-dfc5-4942-b757-10d3806dfdd2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:11.227753 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-26b8e67b-3916-4816-9f2f-d3cb77ebf363 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:11.230008 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-26b8e67b-3916-4816-9f2f-d3cb77ebf363 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:11.231712 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-26b8e67b-3916-4816-9f2f-d3cb77ebf363 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:11.236182 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-26b8e67b-3916-4816-9f2f-d3cb77ebf363 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:11.321421 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d380fb49-d4d3-4567-bc54-4e9161da10d0 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:11.331916 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d380fb49-d4d3-4567-bc54-4e9161da10d0 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b" status: 200 len: 1334 microversion: 2.1 time: 0.430087 Jun 20 12:22:11.334091 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2492/4886] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:10 2022] GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b => generated 1334 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:11.339604 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5b6005df-bc07-4d93-b9ca-03f6de476cfb tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:11.340573 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5b6005df-bc07-4d93-b9ca-03f6de476cfb tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:11.350102 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b6005df-bc07-4d93-b9ca-03f6de476cfb tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:11.350886 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b6005df-bc07-4d93-b9ca-03f6de476cfb tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:11.351913 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b6005df-bc07-4d93-b9ca-03f6de476cfb tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:11.352601 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b6005df-bc07-4d93-b9ca-03f6de476cfb tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:11.643787 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5b6005df-bc07-4d93-b9ca-03f6de476cfb tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:11.647279 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-26b8e67b-3916-4816-9f2f-d3cb77ebf363 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:11.653829 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5b6005df-bc07-4d93-b9ca-03f6de476cfb tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1678 microversion: 2.1 time: 0.317950 Jun 20 12:22:11.659892 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-26b8e67b-3916-4816-9f2f-d3cb77ebf363 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2" status: 200 len: 1512 microversion: 2.1 time: 0.465226 Jun 20 12:22:11.665690 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2493/4887] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:11 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1678 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:11.682660 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2395/4888] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:11 2022] GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2 => generated 1512 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:12.261068 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-4fff9937-f600-4ffa-ad16-3344bf12cf9d req-4205c993-9332-4c6f-9b74-216058264f1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e54387d9-1cd6-4e8b-beb5-8011c1dcb19b", "tag": "221756a6-1d5d-4141-a9d9-be565d5811a2"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:22:12.276438 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-4fff9937-f600-4ffa-ad16-3344bf12cf9d req-4205c993-9332-4c6f-9b74-216058264f1f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:12.276885 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-4fff9937-f600-4ffa-ad16-3344bf12cf9d req-4205c993-9332-4c6f-9b74-216058264f1f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:12.315066 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-4fff9937-f600-4ffa-ad16-3344bf12cf9d req-4205c993-9332-4c6f-9b74-216058264f1f service nova] Creating event network-changed:221756a6-1d5d-4141-a9d9-be565d5811a2 for instance e54387d9-1cd6-4e8b-beb5-8011c1dcb19b on n-h1-master-1 Jun 20 12:22:12.330733 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-4fff9937-f600-4ffa-ad16-3344bf12cf9d req-4205c993-9332-4c6f-9b74-216058264f1f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072326 Jun 20 12:22:12.331398 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2494/4889] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:22:12.359299 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-51924308-d1ef-47b6-aee4-13f657a9635a tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:12.361051 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-51924308-d1ef-47b6-aee4-13f657a9635a tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: e54387d9-1cd6-4e8b-beb5-8011c1dcb19b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:12.380009 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-51924308-d1ef-47b6-aee4-13f657a9635a tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:12.382157 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-51924308-d1ef-47b6-aee4-13f657a9635a tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:12.383271 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-51924308-d1ef-47b6-aee4-13f657a9635a tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:12.385585 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-51924308-d1ef-47b6-aee4-13f657a9635a tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:12.676351 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-83eed617-1594-4f40-8058-a908d5d7664b tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:12.677777 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-83eed617-1594-4f40-8058-a908d5d7664b tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:12.688334 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:12.696421 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:12.732785 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-83eed617-1594-4f40-8058-a908d5d7664b tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:12.732785 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-83eed617-1594-4f40-8058-a908d5d7664b tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:12.732785 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-83eed617-1594-4f40-8058-a908d5d7664b tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:12.739441 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-83eed617-1594-4f40-8058-a908d5d7664b tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:12.853941 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:13.025250 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-83eed617-1594-4f40-8058-a908d5d7664b tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:13.036728 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-83eed617-1594-4f40-8058-a908d5d7664b tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1678 microversion: 2.1 time: 0.367533 Jun 20 12:22:13.039176 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2495/4890] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:12 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1678 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:13.050556 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-832e0a37-3d22-4935-831a-7e07b5824389 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:13.051389 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-832e0a37-3d22-4935-831a-7e07b5824389 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: f6cb9020-dfc5-4942-b757-10d3806dfdd2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:13.060025 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-832e0a37-3d22-4935-831a-7e07b5824389 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:13.060888 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-832e0a37-3d22-4935-831a-7e07b5824389 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:13.062159 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-832e0a37-3d22-4935-831a-7e07b5824389 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:13.062774 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-832e0a37-3d22-4935-831a-7e07b5824389 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:13.312450 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-832e0a37-3d22-4935-831a-7e07b5824389 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:13.329219 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-832e0a37-3d22-4935-831a-7e07b5824389 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2" status: 200 len: 1512 microversion: 2.1 time: 0.286606 Jun 20 12:22:13.332225 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2496/4891] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:13 2022] GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2 => generated 1512 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:14.056193 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-06a9331e-ba16-4a89-bd02-97722e5ec985 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:14.057134 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-06a9331e-ba16-4a89-bd02-97722e5ec985 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:14.070685 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06a9331e-ba16-4a89-bd02-97722e5ec985 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:14.071126 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06a9331e-ba16-4a89-bd02-97722e5ec985 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:14.072444 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06a9331e-ba16-4a89-bd02-97722e5ec985 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:14.073211 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06a9331e-ba16-4a89-bd02-97722e5ec985 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:14.170453 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-51924308-d1ef-47b6-aee4-13f657a9635a tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:14.182072 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-51924308-d1ef-47b6-aee4-13f657a9635a tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b" status: 200 len: 1334 microversion: 2.1 time: 1.836075 Jun 20 12:22:14.182961 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2396/4892] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:12 2022] GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b => generated 1334 bytes in 1838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:14.357515 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a0b70bbc-01ee-4641-b679-5445941117c5 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:14.358140 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a0b70bbc-01ee-4641-b679-5445941117c5 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: f6cb9020-dfc5-4942-b757-10d3806dfdd2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:14.371898 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a0b70bbc-01ee-4641-b679-5445941117c5 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:14.372503 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a0b70bbc-01ee-4641-b679-5445941117c5 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:14.373305 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a0b70bbc-01ee-4641-b679-5445941117c5 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:14.373752 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a0b70bbc-01ee-4641-b679-5445941117c5 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:14.439849 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-06a9331e-ba16-4a89-bd02-97722e5ec985 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:14.454957 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-06a9331e-ba16-4a89-bd02-97722e5ec985 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1678 microversion: 2.1 time: 0.403563 Jun 20 12:22:14.466836 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2497/4893] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:14 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1678 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:14.875040 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a0b70bbc-01ee-4641-b679-5445941117c5 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:14.883999 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a0b70bbc-01ee-4641-b679-5445941117c5 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2" status: 200 len: 1512 microversion: 2.1 time: 0.530596 Jun 20 12:22:14.896395 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2397/4894] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:14 2022] GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2 => generated 1512 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:22:15.199561 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4931d4af-bbe7-4239-baa3-b4a87c4ffacd tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:15.200305 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4931d4af-bbe7-4239-baa3-b4a87c4ffacd tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: e54387d9-1cd6-4e8b-beb5-8011c1dcb19b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:15.221167 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4931d4af-bbe7-4239-baa3-b4a87c4ffacd tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:15.221630 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4931d4af-bbe7-4239-baa3-b4a87c4ffacd tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:15.222608 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4931d4af-bbe7-4239-baa3-b4a87c4ffacd tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:15.223238 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4931d4af-bbe7-4239-baa3-b4a87c4ffacd tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:15.473375 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b5292870-3896-4825-b880-480b4af126f8 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:15.474976 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b5292870-3896-4825-b880-480b4af126f8 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:15.503264 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b5292870-3896-4825-b880-480b4af126f8 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:15.504527 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b5292870-3896-4825-b880-480b4af126f8 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:15.506316 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b5292870-3896-4825-b880-480b4af126f8 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:15.507439 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b5292870-3896-4825-b880-480b4af126f8 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:15.749432 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4931d4af-bbe7-4239-baa3-b4a87c4ffacd tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:15.763220 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4931d4af-bbe7-4239-baa3-b4a87c4ffacd tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b" status: 200 len: 1334 microversion: 2.1 time: 0.568047 Jun 20 12:22:15.773609 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2498/4895] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:15 2022] GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b => generated 1334 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:15.918617 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e95f3570-7935-4e17-97e4-fd772fdd4625 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:15.919689 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e95f3570-7935-4e17-97e4-fd772fdd4625 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: f6cb9020-dfc5-4942-b757-10d3806dfdd2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:15.954324 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e95f3570-7935-4e17-97e4-fd772fdd4625 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:15.961018 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e95f3570-7935-4e17-97e4-fd772fdd4625 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:15.962538 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e95f3570-7935-4e17-97e4-fd772fdd4625 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:15.967676 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e95f3570-7935-4e17-97e4-fd772fdd4625 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:16.282389 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e95f3570-7935-4e17-97e4-fd772fdd4625 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:16.297797 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e95f3570-7935-4e17-97e4-fd772fdd4625 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2" status: 200 len: 1512 microversion: 2.1 time: 0.387311 Jun 20 12:22:16.298572 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2499/4896] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:15 2022] GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2 => generated 1512 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:22:16.351392 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b5292870-3896-4825-b880-480b4af126f8 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:16.366013 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b5292870-3896-4825-b880-480b4af126f8 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1678 microversion: 2.1 time: 0.893140 Jun 20 12:22:16.367850 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2398/4897] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:15 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1678 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:16.781547 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-75b41370-1fd6-465a-a977-d16400d9b1ba tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:16.782179 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-75b41370-1fd6-465a-a977-d16400d9b1ba tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: e54387d9-1cd6-4e8b-beb5-8011c1dcb19b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:16.803731 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-75b41370-1fd6-465a-a977-d16400d9b1ba tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:16.804217 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-75b41370-1fd6-465a-a977-d16400d9b1ba tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:16.805047 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-75b41370-1fd6-465a-a977-d16400d9b1ba tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:16.805495 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-75b41370-1fd6-465a-a977-d16400d9b1ba tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:17.168653 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-99f48fa1-84ce-4604-a2b6-94cdda0aa699 req-565b441e-dfb0-4df9-a7e1-dad7c59d9d8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e54387d9-1cd6-4e8b-beb5-8011c1dcb19b", "tag": "2482c346-6b79-4a36-87c9-da16ae715ce6"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:22:17.270791 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-99f48fa1-84ce-4604-a2b6-94cdda0aa699 req-565b441e-dfb0-4df9-a7e1-dad7c59d9d8e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:17.271471 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-99f48fa1-84ce-4604-a2b6-94cdda0aa699 req-565b441e-dfb0-4df9-a7e1-dad7c59d9d8e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:17.305918 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-99f48fa1-84ce-4604-a2b6-94cdda0aa699 req-565b441e-dfb0-4df9-a7e1-dad7c59d9d8e service nova] Creating event network-changed:2482c346-6b79-4a36-87c9-da16ae715ce6 for instance e54387d9-1cd6-4e8b-beb5-8011c1dcb19b on n-h1-master-1 Jun 20 12:22:17.321405 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-99f48fa1-84ce-4604-a2b6-94cdda0aa699 req-565b441e-dfb0-4df9-a7e1-dad7c59d9d8e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174599 Jun 20 12:22:17.322826 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2399/4898] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:22:17.330565 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-65da77e9-167e-41c5-9cd6-807c12773e16 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:17.331508 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-65da77e9-167e-41c5-9cd6-807c12773e16 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: f6cb9020-dfc5-4942-b757-10d3806dfdd2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:17.340522 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65da77e9-167e-41c5-9cd6-807c12773e16 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:17.341461 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65da77e9-167e-41c5-9cd6-807c12773e16 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:17.343634 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65da77e9-167e-41c5-9cd6-807c12773e16 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:17.344385 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65da77e9-167e-41c5-9cd6-807c12773e16 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:17.582108 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-75b41370-1fd6-465a-a977-d16400d9b1ba tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:17.603144 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-75b41370-1fd6-465a-a977-d16400d9b1ba tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b" status: 200 len: 1334 microversion: 2.1 time: 0.822741 Jun 20 12:22:17.606968 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2500/4899] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:16 2022] GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b => generated 1334 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:17.621498 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6916ceb7-7570-447e-967a-337e7b662880 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:17.625382 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6916ceb7-7570-447e-967a-337e7b662880 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:17.671505 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6916ceb7-7570-447e-967a-337e7b662880 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:17.675454 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6916ceb7-7570-447e-967a-337e7b662880 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:17.677243 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6916ceb7-7570-447e-967a-337e7b662880 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:17.679159 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6916ceb7-7570-447e-967a-337e7b662880 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:17.991350 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-65da77e9-167e-41c5-9cd6-807c12773e16 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:18.017232 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-65da77e9-167e-41c5-9cd6-807c12773e16 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2" status: 200 len: 1512 microversion: 2.1 time: 0.692881 Jun 20 12:22:18.018158 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2400/4900] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:17 2022] GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2 => generated 1512 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:18.030795 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b79a8b1d-8ccb-42d8-8b6c-98c28b929ce2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:18.031711 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b79a8b1d-8ccb-42d8-8b6c-98c28b929ce2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:18.048756 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b79a8b1d-8ccb-42d8-8b6c-98c28b929ce2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:18.049530 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b79a8b1d-8ccb-42d8-8b6c-98c28b929ce2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:18.050672 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b79a8b1d-8ccb-42d8-8b6c-98c28b929ce2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:18.051425 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b79a8b1d-8ccb-42d8-8b6c-98c28b929ce2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:18.452017 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6916ceb7-7570-447e-967a-337e7b662880 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:18.465903 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6916ceb7-7570-447e-967a-337e7b662880 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1655 microversion: 2.1 time: 0.856560 Jun 20 12:22:18.469747 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2501/4901] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:17 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1655 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:18.488173 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-740e80a4-75a4-41df-9c22-b034c554631a tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:22:18.501570 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-740e80a4-75a4-41df-9c22-b034c554631a tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:18.502440 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-740e80a4-75a4-41df-9c22-b034c554631a tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:18.522363 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:18.607609 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-740e80a4-75a4-41df-9c22-b034c554631a tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Going to try to start instance {{(pid=119127) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 20 12:22:18.775255 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-740e80a4-75a4-41df-9c22-b034c554631a tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "POST /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19/action" status: 202 len: 0 microversion: 2.1 time: 0.290980 Jun 20 12:22:18.786049 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2502/4902] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:22:18 2022] POST /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 12:22:18.815237 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-82dffd38-430b-4f0b-b358-d45798ca813a tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:18.819872 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-82dffd38-430b-4f0b-b358-d45798ca813a tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: e54387d9-1cd6-4e8b-beb5-8011c1dcb19b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:18.848439 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-82dffd38-430b-4f0b-b358-d45798ca813a tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:18.849856 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-82dffd38-430b-4f0b-b358-d45798ca813a tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:18.853339 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-82dffd38-430b-4f0b-b358-d45798ca813a tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:18.854007 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-82dffd38-430b-4f0b-b358-d45798ca813a tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:18.880627 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b79a8b1d-8ccb-42d8-8b6c-98c28b929ce2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:18.888908 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b79a8b1d-8ccb-42d8-8b6c-98c28b929ce2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 200 len: 1562 microversion: 2.1 time: 0.869638 Jun 20 12:22:18.905709 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2401/4903] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:18 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 1562 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:18.910926 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-23d007f4-6acf-4adb-b89a-035aeb861aa9 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:18.945295 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-23d007f4-6acf-4adb-b89a-035aeb861aa9 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:19.002398 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23d007f4-6acf-4adb-b89a-035aeb861aa9 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:19.004657 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23d007f4-6acf-4adb-b89a-035aeb861aa9 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:19.007322 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23d007f4-6acf-4adb-b89a-035aeb861aa9 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:19.011977 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23d007f4-6acf-4adb-b89a-035aeb861aa9 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:19.035383 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:19.879172 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-82dffd38-430b-4f0b-b358-d45798ca813a tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:19.900902 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-82dffd38-430b-4f0b-b358-d45798ca813a tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b" status: 200 len: 1334 microversion: 2.1 time: 1.110078 Jun 20 12:22:19.901609 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2503/4904] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:18 2022] GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b => generated 1334 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:19.907236 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ff2448a0-0c84-4e72-8be2-5395ccc76f58 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:19.908104 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ff2448a0-0c84-4e72-8be2-5395ccc76f58 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: f6cb9020-dfc5-4942-b757-10d3806dfdd2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:19.915359 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff2448a0-0c84-4e72-8be2-5395ccc76f58 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:19.917765 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff2448a0-0c84-4e72-8be2-5395ccc76f58 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:19.918818 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff2448a0-0c84-4e72-8be2-5395ccc76f58 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:19.919487 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff2448a0-0c84-4e72-8be2-5395ccc76f58 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:20.023088 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-23d007f4-6acf-4adb-b89a-035aeb861aa9 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:20.033436 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-23d007f4-6acf-4adb-b89a-035aeb861aa9 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1664 microversion: 2.1 time: 1.126513 Jun 20 12:22:20.034029 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2402/4905] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:18 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1664 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:20.048298 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-9da64568-d249-4a5e-a802-910a96205fb9 req-e2509888-4c0a-447b-94a5-aaa5186dbe8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25476e5c-8f10-449a-881b-2e9d9d1b2bfe", "tag": "d4cffb2a-b881-48b3-9739-58fc13501c0e"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:22:20.078525 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9da64568-d249-4a5e-a802-910a96205fb9 req-e2509888-4c0a-447b-94a5-aaa5186dbe8c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:20.080838 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9da64568-d249-4a5e-a802-910a96205fb9 req-e2509888-4c0a-447b-94a5-aaa5186dbe8c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:20.120411 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-9da64568-d249-4a5e-a802-910a96205fb9 req-e2509888-4c0a-447b-94a5-aaa5186dbe8c service nova] Creating event network-changed:d4cffb2a-b881-48b3-9739-58fc13501c0e for instance 25476e5c-8f10-449a-881b-2e9d9d1b2bfe on n-h1-master-1 Jun 20 12:22:20.140992 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-9da64568-d249-4a5e-a802-910a96205fb9 req-e2509888-4c0a-447b-94a5-aaa5186dbe8c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091619 Jun 20 12:22:20.142271 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2403/4906] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:22:20.362554 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ff2448a0-0c84-4e72-8be2-5395ccc76f58 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:20.371227 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ff2448a0-0c84-4e72-8be2-5395ccc76f58 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2" status: 200 len: 1512 microversion: 2.1 time: 0.468220 Jun 20 12:22:20.384012 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2504/4907] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:19 2022] GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2 => generated 1512 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:20.920051 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f0020c99-8be7-4974-b484-ebd1b1d83a1e tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:20.921007 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f0020c99-8be7-4974-b484-ebd1b1d83a1e tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: e54387d9-1cd6-4e8b-beb5-8011c1dcb19b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:20.941571 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f0020c99-8be7-4974-b484-ebd1b1d83a1e tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:20.941807 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f0020c99-8be7-4974-b484-ebd1b1d83a1e tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:20.942761 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f0020c99-8be7-4974-b484-ebd1b1d83a1e tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:20.943224 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f0020c99-8be7-4974-b484-ebd1b1d83a1e tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:21.056329 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-aedd92e1-c33b-4267-9abd-61c59041b1c1 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:21.058564 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-aedd92e1-c33b-4267-9abd-61c59041b1c1 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:21.077947 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:21.079894 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aedd92e1-c33b-4267-9abd-61c59041b1c1 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:21.080883 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aedd92e1-c33b-4267-9abd-61c59041b1c1 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:21.084737 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aedd92e1-c33b-4267-9abd-61c59041b1c1 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:21.085390 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aedd92e1-c33b-4267-9abd-61c59041b1c1 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:21.258920 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f0020c99-8be7-4974-b484-ebd1b1d83a1e tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:21.269007 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f0020c99-8be7-4974-b484-ebd1b1d83a1e tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b" status: 200 len: 1334 microversion: 2.1 time: 0.354887 Jun 20 12:22:21.269981 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2404/4908] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:20 2022] GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b => generated 1334 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:21.394196 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8c464111-4d7c-4a94-a2c9-7be92d1a8d44 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:21.395109 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8c464111-4d7c-4a94-a2c9-7be92d1a8d44 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: f6cb9020-dfc5-4942-b757-10d3806dfdd2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:21.414676 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8c464111-4d7c-4a94-a2c9-7be92d1a8d44 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:21.415399 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8c464111-4d7c-4a94-a2c9-7be92d1a8d44 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:21.416871 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8c464111-4d7c-4a94-a2c9-7be92d1a8d44 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:21.420190 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8c464111-4d7c-4a94-a2c9-7be92d1a8d44 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:21.510121 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-aedd92e1-c33b-4267-9abd-61c59041b1c1 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:21.520114 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-aedd92e1-c33b-4267-9abd-61c59041b1c1 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1664 microversion: 2.1 time: 0.470775 Jun 20 12:22:21.520986 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2505/4909] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:21 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1664 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:22:21.875763 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8c464111-4d7c-4a94-a2c9-7be92d1a8d44 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:21.888479 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8c464111-4d7c-4a94-a2c9-7be92d1a8d44 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2" status: 200 len: 1512 microversion: 2.1 time: 0.500120 Jun 20 12:22:21.899064 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2405/4910] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:21 2022] GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2 => generated 1512 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:22:22.287235 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1ca114cf-9bd0-4b8c-b957-4b24188ce487 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:22.288639 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1ca114cf-9bd0-4b8c-b957-4b24188ce487 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: e54387d9-1cd6-4e8b-beb5-8011c1dcb19b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:22.310829 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1ca114cf-9bd0-4b8c-b957-4b24188ce487 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:22.315626 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1ca114cf-9bd0-4b8c-b957-4b24188ce487 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:22.316776 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1ca114cf-9bd0-4b8c-b957-4b24188ce487 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:22.317230 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1ca114cf-9bd0-4b8c-b957-4b24188ce487 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:22.539698 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4c45c330-cf7e-45ca-91f9-50880c688486 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:22.540633 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4c45c330-cf7e-45ca-91f9-50880c688486 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:22.554382 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4c45c330-cf7e-45ca-91f9-50880c688486 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:22.554891 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4c45c330-cf7e-45ca-91f9-50880c688486 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:22.555801 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4c45c330-cf7e-45ca-91f9-50880c688486 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:22.556268 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4c45c330-cf7e-45ca-91f9-50880c688486 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:22.791428 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1ca114cf-9bd0-4b8c-b957-4b24188ce487 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:22.828752 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1ca114cf-9bd0-4b8c-b957-4b24188ce487 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b" status: 200 len: 1334 microversion: 2.1 time: 0.541714 Jun 20 12:22:22.842533 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2506/4911] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:22 2022] GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b => generated 1334 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:22:22.910995 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8ae018a2-9eb3-46bb-bc6a-1a4a1d3c1579 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:22.911864 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8ae018a2-9eb3-46bb-bc6a-1a4a1d3c1579 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: f6cb9020-dfc5-4942-b757-10d3806dfdd2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:22.948488 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8ae018a2-9eb3-46bb-bc6a-1a4a1d3c1579 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:22.948488 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8ae018a2-9eb3-46bb-bc6a-1a4a1d3c1579 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:22.954151 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8ae018a2-9eb3-46bb-bc6a-1a4a1d3c1579 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:22.954725 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8ae018a2-9eb3-46bb-bc6a-1a4a1d3c1579 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:23.152993 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4c45c330-cf7e-45ca-91f9-50880c688486 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:23.175241 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8ae018a2-9eb3-46bb-bc6a-1a4a1d3c1579 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:23.180053 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4c45c330-cf7e-45ca-91f9-50880c688486 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1668 microversion: 2.1 time: 0.643254 Jun 20 12:22:23.185166 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8ae018a2-9eb3-46bb-bc6a-1a4a1d3c1579 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2" status: 200 len: 1512 microversion: 2.1 time: 0.281933 Jun 20 12:22:23.186763 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2507/4912] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:22 2022] GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2 => generated 1512 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:23.195794 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2406/4913] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:22 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1668 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:23.851746 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8af0e9fa-1850-49e4-a6b1-94eac04c4922 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:23.852410 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8af0e9fa-1850-49e4-a6b1-94eac04c4922 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: e54387d9-1cd6-4e8b-beb5-8011c1dcb19b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:23.861604 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8af0e9fa-1850-49e4-a6b1-94eac04c4922 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:23.865738 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8af0e9fa-1850-49e4-a6b1-94eac04c4922 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:23.866993 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8af0e9fa-1850-49e4-a6b1-94eac04c4922 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:23.873763 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8af0e9fa-1850-49e4-a6b1-94eac04c4922 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:24.209080 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-38f0149d-6e8d-4571-9717-c5cc7379af80 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:24.210165 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8af0e9fa-1850-49e4-a6b1-94eac04c4922 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:24.212791 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-38f0149d-6e8d-4571-9717-c5cc7379af80 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: f6cb9020-dfc5-4942-b757-10d3806dfdd2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:24.221262 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8af0e9fa-1850-49e4-a6b1-94eac04c4922 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b" status: 200 len: 1334 microversion: 2.1 time: 0.375112 Jun 20 12:22:24.222897 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2508/4914] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:23 2022] GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b => generated 1334 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:24.237325 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-38f0149d-6e8d-4571-9717-c5cc7379af80 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:24.238067 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-38f0149d-6e8d-4571-9717-c5cc7379af80 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:24.239015 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-38f0149d-6e8d-4571-9717-c5cc7379af80 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:24.239732 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-38f0149d-6e8d-4571-9717-c5cc7379af80 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:24.542906 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-38f0149d-6e8d-4571-9717-c5cc7379af80 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:24.552983 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-38f0149d-6e8d-4571-9717-c5cc7379af80 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2" status: 200 len: 1512 microversion: 2.1 time: 0.351202 Jun 20 12:22:24.554171 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2407/4915] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:24 2022] GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2 => generated 1512 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:25.250561 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a7db003d-57b0-4d50-b527-abae3608aa89 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:25.251229 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a7db003d-57b0-4d50-b527-abae3608aa89 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: e54387d9-1cd6-4e8b-beb5-8011c1dcb19b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:25.258938 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a7db003d-57b0-4d50-b527-abae3608aa89 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:25.259849 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a7db003d-57b0-4d50-b527-abae3608aa89 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:25.260869 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a7db003d-57b0-4d50-b527-abae3608aa89 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:25.261942 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a7db003d-57b0-4d50-b527-abae3608aa89 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:25.438446 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a7db003d-57b0-4d50-b527-abae3608aa89 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:25.447066 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a7db003d-57b0-4d50-b527-abae3608aa89 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b" status: 200 len: 1334 microversion: 2.1 time: 0.200424 Jun 20 12:22:25.447777 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2509/4916] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:25 2022] GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b => generated 1334 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:25.578841 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cfb311c7-e4c1-455c-99ff-2cf940755dd0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:25.580169 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cfb311c7-e4c1-455c-99ff-2cf940755dd0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: f6cb9020-dfc5-4942-b757-10d3806dfdd2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:25.604040 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cfb311c7-e4c1-455c-99ff-2cf940755dd0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:25.604583 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cfb311c7-e4c1-455c-99ff-2cf940755dd0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:25.605382 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cfb311c7-e4c1-455c-99ff-2cf940755dd0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:25.607088 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cfb311c7-e4c1-455c-99ff-2cf940755dd0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:25.909186 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-cfb311c7-e4c1-455c-99ff-2cf940755dd0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:25.950092 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cfb311c7-e4c1-455c-99ff-2cf940755dd0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2" status: 200 len: 1512 microversion: 2.1 time: 0.372290 Jun 20 12:22:25.950092 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2408/4917] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:25 2022] GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2 => generated 1512 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:26.464980 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7170c8d5-afec-4737-bb4b-809b25f4cda6 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:26.465616 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7170c8d5-afec-4737-bb4b-809b25f4cda6 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: e54387d9-1cd6-4e8b-beb5-8011c1dcb19b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:26.486544 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7170c8d5-afec-4737-bb4b-809b25f4cda6 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:26.487013 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7170c8d5-afec-4737-bb4b-809b25f4cda6 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:26.487830 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7170c8d5-afec-4737-bb4b-809b25f4cda6 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:26.488311 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7170c8d5-afec-4737-bb4b-809b25f4cda6 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:26.966471 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-487e54d2-acf8-4dbb-9075-6f5614fea1e1 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:26.967290 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-487e54d2-acf8-4dbb-9075-6f5614fea1e1 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: f6cb9020-dfc5-4942-b757-10d3806dfdd2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:26.985458 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-487e54d2-acf8-4dbb-9075-6f5614fea1e1 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:26.985933 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-487e54d2-acf8-4dbb-9075-6f5614fea1e1 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:26.995551 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-487e54d2-acf8-4dbb-9075-6f5614fea1e1 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:26.996146 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-487e54d2-acf8-4dbb-9075-6f5614fea1e1 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:27.423714 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-487e54d2-acf8-4dbb-9075-6f5614fea1e1 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:27.433928 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-487e54d2-acf8-4dbb-9075-6f5614fea1e1 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2" status: 200 len: 1512 microversion: 2.1 time: 0.472349 Jun 20 12:22:27.435997 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2409/4918] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:26 2022] GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2 => generated 1512 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:27.450759 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-8ed9653d-a3eb-49b0-826b-f5b41393f101 req-c0feacb5-bca5-4b48-8000-4a05b6d8ab2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e54387d9-1cd6-4e8b-beb5-8011c1dcb19b", "name": "network-vif-plugged", "status": "completed", "tag": "2482c346-6b79-4a36-87c9-da16ae715ce6"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:22:27.461672 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-8ed9653d-a3eb-49b0-826b-f5b41393f101 req-c0feacb5-bca5-4b48-8000-4a05b6d8ab2f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:27.462986 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-8ed9653d-a3eb-49b0-826b-f5b41393f101 req-c0feacb5-bca5-4b48-8000-4a05b6d8ab2f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:27.482374 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-8ed9653d-a3eb-49b0-826b-f5b41393f101 req-c0feacb5-bca5-4b48-8000-4a05b6d8ab2f service nova] Creating event network-vif-plugged:2482c346-6b79-4a36-87c9-da16ae715ce6 for instance e54387d9-1cd6-4e8b-beb5-8011c1dcb19b on n-h1-master-1 Jun 20 12:22:27.489546 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-8ed9653d-a3eb-49b0-826b-f5b41393f101 req-c0feacb5-bca5-4b48-8000-4a05b6d8ab2f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051140 Jun 20 12:22:27.491050 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2410/4919] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:22:27.618814 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7170c8d5-afec-4737-bb4b-809b25f4cda6 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:27.627553 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7170c8d5-afec-4737-bb4b-809b25f4cda6 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b" status: 200 len: 1334 microversion: 2.1 time: 1.167394 Jun 20 12:22:27.632675 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2510/4920] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:26 2022] GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b => generated 1334 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:28.454413 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-88032f67-654f-413f-8839-409149059355 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:28.455285 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-88032f67-654f-413f-8839-409149059355 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: f6cb9020-dfc5-4942-b757-10d3806dfdd2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:28.474919 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88032f67-654f-413f-8839-409149059355 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:28.475404 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88032f67-654f-413f-8839-409149059355 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:28.476301 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88032f67-654f-413f-8839-409149059355 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:28.476791 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88032f67-654f-413f-8839-409149059355 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:28.654411 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-feca9e4f-cd96-462e-9473-1bfa491c472d tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:28.655040 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-feca9e4f-cd96-462e-9473-1bfa491c472d tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: e54387d9-1cd6-4e8b-beb5-8011c1dcb19b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:28.675308 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-feca9e4f-cd96-462e-9473-1bfa491c472d tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:28.675859 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-feca9e4f-cd96-462e-9473-1bfa491c472d tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:28.677175 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-feca9e4f-cd96-462e-9473-1bfa491c472d tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:28.677635 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-feca9e4f-cd96-462e-9473-1bfa491c472d tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:28.873713 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-88032f67-654f-413f-8839-409149059355 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:28.895514 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-88032f67-654f-413f-8839-409149059355 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2" status: 200 len: 1512 microversion: 2.1 time: 0.446633 Jun 20 12:22:28.898212 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2411/4921] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:28 2022] GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2 => generated 1512 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:29.006120 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-feca9e4f-cd96-462e-9473-1bfa491c472d tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:29.014836 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-feca9e4f-cd96-462e-9473-1bfa491c472d tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b" status: 200 len: 1334 microversion: 2.1 time: 0.365886 Jun 20 12:22:29.025045 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2511/4922] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:28 2022] GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b => generated 1334 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:22:29.548561 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-b1c2cfee-a49c-4f9c-a90d-d26540c44d09 req-9cfee6e7-3e35-4dd6-af96-c917957e0560 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e54387d9-1cd6-4e8b-beb5-8011c1dcb19b", "name": "network-vif-plugged", "status": "completed", "tag": "221756a6-1d5d-4141-a9d9-be565d5811a2"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:22:29.563076 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-b1c2cfee-a49c-4f9c-a90d-d26540c44d09 req-9cfee6e7-3e35-4dd6-af96-c917957e0560 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:29.583230 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-b1c2cfee-a49c-4f9c-a90d-d26540c44d09 req-9cfee6e7-3e35-4dd6-af96-c917957e0560 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:29.602091 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-b1c2cfee-a49c-4f9c-a90d-d26540c44d09 req-9cfee6e7-3e35-4dd6-af96-c917957e0560 service nova] Creating event network-vif-plugged:221756a6-1d5d-4141-a9d9-be565d5811a2 for instance e54387d9-1cd6-4e8b-beb5-8011c1dcb19b on n-h1-master-1 Jun 20 12:22:29.625733 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-b1c2cfee-a49c-4f9c-a90d-d26540c44d09 req-9cfee6e7-3e35-4dd6-af96-c917957e0560 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080725 Jun 20 12:22:29.628362 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2412/4923] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:22:29.917511 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e188a1ea-0e70-41fe-a53c-fb430afd2487 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:29.918862 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e188a1ea-0e70-41fe-a53c-fb430afd2487 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: f6cb9020-dfc5-4942-b757-10d3806dfdd2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:29.944082 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e188a1ea-0e70-41fe-a53c-fb430afd2487 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:29.945841 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e188a1ea-0e70-41fe-a53c-fb430afd2487 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:29.953747 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e188a1ea-0e70-41fe-a53c-fb430afd2487 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:29.957362 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e188a1ea-0e70-41fe-a53c-fb430afd2487 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:30.033716 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c08cc349-69c5-401a-814e-04a7983a364a tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:30.034529 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c08cc349-69c5-401a-814e-04a7983a364a tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: e54387d9-1cd6-4e8b-beb5-8011c1dcb19b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:30.054276 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c08cc349-69c5-401a-814e-04a7983a364a tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:30.059391 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c08cc349-69c5-401a-814e-04a7983a364a tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:30.062662 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c08cc349-69c5-401a-814e-04a7983a364a tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:30.064808 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c08cc349-69c5-401a-814e-04a7983a364a tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:30.432232 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c08cc349-69c5-401a-814e-04a7983a364a tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:30.440654 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c08cc349-69c5-401a-814e-04a7983a364a tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b" status: 200 len: 1334 microversion: 2.1 time: 0.412021 Jun 20 12:22:30.441245 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2413/4924] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:30 2022] GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b => generated 1334 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:22:30.495498 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e188a1ea-0e70-41fe-a53c-fb430afd2487 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:30.508321 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e188a1ea-0e70-41fe-a53c-fb430afd2487 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2" status: 200 len: 1512 microversion: 2.1 time: 0.597089 Jun 20 12:22:30.508985 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2512/4925] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:29 2022] GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2 => generated 1512 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:31.458936 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e461aae4-0b7d-490e-87a0-5bd4846fb013 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:31.460703 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e461aae4-0b7d-490e-87a0-5bd4846fb013 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: e54387d9-1cd6-4e8b-beb5-8011c1dcb19b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:31.469630 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e461aae4-0b7d-490e-87a0-5bd4846fb013 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:31.470893 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e461aae4-0b7d-490e-87a0-5bd4846fb013 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:31.472504 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e461aae4-0b7d-490e-87a0-5bd4846fb013 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:31.473184 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e461aae4-0b7d-490e-87a0-5bd4846fb013 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:31.527157 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-adb3f0d7-e622-4316-8114-964bbbb78cb7 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:31.528782 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-adb3f0d7-e622-4316-8114-964bbbb78cb7 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: f6cb9020-dfc5-4942-b757-10d3806dfdd2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:31.542317 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-adb3f0d7-e622-4316-8114-964bbbb78cb7 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:31.548218 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-adb3f0d7-e622-4316-8114-964bbbb78cb7 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:31.549624 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-adb3f0d7-e622-4316-8114-964bbbb78cb7 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:31.550301 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-adb3f0d7-e622-4316-8114-964bbbb78cb7 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:31.793114 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-adb3f0d7-e622-4316-8114-964bbbb78cb7 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:31.803094 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-adb3f0d7-e622-4316-8114-964bbbb78cb7 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2" status: 200 len: 1512 microversion: 2.1 time: 0.281112 Jun 20 12:22:31.803702 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2513/4926] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:31 2022] GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2 => generated 1512 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:22:31.822341 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-42772c94-bb13-4c8b-9993-2096c185d5b2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:22:31.828574 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-42772c94-bb13-4c8b-9993-2096c185d5b2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:31.854501 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-42772c94-bb13-4c8b-9993-2096c185d5b2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:31.854967 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-42772c94-bb13-4c8b-9993-2096c185d5b2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:31.863332 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-42772c94-bb13-4c8b-9993-2096c185d5b2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:31.863794 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-42772c94-bb13-4c8b-9993-2096c185d5b2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:31.920652 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e461aae4-0b7d-490e-87a0-5bd4846fb013 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:31.953120 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e461aae4-0b7d-490e-87a0-5bd4846fb013 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b" status: 200 len: 1670 microversion: 2.1 time: 0.499648 Jun 20 12:22:31.957533 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2414/4927] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:31 2022] GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b => generated 1670 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:31.976797 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-39d81ddf-9cfa-422f-a6c3-f540df1c8852 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:31.977367 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-39d81ddf-9cfa-422f-a6c3-f540df1c8852 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: e54387d9-1cd6-4e8b-beb5-8011c1dcb19b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:32.000495 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-39d81ddf-9cfa-422f-a6c3-f540df1c8852 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:32.000948 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-39d81ddf-9cfa-422f-a6c3-f540df1c8852 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:32.006414 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-39d81ddf-9cfa-422f-a6c3-f540df1c8852 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:32.010896 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-39d81ddf-9cfa-422f-a6c3-f540df1c8852 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:32.045668 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-42772c94-bb13-4c8b-9993-2096c185d5b2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "POST /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe/action" status: 200 len: 24571 microversion: 2.1 time: 0.239253 Jun 20 12:22:32.057102 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2514/4928] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:22:31 2022] POST /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe/action => generated 24571 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:22:32.067015 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-39d81ddf-9cfa-422f-a6c3-f540df1c8852 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b/ips" status: 200 len: 180 microversion: 2.1 time: 0.094179 Jun 20 12:22:32.068619 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2415/4929] 10.222.0.27 () {58 vars in 1247 bytes} [Mon Jun 20 12:22:31 2022] GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b/ips => generated 180 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:22:32.081171 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4916e7ef-accf-4401-b647-27e2f26eec38 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:32.082123 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4916e7ef-accf-4401-b647-27e2f26eec38 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: e54387d9-1cd6-4e8b-beb5-8011c1dcb19b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:32.093137 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4916e7ef-accf-4401-b647-27e2f26eec38 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:32.100063 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4916e7ef-accf-4401-b647-27e2f26eec38 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:32.101321 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4916e7ef-accf-4401-b647-27e2f26eec38 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:32.101774 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4916e7ef-accf-4401-b647-27e2f26eec38 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:32.143252 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4916e7ef-accf-4401-b647-27e2f26eec38 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: e54387d9-1cd6-4e8b-beb5-8011c1dcb19b] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:22:32.280681 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4916e7ef-accf-4401-b647-27e2f26eec38 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b" status: 204 len: 0 microversion: 2.1 time: 0.203281 Jun 20 12:22:32.281475 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2515/4930] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:22:32 2022] DELETE /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:22:32.291006 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e1f25533-f6ec-45ae-88b8-3d49cc14de65 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:32.291706 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e1f25533-f6ec-45ae-88b8-3d49cc14de65 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: e54387d9-1cd6-4e8b-beb5-8011c1dcb19b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:32.303458 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e1f25533-f6ec-45ae-88b8-3d49cc14de65 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:32.307450 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e1f25533-f6ec-45ae-88b8-3d49cc14de65 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:32.308676 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e1f25533-f6ec-45ae-88b8-3d49cc14de65 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:32.309483 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e1f25533-f6ec-45ae-88b8-3d49cc14de65 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:32.580861 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e1f25533-f6ec-45ae-88b8-3d49cc14de65 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:32.614568 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e1f25533-f6ec-45ae-88b8-3d49cc14de65 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b" status: 200 len: 1676 microversion: 2.1 time: 0.328124 Jun 20 12:22:32.617172 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2416/4931] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:32 2022] GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b => generated 1676 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:32.829488 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bd5f2d16-453e-4977-9d73-d98234c374ee tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:32.834082 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bd5f2d16-453e-4977-9d73-d98234c374ee tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: f6cb9020-dfc5-4942-b757-10d3806dfdd2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:32.860294 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bd5f2d16-453e-4977-9d73-d98234c374ee tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:32.861025 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bd5f2d16-453e-4977-9d73-d98234c374ee tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:32.862060 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bd5f2d16-453e-4977-9d73-d98234c374ee tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:32.864108 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bd5f2d16-453e-4977-9d73-d98234c374ee tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:32.902836 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:33.404925 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bd5f2d16-453e-4977-9d73-d98234c374ee tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:33.421466 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bd5f2d16-453e-4977-9d73-d98234c374ee tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2" status: 200 len: 1489 microversion: 2.1 time: 0.601162 Jun 20 12:22:33.426791 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2516/4932] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:32 2022] GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2 => generated 1489 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:22:33.447111 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fa778511-fa3a-4fbd-9be7-058fab160db1 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:22:33.448406 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fa778511-fa3a-4fbd-9be7-058fab160db1 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:33.458411 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fa778511-fa3a-4fbd-9be7-058fab160db1 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:33.459239 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fa778511-fa3a-4fbd-9be7-058fab160db1 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:33.461027 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fa778511-fa3a-4fbd-9be7-058fab160db1 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:33.488740 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fa778511-fa3a-4fbd-9be7-058fab160db1 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:33.586862 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fa778511-fa3a-4fbd-9be7-058fab160db1 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "POST /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/action" status: 200 len: 193 microversion: 2.1 time: 0.144218 Jun 20 12:22:33.594900 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2417/4933] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:22:33 2022] POST /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/action => generated 193 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:22:33.599549 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-284e8041-7d0a-46bd-b71d-d596f75dc9bd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:33.600262 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-284e8041-7d0a-46bd-b71d-d596f75dc9bd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:33.611633 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-284e8041-7d0a-46bd-b71d-d596f75dc9bd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:33.612334 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-284e8041-7d0a-46bd-b71d-d596f75dc9bd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:33.612931 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-284e8041-7d0a-46bd-b71d-d596f75dc9bd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:33.613381 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-284e8041-7d0a-46bd-b71d-d596f75dc9bd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:33.648118 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f95d0b0f-d634-460e-8b69-4dfacecc554d tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:33.649257 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f95d0b0f-d634-460e-8b69-4dfacecc554d tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: e54387d9-1cd6-4e8b-beb5-8011c1dcb19b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:33.667125 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f95d0b0f-d634-460e-8b69-4dfacecc554d tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:33.671864 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f95d0b0f-d634-460e-8b69-4dfacecc554d tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:33.673467 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f95d0b0f-d634-460e-8b69-4dfacecc554d tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:33.674113 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f95d0b0f-d634-460e-8b69-4dfacecc554d tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:33.996858 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-284e8041-7d0a-46bd-b71d-d596f75dc9bd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:34.025793 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-284e8041-7d0a-46bd-b71d-d596f75dc9bd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.429991 Jun 20 12:22:34.026381 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2517/4934] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:33 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:34.053525 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-df5e691f-c71d-49e8-a390-44c4b09d9b40 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:34.058118 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-df5e691f-c71d-49e8-a390-44c4b09d9b40 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:34.076081 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df5e691f-c71d-49e8-a390-44c4b09d9b40 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:34.077760 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df5e691f-c71d-49e8-a390-44c4b09d9b40 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:34.078876 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df5e691f-c71d-49e8-a390-44c4b09d9b40 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:34.081036 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df5e691f-c71d-49e8-a390-44c4b09d9b40 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:34.377863 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f95d0b0f-d634-460e-8b69-4dfacecc554d tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:34.387771 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f95d0b0f-d634-460e-8b69-4dfacecc554d tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b" status: 200 len: 1676 microversion: 2.1 time: 0.750492 Jun 20 12:22:34.405342 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2418/4935] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:33 2022] GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b => generated 1676 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:34.770166 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-df5e691f-c71d-49e8-a390-44c4b09d9b40 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:34.792985 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-df5e691f-c71d-49e8-a390-44c4b09d9b40 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.744469 Jun 20 12:22:34.800368 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2518/4936] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:34 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:34.814857 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dceb8782-09ee-4502-abcf-979f26b70a3b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:34.815677 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-dceb8782-09ee-4502-abcf-979f26b70a3b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:34.838397 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dceb8782-09ee-4502-abcf-979f26b70a3b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:34.839405 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dceb8782-09ee-4502-abcf-979f26b70a3b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:34.856516 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dceb8782-09ee-4502-abcf-979f26b70a3b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:34.864956 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dceb8782-09ee-4502-abcf-979f26b70a3b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:35.571445 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-d70e207b-83d2-4b05-8359-7ecd6ebcc954 req-63d43196-ba1d-414b-86d6-77bfd1bf7ecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e54387d9-1cd6-4e8b-beb5-8011c1dcb19b", "name": "network-vif-deleted", "tag": "2482c346-6b79-4a36-87c9-da16ae715ce6"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:22:35.586806 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-d70e207b-83d2-4b05-8359-7ecd6ebcc954 req-63d43196-ba1d-414b-86d6-77bfd1bf7ecd service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:35.589361 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-d70e207b-83d2-4b05-8359-7ecd6ebcc954 req-63d43196-ba1d-414b-86d6-77bfd1bf7ecd service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:35.604512 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-d70e207b-83d2-4b05-8359-7ecd6ebcc954 req-63d43196-ba1d-414b-86d6-77bfd1bf7ecd service nova] Creating event network-vif-deleted:2482c346-6b79-4a36-87c9-da16ae715ce6 for instance e54387d9-1cd6-4e8b-beb5-8011c1dcb19b on n-h1-master-1 Jun 20 12:22:35.610567 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-d70e207b-83d2-4b05-8359-7ecd6ebcc954 req-63d43196-ba1d-414b-86d6-77bfd1bf7ecd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.369618 Jun 20 12:22:35.611535 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2519/4937] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:22:35.617207 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-67327445-8301-4103-b0d7-86890d00d1a2 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:35.618385 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-67327445-8301-4103-b0d7-86890d00d1a2 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: e54387d9-1cd6-4e8b-beb5-8011c1dcb19b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:35.626536 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-67327445-8301-4103-b0d7-86890d00d1a2 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:35.627265 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-67327445-8301-4103-b0d7-86890d00d1a2 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:35.628333 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-67327445-8301-4103-b0d7-86890d00d1a2 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:35.629005 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-67327445-8301-4103-b0d7-86890d00d1a2 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:36.120051 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-dceb8782-09ee-4502-abcf-979f26b70a3b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:36.133406 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dceb8782-09ee-4502-abcf-979f26b70a3b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 1.323330 Jun 20 12:22:36.136152 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2419/4938] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:34 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:36.152987 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7bc7a858-028a-4c5f-94e6-49735023217a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:36.154035 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7bc7a858-028a-4c5f-94e6-49735023217a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:36.160094 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-67327445-8301-4103-b0d7-86890d00d1a2 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:36.169341 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-67327445-8301-4103-b0d7-86890d00d1a2 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b" status: 200 len: 1496 microversion: 2.1 time: 0.556314 Jun 20 12:22:36.173162 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7bc7a858-028a-4c5f-94e6-49735023217a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:36.176925 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7bc7a858-028a-4c5f-94e6-49735023217a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:36.178024 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7bc7a858-028a-4c5f-94e6-49735023217a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:36.178721 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7bc7a858-028a-4c5f-94e6-49735023217a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:36.190513 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2520/4939] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:35 2022] GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b => generated 1496 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:36.676050 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7bc7a858-028a-4c5f-94e6-49735023217a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:36.689609 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7bc7a858-028a-4c5f-94e6-49735023217a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.541921 Jun 20 12:22:36.691748 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2420/4940] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:36 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:36.936801 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1fc3ef80-c628-457f-827f-f313ee1630d6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1084852476", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "2b5ba955-3292-4f14-a644-c809260e0b34"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:22:37.058423 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-1fc3ef80-c628-457f-827f-f313ee1630d6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] validate_networks() for [('2b5ba955-3292-4f14-a644-c809260e0b34', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:22:37.192317 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-41419475-5a8a-4211-bea5-908244b2d9b7 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:37.193672 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-41419475-5a8a-4211-bea5-908244b2d9b7 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: e54387d9-1cd6-4e8b-beb5-8011c1dcb19b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:37.205961 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-41419475-5a8a-4211-bea5-908244b2d9b7 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:37.206884 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-41419475-5a8a-4211-bea5-908244b2d9b7 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:37.208639 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-41419475-5a8a-4211-bea5-908244b2d9b7 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:37.209533 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-41419475-5a8a-4211-bea5-908244b2d9b7 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:37.282528 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:37.312285 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-41419475-5a8a-4211-bea5-908244b2d9b7 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:37.313320 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-41419475-5a8a-4211-bea5-908244b2d9b7 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:37.313967 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-41419475-5a8a-4211-bea5-908244b2d9b7 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lazy-loading 'fault' on Instance uuid e54387d9-1cd6-4e8b-beb5-8011c1dcb19b {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:22:37.400872 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-41419475-5a8a-4211-bea5-908244b2d9b7 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8fa09acee6e4f9cb99c6e78e5b85589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0953197109e44d0496000c9535c8c583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:37.409701 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-41419475-5a8a-4211-bea5-908244b2d9b7 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b" status: 200 len: 1303 microversion: 2.1 time: 0.225191 Jun 20 12:22:37.411864 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2421/4941] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:37 2022] GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b => generated 1303 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:22:38.052569 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-1fc3ef80-c628-457f-827f-f313ee1630d6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:22:38.053727 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-1fc3ef80-c628-457f-827f-f313ee1630d6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:22:38.054449 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-1fc3ef80-c628-457f-827f-f313ee1630d6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:22:38.055386 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-1fc3ef80-c628-457f-827f-f313ee1630d6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:22:38.055982 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-1fc3ef80-c628-457f-827f-f313ee1630d6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:22:38.070128 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1fc3ef80-c628-457f-827f-f313ee1630d6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:38.072376 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1fc3ef80-c628-457f-827f-f313ee1630d6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:38.073597 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1fc3ef80-c628-457f-827f-f313ee1630d6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:38.074240 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1fc3ef80-c628-457f-827f-f313ee1630d6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:38.098247 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-1fc3ef80-c628-457f-827f-f313ee1630d6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Getting quotas for project 19236314583142029ffd7a1e04460cab. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:22:38.104991 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-1fc3ef80-c628-457f-827f-f313ee1630d6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Getting quotas for user 4ccd420e1ff744b99cb7e5650522e983 and project 19236314583142029ffd7a1e04460cab. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:22:38.120343 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1fc3ef80-c628-457f-827f-f313ee1630d6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:22:38.123210 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1fc3ef80-c628-457f-827f-f313ee1630d6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: b6e4b364-c9ac-4369-8b13-17ad4f918263] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:22:38.158054 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-dff8d792-b2aa-4df4-a158-aa23a501275e req-8fb52b2e-6447-46b9-97bb-2e814953d235 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e54387d9-1cd6-4e8b-beb5-8011c1dcb19b", "name": "network-vif-deleted", "tag": "221756a6-1d5d-4141-a9d9-be565d5811a2"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:22:38.184431 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-dff8d792-b2aa-4df4-a158-aa23a501275e req-8fb52b2e-6447-46b9-97bb-2e814953d235 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:38.189658 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-dff8d792-b2aa-4df4-a158-aa23a501275e req-8fb52b2e-6447-46b9-97bb-2e814953d235 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:38.203344 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1fc3ef80-c628-457f-827f-f313ee1630d6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.270365 Jun 20 12:22:38.215602 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2521/4942] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:22:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1283 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:22:38.219882 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-dff8d792-b2aa-4df4-a158-aa23a501275e req-8fb52b2e-6447-46b9-97bb-2e814953d235 service nova] Creating event network-vif-deleted:221756a6-1d5d-4141-a9d9-be565d5811a2 for instance e54387d9-1cd6-4e8b-beb5-8011c1dcb19b on n-h1-master-1 Jun 20 12:22:38.229140 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d4e2c480-3e1e-4b8e-925d-4108e4c1a34f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:38.230072 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d4e2c480-3e1e-4b8e-925d-4108e4c1a34f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: b6e4b364-c9ac-4369-8b13-17ad4f918263] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:38.239332 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-dff8d792-b2aa-4df4-a158-aa23a501275e req-8fb52b2e-6447-46b9-97bb-2e814953d235 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085483 Jun 20 12:22:38.252607 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2422/4943] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:22:38.356340 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d4e2c480-3e1e-4b8e-925d-4108e4c1a34f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:38.372282 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d4e2c480-3e1e-4b8e-925d-4108e4c1a34f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263" status: 200 len: 1215 microversion: 2.1 time: 0.151279 Jun 20 12:22:38.383847 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2522/4944] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:38 2022] GET /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263 => generated 1215 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:38.436368 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2e6fda0c-100d-4011-a45f-dad13b12efdb tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:38.437793 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2e6fda0c-100d-4011-a45f-dad13b12efdb tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: e54387d9-1cd6-4e8b-beb5-8011c1dcb19b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:38.462125 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2e6fda0c-100d-4011-a45f-dad13b12efdb tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:38.462826 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2e6fda0c-100d-4011-a45f-dad13b12efdb tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:38.470080 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2e6fda0c-100d-4011-a45f-dad13b12efdb tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:38.485211 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2e6fda0c-100d-4011-a45f-dad13b12efdb tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:38.520355 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-2e6fda0c-100d-4011-a45f-dad13b12efdb tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] HTTP exception thrown: Instance e54387d9-1cd6-4e8b-beb5-8011c1dcb19b could not be found. Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2e6fda0c-100d-4011-a45f-dad13b12efdb tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Request method failure captured: Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b HTTP/1.1 Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGYeoDCzSdXnAhbu37zieEBq01kcYOFYUIttikx00ee5xscSvPVcezLf3hcujSpSzVtib_YHINtSJa9dC6m6rwQGS7WQFUPUEPw46T1ErPigEOlrVg_uSnsnnnC5XdDLSs4vJ_xpDtx1AVPdT4p6t7LOR_BPD7OYPUaJY249UPvAw7A Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 0953197109e44d0496000c9535c8c583 Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersTestMultiNic-1921807450 Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0953197109e44d0496000c9535c8c583"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0953197109e44d0496000c9535c8c583"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0953197109e44d0496000c9535c8c583"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0953197109e44d0496000c9535c8c583"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersTestMultiNic-1921807450 Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 0953197109e44d0496000c9535c8c583 Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersTestMultiNic-1921807450 Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersTestMultiNic-1921807450-project Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: a8fa09acee6e4f9cb99c6e78e5b85589 Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersTestMultiNic-1921807450-project Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: exception: Instance e54387d9-1cd6-4e8b-beb5-8011c1dcb19b could not be found. Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'e54387d9-1cd6-4e8b-beb5-8011c1dcb19b'} Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e54387d9-1cd6-4e8b-beb5-8011c1dcb19b could not be found. Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e54387d9-1cd6-4e8b-beb5-8011c1dcb19b could not be found. Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:22:38.522675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:22:38.527414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:22:38.527414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:22:38.527414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:22:38.527414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:22:38.527414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:22:38.527414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e54387d9-1cd6-4e8b-beb5-8011c1dcb19b could not be found. Jun 20 12:22:38.527414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:22:38.530228 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2e6fda0c-100d-4011-a45f-dad13b12efdb tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Returning 404 to user: Instance e54387d9-1cd6-4e8b-beb5-8011c1dcb19b could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:22:38.531380 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2e6fda0c-100d-4011-a45f-dad13b12efdb tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b" status: 404 len: 111 microversion: 2.1 time: 0.105014 Jun 20 12:22:38.548412 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2423/4945] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:38 2022] GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:22:39.194859 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a3c24cbe-d5e7-4461-954e-f5133c8db03b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1888115327 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1888115327-project-admin] Calling method '.version_select at 0x7f607370e8b0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:39.195943 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:22:39.195943 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 12:22:39.197349 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a3c24cbe-d5e7-4461-954e-f5133c8db03b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1888115327 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1888115327-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:39.198100 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a3c24cbe-d5e7-4461-954e-f5133c8db03b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1888115327 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1888115327-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:39.242206 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a3c24cbe-d5e7-4461-954e-f5133c8db03b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1888115327 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1888115327-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:39.242824 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a3c24cbe-d5e7-4461-954e-f5133c8db03b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1888115327 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1888115327-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:39.278275 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a3c24cbe-d5e7-4461-954e-f5133c8db03b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1888115327 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1888115327-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:39.280444 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a3c24cbe-d5e7-4461-954e-f5133c8db03b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1888115327 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1888115327-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:39.294245 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a3c24cbe-d5e7-4461-954e-f5133c8db03b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1888115327 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1888115327-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.390601 Jun 20 12:22:39.298143 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2523/4946] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 12:22:38 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:22:39.405062 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7978e3df-d3e7-4616-8350-637ae2e3ae94 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:39.408122 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7978e3df-d3e7-4616-8350-637ae2e3ae94 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: b6e4b364-c9ac-4369-8b13-17ad4f918263] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:39.427120 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=64 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:39.430168 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7978e3df-d3e7-4616-8350-637ae2e3ae94 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:39.435033 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7978e3df-d3e7-4616-8350-637ae2e3ae94 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:39.436628 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7978e3df-d3e7-4616-8350-637ae2e3ae94 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:39.437376 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7978e3df-d3e7-4616-8350-637ae2e3ae94 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:39.652743 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7978e3df-d3e7-4616-8350-637ae2e3ae94 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:39.662840 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7978e3df-d3e7-4616-8350-637ae2e3ae94 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263" status: 200 len: 1211 microversion: 2.1 time: 0.275487 Jun 20 12:22:39.664213 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2424/4947] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:39 2022] GET /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263 => generated 1211 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:40.683438 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ed76ae19-db0a-4aa5-bdd0-09b765495bc3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:40.685002 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ed76ae19-db0a-4aa5-bdd0-09b765495bc3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: b6e4b364-c9ac-4369-8b13-17ad4f918263] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:40.698708 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ed76ae19-db0a-4aa5-bdd0-09b765495bc3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:40.699377 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ed76ae19-db0a-4aa5-bdd0-09b765495bc3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:40.700409 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ed76ae19-db0a-4aa5-bdd0-09b765495bc3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:40.701220 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ed76ae19-db0a-4aa5-bdd0-09b765495bc3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:40.939313 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ed76ae19-db0a-4aa5-bdd0-09b765495bc3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:40.953733 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ed76ae19-db0a-4aa5-bdd0-09b765495bc3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263" status: 200 len: 1273 microversion: 2.1 time: 0.275826 Jun 20 12:22:40.960705 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2524/4948] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:40 2022] GET /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263 => generated 1273 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:41.973223 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-008f999d-9c60-4c8f-81ad-eae4b445d711 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:41.974623 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-008f999d-9c60-4c8f-81ad-eae4b445d711 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: b6e4b364-c9ac-4369-8b13-17ad4f918263] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:41.983598 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-008f999d-9c60-4c8f-81ad-eae4b445d711 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:41.984400 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-008f999d-9c60-4c8f-81ad-eae4b445d711 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:41.985741 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-008f999d-9c60-4c8f-81ad-eae4b445d711 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:41.986367 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-008f999d-9c60-4c8f-81ad-eae4b445d711 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:42.190723 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-008f999d-9c60-4c8f-81ad-eae4b445d711 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:42.213745 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-008f999d-9c60-4c8f-81ad-eae4b445d711 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263" status: 200 len: 1273 microversion: 2.1 time: 0.238502 Jun 20 12:22:42.213745 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2425/4949] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:41 2022] GET /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263 => generated 1273 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:42.502723 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c1029cf2-156a-45ba-bbec-2cb1ed69e117 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:42.503221 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c1029cf2-156a-45ba-bbec-2cb1ed69e117 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: e54387d9-1cd6-4e8b-beb5-8011c1dcb19b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:42.510910 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c1029cf2-156a-45ba-bbec-2cb1ed69e117 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:42.511357 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c1029cf2-156a-45ba-bbec-2cb1ed69e117 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:42.512674 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c1029cf2-156a-45ba-bbec-2cb1ed69e117 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:42.513303 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c1029cf2-156a-45ba-bbec-2cb1ed69e117 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:42.535888 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-c1029cf2-156a-45ba-bbec-2cb1ed69e117 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] HTTP exception thrown: Instance e54387d9-1cd6-4e8b-beb5-8011c1dcb19b could not be found. Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c1029cf2-156a-45ba-bbec-2cb1ed69e117 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Request method failure captured: Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b HTTP/1.1 Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGYeoDCzSdXnAhbu37zieEBq01kcYOFYUIttikx00ee5xscSvPVcezLf3hcujSpSzVtib_YHINtSJa9dC6m6rwQGS7WQFUPUEPw46T1ErPigEOlrVg_uSnsnnnC5XdDLSs4vJ_xpDtx1AVPdT4p6t7LOR_BPD7OYPUaJY249UPvAw7A Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 0953197109e44d0496000c9535c8c583 Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersTestMultiNic-1921807450 Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0953197109e44d0496000c9535c8c583"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0953197109e44d0496000c9535c8c583"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0953197109e44d0496000c9535c8c583"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0953197109e44d0496000c9535c8c583"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersTestMultiNic-1921807450 Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 0953197109e44d0496000c9535c8c583 Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersTestMultiNic-1921807450 Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersTestMultiNic-1921807450-project Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: a8fa09acee6e4f9cb99c6e78e5b85589 Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersTestMultiNic-1921807450-project Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: exception: Instance e54387d9-1cd6-4e8b-beb5-8011c1dcb19b could not be found. Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'e54387d9-1cd6-4e8b-beb5-8011c1dcb19b'} Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e54387d9-1cd6-4e8b-beb5-8011c1dcb19b could not be found. Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:22:42.538178 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:22:42.543227 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e54387d9-1cd6-4e8b-beb5-8011c1dcb19b could not be found. Jun 20 12:22:42.543227 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:22:42.543227 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:22:42.543227 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:22:42.543227 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:22:42.543227 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:22:42.543227 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:22:42.543227 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:22:42.543227 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:22:42.543227 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e54387d9-1cd6-4e8b-beb5-8011c1dcb19b could not be found. Jun 20 12:22:42.543227 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:22:42.543227 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c1029cf2-156a-45ba-bbec-2cb1ed69e117 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Returning 404 to user: Instance e54387d9-1cd6-4e8b-beb5-8011c1dcb19b could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:22:42.544179 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c1029cf2-156a-45ba-bbec-2cb1ed69e117 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b" status: 404 len: 111 microversion: 2.1 time: 0.046114 Jun 20 12:22:42.544841 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2525/4950] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:22:42 2022] DELETE /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:22:42.554900 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-513fc456-a11f-43a1-9bff-47cc7bb94b6f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:42.556266 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-513fc456-a11f-43a1-9bff-47cc7bb94b6f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: e54387d9-1cd6-4e8b-beb5-8011c1dcb19b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:42.562410 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-513fc456-a11f-43a1-9bff-47cc7bb94b6f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:42.562883 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-513fc456-a11f-43a1-9bff-47cc7bb94b6f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:42.563664 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-513fc456-a11f-43a1-9bff-47cc7bb94b6f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:42.564087 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-513fc456-a11f-43a1-9bff-47cc7bb94b6f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:42.581446 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-513fc456-a11f-43a1-9bff-47cc7bb94b6f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] HTTP exception thrown: Instance e54387d9-1cd6-4e8b-beb5-8011c1dcb19b could not be found. Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-513fc456-a11f-43a1-9bff-47cc7bb94b6f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Request method failure captured: Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b HTTP/1.1 Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGYeoDCzSdXnAhbu37zieEBq01kcYOFYUIttikx00ee5xscSvPVcezLf3hcujSpSzVtib_YHINtSJa9dC6m6rwQGS7WQFUPUEPw46T1ErPigEOlrVg_uSnsnnnC5XdDLSs4vJ_xpDtx1AVPdT4p6t7LOR_BPD7OYPUaJY249UPvAw7A Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 0953197109e44d0496000c9535c8c583 Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersTestMultiNic-1921807450 Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0953197109e44d0496000c9535c8c583"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0953197109e44d0496000c9535c8c583"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0953197109e44d0496000c9535c8c583"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0953197109e44d0496000c9535c8c583"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersTestMultiNic-1921807450 Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 0953197109e44d0496000c9535c8c583 Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersTestMultiNic-1921807450 Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersTestMultiNic-1921807450-project Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: a8fa09acee6e4f9cb99c6e78e5b85589 Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersTestMultiNic-1921807450-project Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: exception: Instance e54387d9-1cd6-4e8b-beb5-8011c1dcb19b could not be found. Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'e54387d9-1cd6-4e8b-beb5-8011c1dcb19b'} Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e54387d9-1cd6-4e8b-beb5-8011c1dcb19b could not be found. Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e54387d9-1cd6-4e8b-beb5-8011c1dcb19b could not be found. Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:22:42.583189 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:22:42.587664 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:22:42.587664 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:22:42.587664 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:22:42.587664 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:22:42.587664 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:22:42.587664 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e54387d9-1cd6-4e8b-beb5-8011c1dcb19b could not be found. Jun 20 12:22:42.587664 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:22:42.587664 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-513fc456-a11f-43a1-9bff-47cc7bb94b6f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Returning 404 to user: Instance e54387d9-1cd6-4e8b-beb5-8011c1dcb19b could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:22:42.587664 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-513fc456-a11f-43a1-9bff-47cc7bb94b6f tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b" status: 404 len: 111 microversion: 2.1 time: 0.036692 Jun 20 12:22:42.596804 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2426/4951] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:42 2022] GET /compute/v2.1/servers/e54387d9-1cd6-4e8b-beb5-8011c1dcb19b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:22:42.606543 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fa4d5cf6-a86c-48c3-8864-a69b4dc60410 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:42.607441 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fa4d5cf6-a86c-48c3-8864-a69b4dc60410 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: 9ddb525a-a112-4b08-829e-406a30d2fb32] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:42.616056 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fa4d5cf6-a86c-48c3-8864-a69b4dc60410 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:42.616917 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fa4d5cf6-a86c-48c3-8864-a69b4dc60410 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:42.617975 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fa4d5cf6-a86c-48c3-8864-a69b4dc60410 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:42.618691 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fa4d5cf6-a86c-48c3-8864-a69b4dc60410 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:42.636458 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-fa4d5cf6-a86c-48c3-8864-a69b4dc60410 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] HTTP exception thrown: Instance 9ddb525a-a112-4b08-829e-406a30d2fb32 could not be found. Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fa4d5cf6-a86c-48c3-8864-a69b4dc60410 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Request method failure captured: Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32 HTTP/1.1 Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGYeoDCzSdXnAhbu37zieEBq01kcYOFYUIttikx00ee5xscSvPVcezLf3hcujSpSzVtib_YHINtSJa9dC6m6rwQGS7WQFUPUEPw46T1ErPigEOlrVg_uSnsnnnC5XdDLSs4vJ_xpDtx1AVPdT4p6t7LOR_BPD7OYPUaJY249UPvAw7A Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 0953197109e44d0496000c9535c8c583 Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersTestMultiNic-1921807450 Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0953197109e44d0496000c9535c8c583"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0953197109e44d0496000c9535c8c583"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0953197109e44d0496000c9535c8c583"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0953197109e44d0496000c9535c8c583"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersTestMultiNic-1921807450 Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 0953197109e44d0496000c9535c8c583 Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersTestMultiNic-1921807450 Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersTestMultiNic-1921807450-project Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: a8fa09acee6e4f9cb99c6e78e5b85589 Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersTestMultiNic-1921807450-project Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 9ddb525a-a112-4b08-829e-406a30d2fb32 could not be found. Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '9ddb525a-a112-4b08-829e-406a30d2fb32'} Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ddb525a-a112-4b08-829e-406a30d2fb32 could not be found. Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:22:42.638598 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:22:42.642685 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ddb525a-a112-4b08-829e-406a30d2fb32 could not be found. Jun 20 12:22:42.642685 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:22:42.642685 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:22:42.642685 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:22:42.642685 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:22:42.642685 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:22:42.642685 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:22:42.642685 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:22:42.642685 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:22:42.642685 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ddb525a-a112-4b08-829e-406a30d2fb32 could not be found. Jun 20 12:22:42.642685 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:22:42.645419 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fa4d5cf6-a86c-48c3-8864-a69b4dc60410 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Returning 404 to user: Instance 9ddb525a-a112-4b08-829e-406a30d2fb32 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:22:42.646794 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fa4d5cf6-a86c-48c3-8864-a69b4dc60410 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32" status: 404 len: 111 microversion: 2.1 time: 0.045117 Jun 20 12:22:42.647856 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2526/4952] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:22:42 2022] DELETE /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:22:42.657383 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4149fe67-056e-4a2e-bdbf-767050ba8871 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:42.658115 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4149fe67-056e-4a2e-bdbf-767050ba8871 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] [instance: 9ddb525a-a112-4b08-829e-406a30d2fb32] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:42.665771 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4149fe67-056e-4a2e-bdbf-767050ba8871 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:42.666292 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4149fe67-056e-4a2e-bdbf-767050ba8871 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:42.667355 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4149fe67-056e-4a2e-bdbf-767050ba8871 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:42.668018 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4149fe67-056e-4a2e-bdbf-767050ba8871 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:42.694632 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-4149fe67-056e-4a2e-bdbf-767050ba8871 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] HTTP exception thrown: Instance 9ddb525a-a112-4b08-829e-406a30d2fb32 could not be found. Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4149fe67-056e-4a2e-bdbf-767050ba8871 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Request method failure captured: Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32 HTTP/1.1 Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGYeoDCzSdXnAhbu37zieEBq01kcYOFYUIttikx00ee5xscSvPVcezLf3hcujSpSzVtib_YHINtSJa9dC6m6rwQGS7WQFUPUEPw46T1ErPigEOlrVg_uSnsnnnC5XdDLSs4vJ_xpDtx1AVPdT4p6t7LOR_BPD7OYPUaJY249UPvAw7A Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 0953197109e44d0496000c9535c8c583 Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersTestMultiNic-1921807450 Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0953197109e44d0496000c9535c8c583"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0953197109e44d0496000c9535c8c583"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0953197109e44d0496000c9535c8c583"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0953197109e44d0496000c9535c8c583"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersTestMultiNic-1921807450 Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 0953197109e44d0496000c9535c8c583 Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersTestMultiNic-1921807450 Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersTestMultiNic-1921807450-project Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: a8fa09acee6e4f9cb99c6e78e5b85589 Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersTestMultiNic-1921807450-project Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 9ddb525a-a112-4b08-829e-406a30d2fb32 could not be found. Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '9ddb525a-a112-4b08-829e-406a30d2fb32'} Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ddb525a-a112-4b08-829e-406a30d2fb32 could not be found. Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ddb525a-a112-4b08-829e-406a30d2fb32 could not be found. Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:22:42.696433 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:22:42.701299 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:22:42.701299 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:22:42.701299 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:22:42.701299 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:22:42.701299 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:22:42.701299 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ddb525a-a112-4b08-829e-406a30d2fb32 could not be found. Jun 20 12:22:42.701299 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:22:42.701299 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4149fe67-056e-4a2e-bdbf-767050ba8871 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] Returning 404 to user: Instance 9ddb525a-a112-4b08-829e-406a30d2fb32 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:22:42.701299 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4149fe67-056e-4a2e-bdbf-767050ba8871 tempest-ServersTestMultiNic-1921807450 tempest-ServersTestMultiNic-1921807450-project] 10.222.0.27 "GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32" status: 404 len: 111 microversion: 2.1 time: 0.045344 Jun 20 12:22:42.701299 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2427/4953] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:42 2022] GET /compute/v2.1/servers/9ddb525a-a112-4b08-829e-406a30d2fb32 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:22:43.092462 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3e6659bd-4969-40b8-a76b-4833947e44bd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:43.093029 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3e6659bd-4969-40b8-a76b-4833947e44bd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:43.103329 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e6659bd-4969-40b8-a76b-4833947e44bd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:43.103820 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e6659bd-4969-40b8-a76b-4833947e44bd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:43.104669 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e6659bd-4969-40b8-a76b-4833947e44bd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:43.105313 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e6659bd-4969-40b8-a76b-4833947e44bd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:43.225680 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b63a8fd5-d93b-4d1d-a3dd-33c308c5444f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:43.226524 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b63a8fd5-d93b-4d1d-a3dd-33c308c5444f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: b6e4b364-c9ac-4369-8b13-17ad4f918263] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:43.240659 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b63a8fd5-d93b-4d1d-a3dd-33c308c5444f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:43.246701 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b63a8fd5-d93b-4d1d-a3dd-33c308c5444f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:43.247802 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b63a8fd5-d93b-4d1d-a3dd-33c308c5444f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:43.248297 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b63a8fd5-d93b-4d1d-a3dd-33c308c5444f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:43.547542 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3e6659bd-4969-40b8-a76b-4833947e44bd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:43.558326 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3e6659bd-4969-40b8-a76b-4833947e44bd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 200 len: 1680 microversion: 2.1 time: 0.472642 Jun 20 12:22:43.567211 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2527/4954] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:43 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 1680 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:43.723785 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ad2ae33b-3fe9-4359-b6d4-825974092e3f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:22:43.724957 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ad2ae33b-3fe9-4359-b6d4-825974092e3f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:43.743632 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ad2ae33b-3fe9-4359-b6d4-825974092e3f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:43.747432 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ad2ae33b-3fe9-4359-b6d4-825974092e3f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:43.748733 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ad2ae33b-3fe9-4359-b6d4-825974092e3f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:43.750145 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ad2ae33b-3fe9-4359-b6d4-825974092e3f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:43.828782 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b63a8fd5-d93b-4d1d-a3dd-33c308c5444f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:43.833911 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ad2ae33b-3fe9-4359-b6d4-825974092e3f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "POST /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe/action" status: 200 len: 32643 microversion: 2.1 time: 0.116229 Jun 20 12:22:43.835023 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2528/4955] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:22:43 2022] POST /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe/action => generated 32643 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 12:22:43.843037 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b63a8fd5-d93b-4d1d-a3dd-33c308c5444f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263" status: 200 len: 1315 microversion: 2.1 time: 0.621312 Jun 20 12:22:43.843643 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2428/4956] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:43 2022] GET /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263 => generated 1315 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:22:44.035973 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7173398f-fb22-431a-80c5-d957477eb8c8 tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:44.036751 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7173398f-fb22-431a-80c5-d957477eb8c8 tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:44.051510 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7173398f-fb22-431a-80c5-d957477eb8c8 tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:44.052248 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7173398f-fb22-431a-80c5-d957477eb8c8 tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:44.053481 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7173398f-fb22-431a-80c5-d957477eb8c8 tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:44.054726 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7173398f-fb22-431a-80c5-d957477eb8c8 tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:44.397945 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7173398f-fb22-431a-80c5-d957477eb8c8 tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 200 len: 1831 microversion: 2.1 time: 0.366019 Jun 20 12:22:44.399665 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2529/4957] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:44 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 1831 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:44.426205 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0d43b3d7-0672-484d-8485-d284108401ad tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:22:44.428487 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0d43b3d7-0672-484d-8485-d284108401ad tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:44.437417 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d43b3d7-0672-484d-8485-d284108401ad tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:44.438506 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d43b3d7-0672-484d-8485-d284108401ad tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:44.439744 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d43b3d7-0672-484d-8485-d284108401ad tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:44.440416 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d43b3d7-0672-484d-8485-d284108401ad tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:44.500543 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-0d43b3d7-0672-484d-8485-d284108401ad tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Lazy-loading 'flavor' on Instance uuid 25476e5c-8f10-449a-881b-2e9d9d1b2bfe {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:22:44.535762 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0d43b3d7-0672-484d-8485-d284108401ad tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Going to try to live migrate instance to another host {{(pid=119128) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 20 12:22:44.859633 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-faf29728-7687-4a1f-b7c6-13b85d31e273 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:44.860286 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-faf29728-7687-4a1f-b7c6-13b85d31e273 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: b6e4b364-c9ac-4369-8b13-17ad4f918263] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:44.894114 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-faf29728-7687-4a1f-b7c6-13b85d31e273 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:44.898155 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-faf29728-7687-4a1f-b7c6-13b85d31e273 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:44.901931 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-faf29728-7687-4a1f-b7c6-13b85d31e273 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:44.905835 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-faf29728-7687-4a1f-b7c6-13b85d31e273 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:45.490118 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-faf29728-7687-4a1f-b7c6-13b85d31e273 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:45.503989 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-faf29728-7687-4a1f-b7c6-13b85d31e273 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263" status: 200 len: 1315 microversion: 2.1 time: 0.646191 Jun 20 12:22:45.515583 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2530/4958] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:44 2022] GET /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263 => generated 1315 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:22:45.786412 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-3d1a4fea-8d1d-49c0-bf25-f204e0c62d95 req-c0ac5cdb-ed04-4f54-9c14-853898363878 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6e4b364-c9ac-4369-8b13-17ad4f918263", "tag": "bf41a0e3-e699-4ba5-aa58-92c4bf5287b5"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:22:45.820815 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-3d1a4fea-8d1d-49c0-bf25-f204e0c62d95 req-c0ac5cdb-ed04-4f54-9c14-853898363878 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:45.821984 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-3d1a4fea-8d1d-49c0-bf25-f204e0c62d95 req-c0ac5cdb-ed04-4f54-9c14-853898363878 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:45.862642 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-3d1a4fea-8d1d-49c0-bf25-f204e0c62d95 req-c0ac5cdb-ed04-4f54-9c14-853898363878 service nova] Creating event network-changed:bf41a0e3-e699-4ba5-aa58-92c4bf5287b5 for instance b6e4b364-c9ac-4369-8b13-17ad4f918263 on n-h1-master-1 Jun 20 12:22:45.876046 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-3d1a4fea-8d1d-49c0-bf25-f204e0c62d95 req-c0ac5cdb-ed04-4f54-9c14-853898363878 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105673 Jun 20 12:22:45.877220 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2531/4959] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:22:46.521550 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d48082f8-86d9-49e8-89b8-6f2dc7e3e380 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:46.522729 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d48082f8-86d9-49e8-89b8-6f2dc7e3e380 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: b6e4b364-c9ac-4369-8b13-17ad4f918263] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:46.547939 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d48082f8-86d9-49e8-89b8-6f2dc7e3e380 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:46.551486 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d48082f8-86d9-49e8-89b8-6f2dc7e3e380 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:46.553840 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d48082f8-86d9-49e8-89b8-6f2dc7e3e380 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:46.556127 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d48082f8-86d9-49e8-89b8-6f2dc7e3e380 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:47.565062 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d48082f8-86d9-49e8-89b8-6f2dc7e3e380 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:47.585715 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d48082f8-86d9-49e8-89b8-6f2dc7e3e380 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263" status: 200 len: 1315 microversion: 2.1 time: 1.068652 Jun 20 12:22:47.590092 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2532/4960] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:46 2022] GET /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263 => generated 1315 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:22:48.549601 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0d43b3d7-0672-484d-8485-d284108401ad tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe/action" status: 202 len: 0 microversion: 2.1 time: 4.127766 Jun 20 12:22:48.551787 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2429/4961] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:22:44 2022] POST /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe/action => generated 0 bytes in 4131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:22:48.562718 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3e1ed64a-1904-401b-bcdc-901757cdfde5 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:48.563695 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3e1ed64a-1904-401b-bcdc-901757cdfde5 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:48.567724 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:48.569166 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=8 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:48.577040 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e1ed64a-1904-401b-bcdc-901757cdfde5 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:48.577498 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e1ed64a-1904-401b-bcdc-901757cdfde5 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:48.578282 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e1ed64a-1904-401b-bcdc-901757cdfde5 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:48.578726 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e1ed64a-1904-401b-bcdc-901757cdfde5 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:48.610113 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4cb855cf-5e67-4fff-95e8-8787fc6558ca tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:48.611195 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4cb855cf-5e67-4fff-95e8-8787fc6558ca tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: b6e4b364-c9ac-4369-8b13-17ad4f918263] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:48.621332 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4cb855cf-5e67-4fff-95e8-8787fc6558ca tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:48.622264 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4cb855cf-5e67-4fff-95e8-8787fc6558ca tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:48.624627 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4cb855cf-5e67-4fff-95e8-8787fc6558ca tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:48.625299 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4cb855cf-5e67-4fff-95e8-8787fc6558ca tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:49.259502 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4cb855cf-5e67-4fff-95e8-8787fc6558ca tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:49.278682 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4cb855cf-5e67-4fff-95e8-8787fc6558ca tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263" status: 200 len: 1315 microversion: 2.1 time: 0.674956 Jun 20 12:22:49.279264 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2430/4962] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:48 2022] GET /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263 => generated 1315 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:49.396689 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3e1ed64a-1904-401b-bcdc-901757cdfde5 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:49.411474 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3e1ed64a-1904-401b-bcdc-901757cdfde5 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 200 len: 1690 microversion: 2.1 time: 0.854018 Jun 20 12:22:49.413091 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2533/4963] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:48 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 1690 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:50.296563 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-87167995-d7da-4961-91fc-ffdb10c5bc27 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:50.298485 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-87167995-d7da-4961-91fc-ffdb10c5bc27 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: b6e4b364-c9ac-4369-8b13-17ad4f918263] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:50.317398 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-87167995-d7da-4961-91fc-ffdb10c5bc27 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:50.318219 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-87167995-d7da-4961-91fc-ffdb10c5bc27 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:50.319259 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-87167995-d7da-4961-91fc-ffdb10c5bc27 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:50.319960 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-87167995-d7da-4961-91fc-ffdb10c5bc27 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:50.432701 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2d61a33a-023b-476b-87db-576b47bfb6c3 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:50.433598 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2d61a33a-023b-476b-87db-576b47bfb6c3 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:50.444613 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2d61a33a-023b-476b-87db-576b47bfb6c3 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:50.444855 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2d61a33a-023b-476b-87db-576b47bfb6c3 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:50.446515 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2d61a33a-023b-476b-87db-576b47bfb6c3 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:50.446759 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2d61a33a-023b-476b-87db-576b47bfb6c3 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:50.621837 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-87167995-d7da-4961-91fc-ffdb10c5bc27 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:50.634952 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-87167995-d7da-4961-91fc-ffdb10c5bc27 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263" status: 200 len: 1315 microversion: 2.1 time: 0.342382 Jun 20 12:22:50.635767 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2431/4964] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:50 2022] GET /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263 => generated 1315 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:51.005886 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2d61a33a-023b-476b-87db-576b47bfb6c3 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:51.019118 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2d61a33a-023b-476b-87db-576b47bfb6c3 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 200 len: 1690 microversion: 2.1 time: 0.591242 Jun 20 12:22:51.020307 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2534/4965] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:50 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 1690 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:51.655083 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-56e79390-c2b7-4458-a9cc-fa9ebb47e0f1 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:51.656128 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-56e79390-c2b7-4458-a9cc-fa9ebb47e0f1 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: b6e4b364-c9ac-4369-8b13-17ad4f918263] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:51.676717 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-56e79390-c2b7-4458-a9cc-fa9ebb47e0f1 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:51.678356 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-56e79390-c2b7-4458-a9cc-fa9ebb47e0f1 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:51.680317 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-56e79390-c2b7-4458-a9cc-fa9ebb47e0f1 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:51.681373 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-56e79390-c2b7-4458-a9cc-fa9ebb47e0f1 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:52.028898 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-56e79390-c2b7-4458-a9cc-fa9ebb47e0f1 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:52.041113 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-335e885d-c7fb-4937-8511-7fb9cf5a5b7b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:52.042104 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-335e885d-c7fb-4937-8511-7fb9cf5a5b7b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:52.042362 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-56e79390-c2b7-4458-a9cc-fa9ebb47e0f1 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263" status: 200 len: 1315 microversion: 2.1 time: 0.393815 Jun 20 12:22:52.060139 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2432/4966] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:51 2022] GET /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263 => generated 1315 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:52.061896 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:52.078273 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-335e885d-c7fb-4937-8511-7fb9cf5a5b7b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:52.078979 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-335e885d-c7fb-4937-8511-7fb9cf5a5b7b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:52.080318 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-335e885d-c7fb-4937-8511-7fb9cf5a5b7b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:52.081399 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-335e885d-c7fb-4937-8511-7fb9cf5a5b7b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:52.463787 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-335e885d-c7fb-4937-8511-7fb9cf5a5b7b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:52.479608 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-335e885d-c7fb-4937-8511-7fb9cf5a5b7b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 200 len: 1690 microversion: 2.1 time: 0.442875 Jun 20 12:22:52.482310 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2535/4967] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:52 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 1690 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:53.088921 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-22f55882-4525-4e17-943d-19a37f1bc42e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:53.096469 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-22f55882-4525-4e17-943d-19a37f1bc42e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: b6e4b364-c9ac-4369-8b13-17ad4f918263] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:53.120310 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-22f55882-4525-4e17-943d-19a37f1bc42e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:53.131078 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-22f55882-4525-4e17-943d-19a37f1bc42e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:53.132277 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-22f55882-4525-4e17-943d-19a37f1bc42e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:53.132802 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-22f55882-4525-4e17-943d-19a37f1bc42e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:53.188602 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-4370b28c-d147-4086-81ed-7cfa96c04a45 req-4060e148-2090-48ee-98eb-cea877983025 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25476e5c-8f10-449a-881b-2e9d9d1b2bfe", "name": "network-vif-unplugged", "status": "completed", "tag": "d4cffb2a-b881-48b3-9739-58fc13501c0e"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:22:53.212565 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-4370b28c-d147-4086-81ed-7cfa96c04a45 req-4060e148-2090-48ee-98eb-cea877983025 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:53.218119 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-4370b28c-d147-4086-81ed-7cfa96c04a45 req-4060e148-2090-48ee-98eb-cea877983025 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:53.247896 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-4370b28c-d147-4086-81ed-7cfa96c04a45 req-4060e148-2090-48ee-98eb-cea877983025 service nova] Creating event network-vif-unplugged:d4cffb2a-b881-48b3-9739-58fc13501c0e for instance 25476e5c-8f10-449a-881b-2e9d9d1b2bfe on n-h1-master-1 Jun 20 12:22:53.263329 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-4370b28c-d147-4086-81ed-7cfa96c04a45 req-4060e148-2090-48ee-98eb-cea877983025 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.487828 Jun 20 12:22:53.268508 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2433/4968] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:22:53.488529 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-87630547-7d48-4d70-bcc0-c94db65cd7ce req-32855b56-b17e-4995-a3a8-575df11a2091 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6e4b364-c9ac-4369-8b13-17ad4f918263", "name": "network-vif-plugged", "status": "completed", "tag": "bf41a0e3-e699-4ba5-aa58-92c4bf5287b5"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:22:53.504840 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-87630547-7d48-4d70-bcc0-c94db65cd7ce req-32855b56-b17e-4995-a3a8-575df11a2091 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:53.505986 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-87630547-7d48-4d70-bcc0-c94db65cd7ce req-32855b56-b17e-4995-a3a8-575df11a2091 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:53.523104 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-87630547-7d48-4d70-bcc0-c94db65cd7ce req-32855b56-b17e-4995-a3a8-575df11a2091 service nova] Creating event network-vif-plugged:bf41a0e3-e699-4ba5-aa58-92c4bf5287b5 for instance b6e4b364-c9ac-4369-8b13-17ad4f918263 on n-h1-master-1 Jun 20 12:22:53.533721 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-87630547-7d48-4d70-bcc0-c94db65cd7ce req-32855b56-b17e-4995-a3a8-575df11a2091 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198464 Jun 20 12:22:53.535847 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2434/4969] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:22:53.545370 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-34949779-297e-4893-82fc-e6ce29cffaab tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:53.546700 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-34949779-297e-4893-82fc-e6ce29cffaab tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:53.554663 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-34949779-297e-4893-82fc-e6ce29cffaab tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:53.556378 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-34949779-297e-4893-82fc-e6ce29cffaab tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:53.557512 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-34949779-297e-4893-82fc-e6ce29cffaab tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:53.558318 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-34949779-297e-4893-82fc-e6ce29cffaab tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:53.805677 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-22f55882-4525-4e17-943d-19a37f1bc42e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:53.813650 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-22f55882-4525-4e17-943d-19a37f1bc42e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263" status: 200 len: 1315 microversion: 2.1 time: 0.750487 Jun 20 12:22:53.816465 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2536/4970] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:53 2022] GET /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263 => generated 1315 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:54.747852 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-34949779-297e-4893-82fc-e6ce29cffaab tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:54.765897 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-34949779-297e-4893-82fc-e6ce29cffaab tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 200 len: 1690 microversion: 2.1 time: 1.227763 Jun 20 12:22:54.766801 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2435/4971] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:53 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 1690 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:54.833154 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f296dddd-6af6-41a3-ae16-c32b3813b2ad tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:54.833935 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f296dddd-6af6-41a3-ae16-c32b3813b2ad tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: b6e4b364-c9ac-4369-8b13-17ad4f918263] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:54.851148 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f296dddd-6af6-41a3-ae16-c32b3813b2ad tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:54.852066 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f296dddd-6af6-41a3-ae16-c32b3813b2ad tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:54.853175 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f296dddd-6af6-41a3-ae16-c32b3813b2ad tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:54.853838 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f296dddd-6af6-41a3-ae16-c32b3813b2ad tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:55.251617 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f296dddd-6af6-41a3-ae16-c32b3813b2ad tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:55.258455 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:55.261139 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f296dddd-6af6-41a3-ae16-c32b3813b2ad tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263" status: 200 len: 1315 microversion: 2.1 time: 0.432036 Jun 20 12:22:55.265474 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2537/4972] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:54 2022] GET /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263 => generated 1315 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:55.329963 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-419d4921-503d-419a-b2bb-167a4673f2e4 req-5f2f1c02-a8f0-4a18-8d7b-f4272e7edf2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25476e5c-8f10-449a-881b-2e9d9d1b2bfe", "tag": "d4cffb2a-b881-48b3-9739-58fc13501c0e"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:22:55.344239 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-419d4921-503d-419a-b2bb-167a4673f2e4 req-5f2f1c02-a8f0-4a18-8d7b-f4272e7edf2b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:55.344685 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-419d4921-503d-419a-b2bb-167a4673f2e4 req-5f2f1c02-a8f0-4a18-8d7b-f4272e7edf2b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:55.391512 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-419d4921-503d-419a-b2bb-167a4673f2e4 req-5f2f1c02-a8f0-4a18-8d7b-f4272e7edf2b service nova] Creating event network-changed:d4cffb2a-b881-48b3-9739-58fc13501c0e for instance 25476e5c-8f10-449a-881b-2e9d9d1b2bfe on n-h1-master-1 Jun 20 12:22:55.409208 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-419d4921-503d-419a-b2bb-167a4673f2e4 req-5f2f1c02-a8f0-4a18-8d7b-f4272e7edf2b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083252 Jun 20 12:22:55.411443 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2436/4973] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:22:55.786879 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-105e9e8e-8a8d-492a-8cfd-8545f2835d1f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:55.787950 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-105e9e8e-8a8d-492a-8cfd-8545f2835d1f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:55.804873 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-105e9e8e-8a8d-492a-8cfd-8545f2835d1f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:55.806033 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-105e9e8e-8a8d-492a-8cfd-8545f2835d1f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:55.807647 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-105e9e8e-8a8d-492a-8cfd-8545f2835d1f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:55.810786 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-105e9e8e-8a8d-492a-8cfd-8545f2835d1f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:56.286318 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-399e929e-01be-4e4d-9c2b-438ac0a7e575 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:56.289168 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-399e929e-01be-4e4d-9c2b-438ac0a7e575 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: b6e4b364-c9ac-4369-8b13-17ad4f918263] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:56.307116 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-399e929e-01be-4e4d-9c2b-438ac0a7e575 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:56.307869 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-399e929e-01be-4e4d-9c2b-438ac0a7e575 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:56.310276 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-399e929e-01be-4e4d-9c2b-438ac0a7e575 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:56.310895 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-399e929e-01be-4e4d-9c2b-438ac0a7e575 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:56.437828 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-105e9e8e-8a8d-492a-8cfd-8545f2835d1f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:56.451123 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-105e9e8e-8a8d-492a-8cfd-8545f2835d1f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 200 len: 1690 microversion: 2.1 time: 0.670510 Jun 20 12:22:56.456251 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2538/4974] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:55 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 1690 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:57.028374 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-399e929e-01be-4e4d-9c2b-438ac0a7e575 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:57.037359 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-399e929e-01be-4e4d-9c2b-438ac0a7e575 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263" status: 200 len: 1503 microversion: 2.1 time: 0.758025 Jun 20 12:22:57.059621 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2437/4975] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:56 2022] GET /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263 => generated 1503 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:57.071273 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9a3391ec-44d2-489c-ad84-902572a024cd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:22:57.073177 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9a3391ec-44d2-489c-ad84-902572a024cd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: b6e4b364-c9ac-4369-8b13-17ad4f918263] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:57.122288 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a3391ec-44d2-489c-ad84-902572a024cd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:57.130058 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a3391ec-44d2-489c-ad84-902572a024cd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:57.134932 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a3391ec-44d2-489c-ad84-902572a024cd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:57.141975 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a3391ec-44d2-489c-ad84-902572a024cd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:57.314808 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9a3391ec-44d2-489c-ad84-902572a024cd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "POST /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263/action" status: 200 len: 14 microversion: 2.1 time: 0.248918 Jun 20 12:22:57.320857 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2539/4976] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:22:57 2022] POST /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263/action => generated 14 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:22:57.470215 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2691c125-1c9b-44a3-85ee-d533496dab67 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:57.470900 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2691c125-1c9b-44a3-85ee-d533496dab67 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:57.493732 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2691c125-1c9b-44a3-85ee-d533496dab67 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:57.495233 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2691c125-1c9b-44a3-85ee-d533496dab67 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:57.496924 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2691c125-1c9b-44a3-85ee-d533496dab67 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:57.503383 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2691c125-1c9b-44a3-85ee-d533496dab67 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:57.978608 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2691c125-1c9b-44a3-85ee-d533496dab67 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:57.989822 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2691c125-1c9b-44a3-85ee-d533496dab67 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 200 len: 1690 microversion: 2.1 time: 0.524701 Jun 20 12:22:57.990790 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2438/4977] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:57 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 1690 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:58.326871 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7ce284b4-3211-49b1-912a-d926751b38a2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:22:58.335476 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7ce284b4-3211-49b1-912a-d926751b38a2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: b6e4b364-c9ac-4369-8b13-17ad4f918263] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:58.348568 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ce284b4-3211-49b1-912a-d926751b38a2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:58.352308 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ce284b4-3211-49b1-912a-d926751b38a2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:58.354882 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ce284b4-3211-49b1-912a-d926751b38a2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:58.356330 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ce284b4-3211-49b1-912a-d926751b38a2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:58.493743 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7ce284b4-3211-49b1-912a-d926751b38a2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "POST /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263/action" status: 200 len: 14 microversion: 2.1 time: 0.170982 Jun 20 12:22:58.498161 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2540/4978] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:22:58 2022] POST /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263/action => generated 14 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:22:59.008554 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5a65c026-ccc3-4364-abbd-5d887262a5e1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:59.011697 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5a65c026-ccc3-4364-abbd-5d887262a5e1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:59.057008 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a65c026-ccc3-4364-abbd-5d887262a5e1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:59.059644 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a65c026-ccc3-4364-abbd-5d887262a5e1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:59.067113 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a65c026-ccc3-4364-abbd-5d887262a5e1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:59.067751 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a65c026-ccc3-4364-abbd-5d887262a5e1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:59.516133 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-86e9d0c1-8e52-41a5-9ec8-0613e388b3be tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:22:59.521760 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-86e9d0c1-8e52-41a5-9ec8-0613e388b3be tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: b6e4b364-c9ac-4369-8b13-17ad4f918263] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:22:59.567921 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86e9d0c1-8e52-41a5-9ec8-0613e388b3be tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:59.572941 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86e9d0c1-8e52-41a5-9ec8-0613e388b3be tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:59.577713 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86e9d0c1-8e52-41a5-9ec8-0613e388b3be tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:59.578193 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5a65c026-ccc3-4364-abbd-5d887262a5e1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:22:59.579282 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86e9d0c1-8e52-41a5-9ec8-0613e388b3be tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:59.590246 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5a65c026-ccc3-4364-abbd-5d887262a5e1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 200 len: 1690 microversion: 2.1 time: 0.586104 Jun 20 12:22:59.594265 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2439/4979] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:22:59 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 1690 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:22:59.674389 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-86e9d0c1-8e52-41a5-9ec8-0613e388b3be tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "POST /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263/action" status: 200 len: 14 microversion: 2.1 time: 0.170120 Jun 20 12:22:59.676380 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2541/4980] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:22:59 2022] POST /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263/action => generated 14 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:23:00.613644 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-66d770fb-0fb0-4fdb-bb3c-b3c17a7a3664 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:00.617692 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-66d770fb-0fb0-4fdb-bb3c-b3c17a7a3664 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:00.629349 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-66d770fb-0fb0-4fdb-bb3c-b3c17a7a3664 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:00.634759 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-66d770fb-0fb0-4fdb-bb3c-b3c17a7a3664 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:00.638113 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-66d770fb-0fb0-4fdb-bb3c-b3c17a7a3664 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:00.638776 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-66d770fb-0fb0-4fdb-bb3c-b3c17a7a3664 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:00.692389 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-969b6dc7-cd0f-4a9a-a11e-961df41adbf7 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:00.694150 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-969b6dc7-cd0f-4a9a-a11e-961df41adbf7 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: b6e4b364-c9ac-4369-8b13-17ad4f918263] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:00.745149 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-969b6dc7-cd0f-4a9a-a11e-961df41adbf7 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:00.750866 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-969b6dc7-cd0f-4a9a-a11e-961df41adbf7 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:00.760703 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-969b6dc7-cd0f-4a9a-a11e-961df41adbf7 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:00.761672 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-969b6dc7-cd0f-4a9a-a11e-961df41adbf7 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:00.887850 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-969b6dc7-cd0f-4a9a-a11e-961df41adbf7 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "POST /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263/action" status: 200 len: 14 microversion: 2.1 time: 0.202531 Jun 20 12:23:00.890180 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2542/4981] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:23:00 2022] POST /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263/action => generated 14 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:23:01.254388 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-66d770fb-0fb0-4fdb-bb3c-b3c17a7a3664 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:01.260271 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:01.272632 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-66d770fb-0fb0-4fdb-bb3c-b3c17a7a3664 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 200 len: 1690 microversion: 2.1 time: 0.663255 Jun 20 12:23:01.288605 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2440/4982] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:00 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 1690 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:01.901439 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f3ff8f6f-6ce2-49ad-a3ab-5a7416141246 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:01.902504 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f3ff8f6f-6ce2-49ad-a3ab-5a7416141246 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: b6e4b364-c9ac-4369-8b13-17ad4f918263] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:01.916216 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f3ff8f6f-6ce2-49ad-a3ab-5a7416141246 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:01.919674 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f3ff8f6f-6ce2-49ad-a3ab-5a7416141246 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:01.923873 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f3ff8f6f-6ce2-49ad-a3ab-5a7416141246 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:01.928739 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f3ff8f6f-6ce2-49ad-a3ab-5a7416141246 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:02.037398 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f3ff8f6f-6ce2-49ad-a3ab-5a7416141246 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "POST /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263/action" status: 200 len: 14 microversion: 2.1 time: 0.139113 Jun 20 12:23:02.038931 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2543/4983] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:23:01 2022] POST /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:23:02.291207 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-02af1ac7-56c3-42aa-9aa1-8cf566541449 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:02.302523 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-02af1ac7-56c3-42aa-9aa1-8cf566541449 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:02.323463 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-02af1ac7-56c3-42aa-9aa1-8cf566541449 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:02.324052 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-02af1ac7-56c3-42aa-9aa1-8cf566541449 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:02.326963 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-02af1ac7-56c3-42aa-9aa1-8cf566541449 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:02.330325 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-02af1ac7-56c3-42aa-9aa1-8cf566541449 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:02.960837 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-02af1ac7-56c3-42aa-9aa1-8cf566541449 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:02.993256 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-02af1ac7-56c3-42aa-9aa1-8cf566541449 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 200 len: 1690 microversion: 2.1 time: 0.707422 Jun 20 12:23:02.994652 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2441/4984] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:02 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 1690 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:03.050966 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9c8939da-f546-4630-b9b0-a7edf95e72b1 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:03.051990 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9c8939da-f546-4630-b9b0-a7edf95e72b1 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: b6e4b364-c9ac-4369-8b13-17ad4f918263] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:03.089708 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9c8939da-f546-4630-b9b0-a7edf95e72b1 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:03.092618 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9c8939da-f546-4630-b9b0-a7edf95e72b1 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:03.093410 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9c8939da-f546-4630-b9b0-a7edf95e72b1 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:03.095993 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9c8939da-f546-4630-b9b0-a7edf95e72b1 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:03.186637 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9c8939da-f546-4630-b9b0-a7edf95e72b1 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "POST /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263/action" status: 200 len: 14 microversion: 2.1 time: 0.140075 Jun 20 12:23:03.187611 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2544/4985] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:23:03 2022] POST /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:23:04.014726 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-69334288-4586-49fe-8460-e697fae18dbd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:04.016486 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-69334288-4586-49fe-8460-e697fae18dbd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:04.031330 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-69334288-4586-49fe-8460-e697fae18dbd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:04.031790 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-69334288-4586-49fe-8460-e697fae18dbd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:04.035289 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-69334288-4586-49fe-8460-e697fae18dbd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:04.039511 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-69334288-4586-49fe-8460-e697fae18dbd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:04.203134 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e9bb7197-6421-4360-8678-c49078a66471 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:04.204191 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e9bb7197-6421-4360-8678-c49078a66471 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: b6e4b364-c9ac-4369-8b13-17ad4f918263] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:04.237669 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e9bb7197-6421-4360-8678-c49078a66471 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:04.238130 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e9bb7197-6421-4360-8678-c49078a66471 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:04.239073 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e9bb7197-6421-4360-8678-c49078a66471 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:04.242445 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e9bb7197-6421-4360-8678-c49078a66471 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:04.351521 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e9bb7197-6421-4360-8678-c49078a66471 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "POST /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263/action" status: 200 len: 14 microversion: 2.1 time: 0.157145 Jun 20 12:23:04.355880 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2545/4986] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:23:04 2022] POST /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263/action => generated 14 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:23:04.698778 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cabb7bd6-6452-4a0f-ba5d-23c72d5cfbc2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-103243896", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "bb3077d7-6103-4c2d-996a-7b6fd28b64fa"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:04.810888 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-cabb7bd6-6452-4a0f-ba5d-23c72d5cfbc2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] validate_networks() for [('bb3077d7-6103-4c2d-996a-7b6fd28b64fa', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:23:05.036314 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-69334288-4586-49fe-8460-e697fae18dbd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:05.061771 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-69334288-4586-49fe-8460-e697fae18dbd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 200 len: 1690 microversion: 2.1 time: 1.054875 Jun 20 12:23:05.080056 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2442/4987] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:04 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 1690 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:05.364635 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a130ae9a-64f8-4581-a28a-3d5284c45d2e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:05.366073 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a130ae9a-64f8-4581-a28a-3d5284c45d2e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: b6e4b364-c9ac-4369-8b13-17ad4f918263] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:05.388612 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a130ae9a-64f8-4581-a28a-3d5284c45d2e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:05.389066 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a130ae9a-64f8-4581-a28a-3d5284c45d2e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:05.389861 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a130ae9a-64f8-4581-a28a-3d5284c45d2e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:05.390292 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a130ae9a-64f8-4581-a28a-3d5284c45d2e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:05.527293 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a130ae9a-64f8-4581-a28a-3d5284c45d2e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "POST /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263/action" status: 200 len: 14 microversion: 2.1 time: 0.167109 Jun 20 12:23:05.539682 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2443/4988] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:23:05 2022] POST /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263/action => generated 14 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 20 12:23:05.805233 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-90ce82e0-4ff6-47d1-8c73-e524b719128f req-94f46b02-aebf-4a14-8eb8-80704489ff68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25476e5c-8f10-449a-881b-2e9d9d1b2bfe", "name": "network-vif-unplugged", "status": "completed", "tag": "d4cffb2a-b881-48b3-9739-58fc13501c0e"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:05.832828 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-90ce82e0-4ff6-47d1-8c73-e524b719128f req-94f46b02-aebf-4a14-8eb8-80704489ff68 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:05.833739 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-90ce82e0-4ff6-47d1-8c73-e524b719128f req-94f46b02-aebf-4a14-8eb8-80704489ff68 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:05.852253 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-90ce82e0-4ff6-47d1-8c73-e524b719128f req-94f46b02-aebf-4a14-8eb8-80704489ff68 service nova] Creating event network-vif-unplugged:d4cffb2a-b881-48b3-9739-58fc13501c0e for instance 25476e5c-8f10-449a-881b-2e9d9d1b2bfe on n-h1-master-1 Jun 20 12:23:05.861786 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-90ce82e0-4ff6-47d1-8c73-e524b719128f req-94f46b02-aebf-4a14-8eb8-80704489ff68 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063144 Jun 20 12:23:05.863668 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2444/4989] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:23:05.974444 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-cabb7bd6-6452-4a0f-ba5d-23c72d5cfbc2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:23:05.975629 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-cabb7bd6-6452-4a0f-ba5d-23c72d5cfbc2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:23:05.976666 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-cabb7bd6-6452-4a0f-ba5d-23c72d5cfbc2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:23:05.977397 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-cabb7bd6-6452-4a0f-ba5d-23c72d5cfbc2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:23:05.977976 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-cabb7bd6-6452-4a0f-ba5d-23c72d5cfbc2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:23:05.989065 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cabb7bd6-6452-4a0f-ba5d-23c72d5cfbc2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:05.989777 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cabb7bd6-6452-4a0f-ba5d-23c72d5cfbc2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:05.990732 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cabb7bd6-6452-4a0f-ba5d-23c72d5cfbc2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:05.991363 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cabb7bd6-6452-4a0f-ba5d-23c72d5cfbc2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:06.040344 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-cabb7bd6-6452-4a0f-ba5d-23c72d5cfbc2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Getting quotas for project 94bcbf77cdc246e99f0a94398ed41a08. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:23:06.058509 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-cabb7bd6-6452-4a0f-ba5d-23c72d5cfbc2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Getting quotas for user 7656081c0941463990b483b9db21536a and project 94bcbf77cdc246e99f0a94398ed41a08. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:23:06.084391 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-66a97a31-9636-4a05-9dca-315ffa941fb9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:06.086481 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-66a97a31-9636-4a05-9dca-315ffa941fb9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:06.088579 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cabb7bd6-6452-4a0f-ba5d-23c72d5cfbc2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Going to run 2 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:23:06.094575 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cabb7bd6-6452-4a0f-ba5d-23c72d5cfbc2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: ecf1523d-6981-4c99-a46f-8effe6f65df8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:23:06.129553 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-66a97a31-9636-4a05-9dca-315ffa941fb9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:06.133530 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-66a97a31-9636-4a05-9dca-315ffa941fb9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:06.134759 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-66a97a31-9636-4a05-9dca-315ffa941fb9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:06.137766 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-66a97a31-9636-4a05-9dca-315ffa941fb9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:06.192924 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cabb7bd6-6452-4a0f-ba5d-23c72d5cfbc2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 98d6319f-8549-4882-aca9-060c2fab3a72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=ecf1523d-6981-4c99-a46f-8effe6f65df8,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:23:06.301052 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cabb7bd6-6452-4a0f-ba5d-23c72d5cfbc2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.898446 Jun 20 12:23:06.303926 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2546/4990] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:23:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:23:06.315405 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-73042446-46de-45ac-9a50-7824ceaf347f tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:06.327979 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-73042446-46de-45ac-9a50-7824ceaf347f tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7656081c0941463990b483b9db21536a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bcbf77cdc246e99f0a94398ed41a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:06.329260 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-73042446-46de-45ac-9a50-7824ceaf347f tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Searching by: {'deleted': False, 'project_id': '94bcbf77cdc246e99f0a94398ed41a08'} {{(pid=119127) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:23:06.349527 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-73042446-46de-45ac-9a50-7824ceaf347f tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:06.350311 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-73042446-46de-45ac-9a50-7824ceaf347f tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:06.352393 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-73042446-46de-45ac-9a50-7824ceaf347f tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:06.353035 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-73042446-46de-45ac-9a50-7824ceaf347f tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:06.392745 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-73042446-46de-45ac-9a50-7824ceaf347f tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.083134 Jun 20 12:23:06.394034 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2547/4991] 10.222.0.27 () {58 vars in 1124 bytes} [Mon Jun 20 12:23:06 2022] GET /compute/v2.1/servers => generated 675 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:23:06.408121 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-37452f62-ef4d-437c-904f-656ac9444d69 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:06.408782 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-37452f62-ef4d-437c-904f-656ac9444d69 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 98d6319f-8549-4882-aca9-060c2fab3a72] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:06.533932 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-37452f62-ef4d-437c-904f-656ac9444d69 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7656081c0941463990b483b9db21536a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bcbf77cdc246e99f0a94398ed41a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:06.545746 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-37452f62-ef4d-437c-904f-656ac9444d69 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "GET /compute/v2.1/servers/98d6319f-8549-4882-aca9-060c2fab3a72" status: 200 len: 1219 microversion: 2.1 time: 0.145421 Jun 20 12:23:06.548933 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2548/4992] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:06 2022] GET /compute/v2.1/servers/98d6319f-8549-4882-aca9-060c2fab3a72 => generated 1219 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:06.561690 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ab89cd2b-a5df-4e4e-b3bc-20554002520d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:06.562634 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ab89cd2b-a5df-4e4e-b3bc-20554002520d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: b6e4b364-c9ac-4369-8b13-17ad4f918263] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:06.575765 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ab89cd2b-a5df-4e4e-b3bc-20554002520d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:06.579977 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ab89cd2b-a5df-4e4e-b3bc-20554002520d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:06.580983 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ab89cd2b-a5df-4e4e-b3bc-20554002520d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:06.581636 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ab89cd2b-a5df-4e4e-b3bc-20554002520d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:06.686096 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ab89cd2b-a5df-4e4e-b3bc-20554002520d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "POST /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263/action" status: 200 len: 14 microversion: 2.1 time: 0.135491 Jun 20 12:23:06.687990 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2549/4993] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:23:06 2022] POST /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:23:07.249479 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-66a97a31-9636-4a05-9dca-315ffa941fb9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:07.263304 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-66a97a31-9636-4a05-9dca-315ffa941fb9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 200 len: 1690 microversion: 2.1 time: 1.187031 Jun 20 12:23:07.270938 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2445/4994] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:06 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 1690 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:07.567251 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2ceac456-a03b-4ccf-9594-27c058fab12b tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:07.567973 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2ceac456-a03b-4ccf-9594-27c058fab12b tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 98d6319f-8549-4882-aca9-060c2fab3a72] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:07.712302 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0a590249-e530-4c6b-b345-be10bd945968 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:07.717987 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0a590249-e530-4c6b-b345-be10bd945968 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: b6e4b364-c9ac-4369-8b13-17ad4f918263] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:07.744362 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a590249-e530-4c6b-b345-be10bd945968 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:07.748973 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a590249-e530-4c6b-b345-be10bd945968 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:07.755219 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a590249-e530-4c6b-b345-be10bd945968 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:07.775086 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a590249-e530-4c6b-b345-be10bd945968 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:07.839973 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2ceac456-a03b-4ccf-9594-27c058fab12b tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7656081c0941463990b483b9db21536a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bcbf77cdc246e99f0a94398ed41a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:07.856298 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2ceac456-a03b-4ccf-9594-27c058fab12b tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "GET /compute/v2.1/servers/98d6319f-8549-4882-aca9-060c2fab3a72" status: 200 len: 1219 microversion: 2.1 time: 0.293347 Jun 20 12:23:07.857823 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2550/4995] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:07 2022] GET /compute/v2.1/servers/98d6319f-8549-4882-aca9-060c2fab3a72 => generated 1219 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:07.921992 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0a590249-e530-4c6b-b345-be10bd945968 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "POST /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263/action" status: 200 len: 8206 microversion: 2.1 time: 0.226623 Jun 20 12:23:07.926309 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2446/4996] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:23:07 2022] POST /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263/action => generated 8206 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:07.939287 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fb9fae0d-710a-41f8-bdb6-2c5beb66f515 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:07.940072 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fb9fae0d-710a-41f8-bdb6-2c5beb66f515 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:07.996830 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fb9fae0d-710a-41f8-bdb6-2c5beb66f515 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:07.997124 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fb9fae0d-710a-41f8-bdb6-2c5beb66f515 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:08.005020 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fb9fae0d-710a-41f8-bdb6-2c5beb66f515 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:08.005823 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fb9fae0d-710a-41f8-bdb6-2c5beb66f515 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:08.289728 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b547f3ff-5065-477d-9d25-2a975da38078 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:08.291837 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b547f3ff-5065-477d-9d25-2a975da38078 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:08.313055 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b547f3ff-5065-477d-9d25-2a975da38078 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:08.320836 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b547f3ff-5065-477d-9d25-2a975da38078 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:08.325372 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b547f3ff-5065-477d-9d25-2a975da38078 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:08.326135 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b547f3ff-5065-477d-9d25-2a975da38078 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:08.455401 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fb9fae0d-710a-41f8-bdb6-2c5beb66f515 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:08.475306 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fb9fae0d-710a-41f8-bdb6-2c5beb66f515 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.540330 Jun 20 12:23:08.476172 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2551/4997] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:07 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:08.508112 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-09c68ed0-d4bf-46f8-b731-c5436a0a25e2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:08.509294 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-09c68ed0-d4bf-46f8-b731-c5436a0a25e2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:08.529029 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-09c68ed0-d4bf-46f8-b731-c5436a0a25e2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:08.531056 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-09c68ed0-d4bf-46f8-b731-c5436a0a25e2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:08.533532 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-09c68ed0-d4bf-46f8-b731-c5436a0a25e2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:08.535027 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-09c68ed0-d4bf-46f8-b731-c5436a0a25e2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:09.519582 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-09c68ed0-d4bf-46f8-b731-c5436a0a25e2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:09.532309 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b547f3ff-5065-477d-9d25-2a975da38078 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:09.537696 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-09c68ed0-d4bf-46f8-b731-c5436a0a25e2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 1.036016 Jun 20 12:23:09.556313 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2552/4998] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:08 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:09.559513 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b547f3ff-5065-477d-9d25-2a975da38078 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 200 len: 1690 microversion: 2.1 time: 1.274882 Jun 20 12:23:09.562738 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2447/4999] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:08 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 1690 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:09.567230 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-600a22fa-cf89-44ba-91a3-efcc4f630876 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:09.567762 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-600a22fa-cf89-44ba-91a3-efcc4f630876 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 98d6319f-8549-4882-aca9-060c2fab3a72] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:09.576803 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-72d5d6e7-257c-40fc-baf4-5c28e2ebccb4 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:09.587271 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-72d5d6e7-257c-40fc-baf4-5c28e2ebccb4 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:09.596547 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-600a22fa-cf89-44ba-91a3-efcc4f630876 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:09.597446 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-600a22fa-cf89-44ba-91a3-efcc4f630876 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:09.598331 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-600a22fa-cf89-44ba-91a3-efcc4f630876 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:09.598812 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-600a22fa-cf89-44ba-91a3-efcc4f630876 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:09.609287 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=50 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:09.611477 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-72d5d6e7-257c-40fc-baf4-5c28e2ebccb4 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:09.611937 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-72d5d6e7-257c-40fc-baf4-5c28e2ebccb4 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:09.612808 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-72d5d6e7-257c-40fc-baf4-5c28e2ebccb4 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:09.613255 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-72d5d6e7-257c-40fc-baf4-5c28e2ebccb4 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:09.844078 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-600a22fa-cf89-44ba-91a3-efcc4f630876 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7656081c0941463990b483b9db21536a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bcbf77cdc246e99f0a94398ed41a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:09.854742 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-600a22fa-cf89-44ba-91a3-efcc4f630876 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "GET /compute/v2.1/servers/98d6319f-8549-4882-aca9-060c2fab3a72" status: 200 len: 1277 microversion: 2.1 time: 0.296634 Jun 20 12:23:09.856190 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2553/5000] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:09 2022] GET /compute/v2.1/servers/98d6319f-8549-4882-aca9-060c2fab3a72 => generated 1277 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:10.511379 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-72d5d6e7-257c-40fc-baf4-5c28e2ebccb4 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:10.529308 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-72d5d6e7-257c-40fc-baf4-5c28e2ebccb4 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.960229 Jun 20 12:23:10.532101 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2448/5001] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:09 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:10.551675 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e44a65a0-4340-45e9-ace8-60e7b3236441 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:10.552933 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e44a65a0-4340-45e9-ace8-60e7b3236441 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:10.562397 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e44a65a0-4340-45e9-ace8-60e7b3236441 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:10.568287 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e44a65a0-4340-45e9-ace8-60e7b3236441 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:10.569460 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e44a65a0-4340-45e9-ace8-60e7b3236441 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:10.571791 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e44a65a0-4340-45e9-ace8-60e7b3236441 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:10.583225 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-81e0f1bf-7e54-4da1-9588-6ef53a00e87d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:10.584499 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-81e0f1bf-7e54-4da1-9588-6ef53a00e87d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:10.596864 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-81e0f1bf-7e54-4da1-9588-6ef53a00e87d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:10.608974 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-81e0f1bf-7e54-4da1-9588-6ef53a00e87d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:10.610122 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-81e0f1bf-7e54-4da1-9588-6ef53a00e87d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:10.610731 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-81e0f1bf-7e54-4da1-9588-6ef53a00e87d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:11.353551 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e44a65a0-4340-45e9-ace8-60e7b3236441 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:11.365429 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e44a65a0-4340-45e9-ace8-60e7b3236441 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.819281 Jun 20 12:23:11.375375 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2554/5002] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:10 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:11.404401 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ea14d606-5acb-4bc3-a490-5f2e27f278d5 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:11.407283 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ea14d606-5acb-4bc3-a490-5f2e27f278d5 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 98d6319f-8549-4882-aca9-060c2fab3a72] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:11.445669 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea14d606-5acb-4bc3-a490-5f2e27f278d5 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:11.448191 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea14d606-5acb-4bc3-a490-5f2e27f278d5 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:11.453003 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea14d606-5acb-4bc3-a490-5f2e27f278d5 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:11.454220 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea14d606-5acb-4bc3-a490-5f2e27f278d5 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:11.975250 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-81e0f1bf-7e54-4da1-9588-6ef53a00e87d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:11.990180 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-81e0f1bf-7e54-4da1-9588-6ef53a00e87d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 200 len: 1690 microversion: 2.1 time: 1.405704 Jun 20 12:23:11.990861 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2449/5003] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:10 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 1690 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:12.030414 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a3956b01-5338-4c3e-8328-32ff79420abe tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:12.031065 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a3956b01-5338-4c3e-8328-32ff79420abe tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:12.035510 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ea14d606-5acb-4bc3-a490-5f2e27f278d5 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7656081c0941463990b483b9db21536a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bcbf77cdc246e99f0a94398ed41a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:12.049357 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ea14d606-5acb-4bc3-a490-5f2e27f278d5 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "GET /compute/v2.1/servers/98d6319f-8549-4882-aca9-060c2fab3a72" status: 200 len: 1319 microversion: 2.1 time: 0.671861 Jun 20 12:23:12.056596 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2555/5004] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:11 2022] GET /compute/v2.1/servers/98d6319f-8549-4882-aca9-060c2fab3a72 => generated 1319 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:12.065602 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3956b01-5338-4c3e-8328-32ff79420abe tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:12.066055 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3956b01-5338-4c3e-8328-32ff79420abe tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:12.071655 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3956b01-5338-4c3e-8328-32ff79420abe tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:12.072100 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3956b01-5338-4c3e-8328-32ff79420abe tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:12.183640 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a3956b01-5338-4c3e-8328-32ff79420abe tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Locking {{(pid=119128) lock /opt/stack/nova/nova/compute/api.py:4700}} Jun 20 12:23:12.282072 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a3956b01-5338-4c3e-8328-32ff79420abe tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "POST /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/action" status: 202 len: 0 microversion: 2.1 time: 0.269747 Jun 20 12:23:12.286095 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2450/5005] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:23:11 2022] POST /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:23:12.294062 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-97cbfd83-3e22-4579-9dbe-b96787fd0d9d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:12.294837 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-97cbfd83-3e22-4579-9dbe-b96787fd0d9d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:12.323015 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-97cbfd83-3e22-4579-9dbe-b96787fd0d9d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:12.332230 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-97cbfd83-3e22-4579-9dbe-b96787fd0d9d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:12.337839 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-97cbfd83-3e22-4579-9dbe-b96787fd0d9d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:12.342928 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-97cbfd83-3e22-4579-9dbe-b96787fd0d9d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:12.977369 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-97cbfd83-3e22-4579-9dbe-b96787fd0d9d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:12.985639 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-97cbfd83-3e22-4579-9dbe-b96787fd0d9d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.697971 Jun 20 12:23:12.986236 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2556/5006] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:12 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:13.023162 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d0a60dd2-7fbe-48eb-a83e-e352d3524a65 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:13.047359 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-86d045ce-0b4d-4223-9b73-4028b259eb7c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:13.051288 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d0a60dd2-7fbe-48eb-a83e-e352d3524a65 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:13.052418 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-86d045ce-0b4d-4223-9b73-4028b259eb7c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:13.055308 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d0a60dd2-7fbe-48eb-a83e-e352d3524a65 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:13.079323 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86d045ce-0b4d-4223-9b73-4028b259eb7c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:13.080087 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86d045ce-0b4d-4223-9b73-4028b259eb7c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:13.081656 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86d045ce-0b4d-4223-9b73-4028b259eb7c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:13.082278 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86d045ce-0b4d-4223-9b73-4028b259eb7c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:13.131719 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-d0a60dd2-7fbe-48eb-a83e-e352d3524a65 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] HTTP exception thrown: Instance 21609be7-c3f0-4e24-a093-2f74ce957a35 is locked Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d0a60dd2-7fbe-48eb-a83e-e352d3524a65 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Request method failure captured: Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/action HTTP/1.1 Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 15 Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGWfcnsnIAQHeUFzemCAqsDSaDjVl1ssR-hcl5jShJJncxtH_i_sUxyV8wxMh7Nb_82a0N8h4PZj2sZBDxn55X-hts8ntzQHnGvnqXOJDUG24ePgw3p5o0pMF-JHnlpIu7C903Kl6_Fa26thSLCLY9zvvFkQX2Lh7LHBESrUQztcSD8 Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 19236314583142029ffd7a1e04460cab Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServerActionsTestJSON-1849432707 Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19236314583142029ffd7a1e04460cab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19236314583142029ffd7a1e04460cab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/19236314583142029ffd7a1e04460cab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_19236314583142029ffd7a1e04460cab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServerActionsTestJSON-1849432707 Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 19236314583142029ffd7a1e04460cab Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServerActionsTestJSON-1849432707 Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServerActionsTestJSON-1849432707-project Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 4ccd420e1ff744b99cb7e5650522e983 Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServerActionsTestJSON-1849432707-project Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: {"os-stop": {}} Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 21609be7-c3f0-4e24-a093-2f74ce957a35 is locked Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '21609be7-c3f0-4e24-a093-2f74ce957a35', 'body': {'os-stop': {}}} Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 21609be7-c3f0-4e24-a093-2f74ce957a35 is locked Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 21609be7-c3f0-4e24-a093-2f74ce957a35 is locked Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21609be7-c3f0-4e24-a093-2f74ce957a35 is locked Jun 20 12:23:13.134168 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:23:13.154178 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d0a60dd2-7fbe-48eb-a83e-e352d3524a65 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Returning 409 to user: Instance 21609be7-c3f0-4e24-a093-2f74ce957a35 is locked {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:23:13.155456 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d0a60dd2-7fbe-48eb-a83e-e352d3524a65 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "POST /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/action" status: 409 len: 107 microversion: 2.1 time: 0.153493 Jun 20 12:23:13.157001 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2451/5007] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:23:13 2022] POST /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/action => generated 107 bytes in 155 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:23:13.167151 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b8b55806-fbc6-423f-8195-6098ca104158 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:13.168022 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b8b55806-fbc6-423f-8195-6098ca104158 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 98d6319f-8549-4882-aca9-060c2fab3a72] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:13.191219 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b8b55806-fbc6-423f-8195-6098ca104158 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:13.192055 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b8b55806-fbc6-423f-8195-6098ca104158 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:13.193109 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b8b55806-fbc6-423f-8195-6098ca104158 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:13.193759 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b8b55806-fbc6-423f-8195-6098ca104158 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:13.659509 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-86d045ce-0b4d-4223-9b73-4028b259eb7c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:13.676870 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-86d045ce-0b4d-4223-9b73-4028b259eb7c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 200 len: 1680 microversion: 2.1 time: 0.645344 Jun 20 12:23:13.677472 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2557/5008] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:13 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 1680 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:13.696884 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-051b22ea-6cfc-4757-bce2-3d15ab98db65 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:13.697540 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-051b22ea-6cfc-4757-bce2-3d15ab98db65 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:13.716474 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-051b22ea-6cfc-4757-bce2-3d15ab98db65 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:13.716770 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-051b22ea-6cfc-4757-bce2-3d15ab98db65 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:13.717848 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-051b22ea-6cfc-4757-bce2-3d15ab98db65 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:13.718373 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-051b22ea-6cfc-4757-bce2-3d15ab98db65 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:13.834699 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b8b55806-fbc6-423f-8195-6098ca104158 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7656081c0941463990b483b9db21536a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bcbf77cdc246e99f0a94398ed41a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:13.849985 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-051b22ea-6cfc-4757-bce2-3d15ab98db65 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Unlocking {{(pid=119127) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jun 20 12:23:13.860601 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b8b55806-fbc6-423f-8195-6098ca104158 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "GET /compute/v2.1/servers/98d6319f-8549-4882-aca9-060c2fab3a72" status: 200 len: 1319 microversion: 2.1 time: 0.699991 Jun 20 12:23:13.862438 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2452/5009] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:13 2022] GET /compute/v2.1/servers/98d6319f-8549-4882-aca9-060c2fab3a72 => generated 1319 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:13.877526 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a5b5f320-a769-44df-96fc-dcc7561d148d tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:13.878469 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a5b5f320-a769-44df-96fc-dcc7561d148d tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:13.901399 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a5b5f320-a769-44df-96fc-dcc7561d148d tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:13.901867 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a5b5f320-a769-44df-96fc-dcc7561d148d tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:13.905642 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a5b5f320-a769-44df-96fc-dcc7561d148d tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:13.905642 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a5b5f320-a769-44df-96fc-dcc7561d148d tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:13.937249 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:14.010924 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-051b22ea-6cfc-4757-bce2-3d15ab98db65 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "POST /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/action" status: 202 len: 0 microversion: 2.1 time: 0.322873 Jun 20 12:23:14.010924 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2558/5010] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:23:13 2022] POST /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:23:14.018887 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-effc5d76-e9a8-4aac-88c6-ae8454c22f80 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:14.039846 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-effc5d76-e9a8-4aac-88c6-ae8454c22f80 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:14.047860 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-effc5d76-e9a8-4aac-88c6-ae8454c22f80 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:14.096263 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-effc5d76-e9a8-4aac-88c6-ae8454c22f80 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Going to try to stop instance {{(pid=119127) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 20 12:23:14.200184 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-effc5d76-e9a8-4aac-88c6-ae8454c22f80 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "POST /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/action" status: 202 len: 0 microversion: 2.1 time: 0.185421 Jun 20 12:23:14.217864 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2559/5011] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:23:14 2022] POST /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:23:14.245893 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8b89a49e-8208-457d-aa94-505daa67f289 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:14.246885 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8b89a49e-8208-457d-aa94-505daa67f289 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:14.279283 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b89a49e-8208-457d-aa94-505daa67f289 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:14.280433 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b89a49e-8208-457d-aa94-505daa67f289 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:14.282465 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b89a49e-8208-457d-aa94-505daa67f289 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:14.283336 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b89a49e-8208-457d-aa94-505daa67f289 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:14.480391 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a5b5f320-a769-44df-96fc-dcc7561d148d tempest-TestNetworkAdvancedServerOps-902338273 tempest-TestNetworkAdvancedServerOps-902338273-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 200 len: 1831 microversion: 2.1 time: 0.605362 Jun 20 12:23:14.483494 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2453/5012] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:13 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 1831 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:14.506217 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3b870abe-da0c-453b-a1a3-7dd336c5dec4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:14.511947 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3b870abe-da0c-453b-a1a3-7dd336c5dec4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:14.551991 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b870abe-da0c-453b-a1a3-7dd336c5dec4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:14.552803 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b870abe-da0c-453b-a1a3-7dd336c5dec4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:14.555846 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b870abe-da0c-453b-a1a3-7dd336c5dec4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:14.559312 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b870abe-da0c-453b-a1a3-7dd336c5dec4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:14.664888 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8b89a49e-8208-457d-aa94-505daa67f289 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:14.684153 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8b89a49e-8208-457d-aa94-505daa67f289 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1681 microversion: 2.1 time: 0.463762 Jun 20 12:23:14.690548 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2560/5013] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:14 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1681 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:14.880028 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d147835f-7248-43fe-8de9-575905b5f072 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:14.882676 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d147835f-7248-43fe-8de9-575905b5f072 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 98d6319f-8549-4882-aca9-060c2fab3a72] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:14.899552 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d147835f-7248-43fe-8de9-575905b5f072 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:14.903373 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d147835f-7248-43fe-8de9-575905b5f072 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:14.905169 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d147835f-7248-43fe-8de9-575905b5f072 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:14.909415 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d147835f-7248-43fe-8de9-575905b5f072 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:15.307568 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3b870abe-da0c-453b-a1a3-7dd336c5dec4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:15.329918 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3b870abe-da0c-453b-a1a3-7dd336c5dec4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 200 len: 1680 microversion: 2.1 time: 0.830907 Jun 20 12:23:15.341714 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2454/5014] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:14 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 1680 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:15.473651 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9f151bc0-8b45-4b37-9174-9bbbb64da996 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:15.477667 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9f151bc0-8b45-4b37-9174-9bbbb64da996 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:15.489931 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9f151bc0-8b45-4b37-9174-9bbbb64da996 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:15.501624 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9f151bc0-8b45-4b37-9174-9bbbb64da996 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:15.505175 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9f151bc0-8b45-4b37-9174-9bbbb64da996 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:15.506379 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9f151bc0-8b45-4b37-9174-9bbbb64da996 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:15.616305 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d147835f-7248-43fe-8de9-575905b5f072 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7656081c0941463990b483b9db21536a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bcbf77cdc246e99f0a94398ed41a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:15.632128 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9f151bc0-8b45-4b37-9174-9bbbb64da996 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "POST /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe/action" status: 200 len: 38661 microversion: 2.1 time: 0.163973 Jun 20 12:23:15.642096 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d147835f-7248-43fe-8de9-575905b5f072 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "GET /compute/v2.1/servers/98d6319f-8549-4882-aca9-060c2fab3a72" status: 200 len: 1319 microversion: 2.1 time: 0.766583 Jun 20 12:23:15.642691 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2561/5015] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:14 2022] GET /compute/v2.1/servers/98d6319f-8549-4882-aca9-060c2fab3a72 => generated 1319 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:15.643392 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2455/5016] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:23:15 2022] POST /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe/action => generated 38661 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:23:15.712737 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fb288121-c61a-4671-b8ef-47aee77305f1 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:15.713837 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fb288121-c61a-4671-b8ef-47aee77305f1 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:15.735221 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fb288121-c61a-4671-b8ef-47aee77305f1 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:15.735677 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fb288121-c61a-4671-b8ef-47aee77305f1 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:15.740710 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fb288121-c61a-4671-b8ef-47aee77305f1 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:15.741363 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fb288121-c61a-4671-b8ef-47aee77305f1 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:16.144343 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-470aed8d-3ec0-426b-b34f-36b4d3a44693 req-004fbc08-f059-43cc-87d5-62fc4df716a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98d6319f-8549-4882-aca9-060c2fab3a72", "tag": "a8394224-3f1e-4f85-af73-e88d2060b7a7"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:16.162223 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-470aed8d-3ec0-426b-b34f-36b4d3a44693 req-004fbc08-f059-43cc-87d5-62fc4df716a3 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:16.162870 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-470aed8d-3ec0-426b-b34f-36b4d3a44693 req-004fbc08-f059-43cc-87d5-62fc4df716a3 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:16.196679 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-470aed8d-3ec0-426b-b34f-36b4d3a44693 req-004fbc08-f059-43cc-87d5-62fc4df716a3 service nova] Creating event network-changed:a8394224-3f1e-4f85-af73-e88d2060b7a7 for instance 98d6319f-8549-4882-aca9-060c2fab3a72 on n-h1-master-1 Jun 20 12:23:16.210314 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-470aed8d-3ec0-426b-b34f-36b4d3a44693 req-004fbc08-f059-43cc-87d5-62fc4df716a3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070315 Jun 20 12:23:16.225005 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2562/5017] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:23:16.445859 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-897d4c7c-6f84-4b87-99ea-3bcc5d26aa6a req-c7cddd42-b7ef-4ae7-95c6-f0d0cc2da521 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecf1523d-6981-4c99-a46f-8effe6f65df8", "tag": "6eee8771-92c2-430e-9c09-9a0476b1c109"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:16.469742 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=4 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:16.473613 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fb288121-c61a-4671-b8ef-47aee77305f1 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:16.480494 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-897d4c7c-6f84-4b87-99ea-3bcc5d26aa6a req-c7cddd42-b7ef-4ae7-95c6-f0d0cc2da521 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:16.483882 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-897d4c7c-6f84-4b87-99ea-3bcc5d26aa6a req-c7cddd42-b7ef-4ae7-95c6-f0d0cc2da521 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:16.484251 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fb288121-c61a-4671-b8ef-47aee77305f1 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1681 microversion: 2.1 time: 0.775879 Jun 20 12:23:16.489601 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2456/5018] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:15 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1681 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:16.532607 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-897d4c7c-6f84-4b87-99ea-3bcc5d26aa6a req-c7cddd42-b7ef-4ae7-95c6-f0d0cc2da521 service nova] Creating event network-changed:6eee8771-92c2-430e-9c09-9a0476b1c109 for instance ecf1523d-6981-4c99-a46f-8effe6f65df8 on n-h2-master-1 Jun 20 12:23:16.547628 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-897d4c7c-6f84-4b87-99ea-3bcc5d26aa6a req-c7cddd42-b7ef-4ae7-95c6-f0d0cc2da521 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105955 Jun 20 12:23:16.551383 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2563/5019] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:23:16.659011 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a7eba133-41ab-43e1-9a94-ddda8d69f56a tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:16.659632 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a7eba133-41ab-43e1-9a94-ddda8d69f56a tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 98d6319f-8549-4882-aca9-060c2fab3a72] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:16.667835 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a7eba133-41ab-43e1-9a94-ddda8d69f56a tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:16.668319 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a7eba133-41ab-43e1-9a94-ddda8d69f56a tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:16.669105 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a7eba133-41ab-43e1-9a94-ddda8d69f56a tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:16.669541 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a7eba133-41ab-43e1-9a94-ddda8d69f56a tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:16.690023 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:17.391164 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a7eba133-41ab-43e1-9a94-ddda8d69f56a tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7656081c0941463990b483b9db21536a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bcbf77cdc246e99f0a94398ed41a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:17.444820 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a7eba133-41ab-43e1-9a94-ddda8d69f56a tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "GET /compute/v2.1/servers/98d6319f-8549-4882-aca9-060c2fab3a72" status: 200 len: 1319 microversion: 2.1 time: 0.787649 Jun 20 12:23:17.446903 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2457/5020] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:16 2022] GET /compute/v2.1/servers/98d6319f-8549-4882-aca9-060c2fab3a72 => generated 1319 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:17.519228 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6981e1d7-2f85-4156-84f1-8ddd1e29c0f3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:17.527508 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6981e1d7-2f85-4156-84f1-8ddd1e29c0f3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:17.561056 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6981e1d7-2f85-4156-84f1-8ddd1e29c0f3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:17.569981 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6981e1d7-2f85-4156-84f1-8ddd1e29c0f3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:17.571563 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6981e1d7-2f85-4156-84f1-8ddd1e29c0f3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:17.589895 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6981e1d7-2f85-4156-84f1-8ddd1e29c0f3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:17.847015 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=10 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:18.061290 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6981e1d7-2f85-4156-84f1-8ddd1e29c0f3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:18.071824 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6981e1d7-2f85-4156-84f1-8ddd1e29c0f3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1681 microversion: 2.1 time: 0.568429 Jun 20 12:23:18.078521 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2564/5021] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:17 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1681 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:18.479319 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-223a9d4a-e55f-4edb-8374-9e2ce721990e tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:18.480309 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-223a9d4a-e55f-4edb-8374-9e2ce721990e tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 98d6319f-8549-4882-aca9-060c2fab3a72] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:18.504744 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-223a9d4a-e55f-4edb-8374-9e2ce721990e tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:18.505193 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-223a9d4a-e55f-4edb-8374-9e2ce721990e tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:18.509091 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-223a9d4a-e55f-4edb-8374-9e2ce721990e tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:18.512140 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-223a9d4a-e55f-4edb-8374-9e2ce721990e tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:18.719935 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bce42228-56d4-4e0c-98f3-04e6d49190d6 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:18.721287 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bce42228-56d4-4e0c-98f3-04e6d49190d6 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:18.733978 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bce42228-56d4-4e0c-98f3-04e6d49190d6 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:18.734633 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bce42228-56d4-4e0c-98f3-04e6d49190d6 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:18.737230 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bce42228-56d4-4e0c-98f3-04e6d49190d6 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:18.741850 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bce42228-56d4-4e0c-98f3-04e6d49190d6 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:18.880479 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bce42228-56d4-4e0c-98f3-04e6d49190d6 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:23:19.138328 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bce42228-56d4-4e0c-98f3-04e6d49190d6 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "DELETE /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 204 len: 0 microversion: 2.1 time: 0.423383 Jun 20 12:23:19.142199 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2565/5022] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:23:18 2022] DELETE /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 12:23:19.150615 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-2dfafbfb-ee20-413f-a5a1-64c58612f7bc req-562fa13a-b2ba-43b8-bbc5-5cb719234654 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25476e5c-8f10-449a-881b-2e9d9d1b2bfe", "tag": "d4cffb2a-b881-48b3-9739-58fc13501c0e"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:19.172833 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-2dfafbfb-ee20-413f-a5a1-64c58612f7bc req-562fa13a-b2ba-43b8-bbc5-5cb719234654 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:19.173275 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-2dfafbfb-ee20-413f-a5a1-64c58612f7bc req-562fa13a-b2ba-43b8-bbc5-5cb719234654 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:19.198724 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-2dfafbfb-ee20-413f-a5a1-64c58612f7bc req-562fa13a-b2ba-43b8-bbc5-5cb719234654 service nova] Creating event network-changed:d4cffb2a-b881-48b3-9739-58fc13501c0e for instance 25476e5c-8f10-449a-881b-2e9d9d1b2bfe on n-h2-master-1 Jun 20 12:23:19.204669 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-2dfafbfb-ee20-413f-a5a1-64c58612f7bc req-562fa13a-b2ba-43b8-bbc5-5cb719234654 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063603 Jun 20 12:23:19.205873 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2566/5023] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:23:19.211914 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4402b230-b3f3-4a63-898e-0229bf7a0546 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:19.212955 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4402b230-b3f3-4a63-898e-0229bf7a0546 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:19.220350 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4402b230-b3f3-4a63-898e-0229bf7a0546 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:19.221299 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4402b230-b3f3-4a63-898e-0229bf7a0546 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:19.222432 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4402b230-b3f3-4a63-898e-0229bf7a0546 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:19.223071 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4402b230-b3f3-4a63-898e-0229bf7a0546 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:19.245182 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-223a9d4a-e55f-4edb-8374-9e2ce721990e tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7656081c0941463990b483b9db21536a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bcbf77cdc246e99f0a94398ed41a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:19.254603 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-223a9d4a-e55f-4edb-8374-9e2ce721990e tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "GET /compute/v2.1/servers/98d6319f-8549-4882-aca9-060c2fab3a72" status: 200 len: 1319 microversion: 2.1 time: 0.783268 Jun 20 12:23:19.258571 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2458/5024] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:18 2022] GET /compute/v2.1/servers/98d6319f-8549-4882-aca9-060c2fab3a72 => generated 1319 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:19.264665 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-99d603a7-1dc2-4756-ba3f-2ff65a71d424 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:19.268742 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-99d603a7-1dc2-4756-ba3f-2ff65a71d424 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:19.285528 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-99d603a7-1dc2-4756-ba3f-2ff65a71d424 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:19.286284 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-99d603a7-1dc2-4756-ba3f-2ff65a71d424 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:19.294731 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-99d603a7-1dc2-4756-ba3f-2ff65a71d424 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:19.295244 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-99d603a7-1dc2-4756-ba3f-2ff65a71d424 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:19.462244 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4402b230-b3f3-4a63-898e-0229bf7a0546 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:19.472272 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4402b230-b3f3-4a63-898e-0229bf7a0546 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1681 microversion: 2.1 time: 0.264845 Jun 20 12:23:19.474297 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2567/5025] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:19 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1681 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:19.480863 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5f8cdc26-65ec-44ab-8ea1-b5916cf944da tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:19.482160 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5f8cdc26-65ec-44ab-8ea1-b5916cf944da tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:19.489565 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f8cdc26-65ec-44ab-8ea1-b5916cf944da tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:19.490625 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f8cdc26-65ec-44ab-8ea1-b5916cf944da tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:19.491942 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f8cdc26-65ec-44ab-8ea1-b5916cf944da tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:19.492906 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f8cdc26-65ec-44ab-8ea1-b5916cf944da tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:19.531943 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5f8cdc26-65ec-44ab-8ea1-b5916cf944da tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055698 Jun 20 12:23:19.533206 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2568/5026] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:23:19 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:23:19.655396 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cb75ed5d-d5ef-4f15-a77a-e07b033bb812 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:19.656001 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cb75ed5d-d5ef-4f15-a77a-e07b033bb812 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:19.681346 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cb75ed5d-d5ef-4f15-a77a-e07b033bb812 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:19.682161 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cb75ed5d-d5ef-4f15-a77a-e07b033bb812 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:19.683672 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cb75ed5d-d5ef-4f15-a77a-e07b033bb812 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:19.684464 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cb75ed5d-d5ef-4f15-a77a-e07b033bb812 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:19.740172 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cb75ed5d-d5ef-4f15-a77a-e07b033bb812 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:23:19.789177 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-99d603a7-1dc2-4756-ba3f-2ff65a71d424 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:19.801822 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-99d603a7-1dc2-4756-ba3f-2ff65a71d424 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 200 len: 1686 microversion: 2.1 time: 0.541801 Jun 20 12:23:19.802411 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2459/5027] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:19 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 1686 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:19.907400 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:19.942757 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cb75ed5d-d5ef-4f15-a77a-e07b033bb812 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "DELETE /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 204 len: 0 microversion: 2.1 time: 0.291129 Jun 20 12:23:19.946928 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2569/5028] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:23:19 2022] DELETE /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 12:23:20.176916 n-d-master-1 devstack@n-api.service[119127]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 12:23:20.177176 n-d-master-1 devstack@n-api.service[119127]: Mon Jun 20 12:23:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 12:23:20.274381 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-566ca39a-afa5-40e6-b716-341da9c49659 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:20.275885 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-566ca39a-afa5-40e6-b716-341da9c49659 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 98d6319f-8549-4882-aca9-060c2fab3a72] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:20.289359 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-566ca39a-afa5-40e6-b716-341da9c49659 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:20.290840 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-566ca39a-afa5-40e6-b716-341da9c49659 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:20.292752 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-566ca39a-afa5-40e6-b716-341da9c49659 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:20.296737 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-566ca39a-afa5-40e6-b716-341da9c49659 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:20.592459 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2341969b-d743-47a4-885f-c52b6263dad2 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:20.593661 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2341969b-d743-47a4-885f-c52b6263dad2 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:20.607470 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2341969b-d743-47a4-885f-c52b6263dad2 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:20.612864 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2341969b-d743-47a4-885f-c52b6263dad2 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:20.613971 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2341969b-d743-47a4-885f-c52b6263dad2 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:20.614616 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2341969b-d743-47a4-885f-c52b6263dad2 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:20.997827 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2341969b-d743-47a4-885f-c52b6263dad2 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:21.006256 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2341969b-d743-47a4-885f-c52b6263dad2 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1674 microversion: 2.1 time: 1.055131 Jun 20 12:23:21.014226 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2460/5029] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:19 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1674 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:21.021211 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9334289e-f557-40e9-985f-876a342db356 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:21.028643 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9334289e-f557-40e9-985f-876a342db356 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:21.047071 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9334289e-f557-40e9-985f-876a342db356 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:21.051121 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9334289e-f557-40e9-985f-876a342db356 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:21.052400 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9334289e-f557-40e9-985f-876a342db356 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:21.056898 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9334289e-f557-40e9-985f-876a342db356 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:21.287842 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-566ca39a-afa5-40e6-b716-341da9c49659 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7656081c0941463990b483b9db21536a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bcbf77cdc246e99f0a94398ed41a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:21.299584 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-566ca39a-afa5-40e6-b716-341da9c49659 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "GET /compute/v2.1/servers/98d6319f-8549-4882-aca9-060c2fab3a72" status: 200 len: 1319 microversion: 2.1 time: 1.031384 Jun 20 12:23:21.316828 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2570/5030] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:20 2022] GET /compute/v2.1/servers/98d6319f-8549-4882-aca9-060c2fab3a72 => generated 1319 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:21.329086 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-abe23598-4e70-4384-9c18-28318cb5173b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:21.330413 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-abe23598-4e70-4384-9c18-28318cb5173b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:21.346130 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-abe23598-4e70-4384-9c18-28318cb5173b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:21.347998 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-abe23598-4e70-4384-9c18-28318cb5173b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:21.353007 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-abe23598-4e70-4384-9c18-28318cb5173b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:21.353790 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-abe23598-4e70-4384-9c18-28318cb5173b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:21.409996 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9334289e-f557-40e9-985f-876a342db356 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:21.419191 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9334289e-f557-40e9-985f-876a342db356 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1681 microversion: 2.1 time: 0.402409 Jun 20 12:23:21.420059 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2461/5031] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:21 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1681 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:21.882597 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-abe23598-4e70-4384-9c18-28318cb5173b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:21.903127 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-abe23598-4e70-4384-9c18-28318cb5173b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 200 len: 1686 microversion: 2.1 time: 0.579227 Jun 20 12:23:21.915734 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2571/5032] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:21 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 1686 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:22.035748 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-22247caf-faa2-49e8-9f99-89d010b0f009 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:22.036406 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-22247caf-faa2-49e8-9f99-89d010b0f009 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:22.062635 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22247caf-faa2-49e8-9f99-89d010b0f009 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:22.063547 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22247caf-faa2-49e8-9f99-89d010b0f009 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:22.064454 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22247caf-faa2-49e8-9f99-89d010b0f009 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:22.064891 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22247caf-faa2-49e8-9f99-89d010b0f009 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:22.342040 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-06817a63-7555-4a1a-a7b0-51816bf51a60 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:22.348528 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-06817a63-7555-4a1a-a7b0-51816bf51a60 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 98d6319f-8549-4882-aca9-060c2fab3a72] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:22.372474 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06817a63-7555-4a1a-a7b0-51816bf51a60 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:22.373828 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06817a63-7555-4a1a-a7b0-51816bf51a60 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:22.377232 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06817a63-7555-4a1a-a7b0-51816bf51a60 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:22.378023 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06817a63-7555-4a1a-a7b0-51816bf51a60 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:22.416617 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:23.463106 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-22247caf-faa2-49e8-9f99-89d010b0f009 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:23.479046 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-22247caf-faa2-49e8-9f99-89d010b0f009 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1674 microversion: 2.1 time: 1.451380 Jun 20 12:23:23.483545 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2462/5033] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:22 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1674 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:23.502238 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4fd5b2c4-01cb-4e0d-b68b-e64481c73f0b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:23.506843 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4fd5b2c4-01cb-4e0d-b68b-e64481c73f0b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:23.532552 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4fd5b2c4-01cb-4e0d-b68b-e64481c73f0b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:23.533008 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4fd5b2c4-01cb-4e0d-b68b-e64481c73f0b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:23.533793 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4fd5b2c4-01cb-4e0d-b68b-e64481c73f0b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:23.540765 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4fd5b2c4-01cb-4e0d-b68b-e64481c73f0b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:24.062031 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-06817a63-7555-4a1a-a7b0-51816bf51a60 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7656081c0941463990b483b9db21536a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bcbf77cdc246e99f0a94398ed41a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:24.073799 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-06817a63-7555-4a1a-a7b0-51816bf51a60 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "GET /compute/v2.1/servers/98d6319f-8549-4882-aca9-060c2fab3a72" status: 200 len: 1319 microversion: 2.1 time: 1.752076 Jun 20 12:23:24.075711 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2572/5034] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:22 2022] GET /compute/v2.1/servers/98d6319f-8549-4882-aca9-060c2fab3a72 => generated 1319 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:24.119544 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-17e8e962-cb4a-48b9-b6b8-2df98521d7c2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:24.122959 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-17e8e962-cb4a-48b9-b6b8-2df98521d7c2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:24.160803 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17e8e962-cb4a-48b9-b6b8-2df98521d7c2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:24.165848 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17e8e962-cb4a-48b9-b6b8-2df98521d7c2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:24.170972 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17e8e962-cb4a-48b9-b6b8-2df98521d7c2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:24.171768 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17e8e962-cb4a-48b9-b6b8-2df98521d7c2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:24.670786 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4fd5b2c4-01cb-4e0d-b68b-e64481c73f0b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:24.707054 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4fd5b2c4-01cb-4e0d-b68b-e64481c73f0b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1681 microversion: 2.1 time: 1.222275 Jun 20 12:23:24.713614 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2463/5035] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:23 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1681 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:24.728266 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b23ecd09-64d8-45a7-811c-683e130c307f tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:24.735228 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b23ecd09-64d8-45a7-811c-683e130c307f tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:24.757858 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b23ecd09-64d8-45a7-811c-683e130c307f tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:24.760501 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b23ecd09-64d8-45a7-811c-683e130c307f tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:24.764730 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b23ecd09-64d8-45a7-811c-683e130c307f tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:24.766627 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b23ecd09-64d8-45a7-811c-683e130c307f tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:24.787526 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-17e8e962-cb4a-48b9-b6b8-2df98521d7c2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:24.801871 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-17e8e962-cb4a-48b9-b6b8-2df98521d7c2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 200 len: 1686 microversion: 2.1 time: 0.724550 Jun 20 12:23:24.802869 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2573/5036] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:24 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 1686 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:25.094264 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4d4e9695-1846-436b-b03c-da307e403cc2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:25.095602 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4d4e9695-1846-436b-b03c-da307e403cc2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 98d6319f-8549-4882-aca9-060c2fab3a72] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:25.107459 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d4e9695-1846-436b-b03c-da307e403cc2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:25.108504 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d4e9695-1846-436b-b03c-da307e403cc2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:25.111139 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d4e9695-1846-436b-b03c-da307e403cc2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:25.111596 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d4e9695-1846-436b-b03c-da307e403cc2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:25.589258 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4d4e9695-1846-436b-b03c-da307e403cc2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7656081c0941463990b483b9db21536a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bcbf77cdc246e99f0a94398ed41a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:25.603590 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4d4e9695-1846-436b-b03c-da307e403cc2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "GET /compute/v2.1/servers/98d6319f-8549-4882-aca9-060c2fab3a72" status: 200 len: 1319 microversion: 2.1 time: 0.514247 Jun 20 12:23:25.604542 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2574/5037] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:25 2022] GET /compute/v2.1/servers/98d6319f-8549-4882-aca9-060c2fab3a72 => generated 1319 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:25.686619 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-8a7c474b-8ae0-4835-a81d-a7fe6599b97a req-aa31ac25-3155-4e9d-8605-6171af9f8269 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25476e5c-8f10-449a-881b-2e9d9d1b2bfe", "name": "network-vif-deleted", "tag": "d4cffb2a-b881-48b3-9739-58fc13501c0e"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:25.701296 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-8a7c474b-8ae0-4835-a81d-a7fe6599b97a req-aa31ac25-3155-4e9d-8605-6171af9f8269 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:25.702931 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-8a7c474b-8ae0-4835-a81d-a7fe6599b97a req-aa31ac25-3155-4e9d-8605-6171af9f8269 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:25.724162 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-8a7c474b-8ae0-4835-a81d-a7fe6599b97a req-aa31ac25-3155-4e9d-8605-6171af9f8269 service nova] Creating event network-vif-deleted:d4cffb2a-b881-48b3-9739-58fc13501c0e for instance 25476e5c-8f10-449a-881b-2e9d9d1b2bfe on n-h2-master-1 Jun 20 12:23:25.733451 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-8a7c474b-8ae0-4835-a81d-a7fe6599b97a req-aa31ac25-3155-4e9d-8605-6171af9f8269 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049958 Jun 20 12:23:25.735634 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2575/5038] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:23:25.748795 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-91a5d6dd-0a2f-44b9-ba1e-36eca63902dc tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:25.749262 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-91a5d6dd-0a2f-44b9-ba1e-36eca63902dc tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:25.766599 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91a5d6dd-0a2f-44b9-ba1e-36eca63902dc tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:25.771287 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91a5d6dd-0a2f-44b9-ba1e-36eca63902dc tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:25.772732 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91a5d6dd-0a2f-44b9-ba1e-36eca63902dc tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:25.774958 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91a5d6dd-0a2f-44b9-ba1e-36eca63902dc tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:25.787130 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b23ecd09-64d8-45a7-811c-683e130c307f tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:25.804431 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b23ecd09-64d8-45a7-811c-683e130c307f tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1674 microversion: 2.1 time: 1.087293 Jun 20 12:23:25.805432 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2464/5039] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:24 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1674 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:25.816848 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-b8c760bf-a189-4ccf-a80f-4bcbbb7c1c82 req-dfe47784-be82-40b1-8420-cea38906d584 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98d6319f-8549-4882-aca9-060c2fab3a72", "name": "network-vif-plugged", "status": "completed", "tag": "a8394224-3f1e-4f85-af73-e88d2060b7a7"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:25.827945 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-b8c760bf-a189-4ccf-a80f-4bcbbb7c1c82 req-dfe47784-be82-40b1-8420-cea38906d584 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:25.839703 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-b8c760bf-a189-4ccf-a80f-4bcbbb7c1c82 req-dfe47784-be82-40b1-8420-cea38906d584 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:25.876848 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-b8c760bf-a189-4ccf-a80f-4bcbbb7c1c82 req-dfe47784-be82-40b1-8420-cea38906d584 service nova] Creating event network-vif-plugged:a8394224-3f1e-4f85-af73-e88d2060b7a7 for instance 98d6319f-8549-4882-aca9-060c2fab3a72 on n-h1-master-1 Jun 20 12:23:25.895217 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-b8c760bf-a189-4ccf-a80f-4bcbbb7c1c82 req-dfe47784-be82-40b1-8420-cea38906d584 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084396 Jun 20 12:23:25.897717 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2465/5040] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:23:25.924521 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e137a697-bcff-46f5-8470-dc6f8852c59d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:25.926435 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e137a697-bcff-46f5-8470-dc6f8852c59d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:25.942349 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e137a697-bcff-46f5-8470-dc6f8852c59d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:25.949155 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e137a697-bcff-46f5-8470-dc6f8852c59d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:25.950598 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e137a697-bcff-46f5-8470-dc6f8852c59d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:25.951316 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e137a697-bcff-46f5-8470-dc6f8852c59d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:26.006890 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e137a697-bcff-46f5-8470-dc6f8852c59d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:26.007674 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e137a697-bcff-46f5-8470-dc6f8852c59d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:26.008432 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-e137a697-bcff-46f5-8470-dc6f8852c59d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lazy-loading 'fault' on Instance uuid 25476e5c-8f10-449a-881b-2e9d9d1b2bfe {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:23:26.209547 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-91a5d6dd-0a2f-44b9-ba1e-36eca63902dc tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:26.222565 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-91a5d6dd-0a2f-44b9-ba1e-36eca63902dc tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1658 microversion: 2.1 time: 0.482137 Jun 20 12:23:26.223660 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2576/5041] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:25 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1658 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:26.244517 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-366c47d6-6007-4c1f-9dff-f76aec91fa0c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:26.253731 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-366c47d6-6007-4c1f-9dff-f76aec91fa0c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:26.255160 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-366c47d6-6007-4c1f-9dff-f76aec91fa0c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:26.281345 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e137a697-bcff-46f5-8470-dc6f8852c59d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:26.292472 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-366c47d6-6007-4c1f-9dff-f76aec91fa0c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Going to try to start instance {{(pid=119127) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 20 12:23:26.295345 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e137a697-bcff-46f5-8470-dc6f8852c59d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 200 len: 1357 microversion: 2.1 time: 0.395845 Jun 20 12:23:26.297432 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2466/5042] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:25 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 1357 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:26.371662 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-366c47d6-6007-4c1f-9dff-f76aec91fa0c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "POST /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/action" status: 202 len: 0 microversion: 2.1 time: 0.132797 Jun 20 12:23:26.381599 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2577/5043] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:23:26 2022] POST /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 12:23:26.382750 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-56fcecad-aaea-4daf-8f15-d746b5fe239a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:26.386183 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-56fcecad-aaea-4daf-8f15-d746b5fe239a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:26.395850 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-56fcecad-aaea-4daf-8f15-d746b5fe239a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:26.396652 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-56fcecad-aaea-4daf-8f15-d746b5fe239a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:26.399307 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-56fcecad-aaea-4daf-8f15-d746b5fe239a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:26.400030 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-56fcecad-aaea-4daf-8f15-d746b5fe239a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:26.623566 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-71630e3f-0e5b-4847-b2e1-3c0203cb44aa tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:26.624741 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-71630e3f-0e5b-4847-b2e1-3c0203cb44aa tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 98d6319f-8549-4882-aca9-060c2fab3a72] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:26.633297 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-71630e3f-0e5b-4847-b2e1-3c0203cb44aa tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:26.634069 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-71630e3f-0e5b-4847-b2e1-3c0203cb44aa tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:26.635034 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-71630e3f-0e5b-4847-b2e1-3c0203cb44aa tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:26.636328 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-71630e3f-0e5b-4847-b2e1-3c0203cb44aa tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:26.873178 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-56fcecad-aaea-4daf-8f15-d746b5fe239a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:26.888674 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-56fcecad-aaea-4daf-8f15-d746b5fe239a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1667 microversion: 2.1 time: 0.510631 Jun 20 12:23:26.889931 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2467/5044] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:26 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1667 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:26.922927 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cf1fa65d-689d-469b-b96d-9ef7ff1fec7c tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:26.924365 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cf1fa65d-689d-469b-b96d-9ef7ff1fec7c tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:26.938583 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cf1fa65d-689d-469b-b96d-9ef7ff1fec7c tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:26.939563 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cf1fa65d-689d-469b-b96d-9ef7ff1fec7c tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:26.940585 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cf1fa65d-689d-469b-b96d-9ef7ff1fec7c tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:26.941198 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cf1fa65d-689d-469b-b96d-9ef7ff1fec7c tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:27.046863 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-71630e3f-0e5b-4847-b2e1-3c0203cb44aa tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7656081c0941463990b483b9db21536a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bcbf77cdc246e99f0a94398ed41a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:27.061106 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-71630e3f-0e5b-4847-b2e1-3c0203cb44aa tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "GET /compute/v2.1/servers/98d6319f-8549-4882-aca9-060c2fab3a72" status: 200 len: 1319 microversion: 2.1 time: 0.441459 Jun 20 12:23:27.072587 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2578/5045] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:26 2022] GET /compute/v2.1/servers/98d6319f-8549-4882-aca9-060c2fab3a72 => generated 1319 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:27.208647 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-cf1fa65d-689d-469b-b96d-9ef7ff1fec7c tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:27.229436 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cf1fa65d-689d-469b-b96d-9ef7ff1fec7c tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1607 microversion: 2.1 time: 0.337851 Jun 20 12:23:27.231038 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2468/5046] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:26 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1607 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:27.321572 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2e647100-b577-4103-ba19-23b9d86a6c44 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:27.322538 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2e647100-b577-4103-ba19-23b9d86a6c44 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 25476e5c-8f10-449a-881b-2e9d9d1b2bfe] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:27.340404 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2e647100-b577-4103-ba19-23b9d86a6c44 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:27.341700 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2e647100-b577-4103-ba19-23b9d86a6c44 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:27.355136 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2e647100-b577-4103-ba19-23b9d86a6c44 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:27.357139 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2e647100-b577-4103-ba19-23b9d86a6c44 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:27.392030 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-2e647100-b577-4103-ba19-23b9d86a6c44 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] HTTP exception thrown: Instance 25476e5c-8f10-449a-881b-2e9d9d1b2bfe could not be found. Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2e647100-b577-4103-ba19-23b9d86a6c44 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Request method failure captured: Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe HTTP/1.1 Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGRxXwEWVrLndBXp9okenLjyhkdOBOwXRK4Cejibgug0y9gZVb-q35CPxL4ypqyn2D__W7NeZfrt6P6zq_dz_jtM9HHb9YjfilwN-Kw8EltvT9MAEPJplbU2PqTsTUjGeGogBzl7yp09NSZXdDKx25vj0o6ShE6q88hEvQEZpmuKykM Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 9e9e481852fe4e6ebdc15ec343a741f2 Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2045574846 Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9e9e481852fe4e6ebdc15ec343a741f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9e9e481852fe4e6ebdc15ec343a741f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9e9e481852fe4e6ebdc15ec343a741f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9e9e481852fe4e6ebdc15ec343a741f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2045574846 Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 9e9e481852fe4e6ebdc15ec343a741f2 Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2045574846 Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-TestNetworkAdvancedServerOps-2045574846-project Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: cd27c8696f7147e18054b26ebbae7045 Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2045574846-project Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 25476e5c-8f10-449a-881b-2e9d9d1b2bfe could not be found. Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '25476e5c-8f10-449a-881b-2e9d9d1b2bfe'} Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25476e5c-8f10-449a-881b-2e9d9d1b2bfe could not be found. Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25476e5c-8f10-449a-881b-2e9d9d1b2bfe could not be found. Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:23:27.394007 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:23:27.399384 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:23:27.399384 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:23:27.399384 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:23:27.399384 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:23:27.399384 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:23:27.399384 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:23:27.399384 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25476e5c-8f10-449a-881b-2e9d9d1b2bfe could not be found. Jun 20 12:23:27.399384 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:23:27.399384 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2e647100-b577-4103-ba19-23b9d86a6c44 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Returning 404 to user: Instance 25476e5c-8f10-449a-881b-2e9d9d1b2bfe could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:23:27.399384 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2e647100-b577-4103-ba19-23b9d86a6c44 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe" status: 404 len: 111 microversion: 2.1 time: 0.082510 Jun 20 12:23:27.400520 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2579/5047] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:27 2022] GET /compute/v2.1/servers/25476e5c-8f10-449a-881b-2e9d9d1b2bfe => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:23:27.908034 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-12350a98-8a87-43bb-a37f-2aca4bbd2219 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:27.909708 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-12350a98-8a87-43bb-a37f-2aca4bbd2219 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:27.921106 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-12350a98-8a87-43bb-a37f-2aca4bbd2219 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:27.922209 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-12350a98-8a87-43bb-a37f-2aca4bbd2219 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:27.923174 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-12350a98-8a87-43bb-a37f-2aca4bbd2219 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:27.927470 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-12350a98-8a87-43bb-a37f-2aca4bbd2219 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:27.966034 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-db0480a7-25ed-48f1-aaa8-676d0d3c0704 req-b941ec18-7559-4cf5-917b-ad01345412dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecf1523d-6981-4c99-a46f-8effe6f65df8", "name": "network-vif-plugged", "status": "completed", "tag": "6eee8771-92c2-430e-9c09-9a0476b1c109"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:27.984185 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-db0480a7-25ed-48f1-aaa8-676d0d3c0704 req-b941ec18-7559-4cf5-917b-ad01345412dc service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:27.986205 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-db0480a7-25ed-48f1-aaa8-676d0d3c0704 req-b941ec18-7559-4cf5-917b-ad01345412dc service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:28.010010 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-db0480a7-25ed-48f1-aaa8-676d0d3c0704 req-b941ec18-7559-4cf5-917b-ad01345412dc service nova] Creating event network-vif-plugged:6eee8771-92c2-430e-9c09-9a0476b1c109 for instance ecf1523d-6981-4c99-a46f-8effe6f65df8 on n-h2-master-1 Jun 20 12:23:28.016122 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-db0480a7-25ed-48f1-aaa8-676d0d3c0704 req-b941ec18-7559-4cf5-917b-ad01345412dc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059973 Jun 20 12:23:28.021151 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2580/5048] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:23:28.080231 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c7e6a0da-91d3-4cf1-96aa-bd1c2e464be7 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:28.081390 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c7e6a0da-91d3-4cf1-96aa-bd1c2e464be7 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 98d6319f-8549-4882-aca9-060c2fab3a72] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:28.096609 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c7e6a0da-91d3-4cf1-96aa-bd1c2e464be7 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:28.100634 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c7e6a0da-91d3-4cf1-96aa-bd1c2e464be7 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:28.102529 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c7e6a0da-91d3-4cf1-96aa-bd1c2e464be7 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:28.103221 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c7e6a0da-91d3-4cf1-96aa-bd1c2e464be7 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:28.788245 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-12350a98-8a87-43bb-a37f-2aca4bbd2219 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:28.804812 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-12350a98-8a87-43bb-a37f-2aca4bbd2219 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1667 microversion: 2.1 time: 0.893549 Jun 20 12:23:28.807757 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2469/5049] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:27 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1667 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:28.835186 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7d8d1e37-127c-487e-9fde-c68a93287d95 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:28.839717 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7d8d1e37-127c-487e-9fde-c68a93287d95 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:28.860563 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7d8d1e37-127c-487e-9fde-c68a93287d95 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:28.862848 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7d8d1e37-127c-487e-9fde-c68a93287d95 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:28.878429 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7d8d1e37-127c-487e-9fde-c68a93287d95 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:28.879225 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7d8d1e37-127c-487e-9fde-c68a93287d95 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:29.078715 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7d8d1e37-127c-487e-9fde-c68a93287d95 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:29.099221 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7d8d1e37-127c-487e-9fde-c68a93287d95 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1323 microversion: 2.1 time: 0.284857 Jun 20 12:23:29.103699 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2470/5050] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:28 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1323 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:29.113411 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-8b03a146-b71c-44e6-8817-c06fc96de0a0 req-199e5cbd-f8f0-4600-b0e1-b68dfb8cf1a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "442a5a56-7a8d-4804-ab29-515e6d314b19", "name": "network-vif-deleted", "tag": "f2aa724a-10fa-4182-ae95-b075493ddc8c"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:29.125617 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-8b03a146-b71c-44e6-8817-c06fc96de0a0 req-199e5cbd-f8f0-4600-b0e1-b68dfb8cf1a5 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:29.134843 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-8b03a146-b71c-44e6-8817-c06fc96de0a0 req-199e5cbd-f8f0-4600-b0e1-b68dfb8cf1a5 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:29.160877 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-8b03a146-b71c-44e6-8817-c06fc96de0a0 req-199e5cbd-f8f0-4600-b0e1-b68dfb8cf1a5 service nova] Creating event network-vif-deleted:f2aa724a-10fa-4182-ae95-b075493ddc8c for instance 442a5a56-7a8d-4804-ab29-515e6d314b19 on n-h2-master-1 Jun 20 12:23:29.189814 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-8b03a146-b71c-44e6-8817-c06fc96de0a0 req-199e5cbd-f8f0-4600-b0e1-b68dfb8cf1a5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084445 Jun 20 12:23:29.193345 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2471/5051] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:23:29.315158 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c7e6a0da-91d3-4cf1-96aa-bd1c2e464be7 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7656081c0941463990b483b9db21536a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bcbf77cdc246e99f0a94398ed41a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:29.332595 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c7e6a0da-91d3-4cf1-96aa-bd1c2e464be7 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "GET /compute/v2.1/servers/98d6319f-8549-4882-aca9-060c2fab3a72" status: 200 len: 1507 microversion: 2.1 time: 1.256974 Jun 20 12:23:29.343887 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2581/5052] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:28 2022] GET /compute/v2.1/servers/98d6319f-8549-4882-aca9-060c2fab3a72 => generated 1507 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:29.354701 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3a6695a6-d6ea-4b0e-8fe6-15f68081ba54 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:29.355414 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3a6695a6-d6ea-4b0e-8fe6-15f68081ba54 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: ecf1523d-6981-4c99-a46f-8effe6f65df8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:29.372262 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3a6695a6-d6ea-4b0e-8fe6-15f68081ba54 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:29.372728 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3a6695a6-d6ea-4b0e-8fe6-15f68081ba54 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:29.373521 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3a6695a6-d6ea-4b0e-8fe6-15f68081ba54 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:29.373964 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3a6695a6-d6ea-4b0e-8fe6-15f68081ba54 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:29.827547 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c33abc36-c329-4d3d-b86b-401bcf85b946 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:29.828175 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c33abc36-c329-4d3d-b86b-401bcf85b946 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:29.845521 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c33abc36-c329-4d3d-b86b-401bcf85b946 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:29.845647 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c33abc36-c329-4d3d-b86b-401bcf85b946 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:29.850246 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c33abc36-c329-4d3d-b86b-401bcf85b946 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:29.851024 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c33abc36-c329-4d3d-b86b-401bcf85b946 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:30.609572 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c33abc36-c329-4d3d-b86b-401bcf85b946 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:30.625591 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c33abc36-c329-4d3d-b86b-401bcf85b946 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1667 microversion: 2.1 time: 0.797426 Jun 20 12:23:30.627079 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2582/5053] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:29 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1667 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:30.637227 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1ef31931-f9b9-489b-a9a0-21cfc88c9a68 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:30.638585 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1ef31931-f9b9-489b-a9a0-21cfc88c9a68 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:30.657335 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1ef31931-f9b9-489b-a9a0-21cfc88c9a68 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:30.660244 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1ef31931-f9b9-489b-a9a0-21cfc88c9a68 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:30.667702 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1ef31931-f9b9-489b-a9a0-21cfc88c9a68 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:30.668595 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1ef31931-f9b9-489b-a9a0-21cfc88c9a68 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:30.715421 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1ef31931-f9b9-489b-a9a0-21cfc88c9a68 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:30.716262 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1ef31931-f9b9-489b-a9a0-21cfc88c9a68 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:30.716902 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-1ef31931-f9b9-489b-a9a0-21cfc88c9a68 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lazy-loading 'fault' on Instance uuid 442a5a56-7a8d-4804-ab29-515e6d314b19 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:23:30.815344 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1ef31931-f9b9-489b-a9a0-21cfc88c9a68 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:30.831112 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1ef31931-f9b9-489b-a9a0-21cfc88c9a68 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 200 len: 1328 microversion: 2.1 time: 0.199255 Jun 20 12:23:30.833791 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2583/5054] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:30 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 1328 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:30.859619 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3a6695a6-d6ea-4b0e-8fe6-15f68081ba54 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7656081c0941463990b483b9db21536a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bcbf77cdc246e99f0a94398ed41a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:30.874321 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3a6695a6-d6ea-4b0e-8fe6-15f68081ba54 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "GET /compute/v2.1/servers/ecf1523d-6981-4c99-a46f-8effe6f65df8" status: 200 len: 1319 microversion: 2.1 time: 1.524250 Jun 20 12:23:30.887169 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2472/5055] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:29 2022] GET /compute/v2.1/servers/ecf1523d-6981-4c99-a46f-8effe6f65df8 => generated 1319 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:31.649255 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-140ac39f-98c3-49ac-aa06-fe44c0be5a05 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:31.653441 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-140ac39f-98c3-49ac-aa06-fe44c0be5a05 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:31.667894 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-140ac39f-98c3-49ac-aa06-fe44c0be5a05 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:31.669347 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-140ac39f-98c3-49ac-aa06-fe44c0be5a05 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:31.673266 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-140ac39f-98c3-49ac-aa06-fe44c0be5a05 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:31.674848 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-140ac39f-98c3-49ac-aa06-fe44c0be5a05 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:31.850166 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d7bfb7c3-7c57-4fdb-8055-82da7fa1d875 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:31.850867 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d7bfb7c3-7c57-4fdb-8055-82da7fa1d875 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:31.864234 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d7bfb7c3-7c57-4fdb-8055-82da7fa1d875 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:31.890228 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d7bfb7c3-7c57-4fdb-8055-82da7fa1d875 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:31.893002 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d7bfb7c3-7c57-4fdb-8055-82da7fa1d875 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:31.901484 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d7bfb7c3-7c57-4fdb-8055-82da7fa1d875 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:31.940797 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-d7bfb7c3-7c57-4fdb-8055-82da7fa1d875 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] HTTP exception thrown: Instance 442a5a56-7a8d-4804-ab29-515e6d314b19 could not be found. Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d7bfb7c3-7c57-4fdb-8055-82da7fa1d875 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Request method failure captured: Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 HTTP/1.1 Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGWLkuKwKPjdKtUhc6dNGwsLHhL8Mdhfpzf_4vXVWLCDSgHqf13sQd-9LF3MGnQa8psDEc9JEkJzZSaw9_ikn85Q0ll0Nix-ZVBlwng9bwAGAqG_v56imSaNIrFE1kQs0xywtIhYs4nVxj6oFHlE90I0jsmgvQVO4a7me_Rr1FZasH4 Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: e32e6c9093de44cf932e533ee20b0e31 Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-AttachVolumeTestJSON-1076215088 Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e32e6c9093de44cf932e533ee20b0e31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e32e6c9093de44cf932e533ee20b0e31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e32e6c9093de44cf932e533ee20b0e31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e32e6c9093de44cf932e533ee20b0e31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-AttachVolumeTestJSON-1076215088 Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: e32e6c9093de44cf932e533ee20b0e31 Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1076215088 Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-AttachVolumeTestJSON-1076215088-project Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 0174505a4b2b404dbab8c4aaf399e057 Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-AttachVolumeTestJSON-1076215088-project Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 442a5a56-7a8d-4804-ab29-515e6d314b19 could not be found. Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '442a5a56-7a8d-4804-ab29-515e6d314b19'} Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 442a5a56-7a8d-4804-ab29-515e6d314b19 could not be found. Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 442a5a56-7a8d-4804-ab29-515e6d314b19 could not be found. Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:23:31.945454 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:23:31.950984 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:23:31.950984 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:23:31.950984 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:23:31.950984 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:23:31.950984 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:23:31.950984 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 442a5a56-7a8d-4804-ab29-515e6d314b19 could not be found. Jun 20 12:23:31.950984 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:23:31.953298 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d7bfb7c3-7c57-4fdb-8055-82da7fa1d875 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Returning 404 to user: Instance 442a5a56-7a8d-4804-ab29-515e6d314b19 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:23:31.956138 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d7bfb7c3-7c57-4fdb-8055-82da7fa1d875 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 404 len: 111 microversion: 2.1 time: 0.110477 Jun 20 12:23:31.957958 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2473/5056] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:31 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:23:31.968145 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9325d0f7-788e-4f74-86dd-5b25d8b4ca0b tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:31.971089 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9325d0f7-788e-4f74-86dd-5b25d8b4ca0b tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: ecf1523d-6981-4c99-a46f-8effe6f65df8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:31.986698 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9325d0f7-788e-4f74-86dd-5b25d8b4ca0b tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:31.987653 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9325d0f7-788e-4f74-86dd-5b25d8b4ca0b tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:31.988991 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9325d0f7-788e-4f74-86dd-5b25d8b4ca0b tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:31.991003 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9325d0f7-788e-4f74-86dd-5b25d8b4ca0b tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:32.065796 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-140ac39f-98c3-49ac-aa06-fe44c0be5a05 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:32.086278 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-140ac39f-98c3-49ac-aa06-fe44c0be5a05 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.441032 Jun 20 12:23:32.087192 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2584/5057] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:31 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:32.102486 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b152f454-315e-472f-9cff-e2094d284545 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '.version_select at 0x7f6072260a60>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:32.172588 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b152f454-315e-472f-9cff-e2094d284545 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2083230820" status: 202 len: 0 microversion: 2.1 time: 0.079611 Jun 20 12:23:32.176024 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2585/5058] 10.222.0.27 () {58 vars in 1220 bytes} [Mon Jun 20 12:23:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2083230820 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:23:32.190146 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a46322fd-4f2c-45bf-8ae2-8b6420a97fe5 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:32.194590 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a46322fd-4f2c-45bf-8ae2-8b6420a97fe5 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:32.212328 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a46322fd-4f2c-45bf-8ae2-8b6420a97fe5 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:32.214550 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a46322fd-4f2c-45bf-8ae2-8b6420a97fe5 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:32.217588 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a46322fd-4f2c-45bf-8ae2-8b6420a97fe5 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:32.219610 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a46322fd-4f2c-45bf-8ae2-8b6420a97fe5 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:32.600465 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9325d0f7-788e-4f74-86dd-5b25d8b4ca0b tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7656081c0941463990b483b9db21536a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bcbf77cdc246e99f0a94398ed41a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:32.622705 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9325d0f7-788e-4f74-86dd-5b25d8b4ca0b tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "GET /compute/v2.1/servers/ecf1523d-6981-4c99-a46f-8effe6f65df8" status: 200 len: 1507 microversion: 2.1 time: 0.663452 Jun 20 12:23:32.623499 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2474/5059] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:31 2022] GET /compute/v2.1/servers/ecf1523d-6981-4c99-a46f-8effe6f65df8 => generated 1507 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:32.648939 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-59edc7de-9f5a-4b70-ae16-d77c958dfde3 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:32.649551 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-59edc7de-9f5a-4b70-ae16-d77c958dfde3 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: ecf1523d-6981-4c99-a46f-8effe6f65df8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:32.699082 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-59edc7de-9f5a-4b70-ae16-d77c958dfde3 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:32.699569 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-59edc7de-9f5a-4b70-ae16-d77c958dfde3 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:32.700464 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-59edc7de-9f5a-4b70-ae16-d77c958dfde3 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:32.700901 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-59edc7de-9f5a-4b70-ae16-d77c958dfde3 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:32.744520 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:32.781689 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-59edc7de-9f5a-4b70-ae16-d77c958dfde3 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: ecf1523d-6981-4c99-a46f-8effe6f65df8] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:23:32.982453 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-59edc7de-9f5a-4b70-ae16-d77c958dfde3 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ecf1523d-6981-4c99-a46f-8effe6f65df8" status: 204 len: 0 microversion: 2.1 time: 0.339981 Jun 20 12:23:32.987697 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2475/5060] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:23:32 2022] DELETE /compute/v2.1/servers/ecf1523d-6981-4c99-a46f-8effe6f65df8 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:23:33.007485 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5545c341-6c9e-4ef8-93cb-c753d6bfaece tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:33.013935 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5545c341-6c9e-4ef8-93cb-c753d6bfaece tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 98d6319f-8549-4882-aca9-060c2fab3a72] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:33.027769 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5545c341-6c9e-4ef8-93cb-c753d6bfaece tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:33.029636 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5545c341-6c9e-4ef8-93cb-c753d6bfaece tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:33.034995 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5545c341-6c9e-4ef8-93cb-c753d6bfaece tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:33.042545 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5545c341-6c9e-4ef8-93cb-c753d6bfaece tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:33.096366 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5545c341-6c9e-4ef8-93cb-c753d6bfaece tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 98d6319f-8549-4882-aca9-060c2fab3a72] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:23:33.249929 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5545c341-6c9e-4ef8-93cb-c753d6bfaece tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "DELETE /compute/v2.1/servers/98d6319f-8549-4882-aca9-060c2fab3a72" status: 204 len: 0 microversion: 2.1 time: 0.258050 Jun 20 12:23:33.250854 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2476/5061] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:23:32 2022] DELETE /compute/v2.1/servers/98d6319f-8549-4882-aca9-060c2fab3a72 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:23:33.295226 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a46322fd-4f2c-45bf-8ae2-8b6420a97fe5 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:33.312626 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a46322fd-4f2c-45bf-8ae2-8b6420a97fe5 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 1.134108 Jun 20 12:23:33.313733 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2586/5062] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:32 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:33.333315 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7c388427-1166-43df-ae6a-0537bdd25a8a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:33.333953 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7c388427-1166-43df-ae6a-0537bdd25a8a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:33.357649 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7c388427-1166-43df-ae6a-0537bdd25a8a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:33.359941 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7c388427-1166-43df-ae6a-0537bdd25a8a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:33.364892 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7c388427-1166-43df-ae6a-0537bdd25a8a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:33.367727 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7c388427-1166-43df-ae6a-0537bdd25a8a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:33.450610 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7c388427-1166-43df-ae6a-0537bdd25a8a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Unlocking {{(pid=119128) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jun 20 12:23:33.497593 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7500aee4-c5a5-47ed-91c3-58ab187e02c2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1150022522", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "bb3077d7-6103-4c2d-996a-7b6fd28b64fa"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:33.537654 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7c388427-1166-43df-ae6a-0537bdd25a8a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "POST /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/action" status: 202 len: 0 microversion: 2.1 time: 0.207610 Jun 20 12:23:33.540551 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2477/5063] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:23:33 2022] POST /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:23:33.556639 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-61512e13-d7ac-4564-b4a4-792218bab637 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:33.557763 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-61512e13-d7ac-4564-b4a4-792218bab637 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:33.565458 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-61512e13-d7ac-4564-b4a4-792218bab637 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:33.566046 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-61512e13-d7ac-4564-b4a4-792218bab637 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:33.566957 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-61512e13-d7ac-4564-b4a4-792218bab637 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:33.567846 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-61512e13-d7ac-4564-b4a4-792218bab637 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:33.607521 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-7500aee4-c5a5-47ed-91c3-58ab187e02c2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] validate_networks() for [('bb3077d7-6103-4c2d-996a-7b6fd28b64fa', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:23:34.221932 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-61512e13-d7ac-4564-b4a4-792218bab637 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:34.241031 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-61512e13-d7ac-4564-b4a4-792218bab637 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.691874 Jun 20 12:23:34.241643 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2478/5064] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:33 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:34.261997 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-97ec637b-e376-4fec-b067-ced4bb1089e3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:34.262617 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-97ec637b-e376-4fec-b067-ced4bb1089e3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:34.282273 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-97ec637b-e376-4fec-b067-ced4bb1089e3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:34.282719 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-97ec637b-e376-4fec-b067-ced4bb1089e3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:34.283711 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-97ec637b-e376-4fec-b067-ced4bb1089e3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:34.284402 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-97ec637b-e376-4fec-b067-ced4bb1089e3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:35.439741 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-97ec637b-e376-4fec-b067-ced4bb1089e3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:35.456732 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-97ec637b-e376-4fec-b067-ced4bb1089e3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 1.198455 Jun 20 12:23:35.468258 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2479/5065] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:34 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:35.476698 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5b68cc69-a2d0-40df-b243-9a8da62557cc tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:35.478590 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5b68cc69-a2d0-40df-b243-9a8da62557cc tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:35.491292 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5b68cc69-a2d0-40df-b243-9a8da62557cc tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:35.492127 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5b68cc69-a2d0-40df-b243-9a8da62557cc tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:35.493276 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5b68cc69-a2d0-40df-b243-9a8da62557cc tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:35.501705 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5b68cc69-a2d0-40df-b243-9a8da62557cc tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:35.545304 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-7500aee4-c5a5-47ed-91c3-58ab187e02c2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:23:35.545839 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-7500aee4-c5a5-47ed-91c3-58ab187e02c2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:23:35.546124 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-7500aee4-c5a5-47ed-91c3-58ab187e02c2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:23:35.546898 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-7500aee4-c5a5-47ed-91c3-58ab187e02c2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:23:35.547315 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-7500aee4-c5a5-47ed-91c3-58ab187e02c2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:23:35.569121 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7500aee4-c5a5-47ed-91c3-58ab187e02c2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:35.570592 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7500aee4-c5a5-47ed-91c3-58ab187e02c2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:35.571437 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7500aee4-c5a5-47ed-91c3-58ab187e02c2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:35.571876 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7500aee4-c5a5-47ed-91c3-58ab187e02c2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:35.624431 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-7500aee4-c5a5-47ed-91c3-58ab187e02c2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Getting quotas for project 94bcbf77cdc246e99f0a94398ed41a08. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:23:35.637952 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-7500aee4-c5a5-47ed-91c3-58ab187e02c2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Getting quotas for user 7656081c0941463990b483b9db21536a and project 94bcbf77cdc246e99f0a94398ed41a08. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:23:35.688019 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7500aee4-c5a5-47ed-91c3-58ab187e02c2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Going to run 2 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:23:35.698777 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7500aee4-c5a5-47ed-91c3-58ab187e02c2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 9be6e8da-8751-4fc9-b839-dac8cb2aa0b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:23:35.792514 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7500aee4-c5a5-47ed-91c3-58ab187e02c2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=9be6e8da-8751-4fc9-b839-dac8cb2aa0b4,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:23:35.873328 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7500aee4-c5a5-47ed-91c3-58ab187e02c2 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.379699 Jun 20 12:23:35.874752 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2587/5066] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:23:33 2022] POST /compute/v2.1/servers => generated 32 bytes in 2382 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Jun 20 12:23:35.885491 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-155f2a96-f7a1-4565-95a4-2f5ff5191d21 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:35.893007 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-155f2a96-f7a1-4565-95a4-2f5ff5191d21 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7656081c0941463990b483b9db21536a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bcbf77cdc246e99f0a94398ed41a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:35.894806 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-155f2a96-f7a1-4565-95a4-2f5ff5191d21 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Searching by: {'deleted': False, 'project_id': '94bcbf77cdc246e99f0a94398ed41a08'} {{(pid=119127) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:23:35.966226 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-155f2a96-f7a1-4565-95a4-2f5ff5191d21 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:35.967051 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-155f2a96-f7a1-4565-95a4-2f5ff5191d21 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:35.968381 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-155f2a96-f7a1-4565-95a4-2f5ff5191d21 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:35.969095 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-155f2a96-f7a1-4565-95a4-2f5ff5191d21 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:36.024789 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.multi_cell_list [None req-155f2a96-f7a1-4565-95a4-2f5ff5191d21 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=119127) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 12:23:36.132710 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-155f2a96-f7a1-4565-95a4-2f5ff5191d21 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.253098 Jun 20 12:23:36.137408 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2588/5067] 10.222.0.27 () {58 vars in 1124 bytes} [Mon Jun 20 12:23:35 2022] GET /compute/v2.1/servers => generated 1335 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:36.165994 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5dfe93ed-902a-4849-a72e-4f2b0ad0f9ee tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:36.167048 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5dfe93ed-902a-4849-a72e-4f2b0ad0f9ee tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:36.484224 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5dfe93ed-902a-4849-a72e-4f2b0ad0f9ee tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7656081c0941463990b483b9db21536a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bcbf77cdc246e99f0a94398ed41a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:36.494652 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5dfe93ed-902a-4849-a72e-4f2b0ad0f9ee tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "GET /compute/v2.1/servers/69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c" status: 200 len: 1218 microversion: 2.1 time: 0.346726 Jun 20 12:23:36.496323 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2589/5068] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:36 2022] GET /compute/v2.1/servers/69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c => generated 1218 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:36.506827 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1229eb68-2908-44cb-a948-e3219c4c7169 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Action: 'create', calling method: .version_select at 0x7f6072200820>, body: {"keypair": {"name": "tempest-keypair-2010489312", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvh0it9VWMvET3f60N/XH2dPE6I2JEa8WgNCPU747s2xKyGiXyHFWprP/fLZO1Dui0eNBaHmYa6obiDFQ6tIuTPLWXADT4ZQGmzKHBEFVrk4kXkwQiCPS5huFvaPNzfUw=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:36.579479 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-1229eb68-2908-44cb-a948-e3219c4c7169 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Getting quotas for project e32e6c9093de44cf932e533ee20b0e31. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:23:36.613261 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-1229eb68-2908-44cb-a948-e3219c4c7169 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Getting quotas for user 0174505a4b2b404dbab8c4aaf399e057 and project e32e6c9093de44cf932e533ee20b0e31. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:23:36.691447 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1229eb68-2908-44cb-a948-e3219c4c7169 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.192482 Jun 20 12:23:36.701085 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2590/5069] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 12:23:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:23:36.730641 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5b68cc69-a2d0-40df-b243-9a8da62557cc tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:36.745333 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5b68cc69-a2d0-40df-b243-9a8da62557cc tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 1.272777 Jun 20 12:23:36.756839 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2480/5070] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:35 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:36.763300 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-74162a05-67c6-4ee9-811a-2638fb82649c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:36.764007 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-74162a05-67c6-4ee9-811a-2638fb82649c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:36.780266 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-74162a05-67c6-4ee9-811a-2638fb82649c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:36.781035 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-74162a05-67c6-4ee9-811a-2638fb82649c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:36.783130 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-74162a05-67c6-4ee9-811a-2638fb82649c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:36.785354 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-74162a05-67c6-4ee9-811a-2638fb82649c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:36.941049 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:36.963689 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-74162a05-67c6-4ee9-811a-2638fb82649c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "POST /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/action" status: 202 len: 0 microversion: 2.1 time: 0.204109 Jun 20 12:23:36.968904 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2591/5071] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:23:36 2022] POST /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:23:36.974061 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-480eab16-278f-464f-bffe-66906fe9afcd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:36.975157 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-480eab16-278f-464f-bffe-66906fe9afcd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:36.989256 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-480eab16-278f-464f-bffe-66906fe9afcd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:36.992476 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-480eab16-278f-464f-bffe-66906fe9afcd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:36.996656 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-480eab16-278f-464f-bffe-66906fe9afcd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:36.998935 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-480eab16-278f-464f-bffe-66906fe9afcd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:37.530867 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9bf4626b-2a8c-4f11-bcaf-139f4c1b6355 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:37.531969 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9bf4626b-2a8c-4f11-bcaf-139f4c1b6355 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:37.564934 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9bf4626b-2a8c-4f11-bcaf-139f4c1b6355 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:37.568089 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9bf4626b-2a8c-4f11-bcaf-139f4c1b6355 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:37.575116 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9bf4626b-2a8c-4f11-bcaf-139f4c1b6355 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:37.575807 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9bf4626b-2a8c-4f11-bcaf-139f4c1b6355 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:37.857204 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-480eab16-278f-464f-bffe-66906fe9afcd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:37.869946 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-480eab16-278f-464f-bffe-66906fe9afcd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1676 microversion: 2.1 time: 0.900100 Jun 20 12:23:37.872343 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2481/5072] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:36 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1676 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:37.966053 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9bf4626b-2a8c-4f11-bcaf-139f4c1b6355 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7656081c0941463990b483b9db21536a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bcbf77cdc246e99f0a94398ed41a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:37.979631 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9bf4626b-2a8c-4f11-bcaf-139f4c1b6355 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "GET /compute/v2.1/servers/69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c" status: 200 len: 1222 microversion: 2.1 time: 0.467594 Jun 20 12:23:37.983793 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2592/5073] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:37 2022] GET /compute/v2.1/servers/69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c => generated 1222 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:38.254758 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-e7a8ab86-df02-485e-9807-c0beb209d394 req-395d4d08-6cbc-4a45-9898-2dab9753c927 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecf1523d-6981-4c99-a46f-8effe6f65df8", "name": "network-vif-deleted", "tag": "6eee8771-92c2-430e-9c09-9a0476b1c109"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:38.306161 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e7a8ab86-df02-485e-9807-c0beb209d394 req-395d4d08-6cbc-4a45-9898-2dab9753c927 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:38.309694 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e7a8ab86-df02-485e-9807-c0beb209d394 req-395d4d08-6cbc-4a45-9898-2dab9753c927 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:38.342727 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-e7a8ab86-df02-485e-9807-c0beb209d394 req-395d4d08-6cbc-4a45-9898-2dab9753c927 service nova] Creating event network-vif-deleted:6eee8771-92c2-430e-9c09-9a0476b1c109 for instance ecf1523d-6981-4c99-a46f-8effe6f65df8 on n-h2-master-1 Jun 20 12:23:38.352099 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-e7a8ab86-df02-485e-9807-c0beb209d394 req-395d4d08-6cbc-4a45-9898-2dab9753c927 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113276 Jun 20 12:23:38.354144 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2482/5074] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:23:38.590414 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-0f09d4d9-7537-4d85-b444-42f9627d4ec0 req-dae53f7d-e90e-48f3-ae0e-776c762fc030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98d6319f-8549-4882-aca9-060c2fab3a72", "name": "network-vif-deleted", "tag": "a8394224-3f1e-4f85-af73-e88d2060b7a7"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:38.605332 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-0f09d4d9-7537-4d85-b444-42f9627d4ec0 req-dae53f7d-e90e-48f3-ae0e-776c762fc030 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:38.605789 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-0f09d4d9-7537-4d85-b444-42f9627d4ec0 req-dae53f7d-e90e-48f3-ae0e-776c762fc030 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:38.636721 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-0f09d4d9-7537-4d85-b444-42f9627d4ec0 req-dae53f7d-e90e-48f3-ae0e-776c762fc030 service nova] Creating event network-vif-deleted:a8394224-3f1e-4f85-af73-e88d2060b7a7 for instance 98d6319f-8549-4882-aca9-060c2fab3a72 on n-h1-master-1 Jun 20 12:23:38.653320 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-0f09d4d9-7537-4d85-b444-42f9627d4ec0 req-dae53f7d-e90e-48f3-ae0e-776c762fc030 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068314 Jun 20 12:23:38.657699 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2593/5075] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:23:38.900781 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dbdc382e-15c7-457d-8280-18f1f276db35 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:38.902932 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-dbdc382e-15c7-457d-8280-18f1f276db35 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:38.932292 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dbdc382e-15c7-457d-8280-18f1f276db35 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:38.933902 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dbdc382e-15c7-457d-8280-18f1f276db35 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:38.937022 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dbdc382e-15c7-457d-8280-18f1f276db35 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:38.938174 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dbdc382e-15c7-457d-8280-18f1f276db35 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:39.004658 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1d6fb8d5-34cb-4f17-90d9-ff57876058c4 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:39.005463 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1d6fb8d5-34cb-4f17-90d9-ff57876058c4 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:39.018953 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1d6fb8d5-34cb-4f17-90d9-ff57876058c4 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:39.019795 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1d6fb8d5-34cb-4f17-90d9-ff57876058c4 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:39.021217 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1d6fb8d5-34cb-4f17-90d9-ff57876058c4 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:39.022180 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1d6fb8d5-34cb-4f17-90d9-ff57876058c4 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:39.542226 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1d6fb8d5-34cb-4f17-90d9-ff57876058c4 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7656081c0941463990b483b9db21536a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bcbf77cdc246e99f0a94398ed41a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:39.557756 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1d6fb8d5-34cb-4f17-90d9-ff57876058c4 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "GET /compute/v2.1/servers/69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c" status: 200 len: 1276 microversion: 2.1 time: 0.559958 Jun 20 12:23:39.571154 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2594/5076] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:38 2022] GET /compute/v2.1/servers/69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c => generated 1276 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:40.082267 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-dbdc382e-15c7-457d-8280-18f1f276db35 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:40.092899 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dbdc382e-15c7-457d-8280-18f1f276db35 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1656 microversion: 2.1 time: 1.207303 Jun 20 12:23:40.096522 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2483/5077] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:38 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1656 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:40.112512 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e15c9d7f-6b9c-4f26-a821-280aa6eb0cae tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:40.113789 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e15c9d7f-6b9c-4f26-a821-280aa6eb0cae tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:40.129525 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e15c9d7f-6b9c-4f26-a821-280aa6eb0cae tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:40.130305 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e15c9d7f-6b9c-4f26-a821-280aa6eb0cae tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:40.131193 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e15c9d7f-6b9c-4f26-a821-280aa6eb0cae tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:40.131595 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e15c9d7f-6b9c-4f26-a821-280aa6eb0cae tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:40.280074 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e15c9d7f-6b9c-4f26-a821-280aa6eb0cae tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "POST /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/action" status: 202 len: 0 microversion: 2.1 time: 0.172447 Jun 20 12:23:40.280830 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2595/5078] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:23:40 2022] POST /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:23:40.291784 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6ae9232a-4dda-44a3-9ced-ed963fa9cda8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:40.292686 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6ae9232a-4dda-44a3-9ced-ed963fa9cda8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:40.299702 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:40.326528 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ae9232a-4dda-44a3-9ced-ed963fa9cda8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:40.331631 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ae9232a-4dda-44a3-9ced-ed963fa9cda8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:40.337180 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ae9232a-4dda-44a3-9ced-ed963fa9cda8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:40.339357 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ae9232a-4dda-44a3-9ced-ed963fa9cda8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:40.576957 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fdc15061-19f7-4546-80f1-9fdb9da92b1a tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:40.577883 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fdc15061-19f7-4546-80f1-9fdb9da92b1a tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:40.591695 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fdc15061-19f7-4546-80f1-9fdb9da92b1a tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:40.597448 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fdc15061-19f7-4546-80f1-9fdb9da92b1a tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:40.598853 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fdc15061-19f7-4546-80f1-9fdb9da92b1a tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:40.599505 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fdc15061-19f7-4546-80f1-9fdb9da92b1a tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:41.094530 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fdc15061-19f7-4546-80f1-9fdb9da92b1a tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7656081c0941463990b483b9db21536a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bcbf77cdc246e99f0a94398ed41a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:41.111935 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fdc15061-19f7-4546-80f1-9fdb9da92b1a tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "GET /compute/v2.1/servers/69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c" status: 200 len: 1276 microversion: 2.1 time: 0.537987 Jun 20 12:23:41.116709 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2596/5079] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:40 2022] GET /compute/v2.1/servers/69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c => generated 1276 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:41.844234 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6ae9232a-4dda-44a3-9ced-ed963fa9cda8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:41.864725 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6ae9232a-4dda-44a3-9ced-ed963fa9cda8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1663 microversion: 2.1 time: 1.575399 Jun 20 12:23:41.867576 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2484/5080] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:40 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1663 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:42.130790 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cf908302-fc85-4502-931b-87662d8a5f32 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:42.131522 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cf908302-fc85-4502-931b-87662d8a5f32 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:42.155186 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cf908302-fc85-4502-931b-87662d8a5f32 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:42.155649 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cf908302-fc85-4502-931b-87662d8a5f32 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:42.156469 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cf908302-fc85-4502-931b-87662d8a5f32 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:42.156917 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cf908302-fc85-4502-931b-87662d8a5f32 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:42.438369 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cf908302-fc85-4502-931b-87662d8a5f32 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7656081c0941463990b483b9db21536a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bcbf77cdc246e99f0a94398ed41a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:42.451109 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cf908302-fc85-4502-931b-87662d8a5f32 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "GET /compute/v2.1/servers/69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c" status: 200 len: 1276 microversion: 2.1 time: 0.324697 Jun 20 12:23:42.453332 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2597/5081] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:42 2022] GET /compute/v2.1/servers/69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c => generated 1276 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:42.907811 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-10e598d6-250c-4cc0-a2ef-5995c5d3db90 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:42.912514 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-10e598d6-250c-4cc0-a2ef-5995c5d3db90 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:42.961112 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-10e598d6-250c-4cc0-a2ef-5995c5d3db90 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:42.965542 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-10e598d6-250c-4cc0-a2ef-5995c5d3db90 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:42.968581 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-10e598d6-250c-4cc0-a2ef-5995c5d3db90 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:42.970238 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-10e598d6-250c-4cc0-a2ef-5995c5d3db90 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:43.473707 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-39ba13b1-1010-4927-8fb1-de7b51cc5270 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:43.475923 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-39ba13b1-1010-4927-8fb1-de7b51cc5270 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:43.487663 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-39ba13b1-1010-4927-8fb1-de7b51cc5270 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:43.491082 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-39ba13b1-1010-4927-8fb1-de7b51cc5270 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:43.495343 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-39ba13b1-1010-4927-8fb1-de7b51cc5270 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:43.495901 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-39ba13b1-1010-4927-8fb1-de7b51cc5270 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:43.867384 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-10e598d6-250c-4cc0-a2ef-5995c5d3db90 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:43.884849 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-10e598d6-250c-4cc0-a2ef-5995c5d3db90 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 1.003834 Jun 20 12:23:43.886310 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2485/5082] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:42 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:43.905040 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ba2c5cf3-bead-417f-8e96-79e17746a32e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:43.906444 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ba2c5cf3-bead-417f-8e96-79e17746a32e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:43.924986 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba2c5cf3-bead-417f-8e96-79e17746a32e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:43.931153 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba2c5cf3-bead-417f-8e96-79e17746a32e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:43.932412 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba2c5cf3-bead-417f-8e96-79e17746a32e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:43.934638 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba2c5cf3-bead-417f-8e96-79e17746a32e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:44.377258 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-39ba13b1-1010-4927-8fb1-de7b51cc5270 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7656081c0941463990b483b9db21536a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bcbf77cdc246e99f0a94398ed41a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:44.393823 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-39ba13b1-1010-4927-8fb1-de7b51cc5270 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "GET /compute/v2.1/servers/69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c" status: 200 len: 1318 microversion: 2.1 time: 0.924850 Jun 20 12:23:44.394838 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2598/5083] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:43 2022] GET /compute/v2.1/servers/69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c => generated 1318 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:44.432818 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ba2c5cf3-bead-417f-8e96-79e17746a32e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:44.437871 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:44.445124 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ba2c5cf3-bead-417f-8e96-79e17746a32e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.546081 Jun 20 12:23:44.449938 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2486/5084] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:43 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:44.472929 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-68eb8b8f-8fd8-4ac8-ad3d-1aba577563c2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:44.473546 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-68eb8b8f-8fd8-4ac8-ad3d-1aba577563c2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:44.481218 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-68eb8b8f-8fd8-4ac8-ad3d-1aba577563c2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:44.482405 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-68eb8b8f-8fd8-4ac8-ad3d-1aba577563c2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:44.483372 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-68eb8b8f-8fd8-4ac8-ad3d-1aba577563c2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:44.483983 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-68eb8b8f-8fd8-4ac8-ad3d-1aba577563c2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:44.932394 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-68eb8b8f-8fd8-4ac8-ad3d-1aba577563c2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:44.941084 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-68eb8b8f-8fd8-4ac8-ad3d-1aba577563c2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.472335 Jun 20 12:23:44.944464 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2599/5085] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:44 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:44.960779 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1e288f5e-12b0-4ab5-9ce3-19f10394365e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:44.961394 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1e288f5e-12b0-4ab5-9ce3-19f10394365e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:44.981455 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e288f5e-12b0-4ab5-9ce3-19f10394365e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:44.982334 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e288f5e-12b0-4ab5-9ce3-19f10394365e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:44.983426 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e288f5e-12b0-4ab5-9ce3-19f10394365e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:44.985365 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e288f5e-12b0-4ab5-9ce3-19f10394365e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:45.052262 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f9b32c85-733d-4929-b828-8f9da2526ccc tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-433659312", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93744e5c-d7f7-4f82-a5ab-ad936f4a3557"}], "security_groups": [{"name": "tempest-securitygroup--39571858"}], "key_name": "tempest-keypair-2010489312", "user_data": "}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:45.346882 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-f9b32c85-733d-4929-b828-8f9da2526ccc tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] validate_networks() for [('93744e5c-d7f7-4f82-a5ab-ad936f4a3557', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:23:45.395399 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1e288f5e-12b0-4ab5-9ce3-19f10394365e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:45.409339 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1e288f5e-12b0-4ab5-9ce3-19f10394365e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.453197 Jun 20 12:23:45.411833 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2487/5086] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:44 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:45.424009 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-78375403-ce88-4fd3-afbe-337b72bff8ad tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:45.425761 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-78375403-ce88-4fd3-afbe-337b72bff8ad tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:45.440522 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-78375403-ce88-4fd3-afbe-337b72bff8ad tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:45.446342 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-78375403-ce88-4fd3-afbe-337b72bff8ad tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:45.447805 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-78375403-ce88-4fd3-afbe-337b72bff8ad tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:45.456620 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-78375403-ce88-4fd3-afbe-337b72bff8ad tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:45.841469 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-78375403-ce88-4fd3-afbe-337b72bff8ad tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7656081c0941463990b483b9db21536a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bcbf77cdc246e99f0a94398ed41a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:45.857808 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-78375403-ce88-4fd3-afbe-337b72bff8ad tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "GET /compute/v2.1/servers/69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c" status: 200 len: 1318 microversion: 2.1 time: 0.444282 Jun 20 12:23:45.862092 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2488/5087] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:45 2022] GET /compute/v2.1/servers/69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c => generated 1318 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:45.874370 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3ad8809b-b450-4f34-acab-b2b9d3d142a3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:45.879497 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3ad8809b-b450-4f34-acab-b2b9d3d142a3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:45.895555 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3ad8809b-b450-4f34-acab-b2b9d3d142a3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:45.896480 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3ad8809b-b450-4f34-acab-b2b9d3d142a3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:45.898452 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3ad8809b-b450-4f34-acab-b2b9d3d142a3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:45.899798 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3ad8809b-b450-4f34-acab-b2b9d3d142a3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:45.986913 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=4 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:46.114068 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3ad8809b-b450-4f34-acab-b2b9d3d142a3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:46.125377 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3ad8809b-b450-4f34-acab-b2b9d3d142a3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.261778 Jun 20 12:23:46.125985 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2489/5088] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:45 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:46.144385 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6638725f-10c7-4590-90e9-de7d263bbde8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:46.145456 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6638725f-10c7-4590-90e9-de7d263bbde8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:46.152708 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6638725f-10c7-4590-90e9-de7d263bbde8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:46.153574 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6638725f-10c7-4590-90e9-de7d263bbde8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:46.154612 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6638725f-10c7-4590-90e9-de7d263bbde8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:46.155270 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6638725f-10c7-4590-90e9-de7d263bbde8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:46.526039 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6638725f-10c7-4590-90e9-de7d263bbde8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:46.536547 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6638725f-10c7-4590-90e9-de7d263bbde8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.397190 Jun 20 12:23:46.551334 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2490/5089] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:46 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:46.558212 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f3cf687b-f7ff-4b7c-aca8-905f139ee287 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '.version_select at 0x7f60733244c0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:46.585887 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f3cf687b-f7ff-4b7c-aca8-905f139ee287 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1955254088" status: 202 len: 0 microversion: 2.1 time: 0.032927 Jun 20 12:23:46.587152 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2491/5090] 10.222.0.27 () {58 vars in 1283 bytes} [Mon Jun 20 12:23:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1955254088 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:23:46.628469 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a848dc7a-fcad-4265-9fd5-e66bef9af746 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Action: 'create', calling method: .version_select at 0x7f60729a3160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-690292039", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNalwd6UhX+3Vh6+Vl/osb1y0UK6couQp49wegYdnjpXYGh4kYWCJTR1L43HOoU7F3+5r22Y2dsfg6Ia5zrg09mHITySO/kdtreJGczsLhUelStk0ZsFRa7FM6B3icfWcw=="}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:46.637697 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=12 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:46.653516 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-a848dc7a-fcad-4265-9fd5-e66bef9af746 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Getting quotas for project 9e9e481852fe4e6ebdc15ec343a741f2. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:23:46.658828 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:46.663732 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-a848dc7a-fcad-4265-9fd5-e66bef9af746 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Getting quotas for user cd27c8696f7147e18054b26ebbae7045 and project 9e9e481852fe4e6ebdc15ec343a741f2. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:23:46.696417 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a848dc7a-fcad-4265-9fd5-e66bef9af746 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.073109 Jun 20 12:23:46.697991 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2492/5091] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 12:23:46 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:23:46.878352 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e431510c-fffe-468e-b993-6adf1cbe03a8 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:46.879552 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e431510c-fffe-468e-b993-6adf1cbe03a8 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:46.886664 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e431510c-fffe-468e-b993-6adf1cbe03a8 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:46.887896 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e431510c-fffe-468e-b993-6adf1cbe03a8 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:46.888958 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e431510c-fffe-468e-b993-6adf1cbe03a8 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:46.889534 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e431510c-fffe-468e-b993-6adf1cbe03a8 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:47.358431 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-f9b32c85-733d-4929-b828-8f9da2526ccc tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:23:47.358950 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-f9b32c85-733d-4929-b828-8f9da2526ccc tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:23:47.359448 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-f9b32c85-733d-4929-b828-8f9da2526ccc tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:23:47.359868 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-f9b32c85-733d-4929-b828-8f9da2526ccc tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:23:47.360458 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-f9b32c85-733d-4929-b828-8f9da2526ccc tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:23:47.377392 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9b32c85-733d-4929-b828-8f9da2526ccc tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:47.379078 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9b32c85-733d-4929-b828-8f9da2526ccc tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:47.380098 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9b32c85-733d-4929-b828-8f9da2526ccc tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:47.382998 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9b32c85-733d-4929-b828-8f9da2526ccc tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:47.409460 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-f9b32c85-733d-4929-b828-8f9da2526ccc tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Getting quotas for project e32e6c9093de44cf932e533ee20b0e31. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:23:47.424931 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-f9b32c85-733d-4929-b828-8f9da2526ccc tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Getting quotas for user 0174505a4b2b404dbab8c4aaf399e057 and project e32e6c9093de44cf932e533ee20b0e31. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:23:47.460024 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e431510c-fffe-468e-b993-6adf1cbe03a8 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7656081c0941463990b483b9db21536a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bcbf77cdc246e99f0a94398ed41a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:47.465782 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f9b32c85-733d-4929-b828-8f9da2526ccc tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:23:47.470596 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f9b32c85-733d-4929-b828-8f9da2526ccc tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 5b047d91-122c-44ee-b96e-1e0836960caa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:23:47.472698 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e431510c-fffe-468e-b993-6adf1cbe03a8 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "GET /compute/v2.1/servers/69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c" status: 200 len: 1318 microversion: 2.1 time: 0.597076 Jun 20 12:23:47.475932 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2493/5092] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:46 2022] GET /compute/v2.1/servers/69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c => generated 1318 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:47.487416 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-80c201d9-24b8-4112-b5d0-dc8f40e99812 req-16fccd03-bdb8-4011-9cae-9481f6dee1c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c", "tag": "194226fb-d5e0-469e-b28d-d34a807393bf"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:47.521711 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-80c201d9-24b8-4112-b5d0-dc8f40e99812 req-16fccd03-bdb8-4011-9cae-9481f6dee1c9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:47.521711 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-80c201d9-24b8-4112-b5d0-dc8f40e99812 req-16fccd03-bdb8-4011-9cae-9481f6dee1c9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:47.543825 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-80c201d9-24b8-4112-b5d0-dc8f40e99812 req-16fccd03-bdb8-4011-9cae-9481f6dee1c9 service nova] Creating event network-changed:194226fb-d5e0-469e-b28d-d34a807393bf for instance 69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c on n-h1-master-1 Jun 20 12:23:47.550891 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-80c201d9-24b8-4112-b5d0-dc8f40e99812 req-16fccd03-bdb8-4011-9cae-9481f6dee1c9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072512 Jun 20 12:23:47.553592 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2494/5093] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:23:47.583192 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f9b32c85-733d-4929-b828-8f9da2526ccc tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.535222 Jun 20 12:23:47.588000 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2600/5094] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:23:45 2022] POST /compute/v2.1/servers => generated 400 bytes in 2541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:23:47.596891 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7b43b593-1225-4832-9766-eab911a158e9 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:47.598120 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7b43b593-1225-4832-9766-eab911a158e9 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 5b047d91-122c-44ee-b96e-1e0836960caa] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:47.710727 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7b43b593-1225-4832-9766-eab911a158e9 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:47.726089 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7b43b593-1225-4832-9766-eab911a158e9 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa" status: 200 len: 1237 microversion: 2.1 time: 0.134530 Jun 20 12:23:47.739250 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2495/5095] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:47 2022] GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa => generated 1237 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:48.492772 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a847aaba-abee-40db-8526-82dbe706c579 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:48.493421 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a847aaba-abee-40db-8526-82dbe706c579 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:48.511851 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a847aaba-abee-40db-8526-82dbe706c579 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:48.512343 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a847aaba-abee-40db-8526-82dbe706c579 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:48.513987 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a847aaba-abee-40db-8526-82dbe706c579 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:48.514425 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a847aaba-abee-40db-8526-82dbe706c579 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:48.747931 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0f007085-4920-4352-836d-26c50ffea3e0 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:48.749015 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0f007085-4920-4352-836d-26c50ffea3e0 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 5b047d91-122c-44ee-b96e-1e0836960caa] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:48.774530 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f007085-4920-4352-836d-26c50ffea3e0 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:48.775138 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f007085-4920-4352-836d-26c50ffea3e0 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:48.778117 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f007085-4920-4352-836d-26c50ffea3e0 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:48.778838 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f007085-4920-4352-836d-26c50ffea3e0 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:48.930626 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0f007085-4920-4352-836d-26c50ffea3e0 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:48.946955 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0f007085-4920-4352-836d-26c50ffea3e0 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa" status: 200 len: 1289 microversion: 2.1 time: 0.203582 Jun 20 12:23:48.963788 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2496/5096] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:48 2022] GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa => generated 1289 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:49.059419 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a847aaba-abee-40db-8526-82dbe706c579 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7656081c0941463990b483b9db21536a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bcbf77cdc246e99f0a94398ed41a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:49.071438 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a847aaba-abee-40db-8526-82dbe706c579 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "GET /compute/v2.1/servers/69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c" status: 200 len: 1318 microversion: 2.1 time: 0.583329 Jun 20 12:23:49.072921 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2601/5097] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:48 2022] GET /compute/v2.1/servers/69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c => generated 1318 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:49.975048 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d68f0e93-9b38-4666-b0e0-915eec1bceea tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:49.977694 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d68f0e93-9b38-4666-b0e0-915eec1bceea tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 5b047d91-122c-44ee-b96e-1e0836960caa] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:50.023548 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d68f0e93-9b38-4666-b0e0-915eec1bceea tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:50.025184 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d68f0e93-9b38-4666-b0e0-915eec1bceea tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:50.027260 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d68f0e93-9b38-4666-b0e0-915eec1bceea tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:50.031497 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d68f0e93-9b38-4666-b0e0-915eec1bceea tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:50.089303 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ab9787b4-fcbc-4b78-9273-cbbe555d303e tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:50.090573 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ab9787b4-fcbc-4b78-9273-cbbe555d303e tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:50.109447 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ab9787b4-fcbc-4b78-9273-cbbe555d303e tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:50.110101 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ab9787b4-fcbc-4b78-9273-cbbe555d303e tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:50.111072 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ab9787b4-fcbc-4b78-9273-cbbe555d303e tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:50.111682 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ab9787b4-fcbc-4b78-9273-cbbe555d303e tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:50.479485 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d68f0e93-9b38-4666-b0e0-915eec1bceea tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:50.492251 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d68f0e93-9b38-4666-b0e0-915eec1bceea tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa" status: 200 len: 1295 microversion: 2.1 time: 0.526380 Jun 20 12:23:50.494992 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2497/5098] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:49 2022] GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa => generated 1295 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:50.505236 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-531530b1-f40b-4ffe-a7a9-4a465497e9d7 req-043ad903-5b9b-44eb-b38c-0629c4b246bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9be6e8da-8751-4fc9-b839-dac8cb2aa0b4", "tag": "960efdfb-aa20-4057-ac09-99321d2186ce"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:50.530532 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-531530b1-f40b-4ffe-a7a9-4a465497e9d7 req-043ad903-5b9b-44eb-b38c-0629c4b246bc service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:50.531480 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-531530b1-f40b-4ffe-a7a9-4a465497e9d7 req-043ad903-5b9b-44eb-b38c-0629c4b246bc service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:50.567572 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-531530b1-f40b-4ffe-a7a9-4a465497e9d7 req-043ad903-5b9b-44eb-b38c-0629c4b246bc service nova] Creating event network-changed:960efdfb-aa20-4057-ac09-99321d2186ce for instance 9be6e8da-8751-4fc9-b839-dac8cb2aa0b4 on n-h2-master-1 Jun 20 12:23:50.581364 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-531530b1-f40b-4ffe-a7a9-4a465497e9d7 req-043ad903-5b9b-44eb-b38c-0629c4b246bc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081808 Jun 20 12:23:50.583733 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2498/5099] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:23:50.985796 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-687f21e9-4c4e-4f5d-bb11-08266b322892 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Action: 'create', calling method: .version_select at 0x7f6073b78af0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-970871994", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcNe0APVigs0ydhGmSmWXsrY0UuypIz4PVCA/S18UYfSxcgMpfzMVVgRQllxBJJeMUQWFfBsUIkwKDpkocE5ROFNMhX7kej8ZiDd0z65csX6QzczfdGkr8Yl3hon1EDqQ=="}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:51.049370 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-687f21e9-4c4e-4f5d-bb11-08266b322892 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Getting quotas for project 1ed88b4072a24b37a5ceec3b239ac8fa. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:23:51.069820 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-687f21e9-4c4e-4f5d-bb11-08266b322892 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Getting quotas for user aeafcd88ca6c415e90b51c262b62597f and project 1ed88b4072a24b37a5ceec3b239ac8fa. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:23:51.118024 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ab9787b4-fcbc-4b78-9273-cbbe555d303e tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7656081c0941463990b483b9db21536a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bcbf77cdc246e99f0a94398ed41a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:51.135060 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ab9787b4-fcbc-4b78-9273-cbbe555d303e tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "GET /compute/v2.1/servers/69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c" status: 200 len: 1318 microversion: 2.1 time: 1.049760 Jun 20 12:23:51.145438 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2602/5100] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:50 2022] GET /compute/v2.1/servers/69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c => generated 1318 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:51.149449 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-687f21e9-4c4e-4f5d-bb11-08266b322892 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.179355 Jun 20 12:23:51.155084 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2499/5101] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 12:23:50 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:23:51.512100 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3a016cbb-b194-4b2b-aa91-cdf55b9a7bb8 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:51.512786 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3a016cbb-b194-4b2b-aa91-cdf55b9a7bb8 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 5b047d91-122c-44ee-b96e-1e0836960caa] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:51.525740 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a016cbb-b194-4b2b-aa91-cdf55b9a7bb8 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:51.526572 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a016cbb-b194-4b2b-aa91-cdf55b9a7bb8 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:51.527674 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a016cbb-b194-4b2b-aa91-cdf55b9a7bb8 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:51.528329 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a016cbb-b194-4b2b-aa91-cdf55b9a7bb8 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:51.709223 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3a016cbb-b194-4b2b-aa91-cdf55b9a7bb8 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:51.726649 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3a016cbb-b194-4b2b-aa91-cdf55b9a7bb8 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa" status: 200 len: 1295 microversion: 2.1 time: 0.218564 Jun 20 12:23:51.728122 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2603/5102] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:51 2022] GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa => generated 1295 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:52.156787 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-23582568-d26b-4857-88b9-5db889f121e9 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:52.157545 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-23582568-d26b-4857-88b9-5db889f121e9 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:52.173864 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23582568-d26b-4857-88b9-5db889f121e9 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:52.178086 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23582568-d26b-4857-88b9-5db889f121e9 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:52.183947 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23582568-d26b-4857-88b9-5db889f121e9 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:52.185014 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23582568-d26b-4857-88b9-5db889f121e9 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:52.744941 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bfbfc9aa-d2e8-42d5-9abb-1a7fd3269d37 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:52.745612 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bfbfc9aa-d2e8-42d5-9abb-1a7fd3269d37 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 5b047d91-122c-44ee-b96e-1e0836960caa] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:52.776367 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bfbfc9aa-d2e8-42d5-9abb-1a7fd3269d37 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:52.778104 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bfbfc9aa-d2e8-42d5-9abb-1a7fd3269d37 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:52.782101 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bfbfc9aa-d2e8-42d5-9abb-1a7fd3269d37 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:52.782883 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bfbfc9aa-d2e8-42d5-9abb-1a7fd3269d37 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:52.854920 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-23582568-d26b-4857-88b9-5db889f121e9 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7656081c0941463990b483b9db21536a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bcbf77cdc246e99f0a94398ed41a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:52.878892 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-23582568-d26b-4857-88b9-5db889f121e9 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "GET /compute/v2.1/servers/69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c" status: 200 len: 1318 microversion: 2.1 time: 0.729905 Jun 20 12:23:52.889958 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2500/5103] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:52 2022] GET /compute/v2.1/servers/69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c => generated 1318 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:53.239272 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bfbfc9aa-d2e8-42d5-9abb-1a7fd3269d37 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:53.257514 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bfbfc9aa-d2e8-42d5-9abb-1a7fd3269d37 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa" status: 200 len: 1361 microversion: 2.1 time: 0.516833 Jun 20 12:23:53.259499 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2604/5104] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:52 2022] GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa => generated 1361 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:53.571538 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-b8ab916a-e179-440e-9a18-679fe9e813a6 req-ed69f687-01bd-40bd-9e00-68fbd9076747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c", "name": "network-vif-plugged", "status": "completed", "tag": "194226fb-d5e0-469e-b28d-d34a807393bf"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:53.596222 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-b8ab916a-e179-440e-9a18-679fe9e813a6 req-ed69f687-01bd-40bd-9e00-68fbd9076747 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:53.596724 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-b8ab916a-e179-440e-9a18-679fe9e813a6 req-ed69f687-01bd-40bd-9e00-68fbd9076747 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:53.627628 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-b8ab916a-e179-440e-9a18-679fe9e813a6 req-ed69f687-01bd-40bd-9e00-68fbd9076747 service nova] Creating event network-vif-plugged:194226fb-d5e0-469e-b28d-d34a807393bf for instance 69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c on n-h1-master-1 Jun 20 12:23:53.645769 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-b8ab916a-e179-440e-9a18-679fe9e813a6 req-ed69f687-01bd-40bd-9e00-68fbd9076747 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082479 Jun 20 12:23:53.646911 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2501/5105] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:23:53.896749 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-81672217-216e-4bf9-9531-e3c2e3890fac tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:53.898590 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-81672217-216e-4bf9-9531-e3c2e3890fac tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:53.905889 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-81672217-216e-4bf9-9531-e3c2e3890fac tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:53.907150 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-81672217-216e-4bf9-9531-e3c2e3890fac tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:53.907841 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-81672217-216e-4bf9-9531-e3c2e3890fac tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:53.908961 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-81672217-216e-4bf9-9531-e3c2e3890fac tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:54.276618 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e96a87a7-a2bf-47a1-82da-a486070fcb0e tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:54.277876 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e96a87a7-a2bf-47a1-82da-a486070fcb0e tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 5b047d91-122c-44ee-b96e-1e0836960caa] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:54.294211 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e96a87a7-a2bf-47a1-82da-a486070fcb0e tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:54.294814 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e96a87a7-a2bf-47a1-82da-a486070fcb0e tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:54.297158 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e96a87a7-a2bf-47a1-82da-a486070fcb0e tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:54.298734 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e96a87a7-a2bf-47a1-82da-a486070fcb0e tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:54.737211 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e96a87a7-a2bf-47a1-82da-a486070fcb0e tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:54.748844 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-81672217-216e-4bf9-9531-e3c2e3890fac tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7656081c0941463990b483b9db21536a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bcbf77cdc246e99f0a94398ed41a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:54.750146 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e96a87a7-a2bf-47a1-82da-a486070fcb0e tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa" status: 200 len: 1361 microversion: 2.1 time: 0.478917 Jun 20 12:23:54.761798 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2502/5106] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:54 2022] GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa => generated 1361 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:54.762995 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-81672217-216e-4bf9-9531-e3c2e3890fac tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "GET /compute/v2.1/servers/69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c" status: 200 len: 1318 microversion: 2.1 time: 0.870221 Jun 20 12:23:54.775060 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2605/5107] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:53 2022] GET /compute/v2.1/servers/69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c => generated 1318 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:55.007444 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d2f5a1b4-fae0-4ca5-b7d6-3a508c733a51 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-224445313", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "0158ec12-92b0-4f4f-8574-ed5e2cd7f2b3"}], "key_name": "tempest-TestNetworkBasicOps-970871994", "security_groups": [{"name": "tempest-secgroup-smoke-1063311448"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:55.574317 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-d2f5a1b4-fae0-4ca5-b7d6-3a508c733a51 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] validate_networks() for [('0158ec12-92b0-4f4f-8574-ed5e2cd7f2b3', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:23:55.769951 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1d5d5ccc-ae7a-41a9-a256-e60a496f0fef tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:55.771434 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1d5d5ccc-ae7a-41a9-a256-e60a496f0fef tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 5b047d91-122c-44ee-b96e-1e0836960caa] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:55.782691 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1d5d5ccc-ae7a-41a9-a256-e60a496f0fef tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:55.783684 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1d5d5ccc-ae7a-41a9-a256-e60a496f0fef tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:55.785007 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1d5d5ccc-ae7a-41a9-a256-e60a496f0fef tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:55.785711 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1d5d5ccc-ae7a-41a9-a256-e60a496f0fef tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:56.264310 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1d5d5ccc-ae7a-41a9-a256-e60a496f0fef tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:56.276525 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1d5d5ccc-ae7a-41a9-a256-e60a496f0fef tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa" status: 200 len: 1361 microversion: 2.1 time: 0.512537 Jun 20 12:23:56.289328 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2606/5108] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:55 2022] GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa => generated 1361 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:56.299866 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d8282618-fce2-42c9-8721-335b431fc568 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:56.300916 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d8282618-fce2-42c9-8721-335b431fc568 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:56.316893 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d8282618-fce2-42c9-8721-335b431fc568 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:56.318909 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d8282618-fce2-42c9-8721-335b431fc568 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:56.321125 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d8282618-fce2-42c9-8721-335b431fc568 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:56.321848 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d8282618-fce2-42c9-8721-335b431fc568 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:56.717015 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d8282618-fce2-42c9-8721-335b431fc568 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7656081c0941463990b483b9db21536a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bcbf77cdc246e99f0a94398ed41a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:56.725334 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d8282618-fce2-42c9-8721-335b431fc568 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "GET /compute/v2.1/servers/69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c" status: 200 len: 1505 microversion: 2.1 time: 0.432964 Jun 20 12:23:56.726319 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2607/5109] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:56 2022] GET /compute/v2.1/servers/69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c => generated 1505 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:56.731230 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-165eb52f-876c-47cd-9ca6-c7a509359cf9 req-c41ba49f-8f37-4c7f-a036-eba1208b8cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b047d91-122c-44ee-b96e-1e0836960caa", "tag": "22195dfd-111f-4198-a632-bf1919d0b981"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:56.739898 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-165eb52f-876c-47cd-9ca6-c7a509359cf9 req-c41ba49f-8f37-4c7f-a036-eba1208b8cf4 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:56.740839 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-165eb52f-876c-47cd-9ca6-c7a509359cf9 req-c41ba49f-8f37-4c7f-a036-eba1208b8cf4 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:56.753665 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-165eb52f-876c-47cd-9ca6-c7a509359cf9 req-c41ba49f-8f37-4c7f-a036-eba1208b8cf4 service nova] Creating event network-changed:22195dfd-111f-4198-a632-bf1919d0b981 for instance 5b047d91-122c-44ee-b96e-1e0836960caa on n-h2-master-1 Jun 20 12:23:56.758979 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-165eb52f-876c-47cd-9ca6-c7a509359cf9 req-c41ba49f-8f37-4c7f-a036-eba1208b8cf4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031244 Jun 20 12:23:56.760184 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2608/5110] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:23:56.765606 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-63cc8c2b-f1dc-4fa3-9469-053c30ed4d1e tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:56.766512 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-63cc8c2b-f1dc-4fa3-9469-053c30ed4d1e tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 9be6e8da-8751-4fc9-b839-dac8cb2aa0b4] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:56.774313 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63cc8c2b-f1dc-4fa3-9469-053c30ed4d1e tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:56.775567 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63cc8c2b-f1dc-4fa3-9469-053c30ed4d1e tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:56.776560 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63cc8c2b-f1dc-4fa3-9469-053c30ed4d1e tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:56.777158 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63cc8c2b-f1dc-4fa3-9469-053c30ed4d1e tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:56.798885 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:56.820880 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-d2f5a1b4-fae0-4ca5-b7d6-3a508c733a51 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:23:56.821576 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-d2f5a1b4-fae0-4ca5-b7d6-3a508c733a51 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:23:56.822088 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-d2f5a1b4-fae0-4ca5-b7d6-3a508c733a51 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:23:56.823298 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-d2f5a1b4-fae0-4ca5-b7d6-3a508c733a51 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:23:56.823821 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-d2f5a1b4-fae0-4ca5-b7d6-3a508c733a51 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:23:56.837493 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d2f5a1b4-fae0-4ca5-b7d6-3a508c733a51 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:56.837493 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d2f5a1b4-fae0-4ca5-b7d6-3a508c733a51 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:56.837493 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d2f5a1b4-fae0-4ca5-b7d6-3a508c733a51 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:56.837493 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d2f5a1b4-fae0-4ca5-b7d6-3a508c733a51 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:56.881877 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-d2f5a1b4-fae0-4ca5-b7d6-3a508c733a51 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Getting quotas for project 1ed88b4072a24b37a5ceec3b239ac8fa. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:23:56.894817 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-d2f5a1b4-fae0-4ca5-b7d6-3a508c733a51 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Getting quotas for user aeafcd88ca6c415e90b51c262b62597f and project 1ed88b4072a24b37a5ceec3b239ac8fa. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:23:56.922114 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d2f5a1b4-fae0-4ca5-b7d6-3a508c733a51 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:23:56.926260 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d2f5a1b4-fae0-4ca5-b7d6-3a508c733a51 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: bf0e099f-bcdd-4b6e-b18c-c6117afacfe6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:23:57.011896 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d2f5a1b4-fae0-4ca5-b7d6-3a508c733a51 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.010241 Jun 20 12:23:57.013401 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2503/5111] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:23:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 2012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:23:57.029315 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8795b710-8a4e-430f-9157-bcf39b77c045 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:57.030726 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8795b710-8a4e-430f-9157-bcf39b77c045 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: bf0e099f-bcdd-4b6e-b18c-c6117afacfe6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:57.199983 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8795b710-8a4e-430f-9157-bcf39b77c045 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:57.216868 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8795b710-8a4e-430f-9157-bcf39b77c045 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/bf0e099f-bcdd-4b6e-b18c-c6117afacfe6" status: 200 len: 1247 microversion: 2.1 time: 0.194361 Jun 20 12:23:57.218073 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2504/5112] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:57 2022] GET /compute/v2.1/servers/bf0e099f-bcdd-4b6e-b18c-c6117afacfe6 => generated 1247 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:57.232114 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-439dad66-9349-4986-b64b-e1568232a4c8 req-90d6fbd4-ffaf-4ed5-8091-a8b10d7b0b61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9be6e8da-8751-4fc9-b839-dac8cb2aa0b4", "name": "network-vif-plugged", "status": "completed", "tag": "960efdfb-aa20-4057-ac09-99321d2186ce"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:57.246890 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-439dad66-9349-4986-b64b-e1568232a4c8 req-90d6fbd4-ffaf-4ed5-8091-a8b10d7b0b61 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:57.247648 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-439dad66-9349-4986-b64b-e1568232a4c8 req-90d6fbd4-ffaf-4ed5-8091-a8b10d7b0b61 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:57.263993 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-439dad66-9349-4986-b64b-e1568232a4c8 req-90d6fbd4-ffaf-4ed5-8091-a8b10d7b0b61 service nova] Creating event network-vif-plugged:960efdfb-aa20-4057-ac09-99321d2186ce for instance 9be6e8da-8751-4fc9-b839-dac8cb2aa0b4 on n-h2-master-1 Jun 20 12:23:57.298075 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-439dad66-9349-4986-b64b-e1568232a4c8 req-90d6fbd4-ffaf-4ed5-8091-a8b10d7b0b61 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078155 Jun 20 12:23:57.299154 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2505/5113] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:23:57.314693 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4f242cdf-908c-4763-bf53-3fdf1b5e25a4 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:57.318582 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4f242cdf-908c-4763-bf53-3fdf1b5e25a4 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 5b047d91-122c-44ee-b96e-1e0836960caa] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:57.327681 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4f242cdf-908c-4763-bf53-3fdf1b5e25a4 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:57.328924 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4f242cdf-908c-4763-bf53-3fdf1b5e25a4 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:57.330026 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4f242cdf-908c-4763-bf53-3fdf1b5e25a4 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:57.330651 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4f242cdf-908c-4763-bf53-3fdf1b5e25a4 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:57.392562 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-63cc8c2b-f1dc-4fa3-9469-053c30ed4d1e tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7656081c0941463990b483b9db21536a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bcbf77cdc246e99f0a94398ed41a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:57.404163 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:57.408321 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-63cc8c2b-f1dc-4fa3-9469-053c30ed4d1e tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "GET /compute/v2.1/servers/9be6e8da-8751-4fc9-b839-dac8cb2aa0b4" status: 200 len: 1318 microversion: 2.1 time: 0.646669 Jun 20 12:23:57.416409 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2609/5114] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:56 2022] GET /compute/v2.1/servers/9be6e8da-8751-4fc9-b839-dac8cb2aa0b4 => generated 1318 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:57.609577 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4f242cdf-908c-4763-bf53-3fdf1b5e25a4 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:57.622953 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4f242cdf-908c-4763-bf53-3fdf1b5e25a4 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa" status: 200 len: 1361 microversion: 2.1 time: 0.313154 Jun 20 12:23:57.623596 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2506/5115] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:57 2022] GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa => generated 1361 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:58.237219 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-07056907-f94b-4b6d-bd60-782578d5df0e tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:58.237881 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-07056907-f94b-4b6d-bd60-782578d5df0e tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: bf0e099f-bcdd-4b6e-b18c-c6117afacfe6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:58.244857 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:58.282461 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-07056907-f94b-4b6d-bd60-782578d5df0e tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:58.288018 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-07056907-f94b-4b6d-bd60-782578d5df0e tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:58.292267 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-07056907-f94b-4b6d-bd60-782578d5df0e tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:58.294945 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-07056907-f94b-4b6d-bd60-782578d5df0e tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:58.428838 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-70e29020-7d09-4db0-987c-f27afd556696 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:58.429438 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-70e29020-7d09-4db0-987c-f27afd556696 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 9be6e8da-8751-4fc9-b839-dac8cb2aa0b4] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:58.440779 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-70e29020-7d09-4db0-987c-f27afd556696 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:58.441145 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-70e29020-7d09-4db0-987c-f27afd556696 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:58.441959 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-70e29020-7d09-4db0-987c-f27afd556696 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:58.442455 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-70e29020-7d09-4db0-987c-f27afd556696 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:58.517560 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-07056907-f94b-4b6d-bd60-782578d5df0e tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:58.541477 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-07056907-f94b-4b6d-bd60-782578d5df0e tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/bf0e099f-bcdd-4b6e-b18c-c6117afacfe6" status: 200 len: 1299 microversion: 2.1 time: 0.305331 Jun 20 12:23:58.544408 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2610/5116] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:58 2022] GET /compute/v2.1/servers/bf0e099f-bcdd-4b6e-b18c-c6117afacfe6 => generated 1299 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:58.645911 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a2b77fc2-4313-49cc-96a5-202ed3b6fa97 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:58.647127 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a2b77fc2-4313-49cc-96a5-202ed3b6fa97 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 5b047d91-122c-44ee-b96e-1e0836960caa] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:58.674108 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a2b77fc2-4313-49cc-96a5-202ed3b6fa97 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:58.680421 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a2b77fc2-4313-49cc-96a5-202ed3b6fa97 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:58.691953 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a2b77fc2-4313-49cc-96a5-202ed3b6fa97 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:58.695643 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a2b77fc2-4313-49cc-96a5-202ed3b6fa97 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:59.036293 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-70e29020-7d09-4db0-987c-f27afd556696 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7656081c0941463990b483b9db21536a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bcbf77cdc246e99f0a94398ed41a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:59.046962 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-70e29020-7d09-4db0-987c-f27afd556696 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "GET /compute/v2.1/servers/9be6e8da-8751-4fc9-b839-dac8cb2aa0b4" status: 200 len: 1318 microversion: 2.1 time: 0.623390 Jun 20 12:23:59.060180 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2507/5117] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:58 2022] GET /compute/v2.1/servers/9be6e8da-8751-4fc9-b839-dac8cb2aa0b4 => generated 1318 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:59.406321 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a2b77fc2-4313-49cc-96a5-202ed3b6fa97 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:59.421828 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a2b77fc2-4313-49cc-96a5-202ed3b6fa97 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa" status: 200 len: 1361 microversion: 2.1 time: 0.783372 Jun 20 12:23:59.426623 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2611/5118] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:58 2022] GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa => generated 1361 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:59.577756 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4441c087-d86e-4ff3-b8d3-7e4300692ecc tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:59.579103 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4441c087-d86e-4ff3-b8d3-7e4300692ecc tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: bf0e099f-bcdd-4b6e-b18c-c6117afacfe6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:59.600928 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4441c087-d86e-4ff3-b8d3-7e4300692ecc tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:59.602591 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4441c087-d86e-4ff3-b8d3-7e4300692ecc tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:59.604362 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4441c087-d86e-4ff3-b8d3-7e4300692ecc tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:59.606557 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4441c087-d86e-4ff3-b8d3-7e4300692ecc tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:59.903945 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4441c087-d86e-4ff3-b8d3-7e4300692ecc tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:59.925379 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4441c087-d86e-4ff3-b8d3-7e4300692ecc tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/bf0e099f-bcdd-4b6e-b18c-c6117afacfe6" status: 200 len: 1305 microversion: 2.1 time: 0.364622 Jun 20 12:23:59.969666 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2508/5119] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:59 2022] GET /compute/v2.1/servers/bf0e099f-bcdd-4b6e-b18c-c6117afacfe6 => generated 1305 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:00.065765 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-353ffe99-259c-4d6e-9eaf-c434fbd977b9 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:00.066230 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-353ffe99-259c-4d6e-9eaf-c434fbd977b9 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 9be6e8da-8751-4fc9-b839-dac8cb2aa0b4] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:00.077961 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-353ffe99-259c-4d6e-9eaf-c434fbd977b9 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:00.082545 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-353ffe99-259c-4d6e-9eaf-c434fbd977b9 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:00.085808 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-353ffe99-259c-4d6e-9eaf-c434fbd977b9 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:00.086273 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-353ffe99-259c-4d6e-9eaf-c434fbd977b9 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:00.445010 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-459cca69-0856-48b2-a651-6144b789bd57 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:00.445645 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-459cca69-0856-48b2-a651-6144b789bd57 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 5b047d91-122c-44ee-b96e-1e0836960caa] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:00.487298 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-459cca69-0856-48b2-a651-6144b789bd57 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:00.494388 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-459cca69-0856-48b2-a651-6144b789bd57 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:00.506019 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-459cca69-0856-48b2-a651-6144b789bd57 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:00.506664 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-459cca69-0856-48b2-a651-6144b789bd57 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:00.529834 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-353ffe99-259c-4d6e-9eaf-c434fbd977b9 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7656081c0941463990b483b9db21536a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bcbf77cdc246e99f0a94398ed41a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:00.540554 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-353ffe99-259c-4d6e-9eaf-c434fbd977b9 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "GET /compute/v2.1/servers/9be6e8da-8751-4fc9-b839-dac8cb2aa0b4" status: 200 len: 1318 microversion: 2.1 time: 0.479748 Jun 20 12:24:00.542652 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2612/5120] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:00 2022] GET /compute/v2.1/servers/9be6e8da-8751-4fc9-b839-dac8cb2aa0b4 => generated 1318 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:00.960304 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c2b8f1df-549a-4f15-b0dd-213449ed20ee tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:00.962536 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c2b8f1df-549a-4f15-b0dd-213449ed20ee tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: bf0e099f-bcdd-4b6e-b18c-c6117afacfe6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:00.974746 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c2b8f1df-549a-4f15-b0dd-213449ed20ee tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:00.975616 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c2b8f1df-549a-4f15-b0dd-213449ed20ee tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:00.977920 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c2b8f1df-549a-4f15-b0dd-213449ed20ee tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:00.980802 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c2b8f1df-549a-4f15-b0dd-213449ed20ee tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:01.527669 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-459cca69-0856-48b2-a651-6144b789bd57 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:01.538329 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-459cca69-0856-48b2-a651-6144b789bd57 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa" status: 200 len: 1361 microversion: 2.1 time: 1.099494 Jun 20 12:24:01.539044 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2509/5121] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:00 2022] GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa => generated 1361 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:01.560522 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-95d31a3a-c3da-479d-8e87-71e5e99da780 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:01.561420 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-95d31a3a-c3da-479d-8e87-71e5e99da780 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 9be6e8da-8751-4fc9-b839-dac8cb2aa0b4] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:01.573975 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95d31a3a-c3da-479d-8e87-71e5e99da780 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:01.574805 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95d31a3a-c3da-479d-8e87-71e5e99da780 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:01.576080 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95d31a3a-c3da-479d-8e87-71e5e99da780 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:01.576784 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95d31a3a-c3da-479d-8e87-71e5e99da780 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:01.819155 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c2b8f1df-549a-4f15-b0dd-213449ed20ee tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:01.827978 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c2b8f1df-549a-4f15-b0dd-213449ed20ee tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/bf0e099f-bcdd-4b6e-b18c-c6117afacfe6" status: 200 len: 1373 microversion: 2.1 time: 0.874080 Jun 20 12:24:01.829225 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2613/5122] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:00 2022] GET /compute/v2.1/servers/bf0e099f-bcdd-4b6e-b18c-c6117afacfe6 => generated 1373 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:02.519644 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-95d31a3a-c3da-479d-8e87-71e5e99da780 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7656081c0941463990b483b9db21536a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bcbf77cdc246e99f0a94398ed41a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:02.536729 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-95d31a3a-c3da-479d-8e87-71e5e99da780 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "GET /compute/v2.1/servers/9be6e8da-8751-4fc9-b839-dac8cb2aa0b4" status: 200 len: 1506 microversion: 2.1 time: 0.979935 Jun 20 12:24:02.538185 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2510/5123] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:01 2022] GET /compute/v2.1/servers/9be6e8da-8751-4fc9-b839-dac8cb2aa0b4 => generated 1506 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:24:02.568338 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9e9a2d26-f6b9-4bb0-81f0-91a78a841692 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:02.569522 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9e9a2d26-f6b9-4bb0-81f0-91a78a841692 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 5b047d91-122c-44ee-b96e-1e0836960caa] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:02.631604 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9e9a2d26-f6b9-4bb0-81f0-91a78a841692 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:02.632489 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9e9a2d26-f6b9-4bb0-81f0-91a78a841692 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:02.633370 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cebdbc1f-f172-42aa-9d96-84fe455ab985 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:02.634554 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cebdbc1f-f172-42aa-9d96-84fe455ab985 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 9be6e8da-8751-4fc9-b839-dac8cb2aa0b4] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:02.634699 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9e9a2d26-f6b9-4bb0-81f0-91a78a841692 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:02.638245 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9e9a2d26-f6b9-4bb0-81f0-91a78a841692 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:02.659014 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cebdbc1f-f172-42aa-9d96-84fe455ab985 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:02.659475 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cebdbc1f-f172-42aa-9d96-84fe455ab985 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:02.660420 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cebdbc1f-f172-42aa-9d96-84fe455ab985 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:02.661532 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cebdbc1f-f172-42aa-9d96-84fe455ab985 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:02.729848 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cebdbc1f-f172-42aa-9d96-84fe455ab985 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 9be6e8da-8751-4fc9-b839-dac8cb2aa0b4] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:24:02.736001 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:02.918007 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=5 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:02.923227 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cebdbc1f-f172-42aa-9d96-84fe455ab985 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9be6e8da-8751-4fc9-b839-dac8cb2aa0b4" status: 204 len: 0 microversion: 2.1 time: 0.334469 Jun 20 12:24:02.924190 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2511/5124] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:24:02 2022] DELETE /compute/v2.1/servers/9be6e8da-8751-4fc9-b839-dac8cb2aa0b4 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:24:02.931564 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-140bbd7a-10cb-4884-819d-676dc1ed2185 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:02.933286 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-140bbd7a-10cb-4884-819d-676dc1ed2185 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: bf0e099f-bcdd-4b6e-b18c-c6117afacfe6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:02.945961 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-140bbd7a-10cb-4884-819d-676dc1ed2185 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:02.948174 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-140bbd7a-10cb-4884-819d-676dc1ed2185 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:02.951497 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-140bbd7a-10cb-4884-819d-676dc1ed2185 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:02.953883 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-140bbd7a-10cb-4884-819d-676dc1ed2185 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:03.449660 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9e9a2d26-f6b9-4bb0-81f0-91a78a841692 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:03.469849 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9e9a2d26-f6b9-4bb0-81f0-91a78a841692 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa" status: 200 len: 1361 microversion: 2.1 time: 0.909541 Jun 20 12:24:03.472743 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2614/5125] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:02 2022] GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa => generated 1361 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:03.487939 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9b7d0d43-f26d-4fba-8a71-05bd8b66a380 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:03.488862 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9b7d0d43-f26d-4fba-8a71-05bd8b66a380 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:03.504358 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b7d0d43-f26d-4fba-8a71-05bd8b66a380 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:03.505224 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b7d0d43-f26d-4fba-8a71-05bd8b66a380 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:03.508989 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b7d0d43-f26d-4fba-8a71-05bd8b66a380 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:03.510084 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b7d0d43-f26d-4fba-8a71-05bd8b66a380 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:03.553297 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-140bbd7a-10cb-4884-819d-676dc1ed2185 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:03.576095 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-140bbd7a-10cb-4884-819d-676dc1ed2185 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/bf0e099f-bcdd-4b6e-b18c-c6117afacfe6" status: 200 len: 1373 microversion: 2.1 time: 0.650390 Jun 20 12:24:03.577549 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9b7d0d43-f26d-4fba-8a71-05bd8b66a380 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:24:03.581809 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2512/5126] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:02 2022] GET /compute/v2.1/servers/bf0e099f-bcdd-4b6e-b18c-c6117afacfe6 => generated 1373 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:03.796066 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9b7d0d43-f26d-4fba-8a71-05bd8b66a380 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "DELETE /compute/v2.1/servers/69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c" status: 204 len: 0 microversion: 2.1 time: 0.321191 Jun 20 12:24:03.803872 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2615/5127] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:24:03 2022] DELETE /compute/v2.1/servers/69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:24:03.812578 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b8f1e3fa-c5d8-4774-9e17-86aa105ca7ca tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:03.813213 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b8f1e3fa-c5d8-4774-9e17-86aa105ca7ca tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 9be6e8da-8751-4fc9-b839-dac8cb2aa0b4] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:03.829969 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b8f1e3fa-c5d8-4774-9e17-86aa105ca7ca tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:03.830338 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b8f1e3fa-c5d8-4774-9e17-86aa105ca7ca tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:03.831162 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b8f1e3fa-c5d8-4774-9e17-86aa105ca7ca tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:03.831608 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b8f1e3fa-c5d8-4774-9e17-86aa105ca7ca tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:04.292947 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b8f1e3fa-c5d8-4774-9e17-86aa105ca7ca tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7656081c0941463990b483b9db21536a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bcbf77cdc246e99f0a94398ed41a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:04.304300 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b8f1e3fa-c5d8-4774-9e17-86aa105ca7ca tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "GET /compute/v2.1/servers/9be6e8da-8751-4fc9-b839-dac8cb2aa0b4" status: 200 len: 1512 microversion: 2.1 time: 0.495844 Jun 20 12:24:04.304909 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2513/5128] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:03 2022] GET /compute/v2.1/servers/9be6e8da-8751-4fc9-b839-dac8cb2aa0b4 => generated 1512 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:04.491745 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-da9ef547-0008-4d43-aec7-611f85d20c37 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:04.493946 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-da9ef547-0008-4d43-aec7-611f85d20c37 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 5b047d91-122c-44ee-b96e-1e0836960caa] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:04.504815 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da9ef547-0008-4d43-aec7-611f85d20c37 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:04.508639 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da9ef547-0008-4d43-aec7-611f85d20c37 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:04.512587 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da9ef547-0008-4d43-aec7-611f85d20c37 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:04.513376 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da9ef547-0008-4d43-aec7-611f85d20c37 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:04.605650 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d99dc891-c942-4cfd-9225-f95164f8f6eb tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:04.607072 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d99dc891-c942-4cfd-9225-f95164f8f6eb tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: bf0e099f-bcdd-4b6e-b18c-c6117afacfe6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:04.617748 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d99dc891-c942-4cfd-9225-f95164f8f6eb tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:04.621443 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d99dc891-c942-4cfd-9225-f95164f8f6eb tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:04.622494 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d99dc891-c942-4cfd-9225-f95164f8f6eb tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:04.624398 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d99dc891-c942-4cfd-9225-f95164f8f6eb tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:05.032864 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-da9ef547-0008-4d43-aec7-611f85d20c37 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:05.044105 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-da9ef547-0008-4d43-aec7-611f85d20c37 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa" status: 200 len: 1361 microversion: 2.1 time: 0.558053 Jun 20 12:24:05.057304 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2616/5129] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:04 2022] GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa => generated 1361 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:05.062856 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-2cfd657f-5999-4446-bbea-287efcd74fa7 req-e2b05705-d5cc-4399-82c6-f7a6aa35d870 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf0e099f-bcdd-4b6e-b18c-c6117afacfe6", "tag": "d37a67de-6448-4845-9136-14ad539179f4"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:24:05.072585 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-2cfd657f-5999-4446-bbea-287efcd74fa7 req-e2b05705-d5cc-4399-82c6-f7a6aa35d870 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:05.073439 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-2cfd657f-5999-4446-bbea-287efcd74fa7 req-e2b05705-d5cc-4399-82c6-f7a6aa35d870 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:05.090527 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-2cfd657f-5999-4446-bbea-287efcd74fa7 req-e2b05705-d5cc-4399-82c6-f7a6aa35d870 service nova] Creating event network-changed:d37a67de-6448-4845-9136-14ad539179f4 for instance bf0e099f-bcdd-4b6e-b18c-c6117afacfe6 on n-h1-master-1 Jun 20 12:24:05.098186 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-2cfd657f-5999-4446-bbea-287efcd74fa7 req-e2b05705-d5cc-4399-82c6-f7a6aa35d870 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039000 Jun 20 12:24:05.099412 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2617/5130] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:24:05.292466 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d99dc891-c942-4cfd-9225-f95164f8f6eb tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:05.304860 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d99dc891-c942-4cfd-9225-f95164f8f6eb tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/bf0e099f-bcdd-4b6e-b18c-c6117afacfe6" status: 200 len: 1373 microversion: 2.1 time: 0.709246 Jun 20 12:24:05.306310 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2514/5131] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:04 2022] GET /compute/v2.1/servers/bf0e099f-bcdd-4b6e-b18c-c6117afacfe6 => generated 1373 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:05.322980 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2d8c1afc-d375-470b-bc12-adae658c052f tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:05.323975 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2d8c1afc-d375-470b-bc12-adae658c052f tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 9be6e8da-8751-4fc9-b839-dac8cb2aa0b4] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:05.337512 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2d8c1afc-d375-470b-bc12-adae658c052f tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:05.338525 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2d8c1afc-d375-470b-bc12-adae658c052f tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:05.342865 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2d8c1afc-d375-470b-bc12-adae658c052f tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:05.343544 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2d8c1afc-d375-470b-bc12-adae658c052f tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:05.693365 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-75523d4f-f152-42c4-a59c-acdcfbb1c0d6 req-9d8f797d-be1a-46dd-908d-98c9a310d9e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b047d91-122c-44ee-b96e-1e0836960caa", "name": "network-vif-plugged", "status": "completed", "tag": "22195dfd-111f-4198-a632-bf1919d0b981"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:24:05.708075 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-75523d4f-f152-42c4-a59c-acdcfbb1c0d6 req-9d8f797d-be1a-46dd-908d-98c9a310d9e4 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:05.711640 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-75523d4f-f152-42c4-a59c-acdcfbb1c0d6 req-9d8f797d-be1a-46dd-908d-98c9a310d9e4 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:05.743077 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-75523d4f-f152-42c4-a59c-acdcfbb1c0d6 req-9d8f797d-be1a-46dd-908d-98c9a310d9e4 service nova] Creating event network-vif-plugged:22195dfd-111f-4198-a632-bf1919d0b981 for instance 5b047d91-122c-44ee-b96e-1e0836960caa on n-h2-master-1 Jun 20 12:24:05.748295 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-75523d4f-f152-42c4-a59c-acdcfbb1c0d6 req-9d8f797d-be1a-46dd-908d-98c9a310d9e4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059476 Jun 20 12:24:05.749498 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2515/5132] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:24:05.943095 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2d8c1afc-d375-470b-bc12-adae658c052f tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7656081c0941463990b483b9db21536a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bcbf77cdc246e99f0a94398ed41a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:05.971518 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2d8c1afc-d375-470b-bc12-adae658c052f tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "GET /compute/v2.1/servers/9be6e8da-8751-4fc9-b839-dac8cb2aa0b4" status: 200 len: 1512 microversion: 2.1 time: 0.646928 Jun 20 12:24:05.973334 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2618/5133] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:05 2022] GET /compute/v2.1/servers/9be6e8da-8751-4fc9-b839-dac8cb2aa0b4 => generated 1512 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:06.069484 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-80eeb135-fe39-4755-baca-0ed8c2491be4 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:06.071407 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-80eeb135-fe39-4755-baca-0ed8c2491be4 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 5b047d91-122c-44ee-b96e-1e0836960caa] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:06.083005 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80eeb135-fe39-4755-baca-0ed8c2491be4 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:06.083993 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80eeb135-fe39-4755-baca-0ed8c2491be4 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:06.085105 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80eeb135-fe39-4755-baca-0ed8c2491be4 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:06.086054 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80eeb135-fe39-4755-baca-0ed8c2491be4 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:06.325956 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-711889f8-6952-4db0-9343-a2969ef47653 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:06.326953 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-711889f8-6952-4db0-9343-a2969ef47653 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: bf0e099f-bcdd-4b6e-b18c-c6117afacfe6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:06.334684 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-711889f8-6952-4db0-9343-a2969ef47653 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:06.335478 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-711889f8-6952-4db0-9343-a2969ef47653 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:06.336844 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-711889f8-6952-4db0-9343-a2969ef47653 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:06.337487 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-711889f8-6952-4db0-9343-a2969ef47653 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:06.671814 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-711889f8-6952-4db0-9343-a2969ef47653 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:06.678556 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-80eeb135-fe39-4755-baca-0ed8c2491be4 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:06.691727 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-711889f8-6952-4db0-9343-a2969ef47653 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/bf0e099f-bcdd-4b6e-b18c-c6117afacfe6" status: 200 len: 1373 microversion: 2.1 time: 0.367215 Jun 20 12:24:06.695187 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2619/5134] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:06 2022] GET /compute/v2.1/servers/bf0e099f-bcdd-4b6e-b18c-c6117afacfe6 => generated 1373 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:06.704818 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-80eeb135-fe39-4755-baca-0ed8c2491be4 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa" status: 200 len: 1361 microversion: 2.1 time: 0.642496 Jun 20 12:24:06.705325 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2516/5135] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:06 2022] GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa => generated 1361 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:24:06.801321 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-40111f66-6c87-4339-9658-5b12c04bba44 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:24:06.802654 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-40111f66-6c87-4339-9658-5b12c04bba44 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:06.816103 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-40111f66-6c87-4339-9658-5b12c04bba44 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:06.816889 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-40111f66-6c87-4339-9658-5b12c04bba44 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:06.817749 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-40111f66-6c87-4339-9658-5b12c04bba44 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:06.818187 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-40111f66-6c87-4339-9658-5b12c04bba44 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:06.974335 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-40111f66-6c87-4339-9658-5b12c04bba44 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "POST /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/action" status: 202 len: 0 microversion: 2.1 time: 0.176668 Jun 20 12:24:06.979683 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2620/5136] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:24:06 2022] POST /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:24:06.984435 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9b5b2334-237d-493c-a2f2-697faf831a1d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:06.985065 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9b5b2334-237d-493c-a2f2-697faf831a1d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:06.988264 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:06.992017 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-61a4be7a-6f63-4bf7-bb86-02d55c296f73 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:06.994873 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-61a4be7a-6f63-4bf7-bb86-02d55c296f73 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 9be6e8da-8751-4fc9-b839-dac8cb2aa0b4] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:06.995554 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9b5b2334-237d-493c-a2f2-697faf831a1d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:06.997948 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9b5b2334-237d-493c-a2f2-697faf831a1d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:07.012709 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9b5b2334-237d-493c-a2f2-697faf831a1d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:07.013951 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9b5b2334-237d-493c-a2f2-697faf831a1d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:07.025838 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-61a4be7a-6f63-4bf7-bb86-02d55c296f73 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:07.026919 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-61a4be7a-6f63-4bf7-bb86-02d55c296f73 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:07.028358 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-61a4be7a-6f63-4bf7-bb86-02d55c296f73 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:07.029000 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-61a4be7a-6f63-4bf7-bb86-02d55c296f73 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:07.215376 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=18 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:07.410791 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-61a4be7a-6f63-4bf7-bb86-02d55c296f73 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7656081c0941463990b483b9db21536a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bcbf77cdc246e99f0a94398ed41a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:07.426317 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-61a4be7a-6f63-4bf7-bb86-02d55c296f73 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "GET /compute/v2.1/servers/9be6e8da-8751-4fc9-b839-dac8cb2aa0b4" status: 200 len: 1470 microversion: 2.1 time: 0.439652 Jun 20 12:24:07.451522 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2621/5137] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:06 2022] GET /compute/v2.1/servers/9be6e8da-8751-4fc9-b839-dac8cb2aa0b4 => generated 1470 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:07.471758 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-4838db5d-d556-4b27-bd80-bd39c9c2ba5f req-bb2f636c-6a6e-42ee-bc86-5eb4908a5fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9be6e8da-8751-4fc9-b839-dac8cb2aa0b4", "name": "network-vif-deleted", "tag": "960efdfb-aa20-4057-ac09-99321d2186ce"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:24:07.513398 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-4838db5d-d556-4b27-bd80-bd39c9c2ba5f req-bb2f636c-6a6e-42ee-bc86-5eb4908a5fe5 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:07.514106 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-4838db5d-d556-4b27-bd80-bd39c9c2ba5f req-bb2f636c-6a6e-42ee-bc86-5eb4908a5fe5 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:07.568603 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-4838db5d-d556-4b27-bd80-bd39c9c2ba5f req-bb2f636c-6a6e-42ee-bc86-5eb4908a5fe5 service nova] Creating event network-vif-deleted:960efdfb-aa20-4057-ac09-99321d2186ce for instance 9be6e8da-8751-4fc9-b839-dac8cb2aa0b4 on n-h2-master-1 Jun 20 12:24:07.587696 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-4838db5d-d556-4b27-bd80-bd39c9c2ba5f req-bb2f636c-6a6e-42ee-bc86-5eb4908a5fe5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130967 Jun 20 12:24:07.589110 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2622/5138] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:24:07.715606 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d4d28d46-805d-4279-8a78-e85e99e7a02a tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:07.716371 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d4d28d46-805d-4279-8a78-e85e99e7a02a tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: bf0e099f-bcdd-4b6e-b18c-c6117afacfe6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:07.731432 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d4d28d46-805d-4279-8a78-e85e99e7a02a tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:07.732437 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d4d28d46-805d-4279-8a78-e85e99e7a02a tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:07.734230 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d4d28d46-805d-4279-8a78-e85e99e7a02a tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:07.736791 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d4d28d46-805d-4279-8a78-e85e99e7a02a tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:07.990154 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9b5b2334-237d-493c-a2f2-697faf831a1d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:08.000657 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9b5b2334-237d-493c-a2f2-697faf831a1d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1673 microversion: 2.1 time: 1.020114 Jun 20 12:24:08.012419 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2517/5139] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:06 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1673 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:24:08.030963 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ffc6d321-de50-42a1-a20d-8cb2b93bed07 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:08.032624 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ffc6d321-de50-42a1-a20d-8cb2b93bed07 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 5b047d91-122c-44ee-b96e-1e0836960caa] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:08.052622 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ffc6d321-de50-42a1-a20d-8cb2b93bed07 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:08.054810 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ffc6d321-de50-42a1-a20d-8cb2b93bed07 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:08.056359 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ffc6d321-de50-42a1-a20d-8cb2b93bed07 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:08.060951 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ffc6d321-de50-42a1-a20d-8cb2b93bed07 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:08.677494 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d4d28d46-805d-4279-8a78-e85e99e7a02a tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:08.687555 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d4d28d46-805d-4279-8a78-e85e99e7a02a tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/bf0e099f-bcdd-4b6e-b18c-c6117afacfe6" status: 200 len: 1373 microversion: 2.1 time: 0.977595 Jun 20 12:24:08.693729 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2623/5140] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:07 2022] GET /compute/v2.1/servers/bf0e099f-bcdd-4b6e-b18c-c6117afacfe6 => generated 1373 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:08.707608 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-69956dfe-3f23-4aa3-9253-61fbe6f0b5df tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:08.708731 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-69956dfe-3f23-4aa3-9253-61fbe6f0b5df tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 9be6e8da-8751-4fc9-b839-dac8cb2aa0b4] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:08.717392 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-69956dfe-3f23-4aa3-9253-61fbe6f0b5df tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:08.718078 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-69956dfe-3f23-4aa3-9253-61fbe6f0b5df tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:08.719737 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-69956dfe-3f23-4aa3-9253-61fbe6f0b5df tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:08.720371 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-69956dfe-3f23-4aa3-9253-61fbe6f0b5df tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:08.737719 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-69956dfe-3f23-4aa3-9253-61fbe6f0b5df tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] HTTP exception thrown: Instance 9be6e8da-8751-4fc9-b839-dac8cb2aa0b4 could not be found. Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-69956dfe-3f23-4aa3-9253-61fbe6f0b5df tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Request method failure captured: Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/9be6e8da-8751-4fc9-b839-dac8cb2aa0b4 HTTP/1.1 Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGan5wDSHb3yerQSCSiB1UUmFkfAMh0-klsR7H8eC77T56dQn_iZ1MgSkqNS111N8fkw1RUhrROgURlYrqOg88vy7BidaGa4YMigHP54StVo5r1z4y6Dc8_CIG9qg0ORa4CuIxVaF0h40i6F0SsK4EOxyiQoa7Rmx37-viRA8cP4rwg Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 94bcbf77cdc246e99f0a94398ed41a08 Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-MultipleCreateTestJSON-1421890612 Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/94bcbf77cdc246e99f0a94398ed41a08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/94bcbf77cdc246e99f0a94398ed41a08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/94bcbf77cdc246e99f0a94398ed41a08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_94bcbf77cdc246e99f0a94398ed41a08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-MultipleCreateTestJSON-1421890612 Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 94bcbf77cdc246e99f0a94398ed41a08 Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1421890612 Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-MultipleCreateTestJSON-1421890612-project Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 7656081c0941463990b483b9db21536a Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-MultipleCreateTestJSON-1421890612-project Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 9be6e8da-8751-4fc9-b839-dac8cb2aa0b4 could not be found. Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '9be6e8da-8751-4fc9-b839-dac8cb2aa0b4'} Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9be6e8da-8751-4fc9-b839-dac8cb2aa0b4 could not be found. Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9be6e8da-8751-4fc9-b839-dac8cb2aa0b4 could not be found. Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:24:08.739804 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:24:08.747341 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:24:08.747341 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:24:08.747341 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:24:08.747341 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:24:08.747341 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:24:08.747341 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9be6e8da-8751-4fc9-b839-dac8cb2aa0b4 could not be found. Jun 20 12:24:08.747341 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:24:08.749530 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-69956dfe-3f23-4aa3-9253-61fbe6f0b5df tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Returning 404 to user: Instance 9be6e8da-8751-4fc9-b839-dac8cb2aa0b4 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:24:08.750725 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-69956dfe-3f23-4aa3-9253-61fbe6f0b5df tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "GET /compute/v2.1/servers/9be6e8da-8751-4fc9-b839-dac8cb2aa0b4" status: 404 len: 111 microversion: 2.1 time: 0.047113 Jun 20 12:24:08.751519 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2624/5141] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:08 2022] GET /compute/v2.1/servers/9be6e8da-8751-4fc9-b839-dac8cb2aa0b4 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:24:08.760495 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e60ce110-aeb2-41b3-8311-e47f5e06a143 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:08.761475 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e60ce110-aeb2-41b3-8311-e47f5e06a143 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:08.771144 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e60ce110-aeb2-41b3-8311-e47f5e06a143 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:08.772046 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e60ce110-aeb2-41b3-8311-e47f5e06a143 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:08.773183 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e60ce110-aeb2-41b3-8311-e47f5e06a143 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:08.774101 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e60ce110-aeb2-41b3-8311-e47f5e06a143 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:08.810663 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:08.828149 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e60ce110-aeb2-41b3-8311-e47f5e06a143 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:08.829162 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e60ce110-aeb2-41b3-8311-e47f5e06a143 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:08.829848 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-e60ce110-aeb2-41b3-8311-e47f5e06a143 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lazy-loading 'fault' on Instance uuid 69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:24:09.074813 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ffc6d321-de50-42a1-a20d-8cb2b93bed07 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:09.089687 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ffc6d321-de50-42a1-a20d-8cb2b93bed07 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa" status: 200 len: 1546 microversion: 2.1 time: 1.064355 Jun 20 12:24:09.101871 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2518/5142] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:08 2022] GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa => generated 1546 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:09.116576 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9f6dd42f-899e-4909-8c5d-ecf5ca1ad125 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:09.117467 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9f6dd42f-899e-4909-8c5d-ecf5ca1ad125 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:09.143561 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9f6dd42f-899e-4909-8c5d-ecf5ca1ad125 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:09.146338 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9f6dd42f-899e-4909-8c5d-ecf5ca1ad125 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:09.150075 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9f6dd42f-899e-4909-8c5d-ecf5ca1ad125 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:09.152381 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9f6dd42f-899e-4909-8c5d-ecf5ca1ad125 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:09.288570 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e60ce110-aeb2-41b3-8311-e47f5e06a143 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7656081c0941463990b483b9db21536a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bcbf77cdc246e99f0a94398ed41a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:09.302429 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e60ce110-aeb2-41b3-8311-e47f5e06a143 tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "GET /compute/v2.1/servers/69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c" status: 200 len: 1308 microversion: 2.1 time: 0.545645 Jun 20 12:24:09.303066 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2625/5143] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:08 2022] GET /compute/v2.1/servers/69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c => generated 1308 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:09.318199 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e58f9779-b565-4afd-9865-2594c6c14f3c tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:09.318706 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e58f9779-b565-4afd-9865-2594c6c14f3c tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 5b047d91-122c-44ee-b96e-1e0836960caa] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:09.340428 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e58f9779-b565-4afd-9865-2594c6c14f3c tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:09.341299 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e58f9779-b565-4afd-9865-2594c6c14f3c tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:09.342288 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e58f9779-b565-4afd-9865-2594c6c14f3c tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:09.342753 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e58f9779-b565-4afd-9865-2594c6c14f3c tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:09.523829 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e58f9779-b565-4afd-9865-2594c6c14f3c tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.215032 Jun 20 12:24:09.526431 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2626/5144] 10.222.0.27 () {58 vars in 1274 bytes} [Mon Jun 20 12:24:09 2022] GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa/os-interface => generated 284 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:24:09.709605 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5d70acc4-75d8-4c2c-9100-6e80175c4ef3 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:09.710333 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5d70acc4-75d8-4c2c-9100-6e80175c4ef3 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: bf0e099f-bcdd-4b6e-b18c-c6117afacfe6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:09.731921 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5d70acc4-75d8-4c2c-9100-6e80175c4ef3 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:09.733135 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5d70acc4-75d8-4c2c-9100-6e80175c4ef3 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:09.741081 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5d70acc4-75d8-4c2c-9100-6e80175c4ef3 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:09.741885 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5d70acc4-75d8-4c2c-9100-6e80175c4ef3 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:10.065575 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9f6dd42f-899e-4909-8c5d-ecf5ca1ad125 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:10.080676 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9f6dd42f-899e-4909-8c5d-ecf5ca1ad125 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1673 microversion: 2.1 time: 0.976737 Jun 20 12:24:10.098848 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2519/5145] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:09 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1673 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:10.106963 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-dfd1e0e2-9f21-4a90-9405-2d9978d5fdd4 req-d0fe52b0-af29-4c57-868c-137131fd2d20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c", "name": "network-vif-deleted", "tag": "194226fb-d5e0-469e-b28d-d34a807393bf"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:24:10.149501 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-dfd1e0e2-9f21-4a90-9405-2d9978d5fdd4 req-d0fe52b0-af29-4c57-868c-137131fd2d20 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:10.155372 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-dfd1e0e2-9f21-4a90-9405-2d9978d5fdd4 req-d0fe52b0-af29-4c57-868c-137131fd2d20 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:10.181634 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-dfd1e0e2-9f21-4a90-9405-2d9978d5fdd4 req-d0fe52b0-af29-4c57-868c-137131fd2d20 service nova] Creating event network-vif-deleted:194226fb-d5e0-469e-b28d-d34a807393bf for instance 69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c on n-h1-master-1 Jun 20 12:24:10.198122 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-dfd1e0e2-9f21-4a90-9405-2d9978d5fdd4 req-d0fe52b0-af29-4c57-868c-137131fd2d20 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097166 Jun 20 12:24:10.199200 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2520/5146] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:24:10.329912 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-070a8a5b-e6ff-40fa-9f5b-59f6d580b0dd tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:10.331357 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-070a8a5b-e6ff-40fa-9f5b-59f6d580b0dd tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] [instance: 69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:10.343340 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-070a8a5b-e6ff-40fa-9f5b-59f6d580b0dd tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:10.344091 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-070a8a5b-e6ff-40fa-9f5b-59f6d580b0dd tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:10.345177 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-070a8a5b-e6ff-40fa-9f5b-59f6d580b0dd tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:10.345790 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-070a8a5b-e6ff-40fa-9f5b-59f6d580b0dd tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:10.370447 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-070a8a5b-e6ff-40fa-9f5b-59f6d580b0dd tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] HTTP exception thrown: Instance 69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c could not be found. Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-070a8a5b-e6ff-40fa-9f5b-59f6d580b0dd tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Request method failure captured: Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c HTTP/1.1 Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGan5wDSHb3yerQSCSiB1UUmFkfAMh0-klsR7H8eC77T56dQn_iZ1MgSkqNS111N8fkw1RUhrROgURlYrqOg88vy7BidaGa4YMigHP54StVo5r1z4y6Dc8_CIG9qg0ORa4CuIxVaF0h40i6F0SsK4EOxyiQoa7Rmx37-viRA8cP4rwg Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 94bcbf77cdc246e99f0a94398ed41a08 Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-MultipleCreateTestJSON-1421890612 Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/94bcbf77cdc246e99f0a94398ed41a08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/94bcbf77cdc246e99f0a94398ed41a08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/94bcbf77cdc246e99f0a94398ed41a08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_94bcbf77cdc246e99f0a94398ed41a08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-MultipleCreateTestJSON-1421890612 Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 94bcbf77cdc246e99f0a94398ed41a08 Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1421890612 Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-MultipleCreateTestJSON-1421890612-project Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 7656081c0941463990b483b9db21536a Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-MultipleCreateTestJSON-1421890612-project Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c could not be found. Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c'} Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c could not be found. Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c could not be found. Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:24:10.373384 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:24:10.379859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:24:10.379859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:24:10.379859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:24:10.379859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:24:10.379859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:24:10.379859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c could not be found. Jun 20 12:24:10.379859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:24:10.383170 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-070a8a5b-e6ff-40fa-9f5b-59f6d580b0dd tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] Returning 404 to user: Instance 69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:24:10.384324 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-070a8a5b-e6ff-40fa-9f5b-59f6d580b0dd tempest-MultipleCreateTestJSON-1421890612 tempest-MultipleCreateTestJSON-1421890612-project] 10.222.0.27 "GET /compute/v2.1/servers/69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c" status: 404 len: 111 microversion: 2.1 time: 0.068190 Jun 20 12:24:10.385451 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2521/5147] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:10 2022] GET /compute/v2.1/servers/69c7e9c2-36fa-46eb-bffe-1d2b9caa1d2c => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:24:10.817855 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5d70acc4-75d8-4c2c-9100-6e80175c4ef3 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:10.827845 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5d70acc4-75d8-4c2c-9100-6e80175c4ef3 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/bf0e099f-bcdd-4b6e-b18c-c6117afacfe6" status: 200 len: 1373 microversion: 2.1 time: 1.121769 Jun 20 12:24:10.828693 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2627/5148] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:09 2022] GET /compute/v2.1/servers/bf0e099f-bcdd-4b6e-b18c-c6117afacfe6 => generated 1373 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:24:11.103330 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2f09e11a-cbfe-4a4e-b773-6140a9d8a24d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:11.104008 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2f09e11a-cbfe-4a4e-b773-6140a9d8a24d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:11.118448 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2f09e11a-cbfe-4a4e-b773-6140a9d8a24d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:11.119217 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2f09e11a-cbfe-4a4e-b773-6140a9d8a24d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:11.120423 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2f09e11a-cbfe-4a4e-b773-6140a9d8a24d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:11.121200 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2f09e11a-cbfe-4a4e-b773-6140a9d8a24d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:11.622017 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a943c85f-a2df-4ed0-878b-25a5a2a3cc71 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-617256560", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "7f3c52d2-1d4f-4f08-951b-fbb69a8e33d4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-690292039", "security_groups": [{"name": "tempest-secgroup-smoke-203801118"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:24:11.713791 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2f09e11a-cbfe-4a4e-b773-6140a9d8a24d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:11.723839 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2f09e11a-cbfe-4a4e-b773-6140a9d8a24d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1678 microversion: 2.1 time: 0.625121 Jun 20 12:24:11.724526 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2522/5149] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:11 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1678 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:11.740236 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-889806e4-439b-435c-a786-c40c7d064342 req-c4ff1549-2db3-4252-953a-c8cf59704d82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf0e099f-bcdd-4b6e-b18c-c6117afacfe6", "name": "network-vif-plugged", "status": "completed", "tag": "d37a67de-6448-4845-9136-14ad539179f4"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:24:11.789707 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-889806e4-439b-435c-a786-c40c7d064342 req-c4ff1549-2db3-4252-953a-c8cf59704d82 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:11.790418 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-889806e4-439b-435c-a786-c40c7d064342 req-c4ff1549-2db3-4252-953a-c8cf59704d82 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:11.822594 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-889806e4-439b-435c-a786-c40c7d064342 req-c4ff1549-2db3-4252-953a-c8cf59704d82 service nova] Creating event network-vif-plugged:d37a67de-6448-4845-9136-14ad539179f4 for instance bf0e099f-bcdd-4b6e-b18c-c6117afacfe6 on n-h1-master-1 Jun 20 12:24:11.831921 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-889806e4-439b-435c-a786-c40c7d064342 req-c4ff1549-2db3-4252-953a-c8cf59704d82 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098685 Jun 20 12:24:11.833422 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2523/5150] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:24:11.846450 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d02c80bd-2daf-46e4-bfbf-cac963804267 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:11.847483 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d02c80bd-2daf-46e4-bfbf-cac963804267 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: bf0e099f-bcdd-4b6e-b18c-c6117afacfe6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:11.872150 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d02c80bd-2daf-46e4-bfbf-cac963804267 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:11.873040 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d02c80bd-2daf-46e4-bfbf-cac963804267 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:11.874021 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d02c80bd-2daf-46e4-bfbf-cac963804267 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:11.874632 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d02c80bd-2daf-46e4-bfbf-cac963804267 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:12.343202 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-a943c85f-a2df-4ed0-878b-25a5a2a3cc71 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] validate_networks() for [('7f3c52d2-1d4f-4f08-951b-fbb69a8e33d4', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:24:13.313259 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-a943c85f-a2df-4ed0-878b-25a5a2a3cc71 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:24:13.313766 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-a943c85f-a2df-4ed0-878b-25a5a2a3cc71 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:24:13.314498 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-a943c85f-a2df-4ed0-878b-25a5a2a3cc71 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:24:13.315802 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-a943c85f-a2df-4ed0-878b-25a5a2a3cc71 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:24:13.316501 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-a943c85f-a2df-4ed0-878b-25a5a2a3cc71 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:24:13.321964 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d02c80bd-2daf-46e4-bfbf-cac963804267 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:13.338647 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d02c80bd-2daf-46e4-bfbf-cac963804267 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/bf0e099f-bcdd-4b6e-b18c-c6117afacfe6" status: 200 len: 1373 microversion: 2.1 time: 1.493278 Jun 20 12:24:13.340433 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2524/5151] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:11 2022] GET /compute/v2.1/servers/bf0e099f-bcdd-4b6e-b18c-c6117afacfe6 => generated 1373 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:24:13.352926 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a943c85f-a2df-4ed0-878b-25a5a2a3cc71 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:13.360956 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0c98f511-c8b4-46ee-9f18-873503dee9f3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:13.360956 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0c98f511-c8b4-46ee-9f18-873503dee9f3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:13.361231 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a943c85f-a2df-4ed0-878b-25a5a2a3cc71 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:13.362416 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a943c85f-a2df-4ed0-878b-25a5a2a3cc71 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:13.364892 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a943c85f-a2df-4ed0-878b-25a5a2a3cc71 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:13.390575 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c98f511-c8b4-46ee-9f18-873503dee9f3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:13.392007 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c98f511-c8b4-46ee-9f18-873503dee9f3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:13.395530 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c98f511-c8b4-46ee-9f18-873503dee9f3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:13.396477 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c98f511-c8b4-46ee-9f18-873503dee9f3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:13.429506 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-a943c85f-a2df-4ed0-878b-25a5a2a3cc71 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Getting quotas for project 9e9e481852fe4e6ebdc15ec343a741f2. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:24:13.461640 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-a943c85f-a2df-4ed0-878b-25a5a2a3cc71 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Getting quotas for user cd27c8696f7147e18054b26ebbae7045 and project 9e9e481852fe4e6ebdc15ec343a741f2. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:24:13.518782 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a943c85f-a2df-4ed0-878b-25a5a2a3cc71 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:24:13.529244 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a943c85f-a2df-4ed0-878b-25a5a2a3cc71 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 7ac4715b-0c6b-4e90-b6e3-63a115494aec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:24:13.657342 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a943c85f-a2df-4ed0-878b-25a5a2a3cc71 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.040052 Jun 20 12:24:13.660134 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2628/5152] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:24:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 2043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:24:13.672997 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-03a91ee4-bcff-4684-89b5-101bd1930266 req-8ef1069b-165a-4711-b1d3-17b6e5db8620 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b047d91-122c-44ee-b96e-1e0836960caa", "tag": "22195dfd-111f-4198-a632-bf1919d0b981"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:24:13.715154 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-03a91ee4-bcff-4684-89b5-101bd1930266 req-8ef1069b-165a-4711-b1d3-17b6e5db8620 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:13.721877 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-03a91ee4-bcff-4684-89b5-101bd1930266 req-8ef1069b-165a-4711-b1d3-17b6e5db8620 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:13.761197 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-03a91ee4-bcff-4684-89b5-101bd1930266 req-8ef1069b-165a-4711-b1d3-17b6e5db8620 service nova] Creating event network-changed:22195dfd-111f-4198-a632-bf1919d0b981 for instance 5b047d91-122c-44ee-b96e-1e0836960caa on n-h2-master-1 Jun 20 12:24:13.782970 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-03a91ee4-bcff-4684-89b5-101bd1930266 req-8ef1069b-165a-4711-b1d3-17b6e5db8620 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118205 Jun 20 12:24:13.787251 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2629/5153] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:24:13.812424 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-44d83c05-a729-4f3a-902e-7d4cb7bf33b4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:13.813694 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-44d83c05-a729-4f3a-902e-7d4cb7bf33b4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 7ac4715b-0c6b-4e90-b6e3-63a115494aec] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:13.855418 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:14.126046 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-44d83c05-a729-4f3a-902e-7d4cb7bf33b4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:14.145422 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-44d83c05-a729-4f3a-902e-7d4cb7bf33b4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec" status: 200 len: 1265 microversion: 2.1 time: 0.356723 Jun 20 12:24:14.146058 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2630/5154] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:13 2022] GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec => generated 1265 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:14.320884 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0c98f511-c8b4-46ee-9f18-873503dee9f3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:14.349843 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0c98f511-c8b4-46ee-9f18-873503dee9f3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 1.005460 Jun 20 12:24:14.354092 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2525/5155] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:13 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:14.371809 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-619b5ae5-17e1-4b62-b509-6b8aaec2d4e2 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:14.372475 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-619b5ae5-17e1-4b62-b509-6b8aaec2d4e2 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: bf0e099f-bcdd-4b6e-b18c-c6117afacfe6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:14.389020 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-619b5ae5-17e1-4b62-b509-6b8aaec2d4e2 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:14.390044 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-619b5ae5-17e1-4b62-b509-6b8aaec2d4e2 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:14.395524 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-619b5ae5-17e1-4b62-b509-6b8aaec2d4e2 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:14.396004 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-619b5ae5-17e1-4b62-b509-6b8aaec2d4e2 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:14.955814 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-619b5ae5-17e1-4b62-b509-6b8aaec2d4e2 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:14.993816 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-619b5ae5-17e1-4b62-b509-6b8aaec2d4e2 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/bf0e099f-bcdd-4b6e-b18c-c6117afacfe6" status: 200 len: 1546 microversion: 2.1 time: 0.632970 Jun 20 12:24:15.012495 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2631/5156] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:14 2022] GET /compute/v2.1/servers/bf0e099f-bcdd-4b6e-b18c-c6117afacfe6 => generated 1546 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:15.020431 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-edcb76c9-d72a-49b3-86c3-9dda8a7e50a9 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:15.021825 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-edcb76c9-d72a-49b3-86c3-9dda8a7e50a9 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: bf0e099f-bcdd-4b6e-b18c-c6117afacfe6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:15.032738 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-edcb76c9-d72a-49b3-86c3-9dda8a7e50a9 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:15.033706 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-edcb76c9-d72a-49b3-86c3-9dda8a7e50a9 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:15.037612 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-edcb76c9-d72a-49b3-86c3-9dda8a7e50a9 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:15.039421 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-edcb76c9-d72a-49b3-86c3-9dda8a7e50a9 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:15.165764 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5672ca01-5a76-41ee-ab4e-a02b26f76d05 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:15.167316 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5672ca01-5a76-41ee-ab4e-a02b26f76d05 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 7ac4715b-0c6b-4e90-b6e3-63a115494aec] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:15.207598 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5672ca01-5a76-41ee-ab4e-a02b26f76d05 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:15.211547 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5672ca01-5a76-41ee-ab4e-a02b26f76d05 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:15.218116 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5672ca01-5a76-41ee-ab4e-a02b26f76d05 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:15.224237 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5672ca01-5a76-41ee-ab4e-a02b26f76d05 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:15.589213 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5672ca01-5a76-41ee-ab4e-a02b26f76d05 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:15.605992 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5672ca01-5a76-41ee-ab4e-a02b26f76d05 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec" status: 200 len: 1317 microversion: 2.1 time: 0.446914 Jun 20 12:24:15.606626 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2632/5157] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:15 2022] GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec => generated 1317 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:16.197422 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-edcb76c9-d72a-49b3-86c3-9dda8a7e50a9 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:16.230759 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-edcb76c9-d72a-49b3-86c3-9dda8a7e50a9 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/bf0e099f-bcdd-4b6e-b18c-c6117afacfe6" status: 200 len: 1546 microversion: 2.1 time: 1.207937 Jun 20 12:24:16.252537 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2526/5158] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:15 2022] GET /compute/v2.1/servers/bf0e099f-bcdd-4b6e-b18c-c6117afacfe6 => generated 1546 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:16.627302 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8126a48b-542d-4f75-9c3e-16a9ac6bb7d1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:16.627908 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8126a48b-542d-4f75-9c3e-16a9ac6bb7d1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 7ac4715b-0c6b-4e90-b6e3-63a115494aec] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:16.637203 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8126a48b-542d-4f75-9c3e-16a9ac6bb7d1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:16.637657 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8126a48b-542d-4f75-9c3e-16a9ac6bb7d1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:16.663282 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8126a48b-542d-4f75-9c3e-16a9ac6bb7d1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:16.665850 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8126a48b-542d-4f75-9c3e-16a9ac6bb7d1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:16.824817 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8126a48b-542d-4f75-9c3e-16a9ac6bb7d1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:16.839359 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8126a48b-542d-4f75-9c3e-16a9ac6bb7d1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec" status: 200 len: 1323 microversion: 2.1 time: 0.216756 Jun 20 12:24:16.864052 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2633/5159] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:16 2022] GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec => generated 1323 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:17.870072 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ecbdb631-488f-4000-b4e5-64ea0667ce91 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:17.871941 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ecbdb631-488f-4000-b4e5-64ea0667ce91 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 7ac4715b-0c6b-4e90-b6e3-63a115494aec] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:17.889348 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ecbdb631-488f-4000-b4e5-64ea0667ce91 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:17.890246 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ecbdb631-488f-4000-b4e5-64ea0667ce91 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:17.891309 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ecbdb631-488f-4000-b4e5-64ea0667ce91 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:17.891988 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ecbdb631-488f-4000-b4e5-64ea0667ce91 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:18.116970 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ecbdb631-488f-4000-b4e5-64ea0667ce91 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:18.130762 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ecbdb631-488f-4000-b4e5-64ea0667ce91 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec" status: 200 len: 1323 microversion: 2.1 time: 0.264059 Jun 20 12:24:18.137336 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2527/5160] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:17 2022] GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec => generated 1323 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:19.154413 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b00cd5fc-7d62-4157-9e79-c6f2bce2b9dd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:19.155943 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b00cd5fc-7d62-4157-9e79-c6f2bce2b9dd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 7ac4715b-0c6b-4e90-b6e3-63a115494aec] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:19.169992 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b00cd5fc-7d62-4157-9e79-c6f2bce2b9dd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:19.173680 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b00cd5fc-7d62-4157-9e79-c6f2bce2b9dd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:19.174784 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b00cd5fc-7d62-4157-9e79-c6f2bce2b9dd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:19.175639 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b00cd5fc-7d62-4157-9e79-c6f2bce2b9dd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:19.446566 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b00cd5fc-7d62-4157-9e79-c6f2bce2b9dd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:19.458586 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b00cd5fc-7d62-4157-9e79-c6f2bce2b9dd tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec" status: 200 len: 1390 microversion: 2.1 time: 0.307655 Jun 20 12:24:19.470533 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2634/5161] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:19 2022] GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec => generated 1390 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:20.119016 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-75858774-79b1-40c7-9532-6e65ace656b1 req-76f019b4-7820-4c61-bc67-e97f3dd855db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ac4715b-0c6b-4e90-b6e3-63a115494aec", "tag": "73ffd2e1-a5c9-4cd2-b381-c75748f2cb0b"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:24:20.132655 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-75858774-79b1-40c7-9532-6e65ace656b1 req-76f019b4-7820-4c61-bc67-e97f3dd855db service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:20.139668 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-75858774-79b1-40c7-9532-6e65ace656b1 req-76f019b4-7820-4c61-bc67-e97f3dd855db service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:20.162525 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-75858774-79b1-40c7-9532-6e65ace656b1 req-76f019b4-7820-4c61-bc67-e97f3dd855db service nova] Creating event network-changed:73ffd2e1-a5c9-4cd2-b381-c75748f2cb0b for instance 7ac4715b-0c6b-4e90-b6e3-63a115494aec on n-h2-master-1 Jun 20 12:24:20.182641 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-75858774-79b1-40c7-9532-6e65ace656b1 req-76f019b4-7820-4c61-bc67-e97f3dd855db service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067434 Jun 20 12:24:20.184033 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2528/5162] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:24:20.477074 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a5cb405d-7954-4ccc-a339-bd221c0498db tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:20.478911 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a5cb405d-7954-4ccc-a339-bd221c0498db tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 7ac4715b-0c6b-4e90-b6e3-63a115494aec] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:20.487167 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5cb405d-7954-4ccc-a339-bd221c0498db tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:20.489488 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5cb405d-7954-4ccc-a339-bd221c0498db tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:20.491618 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5cb405d-7954-4ccc-a339-bd221c0498db tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:20.493695 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5cb405d-7954-4ccc-a339-bd221c0498db tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:21.162284 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a5cb405d-7954-4ccc-a339-bd221c0498db tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:21.179123 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a5cb405d-7954-4ccc-a339-bd221c0498db tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec" status: 200 len: 1390 microversion: 2.1 time: 0.699790 Jun 20 12:24:21.190685 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2635/5163] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:20 2022] GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec => generated 1390 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:22.202670 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0380efd6-e9fb-4676-9970-b6bd4372c9a1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:22.204164 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0380efd6-e9fb-4676-9970-b6bd4372c9a1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 7ac4715b-0c6b-4e90-b6e3-63a115494aec] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:22.215223 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0380efd6-e9fb-4676-9970-b6bd4372c9a1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:22.216140 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0380efd6-e9fb-4676-9970-b6bd4372c9a1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:22.218054 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0380efd6-e9fb-4676-9970-b6bd4372c9a1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:22.219758 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0380efd6-e9fb-4676-9970-b6bd4372c9a1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:22.997042 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0380efd6-e9fb-4676-9970-b6bd4372c9a1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:23.013527 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0380efd6-e9fb-4676-9970-b6bd4372c9a1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec" status: 200 len: 1390 microversion: 2.1 time: 0.818487 Jun 20 12:24:23.028064 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2529/5164] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:22 2022] GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec => generated 1390 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:23.281315 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-a37d9e10-6f80-4e42-82a9-47a6217a7cc2 req-2955d444-afeb-494d-b8e7-20f4a92a28f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf0e099f-bcdd-4b6e-b18c-c6117afacfe6", "tag": "d37a67de-6448-4845-9136-14ad539179f4"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:24:23.302315 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-a37d9e10-6f80-4e42-82a9-47a6217a7cc2 req-2955d444-afeb-494d-b8e7-20f4a92a28f3 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:23.306608 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-a37d9e10-6f80-4e42-82a9-47a6217a7cc2 req-2955d444-afeb-494d-b8e7-20f4a92a28f3 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:23.324412 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-a37d9e10-6f80-4e42-82a9-47a6217a7cc2 req-2955d444-afeb-494d-b8e7-20f4a92a28f3 service nova] Creating event network-changed:d37a67de-6448-4845-9136-14ad539179f4 for instance bf0e099f-bcdd-4b6e-b18c-c6117afacfe6 on n-h1-master-1 Jun 20 12:24:23.335674 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-a37d9e10-6f80-4e42-82a9-47a6217a7cc2 req-2955d444-afeb-494d-b8e7-20f4a92a28f3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058738 Jun 20 12:24:23.341080 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2636/5165] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:24:24.031848 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2e10562e-1306-4e36-a68c-1bbc6dee71a0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:24.033217 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2e10562e-1306-4e36-a68c-1bbc6dee71a0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 7ac4715b-0c6b-4e90-b6e3-63a115494aec] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:24.048629 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2e10562e-1306-4e36-a68c-1bbc6dee71a0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:24.049112 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2e10562e-1306-4e36-a68c-1bbc6dee71a0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:24.049933 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2e10562e-1306-4e36-a68c-1bbc6dee71a0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:24.061335 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2e10562e-1306-4e36-a68c-1bbc6dee71a0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:24.117090 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:24.510966 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2e10562e-1306-4e36-a68c-1bbc6dee71a0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:24.533654 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2e10562e-1306-4e36-a68c-1bbc6dee71a0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec" status: 200 len: 1390 microversion: 2.1 time: 0.505964 Jun 20 12:24:24.535427 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2530/5166] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:24 2022] GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec => generated 1390 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:25.548702 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:25.549969 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=8 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:25.555287 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-20986870-c94b-4f83-b137-e461ea4055ca tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:25.555961 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-20986870-c94b-4f83-b137-e461ea4055ca tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 7ac4715b-0c6b-4e90-b6e3-63a115494aec] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:25.591647 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-20986870-c94b-4f83-b137-e461ea4055ca tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:25.592117 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-20986870-c94b-4f83-b137-e461ea4055ca tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:25.593036 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-20986870-c94b-4f83-b137-e461ea4055ca tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:25.593496 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-20986870-c94b-4f83-b137-e461ea4055ca tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:26.312875 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-20986870-c94b-4f83-b137-e461ea4055ca tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:26.323263 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-20986870-c94b-4f83-b137-e461ea4055ca tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec" status: 200 len: 1390 microversion: 2.1 time: 0.775408 Jun 20 12:24:26.336926 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2637/5167] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:25 2022] GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec => generated 1390 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:27.343508 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-58049e8d-0edf-4663-8105-a8cdc5d14ec0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:27.344879 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-58049e8d-0edf-4663-8105-a8cdc5d14ec0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 7ac4715b-0c6b-4e90-b6e3-63a115494aec] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:27.355661 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-58049e8d-0edf-4663-8105-a8cdc5d14ec0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:27.355661 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-58049e8d-0edf-4663-8105-a8cdc5d14ec0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:27.355661 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-58049e8d-0edf-4663-8105-a8cdc5d14ec0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:27.355661 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-58049e8d-0edf-4663-8105-a8cdc5d14ec0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:27.696610 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-58049e8d-0edf-4663-8105-a8cdc5d14ec0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:27.706101 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-58049e8d-0edf-4663-8105-a8cdc5d14ec0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec" status: 200 len: 1390 microversion: 2.1 time: 0.366666 Jun 20 12:24:27.707626 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2531/5168] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:27 2022] GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec => generated 1390 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:28.724096 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5666a027-1f63-4b95-a9e6-1af9afba0653 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:28.724893 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5666a027-1f63-4b95-a9e6-1af9afba0653 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 7ac4715b-0c6b-4e90-b6e3-63a115494aec] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:28.732702 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5666a027-1f63-4b95-a9e6-1af9afba0653 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:28.733154 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5666a027-1f63-4b95-a9e6-1af9afba0653 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:28.734285 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5666a027-1f63-4b95-a9e6-1af9afba0653 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:28.735098 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5666a027-1f63-4b95-a9e6-1af9afba0653 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:29.423509 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5666a027-1f63-4b95-a9e6-1af9afba0653 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:29.437828 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5666a027-1f63-4b95-a9e6-1af9afba0653 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec" status: 200 len: 1390 microversion: 2.1 time: 0.717984 Jun 20 12:24:29.439030 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2638/5169] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:28 2022] GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec => generated 1390 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:29.457470 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-772858b5-87f3-4aca-a508-ee5046b24576 req-f70cfc05-d502-4080-a8fb-d19e2c6bcb92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ac4715b-0c6b-4e90-b6e3-63a115494aec", "name": "network-vif-plugged", "status": "completed", "tag": "73ffd2e1-a5c9-4cd2-b381-c75748f2cb0b"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:24:29.468038 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-772858b5-87f3-4aca-a508-ee5046b24576 req-f70cfc05-d502-4080-a8fb-d19e2c6bcb92 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:29.468955 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-772858b5-87f3-4aca-a508-ee5046b24576 req-f70cfc05-d502-4080-a8fb-d19e2c6bcb92 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:29.483111 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-772858b5-87f3-4aca-a508-ee5046b24576 req-f70cfc05-d502-4080-a8fb-d19e2c6bcb92 service nova] Creating event network-vif-plugged:73ffd2e1-a5c9-4cd2-b381-c75748f2cb0b for instance 7ac4715b-0c6b-4e90-b6e3-63a115494aec on n-h2-master-1 Jun 20 12:24:29.489365 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-772858b5-87f3-4aca-a508-ee5046b24576 req-f70cfc05-d502-4080-a8fb-d19e2c6bcb92 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036146 Jun 20 12:24:29.490587 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2532/5170] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:24:30.461587 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-16ea7988-1813-4dce-9b7d-0146022aba4f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:30.463150 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-16ea7988-1813-4dce-9b7d-0146022aba4f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 7ac4715b-0c6b-4e90-b6e3-63a115494aec] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:30.486419 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-16ea7988-1813-4dce-9b7d-0146022aba4f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:30.487255 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-16ea7988-1813-4dce-9b7d-0146022aba4f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:30.488714 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-16ea7988-1813-4dce-9b7d-0146022aba4f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:30.489655 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-16ea7988-1813-4dce-9b7d-0146022aba4f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:31.018540 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-16ea7988-1813-4dce-9b7d-0146022aba4f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:31.020415 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-874338d1-3003-45f0-ae8f-ee925d71bfa8 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1703115550", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "229b7ecc-93a6-4c2b-aede-3cd5c398071a"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:24:31.027934 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-16ea7988-1813-4dce-9b7d-0146022aba4f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec" status: 200 len: 1390 microversion: 2.1 time: 0.572371 Jun 20 12:24:31.040588 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2639/5171] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:30 2022] GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec => generated 1390 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:31.125828 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-874338d1-3003-45f0-ae8f-ee925d71bfa8 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] validate_networks() for [('229b7ecc-93a6-4c2b-aede-3cd5c398071a', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:24:32.048925 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7ba60296-2abf-4e8b-ad9f-0a8a4d25a2af tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:32.050212 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7ba60296-2abf-4e8b-ad9f-0a8a4d25a2af tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 7ac4715b-0c6b-4e90-b6e3-63a115494aec] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:32.094609 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ba60296-2abf-4e8b-ad9f-0a8a4d25a2af tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:32.095405 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ba60296-2abf-4e8b-ad9f-0a8a4d25a2af tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:32.096511 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ba60296-2abf-4e8b-ad9f-0a8a4d25a2af tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:32.098706 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ba60296-2abf-4e8b-ad9f-0a8a4d25a2af tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:32.353126 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-874338d1-3003-45f0-ae8f-ee925d71bfa8 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:24:32.353632 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-874338d1-3003-45f0-ae8f-ee925d71bfa8 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:24:32.354487 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-874338d1-3003-45f0-ae8f-ee925d71bfa8 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:24:32.355037 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-874338d1-3003-45f0-ae8f-ee925d71bfa8 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:24:32.355557 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-874338d1-3003-45f0-ae8f-ee925d71bfa8 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:24:32.390647 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-874338d1-3003-45f0-ae8f-ee925d71bfa8 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:32.394503 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-874338d1-3003-45f0-ae8f-ee925d71bfa8 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:32.397711 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-874338d1-3003-45f0-ae8f-ee925d71bfa8 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:32.398764 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-874338d1-3003-45f0-ae8f-ee925d71bfa8 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:32.443874 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-874338d1-3003-45f0-ae8f-ee925d71bfa8 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Getting quotas for project a2294bc303ed4f36ab22438ca02406ea. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:24:32.469110 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-874338d1-3003-45f0-ae8f-ee925d71bfa8 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Getting quotas for user 4014584efd4f43ac8426c58befba19da and project a2294bc303ed4f36ab22438ca02406ea. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:24:32.494456 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-874338d1-3003-45f0-ae8f-ee925d71bfa8 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:24:32.497360 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-874338d1-3003-45f0-ae8f-ee925d71bfa8 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] [instance: 5b7e4aa9-a25c-48e6-895f-2bb1fda1b938] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:24:32.550868 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7ba60296-2abf-4e8b-ad9f-0a8a4d25a2af tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:32.563945 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7ba60296-2abf-4e8b-ad9f-0a8a4d25a2af tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec" status: 200 len: 1562 microversion: 2.1 time: 0.519244 Jun 20 12:24:32.565448 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2640/5172] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:32 2022] GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec => generated 1562 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:32.600137 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-55e6f534-5634-4add-8e04-0c7932c043a2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:32.600488 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-55e6f534-5634-4add-8e04-0c7932c043a2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 7ac4715b-0c6b-4e90-b6e3-63a115494aec] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:32.601680 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-874338d1-3003-45f0-ae8f-ee925d71bfa8 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.795801 Jun 20 12:24:32.603122 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2533/5173] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:24:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:24:32.615411 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a3c110c7-e603-42da-b89c-e53ff38e9ba9 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:32.616431 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a3c110c7-e603-42da-b89c-e53ff38e9ba9 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] [instance: 5b7e4aa9-a25c-48e6-895f-2bb1fda1b938] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:32.629711 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-55e6f534-5634-4add-8e04-0c7932c043a2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:32.632677 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-55e6f534-5634-4add-8e04-0c7932c043a2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:32.634309 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-55e6f534-5634-4add-8e04-0c7932c043a2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:32.636758 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-55e6f534-5634-4add-8e04-0c7932c043a2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:32.758591 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a3c110c7-e603-42da-b89c-e53ff38e9ba9 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4014584efd4f43ac8426c58befba19da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2294bc303ed4f36ab22438ca02406ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:32.767888 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a3c110c7-e603-42da-b89c-e53ff38e9ba9 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] 10.222.0.27 "GET /compute/v2.1/servers/5b7e4aa9-a25c-48e6-895f-2bb1fda1b938" status: 200 len: 1214 microversion: 2.1 time: 0.158039 Jun 20 12:24:32.768819 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2534/5174] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:32 2022] GET /compute/v2.1/servers/5b7e4aa9-a25c-48e6-895f-2bb1fda1b938 => generated 1214 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:33.640056 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-55e6f534-5634-4add-8e04-0c7932c043a2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:33.649366 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-55e6f534-5634-4add-8e04-0c7932c043a2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec" status: 200 len: 1562 microversion: 2.1 time: 1.071196 Jun 20 12:24:33.650217 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2641/5175] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:32 2022] GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec => generated 1562 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:33.787269 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4ddb8888-c88c-4a28-8c52-7bcd2e0e364c tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:33.788242 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4ddb8888-c88c-4a28-8c52-7bcd2e0e364c tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] [instance: 5b7e4aa9-a25c-48e6-895f-2bb1fda1b938] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:33.792552 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:33.813457 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ddb8888-c88c-4a28-8c52-7bcd2e0e364c tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:33.814012 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ddb8888-c88c-4a28-8c52-7bcd2e0e364c tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:33.818391 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ddb8888-c88c-4a28-8c52-7bcd2e0e364c tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:33.819679 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ddb8888-c88c-4a28-8c52-7bcd2e0e364c tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:33.956832 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4ddb8888-c88c-4a28-8c52-7bcd2e0e364c tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4014584efd4f43ac8426c58befba19da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2294bc303ed4f36ab22438ca02406ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:33.980642 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4ddb8888-c88c-4a28-8c52-7bcd2e0e364c tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] 10.222.0.27 "GET /compute/v2.1/servers/5b7e4aa9-a25c-48e6-895f-2bb1fda1b938" status: 200 len: 1266 microversion: 2.1 time: 0.193181 Jun 20 12:24:33.981895 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2535/5176] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:33 2022] GET /compute/v2.1/servers/5b7e4aa9-a25c-48e6-895f-2bb1fda1b938 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:34.999436 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cfafc033-9c73-4ab4-8728-9ba1f0dd7875 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:35.000741 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cfafc033-9c73-4ab4-8728-9ba1f0dd7875 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] [instance: 5b7e4aa9-a25c-48e6-895f-2bb1fda1b938] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:35.029974 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cfafc033-9c73-4ab4-8728-9ba1f0dd7875 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:35.030428 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cfafc033-9c73-4ab4-8728-9ba1f0dd7875 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:35.031215 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cfafc033-9c73-4ab4-8728-9ba1f0dd7875 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:35.031651 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cfafc033-9c73-4ab4-8728-9ba1f0dd7875 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:35.238621 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cfafc033-9c73-4ab4-8728-9ba1f0dd7875 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4014584efd4f43ac8426c58befba19da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2294bc303ed4f36ab22438ca02406ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:35.265835 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cfafc033-9c73-4ab4-8728-9ba1f0dd7875 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] 10.222.0.27 "GET /compute/v2.1/servers/5b7e4aa9-a25c-48e6-895f-2bb1fda1b938" status: 200 len: 1272 microversion: 2.1 time: 0.270219 Jun 20 12:24:35.267991 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2642/5177] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:34 2022] GET /compute/v2.1/servers/5b7e4aa9-a25c-48e6-895f-2bb1fda1b938 => generated 1272 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:36.169551 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-35b1ca5a-18d1-4b14-8db6-c8a83061f736 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-492169594", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:24:36.274576 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-35b1ca5a-18d1-4b14-8db6-c8a83061f736 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] validate_networks() for [('ac2a4b03-47fb-4eb6-a4ab-3c306e2d4dc8', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:24:36.286095 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-741d7540-1585-40df-91ea-a2f31062645b tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:36.286709 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-741d7540-1585-40df-91ea-a2f31062645b tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] [instance: 5b7e4aa9-a25c-48e6-895f-2bb1fda1b938] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:36.303398 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-741d7540-1585-40df-91ea-a2f31062645b tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:36.303842 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-741d7540-1585-40df-91ea-a2f31062645b tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:36.306548 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-741d7540-1585-40df-91ea-a2f31062645b tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:36.308482 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-741d7540-1585-40df-91ea-a2f31062645b tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:36.439294 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-741d7540-1585-40df-91ea-a2f31062645b tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4014584efd4f43ac8426c58befba19da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2294bc303ed4f36ab22438ca02406ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:36.450393 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-741d7540-1585-40df-91ea-a2f31062645b tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] 10.222.0.27 "GET /compute/v2.1/servers/5b7e4aa9-a25c-48e6-895f-2bb1fda1b938" status: 200 len: 1272 microversion: 2.1 time: 0.168376 Jun 20 12:24:36.455875 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2643/5178] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:36 2022] GET /compute/v2.1/servers/5b7e4aa9-a25c-48e6-895f-2bb1fda1b938 => generated 1272 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:37.471230 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d88ba459-68b9-4d3c-ae93-bfd16b16aaf9 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:37.472359 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d88ba459-68b9-4d3c-ae93-bfd16b16aaf9 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] [instance: 5b7e4aa9-a25c-48e6-895f-2bb1fda1b938] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:37.484752 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d88ba459-68b9-4d3c-ae93-bfd16b16aaf9 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:37.484752 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d88ba459-68b9-4d3c-ae93-bfd16b16aaf9 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:37.485317 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d88ba459-68b9-4d3c-ae93-bfd16b16aaf9 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:37.486458 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d88ba459-68b9-4d3c-ae93-bfd16b16aaf9 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:37.870003 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d88ba459-68b9-4d3c-ae93-bfd16b16aaf9 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4014584efd4f43ac8426c58befba19da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2294bc303ed4f36ab22438ca02406ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:37.885274 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d88ba459-68b9-4d3c-ae93-bfd16b16aaf9 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] 10.222.0.27 "GET /compute/v2.1/servers/5b7e4aa9-a25c-48e6-895f-2bb1fda1b938" status: 200 len: 1314 microversion: 2.1 time: 0.418037 Jun 20 12:24:37.899105 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2644/5179] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:37 2022] GET /compute/v2.1/servers/5b7e4aa9-a25c-48e6-895f-2bb1fda1b938 => generated 1314 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:24:37.927384 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-35b1ca5a-18d1-4b14-8db6-c8a83061f736 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:24:37.928329 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-35b1ca5a-18d1-4b14-8db6-c8a83061f736 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:24:37.928329 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-35b1ca5a-18d1-4b14-8db6-c8a83061f736 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:24:37.928973 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-35b1ca5a-18d1-4b14-8db6-c8a83061f736 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:24:37.929149 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-35b1ca5a-18d1-4b14-8db6-c8a83061f736 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:24:37.947662 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-35b1ca5a-18d1-4b14-8db6-c8a83061f736 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:37.948106 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-35b1ca5a-18d1-4b14-8db6-c8a83061f736 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:37.948924 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-35b1ca5a-18d1-4b14-8db6-c8a83061f736 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:37.949365 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-35b1ca5a-18d1-4b14-8db6-c8a83061f736 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:37.983564 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-35b1ca5a-18d1-4b14-8db6-c8a83061f736 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Getting quotas for project 44cb6606f6a04b8b910fa472b8846f02. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:24:37.989732 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-35b1ca5a-18d1-4b14-8db6-c8a83061f736 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Getting quotas for user 9c8447285bb44a86a82741c6b08c6007 and project 44cb6606f6a04b8b910fa472b8846f02. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:24:38.011325 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-35b1ca5a-18d1-4b14-8db6-c8a83061f736 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:24:38.017319 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-35b1ca5a-18d1-4b14-8db6-c8a83061f736 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:24:38.117192 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-35b1ca5a-18d1-4b14-8db6-c8a83061f736 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.150074 Jun 20 12:24:38.132155 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f189eaf1-35fc-45ee-a94f-34eb8ff13109 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:38.132803 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f189eaf1-35fc-45ee-a94f-34eb8ff13109 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:38.137104 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2536/5180] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:24:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 2171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:24:38.289377 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f189eaf1-35fc-45ee-a94f-34eb8ff13109 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:38.298832 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f189eaf1-35fc-45ee-a94f-34eb8ff13109 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1213 microversion: 2.1 time: 0.173681 Jun 20 12:24:38.309924 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2645/5181] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:38 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1213 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:38.905984 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cef48465-6254-44dc-b5c9-b81949683348 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:38.906770 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cef48465-6254-44dc-b5c9-b81949683348 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] [instance: 5b7e4aa9-a25c-48e6-895f-2bb1fda1b938] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:38.918262 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cef48465-6254-44dc-b5c9-b81949683348 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:38.922992 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cef48465-6254-44dc-b5c9-b81949683348 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:38.926475 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cef48465-6254-44dc-b5c9-b81949683348 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:38.929940 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cef48465-6254-44dc-b5c9-b81949683348 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:39.332445 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dcc1da22-8f07-477c-a403-710f6220b0b9 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:39.333908 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dcc1da22-8f07-477c-a403-710f6220b0b9 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:39.349792 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dcc1da22-8f07-477c-a403-710f6220b0b9 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:39.351513 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dcc1da22-8f07-477c-a403-710f6220b0b9 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:39.353980 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dcc1da22-8f07-477c-a403-710f6220b0b9 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:39.357285 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dcc1da22-8f07-477c-a403-710f6220b0b9 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:39.407234 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=99 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:39.557523 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-cef48465-6254-44dc-b5c9-b81949683348 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4014584efd4f43ac8426c58befba19da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2294bc303ed4f36ab22438ca02406ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:39.569787 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cef48465-6254-44dc-b5c9-b81949683348 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] 10.222.0.27 "GET /compute/v2.1/servers/5b7e4aa9-a25c-48e6-895f-2bb1fda1b938" status: 200 len: 1314 microversion: 2.1 time: 0.667701 Jun 20 12:24:39.570472 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2537/5182] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:38 2022] GET /compute/v2.1/servers/5b7e4aa9-a25c-48e6-895f-2bb1fda1b938 => generated 1314 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:39.609764 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dcc1da22-8f07-477c-a403-710f6220b0b9 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:39.626201 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-db02fdf3-ba2c-4f61-9f9a-64016332bdde tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:24:39.627415 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-db02fdf3-ba2c-4f61-9f9a-64016332bdde tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: bf0e099f-bcdd-4b6e-b18c-c6117afacfe6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:39.638902 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-db02fdf3-ba2c-4f61-9f9a-64016332bdde tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:39.640822 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-db02fdf3-ba2c-4f61-9f9a-64016332bdde tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:39.641691 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-db02fdf3-ba2c-4f61-9f9a-64016332bdde tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:39.642139 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-db02fdf3-ba2c-4f61-9f9a-64016332bdde tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:39.657304 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dcc1da22-8f07-477c-a403-710f6220b0b9 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1265 microversion: 2.1 time: 0.327405 Jun 20 12:24:39.676581 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2646/5183] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:39 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1265 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:24:39.717161 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-eb5870c2-ce0f-4e7b-a920-1876008cbd0d req-1d7b3f45-a338-4c5c-98fa-d7c0bc56c188 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b7e4aa9-a25c-48e6-895f-2bb1fda1b938", "tag": "2d7ced42-1573-4d34-a85f-34e90b7393b2"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:24:39.740430 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-db02fdf3-ba2c-4f61-9f9a-64016332bdde tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "POST /compute/v2.1/servers/bf0e099f-bcdd-4b6e-b18c-c6117afacfe6/action" status: 200 len: 24522 microversion: 2.1 time: 0.118761 Jun 20 12:24:39.741116 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2538/5184] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:24:39 2022] POST /compute/v2.1/servers/bf0e099f-bcdd-4b6e-b18c-c6117afacfe6/action => generated 24522 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:24:39.765741 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-eb5870c2-ce0f-4e7b-a920-1876008cbd0d req-1d7b3f45-a338-4c5c-98fa-d7c0bc56c188 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:39.766152 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-eb5870c2-ce0f-4e7b-a920-1876008cbd0d req-1d7b3f45-a338-4c5c-98fa-d7c0bc56c188 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:39.793069 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-eb5870c2-ce0f-4e7b-a920-1876008cbd0d req-1d7b3f45-a338-4c5c-98fa-d7c0bc56c188 service nova] Creating event network-changed:2d7ced42-1573-4d34-a85f-34e90b7393b2 for instance 5b7e4aa9-a25c-48e6-895f-2bb1fda1b938 on n-h1-master-1 Jun 20 12:24:39.805697 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-eb5870c2-ce0f-4e7b-a920-1876008cbd0d req-1d7b3f45-a338-4c5c-98fa-d7c0bc56c188 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120102 Jun 20 12:24:39.806335 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2647/5185] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:24:40.236698 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ff3de9e6-35e5-41fd-a897-73a40c4d9867 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:40.237416 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ff3de9e6-35e5-41fd-a897-73a40c4d9867 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 7ac4715b-0c6b-4e90-b6e3-63a115494aec] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:40.258836 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ff3de9e6-35e5-41fd-a897-73a40c4d9867 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:40.259293 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ff3de9e6-35e5-41fd-a897-73a40c4d9867 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:40.260096 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ff3de9e6-35e5-41fd-a897-73a40c4d9867 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:40.264445 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ff3de9e6-35e5-41fd-a897-73a40c4d9867 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:40.590622 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7af5ae4a-e1b0-400b-ba9b-4f95a109ba1b tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:40.592708 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7af5ae4a-e1b0-400b-ba9b-4f95a109ba1b tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] [instance: 5b7e4aa9-a25c-48e6-895f-2bb1fda1b938] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:40.610474 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7af5ae4a-e1b0-400b-ba9b-4f95a109ba1b tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:40.611756 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7af5ae4a-e1b0-400b-ba9b-4f95a109ba1b tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:40.614936 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7af5ae4a-e1b0-400b-ba9b-4f95a109ba1b tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:40.616180 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7af5ae4a-e1b0-400b-ba9b-4f95a109ba1b tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:40.788374 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ff3de9e6-35e5-41fd-a897-73a40c4d9867 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:40.803615 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ff3de9e6-35e5-41fd-a897-73a40c4d9867 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec" status: 200 len: 1562 microversion: 2.1 time: 0.571194 Jun 20 12:24:40.821951 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2539/5186] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:40 2022] GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec => generated 1562 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:40.829508 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-249ea4b2-2cba-4510-b02f-8725c5c8596e tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:40.832074 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-249ea4b2-2cba-4510-b02f-8725c5c8596e tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:40.849099 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-249ea4b2-2cba-4510-b02f-8725c5c8596e tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:40.849607 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-249ea4b2-2cba-4510-b02f-8725c5c8596e tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:40.850805 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-249ea4b2-2cba-4510-b02f-8725c5c8596e tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:40.853965 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-249ea4b2-2cba-4510-b02f-8725c5c8596e tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:41.003525 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-249ea4b2-2cba-4510-b02f-8725c5c8596e tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:41.020192 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-249ea4b2-2cba-4510-b02f-8725c5c8596e tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1271 microversion: 2.1 time: 0.189204 Jun 20 12:24:41.021111 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2540/5187] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:40 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1271 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:41.297717 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7af5ae4a-e1b0-400b-ba9b-4f95a109ba1b tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4014584efd4f43ac8426c58befba19da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2294bc303ed4f36ab22438ca02406ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:41.311302 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7af5ae4a-e1b0-400b-ba9b-4f95a109ba1b tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] 10.222.0.27 "GET /compute/v2.1/servers/5b7e4aa9-a25c-48e6-895f-2bb1fda1b938" status: 200 len: 1314 microversion: 2.1 time: 0.727157 Jun 20 12:24:41.314602 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2648/5188] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:40 2022] GET /compute/v2.1/servers/5b7e4aa9-a25c-48e6-895f-2bb1fda1b938 => generated 1314 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:41.871278 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-06b333bb-daaf-468e-8efe-afdf94a4bf50 req-f4c0ba8d-636d-4b48-b745-1f46ff8b6bac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ac4715b-0c6b-4e90-b6e3-63a115494aec", "tag": "73ffd2e1-a5c9-4cd2-b381-c75748f2cb0b"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:24:41.884940 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-06b333bb-daaf-468e-8efe-afdf94a4bf50 req-f4c0ba8d-636d-4b48-b745-1f46ff8b6bac service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:41.885959 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-06b333bb-daaf-468e-8efe-afdf94a4bf50 req-f4c0ba8d-636d-4b48-b745-1f46ff8b6bac service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:41.901350 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-06b333bb-daaf-468e-8efe-afdf94a4bf50 req-f4c0ba8d-636d-4b48-b745-1f46ff8b6bac service nova] Creating event network-changed:73ffd2e1-a5c9-4cd2-b381-c75748f2cb0b for instance 7ac4715b-0c6b-4e90-b6e3-63a115494aec on n-h2-master-1 Jun 20 12:24:41.909823 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-06b333bb-daaf-468e-8efe-afdf94a4bf50 req-f4c0ba8d-636d-4b48-b745-1f46ff8b6bac service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041998 Jun 20 12:24:41.911253 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2541/5189] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:24:42.042753 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3eb0024d-cffb-4e4f-b469-c1e9a051f79f tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:42.043349 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3eb0024d-cffb-4e4f-b469-c1e9a051f79f tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:42.059100 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3eb0024d-cffb-4e4f-b469-c1e9a051f79f tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:42.059920 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3eb0024d-cffb-4e4f-b469-c1e9a051f79f tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:42.061205 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3eb0024d-cffb-4e4f-b469-c1e9a051f79f tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:42.062339 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3eb0024d-cffb-4e4f-b469-c1e9a051f79f tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:42.330791 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-614e1be7-c676-4a5e-8e10-cafe9b089280 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:42.332523 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-614e1be7-c676-4a5e-8e10-cafe9b089280 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] [instance: 5b7e4aa9-a25c-48e6-895f-2bb1fda1b938] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:42.339687 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-614e1be7-c676-4a5e-8e10-cafe9b089280 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:42.340610 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-614e1be7-c676-4a5e-8e10-cafe9b089280 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:42.341691 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-614e1be7-c676-4a5e-8e10-cafe9b089280 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:42.345913 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-614e1be7-c676-4a5e-8e10-cafe9b089280 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:42.833325 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3eb0024d-cffb-4e4f-b469-c1e9a051f79f tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:42.841590 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3eb0024d-cffb-4e4f-b469-c1e9a051f79f tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1313 microversion: 2.1 time: 0.807643 Jun 20 12:24:42.851856 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2649/5190] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:42 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1313 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:43.375452 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-614e1be7-c676-4a5e-8e10-cafe9b089280 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4014584efd4f43ac8426c58befba19da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2294bc303ed4f36ab22438ca02406ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:43.403397 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-614e1be7-c676-4a5e-8e10-cafe9b089280 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] 10.222.0.27 "GET /compute/v2.1/servers/5b7e4aa9-a25c-48e6-895f-2bb1fda1b938" status: 200 len: 1314 microversion: 2.1 time: 1.075802 Jun 20 12:24:43.416238 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2542/5191] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:42 2022] GET /compute/v2.1/servers/5b7e4aa9-a25c-48e6-895f-2bb1fda1b938 => generated 1314 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:43.859791 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-465e8e36-8f2f-42f8-8ac4-24a7256c0d06 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:43.860518 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-465e8e36-8f2f-42f8-8ac4-24a7256c0d06 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:43.874760 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-465e8e36-8f2f-42f8-8ac4-24a7256c0d06 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:43.875913 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-465e8e36-8f2f-42f8-8ac4-24a7256c0d06 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:43.876931 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-465e8e36-8f2f-42f8-8ac4-24a7256c0d06 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:43.882122 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-465e8e36-8f2f-42f8-8ac4-24a7256c0d06 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:44.423505 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4f963cdc-890f-4f5a-8ae5-a34e146f4ed8 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:44.424121 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4f963cdc-890f-4f5a-8ae5-a34e146f4ed8 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] [instance: 5b7e4aa9-a25c-48e6-895f-2bb1fda1b938] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:44.445155 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4f963cdc-890f-4f5a-8ae5-a34e146f4ed8 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:44.445476 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4f963cdc-890f-4f5a-8ae5-a34e146f4ed8 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:44.445675 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-465e8e36-8f2f-42f8-8ac4-24a7256c0d06 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:44.446256 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4f963cdc-890f-4f5a-8ae5-a34e146f4ed8 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:44.446691 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4f963cdc-890f-4f5a-8ae5-a34e146f4ed8 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:44.474796 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-465e8e36-8f2f-42f8-8ac4-24a7256c0d06 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1313 microversion: 2.1 time: 0.619634 Jun 20 12:24:44.478817 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2650/5192] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:43 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1313 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:44.537220 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-18ef9987-3e3b-4633-8f2b-2a30074a727a req-26b7f267-0f0f-46dc-b4de-7a81941f25d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a39f2a3-183c-4001-83fa-3da4af7a0499", "tag": "ed733439-4670-46a8-83fa-cc401c52c7a1"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:24:44.562498 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=44 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:44.565962 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-18ef9987-3e3b-4633-8f2b-2a30074a727a req-26b7f267-0f0f-46dc-b4de-7a81941f25d2 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:44.572867 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-18ef9987-3e3b-4633-8f2b-2a30074a727a req-26b7f267-0f0f-46dc-b4de-7a81941f25d2 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:44.602580 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-18ef9987-3e3b-4633-8f2b-2a30074a727a req-26b7f267-0f0f-46dc-b4de-7a81941f25d2 service nova] Creating event network-changed:ed733439-4670-46a8-83fa-cc401c52c7a1 for instance 1a39f2a3-183c-4001-83fa-3da4af7a0499 on n-h2-master-1 Jun 20 12:24:44.609797 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-18ef9987-3e3b-4633-8f2b-2a30074a727a req-26b7f267-0f0f-46dc-b4de-7a81941f25d2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078012 Jun 20 12:24:44.611210 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2651/5193] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:24:44.768049 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4f963cdc-890f-4f5a-8ae5-a34e146f4ed8 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4014584efd4f43ac8426c58befba19da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2294bc303ed4f36ab22438ca02406ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:44.781045 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4f963cdc-890f-4f5a-8ae5-a34e146f4ed8 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] 10.222.0.27 "GET /compute/v2.1/servers/5b7e4aa9-a25c-48e6-895f-2bb1fda1b938" status: 200 len: 1314 microversion: 2.1 time: 0.361552 Jun 20 12:24:44.791026 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2543/5194] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:44 2022] GET /compute/v2.1/servers/5b7e4aa9-a25c-48e6-895f-2bb1fda1b938 => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:24:45.498780 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a57ce8cb-11c9-4ed9-a297-ddb656375d90 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:45.500388 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a57ce8cb-11c9-4ed9-a297-ddb656375d90 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:45.514127 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a57ce8cb-11c9-4ed9-a297-ddb656375d90 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:45.514127 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a57ce8cb-11c9-4ed9-a297-ddb656375d90 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:45.514345 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a57ce8cb-11c9-4ed9-a297-ddb656375d90 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:45.515158 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a57ce8cb-11c9-4ed9-a297-ddb656375d90 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:45.756489 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-ff5dcb25-63be-4da7-9f0a-a3e6fa56b6ee req-85902ac4-f0cc-41b8-9c74-d7c9f0146ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b7e4aa9-a25c-48e6-895f-2bb1fda1b938", "name": "network-vif-plugged", "status": "completed", "tag": "2d7ced42-1573-4d34-a85f-34e90b7393b2"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:24:45.782963 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-ff5dcb25-63be-4da7-9f0a-a3e6fa56b6ee req-85902ac4-f0cc-41b8-9c74-d7c9f0146ed2 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:45.783564 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-ff5dcb25-63be-4da7-9f0a-a3e6fa56b6ee req-85902ac4-f0cc-41b8-9c74-d7c9f0146ed2 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:45.799052 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-ff5dcb25-63be-4da7-9f0a-a3e6fa56b6ee req-85902ac4-f0cc-41b8-9c74-d7c9f0146ed2 service nova] Creating event network-vif-plugged:2d7ced42-1573-4d34-a85f-34e90b7393b2 for instance 5b7e4aa9-a25c-48e6-895f-2bb1fda1b938 on n-h1-master-1 Jun 20 12:24:45.804872 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-ff5dcb25-63be-4da7-9f0a-a3e6fa56b6ee req-85902ac4-f0cc-41b8-9c74-d7c9f0146ed2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052446 Jun 20 12:24:45.805701 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2544/5195] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:24:45.811702 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-90fc15ff-cc6c-4d50-8717-26339bec1662 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:45.812717 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-90fc15ff-cc6c-4d50-8717-26339bec1662 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] [instance: 5b7e4aa9-a25c-48e6-895f-2bb1fda1b938] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:45.813985 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a57ce8cb-11c9-4ed9-a297-ddb656375d90 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:45.822549 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-90fc15ff-cc6c-4d50-8717-26339bec1662 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:45.823200 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-90fc15ff-cc6c-4d50-8717-26339bec1662 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:45.824541 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-90fc15ff-cc6c-4d50-8717-26339bec1662 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:45.825147 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-90fc15ff-cc6c-4d50-8717-26339bec1662 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:45.844418 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a57ce8cb-11c9-4ed9-a297-ddb656375d90 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1313 microversion: 2.1 time: 0.352741 Jun 20 12:24:45.858250 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2652/5196] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:45 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1313 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:46.047869 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-90fc15ff-cc6c-4d50-8717-26339bec1662 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4014584efd4f43ac8426c58befba19da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2294bc303ed4f36ab22438ca02406ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:46.058130 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-90fc15ff-cc6c-4d50-8717-26339bec1662 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] 10.222.0.27 "GET /compute/v2.1/servers/5b7e4aa9-a25c-48e6-895f-2bb1fda1b938" status: 200 len: 1314 microversion: 2.1 time: 0.251013 Jun 20 12:24:46.059268 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2545/5197] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:45 2022] GET /compute/v2.1/servers/5b7e4aa9-a25c-48e6-895f-2bb1fda1b938 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:46.385212 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8f59f2ce-c909-48c6-85bb-402660ac9ae8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:46.385932 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8f59f2ce-c909-48c6-85bb-402660ac9ae8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:46.392932 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8f59f2ce-c909-48c6-85bb-402660ac9ae8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:46.393776 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8f59f2ce-c909-48c6-85bb-402660ac9ae8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:46.395539 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8f59f2ce-c909-48c6-85bb-402660ac9ae8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:46.396516 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8f59f2ce-c909-48c6-85bb-402660ac9ae8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:46.630752 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8f59f2ce-c909-48c6-85bb-402660ac9ae8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:46.641965 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8f59f2ce-c909-48c6-85bb-402660ac9ae8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.260701 Jun 20 12:24:46.642691 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2653/5198] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:46 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:46.662020 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-303ee3e6-3abd-4fa9-b191-08369e23e814 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:46.662641 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-303ee3e6-3abd-4fa9-b191-08369e23e814 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:46.672011 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-303ee3e6-3abd-4fa9-b191-08369e23e814 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:46.672835 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-303ee3e6-3abd-4fa9-b191-08369e23e814 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:46.673638 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-303ee3e6-3abd-4fa9-b191-08369e23e814 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:46.674095 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-303ee3e6-3abd-4fa9-b191-08369e23e814 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:46.859367 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-303ee3e6-3abd-4fa9-b191-08369e23e814 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:46.868712 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3eb9b339-b8cb-46fa-95cf-551a59906089 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:46.868951 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-303ee3e6-3abd-4fa9-b191-08369e23e814 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.210798 Jun 20 12:24:46.879500 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2546/5199] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:46 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:46.880950 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3eb9b339-b8cb-46fa-95cf-551a59906089 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:46.888665 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3eb9b339-b8cb-46fa-95cf-551a59906089 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:46.889696 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6d939a54-8055-4005-ad8a-883d77c9f6a0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:46.890232 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6d939a54-8055-4005-ad8a-883d77c9f6a0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:46.890384 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3eb9b339-b8cb-46fa-95cf-551a59906089 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:46.891133 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3eb9b339-b8cb-46fa-95cf-551a59906089 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:46.891646 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3eb9b339-b8cb-46fa-95cf-551a59906089 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:46.897808 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6d939a54-8055-4005-ad8a-883d77c9f6a0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:46.898689 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6d939a54-8055-4005-ad8a-883d77c9f6a0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:46.899618 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6d939a54-8055-4005-ad8a-883d77c9f6a0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:46.900055 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6d939a54-8055-4005-ad8a-883d77c9f6a0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:47.060932 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6d939a54-8055-4005-ad8a-883d77c9f6a0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:47.069994 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6d939a54-8055-4005-ad8a-883d77c9f6a0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.185944 Jun 20 12:24:47.071038 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2547/5200] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:46 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:47.077547 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ac29b546-c1cd-4358-b37e-67f83f28f178 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:47.078440 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ac29b546-c1cd-4358-b37e-67f83f28f178 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] [instance: 5b7e4aa9-a25c-48e6-895f-2bb1fda1b938] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:47.087192 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ac29b546-c1cd-4358-b37e-67f83f28f178 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:47.088033 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ac29b546-c1cd-4358-b37e-67f83f28f178 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:47.089072 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ac29b546-c1cd-4358-b37e-67f83f28f178 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:47.089871 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ac29b546-c1cd-4358-b37e-67f83f28f178 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:47.358022 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3eb9b339-b8cb-46fa-95cf-551a59906089 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:47.368540 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3eb9b339-b8cb-46fa-95cf-551a59906089 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1313 microversion: 2.1 time: 0.503564 Jun 20 12:24:47.379943 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2654/5201] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:46 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1313 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:24:47.385390 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-245a28b6-7445-49aa-8326-eb5bf1cce5a9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:47.390527 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-245a28b6-7445-49aa-8326-eb5bf1cce5a9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:47.404608 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-245a28b6-7445-49aa-8326-eb5bf1cce5a9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:47.407228 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-245a28b6-7445-49aa-8326-eb5bf1cce5a9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:47.408240 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-245a28b6-7445-49aa-8326-eb5bf1cce5a9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:47.410691 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-245a28b6-7445-49aa-8326-eb5bf1cce5a9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:47.545250 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ac29b546-c1cd-4358-b37e-67f83f28f178 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4014584efd4f43ac8426c58befba19da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2294bc303ed4f36ab22438ca02406ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:47.554068 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ac29b546-c1cd-4358-b37e-67f83f28f178 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] 10.222.0.27 "GET /compute/v2.1/servers/5b7e4aa9-a25c-48e6-895f-2bb1fda1b938" status: 200 len: 1314 microversion: 2.1 time: 0.481489 Jun 20 12:24:47.554987 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2548/5202] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:47 2022] GET /compute/v2.1/servers/5b7e4aa9-a25c-48e6-895f-2bb1fda1b938 => generated 1314 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:47.597906 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-245a28b6-7445-49aa-8326-eb5bf1cce5a9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:47.606150 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-245a28b6-7445-49aa-8326-eb5bf1cce5a9 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.224646 Jun 20 12:24:47.607040 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2655/5203] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:47 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:47.720151 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-83abacb2-7198-4e65-876c-25609111b36a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-633462413", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "2b5ba955-3292-4f14-a644-c809260e0b34"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:24:47.779697 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-83abacb2-7198-4e65-876c-25609111b36a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] validate_networks() for [('2b5ba955-3292-4f14-a644-c809260e0b34', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:24:47.972732 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=4 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:47.998180 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=14 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:48.387360 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8bbc46d5-1aca-4c2c-9a7b-77d0de18ea41 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:48.388099 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8bbc46d5-1aca-4c2c-9a7b-77d0de18ea41 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:48.406473 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:48.409932 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bbc46d5-1aca-4c2c-9a7b-77d0de18ea41 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:48.410394 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bbc46d5-1aca-4c2c-9a7b-77d0de18ea41 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:48.411190 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bbc46d5-1aca-4c2c-9a7b-77d0de18ea41 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:48.413510 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bbc46d5-1aca-4c2c-9a7b-77d0de18ea41 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:48.578942 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-83abacb2-7198-4e65-876c-25609111b36a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:24:48.579451 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-83abacb2-7198-4e65-876c-25609111b36a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:24:48.579968 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-83abacb2-7198-4e65-876c-25609111b36a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:24:48.580417 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-83abacb2-7198-4e65-876c-25609111b36a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:24:48.580841 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-83abacb2-7198-4e65-876c-25609111b36a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:24:48.591390 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-83abacb2-7198-4e65-876c-25609111b36a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:48.592609 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-83abacb2-7198-4e65-876c-25609111b36a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:48.595773 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-83abacb2-7198-4e65-876c-25609111b36a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:48.596471 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-83abacb2-7198-4e65-876c-25609111b36a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:48.620189 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-83abacb2-7198-4e65-876c-25609111b36a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Getting quotas for project 19236314583142029ffd7a1e04460cab. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:24:48.626229 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-83abacb2-7198-4e65-876c-25609111b36a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Getting quotas for user 4ccd420e1ff744b99cb7e5650522e983 and project 19236314583142029ffd7a1e04460cab. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:24:48.631434 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8bbc46d5-1aca-4c2c-9a7b-77d0de18ea41 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:48.644837 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8bbc46d5-1aca-4c2c-9a7b-77d0de18ea41 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1313 microversion: 2.1 time: 0.257577 Jun 20 12:24:48.645491 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2656/5204] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:48 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1313 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:48.650427 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-eda6a287-d631-4492-93d5-75de8b7097fd tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:48.651041 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-eda6a287-d631-4492-93d5-75de8b7097fd tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] [instance: 5b7e4aa9-a25c-48e6-895f-2bb1fda1b938] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:48.662056 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eda6a287-d631-4492-93d5-75de8b7097fd tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:48.662519 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eda6a287-d631-4492-93d5-75de8b7097fd tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:48.663321 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eda6a287-d631-4492-93d5-75de8b7097fd tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:48.664616 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eda6a287-d631-4492-93d5-75de8b7097fd tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:48.665121 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-83abacb2-7198-4e65-876c-25609111b36a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:24:48.667881 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-83abacb2-7198-4e65-876c-25609111b36a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: dd9ed98a-2b15-455f-8ff2-ead26b5af05b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:24:48.752360 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-83abacb2-7198-4e65-876c-25609111b36a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.035988 Jun 20 12:24:48.753194 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2549/5205] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:24:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:24:48.765136 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-565d5e11-d622-4a5e-8b2d-8c56dd237f7e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:48.765914 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-565d5e11-d622-4a5e-8b2d-8c56dd237f7e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: dd9ed98a-2b15-455f-8ff2-ead26b5af05b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:48.974612 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-eda6a287-d631-4492-93d5-75de8b7097fd tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4014584efd4f43ac8426c58befba19da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2294bc303ed4f36ab22438ca02406ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:48.987918 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-565d5e11-d622-4a5e-8b2d-8c56dd237f7e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:48.988489 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-eda6a287-d631-4492-93d5-75de8b7097fd tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] 10.222.0.27 "GET /compute/v2.1/servers/5b7e4aa9-a25c-48e6-895f-2bb1fda1b938" status: 200 len: 1498 microversion: 2.1 time: 0.336817 Jun 20 12:24:48.992311 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2657/5206] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:48 2022] GET /compute/v2.1/servers/5b7e4aa9-a25c-48e6-895f-2bb1fda1b938 => generated 1498 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:49.031291 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-565d5e11-d622-4a5e-8b2d-8c56dd237f7e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b" status: 200 len: 1214 microversion: 2.1 time: 0.270182 Jun 20 12:24:49.043076 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2550/5207] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:48 2022] GET /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b => generated 1214 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:49.662223 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-60c3d9de-c8a7-45ac-bd4b-71beb8029246 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:49.663655 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-60c3d9de-c8a7-45ac-bd4b-71beb8029246 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:49.696948 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-60c3d9de-c8a7-45ac-bd4b-71beb8029246 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:49.697564 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-60c3d9de-c8a7-45ac-bd4b-71beb8029246 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:49.698788 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-60c3d9de-c8a7-45ac-bd4b-71beb8029246 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:49.700951 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-60c3d9de-c8a7-45ac-bd4b-71beb8029246 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:49.908537 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-60c3d9de-c8a7-45ac-bd4b-71beb8029246 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:49.918633 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-60c3d9de-c8a7-45ac-bd4b-71beb8029246 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1313 microversion: 2.1 time: 0.260857 Jun 20 12:24:49.926191 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2658/5208] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:49 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:50.059998 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-62242c70-ac3a-4139-8b0a-d1422b481611 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:50.060704 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-62242c70-ac3a-4139-8b0a-d1422b481611 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: dd9ed98a-2b15-455f-8ff2-ead26b5af05b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:50.086592 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-62242c70-ac3a-4139-8b0a-d1422b481611 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:50.087057 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-62242c70-ac3a-4139-8b0a-d1422b481611 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:50.087865 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-62242c70-ac3a-4139-8b0a-d1422b481611 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:50.088347 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-62242c70-ac3a-4139-8b0a-d1422b481611 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:50.332931 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-62242c70-ac3a-4139-8b0a-d1422b481611 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:50.356218 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-62242c70-ac3a-4139-8b0a-d1422b481611 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b" status: 200 len: 1274 microversion: 2.1 time: 0.310771 Jun 20 12:24:50.357229 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2551/5209] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:50 2022] GET /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b => generated 1274 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:50.936239 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-735e0ebd-1f75-4e4b-a465-364ddc6a3958 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:50.937259 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-735e0ebd-1f75-4e4b-a465-364ddc6a3958 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:50.947581 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-735e0ebd-1f75-4e4b-a465-364ddc6a3958 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:50.948047 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-735e0ebd-1f75-4e4b-a465-364ddc6a3958 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:50.952767 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-735e0ebd-1f75-4e4b-a465-364ddc6a3958 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:50.958131 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-735e0ebd-1f75-4e4b-a465-364ddc6a3958 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:51.255436 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-735e0ebd-1f75-4e4b-a465-364ddc6a3958 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:51.273672 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-735e0ebd-1f75-4e4b-a465-364ddc6a3958 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1313 microversion: 2.1 time: 0.341260 Jun 20 12:24:51.274954 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2659/5210] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:50 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1313 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:51.376071 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4a117ab0-69f3-4143-b8f9-507b4c7796db tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:51.379048 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4a117ab0-69f3-4143-b8f9-507b4c7796db tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: dd9ed98a-2b15-455f-8ff2-ead26b5af05b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:51.399999 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4a117ab0-69f3-4143-b8f9-507b4c7796db tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:51.400493 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4a117ab0-69f3-4143-b8f9-507b4c7796db tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:51.401584 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4a117ab0-69f3-4143-b8f9-507b4c7796db tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:51.402026 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4a117ab0-69f3-4143-b8f9-507b4c7796db tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:51.842158 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4a117ab0-69f3-4143-b8f9-507b4c7796db tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:51.867505 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4a117ab0-69f3-4143-b8f9-507b4c7796db tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b" status: 200 len: 1314 microversion: 2.1 time: 0.494274 Jun 20 12:24:51.868183 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2552/5211] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:51 2022] GET /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b => generated 1314 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:52.241921 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-c08bf302-7dae-4148-b683-717499e492d7 req-fb930bc0-1add-44a8-bdc4-0f9b667b4fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a39f2a3-183c-4001-83fa-3da4af7a0499", "name": "network-vif-plugged", "status": "completed", "tag": "ed733439-4670-46a8-83fa-cc401c52c7a1"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:24:52.277369 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-c08bf302-7dae-4148-b683-717499e492d7 req-fb930bc0-1add-44a8-bdc4-0f9b667b4fb5 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:52.277821 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-c08bf302-7dae-4148-b683-717499e492d7 req-fb930bc0-1add-44a8-bdc4-0f9b667b4fb5 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:52.293600 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3ffe5e3d-d2a8-4a9c-a9c5-6ad45afd1804 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:52.295895 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3ffe5e3d-d2a8-4a9c-a9c5-6ad45afd1804 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:52.314190 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3ffe5e3d-d2a8-4a9c-a9c5-6ad45afd1804 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:52.314929 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3ffe5e3d-d2a8-4a9c-a9c5-6ad45afd1804 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:52.318041 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3ffe5e3d-d2a8-4a9c-a9c5-6ad45afd1804 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:52.318953 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3ffe5e3d-d2a8-4a9c-a9c5-6ad45afd1804 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:52.321346 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-c08bf302-7dae-4148-b683-717499e492d7 req-fb930bc0-1add-44a8-bdc4-0f9b667b4fb5 service nova] Creating event network-vif-plugged:ed733439-4670-46a8-83fa-cc401c52c7a1 for instance 1a39f2a3-183c-4001-83fa-3da4af7a0499 on n-h2-master-1 Jun 20 12:24:52.328977 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-c08bf302-7dae-4148-b683-717499e492d7 req-fb930bc0-1add-44a8-bdc4-0f9b667b4fb5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091300 Jun 20 12:24:52.331049 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2660/5212] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:24:52.334124 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:52.814680 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3ffe5e3d-d2a8-4a9c-a9c5-6ad45afd1804 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:52.823664 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3ffe5e3d-d2a8-4a9c-a9c5-6ad45afd1804 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1313 microversion: 2.1 time: 0.535939 Jun 20 12:24:52.832976 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2553/5213] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:52 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1313 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:52.892479 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bcc1da01-e68e-43d4-9fea-b0daec3b78f3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:52.893521 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bcc1da01-e68e-43d4-9fea-b0daec3b78f3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: dd9ed98a-2b15-455f-8ff2-ead26b5af05b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:52.907025 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bcc1da01-e68e-43d4-9fea-b0daec3b78f3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:52.908087 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bcc1da01-e68e-43d4-9fea-b0daec3b78f3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:52.909262 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bcc1da01-e68e-43d4-9fea-b0daec3b78f3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:52.909933 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bcc1da01-e68e-43d4-9fea-b0daec3b78f3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:53.066519 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-9af7387b-08c8-44c4-a53c-31a3c36ce2f5 req-c8d0da8d-f697-428a-acd5-eb05feb06994 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd9ed98a-2b15-455f-8ff2-ead26b5af05b", "tag": "1d3e6b7e-bb2c-4e48-b26b-d6098ed14277"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:24:53.125496 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9af7387b-08c8-44c4-a53c-31a3c36ce2f5 req-c8d0da8d-f697-428a-acd5-eb05feb06994 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:53.126261 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9af7387b-08c8-44c4-a53c-31a3c36ce2f5 req-c8d0da8d-f697-428a-acd5-eb05feb06994 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:53.191598 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-9af7387b-08c8-44c4-a53c-31a3c36ce2f5 req-c8d0da8d-f697-428a-acd5-eb05feb06994 service nova] Creating event network-changed:1d3e6b7e-bb2c-4e48-b26b-d6098ed14277 for instance dd9ed98a-2b15-455f-8ff2-ead26b5af05b on n-h1-master-1 Jun 20 12:24:53.198563 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-9af7387b-08c8-44c4-a53c-31a3c36ce2f5 req-c8d0da8d-f697-428a-acd5-eb05feb06994 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138122 Jun 20 12:24:53.200265 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2554/5214] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:24:53.436083 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bcc1da01-e68e-43d4-9fea-b0daec3b78f3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:53.451141 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bcc1da01-e68e-43d4-9fea-b0daec3b78f3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b" status: 200 len: 1314 microversion: 2.1 time: 0.563458 Jun 20 12:24:53.453111 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2661/5215] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:52 2022] GET /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b => generated 1314 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:53.591061 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4644e19a-d2e5-4931-9d65-df655f908f78 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:53.592030 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4644e19a-d2e5-4931-9d65-df655f908f78 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] [instance: 5b7e4aa9-a25c-48e6-895f-2bb1fda1b938] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:53.605122 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4644e19a-d2e5-4931-9d65-df655f908f78 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:53.605612 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4644e19a-d2e5-4931-9d65-df655f908f78 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:53.606582 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4644e19a-d2e5-4931-9d65-df655f908f78 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:53.607190 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4644e19a-d2e5-4931-9d65-df655f908f78 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:53.642341 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4644e19a-d2e5-4931-9d65-df655f908f78 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] [instance: 5b7e4aa9-a25c-48e6-895f-2bb1fda1b938] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:24:53.769935 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4644e19a-d2e5-4931-9d65-df655f908f78 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5b7e4aa9-a25c-48e6-895f-2bb1fda1b938" status: 204 len: 0 microversion: 2.1 time: 0.184860 Jun 20 12:24:53.770960 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2555/5216] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:24:53 2022] DELETE /compute/v2.1/servers/5b7e4aa9-a25c-48e6-895f-2bb1fda1b938 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:24:53.781524 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3046ede5-49be-48e9-825b-3c4a9c1c7115 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:53.784371 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3046ede5-49be-48e9-825b-3c4a9c1c7115 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] [instance: 5b7e4aa9-a25c-48e6-895f-2bb1fda1b938] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:53.796127 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3046ede5-49be-48e9-825b-3c4a9c1c7115 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:53.796911 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3046ede5-49be-48e9-825b-3c4a9c1c7115 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:53.797768 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3046ede5-49be-48e9-825b-3c4a9c1c7115 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:53.798392 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3046ede5-49be-48e9-825b-3c4a9c1c7115 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:53.841599 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e211661a-3dcf-4fb3-94e7-60e2407219a3 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:53.842304 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e211661a-3dcf-4fb3-94e7-60e2407219a3 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:53.849652 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e211661a-3dcf-4fb3-94e7-60e2407219a3 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:53.881087 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e211661a-3dcf-4fb3-94e7-60e2407219a3 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:53.882270 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e211661a-3dcf-4fb3-94e7-60e2407219a3 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:53.882883 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e211661a-3dcf-4fb3-94e7-60e2407219a3 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:54.091047 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3046ede5-49be-48e9-825b-3c4a9c1c7115 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4014584efd4f43ac8426c58befba19da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2294bc303ed4f36ab22438ca02406ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:54.106766 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3046ede5-49be-48e9-825b-3c4a9c1c7115 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] 10.222.0.27 "GET /compute/v2.1/servers/5b7e4aa9-a25c-48e6-895f-2bb1fda1b938" status: 200 len: 1504 microversion: 2.1 time: 0.328699 Jun 20 12:24:54.108648 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2662/5217] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:53 2022] GET /compute/v2.1/servers/5b7e4aa9-a25c-48e6-895f-2bb1fda1b938 => generated 1504 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:54.204762 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e211661a-3dcf-4fb3-94e7-60e2407219a3 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:54.218180 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e211661a-3dcf-4fb3-94e7-60e2407219a3 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1313 microversion: 2.1 time: 0.380576 Jun 20 12:24:54.228798 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2556/5218] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:53 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1313 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:54.478795 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0bdaf36c-f419-4447-bf34-00eb64d902ed tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:54.482226 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0bdaf36c-f419-4447-bf34-00eb64d902ed tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: dd9ed98a-2b15-455f-8ff2-ead26b5af05b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:54.499437 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0bdaf36c-f419-4447-bf34-00eb64d902ed tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:54.500379 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0bdaf36c-f419-4447-bf34-00eb64d902ed tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:54.501765 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0bdaf36c-f419-4447-bf34-00eb64d902ed tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:54.502641 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0bdaf36c-f419-4447-bf34-00eb64d902ed tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:54.671149 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0bdaf36c-f419-4447-bf34-00eb64d902ed tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:54.680422 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0bdaf36c-f419-4447-bf34-00eb64d902ed tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b" status: 200 len: 1314 microversion: 2.1 time: 0.213888 Jun 20 12:24:54.681940 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2663/5219] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:54 2022] GET /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:55.126050 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8fccd6d8-12fa-4cfd-bbb2-5dc48131b1f5 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:55.126650 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8fccd6d8-12fa-4cfd-bbb2-5dc48131b1f5 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] [instance: 5b7e4aa9-a25c-48e6-895f-2bb1fda1b938] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:55.146143 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8fccd6d8-12fa-4cfd-bbb2-5dc48131b1f5 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:55.150744 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8fccd6d8-12fa-4cfd-bbb2-5dc48131b1f5 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:55.161723 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8fccd6d8-12fa-4cfd-bbb2-5dc48131b1f5 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:55.162718 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8fccd6d8-12fa-4cfd-bbb2-5dc48131b1f5 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:55.238415 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4069e400-8758-43c1-b189-f1226fd19f77 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:55.239351 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4069e400-8758-43c1-b189-f1226fd19f77 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:55.258376 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4069e400-8758-43c1-b189-f1226fd19f77 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:55.258860 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4069e400-8758-43c1-b189-f1226fd19f77 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:55.263360 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4069e400-8758-43c1-b189-f1226fd19f77 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:55.263827 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4069e400-8758-43c1-b189-f1226fd19f77 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:55.451705 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8fccd6d8-12fa-4cfd-bbb2-5dc48131b1f5 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4014584efd4f43ac8426c58befba19da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2294bc303ed4f36ab22438ca02406ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:55.465164 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8fccd6d8-12fa-4cfd-bbb2-5dc48131b1f5 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] 10.222.0.27 "GET /compute/v2.1/servers/5b7e4aa9-a25c-48e6-895f-2bb1fda1b938" status: 200 len: 1504 microversion: 2.1 time: 0.342879 Jun 20 12:24:55.476114 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2557/5220] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:55 2022] GET /compute/v2.1/servers/5b7e4aa9-a25c-48e6-895f-2bb1fda1b938 => generated 1504 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:55.575540 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4069e400-8758-43c1-b189-f1226fd19f77 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:55.582104 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:55.589663 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4069e400-8758-43c1-b189-f1226fd19f77 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1498 microversion: 2.1 time: 0.356542 Jun 20 12:24:55.590396 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2664/5221] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:55 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1498 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:55.606729 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5e83bb84-49fd-4993-a4ee-9340d2dc5472 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:24:55.608132 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5e83bb84-49fd-4993-a4ee-9340d2dc5472 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:55.616871 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e83bb84-49fd-4993-a4ee-9340d2dc5472 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:55.617354 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e83bb84-49fd-4993-a4ee-9340d2dc5472 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:55.618366 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e83bb84-49fd-4993-a4ee-9340d2dc5472 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:55.618811 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e83bb84-49fd-4993-a4ee-9340d2dc5472 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:55.646256 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-5e83bb84-49fd-4993-a4ee-9340d2dc5472 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lazy-loading 'flavor' on Instance uuid 1a39f2a3-183c-4001-83fa-3da4af7a0499 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:24:55.700577 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-12114b4f-4eab-4b3e-8e3c-45690c96c427 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:55.701975 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-12114b4f-4eab-4b3e-8e3c-45690c96c427 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: dd9ed98a-2b15-455f-8ff2-ead26b5af05b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:55.720927 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-12114b4f-4eab-4b3e-8e3c-45690c96c427 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:55.722354 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-12114b4f-4eab-4b3e-8e3c-45690c96c427 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:55.723589 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-12114b4f-4eab-4b3e-8e3c-45690c96c427 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:55.724348 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-12114b4f-4eab-4b3e-8e3c-45690c96c427 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:55.790864 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5e83bb84-49fd-4993-a4ee-9340d2dc5472 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "POST /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499/action" status: 200 len: 32 microversion: 2.1 time: 0.188118 Jun 20 12:24:55.792176 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2558/5222] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:24:55 2022] POST /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499/action => generated 32 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:24:55.799453 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2a9f28c0-601c-4992-8683-7e8518b9fda5 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Action: 'create', calling method: .version_select at 0x7f607318e5e0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-8315719", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApGBjGtK/cMUccdbfkIKaqJa+miAby7LO5I2zphkLGI/RWokyknpE3tbisAkHhzwbG3U0EqAcWc7mDyXXT9k2AIM72OFiiPkEIBqBfXyDNxaRfOoUP0dJxuacY2Z/ug8A=="}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:24:55.817911 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-2a9f28c0-601c-4992-8683-7e8518b9fda5 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Getting quotas for project 1ed88b4072a24b37a5ceec3b239ac8fa. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:24:55.824956 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-2a9f28c0-601c-4992-8683-7e8518b9fda5 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Getting quotas for user aeafcd88ca6c415e90b51c262b62597f and project 1ed88b4072a24b37a5ceec3b239ac8fa. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:24:55.863718 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2a9f28c0-601c-4992-8683-7e8518b9fda5 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.069808 Jun 20 12:24:55.864661 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2559/5223] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 12:24:55 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:24:55.876449 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fdc5f47a-ec50-4aa7-baa0-d18d6483e115 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:55.877579 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fdc5f47a-ec50-4aa7-baa0-d18d6483e115 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:55.891064 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fdc5f47a-ec50-4aa7-baa0-d18d6483e115 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:55.892958 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fdc5f47a-ec50-4aa7-baa0-d18d6483e115 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:55.900346 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fdc5f47a-ec50-4aa7-baa0-d18d6483e115 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:55.901321 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fdc5f47a-ec50-4aa7-baa0-d18d6483e115 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:56.962250 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-12114b4f-4eab-4b3e-8e3c-45690c96c427 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:56.972950 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-12114b4f-4eab-4b3e-8e3c-45690c96c427 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b" status: 200 len: 1314 microversion: 2.1 time: 1.278631 Jun 20 12:24:56.982114 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2665/5224] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:55 2022] GET /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b => generated 1314 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:56.990534 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-030db95f-4a59-4297-8708-735b63eb7f8b tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:56.992400 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-030db95f-4a59-4297-8708-735b63eb7f8b tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] [instance: 5b7e4aa9-a25c-48e6-895f-2bb1fda1b938] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:57.037795 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-030db95f-4a59-4297-8708-735b63eb7f8b tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:57.037795 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-030db95f-4a59-4297-8708-735b63eb7f8b tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:57.044241 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-030db95f-4a59-4297-8708-735b63eb7f8b tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:57.045777 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-030db95f-4a59-4297-8708-735b63eb7f8b tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:57.060745 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fdc5f47a-ec50-4aa7-baa0-d18d6483e115 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:57.069884 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fdc5f47a-ec50-4aa7-baa0-d18d6483e115 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1504 microversion: 2.1 time: 1.203094 Jun 20 12:24:57.084242 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2560/5225] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:55 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1504 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:57.256120 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-88d1ca92-27ee-4a79-a86d-38a795fb9494 req-28a3087b-6df7-454e-8bbf-49af6fb6df05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b7e4aa9-a25c-48e6-895f-2bb1fda1b938", "name": "network-vif-deleted", "tag": "2d7ced42-1573-4d34-a85f-34e90b7393b2"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:24:57.275265 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-88d1ca92-27ee-4a79-a86d-38a795fb9494 req-28a3087b-6df7-454e-8bbf-49af6fb6df05 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:57.277244 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-88d1ca92-27ee-4a79-a86d-38a795fb9494 req-28a3087b-6df7-454e-8bbf-49af6fb6df05 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:57.319857 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-030db95f-4a59-4297-8708-735b63eb7f8b tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4014584efd4f43ac8426c58befba19da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2294bc303ed4f36ab22438ca02406ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:57.329927 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-88d1ca92-27ee-4a79-a86d-38a795fb9494 req-28a3087b-6df7-454e-8bbf-49af6fb6df05 service nova] Creating event network-vif-deleted:2d7ced42-1573-4d34-a85f-34e90b7393b2 for instance 5b7e4aa9-a25c-48e6-895f-2bb1fda1b938 on n-h1-master-1 Jun 20 12:24:57.344522 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-030db95f-4a59-4297-8708-735b63eb7f8b tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] 10.222.0.27 "GET /compute/v2.1/servers/5b7e4aa9-a25c-48e6-895f-2bb1fda1b938" status: 200 len: 1462 microversion: 2.1 time: 0.366682 Jun 20 12:24:57.350298 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-88d1ca92-27ee-4a79-a86d-38a795fb9494 req-28a3087b-6df7-454e-8bbf-49af6fb6df05 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097917 Jun 20 12:24:57.354946 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2561/5226] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:24:57.358561 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2666/5227] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:56 2022] GET /compute/v2.1/servers/5b7e4aa9-a25c-48e6-895f-2bb1fda1b938 => generated 1462 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:57.991728 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c9e9efb0-7c4e-41db-b804-191a69defce8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:57.992691 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c9e9efb0-7c4e-41db-b804-191a69defce8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: dd9ed98a-2b15-455f-8ff2-ead26b5af05b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:58.002381 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:58.007403 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c9e9efb0-7c4e-41db-b804-191a69defce8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:58.017050 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c9e9efb0-7c4e-41db-b804-191a69defce8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:58.018735 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c9e9efb0-7c4e-41db-b804-191a69defce8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:58.019757 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c9e9efb0-7c4e-41db-b804-191a69defce8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:58.097528 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2b6fc0e0-ccaf-46aa-91fd-aefa65147532 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:58.098891 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2b6fc0e0-ccaf-46aa-91fd-aefa65147532 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:58.116935 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2b6fc0e0-ccaf-46aa-91fd-aefa65147532 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:58.117716 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2b6fc0e0-ccaf-46aa-91fd-aefa65147532 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:58.118684 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2b6fc0e0-ccaf-46aa-91fd-aefa65147532 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:58.119372 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2b6fc0e0-ccaf-46aa-91fd-aefa65147532 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:58.272218 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c9e9efb0-7c4e-41db-b804-191a69defce8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:58.294440 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c9e9efb0-7c4e-41db-b804-191a69defce8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b" status: 200 len: 1314 microversion: 2.1 time: 0.308032 Jun 20 12:24:58.296373 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2562/5228] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:57 2022] GET /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:58.370106 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bac54e70-1d86-4854-beba-947587a75e98 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:58.371041 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bac54e70-1d86-4854-beba-947587a75e98 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] [instance: 5b7e4aa9-a25c-48e6-895f-2bb1fda1b938] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:58.381440 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bac54e70-1d86-4854-beba-947587a75e98 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:58.382571 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bac54e70-1d86-4854-beba-947587a75e98 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:58.383593 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bac54e70-1d86-4854-beba-947587a75e98 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:58.384252 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bac54e70-1d86-4854-beba-947587a75e98 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:58.419199 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-bac54e70-1d86-4854-beba-947587a75e98 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] HTTP exception thrown: Instance 5b7e4aa9-a25c-48e6-895f-2bb1fda1b938 could not be found. Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bac54e70-1d86-4854-beba-947587a75e98 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Request method failure captured: Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/5b7e4aa9-a25c-48e6-895f-2bb1fda1b938 HTTP/1.1 Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGb7ceTz3kx9ILCQsu7i5UUEp5JVB0s7lfdfz-gHy4831h0VEBYVzfJpsiL8PNOurUsOPrdYVgbCqCMi9RfYiV-LoLgTa_NTKwlHCDvFQNiGN7o_6nlN5Te1jqXJUKcGhQUDgu5XWaSKgjVO88CtJ3YjgonKvQqPnaNOOn8NbVSM3Vg Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: a2294bc303ed4f36ab22438ca02406ea Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-VolumesActionsTest-1695233615 Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2294bc303ed4f36ab22438ca02406ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a2294bc303ed4f36ab22438ca02406ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a2294bc303ed4f36ab22438ca02406ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a2294bc303ed4f36ab22438ca02406ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-VolumesActionsTest-1695233615 Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: a2294bc303ed4f36ab22438ca02406ea Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-VolumesActionsTest-1695233615 Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-VolumesActionsTest-1695233615-project Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 4014584efd4f43ac8426c58befba19da Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-VolumesActionsTest-1695233615-project Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 5b7e4aa9-a25c-48e6-895f-2bb1fda1b938 could not be found. Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '5b7e4aa9-a25c-48e6-895f-2bb1fda1b938'} Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b7e4aa9-a25c-48e6-895f-2bb1fda1b938 could not be found. Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b7e4aa9-a25c-48e6-895f-2bb1fda1b938 could not be found. Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:24:58.422218 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:24:58.427440 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:24:58.427440 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:24:58.427440 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:24:58.427440 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:24:58.427440 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:24:58.427440 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b7e4aa9-a25c-48e6-895f-2bb1fda1b938 could not be found. Jun 20 12:24:58.427440 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:24:58.431409 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bac54e70-1d86-4854-beba-947587a75e98 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] Returning 404 to user: Instance 5b7e4aa9-a25c-48e6-895f-2bb1fda1b938 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:24:58.433140 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bac54e70-1d86-4854-beba-947587a75e98 tempest-VolumesActionsTest-1695233615 tempest-VolumesActionsTest-1695233615-project] 10.222.0.27 "GET /compute/v2.1/servers/5b7e4aa9-a25c-48e6-895f-2bb1fda1b938" status: 404 len: 111 microversion: 2.1 time: 0.069280 Jun 20 12:24:58.434896 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2563/5229] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:58 2022] GET /compute/v2.1/servers/5b7e4aa9-a25c-48e6-895f-2bb1fda1b938 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:24:58.720767 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2b6fc0e0-ccaf-46aa-91fd-aefa65147532 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:58.738663 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2b6fc0e0-ccaf-46aa-91fd-aefa65147532 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1504 microversion: 2.1 time: 0.644048 Jun 20 12:24:58.750396 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2667/5230] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:58 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1504 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:24:59.312432 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f188fde7-fa82-49b7-a15a-715285c59b9c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:59.313210 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f188fde7-fa82-49b7-a15a-715285c59b9c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: dd9ed98a-2b15-455f-8ff2-ead26b5af05b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:59.322748 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:59.335697 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f188fde7-fa82-49b7-a15a-715285c59b9c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:59.336515 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f188fde7-fa82-49b7-a15a-715285c59b9c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:59.338392 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f188fde7-fa82-49b7-a15a-715285c59b9c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:59.339415 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f188fde7-fa82-49b7-a15a-715285c59b9c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:59.588433 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f188fde7-fa82-49b7-a15a-715285c59b9c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:59.601231 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f188fde7-fa82-49b7-a15a-715285c59b9c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b" status: 200 len: 1314 microversion: 2.1 time: 0.292016 Jun 20 12:24:59.603422 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2564/5231] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:59 2022] GET /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:59.757884 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ef16f3da-d3db-46f9-81de-7cb92097aba8 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:59.758504 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ef16f3da-d3db-46f9-81de-7cb92097aba8 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:59.784166 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef16f3da-d3db-46f9-81de-7cb92097aba8 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:59.788317 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef16f3da-d3db-46f9-81de-7cb92097aba8 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:59.790835 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef16f3da-d3db-46f9-81de-7cb92097aba8 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:59.792890 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef16f3da-d3db-46f9-81de-7cb92097aba8 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:59.975537 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-07257597-57ef-4acd-9c71-3f5a54314c83 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-2013108886", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "451f7838-c1a4-4422-bf55-f438798d4418"}], "key_name": "tempest-TestNetworkBasicOps-8315719", "security_groups": [{"name": "tempest-secgroup-smoke-486721009"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:25:00.207117 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-07257597-57ef-4acd-9c71-3f5a54314c83 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] validate_networks() for [('451f7838-c1a4-4422-bf55-f438798d4418', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:25:00.304922 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ef16f3da-d3db-46f9-81de-7cb92097aba8 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:00.312741 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ef16f3da-d3db-46f9-81de-7cb92097aba8 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1504 microversion: 2.1 time: 0.560350 Jun 20 12:25:00.322390 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2668/5232] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:59 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1504 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:00.637602 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dc04f0c5-0d46-496b-a515-a899a161a6b2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:00.640638 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dc04f0c5-0d46-496b-a515-a899a161a6b2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: dd9ed98a-2b15-455f-8ff2-ead26b5af05b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:00.657928 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc04f0c5-0d46-496b-a515-a899a161a6b2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:00.658726 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc04f0c5-0d46-496b-a515-a899a161a6b2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:00.663275 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc04f0c5-0d46-496b-a515-a899a161a6b2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:00.663782 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc04f0c5-0d46-496b-a515-a899a161a6b2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:01.061427 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dc04f0c5-0d46-496b-a515-a899a161a6b2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:01.082323 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dc04f0c5-0d46-496b-a515-a899a161a6b2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b" status: 200 len: 1314 microversion: 2.1 time: 0.463850 Jun 20 12:25:01.083209 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2669/5233] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:00 2022] GET /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:01.339915 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6aa7a605-d275-45f8-9f3a-bc69d47714f0 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:01.340546 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6aa7a605-d275-45f8-9f3a-bc69d47714f0 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:01.373337 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6aa7a605-d275-45f8-9f3a-bc69d47714f0 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:01.374374 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6aa7a605-d275-45f8-9f3a-bc69d47714f0 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:01.383491 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6aa7a605-d275-45f8-9f3a-bc69d47714f0 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:01.390272 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6aa7a605-d275-45f8-9f3a-bc69d47714f0 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:01.928244 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-07257597-57ef-4acd-9c71-3f5a54314c83 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:25:01.928709 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-07257597-57ef-4acd-9c71-3f5a54314c83 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:25:01.929129 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-07257597-57ef-4acd-9c71-3f5a54314c83 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:25:01.929538 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-07257597-57ef-4acd-9c71-3f5a54314c83 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:25:01.929948 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-07257597-57ef-4acd-9c71-3f5a54314c83 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:25:01.959165 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-07257597-57ef-4acd-9c71-3f5a54314c83 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:01.959619 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-07257597-57ef-4acd-9c71-3f5a54314c83 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:01.960455 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-07257597-57ef-4acd-9c71-3f5a54314c83 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:01.960959 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-07257597-57ef-4acd-9c71-3f5a54314c83 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:02.031869 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-07257597-57ef-4acd-9c71-3f5a54314c83 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Getting quotas for project 1ed88b4072a24b37a5ceec3b239ac8fa. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:25:02.053878 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-07257597-57ef-4acd-9c71-3f5a54314c83 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Getting quotas for user aeafcd88ca6c415e90b51c262b62597f and project 1ed88b4072a24b37a5ceec3b239ac8fa. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:25:02.097817 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-07257597-57ef-4acd-9c71-3f5a54314c83 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:25:02.100152 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-07257597-57ef-4acd-9c71-3f5a54314c83 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: fab0e84e-17c7-4aa9-bc0a-37d236495cfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:25:02.214030 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-07257597-57ef-4acd-9c71-3f5a54314c83 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.242632 Jun 20 12:25:02.217897 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2565/5234] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:24:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 2247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 12:25:02.223643 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-59a4ab4a-e0a2-4f74-9ab8-fb566220737d req-43f25446-8add-4a9d-9651-49614a51a1ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd9ed98a-2b15-455f-8ff2-ead26b5af05b", "name": "network-vif-plugged", "status": "completed", "tag": "1d3e6b7e-bb2c-4e48-b26b-d6098ed14277"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:25:02.237937 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-59a4ab4a-e0a2-4f74-9ab8-fb566220737d req-43f25446-8add-4a9d-9651-49614a51a1ad service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:02.242926 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-59a4ab4a-e0a2-4f74-9ab8-fb566220737d req-43f25446-8add-4a9d-9651-49614a51a1ad service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:02.302720 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-59a4ab4a-e0a2-4f74-9ab8-fb566220737d req-43f25446-8add-4a9d-9651-49614a51a1ad service nova] Creating event network-vif-plugged:1d3e6b7e-bb2c-4e48-b26b-d6098ed14277 for instance dd9ed98a-2b15-455f-8ff2-ead26b5af05b on n-h1-master-1 Jun 20 12:25:02.311673 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6aa7a605-d275-45f8-9f3a-bc69d47714f0 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:02.338296 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-59a4ab4a-e0a2-4f74-9ab8-fb566220737d req-43f25446-8add-4a9d-9651-49614a51a1ad service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112240 Jun 20 12:25:02.349824 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6aa7a605-d275-45f8-9f3a-bc69d47714f0 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1504 microversion: 2.1 time: 1.011460 Jun 20 12:25:02.351251 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2566/5235] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:25:02.361111 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2969abc2-2766-4ad8-beb0-32cb095d62f2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:02.362969 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2969abc2-2766-4ad8-beb0-32cb095d62f2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: dd9ed98a-2b15-455f-8ff2-ead26b5af05b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:02.368349 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2670/5236] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:01 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1504 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:02.377354 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c3c88d25-d6f9-45d9-8bba-ad8000f74551 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:02.377354 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c3c88d25-d6f9-45d9-8bba-ad8000f74551 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: fab0e84e-17c7-4aa9-bc0a-37d236495cfc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:02.385095 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2969abc2-2766-4ad8-beb0-32cb095d62f2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:02.385552 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2969abc2-2766-4ad8-beb0-32cb095d62f2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:02.386357 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2969abc2-2766-4ad8-beb0-32cb095d62f2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:02.389362 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2969abc2-2766-4ad8-beb0-32cb095d62f2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:02.565908 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c3c88d25-d6f9-45d9-8bba-ad8000f74551 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:02.579244 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c3c88d25-d6f9-45d9-8bba-ad8000f74551 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/fab0e84e-17c7-4aa9-bc0a-37d236495cfc" status: 200 len: 1246 microversion: 2.1 time: 0.209059 Jun 20 12:25:02.581676 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2671/5237] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:02 2022] GET /compute/v2.1/servers/fab0e84e-17c7-4aa9-bc0a-37d236495cfc => generated 1246 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:03.058448 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2969abc2-2766-4ad8-beb0-32cb095d62f2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:03.071827 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2969abc2-2766-4ad8-beb0-32cb095d62f2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b" status: 200 len: 1314 microversion: 2.1 time: 0.715442 Jun 20 12:25:03.074645 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2567/5238] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:02 2022] GET /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b => generated 1314 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:03.393850 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-110c056f-4434-4a0e-a96c-5ed704ff54ef tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:03.398522 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-110c056f-4434-4a0e-a96c-5ed704ff54ef tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:03.439624 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-110c056f-4434-4a0e-a96c-5ed704ff54ef tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:03.442521 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-110c056f-4434-4a0e-a96c-5ed704ff54ef tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:03.445607 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-110c056f-4434-4a0e-a96c-5ed704ff54ef tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:03.447360 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-110c056f-4434-4a0e-a96c-5ed704ff54ef tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:03.602109 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e316bf76-c317-4f14-9348-9093fe3053b0 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:03.605735 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e316bf76-c317-4f14-9348-9093fe3053b0 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: fab0e84e-17c7-4aa9-bc0a-37d236495cfc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:03.643869 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e316bf76-c317-4f14-9348-9093fe3053b0 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:03.663102 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e316bf76-c317-4f14-9348-9093fe3053b0 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:03.665127 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e316bf76-c317-4f14-9348-9093fe3053b0 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:03.669432 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e316bf76-c317-4f14-9348-9093fe3053b0 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:03.857688 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-110c056f-4434-4a0e-a96c-5ed704ff54ef tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:03.903192 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-110c056f-4434-4a0e-a96c-5ed704ff54ef tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1504 microversion: 2.1 time: 0.517383 Jun 20 12:25:03.904537 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2672/5239] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:03 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1504 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:04.030829 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e316bf76-c317-4f14-9348-9093fe3053b0 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:04.059093 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e316bf76-c317-4f14-9348-9093fe3053b0 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/fab0e84e-17c7-4aa9-bc0a-37d236495cfc" status: 200 len: 1250 microversion: 2.1 time: 0.464741 Jun 20 12:25:04.062786 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2568/5240] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:03 2022] GET /compute/v2.1/servers/fab0e84e-17c7-4aa9-bc0a-37d236495cfc => generated 1250 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:04.093033 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-30213300-75b4-4cbc-8bb3-14968c167b8e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:04.093710 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-30213300-75b4-4cbc-8bb3-14968c167b8e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: dd9ed98a-2b15-455f-8ff2-ead26b5af05b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:04.109492 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-30213300-75b4-4cbc-8bb3-14968c167b8e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:04.112300 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-30213300-75b4-4cbc-8bb3-14968c167b8e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:04.119377 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-30213300-75b4-4cbc-8bb3-14968c167b8e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:04.121277 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-30213300-75b4-4cbc-8bb3-14968c167b8e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:04.578185 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-30213300-75b4-4cbc-8bb3-14968c167b8e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:04.599073 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-30213300-75b4-4cbc-8bb3-14968c167b8e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b" status: 200 len: 1502 microversion: 2.1 time: 0.511440 Jun 20 12:25:04.601970 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2673/5241] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:04 2022] GET /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b => generated 1502 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:04.641232 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0449b596-330a-4e6d-b74c-d06b161e656c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:25:04.650361 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0449b596-330a-4e6d-b74c-d06b161e656c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: dd9ed98a-2b15-455f-8ff2-ead26b5af05b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:04.677363 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0449b596-330a-4e6d-b74c-d06b161e656c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:04.678352 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0449b596-330a-4e6d-b74c-d06b161e656c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:04.679444 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0449b596-330a-4e6d-b74c-d06b161e656c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:04.679898 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0449b596-330a-4e6d-b74c-d06b161e656c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:04.933291 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9771575b-f91a-44e4-a7be-cacec531b328 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:04.934418 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9771575b-f91a-44e4-a7be-cacec531b328 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:04.975918 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9771575b-f91a-44e4-a7be-cacec531b328 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:04.976780 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9771575b-f91a-44e4-a7be-cacec531b328 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:04.977936 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9771575b-f91a-44e4-a7be-cacec531b328 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:04.982171 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9771575b-f91a-44e4-a7be-cacec531b328 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:05.174312 n-d-master-1 devstack@n-api.service[119128]: INFO nova.network.security_group_api [None req-0449b596-330a-4e6d-b74c-d06b161e656c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Removing security group c9d80402-56c5-4b26-8a9d-38d61a8bc1ae from port 1d3e6b7e-bb2c-4e48-b26b-d6098ed14277 Jun 20 12:25:05.377246 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9771575b-f91a-44e4-a7be-cacec531b328 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:05.392412 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9771575b-f91a-44e4-a7be-cacec531b328 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1504 microversion: 2.1 time: 0.466305 Jun 20 12:25:05.395302 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2674/5242] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:04 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1504 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:05.409699 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7e6d8ed7-b6cf-4095-b64b-dd480aa1a3c1 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:05.410533 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7e6d8ed7-b6cf-4095-b64b-dd480aa1a3c1 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: fab0e84e-17c7-4aa9-bc0a-37d236495cfc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:05.426651 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7e6d8ed7-b6cf-4095-b64b-dd480aa1a3c1 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:05.427394 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7e6d8ed7-b6cf-4095-b64b-dd480aa1a3c1 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:05.428430 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7e6d8ed7-b6cf-4095-b64b-dd480aa1a3c1 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:05.429461 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7e6d8ed7-b6cf-4095-b64b-dd480aa1a3c1 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:05.587078 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7e6d8ed7-b6cf-4095-b64b-dd480aa1a3c1 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:05.602921 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7e6d8ed7-b6cf-4095-b64b-dd480aa1a3c1 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/fab0e84e-17c7-4aa9-bc0a-37d236495cfc" status: 200 len: 1304 microversion: 2.1 time: 0.206099 Jun 20 12:25:05.606757 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2675/5243] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:05 2022] GET /compute/v2.1/servers/fab0e84e-17c7-4aa9-bc0a-37d236495cfc => generated 1304 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:06.146843 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0449b596-330a-4e6d-b74c-d06b161e656c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "POST /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b/action" status: 202 len: 0 microversion: 2.1 time: 1.531203 Jun 20 12:25:06.148586 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2569/5244] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:25:04 2022] POST /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b/action => generated 0 bytes in 1535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:25:06.161052 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-54a99fe4-6bc8-48af-8e5e-33a01f3fbb65 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:06.162173 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-54a99fe4-6bc8-48af-8e5e-33a01f3fbb65 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: dd9ed98a-2b15-455f-8ff2-ead26b5af05b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:06.195104 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-51dca001-cd37-4f3c-9c24-303de447ba78 req-2f9b2912-0713-4862-9be3-ee13cbc66ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd9ed98a-2b15-455f-8ff2-ead26b5af05b", "tag": "1d3e6b7e-bb2c-4e48-b26b-d6098ed14277"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:25:06.253423 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-54a99fe4-6bc8-48af-8e5e-33a01f3fbb65 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:06.254553 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-54a99fe4-6bc8-48af-8e5e-33a01f3fbb65 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:06.258333 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-51dca001-cd37-4f3c-9c24-303de447ba78 req-2f9b2912-0713-4862-9be3-ee13cbc66ef5 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:06.259413 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-54a99fe4-6bc8-48af-8e5e-33a01f3fbb65 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:06.264865 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-54a99fe4-6bc8-48af-8e5e-33a01f3fbb65 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:06.268163 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-51dca001-cd37-4f3c-9c24-303de447ba78 req-2f9b2912-0713-4862-9be3-ee13cbc66ef5 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:06.330243 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-51dca001-cd37-4f3c-9c24-303de447ba78 req-2f9b2912-0713-4862-9be3-ee13cbc66ef5 service nova] Creating event network-changed:1d3e6b7e-bb2c-4e48-b26b-d6098ed14277 for instance dd9ed98a-2b15-455f-8ff2-ead26b5af05b on n-h1-master-1 Jun 20 12:25:06.346181 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-51dca001-cd37-4f3c-9c24-303de447ba78 req-2f9b2912-0713-4862-9be3-ee13cbc66ef5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160814 Jun 20 12:25:06.360642 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2570/5245] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:25:06.410600 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-699e9099-44a5-423c-a76d-7eab511b55a3 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:06.411352 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-699e9099-44a5-423c-a76d-7eab511b55a3 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:06.431392 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-699e9099-44a5-423c-a76d-7eab511b55a3 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:06.431857 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-699e9099-44a5-423c-a76d-7eab511b55a3 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:06.432683 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-699e9099-44a5-423c-a76d-7eab511b55a3 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:06.433130 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-699e9099-44a5-423c-a76d-7eab511b55a3 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:06.527733 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:07.058442 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-699e9099-44a5-423c-a76d-7eab511b55a3 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:07.067513 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-699e9099-44a5-423c-a76d-7eab511b55a3 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1504 microversion: 2.1 time: 0.662079 Jun 20 12:25:07.068116 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2571/5246] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:06 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1504 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:07.089206 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-338e42b9-47c2-447e-9e00-f9be8d1b33f0 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:07.089824 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-338e42b9-47c2-447e-9e00-f9be8d1b33f0 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: fab0e84e-17c7-4aa9-bc0a-37d236495cfc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:07.104799 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-338e42b9-47c2-447e-9e00-f9be8d1b33f0 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:07.109313 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-338e42b9-47c2-447e-9e00-f9be8d1b33f0 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:07.110262 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-338e42b9-47c2-447e-9e00-f9be8d1b33f0 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:07.110896 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-338e42b9-47c2-447e-9e00-f9be8d1b33f0 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:07.261400 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-338e42b9-47c2-447e-9e00-f9be8d1b33f0 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:07.272551 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-338e42b9-47c2-447e-9e00-f9be8d1b33f0 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/fab0e84e-17c7-4aa9-bc0a-37d236495cfc" status: 200 len: 1304 microversion: 2.1 time: 0.192067 Jun 20 12:25:07.277129 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2572/5247] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:07 2022] GET /compute/v2.1/servers/fab0e84e-17c7-4aa9-bc0a-37d236495cfc => generated 1304 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:07.295514 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-54a99fe4-6bc8-48af-8e5e-33a01f3fbb65 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:07.309078 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-54a99fe4-6bc8-48af-8e5e-33a01f3fbb65 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b" status: 200 len: 1460 microversion: 2.1 time: 1.157051 Jun 20 12:25:07.314842 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2676/5248] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:06 2022] GET /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b => generated 1460 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:07.329493 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-129b4e83-aef4-41af-b56d-56df1dd281fd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:07.330529 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-129b4e83-aef4-41af-b56d-56df1dd281fd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:07.344672 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-129b4e83-aef4-41af-b56d-56df1dd281fd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:07.345242 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-129b4e83-aef4-41af-b56d-56df1dd281fd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:07.346448 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-129b4e83-aef4-41af-b56d-56df1dd281fd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:07.347051 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-129b4e83-aef4-41af-b56d-56df1dd281fd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:08.078545 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-129b4e83-aef4-41af-b56d-56df1dd281fd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:08.088231 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-129b4e83-aef4-41af-b56d-56df1dd281fd tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.762955 Jun 20 12:25:08.093365 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8667bbdc-d90f-4c53-84a0-84f62ec523be tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:08.094282 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2573/5249] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:07 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:08.098474 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8667bbdc-d90f-4c53-84a0-84f62ec523be tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:08.106323 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8667bbdc-d90f-4c53-84a0-84f62ec523be tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:08.106783 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8667bbdc-d90f-4c53-84a0-84f62ec523be tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:08.107580 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8667bbdc-d90f-4c53-84a0-84f62ec523be tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:08.108022 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8667bbdc-d90f-4c53-84a0-84f62ec523be tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:08.123246 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9db5f9d0-41c9-4a2f-9c2e-8afdcad51d33 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:08.124245 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9db5f9d0-41c9-4a2f-9c2e-8afdcad51d33 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:08.143199 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9db5f9d0-41c9-4a2f-9c2e-8afdcad51d33 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:08.145992 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9db5f9d0-41c9-4a2f-9c2e-8afdcad51d33 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:08.150300 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9db5f9d0-41c9-4a2f-9c2e-8afdcad51d33 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:08.150760 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9db5f9d0-41c9-4a2f-9c2e-8afdcad51d33 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:08.511265 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8667bbdc-d90f-4c53-84a0-84f62ec523be tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:08.521166 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8667bbdc-d90f-4c53-84a0-84f62ec523be tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1504 microversion: 2.1 time: 0.433897 Jun 20 12:25:08.525830 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2677/5250] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:08 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1504 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:08.550642 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5f6a8ab2-27b6-4ecd-98c8-5ecb771cf5b0 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:08.561394 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5f6a8ab2-27b6-4ecd-98c8-5ecb771cf5b0 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: fab0e84e-17c7-4aa9-bc0a-37d236495cfc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:08.580064 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f6a8ab2-27b6-4ecd-98c8-5ecb771cf5b0 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:08.581273 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f6a8ab2-27b6-4ecd-98c8-5ecb771cf5b0 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:08.582278 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f6a8ab2-27b6-4ecd-98c8-5ecb771cf5b0 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:08.582930 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f6a8ab2-27b6-4ecd-98c8-5ecb771cf5b0 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:08.637128 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9db5f9d0-41c9-4a2f-9c2e-8afdcad51d33 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:08.653744 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9db5f9d0-41c9-4a2f-9c2e-8afdcad51d33 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.533102 Jun 20 12:25:08.661637 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2574/5251] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:08 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:08.671442 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cc2c0ac6-d561-4779-b543-cb4d3b3ad56c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:08.672527 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cc2c0ac6-d561-4779-b543-cb4d3b3ad56c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:08.682278 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cc2c0ac6-d561-4779-b543-cb4d3b3ad56c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:08.682893 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cc2c0ac6-d561-4779-b543-cb4d3b3ad56c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:08.683752 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cc2c0ac6-d561-4779-b543-cb4d3b3ad56c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:08.684279 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cc2c0ac6-d561-4779-b543-cb4d3b3ad56c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:08.927486 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-cc2c0ac6-d561-4779-b543-cb4d3b3ad56c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:08.941177 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cc2c0ac6-d561-4779-b543-cb4d3b3ad56c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.274577 Jun 20 12:25:08.942924 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2575/5252] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:08 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:08.961892 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7ee4cc47-14f2-4e60-a106-0322fd5661a8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:08.962880 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7ee4cc47-14f2-4e60-a106-0322fd5661a8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:08.975059 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ee4cc47-14f2-4e60-a106-0322fd5661a8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:08.975839 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ee4cc47-14f2-4e60-a106-0322fd5661a8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:08.976716 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ee4cc47-14f2-4e60-a106-0322fd5661a8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:08.977211 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ee4cc47-14f2-4e60-a106-0322fd5661a8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:08.991653 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5f6a8ab2-27b6-4ecd-98c8-5ecb771cf5b0 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:09.015067 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5f6a8ab2-27b6-4ecd-98c8-5ecb771cf5b0 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/fab0e84e-17c7-4aa9-bc0a-37d236495cfc" status: 200 len: 1371 microversion: 2.1 time: 0.467859 Jun 20 12:25:09.033138 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2678/5253] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:08 2022] GET /compute/v2.1/servers/fab0e84e-17c7-4aa9-bc0a-37d236495cfc => generated 1371 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:09.264758 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7ee4cc47-14f2-4e60-a106-0322fd5661a8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:09.283332 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7ee4cc47-14f2-4e60-a106-0322fd5661a8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.327525 Jun 20 12:25:09.284123 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2576/5254] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:08 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:09.504690 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-e3222753-9aad-433d-856a-64a3191a65ef req-14a0dbff-7699-4177-9a26-60b8d1ec94e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fab0e84e-17c7-4aa9-bc0a-37d236495cfc", "tag": "51503e90-9ee4-4a07-9795-cdb998232fc1"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:25:09.513986 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9ef7c09e-f76d-4ad2-914d-c6a3f978873f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-868546561", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "2b5ba955-3292-4f14-a644-c809260e0b34"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:25:09.519622 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e3222753-9aad-433d-856a-64a3191a65ef req-14a0dbff-7699-4177-9a26-60b8d1ec94e1 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:09.522772 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e3222753-9aad-433d-856a-64a3191a65ef req-14a0dbff-7699-4177-9a26-60b8d1ec94e1 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:09.563914 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-e3222753-9aad-433d-856a-64a3191a65ef req-14a0dbff-7699-4177-9a26-60b8d1ec94e1 service nova] Creating event network-changed:51503e90-9ee4-4a07-9795-cdb998232fc1 for instance fab0e84e-17c7-4aa9-bc0a-37d236495cfc on n-h1-master-1 Jun 20 12:25:09.596129 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-e3222753-9aad-433d-856a-64a3191a65ef req-14a0dbff-7699-4177-9a26-60b8d1ec94e1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095423 Jun 20 12:25:09.600693 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2577/5255] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:25:09.612469 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dfe5ba7f-e186-4bde-8479-026837c1a44f tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:09.616957 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-dfe5ba7f-e186-4bde-8479-026837c1a44f tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:09.626237 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-9ef7c09e-f76d-4ad2-914d-c6a3f978873f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] validate_networks() for [('2b5ba955-3292-4f14-a644-c809260e0b34', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:25:09.632702 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dfe5ba7f-e186-4bde-8479-026837c1a44f tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:09.640555 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dfe5ba7f-e186-4bde-8479-026837c1a44f tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:09.655079 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dfe5ba7f-e186-4bde-8479-026837c1a44f tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:09.656256 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dfe5ba7f-e186-4bde-8479-026837c1a44f tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:10.038822 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-dfe5ba7f-e186-4bde-8479-026837c1a44f tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:10.048492 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dfe5ba7f-e186-4bde-8479-026837c1a44f tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1504 microversion: 2.1 time: 0.446205 Jun 20 12:25:10.051098 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2578/5256] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:09 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1504 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:10.067307 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-14e86559-150e-4083-a12c-d094339555a1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:25:10.068522 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-14e86559-150e-4083-a12c-d094339555a1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 7ac4715b-0c6b-4e90-b6e3-63a115494aec] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:10.076972 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-14e86559-150e-4083-a12c-d094339555a1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:10.077694 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-14e86559-150e-4083-a12c-d094339555a1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:10.078950 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-14e86559-150e-4083-a12c-d094339555a1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:10.079568 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-14e86559-150e-4083-a12c-d094339555a1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:10.158187 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-14e86559-150e-4083-a12c-d094339555a1 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "POST /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec/action" status: 200 len: 24560 microversion: 2.1 time: 0.095353 Jun 20 12:25:10.160363 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2579/5257] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:25:10 2022] POST /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec/action => generated 24560 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:25:10.169005 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-01876a5d-418b-440e-aeb4-b0e70ee7668e tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:10.171015 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-01876a5d-418b-440e-aeb4-b0e70ee7668e tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: fab0e84e-17c7-4aa9-bc0a-37d236495cfc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:10.191441 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-01876a5d-418b-440e-aeb4-b0e70ee7668e tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:10.192356 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-01876a5d-418b-440e-aeb4-b0e70ee7668e tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:10.194500 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-01876a5d-418b-440e-aeb4-b0e70ee7668e tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:10.195168 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-01876a5d-418b-440e-aeb4-b0e70ee7668e tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:10.609793 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-9ef7c09e-f76d-4ad2-914d-c6a3f978873f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:25:10.610296 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-9ef7c09e-f76d-4ad2-914d-c6a3f978873f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:25:10.610685 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-9ef7c09e-f76d-4ad2-914d-c6a3f978873f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:25:10.611100 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-9ef7c09e-f76d-4ad2-914d-c6a3f978873f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:25:10.611610 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-9ef7c09e-f76d-4ad2-914d-c6a3f978873f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:25:10.632136 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ef7c09e-f76d-4ad2-914d-c6a3f978873f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:10.632812 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ef7c09e-f76d-4ad2-914d-c6a3f978873f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:10.634366 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ef7c09e-f76d-4ad2-914d-c6a3f978873f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:10.634950 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ef7c09e-f76d-4ad2-914d-c6a3f978873f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:10.675665 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-9ef7c09e-f76d-4ad2-914d-c6a3f978873f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Getting quotas for project 19236314583142029ffd7a1e04460cab. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:25:10.682162 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-9ef7c09e-f76d-4ad2-914d-c6a3f978873f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Getting quotas for user 4ccd420e1ff744b99cb7e5650522e983 and project 19236314583142029ffd7a1e04460cab. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:25:10.699546 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9ef7c09e-f76d-4ad2-914d-c6a3f978873f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:25:10.702436 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9ef7c09e-f76d-4ad2-914d-c6a3f978873f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:25:10.812606 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9ef7c09e-f76d-4ad2-914d-c6a3f978873f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.315301 Jun 20 12:25:10.816258 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2679/5258] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:25:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 12:25:10.833573 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f3032be7-8c22-4db2-b294-55e435484d5c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:10.840928 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f3032be7-8c22-4db2-b294-55e435484d5c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:10.995213 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f3032be7-8c22-4db2-b294-55e435484d5c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:11.018149 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f3032be7-8c22-4db2-b294-55e435484d5c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1214 microversion: 2.1 time: 0.191210 Jun 20 12:25:11.018777 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2680/5259] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:10 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1214 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:11.067869 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-649560d1-e938-4682-98da-a9c5ab310734 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:11.068511 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-649560d1-e938-4682-98da-a9c5ab310734 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:11.082615 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-649560d1-e938-4682-98da-a9c5ab310734 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:11.083158 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-649560d1-e938-4682-98da-a9c5ab310734 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:11.083914 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-649560d1-e938-4682-98da-a9c5ab310734 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:11.084927 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-649560d1-e938-4682-98da-a9c5ab310734 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:11.149337 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-01876a5d-418b-440e-aeb4-b0e70ee7668e tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:11.160820 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-01876a5d-418b-440e-aeb4-b0e70ee7668e tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/fab0e84e-17c7-4aa9-bc0a-37d236495cfc" status: 200 len: 1371 microversion: 2.1 time: 0.998487 Jun 20 12:25:11.161713 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2580/5260] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:10 2022] GET /compute/v2.1/servers/fab0e84e-17c7-4aa9-bc0a-37d236495cfc => generated 1371 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:11.314919 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-649560d1-e938-4682-98da-a9c5ab310734 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:11.331081 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-649560d1-e938-4682-98da-a9c5ab310734 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1504 microversion: 2.1 time: 0.267324 Jun 20 12:25:11.331938 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2681/5261] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:11 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1504 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:12.037213 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4af373fd-4f18-406a-9c89-28d4f9fa9773 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:12.037906 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4af373fd-4f18-406a-9c89-28d4f9fa9773 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:12.041912 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:12.052835 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4af373fd-4f18-406a-9c89-28d4f9fa9773 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:12.056639 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4af373fd-4f18-406a-9c89-28d4f9fa9773 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:12.060024 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4af373fd-4f18-406a-9c89-28d4f9fa9773 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:12.060855 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4af373fd-4f18-406a-9c89-28d4f9fa9773 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:12.087951 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=18 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:12.178277 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4af373fd-4f18-406a-9c89-28d4f9fa9773 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:12.187062 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4af373fd-4f18-406a-9c89-28d4f9fa9773 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1266 microversion: 2.1 time: 0.155799 Jun 20 12:25:12.187591 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7a8a7bc2-925b-444f-a8e5-164b4e16b533 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:12.188812 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7a8a7bc2-925b-444f-a8e5-164b4e16b533 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: fab0e84e-17c7-4aa9-bc0a-37d236495cfc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:12.190995 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2581/5262] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:12 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:12.207637 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7a8a7bc2-925b-444f-a8e5-164b4e16b533 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:12.208607 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7a8a7bc2-925b-444f-a8e5-164b4e16b533 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:12.210006 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7a8a7bc2-925b-444f-a8e5-164b4e16b533 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:12.210504 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7a8a7bc2-925b-444f-a8e5-164b4e16b533 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:12.348875 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e4c8fd42-3e9f-41a9-8e7a-b837450cef95 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:12.350007 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e4c8fd42-3e9f-41a9-8e7a-b837450cef95 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:12.361821 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e4c8fd42-3e9f-41a9-8e7a-b837450cef95 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:12.364407 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e4c8fd42-3e9f-41a9-8e7a-b837450cef95 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:12.365413 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e4c8fd42-3e9f-41a9-8e7a-b837450cef95 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:12.367586 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e4c8fd42-3e9f-41a9-8e7a-b837450cef95 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:12.569556 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7a8a7bc2-925b-444f-a8e5-164b4e16b533 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:12.579430 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7a8a7bc2-925b-444f-a8e5-164b4e16b533 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/fab0e84e-17c7-4aa9-bc0a-37d236495cfc" status: 200 len: 1371 microversion: 2.1 time: 0.404792 Jun 20 12:25:12.581726 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2682/5263] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:12 2022] GET /compute/v2.1/servers/fab0e84e-17c7-4aa9-bc0a-37d236495cfc => generated 1371 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:12.903046 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e4c8fd42-3e9f-41a9-8e7a-b837450cef95 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:12.917990 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e4c8fd42-3e9f-41a9-8e7a-b837450cef95 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1504 microversion: 2.1 time: 0.571613 Jun 20 12:25:12.919863 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2582/5264] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:12 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1504 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:13.209611 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-36a528ba-cd2d-43a0-be57-760d3c4fa06b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:13.210470 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-36a528ba-cd2d-43a0-be57-760d3c4fa06b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:13.238505 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36a528ba-cd2d-43a0-be57-760d3c4fa06b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:13.239270 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36a528ba-cd2d-43a0-be57-760d3c4fa06b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:13.240306 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36a528ba-cd2d-43a0-be57-760d3c4fa06b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:13.240943 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36a528ba-cd2d-43a0-be57-760d3c4fa06b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:13.561391 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-36a528ba-cd2d-43a0-be57-760d3c4fa06b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:13.572547 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-36a528ba-cd2d-43a0-be57-760d3c4fa06b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1272 microversion: 2.1 time: 0.368828 Jun 20 12:25:13.573159 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2683/5265] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:13 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1272 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:13.596931 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b22c013a-d845-4dc0-8ac4-59c62d8dd593 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:13.597610 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b22c013a-d845-4dc0-8ac4-59c62d8dd593 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: fab0e84e-17c7-4aa9-bc0a-37d236495cfc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:13.630626 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b22c013a-d845-4dc0-8ac4-59c62d8dd593 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:13.631101 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b22c013a-d845-4dc0-8ac4-59c62d8dd593 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:13.631932 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b22c013a-d845-4dc0-8ac4-59c62d8dd593 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:13.632444 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b22c013a-d845-4dc0-8ac4-59c62d8dd593 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:13.934950 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5b55be0a-b54d-4819-b0e1-293d34564ddb tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:13.935579 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5b55be0a-b54d-4819-b0e1-293d34564ddb tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:13.943423 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b55be0a-b54d-4819-b0e1-293d34564ddb tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:13.943713 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b55be0a-b54d-4819-b0e1-293d34564ddb tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:13.944545 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b55be0a-b54d-4819-b0e1-293d34564ddb tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:13.956956 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b55be0a-b54d-4819-b0e1-293d34564ddb tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:13.961829 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:14.161902 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b22c013a-d845-4dc0-8ac4-59c62d8dd593 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:14.173503 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b22c013a-d845-4dc0-8ac4-59c62d8dd593 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/fab0e84e-17c7-4aa9-bc0a-37d236495cfc" status: 200 len: 1371 microversion: 2.1 time: 0.580781 Jun 20 12:25:14.174149 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2583/5266] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:13 2022] GET /compute/v2.1/servers/fab0e84e-17c7-4aa9-bc0a-37d236495cfc => generated 1371 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:14.593960 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5354f8ff-72b6-477e-bac8-00b2f2141b69 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:14.595067 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5354f8ff-72b6-477e-bac8-00b2f2141b69 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:14.605462 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5b55be0a-b54d-4819-b0e1-293d34564ddb tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:14.614511 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5b55be0a-b54d-4819-b0e1-293d34564ddb tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1504 microversion: 2.1 time: 0.683386 Jun 20 12:25:14.631462 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5354f8ff-72b6-477e-bac8-00b2f2141b69 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:14.631462 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5354f8ff-72b6-477e-bac8-00b2f2141b69 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:14.632642 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5354f8ff-72b6-477e-bac8-00b2f2141b69 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:14.633170 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2684/5267] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:13 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1504 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:14.635787 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5354f8ff-72b6-477e-bac8-00b2f2141b69 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:15.035000 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5354f8ff-72b6-477e-bac8-00b2f2141b69 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:15.050825 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5354f8ff-72b6-477e-bac8-00b2f2141b69 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1314 microversion: 2.1 time: 0.465147 Jun 20 12:25:15.051791 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2584/5268] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:14 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:15.190545 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b7c420dc-0e30-46c5-896a-6505ebc3d4c5 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:15.191650 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b7c420dc-0e30-46c5-896a-6505ebc3d4c5 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: fab0e84e-17c7-4aa9-bc0a-37d236495cfc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:15.203373 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b7c420dc-0e30-46c5-896a-6505ebc3d4c5 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:15.204140 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b7c420dc-0e30-46c5-896a-6505ebc3d4c5 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:15.207275 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b7c420dc-0e30-46c5-896a-6505ebc3d4c5 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:15.209842 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b7c420dc-0e30-46c5-896a-6505ebc3d4c5 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:15.642289 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8ca50537-1179-45ab-a1d8-e79c57a8c7bc tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:15.642960 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8ca50537-1179-45ab-a1d8-e79c57a8c7bc tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:15.657217 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ca50537-1179-45ab-a1d8-e79c57a8c7bc tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:15.657969 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ca50537-1179-45ab-a1d8-e79c57a8c7bc tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:15.662406 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ca50537-1179-45ab-a1d8-e79c57a8c7bc tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:15.663984 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ca50537-1179-45ab-a1d8-e79c57a8c7bc tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:15.823509 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b7c420dc-0e30-46c5-896a-6505ebc3d4c5 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:15.843601 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b7c420dc-0e30-46c5-896a-6505ebc3d4c5 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/fab0e84e-17c7-4aa9-bc0a-37d236495cfc" status: 200 len: 1371 microversion: 2.1 time: 0.657506 Jun 20 12:25:15.859750 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2685/5269] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:15 2022] GET /compute/v2.1/servers/fab0e84e-17c7-4aa9-bc0a-37d236495cfc => generated 1371 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:16.068640 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d8a26c68-4277-45c4-9b19-a69153b2817a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:16.069270 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d8a26c68-4277-45c4-9b19-a69153b2817a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:16.071265 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:16.093610 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d8a26c68-4277-45c4-9b19-a69153b2817a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:16.095002 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d8a26c68-4277-45c4-9b19-a69153b2817a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:16.095876 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d8a26c68-4277-45c4-9b19-a69153b2817a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:16.096756 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d8a26c68-4277-45c4-9b19-a69153b2817a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:16.180886 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8ca50537-1179-45ab-a1d8-e79c57a8c7bc tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:16.198193 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8ca50537-1179-45ab-a1d8-e79c57a8c7bc tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1504 microversion: 2.1 time: 0.561259 Jun 20 12:25:16.198790 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2585/5270] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:15 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1504 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:16.557023 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-244ecf18-c9b8-46ca-a85b-86449a6394f5 req-fe184791-a70d-42e1-a537-a417765ce13b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c473a298-ea22-4021-ae72-92e85a549c19", "tag": "9b61fdc1-e467-43d0-bf62-8e0407b63f9e"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:25:16.573886 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-244ecf18-c9b8-46ca-a85b-86449a6394f5 req-fe184791-a70d-42e1-a537-a417765ce13b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:16.581457 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-244ecf18-c9b8-46ca-a85b-86449a6394f5 req-fe184791-a70d-42e1-a537-a417765ce13b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:16.610614 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-244ecf18-c9b8-46ca-a85b-86449a6394f5 req-fe184791-a70d-42e1-a537-a417765ce13b service nova] Creating event network-changed:9b61fdc1-e467-43d0-bf62-8e0407b63f9e for instance c473a298-ea22-4021-ae72-92e85a549c19 on n-h2-master-1 Jun 20 12:25:16.624049 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-244ecf18-c9b8-46ca-a85b-86449a6394f5 req-fe184791-a70d-42e1-a537-a417765ce13b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071188 Jun 20 12:25:16.625112 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2586/5271] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:25:16.714441 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-293991ac-3b8d-4947-b366-cd04c6971828 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:16.715204 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-293991ac-3b8d-4947-b366-cd04c6971828 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 5b047d91-122c-44ee-b96e-1e0836960caa] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:16.731412 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-293991ac-3b8d-4947-b366-cd04c6971828 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:16.731986 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-293991ac-3b8d-4947-b366-cd04c6971828 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:16.736914 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-293991ac-3b8d-4947-b366-cd04c6971828 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:16.739312 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-293991ac-3b8d-4947-b366-cd04c6971828 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:16.792018 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d8a26c68-4277-45c4-9b19-a69153b2817a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:16.812125 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d8a26c68-4277-45c4-9b19-a69153b2817a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1314 microversion: 2.1 time: 0.748666 Jun 20 12:25:16.817894 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-293991ac-3b8d-4947-b366-cd04c6971828 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa/ips" status: 200 len: 143 microversion: 2.1 time: 0.107692 Jun 20 12:25:16.819561 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2587/5272] 10.222.0.27 () {58 vars in 1247 bytes} [Mon Jun 20 12:25:16 2022] GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa/ips => generated 143 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:25:16.820359 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2686/5273] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:16 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1314 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:16.866022 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c3fdcd35-01ed-4787-b2ca-a896c7593a1a tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:16.866692 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c3fdcd35-01ed-4787-b2ca-a896c7593a1a tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: fab0e84e-17c7-4aa9-bc0a-37d236495cfc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:16.897264 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c3fdcd35-01ed-4787-b2ca-a896c7593a1a tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:16.898430 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c3fdcd35-01ed-4787-b2ca-a896c7593a1a tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:16.902064 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c3fdcd35-01ed-4787-b2ca-a896c7593a1a tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:16.908268 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c3fdcd35-01ed-4787-b2ca-a896c7593a1a tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:17.217527 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b5650448-a2ba-4760-aa06-0be1c17e0475 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:17.218187 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b5650448-a2ba-4760-aa06-0be1c17e0475 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:17.260671 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5650448-a2ba-4760-aa06-0be1c17e0475 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:17.261528 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5650448-a2ba-4760-aa06-0be1c17e0475 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:17.265338 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5650448-a2ba-4760-aa06-0be1c17e0475 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:17.266734 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5650448-a2ba-4760-aa06-0be1c17e0475 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:17.292309 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c3fdcd35-01ed-4787-b2ca-a896c7593a1a tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:17.307411 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c3fdcd35-01ed-4787-b2ca-a896c7593a1a tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/fab0e84e-17c7-4aa9-bc0a-37d236495cfc" status: 200 len: 1371 microversion: 2.1 time: 0.446672 Jun 20 12:25:17.309336 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2588/5274] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:16 2022] GET /compute/v2.1/servers/fab0e84e-17c7-4aa9-bc0a-37d236495cfc => generated 1371 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:17.830627 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e14246c7-3c6f-4ab3-a236-71ebed4d8eb3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:17.832347 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e14246c7-3c6f-4ab3-a236-71ebed4d8eb3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:17.851352 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e14246c7-3c6f-4ab3-a236-71ebed4d8eb3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:17.853116 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e14246c7-3c6f-4ab3-a236-71ebed4d8eb3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:17.854105 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e14246c7-3c6f-4ab3-a236-71ebed4d8eb3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:17.854718 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e14246c7-3c6f-4ab3-a236-71ebed4d8eb3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:18.257872 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e14246c7-3c6f-4ab3-a236-71ebed4d8eb3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:18.267304 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e14246c7-3c6f-4ab3-a236-71ebed4d8eb3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1314 microversion: 2.1 time: 0.441197 Jun 20 12:25:18.271058 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2589/5275] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:17 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:18.282602 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-986c7e8b-b4bb-4e9d-8cd0-4102252e8037 req-cef95f10-7703-472d-a088-cfea47e642e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fab0e84e-17c7-4aa9-bc0a-37d236495cfc", "name": "network-vif-plugged", "status": "completed", "tag": "51503e90-9ee4-4a07-9795-cdb998232fc1"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:25:18.300498 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-986c7e8b-b4bb-4e9d-8cd0-4102252e8037 req-cef95f10-7703-472d-a088-cfea47e642e1 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:18.305708 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-986c7e8b-b4bb-4e9d-8cd0-4102252e8037 req-cef95f10-7703-472d-a088-cfea47e642e1 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:18.307583 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b5650448-a2ba-4760-aa06-0be1c17e0475 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:18.310348 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:18.328814 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b5650448-a2ba-4760-aa06-0be1c17e0475 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1504 microversion: 2.1 time: 1.117138 Jun 20 12:25:18.343157 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2687/5276] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:17 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1504 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:18.357532 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-986c7e8b-b4bb-4e9d-8cd0-4102252e8037 req-cef95f10-7703-472d-a088-cfea47e642e1 service nova] Creating event network-vif-plugged:51503e90-9ee4-4a07-9795-cdb998232fc1 for instance fab0e84e-17c7-4aa9-bc0a-37d236495cfc on n-h1-master-1 Jun 20 12:25:18.359270 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-15144f37-9291-49e4-a115-39caf7cc2c59 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:18.360079 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-15144f37-9291-49e4-a115-39caf7cc2c59 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: fab0e84e-17c7-4aa9-bc0a-37d236495cfc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:18.371086 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-986c7e8b-b4bb-4e9d-8cd0-4102252e8037 req-cef95f10-7703-472d-a088-cfea47e642e1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089781 Jun 20 12:25:18.372605 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2590/5277] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:25:18.376058 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-15144f37-9291-49e4-a115-39caf7cc2c59 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:18.376705 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-15144f37-9291-49e4-a115-39caf7cc2c59 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:18.377920 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-15144f37-9291-49e4-a115-39caf7cc2c59 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:18.378509 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-15144f37-9291-49e4-a115-39caf7cc2c59 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:18.862234 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-15144f37-9291-49e4-a115-39caf7cc2c59 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:18.875833 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-15144f37-9291-49e4-a115-39caf7cc2c59 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/fab0e84e-17c7-4aa9-bc0a-37d236495cfc" status: 200 len: 1371 microversion: 2.1 time: 0.527753 Jun 20 12:25:18.885557 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2688/5278] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:18 2022] GET /compute/v2.1/servers/fab0e84e-17c7-4aa9-bc0a-37d236495cfc => generated 1371 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:19.287937 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b576b8f3-34aa-4363-890d-f7dbcc4f91ff tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:19.288785 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b576b8f3-34aa-4363-890d-f7dbcc4f91ff tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:19.306873 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b576b8f3-34aa-4363-890d-f7dbcc4f91ff tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:19.308036 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b576b8f3-34aa-4363-890d-f7dbcc4f91ff tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:19.310823 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b576b8f3-34aa-4363-890d-f7dbcc4f91ff tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:19.311519 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b576b8f3-34aa-4363-890d-f7dbcc4f91ff tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:19.349624 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-23c495ee-bdb2-4ccf-ade8-bf9a31bdd318 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:19.353568 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-23c495ee-bdb2-4ccf-ade8-bf9a31bdd318 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:19.365455 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-23c495ee-bdb2-4ccf-ade8-bf9a31bdd318 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:19.365847 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-23c495ee-bdb2-4ccf-ade8-bf9a31bdd318 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:19.368517 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-23c495ee-bdb2-4ccf-ade8-bf9a31bdd318 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:19.369130 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-23c495ee-bdb2-4ccf-ade8-bf9a31bdd318 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:19.513878 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-23c495ee-bdb2-4ccf-ade8-bf9a31bdd318 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:19.522768 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-23c495ee-bdb2-4ccf-ade8-bf9a31bdd318 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1504 microversion: 2.1 time: 0.180326 Jun 20 12:25:19.523800 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2689/5279] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:19 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1504 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:19.574358 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b576b8f3-34aa-4363-890d-f7dbcc4f91ff tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:19.584005 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b576b8f3-34aa-4363-890d-f7dbcc4f91ff tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1314 microversion: 2.1 time: 0.300655 Jun 20 12:25:19.588686 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2591/5280] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:19 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:19.719521 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-34b85bd0-c785-49e5-90ae-9ee46586b013 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66002d18-c9da-4f2a-aea8-6821c9286b66"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:25:19.721055 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-34b85bd0-c785-49e5-90ae-9ee46586b013 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 5b047d91-122c-44ee-b96e-1e0836960caa] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:19.727856 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-34b85bd0-c785-49e5-90ae-9ee46586b013 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:19.728561 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-34b85bd0-c785-49e5-90ae-9ee46586b013 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:19.729517 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-34b85bd0-c785-49e5-90ae-9ee46586b013 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:19.730088 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-34b85bd0-c785-49e5-90ae-9ee46586b013 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:19.896542 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6803e9d1-4ab0-4a4f-b870-03a5daca0139 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:19.897518 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6803e9d1-4ab0-4a4f-b870-03a5daca0139 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: fab0e84e-17c7-4aa9-bc0a-37d236495cfc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:19.914115 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6803e9d1-4ab0-4a4f-b870-03a5daca0139 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:19.914560 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6803e9d1-4ab0-4a4f-b870-03a5daca0139 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:19.915340 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6803e9d1-4ab0-4a4f-b870-03a5daca0139 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:19.920265 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6803e9d1-4ab0-4a4f-b870-03a5daca0139 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:20.191958 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6803e9d1-4ab0-4a4f-b870-03a5daca0139 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:20.201938 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6803e9d1-4ab0-4a4f-b870-03a5daca0139 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/fab0e84e-17c7-4aa9-bc0a-37d236495cfc" status: 200 len: 1371 microversion: 2.1 time: 0.311569 Jun 20 12:25:20.203524 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2592/5281] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:19 2022] GET /compute/v2.1/servers/fab0e84e-17c7-4aa9-bc0a-37d236495cfc => generated 1371 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:20.543909 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7845184b-cf3d-4a4d-b610-9b1dfb1c07ba tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:20.546273 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7845184b-cf3d-4a4d-b610-9b1dfb1c07ba tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:20.555927 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7845184b-cf3d-4a4d-b610-9b1dfb1c07ba tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:20.557261 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7845184b-cf3d-4a4d-b610-9b1dfb1c07ba tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:20.558281 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7845184b-cf3d-4a4d-b610-9b1dfb1c07ba tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:20.558923 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7845184b-cf3d-4a4d-b610-9b1dfb1c07ba tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:20.646235 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:20.747596 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7845184b-cf3d-4a4d-b610-9b1dfb1c07ba tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:20.756648 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7845184b-cf3d-4a4d-b610-9b1dfb1c07ba tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1504 microversion: 2.1 time: 0.219607 Jun 20 12:25:20.766553 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2593/5282] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:20 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1504 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:20.771637 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8d7d514f-c68c-41a5-967a-76ce12457cb8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:20.772544 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8d7d514f-c68c-41a5-967a-76ce12457cb8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:20.779605 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8d7d514f-c68c-41a5-967a-76ce12457cb8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:20.780060 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8d7d514f-c68c-41a5-967a-76ce12457cb8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:20.780884 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8d7d514f-c68c-41a5-967a-76ce12457cb8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:20.781312 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8d7d514f-c68c-41a5-967a-76ce12457cb8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:21.003547 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=10 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:21.027600 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8d7d514f-c68c-41a5-967a-76ce12457cb8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:21.058029 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8d7d514f-c68c-41a5-967a-76ce12457cb8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1314 microversion: 2.1 time: 0.290275 Jun 20 12:25:21.070071 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2594/5283] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:20 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:21.220753 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0bcd0608-6766-42ed-bc97-59bceb429080 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:21.221507 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0bcd0608-6766-42ed-bc97-59bceb429080 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: fab0e84e-17c7-4aa9-bc0a-37d236495cfc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:21.228620 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0bcd0608-6766-42ed-bc97-59bceb429080 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:21.229360 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0bcd0608-6766-42ed-bc97-59bceb429080 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:21.230340 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0bcd0608-6766-42ed-bc97-59bceb429080 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:21.230975 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0bcd0608-6766-42ed-bc97-59bceb429080 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:21.474027 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0bcd0608-6766-42ed-bc97-59bceb429080 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:21.482108 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0bcd0608-6766-42ed-bc97-59bceb429080 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/fab0e84e-17c7-4aa9-bc0a-37d236495cfc" status: 200 len: 1544 microversion: 2.1 time: 0.266626 Jun 20 12:25:21.487800 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2595/5284] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:21 2022] GET /compute/v2.1/servers/fab0e84e-17c7-4aa9-bc0a-37d236495cfc => generated 1544 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:21.506455 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ed094427-75a4-4127-80a4-9a3582d9a1fc tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:21.507080 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ed094427-75a4-4127-80a4-9a3582d9a1fc tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: fab0e84e-17c7-4aa9-bc0a-37d236495cfc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:21.514387 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed094427-75a4-4127-80a4-9a3582d9a1fc tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:21.514903 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed094427-75a4-4127-80a4-9a3582d9a1fc tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:21.515692 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed094427-75a4-4127-80a4-9a3582d9a1fc tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:21.516127 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed094427-75a4-4127-80a4-9a3582d9a1fc tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:21.711476 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ed094427-75a4-4127-80a4-9a3582d9a1fc tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:21.720958 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ed094427-75a4-4127-80a4-9a3582d9a1fc tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/fab0e84e-17c7-4aa9-bc0a-37d236495cfc" status: 200 len: 1544 microversion: 2.1 time: 0.221407 Jun 20 12:25:21.734675 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2596/5285] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:21 2022] GET /compute/v2.1/servers/fab0e84e-17c7-4aa9-bc0a-37d236495cfc => generated 1544 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:21.776571 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ce412fc6-6381-40a0-b45a-0fc3741a5ec1 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:21.777347 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ce412fc6-6381-40a0-b45a-0fc3741a5ec1 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:21.794839 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce412fc6-6381-40a0-b45a-0fc3741a5ec1 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:21.795410 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce412fc6-6381-40a0-b45a-0fc3741a5ec1 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:21.796466 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce412fc6-6381-40a0-b45a-0fc3741a5ec1 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:21.797115 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce412fc6-6381-40a0-b45a-0fc3741a5ec1 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:22.067076 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-34b85bd0-c785-49e5-90ae-9ee46586b013 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "POST /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.351550 Jun 20 12:25:22.073004 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2690/5286] 10.222.0.27 () {60 vars in 1322 bytes} [Mon Jun 20 12:25:19 2022] POST /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa/os-volume_attachments => generated 194 bytes in 2358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:25:22.092009 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3c103f73-071a-45fa-9553-f8bc3fadc94c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:22.094148 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3c103f73-071a-45fa-9553-f8bc3fadc94c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:22.112176 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c103f73-071a-45fa-9553-f8bc3fadc94c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:22.114836 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c103f73-071a-45fa-9553-f8bc3fadc94c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:22.116846 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c103f73-071a-45fa-9553-f8bc3fadc94c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:22.117616 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c103f73-071a-45fa-9553-f8bc3fadc94c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:22.267125 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ce412fc6-6381-40a0-b45a-0fc3741a5ec1 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:22.289124 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ce412fc6-6381-40a0-b45a-0fc3741a5ec1 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1504 microversion: 2.1 time: 0.505569 Jun 20 12:25:22.293284 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2597/5287] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:21 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1504 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:22.536650 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3c103f73-071a-45fa-9553-f8bc3fadc94c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:22.548806 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3c103f73-071a-45fa-9553-f8bc3fadc94c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1314 microversion: 2.1 time: 0.464620 Jun 20 12:25:22.561688 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2691/5288] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:22 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:23.310945 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fc0d8399-c23e-4654-939a-b4eb0947e7a3 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:23.311654 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fc0d8399-c23e-4654-939a-b4eb0947e7a3 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:23.319868 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fc0d8399-c23e-4654-939a-b4eb0947e7a3 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:23.325623 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fc0d8399-c23e-4654-939a-b4eb0947e7a3 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:23.326986 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fc0d8399-c23e-4654-939a-b4eb0947e7a3 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:23.328761 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fc0d8399-c23e-4654-939a-b4eb0947e7a3 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:23.574591 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8e519da6-d9c8-43fc-8125-2f7010a08f83 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:23.578378 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8e519da6-d9c8-43fc-8125-2f7010a08f83 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:23.600381 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8e519da6-d9c8-43fc-8125-2f7010a08f83 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:23.601044 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8e519da6-d9c8-43fc-8125-2f7010a08f83 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:23.602010 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8e519da6-d9c8-43fc-8125-2f7010a08f83 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:23.602978 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8e519da6-d9c8-43fc-8125-2f7010a08f83 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:23.649832 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fc0d8399-c23e-4654-939a-b4eb0947e7a3 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:23.661140 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fc0d8399-c23e-4654-939a-b4eb0947e7a3 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1504 microversion: 2.1 time: 0.353886 Jun 20 12:25:23.677019 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2598/5289] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:23 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1504 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:24.257006 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8e519da6-d9c8-43fc-8125-2f7010a08f83 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:24.279576 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8e519da6-d9c8-43fc-8125-2f7010a08f83 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1314 microversion: 2.1 time: 0.712483 Jun 20 12:25:24.285556 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2692/5290] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:23 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1314 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:24.685166 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-549f71bd-6d56-40b0-b39f-c831128d34e1 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:24.686639 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-549f71bd-6d56-40b0-b39f-c831128d34e1 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:24.707520 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-549f71bd-6d56-40b0-b39f-c831128d34e1 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:24.721899 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-549f71bd-6d56-40b0-b39f-c831128d34e1 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:24.725180 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-549f71bd-6d56-40b0-b39f-c831128d34e1 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:24.726578 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-549f71bd-6d56-40b0-b39f-c831128d34e1 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:25.210458 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-549f71bd-6d56-40b0-b39f-c831128d34e1 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:25.222617 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-549f71bd-6d56-40b0-b39f-c831128d34e1 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1504 microversion: 2.1 time: 0.541571 Jun 20 12:25:25.225482 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2599/5291] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:24 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1504 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:25.303593 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8bbfa2c8-7ee8-4910-8e0f-78978c7d34b3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:25.305540 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8bbfa2c8-7ee8-4910-8e0f-78978c7d34b3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:25.321701 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bbfa2c8-7ee8-4910-8e0f-78978c7d34b3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:25.322435 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bbfa2c8-7ee8-4910-8e0f-78978c7d34b3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:25.325833 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bbfa2c8-7ee8-4910-8e0f-78978c7d34b3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:25.326452 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bbfa2c8-7ee8-4910-8e0f-78978c7d34b3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:25.918997 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8bbfa2c8-7ee8-4910-8e0f-78978c7d34b3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:25.933650 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8bbfa2c8-7ee8-4910-8e0f-78978c7d34b3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1314 microversion: 2.1 time: 0.635793 Jun 20 12:25:25.935807 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2693/5292] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:25 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1314 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:26.242331 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3e9ac99a-0a22-4b41-b448-65f3736ff588 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:26.243587 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3e9ac99a-0a22-4b41-b448-65f3736ff588 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:26.271189 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3e9ac99a-0a22-4b41-b448-65f3736ff588 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:26.271757 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3e9ac99a-0a22-4b41-b448-65f3736ff588 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:26.272847 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3e9ac99a-0a22-4b41-b448-65f3736ff588 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:26.279883 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3e9ac99a-0a22-4b41-b448-65f3736ff588 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:26.957821 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ea010068-cab2-4ecb-82bc-d37a79a22dec tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:26.959029 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ea010068-cab2-4ecb-82bc-d37a79a22dec tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:26.976568 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea010068-cab2-4ecb-82bc-d37a79a22dec tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:26.978202 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea010068-cab2-4ecb-82bc-d37a79a22dec tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:26.979186 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea010068-cab2-4ecb-82bc-d37a79a22dec tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:26.985302 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea010068-cab2-4ecb-82bc-d37a79a22dec tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:27.176134 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3e9ac99a-0a22-4b41-b448-65f3736ff588 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:27.190317 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3e9ac99a-0a22-4b41-b448-65f3736ff588 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1504 microversion: 2.1 time: 0.951768 Jun 20 12:25:27.202139 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2600/5293] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:26 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1504 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:27.678611 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ea010068-cab2-4ecb-82bc-d37a79a22dec tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:27.692558 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ea010068-cab2-4ecb-82bc-d37a79a22dec tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1314 microversion: 2.1 time: 0.738179 Jun 20 12:25:27.693256 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2694/5294] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:26 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1314 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:28.208157 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3a1a0aa9-ea63-4b1f-a529-926a626bcfb8 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:28.209511 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3a1a0aa9-ea63-4b1f-a529-926a626bcfb8 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:28.213923 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:28.230289 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3a1a0aa9-ea63-4b1f-a529-926a626bcfb8 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:28.232275 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3a1a0aa9-ea63-4b1f-a529-926a626bcfb8 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:28.236499 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3a1a0aa9-ea63-4b1f-a529-926a626bcfb8 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:28.238801 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3a1a0aa9-ea63-4b1f-a529-926a626bcfb8 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:28.711511 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a28adec0-dea1-4faa-bc1a-80befaa65101 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:28.713175 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a28adec0-dea1-4faa-bc1a-80befaa65101 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:28.750274 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a28adec0-dea1-4faa-bc1a-80befaa65101 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:28.751802 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a28adec0-dea1-4faa-bc1a-80befaa65101 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:28.756715 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a28adec0-dea1-4faa-bc1a-80befaa65101 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:28.758223 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a28adec0-dea1-4faa-bc1a-80befaa65101 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:29.256231 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3a1a0aa9-ea63-4b1f-a529-926a626bcfb8 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:29.272322 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3a1a0aa9-ea63-4b1f-a529-926a626bcfb8 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1504 microversion: 2.1 time: 1.068425 Jun 20 12:25:29.281420 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a28adec0-dea1-4faa-bc1a-80befaa65101 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:29.289577 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2601/5295] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:28 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1504 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:29.297678 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a28adec0-dea1-4faa-bc1a-80befaa65101 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1314 microversion: 2.1 time: 0.591861 Jun 20 12:25:29.307098 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2695/5296] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:28 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1314 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:29.308972 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-fbab856a-bde0-4884-82a8-a68f207027e1 req-00d05089-ab22-4c73-8a88-7caf6891eb5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c473a298-ea22-4021-ae72-92e85a549c19", "name": "network-vif-plugged", "status": "completed", "tag": "9b61fdc1-e467-43d0-bf62-8e0407b63f9e"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:25:29.354299 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-fbab856a-bde0-4884-82a8-a68f207027e1 req-00d05089-ab22-4c73-8a88-7caf6891eb5d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:29.357866 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-fbab856a-bde0-4884-82a8-a68f207027e1 req-00d05089-ab22-4c73-8a88-7caf6891eb5d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:29.405395 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-fbab856a-bde0-4884-82a8-a68f207027e1 req-00d05089-ab22-4c73-8a88-7caf6891eb5d service nova] Creating event network-vif-plugged:9b61fdc1-e467-43d0-bf62-8e0407b63f9e for instance c473a298-ea22-4021-ae72-92e85a549c19 on n-h2-master-1 Jun 20 12:25:29.418434 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-fbab856a-bde0-4884-82a8-a68f207027e1 req-00d05089-ab22-4c73-8a88-7caf6891eb5d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113421 Jun 20 12:25:29.425145 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2602/5297] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:25:30.289741 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d70aa999-7dc6-43d6-b4a3-eee750cb0f77 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:30.290341 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d70aa999-7dc6-43d6-b4a3-eee750cb0f77 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:30.307936 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d70aa999-7dc6-43d6-b4a3-eee750cb0f77 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:30.308672 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d70aa999-7dc6-43d6-b4a3-eee750cb0f77 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:30.309753 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d70aa999-7dc6-43d6-b4a3-eee750cb0f77 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:30.310407 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d70aa999-7dc6-43d6-b4a3-eee750cb0f77 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:30.324894 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f259b3f1-ed0d-426f-9593-adaff1ed6793 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:30.325719 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f259b3f1-ed0d-426f-9593-adaff1ed6793 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:30.341308 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f259b3f1-ed0d-426f-9593-adaff1ed6793 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:30.349412 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f259b3f1-ed0d-426f-9593-adaff1ed6793 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:30.350490 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f259b3f1-ed0d-426f-9593-adaff1ed6793 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:30.355452 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f259b3f1-ed0d-426f-9593-adaff1ed6793 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:30.693991 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f259b3f1-ed0d-426f-9593-adaff1ed6793 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:30.702748 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f259b3f1-ed0d-426f-9593-adaff1ed6793 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1314 microversion: 2.1 time: 0.382322 Jun 20 12:25:30.714368 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2603/5298] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:30 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:30.772419 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d70aa999-7dc6-43d6-b4a3-eee750cb0f77 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:30.782967 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d70aa999-7dc6-43d6-b4a3-eee750cb0f77 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1504 microversion: 2.1 time: 0.496940 Jun 20 12:25:30.785407 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2696/5299] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:30 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1504 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:31.729283 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-29a214f1-4f6d-4044-9f95-900d91edbec5 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:31.730742 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-29a214f1-4f6d-4044-9f95-900d91edbec5 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:31.745809 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-29a214f1-4f6d-4044-9f95-900d91edbec5 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:31.753828 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-29a214f1-4f6d-4044-9f95-900d91edbec5 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:31.754922 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-29a214f1-4f6d-4044-9f95-900d91edbec5 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:31.756293 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-29a214f1-4f6d-4044-9f95-900d91edbec5 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:31.803291 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5ed66ab6-eeeb-4f95-a080-a86fbd1aebc2 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:31.803896 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5ed66ab6-eeeb-4f95-a080-a86fbd1aebc2 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:31.818155 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5ed66ab6-eeeb-4f95-a080-a86fbd1aebc2 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:31.819554 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5ed66ab6-eeeb-4f95-a080-a86fbd1aebc2 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:31.820558 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5ed66ab6-eeeb-4f95-a080-a86fbd1aebc2 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:31.824063 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5ed66ab6-eeeb-4f95-a080-a86fbd1aebc2 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:32.115921 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5ed66ab6-eeeb-4f95-a080-a86fbd1aebc2 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:32.133986 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5ed66ab6-eeeb-4f95-a080-a86fbd1aebc2 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1484 microversion: 2.1 time: 0.334548 Jun 20 12:25:32.136352 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2697/5300] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:31 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1484 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:32.296041 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-29a214f1-4f6d-4044-9f95-900d91edbec5 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:32.306601 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-29a214f1-4f6d-4044-9f95-900d91edbec5 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1314 microversion: 2.1 time: 0.582307 Jun 20 12:25:32.309148 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2604/5301] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:31 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1314 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:32.459565 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-54ecb421-a1c7-4f56-8bc2-51ec8a4e3ed8 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-241534290", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:25:32.556821 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-54ecb421-a1c7-4f56-8bc2-51ec8a4e3ed8 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] validate_networks() for [('ac2a4b03-47fb-4eb6-a4ab-3c306e2d4dc8', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:25:33.326809 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cb71ca4a-4bcd-4682-aea3-a8babc39180b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:33.328968 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cb71ca4a-4bcd-4682-aea3-a8babc39180b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:33.336152 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-54ecb421-a1c7-4f56-8bc2-51ec8a4e3ed8 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:25:33.336672 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-54ecb421-a1c7-4f56-8bc2-51ec8a4e3ed8 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:25:33.337075 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-54ecb421-a1c7-4f56-8bc2-51ec8a4e3ed8 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:25:33.337488 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-54ecb421-a1c7-4f56-8bc2-51ec8a4e3ed8 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:25:33.337934 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-54ecb421-a1c7-4f56-8bc2-51ec8a4e3ed8 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:25:33.356195 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb71ca4a-4bcd-4682-aea3-a8babc39180b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:33.361700 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb71ca4a-4bcd-4682-aea3-a8babc39180b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:33.364039 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-54ecb421-a1c7-4f56-8bc2-51ec8a4e3ed8 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:33.365111 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb71ca4a-4bcd-4682-aea3-a8babc39180b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:33.365723 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-54ecb421-a1c7-4f56-8bc2-51ec8a4e3ed8 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:33.366427 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb71ca4a-4bcd-4682-aea3-a8babc39180b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:33.367471 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-54ecb421-a1c7-4f56-8bc2-51ec8a4e3ed8 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:33.370003 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-54ecb421-a1c7-4f56-8bc2-51ec8a4e3ed8 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:33.418671 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-54ecb421-a1c7-4f56-8bc2-51ec8a4e3ed8 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Getting quotas for project 44cb6606f6a04b8b910fa472b8846f02. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:25:33.440947 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-54ecb421-a1c7-4f56-8bc2-51ec8a4e3ed8 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Getting quotas for user 9c8447285bb44a86a82741c6b08c6007 and project 44cb6606f6a04b8b910fa472b8846f02. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:25:33.468248 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-54ecb421-a1c7-4f56-8bc2-51ec8a4e3ed8 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:25:33.472805 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-54ecb421-a1c7-4f56-8bc2-51ec8a4e3ed8 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:25:33.578093 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-54ecb421-a1c7-4f56-8bc2-51ec8a4e3ed8 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.126482 Jun 20 12:25:33.582158 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2698/5302] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:25:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 1131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:25:33.601413 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-800917a4-2131-4819-92f6-3ccc452c7819 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:33.602435 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-800917a4-2131-4819-92f6-3ccc452c7819 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:33.799652 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-cb71ca4a-4bcd-4682-aea3-a8babc39180b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:33.808146 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cb71ca4a-4bcd-4682-aea3-a8babc39180b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1502 microversion: 2.1 time: 0.485403 Jun 20 12:25:33.813051 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2605/5303] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:33 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1502 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:33.830103 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-370368d9-5d1f-4b59-87c3-1d43093d30bf tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:25:33.831871 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-370368d9-5d1f-4b59-87c3-1d43093d30bf tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:33.849583 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-370368d9-5d1f-4b59-87c3-1d43093d30bf tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:33.849583 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-370368d9-5d1f-4b59-87c3-1d43093d30bf tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:33.849849 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-370368d9-5d1f-4b59-87c3-1d43093d30bf tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:33.850859 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-800917a4-2131-4819-92f6-3ccc452c7819 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:33.851527 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-370368d9-5d1f-4b59-87c3-1d43093d30bf tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:33.862802 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-800917a4-2131-4819-92f6-3ccc452c7819 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c" status: 200 len: 1213 microversion: 2.1 time: 0.274955 Jun 20 12:25:33.867217 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2699/5304] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:33 2022] GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c => generated 1213 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:34.083838 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-370368d9-5d1f-4b59-87c3-1d43093d30bf tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "POST /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19/action" status: 202 len: 0 microversion: 2.1 time: 0.257947 Jun 20 12:25:34.091824 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2606/5305] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:25:33 2022] POST /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:25:34.097798 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1d9e9a92-673f-4c2c-9356-4ed85341db04 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:34.100618 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1d9e9a92-673f-4c2c-9356-4ed85341db04 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:34.109632 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1d9e9a92-673f-4c2c-9356-4ed85341db04 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:34.110211 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1d9e9a92-673f-4c2c-9356-4ed85341db04 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:34.113219 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1d9e9a92-673f-4c2c-9356-4ed85341db04 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:34.114129 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1d9e9a92-673f-4c2c-9356-4ed85341db04 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:34.336767 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1d9e9a92-673f-4c2c-9356-4ed85341db04 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:34.347984 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1d9e9a92-673f-4c2c-9356-4ed85341db04 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1507 microversion: 2.1 time: 0.254719 Jun 20 12:25:34.349161 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2700/5306] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:34 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1507 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:34.882497 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-97388a53-dd8c-4e6c-857c-c67dbf87f335 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:34.883210 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-97388a53-dd8c-4e6c-857c-c67dbf87f335 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:34.909942 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-97388a53-dd8c-4e6c-857c-c67dbf87f335 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:34.910595 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-97388a53-dd8c-4e6c-857c-c67dbf87f335 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:34.911746 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-97388a53-dd8c-4e6c-857c-c67dbf87f335 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:34.912382 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-97388a53-dd8c-4e6c-857c-c67dbf87f335 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:34.919836 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:35.037398 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-97388a53-dd8c-4e6c-857c-c67dbf87f335 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:35.050389 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-97388a53-dd8c-4e6c-857c-c67dbf87f335 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c" status: 200 len: 1265 microversion: 2.1 time: 0.172060 Jun 20 12:25:35.052148 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2607/5307] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:34 2022] GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:35.365270 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b43934e2-a4c4-40ac-b3e9-ac3f788ddf08 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:35.366656 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b43934e2-a4c4-40ac-b3e9-ac3f788ddf08 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:35.387347 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b43934e2-a4c4-40ac-b3e9-ac3f788ddf08 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:35.388223 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b43934e2-a4c4-40ac-b3e9-ac3f788ddf08 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:35.389276 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b43934e2-a4c4-40ac-b3e9-ac3f788ddf08 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:35.389921 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b43934e2-a4c4-40ac-b3e9-ac3f788ddf08 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:35.395912 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:35.816339 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b43934e2-a4c4-40ac-b3e9-ac3f788ddf08 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:35.834610 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b43934e2-a4c4-40ac-b3e9-ac3f788ddf08 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1487 microversion: 2.1 time: 0.473233 Jun 20 12:25:35.852311 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3c5ef989-4cbc-4b42-bb41-63844fbef721 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:25:35.852865 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3c5ef989-4cbc-4b42-bb41-63844fbef721 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:35.856009 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2701/5308] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:35 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1487 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:35.859349 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3c5ef989-4cbc-4b42-bb41-63844fbef721 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:35.859805 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3c5ef989-4cbc-4b42-bb41-63844fbef721 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:35.860809 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3c5ef989-4cbc-4b42-bb41-63844fbef721 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:35.861100 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3c5ef989-4cbc-4b42-bb41-63844fbef721 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:35.903907 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-3c5ef989-4cbc-4b42-bb41-63844fbef721 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lazy-loading 'flavor' on Instance uuid c473a298-ea22-4021-ae72-92e85a549c19 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:25:36.070756 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-80db3e3f-0480-4984-b84c-95ab09e9a421 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:36.071266 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-80db3e3f-0480-4984-b84c-95ab09e9a421 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:36.089944 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-80db3e3f-0480-4984-b84c-95ab09e9a421 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:36.100614 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-80db3e3f-0480-4984-b84c-95ab09e9a421 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:36.102558 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-80db3e3f-0480-4984-b84c-95ab09e9a421 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:36.104364 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-80db3e3f-0480-4984-b84c-95ab09e9a421 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:36.425279 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3c5ef989-4cbc-4b42-bb41-63844fbef721 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "POST /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19/action" status: 202 len: 0 microversion: 2.1 time: 0.577521 Jun 20 12:25:36.427138 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2608/5309] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:25:35 2022] POST /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19/action => generated 0 bytes in 580 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 12:25:36.462244 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-01cfceca-70d1-4d94-8f91-9ce7215f592c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:36.471660 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-01cfceca-70d1-4d94-8f91-9ce7215f592c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:36.496319 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-01cfceca-70d1-4d94-8f91-9ce7215f592c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:36.496845 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-01cfceca-70d1-4d94-8f91-9ce7215f592c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:36.497609 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-01cfceca-70d1-4d94-8f91-9ce7215f592c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:36.500429 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-01cfceca-70d1-4d94-8f91-9ce7215f592c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:36.731114 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-80db3e3f-0480-4984-b84c-95ab09e9a421 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:36.750622 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-80db3e3f-0480-4984-b84c-95ab09e9a421 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c" status: 200 len: 1313 microversion: 2.1 time: 0.685330 Jun 20 12:25:36.759146 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2702/5310] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:36 2022] GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c => generated 1313 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:37.410372 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-01cfceca-70d1-4d94-8f91-9ce7215f592c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:37.427403 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-01cfceca-70d1-4d94-8f91-9ce7215f592c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1493 microversion: 2.1 time: 0.980180 Jun 20 12:25:37.443106 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2609/5311] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:36 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1493 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:37.771665 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8a0861d2-c087-476b-bfeb-ba3e5a9dd069 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:37.773943 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8a0861d2-c087-476b-bfeb-ba3e5a9dd069 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:37.792386 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a0861d2-c087-476b-bfeb-ba3e5a9dd069 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:37.797357 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a0861d2-c087-476b-bfeb-ba3e5a9dd069 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:37.800241 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a0861d2-c087-476b-bfeb-ba3e5a9dd069 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:37.801710 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a0861d2-c087-476b-bfeb-ba3e5a9dd069 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:38.038402 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-89389d4e-6d75-4bae-a008-6fc7ba83a3cb req-cd091512-5eac-4815-82ce-48d64ba8124f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a35c3e87-7c93-4301-a5a4-de4034af784c", "tag": "0bc7adfa-1ebc-4150-94cf-12c2683a86c4"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:25:38.075428 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-89389d4e-6d75-4bae-a008-6fc7ba83a3cb req-cd091512-5eac-4815-82ce-48d64ba8124f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:38.077224 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-89389d4e-6d75-4bae-a008-6fc7ba83a3cb req-cd091512-5eac-4815-82ce-48d64ba8124f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:38.114684 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-89389d4e-6d75-4bae-a008-6fc7ba83a3cb req-cd091512-5eac-4815-82ce-48d64ba8124f service nova] Creating event network-changed:0bc7adfa-1ebc-4150-94cf-12c2683a86c4 for instance a35c3e87-7c93-4301-a5a4-de4034af784c on n-h1-master-1 Jun 20 12:25:38.139483 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-89389d4e-6d75-4bae-a008-6fc7ba83a3cb req-cd091512-5eac-4815-82ce-48d64ba8124f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103175 Jun 20 12:25:38.140528 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2610/5312] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:25:38.396849 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8a0861d2-c087-476b-bfeb-ba3e5a9dd069 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:38.416885 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8a0861d2-c087-476b-bfeb-ba3e5a9dd069 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c" status: 200 len: 1313 microversion: 2.1 time: 0.650649 Jun 20 12:25:38.420664 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2703/5313] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:37 2022] GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c => generated 1313 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:38.446838 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8ae8e630-d070-4a01-9b80-f37e8546738b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:38.448082 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8ae8e630-d070-4a01-9b80-f37e8546738b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:38.476447 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ae8e630-d070-4a01-9b80-f37e8546738b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:38.476990 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ae8e630-d070-4a01-9b80-f37e8546738b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:38.482237 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ae8e630-d070-4a01-9b80-f37e8546738b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:38.482847 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ae8e630-d070-4a01-9b80-f37e8546738b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:38.678122 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-994f393d-2f07-49e0-9934-a248c03be7ad tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:38.679199 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-994f393d-2f07-49e0-9934-a248c03be7ad tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 5b047d91-122c-44ee-b96e-1e0836960caa] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:38.691725 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-994f393d-2f07-49e0-9934-a248c03be7ad tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:38.692191 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-994f393d-2f07-49e0-9934-a248c03be7ad tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:38.693047 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-994f393d-2f07-49e0-9934-a248c03be7ad tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:38.694373 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-994f393d-2f07-49e0-9934-a248c03be7ad tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:38.744719 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-994f393d-2f07-49e0-9934-a248c03be7ad tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072856 Jun 20 12:25:38.748248 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2704/5314] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:25:38 2022] GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:25:38.757016 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b758c54c-91bc-4374-9424-6a18ba1e5710 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:38.757727 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b758c54c-91bc-4374-9424-6a18ba1e5710 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 5b047d91-122c-44ee-b96e-1e0836960caa] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:38.766071 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b758c54c-91bc-4374-9424-6a18ba1e5710 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:38.766826 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b758c54c-91bc-4374-9424-6a18ba1e5710 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:38.772815 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b758c54c-91bc-4374-9424-6a18ba1e5710 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:38.773824 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b758c54c-91bc-4374-9424-6a18ba1e5710 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:38.840779 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b758c54c-91bc-4374-9424-6a18ba1e5710 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa/os-volume_attachments/66002d18-c9da-4f2a-aea8-6821c9286b66" status: 200 len: 194 microversion: 2.1 time: 0.089413 Jun 20 12:25:38.862718 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2705/5315] 10.222.0.27 () {58 vars in 1412 bytes} [Mon Jun 20 12:25:38 2022] GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa/os-volume_attachments/66002d18-c9da-4f2a-aea8-6821c9286b66 => generated 194 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:25:38.877883 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8ae8e630-d070-4a01-9b80-f37e8546738b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:38.886965 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8ae8e630-d070-4a01-9b80-f37e8546738b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1514 microversion: 2.1 time: 0.444607 Jun 20 12:25:38.901676 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2611/5316] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:38 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1514 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:39.444923 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d10dcffc-efec-4fda-af69-7fddadbd2d2b tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:39.446290 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d10dcffc-efec-4fda-af69-7fddadbd2d2b tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:39.481978 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d10dcffc-efec-4fda-af69-7fddadbd2d2b tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:39.482971 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d10dcffc-efec-4fda-af69-7fddadbd2d2b tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:39.484292 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d10dcffc-efec-4fda-af69-7fddadbd2d2b tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:39.485001 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d10dcffc-efec-4fda-af69-7fddadbd2d2b tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:39.910427 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-083cc3b4-f890-44a5-a9f6-f87636416356 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:39.911660 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-083cc3b4-f890-44a5-a9f6-f87636416356 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:39.927965 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d10dcffc-efec-4fda-af69-7fddadbd2d2b tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:39.937486 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-083cc3b4-f890-44a5-a9f6-f87636416356 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:39.937947 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-083cc3b4-f890-44a5-a9f6-f87636416356 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:39.938922 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-083cc3b4-f890-44a5-a9f6-f87636416356 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:39.939534 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-083cc3b4-f890-44a5-a9f6-f87636416356 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:39.940968 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d10dcffc-efec-4fda-af69-7fddadbd2d2b tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c" status: 200 len: 1313 microversion: 2.1 time: 0.507278 Jun 20 12:25:39.952087 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2706/5317] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:39 2022] GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c => generated 1313 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:40.462496 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-083cc3b4-f890-44a5-a9f6-f87636416356 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:40.477326 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-083cc3b4-f890-44a5-a9f6-f87636416356 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1514 microversion: 2.1 time: 0.570622 Jun 20 12:25:40.487552 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2612/5318] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:39 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1514 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:40.959765 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b87e0544-bcd1-4fd1-a03c-ee0dad0b959d tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:40.961299 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b87e0544-bcd1-4fd1-a03c-ee0dad0b959d tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:40.979287 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b87e0544-bcd1-4fd1-a03c-ee0dad0b959d tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:40.979833 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b87e0544-bcd1-4fd1-a03c-ee0dad0b959d tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:40.981794 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b87e0544-bcd1-4fd1-a03c-ee0dad0b959d tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:40.982256 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b87e0544-bcd1-4fd1-a03c-ee0dad0b959d tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:41.403688 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b87e0544-bcd1-4fd1-a03c-ee0dad0b959d tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:41.414961 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b87e0544-bcd1-4fd1-a03c-ee0dad0b959d tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c" status: 200 len: 1313 microversion: 2.1 time: 0.460966 Jun 20 12:25:41.419330 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2707/5319] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:40 2022] GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c => generated 1313 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:41.509189 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fb5fd26f-3190-477a-96b3-7904f28f2f84 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:41.512094 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fb5fd26f-3190-477a-96b3-7904f28f2f84 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:41.551720 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0fb37485-400d-4d8f-b6b1-a8e715af45e6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec756b7a-4f23-4718-8713-e63f4ea98563"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:25:41.553081 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0fb37485-400d-4d8f-b6b1-a8e715af45e6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 5b047d91-122c-44ee-b96e-1e0836960caa] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:41.558107 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fb5fd26f-3190-477a-96b3-7904f28f2f84 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:41.558676 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fb5fd26f-3190-477a-96b3-7904f28f2f84 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:41.562266 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fb5fd26f-3190-477a-96b3-7904f28f2f84 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:41.562731 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fb5fd26f-3190-477a-96b3-7904f28f2f84 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:41.606388 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0fb37485-400d-4d8f-b6b1-a8e715af45e6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:41.607208 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0fb37485-400d-4d8f-b6b1-a8e715af45e6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:41.608645 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0fb37485-400d-4d8f-b6b1-a8e715af45e6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:41.614927 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0fb37485-400d-4d8f-b6b1-a8e715af45e6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:41.975425 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fb5fd26f-3190-477a-96b3-7904f28f2f84 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:41.992627 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fb5fd26f-3190-477a-96b3-7904f28f2f84 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1514 microversion: 2.1 time: 0.498864 Jun 20 12:25:42.003850 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2613/5320] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:41 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1514 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:42.215418 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0fb37485-400d-4d8f-b6b1-a8e715af45e6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "POST /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.658106 Jun 20 12:25:42.217618 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2708/5321] 10.222.0.27 () {60 vars in 1322 bytes} [Mon Jun 20 12:25:41 2022] POST /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa/os-volume_attachments => generated 194 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:25:42.371255 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-9ec6ae69-1437-4fee-aa1e-be96429fd875 req-a857d985-fe6e-48a3-b413-fd7ce34204ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c473a298-ea22-4021-ae72-92e85a549c19", "name": "network-vif-plugged", "status": "completed", "tag": "9b61fdc1-e467-43d0-bf62-8e0407b63f9e"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:25:42.395596 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9ec6ae69-1437-4fee-aa1e-be96429fd875 req-a857d985-fe6e-48a3-b413-fd7ce34204ae service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:42.401368 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9ec6ae69-1437-4fee-aa1e-be96429fd875 req-a857d985-fe6e-48a3-b413-fd7ce34204ae service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:42.440052 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8bf5300c-ad61-4075-b1dd-a518fd41fcef tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:42.441010 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8bf5300c-ad61-4075-b1dd-a518fd41fcef tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:42.467850 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-9ec6ae69-1437-4fee-aa1e-be96429fd875 req-a857d985-fe6e-48a3-b413-fd7ce34204ae service nova] Creating event network-vif-plugged:9b61fdc1-e467-43d0-bf62-8e0407b63f9e for instance c473a298-ea22-4021-ae72-92e85a549c19 on n-h2-master-1 Jun 20 12:25:42.471908 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bf5300c-ad61-4075-b1dd-a518fd41fcef tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:42.472414 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bf5300c-ad61-4075-b1dd-a518fd41fcef tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:42.481967 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bf5300c-ad61-4075-b1dd-a518fd41fcef tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:42.482334 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bf5300c-ad61-4075-b1dd-a518fd41fcef tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:42.507537 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-9ec6ae69-1437-4fee-aa1e-be96429fd875 req-a857d985-fe6e-48a3-b413-fd7ce34204ae service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140049 Jun 20 12:25:42.525154 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2614/5322] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:25:42.845817 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8bf5300c-ad61-4075-b1dd-a518fd41fcef tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:42.856568 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8bf5300c-ad61-4075-b1dd-a518fd41fcef tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c" status: 200 len: 1313 microversion: 2.1 time: 0.424135 Jun 20 12:25:42.857793 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2709/5323] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:42 2022] GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c => generated 1313 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:43.016986 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d02b59c5-79e7-4e00-9192-89999e74adcb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:43.020126 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d02b59c5-79e7-4e00-9192-89999e74adcb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:43.039597 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d02b59c5-79e7-4e00-9192-89999e74adcb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:43.040854 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d02b59c5-79e7-4e00-9192-89999e74adcb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:43.042735 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d02b59c5-79e7-4e00-9192-89999e74adcb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:43.044975 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d02b59c5-79e7-4e00-9192-89999e74adcb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:43.594244 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d02b59c5-79e7-4e00-9192-89999e74adcb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:43.605269 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d02b59c5-79e7-4e00-9192-89999e74adcb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1514 microversion: 2.1 time: 0.597526 Jun 20 12:25:43.616040 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2615/5324] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:43 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1514 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:43.877303 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f98df9ec-4727-4669-9268-ba2bd23852dc tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:43.879109 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f98df9ec-4727-4669-9268-ba2bd23852dc tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:43.887604 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:43.915054 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=8 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:43.926220 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f98df9ec-4727-4669-9268-ba2bd23852dc tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:43.927884 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f98df9ec-4727-4669-9268-ba2bd23852dc tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:43.933832 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f98df9ec-4727-4669-9268-ba2bd23852dc tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:43.937089 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f98df9ec-4727-4669-9268-ba2bd23852dc tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:44.258088 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f98df9ec-4727-4669-9268-ba2bd23852dc tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:44.270409 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f98df9ec-4727-4669-9268-ba2bd23852dc tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c" status: 200 len: 1313 microversion: 2.1 time: 0.399360 Jun 20 12:25:44.282293 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2710/5325] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:43 2022] GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c => generated 1313 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:44.573983 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-bb68060f-6e2b-4bd5-bb9a-06b072d0e9e1 req-ba383425-a334-4b77-9b9f-5c365995d6db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a35c3e87-7c93-4301-a5a4-de4034af784c", "name": "network-vif-plugged", "status": "completed", "tag": "0bc7adfa-1ebc-4150-94cf-12c2683a86c4"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:25:44.591086 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-bb68060f-6e2b-4bd5-bb9a-06b072d0e9e1 req-ba383425-a334-4b77-9b9f-5c365995d6db service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:44.591576 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-bb68060f-6e2b-4bd5-bb9a-06b072d0e9e1 req-ba383425-a334-4b77-9b9f-5c365995d6db service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:44.622294 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-bb68060f-6e2b-4bd5-bb9a-06b072d0e9e1 req-ba383425-a334-4b77-9b9f-5c365995d6db service nova] Creating event network-vif-plugged:0bc7adfa-1ebc-4150-94cf-12c2683a86c4 for instance a35c3e87-7c93-4301-a5a4-de4034af784c on n-h1-master-1 Jun 20 12:25:44.624899 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c2fe6053-8d81-431b-9f5d-b931aff549f4 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:44.625858 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c2fe6053-8d81-431b-9f5d-b931aff549f4 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:44.637710 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-bb68060f-6e2b-4bd5-bb9a-06b072d0e9e1 req-ba383425-a334-4b77-9b9f-5c365995d6db service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069136 Jun 20 12:25:44.638762 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2616/5326] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:25:44.657080 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c2fe6053-8d81-431b-9f5d-b931aff549f4 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:44.657744 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c2fe6053-8d81-431b-9f5d-b931aff549f4 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:44.658915 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c2fe6053-8d81-431b-9f5d-b931aff549f4 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:44.662387 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c2fe6053-8d81-431b-9f5d-b931aff549f4 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:45.020127 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c2fe6053-8d81-431b-9f5d-b931aff549f4 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:45.062806 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c2fe6053-8d81-431b-9f5d-b931aff549f4 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1514 microversion: 2.1 time: 0.443040 Jun 20 12:25:45.064002 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2711/5327] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:44 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1514 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:45.298685 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c2cd17b1-86f1-4952-8f45-c8254db3d568 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:45.302086 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c2cd17b1-86f1-4952-8f45-c8254db3d568 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:45.315543 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c2cd17b1-86f1-4952-8f45-c8254db3d568 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:45.316333 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c2cd17b1-86f1-4952-8f45-c8254db3d568 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:45.317658 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c2cd17b1-86f1-4952-8f45-c8254db3d568 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:45.319481 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c2cd17b1-86f1-4952-8f45-c8254db3d568 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:45.693060 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c2cd17b1-86f1-4952-8f45-c8254db3d568 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:45.704813 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c2cd17b1-86f1-4952-8f45-c8254db3d568 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c" status: 200 len: 1313 microversion: 2.1 time: 0.417772 Jun 20 12:25:45.705494 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2617/5328] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:45 2022] GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c => generated 1313 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:46.081380 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c8be7243-3e9c-4ccd-872a-d6d5d225893b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:46.082971 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c8be7243-3e9c-4ccd-872a-d6d5d225893b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:46.101761 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c8be7243-3e9c-4ccd-872a-d6d5d225893b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:46.102824 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c8be7243-3e9c-4ccd-872a-d6d5d225893b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:46.105178 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c8be7243-3e9c-4ccd-872a-d6d5d225893b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:46.107363 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c8be7243-3e9c-4ccd-872a-d6d5d225893b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:46.727210 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-14ccad38-2c96-4e62-bc19-f4965a0916db tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:46.728521 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-14ccad38-2c96-4e62-bc19-f4965a0916db tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:46.748239 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-14ccad38-2c96-4e62-bc19-f4965a0916db tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:46.755535 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-14ccad38-2c96-4e62-bc19-f4965a0916db tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:46.757546 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-14ccad38-2c96-4e62-bc19-f4965a0916db tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:46.758460 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-14ccad38-2c96-4e62-bc19-f4965a0916db tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:47.099037 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c8be7243-3e9c-4ccd-872a-d6d5d225893b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:47.108601 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c8be7243-3e9c-4ccd-872a-d6d5d225893b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1509 microversion: 2.1 time: 1.032037 Jun 20 12:25:47.109206 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2712/5329] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:46 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1509 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:47.177181 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-14ccad38-2c96-4e62-bc19-f4965a0916db tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:47.189395 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-14ccad38-2c96-4e62-bc19-f4965a0916db tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c" status: 200 len: 1499 microversion: 2.1 time: 0.468081 Jun 20 12:25:47.190027 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2618/5330] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:46 2022] GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c => generated 1499 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:47.215885 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c1090222-81b4-457b-8775-4407f498d8fa tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:25:47.216992 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c1090222-81b4-457b-8775-4407f498d8fa tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:47.233040 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:47.237784 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c1090222-81b4-457b-8775-4407f498d8fa tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:47.238504 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c1090222-81b4-457b-8775-4407f498d8fa tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:47.240797 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c1090222-81b4-457b-8775-4407f498d8fa tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:47.242364 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c1090222-81b4-457b-8775-4407f498d8fa tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:47.325475 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-c1090222-81b4-457b-8775-4407f498d8fa tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lazy-loading 'flavor' on Instance uuid a35c3e87-7c93-4301-a5a4-de4034af784c {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:25:47.497904 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c1090222-81b4-457b-8775-4407f498d8fa tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "POST /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c/action" status: 200 len: 32 microversion: 2.1 time: 0.292016 Jun 20 12:25:47.501105 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2713/5331] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:25:47 2022] POST /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c/action => generated 32 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:25:47.510351 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f8ab3627-cb16-4c06-b8d7-c0fbebb26cc5 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:47.511404 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f8ab3627-cb16-4c06-b8d7-c0fbebb26cc5 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:47.522821 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8ab3627-cb16-4c06-b8d7-c0fbebb26cc5 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:47.524726 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8ab3627-cb16-4c06-b8d7-c0fbebb26cc5 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:47.526269 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8ab3627-cb16-4c06-b8d7-c0fbebb26cc5 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:47.527225 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8ab3627-cb16-4c06-b8d7-c0fbebb26cc5 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:47.983709 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f8ab3627-cb16-4c06-b8d7-c0fbebb26cc5 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:47.999185 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f8ab3627-cb16-4c06-b8d7-c0fbebb26cc5 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c" status: 200 len: 1505 microversion: 2.1 time: 0.491822 Jun 20 12:25:47.999841 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2619/5332] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:47 2022] GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c => generated 1505 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:48.130652 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-108f074d-835c-4359-80b1-25bba77b64cb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:48.132639 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-108f074d-835c-4359-80b1-25bba77b64cb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:48.171031 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-108f074d-835c-4359-80b1-25bba77b64cb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:48.171981 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-108f074d-835c-4359-80b1-25bba77b64cb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:48.175325 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-108f074d-835c-4359-80b1-25bba77b64cb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:48.186212 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-108f074d-835c-4359-80b1-25bba77b64cb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:48.243434 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:48.949462 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6a4850e2-36bb-4660-9b54-92647d9262b4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:25:48.950999 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6a4850e2-36bb-4660-9b54-92647d9262b4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 7ac4715b-0c6b-4e90-b6e3-63a115494aec] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:48.975275 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a4850e2-36bb-4660-9b54-92647d9262b4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:48.975744 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a4850e2-36bb-4660-9b54-92647d9262b4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:48.976598 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a4850e2-36bb-4660-9b54-92647d9262b4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:48.977042 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a4850e2-36bb-4660-9b54-92647d9262b4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:49.232557 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-108f074d-835c-4359-80b1-25bba77b64cb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:49.248747 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-108f074d-835c-4359-80b1-25bba77b64cb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1509 microversion: 2.1 time: 1.126267 Jun 20 12:25:49.255518 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2714/5333] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:48 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1509 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:49.290436 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3ef859eb-c0ea-41dd-a64d-561768a92281 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:49.292083 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3ef859eb-c0ea-41dd-a64d-561768a92281 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:49.305352 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3ef859eb-c0ea-41dd-a64d-561768a92281 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:49.305806 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3ef859eb-c0ea-41dd-a64d-561768a92281 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:49.306589 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3ef859eb-c0ea-41dd-a64d-561768a92281 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:49.307029 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3ef859eb-c0ea-41dd-a64d-561768a92281 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:49.315923 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-6a4850e2-36bb-4660-9b54-92647d9262b4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:25:49.321110 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-6a4850e2-36bb-4660-9b54-92647d9262b4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:25:49.323573 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-6a4850e2-36bb-4660-9b54-92647d9262b4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:25:49.324003 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-6a4850e2-36bb-4660-9b54-92647d9262b4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:25:49.324798 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-6a4850e2-36bb-4660-9b54-92647d9262b4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:25:49.485887 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6a4850e2-36bb-4660-9b54-92647d9262b4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 7ac4715b-0c6b-4e90-b6e3-63a115494aec] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:49.499654 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a4850e2-36bb-4660-9b54-92647d9262b4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:49.501469 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a4850e2-36bb-4660-9b54-92647d9262b4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:49.503847 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a4850e2-36bb-4660-9b54-92647d9262b4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:49.504523 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a4850e2-36bb-4660-9b54-92647d9262b4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:49.579579 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6a4850e2-36bb-4660-9b54-92647d9262b4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "POST /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec/action" status: 202 len: 1137 microversion: 2.1 time: 0.631771 Jun 20 12:25:49.584339 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2620/5334] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:25:48 2022] POST /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec/action => generated 1137 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jun 20 12:25:49.602234 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c723322e-3df3-4dd7-9088-22f54eea549d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:49.603287 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c723322e-3df3-4dd7-9088-22f54eea549d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 7ac4715b-0c6b-4e90-b6e3-63a115494aec] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:49.613207 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c723322e-3df3-4dd7-9088-22f54eea549d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:49.614052 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c723322e-3df3-4dd7-9088-22f54eea549d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:49.615167 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c723322e-3df3-4dd7-9088-22f54eea549d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:49.616439 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c723322e-3df3-4dd7-9088-22f54eea549d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:49.932819 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c723322e-3df3-4dd7-9088-22f54eea549d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:49.937046 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:49.948709 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c723322e-3df3-4dd7-9088-22f54eea549d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec" status: 200 len: 1690 microversion: 2.1 time: 0.355307 Jun 20 12:25:49.949343 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2621/5335] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:49 2022] GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec => generated 1690 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:50.037533 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3ef859eb-c0ea-41dd-a64d-561768a92281 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:50.049212 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3ef859eb-c0ea-41dd-a64d-561768a92281 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c" status: 200 len: 1505 microversion: 2.1 time: 0.788738 Jun 20 12:25:50.053407 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2715/5336] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:49 2022] GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c => generated 1505 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:50.273644 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-90da5a9f-c2b1-4e89-91bb-357705bb8413 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:50.274784 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-90da5a9f-c2b1-4e89-91bb-357705bb8413 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:50.299231 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-90da5a9f-c2b1-4e89-91bb-357705bb8413 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:50.304019 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-90da5a9f-c2b1-4e89-91bb-357705bb8413 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:50.305955 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-90da5a9f-c2b1-4e89-91bb-357705bb8413 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:50.310505 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-90da5a9f-c2b1-4e89-91bb-357705bb8413 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:50.478186 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-01f0463e-4329-408c-ad00-652dd2fb5f57 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:50.478745 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-01f0463e-4329-408c-ad00-652dd2fb5f57 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: fab0e84e-17c7-4aa9-bc0a-37d236495cfc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:50.492064 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01f0463e-4329-408c-ad00-652dd2fb5f57 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:50.495845 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01f0463e-4329-408c-ad00-652dd2fb5f57 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:50.496693 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01f0463e-4329-408c-ad00-652dd2fb5f57 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:50.497130 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01f0463e-4329-408c-ad00-652dd2fb5f57 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:50.571734 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-01f0463e-4329-408c-ad00-652dd2fb5f57 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: fab0e84e-17c7-4aa9-bc0a-37d236495cfc] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:25:50.671433 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-90da5a9f-c2b1-4e89-91bb-357705bb8413 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:50.687159 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-90da5a9f-c2b1-4e89-91bb-357705bb8413 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1509 microversion: 2.1 time: 0.419111 Jun 20 12:25:50.692136 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2622/5337] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:50 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1509 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:50.747081 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-01f0463e-4329-408c-ad00-652dd2fb5f57 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fab0e84e-17c7-4aa9-bc0a-37d236495cfc" status: 204 len: 0 microversion: 2.1 time: 0.272439 Jun 20 12:25:50.753764 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2716/5338] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:25:50 2022] DELETE /compute/v2.1/servers/fab0e84e-17c7-4aa9-bc0a-37d236495cfc => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:25:50.758595 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-783f686a-131d-4bdf-aa1a-c57cb7e4759a tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:50.759479 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-783f686a-131d-4bdf-aa1a-c57cb7e4759a tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: fab0e84e-17c7-4aa9-bc0a-37d236495cfc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:50.773006 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-783f686a-131d-4bdf-aa1a-c57cb7e4759a tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:50.773006 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-783f686a-131d-4bdf-aa1a-c57cb7e4759a tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:50.773006 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-783f686a-131d-4bdf-aa1a-c57cb7e4759a tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:50.773006 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-783f686a-131d-4bdf-aa1a-c57cb7e4759a tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:50.967458 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3e94a65b-a6f7-4b8a-9ede-b0efdf95ca8a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:50.968177 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3e94a65b-a6f7-4b8a-9ede-b0efdf95ca8a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 7ac4715b-0c6b-4e90-b6e3-63a115494aec] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:50.989601 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e94a65b-a6f7-4b8a-9ede-b0efdf95ca8a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:50.991563 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e94a65b-a6f7-4b8a-9ede-b0efdf95ca8a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:50.993761 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e94a65b-a6f7-4b8a-9ede-b0efdf95ca8a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:50.995542 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e94a65b-a6f7-4b8a-9ede-b0efdf95ca8a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:51.140046 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-783f686a-131d-4bdf-aa1a-c57cb7e4759a tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:51.161925 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-783f686a-131d-4bdf-aa1a-c57cb7e4759a tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/fab0e84e-17c7-4aa9-bc0a-37d236495cfc" status: 200 len: 1550 microversion: 2.1 time: 0.408299 Jun 20 12:25:51.162531 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2623/5339] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:50 2022] GET /compute/v2.1/servers/fab0e84e-17c7-4aa9-bc0a-37d236495cfc => generated 1550 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:51.177260 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fb560eb2-b54f-492e-b564-e3c6925f3551 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:51.188386 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fb560eb2-b54f-492e-b564-e3c6925f3551 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:51.222135 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fb560eb2-b54f-492e-b564-e3c6925f3551 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:51.222932 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fb560eb2-b54f-492e-b564-e3c6925f3551 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:51.223926 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fb560eb2-b54f-492e-b564-e3c6925f3551 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:51.228512 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fb560eb2-b54f-492e-b564-e3c6925f3551 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:51.416214 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3e94a65b-a6f7-4b8a-9ede-b0efdf95ca8a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:51.430131 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3e94a65b-a6f7-4b8a-9ede-b0efdf95ca8a tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec" status: 200 len: 1690 microversion: 2.1 time: 0.467424 Jun 20 12:25:51.434247 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2717/5340] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:50 2022] GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec => generated 1690 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:51.462841 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-00f13224-86f5-4f94-b619-0cd0ac75e29c tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-582649033", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:25:51.612098 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-00f13224-86f5-4f94-b619-0cd0ac75e29c tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] validate_networks() for None {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:25:51.652429 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fb560eb2-b54f-492e-b564-e3c6925f3551 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:51.663241 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fb560eb2-b54f-492e-b564-e3c6925f3551 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c" status: 200 len: 1505 microversion: 2.1 time: 0.489718 Jun 20 12:25:51.663838 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2624/5341] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:51 2022] GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c => generated 1505 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:51.714903 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-16739112-1a1a-44e0-a3fe-d3e2f9088403 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:51.715563 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-16739112-1a1a-44e0-a3fe-d3e2f9088403 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:51.728130 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-16739112-1a1a-44e0-a3fe-d3e2f9088403 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:51.732523 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-16739112-1a1a-44e0-a3fe-d3e2f9088403 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:51.733375 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-16739112-1a1a-44e0-a3fe-d3e2f9088403 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:51.733819 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-16739112-1a1a-44e0-a3fe-d3e2f9088403 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:51.964703 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-16739112-1a1a-44e0-a3fe-d3e2f9088403 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:51.990671 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-16739112-1a1a-44e0-a3fe-d3e2f9088403 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1509 microversion: 2.1 time: 0.270229 Jun 20 12:25:51.995334 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2625/5342] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:51 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1509 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:52.180291 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dc4a7fb8-4822-49b9-8112-7268c4c9171f tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:52.181347 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-dc4a7fb8-4822-49b9-8112-7268c4c9171f tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: fab0e84e-17c7-4aa9-bc0a-37d236495cfc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:52.197978 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc4a7fb8-4822-49b9-8112-7268c4c9171f tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:52.203725 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc4a7fb8-4822-49b9-8112-7268c4c9171f tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:52.209005 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc4a7fb8-4822-49b9-8112-7268c4c9171f tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:52.212081 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc4a7fb8-4822-49b9-8112-7268c4c9171f tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:52.354154 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-00f13224-86f5-4f94-b619-0cd0ac75e29c tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:25:52.354578 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-00f13224-86f5-4f94-b619-0cd0ac75e29c tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:25:52.355217 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-00f13224-86f5-4f94-b619-0cd0ac75e29c tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:25:52.355788 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-00f13224-86f5-4f94-b619-0cd0ac75e29c tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:25:52.356718 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-00f13224-86f5-4f94-b619-0cd0ac75e29c tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:25:52.374091 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-00f13224-86f5-4f94-b619-0cd0ac75e29c tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:52.374784 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-00f13224-86f5-4f94-b619-0cd0ac75e29c tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:52.375868 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-00f13224-86f5-4f94-b619-0cd0ac75e29c tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:52.381038 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-00f13224-86f5-4f94-b619-0cd0ac75e29c tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:52.421351 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-00f13224-86f5-4f94-b619-0cd0ac75e29c tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Getting quotas for project eeedf38e938b4fd39ccfbf50436bb6ab. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:25:52.436156 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-00f13224-86f5-4f94-b619-0cd0ac75e29c tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Getting quotas for user 3ee3168402f24c0481fbe0275cebbdc3 and project eeedf38e938b4fd39ccfbf50436bb6ab. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:25:52.473349 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-00f13224-86f5-4f94-b619-0cd0ac75e29c tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:25:52.475879 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-00f13224-86f5-4f94-b619-0cd0ac75e29c tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] [instance: 82d76221-bbcd-4dc7-a09b-e3b45088b4d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:25:52.636380 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-00f13224-86f5-4f94-b619-0cd0ac75e29c tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.175466 Jun 20 12:25:52.642094 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2718/5343] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:25:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1186 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 12:25:52.650716 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1c5ace0e-f3c4-405f-998b-ba5bf9866b4c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:52.652899 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1c5ace0e-f3c4-405f-998b-ba5bf9866b4c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 7ac4715b-0c6b-4e90-b6e3-63a115494aec] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:52.674606 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c5ace0e-f3c4-405f-998b-ba5bf9866b4c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:52.676921 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c5ace0e-f3c4-405f-998b-ba5bf9866b4c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:52.679254 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c5ace0e-f3c4-405f-998b-ba5bf9866b4c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:52.681413 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c5ace0e-f3c4-405f-998b-ba5bf9866b4c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:52.859639 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-dc4a7fb8-4822-49b9-8112-7268c4c9171f tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:52.872971 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dc4a7fb8-4822-49b9-8112-7268c4c9171f tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/fab0e84e-17c7-4aa9-bc0a-37d236495cfc" status: 200 len: 1550 microversion: 2.1 time: 0.697191 Jun 20 12:25:52.887029 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2626/5344] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:52 2022] GET /compute/v2.1/servers/fab0e84e-17c7-4aa9-bc0a-37d236495cfc => generated 1550 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:52.905969 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ff604348-d264-46a6-b0b1-86044fc7dcc0 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:52.908802 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ff604348-d264-46a6-b0b1-86044fc7dcc0 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] [instance: 82d76221-bbcd-4dc7-a09b-e3b45088b4d0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:53.054809 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1c5ace0e-f3c4-405f-998b-ba5bf9866b4c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:53.063609 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1c5ace0e-f3c4-405f-998b-ba5bf9866b4c tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec" status: 200 len: 1690 microversion: 2.1 time: 0.420061 Jun 20 12:25:53.077802 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2719/5345] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:52 2022] GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec => generated 1690 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:53.088373 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-91c3ad56-20fe-4ee4-8318-6f4dae1eeef4 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:53.091811 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-91c3ad56-20fe-4ee4-8318-6f4dae1eeef4 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:53.101077 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91c3ad56-20fe-4ee4-8318-6f4dae1eeef4 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:53.101615 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91c3ad56-20fe-4ee4-8318-6f4dae1eeef4 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:53.102486 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91c3ad56-20fe-4ee4-8318-6f4dae1eeef4 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:53.103082 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91c3ad56-20fe-4ee4-8318-6f4dae1eeef4 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:53.150545 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ff604348-d264-46a6-b0b1-86044fc7dcc0 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee3168402f24c0481fbe0275cebbdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeedf38e938b4fd39ccfbf50436bb6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:53.166690 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ff604348-d264-46a6-b0b1-86044fc7dcc0 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] 10.222.0.27 "GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0" status: 200 len: 1213 microversion: 2.1 time: 0.271096 Jun 20 12:25:53.167513 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2627/5346] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:52 2022] GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0 => generated 1213 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:53.182778 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-16edcf9a-dc4d-4ff2-9759-bf6ad9646395 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:53.187137 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-16edcf9a-dc4d-4ff2-9759-bf6ad9646395 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:53.208444 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-16edcf9a-dc4d-4ff2-9759-bf6ad9646395 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:53.209718 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-16edcf9a-dc4d-4ff2-9759-bf6ad9646395 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:53.212952 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-16edcf9a-dc4d-4ff2-9759-bf6ad9646395 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:53.215318 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-16edcf9a-dc4d-4ff2-9759-bf6ad9646395 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:53.698097 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-91c3ad56-20fe-4ee4-8318-6f4dae1eeef4 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:53.724015 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-91c3ad56-20fe-4ee4-8318-6f4dae1eeef4 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c" status: 200 len: 1505 microversion: 2.1 time: 0.645187 Jun 20 12:25:53.730794 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2720/5347] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:53 2022] GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c => generated 1505 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:53.742773 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-16edcf9a-dc4d-4ff2-9759-bf6ad9646395 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:53.753399 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-16edcf9a-dc4d-4ff2-9759-bf6ad9646395 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1509 microversion: 2.1 time: 0.582870 Jun 20 12:25:53.759029 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2628/5348] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:53 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1509 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:53.892711 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f9d1e257-97d4-4bd1-90bc-b195f868fb9d tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:53.893349 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f9d1e257-97d4-4bd1-90bc-b195f868fb9d tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: fab0e84e-17c7-4aa9-bc0a-37d236495cfc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:53.903528 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9d1e257-97d4-4bd1-90bc-b195f868fb9d tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:53.904331 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9d1e257-97d4-4bd1-90bc-b195f868fb9d tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:53.905153 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9d1e257-97d4-4bd1-90bc-b195f868fb9d tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:53.905599 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9d1e257-97d4-4bd1-90bc-b195f868fb9d tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:54.082375 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d763e5ea-8dca-4d56-9167-907e1e96fcb5 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:54.082992 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d763e5ea-8dca-4d56-9167-907e1e96fcb5 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 7ac4715b-0c6b-4e90-b6e3-63a115494aec] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:54.118979 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d763e5ea-8dca-4d56-9167-907e1e96fcb5 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:54.128299 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f9d1e257-97d4-4bd1-90bc-b195f868fb9d tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:54.132672 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d763e5ea-8dca-4d56-9167-907e1e96fcb5 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:54.137640 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d763e5ea-8dca-4d56-9167-907e1e96fcb5 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:54.146352 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f9d1e257-97d4-4bd1-90bc-b195f868fb9d tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/fab0e84e-17c7-4aa9-bc0a-37d236495cfc" status: 200 len: 1483 microversion: 2.1 time: 0.258198 Jun 20 12:25:54.147282 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d763e5ea-8dca-4d56-9167-907e1e96fcb5 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:54.150459 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2721/5349] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:53 2022] GET /compute/v2.1/servers/fab0e84e-17c7-4aa9-bc0a-37d236495cfc => generated 1483 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:54.185487 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1f32a1be-7740-4091-b9ef-68c5132ad1fa tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:54.186099 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1f32a1be-7740-4091-b9ef-68c5132ad1fa tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] [instance: 82d76221-bbcd-4dc7-a09b-e3b45088b4d0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:54.208067 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f32a1be-7740-4091-b9ef-68c5132ad1fa tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:54.208913 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f32a1be-7740-4091-b9ef-68c5132ad1fa tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:54.209898 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f32a1be-7740-4091-b9ef-68c5132ad1fa tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:54.211333 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f32a1be-7740-4091-b9ef-68c5132ad1fa tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:54.306745 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1f32a1be-7740-4091-b9ef-68c5132ad1fa tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee3168402f24c0481fbe0275cebbdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeedf38e938b4fd39ccfbf50436bb6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:54.319818 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1f32a1be-7740-4091-b9ef-68c5132ad1fa tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] 10.222.0.27 "GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0" status: 200 len: 1209 microversion: 2.1 time: 0.138627 Jun 20 12:25:54.320946 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2722/5350] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:54 2022] GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0 => generated 1209 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:54.326375 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-d395a28a-0f66-4d8a-8384-9d9a2a5ea51d req-723a7ee0-4b1f-4cc0-8fdc-59291a2be071 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fab0e84e-17c7-4aa9-bc0a-37d236495cfc", "name": "network-vif-deleted", "tag": "51503e90-9ee4-4a07-9795-cdb998232fc1"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:25:54.352670 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-d395a28a-0f66-4d8a-8384-9d9a2a5ea51d req-723a7ee0-4b1f-4cc0-8fdc-59291a2be071 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:54.359925 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-d395a28a-0f66-4d8a-8384-9d9a2a5ea51d req-723a7ee0-4b1f-4cc0-8fdc-59291a2be071 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:54.383040 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-d395a28a-0f66-4d8a-8384-9d9a2a5ea51d req-723a7ee0-4b1f-4cc0-8fdc-59291a2be071 service nova] Creating event network-vif-deleted:51503e90-9ee4-4a07-9795-cdb998232fc1 for instance fab0e84e-17c7-4aa9-bc0a-37d236495cfc on n-h1-master-1 Jun 20 12:25:54.396103 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-d395a28a-0f66-4d8a-8384-9d9a2a5ea51d req-723a7ee0-4b1f-4cc0-8fdc-59291a2be071 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073353 Jun 20 12:25:54.400105 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2723/5351] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:25:54.464750 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d763e5ea-8dca-4d56-9167-907e1e96fcb5 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:54.482503 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d763e5ea-8dca-4d56-9167-907e1e96fcb5 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec" status: 200 len: 1690 microversion: 2.1 time: 0.405640 Jun 20 12:25:54.494465 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2629/5352] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:54 2022] GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec => generated 1690 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:54.750051 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-73e2e971-7a9f-48d2-8e83-3e04a0caea57 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:54.751791 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-73e2e971-7a9f-48d2-8e83-3e04a0caea57 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:54.772923 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-16449212-cfbf-479c-8812-5aab722d4005 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:54.773894 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-16449212-cfbf-479c-8812-5aab722d4005 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:54.777449 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-73e2e971-7a9f-48d2-8e83-3e04a0caea57 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:54.782925 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-73e2e971-7a9f-48d2-8e83-3e04a0caea57 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:54.784378 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-73e2e971-7a9f-48d2-8e83-3e04a0caea57 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:54.786518 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-73e2e971-7a9f-48d2-8e83-3e04a0caea57 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:54.787753 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-16449212-cfbf-479c-8812-5aab722d4005 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:54.790330 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-16449212-cfbf-479c-8812-5aab722d4005 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:54.791172 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-16449212-cfbf-479c-8812-5aab722d4005 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:54.791610 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-16449212-cfbf-479c-8812-5aab722d4005 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:55.206707 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-16449212-cfbf-479c-8812-5aab722d4005 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:55.229765 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-16449212-cfbf-479c-8812-5aab722d4005 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1509 microversion: 2.1 time: 0.460780 Jun 20 12:25:55.235168 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2630/5353] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:54 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1509 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:55.248807 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6de34f12-8c32-4cbf-a20b-8a79fff8fcb3 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:55.249439 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6de34f12-8c32-4cbf-a20b-8a79fff8fcb3 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: fab0e84e-17c7-4aa9-bc0a-37d236495cfc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:55.264550 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6de34f12-8c32-4cbf-a20b-8a79fff8fcb3 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:55.265005 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6de34f12-8c32-4cbf-a20b-8a79fff8fcb3 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:55.267909 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6de34f12-8c32-4cbf-a20b-8a79fff8fcb3 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:55.271882 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6de34f12-8c32-4cbf-a20b-8a79fff8fcb3 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:55.325782 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-6de34f12-8c32-4cbf-a20b-8a79fff8fcb3 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] HTTP exception thrown: Instance fab0e84e-17c7-4aa9-bc0a-37d236495cfc could not be found. Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6de34f12-8c32-4cbf-a20b-8a79fff8fcb3 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Request method failure captured: Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/fab0e84e-17c7-4aa9-bc0a-37d236495cfc HTTP/1.1 Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGa72kVR_SSPWnUGZRxw-G3J4-hwvpug1luVy5r8Ca_eaA02-YD93q1FWHSKS9Tn7i_0JfINvN3iapLSrtvCneB1tQluVFyYyF3eAJhnlxA-bJnSoX10K-r8AAG7MPcURr7bqFwSNhyccR_Qcws2qeyXimx-pEWrLTSIlVSLW3XcvUM Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 1ed88b4072a24b37a5ceec3b239ac8fa Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-TestNetworkBasicOps-648379632 Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1ed88b4072a24b37a5ceec3b239ac8fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1ed88b4072a24b37a5ceec3b239ac8fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1ed88b4072a24b37a5ceec3b239ac8fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1ed88b4072a24b37a5ceec3b239ac8fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-TestNetworkBasicOps-648379632 Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 1ed88b4072a24b37a5ceec3b239ac8fa Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-TestNetworkBasicOps-648379632 Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-TestNetworkBasicOps-648379632-project Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: aeafcd88ca6c415e90b51c262b62597f Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-TestNetworkBasicOps-648379632-project Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: exception: Instance fab0e84e-17c7-4aa9-bc0a-37d236495cfc could not be found. Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'fab0e84e-17c7-4aa9-bc0a-37d236495cfc'} Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fab0e84e-17c7-4aa9-bc0a-37d236495cfc could not be found. Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fab0e84e-17c7-4aa9-bc0a-37d236495cfc could not be found. Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:25:55.327843 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:25:55.333994 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:25:55.333994 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:25:55.333994 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:25:55.333994 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:25:55.333994 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:25:55.333994 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fab0e84e-17c7-4aa9-bc0a-37d236495cfc could not be found. Jun 20 12:25:55.333994 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:25:55.335646 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6de34f12-8c32-4cbf-a20b-8a79fff8fcb3 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Returning 404 to user: Instance fab0e84e-17c7-4aa9-bc0a-37d236495cfc could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:25:55.337650 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6de34f12-8c32-4cbf-a20b-8a79fff8fcb3 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/fab0e84e-17c7-4aa9-bc0a-37d236495cfc" status: 404 len: 111 microversion: 2.1 time: 0.100500 Jun 20 12:25:55.354169 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2631/5354] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:55 2022] GET /compute/v2.1/servers/fab0e84e-17c7-4aa9-bc0a-37d236495cfc => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:25:55.359620 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-73e2e971-7a9f-48d2-8e83-3e04a0caea57 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:55.365096 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2ce109a6-4209-47f3-af28-43ad36e7484f tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:55.365715 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2ce109a6-4209-47f3-af28-43ad36e7484f tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] [instance: 82d76221-bbcd-4dc7-a09b-e3b45088b4d0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:55.371800 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-73e2e971-7a9f-48d2-8e83-3e04a0caea57 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c" status: 200 len: 1505 microversion: 2.1 time: 0.632310 Jun 20 12:25:55.375076 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2724/5355] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:54 2022] GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c => generated 1505 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:55.395339 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2ce109a6-4209-47f3-af28-43ad36e7484f tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:55.395790 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2ce109a6-4209-47f3-af28-43ad36e7484f tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:55.396611 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2ce109a6-4209-47f3-af28-43ad36e7484f tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:55.397047 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2ce109a6-4209-47f3-af28-43ad36e7484f tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:55.504476 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-31cf0e75-78df-4949-b644-3d656fd73ed2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:55.505475 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-31cf0e75-78df-4949-b644-3d656fd73ed2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 7ac4715b-0c6b-4e90-b6e3-63a115494aec] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:55.515981 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-31cf0e75-78df-4949-b644-3d656fd73ed2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:55.516566 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-31cf0e75-78df-4949-b644-3d656fd73ed2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:55.517397 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-31cf0e75-78df-4949-b644-3d656fd73ed2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:55.518097 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-31cf0e75-78df-4949-b644-3d656fd73ed2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:55.529750 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2ce109a6-4209-47f3-af28-43ad36e7484f tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee3168402f24c0481fbe0275cebbdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeedf38e938b4fd39ccfbf50436bb6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:55.538392 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2ce109a6-4209-47f3-af28-43ad36e7484f tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] 10.222.0.27 "GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0" status: 200 len: 1271 microversion: 2.1 time: 0.182615 Jun 20 12:25:55.565110 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2632/5356] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:55 2022] GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0 => generated 1271 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:55.732041 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6119379e-b72a-4965-af10-4d6b497b5711 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '.version_select at 0x7f6072578ca0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:55.800620 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6119379e-b72a-4965-af10-4d6b497b5711 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-8315719" status: 202 len: 0 microversion: 2.1 time: 0.071801 Jun 20 12:25:55.809692 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2633/5357] 10.222.0.27 () {58 vars in 1247 bytes} [Mon Jun 20 12:25:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-8315719 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:25:55.912146 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-31cf0e75-78df-4949-b644-3d656fd73ed2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:55.929441 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-31cf0e75-78df-4949-b644-3d656fd73ed2 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec" status: 200 len: 1690 microversion: 2.1 time: 0.430824 Jun 20 12:25:55.953537 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2725/5358] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:55 2022] GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec => generated 1690 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:56.252918 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-06e31cfe-bc81-4d2c-a23d-e3f4393c6a69 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:56.256089 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-06e31cfe-bc81-4d2c-a23d-e3f4393c6a69 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:56.268639 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-06e31cfe-bc81-4d2c-a23d-e3f4393c6a69 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:56.269103 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-06e31cfe-bc81-4d2c-a23d-e3f4393c6a69 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:56.269914 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-06e31cfe-bc81-4d2c-a23d-e3f4393c6a69 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:56.270363 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-06e31cfe-bc81-4d2c-a23d-e3f4393c6a69 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:56.391732 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3b50a416-2fec-42c8-99ba-139561c863b0 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:56.392684 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3b50a416-2fec-42c8-99ba-139561c863b0 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:56.406314 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3b50a416-2fec-42c8-99ba-139561c863b0 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:56.409562 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3b50a416-2fec-42c8-99ba-139561c863b0 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:56.410667 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3b50a416-2fec-42c8-99ba-139561c863b0 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:56.411307 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3b50a416-2fec-42c8-99ba-139561c863b0 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:56.711548 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3b50a416-2fec-42c8-99ba-139561c863b0 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:56.728107 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3b50a416-2fec-42c8-99ba-139561c863b0 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c" status: 200 len: 1505 microversion: 2.1 time: 0.340961 Jun 20 12:25:56.729049 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2726/5359] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:56 2022] GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c => generated 1505 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:56.735258 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9352a8e1-eecf-4fb1-9115-f27fc43a20d3 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:56.749882 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9352a8e1-eecf-4fb1-9115-f27fc43a20d3 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] [instance: 82d76221-bbcd-4dc7-a09b-e3b45088b4d0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:56.752909 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-06e31cfe-bc81-4d2c-a23d-e3f4393c6a69 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:56.763643 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-06e31cfe-bc81-4d2c-a23d-e3f4393c6a69 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1509 microversion: 2.1 time: 0.514935 Jun 20 12:25:56.766583 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9352a8e1-eecf-4fb1-9115-f27fc43a20d3 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:56.767169 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9352a8e1-eecf-4fb1-9115-f27fc43a20d3 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:56.767786 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2634/5360] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:56 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1509 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:56.768727 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9352a8e1-eecf-4fb1-9115-f27fc43a20d3 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:56.768826 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9352a8e1-eecf-4fb1-9115-f27fc43a20d3 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:56.928287 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9352a8e1-eecf-4fb1-9115-f27fc43a20d3 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee3168402f24c0481fbe0275cebbdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeedf38e938b4fd39ccfbf50436bb6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:56.962762 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9352a8e1-eecf-4fb1-9115-f27fc43a20d3 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] 10.222.0.27 "GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0" status: 200 len: 1271 microversion: 2.1 time: 0.231250 Jun 20 12:25:56.972719 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-47b42bef-9634-4818-93fd-495cf708904e tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:56.973952 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-47b42bef-9634-4818-93fd-495cf708904e tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 7ac4715b-0c6b-4e90-b6e3-63a115494aec] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:56.981962 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2727/5361] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:56 2022] GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0 => generated 1271 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:56.989660 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-47b42bef-9634-4818-93fd-495cf708904e tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:56.990139 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-47b42bef-9634-4818-93fd-495cf708904e tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:56.990955 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-47b42bef-9634-4818-93fd-495cf708904e tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:56.991399 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-47b42bef-9634-4818-93fd-495cf708904e tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:57.316461 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-47b42bef-9634-4818-93fd-495cf708904e tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:57.333894 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-47b42bef-9634-4818-93fd-495cf708904e tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec" status: 200 len: 1690 microversion: 2.1 time: 0.367336 Jun 20 12:25:57.337285 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2635/5362] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:56 2022] GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec => generated 1690 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:57.748895 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-98e5e41e-b127-40d4-8b24-5c5032ac11bc tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:57.760363 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-98e5e41e-b127-40d4-8b24-5c5032ac11bc tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:57.768879 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-98e5e41e-b127-40d4-8b24-5c5032ac11bc tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:57.778053 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-98e5e41e-b127-40d4-8b24-5c5032ac11bc tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:57.778854 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-98e5e41e-b127-40d4-8b24-5c5032ac11bc tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:57.779315 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-98e5e41e-b127-40d4-8b24-5c5032ac11bc tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:57.784006 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-345bc630-9a7a-4d6f-aec2-65086b073cf3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:57.784732 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-345bc630-9a7a-4d6f-aec2-65086b073cf3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:57.800271 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-345bc630-9a7a-4d6f-aec2-65086b073cf3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:57.807759 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-345bc630-9a7a-4d6f-aec2-65086b073cf3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:57.808750 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-345bc630-9a7a-4d6f-aec2-65086b073cf3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:57.809266 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-345bc630-9a7a-4d6f-aec2-65086b073cf3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:58.106399 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-345bc630-9a7a-4d6f-aec2-65086b073cf3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:58.121237 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-345bc630-9a7a-4d6f-aec2-65086b073cf3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1509 microversion: 2.1 time: 0.341355 Jun 20 12:25:58.122801 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2636/5363] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:57 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1509 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:58.129223 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-458bf736-a7fa-4368-abb4-6e2479b28c47 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:58.133061 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-458bf736-a7fa-4368-abb4-6e2479b28c47 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] [instance: 82d76221-bbcd-4dc7-a09b-e3b45088b4d0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:58.137762 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-98e5e41e-b127-40d4-8b24-5c5032ac11bc tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:58.156645 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-458bf736-a7fa-4368-abb4-6e2479b28c47 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:58.157535 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-458bf736-a7fa-4368-abb4-6e2479b28c47 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:58.158580 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-458bf736-a7fa-4368-abb4-6e2479b28c47 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:58.159229 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-458bf736-a7fa-4368-abb4-6e2479b28c47 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:58.160319 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-98e5e41e-b127-40d4-8b24-5c5032ac11bc tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c" status: 200 len: 1505 microversion: 2.1 time: 0.415652 Jun 20 12:25:58.163253 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2728/5364] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:57 2022] GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c => generated 1505 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:58.367193 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ecc5ec23-8f79-4789-a52f-e5cadbfd0dd4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:58.368519 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ecc5ec23-8f79-4789-a52f-e5cadbfd0dd4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 7ac4715b-0c6b-4e90-b6e3-63a115494aec] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:58.401001 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ecc5ec23-8f79-4789-a52f-e5cadbfd0dd4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:58.401459 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ecc5ec23-8f79-4789-a52f-e5cadbfd0dd4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:58.402257 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ecc5ec23-8f79-4789-a52f-e5cadbfd0dd4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:58.402696 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ecc5ec23-8f79-4789-a52f-e5cadbfd0dd4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:58.570934 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-458bf736-a7fa-4368-abb4-6e2479b28c47 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee3168402f24c0481fbe0275cebbdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeedf38e938b4fd39ccfbf50436bb6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:58.593988 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-458bf736-a7fa-4368-abb4-6e2479b28c47 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] 10.222.0.27 "GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0" status: 200 len: 1313 microversion: 2.1 time: 0.469394 Jun 20 12:25:58.595040 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2637/5365] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:58 2022] GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0 => generated 1313 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:59.142299 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-712878f3-2728-498c-ba4c-40f6c0ec266d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:59.143034 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-712878f3-2728-498c-ba4c-40f6c0ec266d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:59.156674 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:59.158796 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-712878f3-2728-498c-ba4c-40f6c0ec266d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:59.159504 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-712878f3-2728-498c-ba4c-40f6c0ec266d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:59.160622 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-712878f3-2728-498c-ba4c-40f6c0ec266d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:59.162537 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-712878f3-2728-498c-ba4c-40f6c0ec266d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:59.271255 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ecc5ec23-8f79-4789-a52f-e5cadbfd0dd4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:59.279716 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ecc5ec23-8f79-4789-a52f-e5cadbfd0dd4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec" status: 200 len: 1690 microversion: 2.1 time: 0.918014 Jun 20 12:25:59.293384 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2729/5366] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:58 2022] GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec => generated 1690 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:59.299137 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e8a5abeb-3a36-42c9-8d4e-99b2099f6713 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:59.300074 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e8a5abeb-3a36-42c9-8d4e-99b2099f6713 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:59.313424 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e8a5abeb-3a36-42c9-8d4e-99b2099f6713 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:59.315215 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e8a5abeb-3a36-42c9-8d4e-99b2099f6713 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:59.317512 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e8a5abeb-3a36-42c9-8d4e-99b2099f6713 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:59.319057 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e8a5abeb-3a36-42c9-8d4e-99b2099f6713 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:00.056309 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e8a5abeb-3a36-42c9-8d4e-99b2099f6713 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:00.069354 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:00.082515 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e8a5abeb-3a36-42c9-8d4e-99b2099f6713 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c" status: 200 len: 1505 microversion: 2.1 time: 0.787245 Jun 20 12:26:00.086387 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2730/5367] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:59 2022] GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c => generated 1505 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:00.159237 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-af703be8-b2f0-4127-b06b-c6961ef7875e tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:00.174674 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-af703be8-b2f0-4127-b06b-c6961ef7875e tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] [instance: 82d76221-bbcd-4dc7-a09b-e3b45088b4d0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:00.202141 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-712878f3-2728-498c-ba4c-40f6c0ec266d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:00.204908 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-af703be8-b2f0-4127-b06b-c6961ef7875e tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:00.205620 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-af703be8-b2f0-4127-b06b-c6961ef7875e tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:00.209487 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-af703be8-b2f0-4127-b06b-c6961ef7875e tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:00.210173 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-af703be8-b2f0-4127-b06b-c6961ef7875e tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:00.211059 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-712878f3-2728-498c-ba4c-40f6c0ec266d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1509 microversion: 2.1 time: 1.073041 Jun 20 12:26:00.224798 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2638/5368] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:59 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1509 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:26:00.311013 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-24dc4fbe-f1db-4ad5-b6b0-64449a253f5b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:00.312230 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-24dc4fbe-f1db-4ad5-b6b0-64449a253f5b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 7ac4715b-0c6b-4e90-b6e3-63a115494aec] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:00.328372 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-24dc4fbe-f1db-4ad5-b6b0-64449a253f5b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:00.329633 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-24dc4fbe-f1db-4ad5-b6b0-64449a253f5b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:00.334778 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-24dc4fbe-f1db-4ad5-b6b0-64449a253f5b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:00.335522 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-24dc4fbe-f1db-4ad5-b6b0-64449a253f5b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:00.698677 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-af703be8-b2f0-4127-b06b-c6961ef7875e tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee3168402f24c0481fbe0275cebbdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeedf38e938b4fd39ccfbf50436bb6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:00.719989 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-af703be8-b2f0-4127-b06b-c6961ef7875e tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] 10.222.0.27 "GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0" status: 200 len: 1313 microversion: 2.1 time: 0.588311 Jun 20 12:26:00.722727 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2731/5369] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:00 2022] GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0 => generated 1313 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:00.834384 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0bd2e555-f818-4690-9721-e7244729235e tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:00.835680 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0bd2e555-f818-4690-9721-e7244729235e tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 5b047d91-122c-44ee-b96e-1e0836960caa] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:00.849921 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0bd2e555-f818-4690-9721-e7244729235e tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:00.851604 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0bd2e555-f818-4690-9721-e7244729235e tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:00.853565 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0bd2e555-f818-4690-9721-e7244729235e tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:00.854845 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0bd2e555-f818-4690-9721-e7244729235e tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:00.907980 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-24dc4fbe-f1db-4ad5-b6b0-64449a253f5b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:00.927473 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-24dc4fbe-f1db-4ad5-b6b0-64449a253f5b tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec" status: 200 len: 1690 microversion: 2.1 time: 0.617812 Jun 20 12:26:00.930601 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2639/5370] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:00 2022] GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec => generated 1690 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:26:00.943699 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0bd2e555-f818-4690-9721-e7244729235e tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.109990 Jun 20 12:26:00.949455 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2732/5371] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:26:00 2022] GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa/os-volume_attachments => generated 371 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:26:00.958157 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-2f6f2d6c-7802-48e0-af74-d6f0180cad29 req-06866d24-c20a-4d49-8c22-f13f66c00b13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82d76221-bbcd-4dc7-a09b-e3b45088b4d0", "tag": "bfaf47ed-1d6d-4b0c-b280-52909fc62108"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:01.004907 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-2f6f2d6c-7802-48e0-af74-d6f0180cad29 req-06866d24-c20a-4d49-8c22-f13f66c00b13 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:01.008242 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-2f6f2d6c-7802-48e0-af74-d6f0180cad29 req-06866d24-c20a-4d49-8c22-f13f66c00b13 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:01.062522 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-2f6f2d6c-7802-48e0-af74-d6f0180cad29 req-06866d24-c20a-4d49-8c22-f13f66c00b13 service nova] Creating event network-changed:bfaf47ed-1d6d-4b0c-b280-52909fc62108 for instance 82d76221-bbcd-4dc7-a09b-e3b45088b4d0 on n-h2-master-1 Jun 20 12:26:01.088062 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-2f6f2d6c-7802-48e0-af74-d6f0180cad29 req-06866d24-c20a-4d49-8c22-f13f66c00b13 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145761 Jun 20 12:26:01.090640 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-61466d58-88d4-4020-a44d-bf3c1ca8bfbb tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:01.091153 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-61466d58-88d4-4020-a44d-bf3c1ca8bfbb tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 5b047d91-122c-44ee-b96e-1e0836960caa] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:01.094611 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2640/5372] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:26:01.101082 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-61466d58-88d4-4020-a44d-bf3c1ca8bfbb tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:01.101798 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-61466d58-88d4-4020-a44d-bf3c1ca8bfbb tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:01.103042 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-61466d58-88d4-4020-a44d-bf3c1ca8bfbb tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:01.103689 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-61466d58-88d4-4020-a44d-bf3c1ca8bfbb tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:01.123673 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e8a0345a-b7f5-4029-9ffb-eb298a121d04 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:01.124719 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e8a0345a-b7f5-4029-9ffb-eb298a121d04 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:01.150839 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e8a0345a-b7f5-4029-9ffb-eb298a121d04 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:01.151228 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e8a0345a-b7f5-4029-9ffb-eb298a121d04 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:01.152032 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e8a0345a-b7f5-4029-9ffb-eb298a121d04 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:01.152791 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e8a0345a-b7f5-4029-9ffb-eb298a121d04 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:01.271241 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-61466d58-88d4-4020-a44d-bf3c1ca8bfbb tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa/os-volume_attachments/66002d18-c9da-4f2a-aea8-6821c9286b66" status: 200 len: 194 microversion: 2.1 time: 0.184837 Jun 20 12:26:01.277777 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2733/5373] 10.222.0.27 () {58 vars in 1412 bytes} [Mon Jun 20 12:26:01 2022] GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa/os-volume_attachments/66002d18-c9da-4f2a-aea8-6821c9286b66 => generated 194 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:26:01.283218 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-66facbac-a6d4-445a-b3d1-7173edc20b3f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:01.285403 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-66facbac-a6d4-445a-b3d1-7173edc20b3f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:01.304986 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66facbac-a6d4-445a-b3d1-7173edc20b3f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:01.307691 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66facbac-a6d4-445a-b3d1-7173edc20b3f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:01.309064 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66facbac-a6d4-445a-b3d1-7173edc20b3f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:01.314229 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66facbac-a6d4-445a-b3d1-7173edc20b3f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:01.995966 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e8a0345a-b7f5-4029-9ffb-eb298a121d04 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:02.015483 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:02.020296 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e8a0345a-b7f5-4029-9ffb-eb298a121d04 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c" status: 200 len: 1505 microversion: 2.1 time: 0.915694 Jun 20 12:26:02.021487 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2641/5374] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:01 2022] GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c => generated 1505 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:02.027371 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a499ec4d-e8e0-4f7a-9cc7-7629a800fecc tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:02.028128 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a499ec4d-e8e0-4f7a-9cc7-7629a800fecc tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 5b047d91-122c-44ee-b96e-1e0836960caa] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:02.036531 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a499ec4d-e8e0-4f7a-9cc7-7629a800fecc tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:02.037359 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a499ec4d-e8e0-4f7a-9cc7-7629a800fecc tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:02.038369 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a499ec4d-e8e0-4f7a-9cc7-7629a800fecc tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:02.039017 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a499ec4d-e8e0-4f7a-9cc7-7629a800fecc tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:02.228314 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-a499ec4d-e8e0-4f7a-9cc7-7629a800fecc tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lazy-loading 'services' on Instance uuid 5b047d91-122c-44ee-b96e-1e0836960caa {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:26:02.379028 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-66facbac-a6d4-445a-b3d1-7173edc20b3f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:02.422778 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-66facbac-a6d4-445a-b3d1-7173edc20b3f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1509 microversion: 2.1 time: 1.116797 Jun 20 12:26:02.425206 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2734/5375] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:01 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1509 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:02.452524 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a499ec4d-e8e0-4f7a-9cc7-7629a800fecc tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa/os-volume_attachments/66002d18-c9da-4f2a-aea8-6821c9286b66" status: 202 len: 0 microversion: 2.1 time: 0.428746 Jun 20 12:26:02.453476 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2642/5376] 10.222.0.27 () {58 vars in 1415 bytes} [Mon Jun 20 12:26:02 2022] DELETE /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa/os-volume_attachments/66002d18-c9da-4f2a-aea8-6821c9286b66 => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:26:02.485161 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b5cb1679-beef-484a-ae4f-2f100cd24f5e tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:02.488293 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b5cb1679-beef-484a-ae4f-2f100cd24f5e tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] [instance: 82d76221-bbcd-4dc7-a09b-e3b45088b4d0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:02.502589 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-91d3934e-5f23-40da-8365-9a153528d79f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:02.504019 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-91d3934e-5f23-40da-8365-9a153528d79f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 7ac4715b-0c6b-4e90-b6e3-63a115494aec] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:02.515712 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:02.518823 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:02.525838 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5cb1679-beef-484a-ae4f-2f100cd24f5e tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:02.527022 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5cb1679-beef-484a-ae4f-2f100cd24f5e tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:02.529435 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5cb1679-beef-484a-ae4f-2f100cd24f5e tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:02.530042 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5cb1679-beef-484a-ae4f-2f100cd24f5e tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:02.534729 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-91d3934e-5f23-40da-8365-9a153528d79f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:02.535201 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-91d3934e-5f23-40da-8365-9a153528d79f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:02.544933 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-91d3934e-5f23-40da-8365-9a153528d79f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:02.545537 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-91d3934e-5f23-40da-8365-9a153528d79f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:02.902112 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b5cb1679-beef-484a-ae4f-2f100cd24f5e tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee3168402f24c0481fbe0275cebbdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeedf38e938b4fd39ccfbf50436bb6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:02.916374 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b5cb1679-beef-484a-ae4f-2f100cd24f5e tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] 10.222.0.27 "GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0" status: 200 len: 1313 microversion: 2.1 time: 0.489300 Jun 20 12:26:02.917450 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2735/5377] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:02 2022] GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0 => generated 1313 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:03.040930 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1c1cc06b-9bd5-4d81-89e3-fee29057bbae tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:03.041723 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1c1cc06b-9bd5-4d81-89e3-fee29057bbae tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:03.058072 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c1cc06b-9bd5-4d81-89e3-fee29057bbae tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:03.058072 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c1cc06b-9bd5-4d81-89e3-fee29057bbae tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:03.059744 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c1cc06b-9bd5-4d81-89e3-fee29057bbae tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:03.059744 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c1cc06b-9bd5-4d81-89e3-fee29057bbae tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:03.155697 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:03.486365 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1c1cc06b-9bd5-4d81-89e3-fee29057bbae tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:03.496911 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1c1cc06b-9bd5-4d81-89e3-fee29057bbae tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c" status: 200 len: 1505 microversion: 2.1 time: 0.460094 Jun 20 12:26:03.498207 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2736/5378] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:03 2022] GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c => generated 1505 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:03.505550 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e3694e67-a3bb-4b59-b8aa-d82eda8c5b7a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:03.512098 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e3694e67-a3bb-4b59-b8aa-d82eda8c5b7a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:03.527546 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e3694e67-a3bb-4b59-b8aa-d82eda8c5b7a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:03.528557 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e3694e67-a3bb-4b59-b8aa-d82eda8c5b7a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:03.529495 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e3694e67-a3bb-4b59-b8aa-d82eda8c5b7a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:03.533442 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e3694e67-a3bb-4b59-b8aa-d82eda8c5b7a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:03.823846 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-91d3934e-5f23-40da-8365-9a153528d79f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:03.853661 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-91d3934e-5f23-40da-8365-9a153528d79f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec" status: 200 len: 1696 microversion: 2.1 time: 1.382821 Jun 20 12:26:03.862474 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2643/5379] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:02 2022] GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec => generated 1696 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:03.885472 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b945ae3d-af82-4870-a0ba-c90bf5fd921e tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:03.886359 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b945ae3d-af82-4870-a0ba-c90bf5fd921e tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: bf0e099f-bcdd-4b6e-b18c-c6117afacfe6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:03.905190 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b945ae3d-af82-4870-a0ba-c90bf5fd921e tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:03.905654 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b945ae3d-af82-4870-a0ba-c90bf5fd921e tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:03.906612 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b945ae3d-af82-4870-a0ba-c90bf5fd921e tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:03.907075 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b945ae3d-af82-4870-a0ba-c90bf5fd921e tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:03.976116 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b945ae3d-af82-4870-a0ba-c90bf5fd921e tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: bf0e099f-bcdd-4b6e-b18c-c6117afacfe6] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:26:04.071762 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e3694e67-a3bb-4b59-b8aa-d82eda8c5b7a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:04.102107 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e3694e67-a3bb-4b59-b8aa-d82eda8c5b7a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1509 microversion: 2.1 time: 0.598070 Jun 20 12:26:04.105272 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2737/5380] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:03 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1509 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:04.146483 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-43c46342-f6e8-4bc8-9552-9354ef5fadea req-257a4187-3caf-4200-8d9c-a44769d44835 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf0e099f-bcdd-4b6e-b18c-c6117afacfe6", "tag": "d37a67de-6448-4845-9136-14ad539179f4"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:04.192271 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-43c46342-f6e8-4bc8-9552-9354ef5fadea req-257a4187-3caf-4200-8d9c-a44769d44835 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:04.192755 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-43c46342-f6e8-4bc8-9552-9354ef5fadea req-257a4187-3caf-4200-8d9c-a44769d44835 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:04.230974 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-43c46342-f6e8-4bc8-9552-9354ef5fadea req-257a4187-3caf-4200-8d9c-a44769d44835 service nova] Creating event network-changed:d37a67de-6448-4845-9136-14ad539179f4 for instance bf0e099f-bcdd-4b6e-b18c-c6117afacfe6 on n-h1-master-1 Jun 20 12:26:04.248889 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-43c46342-f6e8-4bc8-9552-9354ef5fadea req-257a4187-3caf-4200-8d9c-a44769d44835 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136021 Jun 20 12:26:04.249464 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2738/5381] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:26:04.271439 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-454e7587-6f0b-4008-8cfa-bdee4e8d5cf4 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:04.275019 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-454e7587-6f0b-4008-8cfa-bdee4e8d5cf4 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] [instance: 82d76221-bbcd-4dc7-a09b-e3b45088b4d0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:04.288305 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-454e7587-6f0b-4008-8cfa-bdee4e8d5cf4 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:04.290898 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-454e7587-6f0b-4008-8cfa-bdee4e8d5cf4 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:04.293242 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-454e7587-6f0b-4008-8cfa-bdee4e8d5cf4 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:04.299157 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-454e7587-6f0b-4008-8cfa-bdee4e8d5cf4 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:04.322406 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b945ae3d-af82-4870-a0ba-c90bf5fd921e tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bf0e099f-bcdd-4b6e-b18c-c6117afacfe6" status: 204 len: 0 microversion: 2.1 time: 0.440206 Jun 20 12:26:04.331003 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2644/5382] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:26:03 2022] DELETE /compute/v2.1/servers/bf0e099f-bcdd-4b6e-b18c-c6117afacfe6 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:26:04.349919 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-efcf35da-53bd-4938-8848-be071047f73b tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:04.355486 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-efcf35da-53bd-4938-8848-be071047f73b tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: bf0e099f-bcdd-4b6e-b18c-c6117afacfe6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:04.383676 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-efcf35da-53bd-4938-8848-be071047f73b tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:04.384455 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-efcf35da-53bd-4938-8848-be071047f73b tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:04.386941 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-efcf35da-53bd-4938-8848-be071047f73b tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:04.387477 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-efcf35da-53bd-4938-8848-be071047f73b tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:04.586709 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-454e7587-6f0b-4008-8cfa-bdee4e8d5cf4 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee3168402f24c0481fbe0275cebbdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeedf38e938b4fd39ccfbf50436bb6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:04.600530 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-454e7587-6f0b-4008-8cfa-bdee4e8d5cf4 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] 10.222.0.27 "GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0" status: 200 len: 1313 microversion: 2.1 time: 0.346995 Jun 20 12:26:04.601722 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2739/5383] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:04 2022] GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0 => generated 1313 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:04.610925 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-aa54a7d7-9cca-4e78-afd4-28e5137d369a tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:04.611835 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-aa54a7d7-9cca-4e78-afd4-28e5137d369a tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:04.621655 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa54a7d7-9cca-4e78-afd4-28e5137d369a tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:04.622393 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa54a7d7-9cca-4e78-afd4-28e5137d369a tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:04.623385 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa54a7d7-9cca-4e78-afd4-28e5137d369a tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:04.624161 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa54a7d7-9cca-4e78-afd4-28e5137d369a tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:05.202609 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-aa54a7d7-9cca-4e78-afd4-28e5137d369a tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:05.213359 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-aa54a7d7-9cca-4e78-afd4-28e5137d369a tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c" status: 200 len: 1505 microversion: 2.1 time: 0.610343 Jun 20 12:26:05.218600 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2740/5384] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:04 2022] GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c => generated 1505 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:05.226701 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4ab50f46-b05a-491a-a1fb-69c6cb35cf71 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:05.229555 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4ab50f46-b05a-491a-a1fb-69c6cb35cf71 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 7ac4715b-0c6b-4e90-b6e3-63a115494aec] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:05.244583 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4ab50f46-b05a-491a-a1fb-69c6cb35cf71 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:05.244583 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4ab50f46-b05a-491a-a1fb-69c6cb35cf71 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:05.246356 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4ab50f46-b05a-491a-a1fb-69c6cb35cf71 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:05.246881 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4ab50f46-b05a-491a-a1fb-69c6cb35cf71 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:05.248374 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-efcf35da-53bd-4938-8848-be071047f73b tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:05.261383 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-efcf35da-53bd-4938-8848-be071047f73b tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/bf0e099f-bcdd-4b6e-b18c-c6117afacfe6" status: 200 len: 1671 microversion: 2.1 time: 0.926000 Jun 20 12:26:05.265931 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2645/5385] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:04 2022] GET /compute/v2.1/servers/bf0e099f-bcdd-4b6e-b18c-c6117afacfe6 => generated 1671 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:05.288949 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-16d2393e-1300-49cb-bc70-668f30bebf8d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:05.299386 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-16d2393e-1300-49cb-bc70-668f30bebf8d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:05.325257 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-16d2393e-1300-49cb-bc70-668f30bebf8d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:05.326341 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-16d2393e-1300-49cb-bc70-668f30bebf8d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:05.334082 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-16d2393e-1300-49cb-bc70-668f30bebf8d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:05.338146 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-16d2393e-1300-49cb-bc70-668f30bebf8d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:05.832619 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4ab50f46-b05a-491a-a1fb-69c6cb35cf71 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:05.877906 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4ab50f46-b05a-491a-a1fb-69c6cb35cf71 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec" status: 200 len: 1696 microversion: 2.1 time: 0.658756 Jun 20 12:26:05.911280 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2741/5386] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:05 2022] GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec => generated 1696 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:05.932387 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ee171c3e-dc01-47fb-a3b5-27a50b56c943 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:05.943873 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ee171c3e-dc01-47fb-a3b5-27a50b56c943 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] [instance: 82d76221-bbcd-4dc7-a09b-e3b45088b4d0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:05.976926 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee171c3e-dc01-47fb-a3b5-27a50b56c943 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:05.977799 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee171c3e-dc01-47fb-a3b5-27a50b56c943 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:05.979990 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee171c3e-dc01-47fb-a3b5-27a50b56c943 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:05.982511 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee171c3e-dc01-47fb-a3b5-27a50b56c943 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:05.990091 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-16d2393e-1300-49cb-bc70-668f30bebf8d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:06.051286 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-16d2393e-1300-49cb-bc70-668f30bebf8d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1509 microversion: 2.1 time: 0.783668 Jun 20 12:26:06.053725 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2646/5387] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:05 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1509 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:06.249308 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c67bbac2-d811-4f99-8e56-7e6a9fedd1cd tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:06.254039 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c67bbac2-d811-4f99-8e56-7e6a9fedd1cd tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:06.314451 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c67bbac2-d811-4f99-8e56-7e6a9fedd1cd tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:06.314973 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c67bbac2-d811-4f99-8e56-7e6a9fedd1cd tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:06.318422 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c67bbac2-d811-4f99-8e56-7e6a9fedd1cd tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:06.331527 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c67bbac2-d811-4f99-8e56-7e6a9fedd1cd tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:06.709381 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ee171c3e-dc01-47fb-a3b5-27a50b56c943 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee3168402f24c0481fbe0275cebbdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeedf38e938b4fd39ccfbf50436bb6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:06.717977 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ee171c3e-dc01-47fb-a3b5-27a50b56c943 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] 10.222.0.27 "GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0" status: 200 len: 1313 microversion: 2.1 time: 0.804797 Jun 20 12:26:06.725883 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2742/5388] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:05 2022] GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0 => generated 1313 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:06.746577 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ecdcb779-5c46-4551-86bc-f81105808908 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:06.747547 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ecdcb779-5c46-4551-86bc-f81105808908 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: bf0e099f-bcdd-4b6e-b18c-c6117afacfe6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:06.772586 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ecdcb779-5c46-4551-86bc-f81105808908 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:06.773344 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ecdcb779-5c46-4551-86bc-f81105808908 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:06.774314 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ecdcb779-5c46-4551-86bc-f81105808908 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:06.775927 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ecdcb779-5c46-4551-86bc-f81105808908 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:07.612005 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c67bbac2-d811-4f99-8e56-7e6a9fedd1cd tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:07.625249 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c67bbac2-d811-4f99-8e56-7e6a9fedd1cd tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c" status: 200 len: 1505 microversion: 2.1 time: 1.392349 Jun 20 12:26:07.630923 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2647/5389] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:06 2022] GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c => generated 1505 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:07.654675 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4dad51f1-40e7-4185-88fb-6d76d3bb79ef tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:07.658481 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4dad51f1-40e7-4185-88fb-6d76d3bb79ef tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 7ac4715b-0c6b-4e90-b6e3-63a115494aec] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:07.706721 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4dad51f1-40e7-4185-88fb-6d76d3bb79ef tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:07.710315 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4dad51f1-40e7-4185-88fb-6d76d3bb79ef tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:07.711437 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4dad51f1-40e7-4185-88fb-6d76d3bb79ef tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:07.713248 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4dad51f1-40e7-4185-88fb-6d76d3bb79ef tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:07.804409 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ecdcb779-5c46-4551-86bc-f81105808908 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:07.816429 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ecdcb779-5c46-4551-86bc-f81105808908 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/bf0e099f-bcdd-4b6e-b18c-c6117afacfe6" status: 200 len: 1671 microversion: 2.1 time: 1.086190 Jun 20 12:26:07.818593 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2743/5390] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:06 2022] GET /compute/v2.1/servers/bf0e099f-bcdd-4b6e-b18c-c6117afacfe6 => generated 1671 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:07.826938 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-21509940-20cb-4a44-8a92-8c14a22cf44d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:07.827800 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-21509940-20cb-4a44-8a92-8c14a22cf44d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:07.838783 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21509940-20cb-4a44-8a92-8c14a22cf44d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:07.839627 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21509940-20cb-4a44-8a92-8c14a22cf44d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:07.840699 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21509940-20cb-4a44-8a92-8c14a22cf44d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:07.852447 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21509940-20cb-4a44-8a92-8c14a22cf44d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:08.035738 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-21509940-20cb-4a44-8a92-8c14a22cf44d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:08.045423 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-21509940-20cb-4a44-8a92-8c14a22cf44d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1509 microversion: 2.1 time: 0.224672 Jun 20 12:26:08.048402 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2744/5391] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:07 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1509 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:08.053810 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-4d9ddfbd-8ff5-4c83-a607-65d9e4ba9db0 req-918e4293-a6c0-4738-ad66-da2230e92e1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ac4715b-0c6b-4e90-b6e3-63a115494aec", "name": "network-vif-unplugged", "status": "completed", "tag": "73ffd2e1-a5c9-4cd2-b381-c75748f2cb0b"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:08.072005 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-4d9ddfbd-8ff5-4c83-a607-65d9e4ba9db0 req-918e4293-a6c0-4738-ad66-da2230e92e1b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:08.072718 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-4d9ddfbd-8ff5-4c83-a607-65d9e4ba9db0 req-918e4293-a6c0-4738-ad66-da2230e92e1b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:08.092779 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-4d9ddfbd-8ff5-4c83-a607-65d9e4ba9db0 req-918e4293-a6c0-4738-ad66-da2230e92e1b service nova] Creating event network-vif-unplugged:73ffd2e1-a5c9-4cd2-b381-c75748f2cb0b for instance 7ac4715b-0c6b-4e90-b6e3-63a115494aec on n-h2-master-1 Jun 20 12:26:08.099930 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-4d9ddfbd-8ff5-4c83-a607-65d9e4ba9db0 req-918e4293-a6c0-4738-ad66-da2230e92e1b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050107 Jun 20 12:26:08.101013 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2745/5392] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:26:08.118357 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dd77f28f-079b-460b-a0a2-b399992bf761 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:08.119842 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dd77f28f-079b-460b-a0a2-b399992bf761 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] [instance: 82d76221-bbcd-4dc7-a09b-e3b45088b4d0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:08.139657 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd77f28f-079b-460b-a0a2-b399992bf761 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:08.140535 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd77f28f-079b-460b-a0a2-b399992bf761 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:08.141541 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd77f28f-079b-460b-a0a2-b399992bf761 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:08.143936 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd77f28f-079b-460b-a0a2-b399992bf761 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:08.336127 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4dad51f1-40e7-4185-88fb-6d76d3bb79ef tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:08.348138 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4dad51f1-40e7-4185-88fb-6d76d3bb79ef tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec" status: 200 len: 1681 microversion: 2.1 time: 0.715688 Jun 20 12:26:08.367269 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2648/5393] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:07 2022] GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec => generated 1681 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:08.374607 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dd77f28f-079b-460b-a0a2-b399992bf761 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee3168402f24c0481fbe0275cebbdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeedf38e938b4fd39ccfbf50436bb6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:08.393916 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dd77f28f-079b-460b-a0a2-b399992bf761 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] 10.222.0.27 "GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0" status: 200 len: 1313 microversion: 2.1 time: 0.287926 Jun 20 12:26:08.395316 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2746/5394] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:08 2022] GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0 => generated 1313 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:08.646463 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-509cbf1d-5f60-4963-9d10-aed42421c9de tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:08.647813 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-509cbf1d-5f60-4963-9d10-aed42421c9de tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:08.669939 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-509cbf1d-5f60-4963-9d10-aed42421c9de tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:08.671936 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-509cbf1d-5f60-4963-9d10-aed42421c9de tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:08.673134 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-509cbf1d-5f60-4963-9d10-aed42421c9de tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:08.677393 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-509cbf1d-5f60-4963-9d10-aed42421c9de tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:08.836308 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cbbef939-89b4-4a3c-aeb1-51b459db5950 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:08.836930 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cbbef939-89b4-4a3c-aeb1-51b459db5950 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: bf0e099f-bcdd-4b6e-b18c-c6117afacfe6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:08.848418 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cbbef939-89b4-4a3c-aeb1-51b459db5950 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:08.849525 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cbbef939-89b4-4a3c-aeb1-51b459db5950 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:08.852225 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cbbef939-89b4-4a3c-aeb1-51b459db5950 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:08.853551 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cbbef939-89b4-4a3c-aeb1-51b459db5950 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:08.977124 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cbbef939-89b4-4a3c-aeb1-51b459db5950 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:08.985780 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cbbef939-89b4-4a3c-aeb1-51b459db5950 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/bf0e099f-bcdd-4b6e-b18c-c6117afacfe6" status: 200 len: 1484 microversion: 2.1 time: 0.154667 Jun 20 12:26:09.002375 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2747/5395] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:08 2022] GET /compute/v2.1/servers/bf0e099f-bcdd-4b6e-b18c-c6117afacfe6 => generated 1484 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:26:09.065562 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7209af37-23cd-4230-b031-1fb1c56e1265 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:09.066355 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7209af37-23cd-4230-b031-1fb1c56e1265 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:09.075895 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7209af37-23cd-4230-b031-1fb1c56e1265 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:09.076381 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7209af37-23cd-4230-b031-1fb1c56e1265 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:09.077168 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7209af37-23cd-4230-b031-1fb1c56e1265 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:09.093410 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7209af37-23cd-4230-b031-1fb1c56e1265 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:09.150444 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-509cbf1d-5f60-4963-9d10-aed42421c9de tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:09.183495 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-509cbf1d-5f60-4963-9d10-aed42421c9de tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c" status: 200 len: 1505 microversion: 2.1 time: 0.540825 Jun 20 12:26:09.184764 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2649/5396] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:08 2022] GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c => generated 1505 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:09.190600 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-057cb2f5-6930-48b5-a0f9-627e3b2c2d8b req-c6d2ee4c-514e-4582-b7dc-875461eb1fe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf0e099f-bcdd-4b6e-b18c-c6117afacfe6", "name": "network-vif-deleted", "tag": "d37a67de-6448-4845-9136-14ad539179f4"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:09.223880 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-057cb2f5-6930-48b5-a0f9-627e3b2c2d8b req-c6d2ee4c-514e-4582-b7dc-875461eb1fe1 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:09.224673 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-057cb2f5-6930-48b5-a0f9-627e3b2c2d8b req-c6d2ee4c-514e-4582-b7dc-875461eb1fe1 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:09.251779 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-057cb2f5-6930-48b5-a0f9-627e3b2c2d8b req-c6d2ee4c-514e-4582-b7dc-875461eb1fe1 service nova] Creating event network-vif-deleted:d37a67de-6448-4845-9136-14ad539179f4 for instance bf0e099f-bcdd-4b6e-b18c-c6117afacfe6 on n-h1-master-1 Jun 20 12:26:09.274166 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-057cb2f5-6930-48b5-a0f9-627e3b2c2d8b req-c6d2ee4c-514e-4582-b7dc-875461eb1fe1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087416 Jun 20 12:26:09.275077 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2650/5397] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:26:09.416246 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a1b5c154-9426-40d0-beeb-e60443c568a4 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:09.417458 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a1b5c154-9426-40d0-beeb-e60443c568a4 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] [instance: 82d76221-bbcd-4dc7-a09b-e3b45088b4d0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:09.431367 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a1b5c154-9426-40d0-beeb-e60443c568a4 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:09.435228 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a1b5c154-9426-40d0-beeb-e60443c568a4 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:09.436371 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a1b5c154-9426-40d0-beeb-e60443c568a4 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:09.438273 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a1b5c154-9426-40d0-beeb-e60443c568a4 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:09.482079 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7209af37-23cd-4230-b031-1fb1c56e1265 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:09.485248 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:09.492610 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7209af37-23cd-4230-b031-1fb1c56e1265 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1509 microversion: 2.1 time: 0.431977 Jun 20 12:26:09.493571 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2748/5398] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:09 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1509 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:09.906767 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a1b5c154-9426-40d0-beeb-e60443c568a4 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee3168402f24c0481fbe0275cebbdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeedf38e938b4fd39ccfbf50436bb6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:09.917360 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a1b5c154-9426-40d0-beeb-e60443c568a4 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] 10.222.0.27 "GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0" status: 200 len: 1313 microversion: 2.1 time: 0.509518 Jun 20 12:26:09.918036 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2651/5399] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:09 2022] GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0 => generated 1313 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:10.011379 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4c4dc5b9-5dbe-41b2-955e-f1e5525282a6 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:10.012376 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4c4dc5b9-5dbe-41b2-955e-f1e5525282a6 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: bf0e099f-bcdd-4b6e-b18c-c6117afacfe6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:10.034829 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4c4dc5b9-5dbe-41b2-955e-f1e5525282a6 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:10.035461 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4c4dc5b9-5dbe-41b2-955e-f1e5525282a6 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:10.036284 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4c4dc5b9-5dbe-41b2-955e-f1e5525282a6 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:10.036727 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4c4dc5b9-5dbe-41b2-955e-f1e5525282a6 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:10.056436 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-4c4dc5b9-5dbe-41b2-955e-f1e5525282a6 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] HTTP exception thrown: Instance bf0e099f-bcdd-4b6e-b18c-c6117afacfe6 could not be found. Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4c4dc5b9-5dbe-41b2-955e-f1e5525282a6 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Request method failure captured: Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/bf0e099f-bcdd-4b6e-b18c-c6117afacfe6 HTTP/1.1 Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGa72kVR_SSPWnUGZRxw-G3J4-hwvpug1luVy5r8Ca_eaA02-YD93q1FWHSKS9Tn7i_0JfINvN3iapLSrtvCneB1tQluVFyYyF3eAJhnlxA-bJnSoX10K-r8AAG7MPcURr7bqFwSNhyccR_Qcws2qeyXimx-pEWrLTSIlVSLW3XcvUM Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 1ed88b4072a24b37a5ceec3b239ac8fa Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-TestNetworkBasicOps-648379632 Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1ed88b4072a24b37a5ceec3b239ac8fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1ed88b4072a24b37a5ceec3b239ac8fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1ed88b4072a24b37a5ceec3b239ac8fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1ed88b4072a24b37a5ceec3b239ac8fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-TestNetworkBasicOps-648379632 Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 1ed88b4072a24b37a5ceec3b239ac8fa Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-TestNetworkBasicOps-648379632 Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-TestNetworkBasicOps-648379632-project Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: aeafcd88ca6c415e90b51c262b62597f Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-TestNetworkBasicOps-648379632-project Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: exception: Instance bf0e099f-bcdd-4b6e-b18c-c6117afacfe6 could not be found. Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'bf0e099f-bcdd-4b6e-b18c-c6117afacfe6'} Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf0e099f-bcdd-4b6e-b18c-c6117afacfe6 could not be found. Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf0e099f-bcdd-4b6e-b18c-c6117afacfe6 could not be found. Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:26:10.058209 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:26:10.061707 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:26:10.061707 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:26:10.061707 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:26:10.061707 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:26:10.061707 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:26:10.061707 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf0e099f-bcdd-4b6e-b18c-c6117afacfe6 could not be found. Jun 20 12:26:10.061707 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:26:10.061707 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4c4dc5b9-5dbe-41b2-955e-f1e5525282a6 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Returning 404 to user: Instance bf0e099f-bcdd-4b6e-b18c-c6117afacfe6 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:26:10.061707 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4c4dc5b9-5dbe-41b2-955e-f1e5525282a6 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/bf0e099f-bcdd-4b6e-b18c-c6117afacfe6" status: 404 len: 111 microversion: 2.1 time: 0.054587 Jun 20 12:26:10.061707 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2749/5400] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:10 2022] GET /compute/v2.1/servers/bf0e099f-bcdd-4b6e-b18c-c6117afacfe6 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:26:10.220692 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-aa049175-e348-4214-931f-f373eaefa873 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:10.222257 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-aa049175-e348-4214-931f-f373eaefa873 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:10.248540 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aa049175-e348-4214-931f-f373eaefa873 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:10.249546 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aa049175-e348-4214-931f-f373eaefa873 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:10.251814 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aa049175-e348-4214-931f-f373eaefa873 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:10.252598 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aa049175-e348-4214-931f-f373eaefa873 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:10.334339 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-86222d3f-0b65-492e-869a-0b095d910f90 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '.version_select at 0x7f6072157700>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:10.416856 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-86222d3f-0b65-492e-869a-0b095d910f90 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-970871994" status: 202 len: 0 microversion: 2.1 time: 0.087361 Jun 20 12:26:10.431946 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2750/5401] 10.222.0.27 () {58 vars in 1253 bytes} [Mon Jun 20 12:26:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-970871994 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:26:10.525265 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-89f8504c-d124-46f1-95d8-dae170dfb53e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:10.526172 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-89f8504c-d124-46f1-95d8-dae170dfb53e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:10.546771 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-89f8504c-d124-46f1-95d8-dae170dfb53e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:10.547693 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-89f8504c-d124-46f1-95d8-dae170dfb53e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:10.550952 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-89f8504c-d124-46f1-95d8-dae170dfb53e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:10.551708 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-89f8504c-d124-46f1-95d8-dae170dfb53e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:10.764945 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-aa049175-e348-4214-931f-f373eaefa873 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:10.781973 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-aa049175-e348-4214-931f-f373eaefa873 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c" status: 200 len: 1505 microversion: 2.1 time: 0.582750 Jun 20 12:26:10.782594 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2652/5402] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:10 2022] GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c => generated 1505 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:10.938248 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-912135d6-c511-4bf3-8a52-d0d66d418cfc tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:10.940060 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-912135d6-c511-4bf3-8a52-d0d66d418cfc tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] [instance: 82d76221-bbcd-4dc7-a09b-e3b45088b4d0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:10.952898 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-912135d6-c511-4bf3-8a52-d0d66d418cfc tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:10.952898 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-912135d6-c511-4bf3-8a52-d0d66d418cfc tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:10.953776 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-912135d6-c511-4bf3-8a52-d0d66d418cfc tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:10.954222 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-912135d6-c511-4bf3-8a52-d0d66d418cfc tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:11.223884 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-89f8504c-d124-46f1-95d8-dae170dfb53e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:11.238171 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-89f8504c-d124-46f1-95d8-dae170dfb53e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1509 microversion: 2.1 time: 0.729581 Jun 20 12:26:11.239481 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2751/5403] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:10 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1509 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:11.249476 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-7824e942-8a68-4630-99cc-d46f1f4e449b req-762ed630-e343-46c7-b146-8b4d1a8dc25a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ac4715b-0c6b-4e90-b6e3-63a115494aec", "name": "network-vif-plugged", "status": "completed", "tag": "73ffd2e1-a5c9-4cd2-b381-c75748f2cb0b"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:11.264901 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:11.267509 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-7824e942-8a68-4630-99cc-d46f1f4e449b req-762ed630-e343-46c7-b146-8b4d1a8dc25a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:11.276613 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-7824e942-8a68-4630-99cc-d46f1f4e449b req-762ed630-e343-46c7-b146-8b4d1a8dc25a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:11.294874 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-7824e942-8a68-4630-99cc-d46f1f4e449b req-762ed630-e343-46c7-b146-8b4d1a8dc25a service nova] Creating event network-vif-plugged:73ffd2e1-a5c9-4cd2-b381-c75748f2cb0b for instance 7ac4715b-0c6b-4e90-b6e3-63a115494aec on n-h2-master-1 Jun 20 12:26:11.308669 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-7824e942-8a68-4630-99cc-d46f1f4e449b req-762ed630-e343-46c7-b146-8b4d1a8dc25a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067543 Jun 20 12:26:11.314123 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2752/5404] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:26:11.386808 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-912135d6-c511-4bf3-8a52-d0d66d418cfc tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee3168402f24c0481fbe0275cebbdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeedf38e938b4fd39ccfbf50436bb6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:11.403954 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-912135d6-c511-4bf3-8a52-d0d66d418cfc tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] 10.222.0.27 "GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0" status: 200 len: 1313 microversion: 2.1 time: 0.471548 Jun 20 12:26:11.405769 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2653/5405] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:10 2022] GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0 => generated 1313 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:26:11.800763 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3f4e0a31-81ad-4ad1-8cf2-00200305f69c tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:11.801790 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3f4e0a31-81ad-4ad1-8cf2-00200305f69c tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:11.811494 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3f4e0a31-81ad-4ad1-8cf2-00200305f69c tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:11.812394 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3f4e0a31-81ad-4ad1-8cf2-00200305f69c tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:11.813585 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3f4e0a31-81ad-4ad1-8cf2-00200305f69c tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:11.814409 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3f4e0a31-81ad-4ad1-8cf2-00200305f69c tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:12.180595 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3f4e0a31-81ad-4ad1-8cf2-00200305f69c tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:12.191963 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3f4e0a31-81ad-4ad1-8cf2-00200305f69c tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c" status: 200 len: 1505 microversion: 2.1 time: 0.396212 Jun 20 12:26:12.204826 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2753/5406] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:11 2022] GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c => generated 1505 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:12.259920 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-461561f8-c03e-441b-9897-5a46ce8d2c9c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:12.261516 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-461561f8-c03e-441b-9897-5a46ce8d2c9c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:12.273587 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-461561f8-c03e-441b-9897-5a46ce8d2c9c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:12.279788 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-461561f8-c03e-441b-9897-5a46ce8d2c9c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:12.280856 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-461561f8-c03e-441b-9897-5a46ce8d2c9c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:12.281459 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-461561f8-c03e-441b-9897-5a46ce8d2c9c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:12.424473 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-70fb90ec-b02c-458a-aa57-526b44a0d50a tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:12.425800 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-70fb90ec-b02c-458a-aa57-526b44a0d50a tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] [instance: 82d76221-bbcd-4dc7-a09b-e3b45088b4d0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:12.438263 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-70fb90ec-b02c-458a-aa57-526b44a0d50a tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:12.440949 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-70fb90ec-b02c-458a-aa57-526b44a0d50a tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:12.442556 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-70fb90ec-b02c-458a-aa57-526b44a0d50a tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:12.444484 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-70fb90ec-b02c-458a-aa57-526b44a0d50a tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:12.994615 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-461561f8-c03e-441b-9897-5a46ce8d2c9c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:13.022144 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-461561f8-c03e-441b-9897-5a46ce8d2c9c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1509 microversion: 2.1 time: 0.768265 Jun 20 12:26:13.036128 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2654/5407] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:12 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1509 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:13.213932 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-87f936e5-b3ab-4e9b-a8b1-e44bb02b9d9f tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:13.216351 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-87f936e5-b3ab-4e9b-a8b1-e44bb02b9d9f tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:13.265535 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-87f936e5-b3ab-4e9b-a8b1-e44bb02b9d9f tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:13.298012 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-87f936e5-b3ab-4e9b-a8b1-e44bb02b9d9f tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:13.299798 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-87f936e5-b3ab-4e9b-a8b1-e44bb02b9d9f tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:13.305778 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-87f936e5-b3ab-4e9b-a8b1-e44bb02b9d9f tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:13.920956 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-87f936e5-b3ab-4e9b-a8b1-e44bb02b9d9f tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:13.936703 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-87f936e5-b3ab-4e9b-a8b1-e44bb02b9d9f tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c" status: 200 len: 1505 microversion: 2.1 time: 0.725100 Jun 20 12:26:13.952581 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2655/5408] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:13 2022] GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c => generated 1505 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:14.039976 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7391b25f-a9d6-4e09-a219-ec5bfd11870e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:14.040994 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7391b25f-a9d6-4e09-a219-ec5bfd11870e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:14.053291 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7391b25f-a9d6-4e09-a219-ec5bfd11870e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:14.054145 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7391b25f-a9d6-4e09-a219-ec5bfd11870e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:14.055399 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7391b25f-a9d6-4e09-a219-ec5bfd11870e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:14.057346 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7391b25f-a9d6-4e09-a219-ec5bfd11870e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:14.221812 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-70fb90ec-b02c-458a-aa57-526b44a0d50a tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee3168402f24c0481fbe0275cebbdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeedf38e938b4fd39ccfbf50436bb6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:14.231332 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-70fb90ec-b02c-458a-aa57-526b44a0d50a tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] 10.222.0.27 "GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0" status: 200 len: 1313 microversion: 2.1 time: 1.811882 Jun 20 12:26:14.240002 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2754/5409] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:12 2022] GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0 => generated 1313 bytes in 1821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:14.379649 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7391b25f-a9d6-4e09-a219-ec5bfd11870e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:14.399528 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:14.402821 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7391b25f-a9d6-4e09-a219-ec5bfd11870e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1509 microversion: 2.1 time: 0.367801 Jun 20 12:26:14.408486 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2656/5410] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:14 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1509 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:26:14.955054 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bf610b29-dd83-4a69-b5b9-f333bb115063 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:14.955684 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bf610b29-dd83-4a69-b5b9-f333bb115063 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:14.972514 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf610b29-dd83-4a69-b5b9-f333bb115063 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:14.972968 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf610b29-dd83-4a69-b5b9-f333bb115063 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:14.973964 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf610b29-dd83-4a69-b5b9-f333bb115063 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:14.974563 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf610b29-dd83-4a69-b5b9-f333bb115063 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:15.260641 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ef12ebe9-cec4-4eba-a9f1-ddce4ec3d07d tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:15.261590 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ef12ebe9-cec4-4eba-a9f1-ddce4ec3d07d tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] [instance: 82d76221-bbcd-4dc7-a09b-e3b45088b4d0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:15.277648 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef12ebe9-cec4-4eba-a9f1-ddce4ec3d07d tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:15.281177 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef12ebe9-cec4-4eba-a9f1-ddce4ec3d07d tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:15.284483 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef12ebe9-cec4-4eba-a9f1-ddce4ec3d07d tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:15.285453 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef12ebe9-cec4-4eba-a9f1-ddce4ec3d07d tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:15.460843 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bf610b29-dd83-4a69-b5b9-f333bb115063 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:15.470538 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bf610b29-dd83-4a69-b5b9-f333bb115063 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c" status: 200 len: 1505 microversion: 2.1 time: 0.519220 Jun 20 12:26:15.477705 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2755/5411] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:14 2022] GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c => generated 1505 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:15.492782 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-eab9e483-60a2-4110-b059-0fa88ac160b2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:15.497258 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-eab9e483-60a2-4110-b059-0fa88ac160b2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:15.520347 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eab9e483-60a2-4110-b059-0fa88ac160b2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:15.520974 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eab9e483-60a2-4110-b059-0fa88ac160b2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:15.528340 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eab9e483-60a2-4110-b059-0fa88ac160b2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:15.530225 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eab9e483-60a2-4110-b059-0fa88ac160b2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:15.738375 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ef12ebe9-cec4-4eba-a9f1-ddce4ec3d07d tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee3168402f24c0481fbe0275cebbdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeedf38e938b4fd39ccfbf50436bb6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:15.757268 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ef12ebe9-cec4-4eba-a9f1-ddce4ec3d07d tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] 10.222.0.27 "GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0" status: 200 len: 1313 microversion: 2.1 time: 0.502793 Jun 20 12:26:15.768707 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2657/5412] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:15 2022] GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0 => generated 1313 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:15.772728 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d8c901b0-be9d-4900-b3c9-4bdb767bd5ec tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:15.773239 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d8c901b0-be9d-4900-b3c9-4bdb767bd5ec tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 5b047d91-122c-44ee-b96e-1e0836960caa] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:15.799370 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d8c901b0-be9d-4900-b3c9-4bdb767bd5ec tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:15.801225 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d8c901b0-be9d-4900-b3c9-4bdb767bd5ec tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:15.803737 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d8c901b0-be9d-4900-b3c9-4bdb767bd5ec tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:15.806086 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d8c901b0-be9d-4900-b3c9-4bdb767bd5ec tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:15.878113 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d8c901b0-be9d-4900-b3c9-4bdb767bd5ec tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa/os-volume_attachments/ec756b7a-4f23-4718-8713-e63f4ea98563" status: 200 len: 194 microversion: 2.1 time: 0.116013 Jun 20 12:26:15.884600 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2658/5413] 10.222.0.27 () {58 vars in 1412 bytes} [Mon Jun 20 12:26:15 2022] GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa/os-volume_attachments/ec756b7a-4f23-4718-8713-e63f4ea98563 => generated 194 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:26:15.891243 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-4374e493-0e59-4a5c-a29a-b9697dbefd85 req-ca8a670f-a9b1-4a4f-aff1-eacb492d861e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82d76221-bbcd-4dc7-a09b-e3b45088b4d0", "name": "network-vif-plugged", "status": "completed", "tag": "bfaf47ed-1d6d-4b0c-b280-52909fc62108"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:15.919354 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-4374e493-0e59-4a5c-a29a-b9697dbefd85 req-ca8a670f-a9b1-4a4f-aff1-eacb492d861e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:15.920056 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-4374e493-0e59-4a5c-a29a-b9697dbefd85 req-ca8a670f-a9b1-4a4f-aff1-eacb492d861e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:15.935848 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-4374e493-0e59-4a5c-a29a-b9697dbefd85 req-ca8a670f-a9b1-4a4f-aff1-eacb492d861e service nova] Creating event network-vif-plugged:bfaf47ed-1d6d-4b0c-b280-52909fc62108 for instance 82d76221-bbcd-4dc7-a09b-e3b45088b4d0 on n-h2-master-1 Jun 20 12:26:15.955748 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-4374e493-0e59-4a5c-a29a-b9697dbefd85 req-ca8a670f-a9b1-4a4f-aff1-eacb492d861e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056195 Jun 20 12:26:15.957046 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2659/5414] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:26:15.964977 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-09646f09-e9dc-46ab-b9c3-1a52fb8f1272 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:15.965792 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-09646f09-e9dc-46ab-b9c3-1a52fb8f1272 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 5b047d91-122c-44ee-b96e-1e0836960caa] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:15.976537 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-09646f09-e9dc-46ab-b9c3-1a52fb8f1272 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:15.977236 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-09646f09-e9dc-46ab-b9c3-1a52fb8f1272 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:15.978181 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-09646f09-e9dc-46ab-b9c3-1a52fb8f1272 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:15.978772 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-09646f09-e9dc-46ab-b9c3-1a52fb8f1272 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:16.125426 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-09646f09-e9dc-46ab-b9c3-1a52fb8f1272 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lazy-loading 'services' on Instance uuid 5b047d91-122c-44ee-b96e-1e0836960caa {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:26:16.244024 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-09646f09-e9dc-46ab-b9c3-1a52fb8f1272 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa/os-volume_attachments/ec756b7a-4f23-4718-8713-e63f4ea98563" status: 202 len: 0 microversion: 2.1 time: 0.284195 Jun 20 12:26:16.252404 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2660/5415] 10.222.0.27 () {58 vars in 1415 bytes} [Mon Jun 20 12:26:15 2022] DELETE /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa/os-volume_attachments/ec756b7a-4f23-4718-8713-e63f4ea98563 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:26:16.501879 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7173c701-946b-4c6c-9de6-92f9b4de1221 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:16.503422 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7173c701-946b-4c6c-9de6-92f9b4de1221 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:16.511935 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-eab9e483-60a2-4110-b059-0fa88ac160b2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:16.562880 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-eab9e483-60a2-4110-b059-0fa88ac160b2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1506 microversion: 2.1 time: 1.081937 Jun 20 12:26:16.564189 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2756/5416] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:15 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1506 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:16.577374 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7173c701-946b-4c6c-9de6-92f9b4de1221 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:16.577374 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7173c701-946b-4c6c-9de6-92f9b4de1221 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:16.577374 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7173c701-946b-4c6c-9de6-92f9b4de1221 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:16.597009 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7173c701-946b-4c6c-9de6-92f9b4de1221 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:16.776935 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c62a3842-4678-4ae5-8b75-b597515bc781 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:16.778039 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c62a3842-4678-4ae5-8b75-b597515bc781 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] [instance: 82d76221-bbcd-4dc7-a09b-e3b45088b4d0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:16.794350 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c62a3842-4678-4ae5-8b75-b597515bc781 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:16.798069 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c62a3842-4678-4ae5-8b75-b597515bc781 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:16.799296 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c62a3842-4678-4ae5-8b75-b597515bc781 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:16.803467 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c62a3842-4678-4ae5-8b75-b597515bc781 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:16.947057 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7173c701-946b-4c6c-9de6-92f9b4de1221 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:16.963403 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7173c701-946b-4c6c-9de6-92f9b4de1221 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c" status: 200 len: 1505 microversion: 2.1 time: 0.467540 Jun 20 12:26:16.964634 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2661/5417] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:16 2022] GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c => generated 1505 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:26:17.225193 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c62a3842-4678-4ae5-8b75-b597515bc781 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee3168402f24c0481fbe0275cebbdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeedf38e938b4fd39ccfbf50436bb6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:17.238645 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c62a3842-4678-4ae5-8b75-b597515bc781 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] 10.222.0.27 "GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0" status: 200 len: 1313 microversion: 2.1 time: 0.466364 Jun 20 12:26:17.240379 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2757/5418] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:16 2022] GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0 => generated 1313 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:26:17.586854 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-df743a84-c4bb-495f-ba47-5d734e07d67c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:17.588307 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-df743a84-c4bb-495f-ba47-5d734e07d67c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:17.596434 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-df743a84-c4bb-495f-ba47-5d734e07d67c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:17.596932 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-df743a84-c4bb-495f-ba47-5d734e07d67c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:17.597819 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-df743a84-c4bb-495f-ba47-5d734e07d67c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:17.598352 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-df743a84-c4bb-495f-ba47-5d734e07d67c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:17.932178 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-df743a84-c4bb-495f-ba47-5d734e07d67c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:17.940987 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-df743a84-c4bb-495f-ba47-5d734e07d67c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1506 microversion: 2.1 time: 0.361789 Jun 20 12:26:17.942175 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2662/5419] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:17 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1506 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:17.985853 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a4c4b9cd-eb53-415c-9420-ced2355812e4 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:17.986523 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a4c4b9cd-eb53-415c-9420-ced2355812e4 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:18.009137 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a4c4b9cd-eb53-415c-9420-ced2355812e4 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:18.013128 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a4c4b9cd-eb53-415c-9420-ced2355812e4 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:18.014396 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a4c4b9cd-eb53-415c-9420-ced2355812e4 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:18.014917 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a4c4b9cd-eb53-415c-9420-ced2355812e4 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:18.259267 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-db79dec4-d472-42e7-acff-192c5b578aae tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:18.273930 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-db79dec4-d472-42e7-acff-192c5b578aae tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] [instance: 82d76221-bbcd-4dc7-a09b-e3b45088b4d0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:18.294636 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-db79dec4-d472-42e7-acff-192c5b578aae tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:18.295588 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-db79dec4-d472-42e7-acff-192c5b578aae tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:18.299481 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-db79dec4-d472-42e7-acff-192c5b578aae tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:18.301206 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-db79dec4-d472-42e7-acff-192c5b578aae tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:18.416012 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a4c4b9cd-eb53-415c-9420-ced2355812e4 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:18.435001 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a4c4b9cd-eb53-415c-9420-ced2355812e4 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c" status: 200 len: 1485 microversion: 2.1 time: 0.453265 Jun 20 12:26:18.451514 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2758/5420] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:17 2022] GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c => generated 1485 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:18.484873 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d8b12bf0-4c33-4c0c-b5af-d577099cc41c tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:18.485413 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d8b12bf0-4c33-4c0c-b5af-d577099cc41c tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:18.509950 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d8b12bf0-4c33-4c0c-b5af-d577099cc41c tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:18.510802 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d8b12bf0-4c33-4c0c-b5af-d577099cc41c tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:18.512899 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d8b12bf0-4c33-4c0c-b5af-d577099cc41c tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:18.513891 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d8b12bf0-4c33-4c0c-b5af-d577099cc41c tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:18.630067 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d8b12bf0-4c33-4c0c-b5af-d577099cc41c tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "POST /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c/action" status: 202 len: 0 microversion: 2.1 time: 0.171640 Jun 20 12:26:18.633840 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2759/5421] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:26:18 2022] POST /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:26:18.652596 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8415aeb4-a2c0-4385-9ba1-dd0a1ee20923 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:18.654897 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8415aeb4-a2c0-4385-9ba1-dd0a1ee20923 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:18.685097 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8415aeb4-a2c0-4385-9ba1-dd0a1ee20923 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:18.686152 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8415aeb4-a2c0-4385-9ba1-dd0a1ee20923 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:18.687521 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8415aeb4-a2c0-4385-9ba1-dd0a1ee20923 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:18.688119 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8415aeb4-a2c0-4385-9ba1-dd0a1ee20923 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:18.840362 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-db79dec4-d472-42e7-acff-192c5b578aae tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee3168402f24c0481fbe0275cebbdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeedf38e938b4fd39ccfbf50436bb6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:18.857381 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-db79dec4-d472-42e7-acff-192c5b578aae tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] 10.222.0.27 "GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0" status: 200 len: 1463 microversion: 2.1 time: 0.602071 Jun 20 12:26:18.859412 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2663/5422] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:18 2022] GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0 => generated 1463 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:18.876540 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-64490e5f-8de0-4378-ac85-9ff2f1e86040 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eaffbd3e-a7fb-49f4-8143-c906914ae05a", "device": "/dev/sdb"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:18.878590 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-64490e5f-8de0-4378-ac85-9ff2f1e86040 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] [instance: 82d76221-bbcd-4dc7-a09b-e3b45088b4d0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:18.895927 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64490e5f-8de0-4378-ac85-9ff2f1e86040 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:18.896759 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64490e5f-8de0-4378-ac85-9ff2f1e86040 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:18.897781 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64490e5f-8de0-4378-ac85-9ff2f1e86040 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:18.898416 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64490e5f-8de0-4378-ac85-9ff2f1e86040 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:19.107656 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8415aeb4-a2c0-4385-9ba1-dd0a1ee20923 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:19.153543 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8415aeb4-a2c0-4385-9ba1-dd0a1ee20923 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c" status: 200 len: 1493 microversion: 2.1 time: 0.517004 Jun 20 12:26:19.173421 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2760/5423] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:18 2022] GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c => generated 1493 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:19.187806 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1c45ef0a-1ab9-4c72-a4f6-9b6e2be8e964 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:19.190641 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1c45ef0a-1ab9-4c72-a4f6-9b6e2be8e964 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:19.209718 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c45ef0a-1ab9-4c72-a4f6-9b6e2be8e964 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:19.210805 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c45ef0a-1ab9-4c72-a4f6-9b6e2be8e964 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:19.211707 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c45ef0a-1ab9-4c72-a4f6-9b6e2be8e964 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:19.216117 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c45ef0a-1ab9-4c72-a4f6-9b6e2be8e964 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:19.527116 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1c45ef0a-1ab9-4c72-a4f6-9b6e2be8e964 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:19.535721 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1c45ef0a-1ab9-4c72-a4f6-9b6e2be8e964 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1506 microversion: 2.1 time: 0.359201 Jun 20 12:26:19.536349 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2761/5424] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:19 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1506 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:19.541809 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-4ee30b9a-3822-4fe1-bca6-71293dbe4da4 req-8ab2193d-a8d3-4cb9-b5a7-1fb04fad3634 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c473a298-ea22-4021-ae72-92e85a549c19", "name": "network-vif-unplugged", "status": "completed", "tag": "9b61fdc1-e467-43d0-bf62-8e0407b63f9e"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:19.552751 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-4ee30b9a-3822-4fe1-bca6-71293dbe4da4 req-8ab2193d-a8d3-4cb9-b5a7-1fb04fad3634 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:19.553267 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-4ee30b9a-3822-4fe1-bca6-71293dbe4da4 req-8ab2193d-a8d3-4cb9-b5a7-1fb04fad3634 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:19.575800 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-4ee30b9a-3822-4fe1-bca6-71293dbe4da4 req-8ab2193d-a8d3-4cb9-b5a7-1fb04fad3634 service nova] Creating event network-vif-unplugged:9b61fdc1-e467-43d0-bf62-8e0407b63f9e for instance c473a298-ea22-4021-ae72-92e85a549c19 on n-h2-master-1 Jun 20 12:26:19.583051 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-4ee30b9a-3822-4fe1-bca6-71293dbe4da4 req-8ab2193d-a8d3-4cb9-b5a7-1fb04fad3634 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045090 Jun 20 12:26:19.587314 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2762/5425] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:26:20.182131 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b13093d0-e975-45b1-9aa4-a59e27812b6a tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:20.183909 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b13093d0-e975-45b1-9aa4-a59e27812b6a tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:20.195356 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b13093d0-e975-45b1-9aa4-a59e27812b6a tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:20.199389 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b13093d0-e975-45b1-9aa4-a59e27812b6a tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:20.200840 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b13093d0-e975-45b1-9aa4-a59e27812b6a tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:20.201559 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b13093d0-e975-45b1-9aa4-a59e27812b6a tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:20.433049 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b13093d0-e975-45b1-9aa4-a59e27812b6a tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:20.447910 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b13093d0-e975-45b1-9aa4-a59e27812b6a tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c" status: 200 len: 1493 microversion: 2.1 time: 0.271345 Jun 20 12:26:20.448559 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2763/5426] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:20 2022] GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c => generated 1493 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:20.555219 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e2fb846b-ff67-4702-ab14-15aff8fcfb9e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:20.556195 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e2fb846b-ff67-4702-ab14-15aff8fcfb9e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:20.563887 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2fb846b-ff67-4702-ab14-15aff8fcfb9e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:20.564379 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2fb846b-ff67-4702-ab14-15aff8fcfb9e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:20.565551 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2fb846b-ff67-4702-ab14-15aff8fcfb9e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:20.566395 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2fb846b-ff67-4702-ab14-15aff8fcfb9e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:20.789325 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e2fb846b-ff67-4702-ab14-15aff8fcfb9e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:20.798890 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e2fb846b-ff67-4702-ab14-15aff8fcfb9e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1506 microversion: 2.1 time: 0.249206 Jun 20 12:26:20.801488 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2764/5427] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:20 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1506 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:21.077618 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-64490e5f-8de0-4378-ac85-9ff2f1e86040 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] 10.222.0.27 "POST /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.205038 Jun 20 12:26:21.078640 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2664/5428] 10.222.0.27 () {60 vars in 1322 bytes} [Mon Jun 20 12:26:18 2022] POST /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0/os-volume_attachments => generated 194 bytes in 2208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:26:21.466445 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9d923602-c0d8-458f-b99c-9de4387ed5ce tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:21.468933 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9d923602-c0d8-458f-b99c-9de4387ed5ce tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:21.493647 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9d923602-c0d8-458f-b99c-9de4387ed5ce tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:21.496930 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9d923602-c0d8-458f-b99c-9de4387ed5ce tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:21.498859 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9d923602-c0d8-458f-b99c-9de4387ed5ce tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:21.499545 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9d923602-c0d8-458f-b99c-9de4387ed5ce tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:21.818478 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e009f132-4d73-481a-8ae2-5e288baaf1a5 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:21.819450 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e009f132-4d73-481a-8ae2-5e288baaf1a5 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:21.833181 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e009f132-4d73-481a-8ae2-5e288baaf1a5 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:21.836089 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e009f132-4d73-481a-8ae2-5e288baaf1a5 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:21.837679 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e009f132-4d73-481a-8ae2-5e288baaf1a5 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:21.841097 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e009f132-4d73-481a-8ae2-5e288baaf1a5 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:21.901790 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9d923602-c0d8-458f-b99c-9de4387ed5ce tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:21.916945 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9d923602-c0d8-458f-b99c-9de4387ed5ce tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c" status: 200 len: 1499 microversion: 2.1 time: 0.454932 Jun 20 12:26:21.924747 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2765/5429] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:21 2022] GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c => generated 1499 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:21.943089 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-426de6e1-7479-49cf-80d2-cd11b17c4e30 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:21.944134 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-426de6e1-7479-49cf-80d2-cd11b17c4e30 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:21.956244 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-426de6e1-7479-49cf-80d2-cd11b17c4e30 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:21.960339 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-426de6e1-7479-49cf-80d2-cd11b17c4e30 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:21.964547 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-426de6e1-7479-49cf-80d2-cd11b17c4e30 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:21.965212 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-426de6e1-7479-49cf-80d2-cd11b17c4e30 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:22.035002 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-426de6e1-7479-49cf-80d2-cd11b17c4e30 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:26:22.101028 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e009f132-4d73-481a-8ae2-5e288baaf1a5 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:22.112055 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e009f132-4d73-481a-8ae2-5e288baaf1a5 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 200 len: 1449 microversion: 2.1 time: 0.298914 Jun 20 12:26:22.121427 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:22.123452 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2665/5430] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:21 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 1449 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:26:22.132592 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b3c5f55e-c9b9-4d8a-a87a-8f904a5892c7 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:22.134441 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b3c5f55e-c9b9-4d8a-a87a-8f904a5892c7 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:22.143941 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b3c5f55e-c9b9-4d8a-a87a-8f904a5892c7 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:22.144871 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b3c5f55e-c9b9-4d8a-a87a-8f904a5892c7 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:22.146314 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b3c5f55e-c9b9-4d8a-a87a-8f904a5892c7 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:22.146928 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b3c5f55e-c9b9-4d8a-a87a-8f904a5892c7 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:22.260837 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-426de6e1-7479-49cf-80d2-cd11b17c4e30 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c" status: 204 len: 0 microversion: 2.1 time: 0.319050 Jun 20 12:26:22.263290 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2766/5431] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:26:21 2022] DELETE /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 12:26:22.273257 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2eecf092-22c2-4438-9978-25d3736079f7 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:22.275873 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2eecf092-22c2-4438-9978-25d3736079f7 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:22.285907 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2eecf092-22c2-4438-9978-25d3736079f7 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:22.286369 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2eecf092-22c2-4438-9978-25d3736079f7 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:22.287327 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2eecf092-22c2-4438-9978-25d3736079f7 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:22.290755 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2eecf092-22c2-4438-9978-25d3736079f7 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:22.425358 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b3c5f55e-c9b9-4d8a-a87a-8f904a5892c7 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:22.434220 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b3c5f55e-c9b9-4d8a-a87a-8f904a5892c7 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.306403 Jun 20 12:26:22.436192 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2666/5432] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:22 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:26:22.462234 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6de2f60a-6a1c-44c5-a0c4-7984470f2a64 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:22.464960 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6de2f60a-6a1c-44c5-a0c4-7984470f2a64 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:22.490444 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6de2f60a-6a1c-44c5-a0c4-7984470f2a64 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:22.491695 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6de2f60a-6a1c-44c5-a0c4-7984470f2a64 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:22.493387 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6de2f60a-6a1c-44c5-a0c4-7984470f2a64 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:22.494394 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6de2f60a-6a1c-44c5-a0c4-7984470f2a64 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:22.657552 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2eecf092-22c2-4438-9978-25d3736079f7 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:22.680610 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2eecf092-22c2-4438-9978-25d3736079f7 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c" status: 200 len: 1505 microversion: 2.1 time: 0.409735 Jun 20 12:26:22.683699 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2767/5433] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:22 2022] GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c => generated 1505 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:22.781114 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6de2f60a-6a1c-44c5-a0c4-7984470f2a64 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:22.798948 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6de2f60a-6a1c-44c5-a0c4-7984470f2a64 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.342534 Jun 20 12:26:22.799444 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2667/5434] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:22 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:22.816309 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-42af34c5-b34d-465e-a8ee-4f6bef7075a0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:22.817319 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-42af34c5-b34d-465e-a8ee-4f6bef7075a0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:22.824825 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-42af34c5-b34d-465e-a8ee-4f6bef7075a0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:22.825636 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-42af34c5-b34d-465e-a8ee-4f6bef7075a0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:22.826737 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-42af34c5-b34d-465e-a8ee-4f6bef7075a0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:22.827408 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-42af34c5-b34d-465e-a8ee-4f6bef7075a0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:23.024684 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-42af34c5-b34d-465e-a8ee-4f6bef7075a0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:23.033560 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-42af34c5-b34d-465e-a8ee-4f6bef7075a0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.222197 Jun 20 12:26:23.036359 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2768/5435] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:22 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:23.052127 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-35465080-6d09-4239-b1f1-655030816200 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:23.052761 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-35465080-6d09-4239-b1f1-655030816200 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:23.060130 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-35465080-6d09-4239-b1f1-655030816200 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:23.060627 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-35465080-6d09-4239-b1f1-655030816200 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:23.061422 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-35465080-6d09-4239-b1f1-655030816200 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:23.062146 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-35465080-6d09-4239-b1f1-655030816200 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:23.337705 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-35465080-6d09-4239-b1f1-655030816200 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:23.347993 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-35465080-6d09-4239-b1f1-655030816200 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.299979 Jun 20 12:26:23.350313 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2668/5436] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:23 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:23.368307 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1b27af53-4272-41c6-a0f1-7763bea0ef38 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:23.377424 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1b27af53-4272-41c6-a0f1-7763bea0ef38 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:23.378264 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1b27af53-4272-41c6-a0f1-7763bea0ef38 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:23.427232 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1b27af53-4272-41c6-a0f1-7763bea0ef38 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Going to try to stop instance {{(pid=119127) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 20 12:26:23.500193 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1b27af53-4272-41c6-a0f1-7763bea0ef38 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "POST /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/action" status: 202 len: 0 microversion: 2.1 time: 0.135826 Jun 20 12:26:23.505263 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2769/5437] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:26:23 2022] POST /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:26:23.509941 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-71bac11f-7aa0-4bce-b15e-f98a69eb5d06 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:23.510619 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-71bac11f-7aa0-4bce-b15e-f98a69eb5d06 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:23.518200 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-71bac11f-7aa0-4bce-b15e-f98a69eb5d06 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:23.518645 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-71bac11f-7aa0-4bce-b15e-f98a69eb5d06 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:23.519694 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-71bac11f-7aa0-4bce-b15e-f98a69eb5d06 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:23.520190 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-71bac11f-7aa0-4bce-b15e-f98a69eb5d06 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:23.700681 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a24a8815-68b0-4dfe-bea7-4cbd03879674 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:23.701704 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a24a8815-68b0-4dfe-bea7-4cbd03879674 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:23.742178 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a24a8815-68b0-4dfe-bea7-4cbd03879674 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:23.742837 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a24a8815-68b0-4dfe-bea7-4cbd03879674 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:23.751134 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a24a8815-68b0-4dfe-bea7-4cbd03879674 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:23.753543 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a24a8815-68b0-4dfe-bea7-4cbd03879674 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:23.856456 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-71bac11f-7aa0-4bce-b15e-f98a69eb5d06 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:23.865359 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-71bac11f-7aa0-4bce-b15e-f98a69eb5d06 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1681 microversion: 2.1 time: 0.359485 Jun 20 12:26:23.877512 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2669/5438] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:23 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1681 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:26:24.170537 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a24a8815-68b0-4dfe-bea7-4cbd03879674 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:24.181977 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a24a8815-68b0-4dfe-bea7-4cbd03879674 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c" status: 200 len: 1505 microversion: 2.1 time: 0.485962 Jun 20 12:26:24.184299 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2770/5439] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:23 2022] GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c => generated 1505 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:26:24.883778 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c929040a-2b50-48c8-8d91-438aeb262f66 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:24.885703 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c929040a-2b50-48c8-8d91-438aeb262f66 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:24.897561 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c929040a-2b50-48c8-8d91-438aeb262f66 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:24.898293 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c929040a-2b50-48c8-8d91-438aeb262f66 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:24.899319 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c929040a-2b50-48c8-8d91-438aeb262f66 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:24.899950 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c929040a-2b50-48c8-8d91-438aeb262f66 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:25.204020 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2815365d-45fb-4fb6-9446-88d16401ab77 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:25.205301 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2815365d-45fb-4fb6-9446-88d16401ab77 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:25.227915 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c929040a-2b50-48c8-8d91-438aeb262f66 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:25.241040 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c929040a-2b50-48c8-8d91-438aeb262f66 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1681 microversion: 2.1 time: 0.361539 Jun 20 12:26:25.242220 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2670/5440] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:24 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1681 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:25.242478 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2815365d-45fb-4fb6-9446-88d16401ab77 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:25.243085 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2815365d-45fb-4fb6-9446-88d16401ab77 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:25.247553 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2815365d-45fb-4fb6-9446-88d16401ab77 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:25.248864 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2815365d-45fb-4fb6-9446-88d16401ab77 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:25.985024 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2815365d-45fb-4fb6-9446-88d16401ab77 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:25.998354 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2815365d-45fb-4fb6-9446-88d16401ab77 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c" status: 200 len: 1505 microversion: 2.1 time: 0.800211 Jun 20 12:26:26.000190 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2771/5441] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:25 2022] GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c => generated 1505 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:26:26.265536 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d94e5f28-11a6-48f1-890b-7fb23ee4f69e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:26.267464 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d94e5f28-11a6-48f1-890b-7fb23ee4f69e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:26.290770 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d94e5f28-11a6-48f1-890b-7fb23ee4f69e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:26.295804 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d94e5f28-11a6-48f1-890b-7fb23ee4f69e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:26.301256 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d94e5f28-11a6-48f1-890b-7fb23ee4f69e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:26.304438 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d94e5f28-11a6-48f1-890b-7fb23ee4f69e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:26.563595 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-a4945c3e-6c6f-4c00-a3fe-791b6f6715d5 req-8a5e6e7c-5dcc-40f4-bc73-668eee0fa796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a35c3e87-7c93-4301-a5a4-de4034af784c", "name": "network-vif-deleted", "tag": "0bc7adfa-1ebc-4150-94cf-12c2683a86c4"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:26.616304 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-a4945c3e-6c6f-4c00-a3fe-791b6f6715d5 req-8a5e6e7c-5dcc-40f4-bc73-668eee0fa796 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:26.617276 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-a4945c3e-6c6f-4c00-a3fe-791b6f6715d5 req-8a5e6e7c-5dcc-40f4-bc73-668eee0fa796 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:26.669006 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d94e5f28-11a6-48f1-890b-7fb23ee4f69e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:26.687024 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d94e5f28-11a6-48f1-890b-7fb23ee4f69e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1681 microversion: 2.1 time: 0.431168 Jun 20 12:26:26.693137 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-a4945c3e-6c6f-4c00-a3fe-791b6f6715d5 req-8a5e6e7c-5dcc-40f4-bc73-668eee0fa796 service nova] Creating event network-vif-deleted:0bc7adfa-1ebc-4150-94cf-12c2683a86c4 for instance a35c3e87-7c93-4301-a5a4-de4034af784c on n-h1-master-1 Jun 20 12:26:26.705292 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2671/5442] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:26 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1681 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:26.727374 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-a4945c3e-6c6f-4c00-a3fe-791b6f6715d5 req-8a5e6e7c-5dcc-40f4-bc73-668eee0fa796 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171720 Jun 20 12:26:26.733603 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2772/5443] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:26:27.015063 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1a8f4449-8c15-43b4-90bf-c4f7848417a5 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:27.015818 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1a8f4449-8c15-43b4-90bf-c4f7848417a5 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:27.039430 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a8f4449-8c15-43b4-90bf-c4f7848417a5 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:27.043892 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a8f4449-8c15-43b4-90bf-c4f7848417a5 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:27.045482 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a8f4449-8c15-43b4-90bf-c4f7848417a5 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:27.046234 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a8f4449-8c15-43b4-90bf-c4f7848417a5 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:27.084553 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:27.102998 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a8f4449-8c15-43b4-90bf-c4f7848417a5 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:27.104919 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a8f4449-8c15-43b4-90bf-c4f7848417a5 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:27.105676 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-1a8f4449-8c15-43b4-90bf-c4f7848417a5 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lazy-loading 'fault' on Instance uuid a35c3e87-7c93-4301-a5a4-de4034af784c {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:26:27.248764 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1a8f4449-8c15-43b4-90bf-c4f7848417a5 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:27.262940 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1a8f4449-8c15-43b4-90bf-c4f7848417a5 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c" status: 200 len: 1303 microversion: 2.1 time: 0.248516 Jun 20 12:26:27.264273 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2672/5444] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:27 2022] GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c => generated 1303 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:27.720890 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cacb4458-87ec-46ca-932d-547a1fe7f339 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:27.721974 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cacb4458-87ec-46ca-932d-547a1fe7f339 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 5b047d91-122c-44ee-b96e-1e0836960caa] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:27.724135 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-95f37a5b-5b14-4558-869c-e580493fa65f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:27.725247 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-95f37a5b-5b14-4558-869c-e580493fa65f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:27.741802 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cacb4458-87ec-46ca-932d-547a1fe7f339 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:27.742447 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cacb4458-87ec-46ca-932d-547a1fe7f339 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:27.743729 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cacb4458-87ec-46ca-932d-547a1fe7f339 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:27.744396 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cacb4458-87ec-46ca-932d-547a1fe7f339 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:27.750242 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-95f37a5b-5b14-4558-869c-e580493fa65f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:27.750963 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-95f37a5b-5b14-4558-869c-e580493fa65f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:27.752136 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-95f37a5b-5b14-4558-869c-e580493fa65f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:27.752834 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-95f37a5b-5b14-4558-869c-e580493fa65f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:27.785481 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cacb4458-87ec-46ca-932d-547a1fe7f339 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080012 Jun 20 12:26:27.786638 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2673/5445] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:26:27 2022] GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:26:28.113746 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b8eda0d8-b747-4644-8d71-2b701900afc7 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:28.114703 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b8eda0d8-b747-4644-8d71-2b701900afc7 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 5b047d91-122c-44ee-b96e-1e0836960caa] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:28.131512 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b8eda0d8-b747-4644-8d71-2b701900afc7 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:28.131904 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b8eda0d8-b747-4644-8d71-2b701900afc7 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:28.132786 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b8eda0d8-b747-4644-8d71-2b701900afc7 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:28.133214 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b8eda0d8-b747-4644-8d71-2b701900afc7 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:28.215897 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b8eda0d8-b747-4644-8d71-2b701900afc7 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.104966 Jun 20 12:26:28.217013 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2674/5446] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:26:28 2022] GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa/os-volume_attachments => generated 25 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:26:28.239737 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-95f37a5b-5b14-4558-869c-e580493fa65f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:28.251453 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-95f37a5b-5b14-4558-869c-e580493fa65f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1681 microversion: 2.1 time: 0.547012 Jun 20 12:26:28.253256 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2773/5447] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:27 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1681 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:28.281151 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6edd93d5-d283-4308-9986-f39d986f6da3 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:28.282039 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6edd93d5-d283-4308-9986-f39d986f6da3 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: a35c3e87-7c93-4301-a5a4-de4034af784c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:28.291711 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6edd93d5-d283-4308-9986-f39d986f6da3 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:28.296174 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6edd93d5-d283-4308-9986-f39d986f6da3 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:28.297301 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6edd93d5-d283-4308-9986-f39d986f6da3 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:28.299722 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6edd93d5-d283-4308-9986-f39d986f6da3 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:28.311252 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8db00fa0-d8a8-4124-a957-10796db964b6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:28.312100 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8db00fa0-d8a8-4124-a957-10796db964b6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 5b047d91-122c-44ee-b96e-1e0836960caa] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:28.324954 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8db00fa0-d8a8-4124-a957-10796db964b6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:28.325895 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8db00fa0-d8a8-4124-a957-10796db964b6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:28.326799 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-6edd93d5-d283-4308-9986-f39d986f6da3 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] HTTP exception thrown: Instance a35c3e87-7c93-4301-a5a4-de4034af784c could not be found. Jun 20 12:26:28.326976 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8db00fa0-d8a8-4124-a957-10796db964b6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:28.327371 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8db00fa0-d8a8-4124-a957-10796db964b6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6edd93d5-d283-4308-9986-f39d986f6da3 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Request method failure captured: Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c HTTP/1.1 Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGcDupgGBGwciP5WwOa6EBAbnUELeDq1cfmXrHr69Dic_Q7Dt62MbPt6jHu0dUY1nZU5TaBuY6gYCaj2sAH_I98G4k6qn3g0v6IXBPzHeHQofDWGTLaMrm7kVvxwcZ3E_q46B4wi5DdtuxEYwRq_6F3HpK9egTc3r5ieHG3Pcb2Hmyw Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 44cb6606f6a04b8b910fa472b8846f02 Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServerRescueTestJSON-1628951111 Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/44cb6606f6a04b8b910fa472b8846f02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/44cb6606f6a04b8b910fa472b8846f02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/44cb6606f6a04b8b910fa472b8846f02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_44cb6606f6a04b8b910fa472b8846f02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServerRescueTestJSON-1628951111 Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 44cb6606f6a04b8b910fa472b8846f02 Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServerRescueTestJSON-1628951111 Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServerRescueTestJSON-1628951111-project Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 9c8447285bb44a86a82741c6b08c6007 Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServerRescueTestJSON-1628951111-project Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: exception: Instance a35c3e87-7c93-4301-a5a4-de4034af784c could not be found. Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'a35c3e87-7c93-4301-a5a4-de4034af784c'} Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a35c3e87-7c93-4301-a5a4-de4034af784c could not be found. Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a35c3e87-7c93-4301-a5a4-de4034af784c could not be found. Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:26:28.329273 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:26:28.333573 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:26:28.333573 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:26:28.333573 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:26:28.333573 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:26:28.333573 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:26:28.333573 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a35c3e87-7c93-4301-a5a4-de4034af784c could not be found. Jun 20 12:26:28.333573 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:26:28.335202 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6edd93d5-d283-4308-9986-f39d986f6da3 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Returning 404 to user: Instance a35c3e87-7c93-4301-a5a4-de4034af784c could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:26:28.336323 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6edd93d5-d283-4308-9986-f39d986f6da3 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c" status: 404 len: 111 microversion: 2.1 time: 0.059321 Jun 20 12:26:28.337585 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2675/5448] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:28 2022] GET /compute/v2.1/servers/a35c3e87-7c93-4301-a5a4-de4034af784c => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:26:28.346451 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-810d1c06-5900-4ca4-899c-c83b033121a9 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:28.357447 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-810d1c06-5900-4ca4-899c-c83b033121a9 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:28.364596 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-810d1c06-5900-4ca4-899c-c83b033121a9 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:28.365290 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-810d1c06-5900-4ca4-899c-c83b033121a9 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:28.365835 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8db00fa0-d8a8-4124-a957-10796db964b6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 5b047d91-122c-44ee-b96e-1e0836960caa] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:26:28.366477 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-810d1c06-5900-4ca4-899c-c83b033121a9 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:28.367083 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-810d1c06-5900-4ca4-899c-c83b033121a9 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:28.400301 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-810d1c06-5900-4ca4-899c-c83b033121a9 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:26:28.552754 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8db00fa0-d8a8-4124-a957-10796db964b6 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa" status: 204 len: 0 microversion: 2.1 time: 0.244735 Jun 20 12:26:28.553676 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2774/5449] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:26:28 2022] DELETE /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:26:28.566858 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5912976c-8c49-43db-abab-5a4534d50f74 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:28.567666 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5912976c-8c49-43db-abab-5a4534d50f74 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 5b047d91-122c-44ee-b96e-1e0836960caa] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:28.573930 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-810d1c06-5900-4ca4-899c-c83b033121a9 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 204 len: 0 microversion: 2.1 time: 0.230070 Jun 20 12:26:28.575738 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2676/5450] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:26:28 2022] DELETE /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:26:28.581540 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5912976c-8c49-43db-abab-5a4534d50f74 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:28.582645 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5912976c-8c49-43db-abab-5a4534d50f74 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:28.583480 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5912976c-8c49-43db-abab-5a4534d50f74 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:28.584092 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5912976c-8c49-43db-abab-5a4534d50f74 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:28.597770 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2708199d-18a6-4742-8972-1c4f5c6b6c75 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:28.598480 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2708199d-18a6-4742-8972-1c4f5c6b6c75 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:28.613089 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2708199d-18a6-4742-8972-1c4f5c6b6c75 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:28.616401 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2708199d-18a6-4742-8972-1c4f5c6b6c75 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:28.618942 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2708199d-18a6-4742-8972-1c4f5c6b6c75 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:28.622529 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2708199d-18a6-4742-8972-1c4f5c6b6c75 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:28.888308 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5912976c-8c49-43db-abab-5a4534d50f74 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:28.904279 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5912976c-8c49-43db-abab-5a4534d50f74 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa" status: 200 len: 1669 microversion: 2.1 time: 0.346243 Jun 20 12:26:28.906158 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2775/5451] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:28 2022] GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa => generated 1669 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:28.992482 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2708199d-18a6-4742-8972-1c4f5c6b6c75 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:29.021477 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2708199d-18a6-4742-8972-1c4f5c6b6c75 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1490 microversion: 2.1 time: 0.441247 Jun 20 12:26:29.029358 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2677/5452] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:28 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1490 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:29.269051 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9c3044b4-5768-4588-9100-3b09276f3f58 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:29.269670 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9c3044b4-5768-4588-9100-3b09276f3f58 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:29.282348 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9c3044b4-5768-4588-9100-3b09276f3f58 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:29.282813 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9c3044b4-5768-4588-9100-3b09276f3f58 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:29.283614 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9c3044b4-5768-4588-9100-3b09276f3f58 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:29.284058 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9c3044b4-5768-4588-9100-3b09276f3f58 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:29.406827 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-08b978ea-e910-4537-8101-98788615db64 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Action: 'create', calling method: .version_select at 0x7f6072973310>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-324843391", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSiQj/y3GuC8ouZokL34DJpXrPfVU/Rbd7kHPGSx+tNDwQ8gCcrzV6gGpq7Bi0j/5MUwFsoIbXhug62RdTyGXxXcz0o47V8uSYrVBvplEZuuPWafp2w82KY3xDEq1ibyw=="}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:29.411976 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:29.428652 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-08b978ea-e910-4537-8101-98788615db64 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Getting quotas for project 1ed88b4072a24b37a5ceec3b239ac8fa. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:26:29.437741 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-08b978ea-e910-4537-8101-98788615db64 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Getting quotas for user aeafcd88ca6c415e90b51c262b62597f and project 1ed88b4072a24b37a5ceec3b239ac8fa. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:26:29.475072 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-08b978ea-e910-4537-8101-98788615db64 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.072613 Jun 20 12:26:29.486159 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2678/5453] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 12:26:29 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:26:29.547659 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9c3044b4-5768-4588-9100-3b09276f3f58 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:29.558323 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9c3044b4-5768-4588-9100-3b09276f3f58 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1681 microversion: 2.1 time: 0.293630 Jun 20 12:26:29.559246 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2776/5454] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:29 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1681 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:29.926828 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a6f45ba5-9811-48bd-ac63-fef3f3bdd822 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:29.927696 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a6f45ba5-9811-48bd-ac63-fef3f3bdd822 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 5b047d91-122c-44ee-b96e-1e0836960caa] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:29.966886 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6f45ba5-9811-48bd-ac63-fef3f3bdd822 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:29.970029 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6f45ba5-9811-48bd-ac63-fef3f3bdd822 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:29.971781 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6f45ba5-9811-48bd-ac63-fef3f3bdd822 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:29.973661 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6f45ba5-9811-48bd-ac63-fef3f3bdd822 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:30.047893 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9fd4ae68-af90-4633-9e68-536b6148003f tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:30.049905 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9fd4ae68-af90-4633-9e68-536b6148003f tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:30.063571 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9fd4ae68-af90-4633-9e68-536b6148003f tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:30.064041 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9fd4ae68-af90-4633-9e68-536b6148003f tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:30.064873 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9fd4ae68-af90-4633-9e68-536b6148003f tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:30.065309 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9fd4ae68-af90-4633-9e68-536b6148003f tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:30.323534 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a6f45ba5-9811-48bd-ac63-fef3f3bdd822 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:30.332578 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a6f45ba5-9811-48bd-ac63-fef3f3bdd822 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa" status: 200 len: 1669 microversion: 2.1 time: 0.412632 Jun 20 12:26:30.333523 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2679/5455] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:29 2022] GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa => generated 1669 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:30.457630 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9fd4ae68-af90-4633-9e68-536b6148003f tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:30.471454 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9fd4ae68-af90-4633-9e68-536b6148003f tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1490 microversion: 2.1 time: 0.428061 Jun 20 12:26:30.476283 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2777/5456] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:30 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1490 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:30.576588 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2a5708cc-4ba7-4c47-b3d5-fbd379dc82b6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:30.577254 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2a5708cc-4ba7-4c47-b3d5-fbd379dc82b6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:30.587727 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a5708cc-4ba7-4c47-b3d5-fbd379dc82b6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:30.588177 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a5708cc-4ba7-4c47-b3d5-fbd379dc82b6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:30.591565 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a5708cc-4ba7-4c47-b3d5-fbd379dc82b6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:30.597935 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a5708cc-4ba7-4c47-b3d5-fbd379dc82b6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:30.867389 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2a5708cc-4ba7-4c47-b3d5-fbd379dc82b6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:30.879694 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2a5708cc-4ba7-4c47-b3d5-fbd379dc82b6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1681 microversion: 2.1 time: 0.306883 Jun 20 12:26:30.880322 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2680/5457] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:30 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1681 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:31.354450 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f6b4062f-eb6c-4053-a50d-823fa58f6b09 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:31.355186 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f6b4062f-eb6c-4053-a50d-823fa58f6b09 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 5b047d91-122c-44ee-b96e-1e0836960caa] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:31.374975 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f6b4062f-eb6c-4053-a50d-823fa58f6b09 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:31.382554 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f6b4062f-eb6c-4053-a50d-823fa58f6b09 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:31.384140 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f6b4062f-eb6c-4053-a50d-823fa58f6b09 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:31.386951 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f6b4062f-eb6c-4053-a50d-823fa58f6b09 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:31.491014 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4e08fee3-bca1-4ecf-9ab4-70efc411c261 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:31.494527 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4e08fee3-bca1-4ecf-9ab4-70efc411c261 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:31.505646 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4e08fee3-bca1-4ecf-9ab4-70efc411c261 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:31.506688 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4e08fee3-bca1-4ecf-9ab4-70efc411c261 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:31.507769 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4e08fee3-bca1-4ecf-9ab4-70efc411c261 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:31.508383 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4e08fee3-bca1-4ecf-9ab4-70efc411c261 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:31.787584 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4e08fee3-bca1-4ecf-9ab4-70efc411c261 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:31.797845 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4e08fee3-bca1-4ecf-9ab4-70efc411c261 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1490 microversion: 2.1 time: 0.312731 Jun 20 12:26:31.798508 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2681/5458] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:31 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1490 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:31.826014 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f7d1485b-af6b-4fd5-ac3a-00b5591ac195 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-368032220", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "b75c8cfe-4bf0-4640-a872-998e9909907e"}], "key_name": "tempest-TestNetworkBasicOps-324843391", "security_groups": [{"name": "tempest-secgroup-smoke-770184980"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:32.259879 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-f7d1485b-af6b-4fd5-ac3a-00b5591ac195 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] validate_networks() for [('b75c8cfe-4bf0-4640-a872-998e9909907e', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:26:32.408902 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f6b4062f-eb6c-4053-a50d-823fa58f6b09 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:32.419898 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f6b4062f-eb6c-4053-a50d-823fa58f6b09 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa" status: 200 len: 1669 microversion: 2.1 time: 1.073400 Jun 20 12:26:32.421852 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2778/5459] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:31 2022] GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa => generated 1669 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:32.428365 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4478f81b-a352-47b2-bcd7-9ba06a7becd0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:32.429203 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4478f81b-a352-47b2-bcd7-9ba06a7becd0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:32.458688 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4478f81b-a352-47b2-bcd7-9ba06a7becd0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:32.459454 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4478f81b-a352-47b2-bcd7-9ba06a7becd0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:32.460482 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4478f81b-a352-47b2-bcd7-9ba06a7becd0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:32.461261 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4478f81b-a352-47b2-bcd7-9ba06a7becd0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:32.707298 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4478f81b-a352-47b2-bcd7-9ba06a7becd0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:32.718937 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4478f81b-a352-47b2-bcd7-9ba06a7becd0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1681 microversion: 2.1 time: 0.295596 Jun 20 12:26:32.733498 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2779/5460] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:32 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1681 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:32.819537 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7c29fd96-e5dc-438b-a8b0-fca82607e185 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:32.820500 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7c29fd96-e5dc-438b-a8b0-fca82607e185 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:32.827841 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c29fd96-e5dc-438b-a8b0-fca82607e185 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:32.832827 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c29fd96-e5dc-438b-a8b0-fca82607e185 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:32.835098 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c29fd96-e5dc-438b-a8b0-fca82607e185 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:32.836823 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c29fd96-e5dc-438b-a8b0-fca82607e185 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:32.877770 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:32.993828 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-f7d1485b-af6b-4fd5-ac3a-00b5591ac195 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:26:32.995363 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-f7d1485b-af6b-4fd5-ac3a-00b5591ac195 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:26:32.996097 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-f7d1485b-af6b-4fd5-ac3a-00b5591ac195 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:26:32.996540 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-f7d1485b-af6b-4fd5-ac3a-00b5591ac195 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:26:32.996993 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-f7d1485b-af6b-4fd5-ac3a-00b5591ac195 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:26:33.028424 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7d1485b-af6b-4fd5-ac3a-00b5591ac195 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:33.029144 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7d1485b-af6b-4fd5-ac3a-00b5591ac195 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:33.032833 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7d1485b-af6b-4fd5-ac3a-00b5591ac195 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:33.033267 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7d1485b-af6b-4fd5-ac3a-00b5591ac195 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:33.080363 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-f7d1485b-af6b-4fd5-ac3a-00b5591ac195 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Getting quotas for project 1ed88b4072a24b37a5ceec3b239ac8fa. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:26:33.091185 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-f7d1485b-af6b-4fd5-ac3a-00b5591ac195 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Getting quotas for user aeafcd88ca6c415e90b51c262b62597f and project 1ed88b4072a24b37a5ceec3b239ac8fa. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:26:33.092131 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7c29fd96-e5dc-438b-a8b0-fca82607e185 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:33.122242 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7c29fd96-e5dc-438b-a8b0-fca82607e185 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1490 microversion: 2.1 time: 0.304310 Jun 20 12:26:33.124736 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2780/5461] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:32 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1490 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:33.133029 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f7d1485b-af6b-4fd5-ac3a-00b5591ac195 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:26:33.138093 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f7d1485b-af6b-4fd5-ac3a-00b5591ac195 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: 359ef5fc-a540-46a9-9e68-3f5118a6e7e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:26:33.216722 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f7d1485b-af6b-4fd5-ac3a-00b5591ac195 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.417009 Jun 20 12:26:33.218678 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2682/5462] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:26:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 1420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:26:33.229951 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-13b64e3b-fcb8-4558-a876-63210fb5c5d8 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:33.231014 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-13b64e3b-fcb8-4558-a876-63210fb5c5d8 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: 359ef5fc-a540-46a9-9e68-3f5118a6e7e2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:33.365267 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-13b64e3b-fcb8-4558-a876-63210fb5c5d8 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:33.381468 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-13b64e3b-fcb8-4558-a876-63210fb5c5d8 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2" status: 200 len: 1247 microversion: 2.1 time: 0.155950 Jun 20 12:26:33.397726 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2781/5463] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:33 2022] GET /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2 => generated 1247 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:33.440024 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-774f8621-f9e1-4b3b-bfe4-5b74e9e81926 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:33.442406 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-774f8621-f9e1-4b3b-bfe4-5b74e9e81926 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 5b047d91-122c-44ee-b96e-1e0836960caa] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:33.452805 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-774f8621-f9e1-4b3b-bfe4-5b74e9e81926 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:33.453531 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-774f8621-f9e1-4b3b-bfe4-5b74e9e81926 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:33.454381 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-774f8621-f9e1-4b3b-bfe4-5b74e9e81926 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:33.455043 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-774f8621-f9e1-4b3b-bfe4-5b74e9e81926 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:33.742692 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e4743fe1-d262-46ff-ad31-2dc6fce4ce35 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:33.743649 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e4743fe1-d262-46ff-ad31-2dc6fce4ce35 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:33.759441 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e4743fe1-d262-46ff-ad31-2dc6fce4ce35 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:33.760970 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e4743fe1-d262-46ff-ad31-2dc6fce4ce35 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:33.767527 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e4743fe1-d262-46ff-ad31-2dc6fce4ce35 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:33.769623 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e4743fe1-d262-46ff-ad31-2dc6fce4ce35 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:34.098896 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-774f8621-f9e1-4b3b-bfe4-5b74e9e81926 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:34.118049 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-774f8621-f9e1-4b3b-bfe4-5b74e9e81926 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa" status: 200 len: 1669 microversion: 2.1 time: 0.682251 Jun 20 12:26:34.153654 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2683/5464] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:33 2022] GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa => generated 1669 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:34.179462 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f75552ac-6f91-4cd6-945f-0325be59cff9 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:34.182020 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f75552ac-6f91-4cd6-945f-0325be59cff9 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:34.198968 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f75552ac-6f91-4cd6-945f-0325be59cff9 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:34.202519 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f75552ac-6f91-4cd6-945f-0325be59cff9 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:34.205003 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f75552ac-6f91-4cd6-945f-0325be59cff9 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:34.224410 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f75552ac-6f91-4cd6-945f-0325be59cff9 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:34.256280 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e4743fe1-d262-46ff-ad31-2dc6fce4ce35 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:34.267130 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e4743fe1-d262-46ff-ad31-2dc6fce4ce35 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1681 microversion: 2.1 time: 0.529954 Jun 20 12:26:34.270350 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2782/5465] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:33 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1681 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:34.404715 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bd036747-4941-4fc9-ac82-e2c4b9b7865f tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:34.405612 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bd036747-4941-4fc9-ac82-e2c4b9b7865f tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: 359ef5fc-a540-46a9-9e68-3f5118a6e7e2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:34.413208 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bd036747-4941-4fc9-ac82-e2c4b9b7865f tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:34.413986 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bd036747-4941-4fc9-ac82-e2c4b9b7865f tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:34.415002 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bd036747-4941-4fc9-ac82-e2c4b9b7865f tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:34.415875 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bd036747-4941-4fc9-ac82-e2c4b9b7865f tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:34.572000 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bd036747-4941-4fc9-ac82-e2c4b9b7865f tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:34.587768 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bd036747-4941-4fc9-ac82-e2c4b9b7865f tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2" status: 200 len: 1299 microversion: 2.1 time: 0.183676 Jun 20 12:26:34.589337 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2783/5466] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:34 2022] GET /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2 => generated 1299 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:26:34.654501 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-86a2eba0-685b-4e5d-a80f-8d9050b52c06 req-f1364e09-0cca-4b86-b997-9fa0f1d8abe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a39f2a3-183c-4001-83fa-3da4af7a0499", "name": "network-vif-deleted", "tag": "ed733439-4670-46a8-83fa-cc401c52c7a1"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:34.666609 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-86a2eba0-685b-4e5d-a80f-8d9050b52c06 req-f1364e09-0cca-4b86-b997-9fa0f1d8abe8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:34.670696 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-86a2eba0-685b-4e5d-a80f-8d9050b52c06 req-f1364e09-0cca-4b86-b997-9fa0f1d8abe8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:34.727821 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-86a2eba0-685b-4e5d-a80f-8d9050b52c06 req-f1364e09-0cca-4b86-b997-9fa0f1d8abe8 service nova] Creating event network-vif-deleted:ed733439-4670-46a8-83fa-cc401c52c7a1 for instance 1a39f2a3-183c-4001-83fa-3da4af7a0499 on n-h2-master-1 Jun 20 12:26:34.748329 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-86a2eba0-685b-4e5d-a80f-8d9050b52c06 req-f1364e09-0cca-4b86-b997-9fa0f1d8abe8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095866 Jun 20 12:26:34.752120 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2784/5467] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:26:34.773027 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f75552ac-6f91-4cd6-945f-0325be59cff9 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8447285bb44a86a82741c6b08c6007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cb6606f6a04b8b910fa472b8846f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:34.791929 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f75552ac-6f91-4cd6-945f-0325be59cff9 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 200 len: 1490 microversion: 2.1 time: 0.627267 Jun 20 12:26:34.794299 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2684/5468] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:34 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 1490 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:35.144079 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2907326c-2470-4005-968b-831a83c086d3 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:35.145283 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2907326c-2470-4005-968b-831a83c086d3 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 5b047d91-122c-44ee-b96e-1e0836960caa] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:35.161850 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-745ed84f-5bd8-43ba-ae7c-6b2d7565e276 req-93f49fa4-fb8a-44ac-970a-6f1ce3018f48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b047d91-122c-44ee-b96e-1e0836960caa", "name": "network-vif-deleted", "tag": "22195dfd-111f-4198-a632-bf1919d0b981"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:35.163787 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2907326c-2470-4005-968b-831a83c086d3 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:35.166692 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2907326c-2470-4005-968b-831a83c086d3 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:35.171031 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2907326c-2470-4005-968b-831a83c086d3 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:35.171031 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2907326c-2470-4005-968b-831a83c086d3 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:35.178851 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-745ed84f-5bd8-43ba-ae7c-6b2d7565e276 req-93f49fa4-fb8a-44ac-970a-6f1ce3018f48 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:35.179805 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-745ed84f-5bd8-43ba-ae7c-6b2d7565e276 req-93f49fa4-fb8a-44ac-970a-6f1ce3018f48 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:35.237074 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-745ed84f-5bd8-43ba-ae7c-6b2d7565e276 req-93f49fa4-fb8a-44ac-970a-6f1ce3018f48 service nova] Creating event network-vif-deleted:22195dfd-111f-4198-a632-bf1919d0b981 for instance 5b047d91-122c-44ee-b96e-1e0836960caa on n-h2-master-1 Jun 20 12:26:35.255124 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-745ed84f-5bd8-43ba-ae7c-6b2d7565e276 req-93f49fa4-fb8a-44ac-970a-6f1ce3018f48 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097349 Jun 20 12:26:35.258130 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2685/5469] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:26:35.288343 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-be737bf8-e288-4d3e-81bb-919bedcbe0c8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:35.289481 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-be737bf8-e288-4d3e-81bb-919bedcbe0c8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:35.318655 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-be737bf8-e288-4d3e-81bb-919bedcbe0c8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:35.319714 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-be737bf8-e288-4d3e-81bb-919bedcbe0c8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:35.323797 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-be737bf8-e288-4d3e-81bb-919bedcbe0c8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:35.326014 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-be737bf8-e288-4d3e-81bb-919bedcbe0c8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:35.435798 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2907326c-2470-4005-968b-831a83c086d3 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0174505a4b2b404dbab8c4aaf399e057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32e6c9093de44cf932e533ee20b0e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:35.455464 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2907326c-2470-4005-968b-831a83c086d3 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa" status: 200 len: 1603 microversion: 2.1 time: 0.319615 Jun 20 12:26:35.457903 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2785/5470] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:35 2022] GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa => generated 1603 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:35.607250 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fa89a1c8-5ea5-4a79-923a-305b9a3c4bf5 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:35.608227 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fa89a1c8-5ea5-4a79-923a-305b9a3c4bf5 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: 359ef5fc-a540-46a9-9e68-3f5118a6e7e2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:35.630827 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fa89a1c8-5ea5-4a79-923a-305b9a3c4bf5 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:35.633408 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fa89a1c8-5ea5-4a79-923a-305b9a3c4bf5 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:35.635426 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fa89a1c8-5ea5-4a79-923a-305b9a3c4bf5 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:35.640779 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fa89a1c8-5ea5-4a79-923a-305b9a3c4bf5 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:35.798875 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fa89a1c8-5ea5-4a79-923a-305b9a3c4bf5 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:35.812103 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fa89a1c8-5ea5-4a79-923a-305b9a3c4bf5 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2" status: 200 len: 1305 microversion: 2.1 time: 0.206799 Jun 20 12:26:35.812787 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2786/5471] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:35 2022] GET /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2 => generated 1305 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:35.821575 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-be737bf8-e288-4d3e-81bb-919bedcbe0c8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:35.828286 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-626624e2-7909-4e4e-a7c7-1910eebd6f46 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:35.828915 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-626624e2-7909-4e4e-a7c7-1910eebd6f46 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] [instance: 1a39f2a3-183c-4001-83fa-3da4af7a0499] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:35.851411 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-be737bf8-e288-4d3e-81bb-919bedcbe0c8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1658 microversion: 2.1 time: 0.567239 Jun 20 12:26:35.855346 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2686/5472] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:35 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1658 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:35.860808 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-626624e2-7909-4e4e-a7c7-1910eebd6f46 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:35.861176 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-626624e2-7909-4e4e-a7c7-1910eebd6f46 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:35.862149 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-626624e2-7909-4e4e-a7c7-1910eebd6f46 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:35.862591 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-626624e2-7909-4e4e-a7c7-1910eebd6f46 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:35.878406 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-493accee-921d-414b-b951-f0782ee62b80 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:35.902982 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-493accee-921d-414b-b951-f0782ee62b80 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:35.903663 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-626624e2-7909-4e4e-a7c7-1910eebd6f46 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] HTTP exception thrown: Instance 1a39f2a3-183c-4001-83fa-3da4af7a0499 could not be found. Jun 20 12:26:35.904348 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-493accee-921d-414b-b951-f0782ee62b80 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-626624e2-7909-4e4e-a7c7-1910eebd6f46 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Request method failure captured: Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 HTTP/1.1 Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGcDupgGBGwciP5WwOa6EBAbnUELeDq1cfmXrHr69Dic_Q7Dt62MbPt6jHu0dUY1nZU5TaBuY6gYCaj2sAH_I98G4k6qn3g0v6IXBPzHeHQofDWGTLaMrm7kVvxwcZ3E_q46B4wi5DdtuxEYwRq_6F3HpK9egTc3r5ieHG3Pcb2Hmyw Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 44cb6606f6a04b8b910fa472b8846f02 Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServerRescueTestJSON-1628951111 Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/44cb6606f6a04b8b910fa472b8846f02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/44cb6606f6a04b8b910fa472b8846f02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/44cb6606f6a04b8b910fa472b8846f02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_44cb6606f6a04b8b910fa472b8846f02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServerRescueTestJSON-1628951111 Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 44cb6606f6a04b8b910fa472b8846f02 Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServerRescueTestJSON-1628951111 Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServerRescueTestJSON-1628951111-project Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 9c8447285bb44a86a82741c6b08c6007 Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServerRescueTestJSON-1628951111-project Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 1a39f2a3-183c-4001-83fa-3da4af7a0499 could not be found. Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '1a39f2a3-183c-4001-83fa-3da4af7a0499'} Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a39f2a3-183c-4001-83fa-3da4af7a0499 could not be found. Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a39f2a3-183c-4001-83fa-3da4af7a0499 could not be found. Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:26:35.906797 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:26:35.911120 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:26:35.911120 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:26:35.911120 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:26:35.911120 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:26:35.911120 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:26:35.911120 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a39f2a3-183c-4001-83fa-3da4af7a0499 could not be found. Jun 20 12:26:35.911120 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:26:35.914582 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-626624e2-7909-4e4e-a7c7-1910eebd6f46 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] Returning 404 to user: Instance 1a39f2a3-183c-4001-83fa-3da4af7a0499 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:26:35.930673 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-626624e2-7909-4e4e-a7c7-1910eebd6f46 tempest-ServerRescueTestJSON-1628951111 tempest-ServerRescueTestJSON-1628951111-project] 10.222.0.27 "GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499" status: 404 len: 111 microversion: 2.1 time: 0.116383 Jun 20 12:26:35.939274 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2787/5473] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:35 2022] GET /compute/v2.1/servers/1a39f2a3-183c-4001-83fa-3da4af7a0499 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:26:35.996726 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-493accee-921d-414b-b951-f0782ee62b80 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Going to try to start instance {{(pid=119128) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 20 12:26:36.099349 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-493accee-921d-414b-b951-f0782ee62b80 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "POST /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/action" status: 202 len: 0 microversion: 2.1 time: 0.231075 Jun 20 12:26:36.112670 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2687/5474] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:26:35 2022] POST /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 12:26:36.122621 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3c9cb7be-9cd1-4d9a-89dc-2f116e1d1432 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:36.123385 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3c9cb7be-9cd1-4d9a-89dc-2f116e1d1432 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:36.150558 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c9cb7be-9cd1-4d9a-89dc-2f116e1d1432 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:36.151016 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c9cb7be-9cd1-4d9a-89dc-2f116e1d1432 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:36.151812 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c9cb7be-9cd1-4d9a-89dc-2f116e1d1432 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:36.152451 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c9cb7be-9cd1-4d9a-89dc-2f116e1d1432 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:36.476796 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2819b2fa-b76b-48d5-bc3f-e3d77bf71fae tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:36.478296 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2819b2fa-b76b-48d5-bc3f-e3d77bf71fae tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 5b047d91-122c-44ee-b96e-1e0836960caa] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:36.490209 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2819b2fa-b76b-48d5-bc3f-e3d77bf71fae tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:36.497301 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2819b2fa-b76b-48d5-bc3f-e3d77bf71fae tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:36.498581 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2819b2fa-b76b-48d5-bc3f-e3d77bf71fae tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:36.499267 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2819b2fa-b76b-48d5-bc3f-e3d77bf71fae tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:36.541301 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-2819b2fa-b76b-48d5-bc3f-e3d77bf71fae tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] HTTP exception thrown: Instance 5b047d91-122c-44ee-b96e-1e0836960caa could not be found. Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2819b2fa-b76b-48d5-bc3f-e3d77bf71fae tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Request method failure captured: Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa HTTP/1.1 Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGWLkuKwKPjdKtUhc6dNGwsLHhL8Mdhfpzf_4vXVWLCDSgHqf13sQd-9LF3MGnQa8psDEc9JEkJzZSaw9_ikn85Q0ll0Nix-ZVBlwng9bwAGAqG_v56imSaNIrFE1kQs0xywtIhYs4nVxj6oFHlE90I0jsmgvQVO4a7me_Rr1FZasH4 Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: e32e6c9093de44cf932e533ee20b0e31 Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-AttachVolumeTestJSON-1076215088 Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e32e6c9093de44cf932e533ee20b0e31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e32e6c9093de44cf932e533ee20b0e31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e32e6c9093de44cf932e533ee20b0e31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e32e6c9093de44cf932e533ee20b0e31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-AttachVolumeTestJSON-1076215088 Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: e32e6c9093de44cf932e533ee20b0e31 Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1076215088 Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-AttachVolumeTestJSON-1076215088-project Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 0174505a4b2b404dbab8c4aaf399e057 Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-AttachVolumeTestJSON-1076215088-project Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 5b047d91-122c-44ee-b96e-1e0836960caa could not be found. Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '5b047d91-122c-44ee-b96e-1e0836960caa'} Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b047d91-122c-44ee-b96e-1e0836960caa could not be found. Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b047d91-122c-44ee-b96e-1e0836960caa could not be found. Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:26:36.555430 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:26:36.560359 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:26:36.560359 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:26:36.560359 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:26:36.560359 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:26:36.560359 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:26:36.560359 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b047d91-122c-44ee-b96e-1e0836960caa could not be found. Jun 20 12:26:36.560359 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:26:36.561998 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2819b2fa-b76b-48d5-bc3f-e3d77bf71fae tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Returning 404 to user: Instance 5b047d91-122c-44ee-b96e-1e0836960caa could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:26:36.564234 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2819b2fa-b76b-48d5-bc3f-e3d77bf71fae tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa" status: 404 len: 111 microversion: 2.1 time: 0.092204 Jun 20 12:26:36.572110 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2688/5475] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:36 2022] GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:26:36.586447 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-40b95176-3648-457c-a6ae-4ce2a83b1a6a tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '.version_select at 0x7f60724f3dc0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:36.635608 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-40b95176-3648-457c-a6ae-4ce2a83b1a6a tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2010489312" status: 202 len: 0 microversion: 2.1 time: 0.058349 Jun 20 12:26:36.636404 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2689/5476] 10.222.0.27 () {58 vars in 1220 bytes} [Mon Jun 20 12:26:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2010489312 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 12:26:36.832619 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7abe26ef-81ec-4647-b3f9-654c3bb2b246 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:36.833248 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7abe26ef-81ec-4647-b3f9-654c3bb2b246 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: 359ef5fc-a540-46a9-9e68-3f5118a6e7e2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:36.846098 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7abe26ef-81ec-4647-b3f9-654c3bb2b246 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:36.851995 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7abe26ef-81ec-4647-b3f9-654c3bb2b246 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:36.853091 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7abe26ef-81ec-4647-b3f9-654c3bb2b246 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:36.853691 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7abe26ef-81ec-4647-b3f9-654c3bb2b246 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:36.902385 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:37.219565 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7abe26ef-81ec-4647-b3f9-654c3bb2b246 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:37.236128 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7abe26ef-81ec-4647-b3f9-654c3bb2b246 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2" status: 200 len: 1305 microversion: 2.1 time: 0.408855 Jun 20 12:26:37.237837 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2690/5477] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:36 2022] GET /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2 => generated 1305 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:37.528259 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3c9cb7be-9cd1-4d9a-89dc-2f116e1d1432 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:37.544144 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3c9cb7be-9cd1-4d9a-89dc-2f116e1d1432 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1667 microversion: 2.1 time: 1.427936 Jun 20 12:26:37.545056 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2788/5478] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:36 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1667 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:38.256195 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dbc526af-1dcc-4f9e-9e63-51166a4eb367 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:38.256866 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-dbc526af-1dcc-4f9e-9e63-51166a4eb367 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: 359ef5fc-a540-46a9-9e68-3f5118a6e7e2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:38.286894 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dbc526af-1dcc-4f9e-9e63-51166a4eb367 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:38.287263 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dbc526af-1dcc-4f9e-9e63-51166a4eb367 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:38.288082 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dbc526af-1dcc-4f9e-9e63-51166a4eb367 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:38.288553 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dbc526af-1dcc-4f9e-9e63-51166a4eb367 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:38.562942 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bbc3fc61-1b05-4b38-9a86-659136c71f41 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:38.564288 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bbc3fc61-1b05-4b38-9a86-659136c71f41 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:38.574322 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bbc3fc61-1b05-4b38-9a86-659136c71f41 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:38.575160 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bbc3fc61-1b05-4b38-9a86-659136c71f41 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:38.576522 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bbc3fc61-1b05-4b38-9a86-659136c71f41 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:38.577263 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bbc3fc61-1b05-4b38-9a86-659136c71f41 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:38.737774 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-dbc526af-1dcc-4f9e-9e63-51166a4eb367 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:38.757193 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dbc526af-1dcc-4f9e-9e63-51166a4eb367 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2" status: 200 len: 1372 microversion: 2.1 time: 0.506824 Jun 20 12:26:38.772304 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2691/5479] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:38 2022] GET /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2 => generated 1372 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:39.107282 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bbc3fc61-1b05-4b38-9a86-659136c71f41 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:39.121558 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bbc3fc61-1b05-4b38-9a86-659136c71f41 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1667 microversion: 2.1 time: 0.562872 Jun 20 12:26:39.122861 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2789/5480] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:38 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1667 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:26:39.779120 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f7b6a8f1-086d-4f03-acdf-784c3a13ff9d tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:39.779810 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f7b6a8f1-086d-4f03-acdf-784c3a13ff9d tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: 359ef5fc-a540-46a9-9e68-3f5118a6e7e2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:39.794161 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7b6a8f1-086d-4f03-acdf-784c3a13ff9d tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:39.799239 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7b6a8f1-086d-4f03-acdf-784c3a13ff9d tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:39.804329 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7b6a8f1-086d-4f03-acdf-784c3a13ff9d tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:39.807116 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7b6a8f1-086d-4f03-acdf-784c3a13ff9d tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:40.071814 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-ab867659-3004-4979-b02a-81004e41f549 req-abcf3bbe-476f-4aac-8c02-9e48dcb43449 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "359ef5fc-a540-46a9-9e68-3f5118a6e7e2", "tag": "197f938e-4f1a-4410-a945-7fd2dd1c6261"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:40.095910 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ab867659-3004-4979-b02a-81004e41f549 req-abcf3bbe-476f-4aac-8c02-9e48dcb43449 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:40.096472 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ab867659-3004-4979-b02a-81004e41f549 req-abcf3bbe-476f-4aac-8c02-9e48dcb43449 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:40.113249 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-ab867659-3004-4979-b02a-81004e41f549 req-abcf3bbe-476f-4aac-8c02-9e48dcb43449 service nova] Creating event network-changed:197f938e-4f1a-4410-a945-7fd2dd1c6261 for instance 359ef5fc-a540-46a9-9e68-3f5118a6e7e2 on n-h1-master-1 Jun 20 12:26:40.120661 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-ab867659-3004-4979-b02a-81004e41f549 req-abcf3bbe-476f-4aac-8c02-9e48dcb43449 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053223 Jun 20 12:26:40.147830 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2790/5481] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:26:40.164821 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-acf65252-c275-4dcd-8371-cadc0878b6d0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:40.167129 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-acf65252-c275-4dcd-8371-cadc0878b6d0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:40.176465 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-acf65252-c275-4dcd-8371-cadc0878b6d0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:40.177193 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-acf65252-c275-4dcd-8371-cadc0878b6d0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:40.178154 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-acf65252-c275-4dcd-8371-cadc0878b6d0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:40.178822 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-acf65252-c275-4dcd-8371-cadc0878b6d0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:40.418941 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f7b6a8f1-086d-4f03-acdf-784c3a13ff9d tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:40.427198 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f7b6a8f1-086d-4f03-acdf-784c3a13ff9d tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2" status: 200 len: 1372 microversion: 2.1 time: 0.652974 Jun 20 12:26:40.427798 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2692/5482] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:39 2022] GET /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2 => generated 1372 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:40.609749 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-acf65252-c275-4dcd-8371-cadc0878b6d0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:40.619006 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-acf65252-c275-4dcd-8371-cadc0878b6d0 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.469372 Jun 20 12:26:40.620354 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2791/5483] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:40 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:40.636619 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5bb7741a-be6e-44b3-838f-3531fcd88011 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:40.637244 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5bb7741a-be6e-44b3-838f-3531fcd88011 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:40.646295 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5bb7741a-be6e-44b3-838f-3531fcd88011 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:40.646915 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5bb7741a-be6e-44b3-838f-3531fcd88011 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:40.647757 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5bb7741a-be6e-44b3-838f-3531fcd88011 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:40.648266 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5bb7741a-be6e-44b3-838f-3531fcd88011 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:40.961168 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5bb7741a-be6e-44b3-838f-3531fcd88011 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:40.979921 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5bb7741a-be6e-44b3-838f-3531fcd88011 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.346963 Jun 20 12:26:40.980853 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2693/5484] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:40 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:26:41.000068 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ee6e8b18-d48d-415d-98b7-4610fccf8d87 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:41.000781 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ee6e8b18-d48d-415d-98b7-4610fccf8d87 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:41.017832 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee6e8b18-d48d-415d-98b7-4610fccf8d87 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:41.022135 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee6e8b18-d48d-415d-98b7-4610fccf8d87 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:41.023306 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee6e8b18-d48d-415d-98b7-4610fccf8d87 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:41.023900 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee6e8b18-d48d-415d-98b7-4610fccf8d87 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:41.445424 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cdc55bfb-36c9-4343-bf8d-cf5346aab9ad tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:41.446605 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cdc55bfb-36c9-4343-bf8d-cf5346aab9ad tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: 359ef5fc-a540-46a9-9e68-3f5118a6e7e2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:41.463334 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cdc55bfb-36c9-4343-bf8d-cf5346aab9ad tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:41.464183 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cdc55bfb-36c9-4343-bf8d-cf5346aab9ad tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:41.465800 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cdc55bfb-36c9-4343-bf8d-cf5346aab9ad tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:41.467649 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cdc55bfb-36c9-4343-bf8d-cf5346aab9ad tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:41.709761 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-cdc55bfb-36c9-4343-bf8d-cf5346aab9ad tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:41.713733 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ee6e8b18-d48d-415d-98b7-4610fccf8d87 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:41.719864 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cdc55bfb-36c9-4343-bf8d-cf5346aab9ad tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2" status: 200 len: 1372 microversion: 2.1 time: 0.278733 Jun 20 12:26:41.721882 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2694/5485] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:41 2022] GET /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2 => generated 1372 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:41.723784 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ee6e8b18-d48d-415d-98b7-4610fccf8d87 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.728416 Jun 20 12:26:41.727296 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2792/5486] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:40 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:41.743078 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-01baf8b3-6201-4a7d-9360-bdc7e85d2c62 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:41.743965 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-01baf8b3-6201-4a7d-9360-bdc7e85d2c62 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:41.752829 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-01baf8b3-6201-4a7d-9360-bdc7e85d2c62 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:41.753729 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-01baf8b3-6201-4a7d-9360-bdc7e85d2c62 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:41.755045 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-01baf8b3-6201-4a7d-9360-bdc7e85d2c62 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:41.755818 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-01baf8b3-6201-4a7d-9360-bdc7e85d2c62 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:42.031935 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-01baf8b3-6201-4a7d-9360-bdc7e85d2c62 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:42.043485 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-01baf8b3-6201-4a7d-9360-bdc7e85d2c62 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.305771 Jun 20 12:26:42.044300 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2695/5487] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:41 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:42.059802 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8817dcb2-7f72-4c7c-9bfa-d83e9f4d5c75 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:42.060455 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8817dcb2-7f72-4c7c-9bfa-d83e9f4d5c75 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:42.071256 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:42.073089 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8817dcb2-7f72-4c7c-9bfa-d83e9f4d5c75 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:42.073793 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8817dcb2-7f72-4c7c-9bfa-d83e9f4d5c75 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:42.074804 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8817dcb2-7f72-4c7c-9bfa-d83e9f4d5c75 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:42.077031 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8817dcb2-7f72-4c7c-9bfa-d83e9f4d5c75 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:42.674440 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8817dcb2-7f72-4c7c-9bfa-d83e9f4d5c75 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:42.703681 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8817dcb2-7f72-4c7c-9bfa-d83e9f4d5c75 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.647635 Jun 20 12:26:42.704805 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2793/5488] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:42 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:42.736692 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5afa5f0a-c0ee-4d4a-8d52-3d1fd97f1beb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:42.737678 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5afa5f0a-c0ee-4d4a-8d52-3d1fd97f1beb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:42.739614 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ce20ec79-e2ae-4b80-b6d7-d5402751c36a tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:42.742368 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ce20ec79-e2ae-4b80-b6d7-d5402751c36a tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: 359ef5fc-a540-46a9-9e68-3f5118a6e7e2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:42.762262 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5afa5f0a-c0ee-4d4a-8d52-3d1fd97f1beb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:42.764136 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5afa5f0a-c0ee-4d4a-8d52-3d1fd97f1beb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:42.765389 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5afa5f0a-c0ee-4d4a-8d52-3d1fd97f1beb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:42.769406 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5afa5f0a-c0ee-4d4a-8d52-3d1fd97f1beb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:42.770502 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ce20ec79-e2ae-4b80-b6d7-d5402751c36a tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:42.771247 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ce20ec79-e2ae-4b80-b6d7-d5402751c36a tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:42.772408 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ce20ec79-e2ae-4b80-b6d7-d5402751c36a tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:42.773114 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ce20ec79-e2ae-4b80-b6d7-d5402751c36a tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:42.826711 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-5afa5f0a-c0ee-4d4a-8d52-3d1fd97f1beb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lazy-loading 'flavor' on Instance uuid 21609be7-c3f0-4e24-a093-2f74ce957a35 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:26:42.990062 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5afa5f0a-c0ee-4d4a-8d52-3d1fd97f1beb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "POST /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/action" status: 202 len: 0 microversion: 2.1 time: 0.258446 Jun 20 12:26:42.992282 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2696/5489] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:26:42 2022] POST /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:26:43.053933 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e06a9752-a12c-47eb-8414-e44db85130c2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:43.056536 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e06a9752-a12c-47eb-8414-e44db85130c2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:43.066654 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:43.096083 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e06a9752-a12c-47eb-8414-e44db85130c2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:43.098169 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e06a9752-a12c-47eb-8414-e44db85130c2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:43.108451 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e06a9752-a12c-47eb-8414-e44db85130c2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:43.132191 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e06a9752-a12c-47eb-8414-e44db85130c2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:43.133769 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=10 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:43.255434 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ce20ec79-e2ae-4b80-b6d7-d5402751c36a tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:43.271409 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ce20ec79-e2ae-4b80-b6d7-d5402751c36a tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2" status: 200 len: 1372 microversion: 2.1 time: 0.537096 Jun 20 12:26:43.284646 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2794/5490] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:42 2022] GET /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2 => generated 1372 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:43.579184 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e06a9752-a12c-47eb-8414-e44db85130c2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:43.593851 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e06a9752-a12c-47eb-8414-e44db85130c2 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1679 microversion: 2.1 time: 0.590251 Jun 20 12:26:43.606685 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2697/5491] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:42 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1679 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:44.299454 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cf88fc47-d057-452b-9a80-baf8deb74f90 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:44.300136 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cf88fc47-d057-452b-9a80-baf8deb74f90 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: 359ef5fc-a540-46a9-9e68-3f5118a6e7e2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:44.310410 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:44.318986 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cf88fc47-d057-452b-9a80-baf8deb74f90 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:44.320148 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cf88fc47-d057-452b-9a80-baf8deb74f90 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:44.321642 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cf88fc47-d057-452b-9a80-baf8deb74f90 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:44.322265 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cf88fc47-d057-452b-9a80-baf8deb74f90 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:44.616249 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cf88fc47-d057-452b-9a80-baf8deb74f90 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:44.632446 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e21ce8ea-e1c9-49e1-b6ea-de8d0d3a2149 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:44.633513 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e21ce8ea-e1c9-49e1-b6ea-de8d0d3a2149 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:44.641817 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cf88fc47-d057-452b-9a80-baf8deb74f90 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2" status: 200 len: 1372 microversion: 2.1 time: 0.346326 Jun 20 12:26:44.642427 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2795/5492] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:44 2022] GET /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2 => generated 1372 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:44.699545 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e21ce8ea-e1c9-49e1-b6ea-de8d0d3a2149 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:44.710294 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e21ce8ea-e1c9-49e1-b6ea-de8d0d3a2149 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:44.711733 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e21ce8ea-e1c9-49e1-b6ea-de8d0d3a2149 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:44.712536 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e21ce8ea-e1c9-49e1-b6ea-de8d0d3a2149 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:45.114580 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e21ce8ea-e1c9-49e1-b6ea-de8d0d3a2149 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:45.146298 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e21ce8ea-e1c9-49e1-b6ea-de8d0d3a2149 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1662 microversion: 2.1 time: 0.520868 Jun 20 12:26:45.149676 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2698/5493] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:44 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1662 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:45.167099 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-98e77cac-fdc7-4816-bc41-7eb5b9844d1c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:45.168285 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-98e77cac-fdc7-4816-bc41-7eb5b9844d1c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:45.180493 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-98e77cac-fdc7-4816-bc41-7eb5b9844d1c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:45.185114 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-98e77cac-fdc7-4816-bc41-7eb5b9844d1c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:45.190251 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-98e77cac-fdc7-4816-bc41-7eb5b9844d1c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:45.192955 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-98e77cac-fdc7-4816-bc41-7eb5b9844d1c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:45.379364 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-98e77cac-fdc7-4816-bc41-7eb5b9844d1c tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "POST /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/action" status: 202 len: 0 microversion: 2.1 time: 0.214031 Jun 20 12:26:45.380096 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2796/5494] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:26:45 2022] POST /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:26:45.389398 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f43e0f37-62da-4afe-8983-323aba74a856 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:45.390270 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f43e0f37-62da-4afe-8983-323aba74a856 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:45.404730 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f43e0f37-62da-4afe-8983-323aba74a856 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:45.405185 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f43e0f37-62da-4afe-8983-323aba74a856 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:45.406036 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f43e0f37-62da-4afe-8983-323aba74a856 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:45.406468 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f43e0f37-62da-4afe-8983-323aba74a856 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:45.670273 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dd04563d-cff7-408a-bc5a-61a94897bfd6 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:45.671791 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dd04563d-cff7-408a-bc5a-61a94897bfd6 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: 359ef5fc-a540-46a9-9e68-3f5118a6e7e2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:45.697137 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd04563d-cff7-408a-bc5a-61a94897bfd6 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:45.698634 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd04563d-cff7-408a-bc5a-61a94897bfd6 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:45.699452 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd04563d-cff7-408a-bc5a-61a94897bfd6 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:45.699886 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd04563d-cff7-408a-bc5a-61a94897bfd6 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:46.022157 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dd04563d-cff7-408a-bc5a-61a94897bfd6 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:46.036958 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dd04563d-cff7-408a-bc5a-61a94897bfd6 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2" status: 200 len: 1372 microversion: 2.1 time: 0.374750 Jun 20 12:26:46.047077 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2797/5495] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:45 2022] GET /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2 => generated 1372 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:46.144611 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f43e0f37-62da-4afe-8983-323aba74a856 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:46.160990 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f43e0f37-62da-4afe-8983-323aba74a856 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1668 microversion: 2.1 time: 0.773015 Jun 20 12:26:46.164945 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2699/5496] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:45 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1668 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:46.594342 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-046bec28-03f9-46fa-b0d3-a997de01ffd7 req-5362b015-5946-4b6b-9dbd-157a99957766 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "359ef5fc-a540-46a9-9e68-3f5118a6e7e2", "name": "network-vif-plugged", "status": "completed", "tag": "197f938e-4f1a-4410-a945-7fd2dd1c6261"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:46.628650 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-046bec28-03f9-46fa-b0d3-a997de01ffd7 req-5362b015-5946-4b6b-9dbd-157a99957766 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:46.629147 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-046bec28-03f9-46fa-b0d3-a997de01ffd7 req-5362b015-5946-4b6b-9dbd-157a99957766 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:46.673246 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-046bec28-03f9-46fa-b0d3-a997de01ffd7 req-5362b015-5946-4b6b-9dbd-157a99957766 service nova] Creating event network-vif-plugged:197f938e-4f1a-4410-a945-7fd2dd1c6261 for instance 359ef5fc-a540-46a9-9e68-3f5118a6e7e2 on n-h1-master-1 Jun 20 12:26:46.690377 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-046bec28-03f9-46fa-b0d3-a997de01ffd7 req-5362b015-5946-4b6b-9dbd-157a99957766 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101213 Jun 20 12:26:46.696571 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2798/5497] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:26:47.064234 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-03027611-a180-4289-b6ee-1622c23fc2d1 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:47.064978 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-03027611-a180-4289-b6ee-1622c23fc2d1 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: 359ef5fc-a540-46a9-9e68-3f5118a6e7e2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:47.085111 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-03027611-a180-4289-b6ee-1622c23fc2d1 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:47.085755 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-03027611-a180-4289-b6ee-1622c23fc2d1 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:47.086922 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-03027611-a180-4289-b6ee-1622c23fc2d1 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:47.089231 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-03027611-a180-4289-b6ee-1622c23fc2d1 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:47.198158 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-63f890e6-a306-4fdd-8710-0ac7722d040d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:47.198862 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-63f890e6-a306-4fdd-8710-0ac7722d040d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:47.214585 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63f890e6-a306-4fdd-8710-0ac7722d040d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:47.217077 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63f890e6-a306-4fdd-8710-0ac7722d040d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:47.217972 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63f890e6-a306-4fdd-8710-0ac7722d040d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:47.218402 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63f890e6-a306-4fdd-8710-0ac7722d040d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:47.489481 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-03027611-a180-4289-b6ee-1622c23fc2d1 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:47.503967 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-03027611-a180-4289-b6ee-1622c23fc2d1 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2" status: 200 len: 1372 microversion: 2.1 time: 0.443651 Jun 20 12:26:47.512687 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2700/5498] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:47 2022] GET /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2 => generated 1372 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:47.515777 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-63f890e6-a306-4fdd-8710-0ac7722d040d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:47.518266 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:47.525250 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-63f890e6-a306-4fdd-8710-0ac7722d040d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1668 microversion: 2.1 time: 0.331530 Jun 20 12:26:47.525854 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2799/5499] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:47 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1668 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:48.521339 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2107d2df-9f77-49a7-8ab5-5a19ab583dfc tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:48.522924 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2107d2df-9f77-49a7-8ab5-5a19ab583dfc tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: 359ef5fc-a540-46a9-9e68-3f5118a6e7e2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:48.533299 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2107d2df-9f77-49a7-8ab5-5a19ab583dfc tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:48.533994 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2107d2df-9f77-49a7-8ab5-5a19ab583dfc tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:48.534964 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2107d2df-9f77-49a7-8ab5-5a19ab583dfc tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:48.535552 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2107d2df-9f77-49a7-8ab5-5a19ab583dfc tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:48.563285 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-85364fb9-3c65-4f5a-a474-a3aaec0d410d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:48.569678 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-85364fb9-3c65-4f5a-a474-a3aaec0d410d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:48.603260 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-85364fb9-3c65-4f5a-a474-a3aaec0d410d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:48.610551 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-85364fb9-3c65-4f5a-a474-a3aaec0d410d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:48.611846 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-85364fb9-3c65-4f5a-a474-a3aaec0d410d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:48.612458 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-85364fb9-3c65-4f5a-a474-a3aaec0d410d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:49.040372 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2107d2df-9f77-49a7-8ab5-5a19ab583dfc tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:49.057947 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2107d2df-9f77-49a7-8ab5-5a19ab583dfc tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2" status: 200 len: 1544 microversion: 2.1 time: 0.540444 Jun 20 12:26:49.059113 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2701/5500] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:48 2022] GET /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2 => generated 1544 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:49.065514 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e0f14cf7-b377-4fb8-9f4e-9d2e0c81bb8f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:49.066655 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e0f14cf7-b377-4fb8-9f4e-9d2e0c81bb8f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 7ac4715b-0c6b-4e90-b6e3-63a115494aec] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:49.074096 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e0f14cf7-b377-4fb8-9f4e-9d2e0c81bb8f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:49.074802 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e0f14cf7-b377-4fb8-9f4e-9d2e0c81bb8f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:49.075994 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e0f14cf7-b377-4fb8-9f4e-9d2e0c81bb8f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:49.076791 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e0f14cf7-b377-4fb8-9f4e-9d2e0c81bb8f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:49.184066 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e0f14cf7-b377-4fb8-9f4e-9d2e0c81bb8f tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "POST /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec/action" status: 200 len: 24469 microversion: 2.1 time: 0.122912 Jun 20 12:26:49.185230 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2702/5501] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:26:49 2022] POST /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec/action => generated 24469 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:26:49.197455 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c7258212-fa5d-4f94-9c89-5ef58844db06 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:49.198329 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c7258212-fa5d-4f94-9c89-5ef58844db06 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: 359ef5fc-a540-46a9-9e68-3f5118a6e7e2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:49.218405 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c7258212-fa5d-4f94-9c89-5ef58844db06 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:49.220140 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c7258212-fa5d-4f94-9c89-5ef58844db06 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:49.225203 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c7258212-fa5d-4f94-9c89-5ef58844db06 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:49.225867 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c7258212-fa5d-4f94-9c89-5ef58844db06 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:49.280825 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-85364fb9-3c65-4f5a-a474-a3aaec0d410d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:49.299547 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-85364fb9-3c65-4f5a-a474-a3aaec0d410d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.744479 Jun 20 12:26:49.304693 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2800/5502] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:48 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:26:49.321784 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8fc23690-bba7-4cbf-873c-229a9c94a586 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:49.322415 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8fc23690-bba7-4cbf-873c-229a9c94a586 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:49.338774 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8fc23690-bba7-4cbf-873c-229a9c94a586 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:49.339170 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8fc23690-bba7-4cbf-873c-229a9c94a586 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:49.345753 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8fc23690-bba7-4cbf-873c-229a9c94a586 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:49.347714 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8fc23690-bba7-4cbf-873c-229a9c94a586 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:49.721234 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c7258212-fa5d-4f94-9c89-5ef58844db06 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:49.730515 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8fc23690-bba7-4cbf-873c-229a9c94a586 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:49.734226 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c7258212-fa5d-4f94-9c89-5ef58844db06 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2" status: 200 len: 1544 microversion: 2.1 time: 0.546160 Jun 20 12:26:49.735118 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2703/5503] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:49 2022] GET /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2 => generated 1544 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:49.740931 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8fc23690-bba7-4cbf-873c-229a9c94a586 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1671 microversion: 2.1 time: 0.424450 Jun 20 12:26:49.747842 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2801/5504] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:49 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1671 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:26:49.780563 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2b743d09-f32b-4b23-9290-4c7a4efb6df6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:49.781324 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2b743d09-f32b-4b23-9290-4c7a4efb6df6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:49.807137 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2b743d09-f32b-4b23-9290-4c7a4efb6df6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:49.807637 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2b743d09-f32b-4b23-9290-4c7a4efb6df6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:49.808535 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2b743d09-f32b-4b23-9290-4c7a4efb6df6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:49.808978 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2b743d09-f32b-4b23-9290-4c7a4efb6df6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:49.908420 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2b743d09-f32b-4b23-9290-4c7a4efb6df6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:26:49.932679 n-d-master-1 devstack@n-api.service[119128]: INFO nova.compute.api [None req-2b743d09-f32b-4b23-9290-4c7a4efb6df6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Working on deleting snapshot 415397f9-b0a0-4855-ab67-4fb36f659931 from shelved instance... Jun 20 12:26:51.319522 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:51.398706 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2b743d09-f32b-4b23-9290-4c7a4efb6df6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Doing local delete in cell d5df985c-a080-4240-bcef-1787de3aeb9e(cell1) {{(pid=119128) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 20 12:26:51.404414 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2b743d09-f32b-4b23-9290-4c7a4efb6df6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:51.405131 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2b743d09-f32b-4b23-9290-4c7a4efb6df6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:51.405798 n-d-master-1 devstack@n-api.service[119128]: INFO nova.compute.api [None req-2b743d09-f32b-4b23-9290-4c7a4efb6df6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jun 20 12:26:51.412426 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-2b743d09-f32b-4b23-9290-4c7a4efb6df6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] deallocate_for_instance() {{(pid=119128) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jun 20 12:26:53.588378 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f829fccd-a7c0-45d7-ab8c-b57e7e6f3f8b tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:53.588881 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f829fccd-a7c0-45d7-ab8c-b57e7e6f3f8b tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 5b047d91-122c-44ee-b96e-1e0836960caa] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:53.601445 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f829fccd-a7c0-45d7-ab8c-b57e7e6f3f8b tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:53.601903 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f829fccd-a7c0-45d7-ab8c-b57e7e6f3f8b tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:53.607228 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f829fccd-a7c0-45d7-ab8c-b57e7e6f3f8b tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:53.607775 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f829fccd-a7c0-45d7-ab8c-b57e7e6f3f8b tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:53.646371 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-f829fccd-a7c0-45d7-ab8c-b57e7e6f3f8b tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] HTTP exception thrown: Instance 5b047d91-122c-44ee-b96e-1e0836960caa could not be found. Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f829fccd-a7c0-45d7-ab8c-b57e7e6f3f8b tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Request method failure captured: Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa HTTP/1.1 Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGWLkuKwKPjdKtUhc6dNGwsLHhL8Mdhfpzf_4vXVWLCDSgHqf13sQd-9LF3MGnQa8psDEc9JEkJzZSaw9_ikn85Q0ll0Nix-ZVBlwng9bwAGAqG_v56imSaNIrFE1kQs0xywtIhYs4nVxj6oFHlE90I0jsmgvQVO4a7me_Rr1FZasH4 Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: e32e6c9093de44cf932e533ee20b0e31 Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-AttachVolumeTestJSON-1076215088 Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e32e6c9093de44cf932e533ee20b0e31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e32e6c9093de44cf932e533ee20b0e31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e32e6c9093de44cf932e533ee20b0e31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e32e6c9093de44cf932e533ee20b0e31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-AttachVolumeTestJSON-1076215088 Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: e32e6c9093de44cf932e533ee20b0e31 Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1076215088 Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-AttachVolumeTestJSON-1076215088-project Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 0174505a4b2b404dbab8c4aaf399e057 Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-AttachVolumeTestJSON-1076215088-project Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 5b047d91-122c-44ee-b96e-1e0836960caa could not be found. Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '5b047d91-122c-44ee-b96e-1e0836960caa'} Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b047d91-122c-44ee-b96e-1e0836960caa could not be found. Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:26:53.648138 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:26:53.651800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b047d91-122c-44ee-b96e-1e0836960caa could not be found. Jun 20 12:26:53.651800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:26:53.651800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:26:53.651800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:26:53.651800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:26:53.651800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:26:53.651800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:26:53.651800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:26:53.651800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:26:53.651800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b047d91-122c-44ee-b96e-1e0836960caa could not be found. Jun 20 12:26:53.651800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:26:53.659377 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f829fccd-a7c0-45d7-ab8c-b57e7e6f3f8b tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Returning 404 to user: Instance 5b047d91-122c-44ee-b96e-1e0836960caa could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:26:53.660421 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f829fccd-a7c0-45d7-ab8c-b57e7e6f3f8b tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa" status: 404 len: 111 microversion: 2.1 time: 0.076256 Jun 20 12:26:53.660890 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2802/5505] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:26:53 2022] DELETE /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:26:53.677612 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-779dea72-096c-4ff8-8d51-370d2f507040 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:53.678244 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-779dea72-096c-4ff8-8d51-370d2f507040 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 5b047d91-122c-44ee-b96e-1e0836960caa] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:53.705982 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-779dea72-096c-4ff8-8d51-370d2f507040 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:53.706447 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-779dea72-096c-4ff8-8d51-370d2f507040 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:53.707246 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-779dea72-096c-4ff8-8d51-370d2f507040 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:53.707683 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-779dea72-096c-4ff8-8d51-370d2f507040 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:53.770803 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-779dea72-096c-4ff8-8d51-370d2f507040 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] HTTP exception thrown: Instance 5b047d91-122c-44ee-b96e-1e0836960caa could not be found. Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-779dea72-096c-4ff8-8d51-370d2f507040 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Request method failure captured: Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa HTTP/1.1 Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGWLkuKwKPjdKtUhc6dNGwsLHhL8Mdhfpzf_4vXVWLCDSgHqf13sQd-9LF3MGnQa8psDEc9JEkJzZSaw9_ikn85Q0ll0Nix-ZVBlwng9bwAGAqG_v56imSaNIrFE1kQs0xywtIhYs4nVxj6oFHlE90I0jsmgvQVO4a7me_Rr1FZasH4 Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: e32e6c9093de44cf932e533ee20b0e31 Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-AttachVolumeTestJSON-1076215088 Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e32e6c9093de44cf932e533ee20b0e31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e32e6c9093de44cf932e533ee20b0e31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e32e6c9093de44cf932e533ee20b0e31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e32e6c9093de44cf932e533ee20b0e31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-AttachVolumeTestJSON-1076215088 Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: e32e6c9093de44cf932e533ee20b0e31 Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1076215088 Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-AttachVolumeTestJSON-1076215088-project Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 0174505a4b2b404dbab8c4aaf399e057 Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-AttachVolumeTestJSON-1076215088-project Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 5b047d91-122c-44ee-b96e-1e0836960caa could not be found. Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '5b047d91-122c-44ee-b96e-1e0836960caa'} Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b047d91-122c-44ee-b96e-1e0836960caa could not be found. Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b047d91-122c-44ee-b96e-1e0836960caa could not be found. Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:26:53.782184 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:26:53.786000 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:26:53.786000 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:26:53.786000 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:26:53.786000 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:26:53.786000 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:26:53.786000 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b047d91-122c-44ee-b96e-1e0836960caa could not be found. Jun 20 12:26:53.786000 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:26:53.786000 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-779dea72-096c-4ff8-8d51-370d2f507040 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Returning 404 to user: Instance 5b047d91-122c-44ee-b96e-1e0836960caa could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:26:53.800675 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-779dea72-096c-4ff8-8d51-370d2f507040 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa" status: 404 len: 111 microversion: 2.1 time: 0.118682 Jun 20 12:26:53.801386 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2803/5506] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:53 2022] GET /compute/v2.1/servers/5b047d91-122c-44ee-b96e-1e0836960caa => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:26:53.925161 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-2b743d09-f32b-4b23-9290-4c7a4efb6df6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Updating instance_info_cache with network_info: [] {{(pid=119128) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 20 12:26:53.929223 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-d6520323-a542-4993-9eda-6200164ec797 req-7ea72a47-d9ed-4d3b-8bb8-ef967d80ddc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c473a298-ea22-4021-ae72-92e85a549c19", "name": "network-vif-deleted", "tag": "9b61fdc1-e467-43d0-bf62-8e0407b63f9e"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:53.949451 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-d6520323-a542-4993-9eda-6200164ec797 req-7ea72a47-d9ed-4d3b-8bb8-ef967d80ddc3 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:53.949904 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-d6520323-a542-4993-9eda-6200164ec797 req-7ea72a47-d9ed-4d3b-8bb8-ef967d80ddc3 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:54.035890 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.compute.server_external_events [req-d6520323-a542-4993-9eda-6200164ec797 req-7ea72a47-d9ed-4d3b-8bb8-ef967d80ddc3 service nova] Unable to find a host for instance c473a298-ea22-4021-ae72-92e85a549c19. Dropping event network-vif-deleted {{(pid=119127) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 20 12:26:54.036999 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-d6520323-a542-4993-9eda-6200164ec797 req-7ea72a47-d9ed-4d3b-8bb8-ef967d80ddc3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.115393 Jun 20 12:26:54.043720 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2804/5507] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 123 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 20 12:26:54.898951 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2b743d09-f32b-4b23-9290-4c7a4efb6df6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 204 len: 0 microversion: 2.1 time: 5.130228 Jun 20 12:26:54.902068 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2704/5508] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:26:49 2022] DELETE /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 0 bytes in 5134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:26:54.910047 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-be486152-7c79-44f6-b840-221761d03c07 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:54.910660 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-be486152-7c79-44f6-b840-221761d03c07 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: c473a298-ea22-4021-ae72-92e85a549c19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:54.939700 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-be486152-7c79-44f6-b840-221761d03c07 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:54.941858 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-be486152-7c79-44f6-b840-221761d03c07 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:54.942756 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-be486152-7c79-44f6-b840-221761d03c07 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:54.954810 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-be486152-7c79-44f6-b840-221761d03c07 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:54.999184 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-be486152-7c79-44f6-b840-221761d03c07 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] HTTP exception thrown: Instance c473a298-ea22-4021-ae72-92e85a549c19 could not be found. Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-be486152-7c79-44f6-b840-221761d03c07 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Request method failure captured: Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 HTTP/1.1 Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGWfcnsnIAQHeUFzemCAqsDSaDjVl1ssR-hcl5jShJJncxtH_i_sUxyV8wxMh7Nb_82a0N8h4PZj2sZBDxn55X-hts8ntzQHnGvnqXOJDUG24ePgw3p5o0pMF-JHnlpIu7C903Kl6_Fa26thSLCLY9zvvFkQX2Lh7LHBESrUQztcSD8 Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 19236314583142029ffd7a1e04460cab Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServerActionsTestJSON-1849432707 Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19236314583142029ffd7a1e04460cab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19236314583142029ffd7a1e04460cab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/19236314583142029ffd7a1e04460cab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_19236314583142029ffd7a1e04460cab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServerActionsTestJSON-1849432707 Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 19236314583142029ffd7a1e04460cab Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServerActionsTestJSON-1849432707 Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServerActionsTestJSON-1849432707-project Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 4ccd420e1ff744b99cb7e5650522e983 Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServerActionsTestJSON-1849432707-project Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: exception: Instance c473a298-ea22-4021-ae72-92e85a549c19 could not be found. Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'c473a298-ea22-4021-ae72-92e85a549c19'} Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c473a298-ea22-4021-ae72-92e85a549c19 could not be found. Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c473a298-ea22-4021-ae72-92e85a549c19 could not be found. Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:26:55.006160 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:26:55.010695 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:26:55.010695 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:26:55.010695 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:26:55.010695 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:26:55.010695 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:26:55.010695 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c473a298-ea22-4021-ae72-92e85a549c19 could not be found. Jun 20 12:26:55.010695 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:26:55.017668 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-be486152-7c79-44f6-b840-221761d03c07 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Returning 404 to user: Instance c473a298-ea22-4021-ae72-92e85a549c19 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:26:55.018796 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-be486152-7c79-44f6-b840-221761d03c07 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19" status: 404 len: 111 microversion: 2.1 time: 0.112696 Jun 20 12:26:55.020580 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2805/5509] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:54 2022] GET /compute/v2.1/servers/c473a298-ea22-4021-ae72-92e85a549c19 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:26:55.028413 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ca91cba4-baee-4933-8f9b-5904e6bd1d31 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:55.029491 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ca91cba4-baee-4933-8f9b-5904e6bd1d31 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: dd9ed98a-2b15-455f-8ff2-ead26b5af05b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:55.045306 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ca91cba4-baee-4933-8f9b-5904e6bd1d31 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:55.045836 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ca91cba4-baee-4933-8f9b-5904e6bd1d31 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:55.046776 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ca91cba4-baee-4933-8f9b-5904e6bd1d31 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:55.047217 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ca91cba4-baee-4933-8f9b-5904e6bd1d31 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:55.115656 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ca91cba4-baee-4933-8f9b-5904e6bd1d31 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: dd9ed98a-2b15-455f-8ff2-ead26b5af05b] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:26:55.409324 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ca91cba4-baee-4933-8f9b-5904e6bd1d31 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b" status: 204 len: 0 microversion: 2.1 time: 0.385208 Jun 20 12:26:55.416731 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2705/5510] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:26:55 2022] DELETE /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:26:55.427011 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-01068447-148e-4a67-9d07-82b94b077daf tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:55.428393 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-01068447-148e-4a67-9d07-82b94b077daf tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: dd9ed98a-2b15-455f-8ff2-ead26b5af05b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:55.447535 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01068447-148e-4a67-9d07-82b94b077daf tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:55.451640 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01068447-148e-4a67-9d07-82b94b077daf tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:55.453047 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01068447-148e-4a67-9d07-82b94b077daf tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:55.455518 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01068447-148e-4a67-9d07-82b94b077daf tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:55.658817 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-01068447-148e-4a67-9d07-82b94b077daf tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:55.673252 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-01068447-148e-4a67-9d07-82b94b077daf tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b" status: 200 len: 1466 microversion: 2.1 time: 0.250514 Jun 20 12:26:55.677072 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2806/5511] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:55 2022] GET /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b => generated 1466 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:55.747959 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-354e00b1-f873-41c4-9aef-a5de4be3f5f7 req-77378e7d-da0e-488d-83c8-6c58eb7c2f6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "359ef5fc-a540-46a9-9e68-3f5118a6e7e2", "tag": "197f938e-4f1a-4410-a945-7fd2dd1c6261"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:55.758939 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-354e00b1-f873-41c4-9aef-a5de4be3f5f7 req-77378e7d-da0e-488d-83c8-6c58eb7c2f6c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:55.766600 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-354e00b1-f873-41c4-9aef-a5de4be3f5f7 req-77378e7d-da0e-488d-83c8-6c58eb7c2f6c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:55.798259 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-354e00b1-f873-41c4-9aef-a5de4be3f5f7 req-77378e7d-da0e-488d-83c8-6c58eb7c2f6c service nova] Creating event network-changed:197f938e-4f1a-4410-a945-7fd2dd1c6261 for instance 359ef5fc-a540-46a9-9e68-3f5118a6e7e2 on n-h1-master-1 Jun 20 12:26:55.831180 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-354e00b1-f873-41c4-9aef-a5de4be3f5f7 req-77378e7d-da0e-488d-83c8-6c58eb7c2f6c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089890 Jun 20 12:26:55.832984 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2706/5512] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:26:56.694160 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-19348ec8-42da-4c71-89f6-7db59c4c0979 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:56.695131 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-19348ec8-42da-4c71-89f6-7db59c4c0979 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: dd9ed98a-2b15-455f-8ff2-ead26b5af05b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:56.733422 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-19348ec8-42da-4c71-89f6-7db59c4c0979 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:56.739022 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-19348ec8-42da-4c71-89f6-7db59c4c0979 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:56.739896 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-19348ec8-42da-4c71-89f6-7db59c4c0979 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:56.747043 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-19348ec8-42da-4c71-89f6-7db59c4c0979 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:57.122972 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-19348ec8-42da-4c71-89f6-7db59c4c0979 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:57.134410 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-19348ec8-42da-4c71-89f6-7db59c4c0979 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b" status: 200 len: 1466 microversion: 2.1 time: 0.444655 Jun 20 12:26:57.158546 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2807/5513] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:56 2022] GET /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b => generated 1466 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:58.171097 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4f6d2763-beaf-4dbe-ad8d-2be3260e5b31 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:58.191373 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4f6d2763-beaf-4dbe-ad8d-2be3260e5b31 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: dd9ed98a-2b15-455f-8ff2-ead26b5af05b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:58.248615 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:58.320610 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4f6d2763-beaf-4dbe-ad8d-2be3260e5b31 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:58.321127 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4f6d2763-beaf-4dbe-ad8d-2be3260e5b31 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:58.329596 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4f6d2763-beaf-4dbe-ad8d-2be3260e5b31 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:58.330109 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4f6d2763-beaf-4dbe-ad8d-2be3260e5b31 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:58.856368 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4f6d2763-beaf-4dbe-ad8d-2be3260e5b31 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:58.869964 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4f6d2763-beaf-4dbe-ad8d-2be3260e5b31 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b" status: 200 len: 1466 microversion: 2.1 time: 0.712037 Jun 20 12:26:58.880025 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2707/5514] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:58 2022] GET /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b => generated 1466 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:59.888543 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ae65d86d-a47f-4b27-8110-859f6da15cfb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:59.889201 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ae65d86d-a47f-4b27-8110-859f6da15cfb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: dd9ed98a-2b15-455f-8ff2-ead26b5af05b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:59.920293 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ae65d86d-a47f-4b27-8110-859f6da15cfb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:59.920879 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ae65d86d-a47f-4b27-8110-859f6da15cfb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:59.921720 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ae65d86d-a47f-4b27-8110-859f6da15cfb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:59.922155 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ae65d86d-a47f-4b27-8110-859f6da15cfb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:00.351606 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ae65d86d-a47f-4b27-8110-859f6da15cfb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:00.366992 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ae65d86d-a47f-4b27-8110-859f6da15cfb tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b" status: 200 len: 1466 microversion: 2.1 time: 0.483587 Jun 20 12:27:00.378927 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2808/5515] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:59 2022] GET /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b => generated 1466 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:01.385544 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-441ca41d-e3bd-469c-8e2b-cef1e1151768 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:01.386292 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-441ca41d-e3bd-469c-8e2b-cef1e1151768 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: dd9ed98a-2b15-455f-8ff2-ead26b5af05b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:01.421985 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-441ca41d-e3bd-469c-8e2b-cef1e1151768 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:01.422427 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-441ca41d-e3bd-469c-8e2b-cef1e1151768 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:01.423598 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-441ca41d-e3bd-469c-8e2b-cef1e1151768 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:01.427595 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-441ca41d-e3bd-469c-8e2b-cef1e1151768 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:01.822162 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-cb4d551e-e58c-494a-9afe-916a60ddee27 req-d5549810-7c75-4b6f-8c72-c627bf8bb444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd9ed98a-2b15-455f-8ff2-ead26b5af05b", "name": "network-vif-deleted", "tag": "1d3e6b7e-bb2c-4e48-b26b-d6098ed14277"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:01.850530 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-cb4d551e-e58c-494a-9afe-916a60ddee27 req-d5549810-7c75-4b6f-8c72-c627bf8bb444 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:01.860013 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-cb4d551e-e58c-494a-9afe-916a60ddee27 req-d5549810-7c75-4b6f-8c72-c627bf8bb444 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:01.896388 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-cb4d551e-e58c-494a-9afe-916a60ddee27 req-d5549810-7c75-4b6f-8c72-c627bf8bb444 service nova] Creating event network-vif-deleted:1d3e6b7e-bb2c-4e48-b26b-d6098ed14277 for instance dd9ed98a-2b15-455f-8ff2-ead26b5af05b on n-h1-master-1 Jun 20 12:27:01.914804 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-cb4d551e-e58c-494a-9afe-916a60ddee27 req-d5549810-7c75-4b6f-8c72-c627bf8bb444 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111245 Jun 20 12:27:01.921749 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2809/5516] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:27:02.001155 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-441ca41d-e3bd-469c-8e2b-cef1e1151768 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:02.028661 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-441ca41d-e3bd-469c-8e2b-cef1e1151768 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b" status: 200 len: 1466 microversion: 2.1 time: 0.640617 Jun 20 12:27:02.029743 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2708/5517] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:01 2022] GET /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b => generated 1466 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:03.050844 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0d4db373-874d-442a-be39-b0d74182a250 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:03.052138 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0d4db373-874d-442a-be39-b0d74182a250 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: dd9ed98a-2b15-455f-8ff2-ead26b5af05b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:03.076285 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0d4db373-874d-442a-be39-b0d74182a250 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:03.077120 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0d4db373-874d-442a-be39-b0d74182a250 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:03.078255 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0d4db373-874d-442a-be39-b0d74182a250 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:03.082883 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0d4db373-874d-442a-be39-b0d74182a250 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:03.135445 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-0d4db373-874d-442a-be39-b0d74182a250 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] HTTP exception thrown: Instance dd9ed98a-2b15-455f-8ff2-ead26b5af05b could not be found. Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0d4db373-874d-442a-be39-b0d74182a250 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Request method failure captured: Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b HTTP/1.1 Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGWfcnsnIAQHeUFzemCAqsDSaDjVl1ssR-hcl5jShJJncxtH_i_sUxyV8wxMh7Nb_82a0N8h4PZj2sZBDxn55X-hts8ntzQHnGvnqXOJDUG24ePgw3p5o0pMF-JHnlpIu7C903Kl6_Fa26thSLCLY9zvvFkQX2Lh7LHBESrUQztcSD8 Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 19236314583142029ffd7a1e04460cab Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServerActionsTestJSON-1849432707 Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19236314583142029ffd7a1e04460cab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19236314583142029ffd7a1e04460cab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/19236314583142029ffd7a1e04460cab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_19236314583142029ffd7a1e04460cab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServerActionsTestJSON-1849432707 Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 19236314583142029ffd7a1e04460cab Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServerActionsTestJSON-1849432707 Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServerActionsTestJSON-1849432707-project Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 4ccd420e1ff744b99cb7e5650522e983 Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServerActionsTestJSON-1849432707-project Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: exception: Instance dd9ed98a-2b15-455f-8ff2-ead26b5af05b could not be found. Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'dd9ed98a-2b15-455f-8ff2-ead26b5af05b'} Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd9ed98a-2b15-455f-8ff2-ead26b5af05b could not be found. Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd9ed98a-2b15-455f-8ff2-ead26b5af05b could not be found. Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:27:03.141406 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:27:03.145310 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:27:03.145310 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:27:03.145310 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:27:03.145310 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:27:03.145310 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:27:03.145310 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd9ed98a-2b15-455f-8ff2-ead26b5af05b could not be found. Jun 20 12:27:03.145310 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:27:03.147372 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0d4db373-874d-442a-be39-b0d74182a250 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Returning 404 to user: Instance dd9ed98a-2b15-455f-8ff2-ead26b5af05b could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:27:03.148613 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0d4db373-874d-442a-be39-b0d74182a250 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b" status: 404 len: 111 microversion: 2.1 time: 0.106093 Jun 20 12:27:03.157194 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2810/5518] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:03 2022] GET /compute/v2.1/servers/dd9ed98a-2b15-455f-8ff2-ead26b5af05b => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:27:03.159681 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-baedf888-e4be-4559-92d1-2a33b2f8c26f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:03.160569 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-baedf888-e4be-4559-92d1-2a33b2f8c26f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: b6e4b364-c9ac-4369-8b13-17ad4f918263] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:03.183145 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-baedf888-e4be-4559-92d1-2a33b2f8c26f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:03.185086 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-baedf888-e4be-4559-92d1-2a33b2f8c26f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:03.187560 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-baedf888-e4be-4559-92d1-2a33b2f8c26f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:03.191838 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-baedf888-e4be-4559-92d1-2a33b2f8c26f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:03.304624 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-baedf888-e4be-4559-92d1-2a33b2f8c26f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: b6e4b364-c9ac-4369-8b13-17ad4f918263] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:27:03.312102 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-da19c9e6-4e05-4ed0-a2a7-25044ed818b9 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:03.312681 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-da19c9e6-4e05-4ed0-a2a7-25044ed818b9 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:03.325826 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da19c9e6-4e05-4ed0-a2a7-25044ed818b9 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:03.326392 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da19c9e6-4e05-4ed0-a2a7-25044ed818b9 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:03.327198 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da19c9e6-4e05-4ed0-a2a7-25044ed818b9 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:03.327645 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da19c9e6-4e05-4ed0-a2a7-25044ed818b9 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:03.381570 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-da19c9e6-4e05-4ed0-a2a7-25044ed818b9 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] HTTP exception thrown: Instance 442a5a56-7a8d-4804-ab29-515e6d314b19 could not be found. Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-da19c9e6-4e05-4ed0-a2a7-25044ed818b9 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Request method failure captured: Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 HTTP/1.1 Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGWLkuKwKPjdKtUhc6dNGwsLHhL8Mdhfpzf_4vXVWLCDSgHqf13sQd-9LF3MGnQa8psDEc9JEkJzZSaw9_ikn85Q0ll0Nix-ZVBlwng9bwAGAqG_v56imSaNIrFE1kQs0xywtIhYs4nVxj6oFHlE90I0jsmgvQVO4a7me_Rr1FZasH4 Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: e32e6c9093de44cf932e533ee20b0e31 Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-AttachVolumeTestJSON-1076215088 Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e32e6c9093de44cf932e533ee20b0e31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e32e6c9093de44cf932e533ee20b0e31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e32e6c9093de44cf932e533ee20b0e31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e32e6c9093de44cf932e533ee20b0e31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-AttachVolumeTestJSON-1076215088 Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: e32e6c9093de44cf932e533ee20b0e31 Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1076215088 Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-AttachVolumeTestJSON-1076215088-project Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 0174505a4b2b404dbab8c4aaf399e057 Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-AttachVolumeTestJSON-1076215088-project Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 442a5a56-7a8d-4804-ab29-515e6d314b19 could not be found. Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '442a5a56-7a8d-4804-ab29-515e6d314b19'} Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 442a5a56-7a8d-4804-ab29-515e6d314b19 could not be found. Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:27:03.384751 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:27:03.389060 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 442a5a56-7a8d-4804-ab29-515e6d314b19 could not be found. Jun 20 12:27:03.389060 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:27:03.389060 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:27:03.389060 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:27:03.389060 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:27:03.389060 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:27:03.389060 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:27:03.389060 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:27:03.389060 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:27:03.389060 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 442a5a56-7a8d-4804-ab29-515e6d314b19 could not be found. Jun 20 12:27:03.389060 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:27:03.396419 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-da19c9e6-4e05-4ed0-a2a7-25044ed818b9 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Returning 404 to user: Instance 442a5a56-7a8d-4804-ab29-515e6d314b19 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:27:03.397534 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-da19c9e6-4e05-4ed0-a2a7-25044ed818b9 tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "DELETE /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 404 len: 111 microversion: 2.1 time: 0.089956 Jun 20 12:27:03.400671 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2811/5519] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:27:03 2022] DELETE /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:27:03.419102 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-19a52af9-5935-434e-99b6-68fa2f7bbc9d tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:03.422433 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-19a52af9-5935-434e-99b6-68fa2f7bbc9d tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] [instance: 442a5a56-7a8d-4804-ab29-515e6d314b19] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:03.450137 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-19a52af9-5935-434e-99b6-68fa2f7bbc9d tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:03.451019 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-19a52af9-5935-434e-99b6-68fa2f7bbc9d tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:03.452441 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-19a52af9-5935-434e-99b6-68fa2f7bbc9d tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:03.453047 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-19a52af9-5935-434e-99b6-68fa2f7bbc9d tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:03.507370 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-19a52af9-5935-434e-99b6-68fa2f7bbc9d tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] HTTP exception thrown: Instance 442a5a56-7a8d-4804-ab29-515e6d314b19 could not be found. Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-19a52af9-5935-434e-99b6-68fa2f7bbc9d tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Request method failure captured: Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 HTTP/1.1 Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGWLkuKwKPjdKtUhc6dNGwsLHhL8Mdhfpzf_4vXVWLCDSgHqf13sQd-9LF3MGnQa8psDEc9JEkJzZSaw9_ikn85Q0ll0Nix-ZVBlwng9bwAGAqG_v56imSaNIrFE1kQs0xywtIhYs4nVxj6oFHlE90I0jsmgvQVO4a7me_Rr1FZasH4 Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: e32e6c9093de44cf932e533ee20b0e31 Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-AttachVolumeTestJSON-1076215088 Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e32e6c9093de44cf932e533ee20b0e31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e32e6c9093de44cf932e533ee20b0e31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e32e6c9093de44cf932e533ee20b0e31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e32e6c9093de44cf932e533ee20b0e31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-AttachVolumeTestJSON-1076215088 Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: e32e6c9093de44cf932e533ee20b0e31 Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1076215088 Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-AttachVolumeTestJSON-1076215088-project Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 0174505a4b2b404dbab8c4aaf399e057 Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-AttachVolumeTestJSON-1076215088-project Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 442a5a56-7a8d-4804-ab29-515e6d314b19 could not be found. Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '442a5a56-7a8d-4804-ab29-515e6d314b19'} Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 442a5a56-7a8d-4804-ab29-515e6d314b19 could not be found. Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 442a5a56-7a8d-4804-ab29-515e6d314b19 could not be found. Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:27:03.512591 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:27:03.518739 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:27:03.518739 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:27:03.518739 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:27:03.518739 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:27:03.518739 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:27:03.518739 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 442a5a56-7a8d-4804-ab29-515e6d314b19 could not be found. Jun 20 12:27:03.518739 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:27:03.518739 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-19a52af9-5935-434e-99b6-68fa2f7bbc9d tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] Returning 404 to user: Instance 442a5a56-7a8d-4804-ab29-515e6d314b19 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:27:03.518739 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-19a52af9-5935-434e-99b6-68fa2f7bbc9d tempest-AttachVolumeTestJSON-1076215088 tempest-AttachVolumeTestJSON-1076215088-project] 10.222.0.27 "GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19" status: 404 len: 111 microversion: 2.1 time: 0.108838 Jun 20 12:27:03.518739 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2812/5520] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:03 2022] GET /compute/v2.1/servers/442a5a56-7a8d-4804-ab29-515e6d314b19 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:27:03.568733 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-baedf888-e4be-4559-92d1-2a33b2f8c26f tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263" status: 204 len: 0 microversion: 2.1 time: 0.412957 Jun 20 12:27:03.580393 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f89deedc-2bb4-4428-823a-8bc4972db45a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:03.581111 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f89deedc-2bb4-4428-823a-8bc4972db45a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: b6e4b364-c9ac-4369-8b13-17ad4f918263] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:03.589872 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2709/5521] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:27:03 2022] DELETE /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:27:03.595549 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f89deedc-2bb4-4428-823a-8bc4972db45a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:03.599568 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f89deedc-2bb4-4428-823a-8bc4972db45a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:03.600444 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f89deedc-2bb4-4428-823a-8bc4972db45a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:03.611704 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f89deedc-2bb4-4428-823a-8bc4972db45a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:04.041214 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f89deedc-2bb4-4428-823a-8bc4972db45a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:04.055042 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f89deedc-2bb4-4428-823a-8bc4972db45a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263" status: 200 len: 1509 microversion: 2.1 time: 0.477357 Jun 20 12:27:04.057176 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2813/5522] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:03 2022] GET /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263 => generated 1509 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:05.111615 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-463d8873-d3c9-4c3c-a7bb-d4dd1c561bb4 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:05.112383 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-463d8873-d3c9-4c3c-a7bb-d4dd1c561bb4 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: b6e4b364-c9ac-4369-8b13-17ad4f918263] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:05.176972 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-463d8873-d3c9-4c3c-a7bb-d4dd1c561bb4 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:05.180435 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-463d8873-d3c9-4c3c-a7bb-d4dd1c561bb4 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:05.188566 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-463d8873-d3c9-4c3c-a7bb-d4dd1c561bb4 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:05.191086 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-463d8873-d3c9-4c3c-a7bb-d4dd1c561bb4 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:05.790924 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-463d8873-d3c9-4c3c-a7bb-d4dd1c561bb4 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:05.819661 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-463d8873-d3c9-4c3c-a7bb-d4dd1c561bb4 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263" status: 200 len: 1509 microversion: 2.1 time: 0.744874 Jun 20 12:27:05.830669 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2710/5523] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:05 2022] GET /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263 => generated 1509 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:06.840375 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-32e28e08-0e8a-467f-ac7f-4f8d19b5cf64 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:06.841683 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-32e28e08-0e8a-467f-ac7f-4f8d19b5cf64 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: b6e4b364-c9ac-4369-8b13-17ad4f918263] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:06.858837 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-32e28e08-0e8a-467f-ac7f-4f8d19b5cf64 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:06.877220 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-32e28e08-0e8a-467f-ac7f-4f8d19b5cf64 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:06.885531 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-32e28e08-0e8a-467f-ac7f-4f8d19b5cf64 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:06.885531 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-32e28e08-0e8a-467f-ac7f-4f8d19b5cf64 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:07.299401 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ba5e62a6-d5ba-4a8a-be85-e2295e622c1a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-737618864", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "ce2e9d9e-a74d-4fc7-950c-df9300f57b6c"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:07.357107 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-32e28e08-0e8a-467f-ac7f-4f8d19b5cf64 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:07.366558 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-32e28e08-0e8a-467f-ac7f-4f8d19b5cf64 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263" status: 200 len: 1467 microversion: 2.1 time: 0.532882 Jun 20 12:27:07.370368 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2814/5524] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:06 2022] GET /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263 => generated 1467 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:07.383949 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-1a11cb30-577e-444d-a5cd-bf0847dfd67b req-90d435c4-86b1-4947-b192-716e8233f0d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6e4b364-c9ac-4369-8b13-17ad4f918263", "name": "network-vif-deleted", "tag": "bf41a0e3-e699-4ba5-aa58-92c4bf5287b5"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:07.392987 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-ba5e62a6-d5ba-4a8a-be85-e2295e622c1a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] validate_networks() for [('ce2e9d9e-a74d-4fc7-950c-df9300f57b6c', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:27:07.395367 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-1a11cb30-577e-444d-a5cd-bf0847dfd67b req-90d435c4-86b1-4947-b192-716e8233f0d3 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:07.396494 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-1a11cb30-577e-444d-a5cd-bf0847dfd67b req-90d435c4-86b1-4947-b192-716e8233f0d3 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:07.410521 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-1a11cb30-577e-444d-a5cd-bf0847dfd67b req-90d435c4-86b1-4947-b192-716e8233f0d3 service nova] Creating event network-vif-deleted:bf41a0e3-e699-4ba5-aa58-92c4bf5287b5 for instance b6e4b364-c9ac-4369-8b13-17ad4f918263 on n-h1-master-1 Jun 20 12:27:07.430203 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-1a11cb30-577e-444d-a5cd-bf0847dfd67b req-90d435c4-86b1-4947-b192-716e8233f0d3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055921 Jun 20 12:27:07.433422 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2815/5525] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:27:08.395681 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-40203da5-1c3f-43f6-a706-51bbf72501b8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:08.397592 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-40203da5-1c3f-43f6-a706-51bbf72501b8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: b6e4b364-c9ac-4369-8b13-17ad4f918263] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:08.405090 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-ba5e62a6-d5ba-4a8a-be85-e2295e622c1a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:27:08.406613 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-ba5e62a6-d5ba-4a8a-be85-e2295e622c1a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:27:08.407343 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-ba5e62a6-d5ba-4a8a-be85-e2295e622c1a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:27:08.409570 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-ba5e62a6-d5ba-4a8a-be85-e2295e622c1a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:27:08.410261 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-ba5e62a6-d5ba-4a8a-be85-e2295e622c1a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:27:08.421712 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-40203da5-1c3f-43f6-a706-51bbf72501b8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:08.422309 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-40203da5-1c3f-43f6-a706-51bbf72501b8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:08.423177 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-40203da5-1c3f-43f6-a706-51bbf72501b8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:08.427228 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-40203da5-1c3f-43f6-a706-51bbf72501b8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:08.429918 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba5e62a6-d5ba-4a8a-be85-e2295e622c1a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:08.430627 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba5e62a6-d5ba-4a8a-be85-e2295e622c1a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:08.436877 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba5e62a6-d5ba-4a8a-be85-e2295e622c1a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:08.437807 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba5e62a6-d5ba-4a8a-be85-e2295e622c1a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:08.472848 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-40203da5-1c3f-43f6-a706-51bbf72501b8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] HTTP exception thrown: Instance b6e4b364-c9ac-4369-8b13-17ad4f918263 could not be found. Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-40203da5-1c3f-43f6-a706-51bbf72501b8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Request method failure captured: Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263 HTTP/1.1 Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGWfcnsnIAQHeUFzemCAqsDSaDjVl1ssR-hcl5jShJJncxtH_i_sUxyV8wxMh7Nb_82a0N8h4PZj2sZBDxn55X-hts8ntzQHnGvnqXOJDUG24ePgw3p5o0pMF-JHnlpIu7C903Kl6_Fa26thSLCLY9zvvFkQX2Lh7LHBESrUQztcSD8 Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 19236314583142029ffd7a1e04460cab Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServerActionsTestJSON-1849432707 Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19236314583142029ffd7a1e04460cab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19236314583142029ffd7a1e04460cab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/19236314583142029ffd7a1e04460cab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_19236314583142029ffd7a1e04460cab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServerActionsTestJSON-1849432707 Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 19236314583142029ffd7a1e04460cab Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServerActionsTestJSON-1849432707 Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServerActionsTestJSON-1849432707-project Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 4ccd420e1ff744b99cb7e5650522e983 Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServerActionsTestJSON-1849432707-project Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: exception: Instance b6e4b364-c9ac-4369-8b13-17ad4f918263 could not be found. Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'b6e4b364-c9ac-4369-8b13-17ad4f918263'} Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6e4b364-c9ac-4369-8b13-17ad4f918263 could not be found. Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6e4b364-c9ac-4369-8b13-17ad4f918263 could not be found. Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:27:08.479126 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:27:08.486642 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:27:08.486642 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:27:08.486642 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:27:08.486642 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:27:08.486642 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:27:08.486642 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6e4b364-c9ac-4369-8b13-17ad4f918263 could not be found. Jun 20 12:27:08.486642 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:27:08.487395 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-ba5e62a6-d5ba-4a8a-be85-e2295e622c1a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Getting quotas for project 896c053324b34720a7d0f151bfdc8b10. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:27:08.487558 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-40203da5-1c3f-43f6-a706-51bbf72501b8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Returning 404 to user: Instance b6e4b364-c9ac-4369-8b13-17ad4f918263 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:27:08.487558 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-40203da5-1c3f-43f6-a706-51bbf72501b8 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263" status: 404 len: 111 microversion: 2.1 time: 0.100610 Jun 20 12:27:08.490094 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2816/5526] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:08 2022] GET /compute/v2.1/servers/b6e4b364-c9ac-4369-8b13-17ad4f918263 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:27:08.501211 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-ba5e62a6-d5ba-4a8a-be85-e2295e622c1a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Getting quotas for user 8878d44956bd42e18f0409534e562ab6 and project 896c053324b34720a7d0f151bfdc8b10. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:27:08.507394 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-94c33553-d097-44b9-9862-b430915c0e42 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:08.509287 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-94c33553-d097-44b9-9862-b430915c0e42 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: f6cb9020-dfc5-4942-b757-10d3806dfdd2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:08.524023 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-94c33553-d097-44b9-9862-b430915c0e42 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:08.528766 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-94c33553-d097-44b9-9862-b430915c0e42 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:08.537071 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-94c33553-d097-44b9-9862-b430915c0e42 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:08.538093 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-94c33553-d097-44b9-9862-b430915c0e42 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:08.547286 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ba5e62a6-d5ba-4a8a-be85-e2295e622c1a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:27:08.550164 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ba5e62a6-d5ba-4a8a-be85-e2295e622c1a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 64fdc10a-358a-4091-bba7-cfa7651022a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:27:08.602759 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-94c33553-d097-44b9-9862-b430915c0e42 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: f6cb9020-dfc5-4942-b757-10d3806dfdd2] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:27:08.704492 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ba5e62a6-d5ba-4a8a-be85-e2295e622c1a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.781135 Jun 20 12:27:08.725643 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2711/5527] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:27:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 12:27:08.731762 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-87f53db4-ddee-4a3f-8e26-b26ec87e4f23 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:08.742674 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-87f53db4-ddee-4a3f-8e26-b26ec87e4f23 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 64fdc10a-358a-4091-bba7-cfa7651022a6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:08.894852 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-94c33553-d097-44b9-9862-b430915c0e42 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2" status: 204 len: 0 microversion: 2.1 time: 0.398382 Jun 20 12:27:08.901665 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2817/5528] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:27:08 2022] DELETE /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:27:08.915126 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-87f53db4-ddee-4a3f-8e26-b26ec87e4f23 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:08.954740 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d4c7402e-2348-4eb0-8196-b7357d26ed58 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:08.957436 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-87f53db4-ddee-4a3f-8e26-b26ec87e4f23 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/64fdc10a-358a-4091-bba7-cfa7651022a6" status: 200 len: 1192 microversion: 2.1 time: 0.230021 Jun 20 12:27:08.961690 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d4c7402e-2348-4eb0-8196-b7357d26ed58 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: f6cb9020-dfc5-4942-b757-10d3806dfdd2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:08.969974 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2712/5529] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:08 2022] GET /compute/v2.1/servers/64fdc10a-358a-4091-bba7-cfa7651022a6 => generated 1192 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:08.997803 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d4c7402e-2348-4eb0-8196-b7357d26ed58 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:09.010921 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d4c7402e-2348-4eb0-8196-b7357d26ed58 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:09.028353 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d4c7402e-2348-4eb0-8196-b7357d26ed58 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:09.034543 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d4c7402e-2348-4eb0-8196-b7357d26ed58 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:09.919445 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d4c7402e-2348-4eb0-8196-b7357d26ed58 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:09.957516 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d4c7402e-2348-4eb0-8196-b7357d26ed58 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2" status: 200 len: 1495 microversion: 2.1 time: 1.036505 Jun 20 12:27:09.961100 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2818/5530] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:08 2022] GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2 => generated 1495 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:09.998306 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d7232bcb-2feb-4bfc-8ca3-59858f438607 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:10.001319 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d7232bcb-2feb-4bfc-8ca3-59858f438607 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 64fdc10a-358a-4091-bba7-cfa7651022a6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:10.015807 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d7232bcb-2feb-4bfc-8ca3-59858f438607 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:10.017865 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d7232bcb-2feb-4bfc-8ca3-59858f438607 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:10.020021 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d7232bcb-2feb-4bfc-8ca3-59858f438607 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:10.020862 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d7232bcb-2feb-4bfc-8ca3-59858f438607 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:10.248526 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d7232bcb-2feb-4bfc-8ca3-59858f438607 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:10.259657 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d7232bcb-2feb-4bfc-8ca3-59858f438607 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/64fdc10a-358a-4091-bba7-cfa7651022a6" status: 200 len: 1196 microversion: 2.1 time: 0.275874 Jun 20 12:27:10.263639 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2713/5531] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:09 2022] GET /compute/v2.1/servers/64fdc10a-358a-4091-bba7-cfa7651022a6 => generated 1196 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:10.979046 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5b530c2e-7c97-4c29-ae4b-b0f00ff651aa tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:10.979657 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5b530c2e-7c97-4c29-ae4b-b0f00ff651aa tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: f6cb9020-dfc5-4942-b757-10d3806dfdd2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:10.995636 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b530c2e-7c97-4c29-ae4b-b0f00ff651aa tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:10.996136 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b530c2e-7c97-4c29-ae4b-b0f00ff651aa tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:11.022776 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b530c2e-7c97-4c29-ae4b-b0f00ff651aa tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:11.025702 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b530c2e-7c97-4c29-ae4b-b0f00ff651aa tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:11.282784 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c5d9c344-a7ce-4e9d-a6dc-08e7b2427b8b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:11.283398 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c5d9c344-a7ce-4e9d-a6dc-08e7b2427b8b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 64fdc10a-358a-4091-bba7-cfa7651022a6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:11.299604 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c5d9c344-a7ce-4e9d-a6dc-08e7b2427b8b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:11.300512 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c5d9c344-a7ce-4e9d-a6dc-08e7b2427b8b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:11.301696 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c5d9c344-a7ce-4e9d-a6dc-08e7b2427b8b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:11.302314 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c5d9c344-a7ce-4e9d-a6dc-08e7b2427b8b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:11.425889 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5b530c2e-7c97-4c29-ae4b-b0f00ff651aa tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:11.435060 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5b530c2e-7c97-4c29-ae4b-b0f00ff651aa tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2" status: 200 len: 1453 microversion: 2.1 time: 0.459845 Jun 20 12:27:11.441091 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2819/5532] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:10 2022] GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2 => generated 1453 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:11.618202 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c5d9c344-a7ce-4e9d-a6dc-08e7b2427b8b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:11.635710 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c5d9c344-a7ce-4e9d-a6dc-08e7b2427b8b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/64fdc10a-358a-4091-bba7-cfa7651022a6" status: 200 len: 1250 microversion: 2.1 time: 0.357974 Jun 20 12:27:11.642429 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2714/5533] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:11 2022] GET /compute/v2.1/servers/64fdc10a-358a-4091-bba7-cfa7651022a6 => generated 1250 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:11.719452 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-312399ca-3547-46ac-bb00-de39312540bf req-38510993-e315-4f6e-bd31-f2b4454a6123 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6cb9020-dfc5-4942-b757-10d3806dfdd2", "name": "network-vif-deleted", "tag": "ff214df1-96aa-4e43-9f1f-688753119e08"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:11.748429 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-312399ca-3547-46ac-bb00-de39312540bf req-38510993-e315-4f6e-bd31-f2b4454a6123 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:11.748885 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-312399ca-3547-46ac-bb00-de39312540bf req-38510993-e315-4f6e-bd31-f2b4454a6123 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:11.799363 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-312399ca-3547-46ac-bb00-de39312540bf req-38510993-e315-4f6e-bd31-f2b4454a6123 service nova] Creating event network-vif-deleted:ff214df1-96aa-4e43-9f1f-688753119e08 for instance f6cb9020-dfc5-4942-b757-10d3806dfdd2 on n-h2-master-1 Jun 20 12:27:11.815987 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-312399ca-3547-46ac-bb00-de39312540bf req-38510993-e315-4f6e-bd31-f2b4454a6123 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103592 Jun 20 12:27:11.821451 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2820/5534] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:27:12.451646 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7cdaa030-01fe-4520-8079-f07f619e5c56 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:12.452283 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7cdaa030-01fe-4520-8079-f07f619e5c56 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: f6cb9020-dfc5-4942-b757-10d3806dfdd2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:12.462358 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7cdaa030-01fe-4520-8079-f07f619e5c56 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:12.465085 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7cdaa030-01fe-4520-8079-f07f619e5c56 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:12.484984 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7cdaa030-01fe-4520-8079-f07f619e5c56 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:12.485813 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7cdaa030-01fe-4520-8079-f07f619e5c56 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:12.498761 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:12.516635 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-7cdaa030-01fe-4520-8079-f07f619e5c56 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] HTTP exception thrown: Instance f6cb9020-dfc5-4942-b757-10d3806dfdd2 could not be found. Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7cdaa030-01fe-4520-8079-f07f619e5c56 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Request method failure captured: Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2 HTTP/1.1 Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGWfcnsnIAQHeUFzemCAqsDSaDjVl1ssR-hcl5jShJJncxtH_i_sUxyV8wxMh7Nb_82a0N8h4PZj2sZBDxn55X-hts8ntzQHnGvnqXOJDUG24ePgw3p5o0pMF-JHnlpIu7C903Kl6_Fa26thSLCLY9zvvFkQX2Lh7LHBESrUQztcSD8 Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 19236314583142029ffd7a1e04460cab Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServerActionsTestJSON-1849432707 Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19236314583142029ffd7a1e04460cab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19236314583142029ffd7a1e04460cab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/19236314583142029ffd7a1e04460cab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_19236314583142029ffd7a1e04460cab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServerActionsTestJSON-1849432707 Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 19236314583142029ffd7a1e04460cab Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServerActionsTestJSON-1849432707 Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServerActionsTestJSON-1849432707-project Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 4ccd420e1ff744b99cb7e5650522e983 Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServerActionsTestJSON-1849432707-project Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: exception: Instance f6cb9020-dfc5-4942-b757-10d3806dfdd2 could not be found. Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'f6cb9020-dfc5-4942-b757-10d3806dfdd2'} Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6cb9020-dfc5-4942-b757-10d3806dfdd2 could not be found. Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6cb9020-dfc5-4942-b757-10d3806dfdd2 could not be found. Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:27:12.518859 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:27:12.522410 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:27:12.522410 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:27:12.522410 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:27:12.522410 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:27:12.522410 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:27:12.522410 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6cb9020-dfc5-4942-b757-10d3806dfdd2 could not be found. Jun 20 12:27:12.522410 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:27:12.524534 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7cdaa030-01fe-4520-8079-f07f619e5c56 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Returning 404 to user: Instance f6cb9020-dfc5-4942-b757-10d3806dfdd2 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:27:12.525716 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7cdaa030-01fe-4520-8079-f07f619e5c56 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2" status: 404 len: 111 microversion: 2.1 time: 0.078315 Jun 20 12:27:12.547629 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8f7df272-aba0-4e83-b668-1486f148d55b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:12.549159 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8f7df272-aba0-4e83-b668-1486f148d55b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:12.551568 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:12.552171 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2715/5535] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:12 2022] GET /compute/v2.1/servers/f6cb9020-dfc5-4942-b757-10d3806dfdd2 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:27:12.566037 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8f7df272-aba0-4e83-b668-1486f148d55b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:12.567134 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8f7df272-aba0-4e83-b668-1486f148d55b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:12.568300 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8f7df272-aba0-4e83-b668-1486f148d55b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:12.568986 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8f7df272-aba0-4e83-b668-1486f148d55b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:12.606629 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8f7df272-aba0-4e83-b668-1486f148d55b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:27:12.635512 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:12.656427 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5eb52ba0-0d92-4b0b-945c-db66b5bde8bd tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:12.657417 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5eb52ba0-0d92-4b0b-945c-db66b5bde8bd tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 64fdc10a-358a-4091-bba7-cfa7651022a6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:12.685542 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5eb52ba0-0d92-4b0b-945c-db66b5bde8bd tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:12.686575 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5eb52ba0-0d92-4b0b-945c-db66b5bde8bd tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:12.688706 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5eb52ba0-0d92-4b0b-945c-db66b5bde8bd tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:12.691635 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5eb52ba0-0d92-4b0b-945c-db66b5bde8bd tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:12.897415 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8f7df272-aba0-4e83-b668-1486f148d55b tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "DELETE /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 204 len: 0 microversion: 2.1 time: 0.365536 Jun 20 12:27:12.900471 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2821/5536] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:27:12 2022] DELETE /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 12:27:12.913034 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-abed1f9f-a1c7-486b-af9d-3007242583f3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:12.914007 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-abed1f9f-a1c7-486b-af9d-3007242583f3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:12.946367 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-abed1f9f-a1c7-486b-af9d-3007242583f3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:12.947430 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-abed1f9f-a1c7-486b-af9d-3007242583f3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:12.948464 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-abed1f9f-a1c7-486b-af9d-3007242583f3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:12.949064 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-abed1f9f-a1c7-486b-af9d-3007242583f3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:13.199637 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-abed1f9f-a1c7-486b-af9d-3007242583f3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:13.214081 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-abed1f9f-a1c7-486b-af9d-3007242583f3 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1677 microversion: 2.1 time: 0.307368 Jun 20 12:27:13.220504 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2822/5537] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:12 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1677 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:13.491064 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5eb52ba0-0d92-4b0b-945c-db66b5bde8bd tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:13.502771 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5eb52ba0-0d92-4b0b-945c-db66b5bde8bd tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/64fdc10a-358a-4091-bba7-cfa7651022a6" status: 200 len: 1292 microversion: 2.1 time: 0.850835 Jun 20 12:27:13.509717 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2716/5538] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:12 2022] GET /compute/v2.1/servers/64fdc10a-358a-4091-bba7-cfa7651022a6 => generated 1292 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:14.237239 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bb0101fa-9850-4f02-afa8-6c76cffd2c44 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:14.238701 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bb0101fa-9850-4f02-afa8-6c76cffd2c44 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:14.262425 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bb0101fa-9850-4f02-afa8-6c76cffd2c44 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:14.263410 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bb0101fa-9850-4f02-afa8-6c76cffd2c44 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:14.264604 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bb0101fa-9850-4f02-afa8-6c76cffd2c44 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:14.265305 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bb0101fa-9850-4f02-afa8-6c76cffd2c44 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:14.527171 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-25878e8d-c59e-4c60-b42e-e815a58c9d93 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:14.528155 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-25878e8d-c59e-4c60-b42e-e815a58c9d93 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 64fdc10a-358a-4091-bba7-cfa7651022a6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:14.553979 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-25878e8d-c59e-4c60-b42e-e815a58c9d93 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:14.565536 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-25878e8d-c59e-4c60-b42e-e815a58c9d93 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:14.566632 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-25878e8d-c59e-4c60-b42e-e815a58c9d93 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:14.567208 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-25878e8d-c59e-4c60-b42e-e815a58c9d93 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:14.611403 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bb0101fa-9850-4f02-afa8-6c76cffd2c44 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:14.621434 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bb0101fa-9850-4f02-afa8-6c76cffd2c44 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1677 microversion: 2.1 time: 0.388293 Jun 20 12:27:14.622102 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2823/5539] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:14 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1677 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:15.660076 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-138d3f39-7b17-4e27-a6c8-47b3911a6405 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:15.661653 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-138d3f39-7b17-4e27-a6c8-47b3911a6405 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:15.678759 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-138d3f39-7b17-4e27-a6c8-47b3911a6405 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:15.679212 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-138d3f39-7b17-4e27-a6c8-47b3911a6405 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:15.680008 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-138d3f39-7b17-4e27-a6c8-47b3911a6405 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:15.680490 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-138d3f39-7b17-4e27-a6c8-47b3911a6405 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:15.702564 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-25878e8d-c59e-4c60-b42e-e815a58c9d93 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:15.710555 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-25878e8d-c59e-4c60-b42e-e815a58c9d93 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/64fdc10a-358a-4091-bba7-cfa7651022a6" status: 200 len: 1292 microversion: 2.1 time: 1.187253 Jun 20 12:27:15.711150 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2717/5540] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:14 2022] GET /compute/v2.1/servers/64fdc10a-358a-4091-bba7-cfa7651022a6 => generated 1292 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:15.743644 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2a2f0fb3-f16e-43e7-9a4b-7773e16927d5 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:15.759292 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2a2f0fb3-f16e-43e7-9a4b-7773e16927d5 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: 359ef5fc-a540-46a9-9e68-3f5118a6e7e2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:15.786614 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a2f0fb3-f16e-43e7-9a4b-7773e16927d5 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:15.791881 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a2f0fb3-f16e-43e7-9a4b-7773e16927d5 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:15.798771 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a2f0fb3-f16e-43e7-9a4b-7773e16927d5 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:15.802490 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a2f0fb3-f16e-43e7-9a4b-7773e16927d5 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:15.917048 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2a2f0fb3-f16e-43e7-9a4b-7773e16927d5 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "POST /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2/action" status: 200 len: 24568 microversion: 2.1 time: 0.180344 Jun 20 12:27:15.919382 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2718/5541] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:27:15 2022] POST /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2/action => generated 24568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:27:16.063953 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-138d3f39-7b17-4e27-a6c8-47b3911a6405 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:16.096609 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-138d3f39-7b17-4e27-a6c8-47b3911a6405 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1677 microversion: 2.1 time: 0.439265 Jun 20 12:27:16.099237 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2824/5542] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:15 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1677 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:16.733204 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-738864fb-c0ae-406d-aa1d-62ad0828326a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:16.734432 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-738864fb-c0ae-406d-aa1d-62ad0828326a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 64fdc10a-358a-4091-bba7-cfa7651022a6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:16.805856 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-738864fb-c0ae-406d-aa1d-62ad0828326a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:16.807207 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-738864fb-c0ae-406d-aa1d-62ad0828326a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:16.833703 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-738864fb-c0ae-406d-aa1d-62ad0828326a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:16.834171 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-738864fb-c0ae-406d-aa1d-62ad0828326a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:17.002699 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-cb104adb-e720-4191-86e1-790d7fb048fc req-0d8349f4-bc9a-4f3d-a2c0-c7e71905b441 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64fdc10a-358a-4091-bba7-cfa7651022a6", "tag": "8e61ccc2-5954-4a2f-82d7-ab2056d0dc66"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:17.068062 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-cb104adb-e720-4191-86e1-790d7fb048fc req-0d8349f4-bc9a-4f3d-a2c0-c7e71905b441 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:17.080337 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-cb104adb-e720-4191-86e1-790d7fb048fc req-0d8349f4-bc9a-4f3d-a2c0-c7e71905b441 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:17.116901 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-cb104adb-e720-4191-86e1-790d7fb048fc req-0d8349f4-bc9a-4f3d-a2c0-c7e71905b441 service nova] Creating event network-changed:8e61ccc2-5954-4a2f-82d7-ab2056d0dc66 for instance 64fdc10a-358a-4091-bba7-cfa7651022a6 on n-h2-master-1 Jun 20 12:27:17.142434 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-cb104adb-e720-4191-86e1-790d7fb048fc req-0d8349f4-bc9a-4f3d-a2c0-c7e71905b441 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136784 Jun 20 12:27:17.144137 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2825/5543] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:27:17.157583 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6674ae40-f60c-48fa-afb8-b9f11134840e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:17.159188 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6674ae40-f60c-48fa-afb8-b9f11134840e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:17.173376 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6674ae40-f60c-48fa-afb8-b9f11134840e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:17.175367 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6674ae40-f60c-48fa-afb8-b9f11134840e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:17.181225 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6674ae40-f60c-48fa-afb8-b9f11134840e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:17.187768 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6674ae40-f60c-48fa-afb8-b9f11134840e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:17.433762 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6674ae40-f60c-48fa-afb8-b9f11134840e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:17.478356 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6674ae40-f60c-48fa-afb8-b9f11134840e tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1609 microversion: 2.1 time: 0.308669 Jun 20 12:27:17.478356 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2826/5544] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:17 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1609 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:18.023850 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-738864fb-c0ae-406d-aa1d-62ad0828326a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:18.032289 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-738864fb-c0ae-406d-aa1d-62ad0828326a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/64fdc10a-358a-4091-bba7-cfa7651022a6" status: 200 len: 1292 microversion: 2.1 time: 1.308125 Jun 20 12:27:18.046725 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2719/5545] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:16 2022] GET /compute/v2.1/servers/64fdc10a-358a-4091-bba7-cfa7651022a6 => generated 1292 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:18.489563 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-66c31b7a-e09d-45a4-895d-cf7c02a219a6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:18.491508 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-66c31b7a-e09d-45a4-895d-cf7c02a219a6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:18.567995 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66c31b7a-e09d-45a4-895d-cf7c02a219a6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:18.568481 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66c31b7a-e09d-45a4-895d-cf7c02a219a6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:18.576811 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66c31b7a-e09d-45a4-895d-cf7c02a219a6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:18.577381 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66c31b7a-e09d-45a4-895d-cf7c02a219a6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:18.687818 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66c31b7a-e09d-45a4-895d-cf7c02a219a6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:18.687818 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66c31b7a-e09d-45a4-895d-cf7c02a219a6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:18.687818 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-66c31b7a-e09d-45a4-895d-cf7c02a219a6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lazy-loading 'fault' on Instance uuid 21609be7-c3f0-4e24-a093-2f74ce957a35 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:27:18.757909 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-66c31b7a-e09d-45a4-895d-cf7c02a219a6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccd420e1ff744b99cb7e5650522e983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19236314583142029ffd7a1e04460cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:18.769583 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-66c31b7a-e09d-45a4-895d-cf7c02a219a6 tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 200 len: 1329 microversion: 2.1 time: 0.285953 Jun 20 12:27:18.781687 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2827/5546] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:18 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 1329 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:19.052685 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0d1082ad-29ec-48e2-b6ba-aab5bb8f97d5 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:19.054529 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0d1082ad-29ec-48e2-b6ba-aab5bb8f97d5 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 64fdc10a-358a-4091-bba7-cfa7651022a6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:19.065029 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:19.074406 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=8 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:19.088420 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d1082ad-29ec-48e2-b6ba-aab5bb8f97d5 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:19.089818 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d1082ad-29ec-48e2-b6ba-aab5bb8f97d5 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:19.093141 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d1082ad-29ec-48e2-b6ba-aab5bb8f97d5 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:19.094671 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d1082ad-29ec-48e2-b6ba-aab5bb8f97d5 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:19.378427 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0d1082ad-29ec-48e2-b6ba-aab5bb8f97d5 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:19.397111 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0d1082ad-29ec-48e2-b6ba-aab5bb8f97d5 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/64fdc10a-358a-4091-bba7-cfa7651022a6" status: 200 len: 1292 microversion: 2.1 time: 0.350842 Jun 20 12:27:19.400357 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2720/5547] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:19 2022] GET /compute/v2.1/servers/64fdc10a-358a-4091-bba7-cfa7651022a6 => generated 1292 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:19.511206 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-c8ca6c41-cc07-4238-b5b1-1ada4ef3a801 req-08c13a8b-d690-4072-8041-1d982fd2705d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21609be7-c3f0-4e24-a093-2f74ce957a35", "name": "network-vif-deleted", "tag": "23a9a38f-112e-4e3f-97f4-ae81b6b5af7c"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:19.538852 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-c8ca6c41-cc07-4238-b5b1-1ada4ef3a801 req-08c13a8b-d690-4072-8041-1d982fd2705d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:19.539305 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-c8ca6c41-cc07-4238-b5b1-1ada4ef3a801 req-08c13a8b-d690-4072-8041-1d982fd2705d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:19.565988 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-c8ca6c41-cc07-4238-b5b1-1ada4ef3a801 req-08c13a8b-d690-4072-8041-1d982fd2705d service nova] Creating event network-vif-deleted:23a9a38f-112e-4e3f-97f4-ae81b6b5af7c for instance 21609be7-c3f0-4e24-a093-2f74ce957a35 on n-h1-master-1 Jun 20 12:27:19.578469 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-c8ca6c41-cc07-4238-b5b1-1ada4ef3a801 req-08c13a8b-d690-4072-8041-1d982fd2705d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071527 Jun 20 12:27:19.579403 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2828/5548] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:27:19.787837 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0abf3cff-6a28-44d8-948a-7bd6706dc45a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:19.788555 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0abf3cff-6a28-44d8-948a-7bd6706dc45a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] [instance: 21609be7-c3f0-4e24-a093-2f74ce957a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:19.800022 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0abf3cff-6a28-44d8-948a-7bd6706dc45a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:19.824380 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0abf3cff-6a28-44d8-948a-7bd6706dc45a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:19.825923 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0abf3cff-6a28-44d8-948a-7bd6706dc45a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:19.828082 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0abf3cff-6a28-44d8-948a-7bd6706dc45a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:19.858895 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-0abf3cff-6a28-44d8-948a-7bd6706dc45a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] HTTP exception thrown: Instance 21609be7-c3f0-4e24-a093-2f74ce957a35 could not be found. Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0abf3cff-6a28-44d8-948a-7bd6706dc45a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Request method failure captured: Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 HTTP/1.1 Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGWfcnsnIAQHeUFzemCAqsDSaDjVl1ssR-hcl5jShJJncxtH_i_sUxyV8wxMh7Nb_82a0N8h4PZj2sZBDxn55X-hts8ntzQHnGvnqXOJDUG24ePgw3p5o0pMF-JHnlpIu7C903Kl6_Fa26thSLCLY9zvvFkQX2Lh7LHBESrUQztcSD8 Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 19236314583142029ffd7a1e04460cab Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServerActionsTestJSON-1849432707 Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19236314583142029ffd7a1e04460cab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19236314583142029ffd7a1e04460cab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/19236314583142029ffd7a1e04460cab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_19236314583142029ffd7a1e04460cab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServerActionsTestJSON-1849432707 Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 19236314583142029ffd7a1e04460cab Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServerActionsTestJSON-1849432707 Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServerActionsTestJSON-1849432707-project Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 4ccd420e1ff744b99cb7e5650522e983 Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServerActionsTestJSON-1849432707-project Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 21609be7-c3f0-4e24-a093-2f74ce957a35 could not be found. Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '21609be7-c3f0-4e24-a093-2f74ce957a35'} Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21609be7-c3f0-4e24-a093-2f74ce957a35 could not be found. Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21609be7-c3f0-4e24-a093-2f74ce957a35 could not be found. Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:27:19.861177 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:27:19.865146 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:27:19.865146 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:27:19.865146 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:27:19.865146 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:27:19.865146 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:27:19.865146 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21609be7-c3f0-4e24-a093-2f74ce957a35 could not be found. Jun 20 12:27:19.865146 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:27:19.865146 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0abf3cff-6a28-44d8-948a-7bd6706dc45a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Returning 404 to user: Instance 21609be7-c3f0-4e24-a093-2f74ce957a35 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:27:19.865146 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0abf3cff-6a28-44d8-948a-7bd6706dc45a tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35" status: 404 len: 111 microversion: 2.1 time: 0.079452 Jun 20 12:27:19.873832 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2721/5549] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:19 2022] GET /compute/v2.1/servers/21609be7-c3f0-4e24-a093-2f74ce957a35 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:27:19.874940 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6488efb6-d723-422a-b6e3-d25d14a77c5d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] Calling method '.version_select at 0x7f60722fe5e0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:19.925736 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6488efb6-d723-422a-b6e3-d25d14a77c5d tempest-ServerActionsTestJSON-1849432707 tempest-ServerActionsTestJSON-1849432707-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1891866882" status: 202 len: 0 microversion: 2.1 time: 0.055310 Jun 20 12:27:19.928846 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2829/5550] 10.222.0.27 () {58 vars in 1220 bytes} [Mon Jun 20 12:27:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1891866882 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:27:20.419720 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-deec40e1-fa34-4b8a-900c-3d8c2068b567 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:20.420942 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-deec40e1-fa34-4b8a-900c-3d8c2068b567 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 64fdc10a-358a-4091-bba7-cfa7651022a6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:20.439032 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-deec40e1-fa34-4b8a-900c-3d8c2068b567 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:20.443208 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-deec40e1-fa34-4b8a-900c-3d8c2068b567 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:20.444807 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-deec40e1-fa34-4b8a-900c-3d8c2068b567 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:20.445613 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-deec40e1-fa34-4b8a-900c-3d8c2068b567 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:21.287495 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-deec40e1-fa34-4b8a-900c-3d8c2068b567 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:21.299418 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-deec40e1-fa34-4b8a-900c-3d8c2068b567 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/64fdc10a-358a-4091-bba7-cfa7651022a6" status: 200 len: 1292 microversion: 2.1 time: 0.883959 Jun 20 12:27:21.303021 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2722/5551] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:20 2022] GET /compute/v2.1/servers/64fdc10a-358a-4091-bba7-cfa7651022a6 => generated 1292 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:22.321269 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7e9a7a4f-811e-4404-b51a-3802f3d565fc tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:22.323139 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7e9a7a4f-811e-4404-b51a-3802f3d565fc tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 64fdc10a-358a-4091-bba7-cfa7651022a6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:22.361484 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7e9a7a4f-811e-4404-b51a-3802f3d565fc tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:22.376673 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7e9a7a4f-811e-4404-b51a-3802f3d565fc tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:22.386478 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7e9a7a4f-811e-4404-b51a-3802f3d565fc tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:22.386939 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7e9a7a4f-811e-4404-b51a-3802f3d565fc tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:23.175922 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e0190b65-15af-4e50-bcbb-a3b0acbfdcea tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:23.176906 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e0190b65-15af-4e50-bcbb-a3b0acbfdcea tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: 359ef5fc-a540-46a9-9e68-3f5118a6e7e2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:23.187313 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e0190b65-15af-4e50-bcbb-a3b0acbfdcea tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:23.188000 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e0190b65-15af-4e50-bcbb-a3b0acbfdcea tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:23.190608 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e0190b65-15af-4e50-bcbb-a3b0acbfdcea tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:23.203408 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e0190b65-15af-4e50-bcbb-a3b0acbfdcea tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:23.269421 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7e9a7a4f-811e-4404-b51a-3802f3d565fc tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:23.295715 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e0190b65-15af-4e50-bcbb-a3b0acbfdcea tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "POST /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2/action" status: 200 len: 32641 microversion: 2.1 time: 0.124616 Jun 20 12:27:23.297217 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7e9a7a4f-811e-4404-b51a-3802f3d565fc tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/64fdc10a-358a-4091-bba7-cfa7651022a6" status: 200 len: 1292 microversion: 2.1 time: 0.982102 Jun 20 12:27:23.306685 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2723/5552] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:27:23 2022] POST /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2/action => generated 32641 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 12:27:23.307213 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2830/5553] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:22 2022] GET /compute/v2.1/servers/64fdc10a-358a-4091-bba7-cfa7651022a6 => generated 1292 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:24.327058 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c916408a-2054-49dd-95a4-21c01e223585 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:24.328545 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c916408a-2054-49dd-95a4-21c01e223585 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 64fdc10a-358a-4091-bba7-cfa7651022a6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:24.339877 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c916408a-2054-49dd-95a4-21c01e223585 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:24.340874 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c916408a-2054-49dd-95a4-21c01e223585 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:24.341942 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c916408a-2054-49dd-95a4-21c01e223585 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:24.342585 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c916408a-2054-49dd-95a4-21c01e223585 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:25.278908 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c916408a-2054-49dd-95a4-21c01e223585 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:25.302466 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c916408a-2054-49dd-95a4-21c01e223585 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/64fdc10a-358a-4091-bba7-cfa7651022a6" status: 200 len: 1292 microversion: 2.1 time: 0.991725 Jun 20 12:27:25.304541 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2724/5554] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:24 2022] GET /compute/v2.1/servers/64fdc10a-358a-4091-bba7-cfa7651022a6 => generated 1292 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:25.465553 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-7c6764e4-37b7-4fd3-81e3-095716ff01bc req-22b5b4ae-9ecf-4703-9d82-c34c828764e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "359ef5fc-a540-46a9-9e68-3f5118a6e7e2", "tag": "197f938e-4f1a-4410-a945-7fd2dd1c6261"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:25.473018 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-51bbb608-6281-4586-9cc5-3c1d59d0d09f tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:25.473531 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-51bbb608-6281-4586-9cc5-3c1d59d0d09f tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: 359ef5fc-a540-46a9-9e68-3f5118a6e7e2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:25.492174 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-51bbb608-6281-4586-9cc5-3c1d59d0d09f tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:25.492960 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-51bbb608-6281-4586-9cc5-3c1d59d0d09f tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:25.494255 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-7c6764e4-37b7-4fd3-81e3-095716ff01bc req-22b5b4ae-9ecf-4703-9d82-c34c828764e4 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:25.494906 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-51bbb608-6281-4586-9cc5-3c1d59d0d09f tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:25.496690 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-7c6764e4-37b7-4fd3-81e3-095716ff01bc req-22b5b4ae-9ecf-4703-9d82-c34c828764e4 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:25.497952 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-51bbb608-6281-4586-9cc5-3c1d59d0d09f tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:25.582344 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-7c6764e4-37b7-4fd3-81e3-095716ff01bc req-22b5b4ae-9ecf-4703-9d82-c34c828764e4 service nova] Creating event network-changed:197f938e-4f1a-4410-a945-7fd2dd1c6261 for instance 359ef5fc-a540-46a9-9e68-3f5118a6e7e2 on n-h1-master-1 Jun 20 12:27:25.597884 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-7c6764e4-37b7-4fd3-81e3-095716ff01bc req-22b5b4ae-9ecf-4703-9d82-c34c828764e4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133723 Jun 20 12:27:25.599310 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2831/5555] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:27:25.665393 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-51bbb608-6281-4586-9cc5-3c1d59d0d09f tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: 359ef5fc-a540-46a9-9e68-3f5118a6e7e2] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:27:25.873926 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-51bbb608-6281-4586-9cc5-3c1d59d0d09f tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "DELETE /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2" status: 204 len: 0 microversion: 2.1 time: 0.411176 Jun 20 12:27:25.875594 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2725/5556] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:27:25 2022] DELETE /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 12:27:25.884553 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4e432380-4825-48c7-861e-062e673c8731 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:25.885550 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4e432380-4825-48c7-861e-062e673c8731 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: 359ef5fc-a540-46a9-9e68-3f5118a6e7e2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:25.898607 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4e432380-4825-48c7-861e-062e673c8731 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:25.900090 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4e432380-4825-48c7-861e-062e673c8731 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:25.900983 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4e432380-4825-48c7-861e-062e673c8731 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:25.901438 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4e432380-4825-48c7-861e-062e673c8731 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:25.937980 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-eb64ecc1-7daa-490b-8712-0adae9881d39 req-a2557095-31ea-448e-9e9f-160060230bb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64fdc10a-358a-4091-bba7-cfa7651022a6", "name": "network-vif-plugged", "status": "completed", "tag": "8e61ccc2-5954-4a2f-82d7-ab2056d0dc66"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:25.958595 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-eb64ecc1-7daa-490b-8712-0adae9881d39 req-a2557095-31ea-448e-9e9f-160060230bb9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:25.965226 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-eb64ecc1-7daa-490b-8712-0adae9881d39 req-a2557095-31ea-448e-9e9f-160060230bb9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:26.024409 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-eb64ecc1-7daa-490b-8712-0adae9881d39 req-a2557095-31ea-448e-9e9f-160060230bb9 service nova] Creating event network-vif-plugged:8e61ccc2-5954-4a2f-82d7-ab2056d0dc66 for instance 64fdc10a-358a-4091-bba7-cfa7651022a6 on n-h2-master-1 Jun 20 12:27:26.055590 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-eb64ecc1-7daa-490b-8712-0adae9881d39 req-a2557095-31ea-448e-9e9f-160060230bb9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120533 Jun 20 12:27:26.057277 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2726/5557] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:27:26.327051 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4f4a4e26-6b1f-47a0-af05-5d11288700d1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:26.328016 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4f4a4e26-6b1f-47a0-af05-5d11288700d1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 64fdc10a-358a-4091-bba7-cfa7651022a6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:26.337334 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4f4a4e26-6b1f-47a0-af05-5d11288700d1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:26.337964 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4f4a4e26-6b1f-47a0-af05-5d11288700d1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:26.339007 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4f4a4e26-6b1f-47a0-af05-5d11288700d1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:26.342289 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4f4a4e26-6b1f-47a0-af05-5d11288700d1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:26.395685 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4e432380-4825-48c7-861e-062e673c8731 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:26.432441 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4e432380-4825-48c7-861e-062e673c8731 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2" status: 200 len: 1669 microversion: 2.1 time: 0.549813 Jun 20 12:27:26.434382 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2832/5558] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:25 2022] GET /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2 => generated 1669 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:26.807210 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4f4a4e26-6b1f-47a0-af05-5d11288700d1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:26.858251 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4f4a4e26-6b1f-47a0-af05-5d11288700d1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/64fdc10a-358a-4091-bba7-cfa7651022a6" status: 200 len: 1292 microversion: 2.1 time: 0.540637 Jun 20 12:27:26.869009 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2727/5559] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:26 2022] GET /compute/v2.1/servers/64fdc10a-358a-4091-bba7-cfa7651022a6 => generated 1292 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:27.453844 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a038a022-5b58-4474-8732-912683f2db74 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:27.455342 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a038a022-5b58-4474-8732-912683f2db74 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: 359ef5fc-a540-46a9-9e68-3f5118a6e7e2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:27.478383 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a038a022-5b58-4474-8732-912683f2db74 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:27.486559 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a038a022-5b58-4474-8732-912683f2db74 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:27.487689 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a038a022-5b58-4474-8732-912683f2db74 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:27.488323 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a038a022-5b58-4474-8732-912683f2db74 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:27.869329 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a038a022-5b58-4474-8732-912683f2db74 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:27.886254 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8875b98b-ad40-48fc-92e2-ff0bbb8f60d5 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:27.886843 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8875b98b-ad40-48fc-92e2-ff0bbb8f60d5 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 64fdc10a-358a-4091-bba7-cfa7651022a6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:27.898207 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a038a022-5b58-4474-8732-912683f2db74 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2" status: 200 len: 1669 microversion: 2.1 time: 0.446718 Jun 20 12:27:27.906179 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8875b98b-ad40-48fc-92e2-ff0bbb8f60d5 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:27.907064 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8875b98b-ad40-48fc-92e2-ff0bbb8f60d5 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:27.911981 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2833/5560] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:27 2022] GET /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2 => generated 1669 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:27.915779 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8875b98b-ad40-48fc-92e2-ff0bbb8f60d5 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:27.917898 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8875b98b-ad40-48fc-92e2-ff0bbb8f60d5 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:28.883696 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8875b98b-ad40-48fc-92e2-ff0bbb8f60d5 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:28.918383 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dba15479-1576-462c-b944-6bfe594cd440 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:28.920503 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dba15479-1576-462c-b944-6bfe594cd440 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: 359ef5fc-a540-46a9-9e68-3f5118a6e7e2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:28.956340 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dba15479-1576-462c-b944-6bfe594cd440 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:28.956718 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8875b98b-ad40-48fc-92e2-ff0bbb8f60d5 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/64fdc10a-358a-4091-bba7-cfa7651022a6" status: 200 len: 1292 microversion: 2.1 time: 1.073144 Jun 20 12:27:28.957410 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dba15479-1576-462c-b944-6bfe594cd440 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:28.957733 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2728/5561] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:27 2022] GET /compute/v2.1/servers/64fdc10a-358a-4091-bba7-cfa7651022a6 => generated 1292 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:28.975438 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dba15479-1576-462c-b944-6bfe594cd440 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:28.976058 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dba15479-1576-462c-b944-6bfe594cd440 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:29.289263 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dba15479-1576-462c-b944-6bfe594cd440 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:29.303642 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dba15479-1576-462c-b944-6bfe594cd440 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2" status: 200 len: 1669 microversion: 2.1 time: 0.389571 Jun 20 12:27:29.310196 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2834/5562] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:28 2022] GET /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2 => generated 1669 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:29.975363 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-94d2e3d9-97bc-4f19-aa20-0ef748e31752 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:29.975976 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-94d2e3d9-97bc-4f19-aa20-0ef748e31752 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 64fdc10a-358a-4091-bba7-cfa7651022a6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:29.987335 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:30.010097 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94d2e3d9-97bc-4f19-aa20-0ef748e31752 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:30.013459 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94d2e3d9-97bc-4f19-aa20-0ef748e31752 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:30.014463 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94d2e3d9-97bc-4f19-aa20-0ef748e31752 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:30.014907 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94d2e3d9-97bc-4f19-aa20-0ef748e31752 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:30.186487 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d39ff1c9-8057-4e47-a700-d908f75133d4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:30.187882 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d39ff1c9-8057-4e47-a700-d908f75133d4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 7ac4715b-0c6b-4e90-b6e3-63a115494aec] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:30.207881 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d39ff1c9-8057-4e47-a700-d908f75133d4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:30.208717 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d39ff1c9-8057-4e47-a700-d908f75133d4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:30.209807 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d39ff1c9-8057-4e47-a700-d908f75133d4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:30.210409 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d39ff1c9-8057-4e47-a700-d908f75133d4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:30.276769 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d39ff1c9-8057-4e47-a700-d908f75133d4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 7ac4715b-0c6b-4e90-b6e3-63a115494aec] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:27:30.425297 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d39ff1c9-8057-4e47-a700-d908f75133d4 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec" status: 204 len: 0 microversion: 2.1 time: 0.242977 Jun 20 12:27:30.429068 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2835/5563] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:27:30 2022] DELETE /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:27:30.441747 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-83076141-02b3-4828-8435-3832886659a3 req-86bd8360-db25-4e50-9aae-ffa8ba3547da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ac4715b-0c6b-4e90-b6e3-63a115494aec", "tag": "73ffd2e1-a5c9-4cd2-b381-c75748f2cb0b"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:30.466161 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-83076141-02b3-4828-8435-3832886659a3 req-86bd8360-db25-4e50-9aae-ffa8ba3547da service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:30.468377 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-83076141-02b3-4828-8435-3832886659a3 req-86bd8360-db25-4e50-9aae-ffa8ba3547da service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:30.497042 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-83076141-02b3-4828-8435-3832886659a3 req-86bd8360-db25-4e50-9aae-ffa8ba3547da service nova] Creating event network-changed:73ffd2e1-a5c9-4cd2-b381-c75748f2cb0b for instance 7ac4715b-0c6b-4e90-b6e3-63a115494aec on n-h2-master-1 Jun 20 12:27:30.504475 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-83076141-02b3-4828-8435-3832886659a3 req-86bd8360-db25-4e50-9aae-ffa8ba3547da service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075980 Jun 20 12:27:30.505640 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2836/5564] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:27:30.529919 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9044697a-7b47-45a8-993f-7803be6134fc tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:30.530936 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9044697a-7b47-45a8-993f-7803be6134fc tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: 359ef5fc-a540-46a9-9e68-3f5118a6e7e2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:30.544685 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9044697a-7b47-45a8-993f-7803be6134fc tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:30.545475 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9044697a-7b47-45a8-993f-7803be6134fc tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:30.546281 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9044697a-7b47-45a8-993f-7803be6134fc tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:30.546719 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9044697a-7b47-45a8-993f-7803be6134fc tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:30.633481 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9044697a-7b47-45a8-993f-7803be6134fc tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:30.648482 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9044697a-7b47-45a8-993f-7803be6134fc tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2" status: 200 len: 1483 microversion: 2.1 time: 0.124671 Jun 20 12:27:30.653758 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2837/5565] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:30 2022] GET /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2 => generated 1483 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:30.665938 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bd09cde2-8c06-498c-94fb-c0530a7467a0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:30.669652 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bd09cde2-8c06-498c-94fb-c0530a7467a0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 7ac4715b-0c6b-4e90-b6e3-63a115494aec] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:30.684078 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bd09cde2-8c06-498c-94fb-c0530a7467a0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:30.684589 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bd09cde2-8c06-498c-94fb-c0530a7467a0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:30.689098 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bd09cde2-8c06-498c-94fb-c0530a7467a0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:30.690236 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bd09cde2-8c06-498c-94fb-c0530a7467a0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:31.197709 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bd09cde2-8c06-498c-94fb-c0530a7467a0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:31.203541 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:31.216459 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bd09cde2-8c06-498c-94fb-c0530a7467a0 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec" status: 200 len: 1687 microversion: 2.1 time: 0.560595 Jun 20 12:27:31.218121 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2838/5566] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:30 2022] GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec => generated 1687 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:31.227670 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-b33d775b-61c1-4b7a-8c7a-7f04e4662f8d req-4c28a8c9-f04c-4098-8011-59f9008e90df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "359ef5fc-a540-46a9-9e68-3f5118a6e7e2", "name": "network-vif-deleted", "tag": "197f938e-4f1a-4410-a945-7fd2dd1c6261"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:31.244476 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b33d775b-61c1-4b7a-8c7a-7f04e4662f8d req-4c28a8c9-f04c-4098-8011-59f9008e90df service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:31.245158 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b33d775b-61c1-4b7a-8c7a-7f04e4662f8d req-4c28a8c9-f04c-4098-8011-59f9008e90df service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:31.327649 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-b33d775b-61c1-4b7a-8c7a-7f04e4662f8d req-4c28a8c9-f04c-4098-8011-59f9008e90df service nova] Creating event network-vif-deleted:197f938e-4f1a-4410-a945-7fd2dd1c6261 for instance 359ef5fc-a540-46a9-9e68-3f5118a6e7e2 on n-h1-master-1 Jun 20 12:27:31.345889 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-b33d775b-61c1-4b7a-8c7a-7f04e4662f8d req-4c28a8c9-f04c-4098-8011-59f9008e90df service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125537 Jun 20 12:27:31.350886 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2839/5567] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:27:31.360872 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-94d2e3d9-97bc-4f19-aa20-0ef748e31752 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:31.398126 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-94d2e3d9-97bc-4f19-aa20-0ef748e31752 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/64fdc10a-358a-4091-bba7-cfa7651022a6" status: 200 len: 1473 microversion: 2.1 time: 1.425288 Jun 20 12:27:31.400981 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2729/5568] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:29 2022] GET /compute/v2.1/servers/64fdc10a-358a-4091-bba7-cfa7651022a6 => generated 1473 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:31.653158 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-161b4b35-6d01-454f-93bc-09b9977a4538 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-680910361", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:31.672095 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6b226da9-20d5-42c3-be94-df0c197fb075 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:31.673005 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6b226da9-20d5-42c3-be94-df0c197fb075 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: 359ef5fc-a540-46a9-9e68-3f5118a6e7e2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:31.687240 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6b226da9-20d5-42c3-be94-df0c197fb075 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:31.689160 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6b226da9-20d5-42c3-be94-df0c197fb075 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:31.690517 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6b226da9-20d5-42c3-be94-df0c197fb075 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:31.692174 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6b226da9-20d5-42c3-be94-df0c197fb075 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:31.774713 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-161b4b35-6d01-454f-93bc-09b9977a4538 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] validate_networks() for [('ce2e9d9e-a74d-4fc7-950c-df9300f57b6c', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:27:31.831788 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6b226da9-20d5-42c3-be94-df0c197fb075 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:31.832342 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6b226da9-20d5-42c3-be94-df0c197fb075 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:31.832801 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-6b226da9-20d5-42c3-be94-df0c197fb075 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lazy-loading 'fault' on Instance uuid 359ef5fc-a540-46a9-9e68-3f5118a6e7e2 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:27:31.998917 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6b226da9-20d5-42c3-be94-df0c197fb075 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeafcd88ca6c415e90b51c262b62597f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed88b4072a24b37a5ceec3b239ac8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:32.012480 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6b226da9-20d5-42c3-be94-df0c197fb075 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2" status: 200 len: 1337 microversion: 2.1 time: 0.341062 Jun 20 12:27:32.013493 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2730/5569] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:31 2022] GET /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2 => generated 1337 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:32.244752 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8ad8b719-2b18-422d-a1cf-9491483fd23d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:32.245617 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8ad8b719-2b18-422d-a1cf-9491483fd23d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 7ac4715b-0c6b-4e90-b6e3-63a115494aec] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:32.259032 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ad8b719-2b18-422d-a1cf-9491483fd23d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:32.260740 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ad8b719-2b18-422d-a1cf-9491483fd23d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:32.261720 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ad8b719-2b18-422d-a1cf-9491483fd23d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:32.267222 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ad8b719-2b18-422d-a1cf-9491483fd23d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:32.888218 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8ad8b719-2b18-422d-a1cf-9491483fd23d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:32.899912 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8ad8b719-2b18-422d-a1cf-9491483fd23d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec" status: 200 len: 1687 microversion: 2.1 time: 0.659077 Jun 20 12:27:32.902651 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2731/5570] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:32 2022] GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec => generated 1687 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:33.030564 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-12ef779c-4478-4203-9127-a62674cd3f3e tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:33.031363 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-12ef779c-4478-4203-9127-a62674cd3f3e tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] [instance: 359ef5fc-a540-46a9-9e68-3f5118a6e7e2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:33.041252 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-12ef779c-4478-4203-9127-a62674cd3f3e tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:33.041914 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-12ef779c-4478-4203-9127-a62674cd3f3e tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:33.043055 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-12ef779c-4478-4203-9127-a62674cd3f3e tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:33.043546 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-12ef779c-4478-4203-9127-a62674cd3f3e tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:33.073474 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-12ef779c-4478-4203-9127-a62674cd3f3e tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] HTTP exception thrown: Instance 359ef5fc-a540-46a9-9e68-3f5118a6e7e2 could not be found. Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-12ef779c-4478-4203-9127-a62674cd3f3e tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Request method failure captured: Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2 HTTP/1.1 Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGa72kVR_SSPWnUGZRxw-G3J4-hwvpug1luVy5r8Ca_eaA02-YD93q1FWHSKS9Tn7i_0JfINvN3iapLSrtvCneB1tQluVFyYyF3eAJhnlxA-bJnSoX10K-r8AAG7MPcURr7bqFwSNhyccR_Qcws2qeyXimx-pEWrLTSIlVSLW3XcvUM Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 1ed88b4072a24b37a5ceec3b239ac8fa Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-TestNetworkBasicOps-648379632 Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1ed88b4072a24b37a5ceec3b239ac8fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1ed88b4072a24b37a5ceec3b239ac8fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1ed88b4072a24b37a5ceec3b239ac8fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1ed88b4072a24b37a5ceec3b239ac8fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-TestNetworkBasicOps-648379632 Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 1ed88b4072a24b37a5ceec3b239ac8fa Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-TestNetworkBasicOps-648379632 Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-TestNetworkBasicOps-648379632-project Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: aeafcd88ca6c415e90b51c262b62597f Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-TestNetworkBasicOps-648379632-project Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 359ef5fc-a540-46a9-9e68-3f5118a6e7e2 could not be found. Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '359ef5fc-a540-46a9-9e68-3f5118a6e7e2'} Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 359ef5fc-a540-46a9-9e68-3f5118a6e7e2 could not be found. Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 359ef5fc-a540-46a9-9e68-3f5118a6e7e2 could not be found. Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:27:33.075462 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:27:33.079443 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:27:33.079443 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:27:33.079443 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:27:33.079443 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:27:33.079443 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:27:33.079443 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 359ef5fc-a540-46a9-9e68-3f5118a6e7e2 could not be found. Jun 20 12:27:33.079443 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:27:33.079443 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-12ef779c-4478-4203-9127-a62674cd3f3e tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Returning 404 to user: Instance 359ef5fc-a540-46a9-9e68-3f5118a6e7e2 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:27:33.079443 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-12ef779c-4478-4203-9127-a62674cd3f3e tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "GET /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2" status: 404 len: 111 microversion: 2.1 time: 0.051183 Jun 20 12:27:33.079443 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2732/5571] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:33 2022] GET /compute/v2.1/servers/359ef5fc-a540-46a9-9e68-3f5118a6e7e2 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:27:33.676081 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-81450864-a89f-4a97-adae-30151a939942 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] Calling method '.version_select at 0x7f60724ec820>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:33.750963 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-81450864-a89f-4a97-adae-30151a939942 tempest-TestNetworkBasicOps-648379632 tempest-TestNetworkBasicOps-648379632-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-324843391" status: 202 len: 0 microversion: 2.1 time: 0.079618 Jun 20 12:27:33.755169 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2733/5572] 10.222.0.27 () {58 vars in 1253 bytes} [Mon Jun 20 12:27:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-324843391 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:27:33.924684 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d7f029fc-69f9-41dc-890b-2fe95d4ce419 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:33.925801 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d7f029fc-69f9-41dc-890b-2fe95d4ce419 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 7ac4715b-0c6b-4e90-b6e3-63a115494aec] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:33.936252 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d7f029fc-69f9-41dc-890b-2fe95d4ce419 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:33.936252 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d7f029fc-69f9-41dc-890b-2fe95d4ce419 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:33.940647 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d7f029fc-69f9-41dc-890b-2fe95d4ce419 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:33.955704 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d7f029fc-69f9-41dc-890b-2fe95d4ce419 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:33.964586 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:34.258246 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d7f029fc-69f9-41dc-890b-2fe95d4ce419 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd27c8696f7147e18054b26ebbae7045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e481852fe4e6ebdc15ec343a741f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:34.311809 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d7f029fc-69f9-41dc-890b-2fe95d4ce419 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec" status: 200 len: 1501 microversion: 2.1 time: 0.392900 Jun 20 12:27:34.321441 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2734/5573] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:33 2022] GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec => generated 1501 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:34.349645 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-75ac06f4-ecc6-4554-8e57-9d7966a4bd76 req-8b022076-66e1-4976-b32f-8c7c740f7882 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ac4715b-0c6b-4e90-b6e3-63a115494aec", "name": "network-vif-deleted", "tag": "73ffd2e1-a5c9-4cd2-b381-c75748f2cb0b"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:34.367811 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-75ac06f4-ecc6-4554-8e57-9d7966a4bd76 req-8b022076-66e1-4976-b32f-8c7c740f7882 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:34.372136 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-75ac06f4-ecc6-4554-8e57-9d7966a4bd76 req-8b022076-66e1-4976-b32f-8c7c740f7882 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:34.406952 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-75ac06f4-ecc6-4554-8e57-9d7966a4bd76 req-8b022076-66e1-4976-b32f-8c7c740f7882 service nova] Creating event network-vif-deleted:73ffd2e1-a5c9-4cd2-b381-c75748f2cb0b for instance 7ac4715b-0c6b-4e90-b6e3-63a115494aec on n-h2-master-1 Jun 20 12:27:34.424814 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-75ac06f4-ecc6-4554-8e57-9d7966a4bd76 req-8b022076-66e1-4976-b32f-8c7c740f7882 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099950 Jun 20 12:27:34.425982 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2735/5574] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:27:34.598011 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-161b4b35-6d01-454f-93bc-09b9977a4538 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:27:34.598569 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-161b4b35-6d01-454f-93bc-09b9977a4538 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:27:34.598919 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-161b4b35-6d01-454f-93bc-09b9977a4538 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:27:34.599326 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-161b4b35-6d01-454f-93bc-09b9977a4538 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:27:34.599739 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-161b4b35-6d01-454f-93bc-09b9977a4538 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:27:34.622385 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-161b4b35-6d01-454f-93bc-09b9977a4538 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:34.622985 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-161b4b35-6d01-454f-93bc-09b9977a4538 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:34.623801 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-161b4b35-6d01-454f-93bc-09b9977a4538 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:34.624259 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-161b4b35-6d01-454f-93bc-09b9977a4538 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:34.698872 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-161b4b35-6d01-454f-93bc-09b9977a4538 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Getting quotas for project 896c053324b34720a7d0f151bfdc8b10. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:27:34.719215 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-161b4b35-6d01-454f-93bc-09b9977a4538 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Getting quotas for user 8878d44956bd42e18f0409534e562ab6 and project 896c053324b34720a7d0f151bfdc8b10. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:27:34.756565 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-161b4b35-6d01-454f-93bc-09b9977a4538 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:27:34.772019 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-161b4b35-6d01-454f-93bc-09b9977a4538 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: c5902c89-8503-434f-a065-b6c8268f95d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:27:34.942484 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-161b4b35-6d01-454f-93bc-09b9977a4538 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.293023 Jun 20 12:27:34.953064 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2840/5575] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:27:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 3307 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:27:34.960170 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-deafb729-c3d0-4743-8667-b74b3b602f8f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:34.960791 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-deafb729-c3d0-4743-8667-b74b3b602f8f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: c5902c89-8503-434f-a065-b6c8268f95d7] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:35.048768 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-deafb729-c3d0-4743-8667-b74b3b602f8f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: c5902c89-8503-434f-a065-b6c8268f95d7] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:27:35.266565 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-deafb729-c3d0-4743-8667-b74b3b602f8f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c5902c89-8503-434f-a065-b6c8268f95d7" status: 204 len: 0 microversion: 2.1 time: 0.312295 Jun 20 12:27:35.268555 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2736/5576] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:27:34 2022] DELETE /compute/v2.1/servers/c5902c89-8503-434f-a065-b6c8268f95d7 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:27:35.278447 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f5f27b0a-0944-4cf8-882e-ca85e13fa713 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:35.279287 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f5f27b0a-0944-4cf8-882e-ca85e13fa713 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: c5902c89-8503-434f-a065-b6c8268f95d7] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:35.321780 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-f5f27b0a-0944-4cf8-882e-ca85e13fa713 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] HTTP exception thrown: Instance c5902c89-8503-434f-a065-b6c8268f95d7 could not be found. Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f5f27b0a-0944-4cf8-882e-ca85e13fa713 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Request method failure captured: Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/c5902c89-8503-434f-a065-b6c8268f95d7 HTTP/1.1 Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGeaPbwuiKlZtfAakVi9AU1jZJYQpsiuqbtqj4H7EyEfa_Hs7Z-uZ4kORsCa_VB61-2zGcpt-Akt_fwFGZsdE57QH4a5RFxoaFSpMB5wQSEpC1nxSFtZmML3yZTCD6a9Nk7nPWXZGtd_9TDU17ULy9DxSwRUUNLntxWZGEmDQVAe1xk Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersTestJSON-953297781 Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersTestJSON-953297781 Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersTestJSON-953297781 Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersTestJSON-953297781-project Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 8878d44956bd42e18f0409534e562ab6 Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersTestJSON-953297781-project Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: exception: Instance c5902c89-8503-434f-a065-b6c8268f95d7 could not be found. Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'c5902c89-8503-434f-a065-b6c8268f95d7'} Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2877, in _get_instance Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance c5902c89-8503-434f-a065-b6c8268f95d7 Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2889, in _get_instance Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5902c89-8503-434f-a065-b6c8268f95d7 could not be found. Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:27:35.336627 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:27:35.341486 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:27:35.341486 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:27:35.341486 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:27:35.341486 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:27:35.341486 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:27:35.341486 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:27:35.341486 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:27:35.341486 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:27:35.341486 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:27:35.341486 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:27:35.341486 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5902c89-8503-434f-a065-b6c8268f95d7 could not be found. Jun 20 12:27:35.341486 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:27:35.341486 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:27:35.341486 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:27:35.341486 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:27:35.341486 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:27:35.341486 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:27:35.341486 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:27:35.341486 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:27:35.341486 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5902c89-8503-434f-a065-b6c8268f95d7 could not be found. Jun 20 12:27:35.341486 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:27:35.344379 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-df417edd-6d51-4a05-970d-4d6e8c64889d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:35.344912 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-df417edd-6d51-4a05-970d-4d6e8c64889d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] [instance: 7ac4715b-0c6b-4e90-b6e3-63a115494aec] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:35.346229 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f5f27b0a-0944-4cf8-882e-ca85e13fa713 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Returning 404 to user: Instance c5902c89-8503-434f-a065-b6c8268f95d7 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:27:35.347826 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f5f27b0a-0944-4cf8-882e-ca85e13fa713 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/c5902c89-8503-434f-a065-b6c8268f95d7" status: 404 len: 111 microversion: 2.1 time: 0.075149 Jun 20 12:27:35.358340 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2841/5577] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:35 2022] GET /compute/v2.1/servers/c5902c89-8503-434f-a065-b6c8268f95d7 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:27:35.365468 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-df417edd-6d51-4a05-970d-4d6e8c64889d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:35.365935 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-df417edd-6d51-4a05-970d-4d6e8c64889d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:35.370422 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-df417edd-6d51-4a05-970d-4d6e8c64889d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:35.370882 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-df417edd-6d51-4a05-970d-4d6e8c64889d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:35.413774 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-df417edd-6d51-4a05-970d-4d6e8c64889d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] HTTP exception thrown: Instance 7ac4715b-0c6b-4e90-b6e3-63a115494aec could not be found. Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-df417edd-6d51-4a05-970d-4d6e8c64889d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Request method failure captured: Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec HTTP/1.1 Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGRxXwEWVrLndBXp9okenLjyhkdOBOwXRK4Cejibgug0y9gZVb-q35CPxL4ypqyn2D__W7NeZfrt6P6zq_dz_jtM9HHb9YjfilwN-Kw8EltvT9MAEPJplbU2PqTsTUjGeGogBzl7yp09NSZXdDKx25vj0o6ShE6q88hEvQEZpmuKykM Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 9e9e481852fe4e6ebdc15ec343a741f2 Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2045574846 Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9e9e481852fe4e6ebdc15ec343a741f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9e9e481852fe4e6ebdc15ec343a741f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9e9e481852fe4e6ebdc15ec343a741f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9e9e481852fe4e6ebdc15ec343a741f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2045574846 Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 9e9e481852fe4e6ebdc15ec343a741f2 Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2045574846 Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-TestNetworkAdvancedServerOps-2045574846-project Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: cd27c8696f7147e18054b26ebbae7045 Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2045574846-project Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 7ac4715b-0c6b-4e90-b6e3-63a115494aec could not be found. Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '7ac4715b-0c6b-4e90-b6e3-63a115494aec'} Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ac4715b-0c6b-4e90-b6e3-63a115494aec could not be found. Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ac4715b-0c6b-4e90-b6e3-63a115494aec could not be found. Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:27:35.418690 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:27:35.422789 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:27:35.422789 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:27:35.422789 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:27:35.422789 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:27:35.422789 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:27:35.422789 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:27:35.422789 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ac4715b-0c6b-4e90-b6e3-63a115494aec could not be found. Jun 20 12:27:35.422789 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:27:35.422789 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-df417edd-6d51-4a05-970d-4d6e8c64889d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Returning 404 to user: Instance 7ac4715b-0c6b-4e90-b6e3-63a115494aec could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:27:35.422789 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-df417edd-6d51-4a05-970d-4d6e8c64889d tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec" status: 404 len: 111 microversion: 2.1 time: 0.086034 Jun 20 12:27:35.428746 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2737/5578] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:35 2022] GET /compute/v2.1/servers/7ac4715b-0c6b-4e90-b6e3-63a115494aec => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:27:35.639727 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c3f46655-d0a0-4b71-a499-9956ffa0fd03 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1232178241", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "ce2e9d9e-a74d-4fc7-950c-df9300f57b6c"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:35.792438 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-c3f46655-d0a0-4b71-a499-9956ffa0fd03 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] validate_networks() for [('ce2e9d9e-a74d-4fc7-950c-df9300f57b6c', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:27:36.645827 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-c3f46655-d0a0-4b71-a499-9956ffa0fd03 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:27:36.646526 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-c3f46655-d0a0-4b71-a499-9956ffa0fd03 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:27:36.646757 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-c3f46655-d0a0-4b71-a499-9956ffa0fd03 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:27:36.647174 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-c3f46655-d0a0-4b71-a499-9956ffa0fd03 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:27:36.647651 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-c3f46655-d0a0-4b71-a499-9956ffa0fd03 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:27:36.661742 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c3f46655-d0a0-4b71-a499-9956ffa0fd03 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:36.662194 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c3f46655-d0a0-4b71-a499-9956ffa0fd03 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:36.666235 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c3f46655-d0a0-4b71-a499-9956ffa0fd03 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:36.666719 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c3f46655-d0a0-4b71-a499-9956ffa0fd03 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:36.711096 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-c3f46655-d0a0-4b71-a499-9956ffa0fd03 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Getting quotas for project 896c053324b34720a7d0f151bfdc8b10. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:27:36.719706 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-c3f46655-d0a0-4b71-a499-9956ffa0fd03 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Getting quotas for user 8878d44956bd42e18f0409534e562ab6 and project 896c053324b34720a7d0f151bfdc8b10. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:27:36.758751 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c3f46655-d0a0-4b71-a499-9956ffa0fd03 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:27:36.775714 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c3f46655-d0a0-4b71-a499-9956ffa0fd03 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 2c913649-2aa1-40e3-b5b0-715d0075c915] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:27:36.873757 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c3f46655-d0a0-4b71-a499-9956ffa0fd03 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.239256 Jun 20 12:27:36.875683 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2842/5579] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:27:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1242 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:27:36.895869 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-12026dac-4c31-4da8-a199-d05f28a4adab tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:36.905186 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-12026dac-4c31-4da8-a199-d05f28a4adab tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 2c913649-2aa1-40e3-b5b0-715d0075c915] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:37.329440 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-12026dac-4c31-4da8-a199-d05f28a4adab tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:37.342803 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-12026dac-4c31-4da8-a199-d05f28a4adab tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915" status: 200 len: 1221 microversion: 2.1 time: 0.458256 Jun 20 12:27:37.344342 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2738/5580] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:36 2022] GET /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915 => generated 1221 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:38.372821 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-76ef2f91-c4f6-48c5-9794-5b82b09648b8 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:38.379482 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-76ef2f91-c4f6-48c5-9794-5b82b09648b8 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 2c913649-2aa1-40e3-b5b0-715d0075c915] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:38.402970 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-76ef2f91-c4f6-48c5-9794-5b82b09648b8 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:38.420324 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-76ef2f91-c4f6-48c5-9794-5b82b09648b8 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:38.422775 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-76ef2f91-c4f6-48c5-9794-5b82b09648b8 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:38.425279 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-76ef2f91-c4f6-48c5-9794-5b82b09648b8 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:38.634358 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-76ef2f91-c4f6-48c5-9794-5b82b09648b8 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:38.660826 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-76ef2f91-c4f6-48c5-9794-5b82b09648b8 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915" status: 200 len: 1273 microversion: 2.1 time: 0.300541 Jun 20 12:27:38.661439 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2843/5581] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:38 2022] GET /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915 => generated 1273 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:39.679582 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-01b93392-5c29-4fd3-bd45-46ccea6abec2 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:39.680835 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-01b93392-5c29-4fd3-bd45-46ccea6abec2 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 2c913649-2aa1-40e3-b5b0-715d0075c915] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:39.693969 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-01b93392-5c29-4fd3-bd45-46ccea6abec2 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:39.696027 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-01b93392-5c29-4fd3-bd45-46ccea6abec2 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:39.697859 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-01b93392-5c29-4fd3-bd45-46ccea6abec2 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:39.700587 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-01b93392-5c29-4fd3-bd45-46ccea6abec2 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:39.968964 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-01b93392-5c29-4fd3-bd45-46ccea6abec2 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:39.978214 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-01b93392-5c29-4fd3-bd45-46ccea6abec2 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915" status: 200 len: 1279 microversion: 2.1 time: 0.302815 Jun 20 12:27:39.992659 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2739/5582] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:39 2022] GET /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915 => generated 1279 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:41.004127 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bf2e225c-ba5f-43dd-8013-dc4e7830b8e0 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:41.004127 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bf2e225c-ba5f-43dd-8013-dc4e7830b8e0 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 2c913649-2aa1-40e3-b5b0-715d0075c915] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:41.015447 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf2e225c-ba5f-43dd-8013-dc4e7830b8e0 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:41.019879 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf2e225c-ba5f-43dd-8013-dc4e7830b8e0 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:41.021168 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf2e225c-ba5f-43dd-8013-dc4e7830b8e0 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:41.021729 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf2e225c-ba5f-43dd-8013-dc4e7830b8e0 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:41.169200 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bf2e225c-ba5f-43dd-8013-dc4e7830b8e0 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:41.178174 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bf2e225c-ba5f-43dd-8013-dc4e7830b8e0 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915" status: 200 len: 1279 microversion: 2.1 time: 0.182534 Jun 20 12:27:41.189410 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2844/5583] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:40 2022] GET /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915 => generated 1279 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:42.203090 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f047779b-ae9c-473d-a5ca-802a7ae30c12 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:42.204559 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f047779b-ae9c-473d-a5ca-802a7ae30c12 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 2c913649-2aa1-40e3-b5b0-715d0075c915] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:42.221286 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f047779b-ae9c-473d-a5ca-802a7ae30c12 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:42.223108 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f047779b-ae9c-473d-a5ca-802a7ae30c12 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:42.225406 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f047779b-ae9c-473d-a5ca-802a7ae30c12 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:42.227768 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f047779b-ae9c-473d-a5ca-802a7ae30c12 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:43.281675 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f047779b-ae9c-473d-a5ca-802a7ae30c12 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:43.304870 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f047779b-ae9c-473d-a5ca-802a7ae30c12 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915" status: 200 len: 1321 microversion: 2.1 time: 1.107086 Jun 20 12:27:43.319273 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2740/5584] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:42 2022] GET /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915 => generated 1321 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:44.327806 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-44556eb8-a8b7-44f0-af0a-33c0b0a19c2c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:44.328568 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-44556eb8-a8b7-44f0-af0a-33c0b0a19c2c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 2c913649-2aa1-40e3-b5b0-715d0075c915] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:44.331315 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:44.356269 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-44556eb8-a8b7-44f0-af0a-33c0b0a19c2c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:44.357115 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-44556eb8-a8b7-44f0-af0a-33c0b0a19c2c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:44.359771 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-44556eb8-a8b7-44f0-af0a-33c0b0a19c2c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:44.361408 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-44556eb8-a8b7-44f0-af0a-33c0b0a19c2c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:45.334676 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-44556eb8-a8b7-44f0-af0a-33c0b0a19c2c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:45.347817 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-44556eb8-a8b7-44f0-af0a-33c0b0a19c2c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915" status: 200 len: 1321 microversion: 2.1 time: 1.027191 Jun 20 12:27:45.351956 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2845/5585] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:44 2022] GET /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915 => generated 1321 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:46.370473 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7ab05f41-a5d7-4d26-b23e-03866fe97d4f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:46.372194 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7ab05f41-a5d7-4d26-b23e-03866fe97d4f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 2c913649-2aa1-40e3-b5b0-715d0075c915] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:46.380717 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ab05f41-a5d7-4d26-b23e-03866fe97d4f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:46.381476 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ab05f41-a5d7-4d26-b23e-03866fe97d4f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:46.382627 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ab05f41-a5d7-4d26-b23e-03866fe97d4f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:46.383292 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ab05f41-a5d7-4d26-b23e-03866fe97d4f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:47.334465 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=4 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:47.392962 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7ab05f41-a5d7-4d26-b23e-03866fe97d4f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:47.459536 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7ab05f41-a5d7-4d26-b23e-03866fe97d4f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915" status: 200 len: 1321 microversion: 2.1 time: 1.091184 Jun 20 12:27:47.461911 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2741/5586] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:46 2022] GET /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915 => generated 1321 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:47.616998 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=4 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:47.618441 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=12 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:48.113114 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-d6035dfb-8b00-4724-bfa2-4eeb8def9cf0 req-1cfd05ef-3851-4dcf-8761-5bbafbf6926d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c913649-2aa1-40e3-b5b0-715d0075c915", "tag": "2ab72e1e-70f7-4f27-93d3-971ed996890d"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:48.131964 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-d6035dfb-8b00-4724-bfa2-4eeb8def9cf0 req-1cfd05ef-3851-4dcf-8761-5bbafbf6926d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:48.133384 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-d6035dfb-8b00-4724-bfa2-4eeb8def9cf0 req-1cfd05ef-3851-4dcf-8761-5bbafbf6926d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:48.168741 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-d6035dfb-8b00-4724-bfa2-4eeb8def9cf0 req-1cfd05ef-3851-4dcf-8761-5bbafbf6926d service nova] Creating event network-changed:2ab72e1e-70f7-4f27-93d3-971ed996890d for instance 2c913649-2aa1-40e3-b5b0-715d0075c915 on n-h1-master-1 Jun 20 12:27:48.186834 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-d6035dfb-8b00-4724-bfa2-4eeb8def9cf0 req-1cfd05ef-3851-4dcf-8761-5bbafbf6926d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.589842 Jun 20 12:27:48.187929 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2846/5587] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:27:48.478103 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-76d3623a-3d72-4df0-953b-9c205ddf3c8d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:48.478751 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-76d3623a-3d72-4df0-953b-9c205ddf3c8d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 2c913649-2aa1-40e3-b5b0-715d0075c915] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:48.492688 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-76d3623a-3d72-4df0-953b-9c205ddf3c8d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:48.493111 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-76d3623a-3d72-4df0-953b-9c205ddf3c8d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:48.497710 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-76d3623a-3d72-4df0-953b-9c205ddf3c8d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:48.499691 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-76d3623a-3d72-4df0-953b-9c205ddf3c8d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:51.139044 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-76d3623a-3d72-4df0-953b-9c205ddf3c8d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:51.175509 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-76d3623a-3d72-4df0-953b-9c205ddf3c8d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915" status: 200 len: 1321 microversion: 2.1 time: 2.686618 Jun 20 12:27:51.179667 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2742/5588] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:48 2022] GET /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915 => generated 1321 bytes in 2706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:52.195540 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-44964975-5b53-48f3-9c2e-fb02ed31ecd6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:52.196348 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-44964975-5b53-48f3-9c2e-fb02ed31ecd6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 2c913649-2aa1-40e3-b5b0-715d0075c915] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:52.244374 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-44964975-5b53-48f3-9c2e-fb02ed31ecd6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:52.256629 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-44964975-5b53-48f3-9c2e-fb02ed31ecd6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:52.263734 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-44964975-5b53-48f3-9c2e-fb02ed31ecd6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:52.265918 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-44964975-5b53-48f3-9c2e-fb02ed31ecd6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:52.826176 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-44964975-5b53-48f3-9c2e-fb02ed31ecd6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:52.834100 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-44964975-5b53-48f3-9c2e-fb02ed31ecd6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915" status: 200 len: 1321 microversion: 2.1 time: 0.644279 Jun 20 12:27:52.834709 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2847/5589] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:52 2022] GET /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915 => generated 1321 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:53.851292 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-df74ea42-3c19-4840-ad75-407d010f2dd6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:53.852065 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-df74ea42-3c19-4840-ad75-407d010f2dd6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 2c913649-2aa1-40e3-b5b0-715d0075c915] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:53.860811 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-df74ea42-3c19-4840-ad75-407d010f2dd6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:53.875086 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-df74ea42-3c19-4840-ad75-407d010f2dd6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:53.882491 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-df74ea42-3c19-4840-ad75-407d010f2dd6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:53.883570 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-df74ea42-3c19-4840-ad75-407d010f2dd6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:55.371815 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-df74ea42-3c19-4840-ad75-407d010f2dd6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:55.406346 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-df74ea42-3c19-4840-ad75-407d010f2dd6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915" status: 200 len: 1321 microversion: 2.1 time: 1.549893 Jun 20 12:27:55.407906 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2743/5590] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:53 2022] GET /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915 => generated 1321 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:56.436859 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e9b87eb2-05a8-4707-a44a-7e5df50f4659 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:56.438096 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e9b87eb2-05a8-4707-a44a-7e5df50f4659 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 2c913649-2aa1-40e3-b5b0-715d0075c915] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:56.456972 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e9b87eb2-05a8-4707-a44a-7e5df50f4659 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:56.457642 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e9b87eb2-05a8-4707-a44a-7e5df50f4659 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:56.459096 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e9b87eb2-05a8-4707-a44a-7e5df50f4659 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:56.462928 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e9b87eb2-05a8-4707-a44a-7e5df50f4659 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:57.888125 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e9b87eb2-05a8-4707-a44a-7e5df50f4659 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:57.897394 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e9b87eb2-05a8-4707-a44a-7e5df50f4659 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915" status: 200 len: 1321 microversion: 2.1 time: 1.465902 Jun 20 12:27:57.908116 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2848/5591] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:56 2022] GET /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915 => generated 1321 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:58.094407 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2143708b-4006-44ea-bbfc-26a1f17ccad9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] Calling method '.version_select at 0x7f60724dc8b0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:58.158736 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2143708b-4006-44ea-bbfc-26a1f17ccad9 tempest-TestNetworkAdvancedServerOps-2045574846 tempest-TestNetworkAdvancedServerOps-2045574846-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-690292039" status: 202 len: 0 microversion: 2.1 time: 0.061240 Jun 20 12:27:58.168528 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2744/5592] 10.222.0.27 () {58 vars in 1280 bytes} [Mon Jun 20 12:27:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-690292039 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:27:58.927599 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-160b8783-8c3f-4bd9-9268-88be94e51299 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:58.928239 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-160b8783-8c3f-4bd9-9268-88be94e51299 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 2c913649-2aa1-40e3-b5b0-715d0075c915] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:58.983238 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-160b8783-8c3f-4bd9-9268-88be94e51299 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:58.983976 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-160b8783-8c3f-4bd9-9268-88be94e51299 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:59.009265 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-160b8783-8c3f-4bd9-9268-88be94e51299 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:59.010004 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-160b8783-8c3f-4bd9-9268-88be94e51299 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:59.210926 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e27e4379-8dde-49f3-b99f-13673d441f7a tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-992975728", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "dd16f33c-7021-4d65-90f2-f0f7d2a01122"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:59.337235 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-e27e4379-8dde-49f3-b99f-13673d441f7a tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] validate_networks() for [('dd16f33c-7021-4d65-90f2-f0f7d2a01122', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:27:59.697835 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-160b8783-8c3f-4bd9-9268-88be94e51299 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:59.709212 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-160b8783-8c3f-4bd9-9268-88be94e51299 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915" status: 200 len: 1321 microversion: 2.1 time: 0.795779 Jun 20 12:27:59.709717 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2745/5593] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:58 2022] GET /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915 => generated 1321 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:00.203285 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-9852266e-bbf9-4fbd-a08f-9b107326ed59 req-d39bb1fc-0304-4851-8102-c7015ac6a37f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c913649-2aa1-40e3-b5b0-715d0075c915", "name": "network-vif-plugged", "status": "completed", "tag": "2ab72e1e-70f7-4f27-93d3-971ed996890d"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:28:00.207341 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:00.229722 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9852266e-bbf9-4fbd-a08f-9b107326ed59 req-d39bb1fc-0304-4851-8102-c7015ac6a37f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:00.230621 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9852266e-bbf9-4fbd-a08f-9b107326ed59 req-d39bb1fc-0304-4851-8102-c7015ac6a37f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:00.265149 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-9852266e-bbf9-4fbd-a08f-9b107326ed59 req-d39bb1fc-0304-4851-8102-c7015ac6a37f service nova] Creating event network-vif-plugged:2ab72e1e-70f7-4f27-93d3-971ed996890d for instance 2c913649-2aa1-40e3-b5b0-715d0075c915 on n-h1-master-1 Jun 20 12:28:00.276814 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-9852266e-bbf9-4fbd-a08f-9b107326ed59 req-d39bb1fc-0304-4851-8102-c7015ac6a37f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.547094 Jun 20 12:28:00.280236 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2746/5594] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:28:00.672030 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-e27e4379-8dde-49f3-b99f-13673d441f7a tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:28:00.672623 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-e27e4379-8dde-49f3-b99f-13673d441f7a tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:28:00.672949 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-e27e4379-8dde-49f3-b99f-13673d441f7a tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:28:00.673360 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-e27e4379-8dde-49f3-b99f-13673d441f7a tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:28:00.673773 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-e27e4379-8dde-49f3-b99f-13673d441f7a tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:28:00.687167 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e27e4379-8dde-49f3-b99f-13673d441f7a tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:00.687627 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e27e4379-8dde-49f3-b99f-13673d441f7a tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:00.688461 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e27e4379-8dde-49f3-b99f-13673d441f7a tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:00.688917 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e27e4379-8dde-49f3-b99f-13673d441f7a tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:00.731654 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-146975a1-cb72-4e75-b944-f2a9a1a6463b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:00.733655 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-146975a1-cb72-4e75-b944-f2a9a1a6463b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 2c913649-2aa1-40e3-b5b0-715d0075c915] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:00.746717 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-e27e4379-8dde-49f3-b99f-13673d441f7a tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Getting quotas for project ff103422df5e4e108f7006fea6ef6d73. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:28:00.755535 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-146975a1-cb72-4e75-b944-f2a9a1a6463b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:00.758871 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-146975a1-cb72-4e75-b944-f2a9a1a6463b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:00.759957 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-146975a1-cb72-4e75-b944-f2a9a1a6463b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:00.760684 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-146975a1-cb72-4e75-b944-f2a9a1a6463b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:00.782013 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-e27e4379-8dde-49f3-b99f-13673d441f7a tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Getting quotas for user 004709245ec54b4ebe1ba7f0086ca2f6 and project ff103422df5e4e108f7006fea6ef6d73. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:28:00.820697 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e27e4379-8dde-49f3-b99f-13673d441f7a tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:28:00.823047 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e27e4379-8dde-49f3-b99f-13673d441f7a tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] [instance: a47032d7-fd47-4a3a-9a8d-8000eb0c4427] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:28:00.998302 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e27e4379-8dde-49f3-b99f-13673d441f7a tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.624211 Jun 20 12:28:01.003447 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2849/5595] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:27:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:28:01.033046 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9f706882-9da4-42d6-9fff-07b3d8df3bc4 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:01.045599 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9f706882-9da4-42d6-9fff-07b3d8df3bc4 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] [instance: a47032d7-fd47-4a3a-9a8d-8000eb0c4427] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:01.111539 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-146975a1-cb72-4e75-b944-f2a9a1a6463b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:01.122855 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-146975a1-cb72-4e75-b944-f2a9a1a6463b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915" status: 200 len: 1321 microversion: 2.1 time: 0.399097 Jun 20 12:28:01.123923 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2747/5596] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:00 2022] GET /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915 => generated 1321 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:01.239696 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9f706882-9da4-42d6-9fff-07b3d8df3bc4 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004709245ec54b4ebe1ba7f0086ca2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff103422df5e4e108f7006fea6ef6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:01.252728 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9f706882-9da4-42d6-9fff-07b3d8df3bc4 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] 10.222.0.27 "GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427" status: 200 len: 1215 microversion: 2.1 time: 0.242867 Jun 20 12:28:01.263107 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2850/5597] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:01 2022] GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427 => generated 1215 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:02.140847 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2a10bd78-3e17-48e3-814c-ff24c20e4d1e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:02.141471 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2a10bd78-3e17-48e3-814c-ff24c20e4d1e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 2c913649-2aa1-40e3-b5b0-715d0075c915] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:02.154895 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a10bd78-3e17-48e3-814c-ff24c20e4d1e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:02.155210 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a10bd78-3e17-48e3-814c-ff24c20e4d1e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:02.156069 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a10bd78-3e17-48e3-814c-ff24c20e4d1e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:02.160194 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a10bd78-3e17-48e3-814c-ff24c20e4d1e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:02.270207 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9a303ca3-c62d-406d-a976-286e4b76ac13 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:02.270831 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9a303ca3-c62d-406d-a976-286e4b76ac13 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] [instance: a47032d7-fd47-4a3a-9a8d-8000eb0c4427] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:02.433623 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9a303ca3-c62d-406d-a976-286e4b76ac13 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004709245ec54b4ebe1ba7f0086ca2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff103422df5e4e108f7006fea6ef6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:02.442799 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9a303ca3-c62d-406d-a976-286e4b76ac13 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] 10.222.0.27 "GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427" status: 200 len: 1215 microversion: 2.1 time: 0.176421 Jun 20 12:28:02.454500 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2851/5598] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:02 2022] GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427 => generated 1215 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:02.629684 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2a10bd78-3e17-48e3-814c-ff24c20e4d1e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:02.644951 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2a10bd78-3e17-48e3-814c-ff24c20e4d1e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915" status: 200 len: 1503 microversion: 2.1 time: 0.505958 Jun 20 12:28:02.670134 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3edb0103-34b2-4a17-b286-b97bbcd8a6cc tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:02.670792 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3edb0103-34b2-4a17-b286-b97bbcd8a6cc tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 2c913649-2aa1-40e3-b5b0-715d0075c915] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:02.675777 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2748/5599] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:02 2022] GET /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915 => generated 1503 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:02.690937 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3edb0103-34b2-4a17-b286-b97bbcd8a6cc tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:02.694553 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3edb0103-34b2-4a17-b286-b97bbcd8a6cc tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:02.699098 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3edb0103-34b2-4a17-b286-b97bbcd8a6cc tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:02.708243 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3edb0103-34b2-4a17-b286-b97bbcd8a6cc tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:02.719930 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=42 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:03.269767 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3edb0103-34b2-4a17-b286-b97bbcd8a6cc tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:03.282337 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3edb0103-34b2-4a17-b286-b97bbcd8a6cc tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915" status: 200 len: 1503 microversion: 2.1 time: 0.617076 Jun 20 12:28:03.283006 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2852/5600] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:02 2022] GET /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915 => generated 1503 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:28:03.301138 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b2e3cdc0-f197-408c-b6ab-5008641fef64 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:03.306179 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b2e3cdc0-f197-408c-b6ab-5008641fef64 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 2c913649-2aa1-40e3-b5b0-715d0075c915] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:03.329992 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2e3cdc0-f197-408c-b6ab-5008641fef64 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:03.330860 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2e3cdc0-f197-408c-b6ab-5008641fef64 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:03.334582 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2e3cdc0-f197-408c-b6ab-5008641fef64 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:03.336888 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2e3cdc0-f197-408c-b6ab-5008641fef64 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:03.429989 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b2e3cdc0-f197-408c-b6ab-5008641fef64 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 2c913649-2aa1-40e3-b5b0-715d0075c915] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:28:03.461071 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-689ec9e1-5c4f-498f-acad-90b5acab5585 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:03.462024 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-689ec9e1-5c4f-498f-acad-90b5acab5585 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] [instance: a47032d7-fd47-4a3a-9a8d-8000eb0c4427] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:03.485212 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-689ec9e1-5c4f-498f-acad-90b5acab5585 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:03.486213 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-689ec9e1-5c4f-498f-acad-90b5acab5585 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:03.490745 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-689ec9e1-5c4f-498f-acad-90b5acab5585 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:03.494407 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-689ec9e1-5c4f-498f-acad-90b5acab5585 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:03.814781 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b2e3cdc0-f197-408c-b6ab-5008641fef64 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915" status: 204 len: 0 microversion: 2.1 time: 0.519139 Jun 20 12:28:03.819208 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2749/5601] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:28:03 2022] DELETE /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:28:03.834020 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4b838281-d287-44b9-af6f-4d5017f34053 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:03.835035 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4b838281-d287-44b9-af6f-4d5017f34053 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 2c913649-2aa1-40e3-b5b0-715d0075c915] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:03.861004 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4b838281-d287-44b9-af6f-4d5017f34053 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:03.861728 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4b838281-d287-44b9-af6f-4d5017f34053 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:03.869501 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4b838281-d287-44b9-af6f-4d5017f34053 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:03.870414 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4b838281-d287-44b9-af6f-4d5017f34053 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:04.057948 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-689ec9e1-5c4f-498f-acad-90b5acab5585 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004709245ec54b4ebe1ba7f0086ca2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff103422df5e4e108f7006fea6ef6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:04.074683 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-689ec9e1-5c4f-498f-acad-90b5acab5585 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] 10.222.0.27 "GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427" status: 200 len: 1267 microversion: 2.1 time: 0.615156 Jun 20 12:28:04.080974 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2853/5602] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:03 2022] GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427 => generated 1267 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:04.918593 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4b838281-d287-44b9-af6f-4d5017f34053 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:04.925578 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:04.939268 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4b838281-d287-44b9-af6f-4d5017f34053 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915" status: 200 len: 1509 microversion: 2.1 time: 1.117161 Jun 20 12:28:04.939899 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2750/5603] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:03 2022] GET /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915 => generated 1509 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:05.104370 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cfcdd307-3d6c-48e8-ab8d-aa2d68935268 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:05.105996 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cfcdd307-3d6c-48e8-ab8d-aa2d68935268 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] [instance: a47032d7-fd47-4a3a-9a8d-8000eb0c4427] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:05.130213 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cfcdd307-3d6c-48e8-ab8d-aa2d68935268 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:05.132464 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cfcdd307-3d6c-48e8-ab8d-aa2d68935268 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:05.137631 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cfcdd307-3d6c-48e8-ab8d-aa2d68935268 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:05.138948 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cfcdd307-3d6c-48e8-ab8d-aa2d68935268 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:05.323515 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cfcdd307-3d6c-48e8-ab8d-aa2d68935268 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004709245ec54b4ebe1ba7f0086ca2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff103422df5e4e108f7006fea6ef6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:05.336369 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cfcdd307-3d6c-48e8-ab8d-aa2d68935268 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] 10.222.0.27 "GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427" status: 200 len: 1273 microversion: 2.1 time: 0.241439 Jun 20 12:28:05.337569 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2854/5604] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:05 2022] GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427 => generated 1273 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:05.957695 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e4ba6dce-0777-4ded-a1c5-943b7602de91 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:05.958317 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e4ba6dce-0777-4ded-a1c5-943b7602de91 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 2c913649-2aa1-40e3-b5b0-715d0075c915] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:05.974462 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e4ba6dce-0777-4ded-a1c5-943b7602de91 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:05.980965 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e4ba6dce-0777-4ded-a1c5-943b7602de91 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:05.982243 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e4ba6dce-0777-4ded-a1c5-943b7602de91 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:05.983809 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e4ba6dce-0777-4ded-a1c5-943b7602de91 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:06.355809 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f2abcd2b-3f9c-45dc-aaa3-490eee475734 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:06.358037 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f2abcd2b-3f9c-45dc-aaa3-490eee475734 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] [instance: a47032d7-fd47-4a3a-9a8d-8000eb0c4427] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:06.383446 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f2abcd2b-3f9c-45dc-aaa3-490eee475734 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:06.383923 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f2abcd2b-3f9c-45dc-aaa3-490eee475734 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:06.392794 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f2abcd2b-3f9c-45dc-aaa3-490eee475734 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:06.393420 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f2abcd2b-3f9c-45dc-aaa3-490eee475734 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:06.616661 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f2abcd2b-3f9c-45dc-aaa3-490eee475734 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004709245ec54b4ebe1ba7f0086ca2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff103422df5e4e108f7006fea6ef6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:06.629650 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f2abcd2b-3f9c-45dc-aaa3-490eee475734 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] 10.222.0.27 "GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427" status: 200 len: 1273 microversion: 2.1 time: 0.278488 Jun 20 12:28:06.631582 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2855/5605] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:06 2022] GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427 => generated 1273 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:28:07.646954 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-95446e38-5512-4dfa-bb70-e65c457d95ad tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:07.648480 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-95446e38-5512-4dfa-bb70-e65c457d95ad tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] [instance: a47032d7-fd47-4a3a-9a8d-8000eb0c4427] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:07.660553 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-95446e38-5512-4dfa-bb70-e65c457d95ad tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:07.663588 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-95446e38-5512-4dfa-bb70-e65c457d95ad tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:07.667021 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-95446e38-5512-4dfa-bb70-e65c457d95ad tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:07.667901 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-95446e38-5512-4dfa-bb70-e65c457d95ad tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:07.680935 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e4ba6dce-0777-4ded-a1c5-943b7602de91 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:07.693459 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e4ba6dce-0777-4ded-a1c5-943b7602de91 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915" status: 200 len: 1509 microversion: 2.1 time: 1.738848 Jun 20 12:28:07.694533 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2751/5606] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:05 2022] GET /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915 => generated 1509 bytes in 1743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:07.925040 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-c1f52a08-9741-49b9-b7e2-d45f023e9f35 req-ddb0a46e-d93c-40ff-be29-7a84eabecc24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c913649-2aa1-40e3-b5b0-715d0075c915", "name": "network-vif-deleted", "tag": "2ab72e1e-70f7-4f27-93d3-971ed996890d"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:28:07.947478 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-c1f52a08-9741-49b9-b7e2-d45f023e9f35 req-ddb0a46e-d93c-40ff-be29-7a84eabecc24 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:07.947871 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-c1f52a08-9741-49b9-b7e2-d45f023e9f35 req-ddb0a46e-d93c-40ff-be29-7a84eabecc24 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:07.973209 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-c1f52a08-9741-49b9-b7e2-d45f023e9f35 req-ddb0a46e-d93c-40ff-be29-7a84eabecc24 service nova] Creating event network-vif-deleted:2ab72e1e-70f7-4f27-93d3-971ed996890d for instance 2c913649-2aa1-40e3-b5b0-715d0075c915 on n-h1-master-1 Jun 20 12:28:07.990083 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-c1f52a08-9741-49b9-b7e2-d45f023e9f35 req-ddb0a46e-d93c-40ff-be29-7a84eabecc24 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069326 Jun 20 12:28:07.993336 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2752/5607] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:28:08.719989 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-562e0ae6-4d35-4544-992d-b476b9bc0dde tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:08.721325 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-562e0ae6-4d35-4544-992d-b476b9bc0dde tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 2c913649-2aa1-40e3-b5b0-715d0075c915] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:08.758390 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-562e0ae6-4d35-4544-992d-b476b9bc0dde tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:08.759026 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-562e0ae6-4d35-4544-992d-b476b9bc0dde tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:08.768650 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-562e0ae6-4d35-4544-992d-b476b9bc0dde tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:08.771618 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-562e0ae6-4d35-4544-992d-b476b9bc0dde tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:08.800545 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-95446e38-5512-4dfa-bb70-e65c457d95ad tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004709245ec54b4ebe1ba7f0086ca2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff103422df5e4e108f7006fea6ef6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:08.823993 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-95446e38-5512-4dfa-bb70-e65c457d95ad tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] 10.222.0.27 "GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427" status: 200 len: 1315 microversion: 2.1 time: 1.180928 Jun 20 12:28:08.827719 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2856/5608] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:07 2022] GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427 => generated 1315 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:28:08.840062 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-562e0ae6-4d35-4544-992d-b476b9bc0dde tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] HTTP exception thrown: Instance 2c913649-2aa1-40e3-b5b0-715d0075c915 could not be found. Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-562e0ae6-4d35-4544-992d-b476b9bc0dde tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Request method failure captured: Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915 HTTP/1.1 Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGeaPbwuiKlZtfAakVi9AU1jZJYQpsiuqbtqj4H7EyEfa_Hs7Z-uZ4kORsCa_VB61-2zGcpt-Akt_fwFGZsdE57QH4a5RFxoaFSpMB5wQSEpC1nxSFtZmML3yZTCD6a9Nk7nPWXZGtd_9TDU17ULy9DxSwRUUNLntxWZGEmDQVAe1xk Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersTestJSON-953297781 Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersTestJSON-953297781 Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersTestJSON-953297781 Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersTestJSON-953297781-project Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 8878d44956bd42e18f0409534e562ab6 Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersTestJSON-953297781-project Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 2c913649-2aa1-40e3-b5b0-715d0075c915 could not be found. Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '2c913649-2aa1-40e3-b5b0-715d0075c915'} Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c913649-2aa1-40e3-b5b0-715d0075c915 could not be found. Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c913649-2aa1-40e3-b5b0-715d0075c915 could not be found. Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:28:08.845737 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:28:08.850562 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:28:08.850562 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:28:08.850562 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:28:08.850562 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:28:08.850562 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c913649-2aa1-40e3-b5b0-715d0075c915 could not be found. Jun 20 12:28:08.850562 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:28:08.850562 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-562e0ae6-4d35-4544-992d-b476b9bc0dde tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Returning 404 to user: Instance 2c913649-2aa1-40e3-b5b0-715d0075c915 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:28:08.850562 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-562e0ae6-4d35-4544-992d-b476b9bc0dde tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915" status: 404 len: 111 microversion: 2.1 time: 0.136503 Jun 20 12:28:08.850562 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2753/5609] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:08 2022] GET /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:28:08.861929 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e2e4cb70-f331-4b2d-9d6b-9edac24cbf3d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Action: 'create', calling method: .version_select at 0x7f60722fea60>, body: {"keypair": {"name": "tempest-key-740914494", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvWJkbj6nFVuRcWoll6JtSbD1jn1jAr/+90Fl7ayNMHPhTZJzrgK3nwJ7D2psweq6xgp9FvHUKmEeZLrIbGnbio8T3Cm3hiBtmUSeDrvh+bI0aZXTXKyHN8DxYkRa4P7g=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:28:08.908994 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-e2e4cb70-f331-4b2d-9d6b-9edac24cbf3d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Getting quotas for project 896c053324b34720a7d0f151bfdc8b10. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:28:08.925330 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-e2e4cb70-f331-4b2d-9d6b-9edac24cbf3d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Getting quotas for user 8878d44956bd42e18f0409534e562ab6 and project 896c053324b34720a7d0f151bfdc8b10. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:28:09.003027 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e2e4cb70-f331-4b2d-9d6b-9edac24cbf3d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.145919 Jun 20 12:28:09.010702 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2857/5610] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 12:28:08 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:28:09.017364 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-97548c22-4233-4219-a124-c75be44b227f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '.version_select at 0x7f6073c31040>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:09.020856 n-d-master-1 devstack@n-api.service[119128]: WARNING oslo_db.sqlalchemy.utils [None req-97548c22-4233-4219-a124-c75be44b227f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Unique keys not in sort_keys. The sorting order may be unstable. Jun 20 12:28:09.049178 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-97548c22-4233-4219-a124-c75be44b227f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.035631 Jun 20 12:28:09.050012 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2754/5611] 10.222.0.27 () {58 vars in 1136 bytes} [Mon Jun 20 12:28:09 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:28:09.253497 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f4e7b028-6214-46c9-9126-1cd96333662a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-182649286", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "key_name": "tempest-key-740914494", "networks": [{"uuid": "ce2e9d9e-a74d-4fc7-950c-df9300f57b6c"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:28:09.362096 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-f4e7b028-6214-46c9-9126-1cd96333662a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] validate_networks() for [('ce2e9d9e-a74d-4fc7-950c-df9300f57b6c', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:28:09.844495 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b2ca8a78-a780-4e72-b10e-acec0ff29ae1 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:09.845168 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b2ca8a78-a780-4e72-b10e-acec0ff29ae1 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] [instance: a47032d7-fd47-4a3a-9a8d-8000eb0c4427] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:09.860710 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2ca8a78-a780-4e72-b10e-acec0ff29ae1 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:09.861191 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2ca8a78-a780-4e72-b10e-acec0ff29ae1 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:09.861964 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2ca8a78-a780-4e72-b10e-acec0ff29ae1 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:09.862652 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2ca8a78-a780-4e72-b10e-acec0ff29ae1 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:10.441615 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b2ca8a78-a780-4e72-b10e-acec0ff29ae1 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004709245ec54b4ebe1ba7f0086ca2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff103422df5e4e108f7006fea6ef6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:10.453051 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b2ca8a78-a780-4e72-b10e-acec0ff29ae1 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] 10.222.0.27 "GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427" status: 200 len: 1315 microversion: 2.1 time: 0.613020 Jun 20 12:28:10.453686 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2755/5612] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:09 2022] GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427 => generated 1315 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:28:10.464285 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-554cb305-0574-4b2e-b569-663cc6c3f7b7 req-1dfe62a1-02eb-40ba-8864-aadc4ea4d574 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a47032d7-fd47-4a3a-9a8d-8000eb0c4427", "tag": "c0490068-23b8-4960-b234-3eeeca6f3cac"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:28:10.496179 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-554cb305-0574-4b2e-b569-663cc6c3f7b7 req-1dfe62a1-02eb-40ba-8864-aadc4ea4d574 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:10.498291 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-554cb305-0574-4b2e-b569-663cc6c3f7b7 req-1dfe62a1-02eb-40ba-8864-aadc4ea4d574 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:10.546113 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-554cb305-0574-4b2e-b569-663cc6c3f7b7 req-1dfe62a1-02eb-40ba-8864-aadc4ea4d574 service nova] Creating event network-changed:c0490068-23b8-4960-b234-3eeeca6f3cac for instance a47032d7-fd47-4a3a-9a8d-8000eb0c4427 on n-h2-master-1 Jun 20 12:28:10.554704 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-554cb305-0574-4b2e-b569-663cc6c3f7b7 req-1dfe62a1-02eb-40ba-8864-aadc4ea4d574 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098451 Jun 20 12:28:10.556362 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2756/5613] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:28:10.715782 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:11.471454 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-da36210d-487e-48c2-a79e-90a1cb6b2f09 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:11.472917 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-da36210d-487e-48c2-a79e-90a1cb6b2f09 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] [instance: a47032d7-fd47-4a3a-9a8d-8000eb0c4427] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:11.489285 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-da36210d-487e-48c2-a79e-90a1cb6b2f09 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:11.494911 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-da36210d-487e-48c2-a79e-90a1cb6b2f09 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:11.501546 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-da36210d-487e-48c2-a79e-90a1cb6b2f09 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:11.504187 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-da36210d-487e-48c2-a79e-90a1cb6b2f09 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:11.765650 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-da36210d-487e-48c2-a79e-90a1cb6b2f09 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004709245ec54b4ebe1ba7f0086ca2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff103422df5e4e108f7006fea6ef6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:11.779267 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-da36210d-487e-48c2-a79e-90a1cb6b2f09 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] 10.222.0.27 "GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427" status: 200 len: 1315 microversion: 2.1 time: 0.311339 Jun 20 12:28:11.786626 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2757/5614] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:11 2022] GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427 => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:28:12.048710 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-f4e7b028-6214-46c9-9126-1cd96333662a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:28:12.049657 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-f4e7b028-6214-46c9-9126-1cd96333662a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:28:12.049893 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-f4e7b028-6214-46c9-9126-1cd96333662a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:28:12.050280 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-f4e7b028-6214-46c9-9126-1cd96333662a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:28:12.050700 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-f4e7b028-6214-46c9-9126-1cd96333662a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:28:12.099192 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f4e7b028-6214-46c9-9126-1cd96333662a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:12.101963 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f4e7b028-6214-46c9-9126-1cd96333662a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:12.111277 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f4e7b028-6214-46c9-9126-1cd96333662a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:12.112039 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f4e7b028-6214-46c9-9126-1cd96333662a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:12.184599 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-f4e7b028-6214-46c9-9126-1cd96333662a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Getting quotas for project 896c053324b34720a7d0f151bfdc8b10. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:28:12.199920 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-f4e7b028-6214-46c9-9126-1cd96333662a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Getting quotas for user 8878d44956bd42e18f0409534e562ab6 and project 896c053324b34720a7d0f151bfdc8b10. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:28:12.221076 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f4e7b028-6214-46c9-9126-1cd96333662a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:28:12.225554 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f4e7b028-6214-46c9-9126-1cd96333662a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 8f7328d0-2429-4fe9-bf9e-0925f6458204] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:28:12.340856 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f4e7b028-6214-46c9-9126-1cd96333662a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.086410 Jun 20 12:28:12.347381 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2858/5615] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:28:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 3099 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:28:12.359265 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-634d6849-b6ca-4130-a14a-dfd1cffd295a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:12.360724 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-634d6849-b6ca-4130-a14a-dfd1cffd295a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 8f7328d0-2429-4fe9-bf9e-0925f6458204] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:12.562964 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-634d6849-b6ca-4130-a14a-dfd1cffd295a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:12.586570 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-634d6849-b6ca-4130-a14a-dfd1cffd295a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204" status: 200 len: 1227 microversion: 2.1 time: 0.229859 Jun 20 12:28:12.599412 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2758/5616] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:12 2022] GET /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204 => generated 1227 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:12.798686 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d1f18f60-19c2-44c3-a7e5-eebf23b90e60 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:12.799654 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d1f18f60-19c2-44c3-a7e5-eebf23b90e60 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] [instance: a47032d7-fd47-4a3a-9a8d-8000eb0c4427] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:12.825659 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d1f18f60-19c2-44c3-a7e5-eebf23b90e60 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:12.829884 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d1f18f60-19c2-44c3-a7e5-eebf23b90e60 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:12.835912 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d1f18f60-19c2-44c3-a7e5-eebf23b90e60 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:12.840664 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d1f18f60-19c2-44c3-a7e5-eebf23b90e60 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:13.437388 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d1f18f60-19c2-44c3-a7e5-eebf23b90e60 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004709245ec54b4ebe1ba7f0086ca2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff103422df5e4e108f7006fea6ef6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:13.447933 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d1f18f60-19c2-44c3-a7e5-eebf23b90e60 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] 10.222.0.27 "GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427" status: 200 len: 1315 microversion: 2.1 time: 0.654238 Jun 20 12:28:13.452419 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2859/5617] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:12 2022] GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427 => generated 1315 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:28:13.607197 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fdc6b5f4-0832-4121-bc24-ace7f3495953 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:13.607825 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fdc6b5f4-0832-4121-bc24-ace7f3495953 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 8f7328d0-2429-4fe9-bf9e-0925f6458204] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:13.619928 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fdc6b5f4-0832-4121-bc24-ace7f3495953 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:13.620468 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fdc6b5f4-0832-4121-bc24-ace7f3495953 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:13.621272 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fdc6b5f4-0832-4121-bc24-ace7f3495953 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:13.626938 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fdc6b5f4-0832-4121-bc24-ace7f3495953 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:13.990364 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fdc6b5f4-0832-4121-bc24-ace7f3495953 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:13.999799 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fdc6b5f4-0832-4121-bc24-ace7f3495953 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204" status: 200 len: 1279 microversion: 2.1 time: 0.396829 Jun 20 12:28:14.001924 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2759/5618] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:13 2022] GET /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204 => generated 1279 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:14.469117 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-52938b50-fef5-4c71-ac7c-dbafa2ce5c24 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:14.469911 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-52938b50-fef5-4c71-ac7c-dbafa2ce5c24 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] [instance: a47032d7-fd47-4a3a-9a8d-8000eb0c4427] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:14.473224 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=7 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:14.495954 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52938b50-fef5-4c71-ac7c-dbafa2ce5c24 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:14.497495 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52938b50-fef5-4c71-ac7c-dbafa2ce5c24 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:14.503532 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52938b50-fef5-4c71-ac7c-dbafa2ce5c24 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:14.504441 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52938b50-fef5-4c71-ac7c-dbafa2ce5c24 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:14.798989 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-52938b50-fef5-4c71-ac7c-dbafa2ce5c24 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004709245ec54b4ebe1ba7f0086ca2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff103422df5e4e108f7006fea6ef6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:14.817765 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-52938b50-fef5-4c71-ac7c-dbafa2ce5c24 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] 10.222.0.27 "GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427" status: 200 len: 1315 microversion: 2.1 time: 0.352710 Jun 20 12:28:14.819137 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2860/5619] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:14 2022] GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427 => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:28:15.020078 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dc65a9d6-043e-42f8-b20e-605a022e5fe8 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:15.023060 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-dc65a9d6-043e-42f8-b20e-605a022e5fe8 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 8f7328d0-2429-4fe9-bf9e-0925f6458204] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:15.069326 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc65a9d6-043e-42f8-b20e-605a022e5fe8 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:15.084984 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc65a9d6-043e-42f8-b20e-605a022e5fe8 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:15.087862 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc65a9d6-043e-42f8-b20e-605a022e5fe8 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:15.093866 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc65a9d6-043e-42f8-b20e-605a022e5fe8 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:15.425786 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-dc65a9d6-043e-42f8-b20e-605a022e5fe8 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:15.435248 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dc65a9d6-043e-42f8-b20e-605a022e5fe8 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204" status: 200 len: 1285 microversion: 2.1 time: 0.420083 Jun 20 12:28:15.443072 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2760/5620] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:15 2022] GET /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204 => generated 1285 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:15.865579 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-23751a3a-e4ad-4a93-b99c-b88a237ca203 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:15.867265 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-23751a3a-e4ad-4a93-b99c-b88a237ca203 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] [instance: a47032d7-fd47-4a3a-9a8d-8000eb0c4427] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:15.896512 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-23751a3a-e4ad-4a93-b99c-b88a237ca203 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:15.897467 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-23751a3a-e4ad-4a93-b99c-b88a237ca203 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:15.898485 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-23751a3a-e4ad-4a93-b99c-b88a237ca203 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:15.907613 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-23751a3a-e4ad-4a93-b99c-b88a237ca203 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:16.452800 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c90be348-3ea2-49f3-9e46-de742e0c9743 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:16.453418 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c90be348-3ea2-49f3-9e46-de742e0c9743 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 8f7328d0-2429-4fe9-bf9e-0925f6458204] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:16.466217 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c90be348-3ea2-49f3-9e46-de742e0c9743 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:16.466671 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c90be348-3ea2-49f3-9e46-de742e0c9743 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:16.467607 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c90be348-3ea2-49f3-9e46-de742e0c9743 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:16.482082 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c90be348-3ea2-49f3-9e46-de742e0c9743 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:16.559067 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-23751a3a-e4ad-4a93-b99c-b88a237ca203 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004709245ec54b4ebe1ba7f0086ca2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff103422df5e4e108f7006fea6ef6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:16.586204 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-23751a3a-e4ad-4a93-b99c-b88a237ca203 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] 10.222.0.27 "GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427" status: 200 len: 1315 microversion: 2.1 time: 0.740515 Jun 20 12:28:16.590829 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2861/5621] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:15 2022] GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427 => generated 1315 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:16.972364 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c90be348-3ea2-49f3-9e46-de742e0c9743 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:16.989065 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c90be348-3ea2-49f3-9e46-de742e0c9743 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204" status: 200 len: 1327 microversion: 2.1 time: 0.540363 Jun 20 12:28:16.989669 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2761/5622] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:16 2022] GET /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204 => generated 1327 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:17.019991 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2ae1627b-0469-4f5b-bec5-e29c256033c6 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1166092433", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:28:17.186116 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-2ae1627b-0469-4f5b-bec5-e29c256033c6 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] validate_networks() for None {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:28:17.607136 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e19f6ec5-16e4-4191-bb3a-ef75253e0ce8 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:17.607762 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e19f6ec5-16e4-4191-bb3a-ef75253e0ce8 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] [instance: a47032d7-fd47-4a3a-9a8d-8000eb0c4427] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:17.617831 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e19f6ec5-16e4-4191-bb3a-ef75253e0ce8 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:17.618284 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e19f6ec5-16e4-4191-bb3a-ef75253e0ce8 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:17.619076 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e19f6ec5-16e4-4191-bb3a-ef75253e0ce8 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:17.619604 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e19f6ec5-16e4-4191-bb3a-ef75253e0ce8 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:18.149403 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e19f6ec5-16e4-4191-bb3a-ef75253e0ce8 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004709245ec54b4ebe1ba7f0086ca2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff103422df5e4e108f7006fea6ef6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:18.160079 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e19f6ec5-16e4-4191-bb3a-ef75253e0ce8 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] 10.222.0.27 "GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427" status: 200 len: 1315 microversion: 2.1 time: 0.556449 Jun 20 12:28:18.161997 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2762/5623] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:17 2022] GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427 => generated 1315 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:28:18.193201 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0ccd5047-730a-4e2e-9e1e-7364eb4d17c3 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:18.193984 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0ccd5047-730a-4e2e-9e1e-7364eb4d17c3 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 8f7328d0-2429-4fe9-bf9e-0925f6458204] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:18.210249 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0ccd5047-730a-4e2e-9e1e-7364eb4d17c3 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:18.210705 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0ccd5047-730a-4e2e-9e1e-7364eb4d17c3 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:18.211502 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0ccd5047-730a-4e2e-9e1e-7364eb4d17c3 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:18.211953 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0ccd5047-730a-4e2e-9e1e-7364eb4d17c3 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:18.283296 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-2ae1627b-0469-4f5b-bec5-e29c256033c6 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:28:18.283296 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-2ae1627b-0469-4f5b-bec5-e29c256033c6 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:28:18.283296 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-2ae1627b-0469-4f5b-bec5-e29c256033c6 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:28:18.283296 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-2ae1627b-0469-4f5b-bec5-e29c256033c6 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:28:18.283296 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-2ae1627b-0469-4f5b-bec5-e29c256033c6 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:28:18.303577 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2ae1627b-0469-4f5b-bec5-e29c256033c6 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:18.304682 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2ae1627b-0469-4f5b-bec5-e29c256033c6 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:18.309081 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2ae1627b-0469-4f5b-bec5-e29c256033c6 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:18.309928 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2ae1627b-0469-4f5b-bec5-e29c256033c6 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:18.355893 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-2ae1627b-0469-4f5b-bec5-e29c256033c6 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Getting quotas for project e0acb7593db24b07af194c4eba251cff. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:28:18.363425 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-2ae1627b-0469-4f5b-bec5-e29c256033c6 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Getting quotas for user dc5289b306fb4e2e9c42564336ade23a and project e0acb7593db24b07af194c4eba251cff. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:28:18.393639 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2ae1627b-0469-4f5b-bec5-e29c256033c6 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:28:18.400825 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2ae1627b-0469-4f5b-bec5-e29c256033c6 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] [instance: ce5bd643-ecf0-4e74-a49a-98d6469cebeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:28:18.535521 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2ae1627b-0469-4f5b-bec5-e29c256033c6 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.513594 Jun 20 12:28:18.539314 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2862/5624] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:28:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:28:18.555663 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-de7dc567-e76e-4467-a681-c6ca3b0c901a req-db16c444-6e38-465c-9d1f-059aa5a9e7ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f7328d0-2429-4fe9-bf9e-0925f6458204", "tag": "849df7fb-2841-40f4-90bd-c50ffeb7c6d6"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:28:18.575099 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-de7dc567-e76e-4467-a681-c6ca3b0c901a req-db16c444-6e38-465c-9d1f-059aa5a9e7ff service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:18.575605 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-de7dc567-e76e-4467-a681-c6ca3b0c901a req-db16c444-6e38-465c-9d1f-059aa5a9e7ff service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:18.602367 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-de7dc567-e76e-4467-a681-c6ca3b0c901a req-db16c444-6e38-465c-9d1f-059aa5a9e7ff service nova] Creating event network-changed:849df7fb-2841-40f4-90bd-c50ffeb7c6d6 for instance 8f7328d0-2429-4fe9-bf9e-0925f6458204 on n-h1-master-1 Jun 20 12:28:18.614788 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-de7dc567-e76e-4467-a681-c6ca3b0c901a req-db16c444-6e38-465c-9d1f-059aa5a9e7ff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072458 Jun 20 12:28:18.621969 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2863/5625] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:28:18.634090 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-49a76632-b1f5-44d4-a2ea-3df315d2734d tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:18.634889 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-49a76632-b1f5-44d4-a2ea-3df315d2734d tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] [instance: ce5bd643-ecf0-4e74-a49a-98d6469cebeb] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:18.756774 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-49a76632-b1f5-44d4-a2ea-3df315d2734d tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5289b306fb4e2e9c42564336ade23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0acb7593db24b07af194c4eba251cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:18.768709 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-49a76632-b1f5-44d4-a2ea-3df315d2734d tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] 10.222.0.27 "GET /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb" status: 200 len: 1215 microversion: 2.1 time: 0.140892 Jun 20 12:28:18.769325 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2864/5626] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:18 2022] GET /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb => generated 1215 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:19.039923 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0ccd5047-730a-4e2e-9e1e-7364eb4d17c3 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:19.073267 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0ccd5047-730a-4e2e-9e1e-7364eb4d17c3 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204" status: 200 len: 1327 microversion: 2.1 time: 0.906497 Jun 20 12:28:19.075073 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2763/5627] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:18 2022] GET /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204 => generated 1327 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:19.202448 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-612c10fc-d4c4-4d27-b05a-62ae9c027ff8 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:19.205085 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-612c10fc-d4c4-4d27-b05a-62ae9c027ff8 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] [instance: a47032d7-fd47-4a3a-9a8d-8000eb0c4427] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:19.219947 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-612c10fc-d4c4-4d27-b05a-62ae9c027ff8 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:19.220432 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-612c10fc-d4c4-4d27-b05a-62ae9c027ff8 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:19.225707 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-612c10fc-d4c4-4d27-b05a-62ae9c027ff8 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:19.232595 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-612c10fc-d4c4-4d27-b05a-62ae9c027ff8 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:19.622671 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-612c10fc-d4c4-4d27-b05a-62ae9c027ff8 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004709245ec54b4ebe1ba7f0086ca2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff103422df5e4e108f7006fea6ef6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:19.633918 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-612c10fc-d4c4-4d27-b05a-62ae9c027ff8 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] 10.222.0.27 "GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427" status: 200 len: 1315 microversion: 2.1 time: 0.444132 Jun 20 12:28:19.642983 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2865/5628] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:19 2022] GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427 => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:19.787261 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ff3f27d8-e746-4027-bc91-0898373fc0d0 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:19.788410 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ff3f27d8-e746-4027-bc91-0898373fc0d0 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] [instance: ce5bd643-ecf0-4e74-a49a-98d6469cebeb] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:19.811146 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ff3f27d8-e746-4027-bc91-0898373fc0d0 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:19.814139 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ff3f27d8-e746-4027-bc91-0898373fc0d0 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:19.815478 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ff3f27d8-e746-4027-bc91-0898373fc0d0 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:19.817654 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ff3f27d8-e746-4027-bc91-0898373fc0d0 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:20.013905 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ff3f27d8-e746-4027-bc91-0898373fc0d0 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5289b306fb4e2e9c42564336ade23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0acb7593db24b07af194c4eba251cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:20.037287 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ff3f27d8-e746-4027-bc91-0898373fc0d0 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] 10.222.0.27 "GET /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb" status: 200 len: 1211 microversion: 2.1 time: 0.247269 Jun 20 12:28:20.037287 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2764/5629] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:19 2022] GET /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb => generated 1211 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:28:20.092339 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-06a4c594-52a2-4fa7-ac33-5c6c08a3a0f6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:20.093305 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-06a4c594-52a2-4fa7-ac33-5c6c08a3a0f6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 8f7328d0-2429-4fe9-bf9e-0925f6458204] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:20.120563 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06a4c594-52a2-4fa7-ac33-5c6c08a3a0f6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:20.120563 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06a4c594-52a2-4fa7-ac33-5c6c08a3a0f6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:20.120563 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06a4c594-52a2-4fa7-ac33-5c6c08a3a0f6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:20.123979 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06a4c594-52a2-4fa7-ac33-5c6c08a3a0f6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:20.159943 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-b5f0f57a-9b4f-4d18-a365-d899168f8807 req-07c7d6e3-d029-4678-a7e1-f4f78344f83c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a47032d7-fd47-4a3a-9a8d-8000eb0c4427", "name": "network-vif-plugged", "status": "completed", "tag": "c0490068-23b8-4960-b234-3eeeca6f3cac"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:28:20.188511 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-b5f0f57a-9b4f-4d18-a365-d899168f8807 req-07c7d6e3-d029-4678-a7e1-f4f78344f83c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:20.188511 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-b5f0f57a-9b4f-4d18-a365-d899168f8807 req-07c7d6e3-d029-4678-a7e1-f4f78344f83c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:20.247686 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-b5f0f57a-9b4f-4d18-a365-d899168f8807 req-07c7d6e3-d029-4678-a7e1-f4f78344f83c service nova] Creating event network-vif-plugged:c0490068-23b8-4960-b234-3eeeca6f3cac for instance a47032d7-fd47-4a3a-9a8d-8000eb0c4427 on n-h2-master-1 Jun 20 12:28:20.262403 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-b5f0f57a-9b4f-4d18-a365-d899168f8807 req-07c7d6e3-d029-4678-a7e1-f4f78344f83c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106246 Jun 20 12:28:20.271049 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2765/5630] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:28:20.430446 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-06a4c594-52a2-4fa7-ac33-5c6c08a3a0f6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:20.441828 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-06a4c594-52a2-4fa7-ac33-5c6c08a3a0f6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204" status: 200 len: 1327 microversion: 2.1 time: 0.353982 Jun 20 12:28:20.442615 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2866/5631] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:20 2022] GET /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204 => generated 1327 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:20.654096 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3ab33847-f756-47c2-b30a-ae1c05a679ef tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:20.654815 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3ab33847-f756-47c2-b30a-ae1c05a679ef tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] [instance: a47032d7-fd47-4a3a-9a8d-8000eb0c4427] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:20.665091 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3ab33847-f756-47c2-b30a-ae1c05a679ef tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:20.665550 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3ab33847-f756-47c2-b30a-ae1c05a679ef tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:20.666802 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3ab33847-f756-47c2-b30a-ae1c05a679ef tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:20.667471 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3ab33847-f756-47c2-b30a-ae1c05a679ef tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:21.047970 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1a962fa8-e7f6-410a-aae0-1e11b1e7d642 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:21.049366 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1a962fa8-e7f6-410a-aae0-1e11b1e7d642 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] [instance: ce5bd643-ecf0-4e74-a49a-98d6469cebeb] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:21.061818 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a962fa8-e7f6-410a-aae0-1e11b1e7d642 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:21.068279 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a962fa8-e7f6-410a-aae0-1e11b1e7d642 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:21.069428 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a962fa8-e7f6-410a-aae0-1e11b1e7d642 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:21.070028 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a962fa8-e7f6-410a-aae0-1e11b1e7d642 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:21.278084 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1a962fa8-e7f6-410a-aae0-1e11b1e7d642 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5289b306fb4e2e9c42564336ade23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0acb7593db24b07af194c4eba251cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:21.293177 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1a962fa8-e7f6-410a-aae0-1e11b1e7d642 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] 10.222.0.27 "GET /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb" status: 200 len: 1273 microversion: 2.1 time: 0.249507 Jun 20 12:28:21.294134 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2867/5632] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:21 2022] GET /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb => generated 1273 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:21.393205 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3ab33847-f756-47c2-b30a-ae1c05a679ef tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004709245ec54b4ebe1ba7f0086ca2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff103422df5e4e108f7006fea6ef6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:21.406647 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3ab33847-f756-47c2-b30a-ae1c05a679ef tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] 10.222.0.27 "GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427" status: 200 len: 1315 microversion: 2.1 time: 0.759369 Jun 20 12:28:21.408194 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2766/5633] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:20 2022] GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427 => generated 1315 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:21.461918 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f9dd0dd7-85e4-46ef-9f10-80dc14b8ea85 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:21.462680 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f9dd0dd7-85e4-46ef-9f10-80dc14b8ea85 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 8f7328d0-2429-4fe9-bf9e-0925f6458204] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:21.483281 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9dd0dd7-85e4-46ef-9f10-80dc14b8ea85 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:21.485885 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9dd0dd7-85e4-46ef-9f10-80dc14b8ea85 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:21.487914 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9dd0dd7-85e4-46ef-9f10-80dc14b8ea85 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:21.488514 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9dd0dd7-85e4-46ef-9f10-80dc14b8ea85 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:21.898633 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f9dd0dd7-85e4-46ef-9f10-80dc14b8ea85 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:21.912647 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f9dd0dd7-85e4-46ef-9f10-80dc14b8ea85 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204" status: 200 len: 1327 microversion: 2.1 time: 0.457340 Jun 20 12:28:21.927410 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2868/5634] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:21 2022] GET /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204 => generated 1327 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:22.311653 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-524da3d7-9541-4835-86f9-5b540d634af5 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:22.312635 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-524da3d7-9541-4835-86f9-5b540d634af5 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] [instance: ce5bd643-ecf0-4e74-a49a-98d6469cebeb] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:22.325923 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-524da3d7-9541-4835-86f9-5b540d634af5 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:22.325923 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-524da3d7-9541-4835-86f9-5b540d634af5 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:22.327711 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-524da3d7-9541-4835-86f9-5b540d634af5 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:22.328127 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-524da3d7-9541-4835-86f9-5b540d634af5 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:22.424954 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-735ddd87-648f-47d0-badc-8a08d7c2e823 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:22.426478 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-735ddd87-648f-47d0-badc-8a08d7c2e823 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] [instance: a47032d7-fd47-4a3a-9a8d-8000eb0c4427] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:22.443211 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-735ddd87-648f-47d0-badc-8a08d7c2e823 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:22.444863 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-735ddd87-648f-47d0-badc-8a08d7c2e823 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:22.447190 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-735ddd87-648f-47d0-badc-8a08d7c2e823 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:22.448914 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-735ddd87-648f-47d0-badc-8a08d7c2e823 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:22.562211 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-524da3d7-9541-4835-86f9-5b540d634af5 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5289b306fb4e2e9c42564336ade23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0acb7593db24b07af194c4eba251cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:22.572906 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-524da3d7-9541-4835-86f9-5b540d634af5 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] 10.222.0.27 "GET /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb" status: 200 len: 1273 microversion: 2.1 time: 0.265925 Jun 20 12:28:22.580555 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2767/5635] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:22 2022] GET /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb => generated 1273 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:22.823592 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-735ddd87-648f-47d0-badc-8a08d7c2e823 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004709245ec54b4ebe1ba7f0086ca2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff103422df5e4e108f7006fea6ef6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:22.838670 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-735ddd87-648f-47d0-badc-8a08d7c2e823 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] 10.222.0.27 "GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427" status: 200 len: 1315 microversion: 2.1 time: 0.414866 Jun 20 12:28:22.850704 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2869/5636] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:22 2022] GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427 => generated 1315 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:22.936789 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f0c12252-f29e-4aac-9cbd-3b8cd291ef53 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:22.937624 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f0c12252-f29e-4aac-9cbd-3b8cd291ef53 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 8f7328d0-2429-4fe9-bf9e-0925f6458204] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:22.945141 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:22.947174 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f0c12252-f29e-4aac-9cbd-3b8cd291ef53 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:22.947974 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f0c12252-f29e-4aac-9cbd-3b8cd291ef53 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:22.950975 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f0c12252-f29e-4aac-9cbd-3b8cd291ef53 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:22.955375 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f0c12252-f29e-4aac-9cbd-3b8cd291ef53 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:23.601177 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a964280d-951d-4a2f-a8c9-6aca6b6171f0 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:23.601748 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a964280d-951d-4a2f-a8c9-6aca6b6171f0 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] [instance: ce5bd643-ecf0-4e74-a49a-98d6469cebeb] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:23.626896 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a964280d-951d-4a2f-a8c9-6aca6b6171f0 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:23.627371 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a964280d-951d-4a2f-a8c9-6aca6b6171f0 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:23.633252 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a964280d-951d-4a2f-a8c9-6aca6b6171f0 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:23.635034 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a964280d-951d-4a2f-a8c9-6aca6b6171f0 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:23.695816 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f0c12252-f29e-4aac-9cbd-3b8cd291ef53 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:23.719820 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f0c12252-f29e-4aac-9cbd-3b8cd291ef53 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204" status: 200 len: 1327 microversion: 2.1 time: 0.783598 Jun 20 12:28:23.725325 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2768/5637] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:22 2022] GET /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204 => generated 1327 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:23.856605 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a964280d-951d-4a2f-a8c9-6aca6b6171f0 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5289b306fb4e2e9c42564336ade23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0acb7593db24b07af194c4eba251cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:23.858803 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-92b437da-8e4f-4ee1-8b28-15fd847ac11e tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:23.859627 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-92b437da-8e4f-4ee1-8b28-15fd847ac11e tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] [instance: a47032d7-fd47-4a3a-9a8d-8000eb0c4427] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:23.874171 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-92b437da-8e4f-4ee1-8b28-15fd847ac11e tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:23.877507 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a964280d-951d-4a2f-a8c9-6aca6b6171f0 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] 10.222.0.27 "GET /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb" status: 200 len: 1273 microversion: 2.1 time: 0.272212 Jun 20 12:28:23.888286 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-92b437da-8e4f-4ee1-8b28-15fd847ac11e tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:23.889588 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-92b437da-8e4f-4ee1-8b28-15fd847ac11e tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:23.890049 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-92b437da-8e4f-4ee1-8b28-15fd847ac11e tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:23.891560 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2870/5638] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:23 2022] GET /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb => generated 1273 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:24.702677 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-92b437da-8e4f-4ee1-8b28-15fd847ac11e tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004709245ec54b4ebe1ba7f0086ca2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff103422df5e4e108f7006fea6ef6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:24.714180 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-92b437da-8e4f-4ee1-8b28-15fd847ac11e tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] 10.222.0.27 "GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427" status: 200 len: 1503 microversion: 2.1 time: 0.861048 Jun 20 12:28:24.723816 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2769/5639] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:23 2022] GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427 => generated 1503 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:28:24.742033 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-18815cbd-82c7-48bd-9228-4912479a2a7f tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:24.743657 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-18815cbd-82c7-48bd-9228-4912479a2a7f tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] [instance: a47032d7-fd47-4a3a-9a8d-8000eb0c4427] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:24.745043 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-359cbda0-a218-4e45-a8b9-865f19f3223f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:24.749844 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-359cbda0-a218-4e45-a8b9-865f19f3223f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 8f7328d0-2429-4fe9-bf9e-0925f6458204] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:24.764517 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-359cbda0-a218-4e45-a8b9-865f19f3223f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:24.766912 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-359cbda0-a218-4e45-a8b9-865f19f3223f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:24.769571 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-359cbda0-a218-4e45-a8b9-865f19f3223f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:24.770523 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-359cbda0-a218-4e45-a8b9-865f19f3223f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:24.779703 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-18815cbd-82c7-48bd-9228-4912479a2a7f tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:24.782042 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-18815cbd-82c7-48bd-9228-4912479a2a7f tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:24.783114 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-18815cbd-82c7-48bd-9228-4912479a2a7f tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:24.783904 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-18815cbd-82c7-48bd-9228-4912479a2a7f tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:24.957985 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:25.006127 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-18815cbd-82c7-48bd-9228-4912479a2a7f tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.267560 Jun 20 12:28:25.008394 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2871/5640] 10.222.0.27 () {58 vars in 1295 bytes} [Mon Jun 20 12:28:24 2022] DELETE /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427/os-server-password => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:28:25.025084 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-be817138-2307-48a4-b6df-d83ff0c84bd3 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:25.027044 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-be817138-2307-48a4-b6df-d83ff0c84bd3 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] [instance: ce5bd643-ecf0-4e74-a49a-98d6469cebeb] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:25.061590 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-be817138-2307-48a4-b6df-d83ff0c84bd3 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:25.064260 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-be817138-2307-48a4-b6df-d83ff0c84bd3 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:25.067287 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-be817138-2307-48a4-b6df-d83ff0c84bd3 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:25.069355 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-be817138-2307-48a4-b6df-d83ff0c84bd3 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:25.265647 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-be817138-2307-48a4-b6df-d83ff0c84bd3 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5289b306fb4e2e9c42564336ade23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0acb7593db24b07af194c4eba251cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:25.278911 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-be817138-2307-48a4-b6df-d83ff0c84bd3 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] 10.222.0.27 "GET /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb" status: 200 len: 1273 microversion: 2.1 time: 0.263804 Jun 20 12:28:25.284598 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2872/5641] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:25 2022] GET /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb => generated 1273 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:25.294740 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c6566e1e-d0da-4862-807f-c6e0e7678e01 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:25.298432 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c6566e1e-d0da-4862-807f-c6e0e7678e01 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] [instance: a47032d7-fd47-4a3a-9a8d-8000eb0c4427] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:25.335938 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6566e1e-d0da-4862-807f-c6e0e7678e01 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:25.339785 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6566e1e-d0da-4862-807f-c6e0e7678e01 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:25.342305 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6566e1e-d0da-4862-807f-c6e0e7678e01 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:25.345324 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6566e1e-d0da-4862-807f-c6e0e7678e01 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:25.348161 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-359cbda0-a218-4e45-a8b9-865f19f3223f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:25.364309 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-359cbda0-a218-4e45-a8b9-865f19f3223f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204" status: 200 len: 1327 microversion: 2.1 time: 0.624943 Jun 20 12:28:25.375449 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2770/5642] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:24 2022] GET /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204 => generated 1327 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:25.459212 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c6566e1e-d0da-4862-807f-c6e0e7678e01 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] 10.222.0.27 "GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.169780 Jun 20 12:28:25.463882 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2873/5643] 10.222.0.27 () {58 vars in 1292 bytes} [Mon Jun 20 12:28:25 2022] GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427/os-server-password => generated 16 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:28:25.475451 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4fd74696-5591-4f10-86ec-fc8db3b8daf6 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:25.476247 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4fd74696-5591-4f10-86ec-fc8db3b8daf6 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] [instance: a47032d7-fd47-4a3a-9a8d-8000eb0c4427] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:25.499533 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4fd74696-5591-4f10-86ec-fc8db3b8daf6 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:25.502990 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4fd74696-5591-4f10-86ec-fc8db3b8daf6 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:25.504232 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4fd74696-5591-4f10-86ec-fc8db3b8daf6 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:25.507736 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4fd74696-5591-4f10-86ec-fc8db3b8daf6 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:25.560091 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4fd74696-5591-4f10-86ec-fc8db3b8daf6 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] [instance: a47032d7-fd47-4a3a-9a8d-8000eb0c4427] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:28:25.616250 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:25.801264 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4fd74696-5591-4f10-86ec-fc8db3b8daf6 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427" status: 204 len: 0 microversion: 2.1 time: 0.328997 Jun 20 12:28:25.805262 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2771/5644] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:28:25 2022] DELETE /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:28:25.814374 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e9ec1fb7-1d3e-4000-b0f0-bfa1a20d92bb tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:25.816243 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e9ec1fb7-1d3e-4000-b0f0-bfa1a20d92bb tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] [instance: a47032d7-fd47-4a3a-9a8d-8000eb0c4427] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:25.833887 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e9ec1fb7-1d3e-4000-b0f0-bfa1a20d92bb tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:25.834631 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e9ec1fb7-1d3e-4000-b0f0-bfa1a20d92bb tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:25.837291 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e9ec1fb7-1d3e-4000-b0f0-bfa1a20d92bb tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:25.839708 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e9ec1fb7-1d3e-4000-b0f0-bfa1a20d92bb tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:25.949765 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-906bb340-4dfa-48e7-a3cd-a2a2b8c5fe22 req-67283728-c989-4979-a15e-b2ce2dfbafa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f7328d0-2429-4fe9-bf9e-0925f6458204", "name": "network-vif-plugged", "status": "completed", "tag": "849df7fb-2841-40f4-90bd-c50ffeb7c6d6"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:28:25.970606 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-906bb340-4dfa-48e7-a3cd-a2a2b8c5fe22 req-67283728-c989-4979-a15e-b2ce2dfbafa7 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:25.976531 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-906bb340-4dfa-48e7-a3cd-a2a2b8c5fe22 req-67283728-c989-4979-a15e-b2ce2dfbafa7 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:26.011211 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-906bb340-4dfa-48e7-a3cd-a2a2b8c5fe22 req-67283728-c989-4979-a15e-b2ce2dfbafa7 service nova] Creating event network-vif-plugged:849df7fb-2841-40f4-90bd-c50ffeb7c6d6 for instance 8f7328d0-2429-4fe9-bf9e-0925f6458204 on n-h1-master-1 Jun 20 12:28:26.032806 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-906bb340-4dfa-48e7-a3cd-a2a2b8c5fe22 req-67283728-c989-4979-a15e-b2ce2dfbafa7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089246 Jun 20 12:28:26.037447 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2772/5645] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:28:26.301352 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-20cb5df3-04a7-4450-acaf-dd308b904628 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:26.302280 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-20cb5df3-04a7-4450-acaf-dd308b904628 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] [instance: ce5bd643-ecf0-4e74-a49a-98d6469cebeb] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:26.313612 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-20cb5df3-04a7-4450-acaf-dd308b904628 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:26.321217 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-20cb5df3-04a7-4450-acaf-dd308b904628 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:26.322165 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-20cb5df3-04a7-4450-acaf-dd308b904628 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:26.324499 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-20cb5df3-04a7-4450-acaf-dd308b904628 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:26.714722 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-20cb5df3-04a7-4450-acaf-dd308b904628 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5289b306fb4e2e9c42564336ade23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0acb7593db24b07af194c4eba251cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:26.726227 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-20cb5df3-04a7-4450-acaf-dd308b904628 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] 10.222.0.27 "GET /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb" status: 200 len: 1315 microversion: 2.1 time: 0.429567 Jun 20 12:28:26.729833 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2773/5646] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:26 2022] GET /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb => generated 1315 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:28:26.734891 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7c9b20c7-edb2-433f-b3c0-d6c03eb38475 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:26.746555 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7c9b20c7-edb2-433f-b3c0-d6c03eb38475 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 8f7328d0-2429-4fe9-bf9e-0925f6458204] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:26.754152 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7c9b20c7-edb2-433f-b3c0-d6c03eb38475 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:26.756813 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7c9b20c7-edb2-433f-b3c0-d6c03eb38475 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:26.760363 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7c9b20c7-edb2-433f-b3c0-d6c03eb38475 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:26.761242 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7c9b20c7-edb2-433f-b3c0-d6c03eb38475 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:26.798442 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e9ec1fb7-1d3e-4000-b0f0-bfa1a20d92bb tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004709245ec54b4ebe1ba7f0086ca2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff103422df5e4e108f7006fea6ef6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:26.815134 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e9ec1fb7-1d3e-4000-b0f0-bfa1a20d92bb tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] 10.222.0.27 "GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427" status: 200 len: 1509 microversion: 2.1 time: 1.005292 Jun 20 12:28:26.820724 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2874/5647] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:25 2022] GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427 => generated 1509 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:27.287106 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7c9b20c7-edb2-433f-b3c0-d6c03eb38475 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:27.310736 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7c9b20c7-edb2-433f-b3c0-d6c03eb38475 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204" status: 200 len: 1327 microversion: 2.1 time: 0.571796 Jun 20 12:28:27.314339 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2774/5648] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:26 2022] GET /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204 => generated 1327 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:27.747908 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-da173843-8d53-4284-a341-34ade6c3edec tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:27.748636 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-da173843-8d53-4284-a341-34ade6c3edec tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] [instance: ce5bd643-ecf0-4e74-a49a-98d6469cebeb] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:27.761695 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da173843-8d53-4284-a341-34ade6c3edec tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:27.763677 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da173843-8d53-4284-a341-34ade6c3edec tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:27.765060 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da173843-8d53-4284-a341-34ade6c3edec tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:27.766391 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da173843-8d53-4284-a341-34ade6c3edec tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:27.841950 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-970ba216-f74a-443f-a569-8c38aa6bd245 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:27.843447 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-970ba216-f74a-443f-a569-8c38aa6bd245 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] [instance: a47032d7-fd47-4a3a-9a8d-8000eb0c4427] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:27.866253 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-970ba216-f74a-443f-a569-8c38aa6bd245 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:27.867805 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-970ba216-f74a-443f-a569-8c38aa6bd245 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:27.871301 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-970ba216-f74a-443f-a569-8c38aa6bd245 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:27.874996 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-970ba216-f74a-443f-a569-8c38aa6bd245 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:28.266990 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-da173843-8d53-4284-a341-34ade6c3edec tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5289b306fb4e2e9c42564336ade23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0acb7593db24b07af194c4eba251cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:28.276485 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-da173843-8d53-4284-a341-34ade6c3edec tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] 10.222.0.27 "GET /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb" status: 200 len: 1315 microversion: 2.1 time: 0.533841 Jun 20 12:28:28.277097 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2875/5649] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:27 2022] GET /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb => generated 1315 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:28.331896 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-063beeda-e13f-4a68-adba-bc8f212c9e1b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:28.332575 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-063beeda-e13f-4a68-adba-bc8f212c9e1b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 8f7328d0-2429-4fe9-bf9e-0925f6458204] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:28.341471 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=4 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:28.343306 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-063beeda-e13f-4a68-adba-bc8f212c9e1b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:28.343783 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-063beeda-e13f-4a68-adba-bc8f212c9e1b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:28.344635 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-063beeda-e13f-4a68-adba-bc8f212c9e1b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:28.345086 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-063beeda-e13f-4a68-adba-bc8f212c9e1b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:28.763455 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=28 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:28.916366 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-063beeda-e13f-4a68-adba-bc8f212c9e1b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:28.925319 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-063beeda-e13f-4a68-adba-bc8f212c9e1b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204" status: 200 len: 1508 microversion: 2.1 time: 0.597910 Jun 20 12:28:28.927676 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2876/5650] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:28 2022] GET /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204 => generated 1508 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:28:28.950942 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-b41b630b-bc8e-4b02-9b4a-c0d411cfb7f7 req-8e0c257c-166e-4012-9b81-9ea9910014fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce5bd643-ecf0-4e74-a49a-98d6469cebeb", "tag": "6bc40a0b-9ff9-400f-83b4-7615c5951edc"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:28:28.972531 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b41b630b-bc8e-4b02-9b4a-c0d411cfb7f7 req-8e0c257c-166e-4012-9b81-9ea9910014fc service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:28.973300 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b41b630b-bc8e-4b02-9b4a-c0d411cfb7f7 req-8e0c257c-166e-4012-9b81-9ea9910014fc service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:28.995965 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-b41b630b-bc8e-4b02-9b4a-c0d411cfb7f7 req-8e0c257c-166e-4012-9b81-9ea9910014fc service nova] Creating event network-changed:6bc40a0b-9ff9-400f-83b4-7615c5951edc for instance ce5bd643-ecf0-4e74-a49a-98d6469cebeb on n-h1-master-1 Jun 20 12:28:29.020280 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-b41b630b-bc8e-4b02-9b4a-c0d411cfb7f7 req-8e0c257c-166e-4012-9b81-9ea9910014fc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091088 Jun 20 12:28:29.020777 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-970ba216-f74a-443f-a569-8c38aa6bd245 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004709245ec54b4ebe1ba7f0086ca2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff103422df5e4e108f7006fea6ef6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:29.021305 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2877/5651] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:28:29.030685 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-970ba216-f74a-443f-a569-8c38aa6bd245 tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] 10.222.0.27 "GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427" status: 200 len: 1509 microversion: 2.1 time: 1.197255 Jun 20 12:28:29.043092 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2775/5652] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:27 2022] GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427 => generated 1509 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:29.043818 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cdd4472a-11b7-45d4-930b-b8d5e1efad4e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:29.044874 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cdd4472a-11b7-45d4-930b-b8d5e1efad4e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 8f7328d0-2429-4fe9-bf9e-0925f6458204] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:29.057864 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cdd4472a-11b7-45d4-930b-b8d5e1efad4e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:29.062844 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cdd4472a-11b7-45d4-930b-b8d5e1efad4e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:29.063955 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cdd4472a-11b7-45d4-930b-b8d5e1efad4e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:29.066873 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cdd4472a-11b7-45d4-930b-b8d5e1efad4e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:29.296085 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1a33a9c4-1b75-4614-9e38-1100ada8a3c8 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:29.297051 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1a33a9c4-1b75-4614-9e38-1100ada8a3c8 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] [instance: ce5bd643-ecf0-4e74-a49a-98d6469cebeb] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:29.314783 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a33a9c4-1b75-4614-9e38-1100ada8a3c8 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:29.317653 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a33a9c4-1b75-4614-9e38-1100ada8a3c8 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:29.321394 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a33a9c4-1b75-4614-9e38-1100ada8a3c8 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:29.324681 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a33a9c4-1b75-4614-9e38-1100ada8a3c8 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:29.559161 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cdd4472a-11b7-45d4-930b-b8d5e1efad4e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:29.567999 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cdd4472a-11b7-45d4-930b-b8d5e1efad4e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204" status: 200 len: 1508 microversion: 2.1 time: 0.545488 Jun 20 12:28:29.573059 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2878/5653] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:29 2022] GET /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204 => generated 1508 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:29.590916 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5e68d155-9ac2-42e3-abf6-f648d9849441 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:29.599504 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5e68d155-9ac2-42e3-abf6-f648d9849441 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 8f7328d0-2429-4fe9-bf9e-0925f6458204] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:29.611892 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5e68d155-9ac2-42e3-abf6-f648d9849441 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:29.615891 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5e68d155-9ac2-42e3-abf6-f648d9849441 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:29.617037 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5e68d155-9ac2-42e3-abf6-f648d9849441 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:29.624007 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5e68d155-9ac2-42e3-abf6-f648d9849441 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:29.674052 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5e68d155-9ac2-42e3-abf6-f648d9849441 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 8f7328d0-2429-4fe9-bf9e-0925f6458204] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:28:29.876576 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5e68d155-9ac2-42e3-abf6-f648d9849441 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204" status: 204 len: 0 microversion: 2.1 time: 0.289879 Jun 20 12:28:29.877211 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2879/5654] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:28:29 2022] DELETE /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:28:29.886622 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-046cd5c2-00ad-4d5c-8427-07eb98c367d7 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:29.887352 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-046cd5c2-00ad-4d5c-8427-07eb98c367d7 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 8f7328d0-2429-4fe9-bf9e-0925f6458204] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:29.912742 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-046cd5c2-00ad-4d5c-8427-07eb98c367d7 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:29.912742 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-046cd5c2-00ad-4d5c-8427-07eb98c367d7 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:29.912742 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-046cd5c2-00ad-4d5c-8427-07eb98c367d7 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:29.912742 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-046cd5c2-00ad-4d5c-8427-07eb98c367d7 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:30.315795 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-046cd5c2-00ad-4d5c-8427-07eb98c367d7 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:30.333656 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-046cd5c2-00ad-4d5c-8427-07eb98c367d7 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204" status: 200 len: 1514 microversion: 2.1 time: 0.451519 Jun 20 12:28:30.334868 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2880/5655] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:29 2022] GET /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204 => generated 1514 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:30.361402 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1a33a9c4-1b75-4614-9e38-1100ada8a3c8 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5289b306fb4e2e9c42564336ade23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0acb7593db24b07af194c4eba251cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:30.400761 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1a33a9c4-1b75-4614-9e38-1100ada8a3c8 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] 10.222.0.27 "GET /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb" status: 200 len: 1315 microversion: 2.1 time: 1.110343 Jun 20 12:28:30.419014 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2776/5656] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:29 2022] GET /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb => generated 1315 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:30.444617 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cdf35a87-fcf2-4519-af14-b278103df8ec tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:30.445254 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cdf35a87-fcf2-4519-af14-b278103df8ec tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] [instance: a47032d7-fd47-4a3a-9a8d-8000eb0c4427] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:30.462419 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cdf35a87-fcf2-4519-af14-b278103df8ec tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:30.463206 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cdf35a87-fcf2-4519-af14-b278103df8ec tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:30.464176 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cdf35a87-fcf2-4519-af14-b278103df8ec tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:30.464796 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cdf35a87-fcf2-4519-af14-b278103df8ec tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:30.507339 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cdf35a87-fcf2-4519-af14-b278103df8ec tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:30.507967 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cdf35a87-fcf2-4519-af14-b278103df8ec tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:30.508624 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-cdf35a87-fcf2-4519-af14-b278103df8ec tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lazy-loading 'fault' on Instance uuid a47032d7-fd47-4a3a-9a8d-8000eb0c4427 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:28:30.719148 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-cdf35a87-fcf2-4519-af14-b278103df8ec tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004709245ec54b4ebe1ba7f0086ca2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff103422df5e4e108f7006fea6ef6d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:30.725258 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-a65cce68-4f48-45a4-8dcf-6e2976512eb9 req-f19085f8-9e6a-4151-b53b-307c6dc72311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a47032d7-fd47-4a3a-9a8d-8000eb0c4427", "name": "network-vif-deleted", "tag": "c0490068-23b8-4960-b234-3eeeca6f3cac"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:28:30.751865 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cdf35a87-fcf2-4519-af14-b278103df8ec tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] 10.222.0.27 "GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427" status: 200 len: 1305 microversion: 2.1 time: 0.328568 Jun 20 12:28:30.769057 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2777/5657] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:30 2022] GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427 => generated 1305 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:30.774472 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-a65cce68-4f48-45a4-8dcf-6e2976512eb9 req-f19085f8-9e6a-4151-b53b-307c6dc72311 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:30.776642 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-a65cce68-4f48-45a4-8dcf-6e2976512eb9 req-f19085f8-9e6a-4151-b53b-307c6dc72311 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:30.833520 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-a65cce68-4f48-45a4-8dcf-6e2976512eb9 req-f19085f8-9e6a-4151-b53b-307c6dc72311 service nova] Creating event network-vif-deleted:c0490068-23b8-4960-b234-3eeeca6f3cac for instance a47032d7-fd47-4a3a-9a8d-8000eb0c4427 on n-h2-master-1 Jun 20 12:28:30.840106 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-a65cce68-4f48-45a4-8dcf-6e2976512eb9 req-f19085f8-9e6a-4151-b53b-307c6dc72311 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.503490 Jun 20 12:28:30.843435 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2881/5658] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:28:31.351884 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2c3554c4-01df-4692-8e52-de6bda8ac7f1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:31.352528 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2c3554c4-01df-4692-8e52-de6bda8ac7f1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 8f7328d0-2429-4fe9-bf9e-0925f6458204] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:31.360962 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:31.367524 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2c3554c4-01df-4692-8e52-de6bda8ac7f1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:31.369330 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2c3554c4-01df-4692-8e52-de6bda8ac7f1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:31.370288 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2c3554c4-01df-4692-8e52-de6bda8ac7f1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:31.372179 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2c3554c4-01df-4692-8e52-de6bda8ac7f1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:31.418971 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-108acb57-4d8c-45c0-bdee-3a2e5e092147 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:31.419952 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-108acb57-4d8c-45c0-bdee-3a2e5e092147 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] [instance: ce5bd643-ecf0-4e74-a49a-98d6469cebeb] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:31.439183 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-108acb57-4d8c-45c0-bdee-3a2e5e092147 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:31.440162 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-108acb57-4d8c-45c0-bdee-3a2e5e092147 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:31.441149 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-108acb57-4d8c-45c0-bdee-3a2e5e092147 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:31.443442 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-108acb57-4d8c-45c0-bdee-3a2e5e092147 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:31.769820 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-108acb57-4d8c-45c0-bdee-3a2e5e092147 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5289b306fb4e2e9c42564336ade23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0acb7593db24b07af194c4eba251cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:31.782763 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-108acb57-4d8c-45c0-bdee-3a2e5e092147 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] 10.222.0.27 "GET /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb" status: 200 len: 1315 microversion: 2.1 time: 0.368375 Jun 20 12:28:31.783453 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2882/5659] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:31 2022] GET /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb => generated 1315 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:28:31.797195 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e29a9aed-e840-430e-ab2b-6955add4b5ab tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:31.797931 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e29a9aed-e840-430e-ab2b-6955add4b5ab tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] [instance: a47032d7-fd47-4a3a-9a8d-8000eb0c4427] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:31.816093 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e29a9aed-e840-430e-ab2b-6955add4b5ab tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:31.816587 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e29a9aed-e840-430e-ab2b-6955add4b5ab tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:31.817394 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e29a9aed-e840-430e-ab2b-6955add4b5ab tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:31.817844 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e29a9aed-e840-430e-ab2b-6955add4b5ab tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:31.848649 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-e29a9aed-e840-430e-ab2b-6955add4b5ab tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] HTTP exception thrown: Instance a47032d7-fd47-4a3a-9a8d-8000eb0c4427 could not be found. Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e29a9aed-e840-430e-ab2b-6955add4b5ab tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Request method failure captured: Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427 HTTP/1.1 Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGfNC1n3Qffn9fNFwjy4mu8O__rTMkuAjGQRSL_-liMxKQWyv0-ZDo1YyGsNK0ws1boYpcodZ1yTPk0PSj6ZzhbDv1ja1dW9ADUFwKibxSTGAKEANi5HTftf6O7WzKlouAse1XTda_De2zQbxY_t8ou5SdIJ1UHqOXH-GlI52hnoJ2M Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: ff103422df5e4e108f7006fea6ef6d73 Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServerPasswordTestJSON-877561294 Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ff103422df5e4e108f7006fea6ef6d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ff103422df5e4e108f7006fea6ef6d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ff103422df5e4e108f7006fea6ef6d73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ff103422df5e4e108f7006fea6ef6d73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServerPasswordTestJSON-877561294 Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: ff103422df5e4e108f7006fea6ef6d73 Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServerPasswordTestJSON-877561294 Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServerPasswordTestJSON-877561294-project Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 004709245ec54b4ebe1ba7f0086ca2f6 Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServerPasswordTestJSON-877561294-project Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: exception: Instance a47032d7-fd47-4a3a-9a8d-8000eb0c4427 could not be found. Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'a47032d7-fd47-4a3a-9a8d-8000eb0c4427'} Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a47032d7-fd47-4a3a-9a8d-8000eb0c4427 could not be found. Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a47032d7-fd47-4a3a-9a8d-8000eb0c4427 could not be found. Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:28:31.850419 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:28:31.855753 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:28:31.855753 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:28:31.855753 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:28:31.855753 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:28:31.855753 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:28:31.855753 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a47032d7-fd47-4a3a-9a8d-8000eb0c4427 could not be found. Jun 20 12:28:31.855753 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:28:31.855753 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e29a9aed-e840-430e-ab2b-6955add4b5ab tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] Returning 404 to user: Instance a47032d7-fd47-4a3a-9a8d-8000eb0c4427 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:28:31.855753 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e29a9aed-e840-430e-ab2b-6955add4b5ab tempest-ServerPasswordTestJSON-877561294 tempest-ServerPasswordTestJSON-877561294-project] 10.222.0.27 "GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427" status: 404 len: 111 microversion: 2.1 time: 0.067442 Jun 20 12:28:31.868611 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2883/5660] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:31 2022] GET /compute/v2.1/servers/a47032d7-fd47-4a3a-9a8d-8000eb0c4427 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:28:31.903985 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2c3554c4-01df-4692-8e52-de6bda8ac7f1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:31.922759 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2c3554c4-01df-4692-8e52-de6bda8ac7f1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204" status: 200 len: 1514 microversion: 2.1 time: 0.574543 Jun 20 12:28:31.923362 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2778/5661] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:31 2022] GET /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204 => generated 1514 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:32.816647 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7569b282-ecd7-423b-b7e4-b2bebbf4f6a2 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:32.828860 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7569b282-ecd7-423b-b7e4-b2bebbf4f6a2 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] [instance: ce5bd643-ecf0-4e74-a49a-98d6469cebeb] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:32.909021 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7569b282-ecd7-423b-b7e4-b2bebbf4f6a2 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:32.912723 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7569b282-ecd7-423b-b7e4-b2bebbf4f6a2 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:32.913772 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7569b282-ecd7-423b-b7e4-b2bebbf4f6a2 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:32.918186 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7569b282-ecd7-423b-b7e4-b2bebbf4f6a2 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:32.945148 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-defc8e8c-7a99-4c9b-aee3-290f32c20728 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:32.945928 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-defc8e8c-7a99-4c9b-aee3-290f32c20728 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 8f7328d0-2429-4fe9-bf9e-0925f6458204] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:32.970486 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-defc8e8c-7a99-4c9b-aee3-290f32c20728 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:32.971324 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-defc8e8c-7a99-4c9b-aee3-290f32c20728 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:32.973990 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-defc8e8c-7a99-4c9b-aee3-290f32c20728 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:32.975092 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-defc8e8c-7a99-4c9b-aee3-290f32c20728 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:33.272888 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7569b282-ecd7-423b-b7e4-b2bebbf4f6a2 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5289b306fb4e2e9c42564336ade23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0acb7593db24b07af194c4eba251cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:33.286934 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7569b282-ecd7-423b-b7e4-b2bebbf4f6a2 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] 10.222.0.27 "GET /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb" status: 200 len: 1315 microversion: 2.1 time: 0.487847 Jun 20 12:28:33.301358 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2884/5662] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:32 2022] GET /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb => generated 1315 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:34.309471 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6e3899e1-74c7-4cf4-89dc-044b0d50b1af tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:34.310862 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6e3899e1-74c7-4cf4-89dc-044b0d50b1af tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] [instance: ce5bd643-ecf0-4e74-a49a-98d6469cebeb] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:34.333001 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6e3899e1-74c7-4cf4-89dc-044b0d50b1af tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:34.336797 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6e3899e1-74c7-4cf4-89dc-044b0d50b1af tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:34.337904 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6e3899e1-74c7-4cf4-89dc-044b0d50b1af tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:34.338937 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6e3899e1-74c7-4cf4-89dc-044b0d50b1af tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:34.397333 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-defc8e8c-7a99-4c9b-aee3-290f32c20728 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:34.414390 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-defc8e8c-7a99-4c9b-aee3-290f32c20728 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204" status: 200 len: 1514 microversion: 2.1 time: 1.477696 Jun 20 12:28:34.415525 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2779/5663] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:32 2022] GET /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204 => generated 1514 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:28:35.341320 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6e3899e1-74c7-4cf4-89dc-044b0d50b1af tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5289b306fb4e2e9c42564336ade23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0acb7593db24b07af194c4eba251cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:35.374389 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6e3899e1-74c7-4cf4-89dc-044b0d50b1af tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] 10.222.0.27 "GET /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb" status: 200 len: 1315 microversion: 2.1 time: 1.069471 Jun 20 12:28:35.377252 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2885/5664] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:34 2022] GET /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb => generated 1315 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:35.439993 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cb92616d-2012-4fae-8aed-1a0c9a19d214 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:35.440653 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cb92616d-2012-4fae-8aed-1a0c9a19d214 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 8f7328d0-2429-4fe9-bf9e-0925f6458204] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:35.451260 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb92616d-2012-4fae-8aed-1a0c9a19d214 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:35.451719 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb92616d-2012-4fae-8aed-1a0c9a19d214 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:35.452532 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb92616d-2012-4fae-8aed-1a0c9a19d214 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:35.452974 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb92616d-2012-4fae-8aed-1a0c9a19d214 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:36.006466 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-cb92616d-2012-4fae-8aed-1a0c9a19d214 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:36.018608 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cb92616d-2012-4fae-8aed-1a0c9a19d214 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204" status: 200 len: 1514 microversion: 2.1 time: 0.583369 Jun 20 12:28:36.022077 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2780/5665] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:35 2022] GET /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204 => generated 1514 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:36.099974 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-600c2612-73f5-4448-a381-d7b182f385a4 req-68e2911a-4f49-4c00-ba39-3dd77a0bdddb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f7328d0-2429-4fe9-bf9e-0925f6458204", "name": "network-vif-deleted", "tag": "849df7fb-2841-40f4-90bd-c50ffeb7c6d6"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:28:36.133995 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-600c2612-73f5-4448-a381-d7b182f385a4 req-68e2911a-4f49-4c00-ba39-3dd77a0bdddb service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:36.135723 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-600c2612-73f5-4448-a381-d7b182f385a4 req-68e2911a-4f49-4c00-ba39-3dd77a0bdddb service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:36.211546 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-600c2612-73f5-4448-a381-d7b182f385a4 req-68e2911a-4f49-4c00-ba39-3dd77a0bdddb service nova] Creating event network-vif-deleted:849df7fb-2841-40f4-90bd-c50ffeb7c6d6 for instance 8f7328d0-2429-4fe9-bf9e-0925f6458204 on n-h1-master-1 Jun 20 12:28:36.243013 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-600c2612-73f5-4448-a381-d7b182f385a4 req-68e2911a-4f49-4c00-ba39-3dd77a0bdddb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147854 Jun 20 12:28:36.243662 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2886/5666] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:28:36.395455 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-59d2972c-c834-41f3-89b7-9e69eecc580e tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:36.396168 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-59d2972c-c834-41f3-89b7-9e69eecc580e tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] [instance: ce5bd643-ecf0-4e74-a49a-98d6469cebeb] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:36.410955 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-59d2972c-c834-41f3-89b7-9e69eecc580e tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:36.411422 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-59d2972c-c834-41f3-89b7-9e69eecc580e tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:36.443068 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-59d2972c-c834-41f3-89b7-9e69eecc580e tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:36.443955 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-59d2972c-c834-41f3-89b7-9e69eecc580e tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:36.996935 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-59d2972c-c834-41f3-89b7-9e69eecc580e tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5289b306fb4e2e9c42564336ade23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0acb7593db24b07af194c4eba251cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:37.005408 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-59d2972c-c834-41f3-89b7-9e69eecc580e tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] 10.222.0.27 "GET /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb" status: 200 len: 1315 microversion: 2.1 time: 0.616420 Jun 20 12:28:37.014840 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2887/5667] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:36 2022] GET /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb => generated 1315 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:37.039755 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a086ea3c-1e31-41ec-8835-046abffd34d6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:37.041775 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a086ea3c-1e31-41ec-8835-046abffd34d6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 8f7328d0-2429-4fe9-bf9e-0925f6458204] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:37.064416 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a086ea3c-1e31-41ec-8835-046abffd34d6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:37.070176 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a086ea3c-1e31-41ec-8835-046abffd34d6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:37.072282 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a086ea3c-1e31-41ec-8835-046abffd34d6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:37.075691 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a086ea3c-1e31-41ec-8835-046abffd34d6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:37.121248 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-a086ea3c-1e31-41ec-8835-046abffd34d6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] HTTP exception thrown: Instance 8f7328d0-2429-4fe9-bf9e-0925f6458204 could not be found. Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a086ea3c-1e31-41ec-8835-046abffd34d6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Request method failure captured: Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204 HTTP/1.1 Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGeaPbwuiKlZtfAakVi9AU1jZJYQpsiuqbtqj4H7EyEfa_Hs7Z-uZ4kORsCa_VB61-2zGcpt-Akt_fwFGZsdE57QH4a5RFxoaFSpMB5wQSEpC1nxSFtZmML3yZTCD6a9Nk7nPWXZGtd_9TDU17ULy9DxSwRUUNLntxWZGEmDQVAe1xk Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersTestJSON-953297781 Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersTestJSON-953297781 Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersTestJSON-953297781 Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersTestJSON-953297781-project Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 8878d44956bd42e18f0409534e562ab6 Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersTestJSON-953297781-project Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 8f7328d0-2429-4fe9-bf9e-0925f6458204 could not be found. Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '8f7328d0-2429-4fe9-bf9e-0925f6458204'} Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f7328d0-2429-4fe9-bf9e-0925f6458204 could not be found. Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f7328d0-2429-4fe9-bf9e-0925f6458204 could not be found. Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:28:37.126647 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:28:37.131368 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:28:37.131368 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:28:37.131368 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:28:37.131368 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:28:37.131368 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f7328d0-2429-4fe9-bf9e-0925f6458204 could not be found. Jun 20 12:28:37.131368 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:28:37.134069 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a086ea3c-1e31-41ec-8835-046abffd34d6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Returning 404 to user: Instance 8f7328d0-2429-4fe9-bf9e-0925f6458204 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:28:37.135578 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a086ea3c-1e31-41ec-8835-046abffd34d6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204" status: 404 len: 111 microversion: 2.1 time: 0.101401 Jun 20 12:28:37.142176 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2888/5668] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:37 2022] GET /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:28:37.149756 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3a5af56e-c524-465d-9b34-da46193773ba tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '.version_select at 0x7f607350d550>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:37.195137 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4b936de7-4f69-4dee-95e3-51f380dfbd81 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Action: 'create', calling method: .version_select at 0x7f60724a44c0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-51846293", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdgAJEWy/28Zdge2XeOZL45XuNQuXOlifXZo7VTzeUMAsVWXed6h2XKz5OgjLyu6CrJJfiAWjqmzzwUV+HRvIXQEgYfqqgCXcyhTwXCF5W4iQa4YFp+0slb6CCCJYi2Tw=="}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:28:37.201142 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3a5af56e-c524-465d-9b34-da46193773ba tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-key-740914494" status: 202 len: 0 microversion: 2.1 time: 0.056934 Jun 20 12:28:37.202091 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2889/5669] 10.222.0.27 () {58 vars in 1205 bytes} [Mon Jun 20 12:28:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-740914494 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:28:37.262681 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-4b936de7-4f69-4dee-95e3-51f380dfbd81 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Getting quotas for project 4136a79e71ec4e78803ac418f2445ee7. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:28:37.284476 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-4b936de7-4f69-4dee-95e3-51f380dfbd81 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Getting quotas for user b490f46fb1a147dfa995d8fe278fe971 and project 4136a79e71ec4e78803ac418f2445ee7. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:28:37.320154 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4b936de7-4f69-4dee-95e3-51f380dfbd81 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 1.127370 Jun 20 12:28:37.321086 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2781/5670] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 12:28:36 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:28:37.472726 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-33bf13e2-96f6-471a-88d7-c2fb6cf8943e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1532806581", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "ce2e9d9e-a74d-4fc7-950c-df9300f57b6c"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:28:37.647977 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-6977d79c-7496-4fec-aedf-b767beb43f33 req-5735eb7e-aab7-43dd-8fb8-8eeae5f41811 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce5bd643-ecf0-4e74-a49a-98d6469cebeb", "name": "network-vif-plugged", "status": "completed", "tag": "6bc40a0b-9ff9-400f-83b4-7615c5951edc"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:28:37.664919 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-33bf13e2-96f6-471a-88d7-c2fb6cf8943e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] validate_networks() for [('ce2e9d9e-a74d-4fc7-950c-df9300f57b6c', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:28:37.693194 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-6977d79c-7496-4fec-aedf-b767beb43f33 req-5735eb7e-aab7-43dd-8fb8-8eeae5f41811 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:37.694508 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-6977d79c-7496-4fec-aedf-b767beb43f33 req-5735eb7e-aab7-43dd-8fb8-8eeae5f41811 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:37.735080 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-6977d79c-7496-4fec-aedf-b767beb43f33 req-5735eb7e-aab7-43dd-8fb8-8eeae5f41811 service nova] Creating event network-vif-plugged:6bc40a0b-9ff9-400f-83b4-7615c5951edc for instance ce5bd643-ecf0-4e74-a49a-98d6469cebeb on n-h1-master-1 Jun 20 12:28:37.749073 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-6977d79c-7496-4fec-aedf-b767beb43f33 req-5735eb7e-aab7-43dd-8fb8-8eeae5f41811 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106571 Jun 20 12:28:37.752255 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2782/5671] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:28:38.034727 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-81d413d3-ee16-40b5-bdf6-1ca69741c1f9 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:38.035751 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-81d413d3-ee16-40b5-bdf6-1ca69741c1f9 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] [instance: ce5bd643-ecf0-4e74-a49a-98d6469cebeb] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:38.057184 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-81d413d3-ee16-40b5-bdf6-1ca69741c1f9 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:38.058238 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-81d413d3-ee16-40b5-bdf6-1ca69741c1f9 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:38.061247 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-81d413d3-ee16-40b5-bdf6-1ca69741c1f9 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:38.061916 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-81d413d3-ee16-40b5-bdf6-1ca69741c1f9 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:38.915347 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-81d413d3-ee16-40b5-bdf6-1ca69741c1f9 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5289b306fb4e2e9c42564336ade23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0acb7593db24b07af194c4eba251cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:38.932783 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-81d413d3-ee16-40b5-bdf6-1ca69741c1f9 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] 10.222.0.27 "GET /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb" status: 200 len: 1315 microversion: 2.1 time: 0.903766 Jun 20 12:28:38.933893 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2783/5672] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:38 2022] GET /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb => generated 1315 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:39.961255 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-42b3d9e5-6957-41e4-ac62-6b2f3b65aaf7 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:39.966614 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-42b3d9e5-6957-41e4-ac62-6b2f3b65aaf7 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] [instance: ce5bd643-ecf0-4e74-a49a-98d6469cebeb] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:40.011288 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-42b3d9e5-6957-41e4-ac62-6b2f3b65aaf7 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:40.014244 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-42b3d9e5-6957-41e4-ac62-6b2f3b65aaf7 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:40.016181 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-42b3d9e5-6957-41e4-ac62-6b2f3b65aaf7 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:40.016861 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-42b3d9e5-6957-41e4-ac62-6b2f3b65aaf7 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:40.164330 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-33bf13e2-96f6-471a-88d7-c2fb6cf8943e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:28:40.166454 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-33bf13e2-96f6-471a-88d7-c2fb6cf8943e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:28:40.168599 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-33bf13e2-96f6-471a-88d7-c2fb6cf8943e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:28:40.169082 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-33bf13e2-96f6-471a-88d7-c2fb6cf8943e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:28:40.169609 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-33bf13e2-96f6-471a-88d7-c2fb6cf8943e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:28:40.196624 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-33bf13e2-96f6-471a-88d7-c2fb6cf8943e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:40.197190 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-33bf13e2-96f6-471a-88d7-c2fb6cf8943e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:40.198274 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-33bf13e2-96f6-471a-88d7-c2fb6cf8943e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:40.198585 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-33bf13e2-96f6-471a-88d7-c2fb6cf8943e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:40.245788 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-33bf13e2-96f6-471a-88d7-c2fb6cf8943e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Getting quotas for project 896c053324b34720a7d0f151bfdc8b10. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:28:40.257429 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-33bf13e2-96f6-471a-88d7-c2fb6cf8943e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Getting quotas for user 8878d44956bd42e18f0409534e562ab6 and project 896c053324b34720a7d0f151bfdc8b10. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:28:40.285907 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-33bf13e2-96f6-471a-88d7-c2fb6cf8943e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:28:40.289516 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-33bf13e2-96f6-471a-88d7-c2fb6cf8943e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 3d7404de-1c0e-483f-b496-722b0a7cdd57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:28:40.359578 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-33bf13e2-96f6-471a-88d7-c2fb6cf8943e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.893593 Jun 20 12:28:40.360812 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2890/5673] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:28:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:28:40.396057 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5d03e34b-a7b1-43fa-b386-a74c7e858024 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:40.397012 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5d03e34b-a7b1-43fa-b386-a74c7e858024 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 3d7404de-1c0e-483f-b496-722b0a7cdd57] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:40.434084 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:40.515602 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-42b3d9e5-6957-41e4-ac62-6b2f3b65aaf7 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5289b306fb4e2e9c42564336ade23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0acb7593db24b07af194c4eba251cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:40.531397 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-42b3d9e5-6957-41e4-ac62-6b2f3b65aaf7 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] 10.222.0.27 "GET /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb" status: 200 len: 1464 microversion: 2.1 time: 0.574658 Jun 20 12:28:40.532705 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2784/5674] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:39 2022] GET /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb => generated 1464 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:40.612293 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-341fbbff-1b24-4d2d-8155-a03933844a3a tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:40.612801 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-341fbbff-1b24-4d2d-8155-a03933844a3a tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] [instance: ce5bd643-ecf0-4e74-a49a-98d6469cebeb] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:40.631497 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-341fbbff-1b24-4d2d-8155-a03933844a3a tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:40.632157 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-341fbbff-1b24-4d2d-8155-a03933844a3a tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:40.637864 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-341fbbff-1b24-4d2d-8155-a03933844a3a tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:40.638331 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-341fbbff-1b24-4d2d-8155-a03933844a3a tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:40.723983 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5d03e34b-a7b1-43fa-b386-a74c7e858024 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:40.739416 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5d03e34b-a7b1-43fa-b386-a74c7e858024 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57" status: 200 len: 1209 microversion: 2.1 time: 0.364232 Jun 20 12:28:40.741134 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2891/5675] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:40 2022] GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57 => generated 1209 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:40.750316 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-341fbbff-1b24-4d2d-8155-a03933844a3a tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] [instance: ce5bd643-ecf0-4e74-a49a-98d6469cebeb] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:28:40.751799 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0c0b42fc-a5eb-4061-8fa1-06e32443838c tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:40.753213 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0c0b42fc-a5eb-4061-8fa1-06e32443838c tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] [instance: 82d76221-bbcd-4dc7-a09b-e3b45088b4d0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:40.781939 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0c0b42fc-a5eb-4061-8fa1-06e32443838c tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:40.783303 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0c0b42fc-a5eb-4061-8fa1-06e32443838c tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:40.786364 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0c0b42fc-a5eb-4061-8fa1-06e32443838c tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:40.788535 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0c0b42fc-a5eb-4061-8fa1-06e32443838c tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:40.955270 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-341fbbff-1b24-4d2d-8155-a03933844a3a tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb" status: 204 len: 0 microversion: 2.1 time: 0.346678 Jun 20 12:28:40.956656 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2785/5676] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:28:40 2022] DELETE /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 12:28:40.972470 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d39087b6-d0f6-4317-bd22-3f75eb04da51 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:40.973812 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d39087b6-d0f6-4317-bd22-3f75eb04da51 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] [instance: ce5bd643-ecf0-4e74-a49a-98d6469cebeb] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:41.011556 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d39087b6-d0f6-4317-bd22-3f75eb04da51 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:41.012144 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d39087b6-d0f6-4317-bd22-3f75eb04da51 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:41.013073 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d39087b6-d0f6-4317-bd22-3f75eb04da51 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:41.015469 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d39087b6-d0f6-4317-bd22-3f75eb04da51 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:41.105989 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=95,nova_cell1:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:41.108294 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-0c0b42fc-a5eb-4061-8fa1-06e32443838c tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lazy-loading 'services' on Instance uuid 82d76221-bbcd-4dc7-a09b-e3b45088b4d0 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:28:41.314748 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0c0b42fc-a5eb-4061-8fa1-06e32443838c tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] 10.222.0.27 "DELETE /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0/os-volume_attachments/eaffbd3e-a7fb-49f4-8143-c906914ae05a" status: 202 len: 0 microversion: 2.1 time: 0.569389 Jun 20 12:28:41.315584 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2892/5677] 10.222.0.27 () {58 vars in 1415 bytes} [Mon Jun 20 12:28:40 2022] DELETE /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0/os-volume_attachments/eaffbd3e-a7fb-49f4-8143-c906914ae05a => generated 0 bytes in 574 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:28:41.491625 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d39087b6-d0f6-4317-bd22-3f75eb04da51 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5289b306fb4e2e9c42564336ade23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0acb7593db24b07af194c4eba251cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:41.508351 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d39087b6-d0f6-4317-bd22-3f75eb04da51 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] 10.222.0.27 "GET /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb" status: 200 len: 1470 microversion: 2.1 time: 0.540272 Jun 20 12:28:41.515847 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2786/5678] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:40 2022] GET /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb => generated 1470 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:41.756788 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-587c436b-0191-4c6c-9bb4-5a9cc44d1e18 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1910887486", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-51846293", "security_groups": [{"name": "tempest-secgroup-smoke-921299151"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "c3070547-77a7-4ae7-b337-836f1473b427"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:28:41.758590 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-01a016d4-df30-4789-a53c-4ddf01d35553 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:41.759332 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-01a016d4-df30-4789-a53c-4ddf01d35553 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 3d7404de-1c0e-483f-b496-722b0a7cdd57] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:41.767948 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-01a016d4-df30-4789-a53c-4ddf01d35553 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:41.769712 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-01a016d4-df30-4789-a53c-4ddf01d35553 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:41.770962 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-01a016d4-df30-4789-a53c-4ddf01d35553 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:41.773102 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-01a016d4-df30-4789-a53c-4ddf01d35553 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:41.848656 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:41.993403 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-01a016d4-df30-4789-a53c-4ddf01d35553 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:42.032600 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-01a016d4-df30-4789-a53c-4ddf01d35553 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57" status: 200 len: 1213 microversion: 2.1 time: 0.275294 Jun 20 12:28:42.044836 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2787/5679] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:41 2022] GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57 => generated 1213 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:42.534535 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4c689022-602c-4475-9186-8d874785ade7 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:42.535459 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4c689022-602c-4475-9186-8d874785ade7 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] [instance: ce5bd643-ecf0-4e74-a49a-98d6469cebeb] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:42.561288 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4c689022-602c-4475-9186-8d874785ade7 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:42.570430 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4c689022-602c-4475-9186-8d874785ade7 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:42.571577 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4c689022-602c-4475-9186-8d874785ade7 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:42.572973 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4c689022-602c-4475-9186-8d874785ade7 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:42.742152 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-587c436b-0191-4c6c-9bb4-5a9cc44d1e18 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] validate_networks() for [('c3070547-77a7-4ae7-b337-836f1473b427', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:28:44.344880 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4c689022-602c-4475-9186-8d874785ade7 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5289b306fb4e2e9c42564336ade23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0acb7593db24b07af194c4eba251cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:44.364705 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4c689022-602c-4475-9186-8d874785ade7 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] 10.222.0.27 "GET /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb" status: 200 len: 1470 microversion: 2.1 time: 1.835685 Jun 20 12:28:44.367070 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2788/5680] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:42 2022] GET /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb => generated 1470 bytes in 1839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:44.376949 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b9201af2-6df0-4e93-9aa4-5f3a7bb21c11 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:44.382465 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b9201af2-6df0-4e93-9aa4-5f3a7bb21c11 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 3d7404de-1c0e-483f-b496-722b0a7cdd57] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:44.399865 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b9201af2-6df0-4e93-9aa4-5f3a7bb21c11 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:44.401190 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b9201af2-6df0-4e93-9aa4-5f3a7bb21c11 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:44.403229 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b9201af2-6df0-4e93-9aa4-5f3a7bb21c11 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:44.405840 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b9201af2-6df0-4e93-9aa4-5f3a7bb21c11 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:44.587149 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-587c436b-0191-4c6c-9bb4-5a9cc44d1e18 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Getting quotas for project 4136a79e71ec4e78803ac418f2445ee7. Resources: dict_keys(['metadata_items']) {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:28:44.602390 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-587c436b-0191-4c6c-9bb4-5a9cc44d1e18 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Getting quotas for user b490f46fb1a147dfa995d8fe278fe971 and project 4136a79e71ec4e78803ac418f2445ee7. Resources: dict_keys(['metadata_items']) {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:28:44.647249 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-587c436b-0191-4c6c-9bb4-5a9cc44d1e18 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:28:44.651560 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-587c436b-0191-4c6c-9bb4-5a9cc44d1e18 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:28:44.653508 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-587c436b-0191-4c6c-9bb4-5a9cc44d1e18 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:28:44.654124 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-587c436b-0191-4c6c-9bb4-5a9cc44d1e18 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:28:44.654847 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-587c436b-0191-4c6c-9bb4-5a9cc44d1e18 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:28:44.677563 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-587c436b-0191-4c6c-9bb4-5a9cc44d1e18 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:44.682489 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-587c436b-0191-4c6c-9bb4-5a9cc44d1e18 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:44.684287 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-587c436b-0191-4c6c-9bb4-5a9cc44d1e18 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:44.685064 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-587c436b-0191-4c6c-9bb4-5a9cc44d1e18 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:44.732042 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-587c436b-0191-4c6c-9bb4-5a9cc44d1e18 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Getting quotas for project 4136a79e71ec4e78803ac418f2445ee7. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:28:44.747397 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-587c436b-0191-4c6c-9bb4-5a9cc44d1e18 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Getting quotas for user b490f46fb1a147dfa995d8fe278fe971 and project 4136a79e71ec4e78803ac418f2445ee7. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:28:44.783499 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-587c436b-0191-4c6c-9bb4-5a9cc44d1e18 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:28:44.793552 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-587c436b-0191-4c6c-9bb4-5a9cc44d1e18 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] [instance: 0059d853-f820-4e39-953c-133a05c6380e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:28:44.921446 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-587c436b-0191-4c6c-9bb4-5a9cc44d1e18 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.171587 Jun 20 12:28:44.930284 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2893/5681] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:28:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 3181 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:28:44.941521 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4c352f0e-b31c-4dee-8621-93abd5490f36 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:44.942435 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4c352f0e-b31c-4dee-8621-93abd5490f36 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] [instance: 0059d853-f820-4e39-953c-133a05c6380e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:45.090861 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b9201af2-6df0-4e93-9aa4-5f3a7bb21c11 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:45.100726 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b9201af2-6df0-4e93-9aa4-5f3a7bb21c11 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57" status: 200 len: 1267 microversion: 2.1 time: 0.732225 Jun 20 12:28:45.101783 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2789/5682] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:44 2022] GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57 => generated 1267 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:45.342002 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4c352f0e-b31c-4dee-8621-93abd5490f36 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490f46fb1a147dfa995d8fe278fe971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4136a79e71ec4e78803ac418f2445ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:45.362887 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4c352f0e-b31c-4dee-8621-93abd5490f36 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] 10.222.0.27 "GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e" status: 200 len: 1301 microversion: 2.1 time: 0.424705 Jun 20 12:28:45.363966 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2894/5683] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:44 2022] GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e => generated 1301 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:28:45.387592 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7cf9f949-6386-41df-939d-2b92b4e98ad6 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:45.388587 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7cf9f949-6386-41df-939d-2b92b4e98ad6 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] [instance: ce5bd643-ecf0-4e74-a49a-98d6469cebeb] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:45.406054 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7cf9f949-6386-41df-939d-2b92b4e98ad6 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:45.406518 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7cf9f949-6386-41df-939d-2b92b4e98ad6 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:45.407309 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7cf9f949-6386-41df-939d-2b92b4e98ad6 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:45.407749 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7cf9f949-6386-41df-939d-2b92b4e98ad6 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:45.501294 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-c83860e0-666e-4c00-8bfc-2d569dd05a18 req-f5974078-7c9b-4fe7-b913-bc06adda38e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce5bd643-ecf0-4e74-a49a-98d6469cebeb", "name": "network-vif-deleted", "tag": "6bc40a0b-9ff9-400f-83b4-7615c5951edc"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:28:45.529853 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-c83860e0-666e-4c00-8bfc-2d569dd05a18 req-f5974078-7c9b-4fe7-b913-bc06adda38e4 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:45.531691 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-c83860e0-666e-4c00-8bfc-2d569dd05a18 req-f5974078-7c9b-4fe7-b913-bc06adda38e4 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:45.566697 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-c83860e0-666e-4c00-8bfc-2d569dd05a18 req-f5974078-7c9b-4fe7-b913-bc06adda38e4 service nova] Creating event network-vif-deleted:6bc40a0b-9ff9-400f-83b4-7615c5951edc for instance ce5bd643-ecf0-4e74-a49a-98d6469cebeb on n-h1-master-1 Jun 20 12:28:45.583479 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-c83860e0-666e-4c00-8bfc-2d569dd05a18 req-f5974078-7c9b-4fe7-b913-bc06adda38e4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086400 Jun 20 12:28:45.584973 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2895/5684] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:28:45.631124 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7cf9f949-6386-41df-939d-2b92b4e98ad6 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5289b306fb4e2e9c42564336ade23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0acb7593db24b07af194c4eba251cff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:45.644895 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7cf9f949-6386-41df-939d-2b92b4e98ad6 tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] 10.222.0.27 "GET /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb" status: 200 len: 1428 microversion: 2.1 time: 0.265011 Jun 20 12:28:45.645519 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2790/5685] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:45 2022] GET /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb => generated 1428 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:46.120029 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d479433f-e90c-42dc-bd43-cae90ed12d2c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:46.120948 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d479433f-e90c-42dc-bd43-cae90ed12d2c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 3d7404de-1c0e-483f-b496-722b0a7cdd57] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:46.138305 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d479433f-e90c-42dc-bd43-cae90ed12d2c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:46.139115 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d479433f-e90c-42dc-bd43-cae90ed12d2c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:46.140718 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d479433f-e90c-42dc-bd43-cae90ed12d2c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:46.145752 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d479433f-e90c-42dc-bd43-cae90ed12d2c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:46.334938 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d479433f-e90c-42dc-bd43-cae90ed12d2c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:46.348925 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d479433f-e90c-42dc-bd43-cae90ed12d2c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57" status: 200 len: 1267 microversion: 2.1 time: 0.232663 Jun 20 12:28:46.360987 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2896/5686] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:46 2022] GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57 => generated 1267 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:46.380970 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-63310983-f380-4212-9c31-f9feb628ad7a tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:46.381588 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-63310983-f380-4212-9c31-f9feb628ad7a tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] [instance: 0059d853-f820-4e39-953c-133a05c6380e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:46.407013 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-63310983-f380-4212-9c31-f9feb628ad7a tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:46.408701 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-63310983-f380-4212-9c31-f9feb628ad7a tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:46.409790 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-63310983-f380-4212-9c31-f9feb628ad7a tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:46.410580 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-63310983-f380-4212-9c31-f9feb628ad7a tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:46.653810 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-63310983-f380-4212-9c31-f9feb628ad7a tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490f46fb1a147dfa995d8fe278fe971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4136a79e71ec4e78803ac418f2445ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:46.662970 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a7999a73-3404-4e9d-9f3c-bd09ddc84d4c tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:46.663703 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a7999a73-3404-4e9d-9f3c-bd09ddc84d4c tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] [instance: ce5bd643-ecf0-4e74-a49a-98d6469cebeb] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:46.682615 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-63310983-f380-4212-9c31-f9feb628ad7a tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] 10.222.0.27 "GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e" status: 200 len: 1297 microversion: 2.1 time: 0.301209 Jun 20 12:28:46.685487 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a7999a73-3404-4e9d-9f3c-bd09ddc84d4c tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:46.686000 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2791/5687] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:46 2022] GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e => generated 1297 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:46.686767 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a7999a73-3404-4e9d-9f3c-bd09ddc84d4c tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:46.692047 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a7999a73-3404-4e9d-9f3c-bd09ddc84d4c tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:46.692901 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a7999a73-3404-4e9d-9f3c-bd09ddc84d4c tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:46.715685 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-a7999a73-3404-4e9d-9f3c-bd09ddc84d4c tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] HTTP exception thrown: Instance ce5bd643-ecf0-4e74-a49a-98d6469cebeb could not be found. Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a7999a73-3404-4e9d-9f3c-bd09ddc84d4c tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Request method failure captured: Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb HTTP/1.1 Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGfbsJuXh5kVcekDAsjAkECaPmetXlgETtp9sPX-Xr-70c-XWhTrvhqnFbz8hZkq7Clfl9t9CDyP2KtBBmEE1DsOgzCiFucYxG-1VO81Egq33Az2HMXE7uozcnmy0QNEGTbGluSrocXS2nZTSKgmMb13Bm5ogn_VUuwyipCdQUKRcws Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: e0acb7593db24b07af194c4eba251cff Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-VolumesNegativeTest-1011365148 Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e0acb7593db24b07af194c4eba251cff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e0acb7593db24b07af194c4eba251cff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e0acb7593db24b07af194c4eba251cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e0acb7593db24b07af194c4eba251cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-VolumesNegativeTest-1011365148 Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: e0acb7593db24b07af194c4eba251cff Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-VolumesNegativeTest-1011365148 Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-VolumesNegativeTest-1011365148-project Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: dc5289b306fb4e2e9c42564336ade23a Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-VolumesNegativeTest-1011365148-project Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: exception: Instance ce5bd643-ecf0-4e74-a49a-98d6469cebeb could not be found. Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'ce5bd643-ecf0-4e74-a49a-98d6469cebeb'} Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce5bd643-ecf0-4e74-a49a-98d6469cebeb could not be found. Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce5bd643-ecf0-4e74-a49a-98d6469cebeb could not be found. Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:28:46.726467 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:28:46.731050 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:28:46.731050 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:28:46.731050 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:28:46.731050 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:28:46.731050 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:28:46.731050 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce5bd643-ecf0-4e74-a49a-98d6469cebeb could not be found. Jun 20 12:28:46.731050 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:28:46.735698 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a7999a73-3404-4e9d-9f3c-bd09ddc84d4c tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] Returning 404 to user: Instance ce5bd643-ecf0-4e74-a49a-98d6469cebeb could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:28:46.736800 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a7999a73-3404-4e9d-9f3c-bd09ddc84d4c tempest-VolumesNegativeTest-1011365148 tempest-VolumesNegativeTest-1011365148-project] 10.222.0.27 "GET /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb" status: 404 len: 111 microversion: 2.1 time: 0.078713 Jun 20 12:28:46.737976 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2897/5688] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:46 2022] GET /compute/v2.1/servers/ce5bd643-ecf0-4e74-a49a-98d6469cebeb => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:28:47.369007 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-18ba58fb-9b57-4220-9aa8-dee470fc45dc tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:47.369637 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-18ba58fb-9b57-4220-9aa8-dee470fc45dc tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 3d7404de-1c0e-483f-b496-722b0a7cdd57] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:47.371735 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=4 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:47.381106 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-18ba58fb-9b57-4220-9aa8-dee470fc45dc tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:47.385163 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-18ba58fb-9b57-4220-9aa8-dee470fc45dc tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:47.387111 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-18ba58fb-9b57-4220-9aa8-dee470fc45dc tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:47.391511 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-18ba58fb-9b57-4220-9aa8-dee470fc45dc tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:47.704078 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8b068ef3-79b7-4751-8861-cd6f8edd7a5e tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:47.704758 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8b068ef3-79b7-4751-8861-cd6f8edd7a5e tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] [instance: 0059d853-f820-4e39-953c-133a05c6380e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:47.742623 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b068ef3-79b7-4751-8861-cd6f8edd7a5e tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:47.743569 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b068ef3-79b7-4751-8861-cd6f8edd7a5e tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:47.748760 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b068ef3-79b7-4751-8861-cd6f8edd7a5e tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:47.752458 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b068ef3-79b7-4751-8861-cd6f8edd7a5e tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:47.902280 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8b068ef3-79b7-4751-8861-cd6f8edd7a5e tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490f46fb1a147dfa995d8fe278fe971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4136a79e71ec4e78803ac418f2445ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:47.918874 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8b068ef3-79b7-4751-8861-cd6f8edd7a5e tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] 10.222.0.27 "GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e" status: 200 len: 1359 microversion: 2.1 time: 0.221570 Jun 20 12:28:47.921526 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2898/5689] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:47 2022] GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e => generated 1359 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:48.227395 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-18ba58fb-9b57-4220-9aa8-dee470fc45dc tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:48.268651 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-18ba58fb-9b57-4220-9aa8-dee470fc45dc tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57" status: 200 len: 1309 microversion: 2.1 time: 0.904777 Jun 20 12:28:48.269989 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2792/5690] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:47 2022] GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57 => generated 1309 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:48.939382 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9dbd47c8-e459-4415-bf59-2147085fb766 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:48.940871 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9dbd47c8-e459-4415-bf59-2147085fb766 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] [instance: 0059d853-f820-4e39-953c-133a05c6380e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:48.968580 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9dbd47c8-e459-4415-bf59-2147085fb766 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:48.969570 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9dbd47c8-e459-4415-bf59-2147085fb766 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:48.973583 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9dbd47c8-e459-4415-bf59-2147085fb766 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:48.974208 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9dbd47c8-e459-4415-bf59-2147085fb766 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:49.287020 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cf5f91ef-1fbe-4c6a-943b-a7a39301f7a6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:49.287786 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cf5f91ef-1fbe-4c6a-943b-a7a39301f7a6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 3d7404de-1c0e-483f-b496-722b0a7cdd57] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:49.308332 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cf5f91ef-1fbe-4c6a-943b-a7a39301f7a6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:49.312575 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cf5f91ef-1fbe-4c6a-943b-a7a39301f7a6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:49.316853 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cf5f91ef-1fbe-4c6a-943b-a7a39301f7a6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:49.320673 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cf5f91ef-1fbe-4c6a-943b-a7a39301f7a6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:49.426255 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9dbd47c8-e459-4415-bf59-2147085fb766 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490f46fb1a147dfa995d8fe278fe971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4136a79e71ec4e78803ac418f2445ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:49.440757 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9dbd47c8-e459-4415-bf59-2147085fb766 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] 10.222.0.27 "GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e" status: 200 len: 1426 microversion: 2.1 time: 0.505356 Jun 20 12:28:49.449979 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2899/5691] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:48 2022] GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e => generated 1426 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:50.461188 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-76fde83f-cdca-4a15-ae0a-097f2f3b44af tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:50.465376 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-76fde83f-cdca-4a15-ae0a-097f2f3b44af tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] [instance: 0059d853-f820-4e39-953c-133a05c6380e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:50.493430 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-76fde83f-cdca-4a15-ae0a-097f2f3b44af tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:50.494331 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-76fde83f-cdca-4a15-ae0a-097f2f3b44af tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:50.497013 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-76fde83f-cdca-4a15-ae0a-097f2f3b44af tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:50.497679 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-76fde83f-cdca-4a15-ae0a-097f2f3b44af tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:50.897124 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-cf5f91ef-1fbe-4c6a-943b-a7a39301f7a6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:50.908704 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cf5f91ef-1fbe-4c6a-943b-a7a39301f7a6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57" status: 200 len: 1309 microversion: 2.1 time: 1.626423 Jun 20 12:28:50.909313 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2793/5692] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:49 2022] GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57 => generated 1309 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:28:50.992086 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-76fde83f-cdca-4a15-ae0a-097f2f3b44af tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490f46fb1a147dfa995d8fe278fe971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4136a79e71ec4e78803ac418f2445ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:51.027025 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-76fde83f-cdca-4a15-ae0a-097f2f3b44af tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] 10.222.0.27 "GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e" status: 200 len: 1426 microversion: 2.1 time: 0.570682 Jun 20 12:28:51.028481 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2900/5693] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:50 2022] GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e => generated 1426 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:51.926918 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8fbcc034-b91f-49bd-954c-812d5d474d2b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:51.928295 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8fbcc034-b91f-49bd-954c-812d5d474d2b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 3d7404de-1c0e-483f-b496-722b0a7cdd57] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:51.954103 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8fbcc034-b91f-49bd-954c-812d5d474d2b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:51.956476 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8fbcc034-b91f-49bd-954c-812d5d474d2b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:51.958145 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8fbcc034-b91f-49bd-954c-812d5d474d2b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:51.961098 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8fbcc034-b91f-49bd-954c-812d5d474d2b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:52.059491 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3764f391-a13e-4bba-89e9-01309daa6c9b tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:52.060166 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3764f391-a13e-4bba-89e9-01309daa6c9b tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] [instance: 0059d853-f820-4e39-953c-133a05c6380e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:52.082410 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3764f391-a13e-4bba-89e9-01309daa6c9b tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:52.082803 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3764f391-a13e-4bba-89e9-01309daa6c9b tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:52.085352 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3764f391-a13e-4bba-89e9-01309daa6c9b tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:52.087828 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3764f391-a13e-4bba-89e9-01309daa6c9b tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:52.500271 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8fbcc034-b91f-49bd-954c-812d5d474d2b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:52.521123 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8fbcc034-b91f-49bd-954c-812d5d474d2b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57" status: 200 len: 1309 microversion: 2.1 time: 0.598068 Jun 20 12:28:52.527777 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2794/5694] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:51 2022] GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57 => generated 1309 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:52.566759 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-59a1f750-6af3-4cbd-aa29-8a3d58ff2be3 req-37270274-aa42-44d3-b96c-6775c222b017 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d7404de-1c0e-483f-b496-722b0a7cdd57", "tag": "ec2e0f6a-a89f-4516-ae4b-08e2fb42ffbd"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:28:52.599239 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-59a1f750-6af3-4cbd-aa29-8a3d58ff2be3 req-37270274-aa42-44d3-b96c-6775c222b017 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:52.600991 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-59a1f750-6af3-4cbd-aa29-8a3d58ff2be3 req-37270274-aa42-44d3-b96c-6775c222b017 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:52.656614 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-59a1f750-6af3-4cbd-aa29-8a3d58ff2be3 req-37270274-aa42-44d3-b96c-6775c222b017 service nova] Creating event network-changed:ec2e0f6a-a89f-4516-ae4b-08e2fb42ffbd for instance 3d7404de-1c0e-483f-b496-722b0a7cdd57 on n-h2-master-1 Jun 20 12:28:52.671797 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-59a1f750-6af3-4cbd-aa29-8a3d58ff2be3 req-37270274-aa42-44d3-b96c-6775c222b017 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108877 Jun 20 12:28:52.674213 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2795/5695] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:28:53.539951 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2dcc2529-8f00-4ff9-bb38-686b2803747d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:53.541454 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2dcc2529-8f00-4ff9-bb38-686b2803747d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 3d7404de-1c0e-483f-b496-722b0a7cdd57] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:53.554436 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2dcc2529-8f00-4ff9-bb38-686b2803747d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:53.555546 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2dcc2529-8f00-4ff9-bb38-686b2803747d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:53.560916 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2dcc2529-8f00-4ff9-bb38-686b2803747d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:53.561603 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2dcc2529-8f00-4ff9-bb38-686b2803747d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:54.039281 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3764f391-a13e-4bba-89e9-01309daa6c9b tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490f46fb1a147dfa995d8fe278fe971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4136a79e71ec4e78803ac418f2445ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:54.055593 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3764f391-a13e-4bba-89e9-01309daa6c9b tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] 10.222.0.27 "GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e" status: 200 len: 1426 microversion: 2.1 time: 2.000873 Jun 20 12:28:54.061672 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2901/5696] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:52 2022] GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e => generated 1426 bytes in 2008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:54.246681 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2dcc2529-8f00-4ff9-bb38-686b2803747d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:54.253903 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-12420259-04b1-44cc-8afc-0ca05e4ecbaf tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:54.257627 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-12420259-04b1-44cc-8afc-0ca05e4ecbaf tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] [instance: 82d76221-bbcd-4dc7-a09b-e3b45088b4d0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:54.283196 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2dcc2529-8f00-4ff9-bb38-686b2803747d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57" status: 200 len: 1309 microversion: 2.1 time: 0.748519 Jun 20 12:28:54.297474 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2796/5697] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:53 2022] GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57 => generated 1309 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:54.300126 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-12420259-04b1-44cc-8afc-0ca05e4ecbaf tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:54.300996 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-12420259-04b1-44cc-8afc-0ca05e4ecbaf tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:54.302257 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-12420259-04b1-44cc-8afc-0ca05e4ecbaf tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:54.303001 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-12420259-04b1-44cc-8afc-0ca05e4ecbaf tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:54.376167 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-12420259-04b1-44cc-8afc-0ca05e4ecbaf tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] [instance: 82d76221-bbcd-4dc7-a09b-e3b45088b4d0] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:28:54.595625 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-12420259-04b1-44cc-8afc-0ca05e4ecbaf tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] 10.222.0.27 "DELETE /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0" status: 204 len: 0 microversion: 2.1 time: 0.363881 Jun 20 12:28:54.596916 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2902/5698] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:28:54 2022] DELETE /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:28:54.607637 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8426f85c-ced3-447f-abfb-4cb8a141287f tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:54.611229 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8426f85c-ced3-447f-abfb-4cb8a141287f tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] [instance: 82d76221-bbcd-4dc7-a09b-e3b45088b4d0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:54.627885 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8426f85c-ced3-447f-abfb-4cb8a141287f tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:54.628738 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8426f85c-ced3-447f-abfb-4cb8a141287f tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:54.629733 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8426f85c-ced3-447f-abfb-4cb8a141287f tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:54.632688 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8426f85c-ced3-447f-abfb-4cb8a141287f tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:54.829525 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-ab8b55f0-b1d2-43a3-80cd-b06fd95ffa78 req-de30e6ee-d52b-4e37-a0c5-1b0dd7c0267a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0059d853-f820-4e39-953c-133a05c6380e", "tag": "7e555620-532f-4308-8bf3-543e1513fdb0"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:28:54.838588 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=4 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:54.857109 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ab8b55f0-b1d2-43a3-80cd-b06fd95ffa78 req-de30e6ee-d52b-4e37-a0c5-1b0dd7c0267a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:54.865587 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ab8b55f0-b1d2-43a3-80cd-b06fd95ffa78 req-de30e6ee-d52b-4e37-a0c5-1b0dd7c0267a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:54.906006 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-ab8b55f0-b1d2-43a3-80cd-b06fd95ffa78 req-de30e6ee-d52b-4e37-a0c5-1b0dd7c0267a service nova] Creating event network-changed:7e555620-532f-4308-8bf3-543e1513fdb0 for instance 0059d853-f820-4e39-953c-133a05c6380e on n-h1-master-1 Jun 20 12:28:54.919232 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-ab8b55f0-b1d2-43a3-80cd-b06fd95ffa78 req-de30e6ee-d52b-4e37-a0c5-1b0dd7c0267a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095485 Jun 20 12:28:54.920540 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2903/5699] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:28:55.078507 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-21a8f0ba-c462-43db-a19a-7dd4c4d640c9 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:55.079335 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-21a8f0ba-c462-43db-a19a-7dd4c4d640c9 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] [instance: 0059d853-f820-4e39-953c-133a05c6380e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:55.088529 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8426f85c-ced3-447f-abfb-4cb8a141287f tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee3168402f24c0481fbe0275cebbdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeedf38e938b4fd39ccfbf50436bb6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:55.099147 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21a8f0ba-c462-43db-a19a-7dd4c4d640c9 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:55.102120 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21a8f0ba-c462-43db-a19a-7dd4c4d640c9 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:55.103531 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21a8f0ba-c462-43db-a19a-7dd4c4d640c9 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:55.107289 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21a8f0ba-c462-43db-a19a-7dd4c4d640c9 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:55.112500 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8426f85c-ced3-447f-abfb-4cb8a141287f tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] 10.222.0.27 "GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0" status: 200 len: 1469 microversion: 2.1 time: 0.510273 Jun 20 12:28:55.113379 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2797/5700] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:54 2022] GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0 => generated 1469 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:55.315743 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c4864d6e-7a68-415a-8c6d-9da0198e8aa4 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:55.316999 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c4864d6e-7a68-415a-8c6d-9da0198e8aa4 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 3d7404de-1c0e-483f-b496-722b0a7cdd57] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:55.329327 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4864d6e-7a68-415a-8c6d-9da0198e8aa4 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:55.330393 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4864d6e-7a68-415a-8c6d-9da0198e8aa4 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:55.332897 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4864d6e-7a68-415a-8c6d-9da0198e8aa4 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:55.334326 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4864d6e-7a68-415a-8c6d-9da0198e8aa4 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:55.349241 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=20 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:55.607835 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c4864d6e-7a68-415a-8c6d-9da0198e8aa4 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:55.617043 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c4864d6e-7a68-415a-8c6d-9da0198e8aa4 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57" status: 200 len: 1309 microversion: 2.1 time: 0.305960 Jun 20 12:28:55.625659 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2798/5701] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:55 2022] GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57 => generated 1309 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:28:55.695468 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-21a8f0ba-c462-43db-a19a-7dd4c4d640c9 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490f46fb1a147dfa995d8fe278fe971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4136a79e71ec4e78803ac418f2445ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:55.708927 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-21a8f0ba-c462-43db-a19a-7dd4c4d640c9 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] 10.222.0.27 "GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e" status: 200 len: 1426 microversion: 2.1 time: 0.635002 Jun 20 12:28:55.709545 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2904/5702] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:55 2022] GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e => generated 1426 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:28:56.133124 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-13bab3f0-7942-4980-97a5-39e83de9d7a6 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:56.134675 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-13bab3f0-7942-4980-97a5-39e83de9d7a6 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] [instance: 82d76221-bbcd-4dc7-a09b-e3b45088b4d0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:56.182102 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13bab3f0-7942-4980-97a5-39e83de9d7a6 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:56.183371 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13bab3f0-7942-4980-97a5-39e83de9d7a6 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:56.188284 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13bab3f0-7942-4980-97a5-39e83de9d7a6 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:56.193818 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13bab3f0-7942-4980-97a5-39e83de9d7a6 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:56.637459 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-44ea14f6-a0e6-49d7-aef3-ba264c4051ed tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:56.638664 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-44ea14f6-a0e6-49d7-aef3-ba264c4051ed tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 3d7404de-1c0e-483f-b496-722b0a7cdd57] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:56.687682 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-44ea14f6-a0e6-49d7-aef3-ba264c4051ed tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:56.694206 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-44ea14f6-a0e6-49d7-aef3-ba264c4051ed tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:56.698378 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-44ea14f6-a0e6-49d7-aef3-ba264c4051ed tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:56.699681 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-44ea14f6-a0e6-49d7-aef3-ba264c4051ed tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:56.816084 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-13bab3f0-7942-4980-97a5-39e83de9d7a6 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee3168402f24c0481fbe0275cebbdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeedf38e938b4fd39ccfbf50436bb6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:56.825858 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-13bab3f0-7942-4980-97a5-39e83de9d7a6 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] 10.222.0.27 "GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0" status: 200 len: 1469 microversion: 2.1 time: 0.699155 Jun 20 12:28:56.832290 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2799/5703] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:56 2022] GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0 => generated 1469 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:56.842303 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9711ef4d-094f-4adf-8ef4-db13fe954edc tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:56.850419 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9711ef4d-094f-4adf-8ef4-db13fe954edc tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] [instance: 0059d853-f820-4e39-953c-133a05c6380e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:56.872233 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9711ef4d-094f-4adf-8ef4-db13fe954edc tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:56.872815 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9711ef4d-094f-4adf-8ef4-db13fe954edc tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:56.873712 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9711ef4d-094f-4adf-8ef4-db13fe954edc tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:56.874240 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9711ef4d-094f-4adf-8ef4-db13fe954edc tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:57.513085 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9711ef4d-094f-4adf-8ef4-db13fe954edc tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490f46fb1a147dfa995d8fe278fe971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4136a79e71ec4e78803ac418f2445ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:57.524225 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9711ef4d-094f-4adf-8ef4-db13fe954edc tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] 10.222.0.27 "GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e" status: 200 len: 1426 microversion: 2.1 time: 0.690377 Jun 20 12:28:57.528600 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2800/5704] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:56 2022] GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e => generated 1426 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:57.851908 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-93551ab5-7ca5-47ca-b5cd-3186ccc48b4e tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:57.851908 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-93551ab5-7ca5-47ca-b5cd-3186ccc48b4e tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] [instance: 82d76221-bbcd-4dc7-a09b-e3b45088b4d0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:57.871824 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-93551ab5-7ca5-47ca-b5cd-3186ccc48b4e tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:57.872320 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-93551ab5-7ca5-47ca-b5cd-3186ccc48b4e tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:57.873121 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-93551ab5-7ca5-47ca-b5cd-3186ccc48b4e tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:57.873562 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-93551ab5-7ca5-47ca-b5cd-3186ccc48b4e tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:57.938081 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-44ea14f6-a0e6-49d7-aef3-ba264c4051ed tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:57.961967 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-44ea14f6-a0e6-49d7-aef3-ba264c4051ed tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57" status: 200 len: 1309 microversion: 2.1 time: 1.330634 Jun 20 12:28:57.969734 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2905/5705] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:56 2022] GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57 => generated 1309 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:58.489437 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-93551ab5-7ca5-47ca-b5cd-3186ccc48b4e tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee3168402f24c0481fbe0275cebbdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeedf38e938b4fd39ccfbf50436bb6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:58.504626 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-93551ab5-7ca5-47ca-b5cd-3186ccc48b4e tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] 10.222.0.27 "GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0" status: 200 len: 1469 microversion: 2.1 time: 0.658507 Jun 20 12:28:58.523749 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2801/5706] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:57 2022] GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0 => generated 1469 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:58.544649 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4193950d-0937-4d84-b39b-419c28268bea tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:58.547754 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4193950d-0937-4d84-b39b-419c28268bea tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] [instance: 0059d853-f820-4e39-953c-133a05c6380e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:58.562913 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4193950d-0937-4d84-b39b-419c28268bea tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:58.571743 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4193950d-0937-4d84-b39b-419c28268bea tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:58.574349 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4193950d-0937-4d84-b39b-419c28268bea tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:58.576735 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4193950d-0937-4d84-b39b-419c28268bea tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:58.989108 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6c045378-ce9a-4559-9cd7-dd666c72ce8f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:58.989940 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6c045378-ce9a-4559-9cd7-dd666c72ce8f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 3d7404de-1c0e-483f-b496-722b0a7cdd57] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:59.003502 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6c045378-ce9a-4559-9cd7-dd666c72ce8f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:59.015805 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6c045378-ce9a-4559-9cd7-dd666c72ce8f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:59.033212 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6c045378-ce9a-4559-9cd7-dd666c72ce8f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:59.036547 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6c045378-ce9a-4559-9cd7-dd666c72ce8f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:59.240458 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6c045378-ce9a-4559-9cd7-dd666c72ce8f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:59.249878 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6c045378-ce9a-4559-9cd7-dd666c72ce8f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57" status: 200 len: 1309 microversion: 2.1 time: 0.267709 Jun 20 12:28:59.260289 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2802/5707] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:58 2022] GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57 => generated 1309 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:28:59.414842 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4193950d-0937-4d84-b39b-419c28268bea tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490f46fb1a147dfa995d8fe278fe971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4136a79e71ec4e78803ac418f2445ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:59.431857 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4193950d-0937-4d84-b39b-419c28268bea tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] 10.222.0.27 "GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e" status: 200 len: 1426 microversion: 2.1 time: 0.891974 Jun 20 12:28:59.433141 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2906/5708] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:58 2022] GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e => generated 1426 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:59.529959 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-03db7e44-ca9c-4f0d-b313-49f03edae908 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:59.530852 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-03db7e44-ca9c-4f0d-b313-49f03edae908 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] [instance: 82d76221-bbcd-4dc7-a09b-e3b45088b4d0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:59.544142 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-03db7e44-ca9c-4f0d-b313-49f03edae908 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:59.544859 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-03db7e44-ca9c-4f0d-b313-49f03edae908 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:59.546614 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-03db7e44-ca9c-4f0d-b313-49f03edae908 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:59.550715 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-03db7e44-ca9c-4f0d-b313-49f03edae908 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:59.940497 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-03db7e44-ca9c-4f0d-b313-49f03edae908 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee3168402f24c0481fbe0275cebbdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeedf38e938b4fd39ccfbf50436bb6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:59.954477 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-03db7e44-ca9c-4f0d-b313-49f03edae908 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] 10.222.0.27 "GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0" status: 200 len: 1469 microversion: 2.1 time: 0.432509 Jun 20 12:28:59.954754 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2803/5709] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:59 2022] GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0 => generated 1469 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:00.268493 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0e6734d8-9f22-4eb2-90f3-b1e0c4c4ff30 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:00.269190 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0e6734d8-9f22-4eb2-90f3-b1e0c4c4ff30 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 3d7404de-1c0e-483f-b496-722b0a7cdd57] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:00.295511 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0e6734d8-9f22-4eb2-90f3-b1e0c4c4ff30 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:00.300226 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0e6734d8-9f22-4eb2-90f3-b1e0c4c4ff30 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:00.306532 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0e6734d8-9f22-4eb2-90f3-b1e0c4c4ff30 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:00.307056 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0e6734d8-9f22-4eb2-90f3-b1e0c4c4ff30 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:00.451270 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0e22736c-33dd-4bd6-91ba-07a7b163f933 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:00.452049 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0e22736c-33dd-4bd6-91ba-07a7b163f933 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] [instance: 0059d853-f820-4e39-953c-133a05c6380e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:00.468178 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0e22736c-33dd-4bd6-91ba-07a7b163f933 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:00.468791 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0e22736c-33dd-4bd6-91ba-07a7b163f933 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:00.470078 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0e22736c-33dd-4bd6-91ba-07a7b163f933 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:00.470683 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0e22736c-33dd-4bd6-91ba-07a7b163f933 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:00.955589 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0e6734d8-9f22-4eb2-90f3-b1e0c4c4ff30 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:00.982774 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0e6734d8-9f22-4eb2-90f3-b1e0c4c4ff30 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57" status: 200 len: 1309 microversion: 2.1 time: 0.717341 Jun 20 12:29:00.999390 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2907/5710] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:00 2022] GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57 => generated 1309 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:01.021240 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-607a1b38-e323-42eb-acc5-a03c829c9215 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:01.022142 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-607a1b38-e323-42eb-acc5-a03c829c9215 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] [instance: 82d76221-bbcd-4dc7-a09b-e3b45088b4d0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:01.038419 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-607a1b38-e323-42eb-acc5-a03c829c9215 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:01.040148 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-607a1b38-e323-42eb-acc5-a03c829c9215 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:01.043677 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-607a1b38-e323-42eb-acc5-a03c829c9215 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:01.044189 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-607a1b38-e323-42eb-acc5-a03c829c9215 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:01.229671 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-607a1b38-e323-42eb-acc5-a03c829c9215 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee3168402f24c0481fbe0275cebbdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeedf38e938b4fd39ccfbf50436bb6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:01.251263 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-607a1b38-e323-42eb-acc5-a03c829c9215 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] 10.222.0.27 "GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0" status: 200 len: 1298 microversion: 2.1 time: 0.249876 Jun 20 12:29:01.265258 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2908/5711] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:01 2022] GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0 => generated 1298 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:01.287925 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-d27535a6-a67a-4d95-ab43-0d4e47e9a3fb req-a717b466-cee1-4b4b-b5b4-c1b6b38f5d92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82d76221-bbcd-4dc7-a09b-e3b45088b4d0", "name": "network-vif-deleted", "tag": "bfaf47ed-1d6d-4b0c-b280-52909fc62108"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:01.332215 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-d27535a6-a67a-4d95-ab43-0d4e47e9a3fb req-a717b466-cee1-4b4b-b5b4-c1b6b38f5d92 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:01.341577 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-d27535a6-a67a-4d95-ab43-0d4e47e9a3fb req-a717b466-cee1-4b4b-b5b4-c1b6b38f5d92 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:01.362263 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-d27535a6-a67a-4d95-ab43-0d4e47e9a3fb req-a717b466-cee1-4b4b-b5b4-c1b6b38f5d92 service nova] Creating event network-vif-deleted:bfaf47ed-1d6d-4b0c-b280-52909fc62108 for instance 82d76221-bbcd-4dc7-a09b-e3b45088b4d0 on n-h2-master-1 Jun 20 12:29:01.380722 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-d27535a6-a67a-4d95-ab43-0d4e47e9a3fb req-a717b466-cee1-4b4b-b5b4-c1b6b38f5d92 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105489 Jun 20 12:29:01.383775 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2909/5712] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:29:01.755173 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0e22736c-33dd-4bd6-91ba-07a7b163f933 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490f46fb1a147dfa995d8fe278fe971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4136a79e71ec4e78803ac418f2445ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:01.759434 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:01.778552 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0e22736c-33dd-4bd6-91ba-07a7b163f933 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] 10.222.0.27 "GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e" status: 200 len: 1426 microversion: 2.1 time: 1.333339 Jun 20 12:29:01.781554 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2804/5713] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:00 2022] GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e => generated 1426 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:02.017478 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b84254da-3f0f-4eaf-bd5b-32bba149ce59 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:02.024836 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b84254da-3f0f-4eaf-bd5b-32bba149ce59 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 3d7404de-1c0e-483f-b496-722b0a7cdd57] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:02.050811 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b84254da-3f0f-4eaf-bd5b-32bba149ce59 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:02.054547 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b84254da-3f0f-4eaf-bd5b-32bba149ce59 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:02.056844 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b84254da-3f0f-4eaf-bd5b-32bba149ce59 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:02.058317 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b84254da-3f0f-4eaf-bd5b-32bba149ce59 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:02.282831 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b158527b-403c-49eb-9c3d-818138051565 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:02.283889 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b158527b-403c-49eb-9c3d-818138051565 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] [instance: 82d76221-bbcd-4dc7-a09b-e3b45088b4d0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:02.286421 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:02.301143 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b158527b-403c-49eb-9c3d-818138051565 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:02.302135 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b158527b-403c-49eb-9c3d-818138051565 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:02.303797 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b158527b-403c-49eb-9c3d-818138051565 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:02.306033 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b158527b-403c-49eb-9c3d-818138051565 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:02.348142 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-b158527b-403c-49eb-9c3d-818138051565 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] HTTP exception thrown: Instance 82d76221-bbcd-4dc7-a09b-e3b45088b4d0 could not be found. Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b158527b-403c-49eb-9c3d-818138051565 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Request method failure captured: Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0 HTTP/1.1 Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGdLa6R2wlN3NFU_Eqk3MV-Lq9THAswXthJmSYVh8vmkmohEEsvSfrU8KyT0wwy_C-uKTBh8NEx-rVjjgnRGdLz_o1tKr6X4n9qVFf_iI_pwaPDxMABProxY4c7LkWZsW5HtsZtFUQdagnnbgd31y-RujTvDpDgkDlF9tZ9DrHaELNo Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: eeedf38e938b4fd39ccfbf50436bb6ab Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-VolumesBackupsTest-770670330 Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eeedf38e938b4fd39ccfbf50436bb6ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eeedf38e938b4fd39ccfbf50436bb6ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eeedf38e938b4fd39ccfbf50436bb6ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eeedf38e938b4fd39ccfbf50436bb6ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-VolumesBackupsTest-770670330 Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: eeedf38e938b4fd39ccfbf50436bb6ab Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-VolumesBackupsTest-770670330 Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-VolumesBackupsTest-770670330-project Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 3ee3168402f24c0481fbe0275cebbdc3 Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-VolumesBackupsTest-770670330-project Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 82d76221-bbcd-4dc7-a09b-e3b45088b4d0 could not be found. Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '82d76221-bbcd-4dc7-a09b-e3b45088b4d0'} Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82d76221-bbcd-4dc7-a09b-e3b45088b4d0 could not be found. Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82d76221-bbcd-4dc7-a09b-e3b45088b4d0 could not be found. Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:02.351337 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:29:02.357334 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:02.357334 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:29:02.357334 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:29:02.357334 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:29:02.357334 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:29:02.357334 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82d76221-bbcd-4dc7-a09b-e3b45088b4d0 could not be found. Jun 20 12:29:02.357334 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:29:02.359736 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b158527b-403c-49eb-9c3d-818138051565 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] Returning 404 to user: Instance 82d76221-bbcd-4dc7-a09b-e3b45088b4d0 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:29:02.362453 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b158527b-403c-49eb-9c3d-818138051565 tempest-VolumesBackupsTest-770670330 tempest-VolumesBackupsTest-770670330-project] 10.222.0.27 "GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0" status: 404 len: 111 microversion: 2.1 time: 0.083959 Jun 20 12:29:02.364611 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2805/5714] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:02 2022] GET /compute/v2.1/servers/82d76221-bbcd-4dc7-a09b-e3b45088b4d0 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:29:02.798841 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-846c0ebd-4418-4591-80bd-7f040c884dd7 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:02.799596 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-846c0ebd-4418-4591-80bd-7f040c884dd7 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] [instance: 0059d853-f820-4e39-953c-133a05c6380e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:02.814118 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-846c0ebd-4418-4591-80bd-7f040c884dd7 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:02.814733 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-846c0ebd-4418-4591-80bd-7f040c884dd7 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:02.815936 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-846c0ebd-4418-4591-80bd-7f040c884dd7 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:02.816563 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-846c0ebd-4418-4591-80bd-7f040c884dd7 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:02.942710 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b84254da-3f0f-4eaf-bd5b-32bba149ce59 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:02.958045 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b84254da-3f0f-4eaf-bd5b-32bba149ce59 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57" status: 200 len: 1309 microversion: 2.1 time: 0.957361 Jun 20 12:29:02.959772 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2910/5715] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:01 2022] GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57 => generated 1309 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:03.374669 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-5cf8b2c5-837a-4538-8f86-dc1a9f7d41a2 req-271c1b8c-8846-43d1-b013-338a2590e563 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d7404de-1c0e-483f-b496-722b0a7cdd57", "name": "network-vif-plugged", "status": "completed", "tag": "ec2e0f6a-a89f-4516-ae4b-08e2fb42ffbd"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:03.418340 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-5cf8b2c5-837a-4538-8f86-dc1a9f7d41a2 req-271c1b8c-8846-43d1-b013-338a2590e563 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:03.418931 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-5cf8b2c5-837a-4538-8f86-dc1a9f7d41a2 req-271c1b8c-8846-43d1-b013-338a2590e563 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:03.478242 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-5cf8b2c5-837a-4538-8f86-dc1a9f7d41a2 req-271c1b8c-8846-43d1-b013-338a2590e563 service nova] Creating event network-vif-plugged:ec2e0f6a-a89f-4516-ae4b-08e2fb42ffbd for instance 3d7404de-1c0e-483f-b496-722b0a7cdd57 on n-h2-master-1 Jun 20 12:29:03.485999 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-5cf8b2c5-837a-4538-8f86-dc1a9f7d41a2 req-271c1b8c-8846-43d1-b013-338a2590e563 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114945 Jun 20 12:29:03.497940 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2911/5716] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:29:03.679601 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-846c0ebd-4418-4591-80bd-7f040c884dd7 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490f46fb1a147dfa995d8fe278fe971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4136a79e71ec4e78803ac418f2445ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:03.698459 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-846c0ebd-4418-4591-80bd-7f040c884dd7 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] 10.222.0.27 "GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e" status: 200 len: 1426 microversion: 2.1 time: 0.904513 Jun 20 12:29:03.704570 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2806/5717] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:02 2022] GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e => generated 1426 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:03.978007 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fc45dc49-fec5-4cd6-bef8-b69baf16994b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:03.978892 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fc45dc49-fec5-4cd6-bef8-b69baf16994b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 3d7404de-1c0e-483f-b496-722b0a7cdd57] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:04.013120 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fc45dc49-fec5-4cd6-bef8-b69baf16994b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:04.013714 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fc45dc49-fec5-4cd6-bef8-b69baf16994b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:04.014775 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fc45dc49-fec5-4cd6-bef8-b69baf16994b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:04.024705 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fc45dc49-fec5-4cd6-bef8-b69baf16994b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:04.048119 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:04.724809 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9d46016c-a9de-43d6-a0e3-0959c3e96edd tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:04.728195 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9d46016c-a9de-43d6-a0e3-0959c3e96edd tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] [instance: 0059d853-f820-4e39-953c-133a05c6380e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:04.751471 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fc45dc49-fec5-4cd6-bef8-b69baf16994b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:04.780163 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fc45dc49-fec5-4cd6-bef8-b69baf16994b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57" status: 200 len: 1309 microversion: 2.1 time: 0.798575 Jun 20 12:29:04.784526 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d46016c-a9de-43d6-a0e3-0959c3e96edd tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:04.789714 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2912/5718] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:03 2022] GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57 => generated 1309 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:04.806446 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d46016c-a9de-43d6-a0e3-0959c3e96edd tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:04.809232 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d46016c-a9de-43d6-a0e3-0959c3e96edd tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:04.820287 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d46016c-a9de-43d6-a0e3-0959c3e96edd tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:05.482820 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9d46016c-a9de-43d6-a0e3-0959c3e96edd tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490f46fb1a147dfa995d8fe278fe971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4136a79e71ec4e78803ac418f2445ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:05.491702 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9d46016c-a9de-43d6-a0e3-0959c3e96edd tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] 10.222.0.27 "GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e" status: 200 len: 1426 microversion: 2.1 time: 0.776300 Jun 20 12:29:05.492330 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2807/5719] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:04 2022] GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e => generated 1426 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:05.803951 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-af91b2b4-7641-453c-a6bb-4b725d3d7059 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:05.812936 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-af91b2b4-7641-453c-a6bb-4b725d3d7059 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 3d7404de-1c0e-483f-b496-722b0a7cdd57] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:05.823885 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-af91b2b4-7641-453c-a6bb-4b725d3d7059 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:05.824392 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-af91b2b4-7641-453c-a6bb-4b725d3d7059 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:05.825204 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-af91b2b4-7641-453c-a6bb-4b725d3d7059 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:05.825644 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-af91b2b4-7641-453c-a6bb-4b725d3d7059 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:06.064041 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-99a4c2b6-b786-42b7-9c5d-797cb790fb60 req-f109c243-d426-4019-98c5-d65b3e8a76e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0059d853-f820-4e39-953c-133a05c6380e", "name": "network-vif-plugged", "status": "completed", "tag": "7e555620-532f-4308-8bf3-543e1513fdb0"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:06.081954 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-99a4c2b6-b786-42b7-9c5d-797cb790fb60 req-f109c243-d426-4019-98c5-d65b3e8a76e1 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:06.082402 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-99a4c2b6-b786-42b7-9c5d-797cb790fb60 req-f109c243-d426-4019-98c5-d65b3e8a76e1 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:06.111182 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-99a4c2b6-b786-42b7-9c5d-797cb790fb60 req-f109c243-d426-4019-98c5-d65b3e8a76e1 service nova] Creating event network-vif-plugged:7e555620-532f-4308-8bf3-543e1513fdb0 for instance 0059d853-f820-4e39-953c-133a05c6380e on n-h1-master-1 Jun 20 12:29:06.127962 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-99a4c2b6-b786-42b7-9c5d-797cb790fb60 req-f109c243-d426-4019-98c5-d65b3e8a76e1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071071 Jun 20 12:29:06.131107 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2808/5720] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jun 20 12:29:06.288184 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-af91b2b4-7641-453c-a6bb-4b725d3d7059 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:06.306687 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-af91b2b4-7641-453c-a6bb-4b725d3d7059 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57" status: 200 len: 1309 microversion: 2.1 time: 0.510211 Jun 20 12:29:06.316520 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2913/5721] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:05 2022] GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57 => generated 1309 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:06.513623 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1f8f8a55-8287-4785-a88c-3297ffa07498 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:06.515075 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1f8f8a55-8287-4785-a88c-3297ffa07498 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] [instance: 0059d853-f820-4e39-953c-133a05c6380e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:06.538738 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f8f8a55-8287-4785-a88c-3297ffa07498 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:06.541204 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f8f8a55-8287-4785-a88c-3297ffa07498 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:06.542445 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f8f8a55-8287-4785-a88c-3297ffa07498 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:06.550254 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f8f8a55-8287-4785-a88c-3297ffa07498 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:06.876131 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1f8f8a55-8287-4785-a88c-3297ffa07498 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490f46fb1a147dfa995d8fe278fe971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4136a79e71ec4e78803ac418f2445ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:06.888235 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1f8f8a55-8287-4785-a88c-3297ffa07498 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] 10.222.0.27 "GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e" status: 200 len: 1426 microversion: 2.1 time: 0.379604 Jun 20 12:29:06.902497 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2809/5722] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:06 2022] GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e => generated 1426 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:07.326169 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e3f12d19-9385-4a55-867b-41f002a1fa89 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:07.326899 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e3f12d19-9385-4a55-867b-41f002a1fa89 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 3d7404de-1c0e-483f-b496-722b0a7cdd57] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:07.347618 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e3f12d19-9385-4a55-867b-41f002a1fa89 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:07.349580 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e3f12d19-9385-4a55-867b-41f002a1fa89 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:07.353382 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e3f12d19-9385-4a55-867b-41f002a1fa89 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:07.357402 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e3f12d19-9385-4a55-867b-41f002a1fa89 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:07.729390 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9432cc8f-9486-4ad8-b0cc-a5ab952a365b tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-217422676", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:07.756319 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e3f12d19-9385-4a55-867b-41f002a1fa89 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:07.784049 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e3f12d19-9385-4a55-867b-41f002a1fa89 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57" status: 200 len: 1490 microversion: 2.1 time: 0.443448 Jun 20 12:29:07.784751 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2810/5723] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:07 2022] GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57 => generated 1490 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:07.842871 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-9432cc8f-9486-4ad8-b0cc-a5ab952a365b tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] validate_networks() for [('b693aa64-194c-48ff-b501-d251e21510b1', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:29:07.910282 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-30d07389-343f-4c97-a829-4135a89754db tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:07.910282 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-30d07389-343f-4c97-a829-4135a89754db tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] [instance: 0059d853-f820-4e39-953c-133a05c6380e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:07.929353 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-30d07389-343f-4c97-a829-4135a89754db tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:07.933655 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-30d07389-343f-4c97-a829-4135a89754db tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:07.937735 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-30d07389-343f-4c97-a829-4135a89754db tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:07.939523 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-30d07389-343f-4c97-a829-4135a89754db tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:08.350841 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-30d07389-343f-4c97-a829-4135a89754db tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490f46fb1a147dfa995d8fe278fe971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4136a79e71ec4e78803ac418f2445ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:08.367495 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-30d07389-343f-4c97-a829-4135a89754db tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] 10.222.0.27 "GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e" status: 200 len: 1606 microversion: 2.1 time: 0.464117 Jun 20 12:29:08.370343 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2811/5724] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:07 2022] GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e => generated 1606 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:29:08.377560 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9fd34e71-2449-4c06-ac2f-02367fb28e02 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1532806581", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "ce2e9d9e-a74d-4fc7-950c-df9300f57b6c"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:08.543051 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-9fd34e71-2449-4c06-ac2f-02367fb28e02 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] validate_networks() for [('ce2e9d9e-a74d-4fc7-950c-df9300f57b6c', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:29:09.139182 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-9432cc8f-9486-4ad8-b0cc-a5ab952a365b tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:29:09.140438 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-9432cc8f-9486-4ad8-b0cc-a5ab952a365b tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:29:09.141366 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-9432cc8f-9486-4ad8-b0cc-a5ab952a365b tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:29:09.142032 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-9432cc8f-9486-4ad8-b0cc-a5ab952a365b tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:29:09.142674 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-9432cc8f-9486-4ad8-b0cc-a5ab952a365b tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:29:09.180268 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9432cc8f-9486-4ad8-b0cc-a5ab952a365b tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:09.184161 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9432cc8f-9486-4ad8-b0cc-a5ab952a365b tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:09.189576 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9432cc8f-9486-4ad8-b0cc-a5ab952a365b tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:09.190457 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9432cc8f-9486-4ad8-b0cc-a5ab952a365b tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:09.266701 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-9432cc8f-9486-4ad8-b0cc-a5ab952a365b tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Getting quotas for project eed49c99a6a64e779184cfde80a29a52. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:29:09.282991 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-9432cc8f-9486-4ad8-b0cc-a5ab952a365b tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Getting quotas for user 8efa417e5eb04ea682201f30b003bd54 and project eed49c99a6a64e779184cfde80a29a52. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:29:09.320748 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9432cc8f-9486-4ad8-b0cc-a5ab952a365b tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:29:09.335087 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9432cc8f-9486-4ad8-b0cc-a5ab952a365b tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 0f46a132-c8ab-41ae-bd97-ec97591f4a4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:29:09.480658 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9432cc8f-9486-4ad8-b0cc-a5ab952a365b tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.206761 Jun 20 12:29:09.484965 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2914/5725] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:29:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 2214 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:29:09.514906 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-11bfc36b-cf5f-4df0-8971-29870d015851 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:09.516721 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-11bfc36b-cf5f-4df0-8971-29870d015851 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] [instance: 0059d853-f820-4e39-953c-133a05c6380e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:09.552807 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11bfc36b-cf5f-4df0-8971-29870d015851 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:09.554133 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11bfc36b-cf5f-4df0-8971-29870d015851 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:09.555357 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11bfc36b-cf5f-4df0-8971-29870d015851 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:09.558112 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11bfc36b-cf5f-4df0-8971-29870d015851 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:10.127307 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-11bfc36b-cf5f-4df0-8971-29870d015851 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490f46fb1a147dfa995d8fe278fe971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4136a79e71ec4e78803ac418f2445ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:10.142407 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-11bfc36b-cf5f-4df0-8971-29870d015851 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] 10.222.0.27 "GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e" status: 200 len: 1606 microversion: 2.1 time: 0.652608 Jun 20 12:29:10.161041 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2915/5726] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:09 2022] GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e => generated 1606 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:10.410477 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-9fd34e71-2449-4c06-ac2f-02367fb28e02 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:29:10.411676 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-9fd34e71-2449-4c06-ac2f-02367fb28e02 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:29:10.412551 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-9fd34e71-2449-4c06-ac2f-02367fb28e02 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:29:10.413145 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-9fd34e71-2449-4c06-ac2f-02367fb28e02 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:29:10.414382 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-9fd34e71-2449-4c06-ac2f-02367fb28e02 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:29:10.427112 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9fd34e71-2449-4c06-ac2f-02367fb28e02 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:10.427980 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9fd34e71-2449-4c06-ac2f-02367fb28e02 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:10.429030 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9fd34e71-2449-4c06-ac2f-02367fb28e02 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:10.429657 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9fd34e71-2449-4c06-ac2f-02367fb28e02 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:10.459915 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-9fd34e71-2449-4c06-ac2f-02367fb28e02 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Getting quotas for project 896c053324b34720a7d0f151bfdc8b10. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:29:10.469595 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-9fd34e71-2449-4c06-ac2f-02367fb28e02 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Getting quotas for user 8878d44956bd42e18f0409534e562ab6 and project 896c053324b34720a7d0f151bfdc8b10. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:29:10.522111 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9fd34e71-2449-4c06-ac2f-02367fb28e02 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:29:10.526339 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9fd34e71-2449-4c06-ac2f-02367fb28e02 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:29:10.698373 n-d-master-1 devstack@n-api.service[119128]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9fd34e71-2449-4c06-ac2f-02367fb28e02 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [697468ca-fab9-4e73-9695-1fc77bc93977] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 20 12:29:10.917346 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2f8c40c8-008c-45ad-9aa8-59851ad2d615 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Action: 'create', calling method: .version_select at 0x7f6073977a60>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1450629429", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7r4ICHs7y9a7pZH2NaT1gaLsQtZGxStpF6927xVLqqxmYxX/Kld3Tcuvtrf9B78prAPeISIZ129v5wzMmYDKWwwA6N/hVpdZOLkFhDrOAsTxtewCsM2WcifOadp4wxbA=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:10.926798 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:10.972587 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-2f8c40c8-008c-45ad-9aa8-59851ad2d615 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Getting quotas for project 06b38619bb2f4b3e92aa9a9d5c5195b9. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:29:10.991511 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-2f8c40c8-008c-45ad-9aa8-59851ad2d615 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Getting quotas for user e653a6be497a469a9064cb754ea47fa7 and project 06b38619bb2f4b3e92aa9a9d5c5195b9. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:29:11.051006 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2f8c40c8-008c-45ad-9aa8-59851ad2d615 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.885883 Jun 20 12:29:11.053164 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2916/5727] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 12:29:10 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:29:11.077108 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-72705c6f-e8de-4197-8162-0cb9671ca503 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:11.083476 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-72705c6f-e8de-4197-8162-0cb9671ca503 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 0f46a132-c8ab-41ae-bd97-ec97591f4a4f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:11.101065 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-72705c6f-e8de-4197-8162-0cb9671ca503 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:11.103169 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-72705c6f-e8de-4197-8162-0cb9671ca503 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:11.105575 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-72705c6f-e8de-4197-8162-0cb9671ca503 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:11.107394 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-72705c6f-e8de-4197-8162-0cb9671ca503 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:11.296796 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-72705c6f-e8de-4197-8162-0cb9671ca503 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:11.317323 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-72705c6f-e8de-4197-8162-0cb9671ca503 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f" status: 200 len: 1225 microversion: 2.1 time: 0.258404 Jun 20 12:29:11.318574 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2917/5728] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:11 2022] GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f => generated 1225 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:11.360554 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-09a93cbe-1658-42e1-9ec0-866342318848 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:11.361346 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-09a93cbe-1658-42e1-9ec0-866342318848 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] [instance: 0059d853-f820-4e39-953c-133a05c6380e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:11.372864 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-09a93cbe-1658-42e1-9ec0-866342318848 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:11.385288 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-09a93cbe-1658-42e1-9ec0-866342318848 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:11.386721 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-09a93cbe-1658-42e1-9ec0-866342318848 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:11.390180 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-09a93cbe-1658-42e1-9ec0-866342318848 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:11.720234 n-d-master-1 devstack@n-api.service[119128]: INFO oslo.messaging._drivers.impl_rabbit [None req-9fd34e71-2449-4c06-ac2f-02367fb28e02 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [697468ca-fab9-4e73-9695-1fc77bc93977] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 51148. Jun 20 12:29:11.733114 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9fd34e71-2449-4c06-ac2f-02367fb28e02 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.359067 Jun 20 12:29:11.746989 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2812/5729] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:29:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 3375 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:29:11.766011 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-93c58967-1915-4990-b922-1fb8fc3e1aa7 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1457108361", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:11.929447 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-09a93cbe-1658-42e1-9ec0-866342318848 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490f46fb1a147dfa995d8fe278fe971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4136a79e71ec4e78803ac418f2445ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:11.954387 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-09a93cbe-1658-42e1-9ec0-866342318848 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] 10.222.0.27 "GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e" status: 200 len: 1606 microversion: 2.1 time: 0.619281 Jun 20 12:29:11.956001 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2918/5730] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:11 2022] GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e => generated 1606 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:11.964370 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-57f4b283-34f9-4cc7-a339-22907c310da2 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:11.970354 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-57f4b283-34f9-4cc7-a339-22907c310da2 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:12.014929 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-93c58967-1915-4990-b922-1fb8fc3e1aa7 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] validate_networks() for [('b693aa64-194c-48ff-b501-d251e21510b1', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:29:12.273173 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-57f4b283-34f9-4cc7-a339-22907c310da2 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:12.318364 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-57f4b283-34f9-4cc7-a339-22907c310da2 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c" status: 200 len: 1209 microversion: 2.1 time: 0.355860 Jun 20 12:29:12.336178 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2919/5731] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:11 2022] GET /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c => generated 1209 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:13.353374 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1ff8c8ce-429b-42be-96a6-5732894ab0b9 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:13.354030 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1ff8c8ce-429b-42be-96a6-5732894ab0b9 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:13.365654 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1ff8c8ce-429b-42be-96a6-5732894ab0b9 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:13.372625 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1ff8c8ce-429b-42be-96a6-5732894ab0b9 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:13.373769 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1ff8c8ce-429b-42be-96a6-5732894ab0b9 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:13.374364 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1ff8c8ce-429b-42be-96a6-5732894ab0b9 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:13.535545 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1ff8c8ce-429b-42be-96a6-5732894ab0b9 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:13.550113 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1ff8c8ce-429b-42be-96a6-5732894ab0b9 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c" status: 200 len: 1205 microversion: 2.1 time: 0.199215 Jun 20 12:29:13.552173 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2920/5732] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:13 2022] GET /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c => generated 1205 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:29:14.569431 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ed93a2a5-32f5-4084-b256-edc9a49af88a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:14.571541 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ed93a2a5-32f5-4084-b256-edc9a49af88a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:14.590465 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ed93a2a5-32f5-4084-b256-edc9a49af88a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:14.591516 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ed93a2a5-32f5-4084-b256-edc9a49af88a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:14.593573 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ed93a2a5-32f5-4084-b256-edc9a49af88a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:14.595600 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ed93a2a5-32f5-4084-b256-edc9a49af88a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:14.828977 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ed93a2a5-32f5-4084-b256-edc9a49af88a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:14.858103 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ed93a2a5-32f5-4084-b256-edc9a49af88a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c" status: 200 len: 1267 microversion: 2.1 time: 0.291408 Jun 20 12:29:14.872223 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2921/5733] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:14 2022] GET /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c => generated 1267 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:15.217904 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-93c58967-1915-4990-b922-1fb8fc3e1aa7 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:29:15.218461 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-93c58967-1915-4990-b922-1fb8fc3e1aa7 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:29:15.219170 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-93c58967-1915-4990-b922-1fb8fc3e1aa7 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:29:15.220556 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-93c58967-1915-4990-b922-1fb8fc3e1aa7 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:29:15.221533 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-93c58967-1915-4990-b922-1fb8fc3e1aa7 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:29:15.254155 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-93c58967-1915-4990-b922-1fb8fc3e1aa7 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:15.256879 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-93c58967-1915-4990-b922-1fb8fc3e1aa7 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:15.259856 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-93c58967-1915-4990-b922-1fb8fc3e1aa7 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:15.261720 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-93c58967-1915-4990-b922-1fb8fc3e1aa7 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:15.368101 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-93c58967-1915-4990-b922-1fb8fc3e1aa7 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Getting quotas for project eed49c99a6a64e779184cfde80a29a52. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:29:15.384836 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-93c58967-1915-4990-b922-1fb8fc3e1aa7 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Getting quotas for user 8efa417e5eb04ea682201f30b003bd54 and project eed49c99a6a64e779184cfde80a29a52. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:29:15.418352 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-93c58967-1915-4990-b922-1fb8fc3e1aa7 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:29:15.421040 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-93c58967-1915-4990-b922-1fb8fc3e1aa7 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:29:15.543848 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-93c58967-1915-4990-b922-1fb8fc3e1aa7 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.795231 Jun 20 12:29:15.557556 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2813/5734] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:29:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 3810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:29:15.567778 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-60b158a0-9be4-4414-980c-72aa834c1ed3 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:15.568431 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-60b158a0-9be4-4414-980c-72aa834c1ed3 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:15.769892 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-60b158a0-9be4-4414-980c-72aa834c1ed3 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:15.777466 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-60b158a0-9be4-4414-980c-72aa834c1ed3 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1222 microversion: 2.1 time: 0.214323 Jun 20 12:29:15.791016 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2922/5735] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:15 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1222 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:15.878949 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-aa4ead30-0bb3-4221-8b72-6d9e2248cc90 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:15.880762 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-aa4ead30-0bb3-4221-8b72-6d9e2248cc90 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:15.911430 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aa4ead30-0bb3-4221-8b72-6d9e2248cc90 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:15.912142 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aa4ead30-0bb3-4221-8b72-6d9e2248cc90 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:15.913653 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aa4ead30-0bb3-4221-8b72-6d9e2248cc90 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:15.914495 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aa4ead30-0bb3-4221-8b72-6d9e2248cc90 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:16.800499 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5613b33a-e643-4550-b582-43912e05f297 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:16.802025 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5613b33a-e643-4550-b582-43912e05f297 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:16.817264 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5613b33a-e643-4550-b582-43912e05f297 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:16.819238 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5613b33a-e643-4550-b582-43912e05f297 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:16.823840 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5613b33a-e643-4550-b582-43912e05f297 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:16.824945 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5613b33a-e643-4550-b582-43912e05f297 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:16.837272 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-aa4ead30-0bb3-4221-8b72-6d9e2248cc90 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:16.851847 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-aa4ead30-0bb3-4221-8b72-6d9e2248cc90 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c" status: 200 len: 1309 microversion: 2.1 time: 0.979102 Jun 20 12:29:16.857226 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2814/5736] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:15 2022] GET /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c => generated 1309 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:17.035657 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5613b33a-e643-4550-b582-43912e05f297 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:17.048560 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5613b33a-e643-4550-b582-43912e05f297 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1226 microversion: 2.1 time: 0.255373 Jun 20 12:29:17.059358 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2923/5737] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:16 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1226 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:17.875782 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4208c635-688e-43e1-8c03-437eaae293dd tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:17.876991 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4208c635-688e-43e1-8c03-437eaae293dd tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:17.890657 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4208c635-688e-43e1-8c03-437eaae293dd tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:17.891120 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4208c635-688e-43e1-8c03-437eaae293dd tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:17.909039 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4208c635-688e-43e1-8c03-437eaae293dd tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:17.909507 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4208c635-688e-43e1-8c03-437eaae293dd tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:18.076147 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ff637434-82b8-40b7-978a-97cb4e078b3a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:18.077560 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ff637434-82b8-40b7-978a-97cb4e078b3a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:18.086691 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff637434-82b8-40b7-978a-97cb4e078b3a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:18.087500 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff637434-82b8-40b7-978a-97cb4e078b3a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:18.088497 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff637434-82b8-40b7-978a-97cb4e078b3a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:18.089102 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff637434-82b8-40b7-978a-97cb4e078b3a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:18.460142 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ff637434-82b8-40b7-978a-97cb4e078b3a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:18.479174 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ff637434-82b8-40b7-978a-97cb4e078b3a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1280 microversion: 2.1 time: 0.407116 Jun 20 12:29:18.484575 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2924/5738] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:18 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1280 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:19.129830 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-9de7f907-74fd-4786-8995-b5c3c66e1096 req-5341c36a-dd9f-4474-ba6e-00bb3baed7ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c", "tag": "d2c7e251-df2f-4340-81de-0231d98ec084"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:19.142735 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-9de7f907-74fd-4786-8995-b5c3c66e1096 req-5341c36a-dd9f-4474-ba6e-00bb3baed7ff service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:19.143664 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-9de7f907-74fd-4786-8995-b5c3c66e1096 req-5341c36a-dd9f-4474-ba6e-00bb3baed7ff service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:19.161948 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-9de7f907-74fd-4786-8995-b5c3c66e1096 req-5341c36a-dd9f-4474-ba6e-00bb3baed7ff service nova] Creating event network-changed:d2c7e251-df2f-4340-81de-0231d98ec084 for instance cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c on n-h2-master-1 Jun 20 12:29:19.194586 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-9de7f907-74fd-4786-8995-b5c3c66e1096 req-5341c36a-dd9f-4474-ba6e-00bb3baed7ff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069824 Jun 20 12:29:19.195904 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2925/5739] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:29:19.499534 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-79ffb985-2d89-484e-b06a-cbcb678891a6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:19.500320 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-79ffb985-2d89-484e-b06a-cbcb678891a6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:19.502401 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:19.534188 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-79ffb985-2d89-484e-b06a-cbcb678891a6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:19.541011 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-79ffb985-2d89-484e-b06a-cbcb678891a6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:19.542721 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-79ffb985-2d89-484e-b06a-cbcb678891a6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:19.543710 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-79ffb985-2d89-484e-b06a-cbcb678891a6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:19.671108 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-79ffb985-2d89-484e-b06a-cbcb678891a6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:19.678925 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-79ffb985-2d89-484e-b06a-cbcb678891a6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1280 microversion: 2.1 time: 0.184887 Jun 20 12:29:19.688593 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2926/5740] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:19 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1280 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:29:19.799961 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4208c635-688e-43e1-8c03-437eaae293dd tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:19.812802 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4208c635-688e-43e1-8c03-437eaae293dd tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c" status: 200 len: 1309 microversion: 2.1 time: 1.941088 Jun 20 12:29:19.819913 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2815/5741] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:17 2022] GET /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c => generated 1309 bytes in 1945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:20.695542 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b1646793-2736-4e00-8822-f04f8f6560bd tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:20.696233 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b1646793-2736-4e00-8822-f04f8f6560bd tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:20.708416 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b1646793-2736-4e00-8822-f04f8f6560bd tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:20.709286 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b1646793-2736-4e00-8822-f04f8f6560bd tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:20.711188 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b1646793-2736-4e00-8822-f04f8f6560bd tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:20.712089 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b1646793-2736-4e00-8822-f04f8f6560bd tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:20.835012 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-65b66b92-3bab-4754-9e62-2639aaba6c4d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:20.836492 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-65b66b92-3bab-4754-9e62-2639aaba6c4d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:20.847151 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65b66b92-3bab-4754-9e62-2639aaba6c4d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:20.848602 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65b66b92-3bab-4754-9e62-2639aaba6c4d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:20.849772 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65b66b92-3bab-4754-9e62-2639aaba6c4d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:20.850455 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65b66b92-3bab-4754-9e62-2639aaba6c4d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:20.880297 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b1646793-2736-4e00-8822-f04f8f6560bd tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:20.898493 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b1646793-2736-4e00-8822-f04f8f6560bd tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1280 microversion: 2.1 time: 0.207213 Jun 20 12:29:20.902758 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2927/5742] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:20 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1280 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:21.919495 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-78f3ca06-1195-4588-aa71-6ae8a389bb35 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:21.920155 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-78f3ca06-1195-4588-aa71-6ae8a389bb35 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:21.933953 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-78f3ca06-1195-4588-aa71-6ae8a389bb35 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:21.935546 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-78f3ca06-1195-4588-aa71-6ae8a389bb35 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:21.937400 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-78f3ca06-1195-4588-aa71-6ae8a389bb35 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:21.937801 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-78f3ca06-1195-4588-aa71-6ae8a389bb35 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:22.048452 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-78f3ca06-1195-4588-aa71-6ae8a389bb35 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:22.066284 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-78f3ca06-1195-4588-aa71-6ae8a389bb35 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1280 microversion: 2.1 time: 0.150516 Jun 20 12:29:22.068058 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2928/5743] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:21 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1280 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:29:22.114385 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-65b66b92-3bab-4754-9e62-2639aaba6c4d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:22.122844 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-65b66b92-3bab-4754-9e62-2639aaba6c4d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c" status: 200 len: 1309 microversion: 2.1 time: 1.292681 Jun 20 12:29:22.123561 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2816/5744] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:20 2022] GET /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c => generated 1309 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:29:23.086259 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fce213ad-9a55-4202-9b9e-6f421045becd tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:23.087601 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fce213ad-9a55-4202-9b9e-6f421045becd tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:23.102520 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fce213ad-9a55-4202-9b9e-6f421045becd tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:23.104971 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fce213ad-9a55-4202-9b9e-6f421045becd tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:23.106799 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fce213ad-9a55-4202-9b9e-6f421045becd tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:23.108759 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fce213ad-9a55-4202-9b9e-6f421045becd tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:23.142798 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-df799a53-dbfb-4d9c-a6ea-5a93ba35dbcb tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:23.143422 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-df799a53-dbfb-4d9c-a6ea-5a93ba35dbcb tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:23.153921 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-df799a53-dbfb-4d9c-a6ea-5a93ba35dbcb tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:23.160139 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-df799a53-dbfb-4d9c-a6ea-5a93ba35dbcb tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:23.161549 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-df799a53-dbfb-4d9c-a6ea-5a93ba35dbcb tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:23.162155 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-df799a53-dbfb-4d9c-a6ea-5a93ba35dbcb tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:23.794672 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fce213ad-9a55-4202-9b9e-6f421045becd tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:23.816301 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fce213ad-9a55-4202-9b9e-6f421045becd tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1322 microversion: 2.1 time: 0.731954 Jun 20 12:29:23.820881 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2929/5745] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:23 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1322 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:23.843313 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-4050065a-072b-4262-8e6d-c25f620b25f3 req-ecde1581-d461-423b-8af8-2c7414c48dcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f46a132-c8ab-41ae-bd97-ec97591f4a4f", "tag": "9bd93826-9442-4316-9ba3-6a2a9f4cde9a"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:23.866140 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-4050065a-072b-4262-8e6d-c25f620b25f3 req-ecde1581-d461-423b-8af8-2c7414c48dcd service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:23.866592 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-4050065a-072b-4262-8e6d-c25f620b25f3 req-ecde1581-d461-423b-8af8-2c7414c48dcd service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:23.915299 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-4050065a-072b-4262-8e6d-c25f620b25f3 req-ecde1581-d461-423b-8af8-2c7414c48dcd service nova] Creating event network-changed:9bd93826-9442-4316-9ba3-6a2a9f4cde9a for instance 0f46a132-c8ab-41ae-bd97-ec97591f4a4f on n-h1-master-1 Jun 20 12:29:23.932911 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-4050065a-072b-4262-8e6d-c25f620b25f3 req-ecde1581-d461-423b-8af8-2c7414c48dcd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099642 Jun 20 12:29:23.935441 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2930/5746] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:29:24.032194 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-df799a53-dbfb-4d9c-a6ea-5a93ba35dbcb tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:24.051821 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-df799a53-dbfb-4d9c-a6ea-5a93ba35dbcb tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c" status: 200 len: 1309 microversion: 2.1 time: 0.912270 Jun 20 12:29:24.052929 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2817/5747] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:23 2022] GET /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c => generated 1309 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:29:24.850636 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d3393f4d-aa32-4fed-9a5f-2d6bdbe6b656 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:24.851413 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d3393f4d-aa32-4fed-9a5f-2d6bdbe6b656 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:24.880979 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d3393f4d-aa32-4fed-9a5f-2d6bdbe6b656 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:24.882084 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d3393f4d-aa32-4fed-9a5f-2d6bdbe6b656 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:24.883155 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d3393f4d-aa32-4fed-9a5f-2d6bdbe6b656 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:24.883762 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d3393f4d-aa32-4fed-9a5f-2d6bdbe6b656 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:25.071273 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-118289f6-0125-4155-90fb-97d31c2f901b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:25.071905 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-118289f6-0125-4155-90fb-97d31c2f901b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:25.084603 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-118289f6-0125-4155-90fb-97d31c2f901b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:25.086349 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-118289f6-0125-4155-90fb-97d31c2f901b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:25.087396 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-118289f6-0125-4155-90fb-97d31c2f901b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:25.088001 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-118289f6-0125-4155-90fb-97d31c2f901b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:25.344511 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=4 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:25.407559 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=12 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:25.533821 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-118289f6-0125-4155-90fb-97d31c2f901b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:25.560506 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-118289f6-0125-4155-90fb-97d31c2f901b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c" status: 200 len: 1309 microversion: 2.1 time: 0.493922 Jun 20 12:29:25.571577 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2818/5748] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:25 2022] GET /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c => generated 1309 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:25.668864 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d3393f4d-aa32-4fed-9a5f-2d6bdbe6b656 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:25.685053 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d3393f4d-aa32-4fed-9a5f-2d6bdbe6b656 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1322 microversion: 2.1 time: 0.845454 Jun 20 12:29:25.697241 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2931/5749] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:24 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1322 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:29:26.041182 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-f2a422e3-6022-4dee-872e-e5dc951fda1c req-b2e8f949-6991-4aae-8ddf-e266014d7f12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0059d853-f820-4e39-953c-133a05c6380e", "tag": "7e555620-532f-4308-8bf3-543e1513fdb0"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:26.061493 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-f2a422e3-6022-4dee-872e-e5dc951fda1c req-b2e8f949-6991-4aae-8ddf-e266014d7f12 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:26.061938 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-f2a422e3-6022-4dee-872e-e5dc951fda1c req-b2e8f949-6991-4aae-8ddf-e266014d7f12 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:26.111225 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-f2a422e3-6022-4dee-872e-e5dc951fda1c req-b2e8f949-6991-4aae-8ddf-e266014d7f12 service nova] Creating event network-changed:7e555620-532f-4308-8bf3-543e1513fdb0 for instance 0059d853-f820-4e39-953c-133a05c6380e on n-h1-master-1 Jun 20 12:29:26.128084 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-f2a422e3-6022-4dee-872e-e5dc951fda1c req-b2e8f949-6991-4aae-8ddf-e266014d7f12 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092911 Jun 20 12:29:26.129640 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2819/5750] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:29:26.579678 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f14674d0-a090-4402-8aa4-c2ea0aeb4299 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:26.581056 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f14674d0-a090-4402-8aa4-c2ea0aeb4299 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:26.590731 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=14 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:26.609497 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f14674d0-a090-4402-8aa4-c2ea0aeb4299 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:26.610262 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f14674d0-a090-4402-8aa4-c2ea0aeb4299 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:26.613292 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f14674d0-a090-4402-8aa4-c2ea0aeb4299 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:26.615476 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f14674d0-a090-4402-8aa4-c2ea0aeb4299 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:26.719501 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-283d1cb1-c799-41a3-adc4-74c9f8ddf714 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:26.722643 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-283d1cb1-c799-41a3-adc4-74c9f8ddf714 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:26.744754 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-283d1cb1-c799-41a3-adc4-74c9f8ddf714 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:26.746355 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-283d1cb1-c799-41a3-adc4-74c9f8ddf714 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:26.749437 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-283d1cb1-c799-41a3-adc4-74c9f8ddf714 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:26.750334 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-283d1cb1-c799-41a3-adc4-74c9f8ddf714 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:27.228813 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f14674d0-a090-4402-8aa4-c2ea0aeb4299 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:27.250668 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f14674d0-a090-4402-8aa4-c2ea0aeb4299 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c" status: 200 len: 1309 microversion: 2.1 time: 0.673890 Jun 20 12:29:27.255752 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2932/5751] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:26 2022] GET /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c => generated 1309 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:27.975550 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-283d1cb1-c799-41a3-adc4-74c9f8ddf714 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:27.992536 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-283d1cb1-c799-41a3-adc4-74c9f8ddf714 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1322 microversion: 2.1 time: 1.293473 Jun 20 12:29:27.993154 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2820/5752] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:26 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1322 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:28.196545 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-f59c2557-1190-4c47-8089-2044805aa16b req-143ea7f1-5aed-435a-b711-f138c734e741 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88270958-b36b-4d35-ac86-6816bbf97aad", "tag": "7461aa0e-58fa-4b3e-9fee-6033861eff89"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:28.236001 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-f59c2557-1190-4c47-8089-2044805aa16b req-143ea7f1-5aed-435a-b711-f138c734e741 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:28.245166 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-f59c2557-1190-4c47-8089-2044805aa16b req-143ea7f1-5aed-435a-b711-f138c734e741 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:28.266495 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-f59c2557-1190-4c47-8089-2044805aa16b req-143ea7f1-5aed-435a-b711-f138c734e741 service nova] Creating event network-changed:7461aa0e-58fa-4b3e-9fee-6033861eff89 for instance 88270958-b36b-4d35-ac86-6816bbf97aad on n-h1-master-1 Jun 20 12:29:28.271434 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-57422db9-3bc3-48c0-9c9d-bddb171cfa82 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:28.272262 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-57422db9-3bc3-48c0-9c9d-bddb171cfa82 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:28.275153 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-f59c2557-1190-4c47-8089-2044805aa16b req-143ea7f1-5aed-435a-b711-f138c734e741 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083166 Jun 20 12:29:28.276596 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2933/5753] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:29:28.291346 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-57422db9-3bc3-48c0-9c9d-bddb171cfa82 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:28.291811 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-57422db9-3bc3-48c0-9c9d-bddb171cfa82 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:28.306618 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-57422db9-3bc3-48c0-9c9d-bddb171cfa82 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:28.309740 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-57422db9-3bc3-48c0-9c9d-bddb171cfa82 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:29.010745 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-31b479dc-1c74-4695-bd2a-8c07ea71ee34 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:29.011464 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-31b479dc-1c74-4695-bd2a-8c07ea71ee34 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:29.030216 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-31b479dc-1c74-4695-bd2a-8c07ea71ee34 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:29.030994 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-31b479dc-1c74-4695-bd2a-8c07ea71ee34 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:29.031841 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-31b479dc-1c74-4695-bd2a-8c07ea71ee34 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:29.032337 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-31b479dc-1c74-4695-bd2a-8c07ea71ee34 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:29.078475 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:29.260493 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-57422db9-3bc3-48c0-9c9d-bddb171cfa82 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:29.272996 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-57422db9-3bc3-48c0-9c9d-bddb171cfa82 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c" status: 200 len: 1309 microversion: 2.1 time: 1.005608 Jun 20 12:29:29.285433 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2821/5754] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:28 2022] GET /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c => generated 1309 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:29:29.300271 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-f6061594-7148-45ee-a528-7053ad478114 req-3ab218c3-c036-490b-9110-31c104914626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c", "name": "network-vif-plugged", "status": "completed", "tag": "d2c7e251-df2f-4340-81de-0231d98ec084"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:29.327419 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-f6061594-7148-45ee-a528-7053ad478114 req-3ab218c3-c036-490b-9110-31c104914626 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:29.328138 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-f6061594-7148-45ee-a528-7053ad478114 req-3ab218c3-c036-490b-9110-31c104914626 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:29.404692 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-f6061594-7148-45ee-a528-7053ad478114 req-3ab218c3-c036-490b-9110-31c104914626 service nova] Creating event network-vif-plugged:d2c7e251-df2f-4340-81de-0231d98ec084 for instance cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c on n-h2-master-1 Jun 20 12:29:29.421646 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-f6061594-7148-45ee-a528-7053ad478114 req-3ab218c3-c036-490b-9110-31c104914626 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134799 Jun 20 12:29:29.425265 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2822/5755] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:29:29.859109 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-31b479dc-1c74-4695-bd2a-8c07ea71ee34 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:29.872578 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-31b479dc-1c74-4695-bd2a-8c07ea71ee34 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1322 microversion: 2.1 time: 0.862414 Jun 20 12:29:29.874011 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2934/5756] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:29 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1322 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:30.292459 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6021daec-6375-418e-8867-a215be7e179b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:30.293316 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6021daec-6375-418e-8867-a215be7e179b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:30.306359 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6021daec-6375-418e-8867-a215be7e179b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:30.307519 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6021daec-6375-418e-8867-a215be7e179b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:30.308585 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6021daec-6375-418e-8867-a215be7e179b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:30.311898 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6021daec-6375-418e-8867-a215be7e179b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:30.610577 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6021daec-6375-418e-8867-a215be7e179b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:30.619736 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6021daec-6375-418e-8867-a215be7e179b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c" status: 200 len: 1309 microversion: 2.1 time: 0.333648 Jun 20 12:29:30.622078 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2823/5757] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:30 2022] GET /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c => generated 1309 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:30.892300 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bd02d5ad-bc69-4759-871d-c01d70283e5d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:30.893426 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bd02d5ad-bc69-4759-871d-c01d70283e5d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:30.905716 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bd02d5ad-bc69-4759-871d-c01d70283e5d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:30.922346 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bd02d5ad-bc69-4759-871d-c01d70283e5d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:30.936663 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bd02d5ad-bc69-4759-871d-c01d70283e5d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:30.937428 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bd02d5ad-bc69-4759-871d-c01d70283e5d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:31.264248 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bd02d5ad-bc69-4759-871d-c01d70283e5d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:31.280612 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bd02d5ad-bc69-4759-871d-c01d70283e5d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1322 microversion: 2.1 time: 0.393517 Jun 20 12:29:31.283023 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2935/5758] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:30 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1322 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:31.637661 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0a2fc8a9-27e9-4487-bfd7-8197bbac81d5 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:31.638847 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0a2fc8a9-27e9-4487-bfd7-8197bbac81d5 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:31.651840 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a2fc8a9-27e9-4487-bfd7-8197bbac81d5 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:31.652573 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a2fc8a9-27e9-4487-bfd7-8197bbac81d5 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:31.658317 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a2fc8a9-27e9-4487-bfd7-8197bbac81d5 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:31.659309 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a2fc8a9-27e9-4487-bfd7-8197bbac81d5 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:31.662377 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-eb828420-d2e5-48ca-861f-ae497e938a23 req-7e452d4a-8d3a-4c58-899f-2779e8732ca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f46a132-c8ab-41ae-bd97-ec97591f4a4f", "name": "network-vif-plugged", "status": "completed", "tag": "9bd93826-9442-4316-9ba3-6a2a9f4cde9a"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:31.676406 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-eb828420-d2e5-48ca-861f-ae497e938a23 req-7e452d4a-8d3a-4c58-899f-2779e8732ca4 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:31.677219 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-eb828420-d2e5-48ca-861f-ae497e938a23 req-7e452d4a-8d3a-4c58-899f-2779e8732ca4 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:31.692357 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-eb828420-d2e5-48ca-861f-ae497e938a23 req-7e452d4a-8d3a-4c58-899f-2779e8732ca4 service nova] Creating event network-vif-plugged:9bd93826-9442-4316-9ba3-6a2a9f4cde9a for instance 0f46a132-c8ab-41ae-bd97-ec97591f4a4f on n-h1-master-1 Jun 20 12:29:31.698779 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-eb828420-d2e5-48ca-861f-ae497e938a23 req-7e452d4a-8d3a-4c58-899f-2779e8732ca4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041517 Jun 20 12:29:31.700100 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2936/5759] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:29:32.300479 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5520e70b-eaaa-4556-babb-4aa19ade50d6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:32.302588 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5520e70b-eaaa-4556-babb-4aa19ade50d6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:32.337697 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5520e70b-eaaa-4556-babb-4aa19ade50d6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:32.342673 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5520e70b-eaaa-4556-babb-4aa19ade50d6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:32.345724 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5520e70b-eaaa-4556-babb-4aa19ade50d6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:32.364527 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5520e70b-eaaa-4556-babb-4aa19ade50d6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:32.705014 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5520e70b-eaaa-4556-babb-4aa19ade50d6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:32.721429 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5520e70b-eaaa-4556-babb-4aa19ade50d6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1322 microversion: 2.1 time: 0.425792 Jun 20 12:29:32.722068 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2937/5760] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:32 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1322 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:29:32.727616 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6798926a-75f8-4ae1-b292-c1d3972ba6fd tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1152867744-access_point-1297366378", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "0eb65be3-0805-466b-92dc-1c4eadb85574"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1450629429", "security_groups": [{"name": "tempest-secgroup_access--1011005817"}, {"name": "tempest-secgroup_general--877941471"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:32.918443 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0a2fc8a9-27e9-4487-bfd7-8197bbac81d5 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:32.921119 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=96 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:32.930535 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0a2fc8a9-27e9-4487-bfd7-8197bbac81d5 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c" status: 200 len: 1491 microversion: 2.1 time: 1.297332 Jun 20 12:29:32.931888 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2824/5761] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:31 2022] GET /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c => generated 1491 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:32.952086 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c0d97156-514f-4554-b9ad-6ca9f41cef06 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:32.952731 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c0d97156-514f-4554-b9ad-6ca9f41cef06 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 3d7404de-1c0e-483f-b496-722b0a7cdd57] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:32.957566 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:32.969607 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c0d97156-514f-4554-b9ad-6ca9f41cef06 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:32.971983 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c0d97156-514f-4554-b9ad-6ca9f41cef06 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:32.973047 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c0d97156-514f-4554-b9ad-6ca9f41cef06 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:32.973677 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c0d97156-514f-4554-b9ad-6ca9f41cef06 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:33.189505 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c0d97156-514f-4554-b9ad-6ca9f41cef06 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:33.203353 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c0d97156-514f-4554-b9ad-6ca9f41cef06 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57" status: 200 len: 1490 microversion: 2.1 time: 0.255311 Jun 20 12:29:33.205090 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2825/5762] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:32 2022] GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57 => generated 1490 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:33.227815 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8a486cbb-9532-4a6c-aeb6-1cffb9330f26 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:33.228500 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8a486cbb-9532-4a6c-aeb6-1cffb9330f26 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:33.241761 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8a486cbb-9532-4a6c-aeb6-1cffb9330f26 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:33.243289 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8a486cbb-9532-4a6c-aeb6-1cffb9330f26 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:33.245137 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8a486cbb-9532-4a6c-aeb6-1cffb9330f26 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:33.246814 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8a486cbb-9532-4a6c-aeb6-1cffb9330f26 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:33.412776 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8a486cbb-9532-4a6c-aeb6-1cffb9330f26 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:33.422334 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8a486cbb-9532-4a6c-aeb6-1cffb9330f26 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c" status: 200 len: 1491 microversion: 2.1 time: 0.204305 Jun 20 12:29:33.423526 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2826/5763] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:33 2022] GET /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c => generated 1491 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:33.439279 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-597b974f-0bdb-484c-8293-b25ba3c5e7d3 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:33.440033 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-597b974f-0bdb-484c-8293-b25ba3c5e7d3 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:33.447223 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-597b974f-0bdb-484c-8293-b25ba3c5e7d3 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:33.447677 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-597b974f-0bdb-484c-8293-b25ba3c5e7d3 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:33.448497 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-597b974f-0bdb-484c-8293-b25ba3c5e7d3 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:33.448938 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-597b974f-0bdb-484c-8293-b25ba3c5e7d3 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:33.482226 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-597b974f-0bdb-484c-8293-b25ba3c5e7d3 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:29:33.590906 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-597b974f-0bdb-484c-8293-b25ba3c5e7d3 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c" status: 204 len: 0 microversion: 2.1 time: 0.154928 Jun 20 12:29:33.592277 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2827/5764] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:29:33 2022] DELETE /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 12:29:33.602760 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ecdcc2ac-9f74-444b-95e7-6616cd0cfe7c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:33.603549 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ecdcc2ac-9f74-444b-95e7-6616cd0cfe7c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:33.610896 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ecdcc2ac-9f74-444b-95e7-6616cd0cfe7c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:33.611911 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ecdcc2ac-9f74-444b-95e7-6616cd0cfe7c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:33.612910 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ecdcc2ac-9f74-444b-95e7-6616cd0cfe7c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:33.613347 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ecdcc2ac-9f74-444b-95e7-6616cd0cfe7c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:33.829392 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ecdcc2ac-9f74-444b-95e7-6616cd0cfe7c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:33.839516 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ecdcc2ac-9f74-444b-95e7-6616cd0cfe7c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c" status: 200 len: 1497 microversion: 2.1 time: 0.241902 Jun 20 12:29:33.840257 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2828/5765] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:33 2022] GET /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c => generated 1497 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:29:33.845351 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-18078c86-7de2-4aa7-a64c-022fd6bbb87d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:33.846076 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-18078c86-7de2-4aa7-a64c-022fd6bbb87d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:33.855870 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-18078c86-7de2-4aa7-a64c-022fd6bbb87d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:33.856434 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-18078c86-7de2-4aa7-a64c-022fd6bbb87d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:33.858366 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-18078c86-7de2-4aa7-a64c-022fd6bbb87d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:33.858523 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-18078c86-7de2-4aa7-a64c-022fd6bbb87d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:34.210372 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-18078c86-7de2-4aa7-a64c-022fd6bbb87d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:34.236352 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-18078c86-7de2-4aa7-a64c-022fd6bbb87d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1322 microversion: 2.1 time: 0.392201 Jun 20 12:29:34.237700 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2829/5766] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:33 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1322 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:34.867176 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1e8dafd8-d03a-4338-bcce-184f19a02c35 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:34.873247 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1e8dafd8-d03a-4338-bcce-184f19a02c35 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:34.896930 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e8dafd8-d03a-4338-bcce-184f19a02c35 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:34.898507 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e8dafd8-d03a-4338-bcce-184f19a02c35 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:34.900039 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e8dafd8-d03a-4338-bcce-184f19a02c35 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:34.906892 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e8dafd8-d03a-4338-bcce-184f19a02c35 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:35.167824 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1e8dafd8-d03a-4338-bcce-184f19a02c35 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:35.180172 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1e8dafd8-d03a-4338-bcce-184f19a02c35 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c" status: 200 len: 1497 microversion: 2.1 time: 0.320220 Jun 20 12:29:35.189142 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2830/5767] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:34 2022] GET /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c => generated 1497 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:35.255725 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-81db3101-65a5-4ce7-9c33-4a8983f7c2b2 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:35.256516 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-81db3101-65a5-4ce7-9c33-4a8983f7c2b2 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:35.263479 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-81db3101-65a5-4ce7-9c33-4a8983f7c2b2 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:35.263982 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-81db3101-65a5-4ce7-9c33-4a8983f7c2b2 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:35.264808 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-81db3101-65a5-4ce7-9c33-4a8983f7c2b2 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:35.265236 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-81db3101-65a5-4ce7-9c33-4a8983f7c2b2 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:35.490443 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-81db3101-65a5-4ce7-9c33-4a8983f7c2b2 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:35.499025 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-81db3101-65a5-4ce7-9c33-4a8983f7c2b2 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1322 microversion: 2.1 time: 0.248578 Jun 20 12:29:35.508441 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2831/5768] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:35 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:29:35.518667 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-7680e7aa-ce92-41bd-8dbb-6960a9231e4b req-2bba96a2-0026-440f-896a-9f028047e29f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88270958-b36b-4d35-ac86-6816bbf97aad", "name": "network-vif-plugged", "status": "completed", "tag": "7461aa0e-58fa-4b3e-9fee-6033861eff89"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:35.555759 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-7680e7aa-ce92-41bd-8dbb-6960a9231e4b req-2bba96a2-0026-440f-896a-9f028047e29f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:35.556500 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-7680e7aa-ce92-41bd-8dbb-6960a9231e4b req-2bba96a2-0026-440f-896a-9f028047e29f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:35.584337 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-7680e7aa-ce92-41bd-8dbb-6960a9231e4b req-2bba96a2-0026-440f-896a-9f028047e29f service nova] Creating event network-vif-plugged:7461aa0e-58fa-4b3e-9fee-6033861eff89 for instance 88270958-b36b-4d35-ac86-6816bbf97aad on n-h1-master-1 Jun 20 12:29:35.590921 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-7680e7aa-ce92-41bd-8dbb-6960a9231e4b req-2bba96a2-0026-440f-896a-9f028047e29f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081065 Jun 20 12:29:35.591551 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2832/5769] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:29:36.193030 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-03aca003-64b9-457b-a956-8248f1a4b2ed req-c2f4a8b6-da87-43ed-949f-8b812bed6d5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c", "name": "network-vif-deleted", "tag": "d2c7e251-df2f-4340-81de-0231d98ec084"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:36.242524 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-03aca003-64b9-457b-a956-8248f1a4b2ed req-c2f4a8b6-da87-43ed-949f-8b812bed6d5a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:36.242974 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-03aca003-64b9-457b-a956-8248f1a4b2ed req-c2f4a8b6-da87-43ed-949f-8b812bed6d5a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:36.296056 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-03aca003-64b9-457b-a956-8248f1a4b2ed req-c2f4a8b6-da87-43ed-949f-8b812bed6d5a service nova] Creating event network-vif-deleted:d2c7e251-df2f-4340-81de-0231d98ec084 for instance cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c on n-h2-master-1 Jun 20 12:29:36.317753 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-03aca003-64b9-457b-a956-8248f1a4b2ed req-c2f4a8b6-da87-43ed-949f-8b812bed6d5a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140456 Jun 20 12:29:36.318379 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2833/5770] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:29:36.342998 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0fc2a55f-af71-4425-b36e-d7aebb14f741 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:36.345123 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0fc2a55f-af71-4425-b36e-d7aebb14f741 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:36.380077 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0fc2a55f-af71-4425-b36e-d7aebb14f741 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:36.380586 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0fc2a55f-af71-4425-b36e-d7aebb14f741 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:36.381381 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0fc2a55f-af71-4425-b36e-d7aebb14f741 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:36.381828 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0fc2a55f-af71-4425-b36e-d7aebb14f741 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:36.515323 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0fc2a55f-af71-4425-b36e-d7aebb14f741 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:36.524813 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0fc2a55f-af71-4425-b36e-d7aebb14f741 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c" status: 200 len: 1294 microversion: 2.1 time: 0.201673 Jun 20 12:29:36.525678 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2834/5771] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:36 2022] GET /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c => generated 1294 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:36.531205 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1756a17e-5c58-4a99-b81d-985dc79d86b3 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:36.532026 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1756a17e-5c58-4a99-b81d-985dc79d86b3 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:36.539033 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1756a17e-5c58-4a99-b81d-985dc79d86b3 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:36.539677 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1756a17e-5c58-4a99-b81d-985dc79d86b3 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:36.541459 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1756a17e-5c58-4a99-b81d-985dc79d86b3 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:36.542068 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1756a17e-5c58-4a99-b81d-985dc79d86b3 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:36.754565 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1756a17e-5c58-4a99-b81d-985dc79d86b3 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:36.772156 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1756a17e-5c58-4a99-b81d-985dc79d86b3 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1322 microversion: 2.1 time: 0.239368 Jun 20 12:29:36.789263 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2835/5772] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:36 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:37.159531 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-6798926a-75f8-4ae1-b292-c1d3972ba6fd tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] validate_networks() for [('0eb65be3-0805-466b-92dc-1c4eadb85574', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:29:37.546445 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1df90bd9-d6c7-4daf-990a-f7d42422f7ba tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:37.547555 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1df90bd9-d6c7-4daf-990a-f7d42422f7ba tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:37.564174 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1df90bd9-d6c7-4daf-990a-f7d42422f7ba tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:37.564921 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1df90bd9-d6c7-4daf-990a-f7d42422f7ba tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:37.568158 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1df90bd9-d6c7-4daf-990a-f7d42422f7ba tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:37.569248 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1df90bd9-d6c7-4daf-990a-f7d42422f7ba tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:37.587026 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-1df90bd9-d6c7-4daf-990a-f7d42422f7ba tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] HTTP exception thrown: Instance cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c could not be found. Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1df90bd9-d6c7-4daf-990a-f7d42422f7ba tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Request method failure captured: Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c HTTP/1.1 Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGeaPbwuiKlZtfAakVi9AU1jZJYQpsiuqbtqj4H7EyEfa_Hs7Z-uZ4kORsCa_VB61-2zGcpt-Akt_fwFGZsdE57QH4a5RFxoaFSpMB5wQSEpC1nxSFtZmML3yZTCD6a9Nk7nPWXZGtd_9TDU17ULy9DxSwRUUNLntxWZGEmDQVAe1xk Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersTestJSON-953297781 Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersTestJSON-953297781 Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersTestJSON-953297781 Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersTestJSON-953297781-project Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 8878d44956bd42e18f0409534e562ab6 Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersTestJSON-953297781-project Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: exception: Instance cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c could not be found. Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c'} Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c could not be found. Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c could not be found. Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:29:37.592109 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:37.597529 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:29:37.597529 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:29:37.597529 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:29:37.597529 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:29:37.597529 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c could not be found. Jun 20 12:29:37.597529 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:29:37.599098 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1df90bd9-d6c7-4daf-990a-f7d42422f7ba tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Returning 404 to user: Instance cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:29:37.600152 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1df90bd9-d6c7-4daf-990a-f7d42422f7ba tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c" status: 404 len: 111 microversion: 2.1 time: 0.057692 Jun 20 12:29:37.605885 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2836/5773] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:37 2022] GET /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:29:37.615371 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-91adf24b-e7bb-4f79-9bce-635e80864d34 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:37.615940 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-91adf24b-e7bb-4f79-9bce-635e80864d34 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 3d7404de-1c0e-483f-b496-722b0a7cdd57] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:37.635937 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-91adf24b-e7bb-4f79-9bce-635e80864d34 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:37.637130 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-91adf24b-e7bb-4f79-9bce-635e80864d34 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:37.639621 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-91adf24b-e7bb-4f79-9bce-635e80864d34 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:37.640385 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-91adf24b-e7bb-4f79-9bce-635e80864d34 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:37.677698 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-91adf24b-e7bb-4f79-9bce-635e80864d34 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 3d7404de-1c0e-483f-b496-722b0a7cdd57] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:29:37.734876 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-6798926a-75f8-4ae1-b292-c1d3972ba6fd tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:29:37.735308 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-6798926a-75f8-4ae1-b292-c1d3972ba6fd tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:29:37.735945 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-6798926a-75f8-4ae1-b292-c1d3972ba6fd tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:29:37.736398 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-6798926a-75f8-4ae1-b292-c1d3972ba6fd tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:29:37.736807 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-6798926a-75f8-4ae1-b292-c1d3972ba6fd tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:29:37.748359 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6798926a-75f8-4ae1-b292-c1d3972ba6fd tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:37.749127 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6798926a-75f8-4ae1-b292-c1d3972ba6fd tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:37.750131 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6798926a-75f8-4ae1-b292-c1d3972ba6fd tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:37.750870 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6798926a-75f8-4ae1-b292-c1d3972ba6fd tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:37.774551 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-6798926a-75f8-4ae1-b292-c1d3972ba6fd tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Getting quotas for project 06b38619bb2f4b3e92aa9a9d5c5195b9. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:29:37.781032 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-6798926a-75f8-4ae1-b292-c1d3972ba6fd tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Getting quotas for user e653a6be497a469a9064cb754ea47fa7 and project 06b38619bb2f4b3e92aa9a9d5c5195b9. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:29:37.796974 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6798926a-75f8-4ae1-b292-c1d3972ba6fd tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:29:37.799648 n-d-master-1 devstack@n-api.service[119127]: WARNING nova.utils [None req-6798926a-75f8-4ae1-b292-c1d3972ba6fd tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1152867744-access_point-1297366378 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1152867744-ac Jun 20 12:29:37.800720 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6798926a-75f8-4ae1-b292-c1d3972ba6fd tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: a3aa985b-f96c-40ed-ba36-89054521794d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:29:37.809492 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-91adf24b-e7bb-4f79-9bce-635e80864d34 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57" status: 204 len: 0 microversion: 2.1 time: 0.200425 Jun 20 12:29:37.819992 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2837/5774] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:29:37 2022] DELETE /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:29:37.827017 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-18fca94f-0eef-4aa6-9493-bb66d337f6dc tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:37.827853 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-18fca94f-0eef-4aa6-9493-bb66d337f6dc tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:37.836357 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-18fca94f-0eef-4aa6-9493-bb66d337f6dc tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:37.836804 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-18fca94f-0eef-4aa6-9493-bb66d337f6dc tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:37.837766 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-18fca94f-0eef-4aa6-9493-bb66d337f6dc tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:37.838496 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-18fca94f-0eef-4aa6-9493-bb66d337f6dc tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:37.884659 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6798926a-75f8-4ae1-b292-c1d3972ba6fd tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 5.160760 Jun 20 12:29:37.886108 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2938/5775] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:29:32 2022] POST /compute/v2.1/servers => generated 457 bytes in 5163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:29:37.897882 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-77299b02-0cf2-4dcb-9298-72ae973b3199 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:37.898698 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-77299b02-0cf2-4dcb-9298-72ae973b3199 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 3d7404de-1c0e-483f-b496-722b0a7cdd57] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:37.910945 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-77299b02-0cf2-4dcb-9298-72ae973b3199 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:37.911819 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-77299b02-0cf2-4dcb-9298-72ae973b3199 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:37.912872 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-77299b02-0cf2-4dcb-9298-72ae973b3199 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:37.914267 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-77299b02-0cf2-4dcb-9298-72ae973b3199 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:38.088722 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-18fca94f-0eef-4aa6-9493-bb66d337f6dc tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:38.103439 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-18fca94f-0eef-4aa6-9493-bb66d337f6dc tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1516 microversion: 2.1 time: 0.281761 Jun 20 12:29:38.115819 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2838/5776] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:37 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1516 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:38.123801 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-99511214-591d-41b4-8da7-7a1a28611a9e tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:38.124858 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-99511214-591d-41b4-8da7-7a1a28611a9e tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: a3aa985b-f96c-40ed-ba36-89054521794d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:38.198118 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-99511214-591d-41b4-8da7-7a1a28611a9e tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e653a6be497a469a9064cb754ea47fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b38619bb2f4b3e92aa9a9d5c5195b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:38.207735 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-99511214-591d-41b4-8da7-7a1a28611a9e tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d" status: 200 len: 1295 microversion: 2.1 time: 0.089818 Jun 20 12:29:38.217811 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2839/5777] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:38 2022] GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d => generated 1295 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:38.217811 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a8b182b5-6b29-4cb3-809f-acd7b33fe50c tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:38.217811 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a8b182b5-6b29-4cb3-809f-acd7b33fe50c tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:38.227651 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a8b182b5-6b29-4cb3-809f-acd7b33fe50c tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:38.227651 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a8b182b5-6b29-4cb3-809f-acd7b33fe50c tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:38.233042 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-77299b02-0cf2-4dcb-9298-72ae973b3199 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:38.237079 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a8b182b5-6b29-4cb3-809f-acd7b33fe50c tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:38.240610 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a8b182b5-6b29-4cb3-809f-acd7b33fe50c tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:38.248337 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-77299b02-0cf2-4dcb-9298-72ae973b3199 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57" status: 200 len: 1496 microversion: 2.1 time: 0.360780 Jun 20 12:29:38.249405 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2939/5778] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:37 2022] GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57 => generated 1496 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:38.271461 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-a8b182b5-6b29-4cb3-809f-acd7b33fe50c tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lazy-loading 'flavor' on Instance uuid 88270958-b36b-4d35-ac86-6816bbf97aad {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:29:38.293153 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:38.396379 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a8b182b5-6b29-4cb3-809f-acd7b33fe50c tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "POST /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad/action" status: 200 len: 32 microversion: 2.1 time: 0.185266 Jun 20 12:29:38.411760 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-08e170d6-2ea1-494a-88b3-5c86415b48fe tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:38.413010 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-08e170d6-2ea1-494a-88b3-5c86415b48fe tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:38.417281 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2840/5779] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:29:38 2022] POST /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad/action => generated 32 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:29:38.424920 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-08e170d6-2ea1-494a-88b3-5c86415b48fe tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:38.426149 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-08e170d6-2ea1-494a-88b3-5c86415b48fe tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:38.427358 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-08e170d6-2ea1-494a-88b3-5c86415b48fe tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:38.429002 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-08e170d6-2ea1-494a-88b3-5c86415b48fe tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:38.641137 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-08e170d6-2ea1-494a-88b3-5c86415b48fe tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:38.651054 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-08e170d6-2ea1-494a-88b3-5c86415b48fe tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1522 microversion: 2.1 time: 0.246613 Jun 20 12:29:38.651663 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2940/5780] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:38 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:39.245895 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4bf289b0-7a69-41d3-b329-5a0fc9bfb8e0 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:39.251784 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4bf289b0-7a69-41d3-b329-5a0fc9bfb8e0 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: a3aa985b-f96c-40ed-ba36-89054521794d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:39.269033 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5e7d920e-d0bf-4317-92c6-b206ae1e2737 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:39.269800 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5e7d920e-d0bf-4317-92c6-b206ae1e2737 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 3d7404de-1c0e-483f-b496-722b0a7cdd57] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:39.281255 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5e7d920e-d0bf-4317-92c6-b206ae1e2737 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:39.282586 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5e7d920e-d0bf-4317-92c6-b206ae1e2737 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:39.285371 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5e7d920e-d0bf-4317-92c6-b206ae1e2737 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:39.286220 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5e7d920e-d0bf-4317-92c6-b206ae1e2737 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:39.290899 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4bf289b0-7a69-41d3-b329-5a0fc9bfb8e0 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:39.291363 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4bf289b0-7a69-41d3-b329-5a0fc9bfb8e0 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:39.301921 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4bf289b0-7a69-41d3-b329-5a0fc9bfb8e0 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:39.302623 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4bf289b0-7a69-41d3-b329-5a0fc9bfb8e0 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:39.428655 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4bf289b0-7a69-41d3-b329-5a0fc9bfb8e0 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e653a6be497a469a9064cb754ea47fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b38619bb2f4b3e92aa9a9d5c5195b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:39.438379 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4bf289b0-7a69-41d3-b329-5a0fc9bfb8e0 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d" status: 200 len: 1347 microversion: 2.1 time: 0.215580 Jun 20 12:29:39.449316 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2841/5781] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:39 2022] GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d => generated 1347 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:39.674118 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-97e059bc-eef7-4c0d-ae22-9d334851948f tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:39.675045 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-97e059bc-eef7-4c0d-ae22-9d334851948f tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:39.687903 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-97e059bc-eef7-4c0d-ae22-9d334851948f tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:39.688353 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-97e059bc-eef7-4c0d-ae22-9d334851948f tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:39.689362 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-97e059bc-eef7-4c0d-ae22-9d334851948f tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:39.692769 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-97e059bc-eef7-4c0d-ae22-9d334851948f tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:39.922018 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5e7d920e-d0bf-4317-92c6-b206ae1e2737 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:39.966803 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5e7d920e-d0bf-4317-92c6-b206ae1e2737 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57" status: 200 len: 1496 microversion: 2.1 time: 0.701503 Jun 20 12:29:39.970046 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2941/5782] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:39 2022] GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57 => generated 1496 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:40.252235 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-97e059bc-eef7-4c0d-ae22-9d334851948f tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:40.263435 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-97e059bc-eef7-4c0d-ae22-9d334851948f tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1522 microversion: 2.1 time: 0.593736 Jun 20 12:29:40.264030 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2842/5783] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:39 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1522 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:40.459109 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ee12ed26-b7d5-47e6-822d-fae0d539d46d tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:40.459699 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ee12ed26-b7d5-47e6-822d-fae0d539d46d tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: a3aa985b-f96c-40ed-ba36-89054521794d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:40.467858 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee12ed26-b7d5-47e6-822d-fae0d539d46d tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:40.468609 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee12ed26-b7d5-47e6-822d-fae0d539d46d tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:40.469806 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee12ed26-b7d5-47e6-822d-fae0d539d46d tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:40.470290 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee12ed26-b7d5-47e6-822d-fae0d539d46d tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:40.672790 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ee12ed26-b7d5-47e6-822d-fae0d539d46d tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e653a6be497a469a9064cb754ea47fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b38619bb2f4b3e92aa9a9d5c5195b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:40.707169 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ee12ed26-b7d5-47e6-822d-fae0d539d46d tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d" status: 200 len: 1365 microversion: 2.1 time: 0.254302 Jun 20 12:29:40.707780 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2942/5784] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:40 2022] GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d => generated 1365 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:40.756050 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-c67ef56d-cdc9-489f-8520-1c44e97f921d req-87cc25f5-d5cf-4972-bb75-6982e0e5475f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d7404de-1c0e-483f-b496-722b0a7cdd57", "name": "network-vif-deleted", "tag": "ec2e0f6a-a89f-4516-ae4b-08e2fb42ffbd"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:40.779454 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-c67ef56d-cdc9-489f-8520-1c44e97f921d req-87cc25f5-d5cf-4972-bb75-6982e0e5475f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:40.782447 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-c67ef56d-cdc9-489f-8520-1c44e97f921d req-87cc25f5-d5cf-4972-bb75-6982e0e5475f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:40.813579 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-c67ef56d-cdc9-489f-8520-1c44e97f921d req-87cc25f5-d5cf-4972-bb75-6982e0e5475f service nova] Creating event network-vif-deleted:ec2e0f6a-a89f-4516-ae4b-08e2fb42ffbd for instance 3d7404de-1c0e-483f-b496-722b0a7cdd57 on n-h2-master-1 Jun 20 12:29:40.823698 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-c67ef56d-cdc9-489f-8520-1c44e97f921d req-87cc25f5-d5cf-4972-bb75-6982e0e5475f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072177 Jun 20 12:29:40.828261 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2843/5785] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:29:40.988169 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-43c87ea5-8c44-42fd-92e5-ca9d2c335acf tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:40.988885 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-43c87ea5-8c44-42fd-92e5-ca9d2c335acf tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 3d7404de-1c0e-483f-b496-722b0a7cdd57] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:40.991283 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:41.006276 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-43c87ea5-8c44-42fd-92e5-ca9d2c335acf tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:41.006966 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-43c87ea5-8c44-42fd-92e5-ca9d2c335acf tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:41.011714 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-43c87ea5-8c44-42fd-92e5-ca9d2c335acf tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:41.012325 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-43c87ea5-8c44-42fd-92e5-ca9d2c335acf tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:41.074884 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-43c87ea5-8c44-42fd-92e5-ca9d2c335acf tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:41.075909 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-43c87ea5-8c44-42fd-92e5-ca9d2c335acf tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:41.076769 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-43c87ea5-8c44-42fd-92e5-ca9d2c335acf tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lazy-loading 'fault' on Instance uuid 3d7404de-1c0e-483f-b496-722b0a7cdd57 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:29:41.139513 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-43c87ea5-8c44-42fd-92e5-ca9d2c335acf tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:41.151565 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-43c87ea5-8c44-42fd-92e5-ca9d2c335acf tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57" status: 200 len: 1299 microversion: 2.1 time: 0.168242 Jun 20 12:29:41.152808 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2943/5786] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:40 2022] GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57 => generated 1299 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:41.283864 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-abea2d2e-5c2e-4ee5-83b2-b651bb3a72c9 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:41.286034 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-abea2d2e-5c2e-4ee5-83b2-b651bb3a72c9 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:41.332555 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-abea2d2e-5c2e-4ee5-83b2-b651bb3a72c9 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:41.334469 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-abea2d2e-5c2e-4ee5-83b2-b651bb3a72c9 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:41.337704 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-abea2d2e-5c2e-4ee5-83b2-b651bb3a72c9 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:41.339160 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-abea2d2e-5c2e-4ee5-83b2-b651bb3a72c9 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:41.602490 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-abea2d2e-5c2e-4ee5-83b2-b651bb3a72c9 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:41.615577 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-abea2d2e-5c2e-4ee5-83b2-b651bb3a72c9 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1522 microversion: 2.1 time: 0.337540 Jun 20 12:29:41.617202 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2844/5787] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:41 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1522 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:41.727853 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c5e04276-d6c5-43b2-8149-0608bd87cfb8 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:41.728684 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c5e04276-d6c5-43b2-8149-0608bd87cfb8 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: a3aa985b-f96c-40ed-ba36-89054521794d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:41.763402 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c5e04276-d6c5-43b2-8149-0608bd87cfb8 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:41.763858 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c5e04276-d6c5-43b2-8149-0608bd87cfb8 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:41.764745 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c5e04276-d6c5-43b2-8149-0608bd87cfb8 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:41.765179 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c5e04276-d6c5-43b2-8149-0608bd87cfb8 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:42.096760 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c5e04276-d6c5-43b2-8149-0608bd87cfb8 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e653a6be497a469a9064cb754ea47fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b38619bb2f4b3e92aa9a9d5c5195b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:42.111205 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c5e04276-d6c5-43b2-8149-0608bd87cfb8 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d" status: 200 len: 1472 microversion: 2.1 time: 0.387144 Jun 20 12:29:42.112481 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2944/5788] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:41 2022] GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d => generated 1472 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:42.173938 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7b8cea97-a943-4bb6-bea1-59d89a60390c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:42.174781 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7b8cea97-a943-4bb6-bea1-59d89a60390c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 3d7404de-1c0e-483f-b496-722b0a7cdd57] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:42.190048 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7b8cea97-a943-4bb6-bea1-59d89a60390c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:42.195009 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7b8cea97-a943-4bb6-bea1-59d89a60390c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:42.196099 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7b8cea97-a943-4bb6-bea1-59d89a60390c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:42.202046 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7b8cea97-a943-4bb6-bea1-59d89a60390c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:42.231450 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-7b8cea97-a943-4bb6-bea1-59d89a60390c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] HTTP exception thrown: Instance 3d7404de-1c0e-483f-b496-722b0a7cdd57 could not be found. Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7b8cea97-a943-4bb6-bea1-59d89a60390c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Request method failure captured: Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57 HTTP/1.1 Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGeaPbwuiKlZtfAakVi9AU1jZJYQpsiuqbtqj4H7EyEfa_Hs7Z-uZ4kORsCa_VB61-2zGcpt-Akt_fwFGZsdE57QH4a5RFxoaFSpMB5wQSEpC1nxSFtZmML3yZTCD6a9Nk7nPWXZGtd_9TDU17ULy9DxSwRUUNLntxWZGEmDQVAe1xk Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersTestJSON-953297781 Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersTestJSON-953297781 Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersTestJSON-953297781 Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersTestJSON-953297781-project Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 8878d44956bd42e18f0409534e562ab6 Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersTestJSON-953297781-project Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 3d7404de-1c0e-483f-b496-722b0a7cdd57 could not be found. Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '3d7404de-1c0e-483f-b496-722b0a7cdd57'} Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d7404de-1c0e-483f-b496-722b0a7cdd57 could not be found. Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d7404de-1c0e-483f-b496-722b0a7cdd57 could not be found. Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:29:42.233525 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:42.237537 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:29:42.237537 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:29:42.237537 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:29:42.237537 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:29:42.237537 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d7404de-1c0e-483f-b496-722b0a7cdd57 could not be found. Jun 20 12:29:42.237537 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:29:42.242053 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7b8cea97-a943-4bb6-bea1-59d89a60390c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Returning 404 to user: Instance 3d7404de-1c0e-483f-b496-722b0a7cdd57 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:29:42.244675 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7b8cea97-a943-4bb6-bea1-59d89a60390c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57" status: 404 len: 111 microversion: 2.1 time: 0.078110 Jun 20 12:29:42.249557 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2845/5789] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:42 2022] GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:29:42.416827 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-92aa58dc-1d31-4001-8a5e-5facd3e21252 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2118783946", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "ce2e9d9e-a74d-4fc7-950c-df9300f57b6c"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:42.509509 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-92aa58dc-1d31-4001-8a5e-5facd3e21252 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] validate_networks() for [('ce2e9d9e-a74d-4fc7-950c-df9300f57b6c', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:29:42.638987 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-19dbc8fe-2f10-4408-95d2-99ed0fb9f518 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:42.640379 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-19dbc8fe-2f10-4408-95d2-99ed0fb9f518 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:42.652346 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-19dbc8fe-2f10-4408-95d2-99ed0fb9f518 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:42.653401 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-19dbc8fe-2f10-4408-95d2-99ed0fb9f518 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:42.654391 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-19dbc8fe-2f10-4408-95d2-99ed0fb9f518 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:42.655014 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-19dbc8fe-2f10-4408-95d2-99ed0fb9f518 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:42.874228 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-19dbc8fe-2f10-4408-95d2-99ed0fb9f518 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:42.893968 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-19dbc8fe-2f10-4408-95d2-99ed0fb9f518 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1522 microversion: 2.1 time: 0.262281 Jun 20 12:29:42.896190 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2846/5790] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:42 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:29:43.129426 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-78970f56-e5ee-4a91-8e79-a56ac42982a4 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:43.129940 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-78970f56-e5ee-4a91-8e79-a56ac42982a4 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: a3aa985b-f96c-40ed-ba36-89054521794d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:43.142189 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-78970f56-e5ee-4a91-8e79-a56ac42982a4 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:43.142962 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-78970f56-e5ee-4a91-8e79-a56ac42982a4 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:43.165382 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-78970f56-e5ee-4a91-8e79-a56ac42982a4 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:43.165794 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-78970f56-e5ee-4a91-8e79-a56ac42982a4 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:43.570805 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-92aa58dc-1d31-4001-8a5e-5facd3e21252 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:29:43.572546 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-92aa58dc-1d31-4001-8a5e-5facd3e21252 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:29:43.573190 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-92aa58dc-1d31-4001-8a5e-5facd3e21252 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:29:43.573926 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-92aa58dc-1d31-4001-8a5e-5facd3e21252 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:29:43.574743 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-92aa58dc-1d31-4001-8a5e-5facd3e21252 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:29:43.594928 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-92aa58dc-1d31-4001-8a5e-5facd3e21252 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:43.599049 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-92aa58dc-1d31-4001-8a5e-5facd3e21252 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:43.599965 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-92aa58dc-1d31-4001-8a5e-5facd3e21252 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:43.600489 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-92aa58dc-1d31-4001-8a5e-5facd3e21252 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:43.643682 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-92aa58dc-1d31-4001-8a5e-5facd3e21252 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Getting quotas for project 896c053324b34720a7d0f151bfdc8b10. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:29:43.653642 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-92aa58dc-1d31-4001-8a5e-5facd3e21252 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Getting quotas for user 8878d44956bd42e18f0409534e562ab6 and project 896c053324b34720a7d0f151bfdc8b10. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:29:43.698970 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-92aa58dc-1d31-4001-8a5e-5facd3e21252 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:29:43.705330 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-92aa58dc-1d31-4001-8a5e-5facd3e21252 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dea33c0b-6680-408b-b019-b035b89d859f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:29:43.802346 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-92aa58dc-1d31-4001-8a5e-5facd3e21252 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.390274 Jun 20 12:29:43.812672 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2945/5791] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:29:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1401 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:29:43.819152 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-fbc17005-ddb6-4fae-aecf-064c45d10689 req-4c818d0a-e7ae-4416-8a2b-688ed5720607 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3aa985b-f96c-40ed-ba36-89054521794d", "tag": "77968096-f5cc-4986-be10-a6a401e8ba2c"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:43.839941 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-fbc17005-ddb6-4fae-aecf-064c45d10689 req-4c818d0a-e7ae-4416-8a2b-688ed5720607 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:43.840749 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-fbc17005-ddb6-4fae-aecf-064c45d10689 req-4c818d0a-e7ae-4416-8a2b-688ed5720607 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:43.873108 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-fbc17005-ddb6-4fae-aecf-064c45d10689 req-4c818d0a-e7ae-4416-8a2b-688ed5720607 service nova] Creating event network-changed:77968096-f5cc-4986-be10-a6a401e8ba2c for instance a3aa985b-f96c-40ed-ba36-89054521794d on n-h2-master-1 Jun 20 12:29:43.885873 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-fbc17005-ddb6-4fae-aecf-064c45d10689 req-4c818d0a-e7ae-4416-8a2b-688ed5720607 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071769 Jun 20 12:29:43.886960 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2946/5792] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:29:43.899601 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ba28c267-b064-483e-9586-25417ee73a0c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:43.901615 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ba28c267-b064-483e-9586-25417ee73a0c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dea33c0b-6680-408b-b019-b035b89d859f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:43.940415 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-78970f56-e5ee-4a91-8e79-a56ac42982a4 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e653a6be497a469a9064cb754ea47fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b38619bb2f4b3e92aa9a9d5c5195b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:43.949302 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-78970f56-e5ee-4a91-8e79-a56ac42982a4 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d" status: 200 len: 1472 microversion: 2.1 time: 0.824082 Jun 20 12:29:43.964238 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2847/5793] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:43 2022] GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d => generated 1472 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:29:43.965218 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f5dc4ef9-b0fa-4d68-9b2e-d57fc4f287e6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:43.972142 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f5dc4ef9-b0fa-4d68-9b2e-d57fc4f287e6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:43.994017 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f5dc4ef9-b0fa-4d68-9b2e-d57fc4f287e6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:43.994786 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f5dc4ef9-b0fa-4d68-9b2e-d57fc4f287e6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:43.995766 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f5dc4ef9-b0fa-4d68-9b2e-d57fc4f287e6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:43.999302 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f5dc4ef9-b0fa-4d68-9b2e-d57fc4f287e6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:44.048125 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ba28c267-b064-483e-9586-25417ee73a0c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:44.078715 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ba28c267-b064-483e-9586-25417ee73a0c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f" status: 200 len: 1209 microversion: 2.1 time: 0.190281 Jun 20 12:29:44.081645 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2947/5794] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:43 2022] GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f => generated 1209 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:44.392022 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f5dc4ef9-b0fa-4d68-9b2e-d57fc4f287e6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:44.404894 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f5dc4ef9-b0fa-4d68-9b2e-d57fc4f287e6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1522 microversion: 2.1 time: 0.443646 Jun 20 12:29:44.405808 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2848/5795] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:43 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1522 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:44.984179 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9e3ff15e-baef-4d00-8ac4-7279ec55557d tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:44.985306 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9e3ff15e-baef-4d00-8ac4-7279ec55557d tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: a3aa985b-f96c-40ed-ba36-89054521794d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:45.013597 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9e3ff15e-baef-4d00-8ac4-7279ec55557d tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:45.016447 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9e3ff15e-baef-4d00-8ac4-7279ec55557d tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:45.017418 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9e3ff15e-baef-4d00-8ac4-7279ec55557d tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:45.017879 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9e3ff15e-baef-4d00-8ac4-7279ec55557d tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:45.098076 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-70aad634-2ec3-4d7f-8fe3-a305c3090445 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:45.099029 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-70aad634-2ec3-4d7f-8fe3-a305c3090445 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dea33c0b-6680-408b-b019-b035b89d859f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:45.109958 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-70aad634-2ec3-4d7f-8fe3-a305c3090445 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:45.110885 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-70aad634-2ec3-4d7f-8fe3-a305c3090445 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:45.112583 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-70aad634-2ec3-4d7f-8fe3-a305c3090445 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:45.113348 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-70aad634-2ec3-4d7f-8fe3-a305c3090445 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:45.312496 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-70aad634-2ec3-4d7f-8fe3-a305c3090445 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:45.325889 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-70aad634-2ec3-4d7f-8fe3-a305c3090445 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f" status: 200 len: 1261 microversion: 2.1 time: 0.232288 Jun 20 12:29:45.326923 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2849/5796] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:45 2022] GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f => generated 1261 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:45.391301 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9e3ff15e-baef-4d00-8ac4-7279ec55557d tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e653a6be497a469a9064cb754ea47fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b38619bb2f4b3e92aa9a9d5c5195b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:45.409095 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9e3ff15e-baef-4d00-8ac4-7279ec55557d tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d" status: 200 len: 1472 microversion: 2.1 time: 0.430882 Jun 20 12:29:45.410888 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2948/5797] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:44 2022] GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d => generated 1472 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:45.421859 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6e40b73b-701d-466c-8ebd-d5974bdab344 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:45.422784 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6e40b73b-701d-466c-8ebd-d5974bdab344 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:45.430013 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6e40b73b-701d-466c-8ebd-d5974bdab344 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:45.430475 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6e40b73b-701d-466c-8ebd-d5974bdab344 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:45.431286 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6e40b73b-701d-466c-8ebd-d5974bdab344 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:45.431947 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6e40b73b-701d-466c-8ebd-d5974bdab344 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:45.659936 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6e40b73b-701d-466c-8ebd-d5974bdab344 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:45.682484 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6e40b73b-701d-466c-8ebd-d5974bdab344 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1522 microversion: 2.1 time: 0.264374 Jun 20 12:29:45.683394 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2850/5798] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:45 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:45.731012 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f9ffe896-969e-4681-9322-8114d716415f tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:45.732517 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f9ffe896-969e-4681-9322-8114d716415f tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] [instance: 0059d853-f820-4e39-953c-133a05c6380e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:45.742052 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9ffe896-969e-4681-9322-8114d716415f tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:45.743377 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9ffe896-969e-4681-9322-8114d716415f tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:45.744803 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9ffe896-969e-4681-9322-8114d716415f tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:45.745444 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9ffe896-969e-4681-9322-8114d716415f tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:45.774276 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f9ffe896-969e-4681-9322-8114d716415f tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] 10.222.0.27 "GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.050489 Jun 20 12:29:45.780414 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2949/5799] 10.222.0.27 () {58 vars in 1292 bytes} [Mon Jun 20 12:29:45 2022] GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e/os-server-password => generated 116 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:29:46.353921 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-820f1f37-096c-4fd8-b346-f1d76a73f19f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:46.358103 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-820f1f37-096c-4fd8-b346-f1d76a73f19f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dea33c0b-6680-408b-b019-b035b89d859f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:46.385155 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-820f1f37-096c-4fd8-b346-f1d76a73f19f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:46.391207 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-820f1f37-096c-4fd8-b346-f1d76a73f19f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:46.392644 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-820f1f37-096c-4fd8-b346-f1d76a73f19f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:46.393561 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-820f1f37-096c-4fd8-b346-f1d76a73f19f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:46.429646 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0f65b9b4-4622-4cd4-a3af-3515b64f1b4c tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:46.430912 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0f65b9b4-4622-4cd4-a3af-3515b64f1b4c tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: a3aa985b-f96c-40ed-ba36-89054521794d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:46.447197 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f65b9b4-4622-4cd4-a3af-3515b64f1b4c tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:46.449301 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f65b9b4-4622-4cd4-a3af-3515b64f1b4c tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:46.450283 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f65b9b4-4622-4cd4-a3af-3515b64f1b4c tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:46.451808 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f65b9b4-4622-4cd4-a3af-3515b64f1b4c tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:46.569359 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-820f1f37-096c-4fd8-b346-f1d76a73f19f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:46.577747 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-820f1f37-096c-4fd8-b346-f1d76a73f19f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f" status: 200 len: 1261 microversion: 2.1 time: 0.236787 Jun 20 12:29:46.582258 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2851/5800] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:46 2022] GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f => generated 1261 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:46.701871 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b8df1fe3-396b-4afd-80a7-a2c6d46c2e67 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:46.703922 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b8df1fe3-396b-4afd-80a7-a2c6d46c2e67 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:46.715574 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b8df1fe3-396b-4afd-80a7-a2c6d46c2e67 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:46.716035 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b8df1fe3-396b-4afd-80a7-a2c6d46c2e67 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:46.724519 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0f65b9b4-4622-4cd4-a3af-3515b64f1b4c tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e653a6be497a469a9064cb754ea47fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b38619bb2f4b3e92aa9a9d5c5195b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:46.727257 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b8df1fe3-396b-4afd-80a7-a2c6d46c2e67 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:46.727945 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b8df1fe3-396b-4afd-80a7-a2c6d46c2e67 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:46.736938 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0f65b9b4-4622-4cd4-a3af-3515b64f1b4c tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d" status: 200 len: 1472 microversion: 2.1 time: 0.312072 Jun 20 12:29:46.749587 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2950/5801] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:46 2022] GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d => generated 1472 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:47.013097 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b8df1fe3-396b-4afd-80a7-a2c6d46c2e67 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:47.023357 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b8df1fe3-396b-4afd-80a7-a2c6d46c2e67 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1522 microversion: 2.1 time: 0.326745 Jun 20 12:29:47.024154 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2852/5802] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:46 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1522 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:29:47.600881 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fb247df5-1fad-47ef-a3bc-12e4500a6c90 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:47.602766 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fb247df5-1fad-47ef-a3bc-12e4500a6c90 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dea33c0b-6680-408b-b019-b035b89d859f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:47.613849 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fb247df5-1fad-47ef-a3bc-12e4500a6c90 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:47.614667 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fb247df5-1fad-47ef-a3bc-12e4500a6c90 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:47.616077 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fb247df5-1fad-47ef-a3bc-12e4500a6c90 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:47.616569 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fb247df5-1fad-47ef-a3bc-12e4500a6c90 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:47.759848 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-de3a69f3-b0f8-4564-ad14-15ce0f16e6e4 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:47.760654 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-de3a69f3-b0f8-4564-ad14-15ce0f16e6e4 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: a3aa985b-f96c-40ed-ba36-89054521794d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:47.770989 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fb247df5-1fad-47ef-a3bc-12e4500a6c90 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:47.796351 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-de3a69f3-b0f8-4564-ad14-15ce0f16e6e4 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:47.797363 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fb247df5-1fad-47ef-a3bc-12e4500a6c90 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f" status: 200 len: 1261 microversion: 2.1 time: 0.186691 Jun 20 12:29:47.798631 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2951/5803] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:47 2022] GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f => generated 1261 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:47.799633 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-de3a69f3-b0f8-4564-ad14-15ce0f16e6e4 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:47.800666 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-de3a69f3-b0f8-4564-ad14-15ce0f16e6e4 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:47.801242 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-de3a69f3-b0f8-4564-ad14-15ce0f16e6e4 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:48.042039 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-44e21cc3-fed0-4247-a2d2-1defc1ba08bf tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:48.043054 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-44e21cc3-fed0-4247-a2d2-1defc1ba08bf tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:48.058435 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-44e21cc3-fed0-4247-a2d2-1defc1ba08bf tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:48.058718 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-44e21cc3-fed0-4247-a2d2-1defc1ba08bf tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:48.061674 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-44e21cc3-fed0-4247-a2d2-1defc1ba08bf tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:48.062350 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-44e21cc3-fed0-4247-a2d2-1defc1ba08bf tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:48.202970 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:48.394902 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-de3a69f3-b0f8-4564-ad14-15ce0f16e6e4 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e653a6be497a469a9064cb754ea47fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b38619bb2f4b3e92aa9a9d5c5195b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:48.438644 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-de3a69f3-b0f8-4564-ad14-15ce0f16e6e4 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d" status: 200 len: 1472 microversion: 2.1 time: 0.685839 Jun 20 12:29:48.451354 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2853/5804] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:47 2022] GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d => generated 1472 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:48.817450 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-820c015b-122c-40db-a898-79bc37952b4d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:48.818091 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-820c015b-122c-40db-a898-79bc37952b4d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dea33c0b-6680-408b-b019-b035b89d859f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:48.831765 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-820c015b-122c-40db-a898-79bc37952b4d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:48.832249 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-820c015b-122c-40db-a898-79bc37952b4d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:48.834886 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-820c015b-122c-40db-a898-79bc37952b4d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:48.836566 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-820c015b-122c-40db-a898-79bc37952b4d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:48.912803 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-44e21cc3-fed0-4247-a2d2-1defc1ba08bf tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:48.930749 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-44e21cc3-fed0-4247-a2d2-1defc1ba08bf tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1522 microversion: 2.1 time: 0.893345 Jun 20 12:29:48.931379 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2952/5805] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:48 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1522 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:49.456451 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-254106b0-c9fb-4506-b29e-95c1c361a9ba tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:49.457231 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-254106b0-c9fb-4506-b29e-95c1c361a9ba tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: a3aa985b-f96c-40ed-ba36-89054521794d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:49.467410 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-254106b0-c9fb-4506-b29e-95c1c361a9ba tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:49.468330 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-254106b0-c9fb-4506-b29e-95c1c361a9ba tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:49.469500 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-254106b0-c9fb-4506-b29e-95c1c361a9ba tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:49.470182 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-254106b0-c9fb-4506-b29e-95c1c361a9ba tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:49.611877 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-820c015b-122c-40db-a898-79bc37952b4d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:49.624595 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-820c015b-122c-40db-a898-79bc37952b4d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f" status: 200 len: 1267 microversion: 2.1 time: 0.812708 Jun 20 12:29:49.625310 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2854/5806] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:48 2022] GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f => generated 1267 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:49.689534 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-254106b0-c9fb-4506-b29e-95c1c361a9ba tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e653a6be497a469a9064cb754ea47fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b38619bb2f4b3e92aa9a9d5c5195b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:49.698049 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-254106b0-c9fb-4506-b29e-95c1c361a9ba tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d" status: 200 len: 1472 microversion: 2.1 time: 0.246155 Jun 20 12:29:49.700761 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2953/5807] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:49 2022] GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d => generated 1472 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:29:49.949072 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2469678f-7b44-41df-9c1d-cc2e5fce707b tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:49.952648 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2469678f-7b44-41df-9c1d-cc2e5fce707b tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:49.967145 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2469678f-7b44-41df-9c1d-cc2e5fce707b tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:49.969039 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2469678f-7b44-41df-9c1d-cc2e5fce707b tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:49.971366 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2469678f-7b44-41df-9c1d-cc2e5fce707b tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:49.972375 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2469678f-7b44-41df-9c1d-cc2e5fce707b tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:50.266423 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2469678f-7b44-41df-9c1d-cc2e5fce707b tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:50.290823 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2469678f-7b44-41df-9c1d-cc2e5fce707b tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1522 microversion: 2.1 time: 0.345297 Jun 20 12:29:50.291536 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2855/5808] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:49 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:50.644110 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-faa07d07-1ad4-4570-92b5-16c5cd27a53f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:50.644791 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-faa07d07-1ad4-4570-92b5-16c5cd27a53f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dea33c0b-6680-408b-b019-b035b89d859f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:50.653244 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-faa07d07-1ad4-4570-92b5-16c5cd27a53f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:50.654025 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-faa07d07-1ad4-4570-92b5-16c5cd27a53f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:50.655012 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-faa07d07-1ad4-4570-92b5-16c5cd27a53f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:50.655636 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-faa07d07-1ad4-4570-92b5-16c5cd27a53f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:50.721627 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6c35a966-37b8-47a5-a12f-811655abe569 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:50.725169 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6c35a966-37b8-47a5-a12f-811655abe569 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: a3aa985b-f96c-40ed-ba36-89054521794d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:50.749675 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6c35a966-37b8-47a5-a12f-811655abe569 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:50.750040 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6c35a966-37b8-47a5-a12f-811655abe569 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:50.750829 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6c35a966-37b8-47a5-a12f-811655abe569 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:50.751259 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6c35a966-37b8-47a5-a12f-811655abe569 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:51.014868 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-faa07d07-1ad4-4570-92b5-16c5cd27a53f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:51.017985 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:51.031101 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-faa07d07-1ad4-4570-92b5-16c5cd27a53f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f" status: 200 len: 1309 microversion: 2.1 time: 0.387716 Jun 20 12:29:51.043250 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2954/5809] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:50 2022] GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f => generated 1309 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:51.160528 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6c35a966-37b8-47a5-a12f-811655abe569 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e653a6be497a469a9064cb754ea47fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b38619bb2f4b3e92aa9a9d5c5195b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:51.172737 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6c35a966-37b8-47a5-a12f-811655abe569 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d" status: 200 len: 1472 microversion: 2.1 time: 0.455595 Jun 20 12:29:51.178209 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2856/5810] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:50 2022] GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d => generated 1472 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:29:51.308861 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ebafed67-0aeb-4e03-9435-c229cb7630c5 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:51.309488 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ebafed67-0aeb-4e03-9435-c229cb7630c5 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:51.326470 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebafed67-0aeb-4e03-9435-c229cb7630c5 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:51.327363 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebafed67-0aeb-4e03-9435-c229cb7630c5 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:51.328409 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebafed67-0aeb-4e03-9435-c229cb7630c5 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:51.329028 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebafed67-0aeb-4e03-9435-c229cb7630c5 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:51.454974 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-9ba4a452-5715-4d92-9832-ee2de225c4c3 req-091e94b7-68f2-4dcb-b063-1fbb75ecc0e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3aa985b-f96c-40ed-ba36-89054521794d", "name": "network-vif-plugged", "status": "completed", "tag": "77968096-f5cc-4986-be10-a6a401e8ba2c"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:51.467427 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9ba4a452-5715-4d92-9832-ee2de225c4c3 req-091e94b7-68f2-4dcb-b063-1fbb75ecc0e8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:51.467870 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9ba4a452-5715-4d92-9832-ee2de225c4c3 req-091e94b7-68f2-4dcb-b063-1fbb75ecc0e8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:51.476629 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:51.514686 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-9ba4a452-5715-4d92-9832-ee2de225c4c3 req-091e94b7-68f2-4dcb-b063-1fbb75ecc0e8 service nova] Creating event network-vif-plugged:77968096-f5cc-4986-be10-a6a401e8ba2c for instance a3aa985b-f96c-40ed-ba36-89054521794d on n-h2-master-1 Jun 20 12:29:51.527089 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-9ba4a452-5715-4d92-9832-ee2de225c4c3 req-091e94b7-68f2-4dcb-b063-1fbb75ecc0e8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075960 Jun 20 12:29:51.527523 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2857/5811] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:29:51.819613 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-52d960f5-9b4b-4119-9dfb-ae43f4104a85 req-235e46cb-aff0-4634-88be-f1b1a4987465 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dea33c0b-6680-408b-b019-b035b89d859f", "tag": "10bd3d0a-4ec7-48b6-b102-02e762451a60"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:51.837733 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-52d960f5-9b4b-4119-9dfb-ae43f4104a85 req-235e46cb-aff0-4634-88be-f1b1a4987465 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:51.838459 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-52d960f5-9b4b-4119-9dfb-ae43f4104a85 req-235e46cb-aff0-4634-88be-f1b1a4987465 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:51.870915 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-52d960f5-9b4b-4119-9dfb-ae43f4104a85 req-235e46cb-aff0-4634-88be-f1b1a4987465 service nova] Creating event network-changed:10bd3d0a-4ec7-48b6-b102-02e762451a60 for instance dea33c0b-6680-408b-b019-b035b89d859f on n-h2-master-1 Jun 20 12:29:51.881438 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-52d960f5-9b4b-4119-9dfb-ae43f4104a85 req-235e46cb-aff0-4634-88be-f1b1a4987465 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063502 Jun 20 12:29:51.884741 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2858/5812] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:29:51.915066 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ebafed67-0aeb-4e03-9435-c229cb7630c5 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:51.927346 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ebafed67-0aeb-4e03-9435-c229cb7630c5 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1522 microversion: 2.1 time: 0.622933 Jun 20 12:29:51.928702 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2955/5813] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:51 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1522 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:52.051714 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b0a419a0-d33c-4d54-9e2c-71ead326d90a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:52.052384 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b0a419a0-d33c-4d54-9e2c-71ead326d90a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dea33c0b-6680-408b-b019-b035b89d859f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:52.072816 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b0a419a0-d33c-4d54-9e2c-71ead326d90a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:52.073284 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b0a419a0-d33c-4d54-9e2c-71ead326d90a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:52.074095 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b0a419a0-d33c-4d54-9e2c-71ead326d90a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:52.082833 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b0a419a0-d33c-4d54-9e2c-71ead326d90a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:52.200307 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-22b2e3b7-8b13-4d0a-b35f-b95b0f7e5134 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:52.201855 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-22b2e3b7-8b13-4d0a-b35f-b95b0f7e5134 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: a3aa985b-f96c-40ed-ba36-89054521794d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:52.219369 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-22b2e3b7-8b13-4d0a-b35f-b95b0f7e5134 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:52.219865 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-22b2e3b7-8b13-4d0a-b35f-b95b0f7e5134 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:52.220732 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-22b2e3b7-8b13-4d0a-b35f-b95b0f7e5134 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:52.221182 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-22b2e3b7-8b13-4d0a-b35f-b95b0f7e5134 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:52.350435 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b0a419a0-d33c-4d54-9e2c-71ead326d90a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:52.360060 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b0a419a0-d33c-4d54-9e2c-71ead326d90a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f" status: 200 len: 1309 microversion: 2.1 time: 0.314619 Jun 20 12:29:52.362712 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2859/5814] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:52 2022] GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f => generated 1309 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:52.584134 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-22b2e3b7-8b13-4d0a-b35f-b95b0f7e5134 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e653a6be497a469a9064cb754ea47fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b38619bb2f4b3e92aa9a9d5c5195b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:52.597611 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-22b2e3b7-8b13-4d0a-b35f-b95b0f7e5134 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d" status: 200 len: 1472 microversion: 2.1 time: 0.406847 Jun 20 12:29:52.598905 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2956/5815] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:52 2022] GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d => generated 1472 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:52.945966 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-95d5a9ea-6b87-46b8-bd45-ce5df18adec1 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:52.946777 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-95d5a9ea-6b87-46b8-bd45-ce5df18adec1 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:52.954399 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95d5a9ea-6b87-46b8-bd45-ce5df18adec1 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:52.955082 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95d5a9ea-6b87-46b8-bd45-ce5df18adec1 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:52.956033 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95d5a9ea-6b87-46b8-bd45-ce5df18adec1 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:52.956665 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95d5a9ea-6b87-46b8-bd45-ce5df18adec1 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:53.198319 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-95d5a9ea-6b87-46b8-bd45-ce5df18adec1 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:53.205966 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-95d5a9ea-6b87-46b8-bd45-ce5df18adec1 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1522 microversion: 2.1 time: 0.264691 Jun 20 12:29:53.206541 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2860/5816] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:52 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:53.379260 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-07d142c7-de66-4141-8c39-c914a6db043e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:53.379915 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-07d142c7-de66-4141-8c39-c914a6db043e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dea33c0b-6680-408b-b019-b035b89d859f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:53.386968 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-07d142c7-de66-4141-8c39-c914a6db043e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:53.387426 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-07d142c7-de66-4141-8c39-c914a6db043e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:53.388236 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-07d142c7-de66-4141-8c39-c914a6db043e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:53.389266 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-07d142c7-de66-4141-8c39-c914a6db043e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:53.547827 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-07d142c7-de66-4141-8c39-c914a6db043e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:53.556146 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-07d142c7-de66-4141-8c39-c914a6db043e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f" status: 200 len: 1309 microversion: 2.1 time: 0.181029 Jun 20 12:29:53.557249 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2957/5817] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:53 2022] GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f => generated 1309 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:53.615513 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-13d0d731-ad3d-4971-8926-d0318e2e7fe5 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:53.616709 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-13d0d731-ad3d-4971-8926-d0318e2e7fe5 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: a3aa985b-f96c-40ed-ba36-89054521794d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:53.623047 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13d0d731-ad3d-4971-8926-d0318e2e7fe5 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:53.623497 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13d0d731-ad3d-4971-8926-d0318e2e7fe5 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:53.624294 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13d0d731-ad3d-4971-8926-d0318e2e7fe5 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:53.624727 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13d0d731-ad3d-4971-8926-d0318e2e7fe5 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:53.791879 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-13d0d731-ad3d-4971-8926-d0318e2e7fe5 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e653a6be497a469a9064cb754ea47fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b38619bb2f4b3e92aa9a9d5c5195b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:53.802104 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-13d0d731-ad3d-4971-8926-d0318e2e7fe5 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d" status: 200 len: 1472 microversion: 2.1 time: 0.190467 Jun 20 12:29:53.802794 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2861/5818] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:53 2022] GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d => generated 1472 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:54.229571 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fb1741b9-dec5-4fcc-951b-204872e2f57c tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:54.231022 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fb1741b9-dec5-4fcc-951b-204872e2f57c tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:54.251009 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=4 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:54.252786 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=14 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:54.268494 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fb1741b9-dec5-4fcc-951b-204872e2f57c tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:54.269462 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fb1741b9-dec5-4fcc-951b-204872e2f57c tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:54.270541 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fb1741b9-dec5-4fcc-951b-204872e2f57c tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:54.271230 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fb1741b9-dec5-4fcc-951b-204872e2f57c tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:54.538644 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fb1741b9-dec5-4fcc-951b-204872e2f57c tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:54.548433 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fb1741b9-dec5-4fcc-951b-204872e2f57c tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1522 microversion: 2.1 time: 0.327670 Jun 20 12:29:54.560163 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2958/5819] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:54 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1522 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:54.573402 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dbfdd850-7686-4efb-b972-fd9bb328c79a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:54.575454 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-dbfdd850-7686-4efb-b972-fd9bb328c79a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dea33c0b-6680-408b-b019-b035b89d859f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:54.588529 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dbfdd850-7686-4efb-b972-fd9bb328c79a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:54.588977 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dbfdd850-7686-4efb-b972-fd9bb328c79a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:54.589753 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dbfdd850-7686-4efb-b972-fd9bb328c79a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:54.590187 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dbfdd850-7686-4efb-b972-fd9bb328c79a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:54.748537 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-dbfdd850-7686-4efb-b972-fd9bb328c79a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:54.761398 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dbfdd850-7686-4efb-b972-fd9bb328c79a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f" status: 200 len: 1309 microversion: 2.1 time: 0.191971 Jun 20 12:29:54.762290 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2862/5820] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:54 2022] GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f => generated 1309 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:54.821016 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-49491fd5-5cb8-4c6f-8319-de3a55d90893 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:54.822144 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-49491fd5-5cb8-4c6f-8319-de3a55d90893 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: a3aa985b-f96c-40ed-ba36-89054521794d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:54.829698 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-49491fd5-5cb8-4c6f-8319-de3a55d90893 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:54.830179 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-49491fd5-5cb8-4c6f-8319-de3a55d90893 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:54.831375 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-49491fd5-5cb8-4c6f-8319-de3a55d90893 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:54.831939 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-49491fd5-5cb8-4c6f-8319-de3a55d90893 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:54.999934 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-49491fd5-5cb8-4c6f-8319-de3a55d90893 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e653a6be497a469a9064cb754ea47fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b38619bb2f4b3e92aa9a9d5c5195b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:55.009300 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-49491fd5-5cb8-4c6f-8319-de3a55d90893 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d" status: 200 len: 1472 microversion: 2.1 time: 0.193881 Jun 20 12:29:55.012808 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2959/5821] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:54 2022] GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d => generated 1472 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:55.567044 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e098ee8a-daca-460c-9627-1d5db00b3780 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:55.567818 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e098ee8a-daca-460c-9627-1d5db00b3780 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:55.574491 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e098ee8a-daca-460c-9627-1d5db00b3780 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:55.575304 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e098ee8a-daca-460c-9627-1d5db00b3780 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:55.576188 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e098ee8a-daca-460c-9627-1d5db00b3780 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:55.576746 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e098ee8a-daca-460c-9627-1d5db00b3780 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:55.731616 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e098ee8a-daca-460c-9627-1d5db00b3780 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:55.739793 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e098ee8a-daca-460c-9627-1d5db00b3780 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1522 microversion: 2.1 time: 0.176736 Jun 20 12:29:55.740978 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2863/5822] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:55 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:55.778581 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ef9a8df0-b96d-4554-abfe-9dc71cd2170f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:55.779302 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ef9a8df0-b96d-4554-abfe-9dc71cd2170f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dea33c0b-6680-408b-b019-b035b89d859f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:55.786765 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef9a8df0-b96d-4554-abfe-9dc71cd2170f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:55.787469 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef9a8df0-b96d-4554-abfe-9dc71cd2170f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:55.788454 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef9a8df0-b96d-4554-abfe-9dc71cd2170f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:55.789057 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef9a8df0-b96d-4554-abfe-9dc71cd2170f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:55.937715 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ef9a8df0-b96d-4554-abfe-9dc71cd2170f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:55.947262 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ef9a8df0-b96d-4554-abfe-9dc71cd2170f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f" status: 200 len: 1309 microversion: 2.1 time: 0.172149 Jun 20 12:29:55.947874 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2960/5823] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:55 2022] GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f => generated 1309 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:56.030370 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-80e4b260-6b25-4663-9dea-2170e3fb2169 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:56.031227 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-80e4b260-6b25-4663-9dea-2170e3fb2169 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: a3aa985b-f96c-40ed-ba36-89054521794d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:56.038504 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80e4b260-6b25-4663-9dea-2170e3fb2169 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:56.038793 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80e4b260-6b25-4663-9dea-2170e3fb2169 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:56.040362 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80e4b260-6b25-4663-9dea-2170e3fb2169 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:56.040864 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80e4b260-6b25-4663-9dea-2170e3fb2169 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:56.236730 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-80e4b260-6b25-4663-9dea-2170e3fb2169 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e653a6be497a469a9064cb754ea47fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b38619bb2f4b3e92aa9a9d5c5195b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:56.251362 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-80e4b260-6b25-4663-9dea-2170e3fb2169 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d" status: 200 len: 1472 microversion: 2.1 time: 0.224216 Jun 20 12:29:56.253494 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2864/5824] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:56 2022] GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d => generated 1472 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:56.758468 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-839a2580-6341-4240-908a-0501b6a36895 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:56.759063 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-839a2580-6341-4240-908a-0501b6a36895 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:56.768116 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-839a2580-6341-4240-908a-0501b6a36895 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:56.768116 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-839a2580-6341-4240-908a-0501b6a36895 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:56.769453 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-839a2580-6341-4240-908a-0501b6a36895 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:56.769453 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-839a2580-6341-4240-908a-0501b6a36895 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:56.971285 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6029af09-a357-4994-ab58-9636eeb90fae tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:56.972491 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6029af09-a357-4994-ab58-9636eeb90fae tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dea33c0b-6680-408b-b019-b035b89d859f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:56.981923 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6029af09-a357-4994-ab58-9636eeb90fae tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:56.982633 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6029af09-a357-4994-ab58-9636eeb90fae tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:56.983523 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6029af09-a357-4994-ab58-9636eeb90fae tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:56.984167 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6029af09-a357-4994-ab58-9636eeb90fae tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:57.012393 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-839a2580-6341-4240-908a-0501b6a36895 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:57.021454 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-839a2580-6341-4240-908a-0501b6a36895 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1522 microversion: 2.1 time: 0.267155 Jun 20 12:29:57.032500 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2961/5825] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:56 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:57.269681 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ff8648d9-d76a-4ce9-a845-85a1742789dc tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:57.270875 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6029af09-a357-4994-ab58-9636eeb90fae tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:57.271390 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ff8648d9-d76a-4ce9-a845-85a1742789dc tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: a3aa985b-f96c-40ed-ba36-89054521794d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:57.283152 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff8648d9-d76a-4ce9-a845-85a1742789dc tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:57.283634 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff8648d9-d76a-4ce9-a845-85a1742789dc tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:57.284484 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff8648d9-d76a-4ce9-a845-85a1742789dc tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:57.284925 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff8648d9-d76a-4ce9-a845-85a1742789dc tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:57.285104 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6029af09-a357-4994-ab58-9636eeb90fae tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f" status: 200 len: 1309 microversion: 2.1 time: 0.321785 Jun 20 12:29:57.286906 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2865/5826] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:56 2022] GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f => generated 1309 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:57.871566 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ff8648d9-d76a-4ce9-a845-85a1742789dc tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e653a6be497a469a9064cb754ea47fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b38619bb2f4b3e92aa9a9d5c5195b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:57.882347 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ff8648d9-d76a-4ce9-a845-85a1742789dc tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d" status: 200 len: 1644 microversion: 2.1 time: 0.616363 Jun 20 12:29:57.883650 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2962/5827] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:57 2022] GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d => generated 1644 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:29:57.902720 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d78dce67-af84-4ed1-adef-34b667abe3a2 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:57.903727 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d78dce67-af84-4ed1-adef-34b667abe3a2 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: a3aa985b-f96c-40ed-ba36-89054521794d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:57.918399 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d78dce67-af84-4ed1-adef-34b667abe3a2 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:57.919437 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d78dce67-af84-4ed1-adef-34b667abe3a2 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:57.920620 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d78dce67-af84-4ed1-adef-34b667abe3a2 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:57.921372 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d78dce67-af84-4ed1-adef-34b667abe3a2 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:58.039870 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3c31e45a-74bc-4403-b8c7-9835e8645cad tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:58.041203 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3c31e45a-74bc-4403-b8c7-9835e8645cad tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:58.047820 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c31e45a-74bc-4403-b8c7-9835e8645cad tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:58.048540 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c31e45a-74bc-4403-b8c7-9835e8645cad tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:58.049504 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c31e45a-74bc-4403-b8c7-9835e8645cad tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:58.050283 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c31e45a-74bc-4403-b8c7-9835e8645cad tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:58.121000 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d78dce67-af84-4ed1-adef-34b667abe3a2 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e653a6be497a469a9064cb754ea47fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b38619bb2f4b3e92aa9a9d5c5195b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:58.129666 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d78dce67-af84-4ed1-adef-34b667abe3a2 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d" status: 200 len: 1644 microversion: 2.1 time: 0.234120 Jun 20 12:29:58.130515 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2866/5828] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:57 2022] GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d => generated 1644 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:58.148506 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dfe8aad4-8e9f-4add-ab7a-70341efe4602 tempest-TestSecurityGroupsBasicOps-1514337656 tempest-TestSecurityGroupsBasicOps-1514337656-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:58.149333 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-dfe8aad4-8e9f-4add-ab7a-70341efe4602 tempest-TestSecurityGroupsBasicOps-1514337656 tempest-TestSecurityGroupsBasicOps-1514337656-project-admin] [instance: a3aa985b-f96c-40ed-ba36-89054521794d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:58.159757 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dfe8aad4-8e9f-4add-ab7a-70341efe4602 tempest-TestSecurityGroupsBasicOps-1514337656 tempest-TestSecurityGroupsBasicOps-1514337656-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:58.160514 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dfe8aad4-8e9f-4add-ab7a-70341efe4602 tempest-TestSecurityGroupsBasicOps-1514337656 tempest-TestSecurityGroupsBasicOps-1514337656-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:58.161469 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dfe8aad4-8e9f-4add-ab7a-70341efe4602 tempest-TestSecurityGroupsBasicOps-1514337656 tempest-TestSecurityGroupsBasicOps-1514337656-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:58.162077 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dfe8aad4-8e9f-4add-ab7a-70341efe4602 tempest-TestSecurityGroupsBasicOps-1514337656 tempest-TestSecurityGroupsBasicOps-1514337656-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:58.255309 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3c31e45a-74bc-4403-b8c7-9835e8645cad tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:58.264600 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3c31e45a-74bc-4403-b8c7-9835e8645cad tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1522 microversion: 2.1 time: 0.228927 Jun 20 12:29:58.275255 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2963/5829] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:58 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:29:58.304328 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9c8d1f49-3fd3-4363-bbe9-48610635db03 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:58.305288 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9c8d1f49-3fd3-4363-bbe9-48610635db03 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dea33c0b-6680-408b-b019-b035b89d859f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:58.318329 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9c8d1f49-3fd3-4363-bbe9-48610635db03 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:58.319192 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9c8d1f49-3fd3-4363-bbe9-48610635db03 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:58.322591 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9c8d1f49-3fd3-4363-bbe9-48610635db03 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:58.323278 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9c8d1f49-3fd3-4363-bbe9-48610635db03 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:58.541371 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dfe8aad4-8e9f-4add-ab7a-70341efe4602 tempest-TestSecurityGroupsBasicOps-1514337656 tempest-TestSecurityGroupsBasicOps-1514337656-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d" status: 200 len: 1795 microversion: 2.1 time: 0.398873 Jun 20 12:29:58.543188 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2867/5830] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:58 2022] GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d => generated 1795 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:58.645195 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9c8d1f49-3fd3-4363-bbe9-48610635db03 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:58.655985 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9c8d1f49-3fd3-4363-bbe9-48610635db03 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f" status: 200 len: 1309 microversion: 2.1 time: 0.356175 Jun 20 12:29:58.661702 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2964/5831] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:58 2022] GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f => generated 1309 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:59.284343 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3599b233-5d8d-42af-8609-7a02f40c0149 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:59.284343 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3599b233-5d8d-42af-8609-7a02f40c0149 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:59.288252 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:59.323923 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3599b233-5d8d-42af-8609-7a02f40c0149 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:59.325083 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3599b233-5d8d-42af-8609-7a02f40c0149 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:59.326632 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3599b233-5d8d-42af-8609-7a02f40c0149 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:59.329076 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3599b233-5d8d-42af-8609-7a02f40c0149 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:59.615649 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3599b233-5d8d-42af-8609-7a02f40c0149 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:59.625366 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3599b233-5d8d-42af-8609-7a02f40c0149 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1522 microversion: 2.1 time: 0.346835 Jun 20 12:29:59.625970 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2868/5832] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:59 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:59.678656 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-387cfe05-ccdd-4c66-8d37-a6033b0a2c1d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:59.679373 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-387cfe05-ccdd-4c66-8d37-a6033b0a2c1d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dea33c0b-6680-408b-b019-b035b89d859f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:59.692749 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-387cfe05-ccdd-4c66-8d37-a6033b0a2c1d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:59.693468 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-387cfe05-ccdd-4c66-8d37-a6033b0a2c1d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:59.694609 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-387cfe05-ccdd-4c66-8d37-a6033b0a2c1d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:59.694820 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-387cfe05-ccdd-4c66-8d37-a6033b0a2c1d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:00.224141 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-387cfe05-ccdd-4c66-8d37-a6033b0a2c1d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:00.252058 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-387cfe05-ccdd-4c66-8d37-a6033b0a2c1d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f" status: 200 len: 1309 microversion: 2.1 time: 0.577596 Jun 20 12:30:00.256843 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2965/5833] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:59 2022] GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f => generated 1309 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:00.642795 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-74efc58e-23b0-4788-b292-535736b59dd2 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:00.644157 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-74efc58e-23b0-4788-b292-535736b59dd2 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:00.653496 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-74efc58e-23b0-4788-b292-535736b59dd2 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:00.665075 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-74efc58e-23b0-4788-b292-535736b59dd2 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:00.665990 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-74efc58e-23b0-4788-b292-535736b59dd2 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:00.666437 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-74efc58e-23b0-4788-b292-535736b59dd2 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:00.940747 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-74efc58e-23b0-4788-b292-535736b59dd2 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:00.960331 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-74efc58e-23b0-4788-b292-535736b59dd2 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1522 microversion: 2.1 time: 0.322322 Jun 20 12:30:00.960939 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2869/5834] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:00 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:01.054626 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-a8f15dcb-c215-4da0-a3f4-ec551ecdf2bf req-d8f10166-fe68-42e3-b8cb-c37bcbfb64d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dea33c0b-6680-408b-b019-b035b89d859f", "name": "network-vif-plugged", "status": "completed", "tag": "10bd3d0a-4ec7-48b6-b102-02e762451a60"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:30:01.079987 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-a8f15dcb-c215-4da0-a3f4-ec551ecdf2bf req-d8f10166-fe68-42e3-b8cb-c37bcbfb64d8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:01.081338 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-a8f15dcb-c215-4da0-a3f4-ec551ecdf2bf req-d8f10166-fe68-42e3-b8cb-c37bcbfb64d8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:01.099186 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-a8f15dcb-c215-4da0-a3f4-ec551ecdf2bf req-d8f10166-fe68-42e3-b8cb-c37bcbfb64d8 service nova] Creating event network-vif-plugged:10bd3d0a-4ec7-48b6-b102-02e762451a60 for instance dea33c0b-6680-408b-b019-b035b89d859f on n-h2-master-1 Jun 20 12:30:01.107329 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-a8f15dcb-c215-4da0-a3f4-ec551ecdf2bf req-d8f10166-fe68-42e3-b8cb-c37bcbfb64d8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057947 Jun 20 12:30:01.109329 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2966/5835] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:30:01.272924 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a5008e8d-0937-4305-b18c-e8348686f38d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:01.275299 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a5008e8d-0937-4305-b18c-e8348686f38d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dea33c0b-6680-408b-b019-b035b89d859f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:01.287152 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a5008e8d-0937-4305-b18c-e8348686f38d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:01.288090 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a5008e8d-0937-4305-b18c-e8348686f38d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:01.289981 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a5008e8d-0937-4305-b18c-e8348686f38d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:01.290692 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a5008e8d-0937-4305-b18c-e8348686f38d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:01.631717 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a5008e8d-0937-4305-b18c-e8348686f38d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:01.647757 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a5008e8d-0937-4305-b18c-e8348686f38d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f" status: 200 len: 1309 microversion: 2.1 time: 0.379023 Jun 20 12:30:01.661450 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2870/5836] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:01 2022] GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f => generated 1309 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:01.868625 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-52b07868-564b-47b6-a088-baecabab59a4 req-a3bd42fb-9dba-4c76-b431-a21f8da86642 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3aa985b-f96c-40ed-ba36-89054521794d", "tag": "77968096-f5cc-4986-be10-a6a401e8ba2c"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:30:01.901345 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-52b07868-564b-47b6-a088-baecabab59a4 req-a3bd42fb-9dba-4c76-b431-a21f8da86642 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:01.905782 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-52b07868-564b-47b6-a088-baecabab59a4 req-a3bd42fb-9dba-4c76-b431-a21f8da86642 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:01.937239 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-52b07868-564b-47b6-a088-baecabab59a4 req-a3bd42fb-9dba-4c76-b431-a21f8da86642 service nova] Creating event network-changed:77968096-f5cc-4986-be10-a6a401e8ba2c for instance a3aa985b-f96c-40ed-ba36-89054521794d on n-h2-master-1 Jun 20 12:30:01.949786 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-52b07868-564b-47b6-a088-baecabab59a4 req-a3bd42fb-9dba-4c76-b431-a21f8da86642 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087319 Jun 20 12:30:01.954578 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2967/5837] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:30:01.977252 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-20bf058c-c7bb-475b-8516-61e139afcceb tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:01.978471 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-20bf058c-c7bb-475b-8516-61e139afcceb tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:01.985357 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-20bf058c-c7bb-475b-8516-61e139afcceb tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:01.986165 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-20bf058c-c7bb-475b-8516-61e139afcceb tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:01.987536 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-20bf058c-c7bb-475b-8516-61e139afcceb tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:01.988232 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-20bf058c-c7bb-475b-8516-61e139afcceb tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:02.327145 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-20bf058c-c7bb-475b-8516-61e139afcceb tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:02.349054 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-20bf058c-c7bb-475b-8516-61e139afcceb tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1522 microversion: 2.1 time: 0.375884 Jun 20 12:30:02.364249 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2871/5838] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:01 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:02.687359 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-53ae36cd-29c3-40cb-af3e-27794bf28910 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:02.692111 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-53ae36cd-29c3-40cb-af3e-27794bf28910 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dea33c0b-6680-408b-b019-b035b89d859f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:02.720843 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-53ae36cd-29c3-40cb-af3e-27794bf28910 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:02.721364 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-53ae36cd-29c3-40cb-af3e-27794bf28910 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:02.722230 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-53ae36cd-29c3-40cb-af3e-27794bf28910 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:02.724769 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-53ae36cd-29c3-40cb-af3e-27794bf28910 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:03.090025 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-53ae36cd-29c3-40cb-af3e-27794bf28910 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:03.111271 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-53ae36cd-29c3-40cb-af3e-27794bf28910 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f" status: 200 len: 1309 microversion: 2.1 time: 0.449868 Jun 20 12:30:03.112820 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2968/5839] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:02 2022] GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f => generated 1309 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:03.375063 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-82f47181-4644-482a-84a9-d682b53c9ef1 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:03.376335 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-82f47181-4644-482a-84a9-d682b53c9ef1 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:03.387008 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-82f47181-4644-482a-84a9-d682b53c9ef1 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:03.389689 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-82f47181-4644-482a-84a9-d682b53c9ef1 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:03.390702 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-82f47181-4644-482a-84a9-d682b53c9ef1 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:03.392818 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-82f47181-4644-482a-84a9-d682b53c9ef1 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:04.112174 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-82f47181-4644-482a-84a9-d682b53c9ef1 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:04.128907 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-82f47181-4644-482a-84a9-d682b53c9ef1 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1522 microversion: 2.1 time: 0.757831 Jun 20 12:30:04.130165 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2872/5840] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:03 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1522 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:04.138660 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0f245c1d-f21d-4d0c-b042-b6eb0eb5a21f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:04.139320 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0f245c1d-f21d-4d0c-b042-b6eb0eb5a21f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dea33c0b-6680-408b-b019-b035b89d859f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:04.153219 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f245c1d-f21d-4d0c-b042-b6eb0eb5a21f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:04.158980 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f245c1d-f21d-4d0c-b042-b6eb0eb5a21f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:04.159980 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f245c1d-f21d-4d0c-b042-b6eb0eb5a21f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:04.160613 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f245c1d-f21d-4d0c-b042-b6eb0eb5a21f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:04.478270 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0f245c1d-f21d-4d0c-b042-b6eb0eb5a21f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:04.488985 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0f245c1d-f21d-4d0c-b042-b6eb0eb5a21f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f" status: 200 len: 1490 microversion: 2.1 time: 0.362864 Jun 20 12:30:04.494624 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2969/5841] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:04 2022] GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f => generated 1490 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:04.511448 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-74030521-194a-4e60-a0fc-3ca9f2ffa43b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:30:04.513015 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-74030521-194a-4e60-a0fc-3ca9f2ffa43b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dea33c0b-6680-408b-b019-b035b89d859f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:04.530456 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-74030521-194a-4e60-a0fc-3ca9f2ffa43b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:04.530911 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-74030521-194a-4e60-a0fc-3ca9f2ffa43b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:04.531809 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-74030521-194a-4e60-a0fc-3ca9f2ffa43b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:04.532266 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-74030521-194a-4e60-a0fc-3ca9f2ffa43b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:04.690062 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-74030521-194a-4e60-a0fc-3ca9f2ffa43b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "PUT /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f" status: 200 len: 1085 microversion: 2.1 time: 0.180327 Jun 20 12:30:04.695884 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2873/5842] 10.222.0.27 () {60 vars in 1255 bytes} [Mon Jun 20 12:30:04 2022] PUT /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f => generated 1085 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:30:04.711917 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-eae12555-f401-445d-8f5c-ba152070f6d3 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:04.712977 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-eae12555-f401-445d-8f5c-ba152070f6d3 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dea33c0b-6680-408b-b019-b035b89d859f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:04.746940 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eae12555-f401-445d-8f5c-ba152070f6d3 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:04.751188 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eae12555-f401-445d-8f5c-ba152070f6d3 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:04.753265 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eae12555-f401-445d-8f5c-ba152070f6d3 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:04.760910 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eae12555-f401-445d-8f5c-ba152070f6d3 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:05.034587 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-eae12555-f401-445d-8f5c-ba152070f6d3 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:05.047414 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-eae12555-f401-445d-8f5c-ba152070f6d3 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f" status: 200 len: 1511 microversion: 2.1 time: 0.340406 Jun 20 12:30:05.048828 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2970/5843] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:04 2022] GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f => generated 1511 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:05.069296 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-52262c5d-ca1b-46a2-bc30-c0a113f8cbf4 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:05.070135 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-52262c5d-ca1b-46a2-bc30-c0a113f8cbf4 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dea33c0b-6680-408b-b019-b035b89d859f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:05.082083 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-52262c5d-ca1b-46a2-bc30-c0a113f8cbf4 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:05.084724 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-52262c5d-ca1b-46a2-bc30-c0a113f8cbf4 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:05.089064 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-52262c5d-ca1b-46a2-bc30-c0a113f8cbf4 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:05.090893 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-52262c5d-ca1b-46a2-bc30-c0a113f8cbf4 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:05.112225 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:05.150448 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e0021e16-ffa2-4e3b-9361-9fe23720e324 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:05.151864 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e0021e16-ffa2-4e3b-9361-9fe23720e324 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:05.167697 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e0021e16-ffa2-4e3b-9361-9fe23720e324 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:05.168653 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e0021e16-ffa2-4e3b-9361-9fe23720e324 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:05.169865 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e0021e16-ffa2-4e3b-9361-9fe23720e324 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:05.170653 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e0021e16-ffa2-4e3b-9361-9fe23720e324 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:05.258005 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-52262c5d-ca1b-46a2-bc30-c0a113f8cbf4 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:05.267095 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-52262c5d-ca1b-46a2-bc30-c0a113f8cbf4 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f" status: 200 len: 1511 microversion: 2.1 time: 0.203192 Jun 20 12:30:05.268011 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2874/5844] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:05 2022] GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f => generated 1511 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:05.288246 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-43f715b0-5448-43eb-9144-6a240f096cd9 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:05.288741 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-43f715b0-5448-43eb-9144-6a240f096cd9 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dea33c0b-6680-408b-b019-b035b89d859f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:05.298724 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-43f715b0-5448-43eb-9144-6a240f096cd9 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:05.299179 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-43f715b0-5448-43eb-9144-6a240f096cd9 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:05.299959 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-43f715b0-5448-43eb-9144-6a240f096cd9 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:05.300462 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-43f715b0-5448-43eb-9144-6a240f096cd9 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:05.360628 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-43f715b0-5448-43eb-9144-6a240f096cd9 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dea33c0b-6680-408b-b019-b035b89d859f] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:30:05.366757 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e0021e16-ffa2-4e3b-9361-9fe23720e324 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:05.377449 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e0021e16-ffa2-4e3b-9361-9fe23720e324 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1522 microversion: 2.1 time: 0.230843 Jun 20 12:30:05.379453 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2971/5845] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:05 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:30:05.491866 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-43f715b0-5448-43eb-9144-6a240f096cd9 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f" status: 204 len: 0 microversion: 2.1 time: 0.206986 Jun 20 12:30:05.493372 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2875/5846] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:30:05 2022] DELETE /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 12:30:05.502400 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-50f994d2-d6e3-4793-a901-59498657844b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:05.503397 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-50f994d2-d6e3-4793-a901-59498657844b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dea33c0b-6680-408b-b019-b035b89d859f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:05.536258 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-50f994d2-d6e3-4793-a901-59498657844b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:05.537598 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-50f994d2-d6e3-4793-a901-59498657844b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:05.541291 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-50f994d2-d6e3-4793-a901-59498657844b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:05.543207 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-50f994d2-d6e3-4793-a901-59498657844b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:05.815433 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-50f994d2-d6e3-4793-a901-59498657844b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:05.819309 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:05.828054 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-50f994d2-d6e3-4793-a901-59498657844b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f" status: 200 len: 1517 microversion: 2.1 time: 0.330326 Jun 20 12:30:05.832237 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2972/5847] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:05 2022] GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f => generated 1517 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:06.397068 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e37d47fe-8529-4349-b0c2-44bd291218c1 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:06.397670 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e37d47fe-8529-4349-b0c2-44bd291218c1 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:06.405388 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e37d47fe-8529-4349-b0c2-44bd291218c1 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:06.405845 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e37d47fe-8529-4349-b0c2-44bd291218c1 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:06.406614 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e37d47fe-8529-4349-b0c2-44bd291218c1 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:06.407050 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e37d47fe-8529-4349-b0c2-44bd291218c1 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:06.630307 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e37d47fe-8529-4349-b0c2-44bd291218c1 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:06.639180 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e37d47fe-8529-4349-b0c2-44bd291218c1 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1522 microversion: 2.1 time: 0.246989 Jun 20 12:30:06.639180 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2876/5848] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:06 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:06.860594 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-607d8f8f-1b33-44f7-b1e5-4c95f305022f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:06.864774 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-607d8f8f-1b33-44f7-b1e5-4c95f305022f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dea33c0b-6680-408b-b019-b035b89d859f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:06.893576 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-607d8f8f-1b33-44f7-b1e5-4c95f305022f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:06.900460 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-607d8f8f-1b33-44f7-b1e5-4c95f305022f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:06.910225 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-607d8f8f-1b33-44f7-b1e5-4c95f305022f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:06.913915 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-607d8f8f-1b33-44f7-b1e5-4c95f305022f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:07.074832 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-607d8f8f-1b33-44f7-b1e5-4c95f305022f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:07.085046 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-607d8f8f-1b33-44f7-b1e5-4c95f305022f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f" status: 200 len: 1517 microversion: 2.1 time: 0.234803 Jun 20 12:30:07.086702 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2973/5849] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:06 2022] GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f => generated 1517 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:07.669554 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c2d4aa6a-0d62-4c5e-862c-e90d06b9c3be tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:07.670198 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c2d4aa6a-0d62-4c5e-862c-e90d06b9c3be tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:07.688312 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c2d4aa6a-0d62-4c5e-862c-e90d06b9c3be tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:07.689873 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c2d4aa6a-0d62-4c5e-862c-e90d06b9c3be tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:07.691209 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c2d4aa6a-0d62-4c5e-862c-e90d06b9c3be tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:07.692523 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c2d4aa6a-0d62-4c5e-862c-e90d06b9c3be tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:08.107959 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-305338ee-2003-4c12-85d5-5064113f7e9b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:08.108636 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-305338ee-2003-4c12-85d5-5064113f7e9b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dea33c0b-6680-408b-b019-b035b89d859f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:08.128253 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-305338ee-2003-4c12-85d5-5064113f7e9b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:08.128724 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-305338ee-2003-4c12-85d5-5064113f7e9b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:08.133293 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-305338ee-2003-4c12-85d5-5064113f7e9b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:08.134182 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-305338ee-2003-4c12-85d5-5064113f7e9b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:08.187001 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c2d4aa6a-0d62-4c5e-862c-e90d06b9c3be tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:08.200824 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c2d4aa6a-0d62-4c5e-862c-e90d06b9c3be tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1502 microversion: 2.1 time: 0.544236 Jun 20 12:30:08.205060 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2877/5850] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:07 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1502 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:30:08.229286 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-be64df3c-8a00-49a9-b471-6fbfdcaaf37a req-f3d4b11a-8be4-4d76-9ef9-9429136f2471 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dea33c0b-6680-408b-b019-b035b89d859f", "name": "network-vif-deleted", "tag": "10bd3d0a-4ec7-48b6-b102-02e762451a60"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:30:08.288249 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-be64df3c-8a00-49a9-b471-6fbfdcaaf37a req-f3d4b11a-8be4-4d76-9ef9-9429136f2471 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:08.288708 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-be64df3c-8a00-49a9-b471-6fbfdcaaf37a req-f3d4b11a-8be4-4d76-9ef9-9429136f2471 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:08.330493 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-be64df3c-8a00-49a9-b471-6fbfdcaaf37a req-f3d4b11a-8be4-4d76-9ef9-9429136f2471 service nova] Creating event network-vif-deleted:10bd3d0a-4ec7-48b6-b102-02e762451a60 for instance dea33c0b-6680-408b-b019-b035b89d859f on n-h2-master-1 Jun 20 12:30:08.341657 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-be64df3c-8a00-49a9-b471-6fbfdcaaf37a req-f3d4b11a-8be4-4d76-9ef9-9429136f2471 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134134 Jun 20 12:30:08.349056 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2878/5851] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:30:08.370497 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-845637eb-997f-497a-89a0-be6952e43317 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:08.385484 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-845637eb-997f-497a-89a0-be6952e43317 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 0f46a132-c8ab-41ae-bd97-ec97591f4a4f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:08.400409 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-845637eb-997f-497a-89a0-be6952e43317 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:08.401182 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-845637eb-997f-497a-89a0-be6952e43317 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:08.408684 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-845637eb-997f-497a-89a0-be6952e43317 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:08.409518 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-845637eb-997f-497a-89a0-be6952e43317 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:08.425969 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-305338ee-2003-4c12-85d5-5064113f7e9b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:08.449635 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-305338ee-2003-4c12-85d5-5064113f7e9b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f" status: 200 len: 1475 microversion: 2.1 time: 0.345908 Jun 20 12:30:08.451275 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2974/5852] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:08 2022] GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f => generated 1475 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:08.807244 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-845637eb-997f-497a-89a0-be6952e43317 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:08.831054 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-845637eb-997f-497a-89a0-be6952e43317 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f" status: 200 len: 1515 microversion: 2.1 time: 0.479775 Jun 20 12:30:08.832437 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2879/5853] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:08 2022] GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f => generated 1515 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:08.863935 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8b4ac938-f635-43dc-9e46-b51cfd773ad3 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:30:08.866087 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8b4ac938-f635-43dc-9e46-b51cfd773ad3 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 70b46364-5bc3-43c0-80d9-e6ccb3bebbf9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:08.880017 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-8b4ac938-f635-43dc-9e46-b51cfd773ad3 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] HTTP exception thrown: Instance 70b46364-5bc3-43c0-80d9-e6ccb3bebbf9 could not be found. Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8b4ac938-f635-43dc-9e46-b51cfd773ad3 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Request method failure captured: Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers/70b46364-5bc3-43c0-80d9-e6ccb3bebbf9/action HTTP/1.1 Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 14 Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGgSaQU2kYq6294w6QFKPq7A5QMR619m5qrTtjZvOh1Spd4jYt9SdDjLdFiaQeOKoAcYDnhjBb8DNFT4026Xi2z1eTCKzFIZr5YrYMMfaIT2h-JIX2uEPuAOwR8Q0Bfw8WTyUwuKuBg3lk8BU4yAsLY8apXUbOU50Mn1Bj2k7YSVmEI Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: eed49c99a6a64e779184cfde80a29a52 Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2064933160 Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eed49c99a6a64e779184cfde80a29a52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eed49c99a6a64e779184cfde80a29a52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eed49c99a6a64e779184cfde80a29a52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eed49c99a6a64e779184cfde80a29a52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2064933160 Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: eed49c99a6a64e779184cfde80a29a52 Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2064933160 Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServerRescueNegativeTestJSON-2064933160-project Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 8efa417e5eb04ea682201f30b003bd54 Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2064933160-project Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: {"rescue": {}} Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 70b46364-5bc3-43c0-80d9-e6ccb3bebbf9 could not be found. Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '70b46364-5bc3-43c0-80d9-e6ccb3bebbf9', 'body': {'rescue': {}}} Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70b46364-5bc3-43c0-80d9-e6ccb3bebbf9 could not be found. Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70b46364-5bc3-43c0-80d9-e6ccb3bebbf9 could not be found. Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:30:08.905445 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:08.909993 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:30:08.909993 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:30:08.909993 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:30:08.909993 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:30:08.909993 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70b46364-5bc3-43c0-80d9-e6ccb3bebbf9 could not be found. Jun 20 12:30:08.909993 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:30:08.911442 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8b4ac938-f635-43dc-9e46-b51cfd773ad3 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Returning 404 to user: Instance 70b46364-5bc3-43c0-80d9-e6ccb3bebbf9 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:30:08.913647 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8b4ac938-f635-43dc-9e46-b51cfd773ad3 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "POST /compute/v2.1/servers/70b46364-5bc3-43c0-80d9-e6ccb3bebbf9/action" status: 404 len: 111 microversion: 2.1 time: 0.054631 Jun 20 12:30:08.915082 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2975/5854] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:30:08 2022] POST /compute/v2.1/servers/70b46364-5bc3-43c0-80d9-e6ccb3bebbf9/action => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:30:08.926645 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0cd93711-1869-4070-96eb-3c15e1f431f9 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:30:08.928011 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0cd93711-1869-4070-96eb-3c15e1f431f9 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 0f46a132-c8ab-41ae-bd97-ec97591f4a4f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:08.939335 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cd93711-1869-4070-96eb-3c15e1f431f9 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:08.940165 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cd93711-1869-4070-96eb-3c15e1f431f9 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:08.942688 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cd93711-1869-4070-96eb-3c15e1f431f9 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:08.944654 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cd93711-1869-4070-96eb-3c15e1f431f9 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:09.100850 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0cd93711-1869-4070-96eb-3c15e1f431f9 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "POST /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f/action" status: 202 len: 0 microversion: 2.1 time: 0.178475 Jun 20 12:30:09.103028 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2880/5855] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:30:08 2022] POST /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:30:09.117562 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9e31dcea-127d-4e26-9add-b3b93f2ece3a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:09.118408 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9e31dcea-127d-4e26-9add-b3b93f2ece3a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 0f46a132-c8ab-41ae-bd97-ec97591f4a4f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:09.139846 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9e31dcea-127d-4e26-9add-b3b93f2ece3a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:09.140787 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9e31dcea-127d-4e26-9add-b3b93f2ece3a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:09.142294 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9e31dcea-127d-4e26-9add-b3b93f2ece3a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:09.143516 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9e31dcea-127d-4e26-9add-b3b93f2ece3a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:09.471009 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-45d81051-6ef9-4305-9120-738dd3874566 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:09.471913 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-45d81051-6ef9-4305-9120-738dd3874566 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dea33c0b-6680-408b-b019-b035b89d859f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:09.488827 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-45d81051-6ef9-4305-9120-738dd3874566 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:09.498773 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9e31dcea-127d-4e26-9add-b3b93f2ece3a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:09.500059 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-45d81051-6ef9-4305-9120-738dd3874566 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:09.501483 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-45d81051-6ef9-4305-9120-738dd3874566 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:09.511887 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9e31dcea-127d-4e26-9add-b3b93f2ece3a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f" status: 200 len: 1520 microversion: 2.1 time: 0.402330 Jun 20 12:30:09.513275 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2976/5856] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:09 2022] GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f => generated 1520 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:09.517502 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-45d81051-6ef9-4305-9120-738dd3874566 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:09.550959 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-45d81051-6ef9-4305-9120-738dd3874566 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] HTTP exception thrown: Instance dea33c0b-6680-408b-b019-b035b89d859f could not be found. Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-45d81051-6ef9-4305-9120-738dd3874566 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Request method failure captured: Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f HTTP/1.1 Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGeaPbwuiKlZtfAakVi9AU1jZJYQpsiuqbtqj4H7EyEfa_Hs7Z-uZ4kORsCa_VB61-2zGcpt-Akt_fwFGZsdE57QH4a5RFxoaFSpMB5wQSEpC1nxSFtZmML3yZTCD6a9Nk7nPWXZGtd_9TDU17ULy9DxSwRUUNLntxWZGEmDQVAe1xk Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersTestJSON-953297781 Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersTestJSON-953297781 Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersTestJSON-953297781 Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersTestJSON-953297781-project Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 8878d44956bd42e18f0409534e562ab6 Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersTestJSON-953297781-project Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: exception: Instance dea33c0b-6680-408b-b019-b035b89d859f could not be found. Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'dea33c0b-6680-408b-b019-b035b89d859f'} Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dea33c0b-6680-408b-b019-b035b89d859f could not be found. Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dea33c0b-6680-408b-b019-b035b89d859f could not be found. Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:30:09.556978 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:09.561907 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:30:09.561907 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:30:09.561907 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:30:09.561907 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:30:09.561907 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dea33c0b-6680-408b-b019-b035b89d859f could not be found. Jun 20 12:30:09.561907 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:30:09.561907 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-45d81051-6ef9-4305-9120-738dd3874566 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Returning 404 to user: Instance dea33c0b-6680-408b-b019-b035b89d859f could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:30:09.561907 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-45d81051-6ef9-4305-9120-738dd3874566 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f" status: 404 len: 111 microversion: 2.1 time: 0.095432 Jun 20 12:30:09.562432 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2881/5857] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:09 2022] GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:30:09.705568 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-55dbef2b-80e3-489f-9432-d6ea2d9c8f33 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-556871472", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "ce2e9d9e-a74d-4fc7-950c-df9300f57b6c"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:30:09.788976 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-55dbef2b-80e3-489f-9432-d6ea2d9c8f33 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] validate_networks() for [('ce2e9d9e-a74d-4fc7-950c-df9300f57b6c', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:30:10.531895 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6951cc58-a736-470d-9564-164c5102087b tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:10.533992 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6951cc58-a736-470d-9564-164c5102087b tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 0f46a132-c8ab-41ae-bd97-ec97591f4a4f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:10.551758 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6951cc58-a736-470d-9564-164c5102087b tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:10.554803 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6951cc58-a736-470d-9564-164c5102087b tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:10.556839 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6951cc58-a736-470d-9564-164c5102087b tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:10.558610 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6951cc58-a736-470d-9564-164c5102087b tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:10.598232 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-55dbef2b-80e3-489f-9432-d6ea2d9c8f33 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:30:10.598950 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-55dbef2b-80e3-489f-9432-d6ea2d9c8f33 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:30:10.599609 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-55dbef2b-80e3-489f-9432-d6ea2d9c8f33 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:30:10.600347 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-55dbef2b-80e3-489f-9432-d6ea2d9c8f33 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:30:10.600960 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-55dbef2b-80e3-489f-9432-d6ea2d9c8f33 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:30:10.620333 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-55dbef2b-80e3-489f-9432-d6ea2d9c8f33 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:10.622798 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-55dbef2b-80e3-489f-9432-d6ea2d9c8f33 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:10.624912 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-55dbef2b-80e3-489f-9432-d6ea2d9c8f33 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:10.627377 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-55dbef2b-80e3-489f-9432-d6ea2d9c8f33 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:10.687030 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-55dbef2b-80e3-489f-9432-d6ea2d9c8f33 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Getting quotas for project 896c053324b34720a7d0f151bfdc8b10. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:30:10.706914 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-55dbef2b-80e3-489f-9432-d6ea2d9c8f33 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Getting quotas for user 8878d44956bd42e18f0409534e562ab6 and project 896c053324b34720a7d0f151bfdc8b10. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:30:10.742485 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-55dbef2b-80e3-489f-9432-d6ea2d9c8f33 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:30:10.750521 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-55dbef2b-80e3-489f-9432-d6ea2d9c8f33 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:30:10.822167 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:10.888124 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-55dbef2b-80e3-489f-9432-d6ea2d9c8f33 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.187415 Jun 20 12:30:10.901326 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2977/5858] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:30:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1198 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:30:10.913363 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-24ccfb0f-fd99-4e70-9f56-8ab7588ed383 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:10.914644 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-24ccfb0f-fd99-4e70-9f56-8ab7588ed383 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:11.052238 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-24ccfb0f-fd99-4e70-9f56-8ab7588ed383 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:11.054243 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6951cc58-a736-470d-9564-164c5102087b tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:11.063117 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6951cc58-a736-470d-9564-164c5102087b tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f" status: 200 len: 1500 microversion: 2.1 time: 0.536227 Jun 20 12:30:11.064155 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2882/5859] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:10 2022] GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f => generated 1500 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:11.072708 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-24ccfb0f-fd99-4e70-9f56-8ab7588ed383 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1208 microversion: 2.1 time: 0.162578 Jun 20 12:30:11.073601 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2978/5860] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:10 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1208 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:30:11.106361 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3056d2f9-827c-4ab2-9060-f6ecbff4902c tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:30:11.109589 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3056d2f9-827c-4ab2-9060-f6ecbff4902c tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 0f46a132-c8ab-41ae-bd97-ec97591f4a4f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:11.121319 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3056d2f9-827c-4ab2-9060-f6ecbff4902c tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:11.122434 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3056d2f9-827c-4ab2-9060-f6ecbff4902c tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:11.124064 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3056d2f9-827c-4ab2-9060-f6ecbff4902c tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:11.126542 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3056d2f9-827c-4ab2-9060-f6ecbff4902c tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:11.199294 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-3056d2f9-827c-4ab2-9060-f6ecbff4902c tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lazy-loading 'flavor' on Instance uuid 0f46a132-c8ab-41ae-bd97-ec97591f4a4f {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:30:11.263450 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-3056d2f9-827c-4ab2-9060-f6ecbff4902c tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] HTTP exception thrown: Cannot 'rescue' instance 0f46a132-c8ab-41ae-bd97-ec97591f4a4f while it is in vm_state paused Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3056d2f9-827c-4ab2-9060-f6ecbff4902c tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Request method failure captured: Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f/action HTTP/1.1 Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 14 Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGgSaQU2kYq6294w6QFKPq7A5QMR619m5qrTtjZvOh1Spd4jYt9SdDjLdFiaQeOKoAcYDnhjBb8DNFT4026Xi2z1eTCKzFIZr5YrYMMfaIT2h-JIX2uEPuAOwR8Q0Bfw8WTyUwuKuBg3lk8BU4yAsLY8apXUbOU50Mn1Bj2k7YSVmEI Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: eed49c99a6a64e779184cfde80a29a52 Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2064933160 Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eed49c99a6a64e779184cfde80a29a52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eed49c99a6a64e779184cfde80a29a52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eed49c99a6a64e779184cfde80a29a52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eed49c99a6a64e779184cfde80a29a52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2064933160 Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: eed49c99a6a64e779184cfde80a29a52 Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2064933160 Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServerRescueNegativeTestJSON-2064933160-project Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 8efa417e5eb04ea682201f30b003bd54 Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2064933160-project Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: {"rescue": {}} Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: exception: Cannot 'rescue' instance 0f46a132-c8ab-41ae-bd97-ec97591f4a4f while it is in vm_state paused Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '0f46a132-c8ab-41ae-bd97-ec97591f4a4f', 'body': {'rescue': {}}} Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0f46a132-c8ab-41ae-bd97-ec97591f4a4f in vm_state paused. Cannot rescue while the instance is in this state. Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 0f46a132-c8ab-41ae-bd97-ec97591f4a4f while it is in vm_state paused Jun 20 12:30:11.273551 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:30:11.278158 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:30:11.278158 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:30:11.278158 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:11.278158 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:30:11.278158 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:30:11.278158 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:30:11.278158 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:30:11.278158 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 0f46a132-c8ab-41ae-bd97-ec97591f4a4f while it is in vm_state paused Jun 20 12:30:11.278158 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:30:11.278158 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3056d2f9-827c-4ab2-9060-f6ecbff4902c tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Returning 409 to user: Cannot 'rescue' instance 0f46a132-c8ab-41ae-bd97-ec97591f4a4f while it is in vm_state paused {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:30:11.278158 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3056d2f9-827c-4ab2-9060-f6ecbff4902c tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "POST /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f/action" status: 409 len: 144 microversion: 2.1 time: 0.187775 Jun 20 12:30:11.278158 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2883/5861] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:30:11 2022] POST /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f/action => generated 144 bytes in 190 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:30:11.294358 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-469ff013-0dc6-4848-a0b9-ceaa9130c7b5 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:30:11.295321 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-469ff013-0dc6-4848-a0b9-ceaa9130c7b5 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 0f46a132-c8ab-41ae-bd97-ec97591f4a4f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:11.311274 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-469ff013-0dc6-4848-a0b9-ceaa9130c7b5 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:11.313061 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-469ff013-0dc6-4848-a0b9-ceaa9130c7b5 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:11.313905 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-469ff013-0dc6-4848-a0b9-ceaa9130c7b5 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:11.314360 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-469ff013-0dc6-4848-a0b9-ceaa9130c7b5 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:11.477593 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-469ff013-0dc6-4848-a0b9-ceaa9130c7b5 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "POST /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f/action" status: 202 len: 0 microversion: 2.1 time: 0.193325 Jun 20 12:30:11.491902 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8e9c2032-4d9d-4ce1-a1f7-32dae00b09e0 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:11.496667 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8e9c2032-4d9d-4ce1-a1f7-32dae00b09e0 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 0f46a132-c8ab-41ae-bd97-ec97591f4a4f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:11.504045 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2979/5862] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:30:11 2022] POST /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:30:11.520268 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e9c2032-4d9d-4ce1-a1f7-32dae00b09e0 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:11.522556 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e9c2032-4d9d-4ce1-a1f7-32dae00b09e0 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:11.527243 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e9c2032-4d9d-4ce1-a1f7-32dae00b09e0 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:11.529191 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e9c2032-4d9d-4ce1-a1f7-32dae00b09e0 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:12.091294 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ffb79cd2-b4cd-44fc-9ae1-f1ddcd4f60f1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:12.092084 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ffb79cd2-b4cd-44fc-9ae1-f1ddcd4f60f1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:12.287816 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ffb79cd2-b4cd-44fc-9ae1-f1ddcd4f60f1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:12.306420 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ffb79cd2-b4cd-44fc-9ae1-f1ddcd4f60f1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1208 microversion: 2.1 time: 0.219564 Jun 20 12:30:12.307402 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2980/5863] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:12 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1208 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:12.493204 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8e9c2032-4d9d-4ce1-a1f7-32dae00b09e0 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:12.504566 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8e9c2032-4d9d-4ce1-a1f7-32dae00b09e0 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f" status: 200 len: 1507 microversion: 2.1 time: 1.018040 Jun 20 12:30:12.507659 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2884/5864] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:11 2022] GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f => generated 1507 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:13.326117 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-41a76173-7a12-4f7e-ad30-ce3ad3c25c37 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:13.330973 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-41a76173-7a12-4f7e-ad30-ce3ad3c25c37 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:13.344880 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-41a76173-7a12-4f7e-ad30-ce3ad3c25c37 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:13.351575 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-41a76173-7a12-4f7e-ad30-ce3ad3c25c37 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:13.352667 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-41a76173-7a12-4f7e-ad30-ce3ad3c25c37 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:13.353130 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-41a76173-7a12-4f7e-ad30-ce3ad3c25c37 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:13.502820 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-41a76173-7a12-4f7e-ad30-ce3ad3c25c37 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:13.510835 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-41a76173-7a12-4f7e-ad30-ce3ad3c25c37 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1260 microversion: 2.1 time: 0.188775 Jun 20 12:30:13.516721 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2981/5865] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:13 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1260 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:13.531079 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8678e171-98eb-40f6-b67d-ab30d7bbda6a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:13.531617 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8678e171-98eb-40f6-b67d-ab30d7bbda6a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 0f46a132-c8ab-41ae-bd97-ec97591f4a4f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:13.549706 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8678e171-98eb-40f6-b67d-ab30d7bbda6a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:13.550149 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8678e171-98eb-40f6-b67d-ab30d7bbda6a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:13.550930 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8678e171-98eb-40f6-b67d-ab30d7bbda6a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:13.551359 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8678e171-98eb-40f6-b67d-ab30d7bbda6a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:13.949594 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8678e171-98eb-40f6-b67d-ab30d7bbda6a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:13.959702 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8678e171-98eb-40f6-b67d-ab30d7bbda6a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f" status: 200 len: 1515 microversion: 2.1 time: 0.436937 Jun 20 12:30:13.973091 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2885/5866] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:13 2022] GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f => generated 1515 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:14.540089 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b23b01a6-de82-4bc8-9465-5d7e6abd91c0 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:14.542032 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b23b01a6-de82-4bc8-9465-5d7e6abd91c0 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:14.554426 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b23b01a6-de82-4bc8-9465-5d7e6abd91c0 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:14.559494 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b23b01a6-de82-4bc8-9465-5d7e6abd91c0 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:14.561358 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b23b01a6-de82-4bc8-9465-5d7e6abd91c0 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:14.566832 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b23b01a6-de82-4bc8-9465-5d7e6abd91c0 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:14.792280 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b23b01a6-de82-4bc8-9465-5d7e6abd91c0 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:14.807356 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b23b01a6-de82-4bc8-9465-5d7e6abd91c0 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1266 microversion: 2.1 time: 0.271860 Jun 20 12:30:14.819515 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2982/5867] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:14 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1266 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:15.827393 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7a3f38ac-21a8-44f7-8094-61d88a024e2d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:15.828187 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7a3f38ac-21a8-44f7-8094-61d88a024e2d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:15.851994 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7a3f38ac-21a8-44f7-8094-61d88a024e2d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:15.852487 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7a3f38ac-21a8-44f7-8094-61d88a024e2d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:15.853566 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7a3f38ac-21a8-44f7-8094-61d88a024e2d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:15.854020 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7a3f38ac-21a8-44f7-8094-61d88a024e2d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:16.677449 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7a3f38ac-21a8-44f7-8094-61d88a024e2d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:16.686526 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7a3f38ac-21a8-44f7-8094-61d88a024e2d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1308 microversion: 2.1 time: 0.863304 Jun 20 12:30:16.689843 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2886/5868] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:15 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1308 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:16.905020 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b3baca1e-e336-40de-bfff-93d534f13717 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:30:16.907712 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b3baca1e-e336-40de-bfff-93d534f13717 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 0f46a132-c8ab-41ae-bd97-ec97591f4a4f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:16.922016 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3baca1e-e336-40de-bfff-93d534f13717 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:16.923075 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3baca1e-e336-40de-bfff-93d534f13717 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:16.924844 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3baca1e-e336-40de-bfff-93d534f13717 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:16.925559 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3baca1e-e336-40de-bfff-93d534f13717 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:17.003704 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-b3baca1e-e336-40de-bfff-93d534f13717 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lazy-loading 'flavor' on Instance uuid 0f46a132-c8ab-41ae-bd97-ec97591f4a4f {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:30:17.152845 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b3baca1e-e336-40de-bfff-93d534f13717 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "POST /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f/action" status: 200 len: 32 microversion: 2.1 time: 0.254148 Jun 20 12:30:17.157475 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2983/5869] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:30:16 2022] POST /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f/action => generated 32 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:30:17.164435 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-daf45dab-527d-46db-9cc1-a20e07925ad2 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:17.166575 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-daf45dab-527d-46db-9cc1-a20e07925ad2 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 0f46a132-c8ab-41ae-bd97-ec97591f4a4f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:17.185167 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-daf45dab-527d-46db-9cc1-a20e07925ad2 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:17.185752 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-daf45dab-527d-46db-9cc1-a20e07925ad2 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:17.186653 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-daf45dab-527d-46db-9cc1-a20e07925ad2 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:17.189604 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-daf45dab-527d-46db-9cc1-a20e07925ad2 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:17.708113 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-df80781a-539b-4cc2-b0e5-a35441ee5fb6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:17.709334 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-df80781a-539b-4cc2-b0e5-a35441ee5fb6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:17.725009 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df80781a-539b-4cc2-b0e5-a35441ee5fb6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:17.725672 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df80781a-539b-4cc2-b0e5-a35441ee5fb6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:17.726651 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df80781a-539b-4cc2-b0e5-a35441ee5fb6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:17.728022 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df80781a-539b-4cc2-b0e5-a35441ee5fb6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:18.045408 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-df80781a-539b-4cc2-b0e5-a35441ee5fb6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:18.067727 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-df80781a-539b-4cc2-b0e5-a35441ee5fb6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1308 microversion: 2.1 time: 0.365493 Jun 20 12:30:18.069015 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2984/5870] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:17 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1308 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:30:18.094758 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-daf45dab-527d-46db-9cc1-a20e07925ad2 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:18.106817 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-daf45dab-527d-46db-9cc1-a20e07925ad2 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f" status: 200 len: 1521 microversion: 2.1 time: 0.947008 Jun 20 12:30:18.149316 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2887/5871] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:17 2022] GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f => generated 1521 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:18.191969 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-4723ec5c-18cd-437a-a91c-2ef6fe301b75 req-69624b20-f8be-4e47-a5d4-2b8e26eac88e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcea95e3-52dc-4939-a426-505d3f686047", "tag": "6e920d54-bdb0-4f6a-8cb1-adad19178521"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:30:18.210272 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-4723ec5c-18cd-437a-a91c-2ef6fe301b75 req-69624b20-f8be-4e47-a5d4-2b8e26eac88e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:18.210735 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-4723ec5c-18cd-437a-a91c-2ef6fe301b75 req-69624b20-f8be-4e47-a5d4-2b8e26eac88e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:18.251608 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-4723ec5c-18cd-437a-a91c-2ef6fe301b75 req-69624b20-f8be-4e47-a5d4-2b8e26eac88e service nova] Creating event network-changed:6e920d54-bdb0-4f6a-8cb1-adad19178521 for instance dcea95e3-52dc-4939-a426-505d3f686047 on n-h2-master-1 Jun 20 12:30:18.283276 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-4723ec5c-18cd-437a-a91c-2ef6fe301b75 req-69624b20-f8be-4e47-a5d4-2b8e26eac88e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094930 Jun 20 12:30:18.293182 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2985/5872] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:30:19.087029 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c66790b2-af7e-444b-bc2b-257198ae30c9 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:19.087715 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c66790b2-af7e-444b-bc2b-257198ae30c9 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:19.103425 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c66790b2-af7e-444b-bc2b-257198ae30c9 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:19.106121 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c66790b2-af7e-444b-bc2b-257198ae30c9 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:19.107035 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c66790b2-af7e-444b-bc2b-257198ae30c9 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:19.107483 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c66790b2-af7e-444b-bc2b-257198ae30c9 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:19.132764 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-72623a26-f153-47ff-83b3-67a7942b859e tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:19.134110 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-72623a26-f153-47ff-83b3-67a7942b859e tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 0f46a132-c8ab-41ae-bd97-ec97591f4a4f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:19.152356 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-72623a26-f153-47ff-83b3-67a7942b859e tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:19.152858 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-72623a26-f153-47ff-83b3-67a7942b859e tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:19.159349 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-72623a26-f153-47ff-83b3-67a7942b859e tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:19.159628 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-72623a26-f153-47ff-83b3-67a7942b859e tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:19.423742 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-72623a26-f153-47ff-83b3-67a7942b859e tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:19.433576 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-72623a26-f153-47ff-83b3-67a7942b859e tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f" status: 200 len: 1521 microversion: 2.1 time: 0.308288 Jun 20 12:30:19.444908 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2986/5873] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:19 2022] GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:30:19.963908 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c66790b2-af7e-444b-bc2b-257198ae30c9 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:19.980638 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c66790b2-af7e-444b-bc2b-257198ae30c9 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1308 microversion: 2.1 time: 0.898817 Jun 20 12:30:19.995894 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2888/5874] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:19 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1308 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:20.465101 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-27f33d75-27aa-42c2-8a7a-1f7ea3130383 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:20.467720 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-27f33d75-27aa-42c2-8a7a-1f7ea3130383 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 0f46a132-c8ab-41ae-bd97-ec97591f4a4f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:20.484864 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-27f33d75-27aa-42c2-8a7a-1f7ea3130383 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:20.485326 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-27f33d75-27aa-42c2-8a7a-1f7ea3130383 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:20.486131 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-27f33d75-27aa-42c2-8a7a-1f7ea3130383 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:20.486572 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-27f33d75-27aa-42c2-8a7a-1f7ea3130383 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:20.659212 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:20.781818 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-27f33d75-27aa-42c2-8a7a-1f7ea3130383 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:20.812975 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-27f33d75-27aa-42c2-8a7a-1f7ea3130383 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f" status: 200 len: 1521 microversion: 2.1 time: 0.354784 Jun 20 12:30:20.817657 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2987/5875] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:20 2022] GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f => generated 1521 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:20.999888 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-41bcb8cf-053c-4930-9686-8ee6987f05be tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:21.001166 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-41bcb8cf-053c-4930-9686-8ee6987f05be tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:21.027495 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-41bcb8cf-053c-4930-9686-8ee6987f05be tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:21.030334 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-41bcb8cf-053c-4930-9686-8ee6987f05be tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:21.032412 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-41bcb8cf-053c-4930-9686-8ee6987f05be tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:21.034512 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-41bcb8cf-053c-4930-9686-8ee6987f05be tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:21.513869 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-41bcb8cf-053c-4930-9686-8ee6987f05be tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:21.520439 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:21.528096 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-41bcb8cf-053c-4930-9686-8ee6987f05be tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1308 microversion: 2.1 time: 0.532711 Jun 20 12:30:21.528732 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2889/5876] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:20 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1308 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:21.834583 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-06cdadec-2f33-463b-a720-74b9f61274bc tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:21.835275 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-06cdadec-2f33-463b-a720-74b9f61274bc tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 0f46a132-c8ab-41ae-bd97-ec97591f4a4f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:21.855725 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06cdadec-2f33-463b-a720-74b9f61274bc tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:21.855725 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06cdadec-2f33-463b-a720-74b9f61274bc tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:21.855725 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06cdadec-2f33-463b-a720-74b9f61274bc tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:21.855725 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06cdadec-2f33-463b-a720-74b9f61274bc tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:22.112750 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-06cdadec-2f33-463b-a720-74b9f61274bc tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:22.129461 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-06cdadec-2f33-463b-a720-74b9f61274bc tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f" status: 200 len: 1521 microversion: 2.1 time: 0.299172 Jun 20 12:30:22.130580 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2988/5877] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:21 2022] GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:22.548959 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2fbb99db-a7d1-4536-9dff-84bdc329e062 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:22.549829 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2fbb99db-a7d1-4536-9dff-84bdc329e062 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:22.596382 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2fbb99db-a7d1-4536-9dff-84bdc329e062 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:22.597102 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2fbb99db-a7d1-4536-9dff-84bdc329e062 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:22.600718 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2fbb99db-a7d1-4536-9dff-84bdc329e062 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:22.601588 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2fbb99db-a7d1-4536-9dff-84bdc329e062 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:23.148130 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1add9255-969d-4109-b340-ddd995131d7e tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:23.149710 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1add9255-969d-4109-b340-ddd995131d7e tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 0f46a132-c8ab-41ae-bd97-ec97591f4a4f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:23.152406 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=10 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:23.155412 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2fbb99db-a7d1-4536-9dff-84bdc329e062 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:23.168130 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2fbb99db-a7d1-4536-9dff-84bdc329e062 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1308 microversion: 2.1 time: 0.625716 Jun 20 12:30:23.168624 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1add9255-969d-4109-b340-ddd995131d7e tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:23.169069 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1add9255-969d-4109-b340-ddd995131d7e tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:23.173393 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2890/5878] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:22 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1308 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:23.174267 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1add9255-969d-4109-b340-ddd995131d7e tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:23.174751 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1add9255-969d-4109-b340-ddd995131d7e tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:23.519024 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1add9255-969d-4109-b340-ddd995131d7e tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:23.531495 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1add9255-969d-4109-b340-ddd995131d7e tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f" status: 200 len: 1521 microversion: 2.1 time: 0.388287 Jun 20 12:30:23.533567 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2989/5879] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:23 2022] GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f => generated 1521 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:30:24.189560 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-716242b9-302c-4d5d-8737-bbce99048785 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:24.190217 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-716242b9-302c-4d5d-8737-bbce99048785 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:24.206575 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-716242b9-302c-4d5d-8737-bbce99048785 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:24.207035 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-716242b9-302c-4d5d-8737-bbce99048785 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:24.207818 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-716242b9-302c-4d5d-8737-bbce99048785 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:24.208344 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-716242b9-302c-4d5d-8737-bbce99048785 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:24.375031 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-716242b9-302c-4d5d-8737-bbce99048785 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:24.385155 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-716242b9-302c-4d5d-8737-bbce99048785 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1308 microversion: 2.1 time: 0.199451 Jun 20 12:30:24.385786 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2891/5880] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:24 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1308 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:24.551239 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-010a3ab1-e9e0-4d79-9606-c1cfc19280d8 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:24.553081 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-010a3ab1-e9e0-4d79-9606-c1cfc19280d8 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 0f46a132-c8ab-41ae-bd97-ec97591f4a4f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:24.561440 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-010a3ab1-e9e0-4d79-9606-c1cfc19280d8 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:24.562125 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-010a3ab1-e9e0-4d79-9606-c1cfc19280d8 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:24.563366 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-010a3ab1-e9e0-4d79-9606-c1cfc19280d8 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:24.564458 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-010a3ab1-e9e0-4d79-9606-c1cfc19280d8 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:24.813765 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-010a3ab1-e9e0-4d79-9606-c1cfc19280d8 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:24.816034 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:24.829287 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-010a3ab1-e9e0-4d79-9606-c1cfc19280d8 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f" status: 200 len: 1521 microversion: 2.1 time: 0.278481 Jun 20 12:30:24.839807 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2990/5881] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:24 2022] GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:25.408413 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d0f9d28a-9060-4046-a804-c58500900c86 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:25.411342 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d0f9d28a-9060-4046-a804-c58500900c86 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:25.430300 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d0f9d28a-9060-4046-a804-c58500900c86 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:25.431151 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d0f9d28a-9060-4046-a804-c58500900c86 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:25.433521 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d0f9d28a-9060-4046-a804-c58500900c86 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:25.434225 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d0f9d28a-9060-4046-a804-c58500900c86 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:25.704863 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d0f9d28a-9060-4046-a804-c58500900c86 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:25.718168 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d0f9d28a-9060-4046-a804-c58500900c86 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1308 microversion: 2.1 time: 0.319200 Jun 20 12:30:25.720169 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2892/5882] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:25 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1308 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:25.849785 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e8c170a6-8922-42d5-b3c5-6b6bca77f136 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:25.850424 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e8c170a6-8922-42d5-b3c5-6b6bca77f136 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 0f46a132-c8ab-41ae-bd97-ec97591f4a4f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:25.878819 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e8c170a6-8922-42d5-b3c5-6b6bca77f136 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:25.879173 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e8c170a6-8922-42d5-b3c5-6b6bca77f136 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:25.880007 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e8c170a6-8922-42d5-b3c5-6b6bca77f136 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:25.881110 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e8c170a6-8922-42d5-b3c5-6b6bca77f136 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:26.162671 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e8c170a6-8922-42d5-b3c5-6b6bca77f136 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:26.172753 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e8c170a6-8922-42d5-b3c5-6b6bca77f136 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f" status: 200 len: 1521 microversion: 2.1 time: 0.329461 Jun 20 12:30:26.174845 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2991/5883] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:25 2022] GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f => generated 1521 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:26.738982 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-00506fc1-1186-4795-bc3c-fb281eae340b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:26.743043 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-00506fc1-1186-4795-bc3c-fb281eae340b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:26.752952 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-00506fc1-1186-4795-bc3c-fb281eae340b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:26.753760 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-00506fc1-1186-4795-bc3c-fb281eae340b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:26.754769 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-00506fc1-1186-4795-bc3c-fb281eae340b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:26.756710 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-00506fc1-1186-4795-bc3c-fb281eae340b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:27.019364 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-00506fc1-1186-4795-bc3c-fb281eae340b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:27.031603 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-00506fc1-1186-4795-bc3c-fb281eae340b tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1308 microversion: 2.1 time: 0.297955 Jun 20 12:30:27.034293 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2893/5884] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:26 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1308 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:27.195504 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f71d4b61-ad7c-4e5b-b82a-54db2d52445a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:27.196361 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f71d4b61-ad7c-4e5b-b82a-54db2d52445a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 0f46a132-c8ab-41ae-bd97-ec97591f4a4f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:27.205036 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f71d4b61-ad7c-4e5b-b82a-54db2d52445a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:27.205792 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f71d4b61-ad7c-4e5b-b82a-54db2d52445a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:27.207172 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f71d4b61-ad7c-4e5b-b82a-54db2d52445a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:27.211703 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f71d4b61-ad7c-4e5b-b82a-54db2d52445a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:27.443314 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f71d4b61-ad7c-4e5b-b82a-54db2d52445a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:27.452582 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f71d4b61-ad7c-4e5b-b82a-54db2d52445a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f" status: 200 len: 1521 microversion: 2.1 time: 0.264948 Jun 20 12:30:27.458601 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2992/5885] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:27 2022] GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:27.710724 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-a1346de9-ba42-4dae-8e4b-a5b3606bc813 req-fc74db64-379a-4b9a-8715-ac4e5ec20113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcea95e3-52dc-4939-a426-505d3f686047", "name": "network-vif-plugged", "status": "completed", "tag": "6e920d54-bdb0-4f6a-8cb1-adad19178521"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:30:27.733002 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-a1346de9-ba42-4dae-8e4b-a5b3606bc813 req-fc74db64-379a-4b9a-8715-ac4e5ec20113 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:27.737581 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-a1346de9-ba42-4dae-8e4b-a5b3606bc813 req-fc74db64-379a-4b9a-8715-ac4e5ec20113 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:27.763011 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-a1346de9-ba42-4dae-8e4b-a5b3606bc813 req-fc74db64-379a-4b9a-8715-ac4e5ec20113 service nova] Creating event network-vif-plugged:6e920d54-bdb0-4f6a-8cb1-adad19178521 for instance dcea95e3-52dc-4939-a426-505d3f686047 on n-h2-master-1 Jun 20 12:30:27.782028 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-a1346de9-ba42-4dae-8e4b-a5b3606bc813 req-fc74db64-379a-4b9a-8715-ac4e5ec20113 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074930 Jun 20 12:30:27.782865 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2894/5886] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:30:28.050932 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-04bd1b5b-066e-429f-b92e-8739c6852d94 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:28.051676 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-04bd1b5b-066e-429f-b92e-8739c6852d94 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:28.062948 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-04bd1b5b-066e-429f-b92e-8739c6852d94 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:28.063400 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-04bd1b5b-066e-429f-b92e-8739c6852d94 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:28.064465 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-04bd1b5b-066e-429f-b92e-8739c6852d94 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:28.064643 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-04bd1b5b-066e-429f-b92e-8739c6852d94 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:28.409830 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-04bd1b5b-066e-429f-b92e-8739c6852d94 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:28.426711 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-04bd1b5b-066e-429f-b92e-8739c6852d94 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1308 microversion: 2.1 time: 0.378891 Jun 20 12:30:28.427701 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2993/5887] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:28 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1308 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:28.487300 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e9e3b679-14e7-48d9-8a0e-8e35059db0bd tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:28.488415 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e9e3b679-14e7-48d9-8a0e-8e35059db0bd tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 0f46a132-c8ab-41ae-bd97-ec97591f4a4f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:28.502686 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e9e3b679-14e7-48d9-8a0e-8e35059db0bd tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:28.505086 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e9e3b679-14e7-48d9-8a0e-8e35059db0bd tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:28.505086 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e9e3b679-14e7-48d9-8a0e-8e35059db0bd tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:28.505086 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e9e3b679-14e7-48d9-8a0e-8e35059db0bd tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:28.758416 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e9e3b679-14e7-48d9-8a0e-8e35059db0bd tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:28.792228 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e9e3b679-14e7-48d9-8a0e-8e35059db0bd tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f" status: 200 len: 1521 microversion: 2.1 time: 0.301218 Jun 20 12:30:28.792228 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2895/5888] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:28 2022] GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:29.450600 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fc5f220a-4167-49a0-bb04-71b713ede124 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:29.454054 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fc5f220a-4167-49a0-bb04-71b713ede124 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:29.503036 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fc5f220a-4167-49a0-bb04-71b713ede124 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:29.503873 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fc5f220a-4167-49a0-bb04-71b713ede124 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:29.505208 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fc5f220a-4167-49a0-bb04-71b713ede124 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:29.506659 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fc5f220a-4167-49a0-bb04-71b713ede124 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:29.820020 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-eac0d4d2-3817-45a8-ae5d-38d9b0821fb8 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:29.822417 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-eac0d4d2-3817-45a8-ae5d-38d9b0821fb8 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 0f46a132-c8ab-41ae-bd97-ec97591f4a4f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:29.845529 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:29.853173 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eac0d4d2-3817-45a8-ae5d-38d9b0821fb8 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:29.860029 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eac0d4d2-3817-45a8-ae5d-38d9b0821fb8 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:29.863257 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eac0d4d2-3817-45a8-ae5d-38d9b0821fb8 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:29.864798 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eac0d4d2-3817-45a8-ae5d-38d9b0821fb8 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:29.933509 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fc5f220a-4167-49a0-bb04-71b713ede124 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:29.945566 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fc5f220a-4167-49a0-bb04-71b713ede124 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1308 microversion: 2.1 time: 0.506177 Jun 20 12:30:29.958175 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2994/5889] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:29 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1308 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:30.164840 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-eac0d4d2-3817-45a8-ae5d-38d9b0821fb8 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:30.183499 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-eac0d4d2-3817-45a8-ae5d-38d9b0821fb8 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f" status: 200 len: 1521 microversion: 2.1 time: 0.378232 Jun 20 12:30:30.184074 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2896/5890] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:29 2022] GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f => generated 1521 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:30.972298 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-89a2e1a2-38e6-4628-aa28-c643086aa476 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:30.973723 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-89a2e1a2-38e6-4628-aa28-c643086aa476 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:30.993150 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-89a2e1a2-38e6-4628-aa28-c643086aa476 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:30.994326 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-89a2e1a2-38e6-4628-aa28-c643086aa476 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:30.995384 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-89a2e1a2-38e6-4628-aa28-c643086aa476 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:30.999726 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-89a2e1a2-38e6-4628-aa28-c643086aa476 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:31.210336 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3f269835-9097-470c-a94d-66fe25e12d90 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:31.211505 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3f269835-9097-470c-a94d-66fe25e12d90 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 0f46a132-c8ab-41ae-bd97-ec97591f4a4f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:31.236224 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3f269835-9097-470c-a94d-66fe25e12d90 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:31.236685 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3f269835-9097-470c-a94d-66fe25e12d90 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:31.237484 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3f269835-9097-470c-a94d-66fe25e12d90 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:31.237925 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3f269835-9097-470c-a94d-66fe25e12d90 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:31.568114 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3f269835-9097-470c-a94d-66fe25e12d90 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:31.577167 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3f269835-9097-470c-a94d-66fe25e12d90 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f" status: 200 len: 1521 microversion: 2.1 time: 0.374452 Jun 20 12:30:31.580536 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2897/5891] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:31 2022] GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f => generated 1521 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:31.589466 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-89a2e1a2-38e6-4628-aa28-c643086aa476 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:31.598531 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-89a2e1a2-38e6-4628-aa28-c643086aa476 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1489 microversion: 2.1 time: 0.631032 Jun 20 12:30:31.601028 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2995/5892] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:30 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1489 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:31.623087 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a224a0df-1a38-4f4b-8dfe-56cf75706edf tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-227673579"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:30:31.624307 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a224a0df-1a38-4f4b-8dfe-56cf75706edf tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:31.631330 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a224a0df-1a38-4f4b-8dfe-56cf75706edf tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:31.633497 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a224a0df-1a38-4f4b-8dfe-56cf75706edf tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:31.634456 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a224a0df-1a38-4f4b-8dfe-56cf75706edf tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:31.635075 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a224a0df-1a38-4f4b-8dfe-56cf75706edf tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:31.734506 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a224a0df-1a38-4f4b-8dfe-56cf75706edf tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "PUT /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1074 microversion: 2.1 time: 0.118779 Jun 20 12:30:31.735794 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2898/5893] 10.222.0.27 () {60 vars in 1255 bytes} [Mon Jun 20 12:30:31 2022] PUT /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1074 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:31.759004 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4ca369f8-66e6-487b-9569-592061749759 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:31.759004 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4ca369f8-66e6-487b-9569-592061749759 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:31.763260 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4ca369f8-66e6-487b-9569-592061749759 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:31.763903 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4ca369f8-66e6-487b-9569-592061749759 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:31.772990 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4ca369f8-66e6-487b-9569-592061749759 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:31.773760 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4ca369f8-66e6-487b-9569-592061749759 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:32.163298 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4ca369f8-66e6-487b-9569-592061749759 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:32.179124 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4ca369f8-66e6-487b-9569-592061749759 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1500 microversion: 2.1 time: 0.431025 Jun 20 12:30:32.183532 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2996/5894] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:31 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1500 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:32.202128 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4b3715ab-72df-4745-a09c-9e20c367718f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:32.203193 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4b3715ab-72df-4745-a09c-9e20c367718f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:32.219277 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4b3715ab-72df-4745-a09c-9e20c367718f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:32.219884 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4b3715ab-72df-4745-a09c-9e20c367718f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:32.228860 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4b3715ab-72df-4745-a09c-9e20c367718f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:32.229491 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4b3715ab-72df-4745-a09c-9e20c367718f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:32.599446 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6fea523f-2e56-426c-976e-73eab52a5cae tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:32.600490 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6fea523f-2e56-426c-976e-73eab52a5cae tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 0f46a132-c8ab-41ae-bd97-ec97591f4a4f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:32.611837 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6fea523f-2e56-426c-976e-73eab52a5cae tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:32.615580 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6fea523f-2e56-426c-976e-73eab52a5cae tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:32.616556 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6fea523f-2e56-426c-976e-73eab52a5cae tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:32.617110 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6fea523f-2e56-426c-976e-73eab52a5cae tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:32.819076 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4b3715ab-72df-4745-a09c-9e20c367718f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:32.829608 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4b3715ab-72df-4745-a09c-9e20c367718f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1500 microversion: 2.1 time: 0.633265 Jun 20 12:30:32.830346 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2899/5895] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:32 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1500 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:30:32.862179 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2e6ee8e8-d087-498c-9136-449d48e4c778 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:30:32.878332 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2e6ee8e8-d087-498c-9136-449d48e4c778 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:32.887706 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2e6ee8e8-d087-498c-9136-449d48e4c778 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:32.930891 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2e6ee8e8-d087-498c-9136-449d48e4c778 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Going to try to stop instance {{(pid=119128) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 20 12:30:32.979576 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6fea523f-2e56-426c-976e-73eab52a5cae tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:33.003304 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6fea523f-2e56-426c-976e-73eab52a5cae tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f" status: 200 len: 1501 microversion: 2.1 time: 0.408082 Jun 20 12:30:33.012128 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2997/5896] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:32 2022] GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f => generated 1501 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:30:33.019919 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2e6ee8e8-d087-498c-9136-449d48e4c778 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "POST /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047/action" status: 202 len: 0 microversion: 2.1 time: 0.175115 Jun 20 12:30:33.020876 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2900/5897] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:30:32 2022] POST /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:30:33.070065 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c560d06d-87e9-4c63-b322-b3611841777a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b559641-b8fc-413e-a1b4-7f931278b68d"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:30:33.076851 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c560d06d-87e9-4c63-b322-b3611841777a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 0f46a132-c8ab-41ae-bd97-ec97591f4a4f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:33.078646 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f7f61d22-9054-42c4-9c1c-4ab57c5fd6a6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:33.080173 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f7f61d22-9054-42c4-9c1c-4ab57c5fd6a6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:33.091431 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c560d06d-87e9-4c63-b322-b3611841777a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:33.093787 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c560d06d-87e9-4c63-b322-b3611841777a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:33.095445 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c560d06d-87e9-4c63-b322-b3611841777a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:33.096940 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7f61d22-9054-42c4-9c1c-4ab57c5fd6a6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:33.097584 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c560d06d-87e9-4c63-b322-b3611841777a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:33.099177 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7f61d22-9054-42c4-9c1c-4ab57c5fd6a6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:33.101079 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7f61d22-9054-42c4-9c1c-4ab57c5fd6a6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:33.101677 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7f61d22-9054-42c4-9c1c-4ab57c5fd6a6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:33.166985 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-c560d06d-87e9-4c63-b322-b3611841777a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] HTTP exception thrown: Cannot 'attach_volume' instance 0f46a132-c8ab-41ae-bd97-ec97591f4a4f while it is in vm_state rescued Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c560d06d-87e9-4c63-b322-b3611841777a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Request method failure captured: Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f/os-volume_attachments HTTP/1.1 Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 74 Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGgSaQU2kYq6294w6QFKPq7A5QMR619m5qrTtjZvOh1Spd4jYt9SdDjLdFiaQeOKoAcYDnhjBb8DNFT4026Xi2z1eTCKzFIZr5YrYMMfaIT2h-JIX2uEPuAOwR8Q0Bfw8WTyUwuKuBg3lk8BU4yAsLY8apXUbOU50Mn1Bj2k7YSVmEI Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: eed49c99a6a64e779184cfde80a29a52 Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2064933160 Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eed49c99a6a64e779184cfde80a29a52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eed49c99a6a64e779184cfde80a29a52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eed49c99a6a64e779184cfde80a29a52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eed49c99a6a64e779184cfde80a29a52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2064933160 Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: eed49c99a6a64e779184cfde80a29a52 Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2064933160 Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServerRescueNegativeTestJSON-2064933160-project Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 8efa417e5eb04ea682201f30b003bd54 Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2064933160-project Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: {"volumeAttachment": {"volumeId": "4b559641-b8fc-413e-a1b4-7f931278b68d"}} Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: exception: Cannot 'attach_volume' instance 0f46a132-c8ab-41ae-bd97-ec97591f4a4f while it is in vm_state rescued Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: action_args: {'server_id': '0f46a132-c8ab-41ae-bd97-ec97591f4a4f', 'body': {'volumeAttachment': {'volumeId': '4b559641-b8fc-413e-a1b4-7f931278b68d'}}} Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0f46a132-c8ab-41ae-bd97-ec97591f4a4f in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 20 12:30:33.177058 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 20 12:30:33.182177 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 20 12:30:33.182177 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 20 12:30:33.182177 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 0f46a132-c8ab-41ae-bd97-ec97591f4a4f while it is in vm_state rescued Jun 20 12:30:33.182177 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:30:33.182177 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:30:33.182177 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:30:33.182177 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:33.182177 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:30:33.182177 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:30:33.182177 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:30:33.182177 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:30:33.182177 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 0f46a132-c8ab-41ae-bd97-ec97591f4a4f while it is in vm_state rescued Jun 20 12:30:33.182177 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:30:33.184221 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c560d06d-87e9-4c63-b322-b3611841777a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Returning 409 to user: Cannot 'attach_volume' instance 0f46a132-c8ab-41ae-bd97-ec97591f4a4f while it is in vm_state rescued {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:30:33.185579 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c560d06d-87e9-4c63-b322-b3611841777a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "POST /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.138799 Jun 20 12:30:33.186842 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2998/5898] 10.222.0.27 () {60 vars in 1322 bytes} [Mon Jun 20 12:30:33 2022] POST /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f/os-volume_attachments => generated 152 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:30:33.209870 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3cc34899-f503-4d4e-a0bf-5a042f814bb9 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:30:33.210643 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3cc34899-f503-4d4e-a0bf-5a042f814bb9 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 0f46a132-c8ab-41ae-bd97-ec97591f4a4f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:33.224958 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3cc34899-f503-4d4e-a0bf-5a042f814bb9 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:33.225692 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3cc34899-f503-4d4e-a0bf-5a042f814bb9 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:33.230370 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3cc34899-f503-4d4e-a0bf-5a042f814bb9 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:33.231015 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3cc34899-f503-4d4e-a0bf-5a042f814bb9 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:33.401701 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f7f61d22-9054-42c4-9c1c-4ab57c5fd6a6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:33.421810 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f7f61d22-9054-42c4-9c1c-4ab57c5fd6a6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1510 microversion: 2.1 time: 0.365224 Jun 20 12:30:33.422856 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2901/5899] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:33 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1510 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:33.437704 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3cc34899-f503-4d4e-a0bf-5a042f814bb9 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "POST /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f/action" status: 202 len: 0 microversion: 2.1 time: 0.245971 Jun 20 12:30:33.457498 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2999/5900] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:30:33 2022] POST /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:30:33.463345 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e07cbfcd-7d6b-494c-91cf-551a81802b34 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:33.464805 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e07cbfcd-7d6b-494c-91cf-551a81802b34 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 0f46a132-c8ab-41ae-bd97-ec97591f4a4f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:33.480800 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e07cbfcd-7d6b-494c-91cf-551a81802b34 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:33.481216 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e07cbfcd-7d6b-494c-91cf-551a81802b34 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:33.482079 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e07cbfcd-7d6b-494c-91cf-551a81802b34 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:33.482521 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e07cbfcd-7d6b-494c-91cf-551a81802b34 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:34.221096 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e07cbfcd-7d6b-494c-91cf-551a81802b34 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:34.231143 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e07cbfcd-7d6b-494c-91cf-551a81802b34 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f" status: 200 len: 1509 microversion: 2.1 time: 0.780978 Jun 20 12:30:34.252104 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2902/5901] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:33 2022] GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f => generated 1509 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:34.448109 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2cd77956-cc1b-42ac-acf2-a872d3d8c124 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:34.448845 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2cd77956-cc1b-42ac-acf2-a872d3d8c124 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:34.472424 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2cd77956-cc1b-42ac-acf2-a872d3d8c124 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:34.475092 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2cd77956-cc1b-42ac-acf2-a872d3d8c124 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:34.476276 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2cd77956-cc1b-42ac-acf2-a872d3d8c124 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:34.479851 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2cd77956-cc1b-42ac-acf2-a872d3d8c124 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:34.928180 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2cd77956-cc1b-42ac-acf2-a872d3d8c124 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:34.944850 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2cd77956-cc1b-42ac-acf2-a872d3d8c124 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1510 microversion: 2.1 time: 0.507267 Jun 20 12:30:34.948766 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3000/5902] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:34 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1510 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:35.258904 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3b4d1903-a34c-43fa-81c0-9a5e6fef0423 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:35.260262 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3b4d1903-a34c-43fa-81c0-9a5e6fef0423 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 0f46a132-c8ab-41ae-bd97-ec97591f4a4f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:35.272190 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b4d1903-a34c-43fa-81c0-9a5e6fef0423 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:35.277036 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b4d1903-a34c-43fa-81c0-9a5e6fef0423 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:35.278099 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b4d1903-a34c-43fa-81c0-9a5e6fef0423 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:35.278882 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b4d1903-a34c-43fa-81c0-9a5e6fef0423 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:35.965952 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-870d0f78-0051-4abf-ac50-2c6231f0f074 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:35.966611 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-870d0f78-0051-4abf-ac50-2c6231f0f074 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:35.989744 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-870d0f78-0051-4abf-ac50-2c6231f0f074 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:35.990783 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-870d0f78-0051-4abf-ac50-2c6231f0f074 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:36.000416 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-870d0f78-0051-4abf-ac50-2c6231f0f074 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:36.009475 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-870d0f78-0051-4abf-ac50-2c6231f0f074 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:36.062488 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3b4d1903-a34c-43fa-81c0-9a5e6fef0423 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:36.100692 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3b4d1903-a34c-43fa-81c0-9a5e6fef0423 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f" status: 200 len: 1509 microversion: 2.1 time: 0.846511 Jun 20 12:30:36.104296 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2903/5903] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:35 2022] GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f => generated 1509 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:36.617249 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-870d0f78-0051-4abf-ac50-2c6231f0f074 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:36.639767 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-870d0f78-0051-4abf-ac50-2c6231f0f074 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1510 microversion: 2.1 time: 0.677005 Jun 20 12:30:36.640430 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3001/5904] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:35 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1510 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:37.129855 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ee0d9da3-adab-423c-b819-9d0ca90fc8bc tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:37.131320 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ee0d9da3-adab-423c-b819-9d0ca90fc8bc tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 0f46a132-c8ab-41ae-bd97-ec97591f4a4f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:37.147038 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ee0d9da3-adab-423c-b819-9d0ca90fc8bc tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:37.147842 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ee0d9da3-adab-423c-b819-9d0ca90fc8bc tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:37.150126 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ee0d9da3-adab-423c-b819-9d0ca90fc8bc tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:37.150737 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ee0d9da3-adab-423c-b819-9d0ca90fc8bc tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:37.618047 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ee0d9da3-adab-423c-b819-9d0ca90fc8bc tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:37.636716 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ee0d9da3-adab-423c-b819-9d0ca90fc8bc tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f" status: 200 len: 1509 microversion: 2.1 time: 0.517378 Jun 20 12:30:37.639287 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2904/5905] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:37 2022] GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f => generated 1509 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:37.660089 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-253ab61c-6ef0-4919-8f5f-b6ba56ca80ca tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:37.662467 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-253ab61c-6ef0-4919-8f5f-b6ba56ca80ca tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:37.686275 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-253ab61c-6ef0-4919-8f5f-b6ba56ca80ca tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:37.695345 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-253ab61c-6ef0-4919-8f5f-b6ba56ca80ca tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:37.698181 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-253ab61c-6ef0-4919-8f5f-b6ba56ca80ca tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:37.700933 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-253ab61c-6ef0-4919-8f5f-b6ba56ca80ca tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:38.086639 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-253ab61c-6ef0-4919-8f5f-b6ba56ca80ca tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:38.140253 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-253ab61c-6ef0-4919-8f5f-b6ba56ca80ca tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1510 microversion: 2.1 time: 0.486581 Jun 20 12:30:38.143969 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3002/5906] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:37 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1510 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:38.656184 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-facc03c4-ada1-435a-b6e8-12b196cf4ea0 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:38.657756 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-facc03c4-ada1-435a-b6e8-12b196cf4ea0 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 0f46a132-c8ab-41ae-bd97-ec97591f4a4f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:38.673199 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-facc03c4-ada1-435a-b6e8-12b196cf4ea0 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:38.673621 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-facc03c4-ada1-435a-b6e8-12b196cf4ea0 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:38.674907 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-facc03c4-ada1-435a-b6e8-12b196cf4ea0 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:38.675599 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-facc03c4-ada1-435a-b6e8-12b196cf4ea0 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:38.712395 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:39.050272 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-facc03c4-ada1-435a-b6e8-12b196cf4ea0 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:39.064867 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-facc03c4-ada1-435a-b6e8-12b196cf4ea0 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f" status: 200 len: 1515 microversion: 2.1 time: 0.413185 Jun 20 12:30:39.071391 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2905/5907] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:38 2022] GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f => generated 1515 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:30:39.157916 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-86e5aee1-7fa9-4469-9bce-9a505b54c2e6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:39.159245 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-86e5aee1-7fa9-4469-9bce-9a505b54c2e6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:39.170381 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86e5aee1-7fa9-4469-9bce-9a505b54c2e6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:39.178762 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86e5aee1-7fa9-4469-9bce-9a505b54c2e6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:39.179979 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86e5aee1-7fa9-4469-9bce-9a505b54c2e6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:39.180781 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86e5aee1-7fa9-4469-9bce-9a505b54c2e6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:39.694774 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-86e5aee1-7fa9-4469-9bce-9a505b54c2e6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:39.706219 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-86e5aee1-7fa9-4469-9bce-9a505b54c2e6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1510 microversion: 2.1 time: 0.552635 Jun 20 12:30:39.733662 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3003/5908] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:39 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1510 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:40.723827 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-355ee396-37f3-4ebc-8187-f65ad3192970 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:40.725173 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-355ee396-37f3-4ebc-8187-f65ad3192970 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:40.735751 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-355ee396-37f3-4ebc-8187-f65ad3192970 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:40.739814 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-355ee396-37f3-4ebc-8187-f65ad3192970 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:40.740935 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-355ee396-37f3-4ebc-8187-f65ad3192970 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:40.741528 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-355ee396-37f3-4ebc-8187-f65ad3192970 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:41.013572 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-355ee396-37f3-4ebc-8187-f65ad3192970 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:41.026742 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-355ee396-37f3-4ebc-8187-f65ad3192970 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1510 microversion: 2.1 time: 0.307301 Jun 20 12:30:41.038298 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2906/5909] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:40 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1510 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:42.015837 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d4852411-913a-4abb-b9b0-a35960320d53 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Action: 'create', calling method: .version_select at 0x7f60849950d0>, body: {"keypair": {"name": "tempest-keypair-1132091155", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjb030ogIZ5QSfecfnEVxCCK5NdeLBK/BxnPWH5OuuBo3VHCUdAe1m5jkUIUy+j7D1/RsgOzT1/e3IaR5SNUQzSuvh4xv5TGo7vupIUKJgz8eAy7Ojp+Txl4/eWwZWycg=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:30:42.026765 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=57 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:42.036918 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-d4852411-913a-4abb-b9b0-a35960320d53 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Getting quotas for project eed49c99a6a64e779184cfde80a29a52. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:30:42.045017 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8f926a95-4870-419a-a458-ff8e483190e6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:42.045771 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8f926a95-4870-419a-a458-ff8e483190e6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:42.047263 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-d4852411-913a-4abb-b9b0-a35960320d53 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Getting quotas for user 8efa417e5eb04ea682201f30b003bd54 and project eed49c99a6a64e779184cfde80a29a52. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:30:42.061348 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8f926a95-4870-419a-a458-ff8e483190e6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:42.062080 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8f926a95-4870-419a-a458-ff8e483190e6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:42.063386 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8f926a95-4870-419a-a458-ff8e483190e6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:42.063975 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8f926a95-4870-419a-a458-ff8e483190e6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:42.115049 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d4852411-913a-4abb-b9b0-a35960320d53 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.105020 Jun 20 12:30:42.116448 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3004/5910] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 12:30:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:30:42.287099 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8f926a95-4870-419a-a458-ff8e483190e6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:42.344848 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8f926a95-4870-419a-a458-ff8e483190e6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1510 microversion: 2.1 time: 0.296921 Jun 20 12:30:42.353991 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2907/5911] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:42 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1510 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:30:43.371983 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-40339bd1-56f0-49c9-9456-b3512198106e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:43.374698 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-40339bd1-56f0-49c9-9456-b3512198106e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:43.391134 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-40339bd1-56f0-49c9-9456-b3512198106e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:43.396099 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-40339bd1-56f0-49c9-9456-b3512198106e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:43.399494 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-40339bd1-56f0-49c9-9456-b3512198106e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:43.402293 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-40339bd1-56f0-49c9-9456-b3512198106e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:43.692850 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-40339bd1-56f0-49c9-9456-b3512198106e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:43.704158 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-40339bd1-56f0-49c9-9456-b3512198106e tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1510 microversion: 2.1 time: 0.336894 Jun 20 12:30:43.709638 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3005/5912] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:43 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1510 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:44.581588 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-51c13d3e-2a37-4b99-9397-203d41c06388 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-342655353", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b693aa64-194c-48ff-b501-d251e21510b1"}], "security_groups": [{"name": "tempest-securitygroup--224631353"}], "key_name": "tempest-keypair-1132091155", "user_data": "}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:30:44.727375 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7aa10885-07bf-4b5b-9a2e-d5210dd2760d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:44.728857 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7aa10885-07bf-4b5b-9a2e-d5210dd2760d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:44.744077 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7aa10885-07bf-4b5b-9a2e-d5210dd2760d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:44.745000 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7aa10885-07bf-4b5b-9a2e-d5210dd2760d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:44.747312 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7aa10885-07bf-4b5b-9a2e-d5210dd2760d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:44.747924 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7aa10885-07bf-4b5b-9a2e-d5210dd2760d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:44.764951 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-51c13d3e-2a37-4b99-9397-203d41c06388 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] validate_networks() for [('b693aa64-194c-48ff-b501-d251e21510b1', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:30:44.981632 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7aa10885-07bf-4b5b-9a2e-d5210dd2760d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:45.024598 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7aa10885-07bf-4b5b-9a2e-d5210dd2760d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1510 microversion: 2.1 time: 0.302295 Jun 20 12:30:45.034811 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3006/5913] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:44 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1510 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:30:46.042951 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ceefce92-3144-4dc6-86bd-a5357c81648f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:46.044405 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ceefce92-3144-4dc6-86bd-a5357c81648f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:46.070672 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ceefce92-3144-4dc6-86bd-a5357c81648f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:46.076955 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ceefce92-3144-4dc6-86bd-a5357c81648f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:46.078020 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ceefce92-3144-4dc6-86bd-a5357c81648f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:46.084482 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ceefce92-3144-4dc6-86bd-a5357c81648f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:46.361518 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-51c13d3e-2a37-4b99-9397-203d41c06388 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:30:46.362580 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-51c13d3e-2a37-4b99-9397-203d41c06388 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:30:46.363345 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-51c13d3e-2a37-4b99-9397-203d41c06388 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:30:46.364019 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-51c13d3e-2a37-4b99-9397-203d41c06388 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:30:46.364755 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-51c13d3e-2a37-4b99-9397-203d41c06388 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:30:46.374590 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-51c13d3e-2a37-4b99-9397-203d41c06388 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:46.375502 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-51c13d3e-2a37-4b99-9397-203d41c06388 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:46.376662 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ceefce92-3144-4dc6-86bd-a5357c81648f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:46.376922 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-51c13d3e-2a37-4b99-9397-203d41c06388 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:46.377535 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-51c13d3e-2a37-4b99-9397-203d41c06388 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:46.392990 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:46.397764 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-51c13d3e-2a37-4b99-9397-203d41c06388 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Getting quotas for project eed49c99a6a64e779184cfde80a29a52. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:30:46.399662 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ceefce92-3144-4dc6-86bd-a5357c81648f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1510 microversion: 2.1 time: 0.359975 Jun 20 12:30:46.404342 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-51c13d3e-2a37-4b99-9397-203d41c06388 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Getting quotas for user 8efa417e5eb04ea682201f30b003bd54 and project eed49c99a6a64e779184cfde80a29a52. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:30:46.414591 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3007/5914] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:46 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1510 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:46.418858 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-51c13d3e-2a37-4b99-9397-203d41c06388 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:30:46.421407 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-51c13d3e-2a37-4b99-9397-203d41c06388 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:30:46.527381 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-51c13d3e-2a37-4b99-9397-203d41c06388 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.951580 Jun 20 12:30:46.540791 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-180498eb-db7d-4abd-9ca4-60c6496e73c0 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:46.541468 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-180498eb-db7d-4abd-9ca4-60c6496e73c0 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:46.544302 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2908/5915] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:30:44 2022] POST /compute/v2.1/servers => generated 408 bytes in 1958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:30:46.603722 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-180498eb-db7d-4abd-9ca4-60c6496e73c0 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:46.611785 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-180498eb-db7d-4abd-9ca4-60c6496e73c0 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 200 len: 1245 microversion: 2.1 time: 0.077300 Jun 20 12:30:46.612414 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3008/5916] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:46 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 1245 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:47.422786 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9ac7a113-d3d7-418a-95de-af11a47f6f9c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:47.423404 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9ac7a113-d3d7-418a-95de-af11a47f6f9c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:47.464690 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9ac7a113-d3d7-418a-95de-af11a47f6f9c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:47.468974 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9ac7a113-d3d7-418a-95de-af11a47f6f9c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:47.470217 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9ac7a113-d3d7-418a-95de-af11a47f6f9c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:47.470944 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9ac7a113-d3d7-418a-95de-af11a47f6f9c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:47.633910 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-23b057f9-4a13-4a10-b913-ad7035529b3d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:47.635637 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-23b057f9-4a13-4a10-b913-ad7035529b3d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:47.644444 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-23b057f9-4a13-4a10-b913-ad7035529b3d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:47.645388 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-23b057f9-4a13-4a10-b913-ad7035529b3d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:47.646683 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-23b057f9-4a13-4a10-b913-ad7035529b3d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:47.647373 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-23b057f9-4a13-4a10-b913-ad7035529b3d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:47.759312 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9ac7a113-d3d7-418a-95de-af11a47f6f9c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:47.767046 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-23b057f9-4a13-4a10-b913-ad7035529b3d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:47.782274 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-23b057f9-4a13-4a10-b913-ad7035529b3d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 200 len: 1297 microversion: 2.1 time: 0.157636 Jun 20 12:30:47.783053 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9ac7a113-d3d7-418a-95de-af11a47f6f9c tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1510 microversion: 2.1 time: 0.363019 Jun 20 12:30:47.784589 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3009/5917] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:47 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 1297 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:47.790822 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2909/5918] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:47 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1510 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:48.805203 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e1266f64-891b-4d95-80c1-e5d9c9fb27a5 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:48.805875 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e1266f64-891b-4d95-80c1-e5d9c9fb27a5 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:48.813268 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c6739753-4bc7-470c-92bf-ec41b886092f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:48.814760 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c6739753-4bc7-470c-92bf-ec41b886092f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:48.821431 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e1266f64-891b-4d95-80c1-e5d9c9fb27a5 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:48.822467 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e1266f64-891b-4d95-80c1-e5d9c9fb27a5 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:48.824447 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e1266f64-891b-4d95-80c1-e5d9c9fb27a5 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:48.825490 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e1266f64-891b-4d95-80c1-e5d9c9fb27a5 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:48.848052 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6739753-4bc7-470c-92bf-ec41b886092f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:48.849434 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6739753-4bc7-470c-92bf-ec41b886092f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:48.851323 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6739753-4bc7-470c-92bf-ec41b886092f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:48.854192 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6739753-4bc7-470c-92bf-ec41b886092f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:48.960092 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e1266f64-891b-4d95-80c1-e5d9c9fb27a5 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:48.973954 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e1266f64-891b-4d95-80c1-e5d9c9fb27a5 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 200 len: 1303 microversion: 2.1 time: 0.171544 Jun 20 12:30:48.990469 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2910/5919] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:48 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 1303 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:49.141441 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c6739753-4bc7-470c-92bf-ec41b886092f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:49.165933 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c6739753-4bc7-470c-92bf-ec41b886092f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1510 microversion: 2.1 time: 0.362331 Jun 20 12:30:49.166791 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3010/5920] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:48 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1510 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:30:49.995310 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a1262f18-73d7-46bf-a36d-87b805d60fe5 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:49.999698 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a1262f18-73d7-46bf-a36d-87b805d60fe5 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:50.015239 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a1262f18-73d7-46bf-a36d-87b805d60fe5 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:50.018008 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a1262f18-73d7-46bf-a36d-87b805d60fe5 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:50.021610 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a1262f18-73d7-46bf-a36d-87b805d60fe5 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:50.022433 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a1262f18-73d7-46bf-a36d-87b805d60fe5 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:50.189966 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f96fb676-3d18-40b3-bc50-e6e165a8e4a4 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:50.192166 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f96fb676-3d18-40b3-bc50-e6e165a8e4a4 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:50.209950 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f96fb676-3d18-40b3-bc50-e6e165a8e4a4 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:50.211768 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f96fb676-3d18-40b3-bc50-e6e165a8e4a4 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:50.216659 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f96fb676-3d18-40b3-bc50-e6e165a8e4a4 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:50.217778 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f96fb676-3d18-40b3-bc50-e6e165a8e4a4 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:50.354483 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a1262f18-73d7-46bf-a36d-87b805d60fe5 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:50.368167 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a1262f18-73d7-46bf-a36d-87b805d60fe5 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 200 len: 1370 microversion: 2.1 time: 0.379797 Jun 20 12:30:50.370362 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2911/5921] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:49 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 1370 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:50.570346 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f96fb676-3d18-40b3-bc50-e6e165a8e4a4 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:50.586810 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f96fb676-3d18-40b3-bc50-e6e165a8e4a4 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1510 microversion: 2.1 time: 0.395217 Jun 20 12:30:50.587501 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3011/5922] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:50 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1510 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:30:50.905361 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-cee1da5d-4844-4edb-857c-0de7cd17edb3 req-3024fdf5-5404-45b5-ac37-f732f6427b5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c987561-0d7f-495d-9422-99a32b18357a", "tag": "0ba6654d-5537-45cc-b2ee-add339c1b1a6"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:30:50.931454 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-cee1da5d-4844-4edb-857c-0de7cd17edb3 req-3024fdf5-5404-45b5-ac37-f732f6427b5f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:50.934871 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-cee1da5d-4844-4edb-857c-0de7cd17edb3 req-3024fdf5-5404-45b5-ac37-f732f6427b5f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:50.979414 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-cee1da5d-4844-4edb-857c-0de7cd17edb3 req-3024fdf5-5404-45b5-ac37-f732f6427b5f service nova] Creating event network-changed:0ba6654d-5537-45cc-b2ee-add339c1b1a6 for instance 4c987561-0d7f-495d-9422-99a32b18357a on n-h2-master-1 Jun 20 12:30:50.985864 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-cee1da5d-4844-4edb-857c-0de7cd17edb3 req-3024fdf5-5404-45b5-ac37-f732f6427b5f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088172 Jun 20 12:30:50.988719 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2912/5923] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:30:51.386468 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6cb781ec-574a-44cd-b008-8c6ba1ff0ec4 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:51.387098 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6cb781ec-574a-44cd-b008-8c6ba1ff0ec4 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:51.398214 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6cb781ec-574a-44cd-b008-8c6ba1ff0ec4 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:51.398671 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6cb781ec-574a-44cd-b008-8c6ba1ff0ec4 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:51.399457 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6cb781ec-574a-44cd-b008-8c6ba1ff0ec4 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:51.399892 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6cb781ec-574a-44cd-b008-8c6ba1ff0ec4 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:51.624143 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6981f580-dc7d-46a7-a3cf-ab7296b5cf6f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:51.636966 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6981f580-dc7d-46a7-a3cf-ab7296b5cf6f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:51.648911 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6981f580-dc7d-46a7-a3cf-ab7296b5cf6f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:51.649377 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6981f580-dc7d-46a7-a3cf-ab7296b5cf6f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:51.650150 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6981f580-dc7d-46a7-a3cf-ab7296b5cf6f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:51.650577 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6981f580-dc7d-46a7-a3cf-ab7296b5cf6f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:51.667443 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6cb781ec-574a-44cd-b008-8c6ba1ff0ec4 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:51.682196 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6cb781ec-574a-44cd-b008-8c6ba1ff0ec4 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 200 len: 1370 microversion: 2.1 time: 0.299908 Jun 20 12:30:51.687577 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3012/5924] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:51 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 1370 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:30:52.001012 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6981f580-dc7d-46a7-a3cf-ab7296b5cf6f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:52.028516 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6981f580-dc7d-46a7-a3cf-ab7296b5cf6f tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1510 microversion: 2.1 time: 0.414076 Jun 20 12:30:52.029141 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2913/5925] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:51 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1510 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:52.715288 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6ca06741-24e7-4900-92c4-6763e580a5e4 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:52.718186 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6ca06741-24e7-4900-92c4-6763e580a5e4 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:52.742367 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6ca06741-24e7-4900-92c4-6763e580a5e4 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:52.743176 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6ca06741-24e7-4900-92c4-6763e580a5e4 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:52.744683 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6ca06741-24e7-4900-92c4-6763e580a5e4 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:52.745474 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6ca06741-24e7-4900-92c4-6763e580a5e4 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:52.929695 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6ca06741-24e7-4900-92c4-6763e580a5e4 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:52.938347 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6ca06741-24e7-4900-92c4-6763e580a5e4 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 200 len: 1370 microversion: 2.1 time: 0.235559 Jun 20 12:30:52.958069 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3013/5926] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:52 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 1370 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:53.047134 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-051e4e2a-8d7f-47ca-94f6-03119e456481 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:53.048745 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-051e4e2a-8d7f-47ca-94f6-03119e456481 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:53.058537 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-051e4e2a-8d7f-47ca-94f6-03119e456481 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:53.059291 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-051e4e2a-8d7f-47ca-94f6-03119e456481 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:53.060443 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-051e4e2a-8d7f-47ca-94f6-03119e456481 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:53.061196 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-051e4e2a-8d7f-47ca-94f6-03119e456481 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:53.271050 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-051e4e2a-8d7f-47ca-94f6-03119e456481 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:53.280988 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-051e4e2a-8d7f-47ca-94f6-03119e456481 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1510 microversion: 2.1 time: 0.238876 Jun 20 12:30:53.283636 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2914/5927] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:53 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1510 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:53.963245 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e233322b-6826-41c4-953c-b4f8dffdc808 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:53.965686 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e233322b-6826-41c4-953c-b4f8dffdc808 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:53.975911 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e233322b-6826-41c4-953c-b4f8dffdc808 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:53.978281 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e233322b-6826-41c4-953c-b4f8dffdc808 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:53.980230 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e233322b-6826-41c4-953c-b4f8dffdc808 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:53.980698 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e233322b-6826-41c4-953c-b4f8dffdc808 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:54.176720 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e233322b-6826-41c4-953c-b4f8dffdc808 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:54.185584 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e233322b-6826-41c4-953c-b4f8dffdc808 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 200 len: 1370 microversion: 2.1 time: 0.231608 Jun 20 12:30:54.186437 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3014/5928] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:53 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 1370 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:54.302152 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-87220aa3-1489-42d6-a8fa-3e7742fa9109 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:54.303728 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-87220aa3-1489-42d6-a8fa-3e7742fa9109 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:54.314980 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-87220aa3-1489-42d6-a8fa-3e7742fa9109 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:54.317771 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-87220aa3-1489-42d6-a8fa-3e7742fa9109 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:54.320521 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-87220aa3-1489-42d6-a8fa-3e7742fa9109 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:54.321452 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-87220aa3-1489-42d6-a8fa-3e7742fa9109 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:54.516788 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-87220aa3-1489-42d6-a8fa-3e7742fa9109 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:54.535585 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-87220aa3-1489-42d6-a8fa-3e7742fa9109 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1510 microversion: 2.1 time: 0.240118 Jun 20 12:30:54.545987 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2915/5929] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:54 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1510 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:55.204073 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1935a8e0-87f6-4834-97ff-336cdd50f113 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:55.204724 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1935a8e0-87f6-4834-97ff-336cdd50f113 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:55.225800 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1935a8e0-87f6-4834-97ff-336cdd50f113 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:55.226235 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1935a8e0-87f6-4834-97ff-336cdd50f113 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:55.227041 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1935a8e0-87f6-4834-97ff-336cdd50f113 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:55.227482 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1935a8e0-87f6-4834-97ff-336cdd50f113 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:55.392179 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1935a8e0-87f6-4834-97ff-336cdd50f113 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:55.401954 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1935a8e0-87f6-4834-97ff-336cdd50f113 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 200 len: 1370 microversion: 2.1 time: 0.201707 Jun 20 12:30:55.402561 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3015/5930] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:55 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 1370 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:55.553487 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0863f706-ff8c-46a9-9768-db2494eb79df tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:55.554734 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0863f706-ff8c-46a9-9768-db2494eb79df tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:55.569669 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0863f706-ff8c-46a9-9768-db2494eb79df tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:55.570493 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0863f706-ff8c-46a9-9768-db2494eb79df tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:55.571497 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0863f706-ff8c-46a9-9768-db2494eb79df tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:55.572091 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0863f706-ff8c-46a9-9768-db2494eb79df tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:55.841905 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0863f706-ff8c-46a9-9768-db2494eb79df tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:55.849797 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0863f706-ff8c-46a9-9768-db2494eb79df tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1510 microversion: 2.1 time: 0.300552 Jun 20 12:30:55.850388 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2916/5931] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:55 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1510 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:56.427651 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0546e7e2-40f3-4488-94e3-2fb9e1bb3086 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:56.428327 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0546e7e2-40f3-4488-94e3-2fb9e1bb3086 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:56.438382 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0546e7e2-40f3-4488-94e3-2fb9e1bb3086 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:56.439162 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0546e7e2-40f3-4488-94e3-2fb9e1bb3086 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:56.440496 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0546e7e2-40f3-4488-94e3-2fb9e1bb3086 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:56.441450 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0546e7e2-40f3-4488-94e3-2fb9e1bb3086 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:56.611772 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:56.632868 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0546e7e2-40f3-4488-94e3-2fb9e1bb3086 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:56.644487 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0546e7e2-40f3-4488-94e3-2fb9e1bb3086 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 200 len: 1370 microversion: 2.1 time: 0.228862 Jun 20 12:30:56.646582 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3016/5932] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:56 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 1370 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:56.864059 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:56.864766 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:56.869946 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5b9db5ac-d2fa-40f4-b529-6658fc785f04 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:56.870598 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5b9db5ac-d2fa-40f4-b529-6658fc785f04 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:56.877056 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5b9db5ac-d2fa-40f4-b529-6658fc785f04 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:56.877557 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5b9db5ac-d2fa-40f4-b529-6658fc785f04 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:56.878533 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5b9db5ac-d2fa-40f4-b529-6658fc785f04 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:56.879447 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5b9db5ac-d2fa-40f4-b529-6658fc785f04 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:57.046947 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5b9db5ac-d2fa-40f4-b529-6658fc785f04 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:57.057998 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5b9db5ac-d2fa-40f4-b529-6658fc785f04 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1510 microversion: 2.1 time: 0.195054 Jun 20 12:30:57.059504 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2917/5933] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:56 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1510 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:57.662788 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9cad0751-613b-486c-9725-87c179bc3675 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:57.663716 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9cad0751-613b-486c-9725-87c179bc3675 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:57.671606 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9cad0751-613b-486c-9725-87c179bc3675 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:57.672057 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9cad0751-613b-486c-9725-87c179bc3675 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:57.672861 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9cad0751-613b-486c-9725-87c179bc3675 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:57.673799 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9cad0751-613b-486c-9725-87c179bc3675 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:57.893467 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9cad0751-613b-486c-9725-87c179bc3675 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:57.903726 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9cad0751-613b-486c-9725-87c179bc3675 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 200 len: 1370 microversion: 2.1 time: 0.243600 Jun 20 12:30:57.913760 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3017/5934] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:57 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 1370 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:58.074878 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9c8dbd8e-b975-4111-baf0-60f1928c5017 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:58.075509 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9c8dbd8e-b975-4111-baf0-60f1928c5017 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:58.082933 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c8dbd8e-b975-4111-baf0-60f1928c5017 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:58.083762 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c8dbd8e-b975-4111-baf0-60f1928c5017 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:58.084734 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c8dbd8e-b975-4111-baf0-60f1928c5017 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:58.085327 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c8dbd8e-b975-4111-baf0-60f1928c5017 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:58.242973 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9c8dbd8e-b975-4111-baf0-60f1928c5017 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:58.253435 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9c8dbd8e-b975-4111-baf0-60f1928c5017 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1510 microversion: 2.1 time: 0.182331 Jun 20 12:30:58.255549 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2918/5935] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:58 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1510 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:58.921606 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-582cfde2-21ca-427a-97c0-802a23eeb595 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:58.922381 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-582cfde2-21ca-427a-97c0-802a23eeb595 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:58.932243 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-582cfde2-21ca-427a-97c0-802a23eeb595 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:58.933960 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-582cfde2-21ca-427a-97c0-802a23eeb595 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:58.934839 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-582cfde2-21ca-427a-97c0-802a23eeb595 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:58.935281 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-582cfde2-21ca-427a-97c0-802a23eeb595 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:59.150191 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-582cfde2-21ca-427a-97c0-802a23eeb595 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:59.161463 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-582cfde2-21ca-427a-97c0-802a23eeb595 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 200 len: 1370 microversion: 2.1 time: 0.243693 Jun 20 12:30:59.162240 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3018/5936] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:58 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 1370 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:30:59.214765 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-4e3d69ea-972a-4b8b-b83e-64907795647e req-2a9639d4-221b-4643-b642-cc2aace7067f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c987561-0d7f-495d-9422-99a32b18357a", "name": "network-vif-plugged", "status": "completed", "tag": "0ba6654d-5537-45cc-b2ee-add339c1b1a6"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:30:59.229524 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-4e3d69ea-972a-4b8b-b83e-64907795647e req-2a9639d4-221b-4643-b642-cc2aace7067f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:59.229982 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-4e3d69ea-972a-4b8b-b83e-64907795647e req-2a9639d4-221b-4643-b642-cc2aace7067f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:59.245241 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-4e3d69ea-972a-4b8b-b83e-64907795647e req-2a9639d4-221b-4643-b642-cc2aace7067f service nova] Creating event network-vif-plugged:0ba6654d-5537-45cc-b2ee-add339c1b1a6 for instance 4c987561-0d7f-495d-9422-99a32b18357a on n-h2-master-1 Jun 20 12:30:59.251398 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-4e3d69ea-972a-4b8b-b83e-64907795647e req-2a9639d4-221b-4643-b642-cc2aace7067f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041331 Jun 20 12:30:59.256268 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2919/5937] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:30:59.272965 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5bcc6c08-9ed9-446f-8cd0-997c43e63248 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:59.273861 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5bcc6c08-9ed9-446f-8cd0-997c43e63248 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:59.281016 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5bcc6c08-9ed9-446f-8cd0-997c43e63248 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:59.281596 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5bcc6c08-9ed9-446f-8cd0-997c43e63248 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:59.284399 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5bcc6c08-9ed9-446f-8cd0-997c43e63248 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:59.285111 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5bcc6c08-9ed9-446f-8cd0-997c43e63248 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:59.527324 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5bcc6c08-9ed9-446f-8cd0-997c43e63248 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:59.536127 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5bcc6c08-9ed9-446f-8cd0-997c43e63248 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1510 microversion: 2.1 time: 0.267968 Jun 20 12:30:59.540665 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3019/5938] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:59 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1510 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:31:00.188689 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1e769cf9-16d9-4060-bfac-6e27feb94f21 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:00.190101 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1e769cf9-16d9-4060-bfac-6e27feb94f21 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:00.192816 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:00.199934 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e769cf9-16d9-4060-bfac-6e27feb94f21 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:00.200420 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e769cf9-16d9-4060-bfac-6e27feb94f21 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:00.201245 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e769cf9-16d9-4060-bfac-6e27feb94f21 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:00.201688 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e769cf9-16d9-4060-bfac-6e27feb94f21 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:00.371041 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1e769cf9-16d9-4060-bfac-6e27feb94f21 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:00.385436 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1e769cf9-16d9-4060-bfac-6e27feb94f21 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 200 len: 1370 microversion: 2.1 time: 0.210052 Jun 20 12:31:00.386646 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2920/5939] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:00 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 1370 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:31:00.553665 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d5287f20-2660-405b-a872-f9af12e3715a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:00.554367 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d5287f20-2660-405b-a872-f9af12e3715a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:00.561381 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d5287f20-2660-405b-a872-f9af12e3715a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:00.561986 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d5287f20-2660-405b-a872-f9af12e3715a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:00.562788 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d5287f20-2660-405b-a872-f9af12e3715a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:00.563223 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d5287f20-2660-405b-a872-f9af12e3715a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:00.825076 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d5287f20-2660-405b-a872-f9af12e3715a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:00.834449 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d5287f20-2660-405b-a872-f9af12e3715a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1487 microversion: 2.1 time: 0.285083 Jun 20 12:31:00.835057 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3020/5940] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:00 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1487 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:31:00.851507 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1eb93e9c-e5d8-4343-83e6-74b105340e2a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1199253636"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:31:00.853030 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1eb93e9c-e5d8-4343-83e6-74b105340e2a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:00.859178 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1eb93e9c-e5d8-4343-83e6-74b105340e2a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:00.859868 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1eb93e9c-e5d8-4343-83e6-74b105340e2a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:00.860983 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1eb93e9c-e5d8-4343-83e6-74b105340e2a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:00.861584 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1eb93e9c-e5d8-4343-83e6-74b105340e2a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:00.968302 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1eb93e9c-e5d8-4343-83e6-74b105340e2a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "PUT /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1061 microversion: 2.1 time: 0.121119 Jun 20 12:31:00.972420 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2921/5941] 10.222.0.27 () {60 vars in 1255 bytes} [Mon Jun 20 12:31:00 2022] PUT /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1061 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:31:00.985429 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-90d5347d-3a3a-47a3-b968-6a2da3cba478 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:00.986318 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-90d5347d-3a3a-47a3-b968-6a2da3cba478 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:00.994201 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-90d5347d-3a3a-47a3-b968-6a2da3cba478 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:00.996758 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-90d5347d-3a3a-47a3-b968-6a2da3cba478 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:00.997924 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-90d5347d-3a3a-47a3-b968-6a2da3cba478 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:00.998507 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-90d5347d-3a3a-47a3-b968-6a2da3cba478 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:01.192685 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-90d5347d-3a3a-47a3-b968-6a2da3cba478 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:01.208410 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-90d5347d-3a3a-47a3-b968-6a2da3cba478 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1488 microversion: 2.1 time: 0.227877 Jun 20 12:31:01.221697 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3021/5942] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:00 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1488 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:31:01.225798 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3be84cc7-8079-4ff3-9cd0-b23c3fcb8138 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:01.226422 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3be84cc7-8079-4ff3-9cd0-b23c3fcb8138 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:01.236059 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3be84cc7-8079-4ff3-9cd0-b23c3fcb8138 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:01.236564 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3be84cc7-8079-4ff3-9cd0-b23c3fcb8138 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:01.238761 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3be84cc7-8079-4ff3-9cd0-b23c3fcb8138 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:01.239433 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3be84cc7-8079-4ff3-9cd0-b23c3fcb8138 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:01.403327 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9e6e8644-792f-4441-8c5c-bfd97caf35ad tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:01.404024 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9e6e8644-792f-4441-8c5c-bfd97caf35ad tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:01.421256 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9e6e8644-792f-4441-8c5c-bfd97caf35ad tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:01.421952 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9e6e8644-792f-4441-8c5c-bfd97caf35ad tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:01.424436 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9e6e8644-792f-4441-8c5c-bfd97caf35ad tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:01.427753 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9e6e8644-792f-4441-8c5c-bfd97caf35ad tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:01.466303 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3be84cc7-8079-4ff3-9cd0-b23c3fcb8138 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:01.475327 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3be84cc7-8079-4ff3-9cd0-b23c3fcb8138 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1488 microversion: 2.1 time: 0.253999 Jun 20 12:31:01.476477 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2922/5943] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:01 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1488 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:31:01.496992 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-86e2bd4c-98c3-4470-8e36-e205a7a4abf7 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:01.497738 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-86e2bd4c-98c3-4470-8e36-e205a7a4abf7 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:01.505181 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-86e2bd4c-98c3-4470-8e36-e205a7a4abf7 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:01.505920 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-86e2bd4c-98c3-4470-8e36-e205a7a4abf7 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:01.506928 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-86e2bd4c-98c3-4470-8e36-e205a7a4abf7 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:01.507574 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-86e2bd4c-98c3-4470-8e36-e205a7a4abf7 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:01.524526 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:01.542658 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-86e2bd4c-98c3-4470-8e36-e205a7a4abf7 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:31:01.671410 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-86e2bd4c-98c3-4470-8e36-e205a7a4abf7 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 204 len: 0 microversion: 2.1 time: 0.183557 Jun 20 12:31:01.672460 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2923/5944] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:31:01 2022] DELETE /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 12:31:01.678269 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9e6e8644-792f-4441-8c5c-bfd97caf35ad tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:01.684364 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5510e61d-0ba7-4aa4-a428-d11edcd11c06 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:01.685310 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5510e61d-0ba7-4aa4-a428-d11edcd11c06 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:01.693475 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9e6e8644-792f-4441-8c5c-bfd97caf35ad tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 200 len: 1563 microversion: 2.1 time: 0.294301 Jun 20 12:31:01.694403 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3022/5945] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:01 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 1563 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:31:01.708412 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5510e61d-0ba7-4aa4-a428-d11edcd11c06 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:01.710030 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5510e61d-0ba7-4aa4-a428-d11edcd11c06 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:01.710850 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f2a0d25b-aa73-49ec-9f28-e432cec4b34d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:01.711367 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f2a0d25b-aa73-49ec-9f28-e432cec4b34d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:01.712132 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5510e61d-0ba7-4aa4-a428-d11edcd11c06 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:01.712798 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5510e61d-0ba7-4aa4-a428-d11edcd11c06 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:01.732890 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f2a0d25b-aa73-49ec-9f28-e432cec4b34d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:01.735100 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f2a0d25b-aa73-49ec-9f28-e432cec4b34d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:01.739403 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f2a0d25b-aa73-49ec-9f28-e432cec4b34d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:01.741094 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f2a0d25b-aa73-49ec-9f28-e432cec4b34d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:01.874844 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5510e61d-0ba7-4aa4-a428-d11edcd11c06 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:01.883158 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5510e61d-0ba7-4aa4-a428-d11edcd11c06 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1494 microversion: 2.1 time: 0.206057 Jun 20 12:31:01.884914 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2924/5946] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:01 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1494 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:31:01.907705 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f2a0d25b-aa73-49ec-9f28-e432cec4b34d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.201477 Jun 20 12:31:01.909047 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3023/5947] 10.222.0.27 () {58 vars in 1274 bytes} [Mon Jun 20 12:31:01 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a/os-interface => generated 284 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:31:02.902479 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-caf37bd4-d6a6-4919-91f0-9182b129d591 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:02.903111 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-caf37bd4-d6a6-4919-91f0-9182b129d591 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:02.915171 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-caf37bd4-d6a6-4919-91f0-9182b129d591 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:02.915945 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-caf37bd4-d6a6-4919-91f0-9182b129d591 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:02.916949 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-caf37bd4-d6a6-4919-91f0-9182b129d591 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:02.917540 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-caf37bd4-d6a6-4919-91f0-9182b129d591 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:03.764654 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-caf37bd4-d6a6-4919-91f0-9182b129d591 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:03.773922 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-caf37bd4-d6a6-4919-91f0-9182b129d591 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1494 microversion: 2.1 time: 0.875364 Jun 20 12:31:03.783118 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2925/5948] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:02 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1494 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:31:04.208374 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-eca3255d-06fb-43d6-aa98-3e5053f63ea5 req-896179c2-b9f2-4f6d-ba62-2c10ff74192f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c987561-0d7f-495d-9422-99a32b18357a", "tag": "0ba6654d-5537-45cc-b2ee-add339c1b1a6"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:31:04.229075 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-eca3255d-06fb-43d6-aa98-3e5053f63ea5 req-896179c2-b9f2-4f6d-ba62-2c10ff74192f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:04.229539 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-eca3255d-06fb-43d6-aa98-3e5053f63ea5 req-896179c2-b9f2-4f6d-ba62-2c10ff74192f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:04.246881 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-eca3255d-06fb-43d6-aa98-3e5053f63ea5 req-896179c2-b9f2-4f6d-ba62-2c10ff74192f service nova] Creating event network-changed:0ba6654d-5537-45cc-b2ee-add339c1b1a6 for instance 4c987561-0d7f-495d-9422-99a32b18357a on n-h2-master-1 Jun 20 12:31:04.257408 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-eca3255d-06fb-43d6-aa98-3e5053f63ea5 req-896179c2-b9f2-4f6d-ba62-2c10ff74192f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053349 Jun 20 12:31:04.258613 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3024/5949] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:31:04.800769 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-56ac989d-5bcf-49a7-9744-5108e560c423 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:04.801438 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-56ac989d-5bcf-49a7-9744-5108e560c423 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:04.824780 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-56ac989d-5bcf-49a7-9744-5108e560c423 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:04.825293 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-56ac989d-5bcf-49a7-9744-5108e560c423 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:04.826145 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-56ac989d-5bcf-49a7-9744-5108e560c423 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:04.826582 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-56ac989d-5bcf-49a7-9744-5108e560c423 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:05.001728 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-56ac989d-5bcf-49a7-9744-5108e560c423 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:05.013187 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-56ac989d-5bcf-49a7-9744-5108e560c423 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 200 len: 1292 microversion: 2.1 time: 0.216682 Jun 20 12:31:05.021816 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2926/5950] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:04 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 1292 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:31:06.040787 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0c28080f-7221-4886-aeee-e23aedcb8eb2 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:06.041406 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0c28080f-7221-4886-aeee-e23aedcb8eb2 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:06.054092 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0c28080f-7221-4886-aeee-e23aedcb8eb2 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:06.054856 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0c28080f-7221-4886-aeee-e23aedcb8eb2 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:06.056476 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0c28080f-7221-4886-aeee-e23aedcb8eb2 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:06.057662 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0c28080f-7221-4886-aeee-e23aedcb8eb2 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:06.078770 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-0c28080f-7221-4886-aeee-e23aedcb8eb2 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] HTTP exception thrown: Instance dcea95e3-52dc-4939-a426-505d3f686047 could not be found. Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0c28080f-7221-4886-aeee-e23aedcb8eb2 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Request method failure captured: Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 HTTP/1.1 Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGeaPbwuiKlZtfAakVi9AU1jZJYQpsiuqbtqj4H7EyEfa_Hs7Z-uZ4kORsCa_VB61-2zGcpt-Akt_fwFGZsdE57QH4a5RFxoaFSpMB5wQSEpC1nxSFtZmML3yZTCD6a9Nk7nPWXZGtd_9TDU17ULy9DxSwRUUNLntxWZGEmDQVAe1xk Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersTestJSON-953297781-project Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 8878d44956bd42e18f0409534e562ab6 Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersTestJSON-953297781-project Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: exception: Instance dcea95e3-52dc-4939-a426-505d3f686047 could not be found. Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'dcea95e3-52dc-4939-a426-505d3f686047'} Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcea95e3-52dc-4939-a426-505d3f686047 could not be found. Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcea95e3-52dc-4939-a426-505d3f686047 could not be found. Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.082925 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.088078 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:31:06.088078 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:31:06.088078 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:31:06.088078 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:31:06.088078 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcea95e3-52dc-4939-a426-505d3f686047 could not be found. Jun 20 12:31:06.088078 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.108518 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0c28080f-7221-4886-aeee-e23aedcb8eb2 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Returning 404 to user: Instance dcea95e3-52dc-4939-a426-505d3f686047 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:31:06.110615 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0c28080f-7221-4886-aeee-e23aedcb8eb2 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 404 len: 111 microversion: 2.1 time: 0.076531 Jun 20 12:31:06.112481 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3025/5951] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:06 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:31:06.124898 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bf5a7688-4864-4ec7-8e0f-377f2c3c5fc4 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:06.125798 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bf5a7688-4864-4ec7-8e0f-377f2c3c5fc4 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:06.139161 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bf5a7688-4864-4ec7-8e0f-377f2c3c5fc4 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:06.139642 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bf5a7688-4864-4ec7-8e0f-377f2c3c5fc4 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:06.140453 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bf5a7688-4864-4ec7-8e0f-377f2c3c5fc4 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:06.140890 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bf5a7688-4864-4ec7-8e0f-377f2c3c5fc4 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:06.164467 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-bf5a7688-4864-4ec7-8e0f-377f2c3c5fc4 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] HTTP exception thrown: Instance dcea95e3-52dc-4939-a426-505d3f686047 could not be found. Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bf5a7688-4864-4ec7-8e0f-377f2c3c5fc4 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Request method failure captured: Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 HTTP/1.1 Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGeaPbwuiKlZtfAakVi9AU1jZJYQpsiuqbtqj4H7EyEfa_Hs7Z-uZ4kORsCa_VB61-2zGcpt-Akt_fwFGZsdE57QH4a5RFxoaFSpMB5wQSEpC1nxSFtZmML3yZTCD6a9Nk7nPWXZGtd_9TDU17ULy9DxSwRUUNLntxWZGEmDQVAe1xk Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersTestJSON-953297781-project Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 8878d44956bd42e18f0409534e562ab6 Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersTestJSON-953297781-project Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: exception: Instance dcea95e3-52dc-4939-a426-505d3f686047 could not be found. Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'dcea95e3-52dc-4939-a426-505d3f686047'} Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcea95e3-52dc-4939-a426-505d3f686047 could not be found. Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:31:06.168275 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcea95e3-52dc-4939-a426-505d3f686047 could not be found. Jun 20 12:31:06.172342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.172342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:31:06.172342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.172342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.172342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:31:06.172342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:31:06.172342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:31:06.172342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:31:06.172342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcea95e3-52dc-4939-a426-505d3f686047 could not be found. Jun 20 12:31:06.172342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.174498 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bf5a7688-4864-4ec7-8e0f-377f2c3c5fc4 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Returning 404 to user: Instance dcea95e3-52dc-4939-a426-505d3f686047 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:31:06.175722 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bf5a7688-4864-4ec7-8e0f-377f2c3c5fc4 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 404 len: 111 microversion: 2.1 time: 0.054708 Jun 20 12:31:06.177044 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2927/5952] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:31:06 2022] DELETE /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:31:06.185098 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b4c69904-ba69-465c-ac15-57b16de33931 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:06.185709 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b4c69904-ba69-465c-ac15-57b16de33931 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dcea95e3-52dc-4939-a426-505d3f686047] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:06.195588 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b4c69904-ba69-465c-ac15-57b16de33931 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:06.196436 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b4c69904-ba69-465c-ac15-57b16de33931 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:06.197855 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b4c69904-ba69-465c-ac15-57b16de33931 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:06.198519 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b4c69904-ba69-465c-ac15-57b16de33931 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:06.218519 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-b4c69904-ba69-465c-ac15-57b16de33931 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] HTTP exception thrown: Instance dcea95e3-52dc-4939-a426-505d3f686047 could not be found. Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b4c69904-ba69-465c-ac15-57b16de33931 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Request method failure captured: Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 HTTP/1.1 Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGeaPbwuiKlZtfAakVi9AU1jZJYQpsiuqbtqj4H7EyEfa_Hs7Z-uZ4kORsCa_VB61-2zGcpt-Akt_fwFGZsdE57QH4a5RFxoaFSpMB5wQSEpC1nxSFtZmML3yZTCD6a9Nk7nPWXZGtd_9TDU17ULy9DxSwRUUNLntxWZGEmDQVAe1xk Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersTestJSON-953297781-project Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 8878d44956bd42e18f0409534e562ab6 Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersTestJSON-953297781-project Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: exception: Instance dcea95e3-52dc-4939-a426-505d3f686047 could not be found. Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'dcea95e3-52dc-4939-a426-505d3f686047'} Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcea95e3-52dc-4939-a426-505d3f686047 could not be found. Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcea95e3-52dc-4939-a426-505d3f686047 could not be found. Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.220800 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.225612 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:31:06.225612 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:31:06.225612 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:31:06.225612 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:31:06.225612 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcea95e3-52dc-4939-a426-505d3f686047 could not be found. Jun 20 12:31:06.225612 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.226545 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b4c69904-ba69-465c-ac15-57b16de33931 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Returning 404 to user: Instance dcea95e3-52dc-4939-a426-505d3f686047 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:31:06.228483 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b4c69904-ba69-465c-ac15-57b16de33931 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047" status: 404 len: 111 microversion: 2.1 time: 0.046489 Jun 20 12:31:06.229943 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3026/5953] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:06 2022] GET /compute/v2.1/servers/dcea95e3-52dc-4939-a426-505d3f686047 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:31:06.238361 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1ffc84cc-7a76-425e-8c8f-2555ce5a7ad3 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:06.239042 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1ffc84cc-7a76-425e-8c8f-2555ce5a7ad3 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dea33c0b-6680-408b-b019-b035b89d859f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:06.245723 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1ffc84cc-7a76-425e-8c8f-2555ce5a7ad3 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:06.246182 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1ffc84cc-7a76-425e-8c8f-2555ce5a7ad3 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:06.247048 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1ffc84cc-7a76-425e-8c8f-2555ce5a7ad3 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:06.248213 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1ffc84cc-7a76-425e-8c8f-2555ce5a7ad3 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:06.266447 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-1ffc84cc-7a76-425e-8c8f-2555ce5a7ad3 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] HTTP exception thrown: Instance dea33c0b-6680-408b-b019-b035b89d859f could not be found. Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1ffc84cc-7a76-425e-8c8f-2555ce5a7ad3 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Request method failure captured: Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f HTTP/1.1 Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGeaPbwuiKlZtfAakVi9AU1jZJYQpsiuqbtqj4H7EyEfa_Hs7Z-uZ4kORsCa_VB61-2zGcpt-Akt_fwFGZsdE57QH4a5RFxoaFSpMB5wQSEpC1nxSFtZmML3yZTCD6a9Nk7nPWXZGtd_9TDU17ULy9DxSwRUUNLntxWZGEmDQVAe1xk Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersTestJSON-953297781-project Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 8878d44956bd42e18f0409534e562ab6 Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersTestJSON-953297781-project Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: exception: Instance dea33c0b-6680-408b-b019-b035b89d859f could not be found. Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'dea33c0b-6680-408b-b019-b035b89d859f'} Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dea33c0b-6680-408b-b019-b035b89d859f could not be found. Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:31:06.268652 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dea33c0b-6680-408b-b019-b035b89d859f could not be found. Jun 20 12:31:06.272830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.272830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:31:06.272830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.272830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.272830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:31:06.272830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:31:06.272830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:31:06.272830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:31:06.272830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dea33c0b-6680-408b-b019-b035b89d859f could not be found. Jun 20 12:31:06.272830 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.275011 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1ffc84cc-7a76-425e-8c8f-2555ce5a7ad3 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Returning 404 to user: Instance dea33c0b-6680-408b-b019-b035b89d859f could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:31:06.276014 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1ffc84cc-7a76-425e-8c8f-2555ce5a7ad3 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f" status: 404 len: 111 microversion: 2.1 time: 0.041915 Jun 20 12:31:06.279819 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2928/5954] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:31:06 2022] DELETE /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:31:06.285518 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-334750a9-7685-4ae1-a8f2-8173aef81a37 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:06.286390 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-334750a9-7685-4ae1-a8f2-8173aef81a37 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: dea33c0b-6680-408b-b019-b035b89d859f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:06.298347 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-334750a9-7685-4ae1-a8f2-8173aef81a37 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:06.299230 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-334750a9-7685-4ae1-a8f2-8173aef81a37 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:06.300668 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-a030f499-981e-4d66-ad3b-7663f8dab63c req-fd99d807-f69f-49a5-ad2e-17a685d98e6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcea95e3-52dc-4939-a426-505d3f686047", "name": "network-vif-deleted", "tag": "6e920d54-bdb0-4f6a-8cb1-adad19178521"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:31:06.301582 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-334750a9-7685-4ae1-a8f2-8173aef81a37 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:06.302093 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-334750a9-7685-4ae1-a8f2-8173aef81a37 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:06.320367 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-a030f499-981e-4d66-ad3b-7663f8dab63c req-fd99d807-f69f-49a5-ad2e-17a685d98e6d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:06.320795 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-a030f499-981e-4d66-ad3b-7663f8dab63c req-fd99d807-f69f-49a5-ad2e-17a685d98e6d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:06.326805 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-334750a9-7685-4ae1-a8f2-8173aef81a37 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] HTTP exception thrown: Instance dea33c0b-6680-408b-b019-b035b89d859f could not be found. Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-334750a9-7685-4ae1-a8f2-8173aef81a37 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Request method failure captured: Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f HTTP/1.1 Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGeaPbwuiKlZtfAakVi9AU1jZJYQpsiuqbtqj4H7EyEfa_Hs7Z-uZ4kORsCa_VB61-2zGcpt-Akt_fwFGZsdE57QH4a5RFxoaFSpMB5wQSEpC1nxSFtZmML3yZTCD6a9Nk7nPWXZGtd_9TDU17ULy9DxSwRUUNLntxWZGEmDQVAe1xk Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersTestJSON-953297781-project Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 8878d44956bd42e18f0409534e562ab6 Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersTestJSON-953297781-project Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: exception: Instance dea33c0b-6680-408b-b019-b035b89d859f could not be found. Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'dea33c0b-6680-408b-b019-b035b89d859f'} Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dea33c0b-6680-408b-b019-b035b89d859f could not be found. Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dea33c0b-6680-408b-b019-b035b89d859f could not be found. Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.333213 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.338593 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:31:06.338593 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:31:06.338593 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:31:06.338593 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:31:06.338593 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dea33c0b-6680-408b-b019-b035b89d859f could not be found. Jun 20 12:31:06.338593 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.341210 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-334750a9-7685-4ae1-a8f2-8173aef81a37 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Returning 404 to user: Instance dea33c0b-6680-408b-b019-b035b89d859f could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:31:06.342522 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-334750a9-7685-4ae1-a8f2-8173aef81a37 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f" status: 404 len: 111 microversion: 2.1 time: 0.061280 Jun 20 12:31:06.347704 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3027/5955] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:06 2022] GET /compute/v2.1/servers/dea33c0b-6680-408b-b019-b035b89d859f => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:31:06.361221 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-288ceea3-9f0f-4637-bcdc-74cf627e2675 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:06.361438 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-a030f499-981e-4d66-ad3b-7663f8dab63c req-fd99d807-f69f-49a5-ad2e-17a685d98e6d service nova] Creating event network-vif-deleted:6e920d54-bdb0-4f6a-8cb1-adad19178521 for instance dcea95e3-52dc-4939-a426-505d3f686047 on n-h2-master-1 Jun 20 12:31:06.361735 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-288ceea3-9f0f-4637-bcdc-74cf627e2675 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:06.366488 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-a030f499-981e-4d66-ad3b-7663f8dab63c req-fd99d807-f69f-49a5-ad2e-17a685d98e6d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072896 Jun 20 12:31:06.370906 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2929/5956] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:31:06.379260 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-288ceea3-9f0f-4637-bcdc-74cf627e2675 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:06.379730 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-288ceea3-9f0f-4637-bcdc-74cf627e2675 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:06.381252 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-288ceea3-9f0f-4637-bcdc-74cf627e2675 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:06.381707 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-288ceea3-9f0f-4637-bcdc-74cf627e2675 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:06.408749 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-288ceea3-9f0f-4637-bcdc-74cf627e2675 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] HTTP exception thrown: Instance cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c could not be found. Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-288ceea3-9f0f-4637-bcdc-74cf627e2675 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Request method failure captured: Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c HTTP/1.1 Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGeaPbwuiKlZtfAakVi9AU1jZJYQpsiuqbtqj4H7EyEfa_Hs7Z-uZ4kORsCa_VB61-2zGcpt-Akt_fwFGZsdE57QH4a5RFxoaFSpMB5wQSEpC1nxSFtZmML3yZTCD6a9Nk7nPWXZGtd_9TDU17ULy9DxSwRUUNLntxWZGEmDQVAe1xk Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersTestJSON-953297781-project Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 8878d44956bd42e18f0409534e562ab6 Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersTestJSON-953297781-project Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: exception: Instance cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c could not be found. Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c'} Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c could not be found. Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:31:06.410889 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c could not be found. Jun 20 12:31:06.415497 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.415497 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:31:06.415497 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.415497 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.415497 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:31:06.415497 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:31:06.415497 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:31:06.415497 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:31:06.415497 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c could not be found. Jun 20 12:31:06.415497 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.417593 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-288ceea3-9f0f-4637-bcdc-74cf627e2675 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Returning 404 to user: Instance cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:31:06.419449 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-288ceea3-9f0f-4637-bcdc-74cf627e2675 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c" status: 404 len: 111 microversion: 2.1 time: 0.067089 Jun 20 12:31:06.420790 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3028/5957] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:31:06 2022] DELETE /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:31:06.429661 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-06522877-42ad-40f3-9b70-532b683b5578 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:06.431222 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-06522877-42ad-40f3-9b70-532b683b5578 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:06.441273 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-06522877-42ad-40f3-9b70-532b683b5578 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:06.441725 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-06522877-42ad-40f3-9b70-532b683b5578 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:06.442604 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-06522877-42ad-40f3-9b70-532b683b5578 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:06.443114 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-06522877-42ad-40f3-9b70-532b683b5578 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:06.462116 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-06522877-42ad-40f3-9b70-532b683b5578 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] HTTP exception thrown: Instance cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c could not be found. Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-06522877-42ad-40f3-9b70-532b683b5578 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Request method failure captured: Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c HTTP/1.1 Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGeaPbwuiKlZtfAakVi9AU1jZJYQpsiuqbtqj4H7EyEfa_Hs7Z-uZ4kORsCa_VB61-2zGcpt-Akt_fwFGZsdE57QH4a5RFxoaFSpMB5wQSEpC1nxSFtZmML3yZTCD6a9Nk7nPWXZGtd_9TDU17ULy9DxSwRUUNLntxWZGEmDQVAe1xk Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersTestJSON-953297781-project Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 8878d44956bd42e18f0409534e562ab6 Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersTestJSON-953297781-project Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: exception: Instance cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c could not be found. Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c'} Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c could not be found. Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c could not be found. Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.463841 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.467881 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:31:06.467881 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:31:06.467881 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:31:06.467881 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:31:06.467881 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c could not be found. Jun 20 12:31:06.467881 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.467881 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-06522877-42ad-40f3-9b70-532b683b5578 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Returning 404 to user: Instance cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:31:06.467881 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-06522877-42ad-40f3-9b70-532b683b5578 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c" status: 404 len: 111 microversion: 2.1 time: 0.040328 Jun 20 12:31:06.467881 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2930/5958] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:06 2022] GET /compute/v2.1/servers/cebc1ba1-13d4-43be-9bb9-5cbb3fd7994c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:31:06.478167 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f98d62cc-0cae-4ccd-8b5e-9870fd2893d1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:06.479009 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f98d62cc-0cae-4ccd-8b5e-9870fd2893d1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 3d7404de-1c0e-483f-b496-722b0a7cdd57] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:06.486972 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f98d62cc-0cae-4ccd-8b5e-9870fd2893d1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:06.488072 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f98d62cc-0cae-4ccd-8b5e-9870fd2893d1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:06.489505 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f98d62cc-0cae-4ccd-8b5e-9870fd2893d1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:06.490203 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f98d62cc-0cae-4ccd-8b5e-9870fd2893d1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:06.493717 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:06.508960 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-f98d62cc-0cae-4ccd-8b5e-9870fd2893d1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] HTTP exception thrown: Instance 3d7404de-1c0e-483f-b496-722b0a7cdd57 could not be found. Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f98d62cc-0cae-4ccd-8b5e-9870fd2893d1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Request method failure captured: Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57 HTTP/1.1 Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGeaPbwuiKlZtfAakVi9AU1jZJYQpsiuqbtqj4H7EyEfa_Hs7Z-uZ4kORsCa_VB61-2zGcpt-Akt_fwFGZsdE57QH4a5RFxoaFSpMB5wQSEpC1nxSFtZmML3yZTCD6a9Nk7nPWXZGtd_9TDU17ULy9DxSwRUUNLntxWZGEmDQVAe1xk Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersTestJSON-953297781-project Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 8878d44956bd42e18f0409534e562ab6 Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersTestJSON-953297781-project Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 3d7404de-1c0e-483f-b496-722b0a7cdd57 could not be found. Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '3d7404de-1c0e-483f-b496-722b0a7cdd57'} Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d7404de-1c0e-483f-b496-722b0a7cdd57 could not be found. Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:31:06.510784 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d7404de-1c0e-483f-b496-722b0a7cdd57 could not be found. Jun 20 12:31:06.515183 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.515183 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:31:06.515183 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.515183 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.515183 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:31:06.515183 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:31:06.515183 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:31:06.515183 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:31:06.515183 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d7404de-1c0e-483f-b496-722b0a7cdd57 could not be found. Jun 20 12:31:06.515183 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.515183 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f98d62cc-0cae-4ccd-8b5e-9870fd2893d1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Returning 404 to user: Instance 3d7404de-1c0e-483f-b496-722b0a7cdd57 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:31:06.515183 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f98d62cc-0cae-4ccd-8b5e-9870fd2893d1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57" status: 404 len: 111 microversion: 2.1 time: 0.037973 Jun 20 12:31:06.521181 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5623c323-7b4c-4904-8cb8-319b453f61b2 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:06.521799 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5623c323-7b4c-4904-8cb8-319b453f61b2 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 3d7404de-1c0e-483f-b496-722b0a7cdd57] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:06.524675 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3029/5959] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:31:06 2022] DELETE /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:31:06.530179 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5623c323-7b4c-4904-8cb8-319b453f61b2 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:06.531011 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5623c323-7b4c-4904-8cb8-319b453f61b2 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:06.531798 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5623c323-7b4c-4904-8cb8-319b453f61b2 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:06.532412 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5623c323-7b4c-4904-8cb8-319b453f61b2 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:06.548969 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-5623c323-7b4c-4904-8cb8-319b453f61b2 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] HTTP exception thrown: Instance 3d7404de-1c0e-483f-b496-722b0a7cdd57 could not be found. Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5623c323-7b4c-4904-8cb8-319b453f61b2 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Request method failure captured: Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57 HTTP/1.1 Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGeaPbwuiKlZtfAakVi9AU1jZJYQpsiuqbtqj4H7EyEfa_Hs7Z-uZ4kORsCa_VB61-2zGcpt-Akt_fwFGZsdE57QH4a5RFxoaFSpMB5wQSEpC1nxSFtZmML3yZTCD6a9Nk7nPWXZGtd_9TDU17ULy9DxSwRUUNLntxWZGEmDQVAe1xk Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersTestJSON-953297781-project Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 8878d44956bd42e18f0409534e562ab6 Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersTestJSON-953297781-project Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 3d7404de-1c0e-483f-b496-722b0a7cdd57 could not be found. Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '3d7404de-1c0e-483f-b496-722b0a7cdd57'} Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d7404de-1c0e-483f-b496-722b0a7cdd57 could not be found. Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d7404de-1c0e-483f-b496-722b0a7cdd57 could not be found. Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.551178 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.557395 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:31:06.557395 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:31:06.557395 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:31:06.557395 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:31:06.557395 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d7404de-1c0e-483f-b496-722b0a7cdd57 could not be found. Jun 20 12:31:06.557395 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.557395 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5623c323-7b4c-4904-8cb8-319b453f61b2 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Returning 404 to user: Instance 3d7404de-1c0e-483f-b496-722b0a7cdd57 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:31:06.557395 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5623c323-7b4c-4904-8cb8-319b453f61b2 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57" status: 404 len: 111 microversion: 2.1 time: 0.035765 Jun 20 12:31:06.557395 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2931/5960] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:06 2022] GET /compute/v2.1/servers/3d7404de-1c0e-483f-b496-722b0a7cdd57 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:31:06.562268 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6680773e-2cd4-4644-96f6-72fc6d058f1d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:06.562770 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6680773e-2cd4-4644-96f6-72fc6d058f1d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 8f7328d0-2429-4fe9-bf9e-0925f6458204] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:06.569968 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6680773e-2cd4-4644-96f6-72fc6d058f1d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:06.570426 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6680773e-2cd4-4644-96f6-72fc6d058f1d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:06.571375 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6680773e-2cd4-4644-96f6-72fc6d058f1d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:06.572744 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6680773e-2cd4-4644-96f6-72fc6d058f1d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:06.595458 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-6680773e-2cd4-4644-96f6-72fc6d058f1d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] HTTP exception thrown: Instance 8f7328d0-2429-4fe9-bf9e-0925f6458204 could not be found. Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6680773e-2cd4-4644-96f6-72fc6d058f1d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Request method failure captured: Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204 HTTP/1.1 Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGeaPbwuiKlZtfAakVi9AU1jZJYQpsiuqbtqj4H7EyEfa_Hs7Z-uZ4kORsCa_VB61-2zGcpt-Akt_fwFGZsdE57QH4a5RFxoaFSpMB5wQSEpC1nxSFtZmML3yZTCD6a9Nk7nPWXZGtd_9TDU17ULy9DxSwRUUNLntxWZGEmDQVAe1xk Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersTestJSON-953297781-project Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 8878d44956bd42e18f0409534e562ab6 Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersTestJSON-953297781-project Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 8f7328d0-2429-4fe9-bf9e-0925f6458204 could not be found. Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '8f7328d0-2429-4fe9-bf9e-0925f6458204'} Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f7328d0-2429-4fe9-bf9e-0925f6458204 could not be found. Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:31:06.598464 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f7328d0-2429-4fe9-bf9e-0925f6458204 could not be found. Jun 20 12:31:06.603026 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.603026 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:31:06.603026 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.603026 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.603026 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:31:06.603026 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:31:06.603026 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:31:06.603026 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:31:06.603026 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f7328d0-2429-4fe9-bf9e-0925f6458204 could not be found. Jun 20 12:31:06.603026 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.605442 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6680773e-2cd4-4644-96f6-72fc6d058f1d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Returning 404 to user: Instance 8f7328d0-2429-4fe9-bf9e-0925f6458204 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:31:06.606396 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6680773e-2cd4-4644-96f6-72fc6d058f1d tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204" status: 404 len: 111 microversion: 2.1 time: 0.048874 Jun 20 12:31:06.607349 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3030/5961] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:31:06 2022] DELETE /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:31:06.616410 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b2de15e1-77e8-42df-8528-62b032ff0035 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:06.617081 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b2de15e1-77e8-42df-8528-62b032ff0035 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 8f7328d0-2429-4fe9-bf9e-0925f6458204] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:06.638276 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2de15e1-77e8-42df-8528-62b032ff0035 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:06.638945 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2de15e1-77e8-42df-8528-62b032ff0035 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:06.639929 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2de15e1-77e8-42df-8528-62b032ff0035 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:06.640886 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2de15e1-77e8-42df-8528-62b032ff0035 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:06.659437 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-b2de15e1-77e8-42df-8528-62b032ff0035 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] HTTP exception thrown: Instance 8f7328d0-2429-4fe9-bf9e-0925f6458204 could not be found. Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b2de15e1-77e8-42df-8528-62b032ff0035 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Request method failure captured: Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204 HTTP/1.1 Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGeaPbwuiKlZtfAakVi9AU1jZJYQpsiuqbtqj4H7EyEfa_Hs7Z-uZ4kORsCa_VB61-2zGcpt-Akt_fwFGZsdE57QH4a5RFxoaFSpMB5wQSEpC1nxSFtZmML3yZTCD6a9Nk7nPWXZGtd_9TDU17ULy9DxSwRUUNLntxWZGEmDQVAe1xk Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersTestJSON-953297781-project Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 8878d44956bd42e18f0409534e562ab6 Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersTestJSON-953297781-project Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 8f7328d0-2429-4fe9-bf9e-0925f6458204 could not be found. Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '8f7328d0-2429-4fe9-bf9e-0925f6458204'} Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f7328d0-2429-4fe9-bf9e-0925f6458204 could not be found. Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f7328d0-2429-4fe9-bf9e-0925f6458204 could not be found. Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.661700 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.666639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:31:06.666639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:31:06.666639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:31:06.666639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:31:06.666639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f7328d0-2429-4fe9-bf9e-0925f6458204 could not be found. Jun 20 12:31:06.666639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.666639 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b2de15e1-77e8-42df-8528-62b032ff0035 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Returning 404 to user: Instance 8f7328d0-2429-4fe9-bf9e-0925f6458204 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:31:06.666639 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b2de15e1-77e8-42df-8528-62b032ff0035 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204" status: 404 len: 111 microversion: 2.1 time: 0.051553 Jun 20 12:31:06.666639 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2932/5962] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:06 2022] GET /compute/v2.1/servers/8f7328d0-2429-4fe9-bf9e-0925f6458204 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:31:06.672231 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-534496f3-47f2-46c9-8235-f5915ab54eec tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:06.672733 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-534496f3-47f2-46c9-8235-f5915ab54eec tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 2c913649-2aa1-40e3-b5b0-715d0075c915] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:06.679658 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-534496f3-47f2-46c9-8235-f5915ab54eec tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:06.680121 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-534496f3-47f2-46c9-8235-f5915ab54eec tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:06.681609 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-534496f3-47f2-46c9-8235-f5915ab54eec tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:06.682063 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-534496f3-47f2-46c9-8235-f5915ab54eec tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:06.698303 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-534496f3-47f2-46c9-8235-f5915ab54eec tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] HTTP exception thrown: Instance 2c913649-2aa1-40e3-b5b0-715d0075c915 could not be found. Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-534496f3-47f2-46c9-8235-f5915ab54eec tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Request method failure captured: Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915 HTTP/1.1 Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGeaPbwuiKlZtfAakVi9AU1jZJYQpsiuqbtqj4H7EyEfa_Hs7Z-uZ4kORsCa_VB61-2zGcpt-Akt_fwFGZsdE57QH4a5RFxoaFSpMB5wQSEpC1nxSFtZmML3yZTCD6a9Nk7nPWXZGtd_9TDU17ULy9DxSwRUUNLntxWZGEmDQVAe1xk Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersTestJSON-953297781-project Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 8878d44956bd42e18f0409534e562ab6 Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersTestJSON-953297781-project Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 2c913649-2aa1-40e3-b5b0-715d0075c915 could not be found. Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '2c913649-2aa1-40e3-b5b0-715d0075c915'} Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c913649-2aa1-40e3-b5b0-715d0075c915 could not be found. Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:31:06.700086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c913649-2aa1-40e3-b5b0-715d0075c915 could not be found. Jun 20 12:31:06.704118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.704118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:31:06.704118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.704118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.704118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:31:06.704118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:31:06.704118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:31:06.704118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:31:06.704118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c913649-2aa1-40e3-b5b0-715d0075c915 could not be found. Jun 20 12:31:06.704118 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.704118 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-534496f3-47f2-46c9-8235-f5915ab54eec tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Returning 404 to user: Instance 2c913649-2aa1-40e3-b5b0-715d0075c915 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:31:06.704118 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-534496f3-47f2-46c9-8235-f5915ab54eec tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915" status: 404 len: 111 microversion: 2.1 time: 0.033444 Jun 20 12:31:06.704118 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3031/5963] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:31:06 2022] DELETE /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:31:06.718663 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b4940003-44b8-4663-81f1-14156338271a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:06.719376 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b4940003-44b8-4663-81f1-14156338271a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 2c913649-2aa1-40e3-b5b0-715d0075c915] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:06.725883 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b4940003-44b8-4663-81f1-14156338271a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:06.726427 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b4940003-44b8-4663-81f1-14156338271a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:06.727282 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b4940003-44b8-4663-81f1-14156338271a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:06.727733 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b4940003-44b8-4663-81f1-14156338271a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:06.747888 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-b4940003-44b8-4663-81f1-14156338271a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] HTTP exception thrown: Instance 2c913649-2aa1-40e3-b5b0-715d0075c915 could not be found. Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b4940003-44b8-4663-81f1-14156338271a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Request method failure captured: Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915 HTTP/1.1 Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGeaPbwuiKlZtfAakVi9AU1jZJYQpsiuqbtqj4H7EyEfa_Hs7Z-uZ4kORsCa_VB61-2zGcpt-Akt_fwFGZsdE57QH4a5RFxoaFSpMB5wQSEpC1nxSFtZmML3yZTCD6a9Nk7nPWXZGtd_9TDU17ULy9DxSwRUUNLntxWZGEmDQVAe1xk Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersTestJSON-953297781-project Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 8878d44956bd42e18f0409534e562ab6 Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersTestJSON-953297781-project Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 2c913649-2aa1-40e3-b5b0-715d0075c915 could not be found. Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '2c913649-2aa1-40e3-b5b0-715d0075c915'} Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c913649-2aa1-40e3-b5b0-715d0075c915 could not be found. Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c913649-2aa1-40e3-b5b0-715d0075c915 could not be found. Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.767210 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.771675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:31:06.771675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:31:06.771675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:31:06.771675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:31:06.771675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c913649-2aa1-40e3-b5b0-715d0075c915 could not be found. Jun 20 12:31:06.771675 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.771675 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b4940003-44b8-4663-81f1-14156338271a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Returning 404 to user: Instance 2c913649-2aa1-40e3-b5b0-715d0075c915 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:31:06.771675 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b4940003-44b8-4663-81f1-14156338271a tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915" status: 404 len: 111 microversion: 2.1 time: 0.054390 Jun 20 12:31:06.771675 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2933/5964] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:06 2022] GET /compute/v2.1/servers/2c913649-2aa1-40e3-b5b0-715d0075c915 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:31:06.778401 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1e9bae13-422a-42d7-8164-09d4752d60a6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:06.778990 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1e9bae13-422a-42d7-8164-09d4752d60a6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: c5902c89-8503-434f-a065-b6c8268f95d7] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:06.790198 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-1e9bae13-422a-42d7-8164-09d4752d60a6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] HTTP exception thrown: Instance c5902c89-8503-434f-a065-b6c8268f95d7 could not be found. Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1e9bae13-422a-42d7-8164-09d4752d60a6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Request method failure captured: Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/c5902c89-8503-434f-a065-b6c8268f95d7 HTTP/1.1 Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGeaPbwuiKlZtfAakVi9AU1jZJYQpsiuqbtqj4H7EyEfa_Hs7Z-uZ4kORsCa_VB61-2zGcpt-Akt_fwFGZsdE57QH4a5RFxoaFSpMB5wQSEpC1nxSFtZmML3yZTCD6a9Nk7nPWXZGtd_9TDU17ULy9DxSwRUUNLntxWZGEmDQVAe1xk Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersTestJSON-953297781-project Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 8878d44956bd42e18f0409534e562ab6 Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersTestJSON-953297781-project Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: exception: Instance c5902c89-8503-434f-a065-b6c8268f95d7 could not be found. Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'c5902c89-8503-434f-a065-b6c8268f95d7'} Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5902c89-8503-434f-a065-b6c8268f95d7 could not be found. Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5902c89-8503-434f-a065-b6c8268f95d7 could not be found. Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:31:06.792103 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.796703 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.796703 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:31:06.796703 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:31:06.796703 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:31:06.796703 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:31:06.796703 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5902c89-8503-434f-a065-b6c8268f95d7 could not be found. Jun 20 12:31:06.796703 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.798863 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1e9bae13-422a-42d7-8164-09d4752d60a6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Returning 404 to user: Instance c5902c89-8503-434f-a065-b6c8268f95d7 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:31:06.800070 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1e9bae13-422a-42d7-8164-09d4752d60a6 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c5902c89-8503-434f-a065-b6c8268f95d7" status: 404 len: 111 microversion: 2.1 time: 0.025678 Jun 20 12:31:06.801789 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3032/5965] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:31:06 2022] DELETE /compute/v2.1/servers/c5902c89-8503-434f-a065-b6c8268f95d7 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:31:06.809640 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a9fef7b3-7290-4a1c-83eb-cae33da69ef1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:06.810251 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a9fef7b3-7290-4a1c-83eb-cae33da69ef1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: c5902c89-8503-434f-a065-b6c8268f95d7] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:06.816109 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-a9fef7b3-7290-4a1c-83eb-cae33da69ef1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] HTTP exception thrown: Instance c5902c89-8503-434f-a065-b6c8268f95d7 could not be found. Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a9fef7b3-7290-4a1c-83eb-cae33da69ef1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Request method failure captured: Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/c5902c89-8503-434f-a065-b6c8268f95d7 HTTP/1.1 Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGeaPbwuiKlZtfAakVi9AU1jZJYQpsiuqbtqj4H7EyEfa_Hs7Z-uZ4kORsCa_VB61-2zGcpt-Akt_fwFGZsdE57QH4a5RFxoaFSpMB5wQSEpC1nxSFtZmML3yZTCD6a9Nk7nPWXZGtd_9TDU17ULy9DxSwRUUNLntxWZGEmDQVAe1xk Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersTestJSON-953297781 Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersTestJSON-953297781-project Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 8878d44956bd42e18f0409534e562ab6 Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersTestJSON-953297781-project Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: exception: Instance c5902c89-8503-434f-a065-b6c8268f95d7 could not be found. Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'c5902c89-8503-434f-a065-b6c8268f95d7'} Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5902c89-8503-434f-a065-b6c8268f95d7 could not be found. Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5902c89-8503-434f-a065-b6c8268f95d7 could not be found. Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:31:06.817817 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:31:06.823552 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:31:06.823552 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:31:06.823552 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5902c89-8503-434f-a065-b6c8268f95d7 could not be found. Jun 20 12:31:06.823552 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:31:06.823552 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a9fef7b3-7290-4a1c-83eb-cae33da69ef1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Returning 404 to user: Instance c5902c89-8503-434f-a065-b6c8268f95d7 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:31:06.823552 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a9fef7b3-7290-4a1c-83eb-cae33da69ef1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/c5902c89-8503-434f-a065-b6c8268f95d7" status: 404 len: 111 microversion: 2.1 time: 0.013398 Jun 20 12:31:06.838399 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-480457fa-19ff-4f8c-8d29-2a1019941fec tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:06.838885 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-480457fa-19ff-4f8c-8d29-2a1019941fec tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 64fdc10a-358a-4091-bba7-cfa7651022a6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:06.841630 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2934/5966] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:06 2022] GET /compute/v2.1/servers/c5902c89-8503-434f-a065-b6c8268f95d7 => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:31:06.849526 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-480457fa-19ff-4f8c-8d29-2a1019941fec tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:06.849977 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-480457fa-19ff-4f8c-8d29-2a1019941fec tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:06.850740 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-480457fa-19ff-4f8c-8d29-2a1019941fec tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:06.857860 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-480457fa-19ff-4f8c-8d29-2a1019941fec tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:06.887648 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-480457fa-19ff-4f8c-8d29-2a1019941fec tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 64fdc10a-358a-4091-bba7-cfa7651022a6] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:31:07.006710 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-480457fa-19ff-4f8c-8d29-2a1019941fec tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "DELETE /compute/v2.1/servers/64fdc10a-358a-4091-bba7-cfa7651022a6" status: 204 len: 0 microversion: 2.1 time: 0.182254 Jun 20 12:31:07.007855 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3033/5967] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:31:06 2022] DELETE /compute/v2.1/servers/64fdc10a-358a-4091-bba7-cfa7651022a6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:31:07.015879 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5605f57b-ca12-424f-973d-fe3bddf4fbc1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:07.016543 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5605f57b-ca12-424f-973d-fe3bddf4fbc1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 64fdc10a-358a-4091-bba7-cfa7651022a6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:07.028821 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5605f57b-ca12-424f-973d-fe3bddf4fbc1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:07.029269 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5605f57b-ca12-424f-973d-fe3bddf4fbc1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:07.030041 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5605f57b-ca12-424f-973d-fe3bddf4fbc1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:07.030472 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5605f57b-ca12-424f-973d-fe3bddf4fbc1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:07.244118 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5605f57b-ca12-424f-973d-fe3bddf4fbc1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:07.255708 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5605f57b-ca12-424f-973d-fe3bddf4fbc1 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/64fdc10a-358a-4091-bba7-cfa7651022a6" status: 200 len: 1479 microversion: 2.1 time: 0.243585 Jun 20 12:31:07.258227 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2935/5968] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:07 2022] GET /compute/v2.1/servers/64fdc10a-358a-4091-bba7-cfa7651022a6 => generated 1479 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:31:08.274812 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3565e565-7661-47a3-9f5d-fa0ab52b18e9 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:08.276282 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3565e565-7661-47a3-9f5d-fa0ab52b18e9 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 64fdc10a-358a-4091-bba7-cfa7651022a6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:08.284652 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3565e565-7661-47a3-9f5d-fa0ab52b18e9 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:08.285436 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3565e565-7661-47a3-9f5d-fa0ab52b18e9 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:08.286443 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3565e565-7661-47a3-9f5d-fa0ab52b18e9 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:08.287091 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3565e565-7661-47a3-9f5d-fa0ab52b18e9 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:08.433759 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3565e565-7661-47a3-9f5d-fa0ab52b18e9 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:08.444727 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3565e565-7661-47a3-9f5d-fa0ab52b18e9 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/64fdc10a-358a-4091-bba7-cfa7651022a6" status: 200 len: 1479 microversion: 2.1 time: 0.174539 Jun 20 12:31:08.455687 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3034/5969] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:08 2022] GET /compute/v2.1/servers/64fdc10a-358a-4091-bba7-cfa7651022a6 => generated 1479 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:31:09.180847 n-d-master-1 devstack@n-api.service[119128]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 12:31:09.182009 n-d-master-1 devstack@n-api.service[119128]: Mon Jun 20 12:31:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 12:31:09.463102 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-902ee5da-b91c-4bf6-9f31-afc27e92ef56 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:09.463726 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-902ee5da-b91c-4bf6-9f31-afc27e92ef56 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 64fdc10a-358a-4091-bba7-cfa7651022a6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:09.478334 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-902ee5da-b91c-4bf6-9f31-afc27e92ef56 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:09.478794 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-902ee5da-b91c-4bf6-9f31-afc27e92ef56 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:09.479587 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-902ee5da-b91c-4bf6-9f31-afc27e92ef56 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:09.480036 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-902ee5da-b91c-4bf6-9f31-afc27e92ef56 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:09.586764 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-9c19dc4b-0532-4463-80eb-77e406b74289 req-a6f235df-4303-4ae7-8198-d2c78c7edf8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64fdc10a-358a-4091-bba7-cfa7651022a6", "name": "network-vif-deleted", "tag": "8e61ccc2-5954-4a2f-82d7-ab2056d0dc66"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:31:09.600193 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-9c19dc4b-0532-4463-80eb-77e406b74289 req-a6f235df-4303-4ae7-8198-d2c78c7edf8d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:09.601006 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-9c19dc4b-0532-4463-80eb-77e406b74289 req-a6f235df-4303-4ae7-8198-d2c78c7edf8d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:09.619826 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-9c19dc4b-0532-4463-80eb-77e406b74289 req-a6f235df-4303-4ae7-8198-d2c78c7edf8d service nova] Creating event network-vif-deleted:8e61ccc2-5954-4a2f-82d7-ab2056d0dc66 for instance 64fdc10a-358a-4091-bba7-cfa7651022a6 on n-h2-master-1 Jun 20 12:31:09.626049 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-9c19dc4b-0532-4463-80eb-77e406b74289 req-a6f235df-4303-4ae7-8198-d2c78c7edf8d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043329 Jun 20 12:31:09.627155 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3035/5970] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:31:09.656038 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-902ee5da-b91c-4bf6-9f31-afc27e92ef56 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878d44956bd42e18f0409534e562ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896c053324b34720a7d0f151bfdc8b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:09.676278 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-902ee5da-b91c-4bf6-9f31-afc27e92ef56 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/64fdc10a-358a-4091-bba7-cfa7651022a6" status: 200 len: 1437 microversion: 2.1 time: 0.217131 Jun 20 12:31:09.678044 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2936/5971] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:09 2022] GET /compute/v2.1/servers/64fdc10a-358a-4091-bba7-cfa7651022a6 => generated 1437 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:31:10.696064 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fbd455da-5071-4585-b1d9-35e9730151f7 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:10.697797 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fbd455da-5071-4585-b1d9-35e9730151f7 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] [instance: 64fdc10a-358a-4091-bba7-cfa7651022a6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:10.709723 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fbd455da-5071-4585-b1d9-35e9730151f7 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:10.710931 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fbd455da-5071-4585-b1d9-35e9730151f7 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:10.712003 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fbd455da-5071-4585-b1d9-35e9730151f7 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:10.712906 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fbd455da-5071-4585-b1d9-35e9730151f7 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:10.741020 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-fbd455da-5071-4585-b1d9-35e9730151f7 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] HTTP exception thrown: Instance 64fdc10a-358a-4091-bba7-cfa7651022a6 could not be found. Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fbd455da-5071-4585-b1d9-35e9730151f7 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Request method failure captured: Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/64fdc10a-358a-4091-bba7-cfa7651022a6 HTTP/1.1 Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGeaPbwuiKlZtfAakVi9AU1jZJYQpsiuqbtqj4H7EyEfa_Hs7Z-uZ4kORsCa_VB61-2zGcpt-Akt_fwFGZsdE57QH4a5RFxoaFSpMB5wQSEpC1nxSFtZmML3yZTCD6a9Nk7nPWXZGtd_9TDU17ULy9DxSwRUUNLntxWZGEmDQVAe1xk Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersTestJSON-953297781 Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_896c053324b34720a7d0f151bfdc8b10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersTestJSON-953297781 Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 896c053324b34720a7d0f151bfdc8b10 Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersTestJSON-953297781 Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersTestJSON-953297781-project Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 8878d44956bd42e18f0409534e562ab6 Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersTestJSON-953297781-project Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 64fdc10a-358a-4091-bba7-cfa7651022a6 could not be found. Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '64fdc10a-358a-4091-bba7-cfa7651022a6'} Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64fdc10a-358a-4091-bba7-cfa7651022a6 could not be found. Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64fdc10a-358a-4091-bba7-cfa7651022a6 could not be found. Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:10.743030 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:10.748393 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:31:10.748393 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:31:10.748393 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:31:10.748393 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:31:10.748393 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64fdc10a-358a-4091-bba7-cfa7651022a6 could not be found. Jun 20 12:31:10.748393 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:10.750059 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fbd455da-5071-4585-b1d9-35e9730151f7 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Returning 404 to user: Instance 64fdc10a-358a-4091-bba7-cfa7651022a6 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:31:10.751157 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fbd455da-5071-4585-b1d9-35e9730151f7 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/servers/64fdc10a-358a-4091-bba7-cfa7651022a6" status: 404 len: 111 microversion: 2.1 time: 0.059763 Jun 20 12:31:10.752315 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3036/5972] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:10 2022] GET /compute/v2.1/servers/64fdc10a-358a-4091-bba7-cfa7651022a6 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:31:17.462639 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-902ee5da-b91c-4bf6-9f31-afc27e92ef56 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:17.463825 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-902ee5da-b91c-4bf6-9f31-afc27e92ef56 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001583 Jun 20 12:31:17.464164 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2937/5973] 10.222.0.27 () {56 vars in 885 bytes} [Mon Jun 20 12:31:17 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jun 20 12:31:19.283569 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fbd455da-5071-4585-b1d9-35e9730151f7 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:19.285054 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fbd455da-5071-4585-b1d9-35e9730151f7 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001838 Jun 20 12:31:19.285473 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3037/5974] 10.222.0.27 () {56 vars in 885 bytes} [Mon Jun 20 12:31:19 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jun 20 12:31:19.292645 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-902ee5da-b91c-4bf6-9f31-afc27e92ef56 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:19.293811 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-902ee5da-b91c-4bf6-9f31-afc27e92ef56 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001906 Jun 20 12:31:19.294225 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2938/5975] 10.222.0.27 () {54 vars in 1034 bytes} [Mon Jun 20 12:31:19 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Jun 20 12:31:19.300957 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fbd455da-5071-4585-b1d9-35e9730151f7 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:19.302236 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fbd455da-5071-4585-b1d9-35e9730151f7 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001779 Jun 20 12:31:19.302729 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3038/5976] 10.222.0.27 () {54 vars in 1040 bytes} [Mon Jun 20 12:31:19 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:31:19.310263 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-902ee5da-b91c-4bf6-9f31-afc27e92ef56 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:19.311447 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-902ee5da-b91c-4bf6-9f31-afc27e92ef56 tempest-ServersTestJSON-953297781 tempest-ServersTestJSON-953297781-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001843 Jun 20 12:31:19.322508 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2939/5977] 10.222.0.27 () {56 vars in 885 bytes} [Mon Jun 20 12:31:19 2022] GET /compute/ => generated 377 bytes in 12 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jun 20 12:31:34.290362 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c627dd5d-366d-404e-9596-31512057ba5b tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-729151197", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "072a2e85-e5bb-4e25-b3d8-f7447d9e4af6"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1450629429", "security_groups": []}, "os:scheduler_hints": {"different_host": ["a3aa985b-f96c-40ed-ba36-89054521794d"]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:31:34.307825 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:34.319403 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:34.889499 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-c627dd5d-366d-404e-9596-31512057ba5b tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] validate_networks() for [('072a2e85-e5bb-4e25-b3d8-f7447d9e4af6', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:31:35.234914 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:35.238757 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:35.775123 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-56770476-be90-4c8e-8963-4a7b1228f182 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Action: 'create', calling method: .version_select at 0x7f60723b5430>, body: {"keypair": {"name": "tempest-keypair-1749896639", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEatWfMXTbQDY4kHaFuaP6btroL9ZpuY0iaAwYbSfFg7L9pEVeaFPYDh1eLwaLCHFBMig9pTCFqkAKpfNcNOb6muf3VWrsRiwHPV4nWSHvSNR/e46tRZZyMREqe57apsGA=="}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:31:35.799625 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-56770476-be90-4c8e-8963-4a7b1228f182 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Getting quotas for project f4714cac56094f9e9d4ed4adb400064e. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:31:35.809366 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-56770476-be90-4c8e-8963-4a7b1228f182 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Getting quotas for user 2c8b3f11a7294fbd9d750b1fbbeaa65b and project f4714cac56094f9e9d4ed4adb400064e. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:31:35.875539 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-56770476-be90-4c8e-8963-4a7b1228f182 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.654089 Jun 20 12:31:35.879765 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2940/5978] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 12:31:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:31:35.896721 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-c627dd5d-366d-404e-9596-31512057ba5b tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:31:35.901929 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-c627dd5d-366d-404e-9596-31512057ba5b tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:31:35.903118 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-c627dd5d-366d-404e-9596-31512057ba5b tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:31:35.903798 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-c627dd5d-366d-404e-9596-31512057ba5b tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:31:35.904445 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-c627dd5d-366d-404e-9596-31512057ba5b tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:31:35.920623 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c627dd5d-366d-404e-9596-31512057ba5b tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:35.922134 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c627dd5d-366d-404e-9596-31512057ba5b tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:35.927589 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c627dd5d-366d-404e-9596-31512057ba5b tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:35.930627 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c627dd5d-366d-404e-9596-31512057ba5b tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:35.998509 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-c627dd5d-366d-404e-9596-31512057ba5b tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Getting quotas for project 06b38619bb2f4b3e92aa9a9d5c5195b9. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:31:36.023862 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-c627dd5d-366d-404e-9596-31512057ba5b tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Getting quotas for user e653a6be497a469a9064cb754ea47fa7 and project 06b38619bb2f4b3e92aa9a9d5c5195b9. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:31:36.063036 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c627dd5d-366d-404e-9596-31512057ba5b tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:31:36.066688 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c627dd5d-366d-404e-9596-31512057ba5b tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: ef9dcafc-3140-4c17-aee8-455e4d1636c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:31:36.200796 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c627dd5d-366d-404e-9596-31512057ba5b tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.918694 Jun 20 12:31:36.224144 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3039/5979] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:31:34 2022] POST /compute/v2.1/servers => generated 361 bytes in 1943 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:31:36.238644 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2a370b0c-1ff8-4dcf-8616-2afa41a362e8 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:36.239329 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2a370b0c-1ff8-4dcf-8616-2afa41a362e8 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: ef9dcafc-3140-4c17-aee8-455e4d1636c8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:37.332674 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2a370b0c-1ff8-4dcf-8616-2afa41a362e8 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e653a6be497a469a9064cb754ea47fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b38619bb2f4b3e92aa9a9d5c5195b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:37.351654 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2a370b0c-1ff8-4dcf-8616-2afa41a362e8 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "GET /compute/v2.1/servers/ef9dcafc-3140-4c17-aee8-455e4d1636c8" status: 200 len: 1241 microversion: 2.1 time: 1.114087 Jun 20 12:31:37.355499 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2941/5980] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:36 2022] GET /compute/v2.1/servers/ef9dcafc-3140-4c17-aee8-455e4d1636c8 => generated 1241 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:31:38.372255 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-99b425a8-fd9f-4c5e-8b31-0e24f7ee097b tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:38.373853 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-99b425a8-fd9f-4c5e-8b31-0e24f7ee097b tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: ef9dcafc-3140-4c17-aee8-455e4d1636c8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:38.396763 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-99b425a8-fd9f-4c5e-8b31-0e24f7ee097b tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:38.422028 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-99b425a8-fd9f-4c5e-8b31-0e24f7ee097b tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:38.442153 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-99b425a8-fd9f-4c5e-8b31-0e24f7ee097b tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:38.446915 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-99b425a8-fd9f-4c5e-8b31-0e24f7ee097b tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:38.942963 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-99b425a8-fd9f-4c5e-8b31-0e24f7ee097b tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e653a6be497a469a9064cb754ea47fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b38619bb2f4b3e92aa9a9d5c5195b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:38.957468 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-99b425a8-fd9f-4c5e-8b31-0e24f7ee097b tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "GET /compute/v2.1/servers/ef9dcafc-3140-4c17-aee8-455e4d1636c8" status: 200 len: 1301 microversion: 2.1 time: 0.590473 Jun 20 12:31:38.970385 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3040/5981] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:38 2022] GET /compute/v2.1/servers/ef9dcafc-3140-4c17-aee8-455e4d1636c8 => generated 1301 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:31:39.807671 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b8969200-67d4-44ba-86a6-b0a689f2436b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1242913384", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2f68d1fc-6d7d-4fb9-a17e-f5081b1bc479"}], "security_groups": [{"name": "tempest-securitygroup--1329760560"}], "key_name": "tempest-keypair-1749896639", "user_data": "}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:31:39.983438 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-37401b51-20fd-4622-b353-e577da230aea tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:39.984073 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-37401b51-20fd-4622-b353-e577da230aea tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: ef9dcafc-3140-4c17-aee8-455e4d1636c8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:40.009030 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-37401b51-20fd-4622-b353-e577da230aea tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:40.009490 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-37401b51-20fd-4622-b353-e577da230aea tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:40.010297 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-37401b51-20fd-4622-b353-e577da230aea tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:40.016619 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-37401b51-20fd-4622-b353-e577da230aea tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:40.166166 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-37401b51-20fd-4622-b353-e577da230aea tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e653a6be497a469a9064cb754ea47fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b38619bb2f4b3e92aa9a9d5c5195b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:40.176381 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-37401b51-20fd-4622-b353-e577da230aea tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "GET /compute/v2.1/servers/ef9dcafc-3140-4c17-aee8-455e4d1636c8" status: 200 len: 1299 microversion: 2.1 time: 0.203664 Jun 20 12:31:40.187361 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3041/5982] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:39 2022] GET /compute/v2.1/servers/ef9dcafc-3140-4c17-aee8-455e4d1636c8 => generated 1299 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:31:40.228990 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-b8969200-67d4-44ba-86a6-b0a689f2436b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] validate_networks() for [('2f68d1fc-6d7d-4fb9-a17e-f5081b1bc479', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:31:41.057818 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-b8969200-67d4-44ba-86a6-b0a689f2436b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:31:41.058510 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-b8969200-67d4-44ba-86a6-b0a689f2436b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:31:41.058759 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-b8969200-67d4-44ba-86a6-b0a689f2436b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:31:41.059338 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-b8969200-67d4-44ba-86a6-b0a689f2436b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:31:41.061172 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-b8969200-67d4-44ba-86a6-b0a689f2436b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:31:41.076522 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b8969200-67d4-44ba-86a6-b0a689f2436b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:41.077264 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b8969200-67d4-44ba-86a6-b0a689f2436b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:41.078269 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b8969200-67d4-44ba-86a6-b0a689f2436b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:41.078895 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b8969200-67d4-44ba-86a6-b0a689f2436b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:41.101145 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-b8969200-67d4-44ba-86a6-b0a689f2436b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Getting quotas for project f4714cac56094f9e9d4ed4adb400064e. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:31:41.109787 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-b8969200-67d4-44ba-86a6-b0a689f2436b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Getting quotas for user 2c8b3f11a7294fbd9d750b1fbbeaa65b and project f4714cac56094f9e9d4ed4adb400064e. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:31:41.125557 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b8969200-67d4-44ba-86a6-b0a689f2436b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:31:41.129930 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b8969200-67d4-44ba-86a6-b0a689f2436b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 028600e9-6eb6-42ac-b62e-de21666d744e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:31:41.194735 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b8969200-67d4-44ba-86a6-b0a689f2436b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.392142 Jun 20 12:31:41.196498 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2942/5983] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:31:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 1397 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:31:41.205253 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-369bd445-1e43-4dc5-9855-75260e003ba2 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:41.206595 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-369bd445-1e43-4dc5-9855-75260e003ba2 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: ef9dcafc-3140-4c17-aee8-455e4d1636c8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:41.208824 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-40b4e4f5-d6ac-41b9-af39-17d3a663efc8 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:41.209453 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-40b4e4f5-d6ac-41b9-af39-17d3a663efc8 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 028600e9-6eb6-42ac-b62e-de21666d744e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:41.217418 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-369bd445-1e43-4dc5-9855-75260e003ba2 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:41.217929 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-369bd445-1e43-4dc5-9855-75260e003ba2 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:41.218721 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-369bd445-1e43-4dc5-9855-75260e003ba2 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:41.223856 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-369bd445-1e43-4dc5-9855-75260e003ba2 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:41.362783 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-369bd445-1e43-4dc5-9855-75260e003ba2 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e653a6be497a469a9064cb754ea47fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b38619bb2f4b3e92aa9a9d5c5195b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:41.372503 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-369bd445-1e43-4dc5-9855-75260e003ba2 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "GET /compute/v2.1/servers/ef9dcafc-3140-4c17-aee8-455e4d1636c8" status: 200 len: 1299 microversion: 2.1 time: 0.171921 Jun 20 12:31:41.376171 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3042/5984] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:41 2022] GET /compute/v2.1/servers/ef9dcafc-3140-4c17-aee8-455e4d1636c8 => generated 1299 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:31:41.381600 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-40b4e4f5-d6ac-41b9-af39-17d3a663efc8 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:41.392504 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-40b4e4f5-d6ac-41b9-af39-17d3a663efc8 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e" status: 200 len: 1242 microversion: 2.1 time: 0.188505 Jun 20 12:31:41.395927 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2943/5985] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:41 2022] GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e => generated 1242 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:31:41.822071 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-28ef8ac7-df53-4a2d-8387-8ed36251d3cc req-eec2d49b-edda-4518-8b31-1b3e309871d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef9dcafc-3140-4c17-aee8-455e4d1636c8", "tag": "860d18b5-659e-47c6-93d4-69587ee6087f"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:31:41.838171 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-28ef8ac7-df53-4a2d-8387-8ed36251d3cc req-eec2d49b-edda-4518-8b31-1b3e309871d9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:41.838627 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-28ef8ac7-df53-4a2d-8387-8ed36251d3cc req-eec2d49b-edda-4518-8b31-1b3e309871d9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:41.879549 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-28ef8ac7-df53-4a2d-8387-8ed36251d3cc req-eec2d49b-edda-4518-8b31-1b3e309871d9 service nova] Creating event network-changed:860d18b5-659e-47c6-93d4-69587ee6087f for instance ef9dcafc-3140-4c17-aee8-455e4d1636c8 on n-h1-master-1 Jun 20 12:31:41.896699 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-28ef8ac7-df53-4a2d-8387-8ed36251d3cc req-eec2d49b-edda-4518-8b31-1b3e309871d9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078794 Jun 20 12:31:41.899361 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3043/5986] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:31:42.394449 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8166cd9b-cc69-43cf-9eb8-5a7b72e54b13 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:42.395844 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8166cd9b-cc69-43cf-9eb8-5a7b72e54b13 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: ef9dcafc-3140-4c17-aee8-455e4d1636c8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:42.405021 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8166cd9b-cc69-43cf-9eb8-5a7b72e54b13 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:42.405986 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8166cd9b-cc69-43cf-9eb8-5a7b72e54b13 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:42.406951 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8166cd9b-cc69-43cf-9eb8-5a7b72e54b13 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:42.407701 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8166cd9b-cc69-43cf-9eb8-5a7b72e54b13 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:42.411930 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a39a58c3-f7f5-4304-bcf9-5c943e07a7f1 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:42.413333 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a39a58c3-f7f5-4304-bcf9-5c943e07a7f1 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 028600e9-6eb6-42ac-b62e-de21666d744e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:42.426126 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a39a58c3-f7f5-4304-bcf9-5c943e07a7f1 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:42.426618 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a39a58c3-f7f5-4304-bcf9-5c943e07a7f1 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:42.427430 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a39a58c3-f7f5-4304-bcf9-5c943e07a7f1 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:42.427878 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a39a58c3-f7f5-4304-bcf9-5c943e07a7f1 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:42.605088 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a39a58c3-f7f5-4304-bcf9-5c943e07a7f1 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:42.613872 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a39a58c3-f7f5-4304-bcf9-5c943e07a7f1 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e" status: 200 len: 1238 microversion: 2.1 time: 0.207604 Jun 20 12:31:42.614674 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3044/5987] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:42 2022] GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e => generated 1238 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:31:42.665147 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8166cd9b-cc69-43cf-9eb8-5a7b72e54b13 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e653a6be497a469a9064cb754ea47fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b38619bb2f4b3e92aa9a9d5c5195b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:42.685928 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8166cd9b-cc69-43cf-9eb8-5a7b72e54b13 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "GET /compute/v2.1/servers/ef9dcafc-3140-4c17-aee8-455e4d1636c8" status: 200 len: 1299 microversion: 2.1 time: 0.296803 Jun 20 12:31:42.686928 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2944/5988] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:42 2022] GET /compute/v2.1/servers/ef9dcafc-3140-4c17-aee8-455e4d1636c8 => generated 1299 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:31:43.635418 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-da379fd1-880a-4fdc-94f0-8be2e55560c2 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:43.637680 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-da379fd1-880a-4fdc-94f0-8be2e55560c2 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 028600e9-6eb6-42ac-b62e-de21666d744e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:43.647979 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da379fd1-880a-4fdc-94f0-8be2e55560c2 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:43.648914 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da379fd1-880a-4fdc-94f0-8be2e55560c2 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:43.654706 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da379fd1-880a-4fdc-94f0-8be2e55560c2 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:43.654706 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da379fd1-880a-4fdc-94f0-8be2e55560c2 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:43.710664 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a45bedf7-545c-463c-a8e9-25b930d7f7ac tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:43.711285 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a45bedf7-545c-463c-a8e9-25b930d7f7ac tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: ef9dcafc-3140-4c17-aee8-455e4d1636c8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:43.721338 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a45bedf7-545c-463c-a8e9-25b930d7f7ac tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:43.721943 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a45bedf7-545c-463c-a8e9-25b930d7f7ac tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:43.722926 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a45bedf7-545c-463c-a8e9-25b930d7f7ac tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:43.723373 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a45bedf7-545c-463c-a8e9-25b930d7f7ac tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:43.781997 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-da379fd1-880a-4fdc-94f0-8be2e55560c2 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:43.795335 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-da379fd1-880a-4fdc-94f0-8be2e55560c2 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e" status: 200 len: 1300 microversion: 2.1 time: 0.164819 Jun 20 12:31:43.796904 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3045/5989] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:43 2022] GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e => generated 1300 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:31:43.828617 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a45bedf7-545c-463c-a8e9-25b930d7f7ac tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e653a6be497a469a9064cb754ea47fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b38619bb2f4b3e92aa9a9d5c5195b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:43.838915 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a45bedf7-545c-463c-a8e9-25b930d7f7ac tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "GET /compute/v2.1/servers/ef9dcafc-3140-4c17-aee8-455e4d1636c8" status: 200 len: 1299 microversion: 2.1 time: 0.133886 Jun 20 12:31:43.840734 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2945/5990] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:43 2022] GET /compute/v2.1/servers/ef9dcafc-3140-4c17-aee8-455e4d1636c8 => generated 1299 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:31:44.816390 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-eae205e5-b861-411d-886f-1b8a197077d4 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:44.817024 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-eae205e5-b861-411d-886f-1b8a197077d4 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 028600e9-6eb6-42ac-b62e-de21666d744e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:44.824555 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eae205e5-b861-411d-886f-1b8a197077d4 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:44.825018 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eae205e5-b861-411d-886f-1b8a197077d4 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:44.826291 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eae205e5-b861-411d-886f-1b8a197077d4 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:44.826748 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eae205e5-b861-411d-886f-1b8a197077d4 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:44.858173 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-773edb89-e462-430b-902b-c0b37079671a tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:44.859448 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-773edb89-e462-430b-902b-c0b37079671a tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: ef9dcafc-3140-4c17-aee8-455e4d1636c8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:44.876169 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-773edb89-e462-430b-902b-c0b37079671a tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:44.877210 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-773edb89-e462-430b-902b-c0b37079671a tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:44.879416 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-773edb89-e462-430b-902b-c0b37079671a tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:44.881586 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-773edb89-e462-430b-902b-c0b37079671a tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:44.987983 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-773edb89-e462-430b-902b-c0b37079671a tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e653a6be497a469a9064cb754ea47fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b38619bb2f4b3e92aa9a9d5c5195b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:44.997776 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-773edb89-e462-430b-902b-c0b37079671a tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "GET /compute/v2.1/servers/ef9dcafc-3140-4c17-aee8-455e4d1636c8" status: 200 len: 1299 microversion: 2.1 time: 0.144341 Jun 20 12:31:45.009146 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2946/5991] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:44 2022] GET /compute/v2.1/servers/ef9dcafc-3140-4c17-aee8-455e4d1636c8 => generated 1299 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:31:45.158884 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-eae205e5-b861-411d-886f-1b8a197077d4 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:45.168137 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-eae205e5-b861-411d-886f-1b8a197077d4 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e" status: 200 len: 1368 microversion: 2.1 time: 0.358055 Jun 20 12:31:45.169509 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3046/5992] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:44 2022] GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e => generated 1368 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:31:45.544071 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-ef962d0d-062b-416a-8dad-0c7fdbb3ade2 req-d7db2614-6647-4f23-8f8b-87fe8b2b4c3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "028600e9-6eb6-42ac-b62e-de21666d744e", "tag": "c23691ac-f03d-442c-8a79-82564869fd85"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:31:45.565901 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-ef962d0d-062b-416a-8dad-0c7fdbb3ade2 req-d7db2614-6647-4f23-8f8b-87fe8b2b4c3f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:45.566758 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-ef962d0d-062b-416a-8dad-0c7fdbb3ade2 req-d7db2614-6647-4f23-8f8b-87fe8b2b4c3f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:45.583450 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-ef962d0d-062b-416a-8dad-0c7fdbb3ade2 req-d7db2614-6647-4f23-8f8b-87fe8b2b4c3f service nova] Creating event network-changed:c23691ac-f03d-442c-8a79-82564869fd85 for instance 028600e9-6eb6-42ac-b62e-de21666d744e on n-h2-master-1 Jun 20 12:31:45.589130 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-ef962d0d-062b-416a-8dad-0c7fdbb3ade2 req-d7db2614-6647-4f23-8f8b-87fe8b2b4c3f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049487 Jun 20 12:31:45.593935 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2947/5993] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:31:46.016967 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e952097a-20a9-4dc8-904f-b66b53e9acda tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:46.018417 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e952097a-20a9-4dc8-904f-b66b53e9acda tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: ef9dcafc-3140-4c17-aee8-455e4d1636c8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:46.039892 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:46.043830 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:46.047970 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e952097a-20a9-4dc8-904f-b66b53e9acda tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:46.050565 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e952097a-20a9-4dc8-904f-b66b53e9acda tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:46.054838 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e952097a-20a9-4dc8-904f-b66b53e9acda tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:46.055374 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e952097a-20a9-4dc8-904f-b66b53e9acda tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:46.168844 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e952097a-20a9-4dc8-904f-b66b53e9acda tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e653a6be497a469a9064cb754ea47fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b38619bb2f4b3e92aa9a9d5c5195b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:46.185058 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e952097a-20a9-4dc8-904f-b66b53e9acda tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "GET /compute/v2.1/servers/ef9dcafc-3140-4c17-aee8-455e4d1636c8" status: 200 len: 1299 microversion: 2.1 time: 0.172189 Jun 20 12:31:46.188409 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-539aa2f0-32af-4ecb-b0e8-0f8c8c9dfb7c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:46.191040 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-539aa2f0-32af-4ecb-b0e8-0f8c8c9dfb7c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 028600e9-6eb6-42ac-b62e-de21666d744e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:46.199190 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-539aa2f0-32af-4ecb-b0e8-0f8c8c9dfb7c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:46.200449 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-539aa2f0-32af-4ecb-b0e8-0f8c8c9dfb7c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:46.201547 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-539aa2f0-32af-4ecb-b0e8-0f8c8c9dfb7c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:46.202386 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-539aa2f0-32af-4ecb-b0e8-0f8c8c9dfb7c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:46.202792 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3047/5994] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:46 2022] GET /compute/v2.1/servers/ef9dcafc-3140-4c17-aee8-455e4d1636c8 => generated 1299 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:31:46.430271 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-539aa2f0-32af-4ecb-b0e8-0f8c8c9dfb7c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:46.440709 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-539aa2f0-32af-4ecb-b0e8-0f8c8c9dfb7c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e" status: 200 len: 1368 microversion: 2.1 time: 0.257196 Jun 20 12:31:46.458792 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2948/5995] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:46 2022] GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e => generated 1368 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:31:47.202988 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0f1b0a6b-e08e-4654-a478-6878b007e4d1 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:47.203801 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0f1b0a6b-e08e-4654-a478-6878b007e4d1 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: ef9dcafc-3140-4c17-aee8-455e4d1636c8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:47.212158 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f1b0a6b-e08e-4654-a478-6878b007e4d1 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:47.213023 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f1b0a6b-e08e-4654-a478-6878b007e4d1 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:47.214093 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f1b0a6b-e08e-4654-a478-6878b007e4d1 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:47.214740 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f1b0a6b-e08e-4654-a478-6878b007e4d1 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:47.342363 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0f1b0a6b-e08e-4654-a478-6878b007e4d1 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e653a6be497a469a9064cb754ea47fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b38619bb2f4b3e92aa9a9d5c5195b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:47.354511 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0f1b0a6b-e08e-4654-a478-6878b007e4d1 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "GET /compute/v2.1/servers/ef9dcafc-3140-4c17-aee8-455e4d1636c8" status: 200 len: 1299 microversion: 2.1 time: 0.155298 Jun 20 12:31:47.364514 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3048/5996] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:47 2022] GET /compute/v2.1/servers/ef9dcafc-3140-4c17-aee8-455e4d1636c8 => generated 1299 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:31:47.458365 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4419e52c-8088-4bd0-9196-17f5ca30fd63 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:47.459355 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4419e52c-8088-4bd0-9196-17f5ca30fd63 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 028600e9-6eb6-42ac-b62e-de21666d744e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:47.467080 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4419e52c-8088-4bd0-9196-17f5ca30fd63 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:47.467524 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4419e52c-8088-4bd0-9196-17f5ca30fd63 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:47.468679 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4419e52c-8088-4bd0-9196-17f5ca30fd63 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:47.469479 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4419e52c-8088-4bd0-9196-17f5ca30fd63 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:47.628424 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4419e52c-8088-4bd0-9196-17f5ca30fd63 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:47.636643 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4419e52c-8088-4bd0-9196-17f5ca30fd63 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e" status: 200 len: 1368 microversion: 2.1 time: 0.182283 Jun 20 12:31:47.637251 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2949/5997] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:47 2022] GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e => generated 1368 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:31:47.885169 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-6c2d9c19-0f92-402c-a291-5bf48fa16f1b req-e7c3e313-7b0d-4c5e-a592-4552b59b3d05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef9dcafc-3140-4c17-aee8-455e4d1636c8", "name": "network-vif-plugged", "status": "completed", "tag": "860d18b5-659e-47c6-93d4-69587ee6087f"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:31:47.894682 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-6c2d9c19-0f92-402c-a291-5bf48fa16f1b req-e7c3e313-7b0d-4c5e-a592-4552b59b3d05 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:47.895433 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-6c2d9c19-0f92-402c-a291-5bf48fa16f1b req-e7c3e313-7b0d-4c5e-a592-4552b59b3d05 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:47.911303 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-6c2d9c19-0f92-402c-a291-5bf48fa16f1b req-e7c3e313-7b0d-4c5e-a592-4552b59b3d05 service nova] Creating event network-vif-plugged:860d18b5-659e-47c6-93d4-69587ee6087f for instance ef9dcafc-3140-4c17-aee8-455e4d1636c8 on n-h1-master-1 Jun 20 12:31:47.921095 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-6c2d9c19-0f92-402c-a291-5bf48fa16f1b req-e7c3e313-7b0d-4c5e-a592-4552b59b3d05 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039416 Jun 20 12:31:47.922012 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3049/5998] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:31:48.375804 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e14afd07-1c18-4b7f-86a7-58232e5697c4 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:48.377816 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e14afd07-1c18-4b7f-86a7-58232e5697c4 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: ef9dcafc-3140-4c17-aee8-455e4d1636c8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:48.385582 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e14afd07-1c18-4b7f-86a7-58232e5697c4 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:48.386137 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e14afd07-1c18-4b7f-86a7-58232e5697c4 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:48.387195 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e14afd07-1c18-4b7f-86a7-58232e5697c4 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:48.387707 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e14afd07-1c18-4b7f-86a7-58232e5697c4 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:48.503065 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e14afd07-1c18-4b7f-86a7-58232e5697c4 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e653a6be497a469a9064cb754ea47fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b38619bb2f4b3e92aa9a9d5c5195b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:48.512758 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e14afd07-1c18-4b7f-86a7-58232e5697c4 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "GET /compute/v2.1/servers/ef9dcafc-3140-4c17-aee8-455e4d1636c8" status: 200 len: 1299 microversion: 2.1 time: 0.140976 Jun 20 12:31:48.514063 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2950/5999] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:48 2022] GET /compute/v2.1/servers/ef9dcafc-3140-4c17-aee8-455e4d1636c8 => generated 1299 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:31:48.656091 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7c4c01d3-ebfa-4538-84be-4fda83e0a582 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:48.658170 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7c4c01d3-ebfa-4538-84be-4fda83e0a582 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 028600e9-6eb6-42ac-b62e-de21666d744e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:48.670479 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c4c01d3-ebfa-4538-84be-4fda83e0a582 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:48.671561 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c4c01d3-ebfa-4538-84be-4fda83e0a582 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:48.675779 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c4c01d3-ebfa-4538-84be-4fda83e0a582 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:48.676589 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c4c01d3-ebfa-4538-84be-4fda83e0a582 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:48.859005 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7c4c01d3-ebfa-4538-84be-4fda83e0a582 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:48.868565 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7c4c01d3-ebfa-4538-84be-4fda83e0a582 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e" status: 200 len: 1368 microversion: 2.1 time: 0.217887 Jun 20 12:31:48.881873 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3050/6000] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:48 2022] GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e => generated 1368 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:31:49.530645 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-49c247a1-18fa-4121-802f-3c7b8349d83a tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:49.531258 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-49c247a1-18fa-4121-802f-3c7b8349d83a tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: ef9dcafc-3140-4c17-aee8-455e4d1636c8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:49.545590 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-49c247a1-18fa-4121-802f-3c7b8349d83a tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:49.546050 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-49c247a1-18fa-4121-802f-3c7b8349d83a tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:49.546845 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-49c247a1-18fa-4121-802f-3c7b8349d83a tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:49.547289 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-49c247a1-18fa-4121-802f-3c7b8349d83a tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:49.739399 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-49c247a1-18fa-4121-802f-3c7b8349d83a tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e653a6be497a469a9064cb754ea47fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b38619bb2f4b3e92aa9a9d5c5195b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:49.749563 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-49c247a1-18fa-4121-802f-3c7b8349d83a tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "GET /compute/v2.1/servers/ef9dcafc-3140-4c17-aee8-455e4d1636c8" status: 200 len: 1472 microversion: 2.1 time: 0.222608 Jun 20 12:31:49.750477 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2951/6001] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:49 2022] GET /compute/v2.1/servers/ef9dcafc-3140-4c17-aee8-455e4d1636c8 => generated 1472 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:31:49.768945 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a8373bd4-7aa9-42e8-b465-51b75316b0c4 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:49.775060 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a8373bd4-7aa9-42e8-b465-51b75316b0c4 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: ef9dcafc-3140-4c17-aee8-455e4d1636c8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:49.797617 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a8373bd4-7aa9-42e8-b465-51b75316b0c4 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:49.798435 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a8373bd4-7aa9-42e8-b465-51b75316b0c4 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:49.799834 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a8373bd4-7aa9-42e8-b465-51b75316b0c4 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:49.805301 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a8373bd4-7aa9-42e8-b465-51b75316b0c4 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:49.896301 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0d86567e-c65f-46a6-8cd1-32ad94aca1d1 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:49.897143 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0d86567e-c65f-46a6-8cd1-32ad94aca1d1 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 028600e9-6eb6-42ac-b62e-de21666d744e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:49.908189 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d86567e-c65f-46a6-8cd1-32ad94aca1d1 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:49.910597 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d86567e-c65f-46a6-8cd1-32ad94aca1d1 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:49.911546 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d86567e-c65f-46a6-8cd1-32ad94aca1d1 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:49.915953 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d86567e-c65f-46a6-8cd1-32ad94aca1d1 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:50.186960 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0d86567e-c65f-46a6-8cd1-32ad94aca1d1 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:50.198339 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0d86567e-c65f-46a6-8cd1-32ad94aca1d1 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e" status: 200 len: 1368 microversion: 2.1 time: 0.306867 Jun 20 12:31:50.206465 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2952/6002] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:49 2022] GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e => generated 1368 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:31:50.339286 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a8373bd4-7aa9-42e8-b465-51b75316b0c4 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e653a6be497a469a9064cb754ea47fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b38619bb2f4b3e92aa9a9d5c5195b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:50.350761 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a8373bd4-7aa9-42e8-b465-51b75316b0c4 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "GET /compute/v2.1/servers/ef9dcafc-3140-4c17-aee8-455e4d1636c8" status: 200 len: 1472 microversion: 2.1 time: 0.587559 Jun 20 12:31:50.363634 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3051/6003] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:49 2022] GET /compute/v2.1/servers/ef9dcafc-3140-4c17-aee8-455e4d1636c8 => generated 1472 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:31:50.367482 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2aa61beb-6a75-420e-b83a-5f040b5491ff tempest-TestSecurityGroupsBasicOps-1514337656 tempest-TestSecurityGroupsBasicOps-1514337656-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:50.368117 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2aa61beb-6a75-420e-b83a-5f040b5491ff tempest-TestSecurityGroupsBasicOps-1514337656 tempest-TestSecurityGroupsBasicOps-1514337656-project-admin] [instance: ef9dcafc-3140-4c17-aee8-455e4d1636c8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:50.419725 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2aa61beb-6a75-420e-b83a-5f040b5491ff tempest-TestSecurityGroupsBasicOps-1514337656 tempest-TestSecurityGroupsBasicOps-1514337656-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:50.424746 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2aa61beb-6a75-420e-b83a-5f040b5491ff tempest-TestSecurityGroupsBasicOps-1514337656 tempest-TestSecurityGroupsBasicOps-1514337656-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:50.431425 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2aa61beb-6a75-420e-b83a-5f040b5491ff tempest-TestSecurityGroupsBasicOps-1514337656 tempest-TestSecurityGroupsBasicOps-1514337656-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:50.433914 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2aa61beb-6a75-420e-b83a-5f040b5491ff tempest-TestSecurityGroupsBasicOps-1514337656 tempest-TestSecurityGroupsBasicOps-1514337656-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:50.588576 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2aa61beb-6a75-420e-b83a-5f040b5491ff tempest-TestSecurityGroupsBasicOps-1514337656 tempest-TestSecurityGroupsBasicOps-1514337656-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ef9dcafc-3140-4c17-aee8-455e4d1636c8" status: 200 len: 1623 microversion: 2.1 time: 0.225295 Jun 20 12:31:50.590070 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2953/6004] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:50 2022] GET /compute/v2.1/servers/ef9dcafc-3140-4c17-aee8-455e4d1636c8 => generated 1623 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:31:50.605554 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-80d49613-d52f-4fd2-addf-fcdf7358bb0d tempest-TestSecurityGroupsBasicOps-1514337656 tempest-TestSecurityGroupsBasicOps-1514337656-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:50.606376 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-80d49613-d52f-4fd2-addf-fcdf7358bb0d tempest-TestSecurityGroupsBasicOps-1514337656 tempest-TestSecurityGroupsBasicOps-1514337656-project-admin] [instance: a3aa985b-f96c-40ed-ba36-89054521794d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:50.614544 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-80d49613-d52f-4fd2-addf-fcdf7358bb0d tempest-TestSecurityGroupsBasicOps-1514337656 tempest-TestSecurityGroupsBasicOps-1514337656-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:50.615292 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-80d49613-d52f-4fd2-addf-fcdf7358bb0d tempest-TestSecurityGroupsBasicOps-1514337656 tempest-TestSecurityGroupsBasicOps-1514337656-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:50.616273 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-80d49613-d52f-4fd2-addf-fcdf7358bb0d tempest-TestSecurityGroupsBasicOps-1514337656 tempest-TestSecurityGroupsBasicOps-1514337656-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:50.616870 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-80d49613-d52f-4fd2-addf-fcdf7358bb0d tempest-TestSecurityGroupsBasicOps-1514337656 tempest-TestSecurityGroupsBasicOps-1514337656-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:50.808611 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-80d49613-d52f-4fd2-addf-fcdf7358bb0d tempest-TestSecurityGroupsBasicOps-1514337656 tempest-TestSecurityGroupsBasicOps-1514337656-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d" status: 200 len: 1913 microversion: 2.1 time: 0.206983 Jun 20 12:31:50.810323 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3052/6005] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:50 2022] GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d => generated 1913 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:31:50.889949 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c93fe992-1823-4d2b-852e-08a3b79e2ba9 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:50.892516 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c93fe992-1823-4d2b-852e-08a3b79e2ba9 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: ef9dcafc-3140-4c17-aee8-455e4d1636c8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:50.907095 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c93fe992-1823-4d2b-852e-08a3b79e2ba9 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:50.908136 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c93fe992-1823-4d2b-852e-08a3b79e2ba9 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:50.912615 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c93fe992-1823-4d2b-852e-08a3b79e2ba9 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:50.913440 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c93fe992-1823-4d2b-852e-08a3b79e2ba9 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:50.963634 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c93fe992-1823-4d2b-852e-08a3b79e2ba9 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: ef9dcafc-3140-4c17-aee8-455e4d1636c8] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:31:51.084379 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c93fe992-1823-4d2b-852e-08a3b79e2ba9 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ef9dcafc-3140-4c17-aee8-455e4d1636c8" status: 204 len: 0 microversion: 2.1 time: 0.197999 Jun 20 12:31:51.084379 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2954/6006] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:31:50 2022] DELETE /compute/v2.1/servers/ef9dcafc-3140-4c17-aee8-455e4d1636c8 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:31:51.091797 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-68818c7b-859b-4ee2-920b-b335158f39c8 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:51.092447 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-68818c7b-859b-4ee2-920b-b335158f39c8 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: ef9dcafc-3140-4c17-aee8-455e4d1636c8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:51.099873 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-68818c7b-859b-4ee2-920b-b335158f39c8 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:51.101874 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-68818c7b-859b-4ee2-920b-b335158f39c8 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:51.103282 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-68818c7b-859b-4ee2-920b-b335158f39c8 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:51.103900 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-68818c7b-859b-4ee2-920b-b335158f39c8 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:51.225462 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f56463be-dafa-40d9-b90d-4791b0d05fcf tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:51.226276 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f56463be-dafa-40d9-b90d-4791b0d05fcf tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 028600e9-6eb6-42ac-b62e-de21666d744e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:51.242137 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:51.248876 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f56463be-dafa-40d9-b90d-4791b0d05fcf tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:51.249332 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f56463be-dafa-40d9-b90d-4791b0d05fcf tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:51.250124 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f56463be-dafa-40d9-b90d-4791b0d05fcf tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:51.250530 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f56463be-dafa-40d9-b90d-4791b0d05fcf tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:51.254017 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-68818c7b-859b-4ee2-920b-b335158f39c8 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e653a6be497a469a9064cb754ea47fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b38619bb2f4b3e92aa9a9d5c5195b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:51.262764 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-68818c7b-859b-4ee2-920b-b335158f39c8 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "GET /compute/v2.1/servers/ef9dcafc-3140-4c17-aee8-455e4d1636c8" status: 200 len: 1478 microversion: 2.1 time: 0.174657 Jun 20 12:31:51.263921 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3053/6007] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:51 2022] GET /compute/v2.1/servers/ef9dcafc-3140-4c17-aee8-455e4d1636c8 => generated 1478 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:31:51.386023 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=14 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:51.459596 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f56463be-dafa-40d9-b90d-4791b0d05fcf tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:51.468237 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f56463be-dafa-40d9-b90d-4791b0d05fcf tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e" status: 200 len: 1368 microversion: 2.1 time: 0.248941 Jun 20 12:31:51.469098 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2955/6008] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:51 2022] GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e => generated 1368 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:31:51.707583 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-ae8474fa-ccdc-4884-8819-91ebed3f2236 req-6027763b-83f0-416d-854b-d8a210cc4a81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "028600e9-6eb6-42ac-b62e-de21666d744e", "name": "network-vif-plugged", "status": "completed", "tag": "c23691ac-f03d-442c-8a79-82564869fd85"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:31:51.721961 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ae8474fa-ccdc-4884-8819-91ebed3f2236 req-6027763b-83f0-416d-854b-d8a210cc4a81 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:51.723282 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ae8474fa-ccdc-4884-8819-91ebed3f2236 req-6027763b-83f0-416d-854b-d8a210cc4a81 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:51.741592 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-ae8474fa-ccdc-4884-8819-91ebed3f2236 req-6027763b-83f0-416d-854b-d8a210cc4a81 service nova] Creating event network-vif-plugged:c23691ac-f03d-442c-8a79-82564869fd85 for instance 028600e9-6eb6-42ac-b62e-de21666d744e on n-h2-master-1 Jun 20 12:31:51.747129 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-ae8474fa-ccdc-4884-8819-91ebed3f2236 req-6027763b-83f0-416d-854b-d8a210cc4a81 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044431 Jun 20 12:31:51.748741 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3054/6009] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:31:52.281483 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bcd16fdc-378e-4723-8b50-0bf39103af14 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:52.282280 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bcd16fdc-378e-4723-8b50-0bf39103af14 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: ef9dcafc-3140-4c17-aee8-455e4d1636c8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:52.292644 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bcd16fdc-378e-4723-8b50-0bf39103af14 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:52.293900 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bcd16fdc-378e-4723-8b50-0bf39103af14 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:52.295471 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bcd16fdc-378e-4723-8b50-0bf39103af14 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:52.296422 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bcd16fdc-378e-4723-8b50-0bf39103af14 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:52.488307 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-864a9cbd-f9bc-48b4-9b58-e6051d4ae2d7 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:52.490041 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-864a9cbd-f9bc-48b4-9b58-e6051d4ae2d7 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 028600e9-6eb6-42ac-b62e-de21666d744e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:52.500698 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-864a9cbd-f9bc-48b4-9b58-e6051d4ae2d7 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:52.501817 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-864a9cbd-f9bc-48b4-9b58-e6051d4ae2d7 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:52.503113 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-864a9cbd-f9bc-48b4-9b58-e6051d4ae2d7 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:52.503810 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-864a9cbd-f9bc-48b4-9b58-e6051d4ae2d7 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:52.766589 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-864a9cbd-f9bc-48b4-9b58-e6051d4ae2d7 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:52.790348 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-864a9cbd-f9bc-48b4-9b58-e6051d4ae2d7 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e" status: 200 len: 1368 microversion: 2.1 time: 0.308007 Jun 20 12:31:52.797985 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3055/6010] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:52 2022] GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e => generated 1368 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:31:52.922448 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-bcd16fdc-378e-4723-8b50-0bf39103af14 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e653a6be497a469a9064cb754ea47fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b38619bb2f4b3e92aa9a9d5c5195b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:52.933502 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bcd16fdc-378e-4723-8b50-0bf39103af14 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "GET /compute/v2.1/servers/ef9dcafc-3140-4c17-aee8-455e4d1636c8" status: 200 len: 1478 microversion: 2.1 time: 0.655598 Jun 20 12:31:52.944479 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2956/6011] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:52 2022] GET /compute/v2.1/servers/ef9dcafc-3140-4c17-aee8-455e4d1636c8 => generated 1478 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:31:53.484950 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-fd8b7dec-91b2-4820-8992-5c866f63a317 req-65240499-5373-43ee-8970-2c541a2a0878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef9dcafc-3140-4c17-aee8-455e4d1636c8", "name": "network-vif-deleted", "tag": "860d18b5-659e-47c6-93d4-69587ee6087f"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:31:53.509785 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-fd8b7dec-91b2-4820-8992-5c866f63a317 req-65240499-5373-43ee-8970-2c541a2a0878 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:53.513841 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-fd8b7dec-91b2-4820-8992-5c866f63a317 req-65240499-5373-43ee-8970-2c541a2a0878 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:53.531144 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-fd8b7dec-91b2-4820-8992-5c866f63a317 req-65240499-5373-43ee-8970-2c541a2a0878 service nova] Creating event network-vif-deleted:860d18b5-659e-47c6-93d4-69587ee6087f for instance ef9dcafc-3140-4c17-aee8-455e4d1636c8 on n-h1-master-1 Jun 20 12:31:53.540319 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-fd8b7dec-91b2-4820-8992-5c866f63a317 req-65240499-5373-43ee-8970-2c541a2a0878 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059883 Jun 20 12:31:53.544490 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3056/6012] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:31:53.809165 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-76759272-70ed-42cf-8f4f-263a924e6596 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:53.809958 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-76759272-70ed-42cf-8f4f-263a924e6596 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 028600e9-6eb6-42ac-b62e-de21666d744e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:53.819142 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-76759272-70ed-42cf-8f4f-263a924e6596 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:53.820184 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-76759272-70ed-42cf-8f4f-263a924e6596 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:53.821492 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-76759272-70ed-42cf-8f4f-263a924e6596 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:53.822435 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-76759272-70ed-42cf-8f4f-263a924e6596 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:53.952670 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-31ed1e1f-394c-486b-b6d0-153032734aea tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:53.953268 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-31ed1e1f-394c-486b-b6d0-153032734aea tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: ef9dcafc-3140-4c17-aee8-455e4d1636c8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:53.969430 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-31ed1e1f-394c-486b-b6d0-153032734aea tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:53.970175 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-31ed1e1f-394c-486b-b6d0-153032734aea tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:53.971288 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-31ed1e1f-394c-486b-b6d0-153032734aea tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:53.985032 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-31ed1e1f-394c-486b-b6d0-153032734aea tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:54.079747 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-31ed1e1f-394c-486b-b6d0-153032734aea tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:54.080973 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-31ed1e1f-394c-486b-b6d0-153032734aea tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:54.084752 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-31ed1e1f-394c-486b-b6d0-153032734aea tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lazy-loading 'fault' on Instance uuid ef9dcafc-3140-4c17-aee8-455e4d1636c8 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:31:54.097572 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-76759272-70ed-42cf-8f4f-263a924e6596 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:54.107604 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-76759272-70ed-42cf-8f4f-263a924e6596 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e" status: 200 len: 1558 microversion: 2.1 time: 0.302616 Jun 20 12:31:54.109134 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2957/6013] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:53 2022] GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e => generated 1558 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:31:54.132074 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1b14ae7c-39ef-4b0f-a98a-05ee4e49d45c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:54.135350 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1b14ae7c-39ef-4b0f-a98a-05ee4e49d45c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 028600e9-6eb6-42ac-b62e-de21666d744e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:54.149261 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1b14ae7c-39ef-4b0f-a98a-05ee4e49d45c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:54.150895 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1b14ae7c-39ef-4b0f-a98a-05ee4e49d45c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:54.152174 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1b14ae7c-39ef-4b0f-a98a-05ee4e49d45c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:54.153700 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1b14ae7c-39ef-4b0f-a98a-05ee4e49d45c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:54.178701 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-31ed1e1f-394c-486b-b6d0-153032734aea tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e653a6be497a469a9064cb754ea47fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b38619bb2f4b3e92aa9a9d5c5195b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:54.188971 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-31ed1e1f-394c-486b-b6d0-153032734aea tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "GET /compute/v2.1/servers/ef9dcafc-3140-4c17-aee8-455e4d1636c8" status: 200 len: 1331 microversion: 2.1 time: 0.241226 Jun 20 12:31:54.190095 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3057/6014] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:53 2022] GET /compute/v2.1/servers/ef9dcafc-3140-4c17-aee8-455e4d1636c8 => generated 1331 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:31:54.279297 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1b14ae7c-39ef-4b0f-a98a-05ee4e49d45c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.154636 Jun 20 12:31:54.279914 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2958/6015] 10.222.0.27 () {58 vars in 1274 bytes} [Mon Jun 20 12:31:54 2022] GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e/os-interface => generated 285 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:31:55.208226 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7416691e-05ea-4c19-8b12-1073af1b56c3 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:55.209782 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7416691e-05ea-4c19-8b12-1073af1b56c3 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: ef9dcafc-3140-4c17-aee8-455e4d1636c8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:55.221432 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7416691e-05ea-4c19-8b12-1073af1b56c3 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:55.221896 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7416691e-05ea-4c19-8b12-1073af1b56c3 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:55.222743 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7416691e-05ea-4c19-8b12-1073af1b56c3 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:55.223185 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7416691e-05ea-4c19-8b12-1073af1b56c3 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:55.265947 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-7416691e-05ea-4c19-8b12-1073af1b56c3 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] HTTP exception thrown: Instance ef9dcafc-3140-4c17-aee8-455e4d1636c8 could not be found. Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7416691e-05ea-4c19-8b12-1073af1b56c3 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Request method failure captured: Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/ef9dcafc-3140-4c17-aee8-455e4d1636c8 HTTP/1.1 Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGgQHfgxOTez_JbovLH_boh-Czr1m6VZe7ct6oAM5lGv7hxzMk10hE2y22z9oexhkebtx22cmTwpvm7FpYpm664A2ks6-kehnBON-phOGYiBJyUhbK_YhNd2vkoyc6aHpTQGOwuwBqSTp8_hZue3WKnsxL1ZyjGskjWt8d3XsS7Z1gY Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 06b38619bb2f4b3e92aa9a9d5c5195b9 Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1152867744 Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/06b38619bb2f4b3e92aa9a9d5c5195b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/06b38619bb2f4b3e92aa9a9d5c5195b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/06b38619bb2f4b3e92aa9a9d5c5195b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_06b38619bb2f4b3e92aa9a9d5c5195b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1152867744 Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 06b38619bb2f4b3e92aa9a9d5c5195b9 Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1152867744 Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-TestSecurityGroupsBasicOps-1152867744-project Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: e653a6be497a469a9064cb754ea47fa7 Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1152867744-project Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: exception: Instance ef9dcafc-3140-4c17-aee8-455e4d1636c8 could not be found. Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'ef9dcafc-3140-4c17-aee8-455e4d1636c8'} Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef9dcafc-3140-4c17-aee8-455e4d1636c8 could not be found. Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef9dcafc-3140-4c17-aee8-455e4d1636c8 could not be found. Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:31:55.268291 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:55.273432 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:31:55.273432 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:31:55.273432 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:31:55.273432 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:31:55.273432 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:31:55.273432 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef9dcafc-3140-4c17-aee8-455e4d1636c8 could not be found. Jun 20 12:31:55.273432 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:31:55.273432 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7416691e-05ea-4c19-8b12-1073af1b56c3 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Returning 404 to user: Instance ef9dcafc-3140-4c17-aee8-455e4d1636c8 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:31:55.273432 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7416691e-05ea-4c19-8b12-1073af1b56c3 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "GET /compute/v2.1/servers/ef9dcafc-3140-4c17-aee8-455e4d1636c8" status: 404 len: 111 microversion: 2.1 time: 0.066918 Jun 20 12:31:55.273432 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3058/6016] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:31:55 2022] GET /compute/v2.1/servers/ef9dcafc-3140-4c17-aee8-455e4d1636c8 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:31:55.849273 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-cfaa4a7d-4c8f-4a7d-97d8-bedb3df155c3 req-d4ebbb98-fb21-4a6c-8fa8-b9393730b2b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "028600e9-6eb6-42ac-b62e-de21666d744e", "tag": "c23691ac-f03d-442c-8a79-82564869fd85"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:31:55.874365 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-cfaa4a7d-4c8f-4a7d-97d8-bedb3df155c3 req-d4ebbb98-fb21-4a6c-8fa8-b9393730b2b6 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:55.875125 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-cfaa4a7d-4c8f-4a7d-97d8-bedb3df155c3 req-d4ebbb98-fb21-4a6c-8fa8-b9393730b2b6 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:55.934762 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-cfaa4a7d-4c8f-4a7d-97d8-bedb3df155c3 req-d4ebbb98-fb21-4a6c-8fa8-b9393730b2b6 service nova] Creating event network-changed:c23691ac-f03d-442c-8a79-82564869fd85 for instance 028600e9-6eb6-42ac-b62e-de21666d744e on n-h2-master-1 Jun 20 12:31:55.944458 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-cfaa4a7d-4c8f-4a7d-97d8-bedb3df155c3 req-d4ebbb98-fb21-4a6c-8fa8-b9393730b2b6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099337 Jun 20 12:31:55.950702 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2959/6017] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:32:01.831480 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4bca08e0-b55c-4997-8f62-af975755e65e tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:01.832059 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4bca08e0-b55c-4997-8f62-af975755e65e tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: a3aa985b-f96c-40ed-ba36-89054521794d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:01.850302 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-e643b4cb-b8e1-4e7e-9b23-49b4db000ee6 req-f2583af2-cafe-45a9-9367-91ba7a8a5624 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3aa985b-f96c-40ed-ba36-89054521794d", "tag": "77968096-f5cc-4986-be10-a6a401e8ba2c"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:32:01.863932 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4bca08e0-b55c-4997-8f62-af975755e65e tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:01.864811 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4bca08e0-b55c-4997-8f62-af975755e65e tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:01.865713 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4bca08e0-b55c-4997-8f62-af975755e65e tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:01.866164 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4bca08e0-b55c-4997-8f62-af975755e65e tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:01.871153 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e643b4cb-b8e1-4e7e-9b23-49b4db000ee6 req-f2583af2-cafe-45a9-9367-91ba7a8a5624 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:01.873734 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e643b4cb-b8e1-4e7e-9b23-49b4db000ee6 req-f2583af2-cafe-45a9-9367-91ba7a8a5624 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:01.881960 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:32:01.901449 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:32:01.910592 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4bca08e0-b55c-4997-8f62-af975755e65e tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: a3aa985b-f96c-40ed-ba36-89054521794d] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:32:01.920955 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-e643b4cb-b8e1-4e7e-9b23-49b4db000ee6 req-f2583af2-cafe-45a9-9367-91ba7a8a5624 service nova] Creating event network-changed:77968096-f5cc-4986-be10-a6a401e8ba2c for instance a3aa985b-f96c-40ed-ba36-89054521794d on n-h2-master-1 Jun 20 12:32:01.939087 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-e643b4cb-b8e1-4e7e-9b23-49b4db000ee6 req-f2583af2-cafe-45a9-9367-91ba7a8a5624 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095980 Jun 20 12:32:01.944382 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2960/6018] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:32:02.067271 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4bca08e0-b55c-4997-8f62-af975755e65e tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d" status: 204 len: 0 microversion: 2.1 time: 0.242817 Jun 20 12:32:02.069090 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3059/6019] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:32:01 2022] DELETE /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:32:02.082760 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-75ff3462-b269-4ceb-a207-0f350e91a384 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:02.088363 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-75ff3462-b269-4ceb-a207-0f350e91a384 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: a3aa985b-f96c-40ed-ba36-89054521794d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:02.111534 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-75ff3462-b269-4ceb-a207-0f350e91a384 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:02.114135 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-75ff3462-b269-4ceb-a207-0f350e91a384 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:02.115053 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-75ff3462-b269-4ceb-a207-0f350e91a384 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:02.115516 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-75ff3462-b269-4ceb-a207-0f350e91a384 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:02.353610 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-75ff3462-b269-4ceb-a207-0f350e91a384 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e653a6be497a469a9064cb754ea47fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b38619bb2f4b3e92aa9a9d5c5195b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:02.363036 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-75ff3462-b269-4ceb-a207-0f350e91a384 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d" status: 200 len: 1768 microversion: 2.1 time: 0.289100 Jun 20 12:32:02.364853 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2961/6020] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:02 2022] GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d => generated 1768 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:03.386225 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-24fbac3a-be14-4c4c-b627-475d8efa87c5 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:03.386876 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-24fbac3a-be14-4c4c-b627-475d8efa87c5 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: a3aa985b-f96c-40ed-ba36-89054521794d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:03.406265 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-24fbac3a-be14-4c4c-b627-475d8efa87c5 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:03.406717 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-24fbac3a-be14-4c4c-b627-475d8efa87c5 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:03.407745 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-24fbac3a-be14-4c4c-b627-475d8efa87c5 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:03.408188 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-24fbac3a-be14-4c4c-b627-475d8efa87c5 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:03.851282 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-24fbac3a-be14-4c4c-b627-475d8efa87c5 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e653a6be497a469a9064cb754ea47fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b38619bb2f4b3e92aa9a9d5c5195b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:03.860940 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-24fbac3a-be14-4c4c-b627-475d8efa87c5 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d" status: 200 len: 1768 microversion: 2.1 time: 0.479480 Jun 20 12:32:03.861822 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3060/6021] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:03 2022] GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d => generated 1768 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:04.862340 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-0de7e78c-e12b-4a7f-8b9d-fcff14fc901b req-5164d407-aa2d-454d-b11a-9d7f7453a8a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3aa985b-f96c-40ed-ba36-89054521794d", "name": "network-vif-deleted", "tag": "77968096-f5cc-4986-be10-a6a401e8ba2c"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:32:04.882777 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b3c3d40b-9bef-4674-9309-6d47dd7bb3c1 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:04.883398 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-0de7e78c-e12b-4a7f-8b9d-fcff14fc901b req-5164d407-aa2d-454d-b11a-9d7f7453a8a0 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:04.883398 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-0de7e78c-e12b-4a7f-8b9d-fcff14fc901b req-5164d407-aa2d-454d-b11a-9d7f7453a8a0 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:04.884471 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b3c3d40b-9bef-4674-9309-6d47dd7bb3c1 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: a3aa985b-f96c-40ed-ba36-89054521794d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:04.886918 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:32:04.895002 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3c3d40b-9bef-4674-9309-6d47dd7bb3c1 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:04.895897 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3c3d40b-9bef-4674-9309-6d47dd7bb3c1 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:04.897049 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3c3d40b-9bef-4674-9309-6d47dd7bb3c1 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:04.897721 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3c3d40b-9bef-4674-9309-6d47dd7bb3c1 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:04.901794 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-0de7e78c-e12b-4a7f-8b9d-fcff14fc901b req-5164d407-aa2d-454d-b11a-9d7f7453a8a0 service nova] Creating event network-vif-deleted:77968096-f5cc-4986-be10-a6a401e8ba2c for instance a3aa985b-f96c-40ed-ba36-89054521794d on n-h2-master-1 Jun 20 12:32:04.908317 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-0de7e78c-e12b-4a7f-8b9d-fcff14fc901b req-5164d407-aa2d-454d-b11a-9d7f7453a8a0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057047 Jun 20 12:32:04.909459 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2962/6022] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:32:05.025646 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b3c3d40b-9bef-4674-9309-6d47dd7bb3c1 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e653a6be497a469a9064cb754ea47fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b38619bb2f4b3e92aa9a9d5c5195b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:05.039678 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b3c3d40b-9bef-4674-9309-6d47dd7bb3c1 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d" status: 200 len: 1380 microversion: 2.1 time: 0.163309 Jun 20 12:32:05.040916 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3061/6023] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:04 2022] GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d => generated 1380 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:06.058526 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b7d390d8-ee6a-4d31-9584-1a3b2249969c tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:06.059935 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b7d390d8-ee6a-4d31-9584-1a3b2249969c tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] [instance: a3aa985b-f96c-40ed-ba36-89054521794d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:06.066147 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:32:06.068563 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b7d390d8-ee6a-4d31-9584-1a3b2249969c tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:06.069235 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b7d390d8-ee6a-4d31-9584-1a3b2249969c tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:06.070247 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b7d390d8-ee6a-4d31-9584-1a3b2249969c tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:06.070861 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b7d390d8-ee6a-4d31-9584-1a3b2249969c tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:06.096162 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-b7d390d8-ee6a-4d31-9584-1a3b2249969c tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] HTTP exception thrown: Instance a3aa985b-f96c-40ed-ba36-89054521794d could not be found. Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b7d390d8-ee6a-4d31-9584-1a3b2249969c tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Request method failure captured: Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d HTTP/1.1 Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGgQHfgxOTez_JbovLH_boh-Czr1m6VZe7ct6oAM5lGv7hxzMk10hE2y22z9oexhkebtx22cmTwpvm7FpYpm664A2ks6-kehnBON-phOGYiBJyUhbK_YhNd2vkoyc6aHpTQGOwuwBqSTp8_hZue3WKnsxL1ZyjGskjWt8d3XsS7Z1gY Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 06b38619bb2f4b3e92aa9a9d5c5195b9 Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1152867744 Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/06b38619bb2f4b3e92aa9a9d5c5195b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/06b38619bb2f4b3e92aa9a9d5c5195b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/06b38619bb2f4b3e92aa9a9d5c5195b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_06b38619bb2f4b3e92aa9a9d5c5195b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1152867744 Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 06b38619bb2f4b3e92aa9a9d5c5195b9 Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1152867744 Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-TestSecurityGroupsBasicOps-1152867744-project Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: e653a6be497a469a9064cb754ea47fa7 Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1152867744-project Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: exception: Instance a3aa985b-f96c-40ed-ba36-89054521794d could not be found. Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'a3aa985b-f96c-40ed-ba36-89054521794d'} Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3aa985b-f96c-40ed-ba36-89054521794d could not be found. Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3aa985b-f96c-40ed-ba36-89054521794d could not be found. Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:32:06.098308 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:32:06.103051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:32:06.103051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:32:06.103051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:32:06.103051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:32:06.103051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:32:06.103051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3aa985b-f96c-40ed-ba36-89054521794d could not be found. Jun 20 12:32:06.103051 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:32:06.105728 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b7d390d8-ee6a-4d31-9584-1a3b2249969c tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Returning 404 to user: Instance a3aa985b-f96c-40ed-ba36-89054521794d could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:32:06.106636 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b7d390d8-ee6a-4d31-9584-1a3b2249969c tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d" status: 404 len: 111 microversion: 2.1 time: 0.053357 Jun 20 12:32:06.107503 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2963/6024] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:06 2022] GET /compute/v2.1/servers/a3aa985b-f96c-40ed-ba36-89054521794d => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:32:12.381339 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-eed618ff-58dd-4f36-af4a-a5e566d44ef7 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] Calling method '.version_select at 0x7f6073648040>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:12.426084 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-eed618ff-58dd-4f36-af4a-a5e566d44ef7 tempest-TestSecurityGroupsBasicOps-1152867744 tempest-TestSecurityGroupsBasicOps-1152867744-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1450629429" status: 202 len: 0 microversion: 2.1 time: 0.048892 Jun 20 12:32:12.430899 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3062/6025] 10.222.0.27 () {58 vars in 1277 bytes} [Mon Jun 20 12:32:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1450629429 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:32:18.050629 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a9e085e7-6fc6-4d7f-ae86-a70aaafa1439 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Action: 'create', calling method: .version_select at 0x7f60724dcca0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-2032277790", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXloASXSTlTMlC623p0+e9+VQUt7CUOqmKDFz/SaefLInu0GGvlES1p3v9jdJKFoJLMMw4fNPayiKDoWBmHxrVvBm+DM7dOuZSV8rMYoRdreVfWFaf3HNXm3dph9PBApw=="}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:32:18.060632 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=10 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:32:18.062559 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:32:18.085850 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-a9e085e7-6fc6-4d7f-ae86-a70aaafa1439 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Getting quotas for project 9f2a9e121b8a48ff9716afd0d824e6dd. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:32:18.096312 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-a9e085e7-6fc6-4d7f-ae86-a70aaafa1439 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Getting quotas for user 6fe9fcb215054013b72a4e301144ae89 and project 9f2a9e121b8a48ff9716afd0d824e6dd. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:32:18.139525 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a9e085e7-6fc6-4d7f-ae86-a70aaafa1439 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.094000 Jun 20 12:32:18.141460 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2964/6026] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 12:32:18 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:32:20.507523 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:32:20.512892 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d9240640-a372-4982-839c-6f5f72f746e9 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-671754675", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "20d03675-3a01-4086-9e30-4ebeda60747b", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-2032277790", "security_groups": [{"name": "tempest-secgroup-smoke-1262839282"}], "networks": [{"uuid": "b3a3e3dc-1bfa-42fd-90cc-961537a1bf22"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:32:20.655912 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-d9240640-a372-4982-839c-6f5f72f746e9 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] validate_networks() for [('b3a3e3dc-1bfa-42fd-90cc-961537a1bf22', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:32:21.170785 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-972c9077-226c-43e4-a9cc-f30b2ae78617 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-3045995", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "a01f37a3-be15-4157-bec2-9be234bba72f"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:32:21.235989 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-972c9077-226c-43e4-a9cc-f30b2ae78617 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] validate_networks() for [('a01f37a3-be15-4157-bec2-9be234bba72f', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:32:21.653288 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-d9240640-a372-4982-839c-6f5f72f746e9 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:32:21.653791 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-d9240640-a372-4982-839c-6f5f72f746e9 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:32:21.654306 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-d9240640-a372-4982-839c-6f5f72f746e9 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:32:21.654822 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-d9240640-a372-4982-839c-6f5f72f746e9 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:32:21.655307 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-d9240640-a372-4982-839c-6f5f72f746e9 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:32:21.667785 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9240640-a372-4982-839c-6f5f72f746e9 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:21.668369 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9240640-a372-4982-839c-6f5f72f746e9 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:21.669560 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9240640-a372-4982-839c-6f5f72f746e9 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:21.670097 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d9240640-a372-4982-839c-6f5f72f746e9 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:21.691361 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-d9240640-a372-4982-839c-6f5f72f746e9 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Getting quotas for project 9f2a9e121b8a48ff9716afd0d824e6dd. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:32:21.697446 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-d9240640-a372-4982-839c-6f5f72f746e9 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Getting quotas for user 6fe9fcb215054013b72a4e301144ae89 and project 9f2a9e121b8a48ff9716afd0d824e6dd. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:32:21.767971 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d9240640-a372-4982-839c-6f5f72f746e9 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:32:21.771036 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d9240640-a372-4982-839c-6f5f72f746e9 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] [instance: 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='20d03675-3a01-4086-9e30-4ebeda60747b',volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:32:21.771292 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-972c9077-226c-43e4-a9cc-f30b2ae78617 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:32:21.772044 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-972c9077-226c-43e4-a9cc-f30b2ae78617 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:32:21.772708 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-972c9077-226c-43e4-a9cc-f30b2ae78617 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:32:21.773276 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-972c9077-226c-43e4-a9cc-f30b2ae78617 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:32:21.774037 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-972c9077-226c-43e4-a9cc-f30b2ae78617 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:32:21.802021 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-972c9077-226c-43e4-a9cc-f30b2ae78617 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:21.802608 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-972c9077-226c-43e4-a9cc-f30b2ae78617 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:21.803426 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-972c9077-226c-43e4-a9cc-f30b2ae78617 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:21.803862 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-972c9077-226c-43e4-a9cc-f30b2ae78617 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:21.840240 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-972c9077-226c-43e4-a9cc-f30b2ae78617 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Getting quotas for project fe42d894ee5647e6b6a26f600f47025a. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:32:21.848145 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-972c9077-226c-43e4-a9cc-f30b2ae78617 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Getting quotas for user fe16a15de5114083a5b5395b225234c3 and project fe42d894ee5647e6b6a26f600f47025a. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:32:21.865073 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-972c9077-226c-43e4-a9cc-f30b2ae78617 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:32:21.868189 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-972c9077-226c-43e4-a9cc-f30b2ae78617 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] [instance: 6b7aca7f-3a71-460f-84b4-f33f7f7b541c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:32:21.933565 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-972c9077-226c-43e4-a9cc-f30b2ae78617 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.075882 Jun 20 12:32:21.934224 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2965/6027] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:32:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:32:21.953597 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b4f389e5-0d3b-4d81-9d49-45919de45782 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:21.954636 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b4f389e5-0d3b-4d81-9d49-45919de45782 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] [instance: 6b7aca7f-3a71-460f-84b4-f33f7f7b541c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:22.009083 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d9240640-a372-4982-839c-6f5f72f746e9 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.503134 Jun 20 12:32:22.012228 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3063/6028] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:32:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 1507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:32:22.023487 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b4f389e5-0d3b-4d81-9d49-45919de45782 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe16a15de5114083a5b5395b225234c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42d894ee5647e6b6a26f600f47025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:22.024311 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ba4f87d8-dbf7-426b-b8d4-78aa0e5075d0 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:22.024934 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ba4f87d8-dbf7-426b-b8d4-78aa0e5075d0 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] [instance: 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:22.030504 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b4f389e5-0d3b-4d81-9d49-45919de45782 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] 10.222.0.27 "GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c" status: 200 len: 1212 microversion: 2.1 time: 0.090005 Jun 20 12:32:22.042484 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2966/6029] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:21 2022] GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c => generated 1212 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:32:22.138748 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ba4f87d8-dbf7-426b-b8d4-78aa0e5075d0 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe9fcb215054013b72a4e301144ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2a9e121b8a48ff9716afd0d824e6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:22.158666 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ba4f87d8-dbf7-426b-b8d4-78aa0e5075d0 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2" status: 200 len: 1098 microversion: 2.1 time: 0.139879 Jun 20 12:32:22.159290 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3064/6030] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:22 2022] GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 => generated 1098 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:23.048860 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-96776a51-db31-4a01-9e71-ba2436d8123b tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:23.049561 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-96776a51-db31-4a01-9e71-ba2436d8123b tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] [instance: 6b7aca7f-3a71-460f-84b4-f33f7f7b541c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:23.058251 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-96776a51-db31-4a01-9e71-ba2436d8123b tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:23.058713 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-96776a51-db31-4a01-9e71-ba2436d8123b tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:23.060660 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-96776a51-db31-4a01-9e71-ba2436d8123b tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:23.061396 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-96776a51-db31-4a01-9e71-ba2436d8123b tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:23.158678 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-96776a51-db31-4a01-9e71-ba2436d8123b tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe16a15de5114083a5b5395b225234c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42d894ee5647e6b6a26f600f47025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:23.172009 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-96776a51-db31-4a01-9e71-ba2436d8123b tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] 10.222.0.27 "GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c" status: 200 len: 1264 microversion: 2.1 time: 0.127843 Jun 20 12:32:23.173654 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2967/6031] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:23 2022] GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c => generated 1264 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:23.186139 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b9a97102-4424-483f-9a4b-9f59a195132d tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:23.186928 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b9a97102-4424-483f-9a4b-9f59a195132d tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] [instance: 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:23.195821 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b9a97102-4424-483f-9a4b-9f59a195132d tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:23.196687 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b9a97102-4424-483f-9a4b-9f59a195132d tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:23.197552 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b9a97102-4424-483f-9a4b-9f59a195132d tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:23.198054 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b9a97102-4424-483f-9a4b-9f59a195132d tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:23.272122 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b9a97102-4424-483f-9a4b-9f59a195132d tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe9fcb215054013b72a4e301144ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2a9e121b8a48ff9716afd0d824e6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:23.280905 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b9a97102-4424-483f-9a4b-9f59a195132d tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2" status: 200 len: 1196 microversion: 2.1 time: 0.099168 Jun 20 12:32:23.281775 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3065/6032] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:23 2022] GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 => generated 1196 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:24.203159 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-59e23388-c173-45d8-89ad-2f97b94723bf tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:24.204408 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-59e23388-c173-45d8-89ad-2f97b94723bf tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] [instance: 6b7aca7f-3a71-460f-84b4-f33f7f7b541c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:24.227204 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-59e23388-c173-45d8-89ad-2f97b94723bf tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:24.227682 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-59e23388-c173-45d8-89ad-2f97b94723bf tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:24.228513 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-59e23388-c173-45d8-89ad-2f97b94723bf tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:24.229136 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-59e23388-c173-45d8-89ad-2f97b94723bf tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:24.301848 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e59c5489-1fb9-44f0-9513-60378a0a2b6f tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:24.302756 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e59c5489-1fb9-44f0-9513-60378a0a2b6f tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] [instance: 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:24.317819 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e59c5489-1fb9-44f0-9513-60378a0a2b6f tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:24.335902 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e59c5489-1fb9-44f0-9513-60378a0a2b6f tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:24.339849 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e59c5489-1fb9-44f0-9513-60378a0a2b6f tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:24.340541 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e59c5489-1fb9-44f0-9513-60378a0a2b6f tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:24.380600 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-59e23388-c173-45d8-89ad-2f97b94723bf tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe16a15de5114083a5b5395b225234c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42d894ee5647e6b6a26f600f47025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:24.397016 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-59e23388-c173-45d8-89ad-2f97b94723bf tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] 10.222.0.27 "GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c" status: 200 len: 1270 microversion: 2.1 time: 0.204347 Jun 20 12:32:24.398177 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2968/6033] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:24 2022] GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c => generated 1270 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:24.432039 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e59c5489-1fb9-44f0-9513-60378a0a2b6f tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe9fcb215054013b72a4e301144ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2a9e121b8a48ff9716afd0d824e6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:24.444128 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e59c5489-1fb9-44f0-9513-60378a0a2b6f tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2" status: 200 len: 1214 microversion: 2.1 time: 0.146240 Jun 20 12:32:24.444974 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3066/6034] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:24 2022] GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 => generated 1214 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:25.415113 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-746c0fbd-e101-4d24-a94a-768deae25d1e tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:25.416435 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-746c0fbd-e101-4d24-a94a-768deae25d1e tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] [instance: 6b7aca7f-3a71-460f-84b4-f33f7f7b541c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:25.425295 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-746c0fbd-e101-4d24-a94a-768deae25d1e tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:25.425751 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-746c0fbd-e101-4d24-a94a-768deae25d1e tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:25.426567 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-746c0fbd-e101-4d24-a94a-768deae25d1e tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:25.427162 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-746c0fbd-e101-4d24-a94a-768deae25d1e tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:25.461459 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-370a8776-4bff-4af2-a565-60d20758b759 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:25.462019 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-370a8776-4bff-4af2-a565-60d20758b759 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] [instance: 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:25.469956 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-370a8776-4bff-4af2-a565-60d20758b759 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:25.470695 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-370a8776-4bff-4af2-a565-60d20758b759 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:25.472329 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-370a8776-4bff-4af2-a565-60d20758b759 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:25.472733 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-370a8776-4bff-4af2-a565-60d20758b759 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:25.642149 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-370a8776-4bff-4af2-a565-60d20758b759 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe9fcb215054013b72a4e301144ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2a9e121b8a48ff9716afd0d824e6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:25.652326 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-370a8776-4bff-4af2-a565-60d20758b759 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2" status: 200 len: 1282 microversion: 2.1 time: 0.194095 Jun 20 12:32:25.653368 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3067/6035] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:25 2022] GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 => generated 1282 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:32:25.919302 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-746c0fbd-e101-4d24-a94a-768deae25d1e tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe16a15de5114083a5b5395b225234c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42d894ee5647e6b6a26f600f47025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:25.929158 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-746c0fbd-e101-4d24-a94a-768deae25d1e tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] 10.222.0.27 "GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c" status: 200 len: 1312 microversion: 2.1 time: 0.518538 Jun 20 12:32:25.930561 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2969/6036] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:25 2022] GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c => generated 1312 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:26.670671 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-01d3b5de-e303-406a-b976-9de61fad6f4d tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:26.671419 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-01d3b5de-e303-406a-b976-9de61fad6f4d tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] [instance: 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:26.688214 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01d3b5de-e303-406a-b976-9de61fad6f4d tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:26.688682 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01d3b5de-e303-406a-b976-9de61fad6f4d tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:26.689472 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01d3b5de-e303-406a-b976-9de61fad6f4d tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:26.689911 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01d3b5de-e303-406a-b976-9de61fad6f4d tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:26.929536 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-01d3b5de-e303-406a-b976-9de61fad6f4d tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe9fcb215054013b72a4e301144ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2a9e121b8a48ff9716afd0d824e6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:26.938225 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-01d3b5de-e303-406a-b976-9de61fad6f4d tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2" status: 200 len: 1282 microversion: 2.1 time: 0.272289 Jun 20 12:32:26.952162 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3068/6037] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:26 2022] GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 => generated 1282 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:26.957262 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b2d7bfd5-0854-4bf4-b683-61b1d7958055 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:26.957884 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b2d7bfd5-0854-4bf4-b683-61b1d7958055 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] [instance: 6b7aca7f-3a71-460f-84b4-f33f7f7b541c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:26.965617 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2d7bfd5-0854-4bf4-b683-61b1d7958055 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:26.966761 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2d7bfd5-0854-4bf4-b683-61b1d7958055 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:26.967563 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2d7bfd5-0854-4bf4-b683-61b1d7958055 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:26.968013 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2d7bfd5-0854-4bf4-b683-61b1d7958055 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:27.257551 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-cc92fa87-8ecf-4f73-a4b1-1e1b0924f0ee req-78fd5719-39f8-426a-b396-fd333729a78e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b7aca7f-3a71-460f-84b4-f33f7f7b541c", "tag": "94e91429-6ea9-42ac-80f4-ef46908782ad"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:32:27.271632 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-cc92fa87-8ecf-4f73-a4b1-1e1b0924f0ee req-78fd5719-39f8-426a-b396-fd333729a78e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:27.272615 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-cc92fa87-8ecf-4f73-a4b1-1e1b0924f0ee req-78fd5719-39f8-426a-b396-fd333729a78e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:27.325246 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-cc92fa87-8ecf-4f73-a4b1-1e1b0924f0ee req-78fd5719-39f8-426a-b396-fd333729a78e service nova] Creating event network-changed:94e91429-6ea9-42ac-80f4-ef46908782ad for instance 6b7aca7f-3a71-460f-84b4-f33f7f7b541c on n-h1-master-1 Jun 20 12:32:27.340364 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-cc92fa87-8ecf-4f73-a4b1-1e1b0924f0ee req-78fd5719-39f8-426a-b396-fd333729a78e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088067 Jun 20 12:32:27.341691 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3069/6038] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:32:27.350783 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b2d7bfd5-0854-4bf4-b683-61b1d7958055 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe16a15de5114083a5b5395b225234c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42d894ee5647e6b6a26f600f47025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:27.361326 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b2d7bfd5-0854-4bf4-b683-61b1d7958055 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] 10.222.0.27 "GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c" status: 200 len: 1312 microversion: 2.1 time: 0.409310 Jun 20 12:32:27.362305 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2970/6039] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:26 2022] GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c => generated 1312 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:27.958560 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ff4b1f0a-3e81-4734-95a4-7bcf2b95d0a6 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:27.960115 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ff4b1f0a-3e81-4734-95a4-7bcf2b95d0a6 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] [instance: 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:27.968823 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff4b1f0a-3e81-4734-95a4-7bcf2b95d0a6 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:27.969868 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff4b1f0a-3e81-4734-95a4-7bcf2b95d0a6 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:27.971160 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff4b1f0a-3e81-4734-95a4-7bcf2b95d0a6 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:27.972489 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff4b1f0a-3e81-4734-95a4-7bcf2b95d0a6 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:28.164742 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ff4b1f0a-3e81-4734-95a4-7bcf2b95d0a6 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe9fcb215054013b72a4e301144ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2a9e121b8a48ff9716afd0d824e6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:28.181586 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ff4b1f0a-3e81-4734-95a4-7bcf2b95d0a6 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2" status: 200 len: 1282 microversion: 2.1 time: 0.225935 Jun 20 12:32:28.182991 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3070/6040] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:27 2022] GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 => generated 1282 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:28.383153 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-91b90170-78ea-4eda-832d-83392a9f998a tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:28.385043 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-91b90170-78ea-4eda-832d-83392a9f998a tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] [instance: 6b7aca7f-3a71-460f-84b4-f33f7f7b541c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:28.400319 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-91b90170-78ea-4eda-832d-83392a9f998a tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:28.401317 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-91b90170-78ea-4eda-832d-83392a9f998a tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:28.402326 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-91b90170-78ea-4eda-832d-83392a9f998a tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:28.403293 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-91b90170-78ea-4eda-832d-83392a9f998a tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:28.596756 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-91b90170-78ea-4eda-832d-83392a9f998a tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe16a15de5114083a5b5395b225234c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42d894ee5647e6b6a26f600f47025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:28.604791 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-91b90170-78ea-4eda-832d-83392a9f998a tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] 10.222.0.27 "GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c" status: 200 len: 1312 microversion: 2.1 time: 0.230408 Jun 20 12:32:28.605385 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2971/6041] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:28 2022] GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c => generated 1312 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:29.200000 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8894132f-67c8-46ed-bcd8-d0f2dcfa25da tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:29.200754 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8894132f-67c8-46ed-bcd8-d0f2dcfa25da tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] [instance: 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:29.215655 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8894132f-67c8-46ed-bcd8-d0f2dcfa25da tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:29.216019 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8894132f-67c8-46ed-bcd8-d0f2dcfa25da tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:29.227937 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8894132f-67c8-46ed-bcd8-d0f2dcfa25da tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:29.228442 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8894132f-67c8-46ed-bcd8-d0f2dcfa25da tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:29.409615 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8894132f-67c8-46ed-bcd8-d0f2dcfa25da tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe9fcb215054013b72a4e301144ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2a9e121b8a48ff9716afd0d824e6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:29.409873 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-ddf4206e-c910-49d2-8e12-9e3343bc939f req-470137d6-6311-418a-a5e8-97d486bba7d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fe3581d-a75d-43b2-a3f0-0cb4b612aef2", "tag": "9a143d9b-6ab1-4697-b2b0-8f8011555ccb"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:32:29.419458 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8894132f-67c8-46ed-bcd8-d0f2dcfa25da tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2" status: 200 len: 1282 microversion: 2.1 time: 0.224056 Jun 20 12:32:29.420652 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3071/6042] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:29 2022] GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 => generated 1282 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:29.435312 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-ddf4206e-c910-49d2-8e12-9e3343bc939f req-470137d6-6311-418a-a5e8-97d486bba7d3 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:29.436336 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-ddf4206e-c910-49d2-8e12-9e3343bc939f req-470137d6-6311-418a-a5e8-97d486bba7d3 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:29.481149 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-ddf4206e-c910-49d2-8e12-9e3343bc939f req-470137d6-6311-418a-a5e8-97d486bba7d3 service nova] Creating event network-changed:9a143d9b-6ab1-4697-b2b0-8f8011555ccb for instance 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 on n-h1-master-1 Jun 20 12:32:29.494732 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-ddf4206e-c910-49d2-8e12-9e3343bc939f req-470137d6-6311-418a-a5e8-97d486bba7d3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089639 Jun 20 12:32:29.497466 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2972/6043] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:32:29.622146 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c9c482c8-3295-4f92-be6c-a51281fc5708 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:29.622754 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c9c482c8-3295-4f92-be6c-a51281fc5708 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] [instance: 6b7aca7f-3a71-460f-84b4-f33f7f7b541c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:29.630880 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c9c482c8-3295-4f92-be6c-a51281fc5708 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:29.631334 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c9c482c8-3295-4f92-be6c-a51281fc5708 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:29.632114 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c9c482c8-3295-4f92-be6c-a51281fc5708 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:29.632576 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c9c482c8-3295-4f92-be6c-a51281fc5708 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:29.780122 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c9c482c8-3295-4f92-be6c-a51281fc5708 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe16a15de5114083a5b5395b225234c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42d894ee5647e6b6a26f600f47025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:29.790968 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c9c482c8-3295-4f92-be6c-a51281fc5708 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] 10.222.0.27 "GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c" status: 200 len: 1312 microversion: 2.1 time: 0.172637 Jun 20 12:32:29.792111 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3072/6044] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:29 2022] GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c => generated 1312 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:30.439092 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f29f20ad-7f3d-46e0-89b0-7773ff1d6950 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:30.440345 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f29f20ad-7f3d-46e0-89b0-7773ff1d6950 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] [instance: 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:30.454435 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f29f20ad-7f3d-46e0-89b0-7773ff1d6950 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:30.455051 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f29f20ad-7f3d-46e0-89b0-7773ff1d6950 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:30.457328 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f29f20ad-7f3d-46e0-89b0-7773ff1d6950 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:30.459558 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f29f20ad-7f3d-46e0-89b0-7773ff1d6950 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:30.647437 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f29f20ad-7f3d-46e0-89b0-7773ff1d6950 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe9fcb215054013b72a4e301144ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2a9e121b8a48ff9716afd0d824e6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:30.656395 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f29f20ad-7f3d-46e0-89b0-7773ff1d6950 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2" status: 200 len: 1282 microversion: 2.1 time: 0.223735 Jun 20 12:32:30.656996 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2973/6045] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:30 2022] GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 => generated 1282 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:30.808594 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b588d041-7d07-4198-b637-9d7379a2981d tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:30.809131 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b588d041-7d07-4198-b637-9d7379a2981d tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] [instance: 6b7aca7f-3a71-460f-84b4-f33f7f7b541c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:30.819029 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b588d041-7d07-4198-b637-9d7379a2981d tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:30.819487 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b588d041-7d07-4198-b637-9d7379a2981d tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:30.820303 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b588d041-7d07-4198-b637-9d7379a2981d tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:30.820833 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b588d041-7d07-4198-b637-9d7379a2981d tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:30.984655 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b588d041-7d07-4198-b637-9d7379a2981d tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe16a15de5114083a5b5395b225234c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42d894ee5647e6b6a26f600f47025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:30.993188 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b588d041-7d07-4198-b637-9d7379a2981d tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] 10.222.0.27 "GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c" status: 200 len: 1312 microversion: 2.1 time: 0.188562 Jun 20 12:32:31.004034 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3073/6046] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:30 2022] GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c => generated 1312 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:31.674153 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9cedf13c-8c1e-4c6f-8442-9a25969fbc59 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:31.674709 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9cedf13c-8c1e-4c6f-8442-9a25969fbc59 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] [instance: 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:31.684188 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9cedf13c-8c1e-4c6f-8442-9a25969fbc59 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:31.684900 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9cedf13c-8c1e-4c6f-8442-9a25969fbc59 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:31.685872 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9cedf13c-8c1e-4c6f-8442-9a25969fbc59 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:31.686727 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9cedf13c-8c1e-4c6f-8442-9a25969fbc59 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:31.811700 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:32:31.857172 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9cedf13c-8c1e-4c6f-8442-9a25969fbc59 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe9fcb215054013b72a4e301144ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2a9e121b8a48ff9716afd0d824e6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:31.865765 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9cedf13c-8c1e-4c6f-8442-9a25969fbc59 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2" status: 200 len: 1270 microversion: 2.1 time: 0.196133 Jun 20 12:32:31.872786 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2974/6047] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:31 2022] GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 => generated 1270 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:32.012327 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8b4f755a-2524-4b3a-93d7-390e20f3198f tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:32.013226 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8b4f755a-2524-4b3a-93d7-390e20f3198f tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] [instance: 6b7aca7f-3a71-460f-84b4-f33f7f7b541c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:32.016366 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:32:32.040528 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b4f755a-2524-4b3a-93d7-390e20f3198f tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:32.041216 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b4f755a-2524-4b3a-93d7-390e20f3198f tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:32.043233 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b4f755a-2524-4b3a-93d7-390e20f3198f tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:32.050344 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b4f755a-2524-4b3a-93d7-390e20f3198f tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:32.154125 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=8 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:32:32.233782 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8b4f755a-2524-4b3a-93d7-390e20f3198f tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe16a15de5114083a5b5395b225234c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42d894ee5647e6b6a26f600f47025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:32.242523 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8b4f755a-2524-4b3a-93d7-390e20f3198f tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] 10.222.0.27 "GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c" status: 200 len: 1312 microversion: 2.1 time: 0.234986 Jun 20 12:32:32.253195 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3074/6048] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:32 2022] GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c => generated 1312 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:32.367356 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-a4d7ff13-d755-4599-a83e-488cbb84a401 req-ab279010-a468-41c7-aee3-92ebeafb2ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b7aca7f-3a71-460f-84b4-f33f7f7b541c", "name": "network-vif-plugged", "status": "completed", "tag": "94e91429-6ea9-42ac-80f4-ef46908782ad"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:32:32.375860 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=12 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:32:32.379558 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-a4d7ff13-d755-4599-a83e-488cbb84a401 req-ab279010-a468-41c7-aee3-92ebeafb2ff2 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:32.380005 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-a4d7ff13-d755-4599-a83e-488cbb84a401 req-ab279010-a468-41c7-aee3-92ebeafb2ff2 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:32.394851 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-a4d7ff13-d755-4599-a83e-488cbb84a401 req-ab279010-a468-41c7-aee3-92ebeafb2ff2 service nova] Creating event network-vif-plugged:94e91429-6ea9-42ac-80f4-ef46908782ad for instance 6b7aca7f-3a71-460f-84b4-f33f7f7b541c on n-h1-master-1 Jun 20 12:32:32.404990 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-a4d7ff13-d755-4599-a83e-488cbb84a401 req-ab279010-a468-41c7-aee3-92ebeafb2ff2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040300 Jun 20 12:32:32.407843 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2975/6049] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:32:32.883365 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-43612789-c3c0-451d-837c-facbfd4e0c64 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:32.884144 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-43612789-c3c0-451d-837c-facbfd4e0c64 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] [instance: 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:32.892418 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-43612789-c3c0-451d-837c-facbfd4e0c64 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:32.896445 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-43612789-c3c0-451d-837c-facbfd4e0c64 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:32.897637 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-43612789-c3c0-451d-837c-facbfd4e0c64 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:32.898877 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-43612789-c3c0-451d-837c-facbfd4e0c64 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:33.106398 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-43612789-c3c0-451d-837c-facbfd4e0c64 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe9fcb215054013b72a4e301144ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2a9e121b8a48ff9716afd0d824e6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:33.115187 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-43612789-c3c0-451d-837c-facbfd4e0c64 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2" status: 200 len: 1270 microversion: 2.1 time: 0.236068 Jun 20 12:32:33.124814 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3075/6050] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:32 2022] GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 => generated 1270 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:33.262265 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f4512151-df28-4e31-8bf7-15ab928f2423 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:33.264245 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f4512151-df28-4e31-8bf7-15ab928f2423 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] [instance: 6b7aca7f-3a71-460f-84b4-f33f7f7b541c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:33.276077 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f4512151-df28-4e31-8bf7-15ab928f2423 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:33.276077 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f4512151-df28-4e31-8bf7-15ab928f2423 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:33.276077 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f4512151-df28-4e31-8bf7-15ab928f2423 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:33.276077 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f4512151-df28-4e31-8bf7-15ab928f2423 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:33.435197 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f4512151-df28-4e31-8bf7-15ab928f2423 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe16a15de5114083a5b5395b225234c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42d894ee5647e6b6a26f600f47025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:33.445695 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f4512151-df28-4e31-8bf7-15ab928f2423 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] 10.222.0.27 "GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c" status: 200 len: 1312 microversion: 2.1 time: 0.188790 Jun 20 12:32:33.456358 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2976/6051] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:33 2022] GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c => generated 1312 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:34.132247 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-88f25ae4-30c3-41c1-8b17-447e3d63fbfb tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:34.134516 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-88f25ae4-30c3-41c1-8b17-447e3d63fbfb tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] [instance: 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:34.140873 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-88f25ae4-30c3-41c1-8b17-447e3d63fbfb tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:34.141569 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-88f25ae4-30c3-41c1-8b17-447e3d63fbfb tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:34.142309 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-88f25ae4-30c3-41c1-8b17-447e3d63fbfb tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:34.142753 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-88f25ae4-30c3-41c1-8b17-447e3d63fbfb tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:34.398682 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-88f25ae4-30c3-41c1-8b17-447e3d63fbfb tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe9fcb215054013b72a4e301144ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2a9e121b8a48ff9716afd0d824e6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:34.408286 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-88f25ae4-30c3-41c1-8b17-447e3d63fbfb tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2" status: 200 len: 1270 microversion: 2.1 time: 0.280028 Jun 20 12:32:34.409070 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3076/6052] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:34 2022] GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 => generated 1270 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:34.467591 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d0765529-122b-45fd-b32a-20695398a42b tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:34.470044 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d0765529-122b-45fd-b32a-20695398a42b tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] [instance: 6b7aca7f-3a71-460f-84b4-f33f7f7b541c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:34.478912 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d0765529-122b-45fd-b32a-20695398a42b tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:34.479370 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d0765529-122b-45fd-b32a-20695398a42b tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:34.480305 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d0765529-122b-45fd-b32a-20695398a42b tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:34.480965 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d0765529-122b-45fd-b32a-20695398a42b tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:34.654268 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6e54c902-7c9b-4bb4-83eb-3f588809baf6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1ee6cee-0929-4444-81c2-fab2b7af4fbe"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:32:34.656534 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6e54c902-7c9b-4bb4-83eb-3f588809baf6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:34.665419 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6e54c902-7c9b-4bb4-83eb-3f588809baf6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:34.666299 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6e54c902-7c9b-4bb4-83eb-3f588809baf6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:34.667319 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6e54c902-7c9b-4bb4-83eb-3f588809baf6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:34.667997 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6e54c902-7c9b-4bb4-83eb-3f588809baf6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:34.760934 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d0765529-122b-45fd-b32a-20695398a42b tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe16a15de5114083a5b5395b225234c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42d894ee5647e6b6a26f600f47025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:34.777126 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d0765529-122b-45fd-b32a-20695398a42b tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] 10.222.0.27 "GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c" status: 200 len: 1499 microversion: 2.1 time: 0.316743 Jun 20 12:32:34.790202 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2977/6053] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:34 2022] GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c => generated 1499 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:34.799580 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f1293208-58ae-43ca-b47a-5aad5d326c30 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:34.803108 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f1293208-58ae-43ca-b47a-5aad5d326c30 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] [instance: 6b7aca7f-3a71-460f-84b4-f33f7f7b541c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:34.822444 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f1293208-58ae-43ca-b47a-5aad5d326c30 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:34.823464 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f1293208-58ae-43ca-b47a-5aad5d326c30 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:34.824511 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f1293208-58ae-43ca-b47a-5aad5d326c30 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:34.824856 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f1293208-58ae-43ca-b47a-5aad5d326c30 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:35.100796 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f1293208-58ae-43ca-b47a-5aad5d326c30 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe16a15de5114083a5b5395b225234c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42d894ee5647e6b6a26f600f47025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:35.116724 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f1293208-58ae-43ca-b47a-5aad5d326c30 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] 10.222.0.27 "GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c" status: 200 len: 1499 microversion: 2.1 time: 0.321042 Jun 20 12:32:35.125950 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2978/6054] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:34 2022] GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c => generated 1499 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:32:35.159681 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-25eb412d-d09e-4c7f-8634-4162a6baeccd tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:32:35.160446 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-25eb412d-d09e-4c7f-8634-4162a6baeccd tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] [instance: 6b7aca7f-3a71-460f-84b4-f33f7f7b541c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:35.176558 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-25eb412d-d09e-4c7f-8634-4162a6baeccd tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:35.177584 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-25eb412d-d09e-4c7f-8634-4162a6baeccd tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:35.179021 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-25eb412d-d09e-4c7f-8634-4162a6baeccd tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:35.179742 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-25eb412d-d09e-4c7f-8634-4162a6baeccd tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:35.195260 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6e54c902-7c9b-4bb4-83eb-3f588809baf6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "POST /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.546448 Jun 20 12:32:35.197097 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3077/6055] 10.222.0.27 () {60 vars in 1322 bytes} [Mon Jun 20 12:32:34 2022] POST /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a/os-volume_attachments => generated 194 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:32:35.236392 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-25eb412d-d09e-4c7f-8634-4162a6baeccd tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lazy-loading 'flavor' on Instance uuid 6b7aca7f-3a71-460f-84b4-f33f7f7b541c {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:32:35.401439 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-25eb412d-d09e-4c7f-8634-4162a6baeccd tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] 10.222.0.27 "POST /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c/action" status: 202 len: 0 microversion: 2.1 time: 0.261278 Jun 20 12:32:35.402617 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2979/6056] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:32:35 2022] POST /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:32:35.412957 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ed14b3e8-a9cf-4470-8a49-3cfe0f547fdf tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:35.413670 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ed14b3e8-a9cf-4470-8a49-3cfe0f547fdf tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] [instance: 6b7aca7f-3a71-460f-84b4-f33f7f7b541c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:35.415741 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:32:35.443346 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a3852f53-9764-46c8-bd8d-3d802603dd97 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:35.444348 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ed14b3e8-a9cf-4470-8a49-3cfe0f547fdf tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:35.444577 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a3852f53-9764-46c8-bd8d-3d802603dd97 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] [instance: 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:35.449522 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ed14b3e8-a9cf-4470-8a49-3cfe0f547fdf tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:35.450884 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ed14b3e8-a9cf-4470-8a49-3cfe0f547fdf tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:35.456280 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ed14b3e8-a9cf-4470-8a49-3cfe0f547fdf tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:35.463402 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3852f53-9764-46c8-bd8d-3d802603dd97 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:35.464145 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3852f53-9764-46c8-bd8d-3d802603dd97 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:35.467766 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3852f53-9764-46c8-bd8d-3d802603dd97 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:35.470833 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3852f53-9764-46c8-bd8d-3d802603dd97 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:35.744779 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ed14b3e8-a9cf-4470-8a49-3cfe0f547fdf tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe16a15de5114083a5b5395b225234c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42d894ee5647e6b6a26f600f47025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:35.758075 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ed14b3e8-a9cf-4470-8a49-3cfe0f547fdf tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] 10.222.0.27 "GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c" status: 200 len: 1507 microversion: 2.1 time: 0.350492 Jun 20 12:32:35.759493 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3078/6057] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:35 2022] GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c => generated 1507 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:35.773114 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a3852f53-9764-46c8-bd8d-3d802603dd97 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe9fcb215054013b72a4e301144ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2a9e121b8a48ff9716afd0d824e6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:35.782092 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a3852f53-9764-46c8-bd8d-3d802603dd97 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2" status: 200 len: 1270 microversion: 2.1 time: 0.356035 Jun 20 12:32:35.782700 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2980/6058] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:35 2022] GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 => generated 1270 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:36.780111 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8e351b05-18b3-4d79-beef-f12a2e64dde2 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:36.785899 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8e351b05-18b3-4d79-beef-f12a2e64dde2 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] [instance: 6b7aca7f-3a71-460f-84b4-f33f7f7b541c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:36.798603 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8e351b05-18b3-4d79-beef-f12a2e64dde2 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:36.799280 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a7706630-0e9a-408e-aa6a-11c4296bcd11 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:36.799870 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8e351b05-18b3-4d79-beef-f12a2e64dde2 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:36.800040 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a7706630-0e9a-408e-aa6a-11c4296bcd11 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] [instance: 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:36.801140 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8e351b05-18b3-4d79-beef-f12a2e64dde2 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:36.801744 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8e351b05-18b3-4d79-beef-f12a2e64dde2 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:36.811975 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a7706630-0e9a-408e-aa6a-11c4296bcd11 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:36.815934 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a7706630-0e9a-408e-aa6a-11c4296bcd11 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:36.817130 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a7706630-0e9a-408e-aa6a-11c4296bcd11 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:36.817897 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a7706630-0e9a-408e-aa6a-11c4296bcd11 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:37.034144 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8e351b05-18b3-4d79-beef-f12a2e64dde2 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe16a15de5114083a5b5395b225234c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42d894ee5647e6b6a26f600f47025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:37.043760 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8e351b05-18b3-4d79-beef-f12a2e64dde2 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] 10.222.0.27 "GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c" status: 200 len: 1490 microversion: 2.1 time: 0.270840 Jun 20 12:32:37.048090 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3079/6059] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:36 2022] GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c => generated 1490 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:37.066038 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-08dad1c8-4683-4753-9862-87d622438989 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:32:37.067086 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-08dad1c8-4683-4753-9862-87d622438989 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] [instance: 6b7aca7f-3a71-460f-84b4-f33f7f7b541c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:37.075348 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a7706630-0e9a-408e-aa6a-11c4296bcd11 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe9fcb215054013b72a4e301144ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2a9e121b8a48ff9716afd0d824e6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:37.084395 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a7706630-0e9a-408e-aa6a-11c4296bcd11 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2" status: 200 len: 1270 microversion: 2.1 time: 0.289076 Jun 20 12:32:37.095136 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2981/6060] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:36 2022] GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 => generated 1270 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:37.097718 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-08dad1c8-4683-4753-9862-87d622438989 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:37.098430 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-08dad1c8-4683-4753-9862-87d622438989 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:37.099441 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-08dad1c8-4683-4753-9862-87d622438989 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:37.100073 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-08dad1c8-4683-4753-9862-87d622438989 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:37.131370 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:32:37.246958 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-08dad1c8-4683-4753-9862-87d622438989 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] 10.222.0.27 "POST /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c/action" status: 202 len: 0 microversion: 2.1 time: 0.186725 Jun 20 12:32:37.252000 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3080/6061] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:32:37 2022] POST /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:32:37.256813 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8b2c4d0d-f1c3-4bfd-b632-1f6287306edc tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:37.257804 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8b2c4d0d-f1c3-4bfd-b632-1f6287306edc tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] [instance: 6b7aca7f-3a71-460f-84b4-f33f7f7b541c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:37.266508 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8b2c4d0d-f1c3-4bfd-b632-1f6287306edc tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:37.267628 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8b2c4d0d-f1c3-4bfd-b632-1f6287306edc tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:37.269174 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8b2c4d0d-f1c3-4bfd-b632-1f6287306edc tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:37.269816 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8b2c4d0d-f1c3-4bfd-b632-1f6287306edc tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:37.528170 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8b2c4d0d-f1c3-4bfd-b632-1f6287306edc tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe16a15de5114083a5b5395b225234c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42d894ee5647e6b6a26f600f47025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:37.533616 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:32:37.540943 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8b2c4d0d-f1c3-4bfd-b632-1f6287306edc tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] 10.222.0.27 "GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c" status: 200 len: 1496 microversion: 2.1 time: 0.288409 Jun 20 12:32:37.542298 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2982/6062] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:37 2022] GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c => generated 1496 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:32:38.103508 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dc455eec-3f39-46a1-a1b4-ef6c31551b2a tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:38.104325 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dc455eec-3f39-46a1-a1b4-ef6c31551b2a tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] [instance: 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:38.116304 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc455eec-3f39-46a1-a1b4-ef6c31551b2a tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:38.122973 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc455eec-3f39-46a1-a1b4-ef6c31551b2a tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:38.123961 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc455eec-3f39-46a1-a1b4-ef6c31551b2a tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:38.124617 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc455eec-3f39-46a1-a1b4-ef6c31551b2a tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:38.345925 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dc455eec-3f39-46a1-a1b4-ef6c31551b2a tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe9fcb215054013b72a4e301144ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2a9e121b8a48ff9716afd0d824e6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:38.354709 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dc455eec-3f39-46a1-a1b4-ef6c31551b2a tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2" status: 200 len: 1270 microversion: 2.1 time: 0.256381 Jun 20 12:32:38.355838 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3081/6063] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:38 2022] GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 => generated 1270 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:38.560947 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dad7aa4b-7a0b-48b6-9d1d-b98750ed5be1 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:38.561575 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-dad7aa4b-7a0b-48b6-9d1d-b98750ed5be1 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] [instance: 6b7aca7f-3a71-460f-84b4-f33f7f7b541c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:38.570578 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dad7aa4b-7a0b-48b6-9d1d-b98750ed5be1 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:38.571012 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dad7aa4b-7a0b-48b6-9d1d-b98750ed5be1 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:38.571824 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dad7aa4b-7a0b-48b6-9d1d-b98750ed5be1 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:38.572281 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dad7aa4b-7a0b-48b6-9d1d-b98750ed5be1 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:38.867648 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-dad7aa4b-7a0b-48b6-9d1d-b98750ed5be1 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe16a15de5114083a5b5395b225234c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42d894ee5647e6b6a26f600f47025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:38.875562 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dad7aa4b-7a0b-48b6-9d1d-b98750ed5be1 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] 10.222.0.27 "GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c" status: 200 len: 1496 microversion: 2.1 time: 0.319492 Jun 20 12:32:38.876581 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2983/6064] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:38 2022] GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c => generated 1496 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:39.394884 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6476449c-bb3f-42f7-9948-46a5a04753e8 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:39.395677 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6476449c-bb3f-42f7-9948-46a5a04753e8 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] [instance: 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:39.403268 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6476449c-bb3f-42f7-9948-46a5a04753e8 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:39.403812 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6476449c-bb3f-42f7-9948-46a5a04753e8 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:39.404718 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6476449c-bb3f-42f7-9948-46a5a04753e8 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:39.405152 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6476449c-bb3f-42f7-9948-46a5a04753e8 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:39.554509 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6476449c-bb3f-42f7-9948-46a5a04753e8 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe9fcb215054013b72a4e301144ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2a9e121b8a48ff9716afd0d824e6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:39.563193 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6476449c-bb3f-42f7-9948-46a5a04753e8 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2" status: 200 len: 1270 microversion: 2.1 time: 0.184243 Jun 20 12:32:39.563959 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3082/6065] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:39 2022] GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 => generated 1270 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:39.893929 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e95d9558-f0a8-4a65-b504-065827a3ee5b tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:39.895421 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e95d9558-f0a8-4a65-b504-065827a3ee5b tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] [instance: 6b7aca7f-3a71-460f-84b4-f33f7f7b541c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:39.902703 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e95d9558-f0a8-4a65-b504-065827a3ee5b tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:39.903487 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e95d9558-f0a8-4a65-b504-065827a3ee5b tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:39.904526 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e95d9558-f0a8-4a65-b504-065827a3ee5b tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:39.905299 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e95d9558-f0a8-4a65-b504-065827a3ee5b tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:40.062270 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e95d9558-f0a8-4a65-b504-065827a3ee5b tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe16a15de5114083a5b5395b225234c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42d894ee5647e6b6a26f600f47025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:40.073551 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e95d9558-f0a8-4a65-b504-065827a3ee5b tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] 10.222.0.27 "GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c" status: 200 len: 1499 microversion: 2.1 time: 0.184134 Jun 20 12:32:40.074779 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2984/6066] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:39 2022] GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c => generated 1499 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:40.090670 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5acf8963-b572-48a8-8500-e2882bab2c39 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:32:40.091562 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5acf8963-b572-48a8-8500-e2882bab2c39 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] [instance: 6b7aca7f-3a71-460f-84b4-f33f7f7b541c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:40.098573 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5acf8963-b572-48a8-8500-e2882bab2c39 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:40.099384 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5acf8963-b572-48a8-8500-e2882bab2c39 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:40.100462 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5acf8963-b572-48a8-8500-e2882bab2c39 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:40.101441 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5acf8963-b572-48a8-8500-e2882bab2c39 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:40.136285 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-5acf8963-b572-48a8-8500-e2882bab2c39 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lazy-loading 'flavor' on Instance uuid 6b7aca7f-3a71-460f-84b4-f33f7f7b541c {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:32:40.196870 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-0468efa7-50bb-42e8-a614-6cbc4ef01736 req-79786d35-3865-4b8e-bf8a-05d9080c3836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fe3581d-a75d-43b2-a3f0-0cb4b612aef2", "name": "network-vif-plugged", "status": "completed", "tag": "9a143d9b-6ab1-4697-b2b0-8f8011555ccb"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:32:40.210455 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-0468efa7-50bb-42e8-a614-6cbc4ef01736 req-79786d35-3865-4b8e-bf8a-05d9080c3836 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:40.216407 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-0468efa7-50bb-42e8-a614-6cbc4ef01736 req-79786d35-3865-4b8e-bf8a-05d9080c3836 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:40.231202 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-0468efa7-50bb-42e8-a614-6cbc4ef01736 req-79786d35-3865-4b8e-bf8a-05d9080c3836 service nova] Creating event network-vif-plugged:9a143d9b-6ab1-4697-b2b0-8f8011555ccb for instance 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 on n-h1-master-1 Jun 20 12:32:40.251642 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-0468efa7-50bb-42e8-a614-6cbc4ef01736 req-79786d35-3865-4b8e-bf8a-05d9080c3836 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058389 Jun 20 12:32:40.252781 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2985/6067] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:32:40.254569 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5acf8963-b572-48a8-8500-e2882bab2c39 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] 10.222.0.27 "POST /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c/action" status: 202 len: 0 microversion: 2.1 time: 0.167567 Jun 20 12:32:40.255256 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3083/6068] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:32:40 2022] POST /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:32:40.272841 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1aafbf90-ba05-4fe0-9aab-91f890f10a82 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:40.275653 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1aafbf90-ba05-4fe0-9aab-91f890f10a82 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] [instance: 6b7aca7f-3a71-460f-84b4-f33f7f7b541c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:40.293312 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1aafbf90-ba05-4fe0-9aab-91f890f10a82 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:40.294035 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1aafbf90-ba05-4fe0-9aab-91f890f10a82 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:40.295037 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1aafbf90-ba05-4fe0-9aab-91f890f10a82 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:40.300615 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1aafbf90-ba05-4fe0-9aab-91f890f10a82 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:40.530999 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1aafbf90-ba05-4fe0-9aab-91f890f10a82 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe16a15de5114083a5b5395b225234c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42d894ee5647e6b6a26f600f47025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:40.541116 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1aafbf90-ba05-4fe0-9aab-91f890f10a82 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] 10.222.0.27 "GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c" status: 200 len: 1507 microversion: 2.1 time: 0.279530 Jun 20 12:32:40.541708 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2986/6069] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:40 2022] GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c => generated 1507 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:40.582554 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4d7e840e-911a-4bdb-8b55-8d78f5203359 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:40.584091 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4d7e840e-911a-4bdb-8b55-8d78f5203359 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] [instance: 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:40.591539 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d7e840e-911a-4bdb-8b55-8d78f5203359 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:40.592371 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d7e840e-911a-4bdb-8b55-8d78f5203359 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:40.593370 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d7e840e-911a-4bdb-8b55-8d78f5203359 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:40.594130 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d7e840e-911a-4bdb-8b55-8d78f5203359 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:40.751827 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4d7e840e-911a-4bdb-8b55-8d78f5203359 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe9fcb215054013b72a4e301144ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2a9e121b8a48ff9716afd0d824e6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:40.762853 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4d7e840e-911a-4bdb-8b55-8d78f5203359 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2" status: 200 len: 1270 microversion: 2.1 time: 0.186064 Jun 20 12:32:40.764017 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3084/6070] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:40 2022] GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 => generated 1270 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:41.566785 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6a5134de-01ef-40f4-8310-28b861cef86a tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:41.567483 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6a5134de-01ef-40f4-8310-28b861cef86a tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] [instance: 6b7aca7f-3a71-460f-84b4-f33f7f7b541c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:41.574257 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a5134de-01ef-40f4-8310-28b861cef86a tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:41.574725 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a5134de-01ef-40f4-8310-28b861cef86a tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:41.575514 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a5134de-01ef-40f4-8310-28b861cef86a tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:41.575953 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a5134de-01ef-40f4-8310-28b861cef86a tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:41.762954 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6a5134de-01ef-40f4-8310-28b861cef86a tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe16a15de5114083a5b5395b225234c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42d894ee5647e6b6a26f600f47025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:41.771025 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6a5134de-01ef-40f4-8310-28b861cef86a tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] 10.222.0.27 "GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c" status: 200 len: 1490 microversion: 2.1 time: 0.216275 Jun 20 12:32:41.772419 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2987/6071] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:41 2022] GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c => generated 1490 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:41.792459 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d424659f-86b4-4123-8dc6-ad0ca5a53545 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:41.793454 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d424659f-86b4-4123-8dc6-ad0ca5a53545 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] [instance: 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:41.807737 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d424659f-86b4-4123-8dc6-ad0ca5a53545 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:41.809014 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1e34e2c5-fe2d-4666-b205-51b5ce10d9b3 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:32:41.810026 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d424659f-86b4-4123-8dc6-ad0ca5a53545 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:41.810315 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1e34e2c5-fe2d-4666-b205-51b5ce10d9b3 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] [instance: 6b7aca7f-3a71-460f-84b4-f33f7f7b541c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:41.811211 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d424659f-86b4-4123-8dc6-ad0ca5a53545 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:41.814604 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d424659f-86b4-4123-8dc6-ad0ca5a53545 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:41.820813 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e34e2c5-fe2d-4666-b205-51b5ce10d9b3 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:41.821262 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e34e2c5-fe2d-4666-b205-51b5ce10d9b3 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:41.822287 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e34e2c5-fe2d-4666-b205-51b5ce10d9b3 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:41.823140 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e34e2c5-fe2d-4666-b205-51b5ce10d9b3 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:41.945419 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1e34e2c5-fe2d-4666-b205-51b5ce10d9b3 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] 10.222.0.27 "POST /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c/action" status: 202 len: 0 microversion: 2.1 time: 0.145751 Jun 20 12:32:41.961659 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2988/6072] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:32:41 2022] POST /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:32:41.996670 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b97bd221-e96a-4c00-9029-5582696fe825 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:41.999227 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b97bd221-e96a-4c00-9029-5582696fe825 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] [instance: 6b7aca7f-3a71-460f-84b4-f33f7f7b541c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:42.034755 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b97bd221-e96a-4c00-9029-5582696fe825 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:42.035380 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b97bd221-e96a-4c00-9029-5582696fe825 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:42.036598 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b97bd221-e96a-4c00-9029-5582696fe825 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:42.037059 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b97bd221-e96a-4c00-9029-5582696fe825 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:42.116867 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d424659f-86b4-4123-8dc6-ad0ca5a53545 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe9fcb215054013b72a4e301144ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2a9e121b8a48ff9716afd0d824e6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:42.125408 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d424659f-86b4-4123-8dc6-ad0ca5a53545 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2" status: 200 len: 1458 microversion: 2.1 time: 0.338667 Jun 20 12:32:42.126819 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3085/6073] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:41 2022] GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 => generated 1458 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:32:42.143650 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f52b10f6-3084-4e3e-b6d6-7e872ebb2df8 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:42.144755 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f52b10f6-3084-4e3e-b6d6-7e872ebb2df8 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] [instance: 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:42.151678 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f52b10f6-3084-4e3e-b6d6-7e872ebb2df8 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:42.152553 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f52b10f6-3084-4e3e-b6d6-7e872ebb2df8 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:42.153577 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f52b10f6-3084-4e3e-b6d6-7e872ebb2df8 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:42.154237 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f52b10f6-3084-4e3e-b6d6-7e872ebb2df8 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:42.364698 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f52b10f6-3084-4e3e-b6d6-7e872ebb2df8 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe9fcb215054013b72a4e301144ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2a9e121b8a48ff9716afd0d824e6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:42.373697 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f52b10f6-3084-4e3e-b6d6-7e872ebb2df8 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2" status: 200 len: 1458 microversion: 2.1 time: 0.233746 Jun 20 12:32:42.374992 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3086/6074] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:42 2022] GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 => generated 1458 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:32:42.434917 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b97bd221-e96a-4c00-9029-5582696fe825 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe16a15de5114083a5b5395b225234c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42d894ee5647e6b6a26f600f47025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:42.443620 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b97bd221-e96a-4c00-9029-5582696fe825 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] 10.222.0.27 "GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c" status: 200 len: 1496 microversion: 2.1 time: 0.474858 Jun 20 12:32:42.456256 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2989/6075] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:41 2022] GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c => generated 1496 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:43.473111 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f9729efc-ffc4-48f1-a491-985531265661 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:43.473737 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f9729efc-ffc4-48f1-a491-985531265661 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] [instance: 6b7aca7f-3a71-460f-84b4-f33f7f7b541c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:43.494141 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9729efc-ffc4-48f1-a491-985531265661 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:43.494614 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9729efc-ffc4-48f1-a491-985531265661 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:43.495564 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9729efc-ffc4-48f1-a491-985531265661 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:43.496016 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9729efc-ffc4-48f1-a491-985531265661 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:43.831278 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f9729efc-ffc4-48f1-a491-985531265661 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe16a15de5114083a5b5395b225234c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42d894ee5647e6b6a26f600f47025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:43.852624 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f9729efc-ffc4-48f1-a491-985531265661 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] 10.222.0.27 "GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c" status: 200 len: 1496 microversion: 2.1 time: 0.389421 Jun 20 12:32:43.853639 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3087/6076] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:43 2022] GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c => generated 1496 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:44.875005 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1d2f9326-5018-42e4-8909-829ff1f34749 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:44.876664 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1d2f9326-5018-42e4-8909-829ff1f34749 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] [instance: 6b7aca7f-3a71-460f-84b4-f33f7f7b541c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:44.892579 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d2f9326-5018-42e4-8909-829ff1f34749 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:44.893479 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d2f9326-5018-42e4-8909-829ff1f34749 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:44.894551 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d2f9326-5018-42e4-8909-829ff1f34749 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:44.896142 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d2f9326-5018-42e4-8909-829ff1f34749 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:45.100893 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1d2f9326-5018-42e4-8909-829ff1f34749 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe16a15de5114083a5b5395b225234c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42d894ee5647e6b6a26f600f47025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:45.110840 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1d2f9326-5018-42e4-8909-829ff1f34749 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] 10.222.0.27 "GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c" status: 200 len: 1499 microversion: 2.1 time: 0.243054 Jun 20 12:32:45.122178 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2990/6077] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:44 2022] GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c => generated 1499 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:45.128279 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1919cce1-89ec-4139-aab1-c73739e2ed6e tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:45.128835 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1919cce1-89ec-4139-aab1-c73739e2ed6e tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] [instance: 6b7aca7f-3a71-460f-84b4-f33f7f7b541c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:45.141843 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1919cce1-89ec-4139-aab1-c73739e2ed6e tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:45.142972 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1919cce1-89ec-4139-aab1-c73739e2ed6e tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:45.143802 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1919cce1-89ec-4139-aab1-c73739e2ed6e tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:45.147872 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-c7619466-4196-4a5f-8f1f-cb9e61fc6c7a req-13583f78-0610-4aaf-a76c-f0021c0c3d18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fe3581d-a75d-43b2-a3f0-0cb4b612aef2", "tag": "9a143d9b-6ab1-4697-b2b0-8f8011555ccb"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:32:45.149463 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1919cce1-89ec-4139-aab1-c73739e2ed6e tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:45.169938 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-c7619466-4196-4a5f-8f1f-cb9e61fc6c7a req-13583f78-0610-4aaf-a76c-f0021c0c3d18 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:45.170566 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-c7619466-4196-4a5f-8f1f-cb9e61fc6c7a req-13583f78-0610-4aaf-a76c-f0021c0c3d18 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:45.190194 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1919cce1-89ec-4139-aab1-c73739e2ed6e tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] [instance: 6b7aca7f-3a71-460f-84b4-f33f7f7b541c] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:32:45.198194 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-c7619466-4196-4a5f-8f1f-cb9e61fc6c7a req-13583f78-0610-4aaf-a76c-f0021c0c3d18 service nova] Creating event network-changed:9a143d9b-6ab1-4697-b2b0-8f8011555ccb for instance 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 on n-h1-master-1 Jun 20 12:32:45.212368 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-c7619466-4196-4a5f-8f1f-cb9e61fc6c7a req-13583f78-0610-4aaf-a76c-f0021c0c3d18 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065434 Jun 20 12:32:45.213428 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2991/6078] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:32:45.313905 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1919cce1-89ec-4139-aab1-c73739e2ed6e tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c" status: 204 len: 0 microversion: 2.1 time: 0.189508 Jun 20 12:32:45.314782 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3088/6079] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:32:45 2022] DELETE /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:32:45.328867 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bbf98477-1ede-410c-af52-1d212bbdda31 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:45.330031 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bbf98477-1ede-410c-af52-1d212bbdda31 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] [instance: 6b7aca7f-3a71-460f-84b4-f33f7f7b541c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:45.342639 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bbf98477-1ede-410c-af52-1d212bbdda31 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:45.343402 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bbf98477-1ede-410c-af52-1d212bbdda31 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:45.344473 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bbf98477-1ede-410c-af52-1d212bbdda31 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:45.344970 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bbf98477-1ede-410c-af52-1d212bbdda31 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:45.734445 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-bbf98477-1ede-410c-af52-1d212bbdda31 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe16a15de5114083a5b5395b225234c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42d894ee5647e6b6a26f600f47025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:45.742655 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bbf98477-1ede-410c-af52-1d212bbdda31 tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] 10.222.0.27 "GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c" status: 200 len: 1505 microversion: 2.1 time: 0.422071 Jun 20 12:32:45.743264 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2992/6080] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:45 2022] GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c => generated 1505 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:46.790869 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5f4622cf-a0ae-4e30-8c35-c013f29cfd6f tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:46.791706 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5f4622cf-a0ae-4e30-8c35-c013f29cfd6f tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] [instance: 6b7aca7f-3a71-460f-84b4-f33f7f7b541c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:46.813102 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f4622cf-a0ae-4e30-8c35-c013f29cfd6f tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:46.813562 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f4622cf-a0ae-4e30-8c35-c013f29cfd6f tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:46.814900 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f4622cf-a0ae-4e30-8c35-c013f29cfd6f tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:46.815699 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f4622cf-a0ae-4e30-8c35-c013f29cfd6f tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:46.919795 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-5d86bcfb-5bf9-4b8f-aaf9-28e298bf1f85 req-39c28b88-144c-40c3-ae37-2e120c819c81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fe3581d-a75d-43b2-a3f0-0cb4b612aef2", "tag": "9a143d9b-6ab1-4697-b2b0-8f8011555ccb"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:32:46.943277 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-5d86bcfb-5bf9-4b8f-aaf9-28e298bf1f85 req-39c28b88-144c-40c3-ae37-2e120c819c81 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:46.943791 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-5d86bcfb-5bf9-4b8f-aaf9-28e298bf1f85 req-39c28b88-144c-40c3-ae37-2e120c819c81 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:46.978168 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-5d86bcfb-5bf9-4b8f-aaf9-28e298bf1f85 req-39c28b88-144c-40c3-ae37-2e120c819c81 service nova] Creating event network-changed:9a143d9b-6ab1-4697-b2b0-8f8011555ccb for instance 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 on n-h1-master-1 Jun 20 12:32:46.992307 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-5d86bcfb-5bf9-4b8f-aaf9-28e298bf1f85 req-39c28b88-144c-40c3-ae37-2e120c819c81 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075473 Jun 20 12:32:46.993640 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2993/6081] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:32:47.053155 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5f4622cf-a0ae-4e30-8c35-c013f29cfd6f tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe16a15de5114083a5b5395b225234c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42d894ee5647e6b6a26f600f47025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:47.070840 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5f4622cf-a0ae-4e30-8c35-c013f29cfd6f tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] 10.222.0.27 "GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c" status: 200 len: 1505 microversion: 2.1 time: 0.304659 Jun 20 12:32:47.071799 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3089/6082] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:46 2022] GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c => generated 1505 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:48.093192 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-87b437cf-f9d4-4239-b375-41f4301cc4ee tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:48.095607 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-87b437cf-f9d4-4239-b375-41f4301cc4ee tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] [instance: 6b7aca7f-3a71-460f-84b4-f33f7f7b541c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:48.103129 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=4 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:32:48.106082 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-87b437cf-f9d4-4239-b375-41f4301cc4ee tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:48.107147 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-87b437cf-f9d4-4239-b375-41f4301cc4ee tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:48.107951 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-87b437cf-f9d4-4239-b375-41f4301cc4ee tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:48.109220 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-87b437cf-f9d4-4239-b375-41f4301cc4ee tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:48.269551 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-87b437cf-f9d4-4239-b375-41f4301cc4ee tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe16a15de5114083a5b5395b225234c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe42d894ee5647e6b6a26f600f47025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:48.281312 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-87b437cf-f9d4-4239-b375-41f4301cc4ee tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] 10.222.0.27 "GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c" status: 200 len: 1463 microversion: 2.1 time: 0.192509 Jun 20 12:32:48.281583 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2994/6083] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:48 2022] GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c => generated 1463 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:32:49.148475 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-3fd698da-17c7-4437-a5c7-d9d77e61615d req-db977b6e-855f-4b05-9f7e-be9e70aa792b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fe3581d-a75d-43b2-a3f0-0cb4b612aef2", "tag": "9a143d9b-6ab1-4697-b2b0-8f8011555ccb"}, {"server_uuid": "6b7aca7f-3a71-460f-84b4-f33f7f7b541c", "name": "network-vif-deleted", "tag": "94e91429-6ea9-42ac-80f4-ef46908782ad"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:32:49.158616 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-3fd698da-17c7-4437-a5c7-d9d77e61615d req-db977b6e-855f-4b05-9f7e-be9e70aa792b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:49.159148 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-3fd698da-17c7-4437-a5c7-d9d77e61615d req-db977b6e-855f-4b05-9f7e-be9e70aa792b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:49.173406 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-3fd698da-17c7-4437-a5c7-d9d77e61615d req-db977b6e-855f-4b05-9f7e-be9e70aa792b service nova] Creating event network-changed:9a143d9b-6ab1-4697-b2b0-8f8011555ccb for instance 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 on n-h1-master-1 Jun 20 12:32:49.174640 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-3fd698da-17c7-4437-a5c7-d9d77e61615d req-db977b6e-855f-4b05-9f7e-be9e70aa792b service nova] Creating event network-vif-deleted:94e91429-6ea9-42ac-80f4-ef46908782ad for instance 6b7aca7f-3a71-460f-84b4-f33f7f7b541c on n-h1-master-1 Jun 20 12:32:49.181764 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-3fd698da-17c7-4437-a5c7-d9d77e61615d req-db977b6e-855f-4b05-9f7e-be9e70aa792b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.155006 Jun 20 12:32:49.188175 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3090/6084] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:32:49.302544 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2996582c-66b2-45c3-a3e8-facc812e44ec tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:49.304612 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2996582c-66b2-45c3-a3e8-facc812e44ec tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] [instance: 6b7aca7f-3a71-460f-84b4-f33f7f7b541c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:49.323930 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2996582c-66b2-45c3-a3e8-facc812e44ec tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:49.325024 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2996582c-66b2-45c3-a3e8-facc812e44ec tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:49.327369 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2996582c-66b2-45c3-a3e8-facc812e44ec tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:49.328946 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2996582c-66b2-45c3-a3e8-facc812e44ec tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:49.365029 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-2996582c-66b2-45c3-a3e8-facc812e44ec tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] HTTP exception thrown: Instance 6b7aca7f-3a71-460f-84b4-f33f7f7b541c could not be found. Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2996582c-66b2-45c3-a3e8-facc812e44ec tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Request method failure captured: Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c HTTP/1.1 Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGjSBDjN2ntVfMVqhh6IAdC4RSDtrgDW7zgj3OopeKhBh1DNlmL_roEvya7xmIINktnBhrn8-Ai5GVEgvGyBnqF28S2VSDqOn5A5wCgYTEKSNtd-pG9xwnUp80afwfN1XVdICwBQEaCleBj_02NuuuSOgqJ1hgwLxkMzTApBSTRVp6I Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: fe42d894ee5647e6b6a26f600f47025a Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-TestServerAdvancedOps-720123128 Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fe42d894ee5647e6b6a26f600f47025a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fe42d894ee5647e6b6a26f600f47025a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fe42d894ee5647e6b6a26f600f47025a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fe42d894ee5647e6b6a26f600f47025a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-TestServerAdvancedOps-720123128 Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: fe42d894ee5647e6b6a26f600f47025a Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-TestServerAdvancedOps-720123128 Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-TestServerAdvancedOps-720123128-project Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: fe16a15de5114083a5b5395b225234c3 Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-TestServerAdvancedOps-720123128-project Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 6b7aca7f-3a71-460f-84b4-f33f7f7b541c could not be found. Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '6b7aca7f-3a71-460f-84b4-f33f7f7b541c'} Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b7aca7f-3a71-460f-84b4-f33f7f7b541c could not be found. Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b7aca7f-3a71-460f-84b4-f33f7f7b541c could not be found. Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:32:49.366763 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:32:49.372169 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:32:49.372169 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:32:49.372169 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:32:49.372169 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:32:49.372169 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:32:49.372169 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b7aca7f-3a71-460f-84b4-f33f7f7b541c could not be found. Jun 20 12:32:49.372169 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:32:49.372169 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2996582c-66b2-45c3-a3e8-facc812e44ec tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] Returning 404 to user: Instance 6b7aca7f-3a71-460f-84b4-f33f7f7b541c could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:32:49.372169 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2996582c-66b2-45c3-a3e8-facc812e44ec tempest-TestServerAdvancedOps-720123128 tempest-TestServerAdvancedOps-720123128-project] 10.222.0.27 "GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c" status: 404 len: 111 microversion: 2.1 time: 0.070214 Jun 20 12:32:49.372169 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2995/6085] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:49 2022] GET /compute/v2.1/servers/6b7aca7f-3a71-460f-84b4-f33f7f7b541c => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:32:50.667390 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0eb602f4-78e0-4432-922b-d724a103415a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:32:50.669640 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0eb602f4-78e0-4432-922b-d724a103415a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:50.677729 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0eb602f4-78e0-4432-922b-d724a103415a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:50.678501 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0eb602f4-78e0-4432-922b-d724a103415a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:50.679490 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0eb602f4-78e0-4432-922b-d724a103415a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:50.680162 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0eb602f4-78e0-4432-922b-d724a103415a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:50.708436 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-0eb602f4-78e0-4432-922b-d724a103415a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lazy-loading 'flavor' on Instance uuid 4c987561-0d7f-495d-9422-99a32b18357a {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:32:50.865355 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:32:50.913241 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0eb602f4-78e0-4432-922b-d724a103415a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "POST /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a/action" status: 200 len: 32 microversion: 2.1 time: 0.254245 Jun 20 12:32:50.919643 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3091/6086] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:32:50 2022] POST /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a/action => generated 32 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:32:50.924129 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a37d865c-8f90-4d7f-835d-c8b243266bba tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:50.926213 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a37d865c-8f90-4d7f-835d-c8b243266bba tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:50.939053 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a37d865c-8f90-4d7f-835d-c8b243266bba tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:50.940326 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a37d865c-8f90-4d7f-835d-c8b243266bba tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:50.941425 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a37d865c-8f90-4d7f-835d-c8b243266bba tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:50.942137 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a37d865c-8f90-4d7f-835d-c8b243266bba tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:51.365403 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a37d865c-8f90-4d7f-835d-c8b243266bba tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:51.375606 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a37d865c-8f90-4d7f-835d-c8b243266bba tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 200 len: 1733 microversion: 2.1 time: 0.455579 Jun 20 12:32:51.377295 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2996/6087] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:50 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 1733 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:32:52.409706 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-08d1afdc-d3bf-4aaf-9ca2-d53f20c3f1e4 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:52.410743 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-08d1afdc-d3bf-4aaf-9ca2-d53f20c3f1e4 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:52.437527 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-08d1afdc-d3bf-4aaf-9ca2-d53f20c3f1e4 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:52.437527 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-08d1afdc-d3bf-4aaf-9ca2-d53f20c3f1e4 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:52.442312 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-08d1afdc-d3bf-4aaf-9ca2-d53f20c3f1e4 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:52.443714 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-08d1afdc-d3bf-4aaf-9ca2-d53f20c3f1e4 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:52.756777 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-08d1afdc-d3bf-4aaf-9ca2-d53f20c3f1e4 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:52.766797 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-08d1afdc-d3bf-4aaf-9ca2-d53f20c3f1e4 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 200 len: 1733 microversion: 2.1 time: 0.376327 Jun 20 12:32:52.785283 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3092/6088] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:52 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 1733 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:53.787708 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-122f59db-75f6-4ee5-a339-d18eb6de0939 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:53.788770 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-122f59db-75f6-4ee5-a339-d18eb6de0939 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:53.796988 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-122f59db-75f6-4ee5-a339-d18eb6de0939 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:53.797730 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-122f59db-75f6-4ee5-a339-d18eb6de0939 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:53.798720 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-122f59db-75f6-4ee5-a339-d18eb6de0939 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:53.799453 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-122f59db-75f6-4ee5-a339-d18eb6de0939 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:53.977762 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-122f59db-75f6-4ee5-a339-d18eb6de0939 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:53.988943 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-122f59db-75f6-4ee5-a339-d18eb6de0939 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 200 len: 1733 microversion: 2.1 time: 0.205917 Jun 20 12:32:53.989807 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2997/6089] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:53 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 1733 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:32:55.007893 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c9ac972f-d246-43a6-8899-101cd8e6fd2d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:55.009643 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c9ac972f-d246-43a6-8899-101cd8e6fd2d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:55.019117 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c9ac972f-d246-43a6-8899-101cd8e6fd2d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:55.020348 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c9ac972f-d246-43a6-8899-101cd8e6fd2d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:55.021041 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c9ac972f-d246-43a6-8899-101cd8e6fd2d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:55.021487 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c9ac972f-d246-43a6-8899-101cd8e6fd2d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:55.176756 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c9ac972f-d246-43a6-8899-101cd8e6fd2d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:55.185110 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c9ac972f-d246-43a6-8899-101cd8e6fd2d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 200 len: 1733 microversion: 2.1 time: 0.181780 Jun 20 12:32:55.187035 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3093/6090] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:55 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 1733 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:56.203684 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2e555042-ddf3-4156-95fe-ef26a0379b74 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:56.204476 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2e555042-ddf3-4156-95fe-ef26a0379b74 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:56.213783 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2e555042-ddf3-4156-95fe-ef26a0379b74 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:56.214687 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2e555042-ddf3-4156-95fe-ef26a0379b74 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:56.215438 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2e555042-ddf3-4156-95fe-ef26a0379b74 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:56.215883 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2e555042-ddf3-4156-95fe-ef26a0379b74 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:56.416053 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2e555042-ddf3-4156-95fe-ef26a0379b74 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:56.434322 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2e555042-ddf3-4156-95fe-ef26a0379b74 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 200 len: 1733 microversion: 2.1 time: 0.234591 Jun 20 12:32:56.436230 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2998/6091] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:56 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 1733 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:57.450877 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9681d3b1-e433-4948-a27f-b21872be4af4 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:57.451494 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9681d3b1-e433-4948-a27f-b21872be4af4 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:57.458758 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9681d3b1-e433-4948-a27f-b21872be4af4 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:57.459211 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9681d3b1-e433-4948-a27f-b21872be4af4 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:57.459986 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9681d3b1-e433-4948-a27f-b21872be4af4 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:57.460454 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9681d3b1-e433-4948-a27f-b21872be4af4 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:57.615128 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9681d3b1-e433-4948-a27f-b21872be4af4 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:57.634834 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9681d3b1-e433-4948-a27f-b21872be4af4 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 200 len: 1733 microversion: 2.1 time: 0.187342 Jun 20 12:32:57.637416 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3094/6092] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:57 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 1733 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:58.657149 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-96067c89-8ef5-4856-8e24-2d60340653f0 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:58.662202 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-96067c89-8ef5-4856-8e24-2d60340653f0 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:58.682334 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-96067c89-8ef5-4856-8e24-2d60340653f0 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:58.682859 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-96067c89-8ef5-4856-8e24-2d60340653f0 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:58.683725 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-96067c89-8ef5-4856-8e24-2d60340653f0 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:58.684166 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-96067c89-8ef5-4856-8e24-2d60340653f0 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:58.860795 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-96067c89-8ef5-4856-8e24-2d60340653f0 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:58.869824 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-96067c89-8ef5-4856-8e24-2d60340653f0 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 200 len: 1733 microversion: 2.1 time: 0.219067 Jun 20 12:32:58.871063 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2999/6093] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:58 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 1733 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:59.887290 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-366be136-b41c-49d7-b0a2-0e0c0e346b9b tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:59.887911 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-366be136-b41c-49d7-b0a2-0e0c0e346b9b tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:59.908118 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-366be136-b41c-49d7-b0a2-0e0c0e346b9b tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:59.908642 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-366be136-b41c-49d7-b0a2-0e0c0e346b9b tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:59.910127 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-366be136-b41c-49d7-b0a2-0e0c0e346b9b tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:59.910578 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-366be136-b41c-49d7-b0a2-0e0c0e346b9b tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:00.115678 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-366be136-b41c-49d7-b0a2-0e0c0e346b9b tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:00.126960 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-366be136-b41c-49d7-b0a2-0e0c0e346b9b tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 200 len: 1733 microversion: 2.1 time: 0.243400 Jun 20 12:33:00.127783 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3095/6094] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:59 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 1733 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:33:01.151632 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-29f234db-2307-4d6f-92be-01703fc80b93 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:01.153171 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-29f234db-2307-4d6f-92be-01703fc80b93 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:01.162545 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-29f234db-2307-4d6f-92be-01703fc80b93 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:01.163921 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-29f234db-2307-4d6f-92be-01703fc80b93 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:01.165130 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-29f234db-2307-4d6f-92be-01703fc80b93 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:01.165709 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-29f234db-2307-4d6f-92be-01703fc80b93 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:01.345480 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-29f234db-2307-4d6f-92be-01703fc80b93 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:01.355938 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-29f234db-2307-4d6f-92be-01703fc80b93 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 200 len: 1733 microversion: 2.1 time: 0.213666 Jun 20 12:33:01.356875 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3000/6095] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:33:01 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 1733 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:33:02.379680 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7cb828b8-b1ef-4505-9ccf-18d6f858b9af tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:02.381318 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7cb828b8-b1ef-4505-9ccf-18d6f858b9af tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:02.390314 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7cb828b8-b1ef-4505-9ccf-18d6f858b9af tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:02.391200 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7cb828b8-b1ef-4505-9ccf-18d6f858b9af tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:02.392191 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7cb828b8-b1ef-4505-9ccf-18d6f858b9af tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:02.392818 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7cb828b8-b1ef-4505-9ccf-18d6f858b9af tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:02.607062 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7cb828b8-b1ef-4505-9ccf-18d6f858b9af tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:02.616238 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7cb828b8-b1ef-4505-9ccf-18d6f858b9af tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 200 len: 1733 microversion: 2.1 time: 0.241930 Jun 20 12:33:02.617053 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3096/6096] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:33:02 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 1733 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:33:03.633749 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f4000ba7-b5c0-4039-802b-c18930d62e95 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:03.636106 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f4000ba7-b5c0-4039-802b-c18930d62e95 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:03.645389 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f4000ba7-b5c0-4039-802b-c18930d62e95 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:03.645994 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f4000ba7-b5c0-4039-802b-c18930d62e95 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:03.646838 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f4000ba7-b5c0-4039-802b-c18930d62e95 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:03.647327 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f4000ba7-b5c0-4039-802b-c18930d62e95 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:03.652590 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:33:03.803224 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f4000ba7-b5c0-4039-802b-c18930d62e95 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:03.812162 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f4000ba7-b5c0-4039-802b-c18930d62e95 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 200 len: 1733 microversion: 2.1 time: 0.182706 Jun 20 12:33:03.812874 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3001/6097] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:33:03 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 1733 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:33:04.832126 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f437f85c-523d-4a03-a987-083c812c03ee tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:04.832750 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f437f85c-523d-4a03-a987-083c812c03ee tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:04.841466 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f437f85c-523d-4a03-a987-083c812c03ee tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:04.842911 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f437f85c-523d-4a03-a987-083c812c03ee tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:04.844939 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f437f85c-523d-4a03-a987-083c812c03ee tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:04.845549 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f437f85c-523d-4a03-a987-083c812c03ee tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:04.988557 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f437f85c-523d-4a03-a987-083c812c03ee tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:04.997985 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f437f85c-523d-4a03-a987-083c812c03ee tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 200 len: 1733 microversion: 2.1 time: 0.170855 Jun 20 12:33:04.998748 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3097/6098] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:33:04 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 1733 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:33:06.018600 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-368d2c3d-bc1c-4c09-93d1-8b093fe48a0d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:06.019658 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-368d2c3d-bc1c-4c09-93d1-8b093fe48a0d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:06.027695 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-368d2c3d-bc1c-4c09-93d1-8b093fe48a0d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:06.028267 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-368d2c3d-bc1c-4c09-93d1-8b093fe48a0d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:06.029528 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-368d2c3d-bc1c-4c09-93d1-8b093fe48a0d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:06.030069 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-368d2c3d-bc1c-4c09-93d1-8b093fe48a0d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:06.207593 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-368d2c3d-bc1c-4c09-93d1-8b093fe48a0d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:06.216545 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-368d2c3d-bc1c-4c09-93d1-8b093fe48a0d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 200 len: 1733 microversion: 2.1 time: 0.204554 Jun 20 12:33:06.217414 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3002/6099] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:33:06 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 1733 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:33:07.242590 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-90420bc3-977b-4a98-ae84-657b144c80b6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:07.256564 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-90420bc3-977b-4a98-ae84-657b144c80b6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:07.256564 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:33:07.257897 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-90420bc3-977b-4a98-ae84-657b144c80b6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:07.258645 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-90420bc3-977b-4a98-ae84-657b144c80b6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:07.259443 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-90420bc3-977b-4a98-ae84-657b144c80b6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:07.260018 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-90420bc3-977b-4a98-ae84-657b144c80b6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:07.440424 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-90420bc3-977b-4a98-ae84-657b144c80b6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:07.451509 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-90420bc3-977b-4a98-ae84-657b144c80b6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 200 len: 1733 microversion: 2.1 time: 0.219589 Jun 20 12:33:07.452192 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3098/6100] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:33:07 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 1733 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:33:08.470217 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-40776d33-153c-48ec-9f92-293d5e985801 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:08.470852 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-40776d33-153c-48ec-9f92-293d5e985801 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:08.478507 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-40776d33-153c-48ec-9f92-293d5e985801 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:08.478976 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-40776d33-153c-48ec-9f92-293d5e985801 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:08.479761 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-40776d33-153c-48ec-9f92-293d5e985801 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:08.480231 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-40776d33-153c-48ec-9f92-293d5e985801 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:08.622473 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-40776d33-153c-48ec-9f92-293d5e985801 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:08.631788 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-40776d33-153c-48ec-9f92-293d5e985801 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 200 len: 1733 microversion: 2.1 time: 0.166287 Jun 20 12:33:08.636291 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3003/6101] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:33:08 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 1733 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:33:09.653429 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fb57c051-adcc-410e-87b0-4c013a1d2683 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:09.654199 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fb57c051-adcc-410e-87b0-4c013a1d2683 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:09.668460 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fb57c051-adcc-410e-87b0-4c013a1d2683 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:09.668945 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fb57c051-adcc-410e-87b0-4c013a1d2683 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:09.669923 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fb57c051-adcc-410e-87b0-4c013a1d2683 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:09.670385 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fb57c051-adcc-410e-87b0-4c013a1d2683 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:09.863986 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fb57c051-adcc-410e-87b0-4c013a1d2683 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:09.874594 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fb57c051-adcc-410e-87b0-4c013a1d2683 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 200 len: 1733 microversion: 2.1 time: 0.227212 Jun 20 12:33:09.875610 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3099/6102] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:33:09 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 1733 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:33:10.897486 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4b6013e9-10d8-4a3b-a189-df59591c84bb tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:10.899056 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4b6013e9-10d8-4a3b-a189-df59591c84bb tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:10.907587 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4b6013e9-10d8-4a3b-a189-df59591c84bb tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:10.908450 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4b6013e9-10d8-4a3b-a189-df59591c84bb tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:10.909504 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4b6013e9-10d8-4a3b-a189-df59591c84bb tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:10.909981 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4b6013e9-10d8-4a3b-a189-df59591c84bb tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:11.127035 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4b6013e9-10d8-4a3b-a189-df59591c84bb tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:11.137827 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4b6013e9-10d8-4a3b-a189-df59591c84bb tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 200 len: 1733 microversion: 2.1 time: 0.245105 Jun 20 12:33:11.139216 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3004/6103] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:33:10 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 1733 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:33:12.162300 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bcce55d2-29ca-445d-b937-ada6a4bca534 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:12.162955 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bcce55d2-29ca-445d-b937-ada6a4bca534 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:12.175951 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bcce55d2-29ca-445d-b937-ada6a4bca534 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:12.176531 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bcce55d2-29ca-445d-b937-ada6a4bca534 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:12.177388 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bcce55d2-29ca-445d-b937-ada6a4bca534 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:12.177969 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bcce55d2-29ca-445d-b937-ada6a4bca534 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:12.367299 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bcce55d2-29ca-445d-b937-ada6a4bca534 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:12.382129 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bcce55d2-29ca-445d-b937-ada6a4bca534 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 200 len: 1713 microversion: 2.1 time: 0.224291 Jun 20 12:33:12.383171 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3100/6104] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:33:12 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 1713 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:33:12.572607 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-572d6d7c-9be0-4e87-a728-8bf2cd10d12a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:12.574356 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-572d6d7c-9be0-4e87-a728-8bf2cd10d12a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:12.583112 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-572d6d7c-9be0-4e87-a728-8bf2cd10d12a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:12.583929 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-572d6d7c-9be0-4e87-a728-8bf2cd10d12a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:12.584999 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-572d6d7c-9be0-4e87-a728-8bf2cd10d12a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:12.585683 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-572d6d7c-9be0-4e87-a728-8bf2cd10d12a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:12.718236 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-572d6d7c-9be0-4e87-a728-8bf2cd10d12a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] HTTP exception thrown: Cannot 'detach_volume' instance 4c987561-0d7f-495d-9422-99a32b18357a while it is in vm_state rescued Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-572d6d7c-9be0-4e87-a728-8bf2cd10d12a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Request method failure captured: Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a/os-volume_attachments/d1ee6cee-0929-4444-81c2-fab2b7af4fbe HTTP/1.1 Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGgSaQU2kYq6294w6QFKPq7A5QMR619m5qrTtjZvOh1Spd4jYt9SdDjLdFiaQeOKoAcYDnhjBb8DNFT4026Xi2z1eTCKzFIZr5YrYMMfaIT2h-JIX2uEPuAOwR8Q0Bfw8WTyUwuKuBg3lk8BU4yAsLY8apXUbOU50Mn1Bj2k7YSVmEI Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: eed49c99a6a64e779184cfde80a29a52 Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2064933160 Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eed49c99a6a64e779184cfde80a29a52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eed49c99a6a64e779184cfde80a29a52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eed49c99a6a64e779184cfde80a29a52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eed49c99a6a64e779184cfde80a29a52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2064933160 Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: eed49c99a6a64e779184cfde80a29a52 Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2064933160 Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServerRescueNegativeTestJSON-2064933160-project Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 8efa417e5eb04ea682201f30b003bd54 Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2064933160-project Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: exception: Cannot 'detach_volume' instance 4c987561-0d7f-495d-9422-99a32b18357a while it is in vm_state rescued Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: action_args: {'server_id': '4c987561-0d7f-495d-9422-99a32b18357a', 'id': 'd1ee6cee-0929-4444-81c2-fab2b7af4fbe'} Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4c987561-0d7f-495d-9422-99a32b18357a in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4c987561-0d7f-495d-9422-99a32b18357a while it is in vm_state rescued Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:33:12.726285 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:33:12.732939 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:33:12.732939 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:33:12.732939 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:33:12.732939 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:33:12.732939 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4c987561-0d7f-495d-9422-99a32b18357a while it is in vm_state rescued Jun 20 12:33:12.732939 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:33:12.734352 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-572d6d7c-9be0-4e87-a728-8bf2cd10d12a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Returning 409 to user: Cannot 'detach_volume' instance 4c987561-0d7f-495d-9422-99a32b18357a while it is in vm_state rescued {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:33:12.735248 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-572d6d7c-9be0-4e87-a728-8bf2cd10d12a tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a/os-volume_attachments/d1ee6cee-0929-4444-81c2-fab2b7af4fbe" status: 409 len: 152 microversion: 2.1 time: 0.169327 Jun 20 12:33:12.737241 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3005/6105] 10.222.0.27 () {58 vars in 1415 bytes} [Mon Jun 20 12:33:12 2022] DELETE /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a/os-volume_attachments/d1ee6cee-0929-4444-81c2-fab2b7af4fbe => generated 152 bytes in 171 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:33:12.751931 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-82e7c373-78b6-48b9-a82f-35c813076254 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:33:12.753378 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-82e7c373-78b6-48b9-a82f-35c813076254 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:12.763363 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-82e7c373-78b6-48b9-a82f-35c813076254 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:12.764557 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-82e7c373-78b6-48b9-a82f-35c813076254 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:12.765834 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-82e7c373-78b6-48b9-a82f-35c813076254 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:12.766823 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-82e7c373-78b6-48b9-a82f-35c813076254 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:12.884785 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-82e7c373-78b6-48b9-a82f-35c813076254 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "POST /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a/action" status: 202 len: 0 microversion: 2.1 time: 0.139099 Jun 20 12:33:12.888336 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3101/6106] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:33:12 2022] POST /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:33:12.903720 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5abc2a1d-5b8e-481e-8a0e-4e18e6f09085 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:12.904648 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5abc2a1d-5b8e-481e-8a0e-4e18e6f09085 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:12.919858 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5abc2a1d-5b8e-481e-8a0e-4e18e6f09085 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:12.922398 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5abc2a1d-5b8e-481e-8a0e-4e18e6f09085 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:12.923417 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5abc2a1d-5b8e-481e-8a0e-4e18e6f09085 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:12.924024 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5abc2a1d-5b8e-481e-8a0e-4e18e6f09085 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:13.162734 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5abc2a1d-5b8e-481e-8a0e-4e18e6f09085 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:13.172995 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5abc2a1d-5b8e-481e-8a0e-4e18e6f09085 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 200 len: 1721 microversion: 2.1 time: 0.281430 Jun 20 12:33:13.176742 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3006/6107] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:33:12 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 1721 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:33:14.198739 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cf7d9e0f-6d5b-4d77-ac01-210d319a74dc tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:14.200714 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cf7d9e0f-6d5b-4d77-ac01-210d319a74dc tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:14.213850 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cf7d9e0f-6d5b-4d77-ac01-210d319a74dc tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:14.232488 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cf7d9e0f-6d5b-4d77-ac01-210d319a74dc tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:14.234048 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cf7d9e0f-6d5b-4d77-ac01-210d319a74dc tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:14.234683 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cf7d9e0f-6d5b-4d77-ac01-210d319a74dc tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:14.458169 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cf7d9e0f-6d5b-4d77-ac01-210d319a74dc tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:14.471390 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cf7d9e0f-6d5b-4d77-ac01-210d319a74dc tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 200 len: 1721 microversion: 2.1 time: 0.279449 Jun 20 12:33:14.472024 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3102/6108] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:33:14 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 1721 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:33:15.511016 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f49fa17e-d937-41f4-97d8-9cdbca95f15c tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:15.512742 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f49fa17e-d937-41f4-97d8-9cdbca95f15c tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:15.522950 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f49fa17e-d937-41f4-97d8-9cdbca95f15c tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:15.523965 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f49fa17e-d937-41f4-97d8-9cdbca95f15c tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:15.525623 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f49fa17e-d937-41f4-97d8-9cdbca95f15c tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:15.526287 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f49fa17e-d937-41f4-97d8-9cdbca95f15c tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:15.739824 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f49fa17e-d937-41f4-97d8-9cdbca95f15c tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:15.748275 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f49fa17e-d937-41f4-97d8-9cdbca95f15c tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 200 len: 1721 microversion: 2.1 time: 0.251788 Jun 20 12:33:15.748953 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3007/6109] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:33:15 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 1721 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:33:16.766865 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e305187f-9be4-45a3-af9d-c4edddfda4b8 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:16.768019 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e305187f-9be4-45a3-af9d-c4edddfda4b8 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:16.776281 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e305187f-9be4-45a3-af9d-c4edddfda4b8 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:16.776734 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e305187f-9be4-45a3-af9d-c4edddfda4b8 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:16.777499 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e305187f-9be4-45a3-af9d-c4edddfda4b8 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:16.778123 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e305187f-9be4-45a3-af9d-c4edddfda4b8 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:16.946262 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e305187f-9be4-45a3-af9d-c4edddfda4b8 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:16.956955 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e305187f-9be4-45a3-af9d-c4edddfda4b8 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 200 len: 1727 microversion: 2.1 time: 0.194343 Jun 20 12:33:16.957875 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3103/6110] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:33:16 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 1727 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:33:16.975417 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dd7d82bc-7917-4f4e-912b-7a2e484a8ad5 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:16.976164 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-dd7d82bc-7917-4f4e-912b-7a2e484a8ad5 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:16.985786 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dd7d82bc-7917-4f4e-912b-7a2e484a8ad5 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:16.986243 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dd7d82bc-7917-4f4e-912b-7a2e484a8ad5 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:16.987037 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dd7d82bc-7917-4f4e-912b-7a2e484a8ad5 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:16.987478 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dd7d82bc-7917-4f4e-912b-7a2e484a8ad5 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:17.083745 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dd7d82bc-7917-4f4e-912b-7a2e484a8ad5 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.112250 Jun 20 12:33:17.084556 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3008/6111] 10.222.0.27 () {58 vars in 1274 bytes} [Mon Jun 20 12:33:16 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:33:18.481122 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-6cb2f01d-228d-43f0-8fc5-3faffcdd86a3 req-4cd96d41-ee3d-403a-9d99-f8160ae47abc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c987561-0d7f-495d-9422-99a32b18357a", "tag": "0ba6654d-5537-45cc-b2ee-add339c1b1a6"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:33:18.492391 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-6cb2f01d-228d-43f0-8fc5-3faffcdd86a3 req-4cd96d41-ee3d-403a-9d99-f8160ae47abc service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:18.493175 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-6cb2f01d-228d-43f0-8fc5-3faffcdd86a3 req-4cd96d41-ee3d-403a-9d99-f8160ae47abc service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:18.508545 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-6cb2f01d-228d-43f0-8fc5-3faffcdd86a3 req-4cd96d41-ee3d-403a-9d99-f8160ae47abc service nova] Creating event network-changed:0ba6654d-5537-45cc-b2ee-add339c1b1a6 for instance 4c987561-0d7f-495d-9422-99a32b18357a on n-h2-master-1 Jun 20 12:33:18.515455 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-6cb2f01d-228d-43f0-8fc5-3faffcdd86a3 req-4cd96d41-ee3d-403a-9d99-f8160ae47abc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039652 Jun 20 12:33:18.516307 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3104/6112] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:33:20.537036 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-471070a5-59db-4c71-8e06-6818679fd384 req-2e1b90d2-172f-4d27-90ab-b7b4ad98e008 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c987561-0d7f-495d-9422-99a32b18357a", "tag": "0ba6654d-5537-45cc-b2ee-add339c1b1a6"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:33:20.566980 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=30 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:33:20.569401 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-471070a5-59db-4c71-8e06-6818679fd384 req-2e1b90d2-172f-4d27-90ab-b7b4ad98e008 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:20.570013 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-471070a5-59db-4c71-8e06-6818679fd384 req-2e1b90d2-172f-4d27-90ab-b7b4ad98e008 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:20.592795 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-471070a5-59db-4c71-8e06-6818679fd384 req-2e1b90d2-172f-4d27-90ab-b7b4ad98e008 service nova] Creating event network-changed:0ba6654d-5537-45cc-b2ee-add339c1b1a6 for instance 4c987561-0d7f-495d-9422-99a32b18357a on n-h2-master-1 Jun 20 12:33:20.599153 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-471070a5-59db-4c71-8e06-6818679fd384 req-2e1b90d2-172f-4d27-90ab-b7b4ad98e008 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070134 Jun 20 12:33:20.600076 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3009/6113] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:33:21.207084 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bedac629-b3b6-44ec-b17d-a25d9a467667 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:21.209126 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bedac629-b3b6-44ec-b17d-a25d9a467667 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] [instance: 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:21.217946 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bedac629-b3b6-44ec-b17d-a25d9a467667 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:21.218893 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bedac629-b3b6-44ec-b17d-a25d9a467667 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:21.219889 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bedac629-b3b6-44ec-b17d-a25d9a467667 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:21.220534 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bedac629-b3b6-44ec-b17d-a25d9a467667 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:21.256147 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bedac629-b3b6-44ec-b17d-a25d9a467667 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] [instance: 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:33:21.382025 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bedac629-b3b6-44ec-b17d-a25d9a467667 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2" status: 204 len: 0 microversion: 2.1 time: 0.175826 Jun 20 12:33:21.384756 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3105/6114] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:33:21 2022] DELETE /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 12:33:21.400858 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-88be397d-d36c-4d24-92d2-bb93813dfda5 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:21.402791 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-88be397d-d36c-4d24-92d2-bb93813dfda5 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] [instance: 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:21.413903 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88be397d-d36c-4d24-92d2-bb93813dfda5 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:21.414829 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88be397d-d36c-4d24-92d2-bb93813dfda5 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:21.415921 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88be397d-d36c-4d24-92d2-bb93813dfda5 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:21.416685 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88be397d-d36c-4d24-92d2-bb93813dfda5 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:21.696857 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-88be397d-d36c-4d24-92d2-bb93813dfda5 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe9fcb215054013b72a4e301144ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2a9e121b8a48ff9716afd0d824e6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:21.714367 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-88be397d-d36c-4d24-92d2-bb93813dfda5 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2" status: 200 len: 1583 microversion: 2.1 time: 0.319890 Jun 20 12:33:21.725482 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3010/6115] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:33:21 2022] GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 => generated 1583 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:33:22.623550 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-3f8129fc-8f45-457b-a217-0feb6e2fa565 req-bcaec84f-c79b-4097-9385-d4cb929ac696 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fe3581d-a75d-43b2-a3f0-0cb4b612aef2", "tag": "9a143d9b-6ab1-4697-b2b0-8f8011555ccb"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:33:22.635040 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-3f8129fc-8f45-457b-a217-0feb6e2fa565 req-bcaec84f-c79b-4097-9385-d4cb929ac696 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:22.635930 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-3f8129fc-8f45-457b-a217-0feb6e2fa565 req-bcaec84f-c79b-4097-9385-d4cb929ac696 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:22.639851 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:33:22.653445 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-3f8129fc-8f45-457b-a217-0feb6e2fa565 req-bcaec84f-c79b-4097-9385-d4cb929ac696 service nova] Creating event network-changed:9a143d9b-6ab1-4697-b2b0-8f8011555ccb for instance 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 on n-h1-master-1 Jun 20 12:33:22.660235 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-3f8129fc-8f45-457b-a217-0feb6e2fa565 req-bcaec84f-c79b-4097-9385-d4cb929ac696 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040803 Jun 20 12:33:22.661953 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3106/6116] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:33:22.746346 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6544cd1c-6ba1-4868-ae59-dea9e0914b8c tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:22.747147 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6544cd1c-6ba1-4868-ae59-dea9e0914b8c tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] [instance: 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:22.766021 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6544cd1c-6ba1-4868-ae59-dea9e0914b8c tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:22.766626 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6544cd1c-6ba1-4868-ae59-dea9e0914b8c tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:22.770422 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6544cd1c-6ba1-4868-ae59-dea9e0914b8c tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:22.770422 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6544cd1c-6ba1-4868-ae59-dea9e0914b8c tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:22.955692 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6544cd1c-6ba1-4868-ae59-dea9e0914b8c tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe9fcb215054013b72a4e301144ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2a9e121b8a48ff9716afd0d824e6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:22.964691 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6544cd1c-6ba1-4868-ae59-dea9e0914b8c tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2" status: 200 len: 1583 microversion: 2.1 time: 0.223683 Jun 20 12:33:22.967688 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3011/6117] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:33:22 2022] GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 => generated 1583 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:33:23.988835 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fd7f3c2e-d0f1-43ba-bddb-6010b20c33d6 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:23.990223 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fd7f3c2e-d0f1-43ba-bddb-6010b20c33d6 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] [instance: 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:24.021469 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fd7f3c2e-d0f1-43ba-bddb-6010b20c33d6 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:24.023441 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fd7f3c2e-d0f1-43ba-bddb-6010b20c33d6 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:24.026033 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fd7f3c2e-d0f1-43ba-bddb-6010b20c33d6 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:24.028094 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fd7f3c2e-d0f1-43ba-bddb-6010b20c33d6 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:24.127986 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-9a568f14-876d-44cf-be7d-44e5c43fc6cf req-60cec3fd-3e39-41f7-8052-5d597096a8d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fe3581d-a75d-43b2-a3f0-0cb4b612aef2", "name": "network-vif-deleted", "tag": "9a143d9b-6ab1-4697-b2b0-8f8011555ccb"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:33:24.148904 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9a568f14-876d-44cf-be7d-44e5c43fc6cf req-60cec3fd-3e39-41f7-8052-5d597096a8d6 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:24.153023 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9a568f14-876d-44cf-be7d-44e5c43fc6cf req-60cec3fd-3e39-41f7-8052-5d597096a8d6 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:24.170843 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-9a568f14-876d-44cf-be7d-44e5c43fc6cf req-60cec3fd-3e39-41f7-8052-5d597096a8d6 service nova] Creating event network-vif-deleted:9a143d9b-6ab1-4697-b2b0-8f8011555ccb for instance 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 on n-h1-master-1 Jun 20 12:33:24.177343 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-9a568f14-876d-44cf-be7d-44e5c43fc6cf req-60cec3fd-3e39-41f7-8052-5d597096a8d6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053069 Jun 20 12:33:24.178725 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3012/6118] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:33:24.185994 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-03dd7ed5-b041-4148-8b90-129aa03e1ab8 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:24.186910 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-03dd7ed5-b041-4148-8b90-129aa03e1ab8 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 028600e9-6eb6-42ac-b62e-de21666d744e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:24.195613 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-03dd7ed5-b041-4148-8b90-129aa03e1ab8 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:24.196517 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-03dd7ed5-b041-4148-8b90-129aa03e1ab8 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:24.197475 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-03dd7ed5-b041-4148-8b90-129aa03e1ab8 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:24.198133 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-03dd7ed5-b041-4148-8b90-129aa03e1ab8 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:24.229116 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-03dd7ed5-b041-4148-8b90-129aa03e1ab8 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e/ips" status: 200 len: 150 microversion: 2.1 time: 0.048884 Jun 20 12:33:24.229998 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3013/6119] 10.222.0.27 () {58 vars in 1247 bytes} [Mon Jun 20 12:33:24 2022] GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e/ips => generated 150 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:33:24.265803 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fd7f3c2e-d0f1-43ba-bddb-6010b20c33d6 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe9fcb215054013b72a4e301144ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2a9e121b8a48ff9716afd0d824e6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:24.284870 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fd7f3c2e-d0f1-43ba-bddb-6010b20c33d6 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2" status: 200 len: 1396 microversion: 2.1 time: 0.301518 Jun 20 12:33:24.286627 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3107/6120] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:33:23 2022] GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 => generated 1396 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:33:25.306476 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-df39ace8-ad5d-46b6-9436-7118172fa0f5 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:25.308130 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-df39ace8-ad5d-46b6-9436-7118172fa0f5 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] [instance: 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:25.318307 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-df39ace8-ad5d-46b6-9436-7118172fa0f5 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:25.319201 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-df39ace8-ad5d-46b6-9436-7118172fa0f5 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:25.320420 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-df39ace8-ad5d-46b6-9436-7118172fa0f5 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:25.321349 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-df39ace8-ad5d-46b6-9436-7118172fa0f5 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:25.407747 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-df39ace8-ad5d-46b6-9436-7118172fa0f5 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe9fcb215054013b72a4e301144ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2a9e121b8a48ff9716afd0d824e6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:25.418747 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-df39ace8-ad5d-46b6-9436-7118172fa0f5 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2" status: 200 len: 1229 microversion: 2.1 time: 0.118613 Jun 20 12:33:25.420874 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3014/6121] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:33:25 2022] GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 => generated 1229 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:33:25.814161 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dc73fc3f-cab5-4f14-b20b-4374de64e415 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f87ffa6e-54ec-494d-bfc7-67ae089e0026"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:33:25.815503 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dc73fc3f-cab5-4f14-b20b-4374de64e415 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 028600e9-6eb6-42ac-b62e-de21666d744e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:25.827483 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc73fc3f-cab5-4f14-b20b-4374de64e415 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:25.828090 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc73fc3f-cab5-4f14-b20b-4374de64e415 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:25.829191 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc73fc3f-cab5-4f14-b20b-4374de64e415 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:25.829791 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc73fc3f-cab5-4f14-b20b-4374de64e415 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:26.240687 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dc73fc3f-cab5-4f14-b20b-4374de64e415 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "POST /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.429395 Jun 20 12:33:26.243614 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3108/6122] 10.222.0.27 () {60 vars in 1322 bytes} [Mon Jun 20 12:33:25 2022] POST /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e/os-volume_attachments => generated 194 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:33:26.441275 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0efb4b0f-29ff-4907-af6a-53f54d1aa2ae tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:26.444305 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0efb4b0f-29ff-4907-af6a-53f54d1aa2ae tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] [instance: 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:26.470905 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0efb4b0f-29ff-4907-af6a-53f54d1aa2ae tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:26.471882 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0efb4b0f-29ff-4907-af6a-53f54d1aa2ae tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:26.475029 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0efb4b0f-29ff-4907-af6a-53f54d1aa2ae tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:26.480741 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0efb4b0f-29ff-4907-af6a-53f54d1aa2ae tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:26.622938 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0efb4b0f-29ff-4907-af6a-53f54d1aa2ae tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe9fcb215054013b72a4e301144ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2a9e121b8a48ff9716afd0d824e6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:26.634334 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0efb4b0f-29ff-4907-af6a-53f54d1aa2ae tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2" status: 200 len: 1229 microversion: 2.1 time: 0.202073 Jun 20 12:33:26.635703 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3015/6123] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:33:26 2022] GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 => generated 1229 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:33:27.659389 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1e439030-46c3-4c47-b376-cf08af76b505 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:27.663817 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1e439030-46c3-4c47-b376-cf08af76b505 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] [instance: 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:27.672866 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1e439030-46c3-4c47-b376-cf08af76b505 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:27.673666 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1e439030-46c3-4c47-b376-cf08af76b505 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:27.674709 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1e439030-46c3-4c47-b376-cf08af76b505 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:27.675875 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1e439030-46c3-4c47-b376-cf08af76b505 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:27.753520 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1e439030-46c3-4c47-b376-cf08af76b505 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe9fcb215054013b72a4e301144ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2a9e121b8a48ff9716afd0d824e6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:27.766302 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1e439030-46c3-4c47-b376-cf08af76b505 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2" status: 200 len: 1229 microversion: 2.1 time: 0.118119 Jun 20 12:33:27.767485 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3109/6124] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:33:27 2022] GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 => generated 1229 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:33:28.783253 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-325a6b0b-71f0-4387-8eb1-99063a2806d9 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:28.783870 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-325a6b0b-71f0-4387-8eb1-99063a2806d9 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] [instance: 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:28.792654 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-325a6b0b-71f0-4387-8eb1-99063a2806d9 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:28.793270 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-325a6b0b-71f0-4387-8eb1-99063a2806d9 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:28.794648 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-325a6b0b-71f0-4387-8eb1-99063a2806d9 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:28.795335 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-325a6b0b-71f0-4387-8eb1-99063a2806d9 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:28.891849 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-325a6b0b-71f0-4387-8eb1-99063a2806d9 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe9fcb215054013b72a4e301144ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2a9e121b8a48ff9716afd0d824e6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:28.900833 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-325a6b0b-71f0-4387-8eb1-99063a2806d9 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2" status: 200 len: 1229 microversion: 2.1 time: 0.121470 Jun 20 12:33:28.911628 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3016/6125] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:33:28 2022] GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 => generated 1229 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:33:29.920958 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1a9804b1-6706-4763-9af8-66b89e79b21e tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:29.922190 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1a9804b1-6706-4763-9af8-66b89e79b21e tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] [instance: 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:29.936045 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a9804b1-6706-4763-9af8-66b89e79b21e tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:29.936624 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a9804b1-6706-4763-9af8-66b89e79b21e tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:29.937417 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a9804b1-6706-4763-9af8-66b89e79b21e tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:29.938081 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a9804b1-6706-4763-9af8-66b89e79b21e tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:30.055878 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1a9804b1-6706-4763-9af8-66b89e79b21e tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe9fcb215054013b72a4e301144ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2a9e121b8a48ff9716afd0d824e6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:30.071324 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1a9804b1-6706-4763-9af8-66b89e79b21e tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2" status: 200 len: 1229 microversion: 2.1 time: 0.157071 Jun 20 12:33:30.071921 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3110/6126] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:33:29 2022] GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 => generated 1229 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:33:31.090392 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bea09e9c-1784-4694-83f1-06b397f577f2 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:31.092115 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bea09e9c-1784-4694-83f1-06b397f577f2 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] [instance: 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:31.099962 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bea09e9c-1784-4694-83f1-06b397f577f2 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:31.100748 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bea09e9c-1784-4694-83f1-06b397f577f2 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:31.101779 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bea09e9c-1784-4694-83f1-06b397f577f2 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:31.102390 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bea09e9c-1784-4694-83f1-06b397f577f2 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:31.119596 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-bea09e9c-1784-4694-83f1-06b397f577f2 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] HTTP exception thrown: Instance 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 could not be found. Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bea09e9c-1784-4694-83f1-06b397f577f2 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Request method failure captured: Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 HTTP/1.1 Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGgAq2cu9e4RekDPC9G7qMOHYZDVJTeUC1kycc70O050UwZVZqW9e1A2P88Vqogu7zvGUOalah-ce9QlCDet0Xu-N9eBakq4ryr4OxhU94KG2g42x8rR4fp2yR8Ro_IwrGYKS5tJM9D3K5E7xbqjgOGNzhjSdkbiVyuP550at77jcKI Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 9f2a9e121b8a48ff9716afd0d824e6dd Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-TestVolumeBackupRestore-1280937637 Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9f2a9e121b8a48ff9716afd0d824e6dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9f2a9e121b8a48ff9716afd0d824e6dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9f2a9e121b8a48ff9716afd0d824e6dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9f2a9e121b8a48ff9716afd0d824e6dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-TestVolumeBackupRestore-1280937637 Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 9f2a9e121b8a48ff9716afd0d824e6dd Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1280937637 Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-TestVolumeBackupRestore-1280937637-project Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 6fe9fcb215054013b72a4e301144ae89 Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-TestVolumeBackupRestore-1280937637-project Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 could not be found. Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '1fe3581d-a75d-43b2-a3f0-0cb4b612aef2'} Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 could not be found. Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 could not be found. Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:33:31.121932 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:33:31.126980 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:33:31.126980 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:33:31.126980 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:33:31.126980 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:33:31.126980 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:33:31.126980 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 could not be found. Jun 20 12:33:31.126980 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:33:31.129083 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bea09e9c-1784-4694-83f1-06b397f577f2 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Returning 404 to user: Instance 1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:33:31.130157 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bea09e9c-1784-4694-83f1-06b397f577f2 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2" status: 404 len: 111 microversion: 2.1 time: 0.044629 Jun 20 12:33:31.131171 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3017/6127] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:33:31 2022] GET /compute/v2.1/servers/1fe3581d-a75d-43b2-a3f0-0cb4b612aef2 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:33:31.339149 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6422a757-27c4-4cf3-b272-c2bbd76dcaa1 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] Calling method '.version_select at 0x7f6072451a60>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:31.367310 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6422a757-27c4-4cf3-b272-c2bbd76dcaa1 tempest-TestVolumeBackupRestore-1280937637 tempest-TestVolumeBackupRestore-1280937637-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2032277790" status: 202 len: 0 microversion: 2.1 time: 0.032327 Jun 20 12:33:31.374728 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3111/6128] 10.222.0.27 () {58 vars in 1268 bytes} [Mon Jun 20 12:33:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2032277790 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:33:48.476098 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-663b2a69-fee1-4ab4-ae33-ac7ab72fd40e tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Action: 'create', calling method: .version_select at 0x7f60729730d0>, body: {"keypair": {"name": "tempest-keypair-938004171", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNw1yt57nhA+Q4gg1AzJfjJ+Ru8WgxiC8+dHl/bGMk559THNhbpbTKMg5dVVJTzTr+AdbCsZn9mnpR13fVGT/6j5cKFoRBzqgzW4hLDcfibWe/ldLfJF2J4Isxw8cXP1AA=="}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:33:48.490219 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=17 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:33:48.491760 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=84 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:33:48.508230 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-663b2a69-fee1-4ab4-ae33-ac7ab72fd40e tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Getting quotas for project f4714cac56094f9e9d4ed4adb400064e. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:33:48.516412 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-663b2a69-fee1-4ab4-ae33-ac7ab72fd40e tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Getting quotas for user 2c8b3f11a7294fbd9d750b1fbbeaa65b and project f4714cac56094f9e9d4ed4adb400064e. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:33:48.566509 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-663b2a69-fee1-4ab4-ae33-ac7ab72fd40e tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.097338 Jun 20 12:33:48.567363 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3018/6129] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 12:33:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:33:49.690543 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:33:49.691453 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:33:50.242095 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-857f1a64-960a-42b9-8a38-635bac3ea93f tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:50.244493 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-857f1a64-960a-42b9-8a38-635bac3ea93f tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] [instance: 0059d853-f820-4e39-953c-133a05c6380e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:50.258382 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-857f1a64-960a-42b9-8a38-635bac3ea93f tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:50.258698 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-857f1a64-960a-42b9-8a38-635bac3ea93f tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:50.260513 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-857f1a64-960a-42b9-8a38-635bac3ea93f tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:50.261268 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-857f1a64-960a-42b9-8a38-635bac3ea93f tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:50.330756 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-857f1a64-960a-42b9-8a38-635bac3ea93f tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] [instance: 0059d853-f820-4e39-953c-133a05c6380e] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:33:50.583779 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-857f1a64-960a-42b9-8a38-635bac3ea93f tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e" status: 204 len: 0 microversion: 2.1 time: 0.894977 Jun 20 12:33:50.589600 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3112/6130] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:33:49 2022] DELETE /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e => generated 0 bytes in 902 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:33:50.599800 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1fa513f0-d365-4d08-bbb4-479fa7030c54 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:50.600465 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1fa513f0-d365-4d08-bbb4-479fa7030c54 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] [instance: 0059d853-f820-4e39-953c-133a05c6380e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:50.611171 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1fa513f0-d365-4d08-bbb4-479fa7030c54 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:50.611639 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1fa513f0-d365-4d08-bbb4-479fa7030c54 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:50.612560 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1fa513f0-d365-4d08-bbb4-479fa7030c54 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:50.613006 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1fa513f0-d365-4d08-bbb4-479fa7030c54 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:50.877657 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1fa513f0-d365-4d08-bbb4-479fa7030c54 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490f46fb1a147dfa995d8fe278fe971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4136a79e71ec4e78803ac418f2445ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:50.888820 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1fa513f0-d365-4d08-bbb4-479fa7030c54 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] 10.222.0.27 "GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e" status: 200 len: 1730 microversion: 2.1 time: 0.294548 Jun 20 12:33:50.890309 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3019/6131] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:33:50 2022] GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e => generated 1730 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:33:50.989523 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-656152f1-d739-4d3b-a75b-16d676d2186c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1913312920", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2f68d1fc-6d7d-4fb9-a17e-f5081b1bc479"}], "security_groups": [{"name": "tempest-securitygroup--1560998670"}], "key_name": "tempest-keypair-938004171", "user_data": "}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:33:51.119034 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-656152f1-d739-4d3b-a75b-16d676d2186c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] validate_networks() for [('2f68d1fc-6d7d-4fb9-a17e-f5081b1bc479', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:33:51.870805 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-656152f1-d739-4d3b-a75b-16d676d2186c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:33:51.871960 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-656152f1-d739-4d3b-a75b-16d676d2186c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:33:51.873124 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-656152f1-d739-4d3b-a75b-16d676d2186c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:33:51.873756 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-656152f1-d739-4d3b-a75b-16d676d2186c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:33:51.874566 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-656152f1-d739-4d3b-a75b-16d676d2186c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:33:51.889841 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-656152f1-d739-4d3b-a75b-16d676d2186c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:51.890547 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-656152f1-d739-4d3b-a75b-16d676d2186c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:51.892367 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-656152f1-d739-4d3b-a75b-16d676d2186c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:51.893026 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-656152f1-d739-4d3b-a75b-16d676d2186c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:51.911029 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c44634bb-66b6-4e6d-abd6-3a20f73ba864 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:51.914977 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c44634bb-66b6-4e6d-abd6-3a20f73ba864 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] [instance: 0059d853-f820-4e39-953c-133a05c6380e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:51.924482 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-656152f1-d739-4d3b-a75b-16d676d2186c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Getting quotas for project f4714cac56094f9e9d4ed4adb400064e. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:33:51.932125 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-656152f1-d739-4d3b-a75b-16d676d2186c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Getting quotas for user 2c8b3f11a7294fbd9d750b1fbbeaa65b and project f4714cac56094f9e9d4ed4adb400064e. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:33:51.934125 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c44634bb-66b6-4e6d-abd6-3a20f73ba864 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:51.935298 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c44634bb-66b6-4e6d-abd6-3a20f73ba864 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:51.936527 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c44634bb-66b6-4e6d-abd6-3a20f73ba864 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:51.936987 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c44634bb-66b6-4e6d-abd6-3a20f73ba864 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:51.977189 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-656152f1-d739-4d3b-a75b-16d676d2186c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:33:51.980093 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-656152f1-d739-4d3b-a75b-16d676d2186c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:33:52.047245 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-656152f1-d739-4d3b-a75b-16d676d2186c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.062134 Jun 20 12:33:52.052954 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3113/6132] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:33:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 1064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:33:52.059080 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d677f9dc-fbf7-48eb-97a0-b302d04a67f0 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:52.060334 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d677f9dc-fbf7-48eb-97a0-b302d04a67f0 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:52.196526 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d677f9dc-fbf7-48eb-97a0-b302d04a67f0 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:52.211148 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d677f9dc-fbf7-48eb-97a0-b302d04a67f0 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651" status: 200 len: 1241 microversion: 2.1 time: 0.155963 Jun 20 12:33:52.222413 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3114/6133] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:33:52 2022] GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 => generated 1241 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:33:52.303961 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c44634bb-66b6-4e6d-abd6-3a20f73ba864 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490f46fb1a147dfa995d8fe278fe971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4136a79e71ec4e78803ac418f2445ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:52.313109 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c44634bb-66b6-4e6d-abd6-3a20f73ba864 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] 10.222.0.27 "GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e" status: 200 len: 1730 microversion: 2.1 time: 0.409585 Jun 20 12:33:52.314818 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3020/6134] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:33:51 2022] GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e => generated 1730 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:33:53.156780 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-ac8ea5a6-5805-4363-9722-4fcace0bd5eb req-84ea7799-b491-4745-b54b-4841e6c8bcc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0059d853-f820-4e39-953c-133a05c6380e", "name": "network-vif-deleted", "tag": "7e555620-532f-4308-8bf3-543e1513fdb0"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:33:53.171020 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ac8ea5a6-5805-4363-9722-4fcace0bd5eb req-84ea7799-b491-4745-b54b-4841e6c8bcc8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:53.171567 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ac8ea5a6-5805-4363-9722-4fcace0bd5eb req-84ea7799-b491-4745-b54b-4841e6c8bcc8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:53.191435 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-ac8ea5a6-5805-4363-9722-4fcace0bd5eb req-84ea7799-b491-4745-b54b-4841e6c8bcc8 service nova] Creating event network-vif-deleted:7e555620-532f-4308-8bf3-543e1513fdb0 for instance 0059d853-f820-4e39-953c-133a05c6380e on n-h1-master-1 Jun 20 12:33:53.199999 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-ac8ea5a6-5805-4363-9722-4fcace0bd5eb req-84ea7799-b491-4745-b54b-4841e6c8bcc8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049454 Jun 20 12:33:53.201803 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3115/6135] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:33:53.231274 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-adedb417-7d08-4e64-a5c2-240a9d698f0b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:53.233178 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-adedb417-7d08-4e64-a5c2-240a9d698f0b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:53.244867 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-adedb417-7d08-4e64-a5c2-240a9d698f0b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:53.245604 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-adedb417-7d08-4e64-a5c2-240a9d698f0b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:53.246719 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-adedb417-7d08-4e64-a5c2-240a9d698f0b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:53.247337 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-adedb417-7d08-4e64-a5c2-240a9d698f0b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:53.331928 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b1efc1a0-bdc9-4da3-b6f9-ce25b8f94442 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:53.332950 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b1efc1a0-bdc9-4da3-b6f9-ce25b8f94442 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] [instance: 0059d853-f820-4e39-953c-133a05c6380e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:53.354074 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b1efc1a0-bdc9-4da3-b6f9-ce25b8f94442 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:53.354927 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b1efc1a0-bdc9-4da3-b6f9-ce25b8f94442 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:53.356100 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b1efc1a0-bdc9-4da3-b6f9-ce25b8f94442 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:53.356906 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b1efc1a0-bdc9-4da3-b6f9-ce25b8f94442 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:53.421274 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-adedb417-7d08-4e64-a5c2-240a9d698f0b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:53.448346 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-adedb417-7d08-4e64-a5c2-240a9d698f0b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651" status: 200 len: 1237 microversion: 2.1 time: 0.211508 Jun 20 12:33:53.451211 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3021/6136] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:33:53 2022] GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 => generated 1237 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:33:53.504998 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b1efc1a0-bdc9-4da3-b6f9-ce25b8f94442 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b490f46fb1a147dfa995d8fe278fe971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4136a79e71ec4e78803ac418f2445ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:53.528964 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b1efc1a0-bdc9-4da3-b6f9-ce25b8f94442 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] 10.222.0.27 "GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e" status: 200 len: 1382 microversion: 2.1 time: 0.201508 Jun 20 12:33:53.539733 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3116/6137] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:33:53 2022] GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e => generated 1382 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:33:54.470315 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e315380c-a45d-4ab7-9a06-9b71cfec8e66 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:54.473025 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e315380c-a45d-4ab7-9a06-9b71cfec8e66 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:54.498986 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e315380c-a45d-4ab7-9a06-9b71cfec8e66 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:54.499728 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e315380c-a45d-4ab7-9a06-9b71cfec8e66 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:54.502400 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e315380c-a45d-4ab7-9a06-9b71cfec8e66 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:54.503035 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e315380c-a45d-4ab7-9a06-9b71cfec8e66 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:54.547841 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f662f93c-63fc-4d54-a98f-1c38e63788bd tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:54.548832 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f662f93c-63fc-4d54-a98f-1c38e63788bd tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] [instance: 0059d853-f820-4e39-953c-133a05c6380e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:54.556711 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f662f93c-63fc-4d54-a98f-1c38e63788bd tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:54.557699 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f662f93c-63fc-4d54-a98f-1c38e63788bd tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:54.558981 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f662f93c-63fc-4d54-a98f-1c38e63788bd tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:54.559648 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f662f93c-63fc-4d54-a98f-1c38e63788bd tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:54.577695 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-f662f93c-63fc-4d54-a98f-1c38e63788bd tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] HTTP exception thrown: Instance 0059d853-f820-4e39-953c-133a05c6380e could not be found. Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f662f93c-63fc-4d54-a98f-1c38e63788bd tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Request method failure captured: Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e HTTP/1.1 Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGfi-Vi49xLQKW1vi9yirE3xOErh9xvC8CtHUoxDDsuF06VMOnnf_1ij9JLU6Gg2GHaLNd6KNPsQPHNgJat2nKWZdb04Q1Nb-0jC8VotkRbPDwvQ3KXCey1eOQr5FnACuL6AWNds806N7X8-4Qgq0xKu6U0ePMfi1m9tTlQo2eizaMU Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 4136a79e71ec4e78803ac418f2445ee7 Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-TestServerBasicOps-667830575 Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4136a79e71ec4e78803ac418f2445ee7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4136a79e71ec4e78803ac418f2445ee7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4136a79e71ec4e78803ac418f2445ee7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4136a79e71ec4e78803ac418f2445ee7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-TestServerBasicOps-667830575 Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 4136a79e71ec4e78803ac418f2445ee7 Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-TestServerBasicOps-667830575 Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-TestServerBasicOps-667830575-project Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: b490f46fb1a147dfa995d8fe278fe971 Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-TestServerBasicOps-667830575-project Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 0059d853-f820-4e39-953c-133a05c6380e could not be found. Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '0059d853-f820-4e39-953c-133a05c6380e'} Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0059d853-f820-4e39-953c-133a05c6380e could not be found. Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0059d853-f820-4e39-953c-133a05c6380e could not be found. Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:33:54.580086 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:33:54.586596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:33:54.586596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:33:54.586596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:33:54.586596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:33:54.586596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:33:54.586596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0059d853-f820-4e39-953c-133a05c6380e could not be found. Jun 20 12:33:54.586596 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:33:54.589200 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f662f93c-63fc-4d54-a98f-1c38e63788bd tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Returning 404 to user: Instance 0059d853-f820-4e39-953c-133a05c6380e could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:33:54.590613 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f662f93c-63fc-4d54-a98f-1c38e63788bd tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] 10.222.0.27 "GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e" status: 404 len: 111 microversion: 2.1 time: 0.047642 Jun 20 12:33:54.591786 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3117/6138] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:33:54 2022] GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:33:54.673954 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e315380c-a45d-4ab7-9a06-9b71cfec8e66 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:54.687011 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e315380c-a45d-4ab7-9a06-9b71cfec8e66 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651" status: 200 len: 1299 microversion: 2.1 time: 0.220698 Jun 20 12:33:54.697102 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3022/6139] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:33:54 2022] GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 => generated 1299 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:33:55.368636 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e90014f2-4ece-4cc0-bfcf-4b1121e38e72 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:55.369409 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e90014f2-4ece-4cc0-bfcf-4b1121e38e72 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] [instance: 0059d853-f820-4e39-953c-133a05c6380e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:55.381436 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e90014f2-4ece-4cc0-bfcf-4b1121e38e72 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:55.382353 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e90014f2-4ece-4cc0-bfcf-4b1121e38e72 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:55.383366 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e90014f2-4ece-4cc0-bfcf-4b1121e38e72 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:55.384292 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e90014f2-4ece-4cc0-bfcf-4b1121e38e72 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:55.403618 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-e90014f2-4ece-4cc0-bfcf-4b1121e38e72 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] HTTP exception thrown: Instance 0059d853-f820-4e39-953c-133a05c6380e could not be found. Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e90014f2-4ece-4cc0-bfcf-4b1121e38e72 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Request method failure captured: Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e HTTP/1.1 Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGfi-Vi49xLQKW1vi9yirE3xOErh9xvC8CtHUoxDDsuF06VMOnnf_1ij9JLU6Gg2GHaLNd6KNPsQPHNgJat2nKWZdb04Q1Nb-0jC8VotkRbPDwvQ3KXCey1eOQr5FnACuL6AWNds806N7X8-4Qgq0xKu6U0ePMfi1m9tTlQo2eizaMU Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 4136a79e71ec4e78803ac418f2445ee7 Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-TestServerBasicOps-667830575 Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4136a79e71ec4e78803ac418f2445ee7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4136a79e71ec4e78803ac418f2445ee7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4136a79e71ec4e78803ac418f2445ee7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4136a79e71ec4e78803ac418f2445ee7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-TestServerBasicOps-667830575 Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 4136a79e71ec4e78803ac418f2445ee7 Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-TestServerBasicOps-667830575 Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-TestServerBasicOps-667830575-project Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: b490f46fb1a147dfa995d8fe278fe971 Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-TestServerBasicOps-667830575-project Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 0059d853-f820-4e39-953c-133a05c6380e could not be found. Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '0059d853-f820-4e39-953c-133a05c6380e'} Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0059d853-f820-4e39-953c-133a05c6380e could not be found. Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:33:55.405676 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0059d853-f820-4e39-953c-133a05c6380e could not be found. Jun 20 12:33:55.410693 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:33:55.410693 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:33:55.410693 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:33:55.410693 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:33:55.410693 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:33:55.410693 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:33:55.410693 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:33:55.410693 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:33:55.410693 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0059d853-f820-4e39-953c-133a05c6380e could not be found. Jun 20 12:33:55.410693 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:33:55.426913 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e90014f2-4ece-4cc0-bfcf-4b1121e38e72 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Returning 404 to user: Instance 0059d853-f820-4e39-953c-133a05c6380e could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:33:55.428130 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e90014f2-4ece-4cc0-bfcf-4b1121e38e72 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e" status: 404 len: 111 microversion: 2.1 time: 0.064165 Jun 20 12:33:55.432575 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3118/6140] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:33:55 2022] DELETE /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:33:55.439182 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7a347a11-0e7c-4c48-8997-18633d1dcf5c tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:55.439796 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7a347a11-0e7c-4c48-8997-18633d1dcf5c tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] [instance: 0059d853-f820-4e39-953c-133a05c6380e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:55.459933 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7a347a11-0e7c-4c48-8997-18633d1dcf5c tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:55.470368 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7a347a11-0e7c-4c48-8997-18633d1dcf5c tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:55.471378 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7a347a11-0e7c-4c48-8997-18633d1dcf5c tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:55.474100 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7a347a11-0e7c-4c48-8997-18633d1dcf5c tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:55.496247 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-7a347a11-0e7c-4c48-8997-18633d1dcf5c tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] HTTP exception thrown: Instance 0059d853-f820-4e39-953c-133a05c6380e could not be found. Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7a347a11-0e7c-4c48-8997-18633d1dcf5c tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Request method failure captured: Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e HTTP/1.1 Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGfi-Vi49xLQKW1vi9yirE3xOErh9xvC8CtHUoxDDsuF06VMOnnf_1ij9JLU6Gg2GHaLNd6KNPsQPHNgJat2nKWZdb04Q1Nb-0jC8VotkRbPDwvQ3KXCey1eOQr5FnACuL6AWNds806N7X8-4Qgq0xKu6U0ePMfi1m9tTlQo2eizaMU Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 4136a79e71ec4e78803ac418f2445ee7 Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-TestServerBasicOps-667830575 Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4136a79e71ec4e78803ac418f2445ee7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4136a79e71ec4e78803ac418f2445ee7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4136a79e71ec4e78803ac418f2445ee7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4136a79e71ec4e78803ac418f2445ee7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-TestServerBasicOps-667830575 Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 4136a79e71ec4e78803ac418f2445ee7 Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-TestServerBasicOps-667830575 Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-TestServerBasicOps-667830575-project Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: b490f46fb1a147dfa995d8fe278fe971 Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-TestServerBasicOps-667830575-project Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 0059d853-f820-4e39-953c-133a05c6380e could not be found. Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '0059d853-f820-4e39-953c-133a05c6380e'} Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0059d853-f820-4e39-953c-133a05c6380e could not be found. Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0059d853-f820-4e39-953c-133a05c6380e could not be found. Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:33:55.497874 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:33:55.504154 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:33:55.504154 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:33:55.504154 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:33:55.504154 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:33:55.504154 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:33:55.504154 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0059d853-f820-4e39-953c-133a05c6380e could not be found. Jun 20 12:33:55.504154 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:33:55.506560 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7a347a11-0e7c-4c48-8997-18633d1dcf5c tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Returning 404 to user: Instance 0059d853-f820-4e39-953c-133a05c6380e could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:33:55.508554 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7a347a11-0e7c-4c48-8997-18633d1dcf5c tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] 10.222.0.27 "GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e" status: 404 len: 111 microversion: 2.1 time: 0.073721 Jun 20 12:33:55.510090 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3023/6141] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:33:55 2022] GET /compute/v2.1/servers/0059d853-f820-4e39-953c-133a05c6380e => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:33:55.710259 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c6553d7d-46a7-470c-a3b0-5f8f3df0145f tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:55.710900 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c6553d7d-46a7-470c-a3b0-5f8f3df0145f tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:55.718526 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6553d7d-46a7-470c-a3b0-5f8f3df0145f tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:55.719139 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6553d7d-46a7-470c-a3b0-5f8f3df0145f tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:55.720363 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6553d7d-46a7-470c-a3b0-5f8f3df0145f tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:55.721150 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6553d7d-46a7-470c-a3b0-5f8f3df0145f tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:55.913068 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-de10f8f5-5711-4f00-b412-343b33a626f7 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] Calling method '.version_select at 0x7f6073189670>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:55.948960 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c6553d7d-46a7-470c-a3b0-5f8f3df0145f tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:55.958774 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-de10f8f5-5711-4f00-b412-343b33a626f7 tempest-TestServerBasicOps-667830575 tempest-TestServerBasicOps-667830575-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-51846293" status: 202 len: 0 microversion: 2.1 time: 0.049753 Jun 20 12:33:55.959270 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3024/6142] 10.222.0.27 () {58 vars in 1247 bytes} [Mon Jun 20 12:33:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-51846293 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:33:55.959659 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c6553d7d-46a7-470c-a3b0-5f8f3df0145f tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651" status: 200 len: 1367 microversion: 2.1 time: 0.250665 Jun 20 12:33:55.960585 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3119/6143] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:33:55 2022] GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:33:56.459327 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-e7b03bb2-d4be-442c-a019-66da7772c160 req-59dff685-011d-4b68-9e06-8bca20462355 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651", "tag": "f9156d23-204a-4564-8c50-89c7db586dbd"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:33:56.481215 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e7b03bb2-d4be-442c-a019-66da7772c160 req-59dff685-011d-4b68-9e06-8bca20462355 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:56.483269 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e7b03bb2-d4be-442c-a019-66da7772c160 req-59dff685-011d-4b68-9e06-8bca20462355 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:56.519405 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-e7b03bb2-d4be-442c-a019-66da7772c160 req-59dff685-011d-4b68-9e06-8bca20462355 service nova] Creating event network-changed:f9156d23-204a-4564-8c50-89c7db586dbd for instance 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 on n-h2-master-1 Jun 20 12:33:56.526489 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-e7b03bb2-d4be-442c-a019-66da7772c160 req-59dff685-011d-4b68-9e06-8bca20462355 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072285 Jun 20 12:33:56.527753 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3025/6144] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:33:56.990406 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1cc7935e-fff3-4363-94c9-f9414d2ac10c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:56.991005 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1cc7935e-fff3-4363-94c9-f9414d2ac10c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:56.998541 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1cc7935e-fff3-4363-94c9-f9414d2ac10c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:56.999233 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1cc7935e-fff3-4363-94c9-f9414d2ac10c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:57.000177 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1cc7935e-fff3-4363-94c9-f9414d2ac10c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:57.000806 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1cc7935e-fff3-4363-94c9-f9414d2ac10c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:57.219402 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1cc7935e-fff3-4363-94c9-f9414d2ac10c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:57.227434 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1cc7935e-fff3-4363-94c9-f9414d2ac10c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651" status: 200 len: 1367 microversion: 2.1 time: 0.240844 Jun 20 12:33:57.228634 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3120/6145] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:33:56 2022] GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:33:58.247922 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-52ccc0e8-f9b3-490d-a502-b6f2444d61f2 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:58.249335 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-52ccc0e8-f9b3-490d-a502-b6f2444d61f2 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:58.257256 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-52ccc0e8-f9b3-490d-a502-b6f2444d61f2 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:58.257989 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-52ccc0e8-f9b3-490d-a502-b6f2444d61f2 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:58.259615 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-52ccc0e8-f9b3-490d-a502-b6f2444d61f2 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:58.260427 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-52ccc0e8-f9b3-490d-a502-b6f2444d61f2 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:58.431869 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-52ccc0e8-f9b3-490d-a502-b6f2444d61f2 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:58.441928 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-52ccc0e8-f9b3-490d-a502-b6f2444d61f2 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651" status: 200 len: 1367 microversion: 2.1 time: 0.199948 Jun 20 12:33:58.451776 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3026/6146] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:33:58 2022] GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:33:59.460333 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ef0e9c0b-a653-42cb-8eeb-554d337b140e tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:59.461732 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ef0e9c0b-a653-42cb-8eeb-554d337b140e tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:59.470337 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef0e9c0b-a653-42cb-8eeb-554d337b140e tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:59.471195 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef0e9c0b-a653-42cb-8eeb-554d337b140e tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:59.472184 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef0e9c0b-a653-42cb-8eeb-554d337b140e tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:59.472848 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef0e9c0b-a653-42cb-8eeb-554d337b140e tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:59.696881 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ef0e9c0b-a653-42cb-8eeb-554d337b140e tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:59.707855 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ef0e9c0b-a653-42cb-8eeb-554d337b140e tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651" status: 200 len: 1367 microversion: 2.1 time: 0.252002 Jun 20 12:33:59.711051 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3121/6147] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:33:59 2022] GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:34:00.753175 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ecbb6dba-6731-49d0-9c63-a92996687522 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:00.755295 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ecbb6dba-6731-49d0-9c63-a92996687522 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:00.784155 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=4 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:34:00.799712 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ecbb6dba-6731-49d0-9c63-a92996687522 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:00.800992 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ecbb6dba-6731-49d0-9c63-a92996687522 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:00.802626 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ecbb6dba-6731-49d0-9c63-a92996687522 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:00.807730 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ecbb6dba-6731-49d0-9c63-a92996687522 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:01.090943 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ecbb6dba-6731-49d0-9c63-a92996687522 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:01.099852 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ecbb6dba-6731-49d0-9c63-a92996687522 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651" status: 200 len: 1367 microversion: 2.1 time: 0.365420 Jun 20 12:34:01.110628 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3027/6148] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:00 2022] GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 => generated 1367 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:34:02.117867 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ea0efe6b-59ae-44a1-aa15-b5b96ec38b49 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:02.119874 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ea0efe6b-59ae-44a1-aa15-b5b96ec38b49 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:02.124059 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:34:02.131872 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea0efe6b-59ae-44a1-aa15-b5b96ec38b49 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:02.132626 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea0efe6b-59ae-44a1-aa15-b5b96ec38b49 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:02.133615 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea0efe6b-59ae-44a1-aa15-b5b96ec38b49 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:02.134227 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea0efe6b-59ae-44a1-aa15-b5b96ec38b49 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:02.203831 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=8 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:34:02.413710 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ea0efe6b-59ae-44a1-aa15-b5b96ec38b49 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:02.423034 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ea0efe6b-59ae-44a1-aa15-b5b96ec38b49 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651" status: 200 len: 1367 microversion: 2.1 time: 0.309133 Jun 20 12:34:02.426768 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3122/6149] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:02 2022] GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 => generated 1367 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:34:02.537493 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-fc1dd578-5479-4358-b9f1-29894a60c262 req-d296e826-663e-4710-91f0-2ca11385e950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651", "name": "network-vif-plugged", "status": "completed", "tag": "f9156d23-204a-4564-8c50-89c7db586dbd"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:34:02.555400 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-fc1dd578-5479-4358-b9f1-29894a60c262 req-d296e826-663e-4710-91f0-2ca11385e950 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:02.559940 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-fc1dd578-5479-4358-b9f1-29894a60c262 req-d296e826-663e-4710-91f0-2ca11385e950 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:02.598922 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-fc1dd578-5479-4358-b9f1-29894a60c262 req-d296e826-663e-4710-91f0-2ca11385e950 service nova] Creating event network-vif-plugged:f9156d23-204a-4564-8c50-89c7db586dbd for instance 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 on n-h2-master-1 Jun 20 12:34:02.605659 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-fc1dd578-5479-4358-b9f1-29894a60c262 req-d296e826-663e-4710-91f0-2ca11385e950 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.375671 Jun 20 12:34:02.608021 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3028/6150] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:34:03.445763 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f5fd2af5-294b-48ae-93fe-8a84c685e05c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:03.446557 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f5fd2af5-294b-48ae-93fe-8a84c685e05c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:03.474141 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5fd2af5-294b-48ae-93fe-8a84c685e05c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:03.474764 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5fd2af5-294b-48ae-93fe-8a84c685e05c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:03.476232 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5fd2af5-294b-48ae-93fe-8a84c685e05c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:03.476876 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5fd2af5-294b-48ae-93fe-8a84c685e05c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:03.749549 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f5fd2af5-294b-48ae-93fe-8a84c685e05c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:03.764937 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f5fd2af5-294b-48ae-93fe-8a84c685e05c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651" status: 200 len: 1367 microversion: 2.1 time: 0.328439 Jun 20 12:34:03.768936 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3123/6151] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:03 2022] GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 => generated 1367 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:34:04.788094 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dd562d63-bdc6-4215-9496-c9b9aeebf9ee tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:04.789065 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-dd562d63-bdc6-4215-9496-c9b9aeebf9ee tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:04.806575 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dd562d63-bdc6-4215-9496-c9b9aeebf9ee tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:04.808827 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dd562d63-bdc6-4215-9496-c9b9aeebf9ee tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:04.811278 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dd562d63-bdc6-4215-9496-c9b9aeebf9ee tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:04.813139 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dd562d63-bdc6-4215-9496-c9b9aeebf9ee tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:05.716507 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-dd562d63-bdc6-4215-9496-c9b9aeebf9ee tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:05.733667 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dd562d63-bdc6-4215-9496-c9b9aeebf9ee tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651" status: 200 len: 1557 microversion: 2.1 time: 0.951181 Jun 20 12:34:05.750662 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cff09a5d-ae7d-4842-9acf-4ae0bb05d343 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:05.751921 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cff09a5d-ae7d-4842-9acf-4ae0bb05d343 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:05.756331 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3029/6152] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:04 2022] GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 => generated 1557 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:34:05.768028 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cff09a5d-ae7d-4842-9acf-4ae0bb05d343 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:05.768550 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cff09a5d-ae7d-4842-9acf-4ae0bb05d343 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:05.769359 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cff09a5d-ae7d-4842-9acf-4ae0bb05d343 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:05.769805 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cff09a5d-ae7d-4842-9acf-4ae0bb05d343 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:05.910837 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cff09a5d-ae7d-4842-9acf-4ae0bb05d343 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.164059 Jun 20 12:34:05.919454 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3124/6153] 10.222.0.27 () {58 vars in 1274 bytes} [Mon Jun 20 12:34:05 2022] GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651/os-interface => generated 285 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:34:07.254185 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-86f5512b-3c73-40d5-ba5a-60114ee9be44 req-5eea2287-536c-4a4b-aadd-666b76baeded service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651", "tag": "f9156d23-204a-4564-8c50-89c7db586dbd"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:34:07.275227 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-86f5512b-3c73-40d5-ba5a-60114ee9be44 req-5eea2287-536c-4a4b-aadd-666b76baeded service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:07.275558 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-86f5512b-3c73-40d5-ba5a-60114ee9be44 req-5eea2287-536c-4a4b-aadd-666b76baeded service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:07.296163 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-86f5512b-3c73-40d5-ba5a-60114ee9be44 req-5eea2287-536c-4a4b-aadd-666b76baeded service nova] Creating event network-changed:f9156d23-204a-4564-8c50-89c7db586dbd for instance 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 on n-h2-master-1 Jun 20 12:34:07.319591 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-86f5512b-3c73-40d5-ba5a-60114ee9be44 req-5eea2287-536c-4a4b-aadd-666b76baeded service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068697 Jun 20 12:34:07.320493 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3030/6154] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:34:13.560536 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8df0c396-db2a-4558-aa23-acf7c26b58f0 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:13.561797 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8df0c396-db2a-4558-aa23-acf7c26b58f0 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:13.568892 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8df0c396-db2a-4558-aa23-acf7c26b58f0 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:13.569561 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8df0c396-db2a-4558-aa23-acf7c26b58f0 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:13.570566 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8df0c396-db2a-4558-aa23-acf7c26b58f0 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:13.571070 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8df0c396-db2a-4558-aa23-acf7c26b58f0 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:13.706771 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-8df0c396-db2a-4558-aa23-acf7c26b58f0 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lazy-loading 'services' on Instance uuid 4c987561-0d7f-495d-9422-99a32b18357a {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:34:13.826695 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8df0c396-db2a-4558-aa23-acf7c26b58f0 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a/os-volume_attachments/d1ee6cee-0929-4444-81c2-fab2b7af4fbe" status: 202 len: 0 microversion: 2.1 time: 0.271469 Jun 20 12:34:13.828025 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3125/6155] 10.222.0.27 () {58 vars in 1415 bytes} [Mon Jun 20 12:34:13 2022] DELETE /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a/os-volume_attachments/d1ee6cee-0929-4444-81c2-fab2b7af4fbe => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:34:13.839341 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b6b596ce-ca81-4842-95ee-e5fc918cfa12 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:13.840440 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b6b596ce-ca81-4842-95ee-e5fc918cfa12 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:13.873656 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b6b596ce-ca81-4842-95ee-e5fc918cfa12 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:13.874172 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b6b596ce-ca81-4842-95ee-e5fc918cfa12 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:13.875192 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b6b596ce-ca81-4842-95ee-e5fc918cfa12 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:13.875699 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b6b596ce-ca81-4842-95ee-e5fc918cfa12 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:13.937257 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b6b596ce-ca81-4842-95ee-e5fc918cfa12 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104415 Jun 20 12:34:13.938314 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3031/6156] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:34:13 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:34:14.954059 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7c1f5712-de22-4799-a496-570810afcb76 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:14.955183 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7c1f5712-de22-4799-a496-570810afcb76 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:14.982216 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c1f5712-de22-4799-a496-570810afcb76 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:14.982939 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c1f5712-de22-4799-a496-570810afcb76 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:14.983909 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c1f5712-de22-4799-a496-570810afcb76 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:14.984525 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c1f5712-de22-4799-a496-570810afcb76 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:15.067342 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7c1f5712-de22-4799-a496-570810afcb76 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121249 Jun 20 12:34:15.067955 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3126/6157] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:34:14 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:34:16.081059 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2f1f0b3b-e562-49b8-a324-3920a71a8a3d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:16.082557 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2f1f0b3b-e562-49b8-a324-3920a71a8a3d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:16.101190 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2f1f0b3b-e562-49b8-a324-3920a71a8a3d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:16.101790 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2f1f0b3b-e562-49b8-a324-3920a71a8a3d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:16.104023 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2f1f0b3b-e562-49b8-a324-3920a71a8a3d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:16.105612 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2f1f0b3b-e562-49b8-a324-3920a71a8a3d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:16.188162 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2f1f0b3b-e562-49b8-a324-3920a71a8a3d tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112533 Jun 20 12:34:16.189734 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3032/6158] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:34:16 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:34:17.204364 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b4203742-51a4-4e1e-bd01-0334e6ecece1 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:17.206343 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b4203742-51a4-4e1e-bd01-0334e6ecece1 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:17.225809 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b4203742-51a4-4e1e-bd01-0334e6ecece1 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:17.226707 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b4203742-51a4-4e1e-bd01-0334e6ecece1 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:17.227866 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b4203742-51a4-4e1e-bd01-0334e6ecece1 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:17.230277 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b4203742-51a4-4e1e-bd01-0334e6ecece1 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:17.347184 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b4203742-51a4-4e1e-bd01-0334e6ecece1 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148963 Jun 20 12:34:17.351491 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3127/6159] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:34:17 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:34:18.363437 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-259105dd-319d-4209-bad1-9a03ad0375eb tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:18.364454 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-259105dd-319d-4209-bad1-9a03ad0375eb tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:18.379837 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-259105dd-319d-4209-bad1-9a03ad0375eb tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:18.380336 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-259105dd-319d-4209-bad1-9a03ad0375eb tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:18.381233 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-259105dd-319d-4209-bad1-9a03ad0375eb tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:18.381574 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-259105dd-319d-4209-bad1-9a03ad0375eb tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:18.502171 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-259105dd-319d-4209-bad1-9a03ad0375eb tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125558 Jun 20 12:34:18.503819 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3033/6160] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:34:18 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:34:19.520348 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0dfccc61-742b-46ea-b5e8-60daad36d572 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:19.522411 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0dfccc61-742b-46ea-b5e8-60daad36d572 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:19.538823 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0dfccc61-742b-46ea-b5e8-60daad36d572 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:19.539812 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0dfccc61-742b-46ea-b5e8-60daad36d572 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:19.540852 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0dfccc61-742b-46ea-b5e8-60daad36d572 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:19.541622 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0dfccc61-742b-46ea-b5e8-60daad36d572 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:19.605104 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0dfccc61-742b-46ea-b5e8-60daad36d572 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093687 Jun 20 12:34:19.608111 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3128/6161] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:34:19 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:34:20.619039 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6e12ee5e-d607-4dc0-8829-0032c4a4ab94 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:20.620797 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6e12ee5e-d607-4dc0-8829-0032c4a4ab94 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:20.637723 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:34:20.645129 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6e12ee5e-d607-4dc0-8829-0032c4a4ab94 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:20.645832 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6e12ee5e-d607-4dc0-8829-0032c4a4ab94 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:20.647407 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6e12ee5e-d607-4dc0-8829-0032c4a4ab94 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:20.647998 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6e12ee5e-d607-4dc0-8829-0032c4a4ab94 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:20.651936 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=69 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:34:20.741321 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6e12ee5e-d607-4dc0-8829-0032c4a4ab94 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127195 Jun 20 12:34:20.742586 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3034/6162] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:34:20 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:34:21.754081 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fce0514f-6b9e-499d-81eb-eb79b64fc571 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:21.755101 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fce0514f-6b9e-499d-81eb-eb79b64fc571 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:21.765314 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:34:21.770703 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fce0514f-6b9e-499d-81eb-eb79b64fc571 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:21.772450 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fce0514f-6b9e-499d-81eb-eb79b64fc571 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:21.774074 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fce0514f-6b9e-499d-81eb-eb79b64fc571 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:21.775619 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fce0514f-6b9e-499d-81eb-eb79b64fc571 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:21.789511 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:34:21.849940 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fce0514f-6b9e-499d-81eb-eb79b64fc571 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.100028 Jun 20 12:34:21.851280 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3129/6163] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:34:21 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a/os-volume_attachments => generated 25 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:34:21.978892 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8073e59e-da8b-4435-93d7-c8075f035498 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:34:21.980780 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8073e59e-da8b-4435-93d7-c8075f035498 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:21.988796 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8073e59e-da8b-4435-93d7-c8075f035498 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:21.989548 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8073e59e-da8b-4435-93d7-c8075f035498 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:21.990519 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8073e59e-da8b-4435-93d7-c8075f035498 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:21.991654 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8073e59e-da8b-4435-93d7-c8075f035498 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:22.024300 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-8073e59e-da8b-4435-93d7-c8075f035498 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] HTTP exception thrown: Cannot 'reboot' instance 88270958-b36b-4d35-ac86-6816bbf97aad while it is in vm_state rescued Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8073e59e-da8b-4435-93d7-c8075f035498 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Request method failure captured: Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad/action HTTP/1.1 Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 28 Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGgSaQU2kYq6294w6QFKPq7A5QMR619m5qrTtjZvOh1Spd4jYt9SdDjLdFiaQeOKoAcYDnhjBb8DNFT4026Xi2z1eTCKzFIZr5YrYMMfaIT2h-JIX2uEPuAOwR8Q0Bfw8WTyUwuKuBg3lk8BU4yAsLY8apXUbOU50Mn1Bj2k7YSVmEI Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: eed49c99a6a64e779184cfde80a29a52 Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2064933160 Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eed49c99a6a64e779184cfde80a29a52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eed49c99a6a64e779184cfde80a29a52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eed49c99a6a64e779184cfde80a29a52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eed49c99a6a64e779184cfde80a29a52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2064933160 Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: eed49c99a6a64e779184cfde80a29a52 Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2064933160 Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServerRescueNegativeTestJSON-2064933160-project Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 8efa417e5eb04ea682201f30b003bd54 Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2064933160-project Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: {"reboot": {"type": "HARD"}} Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: exception: Cannot 'reboot' instance 88270958-b36b-4d35-ac86-6816bbf97aad while it is in vm_state rescued Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '88270958-b36b-4d35-ac86-6816bbf97aad', 'body': {'reboot': {'type': 'HARD'}}} Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3497, in reboot Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 88270958-b36b-4d35-ac86-6816bbf97aad in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 20 12:34:22.028014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 20 12:34:22.031105 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 88270958-b36b-4d35-ac86-6816bbf97aad while it is in vm_state rescued Jun 20 12:34:22.031105 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:34:22.031105 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:34:22.031105 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:34:22.031105 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:34:22.031105 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:34:22.031105 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:34:22.031105 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:34:22.031105 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:34:22.031105 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 88270958-b36b-4d35-ac86-6816bbf97aad while it is in vm_state rescued Jun 20 12:34:22.031105 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:34:22.033737 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8073e59e-da8b-4435-93d7-c8075f035498 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Returning 409 to user: Cannot 'reboot' instance 88270958-b36b-4d35-ac86-6816bbf97aad while it is in vm_state rescued {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:34:22.035190 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8073e59e-da8b-4435-93d7-c8075f035498 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "POST /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad/action" status: 409 len: 145 microversion: 2.1 time: 0.061463 Jun 20 12:34:22.036368 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3035/6164] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:34:21 2022] POST /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad/action => generated 145 bytes in 63 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:34:22.052422 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7ddc4198-6aff-4fb6-82e8-07c74c47c7a8 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:34:22.056781 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7ddc4198-6aff-4fb6-82e8-07c74c47c7a8 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:22.076012 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ddc4198-6aff-4fb6-82e8-07c74c47c7a8 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:22.076889 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ddc4198-6aff-4fb6-82e8-07c74c47c7a8 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:22.078236 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ddc4198-6aff-4fb6-82e8-07c74c47c7a8 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:22.079008 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ddc4198-6aff-4fb6-82e8-07c74c47c7a8 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:22.174451 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-7ddc4198-6aff-4fb6-82e8-07c74c47c7a8 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] HTTP exception thrown: Cannot 'rebuild' instance 88270958-b36b-4d35-ac86-6816bbf97aad while it is in vm_state rescued Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7ddc4198-6aff-4fb6-82e8-07c74c47c7a8 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Request method failure captured: Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad/action HTTP/1.1 Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 65 Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGgSaQU2kYq6294w6QFKPq7A5QMR619m5qrTtjZvOh1Spd4jYt9SdDjLdFiaQeOKoAcYDnhjBb8DNFT4026Xi2z1eTCKzFIZr5YrYMMfaIT2h-JIX2uEPuAOwR8Q0Bfw8WTyUwuKuBg3lk8BU4yAsLY8apXUbOU50Mn1Bj2k7YSVmEI Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: eed49c99a6a64e779184cfde80a29a52 Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2064933160 Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eed49c99a6a64e779184cfde80a29a52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eed49c99a6a64e779184cfde80a29a52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eed49c99a6a64e779184cfde80a29a52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eed49c99a6a64e779184cfde80a29a52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2064933160 Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: eed49c99a6a64e779184cfde80a29a52 Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2064933160 Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServerRescueNegativeTestJSON-2064933160-project Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 8efa417e5eb04ea682201f30b003bd54 Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2064933160-project Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: {"rebuild": {"imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83"}} Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: exception: Cannot 'rebuild' instance 88270958-b36b-4d35-ac86-6816bbf97aad while it is in vm_state rescued Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '88270958-b36b-4d35-ac86-6816bbf97aad', 'body': {'rebuild': {'imageRef': 'f16836cc-4e18-4bd0-b261-3865adf8cb83'}}} Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 88270958-b36b-4d35-ac86-6816bbf97aad in vm_state rescued. Cannot rebuild while the instance is in this state. Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:34:22.179893 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:34:22.195422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:34:22.195422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jun 20 12:34:22.195422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Jun 20 12:34:22.195422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 20 12:34:22.195422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 20 12:34:22.195422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 20 12:34:22.195422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 88270958-b36b-4d35-ac86-6816bbf97aad while it is in vm_state rescued Jun 20 12:34:22.195422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:34:22.195422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:34:22.195422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:34:22.195422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:34:22.195422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:34:22.195422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:34:22.195422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:34:22.195422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:34:22.195422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 88270958-b36b-4d35-ac86-6816bbf97aad while it is in vm_state rescued Jun 20 12:34:22.195422 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:34:22.195422 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7ddc4198-6aff-4fb6-82e8-07c74c47c7a8 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Returning 409 to user: Cannot 'rebuild' instance 88270958-b36b-4d35-ac86-6816bbf97aad while it is in vm_state rescued {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:34:22.195422 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7ddc4198-6aff-4fb6-82e8-07c74c47c7a8 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "POST /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad/action" status: 409 len: 146 microversion: 2.1 time: 0.139629 Jun 20 12:34:22.195422 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3130/6165] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:34:22 2022] POST /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad/action => generated 146 bytes in 144 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:34:22.203279 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cfd6083d-83d2-4692-835a-84c8bad05382 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:22.205521 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cfd6083d-83d2-4692-835a-84c8bad05382 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:22.217970 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cfd6083d-83d2-4692-835a-84c8bad05382 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:22.219451 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cfd6083d-83d2-4692-835a-84c8bad05382 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:22.220446 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cfd6083d-83d2-4692-835a-84c8bad05382 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:22.221031 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cfd6083d-83d2-4692-835a-84c8bad05382 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:22.258942 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cfd6083d-83d2-4692-835a-84c8bad05382 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:34:22.408173 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cfd6083d-83d2-4692-835a-84c8bad05382 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 204 len: 0 microversion: 2.1 time: 0.209160 Jun 20 12:34:22.409979 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3036/6166] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:34:22 2022] DELETE /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 12:34:22.423053 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6d2fdafb-0134-47d6-ae59-4b2dcbe61367 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:22.424094 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6d2fdafb-0134-47d6-ae59-4b2dcbe61367 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:22.433798 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6d2fdafb-0134-47d6-ae59-4b2dcbe61367 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:22.434590 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6d2fdafb-0134-47d6-ae59-4b2dcbe61367 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:22.435597 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6d2fdafb-0134-47d6-ae59-4b2dcbe61367 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:22.436289 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6d2fdafb-0134-47d6-ae59-4b2dcbe61367 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:22.750051 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6d2fdafb-0134-47d6-ae59-4b2dcbe61367 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:22.768577 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6d2fdafb-0134-47d6-ae59-4b2dcbe61367 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 200 len: 1687 microversion: 2.1 time: 0.352609 Jun 20 12:34:22.769730 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3131/6167] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:22 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 1687 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:34:23.259415 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8d9498b5-8c77-498d-89e0-36adfa3d7a9b tempest-TestAggregatesBasicOps-1645642477 tempest-TestAggregatesBasicOps-1645642477-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-364830572", "availability_zone": "foo_zone"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:34:23.261117 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:34:23.261117 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 12:34:23.262103 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.aggregate [None req-8d9498b5-8c77-498d-89e0-36adfa3d7a9b tempest-TestAggregatesBasicOps-1645642477 tempest-TestAggregatesBasicOps-1645642477-project-admin] Generated uuid 4d3367ff-dd54-47c0-abef-a0cb969bf3b2 for aggregate {{(pid=119128) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 20 12:34:23.298903 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8d9498b5-8c77-498d-89e0-36adfa3d7a9b tempest-TestAggregatesBasicOps-1645642477 tempest-TestAggregatesBasicOps-1645642477-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.199989 Jun 20 12:34:23.300141 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3037/6168] 10.222.0.27 () {60 vars in 1163 bytes} [Mon Jun 20 12:34:23 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:34:23.311457 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ffd9f36a-4899-4a0f-9a1d-3115f849ce20 tempest-TestAggregatesBasicOps-1645642477 tempest-TestAggregatesBasicOps-1645642477-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:34:23.314035 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:34:23.314035 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 12:34:23.348240 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ffd9f36a-4899-4a0f-9a1d-3115f849ce20 tempest-TestAggregatesBasicOps-1645642477 tempest-TestAggregatesBasicOps-1645642477-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.041197 Jun 20 12:34:23.349114 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3132/6169] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Jun 20 12:34:23 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:34:23.359778 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2603e734-0370-40e2-85b1-68a451ff06ae tempest-TestAggregatesBasicOps-1645642477 tempest-TestAggregatesBasicOps-1645642477-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:23.361144 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:34:23.361144 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 12:34:23.362522 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2603e734-0370-40e2-85b1-68a451ff06ae tempest-TestAggregatesBasicOps-1645642477 tempest-TestAggregatesBasicOps-1645642477-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:23.362975 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2603e734-0370-40e2-85b1-68a451ff06ae tempest-TestAggregatesBasicOps-1645642477 tempest-TestAggregatesBasicOps-1645642477-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:23.363791 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2603e734-0370-40e2-85b1-68a451ff06ae tempest-TestAggregatesBasicOps-1645642477 tempest-TestAggregatesBasicOps-1645642477-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:23.364249 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2603e734-0370-40e2-85b1-68a451ff06ae tempest-TestAggregatesBasicOps-1645642477 tempest-TestAggregatesBasicOps-1645642477-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:23.393884 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2603e734-0370-40e2-85b1-68a451ff06ae tempest-TestAggregatesBasicOps-1645642477 tempest-TestAggregatesBasicOps-1645642477-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.037720 Jun 20 12:34:23.394532 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3038/6170] 10.222.0.27 () {58 vars in 1175 bytes} [Mon Jun 20 12:34:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:34:23.406375 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-220a40e0-122e-4f1e-ab4c-ddd266623df4 tempest-TestAggregatesBasicOps-1645642477 tempest-TestAggregatesBasicOps-1645642477-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:23.407188 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:34:23.407188 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 12:34:23.420423 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-220a40e0-122e-4f1e-ab4c-ddd266623df4 tempest-TestAggregatesBasicOps-1645642477 tempest-TestAggregatesBasicOps-1645642477-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.018715 Jun 20 12:34:23.421022 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3133/6171] 10.222.0.27 () {58 vars in 1142 bytes} [Mon Jun 20 12:34:23 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:34:23.432741 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-24eb9f02-bbb2-47cb-ae41-593febf91393 tempest-TestAggregatesBasicOps-1645642477 tempest-TestAggregatesBasicOps-1645642477-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:34:23.435115 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:34:23.435115 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 12:34:23.444886 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-24eb9f02-bbb2-47cb-ae41-593febf91393 tempest-TestAggregatesBasicOps-1645642477 tempest-TestAggregatesBasicOps-1645642477-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:23.445247 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-24eb9f02-bbb2-47cb-ae41-593febf91393 tempest-TestAggregatesBasicOps-1645642477 tempest-TestAggregatesBasicOps-1645642477-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:23.670888 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-24eb9f02-bbb2-47cb-ae41-593febf91393 tempest-TestAggregatesBasicOps-1645642477 tempest-TestAggregatesBasicOps-1645642477-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.242721 Jun 20 12:34:23.677046 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3039/6172] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Jun 20 12:34:23 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:34:23.683452 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-413f0912-aee7-4b74-8ec3-a56a0ea99a5d tempest-TestAggregatesBasicOps-1645642477 tempest-TestAggregatesBasicOps-1645642477-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:23.684307 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:34:23.684307 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 12:34:23.721682 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-413f0912-aee7-4b74-8ec3-a56a0ea99a5d tempest-TestAggregatesBasicOps-1645642477 tempest-TestAggregatesBasicOps-1645642477-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.042985 Jun 20 12:34:23.722662 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3134/6173] 10.222.0.27 () {58 vars in 1151 bytes} [Mon Jun 20 12:34:23 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:34:23.733475 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9462c886-6843-4a0b-93cf-60e4841bbd0f tempest-TestAggregatesBasicOps-1645642477 tempest-TestAggregatesBasicOps-1645642477-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1295167928", "availability_zone": "foo_zone"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:34:23.734992 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:34:23.734992 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 12:34:23.793723 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-98330e2e-e86b-4891-b495-dc8acf2fac09 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:23.794375 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-98330e2e-e86b-4891-b495-dc8acf2fac09 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:23.798040 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9462c886-6843-4a0b-93cf-60e4841bbd0f tempest-TestAggregatesBasicOps-1645642477 tempest-TestAggregatesBasicOps-1645642477-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.060853 Jun 20 12:34:23.799078 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3040/6174] 10.222.0.27 () {60 vars in 1172 bytes} [Mon Jun 20 12:34:23 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:34:23.802508 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-98330e2e-e86b-4891-b495-dc8acf2fac09 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:23.803123 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-98330e2e-e86b-4891-b495-dc8acf2fac09 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:23.804467 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-98330e2e-e86b-4891-b495-dc8acf2fac09 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:23.805067 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-98330e2e-e86b-4891-b495-dc8acf2fac09 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:23.810514 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6e81e4cf-6cd1-46c1-89af-ad16203d11c5 tempest-TestAggregatesBasicOps-1645642477 tempest-TestAggregatesBasicOps-1645642477-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:34:23.811806 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:34:23.811806 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 12:34:23.839043 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6e81e4cf-6cd1-46c1-89af-ad16203d11c5 tempest-TestAggregatesBasicOps-1645642477 tempest-TestAggregatesBasicOps-1645642477-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.032095 Jun 20 12:34:23.844746 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3041/6175] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Jun 20 12:34:23 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:34:23.850809 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-25eeb1b0-f7d9-4991-8c11-3bbb2b8d2883 tempest-TestAggregatesBasicOps-1645642477 tempest-TestAggregatesBasicOps-1645642477-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:23.851605 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:34:23.851605 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 12:34:23.861858 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-25eeb1b0-f7d9-4991-8c11-3bbb2b8d2883 tempest-TestAggregatesBasicOps-1645642477 tempest-TestAggregatesBasicOps-1645642477-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.015631 Jun 20 12:34:23.871073 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3042/6176] 10.222.0.27 () {58 vars in 1151 bytes} [Mon Jun 20 12:34:23 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:34:23.877310 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-56f83953-005d-4b24-a1e9-f808a597563d tempest-TestAggregatesBasicOps-1645642477 tempest-TestAggregatesBasicOps-1645642477-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:34:23.878679 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:34:23.878679 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 12:34:23.888190 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-56f83953-005d-4b24-a1e9-f808a597563d tempest-TestAggregatesBasicOps-1645642477 tempest-TestAggregatesBasicOps-1645642477-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:23.900040 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-56f83953-005d-4b24-a1e9-f808a597563d tempest-TestAggregatesBasicOps-1645642477 tempest-TestAggregatesBasicOps-1645642477-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:24.000260 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-98330e2e-e86b-4891-b495-dc8acf2fac09 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:24.011632 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-98330e2e-e86b-4891-b495-dc8acf2fac09 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 200 len: 1687 microversion: 2.1 time: 0.228265 Jun 20 12:34:24.013114 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3135/6177] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:23 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 1687 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:34:24.101766 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-56f83953-005d-4b24-a1e9-f808a597563d tempest-TestAggregatesBasicOps-1645642477 tempest-TestAggregatesBasicOps-1645642477-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.229426 Jun 20 12:34:24.103264 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3043/6178] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Jun 20 12:34:23 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:34:24.113749 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-56b03410-def4-4820-9ba7-d75ee9434f2c tempest-TestAggregatesBasicOps-1645642477 tempest-TestAggregatesBasicOps-1645642477-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:24.114596 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:34:24.114596 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 12:34:24.140855 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-56b03410-def4-4820-9ba7-d75ee9434f2c tempest-TestAggregatesBasicOps-1645642477 tempest-TestAggregatesBasicOps-1645642477-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.030891 Jun 20 12:34:24.141638 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3136/6179] 10.222.0.27 () {58 vars in 1154 bytes} [Mon Jun 20 12:34:24 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 20 12:34:25.031384 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8867c939-17f1-428b-a4dc-44c7183d7b34 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:25.033820 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8867c939-17f1-428b-a4dc-44c7183d7b34 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:25.045660 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8867c939-17f1-428b-a4dc-44c7183d7b34 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:25.047194 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8867c939-17f1-428b-a4dc-44c7183d7b34 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:25.048267 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8867c939-17f1-428b-a4dc-44c7183d7b34 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:25.049596 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8867c939-17f1-428b-a4dc-44c7183d7b34 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:25.247143 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8867c939-17f1-428b-a4dc-44c7183d7b34 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:25.257029 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8867c939-17f1-428b-a4dc-44c7183d7b34 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 200 len: 1687 microversion: 2.1 time: 0.231104 Jun 20 12:34:25.259295 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3044/6180] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:25 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 1687 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:34:26.275794 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-578e8612-9c69-4204-9e1e-1575ae261312 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:26.277671 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-578e8612-9c69-4204-9e1e-1575ae261312 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:26.288637 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-578e8612-9c69-4204-9e1e-1575ae261312 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:26.295403 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-578e8612-9c69-4204-9e1e-1575ae261312 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:26.296856 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-578e8612-9c69-4204-9e1e-1575ae261312 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:26.301015 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-578e8612-9c69-4204-9e1e-1575ae261312 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:26.674673 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-578e8612-9c69-4204-9e1e-1575ae261312 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:26.684805 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-578e8612-9c69-4204-9e1e-1575ae261312 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 200 len: 1687 microversion: 2.1 time: 0.414216 Jun 20 12:34:26.685442 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3137/6181] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:26 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 1687 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:34:27.707296 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ee8165a1-71c3-4f01-98a9-113b240e73a2 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:27.708063 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ee8165a1-71c3-4f01-98a9-113b240e73a2 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:27.735457 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ee8165a1-71c3-4f01-98a9-113b240e73a2 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:27.736283 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ee8165a1-71c3-4f01-98a9-113b240e73a2 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:27.737630 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ee8165a1-71c3-4f01-98a9-113b240e73a2 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:27.738376 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ee8165a1-71c3-4f01-98a9-113b240e73a2 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:28.087482 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ee8165a1-71c3-4f01-98a9-113b240e73a2 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:28.096794 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ee8165a1-71c3-4f01-98a9-113b240e73a2 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 200 len: 1620 microversion: 2.1 time: 0.395434 Jun 20 12:34:28.096794 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3045/6182] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:27 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 1620 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:34:28.217151 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-7103036c-0b0d-4f66-824e-87c1f1776538 req-b2d63c53-6996-402f-bcb4-96e4124aeb03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c987561-0d7f-495d-9422-99a32b18357a", "name": "network-vif-deleted", "tag": "0ba6654d-5537-45cc-b2ee-add339c1b1a6"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:34:28.249170 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-7103036c-0b0d-4f66-824e-87c1f1776538 req-b2d63c53-6996-402f-bcb4-96e4124aeb03 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:28.250080 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-7103036c-0b0d-4f66-824e-87c1f1776538 req-b2d63c53-6996-402f-bcb4-96e4124aeb03 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:28.314562 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-7103036c-0b0d-4f66-824e-87c1f1776538 req-b2d63c53-6996-402f-bcb4-96e4124aeb03 service nova] Creating event network-vif-deleted:0ba6654d-5537-45cc-b2ee-add339c1b1a6 for instance 4c987561-0d7f-495d-9422-99a32b18357a on n-h2-master-1 Jun 20 12:34:28.337594 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-7103036c-0b0d-4f66-824e-87c1f1776538 req-b2d63c53-6996-402f-bcb4-96e4124aeb03 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129087 Jun 20 12:34:28.347021 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3138/6183] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:34:29.117045 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1968f8eb-bca5-4dbb-bef8-6fd5786eb9c3 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:29.118220 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1968f8eb-bca5-4dbb-bef8-6fd5786eb9c3 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 4c987561-0d7f-495d-9422-99a32b18357a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:29.138632 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1968f8eb-bca5-4dbb-bef8-6fd5786eb9c3 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:29.142868 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1968f8eb-bca5-4dbb-bef8-6fd5786eb9c3 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:29.143827 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1968f8eb-bca5-4dbb-bef8-6fd5786eb9c3 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:29.144378 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1968f8eb-bca5-4dbb-bef8-6fd5786eb9c3 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:29.193089 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-1968f8eb-bca5-4dbb-bef8-6fd5786eb9c3 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] HTTP exception thrown: Instance 4c987561-0d7f-495d-9422-99a32b18357a could not be found. Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1968f8eb-bca5-4dbb-bef8-6fd5786eb9c3 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Request method failure captured: Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a HTTP/1.1 Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGgSaQU2kYq6294w6QFKPq7A5QMR619m5qrTtjZvOh1Spd4jYt9SdDjLdFiaQeOKoAcYDnhjBb8DNFT4026Xi2z1eTCKzFIZr5YrYMMfaIT2h-JIX2uEPuAOwR8Q0Bfw8WTyUwuKuBg3lk8BU4yAsLY8apXUbOU50Mn1Bj2k7YSVmEI Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: eed49c99a6a64e779184cfde80a29a52 Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2064933160 Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eed49c99a6a64e779184cfde80a29a52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eed49c99a6a64e779184cfde80a29a52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eed49c99a6a64e779184cfde80a29a52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eed49c99a6a64e779184cfde80a29a52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2064933160 Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: eed49c99a6a64e779184cfde80a29a52 Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2064933160 Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServerRescueNegativeTestJSON-2064933160-project Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 8efa417e5eb04ea682201f30b003bd54 Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2064933160-project Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 4c987561-0d7f-495d-9422-99a32b18357a could not be found. Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '4c987561-0d7f-495d-9422-99a32b18357a'} Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c987561-0d7f-495d-9422-99a32b18357a could not be found. Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c987561-0d7f-495d-9422-99a32b18357a could not be found. Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:34:29.201469 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:34:29.205603 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:34:29.205603 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:34:29.205603 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:34:29.205603 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:34:29.205603 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:34:29.205603 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:34:29.205603 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c987561-0d7f-495d-9422-99a32b18357a could not be found. Jun 20 12:34:29.205603 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:34:29.207436 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1968f8eb-bca5-4dbb-bef8-6fd5786eb9c3 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Returning 404 to user: Instance 4c987561-0d7f-495d-9422-99a32b18357a could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:34:29.212522 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1968f8eb-bca5-4dbb-bef8-6fd5786eb9c3 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a" status: 404 len: 111 microversion: 2.1 time: 0.099318 Jun 20 12:34:29.214514 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3046/6184] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:29 2022] GET /compute/v2.1/servers/4c987561-0d7f-495d-9422-99a32b18357a => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:34:29.232890 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ab5c59f7-89f9-493b-bc10-53990fbd7f34 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '.version_select at 0x7f60849953a0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:29.261559 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ab5c59f7-89f9-493b-bc10-53990fbd7f34 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1132091155" status: 202 len: 0 microversion: 2.1 time: 0.040236 Jun 20 12:34:29.267382 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3139/6185] 10.222.0.27 () {58 vars in 1220 bytes} [Mon Jun 20 12:34:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1132091155 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:34:37.540673 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c969c8eb-b74f-4545-bd75-19a5711ab014 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:37.542534 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c969c8eb-b74f-4545-bd75-19a5711ab014 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:37.549495 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:34:37.563081 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c969c8eb-b74f-4545-bd75-19a5711ab014 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:37.565742 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c969c8eb-b74f-4545-bd75-19a5711ab014 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:37.566609 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c969c8eb-b74f-4545-bd75-19a5711ab014 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:37.567220 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c969c8eb-b74f-4545-bd75-19a5711ab014 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:37.667262 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c969c8eb-b74f-4545-bd75-19a5711ab014 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:34:37.851944 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c969c8eb-b74f-4545-bd75-19a5711ab014 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "DELETE /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 204 len: 0 microversion: 2.1 time: 0.316101 Jun 20 12:34:37.860746 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3047/6186] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:34:37 2022] DELETE /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:34:37.892790 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c6367a5e-14e8-4b32-b364-6bc64387e385 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:37.896330 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c6367a5e-14e8-4b32-b364-6bc64387e385 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:37.919480 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6367a5e-14e8-4b32-b364-6bc64387e385 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:37.921015 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6367a5e-14e8-4b32-b364-6bc64387e385 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:37.923543 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6367a5e-14e8-4b32-b364-6bc64387e385 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:37.924756 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6367a5e-14e8-4b32-b364-6bc64387e385 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:38.244634 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c6367a5e-14e8-4b32-b364-6bc64387e385 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:38.264054 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c6367a5e-14e8-4b32-b364-6bc64387e385 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1508 microversion: 2.1 time: 0.398379 Jun 20 12:34:38.273518 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3140/6187] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:37 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1508 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:34:39.292978 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-792abe74-5258-4e5e-8361-98aa8c0fb049 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:39.294548 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-792abe74-5258-4e5e-8361-98aa8c0fb049 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:39.315530 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-792abe74-5258-4e5e-8361-98aa8c0fb049 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:39.318465 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-792abe74-5258-4e5e-8361-98aa8c0fb049 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:39.323045 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-792abe74-5258-4e5e-8361-98aa8c0fb049 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:39.328162 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-792abe74-5258-4e5e-8361-98aa8c0fb049 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:39.668119 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-792abe74-5258-4e5e-8361-98aa8c0fb049 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:39.681505 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-792abe74-5258-4e5e-8361-98aa8c0fb049 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1508 microversion: 2.1 time: 0.402244 Jun 20 12:34:39.683579 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3048/6188] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:39 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1508 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:34:40.034338 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-4424771f-5db8-421b-a250-9a1547e389d2 req-41d27931-35fb-49bd-a336-b20781f949e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88270958-b36b-4d35-ac86-6816bbf97aad", "name": "network-vif-deleted", "tag": "7461aa0e-58fa-4b3e-9fee-6033861eff89"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:34:40.065277 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-4424771f-5db8-421b-a250-9a1547e389d2 req-41d27931-35fb-49bd-a336-b20781f949e6 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:40.067424 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-4424771f-5db8-421b-a250-9a1547e389d2 req-41d27931-35fb-49bd-a336-b20781f949e6 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:40.096562 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-4424771f-5db8-421b-a250-9a1547e389d2 req-41d27931-35fb-49bd-a336-b20781f949e6 service nova] Creating event network-vif-deleted:7461aa0e-58fa-4b3e-9fee-6033861eff89 for instance 88270958-b36b-4d35-ac86-6816bbf97aad on n-h1-master-1 Jun 20 12:34:40.103840 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-4424771f-5db8-421b-a250-9a1547e389d2 req-41d27931-35fb-49bd-a336-b20781f949e6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073343 Jun 20 12:34:40.108655 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3141/6189] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:34:40.702978 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-118cea96-d76f-4df6-8d09-8a5ed32bfdac tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:40.703650 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-118cea96-d76f-4df6-8d09-8a5ed32bfdac tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:40.718828 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-118cea96-d76f-4df6-8d09-8a5ed32bfdac tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:40.719480 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-118cea96-d76f-4df6-8d09-8a5ed32bfdac tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:40.720480 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-118cea96-d76f-4df6-8d09-8a5ed32bfdac tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:40.721074 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-118cea96-d76f-4df6-8d09-8a5ed32bfdac tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:40.794982 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-118cea96-d76f-4df6-8d09-8a5ed32bfdac tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:40.795445 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-118cea96-d76f-4df6-8d09-8a5ed32bfdac tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:40.795913 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-118cea96-d76f-4df6-8d09-8a5ed32bfdac tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lazy-loading 'fault' on Instance uuid 88270958-b36b-4d35-ac86-6816bbf97aad {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:34:40.941451 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-118cea96-d76f-4df6-8d09-8a5ed32bfdac tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:40.950577 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-118cea96-d76f-4df6-8d09-8a5ed32bfdac tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 200 len: 1312 microversion: 2.1 time: 0.253888 Jun 20 12:34:40.951182 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3049/6190] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:40 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 1312 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:34:41.986901 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0f2d9937-6aae-4f88-ab83-dc1439e96203 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:41.987767 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0f2d9937-6aae-4f88-ab83-dc1439e96203 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 88270958-b36b-4d35-ac86-6816bbf97aad] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:41.999775 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f2d9937-6aae-4f88-ab83-dc1439e96203 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:42.000252 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f2d9937-6aae-4f88-ab83-dc1439e96203 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:42.001212 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f2d9937-6aae-4f88-ab83-dc1439e96203 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:42.002441 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f2d9937-6aae-4f88-ab83-dc1439e96203 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:42.039055 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-0f2d9937-6aae-4f88-ab83-dc1439e96203 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] HTTP exception thrown: Instance 88270958-b36b-4d35-ac86-6816bbf97aad could not be found. Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0f2d9937-6aae-4f88-ab83-dc1439e96203 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Request method failure captured: Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad HTTP/1.1 Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGgSaQU2kYq6294w6QFKPq7A5QMR619m5qrTtjZvOh1Spd4jYt9SdDjLdFiaQeOKoAcYDnhjBb8DNFT4026Xi2z1eTCKzFIZr5YrYMMfaIT2h-JIX2uEPuAOwR8Q0Bfw8WTyUwuKuBg3lk8BU4yAsLY8apXUbOU50Mn1Bj2k7YSVmEI Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: eed49c99a6a64e779184cfde80a29a52 Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2064933160 Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eed49c99a6a64e779184cfde80a29a52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eed49c99a6a64e779184cfde80a29a52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eed49c99a6a64e779184cfde80a29a52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eed49c99a6a64e779184cfde80a29a52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2064933160 Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: eed49c99a6a64e779184cfde80a29a52 Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2064933160 Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServerRescueNegativeTestJSON-2064933160-project Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 8efa417e5eb04ea682201f30b003bd54 Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2064933160-project Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 88270958-b36b-4d35-ac86-6816bbf97aad could not be found. Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '88270958-b36b-4d35-ac86-6816bbf97aad'} Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88270958-b36b-4d35-ac86-6816bbf97aad could not be found. Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88270958-b36b-4d35-ac86-6816bbf97aad could not be found. Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:34:42.041104 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:34:42.045314 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:34:42.045314 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:34:42.045314 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:34:42.045314 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:34:42.045314 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:34:42.045314 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:34:42.045314 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88270958-b36b-4d35-ac86-6816bbf97aad could not be found. Jun 20 12:34:42.045314 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:34:42.047624 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0f2d9937-6aae-4f88-ab83-dc1439e96203 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Returning 404 to user: Instance 88270958-b36b-4d35-ac86-6816bbf97aad could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:34:42.048857 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0f2d9937-6aae-4f88-ab83-dc1439e96203 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad" status: 404 len: 111 microversion: 2.1 time: 0.082673 Jun 20 12:34:42.058858 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-42604e3f-29dd-438c-923a-6086b604055e tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:42.060100 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-42604e3f-29dd-438c-923a-6086b604055e tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 0f46a132-c8ab-41ae-bd97-ec97591f4a4f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:42.060601 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3142/6191] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:41 2022] GET /compute/v2.1/servers/88270958-b36b-4d35-ac86-6816bbf97aad => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:34:42.070476 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-42604e3f-29dd-438c-923a-6086b604055e tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:42.071241 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-42604e3f-29dd-438c-923a-6086b604055e tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:42.072475 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-42604e3f-29dd-438c-923a-6086b604055e tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:42.073240 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-42604e3f-29dd-438c-923a-6086b604055e tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:42.114316 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-42604e3f-29dd-438c-923a-6086b604055e tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 0f46a132-c8ab-41ae-bd97-ec97591f4a4f] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:34:42.253827 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-42604e3f-29dd-438c-923a-6086b604055e tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f" status: 204 len: 0 microversion: 2.1 time: 0.199375 Jun 20 12:34:42.254715 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3050/6192] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:34:42 2022] DELETE /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:34:42.263872 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ff1eaeaa-de60-46b8-a118-646854933922 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:42.264498 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ff1eaeaa-de60-46b8-a118-646854933922 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 0f46a132-c8ab-41ae-bd97-ec97591f4a4f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:42.274759 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff1eaeaa-de60-46b8-a118-646854933922 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:42.276974 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff1eaeaa-de60-46b8-a118-646854933922 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:42.281515 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff1eaeaa-de60-46b8-a118-646854933922 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:42.282190 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff1eaeaa-de60-46b8-a118-646854933922 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:42.604295 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ff1eaeaa-de60-46b8-a118-646854933922 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:42.629896 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ff1eaeaa-de60-46b8-a118-646854933922 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f" status: 200 len: 1521 microversion: 2.1 time: 0.366183 Jun 20 12:34:42.630558 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3143/6193] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:42 2022] GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f => generated 1521 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:34:43.649010 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0c453b4f-8d15-4026-ae9a-b7595c458fb6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:43.649797 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0c453b4f-8d15-4026-ae9a-b7595c458fb6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 0f46a132-c8ab-41ae-bd97-ec97591f4a4f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:43.666075 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c453b4f-8d15-4026-ae9a-b7595c458fb6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:43.668554 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c453b4f-8d15-4026-ae9a-b7595c458fb6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:43.671966 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c453b4f-8d15-4026-ae9a-b7595c458fb6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:43.672494 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c453b4f-8d15-4026-ae9a-b7595c458fb6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:43.936099 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0c453b4f-8d15-4026-ae9a-b7595c458fb6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:43.939926 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:34:43.957108 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0c453b4f-8d15-4026-ae9a-b7595c458fb6 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f" status: 200 len: 1521 microversion: 2.1 time: 0.313252 Jun 20 12:34:43.959683 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3051/6194] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:43 2022] GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:34:44.976287 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-76536a6b-939c-4bea-8e20-adbcb5bfd027 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:44.976978 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-76536a6b-939c-4bea-8e20-adbcb5bfd027 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 0f46a132-c8ab-41ae-bd97-ec97591f4a4f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:44.988971 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-76536a6b-939c-4bea-8e20-adbcb5bfd027 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:44.991871 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-76536a6b-939c-4bea-8e20-adbcb5bfd027 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:44.992950 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-76536a6b-939c-4bea-8e20-adbcb5bfd027 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:44.994977 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-76536a6b-939c-4bea-8e20-adbcb5bfd027 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:45.261280 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-76536a6b-939c-4bea-8e20-adbcb5bfd027 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:45.275899 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-76536a6b-939c-4bea-8e20-adbcb5bfd027 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f" status: 200 len: 1521 microversion: 2.1 time: 0.301659 Jun 20 12:34:45.277774 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3144/6195] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:44 2022] GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:34:46.297184 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8f20ba41-3ebb-4b4f-928d-424ffbfa1279 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:46.297986 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8f20ba41-3ebb-4b4f-928d-424ffbfa1279 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 0f46a132-c8ab-41ae-bd97-ec97591f4a4f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:46.324592 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8f20ba41-3ebb-4b4f-928d-424ffbfa1279 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:46.325047 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8f20ba41-3ebb-4b4f-928d-424ffbfa1279 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:46.325984 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8f20ba41-3ebb-4b4f-928d-424ffbfa1279 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:46.326425 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8f20ba41-3ebb-4b4f-928d-424ffbfa1279 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:46.601273 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-e59c0176-a70f-42a4-9078-972e9a431ba9 req-37ff7c0c-2c83-45a9-8d1d-c73b125fab70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f46a132-c8ab-41ae-bd97-ec97591f4a4f", "name": "network-vif-deleted", "tag": "9bd93826-9442-4316-9ba3-6a2a9f4cde9a"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:34:46.614626 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8f20ba41-3ebb-4b4f-928d-424ffbfa1279 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa417e5eb04ea682201f30b003bd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed49c99a6a64e779184cfde80a29a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:46.617706 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-e59c0176-a70f-42a4-9078-972e9a431ba9 req-37ff7c0c-2c83-45a9-8d1d-c73b125fab70 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:46.619058 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-e59c0176-a70f-42a4-9078-972e9a431ba9 req-37ff7c0c-2c83-45a9-8d1d-c73b125fab70 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:46.631618 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8f20ba41-3ebb-4b4f-928d-424ffbfa1279 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f" status: 200 len: 1479 microversion: 2.1 time: 0.340772 Jun 20 12:34:46.636717 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3052/6196] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:46 2022] GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f => generated 1479 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:34:46.677315 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-e59c0176-a70f-42a4-9078-972e9a431ba9 req-37ff7c0c-2c83-45a9-8d1d-c73b125fab70 service nova] Creating event network-vif-deleted:9bd93826-9442-4316-9ba3-6a2a9f4cde9a for instance 0f46a132-c8ab-41ae-bd97-ec97591f4a4f on n-h1-master-1 Jun 20 12:34:46.694465 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-e59c0176-a70f-42a4-9078-972e9a431ba9 req-37ff7c0c-2c83-45a9-8d1d-c73b125fab70 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100222 Jun 20 12:34:46.696262 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3145/6197] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:34:47.652484 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7bdc4944-7e76-4023-b971-c005c6a5d490 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:47.653209 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7bdc4944-7e76-4023-b971-c005c6a5d490 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] [instance: 0f46a132-c8ab-41ae-bd97-ec97591f4a4f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:47.660835 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7bdc4944-7e76-4023-b971-c005c6a5d490 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:47.661311 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7bdc4944-7e76-4023-b971-c005c6a5d490 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:47.662113 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7bdc4944-7e76-4023-b971-c005c6a5d490 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:47.662497 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7bdc4944-7e76-4023-b971-c005c6a5d490 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:47.677116 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-7bdc4944-7e76-4023-b971-c005c6a5d490 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] HTTP exception thrown: Instance 0f46a132-c8ab-41ae-bd97-ec97591f4a4f could not be found. Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7bdc4944-7e76-4023-b971-c005c6a5d490 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Request method failure captured: Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f HTTP/1.1 Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGgSaQU2kYq6294w6QFKPq7A5QMR619m5qrTtjZvOh1Spd4jYt9SdDjLdFiaQeOKoAcYDnhjBb8DNFT4026Xi2z1eTCKzFIZr5YrYMMfaIT2h-JIX2uEPuAOwR8Q0Bfw8WTyUwuKuBg3lk8BU4yAsLY8apXUbOU50Mn1Bj2k7YSVmEI Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: eed49c99a6a64e779184cfde80a29a52 Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2064933160 Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eed49c99a6a64e779184cfde80a29a52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eed49c99a6a64e779184cfde80a29a52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eed49c99a6a64e779184cfde80a29a52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eed49c99a6a64e779184cfde80a29a52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2064933160 Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: eed49c99a6a64e779184cfde80a29a52 Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2064933160 Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServerRescueNegativeTestJSON-2064933160-project Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 8efa417e5eb04ea682201f30b003bd54 Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2064933160-project Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 0f46a132-c8ab-41ae-bd97-ec97591f4a4f could not be found. Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '0f46a132-c8ab-41ae-bd97-ec97591f4a4f'} Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f46a132-c8ab-41ae-bd97-ec97591f4a4f could not be found. Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f46a132-c8ab-41ae-bd97-ec97591f4a4f could not be found. Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:34:47.682677 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:34:47.687239 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:34:47.687239 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:34:47.687239 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:34:47.687239 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:34:47.687239 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:34:47.687239 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:34:47.687239 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f46a132-c8ab-41ae-bd97-ec97591f4a4f could not be found. Jun 20 12:34:47.687239 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:34:47.687239 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7bdc4944-7e76-4023-b971-c005c6a5d490 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] Returning 404 to user: Instance 0f46a132-c8ab-41ae-bd97-ec97591f4a4f could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:34:47.687239 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7bdc4944-7e76-4023-b971-c005c6a5d490 tempest-ServerRescueNegativeTestJSON-2064933160 tempest-ServerRescueNegativeTestJSON-2064933160-project] 10.222.0.27 "GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f" status: 404 len: 111 microversion: 2.1 time: 0.037018 Jun 20 12:34:47.687239 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3053/6198] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:47 2022] GET /compute/v2.1/servers/0f46a132-c8ab-41ae-bd97-ec97591f4a4f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:34:48.587865 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f041144c-bd13-4859-ba96-cfd7fabded1c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-818539622", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "f9eb724c-6278-4c82-922e-6b97d763c833", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fda59e99-54c8-4d95-ad3c-e4129b9a154d"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:34:48.676698 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-f041144c-bd13-4859-ba96-cfd7fabded1c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] validate_networks() for [('fda59e99-54c8-4d95-ad3c-e4129b9a154d', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:34:49.609668 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-f041144c-bd13-4859-ba96-cfd7fabded1c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:34:49.610252 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-f041144c-bd13-4859-ba96-cfd7fabded1c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:34:49.610738 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-f041144c-bd13-4859-ba96-cfd7fabded1c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:34:49.611245 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-f041144c-bd13-4859-ba96-cfd7fabded1c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:34:49.611749 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-f041144c-bd13-4859-ba96-cfd7fabded1c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:34:49.631325 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f041144c-bd13-4859-ba96-cfd7fabded1c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:49.635888 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f041144c-bd13-4859-ba96-cfd7fabded1c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:49.637171 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f041144c-bd13-4859-ba96-cfd7fabded1c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:49.637816 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f041144c-bd13-4859-ba96-cfd7fabded1c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:49.692643 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-f041144c-bd13-4859-ba96-cfd7fabded1c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Getting quotas for project 5a9c7bbcc9a149f5b77a89141a306c3e. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:34:49.704410 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-f041144c-bd13-4859-ba96-cfd7fabded1c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Getting quotas for user fed0afc129364664aed8d8a96f499831 and project 5a9c7bbcc9a149f5b77a89141a306c3e. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:34:49.850754 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f041144c-bd13-4859-ba96-cfd7fabded1c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:34:49.855766 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f041144c-bd13-4859-ba96-cfd7fabded1c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 6fed9595-534e-43fc-bd3b-1c63793c7de8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f9eb724c-6278-4c82-922e-6b97d763c833',volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:34:50.138747 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f041144c-bd13-4859-ba96-cfd7fabded1c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.558680 Jun 20 12:34:50.140460 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3146/6199] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:34:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:34:50.158530 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-16131042-ac0e-4c82-a36a-7e946c1955f0 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:50.159941 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-16131042-ac0e-4c82-a36a-7e946c1955f0 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 6fed9595-534e-43fc-bd3b-1c63793c7de8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:50.274643 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-16131042-ac0e-4c82-a36a-7e946c1955f0 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:50.325088 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-16131042-ac0e-4c82-a36a-7e946c1955f0 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8" status: 200 len: 1056 microversion: 2.1 time: 0.177987 Jun 20 12:34:50.329205 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3054/6200] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:50 2022] GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8 => generated 1056 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:34:51.348437 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a7b2092f-e091-4b0e-87b0-70ef5f5c6ead tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:51.349229 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a7b2092f-e091-4b0e-87b0-70ef5f5c6ead tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 6fed9595-534e-43fc-bd3b-1c63793c7de8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:51.363708 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a7b2092f-e091-4b0e-87b0-70ef5f5c6ead tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:51.365540 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a7b2092f-e091-4b0e-87b0-70ef5f5c6ead tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:51.368046 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a7b2092f-e091-4b0e-87b0-70ef5f5c6ead tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:51.368813 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a7b2092f-e091-4b0e-87b0-70ef5f5c6ead tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:51.504650 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a7b2092f-e091-4b0e-87b0-70ef5f5c6ead tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:51.516273 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a7b2092f-e091-4b0e-87b0-70ef5f5c6ead tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8" status: 200 len: 1154 microversion: 2.1 time: 0.173328 Jun 20 12:34:51.517029 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3147/6201] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:51 2022] GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8 => generated 1154 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:34:52.536741 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-36bc2d36-9802-4939-9f6f-fbe22a9f4952 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:52.537942 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-36bc2d36-9802-4939-9f6f-fbe22a9f4952 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 6fed9595-534e-43fc-bd3b-1c63793c7de8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:52.542180 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=4,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:34:52.551749 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-36bc2d36-9802-4939-9f6f-fbe22a9f4952 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:52.555767 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-36bc2d36-9802-4939-9f6f-fbe22a9f4952 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:52.557189 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-36bc2d36-9802-4939-9f6f-fbe22a9f4952 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:52.561200 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-36bc2d36-9802-4939-9f6f-fbe22a9f4952 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:52.779401 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-36bc2d36-9802-4939-9f6f-fbe22a9f4952 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:52.792681 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-36bc2d36-9802-4939-9f6f-fbe22a9f4952 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8" status: 200 len: 1172 microversion: 2.1 time: 0.258118 Jun 20 12:34:52.795004 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3055/6202] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:52 2022] GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8 => generated 1172 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:34:53.815006 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1a5cbb8a-dea4-4158-b37d-b3c981c3df53 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:53.816236 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1a5cbb8a-dea4-4158-b37d-b3c981c3df53 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 6fed9595-534e-43fc-bd3b-1c63793c7de8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:53.821539 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:34:53.842637 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a5cbb8a-dea4-4158-b37d-b3c981c3df53 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:53.843118 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a5cbb8a-dea4-4158-b37d-b3c981c3df53 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:53.843939 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a5cbb8a-dea4-4158-b37d-b3c981c3df53 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:53.844431 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a5cbb8a-dea4-4158-b37d-b3c981c3df53 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:53.875538 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=62 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:34:54.415985 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1a5cbb8a-dea4-4158-b37d-b3c981c3df53 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:54.424017 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1a5cbb8a-dea4-4158-b37d-b3c981c3df53 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8" status: 200 len: 1214 microversion: 2.1 time: 0.616099 Jun 20 12:34:54.437243 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3148/6203] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:53 2022] GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8 => generated 1214 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:34:55.448300 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3e47d7d8-5868-4ebb-9cb5-9c7a9525feaf tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:55.454905 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3e47d7d8-5868-4ebb-9cb5-9c7a9525feaf tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 6fed9595-534e-43fc-bd3b-1c63793c7de8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:55.481779 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3e47d7d8-5868-4ebb-9cb5-9c7a9525feaf tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:55.493040 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3e47d7d8-5868-4ebb-9cb5-9c7a9525feaf tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:55.496782 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3e47d7d8-5868-4ebb-9cb5-9c7a9525feaf tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:55.498527 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3e47d7d8-5868-4ebb-9cb5-9c7a9525feaf tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:56.118088 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3e47d7d8-5868-4ebb-9cb5-9c7a9525feaf tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:56.126606 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3e47d7d8-5868-4ebb-9cb5-9c7a9525feaf tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8" status: 200 len: 1214 microversion: 2.1 time: 0.687002 Jun 20 12:34:56.137720 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3056/6204] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:55 2022] GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8 => generated 1214 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:34:56.275153 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-707cba6a-561b-48c2-abba-b4d54ae30f8b req-a1334135-e719-4d3b-81c7-7a7d95470842 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fed9595-534e-43fc-bd3b-1c63793c7de8", "tag": "83aff13b-19c1-4ac4-8853-1b6220ac4764"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:34:56.302445 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-707cba6a-561b-48c2-abba-b4d54ae30f8b req-a1334135-e719-4d3b-81c7-7a7d95470842 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:56.304407 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-707cba6a-561b-48c2-abba-b4d54ae30f8b req-a1334135-e719-4d3b-81c7-7a7d95470842 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:56.334825 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-707cba6a-561b-48c2-abba-b4d54ae30f8b req-a1334135-e719-4d3b-81c7-7a7d95470842 service nova] Creating event network-changed:83aff13b-19c1-4ac4-8853-1b6220ac4764 for instance 6fed9595-534e-43fc-bd3b-1c63793c7de8 on n-h1-master-1 Jun 20 12:34:56.354891 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-707cba6a-561b-48c2-abba-b4d54ae30f8b req-a1334135-e719-4d3b-81c7-7a7d95470842 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087480 Jun 20 12:34:56.355521 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3149/6205] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:34:56.920853 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-71d56fef-a4a4-446f-b503-e5a5ebba83e6 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:56.921839 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:34:56.921839 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 12:34:56.923180 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-71d56fef-a4a4-446f-b503-e5a5ebba83e6 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:56.923725 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-71d56fef-a4a4-446f-b503-e5a5ebba83e6 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:56.924666 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-71d56fef-a4a4-446f-b503-e5a5ebba83e6 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:56.925217 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-71d56fef-a4a4-446f-b503-e5a5ebba83e6 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:57.009730 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-71d56fef-a4a4-446f-b503-e5a5ebba83e6 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] 10.222.0.27 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.640657 Jun 20 12:34:57.015853 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3057/6206] 10.222.0.27 () {58 vars in 1184 bytes} [Mon Jun 20 12:34:56 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:34:57.154616 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b964fd75-c160-4791-9c09-1838bae0f093 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:57.155338 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b964fd75-c160-4791-9c09-1838bae0f093 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 6fed9595-534e-43fc-bd3b-1c63793c7de8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:57.174413 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b964fd75-c160-4791-9c09-1838bae0f093 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:57.174877 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b964fd75-c160-4791-9c09-1838bae0f093 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:57.175677 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b964fd75-c160-4791-9c09-1838bae0f093 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:57.176120 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b964fd75-c160-4791-9c09-1838bae0f093 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:57.251465 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5ec51d83-f2c3-4191-8ef9-97fc8462ca10 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-2080819498", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "availability_zone": "nova:n-h2-master-1", "networks": [{"uuid": "c65d10ce-124f-4369-a021-29e9cd1036ba"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:34:57.378402 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-5ec51d83-f2c3-4191-8ef9-97fc8462ca10 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] validate_networks() for [('c65d10ce-124f-4369-a021-29e9cd1036ba', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:34:57.471436 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b964fd75-c160-4791-9c09-1838bae0f093 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:57.481486 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b964fd75-c160-4791-9c09-1838bae0f093 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8" status: 200 len: 1214 microversion: 2.1 time: 0.331692 Jun 20 12:34:57.498306 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3150/6207] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:57 2022] GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8 => generated 1214 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:34:58.499745 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-26325a7f-b812-4668-b48a-44a807ee7ba5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:58.500708 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-26325a7f-b812-4668-b48a-44a807ee7ba5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 6fed9595-534e-43fc-bd3b-1c63793c7de8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:58.519237 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-26325a7f-b812-4668-b48a-44a807ee7ba5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:58.519645 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-26325a7f-b812-4668-b48a-44a807ee7ba5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:58.525241 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-26325a7f-b812-4668-b48a-44a807ee7ba5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:58.526161 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-26325a7f-b812-4668-b48a-44a807ee7ba5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:58.766967 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-5ec51d83-f2c3-4191-8ef9-97fc8462ca10 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:34:58.767436 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-5ec51d83-f2c3-4191-8ef9-97fc8462ca10 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:34:58.767954 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-5ec51d83-f2c3-4191-8ef9-97fc8462ca10 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:34:58.768603 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-5ec51d83-f2c3-4191-8ef9-97fc8462ca10 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:34:58.769028 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-5ec51d83-f2c3-4191-8ef9-97fc8462ca10 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:34:58.788652 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5ec51d83-f2c3-4191-8ef9-97fc8462ca10 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:58.789028 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5ec51d83-f2c3-4191-8ef9-97fc8462ca10 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:58.796365 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5ec51d83-f2c3-4191-8ef9-97fc8462ca10 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:58.796835 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5ec51d83-f2c3-4191-8ef9-97fc8462ca10 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:58.826940 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-5ec51d83-f2c3-4191-8ef9-97fc8462ca10 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Getting quotas for project 7ee4e2c5e94d47d8ad9ee3016ddaf383. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:34:58.828291 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-26325a7f-b812-4668-b48a-44a807ee7ba5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:58.836351 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-26325a7f-b812-4668-b48a-44a807ee7ba5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8" status: 200 len: 1214 microversion: 2.1 time: 0.340622 Jun 20 12:34:58.837022 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3151/6208] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:58 2022] GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8 => generated 1214 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:34:58.839846 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-5ec51d83-f2c3-4191-8ef9-97fc8462ca10 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Getting quotas for user a7a4ea4ce30a4d75b3063a6931f50216 and project 7ee4e2c5e94d47d8ad9ee3016ddaf383. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:34:58.875832 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5ec51d83-f2c3-4191-8ef9-97fc8462ca10 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:34:58.880039 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5ec51d83-f2c3-4191-8ef9-97fc8462ca10 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] [instance: 488ce558-2908-4c52-b86d-f46904b69da8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:34:58.977697 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5ec51d83-f2c3-4191-8ef9-97fc8462ca10 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.729938 Jun 20 12:34:58.978641 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3058/6209] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:34:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:34:58.988755 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cd541bf4-b9b3-437b-a964-26561686d466 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:58.989625 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cd541bf4-b9b3-437b-a964-26561686d466 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] [instance: 488ce558-2908-4c52-b86d-f46904b69da8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:59.188297 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cd541bf4-b9b3-437b-a964-26561686d466 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/488ce558-2908-4c52-b86d-f46904b69da8" status: 200 len: 1329 microversion: 2.1 time: 0.202776 Jun 20 12:34:59.191274 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3152/6210] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:58 2022] GET /compute/v2.1/servers/488ce558-2908-4c52-b86d-f46904b69da8 => generated 1329 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:34:59.859634 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-22e74d8c-07fe-47cf-9bd0-935184b6a847 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:59.860459 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-22e74d8c-07fe-47cf-9bd0-935184b6a847 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 6fed9595-534e-43fc-bd3b-1c63793c7de8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:59.878393 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22e74d8c-07fe-47cf-9bd0-935184b6a847 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:59.878852 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22e74d8c-07fe-47cf-9bd0-935184b6a847 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:59.887845 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22e74d8c-07fe-47cf-9bd0-935184b6a847 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:59.888353 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22e74d8c-07fe-47cf-9bd0-935184b6a847 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:00.208002 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-02684287-26a1-44f9-8a5c-05aa8124efb4 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:00.208650 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-02684287-26a1-44f9-8a5c-05aa8124efb4 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] [instance: 488ce558-2908-4c52-b86d-f46904b69da8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:00.212473 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:00.257179 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-22e74d8c-07fe-47cf-9bd0-935184b6a847 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:00.260921 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02684287-26a1-44f9-8a5c-05aa8124efb4 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:00.262287 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02684287-26a1-44f9-8a5c-05aa8124efb4 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:00.263112 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02684287-26a1-44f9-8a5c-05aa8124efb4 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:00.263555 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02684287-26a1-44f9-8a5c-05aa8124efb4 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:00.268873 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-22e74d8c-07fe-47cf-9bd0-935184b6a847 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8" status: 200 len: 1214 microversion: 2.1 time: 0.415569 Jun 20 12:35:00.270894 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3059/6211] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:59 2022] GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8 => generated 1214 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:00.387963 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-02684287-26a1-44f9-8a5c-05aa8124efb4 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/488ce558-2908-4c52-b86d-f46904b69da8" status: 200 len: 1338 microversion: 2.1 time: 0.184642 Jun 20 12:35:00.394385 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3153/6212] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:00 2022] GET /compute/v2.1/servers/488ce558-2908-4c52-b86d-f46904b69da8 => generated 1338 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:01.287679 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c55983a1-2e3b-43ef-88f0-9c36643f74eb tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:01.288875 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c55983a1-2e3b-43ef-88f0-9c36643f74eb tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 6fed9595-534e-43fc-bd3b-1c63793c7de8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:01.305977 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c55983a1-2e3b-43ef-88f0-9c36643f74eb tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:01.318910 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c55983a1-2e3b-43ef-88f0-9c36643f74eb tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:01.319897 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c55983a1-2e3b-43ef-88f0-9c36643f74eb tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:01.320447 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c55983a1-2e3b-43ef-88f0-9c36643f74eb tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:01.411839 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a035a82e-c25a-4b42-883e-8360e6ffb8e9 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:01.413555 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a035a82e-c25a-4b42-883e-8360e6ffb8e9 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] [instance: 488ce558-2908-4c52-b86d-f46904b69da8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:01.426571 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a035a82e-c25a-4b42-883e-8360e6ffb8e9 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:01.427428 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a035a82e-c25a-4b42-883e-8360e6ffb8e9 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:01.429511 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a035a82e-c25a-4b42-883e-8360e6ffb8e9 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:01.431556 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a035a82e-c25a-4b42-883e-8360e6ffb8e9 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:01.536665 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a035a82e-c25a-4b42-883e-8360e6ffb8e9 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/488ce558-2908-4c52-b86d-f46904b69da8" status: 200 len: 1422 microversion: 2.1 time: 0.129384 Jun 20 12:35:01.553136 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3154/6213] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:01 2022] GET /compute/v2.1/servers/488ce558-2908-4c52-b86d-f46904b69da8 => generated 1422 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:01.664611 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c55983a1-2e3b-43ef-88f0-9c36643f74eb tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:01.676408 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c55983a1-2e3b-43ef-88f0-9c36643f74eb tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8" status: 200 len: 1214 microversion: 2.1 time: 0.392491 Jun 20 12:35:01.679026 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3060/6214] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:01 2022] GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8 => generated 1214 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:02.562914 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-77987f91-23a7-45fb-8602-6a34a8c97e09 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:02.564315 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-77987f91-23a7-45fb-8602-6a34a8c97e09 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] [instance: 488ce558-2908-4c52-b86d-f46904b69da8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:02.581564 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-77987f91-23a7-45fb-8602-6a34a8c97e09 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:02.585585 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-77987f91-23a7-45fb-8602-6a34a8c97e09 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:02.586583 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-77987f91-23a7-45fb-8602-6a34a8c97e09 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:02.587293 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-77987f91-23a7-45fb-8602-6a34a8c97e09 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:02.698156 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-82b78f05-64b9-4a31-bdb7-ca4caa171fa5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:02.700303 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-82b78f05-64b9-4a31-bdb7-ca4caa171fa5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 6fed9595-534e-43fc-bd3b-1c63793c7de8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:02.716554 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-82b78f05-64b9-4a31-bdb7-ca4caa171fa5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:02.717257 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-82b78f05-64b9-4a31-bdb7-ca4caa171fa5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:02.718230 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-82b78f05-64b9-4a31-bdb7-ca4caa171fa5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:02.718869 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-82b78f05-64b9-4a31-bdb7-ca4caa171fa5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:03.089819 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-82b78f05-64b9-4a31-bdb7-ca4caa171fa5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:03.108343 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-82b78f05-64b9-4a31-bdb7-ca4caa171fa5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8" status: 200 len: 1202 microversion: 2.1 time: 0.417837 Jun 20 12:35:03.109578 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3061/6215] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:02 2022] GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8 => generated 1202 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:03.432273 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-77987f91-23a7-45fb-8602-6a34a8c97e09 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/488ce558-2908-4c52-b86d-f46904b69da8" status: 200 len: 1464 microversion: 2.1 time: 0.871025 Jun 20 12:35:03.435782 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3155/6216] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:02 2022] GET /compute/v2.1/servers/488ce558-2908-4c52-b86d-f46904b69da8 => generated 1464 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:03.634292 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-5382bd64-7048-4431-9cf3-1e55d6ceb456 req-f1817ed9-73c0-4028-8c10-5754e1b5aed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "488ce558-2908-4c52-b86d-f46904b69da8", "tag": "6aded6d6-376a-4947-9e41-04c5bd733753"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:35:03.657200 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-5382bd64-7048-4431-9cf3-1e55d6ceb456 req-f1817ed9-73c0-4028-8c10-5754e1b5aed7 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:03.657825 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-5382bd64-7048-4431-9cf3-1e55d6ceb456 req-f1817ed9-73c0-4028-8c10-5754e1b5aed7 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:03.699186 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-5382bd64-7048-4431-9cf3-1e55d6ceb456 req-f1817ed9-73c0-4028-8c10-5754e1b5aed7 service nova] Creating event network-changed:6aded6d6-376a-4947-9e41-04c5bd733753 for instance 488ce558-2908-4c52-b86d-f46904b69da8 on n-h2-master-1 Jun 20 12:35:03.715936 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-5382bd64-7048-4431-9cf3-1e55d6ceb456 req-f1817ed9-73c0-4028-8c10-5754e1b5aed7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085479 Jun 20 12:35:03.716860 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3062/6217] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:35:04.131329 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-aaa92af3-15fc-4965-8479-1052d836ca07 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:04.132024 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-aaa92af3-15fc-4965-8479-1052d836ca07 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 6fed9595-534e-43fc-bd3b-1c63793c7de8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:04.143966 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aaa92af3-15fc-4965-8479-1052d836ca07 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:04.144651 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aaa92af3-15fc-4965-8479-1052d836ca07 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:04.145824 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aaa92af3-15fc-4965-8479-1052d836ca07 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:04.146408 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aaa92af3-15fc-4965-8479-1052d836ca07 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:04.292950 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-aaa92af3-15fc-4965-8479-1052d836ca07 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:04.301089 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-aaa92af3-15fc-4965-8479-1052d836ca07 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8" status: 200 len: 1202 microversion: 2.1 time: 0.177730 Jun 20 12:35:04.301686 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3156/6218] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:04 2022] GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8 => generated 1202 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:04.452261 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-869cdbf3-5f1d-4336-a119-3eae5f34fe72 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:04.453196 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-869cdbf3-5f1d-4336-a119-3eae5f34fe72 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] [instance: 488ce558-2908-4c52-b86d-f46904b69da8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:04.460441 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-869cdbf3-5f1d-4336-a119-3eae5f34fe72 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:04.460997 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-869cdbf3-5f1d-4336-a119-3eae5f34fe72 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:04.462131 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-869cdbf3-5f1d-4336-a119-3eae5f34fe72 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:04.462608 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-869cdbf3-5f1d-4336-a119-3eae5f34fe72 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:04.610522 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-869cdbf3-5f1d-4336-a119-3eae5f34fe72 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/488ce558-2908-4c52-b86d-f46904b69da8" status: 200 len: 1464 microversion: 2.1 time: 0.163167 Jun 20 12:35:04.611183 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3063/6219] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:04 2022] GET /compute/v2.1/servers/488ce558-2908-4c52-b86d-f46904b69da8 => generated 1464 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:35:05.319901 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-12487ab5-0f0b-45ee-97c9-5164e76c9d85 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:05.320549 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-12487ab5-0f0b-45ee-97c9-5164e76c9d85 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 6fed9595-534e-43fc-bd3b-1c63793c7de8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:05.328847 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-12487ab5-0f0b-45ee-97c9-5164e76c9d85 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:05.329314 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-12487ab5-0f0b-45ee-97c9-5164e76c9d85 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:05.330084 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-12487ab5-0f0b-45ee-97c9-5164e76c9d85 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:05.330518 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-12487ab5-0f0b-45ee-97c9-5164e76c9d85 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:05.474462 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-12487ab5-0f0b-45ee-97c9-5164e76c9d85 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:05.483127 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-12487ab5-0f0b-45ee-97c9-5164e76c9d85 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8" status: 200 len: 1202 microversion: 2.1 time: 0.168377 Jun 20 12:35:05.483731 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3157/6220] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:05 2022] GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8 => generated 1202 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:05.628281 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dbd45acb-a349-4c47-ba5e-271e266a69de tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:05.628868 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-dbd45acb-a349-4c47-ba5e-271e266a69de tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] [instance: 488ce558-2908-4c52-b86d-f46904b69da8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:05.638975 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dbd45acb-a349-4c47-ba5e-271e266a69de tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:05.638975 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dbd45acb-a349-4c47-ba5e-271e266a69de tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:05.638975 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dbd45acb-a349-4c47-ba5e-271e266a69de tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:05.638975 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dbd45acb-a349-4c47-ba5e-271e266a69de tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:05.776712 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dbd45acb-a349-4c47-ba5e-271e266a69de tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/488ce558-2908-4c52-b86d-f46904b69da8" status: 200 len: 1464 microversion: 2.1 time: 0.152331 Jun 20 12:35:05.777316 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3064/6221] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:05 2022] GET /compute/v2.1/servers/488ce558-2908-4c52-b86d-f46904b69da8 => generated 1464 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:06.501225 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-39a7476c-d188-44e2-8515-7a97d750415b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:06.501744 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-39a7476c-d188-44e2-8515-7a97d750415b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 6fed9595-534e-43fc-bd3b-1c63793c7de8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:06.510648 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-39a7476c-d188-44e2-8515-7a97d750415b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:06.512518 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-39a7476c-d188-44e2-8515-7a97d750415b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:06.512684 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-39a7476c-d188-44e2-8515-7a97d750415b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:06.513187 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-39a7476c-d188-44e2-8515-7a97d750415b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:06.693921 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-39a7476c-d188-44e2-8515-7a97d750415b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:06.703593 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-39a7476c-d188-44e2-8515-7a97d750415b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8" status: 200 len: 1202 microversion: 2.1 time: 0.207305 Jun 20 12:35:06.704494 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3158/6222] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:06 2022] GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8 => generated 1202 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:35:06.794581 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b54c6e6e-ca79-42bc-b791-477081fc3649 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:06.796484 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b54c6e6e-ca79-42bc-b791-477081fc3649 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] [instance: 488ce558-2908-4c52-b86d-f46904b69da8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:06.807680 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b54c6e6e-ca79-42bc-b791-477081fc3649 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:06.808140 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b54c6e6e-ca79-42bc-b791-477081fc3649 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:06.808988 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b54c6e6e-ca79-42bc-b791-477081fc3649 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:06.809417 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b54c6e6e-ca79-42bc-b791-477081fc3649 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:07.037471 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b54c6e6e-ca79-42bc-b791-477081fc3649 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/488ce558-2908-4c52-b86d-f46904b69da8" status: 200 len: 1464 microversion: 2.1 time: 0.247206 Jun 20 12:35:07.051470 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3065/6223] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:06 2022] GET /compute/v2.1/servers/488ce558-2908-4c52-b86d-f46904b69da8 => generated 1464 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:35:07.720622 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7fd94c82-42e6-4cca-85a2-646713d9555c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:07.721338 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7fd94c82-42e6-4cca-85a2-646713d9555c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 6fed9595-534e-43fc-bd3b-1c63793c7de8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:07.729521 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7fd94c82-42e6-4cca-85a2-646713d9555c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:07.729521 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7fd94c82-42e6-4cca-85a2-646713d9555c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:07.730131 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7fd94c82-42e6-4cca-85a2-646713d9555c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:07.730682 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7fd94c82-42e6-4cca-85a2-646713d9555c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:07.867677 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7fd94c82-42e6-4cca-85a2-646713d9555c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:07.876008 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7fd94c82-42e6-4cca-85a2-646713d9555c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8" status: 200 len: 1202 microversion: 2.1 time: 0.159171 Jun 20 12:35:07.876652 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3159/6224] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:07 2022] GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8 => generated 1202 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:08.056139 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-803591f7-3798-4de1-a5d9-96d3c1b55f48 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:08.056864 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-803591f7-3798-4de1-a5d9-96d3c1b55f48 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] [instance: 488ce558-2908-4c52-b86d-f46904b69da8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:08.063842 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-803591f7-3798-4de1-a5d9-96d3c1b55f48 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:08.064348 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-803591f7-3798-4de1-a5d9-96d3c1b55f48 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:08.065119 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-803591f7-3798-4de1-a5d9-96d3c1b55f48 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:08.065558 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-803591f7-3798-4de1-a5d9-96d3c1b55f48 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:08.200698 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-803591f7-3798-4de1-a5d9-96d3c1b55f48 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/488ce558-2908-4c52-b86d-f46904b69da8" status: 200 len: 1464 microversion: 2.1 time: 0.148359 Jun 20 12:35:08.201446 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3066/6225] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:08 2022] GET /compute/v2.1/servers/488ce558-2908-4c52-b86d-f46904b69da8 => generated 1464 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:08.544744 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-e4e4b9a5-99a6-4b93-8df2-e222748d1a07 req-131b7e46-f526-4df8-8f16-bc897eb7401f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "488ce558-2908-4c52-b86d-f46904b69da8", "name": "network-vif-plugged", "status": "completed", "tag": "6aded6d6-376a-4947-9e41-04c5bd733753"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:35:08.553853 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-e4e4b9a5-99a6-4b93-8df2-e222748d1a07 req-131b7e46-f526-4df8-8f16-bc897eb7401f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:08.554416 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-e4e4b9a5-99a6-4b93-8df2-e222748d1a07 req-131b7e46-f526-4df8-8f16-bc897eb7401f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:08.567474 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-e4e4b9a5-99a6-4b93-8df2-e222748d1a07 req-131b7e46-f526-4df8-8f16-bc897eb7401f service nova] Creating event network-vif-plugged:6aded6d6-376a-4947-9e41-04c5bd733753 for instance 488ce558-2908-4c52-b86d-f46904b69da8 on n-h2-master-1 Jun 20 12:35:08.573692 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-e4e4b9a5-99a6-4b93-8df2-e222748d1a07 req-131b7e46-f526-4df8-8f16-bc897eb7401f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034707 Jun 20 12:35:08.574491 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3160/6226] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:35:08.894257 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8708ba46-d10c-452a-aa93-cf42ee7c490a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:08.895372 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8708ba46-d10c-452a-aa93-cf42ee7c490a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 6fed9595-534e-43fc-bd3b-1c63793c7de8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:08.898816 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=4 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:08.900076 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=8 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:08.905040 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8708ba46-d10c-452a-aa93-cf42ee7c490a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:08.905867 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8708ba46-d10c-452a-aa93-cf42ee7c490a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:08.906734 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8708ba46-d10c-452a-aa93-cf42ee7c490a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:08.907359 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8708ba46-d10c-452a-aa93-cf42ee7c490a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:09.094094 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8708ba46-d10c-452a-aa93-cf42ee7c490a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:09.107788 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8708ba46-d10c-452a-aa93-cf42ee7c490a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8" status: 200 len: 1202 microversion: 2.1 time: 0.217969 Jun 20 12:35:09.108600 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3067/6227] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:08 2022] GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8 => generated 1202 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:09.217241 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=8 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:09.221565 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-408c736e-fcb0-49f3-b808-e443a53590fe tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:09.222667 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-408c736e-fcb0-49f3-b808-e443a53590fe tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] [instance: 488ce558-2908-4c52-b86d-f46904b69da8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:09.231736 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-408c736e-fcb0-49f3-b808-e443a53590fe tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:09.232067 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-408c736e-fcb0-49f3-b808-e443a53590fe tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:09.232840 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-408c736e-fcb0-49f3-b808-e443a53590fe tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:09.233277 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-408c736e-fcb0-49f3-b808-e443a53590fe tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:09.412195 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-408c736e-fcb0-49f3-b808-e443a53590fe tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/488ce558-2908-4c52-b86d-f46904b69da8" status: 200 len: 1464 microversion: 2.1 time: 0.197120 Jun 20 12:35:09.412950 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3161/6228] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:09 2022] GET /compute/v2.1/servers/488ce558-2908-4c52-b86d-f46904b69da8 => generated 1464 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:10.131091 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c5feb00c-3ffb-4b26-8144-ccf4ee72644e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:10.133162 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c5feb00c-3ffb-4b26-8144-ccf4ee72644e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 6fed9595-534e-43fc-bd3b-1c63793c7de8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:10.142387 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c5feb00c-3ffb-4b26-8144-ccf4ee72644e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:10.142841 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c5feb00c-3ffb-4b26-8144-ccf4ee72644e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:10.143632 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c5feb00c-3ffb-4b26-8144-ccf4ee72644e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:10.144066 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c5feb00c-3ffb-4b26-8144-ccf4ee72644e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:10.305515 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c5feb00c-3ffb-4b26-8144-ccf4ee72644e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:10.313746 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c5feb00c-3ffb-4b26-8144-ccf4ee72644e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8" status: 200 len: 1202 microversion: 2.1 time: 0.189655 Jun 20 12:35:10.316373 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3068/6229] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:10 2022] GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8 => generated 1202 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:10.429400 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-49246f4a-8def-4da1-9294-c58c7987e097 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:10.430138 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-49246f4a-8def-4da1-9294-c58c7987e097 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] [instance: 488ce558-2908-4c52-b86d-f46904b69da8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:10.438005 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-49246f4a-8def-4da1-9294-c58c7987e097 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:10.438490 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-49246f4a-8def-4da1-9294-c58c7987e097 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:10.439451 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-49246f4a-8def-4da1-9294-c58c7987e097 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:10.439870 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-49246f4a-8def-4da1-9294-c58c7987e097 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:10.570513 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-49246f4a-8def-4da1-9294-c58c7987e097 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/488ce558-2908-4c52-b86d-f46904b69da8" status: 200 len: 1649 microversion: 2.1 time: 0.144656 Jun 20 12:35:10.578651 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3162/6230] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:10 2022] GET /compute/v2.1/servers/488ce558-2908-4c52-b86d-f46904b69da8 => generated 1649 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:10.587010 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-53f02a51-5ee6-4f1e-ab07-3331fe6ff4db tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:10.588346 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-53f02a51-5ee6-4f1e-ab07-3331fe6ff4db tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] [instance: 488ce558-2908-4c52-b86d-f46904b69da8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:10.595162 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-53f02a51-5ee6-4f1e-ab07-3331fe6ff4db tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:10.595689 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-53f02a51-5ee6-4f1e-ab07-3331fe6ff4db tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:10.596557 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-53f02a51-5ee6-4f1e-ab07-3331fe6ff4db tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:10.597000 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-53f02a51-5ee6-4f1e-ab07-3331fe6ff4db tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:10.732023 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-53f02a51-5ee6-4f1e-ab07-3331fe6ff4db tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/488ce558-2908-4c52-b86d-f46904b69da8" status: 200 len: 1649 microversion: 2.1 time: 0.148779 Jun 20 12:35:10.732678 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3069/6231] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:10 2022] GET /compute/v2.1/servers/488ce558-2908-4c52-b86d-f46904b69da8 => generated 1649 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:10.750630 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c122995a-75b0-415e-9e80-0af0bd97d536 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:10.752153 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c122995a-75b0-415e-9e80-0af0bd97d536 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] [instance: 488ce558-2908-4c52-b86d-f46904b69da8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:10.762257 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c122995a-75b0-415e-9e80-0af0bd97d536 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:10.762782 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c122995a-75b0-415e-9e80-0af0bd97d536 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:10.764188 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c122995a-75b0-415e-9e80-0af0bd97d536 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:10.764668 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c122995a-75b0-415e-9e80-0af0bd97d536 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:10.925577 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c122995a-75b0-415e-9e80-0af0bd97d536 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/488ce558-2908-4c52-b86d-f46904b69da8" status: 200 len: 1649 microversion: 2.1 time: 0.180589 Jun 20 12:35:10.926775 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3163/6232] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:10 2022] GET /compute/v2.1/servers/488ce558-2908-4c52-b86d-f46904b69da8 => generated 1649 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:11.078187 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7bc1f00e-1d86-49e1-9123-99b7e3f155e2 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1349925079", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "availability_zone": "nova:n-h1-master-1", "networks": [{"uuid": "c65d10ce-124f-4369-a021-29e9cd1036ba"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:35:11.102261 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-94cb9c10-c82b-4310-aed8-593e130f1b37 req-6b6c6457-1cac-42b5-981e-ddf1c8e1171e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fed9595-534e-43fc-bd3b-1c63793c7de8", "name": "network-vif-plugged", "status": "completed", "tag": "83aff13b-19c1-4ac4-8853-1b6220ac4764"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:35:11.114592 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-94cb9c10-c82b-4310-aed8-593e130f1b37 req-6b6c6457-1cac-42b5-981e-ddf1c8e1171e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:11.117724 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-94cb9c10-c82b-4310-aed8-593e130f1b37 req-6b6c6457-1cac-42b5-981e-ddf1c8e1171e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:11.132178 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-94cb9c10-c82b-4310-aed8-593e130f1b37 req-6b6c6457-1cac-42b5-981e-ddf1c8e1171e service nova] Creating event network-vif-plugged:83aff13b-19c1-4ac4-8853-1b6220ac4764 for instance 6fed9595-534e-43fc-bd3b-1c63793c7de8 on n-h1-master-1 Jun 20 12:35:11.140236 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-94cb9c10-c82b-4310-aed8-593e130f1b37 req-6b6c6457-1cac-42b5-981e-ddf1c8e1171e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041660 Jun 20 12:35:11.141502 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3164/6233] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:35:11.161245 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-7bc1f00e-1d86-49e1-9123-99b7e3f155e2 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] validate_networks() for [('c65d10ce-124f-4369-a021-29e9cd1036ba', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:35:11.331211 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ceb55017-c523-4a9b-8122-5763b6b112bd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:11.332531 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ceb55017-c523-4a9b-8122-5763b6b112bd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 6fed9595-534e-43fc-bd3b-1c63793c7de8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:11.341539 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ceb55017-c523-4a9b-8122-5763b6b112bd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:11.342367 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ceb55017-c523-4a9b-8122-5763b6b112bd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:11.343601 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ceb55017-c523-4a9b-8122-5763b6b112bd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:11.345121 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ceb55017-c523-4a9b-8122-5763b6b112bd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:11.492630 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ceb55017-c523-4a9b-8122-5763b6b112bd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:11.502864 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ceb55017-c523-4a9b-8122-5763b6b112bd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8" status: 200 len: 1202 microversion: 2.1 time: 0.176053 Jun 20 12:35:11.503771 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3165/6234] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:11 2022] GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8 => generated 1202 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:11.621115 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-7bc1f00e-1d86-49e1-9123-99b7e3f155e2 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:35:11.621397 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-7bc1f00e-1d86-49e1-9123-99b7e3f155e2 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:35:11.621886 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-7bc1f00e-1d86-49e1-9123-99b7e3f155e2 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:35:11.622288 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-7bc1f00e-1d86-49e1-9123-99b7e3f155e2 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:35:11.622699 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-7bc1f00e-1d86-49e1-9123-99b7e3f155e2 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:35:11.631873 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7bc1f00e-1d86-49e1-9123-99b7e3f155e2 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:11.632348 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7bc1f00e-1d86-49e1-9123-99b7e3f155e2 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:11.633137 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7bc1f00e-1d86-49e1-9123-99b7e3f155e2 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:11.633736 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7bc1f00e-1d86-49e1-9123-99b7e3f155e2 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:11.653674 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-7bc1f00e-1d86-49e1-9123-99b7e3f155e2 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Getting quotas for project 7ee4e2c5e94d47d8ad9ee3016ddaf383. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:35:11.659478 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-7bc1f00e-1d86-49e1-9123-99b7e3f155e2 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Getting quotas for user a7a4ea4ce30a4d75b3063a6931f50216 and project 7ee4e2c5e94d47d8ad9ee3016ddaf383. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:35:11.672755 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7bc1f00e-1d86-49e1-9123-99b7e3f155e2 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:35:11.675106 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7bc1f00e-1d86-49e1-9123-99b7e3f155e2 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] [instance: 430f2910-0355-4cb3-ae87-9151b13c9797] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:35:11.722785 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7bc1f00e-1d86-49e1-9123-99b7e3f155e2 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.650605 Jun 20 12:35:11.728323 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3070/6235] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:35:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:35:11.734201 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7e51221f-7cee-4031-bc0e-a418e0429a6f tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:11.734958 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7e51221f-7cee-4031-bc0e-a418e0429a6f tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] [instance: 430f2910-0355-4cb3-ae87-9151b13c9797] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:11.812086 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7e51221f-7cee-4031-bc0e-a418e0429a6f tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/430f2910-0355-4cb3-ae87-9151b13c9797" status: 200 len: 1329 microversion: 2.1 time: 0.082077 Jun 20 12:35:11.814142 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3166/6236] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:11 2022] GET /compute/v2.1/servers/430f2910-0355-4cb3-ae87-9151b13c9797 => generated 1329 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:12.520951 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-14b04093-f91d-4930-ab91-2b0e23a3f38d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:12.521620 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-14b04093-f91d-4930-ab91-2b0e23a3f38d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 6fed9595-534e-43fc-bd3b-1c63793c7de8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:12.528320 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-14b04093-f91d-4930-ab91-2b0e23a3f38d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:12.528764 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-14b04093-f91d-4930-ab91-2b0e23a3f38d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:12.529555 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-14b04093-f91d-4930-ab91-2b0e23a3f38d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:12.530066 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-14b04093-f91d-4930-ab91-2b0e23a3f38d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:12.689175 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-14b04093-f91d-4930-ab91-2b0e23a3f38d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:12.698089 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-14b04093-f91d-4930-ab91-2b0e23a3f38d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8" status: 200 len: 1389 microversion: 2.1 time: 0.181950 Jun 20 12:35:12.700560 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3071/6237] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:12 2022] GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8 => generated 1389 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:12.714853 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-21ef473d-cba0-490a-959a-d5661ebdbd9b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:12.715464 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-21ef473d-cba0-490a-959a-d5661ebdbd9b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 6fed9595-534e-43fc-bd3b-1c63793c7de8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:12.723230 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21ef473d-cba0-490a-959a-d5661ebdbd9b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:12.733954 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21ef473d-cba0-490a-959a-d5661ebdbd9b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:12.734860 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21ef473d-cba0-490a-959a-d5661ebdbd9b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:12.735299 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21ef473d-cba0-490a-959a-d5661ebdbd9b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:12.830416 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ecac442a-fab6-4357-aa08-66bdc0800ea1 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:12.831046 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ecac442a-fab6-4357-aa08-66bdc0800ea1 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] [instance: 430f2910-0355-4cb3-ae87-9151b13c9797] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:12.838040 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ecac442a-fab6-4357-aa08-66bdc0800ea1 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:12.838727 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ecac442a-fab6-4357-aa08-66bdc0800ea1 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:12.839819 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ecac442a-fab6-4357-aa08-66bdc0800ea1 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:12.840509 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ecac442a-fab6-4357-aa08-66bdc0800ea1 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:12.884722 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-21ef473d-cba0-490a-959a-d5661ebdbd9b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:12.893054 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-21ef473d-cba0-490a-959a-d5661ebdbd9b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8" status: 200 len: 1389 microversion: 2.1 time: 0.182220 Jun 20 12:35:12.893658 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3167/6238] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:12 2022] GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8 => generated 1389 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:12.909709 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d06fa2e9-1917-41d0-985f-1bba6b7df47b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:12.910189 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:12.911621 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d06fa2e9-1917-41d0-985f-1bba6b7df47b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 6fed9595-534e-43fc-bd3b-1c63793c7de8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:12.919735 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d06fa2e9-1917-41d0-985f-1bba6b7df47b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:12.919951 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ecac442a-fab6-4357-aa08-66bdc0800ea1 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/430f2910-0355-4cb3-ae87-9151b13c9797" status: 200 len: 1416 microversion: 2.1 time: 0.093380 Jun 20 12:35:12.920499 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3072/6239] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:12 2022] GET /compute/v2.1/servers/430f2910-0355-4cb3-ae87-9151b13c9797 => generated 1416 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:12.929170 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d06fa2e9-1917-41d0-985f-1bba6b7df47b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:12.930479 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d06fa2e9-1917-41d0-985f-1bba6b7df47b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:12.931101 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d06fa2e9-1917-41d0-985f-1bba6b7df47b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:13.097814 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d06fa2e9-1917-41d0-985f-1bba6b7df47b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:13.101623 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:13.108370 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d06fa2e9-1917-41d0-985f-1bba6b7df47b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8" status: 200 len: 1389 microversion: 2.1 time: 0.202971 Jun 20 12:35:13.109331 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3168/6240] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:12 2022] GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8 => generated 1389 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:13.125395 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ba3d1fc8-e4d6-4120-a4e1-d12a6ad771b8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:13.125893 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ba3d1fc8-e4d6-4120-a4e1-d12a6ad771b8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 6fed9595-534e-43fc-bd3b-1c63793c7de8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:13.132952 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba3d1fc8-e4d6-4120-a4e1-d12a6ad771b8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:13.133934 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba3d1fc8-e4d6-4120-a4e1-d12a6ad771b8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:13.135413 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba3d1fc8-e4d6-4120-a4e1-d12a6ad771b8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:13.136011 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba3d1fc8-e4d6-4120-a4e1-d12a6ad771b8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:13.166684 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ba3d1fc8-e4d6-4120-a4e1-d12a6ad771b8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 6fed9595-534e-43fc-bd3b-1c63793c7de8] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:35:13.261981 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ba3d1fc8-e4d6-4120-a4e1-d12a6ad771b8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8" status: 204 len: 0 microversion: 2.1 time: 0.140522 Jun 20 12:35:13.263507 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3073/6241] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:35:13 2022] DELETE /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:35:13.272983 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e37b4f7b-7df9-4339-a3d0-2ee5419f1f5d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:13.274042 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e37b4f7b-7df9-4339-a3d0-2ee5419f1f5d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 6fed9595-534e-43fc-bd3b-1c63793c7de8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:13.281120 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e37b4f7b-7df9-4339-a3d0-2ee5419f1f5d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:13.281649 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e37b4f7b-7df9-4339-a3d0-2ee5419f1f5d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:13.282563 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e37b4f7b-7df9-4339-a3d0-2ee5419f1f5d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:13.283058 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e37b4f7b-7df9-4339-a3d0-2ee5419f1f5d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:13.425197 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e37b4f7b-7df9-4339-a3d0-2ee5419f1f5d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:13.434372 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e37b4f7b-7df9-4339-a3d0-2ee5419f1f5d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8" status: 200 len: 1395 microversion: 2.1 time: 0.166208 Jun 20 12:35:13.434992 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3169/6242] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:13 2022] GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8 => generated 1395 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:13.937675 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dc39b8db-2df5-49ca-ac29-00af8e7b7819 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:13.939206 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-dc39b8db-2df5-49ca-ac29-00af8e7b7819 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] [instance: 430f2910-0355-4cb3-ae87-9151b13c9797] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:13.954307 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc39b8db-2df5-49ca-ac29-00af8e7b7819 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:13.954979 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc39b8db-2df5-49ca-ac29-00af8e7b7819 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:13.955743 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc39b8db-2df5-49ca-ac29-00af8e7b7819 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:13.956256 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc39b8db-2df5-49ca-ac29-00af8e7b7819 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:14.098972 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dc39b8db-2df5-49ca-ac29-00af8e7b7819 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/430f2910-0355-4cb3-ae87-9151b13c9797" status: 200 len: 1464 microversion: 2.1 time: 0.164944 Jun 20 12:35:14.099581 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3074/6243] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:13 2022] GET /compute/v2.1/servers/430f2910-0355-4cb3-ae87-9151b13c9797 => generated 1464 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:35:14.451568 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a83827b1-e728-4290-97e7-4a7ffb5f7719 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:14.452850 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a83827b1-e728-4290-97e7-4a7ffb5f7719 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 6fed9595-534e-43fc-bd3b-1c63793c7de8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:14.460761 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a83827b1-e728-4290-97e7-4a7ffb5f7719 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:14.461229 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a83827b1-e728-4290-97e7-4a7ffb5f7719 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:14.462076 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a83827b1-e728-4290-97e7-4a7ffb5f7719 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:14.462517 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a83827b1-e728-4290-97e7-4a7ffb5f7719 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:14.605389 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a83827b1-e728-4290-97e7-4a7ffb5f7719 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:14.613443 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a83827b1-e728-4290-97e7-4a7ffb5f7719 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8" status: 200 len: 1395 microversion: 2.1 time: 0.165948 Jun 20 12:35:14.614113 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3170/6244] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:14 2022] GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8 => generated 1395 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:15.125946 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-da2fe396-1b61-4643-9324-05b531203876 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:15.126680 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-da2fe396-1b61-4643-9324-05b531203876 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] [instance: 430f2910-0355-4cb3-ae87-9151b13c9797] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:15.135113 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-da2fe396-1b61-4643-9324-05b531203876 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:15.135880 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-da2fe396-1b61-4643-9324-05b531203876 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:15.137033 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-da2fe396-1b61-4643-9324-05b531203876 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:15.137759 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-da2fe396-1b61-4643-9324-05b531203876 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:15.632471 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4e0faa6d-77b5-451d-98f8-5543b614d40a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:15.634184 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4e0faa6d-77b5-451d-98f8-5543b614d40a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 6fed9595-534e-43fc-bd3b-1c63793c7de8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:15.650486 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4e0faa6d-77b5-451d-98f8-5543b614d40a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:15.650980 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4e0faa6d-77b5-451d-98f8-5543b614d40a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:15.652012 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4e0faa6d-77b5-451d-98f8-5543b614d40a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:15.652496 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4e0faa6d-77b5-451d-98f8-5543b614d40a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:15.859247 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4e0faa6d-77b5-451d-98f8-5543b614d40a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:15.865710 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-da2fe396-1b61-4643-9324-05b531203876 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/430f2910-0355-4cb3-ae87-9151b13c9797" status: 200 len: 1464 microversion: 2.1 time: 0.743935 Jun 20 12:35:15.866809 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3075/6245] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:15 2022] GET /compute/v2.1/servers/430f2910-0355-4cb3-ae87-9151b13c9797 => generated 1464 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:15.872106 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-0e61f399-0c3f-4215-9600-ec4b060d04bc req-c6b24c76-9ee6-43aa-a1c9-2ba87ce6cf2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "430f2910-0355-4cb3-ae87-9151b13c9797", "tag": "3249e0b2-7cd8-4f08-9a5b-8e606ae2d531"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:35:15.873513 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4e0faa6d-77b5-451d-98f8-5543b614d40a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8" status: 200 len: 1395 microversion: 2.1 time: 0.245736 Jun 20 12:35:15.874895 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3171/6246] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:15 2022] GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8 => generated 1395 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:15.888144 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-0e61f399-0c3f-4215-9600-ec4b060d04bc req-c6b24c76-9ee6-43aa-a1c9-2ba87ce6cf2d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:15.888619 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-0e61f399-0c3f-4215-9600-ec4b060d04bc req-c6b24c76-9ee6-43aa-a1c9-2ba87ce6cf2d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:15.905846 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-0e61f399-0c3f-4215-9600-ec4b060d04bc req-c6b24c76-9ee6-43aa-a1c9-2ba87ce6cf2d service nova] Creating event network-changed:3249e0b2-7cd8-4f08-9a5b-8e606ae2d531 for instance 430f2910-0355-4cb3-ae87-9151b13c9797 on n-h1-master-1 Jun 20 12:35:15.916014 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-0e61f399-0c3f-4215-9600-ec4b060d04bc req-c6b24c76-9ee6-43aa-a1c9-2ba87ce6cf2d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046579 Jun 20 12:35:15.917284 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3076/6247] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:35:16.883224 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0ff8a3b9-2a03-4284-90d1-2194722042e0 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:16.884153 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0ff8a3b9-2a03-4284-90d1-2194722042e0 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] [instance: 430f2910-0355-4cb3-ae87-9151b13c9797] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:16.891371 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0ff8a3b9-2a03-4284-90d1-2194722042e0 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:16.892020 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0ff8a3b9-2a03-4284-90d1-2194722042e0 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:16.892664 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0ff8a3b9-2a03-4284-90d1-2194722042e0 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:16.893106 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0ff8a3b9-2a03-4284-90d1-2194722042e0 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:16.893992 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-99f207a7-1140-40f6-9da7-796f981e4991 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:16.894683 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-99f207a7-1140-40f6-9da7-796f981e4991 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 6fed9595-534e-43fc-bd3b-1c63793c7de8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:16.901418 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-99f207a7-1140-40f6-9da7-796f981e4991 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:16.901866 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-99f207a7-1140-40f6-9da7-796f981e4991 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:16.902639 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-99f207a7-1140-40f6-9da7-796f981e4991 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:16.903067 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-99f207a7-1140-40f6-9da7-796f981e4991 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:16.976432 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-99f207a7-1140-40f6-9da7-796f981e4991 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:16.986212 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-99f207a7-1140-40f6-9da7-796f981e4991 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8" status: 200 len: 1187 microversion: 2.1 time: 0.097258 Jun 20 12:35:16.987419 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3077/6248] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:16 2022] GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8 => generated 1187 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:35:17.077689 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0ff8a3b9-2a03-4284-90d1-2194722042e0 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/430f2910-0355-4cb3-ae87-9151b13c9797" status: 200 len: 1464 microversion: 2.1 time: 0.198182 Jun 20 12:35:17.078295 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3172/6249] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:16 2022] GET /compute/v2.1/servers/430f2910-0355-4cb3-ae87-9151b13c9797 => generated 1464 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:17.931836 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-f15186dd-c40b-462e-89b5-4599ad369484 req-5242fb95-5918-40d8-b3bd-03f90be0cf75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fed9595-534e-43fc-bd3b-1c63793c7de8", "name": "network-vif-deleted", "tag": "83aff13b-19c1-4ac4-8853-1b6220ac4764"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:35:17.942242 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-f15186dd-c40b-462e-89b5-4599ad369484 req-5242fb95-5918-40d8-b3bd-03f90be0cf75 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:17.950610 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-f15186dd-c40b-462e-89b5-4599ad369484 req-5242fb95-5918-40d8-b3bd-03f90be0cf75 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:17.963856 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-f15186dd-c40b-462e-89b5-4599ad369484 req-5242fb95-5918-40d8-b3bd-03f90be0cf75 service nova] Creating event network-vif-deleted:83aff13b-19c1-4ac4-8853-1b6220ac4764 for instance 6fed9595-534e-43fc-bd3b-1c63793c7de8 on n-h1-master-1 Jun 20 12:35:17.968774 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-f15186dd-c40b-462e-89b5-4599ad369484 req-5242fb95-5918-40d8-b3bd-03f90be0cf75 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041021 Jun 20 12:35:17.969377 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3078/6250] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:35:18.007939 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e754bf08-86a5-44fe-bbc9-6eb93793d42e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:18.007939 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e754bf08-86a5-44fe-bbc9-6eb93793d42e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 6fed9595-534e-43fc-bd3b-1c63793c7de8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:18.015293 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e754bf08-86a5-44fe-bbc9-6eb93793d42e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:18.015844 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e754bf08-86a5-44fe-bbc9-6eb93793d42e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:18.016651 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e754bf08-86a5-44fe-bbc9-6eb93793d42e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:18.017116 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e754bf08-86a5-44fe-bbc9-6eb93793d42e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:18.095701 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e754bf08-86a5-44fe-bbc9-6eb93793d42e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:18.104537 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0dd5741f-7bc7-4afa-8b03-f24acf59a8ec tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:18.105653 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0dd5741f-7bc7-4afa-8b03-f24acf59a8ec tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] [instance: 430f2910-0355-4cb3-ae87-9151b13c9797] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:18.106290 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e754bf08-86a5-44fe-bbc9-6eb93793d42e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8" status: 200 len: 1187 microversion: 2.1 time: 0.106956 Jun 20 12:35:18.107136 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3173/6251] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:17 2022] GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8 => generated 1187 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:18.113927 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0dd5741f-7bc7-4afa-8b03-f24acf59a8ec tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:18.114377 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0dd5741f-7bc7-4afa-8b03-f24acf59a8ec tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:18.115237 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0dd5741f-7bc7-4afa-8b03-f24acf59a8ec tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:18.115790 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0dd5741f-7bc7-4afa-8b03-f24acf59a8ec tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:18.284370 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0dd5741f-7bc7-4afa-8b03-f24acf59a8ec tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/430f2910-0355-4cb3-ae87-9151b13c9797" status: 200 len: 1464 microversion: 2.1 time: 0.192281 Jun 20 12:35:18.293000 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3079/6252] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:18 2022] GET /compute/v2.1/servers/430f2910-0355-4cb3-ae87-9151b13c9797 => generated 1464 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:35:19.126326 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-97782bf5-dd8d-4828-9781-df06f2b415dd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:19.127097 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-97782bf5-dd8d-4828-9781-df06f2b415dd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 6fed9595-534e-43fc-bd3b-1c63793c7de8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:19.135424 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-97782bf5-dd8d-4828-9781-df06f2b415dd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:19.135970 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-97782bf5-dd8d-4828-9781-df06f2b415dd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:19.136772 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-97782bf5-dd8d-4828-9781-df06f2b415dd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:19.137206 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-97782bf5-dd8d-4828-9781-df06f2b415dd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:19.207291 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-97782bf5-dd8d-4828-9781-df06f2b415dd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:19.219476 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-97782bf5-dd8d-4828-9781-df06f2b415dd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8" status: 200 len: 1187 microversion: 2.1 time: 0.097492 Jun 20 12:35:19.220315 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3174/6253] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:19 2022] GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8 => generated 1187 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:19.301421 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fb5694c6-9c48-4fc5-a59a-d7d284c5687e tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:19.302638 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fb5694c6-9c48-4fc5-a59a-d7d284c5687e tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] [instance: 430f2910-0355-4cb3-ae87-9151b13c9797] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:19.310944 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fb5694c6-9c48-4fc5-a59a-d7d284c5687e tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:19.311675 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fb5694c6-9c48-4fc5-a59a-d7d284c5687e tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:19.312928 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fb5694c6-9c48-4fc5-a59a-d7d284c5687e tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:19.313538 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fb5694c6-9c48-4fc5-a59a-d7d284c5687e tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:19.471374 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fb5694c6-9c48-4fc5-a59a-d7d284c5687e tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/430f2910-0355-4cb3-ae87-9151b13c9797" status: 200 len: 1464 microversion: 2.1 time: 0.173597 Jun 20 12:35:19.472114 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3080/6254] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:19 2022] GET /compute/v2.1/servers/430f2910-0355-4cb3-ae87-9151b13c9797 => generated 1464 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:20.236777 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3c771ef1-180c-40e9-86c6-60a2ada2a8c8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:20.237651 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3c771ef1-180c-40e9-86c6-60a2ada2a8c8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 6fed9595-534e-43fc-bd3b-1c63793c7de8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:20.245776 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c771ef1-180c-40e9-86c6-60a2ada2a8c8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:20.246317 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c771ef1-180c-40e9-86c6-60a2ada2a8c8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:20.247166 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c771ef1-180c-40e9-86c6-60a2ada2a8c8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:20.247710 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c771ef1-180c-40e9-86c6-60a2ada2a8c8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:20.318294 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3c771ef1-180c-40e9-86c6-60a2ada2a8c8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:20.343305 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3c771ef1-180c-40e9-86c6-60a2ada2a8c8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8" status: 200 len: 1187 microversion: 2.1 time: 0.110799 Jun 20 12:35:20.344055 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3175/6255] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:20 2022] GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8 => generated 1187 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:20.493338 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ef6bb494-2191-4b07-8df3-91553b43e1c4 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:20.494964 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ef6bb494-2191-4b07-8df3-91553b43e1c4 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] [instance: 430f2910-0355-4cb3-ae87-9151b13c9797] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:20.504549 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef6bb494-2191-4b07-8df3-91553b43e1c4 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:20.504893 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef6bb494-2191-4b07-8df3-91553b43e1c4 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:20.506187 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef6bb494-2191-4b07-8df3-91553b43e1c4 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:20.506775 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef6bb494-2191-4b07-8df3-91553b43e1c4 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:20.648518 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ef6bb494-2191-4b07-8df3-91553b43e1c4 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/430f2910-0355-4cb3-ae87-9151b13c9797" status: 200 len: 1464 microversion: 2.1 time: 0.163233 Jun 20 12:35:20.649175 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3081/6256] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:20 2022] GET /compute/v2.1/servers/430f2910-0355-4cb3-ae87-9151b13c9797 => generated 1464 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:21.018783 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-c0dc5b07-86b7-4222-bb52-29b5a8e83012 req-3fbbb0da-39dd-4940-9718-f137d17ee8d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "430f2910-0355-4cb3-ae87-9151b13c9797", "name": "network-vif-plugged", "status": "completed", "tag": "3249e0b2-7cd8-4f08-9a5b-8e606ae2d531"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:35:21.028364 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-c0dc5b07-86b7-4222-bb52-29b5a8e83012 req-3fbbb0da-39dd-4940-9718-f137d17ee8d8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:21.028852 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-c0dc5b07-86b7-4222-bb52-29b5a8e83012 req-3fbbb0da-39dd-4940-9718-f137d17ee8d8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:21.043619 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-c0dc5b07-86b7-4222-bb52-29b5a8e83012 req-3fbbb0da-39dd-4940-9718-f137d17ee8d8 service nova] Creating event network-vif-plugged:3249e0b2-7cd8-4f08-9a5b-8e606ae2d531 for instance 430f2910-0355-4cb3-ae87-9151b13c9797 on n-h1-master-1 Jun 20 12:35:21.049564 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-c0dc5b07-86b7-4222-bb52-29b5a8e83012 req-3fbbb0da-39dd-4940-9718-f137d17ee8d8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034423 Jun 20 12:35:21.050493 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3176/6257] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:35:21.361464 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1f1c3c98-1060-4f3e-8c65-dec267f4e274 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:21.370496 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1f1c3c98-1060-4f3e-8c65-dec267f4e274 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 6fed9595-534e-43fc-bd3b-1c63793c7de8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:21.385040 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f1c3c98-1060-4f3e-8c65-dec267f4e274 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:21.385645 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f1c3c98-1060-4f3e-8c65-dec267f4e274 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:21.386550 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f1c3c98-1060-4f3e-8c65-dec267f4e274 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:21.387221 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f1c3c98-1060-4f3e-8c65-dec267f4e274 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:21.403576 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-1f1c3c98-1060-4f3e-8c65-dec267f4e274 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] HTTP exception thrown: Instance 6fed9595-534e-43fc-bd3b-1c63793c7de8 could not be found. Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1f1c3c98-1060-4f3e-8c65-dec267f4e274 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Request method failure captured: Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8 HTTP/1.1 Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGlbodlapeisJn5a0HtwbwcZIYoBmT5AMrWgFKctZEM-c8IEHUY-HIxlKO2btmEhIp6rTchMUsTfBqlVWDOj1EarcMAz1U-zU3gC1LYOn6ihs7mNZ7VuUoyKyfaVYT5-C41dz-fiCbk7B4FysstqCDj9MrkXDGMTtiNF2ZH2AvXNm6I Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 5a9c7bbcc9a149f5b77a89141a306c3e Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-TestVolumeBootPattern-431625802 Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-TestVolumeBootPattern-431625802 Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 5a9c7bbcc9a149f5b77a89141a306c3e Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-TestVolumeBootPattern-431625802 Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-TestVolumeBootPattern-431625802-project Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: fed0afc129364664aed8d8a96f499831 Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-TestVolumeBootPattern-431625802-project Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 6fed9595-534e-43fc-bd3b-1c63793c7de8 could not be found. Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '6fed9595-534e-43fc-bd3b-1c63793c7de8'} Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fed9595-534e-43fc-bd3b-1c63793c7de8 could not be found. Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fed9595-534e-43fc-bd3b-1c63793c7de8 could not be found. Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:35:21.405530 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:35:21.410367 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:35:21.410367 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:35:21.410367 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:35:21.410367 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:35:21.410367 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:35:21.410367 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fed9595-534e-43fc-bd3b-1c63793c7de8 could not be found. Jun 20 12:35:21.410367 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:35:21.410367 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1f1c3c98-1060-4f3e-8c65-dec267f4e274 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Returning 404 to user: Instance 6fed9595-534e-43fc-bd3b-1c63793c7de8 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:35:21.410367 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1f1c3c98-1060-4f3e-8c65-dec267f4e274 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8" status: 404 len: 111 microversion: 2.1 time: 0.049736 Jun 20 12:35:21.412653 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3082/6258] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:21 2022] GET /compute/v2.1/servers/6fed9595-534e-43fc-bd3b-1c63793c7de8 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:35:21.666297 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-09a0f0dc-0c9b-45c5-ae7b-63929443408e tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:21.667610 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-09a0f0dc-0c9b-45c5-ae7b-63929443408e tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] [instance: 430f2910-0355-4cb3-ae87-9151b13c9797] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:21.674600 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-09a0f0dc-0c9b-45c5-ae7b-63929443408e tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:21.674992 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-09a0f0dc-0c9b-45c5-ae7b-63929443408e tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:21.676172 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-09a0f0dc-0c9b-45c5-ae7b-63929443408e tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:21.676651 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-09a0f0dc-0c9b-45c5-ae7b-63929443408e tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:21.808914 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:21.857692 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-09a0f0dc-0c9b-45c5-ae7b-63929443408e tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/430f2910-0355-4cb3-ae87-9151b13c9797" status: 200 len: 1464 microversion: 2.1 time: 0.195614 Jun 20 12:35:21.858644 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3177/6259] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:21 2022] GET /compute/v2.1/servers/430f2910-0355-4cb3-ae87-9151b13c9797 => generated 1464 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:22.880591 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-62c79f67-0350-4bfe-b65c-0a4817e8a2be tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:22.881203 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-62c79f67-0350-4bfe-b65c-0a4817e8a2be tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] [instance: 430f2910-0355-4cb3-ae87-9151b13c9797] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:22.884253 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:22.885089 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:22.886653 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:22.894016 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-62c79f67-0350-4bfe-b65c-0a4817e8a2be tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:22.894911 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-62c79f67-0350-4bfe-b65c-0a4817e8a2be tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:22.894911 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-62c79f67-0350-4bfe-b65c-0a4817e8a2be tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:22.895650 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-62c79f67-0350-4bfe-b65c-0a4817e8a2be tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:23.057509 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-62c79f67-0350-4bfe-b65c-0a4817e8a2be tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/430f2910-0355-4cb3-ae87-9151b13c9797" status: 200 len: 1649 microversion: 2.1 time: 0.180552 Jun 20 12:35:23.058208 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3083/6260] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:22 2022] GET /compute/v2.1/servers/430f2910-0355-4cb3-ae87-9151b13c9797 => generated 1649 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:23.074221 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ce48746d-b762-43de-bf53-4f7094f43487 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:23.074846 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ce48746d-b762-43de-bf53-4f7094f43487 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] [instance: 430f2910-0355-4cb3-ae87-9151b13c9797] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:23.082246 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ce48746d-b762-43de-bf53-4f7094f43487 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:23.082700 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ce48746d-b762-43de-bf53-4f7094f43487 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:23.083488 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ce48746d-b762-43de-bf53-4f7094f43487 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:23.083931 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ce48746d-b762-43de-bf53-4f7094f43487 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:23.168561 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-71aaa50a-8da0-4b96-b063-6abedbadaa38 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:23.169425 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-71aaa50a-8da0-4b96-b063-6abedbadaa38 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:23.176545 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-71aaa50a-8da0-4b96-b063-6abedbadaa38 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:23.177713 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-71aaa50a-8da0-4b96-b063-6abedbadaa38 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:23.178261 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-71aaa50a-8da0-4b96-b063-6abedbadaa38 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:23.178906 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-71aaa50a-8da0-4b96-b063-6abedbadaa38 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:23.204502 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-71aaa50a-8da0-4b96-b063-6abedbadaa38 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651/ips" status: 200 len: 149 microversion: 2.1 time: 0.039952 Jun 20 12:35:23.205795 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3084/6261] 10.222.0.27 () {58 vars in 1247 bytes} [Mon Jun 20 12:35:23 2022] GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:35:23.217048 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f2182ba8-7514-4592-9e39-05384d4a26bd tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f87ffa6e-54ec-494d-bfc7-67ae089e0026"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:35:23.218406 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f2182ba8-7514-4592-9e39-05384d4a26bd tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:23.226097 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f2182ba8-7514-4592-9e39-05384d4a26bd tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:23.227272 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f2182ba8-7514-4592-9e39-05384d4a26bd tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:23.228559 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f2182ba8-7514-4592-9e39-05384d4a26bd tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:23.229081 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f2182ba8-7514-4592-9e39-05384d4a26bd tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:23.247003 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ce48746d-b762-43de-bf53-4f7094f43487 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/430f2910-0355-4cb3-ae87-9151b13c9797" status: 200 len: 1649 microversion: 2.1 time: 0.176747 Jun 20 12:35:23.248316 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3178/6262] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:23 2022] GET /compute/v2.1/servers/430f2910-0355-4cb3-ae87-9151b13c9797 => generated 1649 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:23.263651 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-43e2a05e-7cea-4200-a282-a213ad58604a tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:23.264310 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-43e2a05e-7cea-4200-a282-a213ad58604a tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] [instance: 430f2910-0355-4cb3-ae87-9151b13c9797] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:23.271040 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-43e2a05e-7cea-4200-a282-a213ad58604a tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:23.271702 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-43e2a05e-7cea-4200-a282-a213ad58604a tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:23.272653 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-43e2a05e-7cea-4200-a282-a213ad58604a tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:23.273306 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-43e2a05e-7cea-4200-a282-a213ad58604a tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:23.352621 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-f2182ba8-7514-4592-9e39-05384d4a26bd tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] HTTP exception thrown: Invalid volume: volume f87ffa6e-54ec-494d-bfc7-67ae089e0026 is already attached to instances: 028600e9-6eb6-42ac-b62e-de21666d744e Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f2182ba8-7514-4592-9e39-05384d4a26bd tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Request method failure captured: Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651/os-volume_attachments HTTP/1.1 Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 74 Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGimx3rD_FK4OQ1VdtIOQm_v9s-kKgn6vXzR6ZBiLlIplOW4i7RkYQinkTG1vfKGKwCaoPCprnA7Fw3J7TUX4keyVZVyA-ioRTCduqhd5tDd7aG1Qjuo-15G-XSI8qoUHjPCuXgPU-jMwTPPkfuUfoqrsDV0KX5Zoa18ctkNwDakrYM Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: f4714cac56094f9e9d4ed4adb400064e Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: f4714cac56094f9e9d4ed4adb400064e Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-AttachVolumeNegativeTest-1470856820-project Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 2c8b3f11a7294fbd9d750b1fbbeaa65b Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-AttachVolumeNegativeTest-1470856820-project Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: {"volumeAttachment": {"volumeId": "f87ffa6e-54ec-494d-bfc7-67ae089e0026"}} Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: exception: Invalid volume: volume f87ffa6e-54ec-494d-bfc7-67ae089e0026 is already attached to instances: 028600e9-6eb6-42ac-b62e-de21666d744e Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: action_args: {'server_id': '8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651', 'body': {'volumeAttachment': {'volumeId': 'f87ffa6e-54ec-494d-bfc7-67ae089e0026'}}} Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f87ffa6e-54ec-494d-bfc7-67ae089e0026 is already attached to instances: 028600e9-6eb6-42ac-b62e-de21666d744e Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:35:23.355084 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:35:23.358446 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:35:23.358446 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:35:23.358446 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 20 12:35:23.358446 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 20 12:35:23.358446 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f87ffa6e-54ec-494d-bfc7-67ae089e0026 is already attached to instances: 028600e9-6eb6-42ac-b62e-de21666d744e Jun 20 12:35:23.358446 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:35:23.358446 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:35:23.358446 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:35:23.358446 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:35:23.358446 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:35:23.358446 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:35:23.358446 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:35:23.358446 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:35:23.358446 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f87ffa6e-54ec-494d-bfc7-67ae089e0026 is already attached to instances: 028600e9-6eb6-42ac-b62e-de21666d744e Jun 20 12:35:23.358446 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:35:23.360814 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f2182ba8-7514-4592-9e39-05384d4a26bd tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Returning 400 to user: Invalid volume: volume f87ffa6e-54ec-494d-bfc7-67ae089e0026 is already attached to instances: 028600e9-6eb6-42ac-b62e-de21666d744e {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:35:23.361811 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f2182ba8-7514-4592-9e39-05384d4a26bd tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "POST /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.149715 Jun 20 12:35:23.362909 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3085/6263] 10.222.0.27 () {60 vars in 1322 bytes} [Mon Jun 20 12:35:23 2022] POST /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651/os-volume_attachments => generated 174 bytes in 151 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:35:23.371490 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ee520ac2-2d09-4e2c-b363-f39ec530e051 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:23.372089 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ee520ac2-2d09-4e2c-b363-f39ec530e051 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:23.378587 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ee520ac2-2d09-4e2c-b363-f39ec530e051 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:23.379156 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ee520ac2-2d09-4e2c-b363-f39ec530e051 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:23.380010 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ee520ac2-2d09-4e2c-b363-f39ec530e051 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:23.380555 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ee520ac2-2d09-4e2c-b363-f39ec530e051 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:23.412138 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ee520ac2-2d09-4e2c-b363-f39ec530e051 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:35:23.438427 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-43e2a05e-7cea-4200-a282-a213ad58604a tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/430f2910-0355-4cb3-ae87-9151b13c9797" status: 200 len: 1649 microversion: 2.1 time: 0.178617 Jun 20 12:35:23.439837 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3179/6264] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:23 2022] GET /compute/v2.1/servers/430f2910-0355-4cb3-ae87-9151b13c9797 => generated 1649 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:35:23.455169 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3a77051a-eb87-40e8-a18f-9fccc69f68b5 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:23.455942 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3a77051a-eb87-40e8-a18f-9fccc69f68b5 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] [instance: 430f2910-0355-4cb3-ae87-9151b13c9797] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:23.464906 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a77051a-eb87-40e8-a18f-9fccc69f68b5 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:23.465639 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a77051a-eb87-40e8-a18f-9fccc69f68b5 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:23.466656 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a77051a-eb87-40e8-a18f-9fccc69f68b5 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:23.467306 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a77051a-eb87-40e8-a18f-9fccc69f68b5 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:23.506790 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3a77051a-eb87-40e8-a18f-9fccc69f68b5 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] [instance: 430f2910-0355-4cb3-ae87-9151b13c9797] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:35:23.544087 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ee520ac2-2d09-4e2c-b363-f39ec530e051 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651" status: 204 len: 0 microversion: 2.1 time: 0.172890 Jun 20 12:35:23.544087 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3086/6265] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:35:23 2022] DELETE /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 12:35:23.555645 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-64e2de8d-4b1c-4dc2-ab0f-c3f461ddb09b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:23.556770 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-64e2de8d-4b1c-4dc2-ab0f-c3f461ddb09b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:23.564289 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64e2de8d-4b1c-4dc2-ab0f-c3f461ddb09b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:23.564753 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64e2de8d-4b1c-4dc2-ab0f-c3f461ddb09b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:23.565586 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64e2de8d-4b1c-4dc2-ab0f-c3f461ddb09b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:23.566031 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64e2de8d-4b1c-4dc2-ab0f-c3f461ddb09b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:23.642255 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3a77051a-eb87-40e8-a18f-9fccc69f68b5 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] 10.222.0.27 "DELETE /compute/v2.1/servers/430f2910-0355-4cb3-ae87-9151b13c9797" status: 204 len: 0 microversion: 2.1 time: 0.190444 Jun 20 12:35:23.643835 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3180/6266] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:35:23 2022] DELETE /compute/v2.1/servers/430f2910-0355-4cb3-ae87-9151b13c9797 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:35:23.659545 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9b29751a-fdc7-4146-8a65-77641add145a tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:23.662091 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9b29751a-fdc7-4146-8a65-77641add145a tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] [instance: 430f2910-0355-4cb3-ae87-9151b13c9797] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:23.681331 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b29751a-fdc7-4146-8a65-77641add145a tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:23.681331 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b29751a-fdc7-4146-8a65-77641add145a tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:23.681331 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b29751a-fdc7-4146-8a65-77641add145a tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:23.681914 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b29751a-fdc7-4146-8a65-77641add145a tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:23.784506 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-64e2de8d-4b1c-4dc2-ab0f-c3f461ddb09b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:23.795097 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-64e2de8d-4b1c-4dc2-ab0f-c3f461ddb09b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651" status: 200 len: 1681 microversion: 2.1 time: 0.243736 Jun 20 12:35:23.800814 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3087/6267] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:23 2022] GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 => generated 1681 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:23.911858 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9b29751a-fdc7-4146-8a65-77641add145a tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/430f2910-0355-4cb3-ae87-9151b13c9797" status: 200 len: 1655 microversion: 2.1 time: 0.261811 Jun 20 12:35:23.912871 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3181/6268] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:23 2022] GET /compute/v2.1/servers/430f2910-0355-4cb3-ae87-9151b13c9797 => generated 1655 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:24.812894 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d6320634-cdf3-4f50-a0ba-a2ccbcf183b4 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:24.814209 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d6320634-cdf3-4f50-a0ba-a2ccbcf183b4 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:24.827529 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6320634-cdf3-4f50-a0ba-a2ccbcf183b4 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:24.828164 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6320634-cdf3-4f50-a0ba-a2ccbcf183b4 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:24.830107 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6320634-cdf3-4f50-a0ba-a2ccbcf183b4 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:24.830782 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6320634-cdf3-4f50-a0ba-a2ccbcf183b4 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:24.858591 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:24.930219 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dd130e77-c6b5-42bd-bd59-f9caea3e58d4 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:24.931449 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dd130e77-c6b5-42bd-bd59-f9caea3e58d4 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] [instance: 430f2910-0355-4cb3-ae87-9151b13c9797] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:24.934928 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:24.944278 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd130e77-c6b5-42bd-bd59-f9caea3e58d4 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:24.944740 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd130e77-c6b5-42bd-bd59-f9caea3e58d4 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:24.946011 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd130e77-c6b5-42bd-bd59-f9caea3e58d4 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:24.946700 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd130e77-c6b5-42bd-bd59-f9caea3e58d4 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:25.160044 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d6320634-cdf3-4f50-a0ba-a2ccbcf183b4 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:25.174033 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d6320634-cdf3-4f50-a0ba-a2ccbcf183b4 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651" status: 200 len: 1681 microversion: 2.1 time: 0.365304 Jun 20 12:35:25.176067 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3088/6269] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:24 2022] GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 => generated 1681 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:25.195890 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dd130e77-c6b5-42bd-bd59-f9caea3e58d4 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/430f2910-0355-4cb3-ae87-9151b13c9797" status: 200 len: 1655 microversion: 2.1 time: 0.269685 Jun 20 12:35:25.197393 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3182/6270] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:24 2022] GET /compute/v2.1/servers/430f2910-0355-4cb3-ae87-9151b13c9797 => generated 1655 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:35:26.128252 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-02150ad4-08d4-4bc7-a572-374779071dc2 req-4f90b9aa-73ba-44ed-8249-67a3a40314cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "430f2910-0355-4cb3-ae87-9151b13c9797", "name": "network-vif-deleted", "tag": "3249e0b2-7cd8-4f08-9a5b-8e606ae2d531"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:35:26.147248 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-02150ad4-08d4-4bc7-a572-374779071dc2 req-4f90b9aa-73ba-44ed-8249-67a3a40314cd service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:26.147815 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-02150ad4-08d4-4bc7-a572-374779071dc2 req-4f90b9aa-73ba-44ed-8249-67a3a40314cd service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:26.180459 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-02150ad4-08d4-4bc7-a572-374779071dc2 req-4f90b9aa-73ba-44ed-8249-67a3a40314cd service nova] Creating event network-vif-deleted:3249e0b2-7cd8-4f08-9a5b-8e606ae2d531 for instance 430f2910-0355-4cb3-ae87-9151b13c9797 on n-h1-master-1 Jun 20 12:35:26.189954 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-02150ad4-08d4-4bc7-a572-374779071dc2 req-4f90b9aa-73ba-44ed-8249-67a3a40314cd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066291 Jun 20 12:35:26.191276 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3089/6271] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:35:26.194488 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-da5f7212-9980-425d-b169-d8b3dba8e84d tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:26.194488 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-da5f7212-9980-425d-b169-d8b3dba8e84d tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:26.213769 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da5f7212-9980-425d-b169-d8b3dba8e84d tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:26.214562 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da5f7212-9980-425d-b169-d8b3dba8e84d tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:26.219132 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da5f7212-9980-425d-b169-d8b3dba8e84d tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:26.219968 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9b158ae7-cba9-43aa-9613-0f9dc6e893e6 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:26.220935 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9b158ae7-cba9-43aa-9613-0f9dc6e893e6 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] [instance: 430f2910-0355-4cb3-ae87-9151b13c9797] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:26.221262 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da5f7212-9980-425d-b169-d8b3dba8e84d tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:26.232418 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9b158ae7-cba9-43aa-9613-0f9dc6e893e6 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:26.234208 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9b158ae7-cba9-43aa-9613-0f9dc6e893e6 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:26.235545 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9b158ae7-cba9-43aa-9613-0f9dc6e893e6 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:26.236231 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9b158ae7-cba9-43aa-9613-0f9dc6e893e6 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:26.322362 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9b158ae7-cba9-43aa-9613-0f9dc6e893e6 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:26.323117 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9b158ae7-cba9-43aa-9613-0f9dc6e893e6 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:26.323738 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-9b158ae7-cba9-43aa-9613-0f9dc6e893e6 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lazy-loading 'fault' on Instance uuid 430f2910-0355-4cb3-ae87-9151b13c9797 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:35:26.394713 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9b158ae7-cba9-43aa-9613-0f9dc6e893e6 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/430f2910-0355-4cb3-ae87-9151b13c9797" status: 200 len: 1454 microversion: 2.1 time: 0.181700 Jun 20 12:35:26.395492 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3090/6272] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:26 2022] GET /compute/v2.1/servers/430f2910-0355-4cb3-ae87-9151b13c9797 => generated 1454 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:26.472954 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-da5f7212-9980-425d-b169-d8b3dba8e84d tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:26.482786 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-da5f7212-9980-425d-b169-d8b3dba8e84d tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651" status: 200 len: 1681 microversion: 2.1 time: 0.293339 Jun 20 12:35:26.484058 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3183/6273] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:26 2022] GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 => generated 1681 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:35:27.417709 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a098f3b2-53ce-4d78-8a88-48777b15efd5 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:27.419105 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a098f3b2-53ce-4d78-8a88-48777b15efd5 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] [instance: 430f2910-0355-4cb3-ae87-9151b13c9797] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:27.434098 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a098f3b2-53ce-4d78-8a88-48777b15efd5 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:27.434890 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a098f3b2-53ce-4d78-8a88-48777b15efd5 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:27.437277 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a098f3b2-53ce-4d78-8a88-48777b15efd5 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:27.442229 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a098f3b2-53ce-4d78-8a88-48777b15efd5 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:27.472677 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-a098f3b2-53ce-4d78-8a88-48777b15efd5 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] HTTP exception thrown: Instance 430f2910-0355-4cb3-ae87-9151b13c9797 could not be found. Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a098f3b2-53ce-4d78-8a88-48777b15efd5 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Request method failure captured: Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/430f2910-0355-4cb3-ae87-9151b13c9797 HTTP/1.1 Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGlwIf_TK31KqXGEsnQDGQ200el1mRx6iiAkNgjPek2watwSNJB5Gyeax4ZHQZhxSnWw5R7tRj3NYS6xnuZwXQr1knt31WBodOHrcMkC1u9nowRsu5nqrLTB7o6UTL5g_lDhjch8N7HlIsTrGDxHfrNgjzCIvgbwkJnPjjB6fLUM0Rw Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 7ee4e2c5e94d47d8ad9ee3016ddaf383 Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-TestServerMultinode-1403498289 Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member,admin Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member,admin Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ee4e2c5e94d47d8ad9ee3016ddaf383"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ee4e2c5e94d47d8ad9ee3016ddaf383"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7ee4e2c5e94d47d8ad9ee3016ddaf383"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7ee4e2c5e94d47d8ad9ee3016ddaf383"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-TestServerMultinode-1403498289 Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 7ee4e2c5e94d47d8ad9ee3016ddaf383 Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-TestServerMultinode-1403498289 Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-TestServerMultinode-1403498289-project-admin Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: a7a4ea4ce30a4d75b3063a6931f50216 Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-TestServerMultinode-1403498289-project-admin Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 430f2910-0355-4cb3-ae87-9151b13c9797 could not be found. Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '430f2910-0355-4cb3-ae87-9151b13c9797'} Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 430f2910-0355-4cb3-ae87-9151b13c9797 could not be found. Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 430f2910-0355-4cb3-ae87-9151b13c9797 could not be found. Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:35:27.474638 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:35:27.479869 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:35:27.479869 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:35:27.479869 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:35:27.479869 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:35:27.479869 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:35:27.479869 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 430f2910-0355-4cb3-ae87-9151b13c9797 could not be found. Jun 20 12:35:27.479869 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:35:27.481802 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a098f3b2-53ce-4d78-8a88-48777b15efd5 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Returning 404 to user: Instance 430f2910-0355-4cb3-ae87-9151b13c9797 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:35:27.483197 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a098f3b2-53ce-4d78-8a88-48777b15efd5 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/430f2910-0355-4cb3-ae87-9151b13c9797" status: 404 len: 111 microversion: 2.1 time: 0.072391 Jun 20 12:35:27.486158 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3091/6274] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:27 2022] GET /compute/v2.1/servers/430f2910-0355-4cb3-ae87-9151b13c9797 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:35:27.495876 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8da36d96-877d-4b27-b831-20f3f567d412 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:27.497305 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8da36d96-877d-4b27-b831-20f3f567d412 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] [instance: 488ce558-2908-4c52-b86d-f46904b69da8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:27.505218 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d987571c-bb57-45c0-8125-4fe141cea78f tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:27.506150 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d987571c-bb57-45c0-8125-4fe141cea78f tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:27.513556 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d987571c-bb57-45c0-8125-4fe141cea78f tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:27.514268 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d987571c-bb57-45c0-8125-4fe141cea78f tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:27.515255 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d987571c-bb57-45c0-8125-4fe141cea78f tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:27.516336 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d987571c-bb57-45c0-8125-4fe141cea78f tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:27.523832 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8da36d96-877d-4b27-b831-20f3f567d412 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:27.524613 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8da36d96-877d-4b27-b831-20f3f567d412 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:27.526248 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8da36d96-877d-4b27-b831-20f3f567d412 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:27.526938 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8da36d96-877d-4b27-b831-20f3f567d412 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:27.560911 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d987571c-bb57-45c0-8125-4fe141cea78f tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:27.561622 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d987571c-bb57-45c0-8125-4fe141cea78f tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:27.562218 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-d987571c-bb57-45c0-8125-4fe141cea78f tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lazy-loading 'fault' on Instance uuid 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:35:27.567421 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:27.586377 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8da36d96-877d-4b27-b831-20f3f567d412 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] [instance: 488ce558-2908-4c52-b86d-f46904b69da8] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:35:27.662141 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d987571c-bb57-45c0-8125-4fe141cea78f tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:27.696150 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d987571c-bb57-45c0-8125-4fe141cea78f tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651" status: 200 len: 1331 microversion: 2.1 time: 0.194209 Jun 20 12:35:27.697853 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3092/6275] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:27 2022] GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 => generated 1331 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:27.744347 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8da36d96-877d-4b27-b831-20f3f567d412 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] 10.222.0.27 "DELETE /compute/v2.1/servers/488ce558-2908-4c52-b86d-f46904b69da8" status: 204 len: 0 microversion: 2.1 time: 0.252891 Jun 20 12:35:27.745882 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3184/6276] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:35:27 2022] DELETE /compute/v2.1/servers/488ce558-2908-4c52-b86d-f46904b69da8 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:35:27.754505 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d388d35b-71a5-496b-8e02-2e36f370912c tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:27.755625 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d388d35b-71a5-496b-8e02-2e36f370912c tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] [instance: 488ce558-2908-4c52-b86d-f46904b69da8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:27.767319 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d388d35b-71a5-496b-8e02-2e36f370912c tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:27.768058 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d388d35b-71a5-496b-8e02-2e36f370912c tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:27.769071 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d388d35b-71a5-496b-8e02-2e36f370912c tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:27.769768 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d388d35b-71a5-496b-8e02-2e36f370912c tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:27.926613 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d388d35b-71a5-496b-8e02-2e36f370912c tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/488ce558-2908-4c52-b86d-f46904b69da8" status: 200 len: 1655 microversion: 2.1 time: 0.176571 Jun 20 12:35:27.927203 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3093/6277] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:27 2022] GET /compute/v2.1/servers/488ce558-2908-4c52-b86d-f46904b69da8 => generated 1655 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:28.216590 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-81f608a9-c992-45c8-af4d-52b9729d1f93 req-63acd0d2-ef34-45f6-893e-eb0d94f71f5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651", "name": "network-vif-deleted", "tag": "f9156d23-204a-4564-8c50-89c7db586dbd"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:35:28.226598 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-81f608a9-c992-45c8-af4d-52b9729d1f93 req-63acd0d2-ef34-45f6-893e-eb0d94f71f5a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:28.227678 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-81f608a9-c992-45c8-af4d-52b9729d1f93 req-63acd0d2-ef34-45f6-893e-eb0d94f71f5a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:28.240184 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-81f608a9-c992-45c8-af4d-52b9729d1f93 req-63acd0d2-ef34-45f6-893e-eb0d94f71f5a service nova] Creating event network-vif-deleted:f9156d23-204a-4564-8c50-89c7db586dbd for instance 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 on n-h2-master-1 Jun 20 12:35:28.255197 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-81f608a9-c992-45c8-af4d-52b9729d1f93 req-63acd0d2-ef34-45f6-893e-eb0d94f71f5a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042466 Jun 20 12:35:28.265221 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3185/6278] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:35:28.721169 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2f0ae36d-ebbe-4633-bf3d-051f496723b9 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:28.725896 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2f0ae36d-ebbe-4633-bf3d-051f496723b9 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:28.755122 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2f0ae36d-ebbe-4633-bf3d-051f496723b9 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:28.756442 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2f0ae36d-ebbe-4633-bf3d-051f496723b9 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:28.765730 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2f0ae36d-ebbe-4633-bf3d-051f496723b9 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:28.766844 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2f0ae36d-ebbe-4633-bf3d-051f496723b9 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:28.816331 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2f0ae36d-ebbe-4633-bf3d-051f496723b9 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:28.816972 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2f0ae36d-ebbe-4633-bf3d-051f496723b9 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:28.817809 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-2f0ae36d-ebbe-4633-bf3d-051f496723b9 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lazy-loading 'fault' on Instance uuid 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:35:28.900987 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2f0ae36d-ebbe-4633-bf3d-051f496723b9 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:28.912233 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2f0ae36d-ebbe-4633-bf3d-051f496723b9 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651" status: 200 len: 1331 microversion: 2.1 time: 0.199654 Jun 20 12:35:28.912929 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3094/6279] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:28 2022] GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 => generated 1331 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:28.947712 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bc2a0649-1b39-4ffe-a215-cffcf03e5e16 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:28.950957 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bc2a0649-1b39-4ffe-a215-cffcf03e5e16 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] [instance: 488ce558-2908-4c52-b86d-f46904b69da8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:28.959567 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc2a0649-1b39-4ffe-a215-cffcf03e5e16 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:28.960302 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc2a0649-1b39-4ffe-a215-cffcf03e5e16 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:28.961845 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc2a0649-1b39-4ffe-a215-cffcf03e5e16 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:28.962454 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc2a0649-1b39-4ffe-a215-cffcf03e5e16 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:29.225887 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bc2a0649-1b39-4ffe-a215-cffcf03e5e16 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/488ce558-2908-4c52-b86d-f46904b69da8" status: 200 len: 1655 microversion: 2.1 time: 0.284428 Jun 20 12:35:29.227782 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3186/6280] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:28 2022] GET /compute/v2.1/servers/488ce558-2908-4c52-b86d-f46904b69da8 => generated 1655 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:29.932677 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d2094f1c-2a48-4067-ad40-99df0ff5b904 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:29.933306 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d2094f1c-2a48-4067-ad40-99df0ff5b904 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:29.942637 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d2094f1c-2a48-4067-ad40-99df0ff5b904 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:29.949227 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d2094f1c-2a48-4067-ad40-99df0ff5b904 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:29.957493 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d2094f1c-2a48-4067-ad40-99df0ff5b904 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:29.959789 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d2094f1c-2a48-4067-ad40-99df0ff5b904 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:29.991691 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-d2094f1c-2a48-4067-ad40-99df0ff5b904 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] HTTP exception thrown: Instance 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 could not be found. Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d2094f1c-2a48-4067-ad40-99df0ff5b904 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Request method failure captured: Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 HTTP/1.1 Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGimx3rD_FK4OQ1VdtIOQm_v9s-kKgn6vXzR6ZBiLlIplOW4i7RkYQinkTG1vfKGKwCaoPCprnA7Fw3J7TUX4keyVZVyA-ioRTCduqhd5tDd7aG1Qjuo-15G-XSI8qoUHjPCuXgPU-jMwTPPkfuUfoqrsDV0KX5Zoa18ctkNwDakrYM Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: f4714cac56094f9e9d4ed4adb400064e Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: f4714cac56094f9e9d4ed4adb400064e Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-AttachVolumeNegativeTest-1470856820-project Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 2c8b3f11a7294fbd9d750b1fbbeaa65b Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-AttachVolumeNegativeTest-1470856820-project Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 could not be found. Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651'} Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 could not be found. Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 could not be found. Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:35:29.995020 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:35:30.000393 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:35:30.000393 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:35:30.000393 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:35:30.000393 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:35:30.000393 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:35:30.000393 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 could not be found. Jun 20 12:35:30.000393 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:35:30.002197 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d2094f1c-2a48-4067-ad40-99df0ff5b904 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Returning 404 to user: Instance 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:35:30.003258 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d2094f1c-2a48-4067-ad40-99df0ff5b904 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651" status: 404 len: 111 microversion: 2.1 time: 0.077084 Jun 20 12:35:30.004328 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3095/6281] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:29 2022] GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:35:30.012930 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4184635f-a5ac-48de-8b20-15389b45b7b9 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '.version_select at 0x7f60721ef670>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:30.054640 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4184635f-a5ac-48de-8b20-15389b45b7b9 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-938004171" status: 202 len: 0 microversion: 2.1 time: 0.044342 Jun 20 12:35:30.058356 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3187/6282] 10.222.0.27 () {58 vars in 1217 bytes} [Mon Jun 20 12:35:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-938004171 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:35:30.258925 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4166c1b8-c68d-4407-914d-222982714043 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:30.259794 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4166c1b8-c68d-4407-914d-222982714043 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] [instance: 488ce558-2908-4c52-b86d-f46904b69da8] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:30.272319 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4166c1b8-c68d-4407-914d-222982714043 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:30.272773 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4166c1b8-c68d-4407-914d-222982714043 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:30.274489 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4166c1b8-c68d-4407-914d-222982714043 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:30.275187 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4166c1b8-c68d-4407-914d-222982714043 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:30.282572 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-ad87d1fc-715d-4fc9-b1bd-c074b94cdd53 req-729a33a3-b722-4066-9b1f-388116b52ce9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "488ce558-2908-4c52-b86d-f46904b69da8", "name": "network-vif-deleted", "tag": "6aded6d6-376a-4947-9e41-04c5bd733753"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:35:30.309888 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ad87d1fc-715d-4fc9-b1bd-c074b94cdd53 req-729a33a3-b722-4066-9b1f-388116b52ce9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:30.312857 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ad87d1fc-715d-4fc9-b1bd-c074b94cdd53 req-729a33a3-b722-4066-9b1f-388116b52ce9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:30.345828 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-ad87d1fc-715d-4fc9-b1bd-c074b94cdd53 req-729a33a3-b722-4066-9b1f-388116b52ce9 service nova] Creating event network-vif-deleted:6aded6d6-376a-4947-9e41-04c5bd733753 for instance 488ce558-2908-4c52-b86d-f46904b69da8 on n-h2-master-1 Jun 20 12:35:30.353416 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4166c1b8-c68d-4407-914d-222982714043 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:30.354220 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4166c1b8-c68d-4407-914d-222982714043 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:30.355157 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-4166c1b8-c68d-4407-914d-222982714043 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lazy-loading 'fault' on Instance uuid 488ce558-2908-4c52-b86d-f46904b69da8 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:35:30.355313 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-ad87d1fc-715d-4fc9-b1bd-c074b94cdd53 req-729a33a3-b722-4066-9b1f-388116b52ce9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076922 Jun 20 12:35:30.356698 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3188/6283] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:35:30.419094 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4166c1b8-c68d-4407-914d-222982714043 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/488ce558-2908-4c52-b86d-f46904b69da8" status: 200 len: 1454 microversion: 2.1 time: 0.177401 Jun 20 12:35:30.420041 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3096/6284] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:30 2022] GET /compute/v2.1/servers/488ce558-2908-4c52-b86d-f46904b69da8 => generated 1454 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:31.443804 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-023d6ff4-0db2-42a2-af7b-79016d8356b3 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:31.444777 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-023d6ff4-0db2-42a2-af7b-79016d8356b3 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] [instance: 488ce558-2908-4c52-b86d-f46904b69da8] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:31.453649 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-023d6ff4-0db2-42a2-af7b-79016d8356b3 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:31.454409 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-023d6ff4-0db2-42a2-af7b-79016d8356b3 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:31.455207 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-023d6ff4-0db2-42a2-af7b-79016d8356b3 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:31.455757 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-023d6ff4-0db2-42a2-af7b-79016d8356b3 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:31.471726 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-023d6ff4-0db2-42a2-af7b-79016d8356b3 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] HTTP exception thrown: Instance 488ce558-2908-4c52-b86d-f46904b69da8 could not be found. Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-023d6ff4-0db2-42a2-af7b-79016d8356b3 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Request method failure captured: Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/488ce558-2908-4c52-b86d-f46904b69da8 HTTP/1.1 Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGlwIf_TK31KqXGEsnQDGQ200el1mRx6iiAkNgjPek2watwSNJB5Gyeax4ZHQZhxSnWw5R7tRj3NYS6xnuZwXQr1knt31WBodOHrcMkC1u9nowRsu5nqrLTB7o6UTL5g_lDhjch8N7HlIsTrGDxHfrNgjzCIvgbwkJnPjjB6fLUM0Rw Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 7ee4e2c5e94d47d8ad9ee3016ddaf383 Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-TestServerMultinode-1403498289 Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member,admin Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member,admin Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ee4e2c5e94d47d8ad9ee3016ddaf383"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ee4e2c5e94d47d8ad9ee3016ddaf383"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7ee4e2c5e94d47d8ad9ee3016ddaf383"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7ee4e2c5e94d47d8ad9ee3016ddaf383"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-TestServerMultinode-1403498289 Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 7ee4e2c5e94d47d8ad9ee3016ddaf383 Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-TestServerMultinode-1403498289 Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-TestServerMultinode-1403498289-project-admin Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: a7a4ea4ce30a4d75b3063a6931f50216 Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-TestServerMultinode-1403498289-project-admin Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 488ce558-2908-4c52-b86d-f46904b69da8 could not be found. Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '488ce558-2908-4c52-b86d-f46904b69da8'} Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 488ce558-2908-4c52-b86d-f46904b69da8 could not be found. Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 488ce558-2908-4c52-b86d-f46904b69da8 could not be found. Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:35:31.473931 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:35:31.478383 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:35:31.478383 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:35:31.478383 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:35:31.478383 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:35:31.478383 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:35:31.478383 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 488ce558-2908-4c52-b86d-f46904b69da8 could not be found. Jun 20 12:35:31.478383 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:35:31.478383 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-023d6ff4-0db2-42a2-af7b-79016d8356b3 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] Returning 404 to user: Instance 488ce558-2908-4c52-b86d-f46904b69da8 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:35:31.478383 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-023d6ff4-0db2-42a2-af7b-79016d8356b3 tempest-TestServerMultinode-1403498289 tempest-TestServerMultinode-1403498289-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/488ce558-2908-4c52-b86d-f46904b69da8" status: 404 len: 111 microversion: 2.1 time: 0.037961 Jun 20 12:35:31.479770 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3189/6285] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:31 2022] GET /compute/v2.1/servers/488ce558-2908-4c52-b86d-f46904b69da8 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:35:31.518762 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b2e53e6b-3979-40f4-8f60-e2acbc1ad8df tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:31.519370 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b2e53e6b-3979-40f4-8f60-e2acbc1ad8df tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 028600e9-6eb6-42ac-b62e-de21666d744e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:31.527465 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2e53e6b-3979-40f4-8f60-e2acbc1ad8df tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:31.527920 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2e53e6b-3979-40f4-8f60-e2acbc1ad8df tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:31.528719 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2e53e6b-3979-40f4-8f60-e2acbc1ad8df tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:31.529153 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2e53e6b-3979-40f4-8f60-e2acbc1ad8df tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:31.640623 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-b2e53e6b-3979-40f4-8f60-e2acbc1ad8df tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lazy-loading 'services' on Instance uuid 028600e9-6eb6-42ac-b62e-de21666d744e {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:35:31.754219 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b2e53e6b-3979-40f4-8f60-e2acbc1ad8df tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "DELETE /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e/os-volume_attachments/f87ffa6e-54ec-494d-bfc7-67ae089e0026" status: 202 len: 0 microversion: 2.1 time: 0.239201 Jun 20 12:35:31.761647 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3097/6286] 10.222.0.27 () {58 vars in 1415 bytes} [Mon Jun 20 12:35:31 2022] DELETE /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e/os-volume_attachments/f87ffa6e-54ec-494d-bfc7-67ae089e0026 => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:35:31.766528 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0d8bf723-91ee-49a4-9fad-fc5c724f90e5 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:31.767500 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0d8bf723-91ee-49a4-9fad-fc5c724f90e5 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 028600e9-6eb6-42ac-b62e-de21666d744e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:31.777085 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0d8bf723-91ee-49a4-9fad-fc5c724f90e5 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:31.777870 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0d8bf723-91ee-49a4-9fad-fc5c724f90e5 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:31.778946 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0d8bf723-91ee-49a4-9fad-fc5c724f90e5 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:31.779485 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0d8bf723-91ee-49a4-9fad-fc5c724f90e5 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:31.825884 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0d8bf723-91ee-49a4-9fad-fc5c724f90e5 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063638 Jun 20 12:35:31.830089 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3190/6287] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:35:31 2022] GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:35:32.840902 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4683b214-7646-4d39-86d4-f66cdc0b9214 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:32.842071 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4683b214-7646-4d39-86d4-f66cdc0b9214 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 028600e9-6eb6-42ac-b62e-de21666d744e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:32.865240 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4683b214-7646-4d39-86d4-f66cdc0b9214 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:32.869473 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4683b214-7646-4d39-86d4-f66cdc0b9214 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:32.871479 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4683b214-7646-4d39-86d4-f66cdc0b9214 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:32.875060 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4683b214-7646-4d39-86d4-f66cdc0b9214 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:32.982272 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4683b214-7646-4d39-86d4-f66cdc0b9214 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147580 Jun 20 12:35:32.989530 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3098/6288] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:35:32 2022] GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:35:33.994772 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-325eab18-23c4-417e-872c-9e371742fb33 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:33.995772 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-325eab18-23c4-417e-872c-9e371742fb33 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 028600e9-6eb6-42ac-b62e-de21666d744e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:34.008172 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-325eab18-23c4-417e-872c-9e371742fb33 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:34.015751 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-325eab18-23c4-417e-872c-9e371742fb33 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:34.019303 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-325eab18-23c4-417e-872c-9e371742fb33 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:34.020369 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-325eab18-23c4-417e-872c-9e371742fb33 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:34.098099 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-325eab18-23c4-417e-872c-9e371742fb33 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107640 Jun 20 12:35:34.104315 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3191/6289] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:35:33 2022] GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:35:35.123852 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8e3ab60f-b6c6-4fa5-ba67-d8be79e7a609 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:35.127941 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8e3ab60f-b6c6-4fa5-ba67-d8be79e7a609 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 028600e9-6eb6-42ac-b62e-de21666d744e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:35.145116 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e3ab60f-b6c6-4fa5-ba67-d8be79e7a609 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:35.146892 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e3ab60f-b6c6-4fa5-ba67-d8be79e7a609 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:35.148806 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e3ab60f-b6c6-4fa5-ba67-d8be79e7a609 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:35.149725 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e3ab60f-b6c6-4fa5-ba67-d8be79e7a609 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:35.224989 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8e3ab60f-b6c6-4fa5-ba67-d8be79e7a609 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113448 Jun 20 12:35:35.231984 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3099/6290] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:35:35 2022] GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:35:36.240132 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7630264c-7db8-4193-8320-858b755b8287 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:36.241606 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7630264c-7db8-4193-8320-858b755b8287 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 028600e9-6eb6-42ac-b62e-de21666d744e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:36.262062 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7630264c-7db8-4193-8320-858b755b8287 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:36.262406 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7630264c-7db8-4193-8320-858b755b8287 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:36.264957 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7630264c-7db8-4193-8320-858b755b8287 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:36.265465 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7630264c-7db8-4193-8320-858b755b8287 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:36.322442 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7630264c-7db8-4193-8320-858b755b8287 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086369 Jun 20 12:35:36.323809 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3192/6291] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:35:36 2022] GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:35:37.334327 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9b59813c-29e6-400c-9ff8-b7c862dcb22c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:37.336259 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9b59813c-29e6-400c-9ff8-b7c862dcb22c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 028600e9-6eb6-42ac-b62e-de21666d744e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:37.352374 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9b59813c-29e6-400c-9ff8-b7c862dcb22c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:37.353108 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9b59813c-29e6-400c-9ff8-b7c862dcb22c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:37.354075 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9b59813c-29e6-400c-9ff8-b7c862dcb22c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:37.354677 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9b59813c-29e6-400c-9ff8-b7c862dcb22c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:37.425164 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9b59813c-29e6-400c-9ff8-b7c862dcb22c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095172 Jun 20 12:35:37.425847 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3100/6292] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:35:37 2022] GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:35:38.437916 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6dbf015e-2ef9-4874-8920-fda02d0aa19c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:38.439483 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6dbf015e-2ef9-4874-8920-fda02d0aa19c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 028600e9-6eb6-42ac-b62e-de21666d744e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:38.450746 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6dbf015e-2ef9-4874-8920-fda02d0aa19c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:38.463887 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6dbf015e-2ef9-4874-8920-fda02d0aa19c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:38.465109 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6dbf015e-2ef9-4874-8920-fda02d0aa19c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:38.465732 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6dbf015e-2ef9-4874-8920-fda02d0aa19c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:38.523052 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6dbf015e-2ef9-4874-8920-fda02d0aa19c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089093 Jun 20 12:35:38.531737 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3193/6293] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:35:38 2022] GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:35:39.541970 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ef76db6c-27ad-40e6-8e58-6dffe683d9fc tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:39.543074 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ef76db6c-27ad-40e6-8e58-6dffe683d9fc tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 028600e9-6eb6-42ac-b62e-de21666d744e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:39.560023 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef76db6c-27ad-40e6-8e58-6dffe683d9fc tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:39.560638 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef76db6c-27ad-40e6-8e58-6dffe683d9fc tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:39.561606 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef76db6c-27ad-40e6-8e58-6dffe683d9fc tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:39.562797 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef76db6c-27ad-40e6-8e58-6dffe683d9fc tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:39.618283 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ef76db6c-27ad-40e6-8e58-6dffe683d9fc tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.081083 Jun 20 12:35:39.619378 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3101/6294] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:35:39 2022] GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:35:39.732742 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e131552e-7c3e-4bb8-9603-c1a458ac8a2a tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:39.734045 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e131552e-7c3e-4bb8-9603-c1a458ac8a2a tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 028600e9-6eb6-42ac-b62e-de21666d744e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:39.748147 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e131552e-7c3e-4bb8-9603-c1a458ac8a2a tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:39.749138 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e131552e-7c3e-4bb8-9603-c1a458ac8a2a tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:39.751371 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e131552e-7c3e-4bb8-9603-c1a458ac8a2a tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:39.753784 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e131552e-7c3e-4bb8-9603-c1a458ac8a2a tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:39.817363 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e131552e-7c3e-4bb8-9603-c1a458ac8a2a tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 028600e9-6eb6-42ac-b62e-de21666d744e] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:35:39.933801 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e131552e-7c3e-4bb8-9603-c1a458ac8a2a tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "DELETE /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e" status: 204 len: 0 microversion: 2.1 time: 0.203578 Jun 20 12:35:39.940329 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3194/6295] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:35:39 2022] DELETE /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:35:39.955730 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-de408cbf-d83b-4831-a1e8-6f21ebd2d7cd tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:39.957017 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-de408cbf-d83b-4831-a1e8-6f21ebd2d7cd tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 028600e9-6eb6-42ac-b62e-de21666d744e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:39.970031 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-de408cbf-d83b-4831-a1e8-6f21ebd2d7cd tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:39.971682 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-de408cbf-d83b-4831-a1e8-6f21ebd2d7cd tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:39.972900 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-de408cbf-d83b-4831-a1e8-6f21ebd2d7cd tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:39.973660 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-de408cbf-d83b-4831-a1e8-6f21ebd2d7cd tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:40.232333 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-de408cbf-d83b-4831-a1e8-6f21ebd2d7cd tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:40.244008 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-de408cbf-d83b-4831-a1e8-6f21ebd2d7cd tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e" status: 200 len: 1683 microversion: 2.1 time: 0.303559 Jun 20 12:35:40.256515 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3102/6296] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:39 2022] GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e => generated 1683 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:41.267227 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ace418ea-e6d0-44b7-a48e-665f1a3471d7 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:41.268674 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ace418ea-e6d0-44b7-a48e-665f1a3471d7 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 028600e9-6eb6-42ac-b62e-de21666d744e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:41.278091 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ace418ea-e6d0-44b7-a48e-665f1a3471d7 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:41.279071 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ace418ea-e6d0-44b7-a48e-665f1a3471d7 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:41.280440 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ace418ea-e6d0-44b7-a48e-665f1a3471d7 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:41.281044 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ace418ea-e6d0-44b7-a48e-665f1a3471d7 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:41.564730 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ace418ea-e6d0-44b7-a48e-665f1a3471d7 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:41.581786 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ace418ea-e6d0-44b7-a48e-665f1a3471d7 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e" status: 200 len: 1683 microversion: 2.1 time: 0.315179 Jun 20 12:35:41.604779 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3195/6297] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:41 2022] GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e => generated 1683 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:42.602255 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-85396e61-092a-48db-b5bb-e3bebd128b5d tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:42.603529 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-85396e61-092a-48db-b5bb-e3bebd128b5d tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 028600e9-6eb6-42ac-b62e-de21666d744e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:42.633248 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-85396e61-092a-48db-b5bb-e3bebd128b5d tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:42.634010 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-85396e61-092a-48db-b5bb-e3bebd128b5d tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:42.634997 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-85396e61-092a-48db-b5bb-e3bebd128b5d tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:42.635598 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-85396e61-092a-48db-b5bb-e3bebd128b5d tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:43.062950 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-85396e61-092a-48db-b5bb-e3bebd128b5d tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:43.075886 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-85396e61-092a-48db-b5bb-e3bebd128b5d tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e" status: 200 len: 1683 microversion: 2.1 time: 0.478825 Jun 20 12:35:43.077382 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3103/6298] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:42 2022] GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e => generated 1683 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:44.033652 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-f5a562d8-1852-4d19-8cc5-ff50017b92ef req-71cdb0fe-d18d-4806-bc8a-05ad79383538 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "028600e9-6eb6-42ac-b62e-de21666d744e", "name": "network-vif-deleted", "tag": "c23691ac-f03d-442c-8a79-82564869fd85"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:35:44.046797 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-f5a562d8-1852-4d19-8cc5-ff50017b92ef req-71cdb0fe-d18d-4806-bc8a-05ad79383538 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:44.047244 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-f5a562d8-1852-4d19-8cc5-ff50017b92ef req-71cdb0fe-d18d-4806-bc8a-05ad79383538 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:44.076980 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-f5a562d8-1852-4d19-8cc5-ff50017b92ef req-71cdb0fe-d18d-4806-bc8a-05ad79383538 service nova] Creating event network-vif-deleted:c23691ac-f03d-442c-8a79-82564869fd85 for instance 028600e9-6eb6-42ac-b62e-de21666d744e on n-h2-master-1 Jun 20 12:35:44.096812 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6f4383c6-d470-48d7-b024-e2eafaca6de4 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:44.097437 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-f5a562d8-1852-4d19-8cc5-ff50017b92ef req-71cdb0fe-d18d-4806-bc8a-05ad79383538 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067486 Jun 20 12:35:44.097979 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6f4383c6-d470-48d7-b024-e2eafaca6de4 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 028600e9-6eb6-42ac-b62e-de21666d744e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:44.122905 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3196/6299] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:35:44.129089 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6f4383c6-d470-48d7-b024-e2eafaca6de4 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:44.130239 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6f4383c6-d470-48d7-b024-e2eafaca6de4 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:44.135448 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6f4383c6-d470-48d7-b024-e2eafaca6de4 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:44.136698 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6f4383c6-d470-48d7-b024-e2eafaca6de4 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:44.282454 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6f4383c6-d470-48d7-b024-e2eafaca6de4 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:44.295240 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6f4383c6-d470-48d7-b024-e2eafaca6de4 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e" status: 200 len: 1327 microversion: 2.1 time: 0.204294 Jun 20 12:35:44.306690 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3104/6300] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:44 2022] GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e => generated 1327 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:45.334606 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e8a00846-22c2-4476-9866-97a8a1297d6f tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:45.335978 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e8a00846-22c2-4476-9866-97a8a1297d6f tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 028600e9-6eb6-42ac-b62e-de21666d744e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:45.370215 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e8a00846-22c2-4476-9866-97a8a1297d6f tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:45.375676 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e8a00846-22c2-4476-9866-97a8a1297d6f tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:45.376630 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e8a00846-22c2-4476-9866-97a8a1297d6f tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:45.377085 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e8a00846-22c2-4476-9866-97a8a1297d6f tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:45.439889 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-e8a00846-22c2-4476-9866-97a8a1297d6f tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] HTTP exception thrown: Instance 028600e9-6eb6-42ac-b62e-de21666d744e could not be found. Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e8a00846-22c2-4476-9866-97a8a1297d6f tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Request method failure captured: Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e HTTP/1.1 Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGimx3rD_FK4OQ1VdtIOQm_v9s-kKgn6vXzR6ZBiLlIplOW4i7RkYQinkTG1vfKGKwCaoPCprnA7Fw3J7TUX4keyVZVyA-ioRTCduqhd5tDd7aG1Qjuo-15G-XSI8qoUHjPCuXgPU-jMwTPPkfuUfoqrsDV0KX5Zoa18ctkNwDakrYM Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: f4714cac56094f9e9d4ed4adb400064e Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: f4714cac56094f9e9d4ed4adb400064e Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-AttachVolumeNegativeTest-1470856820-project Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 2c8b3f11a7294fbd9d750b1fbbeaa65b Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-AttachVolumeNegativeTest-1470856820-project Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 028600e9-6eb6-42ac-b62e-de21666d744e could not be found. Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '028600e9-6eb6-42ac-b62e-de21666d744e'} Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 028600e9-6eb6-42ac-b62e-de21666d744e could not be found. Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 028600e9-6eb6-42ac-b62e-de21666d744e could not be found. Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:35:45.465192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:35:45.469197 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:35:45.469197 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:35:45.469197 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:35:45.469197 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:35:45.469197 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:35:45.469197 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 028600e9-6eb6-42ac-b62e-de21666d744e could not be found. Jun 20 12:35:45.469197 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:35:45.474065 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e8a00846-22c2-4476-9866-97a8a1297d6f tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Returning 404 to user: Instance 028600e9-6eb6-42ac-b62e-de21666d744e could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:35:45.477873 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e8a00846-22c2-4476-9866-97a8a1297d6f tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e" status: 404 len: 111 microversion: 2.1 time: 0.162533 Jun 20 12:35:45.487749 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-569529c4-89a8-4fdb-855e-ab95ebe6dc7b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '.version_select at 0x7f6072964f70>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:45.492817 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3197/6301] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:45 2022] GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:35:45.525969 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-569529c4-89a8-4fdb-855e-ab95ebe6dc7b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1749896639" status: 202 len: 0 microversion: 2.1 time: 0.042112 Jun 20 12:35:45.530341 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3105/6302] 10.222.0.27 () {58 vars in 1220 bytes} [Mon Jun 20 12:35:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1749896639 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:35:46.712774 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ffac22f0-6137-495f-afc4-9e6ea932e41b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Action: 'create', calling method: .version_select at 0x7f60849fe430>, body: {"keypair": {"name": "tempest-keypair-790525872", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8RxaCetaiqeFrf3DfD9cAYtytHTLGi/iDE9//zdf1MfANLMPvtHL0HptUFt5SYqoh5DLL2Mf8xIpbilIV2GtlpC60LDBXc/V27zSx5pTGOEEZC72xA51TYCHo4r95ATQ=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:35:46.733186 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-ffac22f0-6137-495f-afc4-9e6ea932e41b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Getting quotas for project f4714cac56094f9e9d4ed4adb400064e. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:35:46.741884 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-ffac22f0-6137-495f-afc4-9e6ea932e41b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Getting quotas for user 2c8b3f11a7294fbd9d750b1fbbeaa65b and project f4714cac56094f9e9d4ed4adb400064e. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:35:46.774001 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ffac22f0-6137-495f-afc4-9e6ea932e41b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.067497 Jun 20 12:35:46.780645 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3198/6303] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 12:35:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:35:49.099097 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e456b847-af7d-4cb2-a41c-420fe3185ba6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1247835611", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2f68d1fc-6d7d-4fb9-a17e-f5081b1bc479"}], "security_groups": [{"name": "tempest-securitygroup--86165692"}], "key_name": "tempest-keypair-790525872", "user_data": "}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:35:49.354241 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-e456b847-af7d-4cb2-a41c-420fe3185ba6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] validate_networks() for [('2f68d1fc-6d7d-4fb9-a17e-f5081b1bc479', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:35:49.890193 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-e456b847-af7d-4cb2-a41c-420fe3185ba6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:35:49.890837 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-e456b847-af7d-4cb2-a41c-420fe3185ba6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:35:49.891552 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-e456b847-af7d-4cb2-a41c-420fe3185ba6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:35:49.892171 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-e456b847-af7d-4cb2-a41c-420fe3185ba6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:35:49.893183 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-e456b847-af7d-4cb2-a41c-420fe3185ba6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:35:49.904251 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e456b847-af7d-4cb2-a41c-420fe3185ba6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:49.904916 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e456b847-af7d-4cb2-a41c-420fe3185ba6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:49.905706 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e456b847-af7d-4cb2-a41c-420fe3185ba6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:49.906329 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e456b847-af7d-4cb2-a41c-420fe3185ba6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:49.915635 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:49.928857 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-e456b847-af7d-4cb2-a41c-420fe3185ba6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Getting quotas for project f4714cac56094f9e9d4ed4adb400064e. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:35:49.934534 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-e456b847-af7d-4cb2-a41c-420fe3185ba6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Getting quotas for user 2c8b3f11a7294fbd9d750b1fbbeaa65b and project f4714cac56094f9e9d4ed4adb400064e. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:35:49.948635 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e456b847-af7d-4cb2-a41c-420fe3185ba6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:35:49.951237 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e456b847-af7d-4cb2-a41c-420fe3185ba6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: f1dbc299-776d-4c09-9457-dc6a998892ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:35:50.002721 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e456b847-af7d-4cb2-a41c-420fe3185ba6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.909469 Jun 20 12:35:50.003992 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3106/6304] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:35:49 2022] POST /compute/v2.1/servers => generated 400 bytes in 911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:35:50.015843 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5b8588f1-b4d9-486b-b26d-cfba2431a9f6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:50.016744 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5b8588f1-b4d9-486b-b26d-cfba2431a9f6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: f1dbc299-776d-4c09-9457-dc6a998892ca] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:50.133306 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5b8588f1-b4d9-486b-b26d-cfba2431a9f6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:50.145467 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5b8588f1-b4d9-486b-b26d-cfba2431a9f6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca" status: 200 len: 1241 microversion: 2.1 time: 0.134060 Jun 20 12:35:50.149185 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3199/6305] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:50 2022] GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca => generated 1241 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:51.167581 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-415d5ac8-1bf8-4489-b30d-b3387abcb547 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:51.168720 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-415d5ac8-1bf8-4489-b30d-b3387abcb547 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: f1dbc299-776d-4c09-9457-dc6a998892ca] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:51.178927 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-415d5ac8-1bf8-4489-b30d-b3387abcb547 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:51.179912 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-415d5ac8-1bf8-4489-b30d-b3387abcb547 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:51.181130 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-415d5ac8-1bf8-4489-b30d-b3387abcb547 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:51.181672 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-415d5ac8-1bf8-4489-b30d-b3387abcb547 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:51.365238 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-415d5ac8-1bf8-4489-b30d-b3387abcb547 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:51.384848 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-415d5ac8-1bf8-4489-b30d-b3387abcb547 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca" status: 200 len: 1301 microversion: 2.1 time: 0.223125 Jun 20 12:35:51.386271 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3107/6306] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:51 2022] GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca => generated 1301 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:52.393024 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7f6d7f3e-443b-40ca-9d70-fe85bf9d131a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-447698649", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "d5adfd0b-f3bc-4f6e-a790-952e360b5cf6", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "fda59e99-54c8-4d95-ad3c-e4129b9a154d"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:35:52.423201 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e3438750-20ec-4de1-9c2f-b00800363650 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:52.424521 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e3438750-20ec-4de1-9c2f-b00800363650 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: f1dbc299-776d-4c09-9457-dc6a998892ca] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:52.435664 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e3438750-20ec-4de1-9c2f-b00800363650 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:52.436402 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e3438750-20ec-4de1-9c2f-b00800363650 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:52.437375 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e3438750-20ec-4de1-9c2f-b00800363650 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:52.437971 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e3438750-20ec-4de1-9c2f-b00800363650 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:52.561408 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-7f6d7f3e-443b-40ca-9d70-fe85bf9d131a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] validate_networks() for [('fda59e99-54c8-4d95-ad3c-e4129b9a154d', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:35:52.747743 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e3438750-20ec-4de1-9c2f-b00800363650 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:52.760182 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e3438750-20ec-4de1-9c2f-b00800363650 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca" status: 200 len: 1365 microversion: 2.1 time: 0.360252 Jun 20 12:35:52.770130 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3108/6307] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:52 2022] GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca => generated 1365 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:53.188125 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-071332ac-2180-4a2d-8777-c4aae1d34a27 req-d953f2c8-6712-4bdb-9e08-38b387595653 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1dbc299-776d-4c09-9457-dc6a998892ca", "tag": "8c66af18-37e1-4a30-a0f1-3ac8f8ac1069"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:35:53.191823 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:53.217355 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-071332ac-2180-4a2d-8777-c4aae1d34a27 req-d953f2c8-6712-4bdb-9e08-38b387595653 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:53.219611 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-071332ac-2180-4a2d-8777-c4aae1d34a27 req-d953f2c8-6712-4bdb-9e08-38b387595653 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:53.247684 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-071332ac-2180-4a2d-8777-c4aae1d34a27 req-d953f2c8-6712-4bdb-9e08-38b387595653 service nova] Creating event network-changed:8c66af18-37e1-4a30-a0f1-3ac8f8ac1069 for instance f1dbc299-776d-4c09-9457-dc6a998892ca on n-h1-master-1 Jun 20 12:35:53.259161 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-071332ac-2180-4a2d-8777-c4aae1d34a27 req-d953f2c8-6712-4bdb-9e08-38b387595653 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075692 Jun 20 12:35:53.260545 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3109/6308] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:35:53.332028 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-7f6d7f3e-443b-40ca-9d70-fe85bf9d131a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:35:53.332028 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-7f6d7f3e-443b-40ca-9d70-fe85bf9d131a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:35:53.332513 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-7f6d7f3e-443b-40ca-9d70-fe85bf9d131a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:35:53.332931 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-7f6d7f3e-443b-40ca-9d70-fe85bf9d131a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:35:53.333352 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-7f6d7f3e-443b-40ca-9d70-fe85bf9d131a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:35:53.345969 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7f6d7f3e-443b-40ca-9d70-fe85bf9d131a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:53.346500 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7f6d7f3e-443b-40ca-9d70-fe85bf9d131a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:53.347555 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7f6d7f3e-443b-40ca-9d70-fe85bf9d131a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:53.348596 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7f6d7f3e-443b-40ca-9d70-fe85bf9d131a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:53.378844 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-7f6d7f3e-443b-40ca-9d70-fe85bf9d131a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Getting quotas for project 5a9c7bbcc9a149f5b77a89141a306c3e. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:35:53.390164 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-7f6d7f3e-443b-40ca-9d70-fe85bf9d131a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Getting quotas for user fed0afc129364664aed8d8a96f499831 and project 5a9c7bbcc9a149f5b77a89141a306c3e. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:35:53.419602 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7f6d7f3e-443b-40ca-9d70-fe85bf9d131a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:35:53.427258 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7f6d7f3e-443b-40ca-9d70-fe85bf9d131a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='d5adfd0b-f3bc-4f6e-a790-952e360b5cf6',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:35:53.529149 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7f6d7f3e-443b-40ca-9d70-fe85bf9d131a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.146873 Jun 20 12:35:53.536734 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3200/6309] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:35:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 12:35:53.550792 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c88a1022-26b0-4cae-b4e4-4f16fc11a9f5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:53.553900 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c88a1022-26b0-4cae-b4e4-4f16fc11a9f5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:53.647074 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c88a1022-26b0-4cae-b4e4-4f16fc11a9f5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:53.655760 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c88a1022-26b0-4cae-b4e4-4f16fc11a9f5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017" status: 200 len: 1056 microversion: 2.1 time: 0.118579 Jun 20 12:35:53.665494 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3110/6310] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:53 2022] GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 => generated 1056 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:53.778100 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-90e17316-f4dd-4f28-b34c-2eedf0993aff tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:53.778610 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-90e17316-f4dd-4f28-b34c-2eedf0993aff tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: f1dbc299-776d-4c09-9457-dc6a998892ca] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:53.786733 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-90e17316-f4dd-4f28-b34c-2eedf0993aff tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:53.787502 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-90e17316-f4dd-4f28-b34c-2eedf0993aff tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:53.788709 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-90e17316-f4dd-4f28-b34c-2eedf0993aff tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:53.789412 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-90e17316-f4dd-4f28-b34c-2eedf0993aff tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:54.097770 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-90e17316-f4dd-4f28-b34c-2eedf0993aff tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:54.110415 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-90e17316-f4dd-4f28-b34c-2eedf0993aff tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca" status: 200 len: 1365 microversion: 2.1 time: 0.335550 Jun 20 12:35:54.120585 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3201/6311] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:53 2022] GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca => generated 1365 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:54.676149 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-92059718-7cc9-4ecc-ac93-73ccfda217bf tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:54.677682 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-92059718-7cc9-4ecc-ac93-73ccfda217bf tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:54.690229 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-92059718-7cc9-4ecc-ac93-73ccfda217bf tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:54.691057 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-92059718-7cc9-4ecc-ac93-73ccfda217bf tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:54.692079 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-92059718-7cc9-4ecc-ac93-73ccfda217bf tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:54.692717 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-92059718-7cc9-4ecc-ac93-73ccfda217bf tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:54.787338 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-92059718-7cc9-4ecc-ac93-73ccfda217bf tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:54.798447 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-92059718-7cc9-4ecc-ac93-73ccfda217bf tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017" status: 200 len: 1108 microversion: 2.1 time: 0.127563 Jun 20 12:35:54.809947 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3111/6312] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:54 2022] GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 => generated 1108 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:55.127992 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-24fde947-bc39-4fde-a488-f780e8ec37ae tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:55.128687 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-24fde947-bc39-4fde-a488-f780e8ec37ae tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: f1dbc299-776d-4c09-9457-dc6a998892ca] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:55.146368 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:55.148524 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-24fde947-bc39-4fde-a488-f780e8ec37ae tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:55.149002 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-24fde947-bc39-4fde-a488-f780e8ec37ae tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:55.149814 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-24fde947-bc39-4fde-a488-f780e8ec37ae tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:55.150261 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-24fde947-bc39-4fde-a488-f780e8ec37ae tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:55.640228 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-24fde947-bc39-4fde-a488-f780e8ec37ae tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:55.658859 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-24fde947-bc39-4fde-a488-f780e8ec37ae tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca" status: 200 len: 1365 microversion: 2.1 time: 0.532398 Jun 20 12:35:55.681320 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3202/6313] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:55 2022] GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca => generated 1365 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:55.815526 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fc8e5d7e-26f7-4044-b9bc-22dd1c96bb2a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:55.816836 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fc8e5d7e-26f7-4044-b9bc-22dd1c96bb2a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:55.827989 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fc8e5d7e-26f7-4044-b9bc-22dd1c96bb2a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:55.828616 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fc8e5d7e-26f7-4044-b9bc-22dd1c96bb2a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:55.830549 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fc8e5d7e-26f7-4044-b9bc-22dd1c96bb2a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:55.831034 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fc8e5d7e-26f7-4044-b9bc-22dd1c96bb2a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:56.079495 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fc8e5d7e-26f7-4044-b9bc-22dd1c96bb2a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:56.088661 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fc8e5d7e-26f7-4044-b9bc-22dd1c96bb2a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017" status: 200 len: 1126 microversion: 2.1 time: 0.277452 Jun 20 12:35:56.089256 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3112/6314] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:55 2022] GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 => generated 1126 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:56.699147 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1200155a-5dd8-4339-9fbb-30af3c0a274c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:56.702411 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1200155a-5dd8-4339-9fbb-30af3c0a274c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: f1dbc299-776d-4c09-9457-dc6a998892ca] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:56.715612 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1200155a-5dd8-4339-9fbb-30af3c0a274c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:56.716885 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1200155a-5dd8-4339-9fbb-30af3c0a274c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:56.717946 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1200155a-5dd8-4339-9fbb-30af3c0a274c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:56.718579 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1200155a-5dd8-4339-9fbb-30af3c0a274c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:56.918310 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1200155a-5dd8-4339-9fbb-30af3c0a274c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:56.926229 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1200155a-5dd8-4339-9fbb-30af3c0a274c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca" status: 200 len: 1365 microversion: 2.1 time: 0.240753 Jun 20 12:35:56.936677 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3203/6315] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:56 2022] GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca => generated 1365 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:57.106090 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7bfc209f-a70f-4cbe-81c6-cee7451828c8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:57.106714 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7bfc209f-a70f-4cbe-81c6-cee7451828c8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:57.116521 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7bfc209f-a70f-4cbe-81c6-cee7451828c8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:57.116980 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7bfc209f-a70f-4cbe-81c6-cee7451828c8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:57.121096 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7bfc209f-a70f-4cbe-81c6-cee7451828c8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:57.121553 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7bfc209f-a70f-4cbe-81c6-cee7451828c8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:57.287240 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-26349dc0-ce35-4267-b510-e04e431797b6 req-2b6f7609-28fa-4946-8527-c02fe12360c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1dbc299-776d-4c09-9457-dc6a998892ca", "name": "network-vif-plugged", "status": "completed", "tag": "8c66af18-37e1-4a30-a0f1-3ac8f8ac1069"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:35:57.306764 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-26349dc0-ce35-4267-b510-e04e431797b6 req-2b6f7609-28fa-4946-8527-c02fe12360c4 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:57.307215 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-26349dc0-ce35-4267-b510-e04e431797b6 req-2b6f7609-28fa-4946-8527-c02fe12360c4 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:57.350877 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-26349dc0-ce35-4267-b510-e04e431797b6 req-2b6f7609-28fa-4946-8527-c02fe12360c4 service nova] Creating event network-vif-plugged:8c66af18-37e1-4a30-a0f1-3ac8f8ac1069 for instance f1dbc299-776d-4c09-9457-dc6a998892ca on n-h1-master-1 Jun 20 12:35:57.361824 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-26349dc0-ce35-4267-b510-e04e431797b6 req-2b6f7609-28fa-4946-8527-c02fe12360c4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078750 Jun 20 12:35:57.362466 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3204/6316] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:35:57.592321 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7bfc209f-a70f-4cbe-81c6-cee7451828c8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:57.606314 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7bfc209f-a70f-4cbe-81c6-cee7451828c8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017" status: 200 len: 1168 microversion: 2.1 time: 0.503204 Jun 20 12:35:57.607894 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3113/6317] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:57 2022] GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 => generated 1168 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:57.705543 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-4f5a79d8-99fa-4daa-a37e-6595f97c9ab0 req-bed40451-4809-4119-81ea-9997c9e21b64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12b2baf4-7582-44e3-93fa-42944effb017", "tag": "5772fa3f-dcc0-4d77-a01d-b89cec0c629a"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:35:57.728861 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-4f5a79d8-99fa-4daa-a37e-6595f97c9ab0 req-bed40451-4809-4119-81ea-9997c9e21b64 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:57.729976 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-4f5a79d8-99fa-4daa-a37e-6595f97c9ab0 req-bed40451-4809-4119-81ea-9997c9e21b64 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:57.735337 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:57.748911 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-4f5a79d8-99fa-4daa-a37e-6595f97c9ab0 req-bed40451-4809-4119-81ea-9997c9e21b64 service nova] Creating event network-changed:5772fa3f-dcc0-4d77-a01d-b89cec0c629a for instance 12b2baf4-7582-44e3-93fa-42944effb017 on n-h2-master-1 Jun 20 12:35:57.755127 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-4f5a79d8-99fa-4daa-a37e-6595f97c9ab0 req-bed40451-4809-4119-81ea-9997c9e21b64 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053535 Jun 20 12:35:57.756408 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3205/6318] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:35:57.945187 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7875a21c-2d0a-4aae-a722-19d76661dd22 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:57.946298 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7875a21c-2d0a-4aae-a722-19d76661dd22 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: f1dbc299-776d-4c09-9457-dc6a998892ca] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:57.957907 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7875a21c-2d0a-4aae-a722-19d76661dd22 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:57.958347 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7875a21c-2d0a-4aae-a722-19d76661dd22 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:57.959138 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7875a21c-2d0a-4aae-a722-19d76661dd22 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:57.959603 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7875a21c-2d0a-4aae-a722-19d76661dd22 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:58.249526 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7875a21c-2d0a-4aae-a722-19d76661dd22 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:58.258379 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7875a21c-2d0a-4aae-a722-19d76661dd22 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca" status: 200 len: 1365 microversion: 2.1 time: 0.317495 Jun 20 12:35:58.259639 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3114/6319] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:57 2022] GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca => generated 1365 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:58.624140 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6e1265f5-95ab-44fa-9789-7533be49bf9e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:58.624879 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6e1265f5-95ab-44fa-9789-7533be49bf9e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:58.641624 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6e1265f5-95ab-44fa-9789-7533be49bf9e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:58.641624 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6e1265f5-95ab-44fa-9789-7533be49bf9e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:58.642996 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6e1265f5-95ab-44fa-9789-7533be49bf9e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:58.643830 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6e1265f5-95ab-44fa-9789-7533be49bf9e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:58.911575 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6e1265f5-95ab-44fa-9789-7533be49bf9e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:58.927410 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6e1265f5-95ab-44fa-9789-7533be49bf9e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017" status: 200 len: 1168 microversion: 2.1 time: 0.307740 Jun 20 12:35:58.929792 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3206/6320] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:58 2022] GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 => generated 1168 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:59.277229 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-924ccd62-3937-42e5-a0f0-a83be46f272e tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:59.278417 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-924ccd62-3937-42e5-a0f0-a83be46f272e tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: f1dbc299-776d-4c09-9457-dc6a998892ca] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:59.286799 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-924ccd62-3937-42e5-a0f0-a83be46f272e tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:59.288119 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-924ccd62-3937-42e5-a0f0-a83be46f272e tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:59.289380 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-924ccd62-3937-42e5-a0f0-a83be46f272e tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:59.290026 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-924ccd62-3937-42e5-a0f0-a83be46f272e tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:59.508876 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-924ccd62-3937-42e5-a0f0-a83be46f272e tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:59.516520 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-924ccd62-3937-42e5-a0f0-a83be46f272e tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca" status: 200 len: 1555 microversion: 2.1 time: 0.244193 Jun 20 12:35:59.517729 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3115/6321] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:59 2022] GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca => generated 1555 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:35:59.533920 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f6b7ebd2-9d7b-4b14-969c-01bf5a8a46c6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:59.534199 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f6b7ebd2-9d7b-4b14-969c-01bf5a8a46c6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: f1dbc299-776d-4c09-9457-dc6a998892ca] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:59.544429 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f6b7ebd2-9d7b-4b14-969c-01bf5a8a46c6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:59.545094 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f6b7ebd2-9d7b-4b14-969c-01bf5a8a46c6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:59.546117 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f6b7ebd2-9d7b-4b14-969c-01bf5a8a46c6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:59.546736 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f6b7ebd2-9d7b-4b14-969c-01bf5a8a46c6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:59.672236 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f6b7ebd2-9d7b-4b14-969c-01bf5a8a46c6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.142651 Jun 20 12:35:59.673917 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3207/6322] 10.222.0.27 () {58 vars in 1274 bytes} [Mon Jun 20 12:35:59 2022] GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca/os-interface => generated 285 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:35:59.947154 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-05a3bee6-8f84-4d85-8160-eb77525f6680 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:59.950885 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-05a3bee6-8f84-4d85-8160-eb77525f6680 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:59.962860 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:59.990378 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05a3bee6-8f84-4d85-8160-eb77525f6680 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:59.992143 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05a3bee6-8f84-4d85-8160-eb77525f6680 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:59.993328 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05a3bee6-8f84-4d85-8160-eb77525f6680 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:59.993952 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05a3bee6-8f84-4d85-8160-eb77525f6680 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:00.251137 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-05a3bee6-8f84-4d85-8160-eb77525f6680 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:36:00.262991 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-05a3bee6-8f84-4d85-8160-eb77525f6680 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017" status: 200 len: 1168 microversion: 2.1 time: 0.321373 Jun 20 12:36:00.272194 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3116/6323] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:35:59 2022] GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 => generated 1168 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:36:01.281438 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8ad66111-995e-43ab-96c9-1bd2c8e22d0f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:01.283470 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8ad66111-995e-43ab-96c9-1bd2c8e22d0f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:01.298707 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ad66111-995e-43ab-96c9-1bd2c8e22d0f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:01.299603 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ad66111-995e-43ab-96c9-1bd2c8e22d0f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:01.301287 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ad66111-995e-43ab-96c9-1bd2c8e22d0f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:01.306936 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ad66111-995e-43ab-96c9-1bd2c8e22d0f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:01.620285 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8ad66111-995e-43ab-96c9-1bd2c8e22d0f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:36:01.628260 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8ad66111-995e-43ab-96c9-1bd2c8e22d0f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017" status: 200 len: 1168 microversion: 2.1 time: 0.352976 Jun 20 12:36:01.629522 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3117/6324] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:36:01 2022] GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 => generated 1168 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:36:01.699947 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-933c5566-73c0-410a-83ab-c48d03429e5f req-606bde58-ef63-4065-8bb4-0e4dfe8fd2fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1dbc299-776d-4c09-9457-dc6a998892ca", "tag": "8c66af18-37e1-4a30-a0f1-3ac8f8ac1069"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:36:01.723601 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-933c5566-73c0-410a-83ab-c48d03429e5f req-606bde58-ef63-4065-8bb4-0e4dfe8fd2fb service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:01.724553 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-933c5566-73c0-410a-83ab-c48d03429e5f req-606bde58-ef63-4065-8bb4-0e4dfe8fd2fb service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:01.776798 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-933c5566-73c0-410a-83ab-c48d03429e5f req-606bde58-ef63-4065-8bb4-0e4dfe8fd2fb service nova] Creating event network-changed:8c66af18-37e1-4a30-a0f1-3ac8f8ac1069 for instance f1dbc299-776d-4c09-9457-dc6a998892ca on n-h1-master-1 Jun 20 12:36:01.816444 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-933c5566-73c0-410a-83ab-c48d03429e5f req-606bde58-ef63-4065-8bb4-0e4dfe8fd2fb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.543011 Jun 20 12:36:01.817549 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3208/6325] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:36:02.649805 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0e2cab35-9b22-454f-af21-b365ae830469 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:02.654662 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0e2cab35-9b22-454f-af21-b365ae830469 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:02.681717 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0e2cab35-9b22-454f-af21-b365ae830469 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:02.686587 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0e2cab35-9b22-454f-af21-b365ae830469 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:02.692662 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0e2cab35-9b22-454f-af21-b365ae830469 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:02.693345 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0e2cab35-9b22-454f-af21-b365ae830469 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:03.199373 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0e2cab35-9b22-454f-af21-b365ae830469 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:36:03.213489 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0e2cab35-9b22-454f-af21-b365ae830469 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017" status: 200 len: 1168 microversion: 2.1 time: 0.571419 Jun 20 12:36:03.214304 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3118/6326] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:36:02 2022] GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 => generated 1168 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:36:04.244015 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-058f777a-ed99-4053-a774-c48df174ffd1 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:04.244940 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-058f777a-ed99-4053-a774-c48df174ffd1 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:04.255418 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:04.258173 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=12 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:04.264804 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-058f777a-ed99-4053-a774-c48df174ffd1 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:04.266492 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-058f777a-ed99-4053-a774-c48df174ffd1 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:04.268009 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-058f777a-ed99-4053-a774-c48df174ffd1 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:04.269136 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-058f777a-ed99-4053-a774-c48df174ffd1 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:04.474413 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-058f777a-ed99-4053-a774-c48df174ffd1 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:36:04.483202 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-058f777a-ed99-4053-a774-c48df174ffd1 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017" status: 200 len: 1168 microversion: 2.1 time: 0.249786 Jun 20 12:36:04.483800 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3209/6327] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:36:04 2022] GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 => generated 1168 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:36:05.499960 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0050ea49-18ff-43ed-ab39-bc8bf1625fbc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:05.501165 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0050ea49-18ff-43ed-ab39-bc8bf1625fbc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:05.503172 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=8 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:05.509394 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0050ea49-18ff-43ed-ab39-bc8bf1625fbc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:05.510041 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0050ea49-18ff-43ed-ab39-bc8bf1625fbc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:05.511091 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0050ea49-18ff-43ed-ab39-bc8bf1625fbc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:05.511685 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0050ea49-18ff-43ed-ab39-bc8bf1625fbc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:05.750015 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0050ea49-18ff-43ed-ab39-bc8bf1625fbc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:36:05.760111 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0050ea49-18ff-43ed-ab39-bc8bf1625fbc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017" status: 200 len: 1168 microversion: 2.1 time: 0.263793 Jun 20 12:36:05.761398 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3119/6328] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:36:05 2022] GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 => generated 1168 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:36:06.778292 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1bc4e732-4d06-435b-90c7-ebf264a2cae3 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:06.778910 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1bc4e732-4d06-435b-90c7-ebf264a2cae3 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:06.786522 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1bc4e732-4d06-435b-90c7-ebf264a2cae3 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:06.787200 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1bc4e732-4d06-435b-90c7-ebf264a2cae3 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:06.788221 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1bc4e732-4d06-435b-90c7-ebf264a2cae3 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:06.788728 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1bc4e732-4d06-435b-90c7-ebf264a2cae3 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:06.932280 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1bc4e732-4d06-435b-90c7-ebf264a2cae3 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:36:06.939945 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1bc4e732-4d06-435b-90c7-ebf264a2cae3 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017" status: 200 len: 1168 microversion: 2.1 time: 0.165625 Jun 20 12:36:06.940645 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3210/6329] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:36:06 2022] GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 => generated 1168 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:36:07.959089 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-707c8487-7db7-4ef9-8835-b0c513355d6d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:07.959711 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-707c8487-7db7-4ef9-8835-b0c513355d6d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:07.966347 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-707c8487-7db7-4ef9-8835-b0c513355d6d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:07.966796 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-707c8487-7db7-4ef9-8835-b0c513355d6d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:07.967575 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-707c8487-7db7-4ef9-8835-b0c513355d6d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:07.968007 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-707c8487-7db7-4ef9-8835-b0c513355d6d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:08.124979 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-707c8487-7db7-4ef9-8835-b0c513355d6d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:36:08.133386 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-707c8487-7db7-4ef9-8835-b0c513355d6d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017" status: 200 len: 1168 microversion: 2.1 time: 0.179272 Jun 20 12:36:08.133975 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3120/6330] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:36:07 2022] GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 => generated 1168 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:36:09.151070 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-51ed1b97-4b83-4a05-93d2-082621243ea2 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:09.151785 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-51ed1b97-4b83-4a05-93d2-082621243ea2 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:09.160157 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51ed1b97-4b83-4a05-93d2-082621243ea2 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:09.160758 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51ed1b97-4b83-4a05-93d2-082621243ea2 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:09.161601 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51ed1b97-4b83-4a05-93d2-082621243ea2 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:09.162106 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51ed1b97-4b83-4a05-93d2-082621243ea2 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:09.310945 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-51ed1b97-4b83-4a05-93d2-082621243ea2 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:36:09.318969 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-51ed1b97-4b83-4a05-93d2-082621243ea2 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017" status: 200 len: 1168 microversion: 2.1 time: 0.172392 Jun 20 12:36:09.319688 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3211/6331] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:36:09 2022] GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 => generated 1168 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:36:10.337294 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bf25ecdc-3e5a-44eb-820f-d8a74d090df7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:10.338073 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bf25ecdc-3e5a-44eb-820f-d8a74d090df7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:10.345452 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bf25ecdc-3e5a-44eb-820f-d8a74d090df7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:10.345877 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bf25ecdc-3e5a-44eb-820f-d8a74d090df7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:10.346691 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bf25ecdc-3e5a-44eb-820f-d8a74d090df7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:10.347113 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bf25ecdc-3e5a-44eb-820f-d8a74d090df7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:10.485685 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-bf25ecdc-3e5a-44eb-820f-d8a74d090df7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:36:10.493673 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bf25ecdc-3e5a-44eb-820f-d8a74d090df7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017" status: 200 len: 1168 microversion: 2.1 time: 0.161191 Jun 20 12:36:10.494593 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3121/6332] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:36:10 2022] GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 => generated 1168 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:36:11.510379 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1c16f7db-d1c6-4424-bf94-b21ba4e38e01 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:11.511097 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1c16f7db-d1c6-4424-bf94-b21ba4e38e01 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:11.518654 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c16f7db-d1c6-4424-bf94-b21ba4e38e01 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:11.519108 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c16f7db-d1c6-4424-bf94-b21ba4e38e01 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:11.519891 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c16f7db-d1c6-4424-bf94-b21ba4e38e01 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:11.520353 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c16f7db-d1c6-4424-bf94-b21ba4e38e01 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:11.671198 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1c16f7db-d1c6-4424-bf94-b21ba4e38e01 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:36:11.679766 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1c16f7db-d1c6-4424-bf94-b21ba4e38e01 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017" status: 200 len: 1168 microversion: 2.1 time: 0.173209 Jun 20 12:36:11.680752 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3212/6333] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:36:11 2022] GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 => generated 1168 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:36:12.698709 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fd0e1284-d446-4f25-9396-468b4ce00ba0 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:12.699249 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fd0e1284-d446-4f25-9396-468b4ce00ba0 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:12.706930 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fd0e1284-d446-4f25-9396-468b4ce00ba0 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:12.707456 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fd0e1284-d446-4f25-9396-468b4ce00ba0 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:12.708546 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fd0e1284-d446-4f25-9396-468b4ce00ba0 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:12.709052 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fd0e1284-d446-4f25-9396-468b4ce00ba0 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:12.864576 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fd0e1284-d446-4f25-9396-468b4ce00ba0 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:36:12.877848 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fd0e1284-d446-4f25-9396-468b4ce00ba0 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017" status: 200 len: 1168 microversion: 2.1 time: 0.183243 Jun 20 12:36:12.878833 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3122/6334] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:36:12 2022] GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 => generated 1168 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:36:13.895435 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-09ce442a-03e9-4388-9bce-223ca2ae5744 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:13.896045 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-09ce442a-03e9-4388-9bce-223ca2ae5744 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:13.903062 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-09ce442a-03e9-4388-9bce-223ca2ae5744 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:13.903546 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-09ce442a-03e9-4388-9bce-223ca2ae5744 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:13.904338 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-09ce442a-03e9-4388-9bce-223ca2ae5744 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:13.904772 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-09ce442a-03e9-4388-9bce-223ca2ae5744 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:14.053526 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-09ce442a-03e9-4388-9bce-223ca2ae5744 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:36:14.065145 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-09ce442a-03e9-4388-9bce-223ca2ae5744 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017" status: 200 len: 1202 microversion: 2.1 time: 0.173360 Jun 20 12:36:14.066030 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3213/6335] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:36:13 2022] GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 => generated 1202 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:36:15.085917 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-94830ec1-e115-41b0-8ba8-e961178fc1ec tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:15.086552 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-94830ec1-e115-41b0-8ba8-e961178fc1ec tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:15.094074 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94830ec1-e115-41b0-8ba8-e961178fc1ec tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:15.094533 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94830ec1-e115-41b0-8ba8-e961178fc1ec tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:15.095322 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94830ec1-e115-41b0-8ba8-e961178fc1ec tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:15.095764 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94830ec1-e115-41b0-8ba8-e961178fc1ec tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:15.249975 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-94830ec1-e115-41b0-8ba8-e961178fc1ec tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:36:15.261363 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-94830ec1-e115-41b0-8ba8-e961178fc1ec tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017" status: 200 len: 1202 microversion: 2.1 time: 0.179834 Jun 20 12:36:15.263186 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3123/6336] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:36:15 2022] GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 => generated 1202 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:36:16.284268 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-463f3c74-a20a-4d48-8a87-cf6c89acc27d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:16.285731 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-463f3c74-a20a-4d48-8a87-cf6c89acc27d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:16.296878 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-463f3c74-a20a-4d48-8a87-cf6c89acc27d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:16.297338 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-463f3c74-a20a-4d48-8a87-cf6c89acc27d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:16.298135 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-463f3c74-a20a-4d48-8a87-cf6c89acc27d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:16.298574 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-463f3c74-a20a-4d48-8a87-cf6c89acc27d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:16.462815 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-463f3c74-a20a-4d48-8a87-cf6c89acc27d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:36:16.474766 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-463f3c74-a20a-4d48-8a87-cf6c89acc27d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017" status: 200 len: 1202 microversion: 2.1 time: 0.194395 Jun 20 12:36:16.477735 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3214/6337] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:36:16 2022] GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 => generated 1202 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:36:17.493929 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-53b8b218-4515-4e80-aebf-82b3f4ad25a7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:17.494682 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-53b8b218-4515-4e80-aebf-82b3f4ad25a7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:17.501525 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-53b8b218-4515-4e80-aebf-82b3f4ad25a7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:17.501945 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-53b8b218-4515-4e80-aebf-82b3f4ad25a7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:17.502719 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-53b8b218-4515-4e80-aebf-82b3f4ad25a7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:17.503155 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-53b8b218-4515-4e80-aebf-82b3f4ad25a7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:17.654891 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-53b8b218-4515-4e80-aebf-82b3f4ad25a7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:36:17.663791 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-53b8b218-4515-4e80-aebf-82b3f4ad25a7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017" status: 200 len: 1202 microversion: 2.1 time: 0.173920 Jun 20 12:36:17.664417 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3124/6338] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:36:17 2022] GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 => generated 1202 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:36:18.681638 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5b24f748-2511-47dc-92ad-470b91c15e36 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:18.682274 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5b24f748-2511-47dc-92ad-470b91c15e36 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:18.689364 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b24f748-2511-47dc-92ad-470b91c15e36 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:18.689828 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b24f748-2511-47dc-92ad-470b91c15e36 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:18.690599 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b24f748-2511-47dc-92ad-470b91c15e36 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:18.691042 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b24f748-2511-47dc-92ad-470b91c15e36 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:18.826397 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5b24f748-2511-47dc-92ad-470b91c15e36 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:36:18.834812 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5b24f748-2511-47dc-92ad-470b91c15e36 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017" status: 200 len: 1202 microversion: 2.1 time: 0.157560 Jun 20 12:36:18.840908 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3215/6339] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:36:18 2022] GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 => generated 1202 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:36:19.854701 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-421d4854-013c-403f-a9c7-c535ea76efc9 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:19.855248 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-421d4854-013c-403f-a9c7-c535ea76efc9 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:19.862623 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-421d4854-013c-403f-a9c7-c535ea76efc9 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:19.863268 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-421d4854-013c-403f-a9c7-c535ea76efc9 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:19.864297 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-421d4854-013c-403f-a9c7-c535ea76efc9 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:19.868128 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-421d4854-013c-403f-a9c7-c535ea76efc9 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:19.872716 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:20.042461 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-421d4854-013c-403f-a9c7-c535ea76efc9 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:36:20.050889 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-421d4854-013c-403f-a9c7-c535ea76efc9 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017" status: 200 len: 1202 microversion: 2.1 time: 0.202824 Jun 20 12:36:20.051604 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3125/6340] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:36:19 2022] GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 => generated 1202 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:36:21.068505 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8d17c50b-9907-4cea-98d7-a7bc20ff5b25 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:21.069193 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8d17c50b-9907-4cea-98d7-a7bc20ff5b25 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:21.077069 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8d17c50b-9907-4cea-98d7-a7bc20ff5b25 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:21.077632 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8d17c50b-9907-4cea-98d7-a7bc20ff5b25 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:21.078572 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8d17c50b-9907-4cea-98d7-a7bc20ff5b25 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:21.079107 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8d17c50b-9907-4cea-98d7-a7bc20ff5b25 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:21.217225 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8d17c50b-9907-4cea-98d7-a7bc20ff5b25 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:36:21.226749 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8d17c50b-9907-4cea-98d7-a7bc20ff5b25 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017" status: 200 len: 1202 microversion: 2.1 time: 0.162386 Jun 20 12:36:21.227524 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3216/6341] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:36:21 2022] GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 => generated 1202 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:36:22.245835 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-30ba8ad3-dbae-468c-91a8-1f1bdd2d6994 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:22.246800 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-30ba8ad3-dbae-468c-91a8-1f1bdd2d6994 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:22.258471 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-30ba8ad3-dbae-468c-91a8-1f1bdd2d6994 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:22.259151 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-30ba8ad3-dbae-468c-91a8-1f1bdd2d6994 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:22.260382 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-30ba8ad3-dbae-468c-91a8-1f1bdd2d6994 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:22.261091 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-30ba8ad3-dbae-468c-91a8-1f1bdd2d6994 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:22.400646 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-30ba8ad3-dbae-468c-91a8-1f1bdd2d6994 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:36:22.409164 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-30ba8ad3-dbae-468c-91a8-1f1bdd2d6994 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017" status: 200 len: 1202 microversion: 2.1 time: 0.169813 Jun 20 12:36:22.409745 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3126/6342] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:36:22 2022] GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 => generated 1202 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:36:22.856463 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-50ebb707-a443-4c08-a7cc-b3c92477c840 req-3e327a00-52d4-4551-8466-e194d4ec8579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12b2baf4-7582-44e3-93fa-42944effb017", "name": "network-vif-plugged", "status": "completed", "tag": "5772fa3f-dcc0-4d77-a01d-b89cec0c629a"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:36:22.866172 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-50ebb707-a443-4c08-a7cc-b3c92477c840 req-3e327a00-52d4-4551-8466-e194d4ec8579 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:22.866628 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-50ebb707-a443-4c08-a7cc-b3c92477c840 req-3e327a00-52d4-4551-8466-e194d4ec8579 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:22.878480 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-50ebb707-a443-4c08-a7cc-b3c92477c840 req-3e327a00-52d4-4551-8466-e194d4ec8579 service nova] Creating event network-vif-plugged:5772fa3f-dcc0-4d77-a01d-b89cec0c629a for instance 12b2baf4-7582-44e3-93fa-42944effb017 on n-h2-master-1 Jun 20 12:36:22.883659 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-50ebb707-a443-4c08-a7cc-b3c92477c840 req-3e327a00-52d4-4551-8466-e194d4ec8579 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031052 Jun 20 12:36:22.884475 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3217/6343] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:36:23.426698 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8de05599-b0b7-4bc1-a2e0-3a2313b4ff65 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:23.427276 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8de05599-b0b7-4bc1-a2e0-3a2313b4ff65 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:23.434865 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8de05599-b0b7-4bc1-a2e0-3a2313b4ff65 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:23.435313 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8de05599-b0b7-4bc1-a2e0-3a2313b4ff65 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:23.436083 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8de05599-b0b7-4bc1-a2e0-3a2313b4ff65 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:23.436552 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8de05599-b0b7-4bc1-a2e0-3a2313b4ff65 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:23.576635 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8de05599-b0b7-4bc1-a2e0-3a2313b4ff65 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:36:23.584705 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8de05599-b0b7-4bc1-a2e0-3a2313b4ff65 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017" status: 200 len: 1202 microversion: 2.1 time: 0.162001 Jun 20 12:36:23.585252 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3127/6344] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:36:23 2022] GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 => generated 1202 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:36:24.604163 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-aa3cb4c1-ded2-4eee-8db4-0dc93a4a6ce9 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:24.604904 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-aa3cb4c1-ded2-4eee-8db4-0dc93a4a6ce9 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:24.611576 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa3cb4c1-ded2-4eee-8db4-0dc93a4a6ce9 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:24.612067 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa3cb4c1-ded2-4eee-8db4-0dc93a4a6ce9 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:24.612872 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa3cb4c1-ded2-4eee-8db4-0dc93a4a6ce9 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:24.613320 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa3cb4c1-ded2-4eee-8db4-0dc93a4a6ce9 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:24.773303 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-aa3cb4c1-ded2-4eee-8db4-0dc93a4a6ce9 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:36:24.781433 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-aa3cb4c1-ded2-4eee-8db4-0dc93a4a6ce9 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017" status: 200 len: 1389 microversion: 2.1 time: 0.183186 Jun 20 12:36:24.782344 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3218/6345] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:36:24 2022] GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 => generated 1389 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:36:24.800517 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a107ca4f-7f40-485d-8992-469b2ad37a39 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:24.801211 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a107ca4f-7f40-485d-8992-469b2ad37a39 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:24.804871 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=40 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:24.810689 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a107ca4f-7f40-485d-8992-469b2ad37a39 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:24.811145 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a107ca4f-7f40-485d-8992-469b2ad37a39 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:24.811923 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a107ca4f-7f40-485d-8992-469b2ad37a39 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:24.812392 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a107ca4f-7f40-485d-8992-469b2ad37a39 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:24.950514 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a107ca4f-7f40-485d-8992-469b2ad37a39 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:36:24.958512 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a107ca4f-7f40-485d-8992-469b2ad37a39 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017" status: 200 len: 1389 microversion: 2.1 time: 0.162549 Jun 20 12:36:24.959166 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3128/6346] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:36:24 2022] GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 => generated 1389 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:36:24.977439 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-680a59f5-cbbb-4501-83e4-debaa646dde1 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:24.978083 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-680a59f5-cbbb-4501-83e4-debaa646dde1 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:24.986140 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-680a59f5-cbbb-4501-83e4-debaa646dde1 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:24.986837 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-680a59f5-cbbb-4501-83e4-debaa646dde1 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:24.987670 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-680a59f5-cbbb-4501-83e4-debaa646dde1 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:24.988121 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-680a59f5-cbbb-4501-83e4-debaa646dde1 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:25.121426 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-680a59f5-cbbb-4501-83e4-debaa646dde1 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:36:25.129460 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-680a59f5-cbbb-4501-83e4-debaa646dde1 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017" status: 200 len: 1389 microversion: 2.1 time: 0.156410 Jun 20 12:36:25.130135 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3219/6347] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:36:24 2022] GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 => generated 1389 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:36:25.201520 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-48243f92-9b76-485c-b472-aa500833995a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:25.202016 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-48243f92-9b76-485c-b472-aa500833995a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:25.208315 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-48243f92-9b76-485c-b472-aa500833995a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:25.208767 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-48243f92-9b76-485c-b472-aa500833995a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:25.209609 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-48243f92-9b76-485c-b472-aa500833995a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:25.210242 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-48243f92-9b76-485c-b472-aa500833995a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:25.236379 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-48243f92-9b76-485c-b472-aa500833995a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:36:25.322471 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-48243f92-9b76-485c-b472-aa500833995a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "DELETE /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017" status: 204 len: 0 microversion: 2.1 time: 0.123745 Jun 20 12:36:25.326804 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3129/6348] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:36:25 2022] DELETE /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:36:25.332170 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b488e81b-9820-48aa-84e1-6071608774eb tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:25.332843 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b488e81b-9820-48aa-84e1-6071608774eb tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:25.335888 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=36 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:25.342885 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b488e81b-9820-48aa-84e1-6071608774eb tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:25.343338 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b488e81b-9820-48aa-84e1-6071608774eb tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:25.344316 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b488e81b-9820-48aa-84e1-6071608774eb tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:25.344603 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b488e81b-9820-48aa-84e1-6071608774eb tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:25.488520 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b488e81b-9820-48aa-84e1-6071608774eb tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:36:25.497636 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b488e81b-9820-48aa-84e1-6071608774eb tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017" status: 200 len: 1395 microversion: 2.1 time: 0.169337 Jun 20 12:36:25.498399 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3220/6349] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:36:25 2022] GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 => generated 1395 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:36:26.515999 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d3a2dfa0-4c7a-4840-91d2-3cd1ff61f403 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:26.516727 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d3a2dfa0-4c7a-4840-91d2-3cd1ff61f403 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:26.524858 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3a2dfa0-4c7a-4840-91d2-3cd1ff61f403 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:26.525309 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3a2dfa0-4c7a-4840-91d2-3cd1ff61f403 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:26.526116 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3a2dfa0-4c7a-4840-91d2-3cd1ff61f403 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:26.526595 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3a2dfa0-4c7a-4840-91d2-3cd1ff61f403 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:26.682028 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d3a2dfa0-4c7a-4840-91d2-3cd1ff61f403 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:36:26.693284 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d3a2dfa0-4c7a-4840-91d2-3cd1ff61f403 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017" status: 200 len: 1395 microversion: 2.1 time: 0.181602 Jun 20 12:36:26.694443 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3130/6350] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:36:26 2022] GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 => generated 1395 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:36:27.598345 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-39e36653-83a0-4299-9f71-77eb4bf67eb4 req-2349f90f-4da6-4c66-b6ec-c11f766095bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12b2baf4-7582-44e3-93fa-42944effb017", "name": "network-vif-deleted", "tag": "5772fa3f-dcc0-4d77-a01d-b89cec0c629a"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:36:27.613688 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-39e36653-83a0-4299-9f71-77eb4bf67eb4 req-2349f90f-4da6-4c66-b6ec-c11f766095bb service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:27.614151 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-39e36653-83a0-4299-9f71-77eb4bf67eb4 req-2349f90f-4da6-4c66-b6ec-c11f766095bb service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:27.653797 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-39e36653-83a0-4299-9f71-77eb4bf67eb4 req-2349f90f-4da6-4c66-b6ec-c11f766095bb service nova] Creating event network-vif-deleted:5772fa3f-dcc0-4d77-a01d-b89cec0c629a for instance 12b2baf4-7582-44e3-93fa-42944effb017 on n-h2-master-1 Jun 20 12:36:27.662868 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-39e36653-83a0-4299-9f71-77eb4bf67eb4 req-2349f90f-4da6-4c66-b6ec-c11f766095bb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068876 Jun 20 12:36:27.663783 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3221/6351] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:36:27.712869 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b8eeeaa9-3076-4449-bb91-b247c7c21444 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:27.713929 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b8eeeaa9-3076-4449-bb91-b247c7c21444 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:27.722554 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b8eeeaa9-3076-4449-bb91-b247c7c21444 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:27.723018 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b8eeeaa9-3076-4449-bb91-b247c7c21444 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:27.724089 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b8eeeaa9-3076-4449-bb91-b247c7c21444 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:27.724697 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b8eeeaa9-3076-4449-bb91-b247c7c21444 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:27.813997 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b8eeeaa9-3076-4449-bb91-b247c7c21444 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:36:27.823037 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b8eeeaa9-3076-4449-bb91-b247c7c21444 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017" status: 200 len: 1187 microversion: 2.1 time: 0.114292 Jun 20 12:36:27.824264 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3131/6352] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:36:27 2022] GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 => generated 1187 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:36:28.843030 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1adba95b-d7d0-409d-981f-5aad6f8127e7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:28.843832 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1adba95b-d7d0-409d-981f-5aad6f8127e7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:28.851928 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1adba95b-d7d0-409d-981f-5aad6f8127e7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:28.852527 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1adba95b-d7d0-409d-981f-5aad6f8127e7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:28.853399 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1adba95b-d7d0-409d-981f-5aad6f8127e7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:28.853903 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1adba95b-d7d0-409d-981f-5aad6f8127e7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:28.856845 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=84 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:28.922900 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1adba95b-d7d0-409d-981f-5aad6f8127e7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:36:28.932574 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1adba95b-d7d0-409d-981f-5aad6f8127e7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017" status: 200 len: 1187 microversion: 2.1 time: 0.095621 Jun 20 12:36:28.933269 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3222/6353] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:36:28 2022] GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 => generated 1187 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:36:29.950424 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-854224bb-5847-4715-a3f0-d9ef053d4723 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:29.951256 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-854224bb-5847-4715-a3f0-d9ef053d4723 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:29.958265 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-854224bb-5847-4715-a3f0-d9ef053d4723 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:29.958718 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-854224bb-5847-4715-a3f0-d9ef053d4723 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:29.959488 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-854224bb-5847-4715-a3f0-d9ef053d4723 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:29.960492 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-854224bb-5847-4715-a3f0-d9ef053d4723 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:30.094198 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-854224bb-5847-4715-a3f0-d9ef053d4723 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:36:30.108476 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-854224bb-5847-4715-a3f0-d9ef053d4723 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017" status: 200 len: 1187 microversion: 2.1 time: 0.161245 Jun 20 12:36:30.118978 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3132/6354] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:36:29 2022] GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 => generated 1187 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:36:31.126800 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-70eeb322-a0dd-4da8-a695-c11878cbc049 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:31.127705 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-70eeb322-a0dd-4da8-a695-c11878cbc049 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:31.136176 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-70eeb322-a0dd-4da8-a695-c11878cbc049 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:31.136728 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-70eeb322-a0dd-4da8-a695-c11878cbc049 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:31.137709 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-70eeb322-a0dd-4da8-a695-c11878cbc049 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:31.138265 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-70eeb322-a0dd-4da8-a695-c11878cbc049 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:31.230856 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-70eeb322-a0dd-4da8-a695-c11878cbc049 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:36:31.239952 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-70eeb322-a0dd-4da8-a695-c11878cbc049 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017" status: 200 len: 1187 microversion: 2.1 time: 0.118100 Jun 20 12:36:31.240577 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3223/6355] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:36:31 2022] GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 => generated 1187 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:36:32.269290 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d4c876a3-4c1b-42c3-a2ae-50cad12751be tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:32.270143 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d4c876a3-4c1b-42c3-a2ae-50cad12751be tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:32.277608 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4c876a3-4c1b-42c3-a2ae-50cad12751be tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:32.278579 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4c876a3-4c1b-42c3-a2ae-50cad12751be tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:32.279528 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4c876a3-4c1b-42c3-a2ae-50cad12751be tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:32.280041 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4c876a3-4c1b-42c3-a2ae-50cad12751be tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:32.317835 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4c876a3-4c1b-42c3-a2ae-50cad12751be tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:32.318643 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4c876a3-4c1b-42c3-a2ae-50cad12751be tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:32.319206 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-d4c876a3-4c1b-42c3-a2ae-50cad12751be tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lazy-loading 'fault' on Instance uuid 12b2baf4-7582-44e3-93fa-42944effb017 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:36:32.373298 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d4c876a3-4c1b-42c3-a2ae-50cad12751be tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:36:32.385153 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d4c876a3-4c1b-42c3-a2ae-50cad12751be tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017" status: 200 len: 1192 microversion: 2.1 time: 0.130493 Jun 20 12:36:32.385757 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3133/6356] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:36:32 2022] GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 => generated 1192 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:36:33.403171 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-da7fd36b-d182-4dfe-9d2e-650b33d9cb11 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:33.403881 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-da7fd36b-d182-4dfe-9d2e-650b33d9cb11 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:33.412431 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da7fd36b-d182-4dfe-9d2e-650b33d9cb11 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:33.413009 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da7fd36b-d182-4dfe-9d2e-650b33d9cb11 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:33.414105 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da7fd36b-d182-4dfe-9d2e-650b33d9cb11 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:33.414761 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da7fd36b-d182-4dfe-9d2e-650b33d9cb11 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:33.429724 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-da7fd36b-d182-4dfe-9d2e-650b33d9cb11 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] HTTP exception thrown: Instance 12b2baf4-7582-44e3-93fa-42944effb017 could not be found. Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-da7fd36b-d182-4dfe-9d2e-650b33d9cb11 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Request method failure captured: Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 HTTP/1.1 Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGlbodlapeisJn5a0HtwbwcZIYoBmT5AMrWgFKctZEM-c8IEHUY-HIxlKO2btmEhIp6rTchMUsTfBqlVWDOj1EarcMAz1U-zU3gC1LYOn6ihs7mNZ7VuUoyKyfaVYT5-C41dz-fiCbk7B4FysstqCDj9MrkXDGMTtiNF2ZH2AvXNm6I Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 5a9c7bbcc9a149f5b77a89141a306c3e Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-TestVolumeBootPattern-431625802 Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-TestVolumeBootPattern-431625802 Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 5a9c7bbcc9a149f5b77a89141a306c3e Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-TestVolumeBootPattern-431625802 Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-TestVolumeBootPattern-431625802-project Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: fed0afc129364664aed8d8a96f499831 Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-TestVolumeBootPattern-431625802-project Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 12b2baf4-7582-44e3-93fa-42944effb017 could not be found. Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '12b2baf4-7582-44e3-93fa-42944effb017'} Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12b2baf4-7582-44e3-93fa-42944effb017 could not be found. Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12b2baf4-7582-44e3-93fa-42944effb017 could not be found. Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:36:33.431593 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:36:33.435481 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:36:33.435481 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:36:33.435481 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:36:33.435481 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:36:33.435481 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:36:33.435481 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12b2baf4-7582-44e3-93fa-42944effb017 could not be found. Jun 20 12:36:33.435481 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:36:33.435481 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-da7fd36b-d182-4dfe-9d2e-650b33d9cb11 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Returning 404 to user: Instance 12b2baf4-7582-44e3-93fa-42944effb017 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:36:33.435481 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-da7fd36b-d182-4dfe-9d2e-650b33d9cb11 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017" status: 404 len: 111 microversion: 2.1 time: 0.034021 Jun 20 12:36:33.435481 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3224/6357] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:36:33 2022] GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:36:35.595656 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6f1dddfd-251e-407a-873e-6c3db0dda61e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:35.596358 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6f1dddfd-251e-407a-873e-6c3db0dda61e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:35.607259 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c9f32afc-5fea-484f-9c1d-ded92033b2aa tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:35.607898 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c9f32afc-5fea-484f-9c1d-ded92033b2aa tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: f1dbc299-776d-4c09-9457-dc6a998892ca] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:35.617561 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c9f32afc-5fea-484f-9c1d-ded92033b2aa tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:35.619444 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6f1dddfd-251e-407a-873e-6c3db0dda61e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:35.620082 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6f1dddfd-251e-407a-873e-6c3db0dda61e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:35.620781 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c9f32afc-5fea-484f-9c1d-ded92033b2aa tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:35.621814 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6f1dddfd-251e-407a-873e-6c3db0dda61e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:35.622858 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c9f32afc-5fea-484f-9c1d-ded92033b2aa tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:35.623498 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6f1dddfd-251e-407a-873e-6c3db0dda61e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:35.624063 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c9f32afc-5fea-484f-9c1d-ded92033b2aa tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:35.648617 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-6f1dddfd-251e-407a-873e-6c3db0dda61e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] HTTP exception thrown: Instance 12b2baf4-7582-44e3-93fa-42944effb017 could not be found. Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6f1dddfd-251e-407a-873e-6c3db0dda61e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Request method failure captured: Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 HTTP/1.1 Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGlbodlapeisJn5a0HtwbwcZIYoBmT5AMrWgFKctZEM-c8IEHUY-HIxlKO2btmEhIp6rTchMUsTfBqlVWDOj1EarcMAz1U-zU3gC1LYOn6ihs7mNZ7VuUoyKyfaVYT5-C41dz-fiCbk7B4FysstqCDj9MrkXDGMTtiNF2ZH2AvXNm6I Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 5a9c7bbcc9a149f5b77a89141a306c3e Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-TestVolumeBootPattern-431625802 Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-TestVolumeBootPattern-431625802 Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 5a9c7bbcc9a149f5b77a89141a306c3e Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-TestVolumeBootPattern-431625802 Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-TestVolumeBootPattern-431625802-project Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: fed0afc129364664aed8d8a96f499831 Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-TestVolumeBootPattern-431625802-project Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 12b2baf4-7582-44e3-93fa-42944effb017 could not be found. Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '12b2baf4-7582-44e3-93fa-42944effb017'} Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12b2baf4-7582-44e3-93fa-42944effb017 could not be found. Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:36:35.651727 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:36:35.656281 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12b2baf4-7582-44e3-93fa-42944effb017 could not be found. Jun 20 12:36:35.656281 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:36:35.656281 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:36:35.656281 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:36:35.656281 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:36:35.656281 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:36:35.656281 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:36:35.656281 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:36:35.656281 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:36:35.656281 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12b2baf4-7582-44e3-93fa-42944effb017 could not be found. Jun 20 12:36:35.656281 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:36:35.659877 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6f1dddfd-251e-407a-873e-6c3db0dda61e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Returning 404 to user: Instance 12b2baf4-7582-44e3-93fa-42944effb017 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:36:35.661039 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6f1dddfd-251e-407a-873e-6c3db0dda61e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "DELETE /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017" status: 404 len: 111 microversion: 2.1 time: 0.069308 Jun 20 12:36:35.662219 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3225/6358] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:36:35 2022] DELETE /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:36:35.662476 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c9f32afc-5fea-484f-9c1d-ded92033b2aa tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca/ips" status: 200 len: 150 microversion: 2.1 time: 0.329486 Jun 20 12:36:35.663343 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3134/6359] 10.222.0.27 () {58 vars in 1247 bytes} [Mon Jun 20 12:36:35 2022] GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca/ips => generated 150 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:36:35.676290 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-27702011-8e09-4b1d-884e-5edb6a546d24 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:35.676857 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-27702011-8e09-4b1d-884e-5edb6a546d24 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 12b2baf4-7582-44e3-93fa-42944effb017] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:35.684954 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-27702011-8e09-4b1d-884e-5edb6a546d24 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:35.685407 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-27702011-8e09-4b1d-884e-5edb6a546d24 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:35.686372 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-27702011-8e09-4b1d-884e-5edb6a546d24 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:35.686820 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-27702011-8e09-4b1d-884e-5edb6a546d24 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:35.703189 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-27702011-8e09-4b1d-884e-5edb6a546d24 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] HTTP exception thrown: Instance 12b2baf4-7582-44e3-93fa-42944effb017 could not be found. Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-27702011-8e09-4b1d-884e-5edb6a546d24 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Request method failure captured: Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 HTTP/1.1 Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGlbodlapeisJn5a0HtwbwcZIYoBmT5AMrWgFKctZEM-c8IEHUY-HIxlKO2btmEhIp6rTchMUsTfBqlVWDOj1EarcMAz1U-zU3gC1LYOn6ihs7mNZ7VuUoyKyfaVYT5-C41dz-fiCbk7B4FysstqCDj9MrkXDGMTtiNF2ZH2AvXNm6I Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 5a9c7bbcc9a149f5b77a89141a306c3e Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-TestVolumeBootPattern-431625802 Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-TestVolumeBootPattern-431625802 Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 5a9c7bbcc9a149f5b77a89141a306c3e Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-TestVolumeBootPattern-431625802 Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-TestVolumeBootPattern-431625802-project Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: fed0afc129364664aed8d8a96f499831 Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-TestVolumeBootPattern-431625802-project Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 12b2baf4-7582-44e3-93fa-42944effb017 could not be found. Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '12b2baf4-7582-44e3-93fa-42944effb017'} Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12b2baf4-7582-44e3-93fa-42944effb017 could not be found. Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12b2baf4-7582-44e3-93fa-42944effb017 could not be found. Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:36:35.704803 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:36:35.715517 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:36:35.715517 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:36:35.715517 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:36:35.715517 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:36:35.715517 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:36:35.715517 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12b2baf4-7582-44e3-93fa-42944effb017 could not be found. Jun 20 12:36:35.715517 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:36:35.715517 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-27702011-8e09-4b1d-884e-5edb6a546d24 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Returning 404 to user: Instance 12b2baf4-7582-44e3-93fa-42944effb017 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:36:35.715517 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-27702011-8e09-4b1d-884e-5edb6a546d24 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017" status: 404 len: 111 microversion: 2.1 time: 0.034126 Jun 20 12:36:35.715517 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3226/6360] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:36:35 2022] GET /compute/v2.1/servers/12b2baf4-7582-44e3-93fa-42944effb017 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:36:37.135795 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-13dd8bdd-aede-48e2-a36f-a0e2010d0b19 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03c72d4c-5a55-4336-bfb2-740ab2eb425c"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:36:37.137220 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-13dd8bdd-aede-48e2-a36f-a0e2010d0b19 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: f1dbc299-776d-4c09-9457-dc6a998892ca] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:37.145013 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13dd8bdd-aede-48e2-a36f-a0e2010d0b19 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:37.145463 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13dd8bdd-aede-48e2-a36f-a0e2010d0b19 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:37.146245 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13dd8bdd-aede-48e2-a36f-a0e2010d0b19 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:37.146681 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13dd8bdd-aede-48e2-a36f-a0e2010d0b19 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:37.553026 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-13dd8bdd-aede-48e2-a36f-a0e2010d0b19 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "POST /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.425024 Jun 20 12:36:37.554053 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3135/6361] 10.222.0.27 () {60 vars in 1322 bytes} [Mon Jun 20 12:36:37 2022] POST /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca/os-volume_attachments => generated 194 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:36:49.532694 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5e50aabe-1caf-4ccb-8885-eb3c804fce96 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03c72d4c-5a55-4336-bfb2-740ab2eb425c"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:36:49.533790 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5e50aabe-1caf-4ccb-8885-eb3c804fce96 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: f1dbc299-776d-4c09-9457-dc6a998892ca] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:49.536636 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=13 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:49.537441 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=17 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:49.543903 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5e50aabe-1caf-4ccb-8885-eb3c804fce96 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:49.544404 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5e50aabe-1caf-4ccb-8885-eb3c804fce96 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:49.545186 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5e50aabe-1caf-4ccb-8885-eb3c804fce96 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:49.545628 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5e50aabe-1caf-4ccb-8885-eb3c804fce96 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:49.776740 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-5e50aabe-1caf-4ccb-8885-eb3c804fce96 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] HTTP exception thrown: Invalid volume: volume 03c72d4c-5a55-4336-bfb2-740ab2eb425c is already attached to instances: f1dbc299-776d-4c09-9457-dc6a998892ca Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5e50aabe-1caf-4ccb-8885-eb3c804fce96 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Request method failure captured: Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca/os-volume_attachments HTTP/1.1 Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 74 Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGimx3rD_FK4OQ1VdtIOQm_v9s-kKgn6vXzR6ZBiLlIplOW4i7RkYQinkTG1vfKGKwCaoPCprnA7Fw3J7TUX4keyVZVyA-ioRTCduqhd5tDd7aG1Qjuo-15G-XSI8qoUHjPCuXgPU-jMwTPPkfuUfoqrsDV0KX5Zoa18ctkNwDakrYM Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: f4714cac56094f9e9d4ed4adb400064e Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: f4714cac56094f9e9d4ed4adb400064e Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-AttachVolumeNegativeTest-1470856820-project Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 2c8b3f11a7294fbd9d750b1fbbeaa65b Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-AttachVolumeNegativeTest-1470856820-project Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: {"volumeAttachment": {"volumeId": "03c72d4c-5a55-4336-bfb2-740ab2eb425c"}} Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: exception: Invalid volume: volume 03c72d4c-5a55-4336-bfb2-740ab2eb425c is already attached to instances: f1dbc299-776d-4c09-9457-dc6a998892ca Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: action_args: {'server_id': 'f1dbc299-776d-4c09-9457-dc6a998892ca', 'body': {'volumeAttachment': {'volumeId': '03c72d4c-5a55-4336-bfb2-740ab2eb425c'}}} Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 03c72d4c-5a55-4336-bfb2-740ab2eb425c is already attached to instances: f1dbc299-776d-4c09-9457-dc6a998892ca Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:36:49.778466 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:36:49.783323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:36:49.783323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:36:49.783323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 20 12:36:49.783323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 20 12:36:49.783323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 03c72d4c-5a55-4336-bfb2-740ab2eb425c is already attached to instances: f1dbc299-776d-4c09-9457-dc6a998892ca Jun 20 12:36:49.783323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:36:49.783323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:36:49.783323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:36:49.783323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:36:49.783323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:36:49.783323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:36:49.783323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:36:49.783323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:36:49.783323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 03c72d4c-5a55-4336-bfb2-740ab2eb425c is already attached to instances: f1dbc299-776d-4c09-9457-dc6a998892ca Jun 20 12:36:49.783323 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:36:49.785253 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5e50aabe-1caf-4ccb-8885-eb3c804fce96 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Returning 400 to user: Invalid volume: volume 03c72d4c-5a55-4336-bfb2-740ab2eb425c is already attached to instances: f1dbc299-776d-4c09-9457-dc6a998892ca {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:36:49.786865 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5e50aabe-1caf-4ccb-8885-eb3c804fce96 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "POST /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.258698 Jun 20 12:36:49.790938 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3227/6362] 10.222.0.27 () {60 vars in 1322 bytes} [Mon Jun 20 12:36:49 2022] POST /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca/os-volume_attachments => generated 174 bytes in 260 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:36:49.861450 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d18753d1-1757-4b91-a0c3-d5a26a292b53 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:49.862424 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d18753d1-1757-4b91-a0c3-d5a26a292b53 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: f1dbc299-776d-4c09-9457-dc6a998892ca] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:49.867426 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:49.867426 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:49.873589 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d18753d1-1757-4b91-a0c3-d5a26a292b53 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:49.874304 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d18753d1-1757-4b91-a0c3-d5a26a292b53 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:49.875279 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d18753d1-1757-4b91-a0c3-d5a26a292b53 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:49.875720 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d18753d1-1757-4b91-a0c3-d5a26a292b53 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:49.983104 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-d18753d1-1757-4b91-a0c3-d5a26a292b53 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lazy-loading 'services' on Instance uuid f1dbc299-776d-4c09-9457-dc6a998892ca {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:36:50.069119 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d18753d1-1757-4b91-a0c3-d5a26a292b53 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca/os-volume_attachments/03c72d4c-5a55-4336-bfb2-740ab2eb425c" status: 202 len: 0 microversion: 2.1 time: 0.213773 Jun 20 12:36:50.069619 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3136/6363] 10.222.0.27 () {58 vars in 1415 bytes} [Mon Jun 20 12:36:49 2022] DELETE /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca/os-volume_attachments/03c72d4c-5a55-4336-bfb2-740ab2eb425c => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:36:50.081439 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-189495be-97e6-4bd8-850e-0cd55f4312af tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:50.082526 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-189495be-97e6-4bd8-850e-0cd55f4312af tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: f1dbc299-776d-4c09-9457-dc6a998892ca] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:50.089647 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-189495be-97e6-4bd8-850e-0cd55f4312af tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:50.090360 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-189495be-97e6-4bd8-850e-0cd55f4312af tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:50.091385 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-189495be-97e6-4bd8-850e-0cd55f4312af tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:50.091979 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-189495be-97e6-4bd8-850e-0cd55f4312af tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:50.129512 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-189495be-97e6-4bd8-850e-0cd55f4312af tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055156 Jun 20 12:36:50.130129 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3228/6364] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:36:50 2022] GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:36:51.144482 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-127ef414-c67c-4076-b345-b8d6dcd6034a tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:51.145513 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-127ef414-c67c-4076-b345-b8d6dcd6034a tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: f1dbc299-776d-4c09-9457-dc6a998892ca] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:51.153631 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-127ef414-c67c-4076-b345-b8d6dcd6034a tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:51.154085 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-127ef414-c67c-4076-b345-b8d6dcd6034a tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:51.154869 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-127ef414-c67c-4076-b345-b8d6dcd6034a tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:51.155307 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-127ef414-c67c-4076-b345-b8d6dcd6034a tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:51.189710 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-127ef414-c67c-4076-b345-b8d6dcd6034a tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051852 Jun 20 12:36:51.190309 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3137/6365] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:36:51 2022] GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:36:52.204691 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a5400bdd-6069-42d7-a085-ba4ac71873c7 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:52.207662 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a5400bdd-6069-42d7-a085-ba4ac71873c7 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: f1dbc299-776d-4c09-9457-dc6a998892ca] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:52.218309 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5400bdd-6069-42d7-a085-ba4ac71873c7 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:52.218769 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5400bdd-6069-42d7-a085-ba4ac71873c7 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:52.219544 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5400bdd-6069-42d7-a085-ba4ac71873c7 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:52.220007 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5400bdd-6069-42d7-a085-ba4ac71873c7 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:52.260175 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a5400bdd-6069-42d7-a085-ba4ac71873c7 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061479 Jun 20 12:36:52.261142 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3229/6366] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:36:52 2022] GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:36:53.273036 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c4f8ba23-9510-4f87-8922-19b9aabaa5f1 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:53.274104 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c4f8ba23-9510-4f87-8922-19b9aabaa5f1 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: f1dbc299-776d-4c09-9457-dc6a998892ca] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:53.283002 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4f8ba23-9510-4f87-8922-19b9aabaa5f1 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:53.283847 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4f8ba23-9510-4f87-8922-19b9aabaa5f1 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:53.284777 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4f8ba23-9510-4f87-8922-19b9aabaa5f1 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:53.285446 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4f8ba23-9510-4f87-8922-19b9aabaa5f1 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:53.329363 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c4f8ba23-9510-4f87-8922-19b9aabaa5f1 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061057 Jun 20 12:36:53.334385 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3138/6367] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:36:53 2022] GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:36:54.344525 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-984718f1-1ee2-4c14-9e8b-542d991b2437 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:54.344525 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-984718f1-1ee2-4c14-9e8b-542d991b2437 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: f1dbc299-776d-4c09-9457-dc6a998892ca] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:54.353028 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-984718f1-1ee2-4c14-9e8b-542d991b2437 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:54.353692 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-984718f1-1ee2-4c14-9e8b-542d991b2437 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:54.354688 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-984718f1-1ee2-4c14-9e8b-542d991b2437 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:54.355253 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-984718f1-1ee2-4c14-9e8b-542d991b2437 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:54.391788 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-984718f1-1ee2-4c14-9e8b-542d991b2437 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054138 Jun 20 12:36:54.396046 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3230/6368] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:36:54 2022] GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:36:55.404099 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-200bb58e-0b9f-413f-bca4-568a93aabeb6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:55.405180 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-200bb58e-0b9f-413f-bca4-568a93aabeb6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: f1dbc299-776d-4c09-9457-dc6a998892ca] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:55.413617 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-200bb58e-0b9f-413f-bca4-568a93aabeb6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:55.414383 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-200bb58e-0b9f-413f-bca4-568a93aabeb6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:55.415617 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-200bb58e-0b9f-413f-bca4-568a93aabeb6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:55.416049 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-200bb58e-0b9f-413f-bca4-568a93aabeb6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:55.452071 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-200bb58e-0b9f-413f-bca4-568a93aabeb6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052563 Jun 20 12:36:55.452708 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3139/6369] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:36:55 2022] GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:36:55.517323 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-eb01842e-cf2a-4e5a-a75f-a6d27723f473 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:55.517911 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-eb01842e-cf2a-4e5a-a75f-a6d27723f473 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: f1dbc299-776d-4c09-9457-dc6a998892ca] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:55.525401 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb01842e-cf2a-4e5a-a75f-a6d27723f473 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:55.525920 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb01842e-cf2a-4e5a-a75f-a6d27723f473 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:55.527025 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb01842e-cf2a-4e5a-a75f-a6d27723f473 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:55.527536 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eb01842e-cf2a-4e5a-a75f-a6d27723f473 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:55.566979 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-eb01842e-cf2a-4e5a-a75f-a6d27723f473 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: f1dbc299-776d-4c09-9457-dc6a998892ca] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:36:55.669829 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-eb01842e-cf2a-4e5a-a75f-a6d27723f473 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca" status: 204 len: 0 microversion: 2.1 time: 0.155893 Jun 20 12:36:55.672520 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3231/6370] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:36:55 2022] DELETE /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:36:55.685396 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-103c5f30-63dd-4576-a544-a56cf4e169c0 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:55.686840 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-103c5f30-63dd-4576-a544-a56cf4e169c0 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: f1dbc299-776d-4c09-9457-dc6a998892ca] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:55.704547 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-103c5f30-63dd-4576-a544-a56cf4e169c0 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:55.705844 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-103c5f30-63dd-4576-a544-a56cf4e169c0 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:55.707588 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-103c5f30-63dd-4576-a544-a56cf4e169c0 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:55.708614 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-103c5f30-63dd-4576-a544-a56cf4e169c0 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:55.873978 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-103c5f30-63dd-4576-a544-a56cf4e169c0 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:36:55.882588 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-103c5f30-63dd-4576-a544-a56cf4e169c0 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca" status: 200 len: 1680 microversion: 2.1 time: 0.206943 Jun 20 12:36:55.883435 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3140/6371] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:36:55 2022] GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca => generated 1680 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:36:56.901511 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1b64fc99-dd88-4f66-ad92-3f1c14f9b54c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:56.902883 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1b64fc99-dd88-4f66-ad92-3f1c14f9b54c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: f1dbc299-776d-4c09-9457-dc6a998892ca] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:56.910799 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1b64fc99-dd88-4f66-ad92-3f1c14f9b54c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:56.911553 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1b64fc99-dd88-4f66-ad92-3f1c14f9b54c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:56.912808 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1b64fc99-dd88-4f66-ad92-3f1c14f9b54c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:56.913441 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1b64fc99-dd88-4f66-ad92-3f1c14f9b54c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:57.074059 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1b64fc99-dd88-4f66-ad92-3f1c14f9b54c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:36:57.083981 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1b64fc99-dd88-4f66-ad92-3f1c14f9b54c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca" status: 200 len: 1680 microversion: 2.1 time: 0.186626 Jun 20 12:36:57.084995 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3232/6372] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:36:56 2022] GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca => generated 1680 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:36:58.106060 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-09eaa726-f285-4789-8c37-ed6e5f7a29b8 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:58.108194 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-09eaa726-f285-4789-8c37-ed6e5f7a29b8 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: f1dbc299-776d-4c09-9457-dc6a998892ca] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:58.118212 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-09eaa726-f285-4789-8c37-ed6e5f7a29b8 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:58.119245 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-09eaa726-f285-4789-8c37-ed6e5f7a29b8 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:58.120123 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-09eaa726-f285-4789-8c37-ed6e5f7a29b8 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:58.120944 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-09eaa726-f285-4789-8c37-ed6e5f7a29b8 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:58.285728 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-79db4d37-af02-4659-873e-c53f084c2011 req-64fcbe25-252a-46ed-ab52-d1ff0bb59f16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1dbc299-776d-4c09-9457-dc6a998892ca", "name": "network-vif-deleted", "tag": "8c66af18-37e1-4a30-a0f1-3ac8f8ac1069"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:36:58.288902 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-09eaa726-f285-4789-8c37-ed6e5f7a29b8 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:36:58.300032 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-09eaa726-f285-4789-8c37-ed6e5f7a29b8 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca" status: 200 len: 1614 microversion: 2.1 time: 0.200550 Jun 20 12:36:58.301393 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3141/6373] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:36:58 2022] GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca => generated 1614 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:36:58.316729 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-79db4d37-af02-4659-873e-c53f084c2011 req-64fcbe25-252a-46ed-ab52-d1ff0bb59f16 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:58.317186 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-79db4d37-af02-4659-873e-c53f084c2011 req-64fcbe25-252a-46ed-ab52-d1ff0bb59f16 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:58.357048 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-79db4d37-af02-4659-873e-c53f084c2011 req-64fcbe25-252a-46ed-ab52-d1ff0bb59f16 service nova] Creating event network-vif-deleted:8c66af18-37e1-4a30-a0f1-3ac8f8ac1069 for instance f1dbc299-776d-4c09-9457-dc6a998892ca on n-h1-master-1 Jun 20 12:36:58.381422 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-79db4d37-af02-4659-873e-c53f084c2011 req-64fcbe25-252a-46ed-ab52-d1ff0bb59f16 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099662 Jun 20 12:36:58.382065 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3233/6374] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:36:59.324833 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5e011f64-48f8-45e4-8f77-2167de0ca14c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:59.326641 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5e011f64-48f8-45e4-8f77-2167de0ca14c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: f1dbc299-776d-4c09-9457-dc6a998892ca] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:36:59.335573 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e011f64-48f8-45e4-8f77-2167de0ca14c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:59.336024 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e011f64-48f8-45e4-8f77-2167de0ca14c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:59.336927 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e011f64-48f8-45e4-8f77-2167de0ca14c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:36:59.337358 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e011f64-48f8-45e4-8f77-2167de0ca14c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:36:59.359316 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-5e011f64-48f8-45e4-8f77-2167de0ca14c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] HTTP exception thrown: Instance f1dbc299-776d-4c09-9457-dc6a998892ca could not be found. Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5e011f64-48f8-45e4-8f77-2167de0ca14c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Request method failure captured: Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca HTTP/1.1 Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGimx3rD_FK4OQ1VdtIOQm_v9s-kKgn6vXzR6ZBiLlIplOW4i7RkYQinkTG1vfKGKwCaoPCprnA7Fw3J7TUX4keyVZVyA-ioRTCduqhd5tDd7aG1Qjuo-15G-XSI8qoUHjPCuXgPU-jMwTPPkfuUfoqrsDV0KX5Zoa18ctkNwDakrYM Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: f4714cac56094f9e9d4ed4adb400064e Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: f4714cac56094f9e9d4ed4adb400064e Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-AttachVolumeNegativeTest-1470856820-project Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 2c8b3f11a7294fbd9d750b1fbbeaa65b Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-AttachVolumeNegativeTest-1470856820-project Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: exception: Instance f1dbc299-776d-4c09-9457-dc6a998892ca could not be found. Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'f1dbc299-776d-4c09-9457-dc6a998892ca'} Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1dbc299-776d-4c09-9457-dc6a998892ca could not be found. Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1dbc299-776d-4c09-9457-dc6a998892ca could not be found. Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:36:59.361362 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:36:59.366543 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:36:59.366543 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:36:59.366543 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:36:59.366543 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:36:59.366543 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:36:59.366543 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1dbc299-776d-4c09-9457-dc6a998892ca could not be found. Jun 20 12:36:59.366543 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:36:59.366543 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5e011f64-48f8-45e4-8f77-2167de0ca14c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Returning 404 to user: Instance f1dbc299-776d-4c09-9457-dc6a998892ca could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:36:59.366543 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5e011f64-48f8-45e4-8f77-2167de0ca14c tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca" status: 404 len: 111 microversion: 2.1 time: 0.045640 Jun 20 12:36:59.366543 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3142/6375] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:36:59 2022] GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:36:59.373512 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f26cc4dd-e7a9-43e2-a010-62b08880ff4e tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '.version_select at 0x7f6072334ee0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:36:59.398116 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f26cc4dd-e7a9-43e2-a010-62b08880ff4e tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-790525872" status: 202 len: 0 microversion: 2.1 time: 0.028405 Jun 20 12:36:59.399645 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3234/6376] 10.222.0.27 () {58 vars in 1217 bytes} [Mon Jun 20 12:36:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-790525872 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:37:00.232958 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0d6ff4e9-e681-4013-a1f0-571a8e8c0dd5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-762641590", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "bd24817e-1153-4c38-bf39-c1cd850aaf0a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "fda59e99-54c8-4d95-ad3c-e4129b9a154d"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:37:00.310379 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-0d6ff4e9-e681-4013-a1f0-571a8e8c0dd5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] validate_networks() for [('fda59e99-54c8-4d95-ad3c-e4129b9a154d', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:37:00.480929 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-011b1ab8-65cb-42be-a4d9-4abe4ae90a86 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Action: 'create', calling method: .version_select at 0x7f6072165ca0>, body: {"keypair": {"name": "tempest-keypair-1436226766", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORLYKMfQmc1roIJQguERs6imHAmV2frI/ffGrI4JHUt4CdZLcw9vAIxxZtYpDIxxB6LhisqSL1palIYf3cwV149GH0I90wWyBX+YuU84Y3ooHMQIY3XY8vWijLd8vzumA=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:37:00.501341 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-011b1ab8-65cb-42be-a4d9-4abe4ae90a86 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Getting quotas for project f4714cac56094f9e9d4ed4adb400064e. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:37:00.507169 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-011b1ab8-65cb-42be-a4d9-4abe4ae90a86 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Getting quotas for user 2c8b3f11a7294fbd9d750b1fbbeaa65b and project f4714cac56094f9e9d4ed4adb400064e. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:37:00.537242 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-011b1ab8-65cb-42be-a4d9-4abe4ae90a86 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.060083 Jun 20 12:37:00.537839 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3235/6377] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 12:37:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:37:01.066395 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-0d6ff4e9-e681-4013-a1f0-571a8e8c0dd5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:37:01.067677 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-0d6ff4e9-e681-4013-a1f0-571a8e8c0dd5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:37:01.068371 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-0d6ff4e9-e681-4013-a1f0-571a8e8c0dd5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:37:01.069515 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-0d6ff4e9-e681-4013-a1f0-571a8e8c0dd5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:37:01.070253 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-0d6ff4e9-e681-4013-a1f0-571a8e8c0dd5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:37:01.082538 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d6ff4e9-e681-4013-a1f0-571a8e8c0dd5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:01.083187 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d6ff4e9-e681-4013-a1f0-571a8e8c0dd5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:01.084614 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d6ff4e9-e681-4013-a1f0-571a8e8c0dd5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:01.085288 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d6ff4e9-e681-4013-a1f0-571a8e8c0dd5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:01.105210 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-0d6ff4e9-e681-4013-a1f0-571a8e8c0dd5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Getting quotas for project 5a9c7bbcc9a149f5b77a89141a306c3e. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:37:01.114186 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-0d6ff4e9-e681-4013-a1f0-571a8e8c0dd5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Getting quotas for user fed0afc129364664aed8d8a96f499831 and project 5a9c7bbcc9a149f5b77a89141a306c3e. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:37:01.186883 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0d6ff4e9-e681-4013-a1f0-571a8e8c0dd5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:37:01.189415 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0d6ff4e9-e681-4013-a1f0-571a8e8c0dd5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bd24817e-1153-4c38-bf39-c1cd850aaf0a',volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:37:01.352465 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0d6ff4e9-e681-4013-a1f0-571a8e8c0dd5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.124467 Jun 20 12:37:01.353460 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3143/6378] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:37:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:37:01.365368 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7c9d6ac0-0d8a-49ea-a7cc-36c8254ae417 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:01.366568 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7c9d6ac0-0d8a-49ea-a7cc-36c8254ae417 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:01.455138 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7c9d6ac0-0d8a-49ea-a7cc-36c8254ae417 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:01.463348 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7c9d6ac0-0d8a-49ea-a7cc-36c8254ae417 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2" status: 200 len: 1070 microversion: 2.1 time: 0.103145 Jun 20 12:37:01.465533 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3236/6379] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:01 2022] GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 => generated 1070 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:02.138138 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-75f3930a-4090-42ab-b166-d058c20eaba5 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1877126025", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2f68d1fc-6d7d-4fb9-a17e-f5081b1bc479"}], "security_groups": [{"name": "tempest-securitygroup--2115027812"}], "key_name": "tempest-keypair-1436226766", "user_data": "}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:37:02.247840 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-75f3930a-4090-42ab-b166-d058c20eaba5 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] validate_networks() for [('2f68d1fc-6d7d-4fb9-a17e-f5081b1bc479', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:37:02.491242 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-66d8bfa7-8727-4546-ba1e-2ff2d74c2421 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:02.491900 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-66d8bfa7-8727-4546-ba1e-2ff2d74c2421 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:02.511460 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66d8bfa7-8727-4546-ba1e-2ff2d74c2421 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:02.512493 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66d8bfa7-8727-4546-ba1e-2ff2d74c2421 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:02.513348 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66d8bfa7-8727-4546-ba1e-2ff2d74c2421 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:02.513795 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66d8bfa7-8727-4546-ba1e-2ff2d74c2421 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:02.619376 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-66d8bfa7-8727-4546-ba1e-2ff2d74c2421 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:02.638563 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-66d8bfa7-8727-4546-ba1e-2ff2d74c2421 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2" status: 200 len: 1186 microversion: 2.1 time: 0.161095 Jun 20 12:37:02.639571 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3237/6380] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:02 2022] GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 => generated 1186 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:03.047503 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-75f3930a-4090-42ab-b166-d058c20eaba5 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:37:03.048262 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-75f3930a-4090-42ab-b166-d058c20eaba5 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:37:03.048905 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-75f3930a-4090-42ab-b166-d058c20eaba5 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:37:03.049467 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-75f3930a-4090-42ab-b166-d058c20eaba5 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:37:03.050034 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-75f3930a-4090-42ab-b166-d058c20eaba5 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:37:03.073439 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-75f3930a-4090-42ab-b166-d058c20eaba5 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:03.078148 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-75f3930a-4090-42ab-b166-d058c20eaba5 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:03.079038 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-75f3930a-4090-42ab-b166-d058c20eaba5 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:03.080740 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-75f3930a-4090-42ab-b166-d058c20eaba5 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:03.134589 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-75f3930a-4090-42ab-b166-d058c20eaba5 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Getting quotas for project f4714cac56094f9e9d4ed4adb400064e. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:37:03.149854 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-75f3930a-4090-42ab-b166-d058c20eaba5 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Getting quotas for user 2c8b3f11a7294fbd9d750b1fbbeaa65b and project f4714cac56094f9e9d4ed4adb400064e. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:37:03.173322 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-75f3930a-4090-42ab-b166-d058c20eaba5 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:37:03.176817 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-75f3930a-4090-42ab-b166-d058c20eaba5 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 901af3d1-ee82-487d-ba43-06eea301b2d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:37:03.245517 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-75f3930a-4090-42ab-b166-d058c20eaba5 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.111701 Jun 20 12:37:03.250944 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3144/6381] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:37:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 1114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:37:03.257663 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6547194d-72fa-4157-8a05-3b6c0efde33d tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:03.258716 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6547194d-72fa-4157-8a05-3b6c0efde33d tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 901af3d1-ee82-487d-ba43-06eea301b2d4] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:03.333887 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6547194d-72fa-4157-8a05-3b6c0efde33d tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:03.341542 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6547194d-72fa-4157-8a05-3b6c0efde33d tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4" status: 200 len: 1242 microversion: 2.1 time: 0.088845 Jun 20 12:37:03.359356 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3238/6382] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:03 2022] GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4 => generated 1242 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:03.656696 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bb875703-800c-4f2a-8e77-00b9a3b7c014 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:03.657403 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bb875703-800c-4f2a-8e77-00b9a3b7c014 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:03.669176 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bb875703-800c-4f2a-8e77-00b9a3b7c014 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:03.670115 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bb875703-800c-4f2a-8e77-00b9a3b7c014 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:03.671655 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bb875703-800c-4f2a-8e77-00b9a3b7c014 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:03.672584 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bb875703-800c-4f2a-8e77-00b9a3b7c014 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:04.025843 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-bb875703-800c-4f2a-8e77-00b9a3b7c014 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:04.035095 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bb875703-800c-4f2a-8e77-00b9a3b7c014 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2" status: 200 len: 1228 microversion: 2.1 time: 0.382868 Jun 20 12:37:04.035692 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3145/6383] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:03 2022] GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 => generated 1228 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:04.367163 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9d2e0b36-a68a-4606-bdb1-5274e66729ad tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:04.368051 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9d2e0b36-a68a-4606-bdb1-5274e66729ad tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 901af3d1-ee82-487d-ba43-06eea301b2d4] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:04.378962 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9d2e0b36-a68a-4606-bdb1-5274e66729ad tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:04.379691 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9d2e0b36-a68a-4606-bdb1-5274e66729ad tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:04.381492 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9d2e0b36-a68a-4606-bdb1-5274e66729ad tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:04.382234 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9d2e0b36-a68a-4606-bdb1-5274e66729ad tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:04.462967 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9d2e0b36-a68a-4606-bdb1-5274e66729ad tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:04.473348 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9d2e0b36-a68a-4606-bdb1-5274e66729ad tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4" status: 200 len: 1294 microversion: 2.1 time: 0.110840 Jun 20 12:37:04.484322 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3239/6384] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:04 2022] GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4 => generated 1294 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:05.054409 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-88c40f11-5068-44f7-9ba6-e4a6616495f3 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:05.055111 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-88c40f11-5068-44f7-9ba6-e4a6616495f3 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:05.062868 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88c40f11-5068-44f7-9ba6-e4a6616495f3 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:05.063326 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88c40f11-5068-44f7-9ba6-e4a6616495f3 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:05.064172 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88c40f11-5068-44f7-9ba6-e4a6616495f3 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:05.064840 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88c40f11-5068-44f7-9ba6-e4a6616495f3 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:05.217184 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-89a6770f-77fb-4b22-9215-c8f72b1eabd8 req-d6920f0f-51fe-42ba-9c61-de6960e409f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2", "tag": "0533e46a-afb9-47fa-9f15-0d53fd1d694d"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:37:05.232320 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-89a6770f-77fb-4b22-9215-c8f72b1eabd8 req-d6920f0f-51fe-42ba-9c61-de6960e409f3 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:05.233111 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-89a6770f-77fb-4b22-9215-c8f72b1eabd8 req-d6920f0f-51fe-42ba-9c61-de6960e409f3 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:05.261921 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-89a6770f-77fb-4b22-9215-c8f72b1eabd8 req-d6920f0f-51fe-42ba-9c61-de6960e409f3 service nova] Creating event network-changed:0533e46a-afb9-47fa-9f15-0d53fd1d694d for instance 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 on n-h1-master-1 Jun 20 12:37:05.275625 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-89a6770f-77fb-4b22-9215-c8f72b1eabd8 req-d6920f0f-51fe-42ba-9c61-de6960e409f3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062304 Jun 20 12:37:05.276635 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3240/6385] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:37:05.493817 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-11c606fa-96b1-4190-85d3-231bc3120784 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:05.495251 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-11c606fa-96b1-4190-85d3-231bc3120784 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 901af3d1-ee82-487d-ba43-06eea301b2d4] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:05.501980 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11c606fa-96b1-4190-85d3-231bc3120784 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:05.502655 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11c606fa-96b1-4190-85d3-231bc3120784 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:05.503621 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11c606fa-96b1-4190-85d3-231bc3120784 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:05.504238 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11c606fa-96b1-4190-85d3-231bc3120784 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:05.542177 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-88c40f11-5068-44f7-9ba6-e4a6616495f3 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:05.553692 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-88c40f11-5068-44f7-9ba6-e4a6616495f3 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2" status: 200 len: 1228 microversion: 2.1 time: 0.503052 Jun 20 12:37:05.555192 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3146/6386] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:05 2022] GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 => generated 1228 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:05.600735 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-11c606fa-96b1-4190-85d3-231bc3120784 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:05.610337 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-11c606fa-96b1-4190-85d3-231bc3120784 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4" status: 200 len: 1300 microversion: 2.1 time: 0.122337 Jun 20 12:37:05.620981 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3241/6387] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:05 2022] GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4 => generated 1300 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:37:06.574275 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fc4069a4-8bc5-40a8-a272-e44852b873ed tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:06.574655 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fc4069a4-8bc5-40a8-a272-e44852b873ed tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:06.589574 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fc4069a4-8bc5-40a8-a272-e44852b873ed tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:06.590049 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fc4069a4-8bc5-40a8-a272-e44852b873ed tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:06.590844 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fc4069a4-8bc5-40a8-a272-e44852b873ed tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:06.591288 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fc4069a4-8bc5-40a8-a272-e44852b873ed tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:06.628795 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3020f9d1-5462-478e-96de-5c2ce2f705e2 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:06.629404 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3020f9d1-5462-478e-96de-5c2ce2f705e2 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 901af3d1-ee82-487d-ba43-06eea301b2d4] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:06.640695 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3020f9d1-5462-478e-96de-5c2ce2f705e2 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:06.641624 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3020f9d1-5462-478e-96de-5c2ce2f705e2 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:06.642871 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3020f9d1-5462-478e-96de-5c2ce2f705e2 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:06.643676 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3020f9d1-5462-478e-96de-5c2ce2f705e2 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:06.855834 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3020f9d1-5462-478e-96de-5c2ce2f705e2 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:06.866547 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3020f9d1-5462-478e-96de-5c2ce2f705e2 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4" status: 200 len: 1368 microversion: 2.1 time: 0.241644 Jun 20 12:37:06.867806 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3242/6388] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:06 2022] GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4 => generated 1368 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:37:07.043004 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fc4069a4-8bc5-40a8-a272-e44852b873ed tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:07.056716 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fc4069a4-8bc5-40a8-a272-e44852b873ed tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2" status: 200 len: 1228 microversion: 2.1 time: 0.488633 Jun 20 12:37:07.058141 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3147/6389] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:06 2022] GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 => generated 1228 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:07.832925 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-ebee1003-f44f-472d-b2cc-c98bda226a64 req-5642ab5e-da6d-4ae0-88b0-46324c941bba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "901af3d1-ee82-487d-ba43-06eea301b2d4", "tag": "4471f6e3-733c-417f-b9a3-81099f289b4e"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:37:07.858341 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ebee1003-f44f-472d-b2cc-c98bda226a64 req-5642ab5e-da6d-4ae0-88b0-46324c941bba service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:07.858851 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ebee1003-f44f-472d-b2cc-c98bda226a64 req-5642ab5e-da6d-4ae0-88b0-46324c941bba service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:07.874069 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-ebee1003-f44f-472d-b2cc-c98bda226a64 req-5642ab5e-da6d-4ae0-88b0-46324c941bba service nova] Creating event network-changed:4471f6e3-733c-417f-b9a3-81099f289b4e for instance 901af3d1-ee82-487d-ba43-06eea301b2d4 on n-h2-master-1 Jun 20 12:37:07.879411 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-ebee1003-f44f-472d-b2cc-c98bda226a64 req-5642ab5e-da6d-4ae0-88b0-46324c941bba service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050946 Jun 20 12:37:07.880874 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3243/6390] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:37:07.887922 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a3e9a04a-9d33-4cca-b8f7-ecce55bc2387 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:07.888793 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a3e9a04a-9d33-4cca-b8f7-ecce55bc2387 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 901af3d1-ee82-487d-ba43-06eea301b2d4] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:07.910719 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3e9a04a-9d33-4cca-b8f7-ecce55bc2387 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:07.911191 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3e9a04a-9d33-4cca-b8f7-ecce55bc2387 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:07.912134 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3e9a04a-9d33-4cca-b8f7-ecce55bc2387 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:07.912646 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3e9a04a-9d33-4cca-b8f7-ecce55bc2387 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:08.077076 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-44acd4a2-647b-4212-8746-4e7aa4abc2e5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:08.077902 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-44acd4a2-647b-4212-8746-4e7aa4abc2e5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:08.092262 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-44acd4a2-647b-4212-8746-4e7aa4abc2e5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:08.092724 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-44acd4a2-647b-4212-8746-4e7aa4abc2e5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:08.093649 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-44acd4a2-647b-4212-8746-4e7aa4abc2e5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:08.094088 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-44acd4a2-647b-4212-8746-4e7aa4abc2e5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:08.278879 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a3e9a04a-9d33-4cca-b8f7-ecce55bc2387 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:08.288185 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a3e9a04a-9d33-4cca-b8f7-ecce55bc2387 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4" status: 200 len: 1368 microversion: 2.1 time: 0.404747 Jun 20 12:37:08.289714 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3148/6391] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:07 2022] GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4 => generated 1368 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:37:08.331724 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-44acd4a2-647b-4212-8746-4e7aa4abc2e5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:08.340857 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-44acd4a2-647b-4212-8746-4e7aa4abc2e5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2" status: 200 len: 1228 microversion: 2.1 time: 0.269355 Jun 20 12:37:08.342260 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3244/6392] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:08 2022] GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 => generated 1228 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:09.307089 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dc70aa40-e89e-4c69-8785-8f5409049e6d tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:09.308468 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-dc70aa40-e89e-4c69-8785-8f5409049e6d tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 901af3d1-ee82-487d-ba43-06eea301b2d4] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:09.316289 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc70aa40-e89e-4c69-8785-8f5409049e6d tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:09.316738 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc70aa40-e89e-4c69-8785-8f5409049e6d tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:09.317630 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc70aa40-e89e-4c69-8785-8f5409049e6d tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:09.318148 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc70aa40-e89e-4c69-8785-8f5409049e6d tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:09.358045 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1eaad62c-cda5-49f9-be36-d34c654f6ca9 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:09.358653 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1eaad62c-cda5-49f9-be36-d34c654f6ca9 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:09.367603 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1eaad62c-cda5-49f9-be36-d34c654f6ca9 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:09.368357 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1eaad62c-cda5-49f9-be36-d34c654f6ca9 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:09.369441 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1eaad62c-cda5-49f9-be36-d34c654f6ca9 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:09.370032 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1eaad62c-cda5-49f9-be36-d34c654f6ca9 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:09.464732 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-dc70aa40-e89e-4c69-8785-8f5409049e6d tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:09.473336 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dc70aa40-e89e-4c69-8785-8f5409049e6d tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4" status: 200 len: 1368 microversion: 2.1 time: 0.171027 Jun 20 12:37:09.473859 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3149/6393] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:09 2022] GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:37:09.518855 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1eaad62c-cda5-49f9-be36-d34c654f6ca9 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:09.527053 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1eaad62c-cda5-49f9-be36-d34c654f6ca9 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2" status: 200 len: 1216 microversion: 2.1 time: 0.172789 Jun 20 12:37:09.527741 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3245/6394] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:09 2022] GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 => generated 1216 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:10.490981 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-77db5a31-6fbc-422d-bcb8-baf65c983791 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:10.491696 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-77db5a31-6fbc-422d-bcb8-baf65c983791 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 901af3d1-ee82-487d-ba43-06eea301b2d4] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:10.499486 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-77db5a31-6fbc-422d-bcb8-baf65c983791 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:10.500538 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-77db5a31-6fbc-422d-bcb8-baf65c983791 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:10.501559 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-77db5a31-6fbc-422d-bcb8-baf65c983791 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:10.502149 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-77db5a31-6fbc-422d-bcb8-baf65c983791 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:10.546168 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-74ad1436-ce12-4a07-80a6-da5cb0d48adc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:10.547655 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-74ad1436-ce12-4a07-80a6-da5cb0d48adc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:10.554803 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-74ad1436-ce12-4a07-80a6-da5cb0d48adc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:10.556389 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-74ad1436-ce12-4a07-80a6-da5cb0d48adc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:10.557174 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-74ad1436-ce12-4a07-80a6-da5cb0d48adc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:10.557621 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-74ad1436-ce12-4a07-80a6-da5cb0d48adc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:10.664074 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-77db5a31-6fbc-422d-bcb8-baf65c983791 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:10.674641 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-77db5a31-6fbc-422d-bcb8-baf65c983791 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4" status: 200 len: 1368 microversion: 2.1 time: 0.187655 Jun 20 12:37:10.676340 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3150/6395] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:10 2022] GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4 => generated 1368 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:10.716727 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-74ad1436-ce12-4a07-80a6-da5cb0d48adc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:10.725802 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-74ad1436-ce12-4a07-80a6-da5cb0d48adc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2" status: 200 len: 1216 microversion: 2.1 time: 0.183939 Jun 20 12:37:10.736422 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3246/6396] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:10 2022] GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 => generated 1216 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:37:11.693318 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-afbbaabc-3faa-49d3-885f-5f09d7625422 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:11.694103 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-afbbaabc-3faa-49d3-885f-5f09d7625422 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 901af3d1-ee82-487d-ba43-06eea301b2d4] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:11.701577 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-afbbaabc-3faa-49d3-885f-5f09d7625422 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:11.702112 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-afbbaabc-3faa-49d3-885f-5f09d7625422 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:11.702959 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-afbbaabc-3faa-49d3-885f-5f09d7625422 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:11.703469 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-afbbaabc-3faa-49d3-885f-5f09d7625422 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:11.743215 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ef730dcf-f656-4323-b316-4a70f43dc87b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:11.743836 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ef730dcf-f656-4323-b316-4a70f43dc87b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:11.751901 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef730dcf-f656-4323-b316-4a70f43dc87b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:11.752489 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef730dcf-f656-4323-b316-4a70f43dc87b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:11.753280 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef730dcf-f656-4323-b316-4a70f43dc87b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:11.753930 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef730dcf-f656-4323-b316-4a70f43dc87b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:11.853182 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-afbbaabc-3faa-49d3-885f-5f09d7625422 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:11.860858 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-afbbaabc-3faa-49d3-885f-5f09d7625422 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4" status: 200 len: 1368 microversion: 2.1 time: 0.172009 Jun 20 12:37:11.861649 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3151/6397] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:11 2022] GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:11.902545 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ef730dcf-f656-4323-b316-4a70f43dc87b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:11.906552 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:37:11.911649 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ef730dcf-f656-4323-b316-4a70f43dc87b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2" status: 200 len: 1216 microversion: 2.1 time: 0.172652 Jun 20 12:37:11.912493 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3247/6398] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:11 2022] GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 => generated 1216 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:12.879321 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-204deddb-48b2-4f43-9b37-63cd2e2701f0 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:12.880190 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-204deddb-48b2-4f43-9b37-63cd2e2701f0 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 901af3d1-ee82-487d-ba43-06eea301b2d4] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:12.887079 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-204deddb-48b2-4f43-9b37-63cd2e2701f0 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:12.887597 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-204deddb-48b2-4f43-9b37-63cd2e2701f0 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:12.888505 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-204deddb-48b2-4f43-9b37-63cd2e2701f0 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:12.889069 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-204deddb-48b2-4f43-9b37-63cd2e2701f0 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:12.929500 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5f116633-0a09-483e-9cca-d173f0805e02 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:12.930105 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5f116633-0a09-483e-9cca-d173f0805e02 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:12.940492 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f116633-0a09-483e-9cca-d173f0805e02 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:12.941489 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f116633-0a09-483e-9cca-d173f0805e02 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:12.942284 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f116633-0a09-483e-9cca-d173f0805e02 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:12.942712 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f116633-0a09-483e-9cca-d173f0805e02 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:13.050489 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-204deddb-48b2-4f43-9b37-63cd2e2701f0 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:13.060919 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-204deddb-48b2-4f43-9b37-63cd2e2701f0 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4" status: 200 len: 1368 microversion: 2.1 time: 0.185863 Jun 20 12:37:13.061669 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3152/6399] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:12 2022] GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4 => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:13.155750 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5f116633-0a09-483e-9cca-d173f0805e02 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:13.164520 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5f116633-0a09-483e-9cca-d173f0805e02 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2" status: 200 len: 1216 microversion: 2.1 time: 0.239354 Jun 20 12:37:13.165375 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3248/6400] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:12 2022] GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 => generated 1216 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:14.078733 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d8c88efa-1051-4f87-bd86-4fde10eda22b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:14.079280 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d8c88efa-1051-4f87-bd86-4fde10eda22b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 901af3d1-ee82-487d-ba43-06eea301b2d4] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:14.081836 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=4 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:37:14.083153 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=12 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:37:14.089931 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d8c88efa-1051-4f87-bd86-4fde10eda22b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:14.090427 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d8c88efa-1051-4f87-bd86-4fde10eda22b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:14.091271 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d8c88efa-1051-4f87-bd86-4fde10eda22b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:14.091691 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d8c88efa-1051-4f87-bd86-4fde10eda22b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:14.182889 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-728f9f4b-c5b6-49a9-a88b-8e63d552a7ce tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:14.184046 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-728f9f4b-c5b6-49a9-a88b-8e63d552a7ce tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:14.186047 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=8 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:37:14.193310 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-728f9f4b-c5b6-49a9-a88b-8e63d552a7ce tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:14.193971 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-728f9f4b-c5b6-49a9-a88b-8e63d552a7ce tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:14.194934 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-728f9f4b-c5b6-49a9-a88b-8e63d552a7ce tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:14.195338 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-728f9f4b-c5b6-49a9-a88b-8e63d552a7ce tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:14.239322 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d8c88efa-1051-4f87-bd86-4fde10eda22b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:14.244242 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:37:14.249914 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d8c88efa-1051-4f87-bd86-4fde10eda22b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4" status: 200 len: 1368 microversion: 2.1 time: 0.175258 Jun 20 12:37:14.252752 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3153/6401] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:14 2022] GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4 => generated 1368 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:14.339495 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-728f9f4b-c5b6-49a9-a88b-8e63d552a7ce tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:14.348441 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-728f9f4b-c5b6-49a9-a88b-8e63d552a7ce tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2" status: 200 len: 1216 microversion: 2.1 time: 0.170066 Jun 20 12:37:14.349002 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3249/6402] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:14 2022] GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 => generated 1216 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:37:15.073523 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-ba8efc30-cdc6-40c6-b9e2-07a3cffe07b1 req-9447b885-59bf-4355-b119-3867c5e605d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "901af3d1-ee82-487d-ba43-06eea301b2d4", "name": "network-vif-plugged", "status": "completed", "tag": "4471f6e3-733c-417f-b9a3-81099f289b4e"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:37:15.082721 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-ba8efc30-cdc6-40c6-b9e2-07a3cffe07b1 req-9447b885-59bf-4355-b119-3867c5e605d5 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:15.083962 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-ba8efc30-cdc6-40c6-b9e2-07a3cffe07b1 req-9447b885-59bf-4355-b119-3867c5e605d5 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:15.098018 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-ba8efc30-cdc6-40c6-b9e2-07a3cffe07b1 req-9447b885-59bf-4355-b119-3867c5e605d5 service nova] Creating event network-vif-plugged:4471f6e3-733c-417f-b9a3-81099f289b4e for instance 901af3d1-ee82-487d-ba43-06eea301b2d4 on n-h2-master-1 Jun 20 12:37:15.103792 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-ba8efc30-cdc6-40c6-b9e2-07a3cffe07b1 req-9447b885-59bf-4355-b119-3867c5e605d5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034948 Jun 20 12:37:15.104908 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3154/6403] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:37:15.267093 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b7df84ca-3658-43e6-82af-64821fad003e tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:15.267866 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b7df84ca-3658-43e6-82af-64821fad003e tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 901af3d1-ee82-487d-ba43-06eea301b2d4] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:15.276312 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b7df84ca-3658-43e6-82af-64821fad003e tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:15.276869 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b7df84ca-3658-43e6-82af-64821fad003e tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:15.277711 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b7df84ca-3658-43e6-82af-64821fad003e tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:15.278268 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b7df84ca-3658-43e6-82af-64821fad003e tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:15.366785 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-16d21ccc-5d69-44fb-9b19-bfa8fdbf63d7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:15.367752 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-16d21ccc-5d69-44fb-9b19-bfa8fdbf63d7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:15.374365 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-16d21ccc-5d69-44fb-9b19-bfa8fdbf63d7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:15.375057 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-16d21ccc-5d69-44fb-9b19-bfa8fdbf63d7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:15.375847 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-16d21ccc-5d69-44fb-9b19-bfa8fdbf63d7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:15.376319 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-16d21ccc-5d69-44fb-9b19-bfa8fdbf63d7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:15.454442 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b7df84ca-3658-43e6-82af-64821fad003e tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:15.463404 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b7df84ca-3658-43e6-82af-64821fad003e tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4" status: 200 len: 1368 microversion: 2.1 time: 0.200143 Jun 20 12:37:15.467332 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3250/6404] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:15 2022] GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4 => generated 1368 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:15.534334 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-16d21ccc-5d69-44fb-9b19-bfa8fdbf63d7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:15.542434 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-16d21ccc-5d69-44fb-9b19-bfa8fdbf63d7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2" status: 200 len: 1216 microversion: 2.1 time: 0.180133 Jun 20 12:37:15.543012 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3155/6405] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:15 2022] GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 => generated 1216 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:16.480292 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-41b71c24-4ebe-480b-bb1d-b11f6cd67c21 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:16.480905 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-41b71c24-4ebe-480b-bb1d-b11f6cd67c21 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 901af3d1-ee82-487d-ba43-06eea301b2d4] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:16.488491 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-41b71c24-4ebe-480b-bb1d-b11f6cd67c21 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:16.488491 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-41b71c24-4ebe-480b-bb1d-b11f6cd67c21 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:16.489084 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-41b71c24-4ebe-480b-bb1d-b11f6cd67c21 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:16.489520 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-41b71c24-4ebe-480b-bb1d-b11f6cd67c21 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:16.559113 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6f02eded-4e99-46f1-a914-7731aa6bf0f6 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:16.559725 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6f02eded-4e99-46f1-a914-7731aa6bf0f6 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:16.567404 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6f02eded-4e99-46f1-a914-7731aa6bf0f6 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:16.567855 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6f02eded-4e99-46f1-a914-7731aa6bf0f6 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:16.568804 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6f02eded-4e99-46f1-a914-7731aa6bf0f6 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:16.569239 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6f02eded-4e99-46f1-a914-7731aa6bf0f6 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:16.635995 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-41b71c24-4ebe-480b-bb1d-b11f6cd67c21 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:16.647692 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-41b71c24-4ebe-480b-bb1d-b11f6cd67c21 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4" status: 200 len: 1368 microversion: 2.1 time: 0.168968 Jun 20 12:37:16.647692 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3251/6406] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:16 2022] GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:16.736383 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6f02eded-4e99-46f1-a914-7731aa6bf0f6 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:16.751573 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6f02eded-4e99-46f1-a914-7731aa6bf0f6 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2" status: 200 len: 1216 microversion: 2.1 time: 0.196378 Jun 20 12:37:16.756875 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3156/6407] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:16 2022] GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 => generated 1216 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:17.664341 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f5ca6f20-662f-4fc8-8a98-594e415f0694 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:17.665163 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f5ca6f20-662f-4fc8-8a98-594e415f0694 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 901af3d1-ee82-487d-ba43-06eea301b2d4] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:17.672773 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5ca6f20-662f-4fc8-8a98-594e415f0694 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:17.673307 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5ca6f20-662f-4fc8-8a98-594e415f0694 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:17.674154 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5ca6f20-662f-4fc8-8a98-594e415f0694 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:17.674676 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5ca6f20-662f-4fc8-8a98-594e415f0694 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:17.768891 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-260b45a1-fd69-463f-80ed-521457ced9a9 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:17.770678 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-260b45a1-fd69-463f-80ed-521457ced9a9 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:17.781598 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-260b45a1-fd69-463f-80ed-521457ced9a9 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:17.782591 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-260b45a1-fd69-463f-80ed-521457ced9a9 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:17.783952 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-260b45a1-fd69-463f-80ed-521457ced9a9 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:17.784835 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-260b45a1-fd69-463f-80ed-521457ced9a9 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:17.859904 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f5ca6f20-662f-4fc8-8a98-594e415f0694 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:17.871120 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f5ca6f20-662f-4fc8-8a98-594e415f0694 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4" status: 200 len: 1558 microversion: 2.1 time: 0.211861 Jun 20 12:37:17.871736 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3252/6408] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:17 2022] GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4 => generated 1558 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:17.889314 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1919865c-1ec6-4080-9ee0-f96d62cb042d tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:17.889966 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1919865c-1ec6-4080-9ee0-f96d62cb042d tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 901af3d1-ee82-487d-ba43-06eea301b2d4] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:17.897571 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1919865c-1ec6-4080-9ee0-f96d62cb042d tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:17.898251 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1919865c-1ec6-4080-9ee0-f96d62cb042d tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:17.899039 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1919865c-1ec6-4080-9ee0-f96d62cb042d tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:17.899399 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1919865c-1ec6-4080-9ee0-f96d62cb042d tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:17.957873 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-260b45a1-fd69-463f-80ed-521457ced9a9 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:17.968279 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-260b45a1-fd69-463f-80ed-521457ced9a9 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2" status: 200 len: 1216 microversion: 2.1 time: 0.202977 Jun 20 12:37:17.973181 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3157/6409] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:17 2022] GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 => generated 1216 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:37:17.986514 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1919865c-1ec6-4080-9ee0-f96d62cb042d tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102514 Jun 20 12:37:17.987134 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3253/6410] 10.222.0.27 () {58 vars in 1274 bytes} [Mon Jun 20 12:37:17 2022] GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:37:18.987980 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c63465ae-b179-4e80-bf52-bf3ea1d73a05 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:18.987980 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c63465ae-b179-4e80-bf52-bf3ea1d73a05 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:19.001262 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c63465ae-b179-4e80-bf52-bf3ea1d73a05 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:19.001696 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c63465ae-b179-4e80-bf52-bf3ea1d73a05 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:19.002605 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c63465ae-b179-4e80-bf52-bf3ea1d73a05 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:19.003287 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c63465ae-b179-4e80-bf52-bf3ea1d73a05 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:19.244819 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c63465ae-b179-4e80-bf52-bf3ea1d73a05 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:19.253119 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c63465ae-b179-4e80-bf52-bf3ea1d73a05 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2" status: 200 len: 1216 microversion: 2.1 time: 0.270666 Jun 20 12:37:19.254449 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3158/6411] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:18 2022] GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 => generated 1216 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:19.380613 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-b088ac53-22de-4940-86ef-deccda91ab86 req-1eda13de-da33-4f8b-9d54-e7b2bfe3c07c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "901af3d1-ee82-487d-ba43-06eea301b2d4", "tag": "4471f6e3-733c-417f-b9a3-81099f289b4e"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:37:19.394139 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b088ac53-22de-4940-86ef-deccda91ab86 req-1eda13de-da33-4f8b-9d54-e7b2bfe3c07c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:19.394844 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b088ac53-22de-4940-86ef-deccda91ab86 req-1eda13de-da33-4f8b-9d54-e7b2bfe3c07c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:19.409982 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-b088ac53-22de-4940-86ef-deccda91ab86 req-1eda13de-da33-4f8b-9d54-e7b2bfe3c07c service nova] Creating event network-changed:4471f6e3-733c-417f-b9a3-81099f289b4e for instance 901af3d1-ee82-487d-ba43-06eea301b2d4 on n-h2-master-1 Jun 20 12:37:19.416951 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-b088ac53-22de-4940-86ef-deccda91ab86 req-1eda13de-da33-4f8b-9d54-e7b2bfe3c07c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042211 Jun 20 12:37:19.419181 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3254/6412] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:37:19.485862 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-7c8933e0-b194-4cf0-aafc-3154f664438c req-8cc7e8f2-69be-4219-be3e-d253ddb2e248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2", "name": "network-vif-plugged", "status": "completed", "tag": "0533e46a-afb9-47fa-9f15-0d53fd1d694d"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:37:19.507353 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-7c8933e0-b194-4cf0-aafc-3154f664438c req-8cc7e8f2-69be-4219-be3e-d253ddb2e248 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:19.508561 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-7c8933e0-b194-4cf0-aafc-3154f664438c req-8cc7e8f2-69be-4219-be3e-d253ddb2e248 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:19.531743 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-7c8933e0-b194-4cf0-aafc-3154f664438c req-8cc7e8f2-69be-4219-be3e-d253ddb2e248 service nova] Creating event network-vif-plugged:0533e46a-afb9-47fa-9f15-0d53fd1d694d for instance 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 on n-h1-master-1 Jun 20 12:37:19.544340 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-7c8933e0-b194-4cf0-aafc-3154f664438c req-8cc7e8f2-69be-4219-be3e-d253ddb2e248 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062771 Jun 20 12:37:19.547813 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3159/6413] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:37:20.278377 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6a3298d4-f1fe-4842-a937-23231f3228a1 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:20.279077 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6a3298d4-f1fe-4842-a937-23231f3228a1 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:20.281722 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:37:20.289147 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6a3298d4-f1fe-4842-a937-23231f3228a1 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:20.289456 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6a3298d4-f1fe-4842-a937-23231f3228a1 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:20.291260 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6a3298d4-f1fe-4842-a937-23231f3228a1 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:20.291709 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6a3298d4-f1fe-4842-a937-23231f3228a1 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:20.452514 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6a3298d4-f1fe-4842-a937-23231f3228a1 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:20.461390 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6a3298d4-f1fe-4842-a937-23231f3228a1 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2" status: 200 len: 1216 microversion: 2.1 time: 0.187559 Jun 20 12:37:20.462641 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3255/6414] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:20 2022] GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 => generated 1216 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:21.480390 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-edfcb757-829f-4dbc-b90e-df590e9ea1d6 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:21.481854 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-edfcb757-829f-4dbc-b90e-df590e9ea1d6 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:21.484756 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:37:21.491381 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-edfcb757-829f-4dbc-b90e-df590e9ea1d6 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:21.491959 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-edfcb757-829f-4dbc-b90e-df590e9ea1d6 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:21.492754 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-edfcb757-829f-4dbc-b90e-df590e9ea1d6 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:21.493193 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-edfcb757-829f-4dbc-b90e-df590e9ea1d6 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:21.646420 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-edfcb757-829f-4dbc-b90e-df590e9ea1d6 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:21.659635 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-edfcb757-829f-4dbc-b90e-df590e9ea1d6 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2" status: 200 len: 1402 microversion: 2.1 time: 0.183798 Jun 20 12:37:21.660703 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3160/6415] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:21 2022] GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 => generated 1402 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:21.687105 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6a87b7b5-e8c1-40d6-a426-4092deddeb75 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:21.688237 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6a87b7b5-e8c1-40d6-a426-4092deddeb75 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:21.699799 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6a87b7b5-e8c1-40d6-a426-4092deddeb75 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:21.700606 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6a87b7b5-e8c1-40d6-a426-4092deddeb75 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:21.701893 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6a87b7b5-e8c1-40d6-a426-4092deddeb75 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:21.702606 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6a87b7b5-e8c1-40d6-a426-4092deddeb75 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:21.872013 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6a87b7b5-e8c1-40d6-a426-4092deddeb75 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:21.889607 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6a87b7b5-e8c1-40d6-a426-4092deddeb75 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2" status: 200 len: 1402 microversion: 2.1 time: 0.209594 Jun 20 12:37:21.890367 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3256/6416] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:21 2022] GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 => generated 1402 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:21.906535 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9d10d6d5-2bae-4fba-91bd-a29c80693d99 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1703674282"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:37:21.907557 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9d10d6d5-2bae-4fba-91bd-a29c80693d99 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:21.914317 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d10d6d5-2bae-4fba-91bd-a29c80693d99 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:21.914769 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d10d6d5-2bae-4fba-91bd-a29c80693d99 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:21.915535 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d10d6d5-2bae-4fba-91bd-a29c80693d99 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:21.915944 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d10d6d5-2bae-4fba-91bd-a29c80693d99 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:22.024566 n-d-master-1 devstack@n-api.service[119128]: INFO nova.compute.api [None req-9d10d6d5-2bae-4fba-91bd-a29c80693d99 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2] Attempting to quiesce instance before volume snapshot. Jun 20 12:37:22.075937 n-d-master-1 devstack@n-api.service[119128]: INFO nova.compute.api [None req-9d10d6d5-2bae-4fba-91bd-a29c80693d99 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Jun 20 12:37:22.153266 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9d10d6d5-2bae-4fba-91bd-a29c80693d99 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2] Creating snapshot from volume bd24817e-1153-4c38-bf39-c1cd850aaf0a. {{(pid=119128) snapshot_instance /opt/stack/nova/nova/compute/api.py:3454}} Jun 20 12:37:23.294339 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9d10d6d5-2bae-4fba-91bd-a29c80693d99 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "POST /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2/action" status: 202 len: 0 microversion: 2.1 time: 1.391963 Jun 20 12:37:23.296854 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3161/6417] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:37:21 2022] POST /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2/action => generated 0 bytes in 1395 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 20 12:37:24.524346 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b2d17e35-02a0-4953-ae35-4afc0f70274d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-408107946", "imageRef": "040b75d3-9af0-4cf4-976c-82fa764db6ff", "flavorRef": "452", "networks": [{"uuid": "fda59e99-54c8-4d95-ad3c-e4129b9a154d"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:37:24.586076 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-b2d17e35-02a0-4953-ae35-4afc0f70274d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] validate_networks() for [('fda59e99-54c8-4d95-ad3c-e4129b9a154d', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:37:25.011990 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-b2d17e35-02a0-4953-ae35-4afc0f70274d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:37:25.012453 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-b2d17e35-02a0-4953-ae35-4afc0f70274d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:37:25.012947 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-b2d17e35-02a0-4953-ae35-4afc0f70274d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:37:25.013363 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-b2d17e35-02a0-4953-ae35-4afc0f70274d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:37:25.013785 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-b2d17e35-02a0-4953-ae35-4afc0f70274d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:37:25.024512 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b2d17e35-02a0-4953-ae35-4afc0f70274d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:25.024963 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b2d17e35-02a0-4953-ae35-4afc0f70274d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:25.026034 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b2d17e35-02a0-4953-ae35-4afc0f70274d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:25.026477 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b2d17e35-02a0-4953-ae35-4afc0f70274d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:25.049617 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-b2d17e35-02a0-4953-ae35-4afc0f70274d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Getting quotas for project 5a9c7bbcc9a149f5b77a89141a306c3e. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:37:25.057087 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-b2d17e35-02a0-4953-ae35-4afc0f70274d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Getting quotas for user fed0afc129364664aed8d8a96f499831 and project 5a9c7bbcc9a149f5b77a89141a306c3e. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:37:25.073645 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b2d17e35-02a0-4953-ae35-4afc0f70274d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:37:25.076921 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b2d17e35-02a0-4953-ae35-4afc0f70274d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='d8cdc0cd-f801-4a9d-9069-f3e8acdc0326',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:37:25.165399 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b2d17e35-02a0-4953-ae35-4afc0f70274d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.644965 Jun 20 12:37:25.172168 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3257/6418] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:37:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:37:25.179862 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-28048c91-a54e-4ab9-90c9-187c24acc8ee tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:25.180353 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-28048c91-a54e-4ab9-90c9-187c24acc8ee tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:25.259967 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-28048c91-a54e-4ab9-90c9-187c24acc8ee tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:25.268864 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-28048c91-a54e-4ab9-90c9-187c24acc8ee tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 200 len: 1229 microversion: 2.1 time: 0.095059 Jun 20 12:37:25.270046 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3162/6419] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:25 2022] GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 1229 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:26.288782 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1dd705c9-301b-4e7d-b855-7859a1ec4068 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:26.289339 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1dd705c9-301b-4e7d-b855-7859a1ec4068 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:26.296960 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1dd705c9-301b-4e7d-b855-7859a1ec4068 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:26.297365 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1dd705c9-301b-4e7d-b855-7859a1ec4068 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:26.298057 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1dd705c9-301b-4e7d-b855-7859a1ec4068 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:26.298682 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1dd705c9-301b-4e7d-b855-7859a1ec4068 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:26.447864 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1dd705c9-301b-4e7d-b855-7859a1ec4068 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:26.458650 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1dd705c9-301b-4e7d-b855-7859a1ec4068 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 200 len: 1299 microversion: 2.1 time: 0.173333 Jun 20 12:37:26.459980 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3258/6420] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:26 2022] GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 1299 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:37:27.479766 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ba20d22f-b405-4906-92be-912dfdc204cc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:27.480626 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ba20d22f-b405-4906-92be-912dfdc204cc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:27.501306 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba20d22f-b405-4906-92be-912dfdc204cc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:27.501786 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba20d22f-b405-4906-92be-912dfdc204cc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:27.504538 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba20d22f-b405-4906-92be-912dfdc204cc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:27.508039 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba20d22f-b405-4906-92be-912dfdc204cc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:27.862708 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ba20d22f-b405-4906-92be-912dfdc204cc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:27.876341 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ba20d22f-b405-4906-92be-912dfdc204cc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 200 len: 1341 microversion: 2.1 time: 0.400681 Jun 20 12:37:27.876946 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3163/6421] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:27 2022] GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 1341 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:28.414547 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-cf00d018-362e-4857-af31-a416bb691b30 req-d2f7661f-83c3-41d2-9cdb-465047d6ec86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0af54a2-9e17-4e2f-8bfb-adc5db92df84", "tag": "a00def3d-8691-4aaf-8384-a396e8abc1fc"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:37:28.432608 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-cf00d018-362e-4857-af31-a416bb691b30 req-d2f7661f-83c3-41d2-9cdb-465047d6ec86 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:28.434236 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-cf00d018-362e-4857-af31-a416bb691b30 req-d2f7661f-83c3-41d2-9cdb-465047d6ec86 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:28.459604 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-cf00d018-362e-4857-af31-a416bb691b30 req-d2f7661f-83c3-41d2-9cdb-465047d6ec86 service nova] Creating event network-changed:a00def3d-8691-4aaf-8384-a396e8abc1fc for instance b0af54a2-9e17-4e2f-8bfb-adc5db92df84 on n-h1-master-1 Jun 20 12:37:28.471389 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-cf00d018-362e-4857-af31-a416bb691b30 req-d2f7661f-83c3-41d2-9cdb-465047d6ec86 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061372 Jun 20 12:37:28.472333 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3259/6422] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:37:28.901476 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-31b64c05-0197-4b56-bbce-0c64eb2b5bfd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:28.902520 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-31b64c05-0197-4b56-bbce-0c64eb2b5bfd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:28.918325 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-31b64c05-0197-4b56-bbce-0c64eb2b5bfd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:28.919235 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-31b64c05-0197-4b56-bbce-0c64eb2b5bfd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:28.920552 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-31b64c05-0197-4b56-bbce-0c64eb2b5bfd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:28.921626 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-31b64c05-0197-4b56-bbce-0c64eb2b5bfd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:29.226635 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-31b64c05-0197-4b56-bbce-0c64eb2b5bfd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:29.240867 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-31b64c05-0197-4b56-bbce-0c64eb2b5bfd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 200 len: 1341 microversion: 2.1 time: 0.348933 Jun 20 12:37:29.242936 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3164/6423] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:28 2022] GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 1341 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:30.261581 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-87ebca48-38fa-482a-b143-d84fa0374997 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:30.262921 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-87ebca48-38fa-482a-b143-d84fa0374997 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:30.274320 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-87ebca48-38fa-482a-b143-d84fa0374997 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:30.274864 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-87ebca48-38fa-482a-b143-d84fa0374997 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:30.275746 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-87ebca48-38fa-482a-b143-d84fa0374997 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:30.276064 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-87ebca48-38fa-482a-b143-d84fa0374997 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:30.493258 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-87ebca48-38fa-482a-b143-d84fa0374997 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:30.503311 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-87ebca48-38fa-482a-b143-d84fa0374997 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 200 len: 1341 microversion: 2.1 time: 0.246766 Jun 20 12:37:30.504161 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3260/6424] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:30 2022] GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 1341 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:37:31.527447 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6ec280fe-52ef-47c1-8136-641d6cdd2323 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:31.528389 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6ec280fe-52ef-47c1-8136-641d6cdd2323 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:31.538228 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ec280fe-52ef-47c1-8136-641d6cdd2323 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:31.538692 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ec280fe-52ef-47c1-8136-641d6cdd2323 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:31.539522 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ec280fe-52ef-47c1-8136-641d6cdd2323 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:31.540253 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ec280fe-52ef-47c1-8136-641d6cdd2323 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:31.743866 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6ec280fe-52ef-47c1-8136-641d6cdd2323 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:31.756325 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6ec280fe-52ef-47c1-8136-641d6cdd2323 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 200 len: 1341 microversion: 2.1 time: 0.236229 Jun 20 12:37:31.757191 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3165/6425] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:31 2022] GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 1341 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:37:32.783464 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4f0e6141-b32a-4dec-8763-fecfd72b97bb tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:32.788056 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4f0e6141-b32a-4dec-8763-fecfd72b97bb tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:32.800579 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4f0e6141-b32a-4dec-8763-fecfd72b97bb tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:32.801037 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4f0e6141-b32a-4dec-8763-fecfd72b97bb tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:32.802472 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4f0e6141-b32a-4dec-8763-fecfd72b97bb tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:32.803105 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4f0e6141-b32a-4dec-8763-fecfd72b97bb tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:33.014801 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4f0e6141-b32a-4dec-8763-fecfd72b97bb tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:33.023662 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4f0e6141-b32a-4dec-8763-fecfd72b97bb tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 200 len: 1341 microversion: 2.1 time: 0.249175 Jun 20 12:37:33.024287 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3261/6426] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:32 2022] GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 1341 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:37:34.063450 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bd16d8c9-048b-4f36-8bf0-7b94ace5999d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:34.065053 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bd16d8c9-048b-4f36-8bf0-7b94ace5999d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:34.072931 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bd16d8c9-048b-4f36-8bf0-7b94ace5999d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:34.073648 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bd16d8c9-048b-4f36-8bf0-7b94ace5999d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:34.074873 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bd16d8c9-048b-4f36-8bf0-7b94ace5999d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:34.075481 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bd16d8c9-048b-4f36-8bf0-7b94ace5999d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:34.249286 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-bd16d8c9-048b-4f36-8bf0-7b94ace5999d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:34.259197 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bd16d8c9-048b-4f36-8bf0-7b94ace5999d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 200 len: 1341 microversion: 2.1 time: 0.200580 Jun 20 12:37:34.259804 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3166/6427] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:34 2022] GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 1341 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:35.280402 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8d45c75c-9e1f-46e4-96a0-53661a6dfa79 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:35.282311 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8d45c75c-9e1f-46e4-96a0-53661a6dfa79 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:35.285934 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:37:35.286690 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:37:35.295208 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8d45c75c-9e1f-46e4-96a0-53661a6dfa79 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:35.295888 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8d45c75c-9e1f-46e4-96a0-53661a6dfa79 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:35.296918 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8d45c75c-9e1f-46e4-96a0-53661a6dfa79 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:35.297735 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8d45c75c-9e1f-46e4-96a0-53661a6dfa79 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:35.453562 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8d45c75c-9e1f-46e4-96a0-53661a6dfa79 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:35.462220 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8d45c75c-9e1f-46e4-96a0-53661a6dfa79 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 200 len: 1341 microversion: 2.1 time: 0.186162 Jun 20 12:37:35.473208 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3262/6428] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:35 2022] GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 1341 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:36.482201 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9b51bf06-ee45-41e2-9ecf-af03753c5c93 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:36.483985 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9b51bf06-ee45-41e2-9ecf-af03753c5c93 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:36.487747 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:37:36.496492 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9b51bf06-ee45-41e2-9ecf-af03753c5c93 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:36.497530 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9b51bf06-ee45-41e2-9ecf-af03753c5c93 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:36.498857 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9b51bf06-ee45-41e2-9ecf-af03753c5c93 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:36.499517 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9b51bf06-ee45-41e2-9ecf-af03753c5c93 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:36.687544 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9b51bf06-ee45-41e2-9ecf-af03753c5c93 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:36.698660 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9b51bf06-ee45-41e2-9ecf-af03753c5c93 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 200 len: 1341 microversion: 2.1 time: 0.220584 Jun 20 12:37:36.699575 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3167/6429] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:36 2022] GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 1341 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:37.716527 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ebe01ef4-bf08-4053-88ce-f8bb2d98017f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:37.717117 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ebe01ef4-bf08-4053-88ce-f8bb2d98017f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:37.725550 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebe01ef4-bf08-4053-88ce-f8bb2d98017f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:37.726067 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebe01ef4-bf08-4053-88ce-f8bb2d98017f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:37.726863 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebe01ef4-bf08-4053-88ce-f8bb2d98017f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:37.727353 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebe01ef4-bf08-4053-88ce-f8bb2d98017f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:37.915921 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ebe01ef4-bf08-4053-88ce-f8bb2d98017f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:37.929852 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ebe01ef4-bf08-4053-88ce-f8bb2d98017f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 200 len: 1341 microversion: 2.1 time: 0.217270 Jun 20 12:37:37.931357 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3263/6430] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:37 2022] GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 1341 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:38.955487 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cdc2d1f8-b7a8-4aa9-b6c0-a34a3a64b62f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:38.956871 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cdc2d1f8-b7a8-4aa9-b6c0-a34a3a64b62f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:38.968087 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cdc2d1f8-b7a8-4aa9-b6c0-a34a3a64b62f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:38.968979 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cdc2d1f8-b7a8-4aa9-b6c0-a34a3a64b62f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:38.970081 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cdc2d1f8-b7a8-4aa9-b6c0-a34a3a64b62f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:38.970565 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cdc2d1f8-b7a8-4aa9-b6c0-a34a3a64b62f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:39.139415 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-cdc2d1f8-b7a8-4aa9-b6c0-a34a3a64b62f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:39.147504 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cdc2d1f8-b7a8-4aa9-b6c0-a34a3a64b62f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 200 len: 1341 microversion: 2.1 time: 0.202435 Jun 20 12:37:39.148241 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3168/6431] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:38 2022] GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 1341 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:40.166645 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-aa7a0413-471e-480f-afd4-37667ecf1cf3 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:40.169791 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-aa7a0413-471e-480f-afd4-37667ecf1cf3 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:40.186030 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa7a0413-471e-480f-afd4-37667ecf1cf3 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:40.186627 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa7a0413-471e-480f-afd4-37667ecf1cf3 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:40.191984 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa7a0413-471e-480f-afd4-37667ecf1cf3 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:40.192466 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa7a0413-471e-480f-afd4-37667ecf1cf3 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:40.404127 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-aa7a0413-471e-480f-afd4-37667ecf1cf3 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:40.414184 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-aa7a0413-471e-480f-afd4-37667ecf1cf3 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 200 len: 1341 microversion: 2.1 time: 0.251396 Jun 20 12:37:40.415331 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3264/6432] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:40 2022] GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 1341 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:37:41.431271 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f863f750-7c49-40ef-b8c2-7a1bee15e8fc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:41.431921 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f863f750-7c49-40ef-b8c2-7a1bee15e8fc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:41.440076 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f863f750-7c49-40ef-b8c2-7a1bee15e8fc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:41.440553 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f863f750-7c49-40ef-b8c2-7a1bee15e8fc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:41.441351 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f863f750-7c49-40ef-b8c2-7a1bee15e8fc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:41.441795 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f863f750-7c49-40ef-b8c2-7a1bee15e8fc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:41.602435 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f863f750-7c49-40ef-b8c2-7a1bee15e8fc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:41.614870 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f863f750-7c49-40ef-b8c2-7a1bee15e8fc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 200 len: 1341 microversion: 2.1 time: 0.187517 Jun 20 12:37:41.615678 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3169/6433] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:41 2022] GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 1341 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:42.633051 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7ee2182b-c3f2-4ebe-b97f-596374a9cecc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:42.633778 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7ee2182b-c3f2-4ebe-b97f-596374a9cecc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:42.643472 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ee2182b-c3f2-4ebe-b97f-596374a9cecc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:42.644218 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ee2182b-c3f2-4ebe-b97f-596374a9cecc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:42.645210 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ee2182b-c3f2-4ebe-b97f-596374a9cecc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:42.645680 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ee2182b-c3f2-4ebe-b97f-596374a9cecc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:42.802131 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7ee2182b-c3f2-4ebe-b97f-596374a9cecc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:42.809995 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7ee2182b-c3f2-4ebe-b97f-596374a9cecc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 200 len: 1341 microversion: 2.1 time: 0.181643 Jun 20 12:37:42.810613 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3265/6434] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:42 2022] GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 1341 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:43.829007 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-39157fcf-fc31-4f97-a94b-956cfe873d85 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:43.829525 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-39157fcf-fc31-4f97-a94b-956cfe873d85 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:43.837213 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-39157fcf-fc31-4f97-a94b-956cfe873d85 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:43.837826 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-39157fcf-fc31-4f97-a94b-956cfe873d85 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:43.838767 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-39157fcf-fc31-4f97-a94b-956cfe873d85 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:43.839247 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-39157fcf-fc31-4f97-a94b-956cfe873d85 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:43.993094 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-39157fcf-fc31-4f97-a94b-956cfe873d85 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:43.995952 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:37:44.003282 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-39157fcf-fc31-4f97-a94b-956cfe873d85 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 200 len: 1341 microversion: 2.1 time: 0.178753 Jun 20 12:37:44.004149 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3170/6435] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:43 2022] GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 1341 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:45.020455 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-18099dee-23c4-4083-88cb-9877f969fcbc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:45.021098 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-18099dee-23c4-4083-88cb-9877f969fcbc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:45.028519 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-18099dee-23c4-4083-88cb-9877f969fcbc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:45.028981 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-18099dee-23c4-4083-88cb-9877f969fcbc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:45.029751 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-18099dee-23c4-4083-88cb-9877f969fcbc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:45.030189 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-18099dee-23c4-4083-88cb-9877f969fcbc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:45.033193 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=95 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:37:45.189024 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-18099dee-23c4-4083-88cb-9877f969fcbc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:45.198522 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-18099dee-23c4-4083-88cb-9877f969fcbc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 200 len: 1341 microversion: 2.1 time: 0.182071 Jun 20 12:37:45.199130 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3266/6436] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:45 2022] GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 1341 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:46.215447 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3b8a34d7-6a16-4fa9-a6d4-96b9745ba4c4 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:46.216092 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3b8a34d7-6a16-4fa9-a6d4-96b9745ba4c4 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:46.226025 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b8a34d7-6a16-4fa9-a6d4-96b9745ba4c4 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:46.226627 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b8a34d7-6a16-4fa9-a6d4-96b9745ba4c4 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:46.227545 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b8a34d7-6a16-4fa9-a6d4-96b9745ba4c4 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:46.227991 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3b8a34d7-6a16-4fa9-a6d4-96b9745ba4c4 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:46.388026 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3b8a34d7-6a16-4fa9-a6d4-96b9745ba4c4 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:46.397245 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3b8a34d7-6a16-4fa9-a6d4-96b9745ba4c4 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 200 len: 1341 microversion: 2.1 time: 0.186011 Jun 20 12:37:46.398109 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3171/6437] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:46 2022] GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 1341 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:47.415896 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4b902bc3-6e18-4cfc-926e-2e608831d3a7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:47.416717 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4b902bc3-6e18-4cfc-926e-2e608831d3a7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:47.424156 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4b902bc3-6e18-4cfc-926e-2e608831d3a7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:47.424753 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4b902bc3-6e18-4cfc-926e-2e608831d3a7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:47.425510 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4b902bc3-6e18-4cfc-926e-2e608831d3a7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:47.425913 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4b902bc3-6e18-4cfc-926e-2e608831d3a7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:47.564477 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4b902bc3-6e18-4cfc-926e-2e608831d3a7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:47.572443 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4b902bc3-6e18-4cfc-926e-2e608831d3a7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 200 len: 1375 microversion: 2.1 time: 0.160908 Jun 20 12:37:47.573258 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3267/6438] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:47 2022] GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 1375 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:48.590527 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-304a101e-54d1-4933-b18a-1a479db4238b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:48.591495 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-304a101e-54d1-4933-b18a-1a479db4238b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:48.599417 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-304a101e-54d1-4933-b18a-1a479db4238b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:48.599888 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-304a101e-54d1-4933-b18a-1a479db4238b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:48.600739 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-304a101e-54d1-4933-b18a-1a479db4238b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:48.601169 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-304a101e-54d1-4933-b18a-1a479db4238b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:48.767407 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-304a101e-54d1-4933-b18a-1a479db4238b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:48.777218 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-304a101e-54d1-4933-b18a-1a479db4238b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 200 len: 1375 microversion: 2.1 time: 0.190698 Jun 20 12:37:48.777823 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3172/6439] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:48 2022] GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 1375 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:49.795138 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0e5a1ade-1ce8-4def-91cd-01fd5e50e5e2 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:49.795810 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0e5a1ade-1ce8-4def-91cd-01fd5e50e5e2 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:49.803183 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0e5a1ade-1ce8-4def-91cd-01fd5e50e5e2 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:49.803621 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0e5a1ade-1ce8-4def-91cd-01fd5e50e5e2 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:49.804453 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0e5a1ade-1ce8-4def-91cd-01fd5e50e5e2 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:49.804851 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0e5a1ade-1ce8-4def-91cd-01fd5e50e5e2 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:49.951906 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0e5a1ade-1ce8-4def-91cd-01fd5e50e5e2 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:49.960340 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0e5a1ade-1ce8-4def-91cd-01fd5e50e5e2 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 200 len: 1375 microversion: 2.1 time: 0.169055 Jun 20 12:37:49.960934 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3268/6440] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:49 2022] GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 1375 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:50.979263 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ca64b085-81f7-45c6-b037-14851710bd6e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:50.979995 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ca64b085-81f7-45c6-b037-14851710bd6e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:50.989360 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ca64b085-81f7-45c6-b037-14851710bd6e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:50.989829 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ca64b085-81f7-45c6-b037-14851710bd6e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:50.990650 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ca64b085-81f7-45c6-b037-14851710bd6e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:50.991102 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ca64b085-81f7-45c6-b037-14851710bd6e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:51.149405 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ca64b085-81f7-45c6-b037-14851710bd6e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:51.161555 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ca64b085-81f7-45c6-b037-14851710bd6e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 200 len: 1375 microversion: 2.1 time: 0.186250 Jun 20 12:37:51.162429 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3173/6441] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:50 2022] GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 1375 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:37:52.181753 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d413e335-6eda-42ab-aaa4-81daeef5b108 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:52.182385 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d413e335-6eda-42ab-aaa4-81daeef5b108 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:52.185011 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:37:52.190511 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d413e335-6eda-42ab-aaa4-81daeef5b108 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:52.190991 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d413e335-6eda-42ab-aaa4-81daeef5b108 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:52.192499 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d413e335-6eda-42ab-aaa4-81daeef5b108 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:52.193000 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d413e335-6eda-42ab-aaa4-81daeef5b108 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:52.344131 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d413e335-6eda-42ab-aaa4-81daeef5b108 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:52.352789 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d413e335-6eda-42ab-aaa4-81daeef5b108 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 200 len: 1375 microversion: 2.1 time: 0.175285 Jun 20 12:37:52.353507 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3269/6442] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:52 2022] GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 1375 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:37:53.370912 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4542c5ab-4b60-4eb8-80e9-553543d02f18 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:53.371991 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4542c5ab-4b60-4eb8-80e9-553543d02f18 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:53.374807 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=30 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:37:53.380744 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4542c5ab-4b60-4eb8-80e9-553543d02f18 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:53.381227 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4542c5ab-4b60-4eb8-80e9-553543d02f18 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:53.382098 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4542c5ab-4b60-4eb8-80e9-553543d02f18 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:53.382546 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4542c5ab-4b60-4eb8-80e9-553543d02f18 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:53.539341 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4542c5ab-4b60-4eb8-80e9-553543d02f18 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:53.551427 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4542c5ab-4b60-4eb8-80e9-553543d02f18 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 200 len: 1375 microversion: 2.1 time: 0.184357 Jun 20 12:37:53.552299 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3174/6443] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:53 2022] GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 1375 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:37:54.570832 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5f4b9974-c4b3-4372-9a05-0643c9f26e4d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:54.571525 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5f4b9974-c4b3-4372-9a05-0643c9f26e4d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:54.578546 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f4b9974-c4b3-4372-9a05-0643c9f26e4d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:54.579003 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f4b9974-c4b3-4372-9a05-0643c9f26e4d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:54.579745 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f4b9974-c4b3-4372-9a05-0643c9f26e4d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:54.580185 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f4b9974-c4b3-4372-9a05-0643c9f26e4d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:54.714694 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5f4b9974-c4b3-4372-9a05-0643c9f26e4d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:54.723179 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5f4b9974-c4b3-4372-9a05-0643c9f26e4d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 200 len: 1375 microversion: 2.1 time: 0.156276 Jun 20 12:37:54.724146 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3270/6444] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:54 2022] GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 1375 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:55.740785 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-df59c7e9-54e2-4b14-9782-bbe48cdeae8c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:55.741436 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-df59c7e9-54e2-4b14-9782-bbe48cdeae8c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:55.748544 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-df59c7e9-54e2-4b14-9782-bbe48cdeae8c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:55.749005 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-df59c7e9-54e2-4b14-9782-bbe48cdeae8c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:55.749779 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-df59c7e9-54e2-4b14-9782-bbe48cdeae8c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:55.750223 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-df59c7e9-54e2-4b14-9782-bbe48cdeae8c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:55.903985 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-df59c7e9-54e2-4b14-9782-bbe48cdeae8c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:55.913492 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-df59c7e9-54e2-4b14-9782-bbe48cdeae8c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 200 len: 1375 microversion: 2.1 time: 0.176861 Jun 20 12:37:55.915226 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3175/6445] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:55 2022] GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 1375 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:56.932059 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-02e63330-082f-4e0e-8d4c-24e53be4e312 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:56.932835 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-02e63330-082f-4e0e-8d4c-24e53be4e312 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:56.939767 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02e63330-082f-4e0e-8d4c-24e53be4e312 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:56.940276 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02e63330-082f-4e0e-8d4c-24e53be4e312 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:56.941082 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02e63330-082f-4e0e-8d4c-24e53be4e312 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:56.941915 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02e63330-082f-4e0e-8d4c-24e53be4e312 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:57.096501 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-02e63330-082f-4e0e-8d4c-24e53be4e312 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:57.104815 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-02e63330-082f-4e0e-8d4c-24e53be4e312 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 200 len: 1375 microversion: 2.1 time: 0.176839 Jun 20 12:37:57.105682 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3271/6446] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:56 2022] GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 1375 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:57.654160 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-183117cd-632f-4854-9bb8-21e161f97f4a req-ed8df2fb-c485-4507-ba5b-0410c1ab5d7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0af54a2-9e17-4e2f-8bfb-adc5db92df84", "name": "network-vif-plugged", "status": "completed", "tag": "a00def3d-8691-4aaf-8384-a396e8abc1fc"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:37:57.673943 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-183117cd-632f-4854-9bb8-21e161f97f4a req-ed8df2fb-c485-4507-ba5b-0410c1ab5d7f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:57.674404 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-183117cd-632f-4854-9bb8-21e161f97f4a req-ed8df2fb-c485-4507-ba5b-0410c1ab5d7f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:57.687650 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-183117cd-632f-4854-9bb8-21e161f97f4a req-ed8df2fb-c485-4507-ba5b-0410c1ab5d7f service nova] Creating event network-vif-plugged:a00def3d-8691-4aaf-8384-a396e8abc1fc for instance b0af54a2-9e17-4e2f-8bfb-adc5db92df84 on n-h1-master-1 Jun 20 12:37:57.693999 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-183117cd-632f-4854-9bb8-21e161f97f4a req-ed8df2fb-c485-4507-ba5b-0410c1ab5d7f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043352 Jun 20 12:37:57.694944 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3176/6447] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:37:58.122708 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dd84ce5d-1500-480f-a2bb-4e6ac13a55fa tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:58.123365 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dd84ce5d-1500-480f-a2bb-4e6ac13a55fa tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:58.131406 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd84ce5d-1500-480f-a2bb-4e6ac13a55fa tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:58.131948 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd84ce5d-1500-480f-a2bb-4e6ac13a55fa tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:58.133031 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd84ce5d-1500-480f-a2bb-4e6ac13a55fa tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:58.133523 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd84ce5d-1500-480f-a2bb-4e6ac13a55fa tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:58.274159 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dd84ce5d-1500-480f-a2bb-4e6ac13a55fa tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:58.283118 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dd84ce5d-1500-480f-a2bb-4e6ac13a55fa tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 200 len: 1375 microversion: 2.1 time: 0.164605 Jun 20 12:37:58.283737 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3272/6448] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:58 2022] GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 1375 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:59.303231 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-823ac9f5-51a1-4e60-9722-5d5c91ab9ef3 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:59.303953 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-823ac9f5-51a1-4e60-9722-5d5c91ab9ef3 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:59.310942 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-823ac9f5-51a1-4e60-9722-5d5c91ab9ef3 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:59.311413 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-823ac9f5-51a1-4e60-9722-5d5c91ab9ef3 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:59.312238 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-823ac9f5-51a1-4e60-9722-5d5c91ab9ef3 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:59.312750 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-823ac9f5-51a1-4e60-9722-5d5c91ab9ef3 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:59.466681 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-823ac9f5-51a1-4e60-9722-5d5c91ab9ef3 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:59.483352 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-823ac9f5-51a1-4e60-9722-5d5c91ab9ef3 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 200 len: 1561 microversion: 2.1 time: 0.185725 Jun 20 12:37:59.488255 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3177/6449] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:59 2022] GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 1561 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:37:59.500795 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a0ab86e5-054e-415e-a35d-1c23eac7d2af tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:59.501654 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a0ab86e5-054e-415e-a35d-1c23eac7d2af tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:59.509425 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a0ab86e5-054e-415e-a35d-1c23eac7d2af tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:59.509884 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a0ab86e5-054e-415e-a35d-1c23eac7d2af tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:59.510663 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a0ab86e5-054e-415e-a35d-1c23eac7d2af tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:59.511164 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a0ab86e5-054e-415e-a35d-1c23eac7d2af tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:59.646354 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a0ab86e5-054e-415e-a35d-1c23eac7d2af tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:37:59.654183 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a0ab86e5-054e-415e-a35d-1c23eac7d2af tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 200 len: 1561 microversion: 2.1 time: 0.157271 Jun 20 12:37:59.654975 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3273/6450] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:59 2022] GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:37:59.735791 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a32057b6-4c63-40e6-af45-a3ecd007f344 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:59.736389 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a32057b6-4c63-40e6-af45-a3ecd007f344 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:59.742610 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a32057b6-4c63-40e6-af45-a3ecd007f344 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:59.743064 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a32057b6-4c63-40e6-af45-a3ecd007f344 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:59.743850 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a32057b6-4c63-40e6-af45-a3ecd007f344 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:59.744334 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a32057b6-4c63-40e6-af45-a3ecd007f344 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:59.774947 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a32057b6-4c63-40e6-af45-a3ecd007f344 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:37:59.860908 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a32057b6-4c63-40e6-af45-a3ecd007f344 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 204 len: 0 microversion: 2.1 time: 0.128617 Jun 20 12:37:59.861507 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3178/6451] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:37:59 2022] DELETE /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:37:59.869888 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bff46001-4873-4f75-b819-dc9ccfc6f709 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:37:59.870708 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bff46001-4873-4f75-b819-dc9ccfc6f709 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:37:59.877019 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bff46001-4873-4f75-b819-dc9ccfc6f709 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:59.877475 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bff46001-4873-4f75-b819-dc9ccfc6f709 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:37:59.878244 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bff46001-4873-4f75-b819-dc9ccfc6f709 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:37:59.878972 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bff46001-4873-4f75-b819-dc9ccfc6f709 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:00.029700 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bff46001-4873-4f75-b819-dc9ccfc6f709 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:38:00.040704 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bff46001-4873-4f75-b819-dc9ccfc6f709 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 200 len: 1567 microversion: 2.1 time: 0.174370 Jun 20 12:38:00.041328 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3274/6452] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:37:59 2022] GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:38:01.060922 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-586b7d87-60ef-42eb-a955-faad5a11dd49 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:01.063274 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-586b7d87-60ef-42eb-a955-faad5a11dd49 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:01.072291 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-586b7d87-60ef-42eb-a955-faad5a11dd49 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:01.072742 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-586b7d87-60ef-42eb-a955-faad5a11dd49 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:01.073549 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-586b7d87-60ef-42eb-a955-faad5a11dd49 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:01.073994 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-586b7d87-60ef-42eb-a955-faad5a11dd49 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:01.225970 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-586b7d87-60ef-42eb-a955-faad5a11dd49 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:38:01.235009 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-586b7d87-60ef-42eb-a955-faad5a11dd49 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 200 len: 1567 microversion: 2.1 time: 0.179162 Jun 20 12:38:01.235735 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3179/6453] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:01 2022] GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:38:02.125461 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-4f6d7eb1-8d45-4e65-9775-d1704a7a4478 req-a6f582d0-e233-41a8-ab19-575d029c08f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0af54a2-9e17-4e2f-8bfb-adc5db92df84", "name": "network-vif-deleted", "tag": "a00def3d-8691-4aaf-8384-a396e8abc1fc"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:38:02.136345 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-4f6d7eb1-8d45-4e65-9775-d1704a7a4478 req-a6f582d0-e233-41a8-ab19-575d029c08f8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:02.137141 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-4f6d7eb1-8d45-4e65-9775-d1704a7a4478 req-a6f582d0-e233-41a8-ab19-575d029c08f8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:02.152534 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-4f6d7eb1-8d45-4e65-9775-d1704a7a4478 req-a6f582d0-e233-41a8-ab19-575d029c08f8 service nova] Creating event network-vif-deleted:a00def3d-8691-4aaf-8384-a396e8abc1fc for instance b0af54a2-9e17-4e2f-8bfb-adc5db92df84 on n-h1-master-1 Jun 20 12:38:02.159280 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-4f6d7eb1-8d45-4e65-9775-d1704a7a4478 req-a6f582d0-e233-41a8-ab19-575d029c08f8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.277544 Jun 20 12:38:02.159952 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3275/6454] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:38:02.253499 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a4d35435-7478-41de-8f32-b8cdbbb81323 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:02.254881 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a4d35435-7478-41de-8f32-b8cdbbb81323 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:02.267751 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a4d35435-7478-41de-8f32-b8cdbbb81323 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:02.268261 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a4d35435-7478-41de-8f32-b8cdbbb81323 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:02.269155 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a4d35435-7478-41de-8f32-b8cdbbb81323 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:02.269827 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a4d35435-7478-41de-8f32-b8cdbbb81323 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:02.363723 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a4d35435-7478-41de-8f32-b8cdbbb81323 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:38:02.374432 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a4d35435-7478-41de-8f32-b8cdbbb81323 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 200 len: 1360 microversion: 2.1 time: 0.124979 Jun 20 12:38:02.375039 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3180/6455] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:02 2022] GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 1360 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:38:03.403691 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fe4aafdc-4e3c-44b6-9801-fa7c863da5a5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:03.406149 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fe4aafdc-4e3c-44b6-9801-fa7c863da5a5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:03.416833 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fe4aafdc-4e3c-44b6-9801-fa7c863da5a5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:03.417974 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fe4aafdc-4e3c-44b6-9801-fa7c863da5a5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:03.419179 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fe4aafdc-4e3c-44b6-9801-fa7c863da5a5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:03.420101 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fe4aafdc-4e3c-44b6-9801-fa7c863da5a5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:03.522296 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fe4aafdc-4e3c-44b6-9801-fa7c863da5a5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:38:03.536908 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fe4aafdc-4e3c-44b6-9801-fa7c863da5a5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 200 len: 1360 microversion: 2.1 time: 0.141738 Jun 20 12:38:03.537707 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3276/6456] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:03 2022] GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 1360 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:38:04.557403 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f88c61a0-96ee-4a19-b043-4878067e8eea tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:04.558341 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f88c61a0-96ee-4a19-b043-4878067e8eea tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:04.565896 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f88c61a0-96ee-4a19-b043-4878067e8eea tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:04.566444 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f88c61a0-96ee-4a19-b043-4878067e8eea tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:04.567424 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f88c61a0-96ee-4a19-b043-4878067e8eea tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:04.567949 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f88c61a0-96ee-4a19-b043-4878067e8eea tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:04.635147 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f88c61a0-96ee-4a19-b043-4878067e8eea tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:38:04.643568 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f88c61a0-96ee-4a19-b043-4878067e8eea tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 200 len: 1360 microversion: 2.1 time: 0.090067 Jun 20 12:38:04.653184 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3181/6457] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:04 2022] GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 1360 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:38:05.660510 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d00e8e0a-3824-4608-b70e-9552c99d1bed tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:05.661282 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d00e8e0a-3824-4608-b70e-9552c99d1bed tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:05.669088 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d00e8e0a-3824-4608-b70e-9552c99d1bed tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:05.669708 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d00e8e0a-3824-4608-b70e-9552c99d1bed tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:05.670513 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d00e8e0a-3824-4608-b70e-9552c99d1bed tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:05.670955 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d00e8e0a-3824-4608-b70e-9552c99d1bed tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:05.753159 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d00e8e0a-3824-4608-b70e-9552c99d1bed tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:38:05.761399 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d00e8e0a-3824-4608-b70e-9552c99d1bed tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 200 len: 1360 microversion: 2.1 time: 0.105066 Jun 20 12:38:05.762009 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3277/6458] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:05 2022] GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 1360 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:38:06.779572 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-593c0da4-6c80-4819-8b36-db341c06c07d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:06.780958 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-593c0da4-6c80-4819-8b36-db341c06c07d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:06.791321 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-593c0da4-6c80-4819-8b36-db341c06c07d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:06.792808 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-593c0da4-6c80-4819-8b36-db341c06c07d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:06.793720 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-593c0da4-6c80-4819-8b36-db341c06c07d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:06.794288 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-593c0da4-6c80-4819-8b36-db341c06c07d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:06.832788 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-593c0da4-6c80-4819-8b36-db341c06c07d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:06.833404 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-593c0da4-6c80-4819-8b36-db341c06c07d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:06.834151 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-593c0da4-6c80-4819-8b36-db341c06c07d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lazy-loading 'fault' on Instance uuid b0af54a2-9e17-4e2f-8bfb-adc5db92df84 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:38:06.887995 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-593c0da4-6c80-4819-8b36-db341c06c07d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:38:06.897010 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-593c0da4-6c80-4819-8b36-db341c06c07d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 200 len: 1365 microversion: 2.1 time: 0.121691 Jun 20 12:38:06.897908 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3182/6459] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:06 2022] GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 1365 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:38:07.915170 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6d1534f3-cd5b-46df-a542-6f490399a9f2 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:07.915869 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6d1534f3-cd5b-46df-a542-6f490399a9f2 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:07.923038 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6d1534f3-cd5b-46df-a542-6f490399a9f2 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:07.923485 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6d1534f3-cd5b-46df-a542-6f490399a9f2 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:07.924250 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6d1534f3-cd5b-46df-a542-6f490399a9f2 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:07.924694 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6d1534f3-cd5b-46df-a542-6f490399a9f2 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:07.939565 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-6d1534f3-cd5b-46df-a542-6f490399a9f2 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] HTTP exception thrown: Instance b0af54a2-9e17-4e2f-8bfb-adc5db92df84 could not be found. Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6d1534f3-cd5b-46df-a542-6f490399a9f2 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Request method failure captured: Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 HTTP/1.1 Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGlbodlapeisJn5a0HtwbwcZIYoBmT5AMrWgFKctZEM-c8IEHUY-HIxlKO2btmEhIp6rTchMUsTfBqlVWDOj1EarcMAz1U-zU3gC1LYOn6ihs7mNZ7VuUoyKyfaVYT5-C41dz-fiCbk7B4FysstqCDj9MrkXDGMTtiNF2ZH2AvXNm6I Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 5a9c7bbcc9a149f5b77a89141a306c3e Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-TestVolumeBootPattern-431625802 Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-TestVolumeBootPattern-431625802 Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 5a9c7bbcc9a149f5b77a89141a306c3e Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-TestVolumeBootPattern-431625802 Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-TestVolumeBootPattern-431625802-project Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: fed0afc129364664aed8d8a96f499831 Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-TestVolumeBootPattern-431625802-project Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: exception: Instance b0af54a2-9e17-4e2f-8bfb-adc5db92df84 could not be found. Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'b0af54a2-9e17-4e2f-8bfb-adc5db92df84'} Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0af54a2-9e17-4e2f-8bfb-adc5db92df84 could not be found. Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0af54a2-9e17-4e2f-8bfb-adc5db92df84 could not be found. Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:38:07.941389 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:38:07.945550 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:38:07.945550 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:38:07.945550 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:38:07.945550 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:38:07.945550 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:38:07.945550 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0af54a2-9e17-4e2f-8bfb-adc5db92df84 could not be found. Jun 20 12:38:07.945550 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:38:07.945550 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6d1534f3-cd5b-46df-a542-6f490399a9f2 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Returning 404 to user: Instance b0af54a2-9e17-4e2f-8bfb-adc5db92df84 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:38:07.949307 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6d1534f3-cd5b-46df-a542-6f490399a9f2 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 404 len: 111 microversion: 2.1 time: 0.037976 Jun 20 12:38:07.951461 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3278/6460] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:07 2022] GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:38:12.255176 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3e80d71a-7c75-4d97-b7ce-2785b60cba47 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:12.255768 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3e80d71a-7c75-4d97-b7ce-2785b60cba47 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:12.263024 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3e80d71a-7c75-4d97-b7ce-2785b60cba47 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:12.263494 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3e80d71a-7c75-4d97-b7ce-2785b60cba47 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:12.264395 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3e80d71a-7c75-4d97-b7ce-2785b60cba47 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:12.264845 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3e80d71a-7c75-4d97-b7ce-2785b60cba47 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:12.297033 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3e80d71a-7c75-4d97-b7ce-2785b60cba47 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:38:12.382100 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3e80d71a-7c75-4d97-b7ce-2785b60cba47 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2" status: 204 len: 0 microversion: 2.1 time: 0.131063 Jun 20 12:38:12.383089 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3183/6461] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:38:12 2022] DELETE /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:38:12.391207 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-efbb6689-03c7-4b21-a888-9a2bf21106b0 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:12.391896 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-efbb6689-03c7-4b21-a888-9a2bf21106b0 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:12.400039 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-efbb6689-03c7-4b21-a888-9a2bf21106b0 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:12.400587 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-efbb6689-03c7-4b21-a888-9a2bf21106b0 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:12.401409 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-efbb6689-03c7-4b21-a888-9a2bf21106b0 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:12.401905 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-efbb6689-03c7-4b21-a888-9a2bf21106b0 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:12.545390 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-efbb6689-03c7-4b21-a888-9a2bf21106b0 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:38:12.553398 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-efbb6689-03c7-4b21-a888-9a2bf21106b0 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2" status: 200 len: 1408 microversion: 2.1 time: 0.166289 Jun 20 12:38:12.554114 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3279/6462] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:12 2022] GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:38:13.571733 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4307a93a-db21-4961-8da3-9d6ad63ca8d6 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:13.572503 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4307a93a-db21-4961-8da3-9d6ad63ca8d6 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:13.579546 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4307a93a-db21-4961-8da3-9d6ad63ca8d6 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:13.580020 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4307a93a-db21-4961-8da3-9d6ad63ca8d6 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:13.580843 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4307a93a-db21-4961-8da3-9d6ad63ca8d6 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:13.581606 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4307a93a-db21-4961-8da3-9d6ad63ca8d6 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:13.597577 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:13.721895 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4307a93a-db21-4961-8da3-9d6ad63ca8d6 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:38:13.731527 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4307a93a-db21-4961-8da3-9d6ad63ca8d6 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2" status: 200 len: 1408 microversion: 2.1 time: 0.163926 Jun 20 12:38:13.732589 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3184/6463] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:13 2022] GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:38:14.282395 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-a0083f5d-e2e1-4e33-a9dd-4720a39d8fec req-cd93e611-842b-4baf-b8e9-b6d717a7b649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2", "name": "network-vif-deleted", "tag": "0533e46a-afb9-47fa-9f15-0d53fd1d694d"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:38:14.291563 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-a0083f5d-e2e1-4e33-a9dd-4720a39d8fec req-cd93e611-842b-4baf-b8e9-b6d717a7b649 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:14.292011 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-a0083f5d-e2e1-4e33-a9dd-4720a39d8fec req-cd93e611-842b-4baf-b8e9-b6d717a7b649 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:14.304573 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-a0083f5d-e2e1-4e33-a9dd-4720a39d8fec req-cd93e611-842b-4baf-b8e9-b6d717a7b649 service nova] Creating event network-vif-deleted:0533e46a-afb9-47fa-9f15-0d53fd1d694d for instance 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 on n-h1-master-1 Jun 20 12:38:14.309964 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-a0083f5d-e2e1-4e33-a9dd-4720a39d8fec req-cd93e611-842b-4baf-b8e9-b6d717a7b649 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032541 Jun 20 12:38:14.310532 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3280/6464] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:38:14.750631 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8cdca2b6-a0e1-4487-bb9a-ff7f6e4c43a6 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:14.751251 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8cdca2b6-a0e1-4487-bb9a-ff7f6e4c43a6 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:14.758304 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8cdca2b6-a0e1-4487-bb9a-ff7f6e4c43a6 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:14.758764 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8cdca2b6-a0e1-4487-bb9a-ff7f6e4c43a6 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:14.759532 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8cdca2b6-a0e1-4487-bb9a-ff7f6e4c43a6 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:14.759971 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8cdca2b6-a0e1-4487-bb9a-ff7f6e4c43a6 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:14.828619 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8cdca2b6-a0e1-4487-bb9a-ff7f6e4c43a6 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:38:14.837317 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8cdca2b6-a0e1-4487-bb9a-ff7f6e4c43a6 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2" status: 200 len: 1201 microversion: 2.1 time: 0.090581 Jun 20 12:38:14.838147 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3185/6465] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:14 2022] GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 => generated 1201 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:38:15.856689 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c85e9832-4c7f-4dc9-89dd-b9d8bec1a99a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:15.857403 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c85e9832-4c7f-4dc9-89dd-b9d8bec1a99a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:15.865101 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c85e9832-4c7f-4dc9-89dd-b9d8bec1a99a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:15.865801 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c85e9832-4c7f-4dc9-89dd-b9d8bec1a99a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:15.866786 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c85e9832-4c7f-4dc9-89dd-b9d8bec1a99a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:15.867236 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c85e9832-4c7f-4dc9-89dd-b9d8bec1a99a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:15.870180 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=78 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:15.941323 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c85e9832-4c7f-4dc9-89dd-b9d8bec1a99a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:38:15.951788 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c85e9832-4c7f-4dc9-89dd-b9d8bec1a99a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2" status: 200 len: 1201 microversion: 2.1 time: 0.100123 Jun 20 12:38:15.960939 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3281/6466] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:15 2022] GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 => generated 1201 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:38:16.969309 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d74d8865-695f-4847-808c-82cadd77a70c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:16.969923 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d74d8865-695f-4847-808c-82cadd77a70c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:16.977513 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d74d8865-695f-4847-808c-82cadd77a70c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:16.977970 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d74d8865-695f-4847-808c-82cadd77a70c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:16.978770 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d74d8865-695f-4847-808c-82cadd77a70c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:16.979227 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d74d8865-695f-4847-808c-82cadd77a70c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:17.077652 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d74d8865-695f-4847-808c-82cadd77a70c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:38:17.086686 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d74d8865-695f-4847-808c-82cadd77a70c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2" status: 200 len: 1201 microversion: 2.1 time: 0.121058 Jun 20 12:38:17.088028 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3186/6467] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:16 2022] GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 => generated 1201 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:38:18.107587 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-825f394f-30b5-4613-828a-78b3f1376826 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:18.108388 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-825f394f-30b5-4613-828a-78b3f1376826 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:18.116469 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-825f394f-30b5-4613-828a-78b3f1376826 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:18.116917 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-825f394f-30b5-4613-828a-78b3f1376826 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:18.117712 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-825f394f-30b5-4613-828a-78b3f1376826 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:18.118367 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-825f394f-30b5-4613-828a-78b3f1376826 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:18.189421 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-825f394f-30b5-4613-828a-78b3f1376826 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:38:18.199629 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-825f394f-30b5-4613-828a-78b3f1376826 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2" status: 200 len: 1201 microversion: 2.1 time: 0.096290 Jun 20 12:38:18.200248 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3282/6468] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:18 2022] GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 => generated 1201 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:38:19.218805 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-495a6b6e-7246-4b7b-bef7-ba2695114d15 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:19.219368 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-495a6b6e-7246-4b7b-bef7-ba2695114d15 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:19.227560 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-495a6b6e-7246-4b7b-bef7-ba2695114d15 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:19.228346 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-495a6b6e-7246-4b7b-bef7-ba2695114d15 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:19.229370 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-495a6b6e-7246-4b7b-bef7-ba2695114d15 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:19.229949 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-495a6b6e-7246-4b7b-bef7-ba2695114d15 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:19.245470 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-495a6b6e-7246-4b7b-bef7-ba2695114d15 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] HTTP exception thrown: Instance 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 could not be found. Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-495a6b6e-7246-4b7b-bef7-ba2695114d15 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Request method failure captured: Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 HTTP/1.1 Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGlbodlapeisJn5a0HtwbwcZIYoBmT5AMrWgFKctZEM-c8IEHUY-HIxlKO2btmEhIp6rTchMUsTfBqlVWDOj1EarcMAz1U-zU3gC1LYOn6ihs7mNZ7VuUoyKyfaVYT5-C41dz-fiCbk7B4FysstqCDj9MrkXDGMTtiNF2ZH2AvXNm6I Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 5a9c7bbcc9a149f5b77a89141a306c3e Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-TestVolumeBootPattern-431625802 Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-TestVolumeBootPattern-431625802 Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 5a9c7bbcc9a149f5b77a89141a306c3e Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-TestVolumeBootPattern-431625802 Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-TestVolumeBootPattern-431625802-project Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: fed0afc129364664aed8d8a96f499831 Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-TestVolumeBootPattern-431625802-project Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 could not be found. Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2'} Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 could not be found. Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 could not be found. Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:38:19.247186 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:38:19.251252 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:38:19.251252 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:38:19.251252 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:38:19.251252 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:38:19.251252 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:38:19.251252 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 could not be found. Jun 20 12:38:19.251252 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:38:19.251252 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-495a6b6e-7246-4b7b-bef7-ba2695114d15 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Returning 404 to user: Instance 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:38:19.251252 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-495a6b6e-7246-4b7b-bef7-ba2695114d15 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2" status: 404 len: 111 microversion: 2.1 time: 0.034545 Jun 20 12:38:19.251252 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3187/6469] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:19 2022] GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:38:22.459797 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-918b5e0b-bb02-4afd-bd96-229d4d55e80f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:22.461038 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-918b5e0b-bb02-4afd-bd96-229d4d55e80f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:22.463648 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=28 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:22.469756 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-918b5e0b-bb02-4afd-bd96-229d4d55e80f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:22.470298 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-918b5e0b-bb02-4afd-bd96-229d4d55e80f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:22.471145 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-918b5e0b-bb02-4afd-bd96-229d4d55e80f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:22.471667 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-918b5e0b-bb02-4afd-bd96-229d4d55e80f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:22.486743 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-918b5e0b-bb02-4afd-bd96-229d4d55e80f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] HTTP exception thrown: Instance b0af54a2-9e17-4e2f-8bfb-adc5db92df84 could not be found. Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-918b5e0b-bb02-4afd-bd96-229d4d55e80f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Request method failure captured: Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 HTTP/1.1 Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGlbodlapeisJn5a0HtwbwcZIYoBmT5AMrWgFKctZEM-c8IEHUY-HIxlKO2btmEhIp6rTchMUsTfBqlVWDOj1EarcMAz1U-zU3gC1LYOn6ihs7mNZ7VuUoyKyfaVYT5-C41dz-fiCbk7B4FysstqCDj9MrkXDGMTtiNF2ZH2AvXNm6I Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 5a9c7bbcc9a149f5b77a89141a306c3e Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-TestVolumeBootPattern-431625802 Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-TestVolumeBootPattern-431625802 Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 5a9c7bbcc9a149f5b77a89141a306c3e Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-TestVolumeBootPattern-431625802 Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-TestVolumeBootPattern-431625802-project Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: fed0afc129364664aed8d8a96f499831 Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-TestVolumeBootPattern-431625802-project Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: exception: Instance b0af54a2-9e17-4e2f-8bfb-adc5db92df84 could not be found. Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'b0af54a2-9e17-4e2f-8bfb-adc5db92df84'} Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0af54a2-9e17-4e2f-8bfb-adc5db92df84 could not be found. Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:38:22.489275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:38:22.496782 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0af54a2-9e17-4e2f-8bfb-adc5db92df84 could not be found. Jun 20 12:38:22.496782 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:38:22.496782 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:38:22.496782 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:38:22.496782 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:38:22.496782 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:38:22.496782 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:38:22.496782 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:38:22.496782 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:38:22.496782 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0af54a2-9e17-4e2f-8bfb-adc5db92df84 could not be found. Jun 20 12:38:22.496782 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:38:22.496782 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-918b5e0b-bb02-4afd-bd96-229d4d55e80f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Returning 404 to user: Instance b0af54a2-9e17-4e2f-8bfb-adc5db92df84 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:38:22.496782 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-918b5e0b-bb02-4afd-bd96-229d4d55e80f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 404 len: 111 microversion: 2.1 time: 0.036119 Jun 20 12:38:22.496782 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3283/6470] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:38:22 2022] DELETE /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:38:22.501771 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-785713c6-8583-47d2-8169-fb36ce83fc6e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:22.502409 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-785713c6-8583-47d2-8169-fb36ce83fc6e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: b0af54a2-9e17-4e2f-8bfb-adc5db92df84] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:22.510105 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-785713c6-8583-47d2-8169-fb36ce83fc6e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:22.510575 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-785713c6-8583-47d2-8169-fb36ce83fc6e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:22.511366 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-785713c6-8583-47d2-8169-fb36ce83fc6e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:22.511822 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-785713c6-8583-47d2-8169-fb36ce83fc6e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:22.526809 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-785713c6-8583-47d2-8169-fb36ce83fc6e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] HTTP exception thrown: Instance b0af54a2-9e17-4e2f-8bfb-adc5db92df84 could not be found. Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-785713c6-8583-47d2-8169-fb36ce83fc6e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Request method failure captured: Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 HTTP/1.1 Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGlbodlapeisJn5a0HtwbwcZIYoBmT5AMrWgFKctZEM-c8IEHUY-HIxlKO2btmEhIp6rTchMUsTfBqlVWDOj1EarcMAz1U-zU3gC1LYOn6ihs7mNZ7VuUoyKyfaVYT5-C41dz-fiCbk7B4FysstqCDj9MrkXDGMTtiNF2ZH2AvXNm6I Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 5a9c7bbcc9a149f5b77a89141a306c3e Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-TestVolumeBootPattern-431625802 Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-TestVolumeBootPattern-431625802 Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 5a9c7bbcc9a149f5b77a89141a306c3e Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-TestVolumeBootPattern-431625802 Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-TestVolumeBootPattern-431625802-project Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: fed0afc129364664aed8d8a96f499831 Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-TestVolumeBootPattern-431625802-project Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: exception: Instance b0af54a2-9e17-4e2f-8bfb-adc5db92df84 could not be found. Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'b0af54a2-9e17-4e2f-8bfb-adc5db92df84'} Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0af54a2-9e17-4e2f-8bfb-adc5db92df84 could not be found. Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0af54a2-9e17-4e2f-8bfb-adc5db92df84 could not be found. Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:38:22.528761 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:38:22.533780 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:38:22.533780 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:38:22.533780 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:38:22.533780 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:38:22.533780 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:38:22.533780 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0af54a2-9e17-4e2f-8bfb-adc5db92df84 could not be found. Jun 20 12:38:22.533780 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:38:22.535265 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-785713c6-8583-47d2-8169-fb36ce83fc6e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Returning 404 to user: Instance b0af54a2-9e17-4e2f-8bfb-adc5db92df84 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:38:22.536538 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-785713c6-8583-47d2-8169-fb36ce83fc6e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84" status: 404 len: 111 microversion: 2.1 time: 0.038502 Jun 20 12:38:22.537424 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3188/6471] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:22 2022] GET /compute/v2.1/servers/b0af54a2-9e17-4e2f-8bfb-adc5db92df84 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:38:23.059858 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-70d5905c-f582-4cd6-ac07-e771a2a9fe1d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:23.060412 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-70d5905c-f582-4cd6-ac07-e771a2a9fe1d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:23.067872 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-70d5905c-f582-4cd6-ac07-e771a2a9fe1d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:23.068444 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-70d5905c-f582-4cd6-ac07-e771a2a9fe1d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:23.069271 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-70d5905c-f582-4cd6-ac07-e771a2a9fe1d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:23.069712 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-70d5905c-f582-4cd6-ac07-e771a2a9fe1d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:23.084759 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-70d5905c-f582-4cd6-ac07-e771a2a9fe1d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] HTTP exception thrown: Instance 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 could not be found. Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-70d5905c-f582-4cd6-ac07-e771a2a9fe1d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Request method failure captured: Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 HTTP/1.1 Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGlbodlapeisJn5a0HtwbwcZIYoBmT5AMrWgFKctZEM-c8IEHUY-HIxlKO2btmEhIp6rTchMUsTfBqlVWDOj1EarcMAz1U-zU3gC1LYOn6ihs7mNZ7VuUoyKyfaVYT5-C41dz-fiCbk7B4FysstqCDj9MrkXDGMTtiNF2ZH2AvXNm6I Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 5a9c7bbcc9a149f5b77a89141a306c3e Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-TestVolumeBootPattern-431625802 Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-TestVolumeBootPattern-431625802 Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 5a9c7bbcc9a149f5b77a89141a306c3e Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-TestVolumeBootPattern-431625802 Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-TestVolumeBootPattern-431625802-project Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: fed0afc129364664aed8d8a96f499831 Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-TestVolumeBootPattern-431625802-project Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 could not be found. Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2'} Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 could not be found. Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:38:23.086358 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:38:23.093426 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 could not be found. Jun 20 12:38:23.093426 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:38:23.093426 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:38:23.093426 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:38:23.093426 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:38:23.093426 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:38:23.093426 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:38:23.093426 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:38:23.093426 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:38:23.093426 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 could not be found. Jun 20 12:38:23.093426 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:38:23.093426 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-70d5905c-f582-4cd6-ac07-e771a2a9fe1d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Returning 404 to user: Instance 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:38:23.093426 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-70d5905c-f582-4cd6-ac07-e771a2a9fe1d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2" status: 404 len: 111 microversion: 2.1 time: 0.031993 Jun 20 12:38:23.093426 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3284/6472] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:38:23 2022] DELETE /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:38:23.097310 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6460f7c6-5e33-463b-b12f-6f310b4ec53d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:23.097897 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6460f7c6-5e33-463b-b12f-6f310b4ec53d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:23.104630 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6460f7c6-5e33-463b-b12f-6f310b4ec53d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:23.105100 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6460f7c6-5e33-463b-b12f-6f310b4ec53d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:23.105897 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6460f7c6-5e33-463b-b12f-6f310b4ec53d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:23.106352 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6460f7c6-5e33-463b-b12f-6f310b4ec53d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:23.121499 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-6460f7c6-5e33-463b-b12f-6f310b4ec53d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] HTTP exception thrown: Instance 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 could not be found. Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6460f7c6-5e33-463b-b12f-6f310b4ec53d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Request method failure captured: Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 HTTP/1.1 Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGlbodlapeisJn5a0HtwbwcZIYoBmT5AMrWgFKctZEM-c8IEHUY-HIxlKO2btmEhIp6rTchMUsTfBqlVWDOj1EarcMAz1U-zU3gC1LYOn6ihs7mNZ7VuUoyKyfaVYT5-C41dz-fiCbk7B4FysstqCDj9MrkXDGMTtiNF2ZH2AvXNm6I Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 5a9c7bbcc9a149f5b77a89141a306c3e Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-TestVolumeBootPattern-431625802 Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-TestVolumeBootPattern-431625802 Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 5a9c7bbcc9a149f5b77a89141a306c3e Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-TestVolumeBootPattern-431625802 Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-TestVolumeBootPattern-431625802-project Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: fed0afc129364664aed8d8a96f499831 Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-TestVolumeBootPattern-431625802-project Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 could not be found. Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2'} Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 could not be found. Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 could not be found. Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:38:23.123243 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:38:23.127642 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:38:23.127642 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:38:23.127642 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:38:23.127642 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:38:23.127642 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:38:23.127642 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 could not be found. Jun 20 12:38:23.127642 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:38:23.127642 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6460f7c6-5e33-463b-b12f-6f310b4ec53d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Returning 404 to user: Instance 7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:38:23.127642 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6460f7c6-5e33-463b-b12f-6f310b4ec53d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2" status: 404 len: 111 microversion: 2.1 time: 0.031838 Jun 20 12:38:23.127642 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3189/6473] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:23 2022] GET /compute/v2.1/servers/7fef7a4b-5d99-40c2-a1cf-14f5a960e4c2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:38:23.209448 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4beb9070-220b-42c7-967e-54da6ab5ed73 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Action: 'create', calling method: .version_select at 0x7f60721a1ee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-997416587", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+L8FGcRIlcnrWf+rFOr5kL+BMcTlJh0/cuT7UxwZJwFpN1fmj5TYysjcRl5twkphzGuQ66zpkNMcNmddHmusmcfxtvh8E3brtw/sfmY4muzjLHrOrqdBLugOlAaOQCCA=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:38:23.224765 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-4beb9070-220b-42c7-967e-54da6ab5ed73 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Getting quotas for project 5a9c7bbcc9a149f5b77a89141a306c3e. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:38:23.230317 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-4beb9070-220b-42c7-967e-54da6ab5ed73 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Getting quotas for user fed0afc129364664aed8d8a96f499831 and project 5a9c7bbcc9a149f5b77a89141a306c3e. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:38:23.263598 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4beb9070-220b-42c7-967e-54da6ab5ed73 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.057986 Jun 20 12:38:23.264244 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3285/6474] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 12:38:23 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:38:28.565046 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d120a2ec-1bc6-44d1-9345-0fb04e0d2f51 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-717020006", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "672a7f33-6fd0-4c9b-b1fa-282f7ce581e1"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:38:28.579068 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:28.624912 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-d120a2ec-1bc6-44d1-9345-0fb04e0d2f51 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] validate_networks() for [('672a7f33-6fd0-4c9b-b1fa-282f7ce581e1', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:38:29.017172 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-d120a2ec-1bc6-44d1-9345-0fb04e0d2f51 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:38:29.017606 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-d120a2ec-1bc6-44d1-9345-0fb04e0d2f51 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:38:29.018122 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-d120a2ec-1bc6-44d1-9345-0fb04e0d2f51 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:38:29.018545 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-d120a2ec-1bc6-44d1-9345-0fb04e0d2f51 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:38:29.018971 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-d120a2ec-1bc6-44d1-9345-0fb04e0d2f51 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:38:29.029973 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d120a2ec-1bc6-44d1-9345-0fb04e0d2f51 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:29.030432 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d120a2ec-1bc6-44d1-9345-0fb04e0d2f51 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:29.031576 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d120a2ec-1bc6-44d1-9345-0fb04e0d2f51 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:29.032013 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d120a2ec-1bc6-44d1-9345-0fb04e0d2f51 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:29.051585 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-d120a2ec-1bc6-44d1-9345-0fb04e0d2f51 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Getting quotas for project 3d7f5f5f354946d391db10d490ca8764. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:38:29.057973 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-d120a2ec-1bc6-44d1-9345-0fb04e0d2f51 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Getting quotas for user 0248fe9cf0934faaaa1059c0a67cdccf and project 3d7f5f5f354946d391db10d490ca8764. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:38:29.072148 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d120a2ec-1bc6-44d1-9345-0fb04e0d2f51 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:38:29.074587 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d120a2ec-1bc6-44d1-9345-0fb04e0d2f51 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] [instance: 9400896f-d98f-4e50-896b-632b7cd9642f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:38:29.123330 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d120a2ec-1bc6-44d1-9345-0fb04e0d2f51 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.562068 Jun 20 12:38:29.129224 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3190/6475] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:38:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:38:29.134402 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9dfa593c-a50c-4ad5-8edf-f354d7cab708 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:29.134982 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9dfa593c-a50c-4ad5-8edf-f354d7cab708 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] [instance: 9400896f-d98f-4e50-896b-632b7cd9642f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:29.201252 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9dfa593c-a50c-4ad5-8edf-f354d7cab708 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248fe9cf0934faaaa1059c0a67cdccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f5f5f354946d391db10d490ca8764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:38:29.213856 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9dfa593c-a50c-4ad5-8edf-f354d7cab708 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] 10.222.0.27 "GET /compute/v2.1/servers/9400896f-d98f-4e50-896b-632b7cd9642f" status: 200 len: 1218 microversion: 2.1 time: 0.079919 Jun 20 12:38:29.213856 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3286/6476] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:29 2022] GET /compute/v2.1/servers/9400896f-d98f-4e50-896b-632b7cd9642f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:38:30.228260 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-48d28add-0e03-4c2c-9164-53e9d35883d6 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:30.229111 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-48d28add-0e03-4c2c-9164-53e9d35883d6 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] [instance: 9400896f-d98f-4e50-896b-632b7cd9642f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:30.248849 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-48d28add-0e03-4c2c-9164-53e9d35883d6 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:30.249324 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-48d28add-0e03-4c2c-9164-53e9d35883d6 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:30.250130 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-48d28add-0e03-4c2c-9164-53e9d35883d6 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:30.250576 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-48d28add-0e03-4c2c-9164-53e9d35883d6 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:30.338285 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-48d28add-0e03-4c2c-9164-53e9d35883d6 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248fe9cf0934faaaa1059c0a67cdccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f5f5f354946d391db10d490ca8764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:38:30.349312 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-48d28add-0e03-4c2c-9164-53e9d35883d6 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] 10.222.0.27 "GET /compute/v2.1/servers/9400896f-d98f-4e50-896b-632b7cd9642f" status: 200 len: 1276 microversion: 2.1 time: 0.125757 Jun 20 12:38:30.350072 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3191/6477] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:30 2022] GET /compute/v2.1/servers/9400896f-d98f-4e50-896b-632b7cd9642f => generated 1276 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:38:31.367723 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-346096d2-243e-4e3a-8628-6be6f9ee4482 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:31.369028 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-346096d2-243e-4e3a-8628-6be6f9ee4482 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] [instance: 9400896f-d98f-4e50-896b-632b7cd9642f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:31.377342 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-346096d2-243e-4e3a-8628-6be6f9ee4482 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:31.378052 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-346096d2-243e-4e3a-8628-6be6f9ee4482 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:31.379343 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-346096d2-243e-4e3a-8628-6be6f9ee4482 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:31.381340 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-346096d2-243e-4e3a-8628-6be6f9ee4482 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:31.533648 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-346096d2-243e-4e3a-8628-6be6f9ee4482 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248fe9cf0934faaaa1059c0a67cdccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f5f5f354946d391db10d490ca8764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:38:31.544989 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-346096d2-243e-4e3a-8628-6be6f9ee4482 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] 10.222.0.27 "GET /compute/v2.1/servers/9400896f-d98f-4e50-896b-632b7cd9642f" status: 200 len: 1318 microversion: 2.1 time: 0.181599 Jun 20 12:38:31.545729 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3287/6478] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:31 2022] GET /compute/v2.1/servers/9400896f-d98f-4e50-896b-632b7cd9642f => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:38:31.598457 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-431e0784-629f-4bc7-83d3-fdbc8bd657f9 req-51b34652-a0ad-4833-b6b1-7441e9975e44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9400896f-d98f-4e50-896b-632b7cd9642f", "tag": "e05da339-4d14-4b4a-be8a-312bcc92a82f"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:38:31.610758 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-431e0784-629f-4bc7-83d3-fdbc8bd657f9 req-51b34652-a0ad-4833-b6b1-7441e9975e44 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:31.611501 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-431e0784-629f-4bc7-83d3-fdbc8bd657f9 req-51b34652-a0ad-4833-b6b1-7441e9975e44 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:31.632550 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-431e0784-629f-4bc7-83d3-fdbc8bd657f9 req-51b34652-a0ad-4833-b6b1-7441e9975e44 service nova] Creating event network-changed:e05da339-4d14-4b4a-be8a-312bcc92a82f for instance 9400896f-d98f-4e50-896b-632b7cd9642f on n-h1-master-1 Jun 20 12:38:31.638630 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-431e0784-629f-4bc7-83d3-fdbc8bd657f9 req-51b34652-a0ad-4833-b6b1-7441e9975e44 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045113 Jun 20 12:38:31.639882 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3192/6479] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:38:32.562961 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a2c4fc81-d2a6-4884-935f-c5197135965c tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:32.563595 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a2c4fc81-d2a6-4884-935f-c5197135965c tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] [instance: 9400896f-d98f-4e50-896b-632b7cd9642f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:32.571703 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a2c4fc81-d2a6-4884-935f-c5197135965c tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:32.572151 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a2c4fc81-d2a6-4884-935f-c5197135965c tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:32.572966 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a2c4fc81-d2a6-4884-935f-c5197135965c tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:32.573392 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a2c4fc81-d2a6-4884-935f-c5197135965c tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:32.721061 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a2c4fc81-d2a6-4884-935f-c5197135965c tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248fe9cf0934faaaa1059c0a67cdccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f5f5f354946d391db10d490ca8764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:38:32.729141 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a2c4fc81-d2a6-4884-935f-c5197135965c tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] 10.222.0.27 "GET /compute/v2.1/servers/9400896f-d98f-4e50-896b-632b7cd9642f" status: 200 len: 1318 microversion: 2.1 time: 0.170301 Jun 20 12:38:32.729745 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3288/6480] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:32 2022] GET /compute/v2.1/servers/9400896f-d98f-4e50-896b-632b7cd9642f => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:38:33.745789 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5ccf24b5-78ef-4e7f-a2cb-8fc3c6cfcd05 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:33.747210 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5ccf24b5-78ef-4e7f-a2cb-8fc3c6cfcd05 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] [instance: 9400896f-d98f-4e50-896b-632b7cd9642f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:33.755074 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5ccf24b5-78ef-4e7f-a2cb-8fc3c6cfcd05 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:33.755449 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5ccf24b5-78ef-4e7f-a2cb-8fc3c6cfcd05 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:33.756328 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5ccf24b5-78ef-4e7f-a2cb-8fc3c6cfcd05 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:33.756752 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5ccf24b5-78ef-4e7f-a2cb-8fc3c6cfcd05 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:33.946446 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5ccf24b5-78ef-4e7f-a2cb-8fc3c6cfcd05 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248fe9cf0934faaaa1059c0a67cdccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f5f5f354946d391db10d490ca8764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:38:33.954385 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5ccf24b5-78ef-4e7f-a2cb-8fc3c6cfcd05 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] 10.222.0.27 "GET /compute/v2.1/servers/9400896f-d98f-4e50-896b-632b7cd9642f" status: 200 len: 1318 microversion: 2.1 time: 0.212765 Jun 20 12:38:33.955313 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3193/6481] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:33 2022] GET /compute/v2.1/servers/9400896f-d98f-4e50-896b-632b7cd9642f => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:38:34.971976 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d4ef3a40-e6e9-4b05-8e6e-2f135ca44388 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:34.972715 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d4ef3a40-e6e9-4b05-8e6e-2f135ca44388 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] [instance: 9400896f-d98f-4e50-896b-632b7cd9642f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:34.980463 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d4ef3a40-e6e9-4b05-8e6e-2f135ca44388 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:34.981012 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d4ef3a40-e6e9-4b05-8e6e-2f135ca44388 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:34.981868 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d4ef3a40-e6e9-4b05-8e6e-2f135ca44388 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:34.982383 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d4ef3a40-e6e9-4b05-8e6e-2f135ca44388 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:35.127652 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d4ef3a40-e6e9-4b05-8e6e-2f135ca44388 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248fe9cf0934faaaa1059c0a67cdccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f5f5f354946d391db10d490ca8764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:38:35.135761 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d4ef3a40-e6e9-4b05-8e6e-2f135ca44388 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] 10.222.0.27 "GET /compute/v2.1/servers/9400896f-d98f-4e50-896b-632b7cd9642f" status: 200 len: 1318 microversion: 2.1 time: 0.167840 Jun 20 12:38:35.136585 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3289/6482] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:34 2022] GET /compute/v2.1/servers/9400896f-d98f-4e50-896b-632b7cd9642f => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:38:35.290881 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ad2a7515-558b-4be4-ba63-a2ab7d320fdd tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:35.291488 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ad2a7515-558b-4be4-ba63-a2ab7d320fdd tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 901af3d1-ee82-487d-ba43-06eea301b2d4] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:35.299289 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ad2a7515-558b-4be4-ba63-a2ab7d320fdd tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:35.299759 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ad2a7515-558b-4be4-ba63-a2ab7d320fdd tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:35.300587 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ad2a7515-558b-4be4-ba63-a2ab7d320fdd tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:35.301042 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ad2a7515-558b-4be4-ba63-a2ab7d320fdd tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:35.326649 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ad2a7515-558b-4be4-ba63-a2ab7d320fdd tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4/ips" status: 200 len: 150 microversion: 2.1 time: 0.039882 Jun 20 12:38:35.332559 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3194/6483] 10.222.0.27 () {58 vars in 1247 bytes} [Mon Jun 20 12:38:35 2022] GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:38:36.152882 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a7c11fd0-ba7c-4d9f-8ea0-b718e2ef5c3c tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:36.154142 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a7c11fd0-ba7c-4d9f-8ea0-b718e2ef5c3c tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] [instance: 9400896f-d98f-4e50-896b-632b7cd9642f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:36.161860 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a7c11fd0-ba7c-4d9f-8ea0-b718e2ef5c3c tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:36.162642 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a7c11fd0-ba7c-4d9f-8ea0-b718e2ef5c3c tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:36.163605 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a7c11fd0-ba7c-4d9f-8ea0-b718e2ef5c3c tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:36.164228 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a7c11fd0-ba7c-4d9f-8ea0-b718e2ef5c3c tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:36.338212 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a7c11fd0-ba7c-4d9f-8ea0-b718e2ef5c3c tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248fe9cf0934faaaa1059c0a67cdccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f5f5f354946d391db10d490ca8764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:38:36.348489 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a7c11fd0-ba7c-4d9f-8ea0-b718e2ef5c3c tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] 10.222.0.27 "GET /compute/v2.1/servers/9400896f-d98f-4e50-896b-632b7cd9642f" status: 200 len: 1318 microversion: 2.1 time: 0.199141 Jun 20 12:38:36.349948 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3290/6484] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:36 2022] GET /compute/v2.1/servers/9400896f-d98f-4e50-896b-632b7cd9642f => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:38:36.717423 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-55ce5b98-6e10-458e-99e2-3985ea1474e8 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed1aa67f-0bc9-4a51-ac5d-c1f4e149f1d9"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:38:36.718618 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-55ce5b98-6e10-458e-99e2-3985ea1474e8 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 901af3d1-ee82-487d-ba43-06eea301b2d4] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:36.726480 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-55ce5b98-6e10-458e-99e2-3985ea1474e8 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:36.727040 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-55ce5b98-6e10-458e-99e2-3985ea1474e8 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:36.727911 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-55ce5b98-6e10-458e-99e2-3985ea1474e8 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:36.728396 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-55ce5b98-6e10-458e-99e2-3985ea1474e8 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:37.022467 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-55ce5b98-6e10-458e-99e2-3985ea1474e8 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "POST /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308979 Jun 20 12:38:37.023310 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3195/6485] 10.222.0.27 () {60 vars in 1322 bytes} [Mon Jun 20 12:38:36 2022] POST /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:38:37.367433 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cb82f439-1be4-4fe5-aa58-33cdd202a02b tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:37.368082 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cb82f439-1be4-4fe5-aa58-33cdd202a02b tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] [instance: 9400896f-d98f-4e50-896b-632b7cd9642f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:37.375885 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cb82f439-1be4-4fe5-aa58-33cdd202a02b tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:37.376439 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cb82f439-1be4-4fe5-aa58-33cdd202a02b tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:37.377237 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cb82f439-1be4-4fe5-aa58-33cdd202a02b tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:37.377682 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cb82f439-1be4-4fe5-aa58-33cdd202a02b tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:37.532557 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cb82f439-1be4-4fe5-aa58-33cdd202a02b tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248fe9cf0934faaaa1059c0a67cdccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f5f5f354946d391db10d490ca8764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:38:37.542179 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cb82f439-1be4-4fe5-aa58-33cdd202a02b tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] 10.222.0.27 "GET /compute/v2.1/servers/9400896f-d98f-4e50-896b-632b7cd9642f" status: 200 len: 1318 microversion: 2.1 time: 0.178920 Jun 20 12:38:37.542785 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3291/6486] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:37 2022] GET /compute/v2.1/servers/9400896f-d98f-4e50-896b-632b7cd9642f => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:38:37.859146 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-38b04c9e-f168-4ba5-983c-679cdbdc30f6 req-e9eee5c9-9b0f-438e-b786-23fe7e41e106 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9400896f-d98f-4e50-896b-632b7cd9642f", "name": "network-vif-plugged", "status": "completed", "tag": "e05da339-4d14-4b4a-be8a-312bcc92a82f"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:38:37.873056 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-38b04c9e-f168-4ba5-983c-679cdbdc30f6 req-e9eee5c9-9b0f-438e-b786-23fe7e41e106 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:37.873559 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-38b04c9e-f168-4ba5-983c-679cdbdc30f6 req-e9eee5c9-9b0f-438e-b786-23fe7e41e106 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:37.885865 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-38b04c9e-f168-4ba5-983c-679cdbdc30f6 req-e9eee5c9-9b0f-438e-b786-23fe7e41e106 service nova] Creating event network-vif-plugged:e05da339-4d14-4b4a-be8a-312bcc92a82f for instance 9400896f-d98f-4e50-896b-632b7cd9642f on n-h1-master-1 Jun 20 12:38:37.891663 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-38b04c9e-f168-4ba5-983c-679cdbdc30f6 req-e9eee5c9-9b0f-438e-b786-23fe7e41e106 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038977 Jun 20 12:38:37.893157 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3196/6487] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:38:38.559362 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a77b903f-15b4-4634-8cdd-04bf90b75490 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:38.560035 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a77b903f-15b4-4634-8cdd-04bf90b75490 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] [instance: 9400896f-d98f-4e50-896b-632b7cd9642f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:38.571656 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a77b903f-15b4-4634-8cdd-04bf90b75490 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:38.572676 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a77b903f-15b4-4634-8cdd-04bf90b75490 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:38.573821 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a77b903f-15b4-4634-8cdd-04bf90b75490 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:38.574424 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a77b903f-15b4-4634-8cdd-04bf90b75490 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:38.714475 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a77b903f-15b4-4634-8cdd-04bf90b75490 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248fe9cf0934faaaa1059c0a67cdccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f5f5f354946d391db10d490ca8764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:38:38.722542 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a77b903f-15b4-4634-8cdd-04bf90b75490 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] 10.222.0.27 "GET /compute/v2.1/servers/9400896f-d98f-4e50-896b-632b7cd9642f" status: 200 len: 1318 microversion: 2.1 time: 0.167233 Jun 20 12:38:38.723117 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3292/6488] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:38 2022] GET /compute/v2.1/servers/9400896f-d98f-4e50-896b-632b7cd9642f => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:38:39.740390 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d36e9adb-2e24-4d37-a016-3426caf43f05 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:39.741160 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d36e9adb-2e24-4d37-a016-3426caf43f05 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] [instance: 9400896f-d98f-4e50-896b-632b7cd9642f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:39.744358 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:39.745046 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:39.751881 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d36e9adb-2e24-4d37-a016-3426caf43f05 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:39.752358 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d36e9adb-2e24-4d37-a016-3426caf43f05 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:39.753158 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d36e9adb-2e24-4d37-a016-3426caf43f05 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:39.753610 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d36e9adb-2e24-4d37-a016-3426caf43f05 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:39.917371 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d36e9adb-2e24-4d37-a016-3426caf43f05 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248fe9cf0934faaaa1059c0a67cdccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f5f5f354946d391db10d490ca8764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:38:39.934531 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d36e9adb-2e24-4d37-a016-3426caf43f05 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] 10.222.0.27 "GET /compute/v2.1/servers/9400896f-d98f-4e50-896b-632b7cd9642f" status: 200 len: 1508 microversion: 2.1 time: 0.198483 Jun 20 12:38:39.949329 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3197/6489] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:39 2022] GET /compute/v2.1/servers/9400896f-d98f-4e50-896b-632b7cd9642f => generated 1508 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:38:43.067298 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:43.072459 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1d012629-75cd-4e5d-aa9f-d4e142858835 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1856662837", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-997416587", "security_groups": [{"name": "tempest-secgroup-smoke-1594074498"}], "block_device_mapping_v2": [{"uuid": "9e00128f-7c4f-4030-8d8b-9d5511e9bc8a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fda59e99-54c8-4d95-ad3c-e4129b9a154d"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:38:43.208328 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-1d012629-75cd-4e5d-aa9f-d4e142858835 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] validate_networks() for [('fda59e99-54c8-4d95-ad3c-e4129b9a154d', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:38:43.655427 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-1d012629-75cd-4e5d-aa9f-d4e142858835 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:38:43.655927 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-1d012629-75cd-4e5d-aa9f-d4e142858835 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:38:43.657089 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-1d012629-75cd-4e5d-aa9f-d4e142858835 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:38:43.657577 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-1d012629-75cd-4e5d-aa9f-d4e142858835 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:38:43.658067 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-1d012629-75cd-4e5d-aa9f-d4e142858835 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:38:43.667905 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1d012629-75cd-4e5d-aa9f-d4e142858835 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:43.668616 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1d012629-75cd-4e5d-aa9f-d4e142858835 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:43.669494 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1d012629-75cd-4e5d-aa9f-d4e142858835 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:43.670005 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1d012629-75cd-4e5d-aa9f-d4e142858835 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:43.688473 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-1d012629-75cd-4e5d-aa9f-d4e142858835 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Getting quotas for project 5a9c7bbcc9a149f5b77a89141a306c3e. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:38:43.694098 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-1d012629-75cd-4e5d-aa9f-d4e142858835 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Getting quotas for user fed0afc129364664aed8d8a96f499831 and project 5a9c7bbcc9a149f5b77a89141a306c3e. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:38:43.758283 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1d012629-75cd-4e5d-aa9f-d4e142858835 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:38:43.760454 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1d012629-75cd-4e5d-aa9f-d4e142858835 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 47bf8feb-9acf-44f3-960f-a4eb84570735] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9e00128f-7c4f-4030-8d8b-9d5511e9bc8a',volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:38:43.903753 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1d012629-75cd-4e5d-aa9f-d4e142858835 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.837412 Jun 20 12:38:43.904467 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3293/6490] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:38:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:38:43.915509 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6f7d50f7-d459-49ad-8513-93b9a137ba0b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:43.916092 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6f7d50f7-d459-49ad-8513-93b9a137ba0b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 47bf8feb-9acf-44f3-960f-a4eb84570735] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:43.981570 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6f7d50f7-d459-49ad-8513-93b9a137ba0b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:38:43.989585 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6f7d50f7-d459-49ad-8513-93b9a137ba0b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735" status: 200 len: 1094 microversion: 2.1 time: 0.078299 Jun 20 12:38:43.990370 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3198/6491] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:43 2022] GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735 => generated 1094 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:38:45.007573 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0878118d-62dc-4f85-82e3-3d2b45ef6996 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:45.008437 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0878118d-62dc-4f85-82e3-3d2b45ef6996 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 47bf8feb-9acf-44f3-960f-a4eb84570735] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:45.016964 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0878118d-62dc-4f85-82e3-3d2b45ef6996 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:45.017572 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0878118d-62dc-4f85-82e3-3d2b45ef6996 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:45.018602 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0878118d-62dc-4f85-82e3-3d2b45ef6996 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:45.019243 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0878118d-62dc-4f85-82e3-3d2b45ef6996 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:45.092793 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0878118d-62dc-4f85-82e3-3d2b45ef6996 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:38:45.103940 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0878118d-62dc-4f85-82e3-3d2b45ef6996 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735" status: 200 len: 1200 microversion: 2.1 time: 0.100422 Jun 20 12:38:45.105060 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3294/6492] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:45 2022] GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735 => generated 1200 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:38:46.122810 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3ecf8733-cf94-4e7b-a877-f1aa5bab1921 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:46.123362 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3ecf8733-cf94-4e7b-a877-f1aa5bab1921 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 47bf8feb-9acf-44f3-960f-a4eb84570735] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:46.139506 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3ecf8733-cf94-4e7b-a877-f1aa5bab1921 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:46.140526 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3ecf8733-cf94-4e7b-a877-f1aa5bab1921 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:46.142063 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3ecf8733-cf94-4e7b-a877-f1aa5bab1921 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:46.142959 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3ecf8733-cf94-4e7b-a877-f1aa5bab1921 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:46.183988 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:46.404990 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3ecf8733-cf94-4e7b-a877-f1aa5bab1921 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:38:46.414820 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3ecf8733-cf94-4e7b-a877-f1aa5bab1921 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735" status: 200 len: 1278 microversion: 2.1 time: 0.295815 Jun 20 12:38:46.416035 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3199/6493] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:46 2022] GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735 => generated 1278 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:38:46.843272 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-e4105a02-2b2f-43d7-a1cf-533a6c31e414 req-b211e942-477b-4424-98b5-1a763785658c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47bf8feb-9acf-44f3-960f-a4eb84570735", "tag": "2163993f-e186-4de1-ba76-05c26cf17781"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:38:46.888992 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-e4105a02-2b2f-43d7-a1cf-533a6c31e414 req-b211e942-477b-4424-98b5-1a763785658c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:46.889459 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-e4105a02-2b2f-43d7-a1cf-533a6c31e414 req-b211e942-477b-4424-98b5-1a763785658c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:46.922234 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=60 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:46.950491 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-e4105a02-2b2f-43d7-a1cf-533a6c31e414 req-b211e942-477b-4424-98b5-1a763785658c service nova] Creating event network-changed:2163993f-e186-4de1-ba76-05c26cf17781 for instance 47bf8feb-9acf-44f3-960f-a4eb84570735 on n-h2-master-1 Jun 20 12:38:46.964830 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-e4105a02-2b2f-43d7-a1cf-533a6c31e414 req-b211e942-477b-4424-98b5-1a763785658c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127849 Jun 20 12:38:46.967896 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3295/6494] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:38:47.433303 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-244f7d88-c86f-4f87-b89c-1b914121f9b8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:47.434577 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-244f7d88-c86f-4f87-b89c-1b914121f9b8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 47bf8feb-9acf-44f3-960f-a4eb84570735] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:47.444029 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-244f7d88-c86f-4f87-b89c-1b914121f9b8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:47.444759 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-244f7d88-c86f-4f87-b89c-1b914121f9b8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:47.445763 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-244f7d88-c86f-4f87-b89c-1b914121f9b8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:47.446221 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-244f7d88-c86f-4f87-b89c-1b914121f9b8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:47.703321 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-244f7d88-c86f-4f87-b89c-1b914121f9b8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:38:47.716743 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-244f7d88-c86f-4f87-b89c-1b914121f9b8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735" status: 200 len: 1278 microversion: 2.1 time: 0.287189 Jun 20 12:38:47.732676 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3200/6495] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:47 2022] GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735 => generated 1278 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:38:48.735900 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ac7777e0-2fd9-4e28-8775-665f19c2a06c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:48.737209 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ac7777e0-2fd9-4e28-8775-665f19c2a06c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 47bf8feb-9acf-44f3-960f-a4eb84570735] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:48.745072 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac7777e0-2fd9-4e28-8775-665f19c2a06c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:48.745528 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac7777e0-2fd9-4e28-8775-665f19c2a06c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:48.746300 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac7777e0-2fd9-4e28-8775-665f19c2a06c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:48.746733 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac7777e0-2fd9-4e28-8775-665f19c2a06c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:48.901412 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ac7777e0-2fd9-4e28-8775-665f19c2a06c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:38:48.913672 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ac7777e0-2fd9-4e28-8775-665f19c2a06c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735" status: 200 len: 1278 microversion: 2.1 time: 0.181862 Jun 20 12:38:48.914489 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3296/6496] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:48 2022] GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735 => generated 1278 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:38:49.223793 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a672c12c-1100-46b6-b9bb-b7b894bdac06 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:49.224762 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a672c12c-1100-46b6-b9bb-b7b894bdac06 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 901af3d1-ee82-487d-ba43-06eea301b2d4] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:49.232333 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a672c12c-1100-46b6-b9bb-b7b894bdac06 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:49.232911 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a672c12c-1100-46b6-b9bb-b7b894bdac06 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:49.233924 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a672c12c-1100-46b6-b9bb-b7b894bdac06 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:49.234470 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a672c12c-1100-46b6-b9bb-b7b894bdac06 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:49.335431 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-a672c12c-1100-46b6-b9bb-b7b894bdac06 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lazy-loading 'services' on Instance uuid 901af3d1-ee82-487d-ba43-06eea301b2d4 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:38:49.440331 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a672c12c-1100-46b6-b9bb-b7b894bdac06 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "DELETE /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4/os-volume_attachments/ed1aa67f-0bc9-4a51-ac5d-c1f4e149f1d9" status: 202 len: 0 microversion: 2.1 time: 0.219956 Jun 20 12:38:49.444141 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3201/6497] 10.222.0.27 () {58 vars in 1415 bytes} [Mon Jun 20 12:38:49 2022] DELETE /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4/os-volume_attachments/ed1aa67f-0bc9-4a51-ac5d-c1f4e149f1d9 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:38:49.452865 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c6ae883c-5a83-49c8-9360-d4af15292b03 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:49.453724 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c6ae883c-5a83-49c8-9360-d4af15292b03 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 901af3d1-ee82-487d-ba43-06eea301b2d4] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:49.460550 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6ae883c-5a83-49c8-9360-d4af15292b03 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:49.461273 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6ae883c-5a83-49c8-9360-d4af15292b03 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:49.462066 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6ae883c-5a83-49c8-9360-d4af15292b03 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:49.462599 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6ae883c-5a83-49c8-9360-d4af15292b03 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:49.497043 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c6ae883c-5a83-49c8-9360-d4af15292b03 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048273 Jun 20 12:38:49.498490 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3297/6498] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:38:49 2022] GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:38:49.934487 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9bc671f7-b8a6-43c1-93cc-50dc3737fb15 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:49.935815 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9bc671f7-b8a6-43c1-93cc-50dc3737fb15 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 47bf8feb-9acf-44f3-960f-a4eb84570735] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:49.943901 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9bc671f7-b8a6-43c1-93cc-50dc3737fb15 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:49.944793 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9bc671f7-b8a6-43c1-93cc-50dc3737fb15 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:49.945811 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9bc671f7-b8a6-43c1-93cc-50dc3737fb15 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:49.946460 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9bc671f7-b8a6-43c1-93cc-50dc3737fb15 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:50.107660 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9bc671f7-b8a6-43c1-93cc-50dc3737fb15 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:38:50.119975 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9bc671f7-b8a6-43c1-93cc-50dc3737fb15 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735" status: 200 len: 1278 microversion: 2.1 time: 0.192742 Jun 20 12:38:50.120853 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3202/6499] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:49 2022] GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735 => generated 1278 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:38:50.510850 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2a2dc1f6-135c-4ebb-848d-2f906fddc851 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:50.511832 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2a2dc1f6-135c-4ebb-848d-2f906fddc851 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 901af3d1-ee82-487d-ba43-06eea301b2d4] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:50.519434 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2a2dc1f6-135c-4ebb-848d-2f906fddc851 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:50.519888 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2a2dc1f6-135c-4ebb-848d-2f906fddc851 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:50.520694 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2a2dc1f6-135c-4ebb-848d-2f906fddc851 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:50.521170 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2a2dc1f6-135c-4ebb-848d-2f906fddc851 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:50.557426 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2a2dc1f6-135c-4ebb-848d-2f906fddc851 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050825 Jun 20 12:38:50.558358 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3298/6500] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:38:50 2022] GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:38:51.145478 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-47e40991-cde2-4f5a-84f6-510a76ea7b35 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:51.146376 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-47e40991-cde2-4f5a-84f6-510a76ea7b35 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 47bf8feb-9acf-44f3-960f-a4eb84570735] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:51.153605 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-47e40991-cde2-4f5a-84f6-510a76ea7b35 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:51.154092 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-47e40991-cde2-4f5a-84f6-510a76ea7b35 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:51.155068 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-47e40991-cde2-4f5a-84f6-510a76ea7b35 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:51.156380 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-47e40991-cde2-4f5a-84f6-510a76ea7b35 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:51.353316 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-47e40991-cde2-4f5a-84f6-510a76ea7b35 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:38:51.364123 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-47e40991-cde2-4f5a-84f6-510a76ea7b35 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735" status: 200 len: 1266 microversion: 2.1 time: 0.230043 Jun 20 12:38:51.365312 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3203/6501] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:51 2022] GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735 => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:38:51.579350 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e90f99e3-95fb-4651-8c33-96c3b0f0c0a2 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:51.581476 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e90f99e3-95fb-4651-8c33-96c3b0f0c0a2 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 901af3d1-ee82-487d-ba43-06eea301b2d4] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:51.592606 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e90f99e3-95fb-4651-8c33-96c3b0f0c0a2 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:51.593061 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e90f99e3-95fb-4651-8c33-96c3b0f0c0a2 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:51.593856 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e90f99e3-95fb-4651-8c33-96c3b0f0c0a2 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:51.594296 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e90f99e3-95fb-4651-8c33-96c3b0f0c0a2 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:51.639322 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e90f99e3-95fb-4651-8c33-96c3b0f0c0a2 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072673 Jun 20 12:38:51.640852 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3299/6502] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:38:51 2022] GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:38:52.384117 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7c83e990-7baf-4e1d-8533-a94adab7c787 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:52.385260 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7c83e990-7baf-4e1d-8533-a94adab7c787 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 47bf8feb-9acf-44f3-960f-a4eb84570735] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:52.392637 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7c83e990-7baf-4e1d-8533-a94adab7c787 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:52.393094 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7c83e990-7baf-4e1d-8533-a94adab7c787 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:52.393893 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7c83e990-7baf-4e1d-8533-a94adab7c787 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:52.394602 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7c83e990-7baf-4e1d-8533-a94adab7c787 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:52.549036 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7c83e990-7baf-4e1d-8533-a94adab7c787 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:38:52.561625 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7c83e990-7baf-4e1d-8533-a94adab7c787 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735" status: 200 len: 1266 microversion: 2.1 time: 0.182292 Jun 20 12:38:52.562460 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3204/6503] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:52 2022] GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:38:52.651910 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-954d9a4e-6977-48ba-815d-0a5445e09efb tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:52.652993 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-954d9a4e-6977-48ba-815d-0a5445e09efb tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 901af3d1-ee82-487d-ba43-06eea301b2d4] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:52.659653 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:52.662301 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-954d9a4e-6977-48ba-815d-0a5445e09efb tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:52.662941 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-954d9a4e-6977-48ba-815d-0a5445e09efb tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:52.663953 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-954d9a4e-6977-48ba-815d-0a5445e09efb tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:52.664579 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-954d9a4e-6977-48ba-815d-0a5445e09efb tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:52.701091 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-954d9a4e-6977-48ba-815d-0a5445e09efb tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053210 Jun 20 12:38:52.701700 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3300/6504] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:38:52 2022] GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:38:53.579455 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-48529605-70ce-432d-a377-3f4e4df7cfca tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:53.580916 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-48529605-70ce-432d-a377-3f4e4df7cfca tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 47bf8feb-9acf-44f3-960f-a4eb84570735] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:53.588016 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-48529605-70ce-432d-a377-3f4e4df7cfca tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:53.588541 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-48529605-70ce-432d-a377-3f4e4df7cfca tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:53.589680 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-48529605-70ce-432d-a377-3f4e4df7cfca tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:53.590146 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-48529605-70ce-432d-a377-3f4e4df7cfca tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:53.717120 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b91f7a1c-6354-4827-a3f9-97cddb13b160 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:53.718606 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b91f7a1c-6354-4827-a3f9-97cddb13b160 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 901af3d1-ee82-487d-ba43-06eea301b2d4] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:53.722912 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:53.724429 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:53.734740 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b91f7a1c-6354-4827-a3f9-97cddb13b160 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:53.735474 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b91f7a1c-6354-4827-a3f9-97cddb13b160 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:53.736928 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b91f7a1c-6354-4827-a3f9-97cddb13b160 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:53.737521 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b91f7a1c-6354-4827-a3f9-97cddb13b160 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:53.758141 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-48529605-70ce-432d-a377-3f4e4df7cfca tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:38:53.770023 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b91f7a1c-6354-4827-a3f9-97cddb13b160 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060348 Jun 20 12:38:53.770660 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3301/6505] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:38:53 2022] GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:38:53.781635 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-48529605-70ce-432d-a377-3f4e4df7cfca tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735" status: 200 len: 1266 microversion: 2.1 time: 0.206192 Jun 20 12:38:53.783247 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3205/6506] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:53 2022] GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:38:54.785817 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4dbae914-9a82-4973-a8f0-1645ed865743 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:54.789794 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4dbae914-9a82-4973-a8f0-1645ed865743 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 901af3d1-ee82-487d-ba43-06eea301b2d4] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:54.801294 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fd27e720-87d9-4eee-ab69-8d5ae64526ce tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:54.802970 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fd27e720-87d9-4eee-ab69-8d5ae64526ce tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 47bf8feb-9acf-44f3-960f-a4eb84570735] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:54.803304 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4dbae914-9a82-4973-a8f0-1645ed865743 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:54.803993 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4dbae914-9a82-4973-a8f0-1645ed865743 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:54.804928 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4dbae914-9a82-4973-a8f0-1645ed865743 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:54.805514 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:54.805666 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4dbae914-9a82-4973-a8f0-1645ed865743 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:54.813630 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fd27e720-87d9-4eee-ab69-8d5ae64526ce tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:54.814459 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fd27e720-87d9-4eee-ab69-8d5ae64526ce tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:54.815519 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fd27e720-87d9-4eee-ab69-8d5ae64526ce tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:54.816124 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fd27e720-87d9-4eee-ab69-8d5ae64526ce tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:54.841310 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4dbae914-9a82-4973-a8f0-1645ed865743 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061633 Jun 20 12:38:54.842336 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3302/6507] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:38:54 2022] GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:38:54.911507 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1befb47a-d44c-4796-9bca-cacfea9d5df0 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:54.911714 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1befb47a-d44c-4796-9bca-cacfea9d5df0 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 901af3d1-ee82-487d-ba43-06eea301b2d4] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:54.919768 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1befb47a-d44c-4796-9bca-cacfea9d5df0 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:54.920486 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1befb47a-d44c-4796-9bca-cacfea9d5df0 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:54.921640 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1befb47a-d44c-4796-9bca-cacfea9d5df0 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:54.922227 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1befb47a-d44c-4796-9bca-cacfea9d5df0 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:54.954397 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1befb47a-d44c-4796-9bca-cacfea9d5df0 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 901af3d1-ee82-487d-ba43-06eea301b2d4] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:38:54.986033 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fd27e720-87d9-4eee-ab69-8d5ae64526ce tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:38:54.994175 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fd27e720-87d9-4eee-ab69-8d5ae64526ce tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735" status: 200 len: 1266 microversion: 2.1 time: 0.198355 Jun 20 12:38:54.994764 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3206/6508] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:54 2022] GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:38:55.060836 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1befb47a-d44c-4796-9bca-cacfea9d5df0 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "DELETE /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4" status: 204 len: 0 microversion: 2.1 time: 0.153687 Jun 20 12:38:55.061771 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3303/6509] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:38:54 2022] DELETE /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 12:38:55.071895 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-26bac268-4dcc-4a9d-ba5b-fd441be68ce0 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:55.072827 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-26bac268-4dcc-4a9d-ba5b-fd441be68ce0 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 901af3d1-ee82-487d-ba43-06eea301b2d4] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:55.079179 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-26bac268-4dcc-4a9d-ba5b-fd441be68ce0 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:55.079657 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-26bac268-4dcc-4a9d-ba5b-fd441be68ce0 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:55.080544 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-26bac268-4dcc-4a9d-ba5b-fd441be68ce0 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:55.081003 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-26bac268-4dcc-4a9d-ba5b-fd441be68ce0 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:55.229632 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-26bac268-4dcc-4a9d-ba5b-fd441be68ce0 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:38:55.238000 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-26bac268-4dcc-4a9d-ba5b-fd441be68ce0 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4" status: 200 len: 1683 microversion: 2.1 time: 0.170919 Jun 20 12:38:55.238533 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3207/6510] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:55 2022] GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4 => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:38:56.011924 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-94303b7d-a9b7-49db-8b01-d888e731681a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:56.013247 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-94303b7d-a9b7-49db-8b01-d888e731681a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 47bf8feb-9acf-44f3-960f-a4eb84570735] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:56.020454 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-94303b7d-a9b7-49db-8b01-d888e731681a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:56.020909 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-94303b7d-a9b7-49db-8b01-d888e731681a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:56.021686 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-94303b7d-a9b7-49db-8b01-d888e731681a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:56.022094 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-94303b7d-a9b7-49db-8b01-d888e731681a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:56.158500 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-94303b7d-a9b7-49db-8b01-d888e731681a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:38:56.167353 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-94303b7d-a9b7-49db-8b01-d888e731681a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735" status: 200 len: 1266 microversion: 2.1 time: 0.159945 Jun 20 12:38:56.168036 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3304/6511] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:56 2022] GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:38:56.256821 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ef6498c3-8df8-4610-bfb5-b5dc6cbc8714 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:56.257725 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ef6498c3-8df8-4610-bfb5-b5dc6cbc8714 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 901af3d1-ee82-487d-ba43-06eea301b2d4] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:56.265388 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef6498c3-8df8-4610-bfb5-b5dc6cbc8714 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:56.265822 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef6498c3-8df8-4610-bfb5-b5dc6cbc8714 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:56.266626 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef6498c3-8df8-4610-bfb5-b5dc6cbc8714 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:56.267076 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef6498c3-8df8-4610-bfb5-b5dc6cbc8714 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:56.409769 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ef6498c3-8df8-4610-bfb5-b5dc6cbc8714 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:38:56.418412 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ef6498c3-8df8-4610-bfb5-b5dc6cbc8714 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4" status: 200 len: 1683 microversion: 2.1 time: 0.165529 Jun 20 12:38:56.419372 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3208/6512] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:56 2022] GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:38:57.185425 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-13ebafef-71aa-4b45-af04-baa21c352645 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:57.186487 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-13ebafef-71aa-4b45-af04-baa21c352645 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 47bf8feb-9acf-44f3-960f-a4eb84570735] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:57.195348 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-13ebafef-71aa-4b45-af04-baa21c352645 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:57.195813 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-13ebafef-71aa-4b45-af04-baa21c352645 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:57.196778 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-13ebafef-71aa-4b45-af04-baa21c352645 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:57.197412 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-13ebafef-71aa-4b45-af04-baa21c352645 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:57.359085 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-13ebafef-71aa-4b45-af04-baa21c352645 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:38:57.369470 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-13ebafef-71aa-4b45-af04-baa21c352645 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735" status: 200 len: 1266 microversion: 2.1 time: 0.188040 Jun 20 12:38:57.373365 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3305/6513] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:57 2022] GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735 => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:38:57.437161 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d5f1450c-165f-4b93-bed3-0fd482aa44c6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:57.437776 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d5f1450c-165f-4b93-bed3-0fd482aa44c6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 901af3d1-ee82-487d-ba43-06eea301b2d4] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:57.445879 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d5f1450c-165f-4b93-bed3-0fd482aa44c6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:57.446156 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d5f1450c-165f-4b93-bed3-0fd482aa44c6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:57.447192 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d5f1450c-165f-4b93-bed3-0fd482aa44c6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:57.447835 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d5f1450c-165f-4b93-bed3-0fd482aa44c6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:57.552409 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d5f1450c-165f-4b93-bed3-0fd482aa44c6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8b3f11a7294fbd9d750b1fbbeaa65b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4714cac56094f9e9d4ed4adb400064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:38:57.564016 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d5f1450c-165f-4b93-bed3-0fd482aa44c6 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4" status: 200 len: 1615 microversion: 2.1 time: 0.130389 Jun 20 12:38:57.564461 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3209/6514] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:57 2022] GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4 => generated 1615 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:38:57.789683 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-54c1eae2-2533-42f8-83b7-57658968fe07 req-07517c5a-ecf4-461d-af5a-d11fe63632da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "901af3d1-ee82-487d-ba43-06eea301b2d4", "name": "network-vif-deleted", "tag": "4471f6e3-733c-417f-b9a3-81099f289b4e"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:38:57.802125 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-54c1eae2-2533-42f8-83b7-57658968fe07 req-07517c5a-ecf4-461d-af5a-d11fe63632da service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:57.804376 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-54c1eae2-2533-42f8-83b7-57658968fe07 req-07517c5a-ecf4-461d-af5a-d11fe63632da service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:57.819572 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-54c1eae2-2533-42f8-83b7-57658968fe07 req-07517c5a-ecf4-461d-af5a-d11fe63632da service nova] Creating event network-vif-deleted:4471f6e3-733c-417f-b9a3-81099f289b4e for instance 901af3d1-ee82-487d-ba43-06eea301b2d4 on n-h2-master-1 Jun 20 12:38:57.826873 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-54c1eae2-2533-42f8-83b7-57658968fe07 req-07517c5a-ecf4-461d-af5a-d11fe63632da service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043310 Jun 20 12:38:57.828002 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3306/6515] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:38:58.387391 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-67592a32-771b-4fcc-80a4-3350d3713cb7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:58.388472 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-67592a32-771b-4fcc-80a4-3350d3713cb7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 47bf8feb-9acf-44f3-960f-a4eb84570735] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:58.408231 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-67592a32-771b-4fcc-80a4-3350d3713cb7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:58.409055 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-67592a32-771b-4fcc-80a4-3350d3713cb7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:58.410102 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-67592a32-771b-4fcc-80a4-3350d3713cb7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:58.410783 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-67592a32-771b-4fcc-80a4-3350d3713cb7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:58.567374 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-67592a32-771b-4fcc-80a4-3350d3713cb7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:38:58.577152 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-67592a32-771b-4fcc-80a4-3350d3713cb7 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735" status: 200 len: 1266 microversion: 2.1 time: 0.193334 Jun 20 12:38:58.577752 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3210/6516] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:58 2022] GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:38:58.582893 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b65efa8e-9562-4df4-afaf-440137f0adf8 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:58.583607 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b65efa8e-9562-4df4-afaf-440137f0adf8 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 901af3d1-ee82-487d-ba43-06eea301b2d4] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:58.596041 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b65efa8e-9562-4df4-afaf-440137f0adf8 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:58.596559 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b65efa8e-9562-4df4-afaf-440137f0adf8 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:58.597299 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b65efa8e-9562-4df4-afaf-440137f0adf8 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:58.597735 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b65efa8e-9562-4df4-afaf-440137f0adf8 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:58.613523 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-b65efa8e-9562-4df4-afaf-440137f0adf8 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] HTTP exception thrown: Instance 901af3d1-ee82-487d-ba43-06eea301b2d4 could not be found. Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b65efa8e-9562-4df4-afaf-440137f0adf8 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Request method failure captured: Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4 HTTP/1.1 Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGimx3rD_FK4OQ1VdtIOQm_v9s-kKgn6vXzR6ZBiLlIplOW4i7RkYQinkTG1vfKGKwCaoPCprnA7Fw3J7TUX4keyVZVyA-ioRTCduqhd5tDd7aG1Qjuo-15G-XSI8qoUHjPCuXgPU-jMwTPPkfuUfoqrsDV0KX5Zoa18ctkNwDakrYM Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: f4714cac56094f9e9d4ed4adb400064e Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: f4714cac56094f9e9d4ed4adb400064e Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-AttachVolumeNegativeTest-1470856820-project Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 2c8b3f11a7294fbd9d750b1fbbeaa65b Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-AttachVolumeNegativeTest-1470856820-project Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 901af3d1-ee82-487d-ba43-06eea301b2d4 could not be found. Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '901af3d1-ee82-487d-ba43-06eea301b2d4'} Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 901af3d1-ee82-487d-ba43-06eea301b2d4 could not be found. Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 901af3d1-ee82-487d-ba43-06eea301b2d4 could not be found. Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:38:58.615228 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:38:58.619851 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:38:58.619851 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:38:58.619851 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:38:58.619851 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:38:58.619851 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:38:58.619851 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 901af3d1-ee82-487d-ba43-06eea301b2d4 could not be found. Jun 20 12:38:58.619851 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:38:58.619851 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b65efa8e-9562-4df4-afaf-440137f0adf8 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Returning 404 to user: Instance 901af3d1-ee82-487d-ba43-06eea301b2d4 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:38:58.619851 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b65efa8e-9562-4df4-afaf-440137f0adf8 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4" status: 404 len: 111 microversion: 2.1 time: 0.038268 Jun 20 12:38:58.619851 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3307/6517] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:58 2022] GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:38:58.625863 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7108f31a-3e06-41dc-b498-4c837f33e12b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '.version_select at 0x7f60848064c0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:58.633703 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:38:58.652721 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7108f31a-3e06-41dc-b498-4c837f33e12b tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1436226766" status: 202 len: 0 microversion: 2.1 time: 0.030626 Jun 20 12:38:58.653350 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3211/6518] 10.222.0.27 () {58 vars in 1220 bytes} [Mon Jun 20 12:38:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1436226766 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:38:59.220281 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2be658c9-98ba-47c7-9ad3-9a8590ddc15f tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a07dca1-5e2f-46bf-9ebd-7d1379e9b5c6", "device": "/dev/sdb"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:38:59.221411 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2be658c9-98ba-47c7-9ad3-9a8590ddc15f tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] [instance: 9400896f-d98f-4e50-896b-632b7cd9642f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:59.228434 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2be658c9-98ba-47c7-9ad3-9a8590ddc15f tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:59.228893 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2be658c9-98ba-47c7-9ad3-9a8590ddc15f tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:59.229692 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2be658c9-98ba-47c7-9ad3-9a8590ddc15f tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:59.230104 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2be658c9-98ba-47c7-9ad3-9a8590ddc15f tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:59.519381 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2be658c9-98ba-47c7-9ad3-9a8590ddc15f tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] 10.222.0.27 "POST /compute/v2.1/servers/9400896f-d98f-4e50-896b-632b7cd9642f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303007 Jun 20 12:38:59.520379 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3308/6519] 10.222.0.27 () {60 vars in 1322 bytes} [Mon Jun 20 12:38:59 2022] POST /compute/v2.1/servers/9400896f-d98f-4e50-896b-632b7cd9642f/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:38:59.598648 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4f8d8a46-9d56-4caf-867c-24e2cb4b6c8e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:38:59.599284 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4f8d8a46-9d56-4caf-867c-24e2cb4b6c8e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 47bf8feb-9acf-44f3-960f-a4eb84570735] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:38:59.606971 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4f8d8a46-9d56-4caf-867c-24e2cb4b6c8e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:59.607428 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4f8d8a46-9d56-4caf-867c-24e2cb4b6c8e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:59.608251 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4f8d8a46-9d56-4caf-867c-24e2cb4b6c8e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:38:59.608706 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4f8d8a46-9d56-4caf-867c-24e2cb4b6c8e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:38:59.787065 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4f8d8a46-9d56-4caf-867c-24e2cb4b6c8e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:38:59.798382 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4f8d8a46-9d56-4caf-867c-24e2cb4b6c8e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735" status: 200 len: 1266 microversion: 2.1 time: 0.203406 Jun 20 12:38:59.799623 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3212/6520] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:38:59 2022] GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735 => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:39:00.816974 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e0e2d421-4d69-4cdf-9654-f34303bb2901 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:39:00.817683 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e0e2d421-4d69-4cdf-9654-f34303bb2901 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 47bf8feb-9acf-44f3-960f-a4eb84570735] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:39:00.833620 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e0e2d421-4d69-4cdf-9654-f34303bb2901 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:00.834457 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e0e2d421-4d69-4cdf-9654-f34303bb2901 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:00.835618 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e0e2d421-4d69-4cdf-9654-f34303bb2901 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:00.836240 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e0e2d421-4d69-4cdf-9654-f34303bb2901 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:00.992479 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e0e2d421-4d69-4cdf-9654-f34303bb2901 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:39:01.001734 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e0e2d421-4d69-4cdf-9654-f34303bb2901 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735" status: 200 len: 1266 microversion: 2.1 time: 0.189038 Jun 20 12:39:01.012861 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3309/6521] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:39:00 2022] GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:39:01.559409 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-7f2492f7-8472-464e-a628-92669f0a2e38 req-cbbce13d-292f-4f0c-ac62-c89623ebfacc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47bf8feb-9acf-44f3-960f-a4eb84570735", "name": "network-vif-plugged", "status": "completed", "tag": "2163993f-e186-4de1-ba76-05c26cf17781"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:39:01.578885 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-7f2492f7-8472-464e-a628-92669f0a2e38 req-cbbce13d-292f-4f0c-ac62-c89623ebfacc service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:01.580673 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-7f2492f7-8472-464e-a628-92669f0a2e38 req-cbbce13d-292f-4f0c-ac62-c89623ebfacc service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:01.599814 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-7f2492f7-8472-464e-a628-92669f0a2e38 req-cbbce13d-292f-4f0c-ac62-c89623ebfacc service nova] Creating event network-vif-plugged:2163993f-e186-4de1-ba76-05c26cf17781 for instance 47bf8feb-9acf-44f3-960f-a4eb84570735 on n-h2-master-1 Jun 20 12:39:01.608047 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-7f2492f7-8472-464e-a628-92669f0a2e38 req-cbbce13d-292f-4f0c-ac62-c89623ebfacc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055795 Jun 20 12:39:01.609270 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3213/6522] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:39:02.020453 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ddd3c96e-5484-4411-8b49-3fbe00383491 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:39:02.021067 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ddd3c96e-5484-4411-8b49-3fbe00383491 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 47bf8feb-9acf-44f3-960f-a4eb84570735] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:39:02.028311 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ddd3c96e-5484-4411-8b49-3fbe00383491 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:02.028750 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ddd3c96e-5484-4411-8b49-3fbe00383491 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:02.029485 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ddd3c96e-5484-4411-8b49-3fbe00383491 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:02.030135 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ddd3c96e-5484-4411-8b49-3fbe00383491 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:02.179198 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ddd3c96e-5484-4411-8b49-3fbe00383491 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:39:02.183081 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:39:02.191136 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ddd3c96e-5484-4411-8b49-3fbe00383491 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735" status: 200 len: 1266 microversion: 2.1 time: 0.174484 Jun 20 12:39:02.191973 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3310/6523] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:39:02 2022] GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:39:02.948313 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ba400121-6762-4f1c-8ab1-9cb4ddea8170 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:39:02.949696 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ba400121-6762-4f1c-8ab1-9cb4ddea8170 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 901af3d1-ee82-487d-ba43-06eea301b2d4] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:39:02.957543 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba400121-6762-4f1c-8ab1-9cb4ddea8170 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:02.958269 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba400121-6762-4f1c-8ab1-9cb4ddea8170 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:02.959264 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba400121-6762-4f1c-8ab1-9cb4ddea8170 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:02.959910 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba400121-6762-4f1c-8ab1-9cb4ddea8170 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:02.978488 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-ba400121-6762-4f1c-8ab1-9cb4ddea8170 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] HTTP exception thrown: Instance 901af3d1-ee82-487d-ba43-06eea301b2d4 could not be found. Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ba400121-6762-4f1c-8ab1-9cb4ddea8170 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Request method failure captured: Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4 HTTP/1.1 Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGimx3rD_FK4OQ1VdtIOQm_v9s-kKgn6vXzR6ZBiLlIplOW4i7RkYQinkTG1vfKGKwCaoPCprnA7Fw3J7TUX4keyVZVyA-ioRTCduqhd5tDd7aG1Qjuo-15G-XSI8qoUHjPCuXgPU-jMwTPPkfuUfoqrsDV0KX5Zoa18ctkNwDakrYM Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: f4714cac56094f9e9d4ed4adb400064e Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: f4714cac56094f9e9d4ed4adb400064e Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-AttachVolumeNegativeTest-1470856820-project Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 2c8b3f11a7294fbd9d750b1fbbeaa65b Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-AttachVolumeNegativeTest-1470856820-project Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 901af3d1-ee82-487d-ba43-06eea301b2d4 could not be found. Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '901af3d1-ee82-487d-ba43-06eea301b2d4'} Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 901af3d1-ee82-487d-ba43-06eea301b2d4 could not be found. Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:39:02.980640 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:39:02.985624 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 901af3d1-ee82-487d-ba43-06eea301b2d4 could not be found. Jun 20 12:39:02.985624 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:39:02.985624 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:39:02.985624 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:39:02.985624 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:39:02.985624 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:39:02.985624 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:39:02.985624 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:39:02.985624 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:39:02.985624 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 901af3d1-ee82-487d-ba43-06eea301b2d4 could not be found. Jun 20 12:39:02.985624 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:39:02.987851 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ba400121-6762-4f1c-8ab1-9cb4ddea8170 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Returning 404 to user: Instance 901af3d1-ee82-487d-ba43-06eea301b2d4 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:39:02.989026 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ba400121-6762-4f1c-8ab1-9cb4ddea8170 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "DELETE /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4" status: 404 len: 111 microversion: 2.1 time: 0.049726 Jun 20 12:39:02.990224 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3214/6524] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:39:02 2022] DELETE /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:39:02.998039 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6dae62ff-a508-4543-bd16-d20a480fd866 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:39:02.998971 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6dae62ff-a508-4543-bd16-d20a480fd866 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 901af3d1-ee82-487d-ba43-06eea301b2d4] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:39:03.008946 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6dae62ff-a508-4543-bd16-d20a480fd866 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:03.009800 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6dae62ff-a508-4543-bd16-d20a480fd866 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:03.010847 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6dae62ff-a508-4543-bd16-d20a480fd866 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:03.011507 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6dae62ff-a508-4543-bd16-d20a480fd866 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:03.028535 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-6dae62ff-a508-4543-bd16-d20a480fd866 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] HTTP exception thrown: Instance 901af3d1-ee82-487d-ba43-06eea301b2d4 could not be found. Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6dae62ff-a508-4543-bd16-d20a480fd866 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Request method failure captured: Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4 HTTP/1.1 Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGimx3rD_FK4OQ1VdtIOQm_v9s-kKgn6vXzR6ZBiLlIplOW4i7RkYQinkTG1vfKGKwCaoPCprnA7Fw3J7TUX4keyVZVyA-ioRTCduqhd5tDd7aG1Qjuo-15G-XSI8qoUHjPCuXgPU-jMwTPPkfuUfoqrsDV0KX5Zoa18ctkNwDakrYM Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: f4714cac56094f9e9d4ed4adb400064e Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: f4714cac56094f9e9d4ed4adb400064e Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-AttachVolumeNegativeTest-1470856820-project Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 2c8b3f11a7294fbd9d750b1fbbeaa65b Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-AttachVolumeNegativeTest-1470856820-project Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 901af3d1-ee82-487d-ba43-06eea301b2d4 could not be found. Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '901af3d1-ee82-487d-ba43-06eea301b2d4'} Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 901af3d1-ee82-487d-ba43-06eea301b2d4 could not be found. Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 901af3d1-ee82-487d-ba43-06eea301b2d4 could not be found. Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:39:03.031057 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:39:03.035231 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:39:03.035231 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:39:03.035231 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:39:03.035231 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:39:03.035231 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:39:03.035231 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 901af3d1-ee82-487d-ba43-06eea301b2d4 could not be found. Jun 20 12:39:03.035231 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:39:03.037015 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6dae62ff-a508-4543-bd16-d20a480fd866 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Returning 404 to user: Instance 901af3d1-ee82-487d-ba43-06eea301b2d4 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:39:03.038114 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6dae62ff-a508-4543-bd16-d20a480fd866 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4" status: 404 len: 111 microversion: 2.1 time: 0.044015 Jun 20 12:39:03.039012 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3311/6525] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:39:02 2022] GET /compute/v2.1/servers/901af3d1-ee82-487d-ba43-06eea301b2d4 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:39:03.209646 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ff7765f0-5d49-4403-98ed-9ee3bb407d52 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:39:03.211371 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ff7765f0-5d49-4403-98ed-9ee3bb407d52 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 47bf8feb-9acf-44f3-960f-a4eb84570735] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:39:03.227790 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ff7765f0-5d49-4403-98ed-9ee3bb407d52 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:03.228735 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ff7765f0-5d49-4403-98ed-9ee3bb407d52 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:03.230119 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ff7765f0-5d49-4403-98ed-9ee3bb407d52 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:03.234068 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ff7765f0-5d49-4403-98ed-9ee3bb407d52 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:03.436409 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ff7765f0-5d49-4403-98ed-9ee3bb407d52 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:39:03.445911 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ff7765f0-5d49-4403-98ed-9ee3bb407d52 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735" status: 200 len: 1266 microversion: 2.1 time: 0.241072 Jun 20 12:39:03.446835 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3215/6526] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:39:03 2022] GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735 => generated 1266 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:39:04.463613 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-36aa88b0-85b1-4c8f-b595-f1af0d87071f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:39:04.464182 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-36aa88b0-85b1-4c8f-b595-f1af0d87071f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 47bf8feb-9acf-44f3-960f-a4eb84570735] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:39:04.472083 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36aa88b0-85b1-4c8f-b595-f1af0d87071f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:04.472621 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36aa88b0-85b1-4c8f-b595-f1af0d87071f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:04.473393 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36aa88b0-85b1-4c8f-b595-f1af0d87071f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:04.473824 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36aa88b0-85b1-4c8f-b595-f1af0d87071f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:04.616581 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-36aa88b0-85b1-4c8f-b595-f1af0d87071f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:39:04.625065 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-36aa88b0-85b1-4c8f-b595-f1af0d87071f tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735" status: 200 len: 1452 microversion: 2.1 time: 0.165659 Jun 20 12:39:04.625622 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3312/6527] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:39:04 2022] GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735 => generated 1452 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:39:04.642199 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-27b30392-b3cd-4156-be31-b7f78a69887b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:39:04.642822 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-27b30392-b3cd-4156-be31-b7f78a69887b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 47bf8feb-9acf-44f3-960f-a4eb84570735] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:39:04.651430 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-27b30392-b3cd-4156-be31-b7f78a69887b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:04.651894 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-27b30392-b3cd-4156-be31-b7f78a69887b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:04.652706 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-27b30392-b3cd-4156-be31-b7f78a69887b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:04.653178 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-27b30392-b3cd-4156-be31-b7f78a69887b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:04.795524 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-27b30392-b3cd-4156-be31-b7f78a69887b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:39:04.806843 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-27b30392-b3cd-4156-be31-b7f78a69887b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735" status: 200 len: 1452 microversion: 2.1 time: 0.166612 Jun 20 12:39:04.806843 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3216/6528] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:39:04 2022] GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735 => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:39:06.829221 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-e2794279-cdac-4d19-a021-56f2342e344b req-71e5542a-92d1-479a-812e-6bc2a5c23778 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47bf8feb-9acf-44f3-960f-a4eb84570735", "tag": "2163993f-e186-4de1-ba76-05c26cf17781"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:39:06.838314 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-e2794279-cdac-4d19-a021-56f2342e344b req-71e5542a-92d1-479a-812e-6bc2a5c23778 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:06.838759 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-e2794279-cdac-4d19-a021-56f2342e344b req-71e5542a-92d1-479a-812e-6bc2a5c23778 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:06.850271 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-e2794279-cdac-4d19-a021-56f2342e344b req-71e5542a-92d1-479a-812e-6bc2a5c23778 service nova] Creating event network-changed:2163993f-e186-4de1-ba76-05c26cf17781 for instance 47bf8feb-9acf-44f3-960f-a4eb84570735 on n-h2-master-1 Jun 20 12:39:06.855528 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-e2794279-cdac-4d19-a021-56f2342e344b req-71e5542a-92d1-479a-812e-6bc2a5c23778 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029984 Jun 20 12:39:06.856379 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3313/6529] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:39:08.501336 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6d1b3b12-43fa-41e6-abed-7b2dbafcdc91 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:39:08.501915 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6d1b3b12-43fa-41e6-abed-7b2dbafcdc91 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: f1dbc299-776d-4c09-9457-dc6a998892ca] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:39:08.509925 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6d1b3b12-43fa-41e6-abed-7b2dbafcdc91 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:08.510392 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6d1b3b12-43fa-41e6-abed-7b2dbafcdc91 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:08.511177 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6d1b3b12-43fa-41e6-abed-7b2dbafcdc91 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:08.511618 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6d1b3b12-43fa-41e6-abed-7b2dbafcdc91 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:08.526489 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-6d1b3b12-43fa-41e6-abed-7b2dbafcdc91 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] HTTP exception thrown: Instance f1dbc299-776d-4c09-9457-dc6a998892ca could not be found. Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6d1b3b12-43fa-41e6-abed-7b2dbafcdc91 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Request method failure captured: Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca HTTP/1.1 Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGimx3rD_FK4OQ1VdtIOQm_v9s-kKgn6vXzR6ZBiLlIplOW4i7RkYQinkTG1vfKGKwCaoPCprnA7Fw3J7TUX4keyVZVyA-ioRTCduqhd5tDd7aG1Qjuo-15G-XSI8qoUHjPCuXgPU-jMwTPPkfuUfoqrsDV0KX5Zoa18ctkNwDakrYM Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: f4714cac56094f9e9d4ed4adb400064e Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: f4714cac56094f9e9d4ed4adb400064e Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-AttachVolumeNegativeTest-1470856820-project Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 2c8b3f11a7294fbd9d750b1fbbeaa65b Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-AttachVolumeNegativeTest-1470856820-project Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: exception: Instance f1dbc299-776d-4c09-9457-dc6a998892ca could not be found. Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'f1dbc299-776d-4c09-9457-dc6a998892ca'} Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1dbc299-776d-4c09-9457-dc6a998892ca could not be found. Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:39:08.528176 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:39:08.532903 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1dbc299-776d-4c09-9457-dc6a998892ca could not be found. Jun 20 12:39:08.532903 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:39:08.532903 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:39:08.532903 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:39:08.532903 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:39:08.532903 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:39:08.532903 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:39:08.532903 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:39:08.532903 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:39:08.532903 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1dbc299-776d-4c09-9457-dc6a998892ca could not be found. Jun 20 12:39:08.532903 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:39:08.532903 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6d1b3b12-43fa-41e6-abed-7b2dbafcdc91 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Returning 404 to user: Instance f1dbc299-776d-4c09-9457-dc6a998892ca could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:39:08.532903 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6d1b3b12-43fa-41e6-abed-7b2dbafcdc91 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca" status: 404 len: 111 microversion: 2.1 time: 0.032310 Jun 20 12:39:08.532903 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3217/6530] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:39:08 2022] DELETE /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:39:08.540974 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-91c8676b-5001-4423-be36-f277ecb1799e tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:39:08.541681 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-91c8676b-5001-4423-be36-f277ecb1799e tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: f1dbc299-776d-4c09-9457-dc6a998892ca] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:39:08.548384 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91c8676b-5001-4423-be36-f277ecb1799e tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:08.548847 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91c8676b-5001-4423-be36-f277ecb1799e tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:08.549624 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91c8676b-5001-4423-be36-f277ecb1799e tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:08.550068 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-91c8676b-5001-4423-be36-f277ecb1799e tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:08.564106 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-91c8676b-5001-4423-be36-f277ecb1799e tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] HTTP exception thrown: Instance f1dbc299-776d-4c09-9457-dc6a998892ca could not be found. Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-91c8676b-5001-4423-be36-f277ecb1799e tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Request method failure captured: Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca HTTP/1.1 Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGimx3rD_FK4OQ1VdtIOQm_v9s-kKgn6vXzR6ZBiLlIplOW4i7RkYQinkTG1vfKGKwCaoPCprnA7Fw3J7TUX4keyVZVyA-ioRTCduqhd5tDd7aG1Qjuo-15G-XSI8qoUHjPCuXgPU-jMwTPPkfuUfoqrsDV0KX5Zoa18ctkNwDakrYM Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: f4714cac56094f9e9d4ed4adb400064e Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: f4714cac56094f9e9d4ed4adb400064e Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-AttachVolumeNegativeTest-1470856820-project Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 2c8b3f11a7294fbd9d750b1fbbeaa65b Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-AttachVolumeNegativeTest-1470856820-project Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: exception: Instance f1dbc299-776d-4c09-9457-dc6a998892ca could not be found. Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'f1dbc299-776d-4c09-9457-dc6a998892ca'} Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1dbc299-776d-4c09-9457-dc6a998892ca could not be found. Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1dbc299-776d-4c09-9457-dc6a998892ca could not be found. Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:39:08.565821 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:39:08.569991 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:39:08.569991 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:39:08.569991 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:39:08.569991 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:39:08.569991 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:39:08.569991 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1dbc299-776d-4c09-9457-dc6a998892ca could not be found. Jun 20 12:39:08.569991 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:39:08.569991 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-91c8676b-5001-4423-be36-f277ecb1799e tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Returning 404 to user: Instance f1dbc299-776d-4c09-9457-dc6a998892ca could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:39:08.569991 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-91c8676b-5001-4423-be36-f277ecb1799e tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca" status: 404 len: 111 microversion: 2.1 time: 0.031527 Jun 20 12:39:08.569991 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3314/6531] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:39:08 2022] GET /compute/v2.1/servers/f1dbc299-776d-4c09-9457-dc6a998892ca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:39:08.576437 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-31ff584b-d98f-49f4-9ddc-a430941660ea tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:39:08.576942 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-31ff584b-d98f-49f4-9ddc-a430941660ea tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:39:08.583238 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-31ff584b-d98f-49f4-9ddc-a430941660ea tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:08.583693 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-31ff584b-d98f-49f4-9ddc-a430941660ea tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:08.584489 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-31ff584b-d98f-49f4-9ddc-a430941660ea tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:08.584936 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-31ff584b-d98f-49f4-9ddc-a430941660ea tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:08.587809 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:39:08.600638 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-31ff584b-d98f-49f4-9ddc-a430941660ea tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] HTTP exception thrown: Instance 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 could not be found. Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-31ff584b-d98f-49f4-9ddc-a430941660ea tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Request method failure captured: Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 HTTP/1.1 Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGimx3rD_FK4OQ1VdtIOQm_v9s-kKgn6vXzR6ZBiLlIplOW4i7RkYQinkTG1vfKGKwCaoPCprnA7Fw3J7TUX4keyVZVyA-ioRTCduqhd5tDd7aG1Qjuo-15G-XSI8qoUHjPCuXgPU-jMwTPPkfuUfoqrsDV0KX5Zoa18ctkNwDakrYM Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: f4714cac56094f9e9d4ed4adb400064e Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: f4714cac56094f9e9d4ed4adb400064e Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-AttachVolumeNegativeTest-1470856820-project Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 2c8b3f11a7294fbd9d750b1fbbeaa65b Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-AttachVolumeNegativeTest-1470856820-project Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 could not be found. Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651'} Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 could not be found. Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:39:08.602639 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:39:08.607428 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 could not be found. Jun 20 12:39:08.607428 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:39:08.607428 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:39:08.607428 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:39:08.607428 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:39:08.607428 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:39:08.607428 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:39:08.607428 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:39:08.607428 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:39:08.607428 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 could not be found. Jun 20 12:39:08.607428 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:39:08.607428 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-31ff584b-d98f-49f4-9ddc-a430941660ea tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Returning 404 to user: Instance 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:39:08.607428 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-31ff584b-d98f-49f4-9ddc-a430941660ea tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651" status: 404 len: 111 microversion: 2.1 time: 0.031652 Jun 20 12:39:08.607428 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3218/6532] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:39:08 2022] DELETE /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:39:08.613741 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4181409e-5076-4383-95c5-c8192ef97ee7 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:39:08.614355 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4181409e-5076-4383-95c5-c8192ef97ee7 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:39:08.620944 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4181409e-5076-4383-95c5-c8192ef97ee7 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:08.621397 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4181409e-5076-4383-95c5-c8192ef97ee7 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:08.622169 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4181409e-5076-4383-95c5-c8192ef97ee7 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:08.622607 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4181409e-5076-4383-95c5-c8192ef97ee7 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:08.636627 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-4181409e-5076-4383-95c5-c8192ef97ee7 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] HTTP exception thrown: Instance 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 could not be found. Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4181409e-5076-4383-95c5-c8192ef97ee7 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Request method failure captured: Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 HTTP/1.1 Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGimx3rD_FK4OQ1VdtIOQm_v9s-kKgn6vXzR6ZBiLlIplOW4i7RkYQinkTG1vfKGKwCaoPCprnA7Fw3J7TUX4keyVZVyA-ioRTCduqhd5tDd7aG1Qjuo-15G-XSI8qoUHjPCuXgPU-jMwTPPkfuUfoqrsDV0KX5Zoa18ctkNwDakrYM Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: f4714cac56094f9e9d4ed4adb400064e Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: f4714cac56094f9e9d4ed4adb400064e Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-AttachVolumeNegativeTest-1470856820-project Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 2c8b3f11a7294fbd9d750b1fbbeaa65b Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-AttachVolumeNegativeTest-1470856820-project Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 could not be found. Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651'} Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 could not be found. Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 could not be found. Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:39:08.638171 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:39:08.642205 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:39:08.642205 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:39:08.642205 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:39:08.642205 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:39:08.642205 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:39:08.642205 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 could not be found. Jun 20 12:39:08.642205 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:39:08.642205 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4181409e-5076-4383-95c5-c8192ef97ee7 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Returning 404 to user: Instance 8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:39:08.642205 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4181409e-5076-4383-95c5-c8192ef97ee7 tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651" status: 404 len: 111 microversion: 2.1 time: 0.029811 Jun 20 12:39:08.642205 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3315/6533] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:39:08 2022] GET /compute/v2.1/servers/8e4dbb7b-1ac7-4cb5-a2f2-c2364cf44651 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:39:11.909363 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-46096df2-833c-4294-b87c-c9ab016cdcda tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:39:11.909915 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-46096df2-833c-4294-b87c-c9ab016cdcda tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 028600e9-6eb6-42ac-b62e-de21666d744e] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:39:11.917941 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-46096df2-833c-4294-b87c-c9ab016cdcda tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:11.918728 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-46096df2-833c-4294-b87c-c9ab016cdcda tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:11.919574 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-46096df2-833c-4294-b87c-c9ab016cdcda tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:11.920085 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-46096df2-833c-4294-b87c-c9ab016cdcda tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:11.934526 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-46096df2-833c-4294-b87c-c9ab016cdcda tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] HTTP exception thrown: Instance 028600e9-6eb6-42ac-b62e-de21666d744e could not be found. Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-46096df2-833c-4294-b87c-c9ab016cdcda tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Request method failure captured: Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e HTTP/1.1 Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGimx3rD_FK4OQ1VdtIOQm_v9s-kKgn6vXzR6ZBiLlIplOW4i7RkYQinkTG1vfKGKwCaoPCprnA7Fw3J7TUX4keyVZVyA-ioRTCduqhd5tDd7aG1Qjuo-15G-XSI8qoUHjPCuXgPU-jMwTPPkfuUfoqrsDV0KX5Zoa18ctkNwDakrYM Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: f4714cac56094f9e9d4ed4adb400064e Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: f4714cac56094f9e9d4ed4adb400064e Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-AttachVolumeNegativeTest-1470856820-project Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 2c8b3f11a7294fbd9d750b1fbbeaa65b Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-AttachVolumeNegativeTest-1470856820-project Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 028600e9-6eb6-42ac-b62e-de21666d744e could not be found. Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '028600e9-6eb6-42ac-b62e-de21666d744e'} Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 028600e9-6eb6-42ac-b62e-de21666d744e could not be found. Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:39:11.936254 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:39:11.940799 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 028600e9-6eb6-42ac-b62e-de21666d744e could not be found. Jun 20 12:39:11.940799 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:39:11.940799 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:39:11.940799 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:39:11.940799 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:39:11.940799 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:39:11.940799 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:39:11.940799 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:39:11.940799 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:39:11.940799 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 028600e9-6eb6-42ac-b62e-de21666d744e could not be found. Jun 20 12:39:11.940799 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:39:11.940799 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-46096df2-833c-4294-b87c-c9ab016cdcda tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Returning 404 to user: Instance 028600e9-6eb6-42ac-b62e-de21666d744e could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:39:11.940799 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-46096df2-833c-4294-b87c-c9ab016cdcda tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "DELETE /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e" status: 404 len: 111 microversion: 2.1 time: 0.034056 Jun 20 12:39:11.941791 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3219/6534] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:39:11 2022] DELETE /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:39:11.953478 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ecf48ad3-0049-423f-b6d8-8fb49727a6ad tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:39:11.954098 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ecf48ad3-0049-423f-b6d8-8fb49727a6ad tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] [instance: 028600e9-6eb6-42ac-b62e-de21666d744e] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:39:11.961368 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ecf48ad3-0049-423f-b6d8-8fb49727a6ad tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:11.961819 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ecf48ad3-0049-423f-b6d8-8fb49727a6ad tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:11.962600 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ecf48ad3-0049-423f-b6d8-8fb49727a6ad tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:11.963173 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ecf48ad3-0049-423f-b6d8-8fb49727a6ad tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:11.980471 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-ecf48ad3-0049-423f-b6d8-8fb49727a6ad tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] HTTP exception thrown: Instance 028600e9-6eb6-42ac-b62e-de21666d744e could not be found. Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ecf48ad3-0049-423f-b6d8-8fb49727a6ad tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Request method failure captured: Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e HTTP/1.1 Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGimx3rD_FK4OQ1VdtIOQm_v9s-kKgn6vXzR6ZBiLlIplOW4i7RkYQinkTG1vfKGKwCaoPCprnA7Fw3J7TUX4keyVZVyA-ioRTCduqhd5tDd7aG1Qjuo-15G-XSI8qoUHjPCuXgPU-jMwTPPkfuUfoqrsDV0KX5Zoa18ctkNwDakrYM Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: f4714cac56094f9e9d4ed4adb400064e Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f4714cac56094f9e9d4ed4adb400064e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: f4714cac56094f9e9d4ed4adb400064e Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1470856820 Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-AttachVolumeNegativeTest-1470856820-project Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 2c8b3f11a7294fbd9d750b1fbbeaa65b Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-AttachVolumeNegativeTest-1470856820-project Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 028600e9-6eb6-42ac-b62e-de21666d744e could not be found. Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '028600e9-6eb6-42ac-b62e-de21666d744e'} Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 028600e9-6eb6-42ac-b62e-de21666d744e could not be found. Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 028600e9-6eb6-42ac-b62e-de21666d744e could not be found. Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:39:11.982192 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:39:11.990187 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:39:11.990187 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:39:11.990187 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:39:11.990187 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:39:11.990187 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:39:11.990187 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 028600e9-6eb6-42ac-b62e-de21666d744e could not be found. Jun 20 12:39:11.990187 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:39:11.990187 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ecf48ad3-0049-423f-b6d8-8fb49727a6ad tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] Returning 404 to user: Instance 028600e9-6eb6-42ac-b62e-de21666d744e could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:39:11.990187 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ecf48ad3-0049-423f-b6d8-8fb49727a6ad tempest-AttachVolumeNegativeTest-1470856820 tempest-AttachVolumeNegativeTest-1470856820-project] 10.222.0.27 "GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e" status: 404 len: 111 microversion: 2.1 time: 0.035137 Jun 20 12:39:11.990187 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3316/6535] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:39:11 2022] GET /compute/v2.1/servers/028600e9-6eb6-42ac-b62e-de21666d744e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:39:24.694787 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6ffe89e9-0841-4f05-b3ed-f62876d364aa tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:39:24.695408 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6ffe89e9-0841-4f05-b3ed-f62876d364aa tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] [instance: 9400896f-d98f-4e50-896b-632b7cd9642f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:39:24.698432 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:39:24.699193 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:39:24.707444 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ffe89e9-0841-4f05-b3ed-f62876d364aa tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:24.707913 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ffe89e9-0841-4f05-b3ed-f62876d364aa tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:24.708757 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ffe89e9-0841-4f05-b3ed-f62876d364aa tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:24.709211 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6ffe89e9-0841-4f05-b3ed-f62876d364aa tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:24.822641 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-6ffe89e9-0841-4f05-b3ed-f62876d364aa tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lazy-loading 'services' on Instance uuid 9400896f-d98f-4e50-896b-632b7cd9642f {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:39:24.916886 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6ffe89e9-0841-4f05-b3ed-f62876d364aa tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9400896f-d98f-4e50-896b-632b7cd9642f/os-volume_attachments/1a07dca1-5e2f-46bf-9ebd-7d1379e9b5c6" status: 202 len: 0 microversion: 2.1 time: 0.225999 Jun 20 12:39:24.917977 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3220/6536] 10.222.0.27 () {58 vars in 1415 bytes} [Mon Jun 20 12:39:24 2022] DELETE /compute/v2.1/servers/9400896f-d98f-4e50-896b-632b7cd9642f/os-volume_attachments/1a07dca1-5e2f-46bf-9ebd-7d1379e9b5c6 => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:39:30.339531 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3c0100dd-a364-4923-aac8-a68e5e50aa51 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:39:30.340324 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3c0100dd-a364-4923-aac8-a68e5e50aa51 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] [instance: 9400896f-d98f-4e50-896b-632b7cd9642f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:39:30.344271 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:39:30.345062 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=17 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:39:30.349223 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c0100dd-a364-4923-aac8-a68e5e50aa51 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:30.349683 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c0100dd-a364-4923-aac8-a68e5e50aa51 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:30.350460 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c0100dd-a364-4923-aac8-a68e5e50aa51 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:30.350900 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c0100dd-a364-4923-aac8-a68e5e50aa51 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:30.381384 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3c0100dd-a364-4923-aac8-a68e5e50aa51 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] [instance: 9400896f-d98f-4e50-896b-632b7cd9642f] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:39:30.490569 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3c0100dd-a364-4923-aac8-a68e5e50aa51 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9400896f-d98f-4e50-896b-632b7cd9642f" status: 204 len: 0 microversion: 2.1 time: 0.153267 Jun 20 12:39:30.495362 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3317/6537] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:39:30 2022] DELETE /compute/v2.1/servers/9400896f-d98f-4e50-896b-632b7cd9642f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:39:30.503346 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0ab80d70-0588-4573-84d1-1572b234ad2f tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:39:30.505292 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0ab80d70-0588-4573-84d1-1572b234ad2f tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] [instance: 9400896f-d98f-4e50-896b-632b7cd9642f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:39:30.515355 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0ab80d70-0588-4573-84d1-1572b234ad2f tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:30.516083 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0ab80d70-0588-4573-84d1-1572b234ad2f tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:30.517082 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0ab80d70-0588-4573-84d1-1572b234ad2f tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:30.517627 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0ab80d70-0588-4573-84d1-1572b234ad2f tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:30.670321 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0ab80d70-0588-4573-84d1-1572b234ad2f tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248fe9cf0934faaaa1059c0a67cdccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f5f5f354946d391db10d490ca8764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:39:30.680830 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0ab80d70-0588-4573-84d1-1572b234ad2f tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] 10.222.0.27 "GET /compute/v2.1/servers/9400896f-d98f-4e50-896b-632b7cd9642f" status: 200 len: 1514 microversion: 2.1 time: 0.183289 Jun 20 12:39:30.681917 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3221/6538] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:39:30 2022] GET /compute/v2.1/servers/9400896f-d98f-4e50-896b-632b7cd9642f => generated 1514 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:39:31.700772 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-93dc009e-61f5-48e8-974a-d17ea866852b tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:39:31.702442 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-93dc009e-61f5-48e8-974a-d17ea866852b tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] [instance: 9400896f-d98f-4e50-896b-632b7cd9642f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:39:31.711719 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93dc009e-61f5-48e8-974a-d17ea866852b tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:31.712332 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93dc009e-61f5-48e8-974a-d17ea866852b tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:31.713542 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93dc009e-61f5-48e8-974a-d17ea866852b tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:31.714006 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93dc009e-61f5-48e8-974a-d17ea866852b tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:31.882011 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-93dc009e-61f5-48e8-974a-d17ea866852b tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248fe9cf0934faaaa1059c0a67cdccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f5f5f354946d391db10d490ca8764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:39:31.894386 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-93dc009e-61f5-48e8-974a-d17ea866852b tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] 10.222.0.27 "GET /compute/v2.1/servers/9400896f-d98f-4e50-896b-632b7cd9642f" status: 200 len: 1514 microversion: 2.1 time: 0.198923 Jun 20 12:39:31.895096 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3318/6539] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:39:31 2022] GET /compute/v2.1/servers/9400896f-d98f-4e50-896b-632b7cd9642f => generated 1514 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:39:32.470618 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-86a2a547-0324-457c-b93c-1802d566a39a req-ef8eb331-7d8c-485c-a1de-82763d1663e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9400896f-d98f-4e50-896b-632b7cd9642f", "name": "network-vif-deleted", "tag": "e05da339-4d14-4b4a-be8a-312bcc92a82f"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:39:32.480268 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-86a2a547-0324-457c-b93c-1802d566a39a req-ef8eb331-7d8c-485c-a1de-82763d1663e7 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:32.481056 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-86a2a547-0324-457c-b93c-1802d566a39a req-ef8eb331-7d8c-485c-a1de-82763d1663e7 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:32.499478 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-86a2a547-0324-457c-b93c-1802d566a39a req-ef8eb331-7d8c-485c-a1de-82763d1663e7 service nova] Creating event network-vif-deleted:e05da339-4d14-4b4a-be8a-312bcc92a82f for instance 9400896f-d98f-4e50-896b-632b7cd9642f on n-h1-master-1 Jun 20 12:39:32.504533 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-86a2a547-0324-457c-b93c-1802d566a39a req-ef8eb331-7d8c-485c-a1de-82763d1663e7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040453 Jun 20 12:39:32.505148 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3222/6540] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:39:32.914524 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-baa245dc-0ae0-49da-8323-9d5e481a12e7 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:39:32.915131 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-baa245dc-0ae0-49da-8323-9d5e481a12e7 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] [instance: 9400896f-d98f-4e50-896b-632b7cd9642f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:39:32.923261 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-baa245dc-0ae0-49da-8323-9d5e481a12e7 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:32.923787 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-baa245dc-0ae0-49da-8323-9d5e481a12e7 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:32.924608 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-baa245dc-0ae0-49da-8323-9d5e481a12e7 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:32.925037 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-baa245dc-0ae0-49da-8323-9d5e481a12e7 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:32.973450 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-baa245dc-0ae0-49da-8323-9d5e481a12e7 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:32.973938 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-baa245dc-0ae0-49da-8323-9d5e481a12e7 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:32.974393 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-baa245dc-0ae0-49da-8323-9d5e481a12e7 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lazy-loading 'fault' on Instance uuid 9400896f-d98f-4e50-896b-632b7cd9642f {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:39:33.018813 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-baa245dc-0ae0-49da-8323-9d5e481a12e7 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248fe9cf0934faaaa1059c0a67cdccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f5f5f354946d391db10d490ca8764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:39:33.026254 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-baa245dc-0ae0-49da-8323-9d5e481a12e7 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] 10.222.0.27 "GET /compute/v2.1/servers/9400896f-d98f-4e50-896b-632b7cd9642f" status: 200 len: 1308 microversion: 2.1 time: 0.117373 Jun 20 12:39:33.027002 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3319/6541] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:39:32 2022] GET /compute/v2.1/servers/9400896f-d98f-4e50-896b-632b7cd9642f => generated 1308 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:39:34.046139 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-79ecc11d-cbdb-4798-bdac-22f3ec642888 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:39:34.046867 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-79ecc11d-cbdb-4798-bdac-22f3ec642888 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] [instance: 9400896f-d98f-4e50-896b-632b7cd9642f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:39:34.053524 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-79ecc11d-cbdb-4798-bdac-22f3ec642888 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:34.053992 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-79ecc11d-cbdb-4798-bdac-22f3ec642888 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:34.054801 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-79ecc11d-cbdb-4798-bdac-22f3ec642888 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:34.055254 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-79ecc11d-cbdb-4798-bdac-22f3ec642888 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:34.069944 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-79ecc11d-cbdb-4798-bdac-22f3ec642888 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] HTTP exception thrown: Instance 9400896f-d98f-4e50-896b-632b7cd9642f could not be found. Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-79ecc11d-cbdb-4798-bdac-22f3ec642888 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Request method failure captured: Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/9400896f-d98f-4e50-896b-632b7cd9642f HTTP/1.1 Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGoIQ4Ki60V9RMx2wYiwwQqRg6BVyK7Hn6hnat0EIiPn-rfJrPbJXaKywVEVgRuYgo17Uf43__TDD69fur3l9I5t_IqDmS1J08sU1A7FtBBLVzMwq2e57zziqDqMFA02KAPSg41kvFiZtZB2p98Nyp7XM6CJ7Kc0hFOqldLov-0lYRw Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 3d7f5f5f354946d391db10d490ca8764 Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1317344980 Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d7f5f5f354946d391db10d490ca8764"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d7f5f5f354946d391db10d490ca8764"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3d7f5f5f354946d391db10d490ca8764"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3d7f5f5f354946d391db10d490ca8764"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-VolumesSnapshotTestJSON-1317344980 Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 3d7f5f5f354946d391db10d490ca8764 Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1317344980 Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-VolumesSnapshotTestJSON-1317344980-project Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 0248fe9cf0934faaaa1059c0a67cdccf Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-VolumesSnapshotTestJSON-1317344980-project Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 9400896f-d98f-4e50-896b-632b7cd9642f could not be found. Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '9400896f-d98f-4e50-896b-632b7cd9642f'} Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9400896f-d98f-4e50-896b-632b7cd9642f could not be found. Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9400896f-d98f-4e50-896b-632b7cd9642f could not be found. Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:39:34.071650 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:39:34.078260 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:39:34.078260 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:39:34.078260 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:39:34.078260 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:39:34.078260 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:39:34.078260 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9400896f-d98f-4e50-896b-632b7cd9642f could not be found. Jun 20 12:39:34.078260 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:39:34.078260 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-79ecc11d-cbdb-4798-bdac-22f3ec642888 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Returning 404 to user: Instance 9400896f-d98f-4e50-896b-632b7cd9642f could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:39:34.078260 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-79ecc11d-cbdb-4798-bdac-22f3ec642888 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] 10.222.0.27 "GET /compute/v2.1/servers/9400896f-d98f-4e50-896b-632b7cd9642f" status: 404 len: 111 microversion: 2.1 time: 0.032973 Jun 20 12:39:34.078260 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3223/6542] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:39:34 2022] GET /compute/v2.1/servers/9400896f-d98f-4e50-896b-632b7cd9642f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:39:41.069263 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1549b8cb-5394-43e6-a615-c9b68e25e4ed tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2040869247", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "672a7f33-6fd0-4c9b-b1fa-282f7ce581e1"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:39:41.139607 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-1549b8cb-5394-43e6-a615-c9b68e25e4ed tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] validate_networks() for [('672a7f33-6fd0-4c9b-b1fa-282f7ce581e1', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:39:41.730558 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-1549b8cb-5394-43e6-a615-c9b68e25e4ed tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:39:41.731253 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-1549b8cb-5394-43e6-a615-c9b68e25e4ed tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:39:41.731799 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-1549b8cb-5394-43e6-a615-c9b68e25e4ed tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:39:41.732419 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-1549b8cb-5394-43e6-a615-c9b68e25e4ed tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:39:41.732893 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-1549b8cb-5394-43e6-a615-c9b68e25e4ed tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:39:41.744916 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1549b8cb-5394-43e6-a615-c9b68e25e4ed tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:41.745748 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1549b8cb-5394-43e6-a615-c9b68e25e4ed tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:41.746616 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1549b8cb-5394-43e6-a615-c9b68e25e4ed tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:41.747409 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1549b8cb-5394-43e6-a615-c9b68e25e4ed tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:41.766524 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-1549b8cb-5394-43e6-a615-c9b68e25e4ed tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Getting quotas for project 3d7f5f5f354946d391db10d490ca8764. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:39:41.772368 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-1549b8cb-5394-43e6-a615-c9b68e25e4ed tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Getting quotas for user 0248fe9cf0934faaaa1059c0a67cdccf and project 3d7f5f5f354946d391db10d490ca8764. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:39:41.786163 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1549b8cb-5394-43e6-a615-c9b68e25e4ed tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:39:41.788480 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1549b8cb-5394-43e6-a615-c9b68e25e4ed tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] [instance: 7140aef3-477b-4392-a8db-317e16d27210] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:39:41.839266 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1549b8cb-5394-43e6-a615-c9b68e25e4ed tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.775295 Jun 20 12:39:41.840191 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3320/6543] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:39:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:39:41.851970 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-35c5df06-ef12-4a46-bfdd-5d2a9e55ff54 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:39:41.852905 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-35c5df06-ef12-4a46-bfdd-5d2a9e55ff54 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] [instance: 7140aef3-477b-4392-a8db-317e16d27210] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:39:41.967141 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-35c5df06-ef12-4a46-bfdd-5d2a9e55ff54 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248fe9cf0934faaaa1059c0a67cdccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f5f5f354946d391db10d490ca8764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:39:41.981277 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-35c5df06-ef12-4a46-bfdd-5d2a9e55ff54 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] 10.222.0.27 "GET /compute/v2.1/servers/7140aef3-477b-4392-a8db-317e16d27210" status: 200 len: 1219 microversion: 2.1 time: 0.133701 Jun 20 12:39:41.982770 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3224/6544] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:39:41 2022] GET /compute/v2.1/servers/7140aef3-477b-4392-a8db-317e16d27210 => generated 1219 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:39:43.004565 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c988d71e-4533-43fe-9a35-219bb00465b0 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:39:43.005812 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c988d71e-4533-43fe-9a35-219bb00465b0 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] [instance: 7140aef3-477b-4392-a8db-317e16d27210] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:39:43.014452 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c988d71e-4533-43fe-9a35-219bb00465b0 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:43.014921 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c988d71e-4533-43fe-9a35-219bb00465b0 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:43.015710 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c988d71e-4533-43fe-9a35-219bb00465b0 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:43.016755 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c988d71e-4533-43fe-9a35-219bb00465b0 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:43.097528 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c988d71e-4533-43fe-9a35-219bb00465b0 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248fe9cf0934faaaa1059c0a67cdccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f5f5f354946d391db10d490ca8764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:39:43.111595 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c988d71e-4533-43fe-9a35-219bb00465b0 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] 10.222.0.27 "GET /compute/v2.1/servers/7140aef3-477b-4392-a8db-317e16d27210" status: 200 len: 1271 microversion: 2.1 time: 0.113547 Jun 20 12:39:43.112796 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3321/6545] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:39:42 2022] GET /compute/v2.1/servers/7140aef3-477b-4392-a8db-317e16d27210 => generated 1271 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:39:44.128769 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-94d1d50b-536e-4b3b-bf6d-2bce03675530 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:39:44.129398 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-94d1d50b-536e-4b3b-bf6d-2bce03675530 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] [instance: 7140aef3-477b-4392-a8db-317e16d27210] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:39:44.131863 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:39:44.139882 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94d1d50b-536e-4b3b-bf6d-2bce03675530 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:44.140388 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94d1d50b-536e-4b3b-bf6d-2bce03675530 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:44.141214 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94d1d50b-536e-4b3b-bf6d-2bce03675530 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:44.141637 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94d1d50b-536e-4b3b-bf6d-2bce03675530 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:44.339002 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-94d1d50b-536e-4b3b-bf6d-2bce03675530 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248fe9cf0934faaaa1059c0a67cdccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f5f5f354946d391db10d490ca8764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:39:44.347627 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-94d1d50b-536e-4b3b-bf6d-2bce03675530 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] 10.222.0.27 "GET /compute/v2.1/servers/7140aef3-477b-4392-a8db-317e16d27210" status: 200 len: 1319 microversion: 2.1 time: 0.222810 Jun 20 12:39:44.348234 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3225/6546] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:39:44 2022] GET /compute/v2.1/servers/7140aef3-477b-4392-a8db-317e16d27210 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:39:44.625663 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-4b5657c6-eb28-407f-bec3-14d5ba89301a req-04ceaad9-700c-4e5c-a212-550338355716 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7140aef3-477b-4392-a8db-317e16d27210", "tag": "25bb622e-d36c-4904-acb8-49a0df67632b"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:39:44.636974 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-4b5657c6-eb28-407f-bec3-14d5ba89301a req-04ceaad9-700c-4e5c-a212-550338355716 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:44.637728 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-4b5657c6-eb28-407f-bec3-14d5ba89301a req-04ceaad9-700c-4e5c-a212-550338355716 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:44.649864 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-4b5657c6-eb28-407f-bec3-14d5ba89301a req-04ceaad9-700c-4e5c-a212-550338355716 service nova] Creating event network-changed:25bb622e-d36c-4904-acb8-49a0df67632b for instance 7140aef3-477b-4392-a8db-317e16d27210 on n-h1-master-1 Jun 20 12:39:44.655358 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-4b5657c6-eb28-407f-bec3-14d5ba89301a req-04ceaad9-700c-4e5c-a212-550338355716 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034648 Jun 20 12:39:44.656066 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3322/6547] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:39:45.364407 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-305f476f-e526-4bba-98fc-2324a9973b38 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:39:45.365065 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-305f476f-e526-4bba-98fc-2324a9973b38 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] [instance: 7140aef3-477b-4392-a8db-317e16d27210] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:39:45.372410 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-305f476f-e526-4bba-98fc-2324a9973b38 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:45.373284 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-305f476f-e526-4bba-98fc-2324a9973b38 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:45.374064 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-305f476f-e526-4bba-98fc-2324a9973b38 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:45.374511 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-305f476f-e526-4bba-98fc-2324a9973b38 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:45.510388 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-305f476f-e526-4bba-98fc-2324a9973b38 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248fe9cf0934faaaa1059c0a67cdccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f5f5f354946d391db10d490ca8764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:39:45.519281 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-305f476f-e526-4bba-98fc-2324a9973b38 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] 10.222.0.27 "GET /compute/v2.1/servers/7140aef3-477b-4392-a8db-317e16d27210" status: 200 len: 1319 microversion: 2.1 time: 0.158664 Jun 20 12:39:45.520111 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3226/6548] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:39:45 2022] GET /compute/v2.1/servers/7140aef3-477b-4392-a8db-317e16d27210 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:39:46.537702 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e4508669-c723-4677-977d-882b62d80452 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:39:46.539116 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e4508669-c723-4677-977d-882b62d80452 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] [instance: 7140aef3-477b-4392-a8db-317e16d27210] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:39:46.547698 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e4508669-c723-4677-977d-882b62d80452 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:46.548574 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e4508669-c723-4677-977d-882b62d80452 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:46.549610 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e4508669-c723-4677-977d-882b62d80452 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:46.550254 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e4508669-c723-4677-977d-882b62d80452 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:46.725877 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e4508669-c723-4677-977d-882b62d80452 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248fe9cf0934faaaa1059c0a67cdccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f5f5f354946d391db10d490ca8764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:39:46.733908 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e4508669-c723-4677-977d-882b62d80452 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] 10.222.0.27 "GET /compute/v2.1/servers/7140aef3-477b-4392-a8db-317e16d27210" status: 200 len: 1319 microversion: 2.1 time: 0.200830 Jun 20 12:39:46.734581 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3323/6549] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:39:46 2022] GET /compute/v2.1/servers/7140aef3-477b-4392-a8db-317e16d27210 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:39:47.751054 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4e20de88-612a-4e97-86da-d151844f7e4b tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:39:47.751669 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4e20de88-612a-4e97-86da-d151844f7e4b tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] [instance: 7140aef3-477b-4392-a8db-317e16d27210] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:39:47.759383 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4e20de88-612a-4e97-86da-d151844f7e4b tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:47.759841 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4e20de88-612a-4e97-86da-d151844f7e4b tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:47.760657 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4e20de88-612a-4e97-86da-d151844f7e4b tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:47.761139 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4e20de88-612a-4e97-86da-d151844f7e4b tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:47.905094 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4e20de88-612a-4e97-86da-d151844f7e4b tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248fe9cf0934faaaa1059c0a67cdccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f5f5f354946d391db10d490ca8764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:39:47.913671 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4e20de88-612a-4e97-86da-d151844f7e4b tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] 10.222.0.27 "GET /compute/v2.1/servers/7140aef3-477b-4392-a8db-317e16d27210" status: 200 len: 1319 microversion: 2.1 time: 0.166661 Jun 20 12:39:47.914264 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3227/6550] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:39:47 2022] GET /compute/v2.1/servers/7140aef3-477b-4392-a8db-317e16d27210 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:39:48.930698 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-96245265-49a3-4d83-9a84-525cc3bb10c7 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:39:48.931237 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-96245265-49a3-4d83-9a84-525cc3bb10c7 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] [instance: 7140aef3-477b-4392-a8db-317e16d27210] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:39:48.939261 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-96245265-49a3-4d83-9a84-525cc3bb10c7 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:48.939816 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-96245265-49a3-4d83-9a84-525cc3bb10c7 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:48.940858 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-96245265-49a3-4d83-9a84-525cc3bb10c7 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:48.941366 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-96245265-49a3-4d83-9a84-525cc3bb10c7 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:49.344278 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-96245265-49a3-4d83-9a84-525cc3bb10c7 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248fe9cf0934faaaa1059c0a67cdccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f5f5f354946d391db10d490ca8764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:39:49.352222 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-96245265-49a3-4d83-9a84-525cc3bb10c7 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] 10.222.0.27 "GET /compute/v2.1/servers/7140aef3-477b-4392-a8db-317e16d27210" status: 200 len: 1319 microversion: 2.1 time: 0.425477 Jun 20 12:39:49.352913 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3324/6551] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:39:48 2022] GET /compute/v2.1/servers/7140aef3-477b-4392-a8db-317e16d27210 => generated 1319 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:39:50.370607 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-62e7c19c-32a0-4805-9b44-4c63dd8cd885 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:39:50.373731 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-62e7c19c-32a0-4805-9b44-4c63dd8cd885 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] [instance: 7140aef3-477b-4392-a8db-317e16d27210] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:39:50.390353 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-62e7c19c-32a0-4805-9b44-4c63dd8cd885 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:50.391057 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-62e7c19c-32a0-4805-9b44-4c63dd8cd885 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:50.392325 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-62e7c19c-32a0-4805-9b44-4c63dd8cd885 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:50.393415 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-62e7c19c-32a0-4805-9b44-4c63dd8cd885 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:50.564077 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-62e7c19c-32a0-4805-9b44-4c63dd8cd885 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248fe9cf0934faaaa1059c0a67cdccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f5f5f354946d391db10d490ca8764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:39:50.574659 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-62e7c19c-32a0-4805-9b44-4c63dd8cd885 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] 10.222.0.27 "GET /compute/v2.1/servers/7140aef3-477b-4392-a8db-317e16d27210" status: 200 len: 1319 microversion: 2.1 time: 0.208480 Jun 20 12:39:50.575518 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3325/6552] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:39:50 2022] GET /compute/v2.1/servers/7140aef3-477b-4392-a8db-317e16d27210 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:39:50.594094 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-7ca2ca6c-a6f6-48d3-bdd1-759fbc7ce1a2 req-09ce04c9-581e-4503-b7b4-ab14eaf69dfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7140aef3-477b-4392-a8db-317e16d27210", "name": "network-vif-plugged", "status": "completed", "tag": "25bb622e-d36c-4904-acb8-49a0df67632b"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:39:50.603620 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-7ca2ca6c-a6f6-48d3-bdd1-759fbc7ce1a2 req-09ce04c9-581e-4503-b7b4-ab14eaf69dfd service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:50.604643 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-7ca2ca6c-a6f6-48d3-bdd1-759fbc7ce1a2 req-09ce04c9-581e-4503-b7b4-ab14eaf69dfd service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:50.616852 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-7ca2ca6c-a6f6-48d3-bdd1-759fbc7ce1a2 req-09ce04c9-581e-4503-b7b4-ab14eaf69dfd service nova] Creating event network-vif-plugged:25bb622e-d36c-4904-acb8-49a0df67632b for instance 7140aef3-477b-4392-a8db-317e16d27210 on n-h1-master-1 Jun 20 12:39:50.621925 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-7ca2ca6c-a6f6-48d3-bdd1-759fbc7ce1a2 req-09ce04c9-581e-4503-b7b4-ab14eaf69dfd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.261110 Jun 20 12:39:50.622589 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3228/6553] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:39:51.593883 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-87881eb9-3c72-4db1-83b9-c2a6e0f438a7 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:39:51.595300 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-87881eb9-3c72-4db1-83b9-c2a6e0f438a7 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] [instance: 7140aef3-477b-4392-a8db-317e16d27210] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:39:51.604869 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-87881eb9-3c72-4db1-83b9-c2a6e0f438a7 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:51.605593 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-87881eb9-3c72-4db1-83b9-c2a6e0f438a7 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:51.607259 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-87881eb9-3c72-4db1-83b9-c2a6e0f438a7 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:51.609019 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-87881eb9-3c72-4db1-83b9-c2a6e0f438a7 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:51.756703 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:39:51.780787 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:39:51.827050 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-87881eb9-3c72-4db1-83b9-c2a6e0f438a7 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248fe9cf0934faaaa1059c0a67cdccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f5f5f354946d391db10d490ca8764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:39:51.836820 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-87881eb9-3c72-4db1-83b9-c2a6e0f438a7 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] 10.222.0.27 "GET /compute/v2.1/servers/7140aef3-477b-4392-a8db-317e16d27210" status: 200 len: 1319 microversion: 2.1 time: 0.247547 Jun 20 12:39:51.845114 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3326/6554] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:39:51 2022] GET /compute/v2.1/servers/7140aef3-477b-4392-a8db-317e16d27210 => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:39:52.853366 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:39:52.859626 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e509f143-37f8-491f-b37b-f1759b7819cd tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:39:52.860712 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e509f143-37f8-491f-b37b-f1759b7819cd tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] [instance: 7140aef3-477b-4392-a8db-317e16d27210] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:39:52.871233 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e509f143-37f8-491f-b37b-f1759b7819cd tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:52.871774 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e509f143-37f8-491f-b37b-f1759b7819cd tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:52.872848 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e509f143-37f8-491f-b37b-f1759b7819cd tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:52.873412 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e509f143-37f8-491f-b37b-f1759b7819cd tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:53.151631 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e509f143-37f8-491f-b37b-f1759b7819cd tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248fe9cf0934faaaa1059c0a67cdccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f5f5f354946d391db10d490ca8764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:39:53.161339 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e509f143-37f8-491f-b37b-f1759b7819cd tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] 10.222.0.27 "GET /compute/v2.1/servers/7140aef3-477b-4392-a8db-317e16d27210" status: 200 len: 1509 microversion: 2.1 time: 0.309451 Jun 20 12:39:53.162799 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3229/6555] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:39:52 2022] GET /compute/v2.1/servers/7140aef3-477b-4392-a8db-317e16d27210 => generated 1509 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:39:53.183547 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ea0d78e0-d377-42bf-abc0-60a2ee0066fd tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8cef04ea-a1eb-4bce-ab5a-973cf4a0a85d", "device": "/dev/sdb"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:39:53.186522 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ea0d78e0-d377-42bf-abc0-60a2ee0066fd tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] [instance: 7140aef3-477b-4392-a8db-317e16d27210] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:39:53.197077 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea0d78e0-d377-42bf-abc0-60a2ee0066fd tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:53.197903 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea0d78e0-d377-42bf-abc0-60a2ee0066fd tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:53.199072 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea0d78e0-d377-42bf-abc0-60a2ee0066fd tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:39:53.199590 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea0d78e0-d377-42bf-abc0-60a2ee0066fd tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:39:53.533881 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ea0d78e0-d377-42bf-abc0-60a2ee0066fd tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] 10.222.0.27 "POST /compute/v2.1/servers/7140aef3-477b-4392-a8db-317e16d27210/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.357311 Jun 20 12:39:53.535135 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3327/6556] 10.222.0.27 () {60 vars in 1322 bytes} [Mon Jun 20 12:39:53 2022] POST /compute/v2.1/servers/7140aef3-477b-4392-a8db-317e16d27210/os-volume_attachments => generated 194 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:40:16.551920 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8a53add3-9224-44ae-81ea-45478e1d82db tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:40:16.553381 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8a53add3-9224-44ae-81ea-45478e1d82db tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] [instance: 7140aef3-477b-4392-a8db-317e16d27210] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:40:16.560875 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=22 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:40:16.562585 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=26 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:40:16.566071 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8a53add3-9224-44ae-81ea-45478e1d82db tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:40:16.567260 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8a53add3-9224-44ae-81ea-45478e1d82db tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:40:16.569760 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8a53add3-9224-44ae-81ea-45478e1d82db tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:40:16.570844 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8a53add3-9224-44ae-81ea-45478e1d82db tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:40:16.672947 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-8a53add3-9224-44ae-81ea-45478e1d82db tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lazy-loading 'services' on Instance uuid 7140aef3-477b-4392-a8db-317e16d27210 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:40:16.781773 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8a53add3-9224-44ae-81ea-45478e1d82db tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7140aef3-477b-4392-a8db-317e16d27210/os-volume_attachments/8cef04ea-a1eb-4bce-ab5a-973cf4a0a85d" status: 202 len: 0 microversion: 2.1 time: 0.233818 Jun 20 12:40:16.782514 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3230/6557] 10.222.0.27 () {58 vars in 1415 bytes} [Mon Jun 20 12:40:16 2022] DELETE /compute/v2.1/servers/7140aef3-477b-4392-a8db-317e16d27210/os-volume_attachments/8cef04ea-a1eb-4bce-ab5a-973cf4a0a85d => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:40:22.251490 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-182ce59f-41b8-478b-a8f7-d53d166392c4 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:40:22.252162 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-182ce59f-41b8-478b-a8f7-d53d166392c4 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] [instance: 7140aef3-477b-4392-a8db-317e16d27210] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:40:22.255031 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:40:22.255729 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:40:22.262349 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-182ce59f-41b8-478b-a8f7-d53d166392c4 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:40:22.262819 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-182ce59f-41b8-478b-a8f7-d53d166392c4 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:40:22.263623 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-182ce59f-41b8-478b-a8f7-d53d166392c4 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:40:22.264068 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-182ce59f-41b8-478b-a8f7-d53d166392c4 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:40:22.298389 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-182ce59f-41b8-478b-a8f7-d53d166392c4 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] [instance: 7140aef3-477b-4392-a8db-317e16d27210] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:40:22.397388 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-182ce59f-41b8-478b-a8f7-d53d166392c4 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7140aef3-477b-4392-a8db-317e16d27210" status: 204 len: 0 microversion: 2.1 time: 0.152166 Jun 20 12:40:22.398095 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3328/6558] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:40:22 2022] DELETE /compute/v2.1/servers/7140aef3-477b-4392-a8db-317e16d27210 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:40:22.407216 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b4a75adb-4dc1-418f-9d23-73b6fdd9fa5d tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:40:22.409477 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b4a75adb-4dc1-418f-9d23-73b6fdd9fa5d tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] [instance: 7140aef3-477b-4392-a8db-317e16d27210] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:40:22.416001 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b4a75adb-4dc1-418f-9d23-73b6fdd9fa5d tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:40:22.416515 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b4a75adb-4dc1-418f-9d23-73b6fdd9fa5d tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:40:22.417321 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b4a75adb-4dc1-418f-9d23-73b6fdd9fa5d tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:40:22.417801 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b4a75adb-4dc1-418f-9d23-73b6fdd9fa5d tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:40:22.798008 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b4a75adb-4dc1-418f-9d23-73b6fdd9fa5d tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248fe9cf0934faaaa1059c0a67cdccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f5f5f354946d391db10d490ca8764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:40:22.807740 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b4a75adb-4dc1-418f-9d23-73b6fdd9fa5d tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] 10.222.0.27 "GET /compute/v2.1/servers/7140aef3-477b-4392-a8db-317e16d27210" status: 200 len: 1515 microversion: 2.1 time: 0.404839 Jun 20 12:40:22.808471 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3231/6559] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:40:22 2022] GET /compute/v2.1/servers/7140aef3-477b-4392-a8db-317e16d27210 => generated 1515 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:40:23.834094 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-74f9b1d1-3eda-4a0d-9329-f6c22360c190 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:40:23.834851 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-74f9b1d1-3eda-4a0d-9329-f6c22360c190 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] [instance: 7140aef3-477b-4392-a8db-317e16d27210] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:40:23.842852 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-74f9b1d1-3eda-4a0d-9329-f6c22360c190 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:40:23.843782 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-74f9b1d1-3eda-4a0d-9329-f6c22360c190 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:40:23.844816 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-74f9b1d1-3eda-4a0d-9329-f6c22360c190 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:40:23.845649 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-74f9b1d1-3eda-4a0d-9329-f6c22360c190 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:40:24.112620 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-74f9b1d1-3eda-4a0d-9329-f6c22360c190 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248fe9cf0934faaaa1059c0a67cdccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f5f5f354946d391db10d490ca8764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:40:24.121041 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-74f9b1d1-3eda-4a0d-9329-f6c22360c190 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] 10.222.0.27 "GET /compute/v2.1/servers/7140aef3-477b-4392-a8db-317e16d27210" status: 200 len: 1515 microversion: 2.1 time: 0.291699 Jun 20 12:40:24.121639 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3329/6560] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:40:23 2022] GET /compute/v2.1/servers/7140aef3-477b-4392-a8db-317e16d27210 => generated 1515 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:40:24.750090 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-e3bf3c0d-a0e0-4ad1-a3ba-105a14a51298 req-0acd3b1a-d2b9-4888-8762-a14c1226e9f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7140aef3-477b-4392-a8db-317e16d27210", "name": "network-vif-deleted", "tag": "25bb622e-d36c-4904-acb8-49a0df67632b"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:40:24.762271 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e3bf3c0d-a0e0-4ad1-a3ba-105a14a51298 req-0acd3b1a-d2b9-4888-8762-a14c1226e9f0 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:40:24.763133 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e3bf3c0d-a0e0-4ad1-a3ba-105a14a51298 req-0acd3b1a-d2b9-4888-8762-a14c1226e9f0 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:40:24.779860 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-e3bf3c0d-a0e0-4ad1-a3ba-105a14a51298 req-0acd3b1a-d2b9-4888-8762-a14c1226e9f0 service nova] Creating event network-vif-deleted:25bb622e-d36c-4904-acb8-49a0df67632b for instance 7140aef3-477b-4392-a8db-317e16d27210 on n-h1-master-1 Jun 20 12:40:24.789220 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-e3bf3c0d-a0e0-4ad1-a3ba-105a14a51298 req-0acd3b1a-d2b9-4888-8762-a14c1226e9f0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045581 Jun 20 12:40:24.790916 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3232/6561] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:40:25.139258 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b99581da-c997-43c4-bf27-0f035bf9ed27 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:40:25.140405 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b99581da-c997-43c4-bf27-0f035bf9ed27 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] [instance: 7140aef3-477b-4392-a8db-317e16d27210] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:40:25.148157 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b99581da-c997-43c4-bf27-0f035bf9ed27 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:40:25.155581 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b99581da-c997-43c4-bf27-0f035bf9ed27 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:40:25.158110 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b99581da-c997-43c4-bf27-0f035bf9ed27 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:40:25.159992 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b99581da-c997-43c4-bf27-0f035bf9ed27 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:40:25.219021 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b99581da-c997-43c4-bf27-0f035bf9ed27 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:40:25.219781 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b99581da-c997-43c4-bf27-0f035bf9ed27 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:40:25.221521 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-b99581da-c997-43c4-bf27-0f035bf9ed27 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lazy-loading 'fault' on Instance uuid 7140aef3-477b-4392-a8db-317e16d27210 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:40:25.296241 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b99581da-c997-43c4-bf27-0f035bf9ed27 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248fe9cf0934faaaa1059c0a67cdccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7f5f5f354946d391db10d490ca8764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:40:25.318538 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b99581da-c997-43c4-bf27-0f035bf9ed27 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] 10.222.0.27 "GET /compute/v2.1/servers/7140aef3-477b-4392-a8db-317e16d27210" status: 200 len: 1309 microversion: 2.1 time: 0.183124 Jun 20 12:40:25.320072 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3330/6562] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:40:25 2022] GET /compute/v2.1/servers/7140aef3-477b-4392-a8db-317e16d27210 => generated 1309 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:40:26.339090 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-652c7604-42bb-485c-a32f-a581bb5f4d90 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:40:26.340645 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-652c7604-42bb-485c-a32f-a581bb5f4d90 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] [instance: 7140aef3-477b-4392-a8db-317e16d27210] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:40:26.349928 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-652c7604-42bb-485c-a32f-a581bb5f4d90 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:40:26.350432 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-652c7604-42bb-485c-a32f-a581bb5f4d90 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:40:26.351241 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-652c7604-42bb-485c-a32f-a581bb5f4d90 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:40:26.351863 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-652c7604-42bb-485c-a32f-a581bb5f4d90 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:40:26.369345 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-652c7604-42bb-485c-a32f-a581bb5f4d90 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] HTTP exception thrown: Instance 7140aef3-477b-4392-a8db-317e16d27210 could not be found. Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-652c7604-42bb-485c-a32f-a581bb5f4d90 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Request method failure captured: Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/7140aef3-477b-4392-a8db-317e16d27210 HTTP/1.1 Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGoIQ4Ki60V9RMx2wYiwwQqRg6BVyK7Hn6hnat0EIiPn-rfJrPbJXaKywVEVgRuYgo17Uf43__TDD69fur3l9I5t_IqDmS1J08sU1A7FtBBLVzMwq2e57zziqDqMFA02KAPSg41kvFiZtZB2p98Nyp7XM6CJ7Kc0hFOqldLov-0lYRw Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 3d7f5f5f354946d391db10d490ca8764 Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1317344980 Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d7f5f5f354946d391db10d490ca8764"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3d7f5f5f354946d391db10d490ca8764"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3d7f5f5f354946d391db10d490ca8764"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3d7f5f5f354946d391db10d490ca8764"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-VolumesSnapshotTestJSON-1317344980 Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 3d7f5f5f354946d391db10d490ca8764 Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1317344980 Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-VolumesSnapshotTestJSON-1317344980-project Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 0248fe9cf0934faaaa1059c0a67cdccf Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-VolumesSnapshotTestJSON-1317344980-project Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 7140aef3-477b-4392-a8db-317e16d27210 could not be found. Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '7140aef3-477b-4392-a8db-317e16d27210'} Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7140aef3-477b-4392-a8db-317e16d27210 could not be found. Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7140aef3-477b-4392-a8db-317e16d27210 could not be found. Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:40:26.371127 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:40:26.377733 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:40:26.377733 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:40:26.377733 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:40:26.377733 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:40:26.377733 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:40:26.377733 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7140aef3-477b-4392-a8db-317e16d27210 could not be found. Jun 20 12:40:26.377733 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:40:26.379406 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-652c7604-42bb-485c-a32f-a581bb5f4d90 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] Returning 404 to user: Instance 7140aef3-477b-4392-a8db-317e16d27210 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:40:26.380511 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-652c7604-42bb-485c-a32f-a581bb5f4d90 tempest-VolumesSnapshotTestJSON-1317344980 tempest-VolumesSnapshotTestJSON-1317344980-project] 10.222.0.27 "GET /compute/v2.1/servers/7140aef3-477b-4392-a8db-317e16d27210" status: 404 len: 111 microversion: 2.1 time: 0.046075 Jun 20 12:40:26.381130 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3233/6563] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:40:26 2022] GET /compute/v2.1/servers/7140aef3-477b-4392-a8db-317e16d27210 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:41:04.645781 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:41:04.648925 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:41:04.894421 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4b632c21-921d-4d57-a110-8d9c5740f86c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:41:04.895135 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4b632c21-921d-4d57-a110-8d9c5740f86c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 47bf8feb-9acf-44f3-960f-a4eb84570735] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:41:04.913550 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4b632c21-921d-4d57-a110-8d9c5740f86c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:04.914604 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4b632c21-921d-4d57-a110-8d9c5740f86c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:04.918231 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4b632c21-921d-4d57-a110-8d9c5740f86c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:04.919224 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4b632c21-921d-4d57-a110-8d9c5740f86c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:04.999234 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4b632c21-921d-4d57-a110-8d9c5740f86c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 47bf8feb-9acf-44f3-960f-a4eb84570735] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:41:05.167808 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4b632c21-921d-4d57-a110-8d9c5740f86c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "DELETE /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735" status: 204 len: 0 microversion: 2.1 time: 0.532625 Jun 20 12:41:05.181504 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d1687ba5-8568-4e62-9cf7-5c1fd82fc8bf tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:41:05.182306 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d1687ba5-8568-4e62-9cf7-5c1fd82fc8bf tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 47bf8feb-9acf-44f3-960f-a4eb84570735] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:41:05.185181 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=8 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:41:05.185933 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:41:05.186191 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3331/6564] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:41:04 2022] DELETE /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:41:05.192798 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d1687ba5-8568-4e62-9cf7-5c1fd82fc8bf tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:05.193529 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d1687ba5-8568-4e62-9cf7-5c1fd82fc8bf tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:05.195289 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d1687ba5-8568-4e62-9cf7-5c1fd82fc8bf tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:05.195967 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d1687ba5-8568-4e62-9cf7-5c1fd82fc8bf tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:05.436669 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d1687ba5-8568-4e62-9cf7-5c1fd82fc8bf tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:41:05.447013 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d1687ba5-8568-4e62-9cf7-5c1fd82fc8bf tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735" status: 200 len: 1576 microversion: 2.1 time: 0.269606 Jun 20 12:41:05.447989 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3234/6565] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:41:05 2022] GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735 => generated 1576 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:41:06.474600 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6b58c361-bac0-4d53-8d04-d1483f065283 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:41:06.480348 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6b58c361-bac0-4d53-8d04-d1483f065283 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 47bf8feb-9acf-44f3-960f-a4eb84570735] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:41:06.491558 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6b58c361-bac0-4d53-8d04-d1483f065283 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:06.492294 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6b58c361-bac0-4d53-8d04-d1483f065283 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:06.494278 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6b58c361-bac0-4d53-8d04-d1483f065283 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:06.494883 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6b58c361-bac0-4d53-8d04-d1483f065283 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:06.671223 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6b58c361-bac0-4d53-8d04-d1483f065283 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:41:06.681664 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6b58c361-bac0-4d53-8d04-d1483f065283 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735" status: 200 len: 1576 microversion: 2.1 time: 0.219587 Jun 20 12:41:06.710627 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3332/6566] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:41:06 2022] GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735 => generated 1576 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:41:07.699056 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c415320f-a778-481b-a7c1-189cf4f499a6 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:41:07.699753 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c415320f-a778-481b-a7c1-189cf4f499a6 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 47bf8feb-9acf-44f3-960f-a4eb84570735] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:41:07.709380 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c415320f-a778-481b-a7c1-189cf4f499a6 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:07.710068 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c415320f-a778-481b-a7c1-189cf4f499a6 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:07.711116 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c415320f-a778-481b-a7c1-189cf4f499a6 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:07.711732 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c415320f-a778-481b-a7c1-189cf4f499a6 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:08.150356 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c415320f-a778-481b-a7c1-189cf4f499a6 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:41:08.160616 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c415320f-a778-481b-a7c1-189cf4f499a6 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735" status: 200 len: 1576 microversion: 2.1 time: 0.465254 Jun 20 12:41:08.171391 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3235/6567] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:41:07 2022] GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735 => generated 1576 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:41:08.778767 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-19a07bbd-c29f-4aae-a094-fc772249e9a8 req-edef3188-d48b-4825-83bf-bbf255c15ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47bf8feb-9acf-44f3-960f-a4eb84570735", "name": "network-vif-deleted", "tag": "2163993f-e186-4de1-ba76-05c26cf17781"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:41:08.827663 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-19a07bbd-c29f-4aae-a094-fc772249e9a8 req-edef3188-d48b-4825-83bf-bbf255c15ef1 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:08.829874 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-19a07bbd-c29f-4aae-a094-fc772249e9a8 req-edef3188-d48b-4825-83bf-bbf255c15ef1 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:08.890029 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-19a07bbd-c29f-4aae-a094-fc772249e9a8 req-edef3188-d48b-4825-83bf-bbf255c15ef1 service nova] Creating event network-vif-deleted:2163993f-e186-4de1-ba76-05c26cf17781 for instance 47bf8feb-9acf-44f3-960f-a4eb84570735 on n-h2-master-1 Jun 20 12:41:08.902959 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-19a07bbd-c29f-4aae-a094-fc772249e9a8 req-edef3188-d48b-4825-83bf-bbf255c15ef1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128313 Jun 20 12:41:08.904803 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3333/6568] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:41:09.178647 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6be85810-db26-4c6e-bf3a-e01e106b418c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:41:09.180834 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6be85810-db26-4c6e-bf3a-e01e106b418c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 47bf8feb-9acf-44f3-960f-a4eb84570735] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:41:09.190673 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6be85810-db26-4c6e-bf3a-e01e106b418c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:09.191392 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6be85810-db26-4c6e-bf3a-e01e106b418c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:09.192431 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6be85810-db26-4c6e-bf3a-e01e106b418c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:09.193702 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6be85810-db26-4c6e-bf3a-e01e106b418c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:09.213256 n-d-master-1 devstack@n-api.service[119128]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 12:41:09.213256 n-d-master-1 devstack@n-api.service[119128]: Mon Jun 20 12:41:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735 (ip 10.222.0.27) !!! Jun 20 12:41:09.323093 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6be85810-db26-4c6e-bf3a-e01e106b418c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:41:09.341286 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6be85810-db26-4c6e-bf3a-e01e106b418c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735" status: 200 len: 1225 microversion: 2.1 time: 0.166828 Jun 20 12:41:09.341902 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3236/6569] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:41:09 2022] GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735 => generated 1225 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:41:10.363889 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-091e2d09-7f02-4641-8d58-5d9723bbb137 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:41:10.364730 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-091e2d09-7f02-4641-8d58-5d9723bbb137 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 47bf8feb-9acf-44f3-960f-a4eb84570735] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:41:10.388396 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-091e2d09-7f02-4641-8d58-5d9723bbb137 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:10.390681 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-091e2d09-7f02-4641-8d58-5d9723bbb137 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:10.397886 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-091e2d09-7f02-4641-8d58-5d9723bbb137 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:10.400391 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-091e2d09-7f02-4641-8d58-5d9723bbb137 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:10.536284 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-091e2d09-7f02-4641-8d58-5d9723bbb137 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:41:10.550678 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-091e2d09-7f02-4641-8d58-5d9723bbb137 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735" status: 200 len: 1225 microversion: 2.1 time: 0.194614 Jun 20 12:41:10.551999 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3334/6570] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:41:10 2022] GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735 => generated 1225 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:41:11.567549 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-58a29a7d-8fa1-4376-93e6-190344e886e3 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:41:11.569704 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-58a29a7d-8fa1-4376-93e6-190344e886e3 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 47bf8feb-9acf-44f3-960f-a4eb84570735] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:41:11.579239 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-58a29a7d-8fa1-4376-93e6-190344e886e3 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:11.580184 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-58a29a7d-8fa1-4376-93e6-190344e886e3 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:11.581173 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-58a29a7d-8fa1-4376-93e6-190344e886e3 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:11.581769 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-58a29a7d-8fa1-4376-93e6-190344e886e3 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:11.671539 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-58a29a7d-8fa1-4376-93e6-190344e886e3 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:41:11.680662 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-58a29a7d-8fa1-4376-93e6-190344e886e3 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735" status: 200 len: 1225 microversion: 2.1 time: 0.117259 Jun 20 12:41:11.681779 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3237/6571] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:41:11 2022] GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735 => generated 1225 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:41:12.703950 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f3147456-3cf7-4a9e-b23a-47187fc6173d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:41:12.703950 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f3147456-3cf7-4a9e-b23a-47187fc6173d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 47bf8feb-9acf-44f3-960f-a4eb84570735] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:41:12.710855 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f3147456-3cf7-4a9e-b23a-47187fc6173d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:12.711450 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f3147456-3cf7-4a9e-b23a-47187fc6173d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:12.712540 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f3147456-3cf7-4a9e-b23a-47187fc6173d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:12.713271 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f3147456-3cf7-4a9e-b23a-47187fc6173d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:12.824482 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f3147456-3cf7-4a9e-b23a-47187fc6173d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:41:12.833378 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f3147456-3cf7-4a9e-b23a-47187fc6173d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735" status: 200 len: 1225 microversion: 2.1 time: 0.138893 Jun 20 12:41:12.834068 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3335/6572] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:41:12 2022] GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735 => generated 1225 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:41:13.851141 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cf3fa901-2618-43fb-827a-77e76ecd8c47 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:41:13.851746 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cf3fa901-2618-43fb-827a-77e76ecd8c47 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 47bf8feb-9acf-44f3-960f-a4eb84570735] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:41:13.860563 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cf3fa901-2618-43fb-827a-77e76ecd8c47 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:13.861032 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cf3fa901-2618-43fb-827a-77e76ecd8c47 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:13.861823 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cf3fa901-2618-43fb-827a-77e76ecd8c47 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:13.862597 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cf3fa901-2618-43fb-827a-77e76ecd8c47 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:13.951101 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-cf3fa901-2618-43fb-827a-77e76ecd8c47 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:41:13.967059 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cf3fa901-2618-43fb-827a-77e76ecd8c47 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735" status: 200 len: 1225 microversion: 2.1 time: 0.119048 Jun 20 12:41:13.968035 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3238/6573] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:41:13 2022] GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735 => generated 1225 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:41:14.984906 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-486a5af5-9d03-485d-b014-15e3cde15d81 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:41:14.985496 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-486a5af5-9d03-485d-b014-15e3cde15d81 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 47bf8feb-9acf-44f3-960f-a4eb84570735] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:41:14.993333 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-486a5af5-9d03-485d-b014-15e3cde15d81 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:14.993790 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-486a5af5-9d03-485d-b014-15e3cde15d81 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:14.994559 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-486a5af5-9d03-485d-b014-15e3cde15d81 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:14.995244 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-486a5af5-9d03-485d-b014-15e3cde15d81 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:15.017374 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-486a5af5-9d03-485d-b014-15e3cde15d81 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] HTTP exception thrown: Instance 47bf8feb-9acf-44f3-960f-a4eb84570735 could not be found. Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-486a5af5-9d03-485d-b014-15e3cde15d81 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Request method failure captured: Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735 HTTP/1.1 Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGlbodlapeisJn5a0HtwbwcZIYoBmT5AMrWgFKctZEM-c8IEHUY-HIxlKO2btmEhIp6rTchMUsTfBqlVWDOj1EarcMAz1U-zU3gC1LYOn6ihs7mNZ7VuUoyKyfaVYT5-C41dz-fiCbk7B4FysstqCDj9MrkXDGMTtiNF2ZH2AvXNm6I Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 5a9c7bbcc9a149f5b77a89141a306c3e Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-TestVolumeBootPattern-431625802 Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-TestVolumeBootPattern-431625802 Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 5a9c7bbcc9a149f5b77a89141a306c3e Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-TestVolumeBootPattern-431625802 Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-TestVolumeBootPattern-431625802-project Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: fed0afc129364664aed8d8a96f499831 Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-TestVolumeBootPattern-431625802-project Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 47bf8feb-9acf-44f3-960f-a4eb84570735 could not be found. Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '47bf8feb-9acf-44f3-960f-a4eb84570735'} Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47bf8feb-9acf-44f3-960f-a4eb84570735 could not be found. Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47bf8feb-9acf-44f3-960f-a4eb84570735 could not be found. Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:41:15.019861 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:41:15.025212 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:41:15.025212 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:41:15.025212 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:41:15.025212 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:41:15.025212 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:41:15.025212 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47bf8feb-9acf-44f3-960f-a4eb84570735 could not be found. Jun 20 12:41:15.025212 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:41:15.025212 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-486a5af5-9d03-485d-b014-15e3cde15d81 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Returning 404 to user: Instance 47bf8feb-9acf-44f3-960f-a4eb84570735 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:41:15.025212 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-486a5af5-9d03-485d-b014-15e3cde15d81 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735" status: 404 len: 111 microversion: 2.1 time: 0.041230 Jun 20 12:41:15.025212 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3336/6574] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:41:14 2022] GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:41:15.155079 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ed49897f-ea0d-4f43-9b79-7428f2721560 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1522819963", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-997416587", "security_groups": [{"name": "tempest-secgroup-smoke-1594074498"}], "block_device_mapping_v2": [{"uuid": "9e00128f-7c4f-4030-8d8b-9d5511e9bc8a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fda59e99-54c8-4d95-ad3c-e4129b9a154d"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:41:15.284908 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-ed49897f-ea0d-4f43-9b79-7428f2721560 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] validate_networks() for [('fda59e99-54c8-4d95-ad3c-e4129b9a154d', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:41:15.876711 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-ed49897f-ea0d-4f43-9b79-7428f2721560 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:41:15.876711 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-ed49897f-ea0d-4f43-9b79-7428f2721560 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:41:15.876711 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-ed49897f-ea0d-4f43-9b79-7428f2721560 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:41:15.876711 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-ed49897f-ea0d-4f43-9b79-7428f2721560 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:41:15.876711 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-ed49897f-ea0d-4f43-9b79-7428f2721560 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:41:15.885926 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed49897f-ea0d-4f43-9b79-7428f2721560 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:15.886511 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed49897f-ea0d-4f43-9b79-7428f2721560 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:15.887385 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed49897f-ea0d-4f43-9b79-7428f2721560 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:15.887984 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed49897f-ea0d-4f43-9b79-7428f2721560 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:15.908054 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-ed49897f-ea0d-4f43-9b79-7428f2721560 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Getting quotas for project 5a9c7bbcc9a149f5b77a89141a306c3e. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:41:15.914599 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-ed49897f-ea0d-4f43-9b79-7428f2721560 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Getting quotas for user fed0afc129364664aed8d8a96f499831 and project 5a9c7bbcc9a149f5b77a89141a306c3e. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:41:15.997041 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ed49897f-ea0d-4f43-9b79-7428f2721560 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:41:16.000294 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ed49897f-ea0d-4f43-9b79-7428f2721560 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 23d20f6e-3955-4967-8936-e092f3c942bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9e00128f-7c4f-4030-8d8b-9d5511e9bc8a',volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:41:16.159079 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ed49897f-ea0d-4f43-9b79-7428f2721560 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.008342 Jun 20 12:41:16.166889 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3239/6575] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:41:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 1017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 12:41:16.171099 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-df47db12-ce19-48b1-b943-b7ae4b6fe576 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:41:16.171992 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-df47db12-ce19-48b1-b943-b7ae4b6fe576 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 23d20f6e-3955-4967-8936-e092f3c942bc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:41:16.554225 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-df47db12-ce19-48b1-b943-b7ae4b6fe576 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:41:16.561712 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-df47db12-ce19-48b1-b943-b7ae4b6fe576 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc" status: 200 len: 1094 microversion: 2.1 time: 0.394822 Jun 20 12:41:16.562589 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3337/6576] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:41:16 2022] GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc => generated 1094 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:41:17.579791 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-78ccc0fd-4579-44b7-a7c8-db0335f8326d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:41:17.581342 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-78ccc0fd-4579-44b7-a7c8-db0335f8326d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 23d20f6e-3955-4967-8936-e092f3c942bc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:41:17.594883 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-78ccc0fd-4579-44b7-a7c8-db0335f8326d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:17.596300 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-78ccc0fd-4579-44b7-a7c8-db0335f8326d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:17.597443 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-78ccc0fd-4579-44b7-a7c8-db0335f8326d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:17.598176 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-78ccc0fd-4579-44b7-a7c8-db0335f8326d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:17.726593 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-78ccc0fd-4579-44b7-a7c8-db0335f8326d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:41:17.754741 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-78ccc0fd-4579-44b7-a7c8-db0335f8326d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc" status: 200 len: 1210 microversion: 2.1 time: 0.177169 Jun 20 12:41:17.762628 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3240/6577] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:41:17 2022] GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc => generated 1210 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:41:18.779883 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7be4f892-28c9-4b21-a898-cae7ecd22668 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:41:18.781347 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7be4f892-28c9-4b21-a898-cae7ecd22668 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 23d20f6e-3955-4967-8936-e092f3c942bc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:41:18.804489 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7be4f892-28c9-4b21-a898-cae7ecd22668 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:18.807794 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7be4f892-28c9-4b21-a898-cae7ecd22668 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:18.812257 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7be4f892-28c9-4b21-a898-cae7ecd22668 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:18.813329 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7be4f892-28c9-4b21-a898-cae7ecd22668 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:18.952538 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7be4f892-28c9-4b21-a898-cae7ecd22668 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:41:18.973111 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7be4f892-28c9-4b21-a898-cae7ecd22668 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc" status: 200 len: 1210 microversion: 2.1 time: 0.198655 Jun 20 12:41:18.980932 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3338/6578] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:41:18 2022] GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc => generated 1210 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:41:19.999880 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7f12b33b-7590-437b-b98b-6e408895d298 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:41:20.001433 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7f12b33b-7590-437b-b98b-6e408895d298 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 23d20f6e-3955-4967-8936-e092f3c942bc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:41:20.018706 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f12b33b-7590-437b-b98b-6e408895d298 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:20.019431 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f12b33b-7590-437b-b98b-6e408895d298 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:20.020528 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f12b33b-7590-437b-b98b-6e408895d298 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:20.021251 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f12b33b-7590-437b-b98b-6e408895d298 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:20.718918 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7f12b33b-7590-437b-b98b-6e408895d298 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:41:20.738482 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7f12b33b-7590-437b-b98b-6e408895d298 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc" status: 200 len: 1278 microversion: 2.1 time: 0.744432 Jun 20 12:41:20.738867 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3241/6579] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:41:19 2022] GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc => generated 1278 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:41:21.269261 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-6d063afa-7873-4ab2-9a49-5dbe3f886ed4 req-e5d60af7-da96-422c-8867-6256d18f43cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23d20f6e-3955-4967-8936-e092f3c942bc", "tag": "3c5e50e8-be21-4cf5-abad-d9a04881fd8d"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:41:21.282827 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-6d063afa-7873-4ab2-9a49-5dbe3f886ed4 req-e5d60af7-da96-422c-8867-6256d18f43cf service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:21.284571 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-6d063afa-7873-4ab2-9a49-5dbe3f886ed4 req-e5d60af7-da96-422c-8867-6256d18f43cf service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:21.313823 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-6d063afa-7873-4ab2-9a49-5dbe3f886ed4 req-e5d60af7-da96-422c-8867-6256d18f43cf service nova] Creating event network-changed:3c5e50e8-be21-4cf5-abad-d9a04881fd8d for instance 23d20f6e-3955-4967-8936-e092f3c942bc on n-h1-master-1 Jun 20 12:41:21.321226 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-6d063afa-7873-4ab2-9a49-5dbe3f886ed4 req-e5d60af7-da96-422c-8867-6256d18f43cf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056889 Jun 20 12:41:21.322606 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3339/6580] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:41:21.755516 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-43502453-c6ea-48d9-96bb-87d16d1c4097 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:41:21.756373 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-43502453-c6ea-48d9-96bb-87d16d1c4097 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 23d20f6e-3955-4967-8936-e092f3c942bc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:41:21.768105 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-43502453-c6ea-48d9-96bb-87d16d1c4097 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:21.769063 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-43502453-c6ea-48d9-96bb-87d16d1c4097 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:21.770139 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-43502453-c6ea-48d9-96bb-87d16d1c4097 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:21.770805 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-43502453-c6ea-48d9-96bb-87d16d1c4097 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:22.159980 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-43502453-c6ea-48d9-96bb-87d16d1c4097 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:41:22.174367 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-43502453-c6ea-48d9-96bb-87d16d1c4097 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc" status: 200 len: 1278 microversion: 2.1 time: 0.422844 Jun 20 12:41:22.187748 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3242/6581] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:41:21 2022] GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc => generated 1278 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:41:23.196395 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6c2022ad-0fd5-44bd-ab19-6b58c2515542 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:41:23.197894 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6c2022ad-0fd5-44bd-ab19-6b58c2515542 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 23d20f6e-3955-4967-8936-e092f3c942bc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:41:23.208435 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c2022ad-0fd5-44bd-ab19-6b58c2515542 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:23.209852 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c2022ad-0fd5-44bd-ab19-6b58c2515542 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:23.211047 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c2022ad-0fd5-44bd-ab19-6b58c2515542 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:23.211758 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c2022ad-0fd5-44bd-ab19-6b58c2515542 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:23.516820 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6c2022ad-0fd5-44bd-ab19-6b58c2515542 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:41:23.526819 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6c2022ad-0fd5-44bd-ab19-6b58c2515542 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc" status: 200 len: 1278 microversion: 2.1 time: 0.338489 Jun 20 12:41:23.546854 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3340/6582] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:41:23 2022] GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc => generated 1278 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:41:24.551074 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e3a7868d-7e14-4b43-aa0d-b3b54713cfbe tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:41:24.552764 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e3a7868d-7e14-4b43-aa0d-b3b54713cfbe tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 23d20f6e-3955-4967-8936-e092f3c942bc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:41:24.560434 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e3a7868d-7e14-4b43-aa0d-b3b54713cfbe tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:24.561262 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e3a7868d-7e14-4b43-aa0d-b3b54713cfbe tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:24.563741 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e3a7868d-7e14-4b43-aa0d-b3b54713cfbe tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:24.564789 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e3a7868d-7e14-4b43-aa0d-b3b54713cfbe tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:24.882389 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e3a7868d-7e14-4b43-aa0d-b3b54713cfbe tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:41:24.890235 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e3a7868d-7e14-4b43-aa0d-b3b54713cfbe tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc" status: 200 len: 1278 microversion: 2.1 time: 0.346804 Jun 20 12:41:24.901560 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3243/6583] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:41:24 2022] GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc => generated 1278 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:41:25.908536 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4d27430d-a227-4c31-9d8f-98ad3690c742 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:41:25.910756 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4d27430d-a227-4c31-9d8f-98ad3690c742 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 23d20f6e-3955-4967-8936-e092f3c942bc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:41:25.919758 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d27430d-a227-4c31-9d8f-98ad3690c742 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:25.920860 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d27430d-a227-4c31-9d8f-98ad3690c742 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:25.921857 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d27430d-a227-4c31-9d8f-98ad3690c742 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:25.922982 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d27430d-a227-4c31-9d8f-98ad3690c742 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:26.155973 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4d27430d-a227-4c31-9d8f-98ad3690c742 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:41:26.165205 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4d27430d-a227-4c31-9d8f-98ad3690c742 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc" status: 200 len: 1266 microversion: 2.1 time: 0.261896 Jun 20 12:41:26.168965 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3341/6584] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:41:25 2022] GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc => generated 1266 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:41:27.184903 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-da82eece-f7d7-4c34-b750-f4f24b8fc1af tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:41:27.185536 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-da82eece-f7d7-4c34-b750-f4f24b8fc1af tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 23d20f6e-3955-4967-8936-e092f3c942bc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:41:27.189121 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:41:27.190723 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:41:27.200576 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-da82eece-f7d7-4c34-b750-f4f24b8fc1af tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:27.201046 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-da82eece-f7d7-4c34-b750-f4f24b8fc1af tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:27.201871 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-da82eece-f7d7-4c34-b750-f4f24b8fc1af tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:27.202316 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-da82eece-f7d7-4c34-b750-f4f24b8fc1af tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:27.418770 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-da82eece-f7d7-4c34-b750-f4f24b8fc1af tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:41:27.436471 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-da82eece-f7d7-4c34-b750-f4f24b8fc1af tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc" status: 200 len: 1266 microversion: 2.1 time: 0.255688 Jun 20 12:41:27.437724 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3244/6585] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:41:27 2022] GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:41:28.456294 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-efeae588-680f-4aaf-bcfc-07384597582b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:41:28.457093 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-efeae588-680f-4aaf-bcfc-07384597582b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 23d20f6e-3955-4967-8936-e092f3c942bc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:41:28.460828 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:41:28.468019 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-efeae588-680f-4aaf-bcfc-07384597582b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:28.468633 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-efeae588-680f-4aaf-bcfc-07384597582b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:28.469763 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-efeae588-680f-4aaf-bcfc-07384597582b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:28.470563 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-efeae588-680f-4aaf-bcfc-07384597582b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:28.632836 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-efeae588-680f-4aaf-bcfc-07384597582b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:41:28.644022 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-efeae588-680f-4aaf-bcfc-07384597582b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc" status: 200 len: 1266 microversion: 2.1 time: 0.192248 Jun 20 12:41:28.654202 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3342/6586] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:41:28 2022] GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:41:29.661534 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8c5a7045-28db-4210-95cc-228a351eba96 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:41:29.662937 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8c5a7045-28db-4210-95cc-228a351eba96 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 23d20f6e-3955-4967-8936-e092f3c942bc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:41:29.671316 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8c5a7045-28db-4210-95cc-228a351eba96 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:29.672072 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8c5a7045-28db-4210-95cc-228a351eba96 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:29.672992 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8c5a7045-28db-4210-95cc-228a351eba96 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:29.673806 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8c5a7045-28db-4210-95cc-228a351eba96 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:30.196646 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8c5a7045-28db-4210-95cc-228a351eba96 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:41:30.208898 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8c5a7045-28db-4210-95cc-228a351eba96 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc" status: 200 len: 1266 microversion: 2.1 time: 0.551250 Jun 20 12:41:30.209554 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3245/6587] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:41:29 2022] GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc => generated 1266 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:41:31.227239 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5d5df99c-ccf4-4110-b531-413eab3cf520 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:41:31.229775 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5d5df99c-ccf4-4110-b531-413eab3cf520 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 23d20f6e-3955-4967-8936-e092f3c942bc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:41:31.236882 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5d5df99c-ccf4-4110-b531-413eab3cf520 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:31.237341 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5d5df99c-ccf4-4110-b531-413eab3cf520 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:31.238121 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5d5df99c-ccf4-4110-b531-413eab3cf520 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:31.240224 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5d5df99c-ccf4-4110-b531-413eab3cf520 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:31.536845 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5d5df99c-ccf4-4110-b531-413eab3cf520 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:41:31.551154 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5d5df99c-ccf4-4110-b531-413eab3cf520 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc" status: 200 len: 1266 microversion: 2.1 time: 0.328136 Jun 20 12:41:31.551735 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3343/6588] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:41:31 2022] GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc => generated 1266 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:41:32.572798 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2aad0d2c-ad75-4bd1-97a2-f1fa257e9e20 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:41:32.574060 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2aad0d2c-ad75-4bd1-97a2-f1fa257e9e20 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 23d20f6e-3955-4967-8936-e092f3c942bc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:41:32.585465 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2aad0d2c-ad75-4bd1-97a2-f1fa257e9e20 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:32.586322 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2aad0d2c-ad75-4bd1-97a2-f1fa257e9e20 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:32.587276 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2aad0d2c-ad75-4bd1-97a2-f1fa257e9e20 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:32.588918 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2aad0d2c-ad75-4bd1-97a2-f1fa257e9e20 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:32.876531 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2aad0d2c-ad75-4bd1-97a2-f1fa257e9e20 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:41:32.889569 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2aad0d2c-ad75-4bd1-97a2-f1fa257e9e20 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc" status: 200 len: 1266 microversion: 2.1 time: 0.324301 Jun 20 12:41:32.890759 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3246/6589] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:41:32 2022] GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc => generated 1266 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:41:33.908093 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-aa3e46c8-17cc-4ffb-b277-125cc1e8a4ca tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:41:33.909581 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-aa3e46c8-17cc-4ffb-b277-125cc1e8a4ca tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 23d20f6e-3955-4967-8936-e092f3c942bc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:41:33.917404 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa3e46c8-17cc-4ffb-b277-125cc1e8a4ca tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:33.917859 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa3e46c8-17cc-4ffb-b277-125cc1e8a4ca tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:33.918636 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa3e46c8-17cc-4ffb-b277-125cc1e8a4ca tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:33.919071 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa3e46c8-17cc-4ffb-b277-125cc1e8a4ca tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:34.147214 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-aa3e46c8-17cc-4ffb-b277-125cc1e8a4ca tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:41:34.155086 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-aa3e46c8-17cc-4ffb-b277-125cc1e8a4ca tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc" status: 200 len: 1266 microversion: 2.1 time: 0.251879 Jun 20 12:41:34.155871 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3344/6590] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:41:33 2022] GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:41:35.173618 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-269625f1-dea1-420c-b5b2-ef3623c89e9e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:41:35.174965 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-269625f1-dea1-420c-b5b2-ef3623c89e9e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 23d20f6e-3955-4967-8936-e092f3c942bc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:41:35.184400 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-269625f1-dea1-420c-b5b2-ef3623c89e9e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:35.185278 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-269625f1-dea1-420c-b5b2-ef3623c89e9e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:35.186600 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-269625f1-dea1-420c-b5b2-ef3623c89e9e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:35.188832 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-269625f1-dea1-420c-b5b2-ef3623c89e9e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:35.217027 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=77 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:41:35.393367 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-269625f1-dea1-420c-b5b2-ef3623c89e9e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:41:35.408192 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-269625f1-dea1-420c-b5b2-ef3623c89e9e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc" status: 200 len: 1266 microversion: 2.1 time: 0.238729 Jun 20 12:41:35.409914 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3247/6591] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:41:35 2022] GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:41:36.428138 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9a259496-803e-49bc-930e-f0264297346e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:41:36.428941 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9a259496-803e-49bc-930e-f0264297346e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 23d20f6e-3955-4967-8936-e092f3c942bc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:41:36.432829 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:41:36.442547 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a259496-803e-49bc-930e-f0264297346e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:36.443363 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a259496-803e-49bc-930e-f0264297346e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:36.444434 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a259496-803e-49bc-930e-f0264297346e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:36.445101 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a259496-803e-49bc-930e-f0264297346e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:36.455696 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:41:36.699651 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9a259496-803e-49bc-930e-f0264297346e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:41:36.712689 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-1d205d03-c92e-4dc8-8102-be3f5ede03cc req-9cc05356-997b-4492-9610-fec99b7433e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23d20f6e-3955-4967-8936-e092f3c942bc", "name": "network-vif-plugged", "status": "completed", "tag": "3c5e50e8-be21-4cf5-abad-d9a04881fd8d"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:41:36.723148 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:41:36.725607 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9a259496-803e-49bc-930e-f0264297346e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc" status: 200 len: 1266 microversion: 2.1 time: 0.302440 Jun 20 12:41:36.730736 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3345/6592] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:41:36 2022] GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc => generated 1266 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:41:36.736017 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-1d205d03-c92e-4dc8-8102-be3f5ede03cc req-9cc05356-997b-4492-9610-fec99b7433e0 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:36.741420 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-1d205d03-c92e-4dc8-8102-be3f5ede03cc req-9cc05356-997b-4492-9610-fec99b7433e0 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:36.769003 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-1d205d03-c92e-4dc8-8102-be3f5ede03cc req-9cc05356-997b-4492-9610-fec99b7433e0 service nova] Creating event network-vif-plugged:3c5e50e8-be21-4cf5-abad-d9a04881fd8d for instance 23d20f6e-3955-4967-8936-e092f3c942bc on n-h1-master-1 Jun 20 12:41:36.775114 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-1d205d03-c92e-4dc8-8102-be3f5ede03cc req-9cc05356-997b-4492-9610-fec99b7433e0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067258 Jun 20 12:41:36.775715 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3248/6593] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:41:37.746862 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bfee2c97-c944-4746-9e5a-3bb97ab4ee70 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:41:37.748050 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bfee2c97-c944-4746-9e5a-3bb97ab4ee70 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 23d20f6e-3955-4967-8936-e092f3c942bc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:41:37.758318 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bfee2c97-c944-4746-9e5a-3bb97ab4ee70 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:37.759154 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bfee2c97-c944-4746-9e5a-3bb97ab4ee70 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:37.760434 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bfee2c97-c944-4746-9e5a-3bb97ab4ee70 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:37.761283 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bfee2c97-c944-4746-9e5a-3bb97ab4ee70 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:37.944079 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bfee2c97-c944-4746-9e5a-3bb97ab4ee70 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:41:37.952509 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bfee2c97-c944-4746-9e5a-3bb97ab4ee70 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc" status: 200 len: 1266 microversion: 2.1 time: 0.209446 Jun 20 12:41:37.953321 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3346/6594] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:41:37 2022] GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:41:38.971364 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d7aecb3b-ea9a-460d-bb5d-c6abdafc2509 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:41:38.973499 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d7aecb3b-ea9a-460d-bb5d-c6abdafc2509 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 23d20f6e-3955-4967-8936-e092f3c942bc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:41:38.979809 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d7aecb3b-ea9a-460d-bb5d-c6abdafc2509 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:38.980288 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d7aecb3b-ea9a-460d-bb5d-c6abdafc2509 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:38.981125 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d7aecb3b-ea9a-460d-bb5d-c6abdafc2509 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:38.981549 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d7aecb3b-ea9a-460d-bb5d-c6abdafc2509 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:39.448314 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d7aecb3b-ea9a-460d-bb5d-c6abdafc2509 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:41:39.462787 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d7aecb3b-ea9a-460d-bb5d-c6abdafc2509 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc" status: 200 len: 1452 microversion: 2.1 time: 0.495584 Jun 20 12:41:39.477044 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3249/6595] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:41:38 2022] GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc => generated 1452 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:41:39.481943 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c65ec47b-7b63-4693-8629-eabf3b1c0555 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:41:39.482575 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c65ec47b-7b63-4693-8629-eabf3b1c0555 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 23d20f6e-3955-4967-8936-e092f3c942bc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:41:39.493719 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c65ec47b-7b63-4693-8629-eabf3b1c0555 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:39.496257 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c65ec47b-7b63-4693-8629-eabf3b1c0555 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:39.497393 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c65ec47b-7b63-4693-8629-eabf3b1c0555 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:39.498004 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c65ec47b-7b63-4693-8629-eabf3b1c0555 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:39.715240 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c65ec47b-7b63-4693-8629-eabf3b1c0555 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:41:39.730098 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c65ec47b-7b63-4693-8629-eabf3b1c0555 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc" status: 200 len: 1452 microversion: 2.1 time: 0.249706 Jun 20 12:41:39.731395 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3347/6596] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:41:39 2022] GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc => generated 1452 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:41:40.226804 n-d-master-1 devstack@n-api.service[119127]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 12:41:40.228014 n-d-master-1 devstack@n-api.service[119127]: Mon Jun 20 12:41:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 12:41:43.706818 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-02cca1f3-e8bf-4eeb-b089-91a7c2a03c3f req-867e7b68-cb20-4e23-8d24-6e7f09493f4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23d20f6e-3955-4967-8936-e092f3c942bc", "tag": "3c5e50e8-be21-4cf5-abad-d9a04881fd8d"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:41:43.716507 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-02cca1f3-e8bf-4eeb-b089-91a7c2a03c3f req-867e7b68-cb20-4e23-8d24-6e7f09493f4a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:41:43.717294 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-02cca1f3-e8bf-4eeb-b089-91a7c2a03c3f req-867e7b68-cb20-4e23-8d24-6e7f09493f4a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:41:43.734277 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-02cca1f3-e8bf-4eeb-b089-91a7c2a03c3f req-867e7b68-cb20-4e23-8d24-6e7f09493f4a service nova] Creating event network-changed:3c5e50e8-be21-4cf5-abad-d9a04881fd8d for instance 23d20f6e-3955-4967-8936-e092f3c942bc on n-h1-master-1 Jun 20 12:41:43.746179 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-02cca1f3-e8bf-4eeb-b089-91a7c2a03c3f req-867e7b68-cb20-4e23-8d24-6e7f09493f4a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138942 Jun 20 12:41:43.747480 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3250/6597] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:42:52.024127 n-d-master-1 devstack@n-api.service[119127]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 12:42:52.024826 n-d-master-1 devstack@n-api.service[119127]: Mon Jun 20 12:42:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 12:43:24.313841 n-d-master-1 devstack@n-api.service[119127]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c8b4e032-3e27-4327-b51f-f4e5667969ed] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 20 12:43:24.314970 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=5 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:43:24.315889 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=17 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:43:24.320588 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-28c60f2a-83ef-42f5-9a2f-7fdc7eff456c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-327187575", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-997416587", "security_groups": [{"name": "tempest-secgroup-smoke-1594074498"}], "block_device_mapping_v2": [{"uuid": "3939fd92-2db6-4b7a-b5f2-43363d8b687e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fda59e99-54c8-4d95-ad3c-e4129b9a154d"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:43:24.948359 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-28c60f2a-83ef-42f5-9a2f-7fdc7eff456c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] validate_networks() for [('fda59e99-54c8-4d95-ad3c-e4129b9a154d', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:43:25.326967 n-d-master-1 devstack@n-api.service[119127]: INFO oslo.messaging._drivers.impl_rabbit [-] [c8b4e032-3e27-4327-b51f-f4e5667969ed] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 38852. Jun 20 12:43:25.557245 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-28c60f2a-83ef-42f5-9a2f-7fdc7eff456c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:43:25.557669 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-28c60f2a-83ef-42f5-9a2f-7fdc7eff456c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:43:25.558145 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-28c60f2a-83ef-42f5-9a2f-7fdc7eff456c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:43:25.558550 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-28c60f2a-83ef-42f5-9a2f-7fdc7eff456c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:43:25.558955 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-28c60f2a-83ef-42f5-9a2f-7fdc7eff456c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:43:25.568615 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28c60f2a-83ef-42f5-9a2f-7fdc7eff456c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:43:25.569065 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28c60f2a-83ef-42f5-9a2f-7fdc7eff456c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:43:25.570034 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28c60f2a-83ef-42f5-9a2f-7fdc7eff456c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:43:25.570636 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28c60f2a-83ef-42f5-9a2f-7fdc7eff456c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:43:25.589727 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-28c60f2a-83ef-42f5-9a2f-7fdc7eff456c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Getting quotas for project 5a9c7bbcc9a149f5b77a89141a306c3e. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:43:25.595096 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-28c60f2a-83ef-42f5-9a2f-7fdc7eff456c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Getting quotas for user fed0afc129364664aed8d8a96f499831 and project 5a9c7bbcc9a149f5b77a89141a306c3e. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:43:25.661555 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-28c60f2a-83ef-42f5-9a2f-7fdc7eff456c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:43:25.663929 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-28c60f2a-83ef-42f5-9a2f-7fdc7eff456c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: aff26d4b-cb0b-4f3d-af4e-53574a436687] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3939fd92-2db6-4b7a-b5f2-43363d8b687e',volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:43:25.821236 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-28c60f2a-83ef-42f5-9a2f-7fdc7eff456c tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.509106 Jun 20 12:43:25.826624 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3348/6598] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:43:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 1511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:43:25.831358 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=5 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:43:25.832110 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=13 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:43:25.838029 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-251aff05-b51d-428d-810e-bc5729631f51 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:43:25.838767 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-251aff05-b51d-428d-810e-bc5729631f51 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: aff26d4b-cb0b-4f3d-af4e-53574a436687] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:43:25.945759 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-251aff05-b51d-428d-810e-bc5729631f51 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:43:25.960736 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-251aff05-b51d-428d-810e-bc5729631f51 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687" status: 200 len: 1093 microversion: 2.1 time: 0.132364 Jun 20 12:43:25.969013 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3251/6599] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:43:25 2022] GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687 => generated 1093 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:43:26.980239 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c613280f-8174-4514-9d4b-3dc4151c3dd5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:43:26.981690 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c613280f-8174-4514-9d4b-3dc4151c3dd5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: aff26d4b-cb0b-4f3d-af4e-53574a436687] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:43:27.000091 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c613280f-8174-4514-9d4b-3dc4151c3dd5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:43:27.001585 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c613280f-8174-4514-9d4b-3dc4151c3dd5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:43:27.008645 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c613280f-8174-4514-9d4b-3dc4151c3dd5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:43:27.009346 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c613280f-8174-4514-9d4b-3dc4151c3dd5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:43:27.113099 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c613280f-8174-4514-9d4b-3dc4151c3dd5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:43:27.125178 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c613280f-8174-4514-9d4b-3dc4151c3dd5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687" status: 200 len: 1209 microversion: 2.1 time: 0.150185 Jun 20 12:43:27.126110 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3349/6600] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:43:26 2022] GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687 => generated 1209 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:43:28.146799 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-741396cf-325d-4300-9161-5fe3d8d919ae tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:43:28.147806 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-741396cf-325d-4300-9161-5fe3d8d919ae tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: aff26d4b-cb0b-4f3d-af4e-53574a436687] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:43:28.176632 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-741396cf-325d-4300-9161-5fe3d8d919ae tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:43:28.177124 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-741396cf-325d-4300-9161-5fe3d8d919ae tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:43:28.178047 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-741396cf-325d-4300-9161-5fe3d8d919ae tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:43:28.178499 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-741396cf-325d-4300-9161-5fe3d8d919ae tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:43:28.505268 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-741396cf-325d-4300-9161-5fe3d8d919ae tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:43:28.515895 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-741396cf-325d-4300-9161-5fe3d8d919ae tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687" status: 200 len: 1277 microversion: 2.1 time: 0.376240 Jun 20 12:43:28.517389 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3252/6601] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:43:28 2022] GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687 => generated 1277 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:43:29.227238 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-e43f6bad-f4b9-4dbb-a93d-175b4f60263f req-7efc0bda-a620-417c-8005-1cc0cf096719 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aff26d4b-cb0b-4f3d-af4e-53574a436687", "tag": "c7f80c16-5ea4-40a5-8cc9-fe7f29e0be3b"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:43:29.245842 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-e43f6bad-f4b9-4dbb-a93d-175b4f60263f req-7efc0bda-a620-417c-8005-1cc0cf096719 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:43:29.247053 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-e43f6bad-f4b9-4dbb-a93d-175b4f60263f req-7efc0bda-a620-417c-8005-1cc0cf096719 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:43:29.287403 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-e43f6bad-f4b9-4dbb-a93d-175b4f60263f req-7efc0bda-a620-417c-8005-1cc0cf096719 service nova] Creating event network-changed:c7f80c16-5ea4-40a5-8cc9-fe7f29e0be3b for instance aff26d4b-cb0b-4f3d-af4e-53574a436687 on n-h2-master-1 Jun 20 12:43:29.295268 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-e43f6bad-f4b9-4dbb-a93d-175b4f60263f req-7efc0bda-a620-417c-8005-1cc0cf096719 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187673 Jun 20 12:43:29.307862 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3350/6602] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:43:29.542739 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f8979b1b-919b-4f7d-845b-ab5da6e968cd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:43:29.544785 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f8979b1b-919b-4f7d-845b-ab5da6e968cd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: aff26d4b-cb0b-4f3d-af4e-53574a436687] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:43:29.565646 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8979b1b-919b-4f7d-845b-ab5da6e968cd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:43:29.567699 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8979b1b-919b-4f7d-845b-ab5da6e968cd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:43:29.571813 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8979b1b-919b-4f7d-845b-ab5da6e968cd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:43:29.572763 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8979b1b-919b-4f7d-845b-ab5da6e968cd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:43:30.320774 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f8979b1b-919b-4f7d-845b-ab5da6e968cd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:43:30.338615 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f8979b1b-919b-4f7d-845b-ab5da6e968cd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687" status: 200 len: 1277 microversion: 2.1 time: 0.806294 Jun 20 12:43:30.351575 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3253/6603] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:43:29 2022] GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687 => generated 1277 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:43:31.359925 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-953a1d91-ce3a-4a0c-b7d4-29e364759562 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:43:31.361974 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-953a1d91-ce3a-4a0c-b7d4-29e364759562 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: aff26d4b-cb0b-4f3d-af4e-53574a436687] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:43:31.384547 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-953a1d91-ce3a-4a0c-b7d4-29e364759562 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:43:31.386824 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-953a1d91-ce3a-4a0c-b7d4-29e364759562 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:43:31.389937 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-953a1d91-ce3a-4a0c-b7d4-29e364759562 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:43:31.390647 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-953a1d91-ce3a-4a0c-b7d4-29e364759562 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:43:31.743761 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-953a1d91-ce3a-4a0c-b7d4-29e364759562 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:43:31.759249 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-953a1d91-ce3a-4a0c-b7d4-29e364759562 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687" status: 200 len: 1277 microversion: 2.1 time: 0.406645 Jun 20 12:43:31.760649 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3351/6604] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:43:31 2022] GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687 => generated 1277 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:43:32.778407 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f7b8461d-7974-4d45-9920-6fefa0ee6700 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:43:32.779200 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f7b8461d-7974-4d45-9920-6fefa0ee6700 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: aff26d4b-cb0b-4f3d-af4e-53574a436687] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:43:32.810162 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7b8461d-7974-4d45-9920-6fefa0ee6700 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:43:32.812962 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7b8461d-7974-4d45-9920-6fefa0ee6700 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:43:32.814382 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7b8461d-7974-4d45-9920-6fefa0ee6700 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:43:32.817713 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7b8461d-7974-4d45-9920-6fefa0ee6700 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:43:33.038828 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f7b8461d-7974-4d45-9920-6fefa0ee6700 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:43:33.056908 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f7b8461d-7974-4d45-9920-6fefa0ee6700 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687" status: 200 len: 1277 microversion: 2.1 time: 0.281188 Jun 20 12:43:33.060516 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3254/6605] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:43:32 2022] GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687 => generated 1277 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:43:34.081662 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4fee568b-a5e9-438b-b824-35fb9176964a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:43:34.083171 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4fee568b-a5e9-438b-b824-35fb9176964a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: aff26d4b-cb0b-4f3d-af4e-53574a436687] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:43:34.098685 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4fee568b-a5e9-438b-b824-35fb9176964a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:43:34.099307 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4fee568b-a5e9-438b-b824-35fb9176964a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:43:34.100220 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4fee568b-a5e9-438b-b824-35fb9176964a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:43:34.102413 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4fee568b-a5e9-438b-b824-35fb9176964a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:43:34.371943 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4fee568b-a5e9-438b-b824-35fb9176964a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:43:34.386811 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4fee568b-a5e9-438b-b824-35fb9176964a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687" status: 200 len: 1277 microversion: 2.1 time: 0.311719 Jun 20 12:43:34.388375 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3352/6606] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:43:34 2022] GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687 => generated 1277 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:43:35.404367 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-05bd248f-1f26-4c44-be2c-57558eae3e0a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:43:35.408721 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-05bd248f-1f26-4c44-be2c-57558eae3e0a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: aff26d4b-cb0b-4f3d-af4e-53574a436687] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:43:35.425347 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05bd248f-1f26-4c44-be2c-57558eae3e0a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:43:35.428815 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05bd248f-1f26-4c44-be2c-57558eae3e0a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:43:35.432632 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05bd248f-1f26-4c44-be2c-57558eae3e0a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:43:35.433328 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05bd248f-1f26-4c44-be2c-57558eae3e0a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:43:35.697813 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-05bd248f-1f26-4c44-be2c-57558eae3e0a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:43:35.706908 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-05bd248f-1f26-4c44-be2c-57558eae3e0a tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687" status: 200 len: 1265 microversion: 2.1 time: 0.306583 Jun 20 12:43:35.709761 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3255/6607] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:43:35 2022] GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687 => generated 1265 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:43:36.727896 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-083f8aaa-5d64-42d0-b0ad-c9437bca6c51 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:43:36.730119 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-083f8aaa-5d64-42d0-b0ad-c9437bca6c51 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: aff26d4b-cb0b-4f3d-af4e-53574a436687] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:43:36.737615 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:43:36.739081 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:43:36.741165 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-083f8aaa-5d64-42d0-b0ad-c9437bca6c51 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:43:36.742947 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-083f8aaa-5d64-42d0-b0ad-c9437bca6c51 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:43:36.744575 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-083f8aaa-5d64-42d0-b0ad-c9437bca6c51 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:43:36.745191 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-083f8aaa-5d64-42d0-b0ad-c9437bca6c51 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:43:37.417397 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-083f8aaa-5d64-42d0-b0ad-c9437bca6c51 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:43:37.462241 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-083f8aaa-5d64-42d0-b0ad-c9437bca6c51 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687" status: 200 len: 1265 microversion: 2.1 time: 0.740600 Jun 20 12:43:37.463601 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3353/6608] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:43:36 2022] GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687 => generated 1265 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:43:38.485262 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e6985484-d186-416b-afbf-201f6f5ed65b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:43:38.486405 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e6985484-d186-416b-afbf-201f6f5ed65b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: aff26d4b-cb0b-4f3d-af4e-53574a436687] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:43:38.490685 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:43:38.505579 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e6985484-d186-416b-afbf-201f6f5ed65b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:43:38.506219 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e6985484-d186-416b-afbf-201f6f5ed65b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:43:38.508066 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e6985484-d186-416b-afbf-201f6f5ed65b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:43:38.508660 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e6985484-d186-416b-afbf-201f6f5ed65b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:43:38.795517 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e6985484-d186-416b-afbf-201f6f5ed65b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:43:38.806269 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e6985484-d186-416b-afbf-201f6f5ed65b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687" status: 200 len: 1265 microversion: 2.1 time: 0.328959 Jun 20 12:43:38.806970 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3256/6609] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:43:38 2022] GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687 => generated 1265 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:43:39.823477 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-52b13705-22aa-42a4-80d3-674327e7b450 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:43:39.824301 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-52b13705-22aa-42a4-80d3-674327e7b450 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: aff26d4b-cb0b-4f3d-af4e-53574a436687] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:43:39.833539 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52b13705-22aa-42a4-80d3-674327e7b450 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:43:39.834030 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52b13705-22aa-42a4-80d3-674327e7b450 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:43:39.834851 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52b13705-22aa-42a4-80d3-674327e7b450 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:43:39.835283 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52b13705-22aa-42a4-80d3-674327e7b450 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:43:40.002762 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-52b13705-22aa-42a4-80d3-674327e7b450 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:43:40.013771 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-52b13705-22aa-42a4-80d3-674327e7b450 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687" status: 200 len: 1265 microversion: 2.1 time: 0.194305 Jun 20 12:43:40.014590 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3354/6610] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:43:39 2022] GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687 => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:43:41.034406 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1a08ef35-94d3-43dc-81ec-c679456b89aa tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:43:41.035729 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1a08ef35-94d3-43dc-81ec-c679456b89aa tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: aff26d4b-cb0b-4f3d-af4e-53574a436687] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:43:41.048953 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a08ef35-94d3-43dc-81ec-c679456b89aa tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:43:41.049347 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a08ef35-94d3-43dc-81ec-c679456b89aa tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:43:41.051977 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a08ef35-94d3-43dc-81ec-c679456b89aa tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:43:41.052551 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a08ef35-94d3-43dc-81ec-c679456b89aa tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:43:41.506589 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1a08ef35-94d3-43dc-81ec-c679456b89aa tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:43:41.524543 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1a08ef35-94d3-43dc-81ec-c679456b89aa tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687" status: 200 len: 1265 microversion: 2.1 time: 0.495888 Jun 20 12:43:41.536980 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3257/6611] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:43:41 2022] GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687 => generated 1265 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:43:42.547681 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-868e4a68-7a24-4f1d-b3e6-c578d04c8846 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:43:42.549595 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-868e4a68-7a24-4f1d-b3e6-c578d04c8846 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: aff26d4b-cb0b-4f3d-af4e-53574a436687] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:43:42.558776 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-868e4a68-7a24-4f1d-b3e6-c578d04c8846 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:43:42.559243 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-868e4a68-7a24-4f1d-b3e6-c578d04c8846 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:43:42.560032 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-868e4a68-7a24-4f1d-b3e6-c578d04c8846 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:43:42.561586 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-868e4a68-7a24-4f1d-b3e6-c578d04c8846 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:43:43.220954 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-868e4a68-7a24-4f1d-b3e6-c578d04c8846 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:43:43.233850 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-868e4a68-7a24-4f1d-b3e6-c578d04c8846 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687" status: 200 len: 1265 microversion: 2.1 time: 0.691022 Jun 20 12:43:43.238974 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3355/6612] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:43:42 2022] GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687 => generated 1265 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:43:44.258399 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ef28f1c3-be5a-4a68-90b7-f2f6835d82bd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:43:44.259344 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ef28f1c3-be5a-4a68-90b7-f2f6835d82bd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: aff26d4b-cb0b-4f3d-af4e-53574a436687] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:43:44.277177 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef28f1c3-be5a-4a68-90b7-f2f6835d82bd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:43:44.284710 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef28f1c3-be5a-4a68-90b7-f2f6835d82bd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:43:44.285682 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef28f1c3-be5a-4a68-90b7-f2f6835d82bd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:43:44.286278 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef28f1c3-be5a-4a68-90b7-f2f6835d82bd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:43:44.441369 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ef28f1c3-be5a-4a68-90b7-f2f6835d82bd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:43:44.449113 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ef28f1c3-be5a-4a68-90b7-f2f6835d82bd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687" status: 200 len: 1265 microversion: 2.1 time: 0.197533 Jun 20 12:43:44.449703 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3258/6613] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:43:44 2022] GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687 => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:43:44.847298 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-7f93ccc7-25b2-44b4-939a-28490b5c6428 req-ba7109d4-11ab-4bcc-b350-6754c744d0e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aff26d4b-cb0b-4f3d-af4e-53574a436687", "name": "network-vif-plugged", "status": "completed", "tag": "c7f80c16-5ea4-40a5-8cc9-fe7f29e0be3b"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:43:44.859188 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-7f93ccc7-25b2-44b4-939a-28490b5c6428 req-ba7109d4-11ab-4bcc-b350-6754c744d0e7 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:43:44.860315 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-7f93ccc7-25b2-44b4-939a-28490b5c6428 req-ba7109d4-11ab-4bcc-b350-6754c744d0e7 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:43:44.878611 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-7f93ccc7-25b2-44b4-939a-28490b5c6428 req-ba7109d4-11ab-4bcc-b350-6754c744d0e7 service nova] Creating event network-vif-plugged:c7f80c16-5ea4-40a5-8cc9-fe7f29e0be3b for instance aff26d4b-cb0b-4f3d-af4e-53574a436687 on n-h2-master-1 Jun 20 12:43:44.885062 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-7f93ccc7-25b2-44b4-939a-28490b5c6428 req-ba7109d4-11ab-4bcc-b350-6754c744d0e7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044391 Jun 20 12:43:44.886318 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3356/6614] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:43:45.466916 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e6b2a89d-b6c8-4a5f-b268-1ef326fe3f0b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:43:45.467541 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e6b2a89d-b6c8-4a5f-b268-1ef326fe3f0b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: aff26d4b-cb0b-4f3d-af4e-53574a436687] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:43:45.475252 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e6b2a89d-b6c8-4a5f-b268-1ef326fe3f0b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:43:45.476022 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e6b2a89d-b6c8-4a5f-b268-1ef326fe3f0b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:43:45.476838 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e6b2a89d-b6c8-4a5f-b268-1ef326fe3f0b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:43:45.477481 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e6b2a89d-b6c8-4a5f-b268-1ef326fe3f0b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:43:45.637310 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e6b2a89d-b6c8-4a5f-b268-1ef326fe3f0b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:43:45.649837 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e6b2a89d-b6c8-4a5f-b268-1ef326fe3f0b tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687" status: 200 len: 1265 microversion: 2.1 time: 0.186938 Jun 20 12:43:45.650511 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3259/6615] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:43:45 2022] GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:43:46.672700 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1f6ca691-60ca-42f7-bf70-90c2c03f94f4 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:43:46.675479 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1f6ca691-60ca-42f7-bf70-90c2c03f94f4 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: aff26d4b-cb0b-4f3d-af4e-53574a436687] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:43:46.684160 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f6ca691-60ca-42f7-bf70-90c2c03f94f4 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:43:46.684982 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f6ca691-60ca-42f7-bf70-90c2c03f94f4 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:43:46.686210 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f6ca691-60ca-42f7-bf70-90c2c03f94f4 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:43:46.687166 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1f6ca691-60ca-42f7-bf70-90c2c03f94f4 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:43:46.888727 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1f6ca691-60ca-42f7-bf70-90c2c03f94f4 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:43:46.897189 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1f6ca691-60ca-42f7-bf70-90c2c03f94f4 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687" status: 200 len: 1451 microversion: 2.1 time: 0.232772 Jun 20 12:43:46.897960 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3357/6616] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:43:46 2022] GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687 => generated 1451 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:43:46.913888 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-af9a693c-f5de-4b25-b58b-f3f014dabbb5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:43:46.914711 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-af9a693c-f5de-4b25-b58b-f3f014dabbb5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: aff26d4b-cb0b-4f3d-af4e-53574a436687] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:43:46.922834 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-af9a693c-f5de-4b25-b58b-f3f014dabbb5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:43:46.923443 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-af9a693c-f5de-4b25-b58b-f3f014dabbb5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:43:46.924446 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-af9a693c-f5de-4b25-b58b-f3f014dabbb5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:43:46.925249 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-af9a693c-f5de-4b25-b58b-f3f014dabbb5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:43:47.166285 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-af9a693c-f5de-4b25-b58b-f3f014dabbb5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:43:47.175713 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-af9a693c-f5de-4b25-b58b-f3f014dabbb5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687" status: 200 len: 1451 microversion: 2.1 time: 0.265928 Jun 20 12:43:47.187646 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3260/6617] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:43:46 2022] GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687 => generated 1451 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:43:49.021054 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-4e6e3e1e-b900-4543-b334-e6314826c6e7 req-2fa1b5d4-4439-41c6-922d-f1afb9817745 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aff26d4b-cb0b-4f3d-af4e-53574a436687", "tag": "c7f80c16-5ea4-40a5-8cc9-fe7f29e0be3b"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:43:49.030425 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-4e6e3e1e-b900-4543-b334-e6314826c6e7 req-2fa1b5d4-4439-41c6-922d-f1afb9817745 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:43:49.030869 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-4e6e3e1e-b900-4543-b334-e6314826c6e7 req-2fa1b5d4-4439-41c6-922d-f1afb9817745 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:43:49.043431 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-4e6e3e1e-b900-4543-b334-e6314826c6e7 req-2fa1b5d4-4439-41c6-922d-f1afb9817745 service nova] Creating event network-changed:c7f80c16-5ea4-40a5-8cc9-fe7f29e0be3b for instance aff26d4b-cb0b-4f3d-af4e-53574a436687 on n-h2-master-1 Jun 20 12:43:49.050628 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-4e6e3e1e-b900-4543-b334-e6314826c6e7 req-2fa1b5d4-4439-41c6-922d-f1afb9817745 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033978 Jun 20 12:43:49.051886 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3358/6618] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:44:29.202020 n-d-master-1 devstack@n-api.service[119128]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 12:44:29.202631 n-d-master-1 devstack@n-api.service[119128]: Mon Jun 20 12:44:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 12:44:29.236875 n-d-master-1 devstack@n-api.service[119128]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 12:44:29.237256 n-d-master-1 devstack@n-api.service[119128]: Mon Jun 20 12:44:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 12:44:41.006462 n-d-master-1 devstack@n-api.service[119128]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 12:44:41.007653 n-d-master-1 devstack@n-api.service[119128]: Mon Jun 20 12:44:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 12:45:00.237834 n-d-master-1 devstack@n-api.service[119127]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 12:45:00.238527 n-d-master-1 devstack@n-api.service[119127]: Mon Jun 20 12:45:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 12:45:19.181772 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=22 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:45:19.182562 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=54 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:45:19.186646 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-edd178e6-bbd3-42ff-8979-076ba9e4602e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:45:19.187201 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-edd178e6-bbd3-42ff-8979-076ba9e4602e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: aff26d4b-cb0b-4f3d-af4e-53574a436687] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:45:19.191706 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:45:19.192508 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=50 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:45:19.197266 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-d4036478-2a28-4572-8888-ac79debb35dd req-1aa14a86-60e3-4d96-a060-ba80440374c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aff26d4b-cb0b-4f3d-af4e-53574a436687", "tag": "c7f80c16-5ea4-40a5-8cc9-fe7f29e0be3b"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:45:19.210283 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-edd178e6-bbd3-42ff-8979-076ba9e4602e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:19.210757 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-edd178e6-bbd3-42ff-8979-076ba9e4602e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:19.211563 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-edd178e6-bbd3-42ff-8979-076ba9e4602e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:19.212016 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-edd178e6-bbd3-42ff-8979-076ba9e4602e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:19.218799 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-d4036478-2a28-4572-8888-ac79debb35dd req-1aa14a86-60e3-4d96-a060-ba80440374c8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:19.219281 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-d4036478-2a28-4572-8888-ac79debb35dd req-1aa14a86-60e3-4d96-a060-ba80440374c8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:19.235805 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-d4036478-2a28-4572-8888-ac79debb35dd req-1aa14a86-60e3-4d96-a060-ba80440374c8 service nova] Creating event network-changed:c7f80c16-5ea4-40a5-8cc9-fe7f29e0be3b for instance aff26d4b-cb0b-4f3d-af4e-53574a436687 on n-h2-master-1 Jun 20 12:45:19.241391 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-d4036478-2a28-4572-8888-ac79debb35dd req-1aa14a86-60e3-4d96-a060-ba80440374c8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062654 Jun 20 12:45:19.243378 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3359/6619] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:45:19.253742 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-edd178e6-bbd3-42ff-8979-076ba9e4602e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: aff26d4b-cb0b-4f3d-af4e-53574a436687] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:45:19.370628 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-edd178e6-bbd3-42ff-8979-076ba9e4602e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "DELETE /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687" status: 204 len: 0 microversion: 2.1 time: 0.193472 Jun 20 12:45:19.371519 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3261/6620] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:45:19 2022] DELETE /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:45:19.383427 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1981dac9-8d19-4045-92dc-1e6c0ff73719 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:45:19.384107 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1981dac9-8d19-4045-92dc-1e6c0ff73719 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: aff26d4b-cb0b-4f3d-af4e-53574a436687] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:45:19.395858 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1981dac9-8d19-4045-92dc-1e6c0ff73719 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:19.396485 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1981dac9-8d19-4045-92dc-1e6c0ff73719 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:19.397132 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1981dac9-8d19-4045-92dc-1e6c0ff73719 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:19.398284 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1981dac9-8d19-4045-92dc-1e6c0ff73719 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:19.599357 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1981dac9-8d19-4045-92dc-1e6c0ff73719 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:45:19.608036 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1981dac9-8d19-4045-92dc-1e6c0ff73719 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687" status: 200 len: 1575 microversion: 2.1 time: 0.229965 Jun 20 12:45:19.608968 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3360/6621] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:45:19 2022] GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687 => generated 1575 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:45:20.626389 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4f278b49-c567-42a5-8634-c383a8c860dc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:45:20.628149 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4f278b49-c567-42a5-8634-c383a8c860dc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: aff26d4b-cb0b-4f3d-af4e-53574a436687] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:45:20.635640 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4f278b49-c567-42a5-8634-c383a8c860dc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:20.636252 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4f278b49-c567-42a5-8634-c383a8c860dc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:20.637251 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4f278b49-c567-42a5-8634-c383a8c860dc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:20.637806 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4f278b49-c567-42a5-8634-c383a8c860dc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:20.814577 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4f278b49-c567-42a5-8634-c383a8c860dc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:45:20.822820 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4f278b49-c567-42a5-8634-c383a8c860dc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687" status: 200 len: 1575 microversion: 2.1 time: 0.200693 Jun 20 12:45:20.823497 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3262/6622] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:45:20 2022] GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687 => generated 1575 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:45:21.842271 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7260431f-059c-4d7a-bddf-c5ffbb305666 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:45:21.843041 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7260431f-059c-4d7a-bddf-c5ffbb305666 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: aff26d4b-cb0b-4f3d-af4e-53574a436687] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:45:21.851383 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7260431f-059c-4d7a-bddf-c5ffbb305666 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:21.852194 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7260431f-059c-4d7a-bddf-c5ffbb305666 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:21.853136 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7260431f-059c-4d7a-bddf-c5ffbb305666 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:21.853667 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7260431f-059c-4d7a-bddf-c5ffbb305666 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:21.927479 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7260431f-059c-4d7a-bddf-c5ffbb305666 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:45:21.935820 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7260431f-059c-4d7a-bddf-c5ffbb305666 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687" status: 200 len: 1389 microversion: 2.1 time: 0.097841 Jun 20 12:45:21.942597 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3361/6623] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:45:21 2022] GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687 => generated 1389 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:45:22.065819 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-5f010fcf-dbb7-496f-8e10-bdb811744883 req-08e0d9fb-ff5f-4490-b737-bbeae39e2b1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aff26d4b-cb0b-4f3d-af4e-53574a436687", "name": "network-vif-deleted", "tag": "c7f80c16-5ea4-40a5-8cc9-fe7f29e0be3b"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:45:22.075309 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-5f010fcf-dbb7-496f-8e10-bdb811744883 req-08e0d9fb-ff5f-4490-b737-bbeae39e2b1e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:22.075772 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-5f010fcf-dbb7-496f-8e10-bdb811744883 req-08e0d9fb-ff5f-4490-b737-bbeae39e2b1e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:22.087759 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-5f010fcf-dbb7-496f-8e10-bdb811744883 req-08e0d9fb-ff5f-4490-b737-bbeae39e2b1e service nova] Creating event network-vif-deleted:c7f80c16-5ea4-40a5-8cc9-fe7f29e0be3b for instance aff26d4b-cb0b-4f3d-af4e-53574a436687 on n-h2-master-1 Jun 20 12:45:22.092656 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-5f010fcf-dbb7-496f-8e10-bdb811744883 req-08e0d9fb-ff5f-4490-b737-bbeae39e2b1e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030658 Jun 20 12:45:22.093286 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3263/6624] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:45:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:45:22.957447 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d126f17f-75b3-434f-ac18-4f4458e136e0 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:45:22.958372 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d126f17f-75b3-434f-ac18-4f4458e136e0 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: aff26d4b-cb0b-4f3d-af4e-53574a436687] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:45:22.965240 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d126f17f-75b3-434f-ac18-4f4458e136e0 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:22.965697 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d126f17f-75b3-434f-ac18-4f4458e136e0 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:22.966748 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d126f17f-75b3-434f-ac18-4f4458e136e0 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:22.967197 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d126f17f-75b3-434f-ac18-4f4458e136e0 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:23.051081 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d126f17f-75b3-434f-ac18-4f4458e136e0 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:45:23.060355 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d126f17f-75b3-434f-ac18-4f4458e136e0 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687" status: 200 len: 1224 microversion: 2.1 time: 0.110091 Jun 20 12:45:23.061039 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3362/6625] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:45:22 2022] GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687 => generated 1224 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:45:24.081797 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d3d36f08-2bb5-473e-b0b1-b0c3fe9470f8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:45:24.083111 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d3d36f08-2bb5-473e-b0b1-b0c3fe9470f8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: aff26d4b-cb0b-4f3d-af4e-53574a436687] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:45:24.089916 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3d36f08-2bb5-473e-b0b1-b0c3fe9470f8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:24.090359 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3d36f08-2bb5-473e-b0b1-b0c3fe9470f8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:24.091183 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3d36f08-2bb5-473e-b0b1-b0c3fe9470f8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:24.091630 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3d36f08-2bb5-473e-b0b1-b0c3fe9470f8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:24.168124 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d3d36f08-2bb5-473e-b0b1-b0c3fe9470f8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:45:24.180389 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d3d36f08-2bb5-473e-b0b1-b0c3fe9470f8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687" status: 200 len: 1224 microversion: 2.1 time: 0.105285 Jun 20 12:45:24.182093 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3264/6626] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:45:24 2022] GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687 => generated 1224 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:45:25.199071 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f6714b91-7df7-4331-816b-1d69b47cfd2d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:45:25.199962 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f6714b91-7df7-4331-816b-1d69b47cfd2d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: aff26d4b-cb0b-4f3d-af4e-53574a436687] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:45:25.208218 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f6714b91-7df7-4331-816b-1d69b47cfd2d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:25.208824 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f6714b91-7df7-4331-816b-1d69b47cfd2d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:25.209728 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f6714b91-7df7-4331-816b-1d69b47cfd2d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:25.210602 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f6714b91-7df7-4331-816b-1d69b47cfd2d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:25.288638 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f6714b91-7df7-4331-816b-1d69b47cfd2d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:45:25.297863 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f6714b91-7df7-4331-816b-1d69b47cfd2d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687" status: 200 len: 1224 microversion: 2.1 time: 0.103162 Jun 20 12:45:25.298633 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3363/6627] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:45:25 2022] GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687 => generated 1224 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:45:26.317689 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f125b0fe-bc18-4c54-94a7-61f7ee9477c1 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:45:26.318260 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f125b0fe-bc18-4c54-94a7-61f7ee9477c1 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: aff26d4b-cb0b-4f3d-af4e-53574a436687] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:45:26.325113 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f125b0fe-bc18-4c54-94a7-61f7ee9477c1 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:26.325574 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f125b0fe-bc18-4c54-94a7-61f7ee9477c1 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:26.326357 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f125b0fe-bc18-4c54-94a7-61f7ee9477c1 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:26.326803 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f125b0fe-bc18-4c54-94a7-61f7ee9477c1 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:26.397664 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f125b0fe-bc18-4c54-94a7-61f7ee9477c1 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:45:26.409110 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f125b0fe-bc18-4c54-94a7-61f7ee9477c1 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687" status: 200 len: 1224 microversion: 2.1 time: 0.096243 Jun 20 12:45:26.409584 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3265/6628] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:45:26 2022] GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:45:27.430139 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9ad2361f-3030-4d2a-88ce-cf7ae60d82a8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:45:27.430766 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9ad2361f-3030-4d2a-88ce-cf7ae60d82a8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: aff26d4b-cb0b-4f3d-af4e-53574a436687] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:45:27.438091 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ad2361f-3030-4d2a-88ce-cf7ae60d82a8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:27.438549 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ad2361f-3030-4d2a-88ce-cf7ae60d82a8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:27.439332 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ad2361f-3030-4d2a-88ce-cf7ae60d82a8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:27.439772 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ad2361f-3030-4d2a-88ce-cf7ae60d82a8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:27.456250 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-9ad2361f-3030-4d2a-88ce-cf7ae60d82a8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] HTTP exception thrown: Instance aff26d4b-cb0b-4f3d-af4e-53574a436687 could not be found. Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9ad2361f-3030-4d2a-88ce-cf7ae60d82a8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Request method failure captured: Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687 HTTP/1.1 Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGlbodlapeisJn5a0HtwbwcZIYoBmT5AMrWgFKctZEM-c8IEHUY-HIxlKO2btmEhIp6rTchMUsTfBqlVWDOj1EarcMAz1U-zU3gC1LYOn6ihs7mNZ7VuUoyKyfaVYT5-C41dz-fiCbk7B4FysstqCDj9MrkXDGMTtiNF2ZH2AvXNm6I Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 5a9c7bbcc9a149f5b77a89141a306c3e Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-TestVolumeBootPattern-431625802 Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-TestVolumeBootPattern-431625802 Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 5a9c7bbcc9a149f5b77a89141a306c3e Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-TestVolumeBootPattern-431625802 Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-TestVolumeBootPattern-431625802-project Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: fed0afc129364664aed8d8a96f499831 Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-TestVolumeBootPattern-431625802-project Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: exception: Instance aff26d4b-cb0b-4f3d-af4e-53574a436687 could not be found. Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'aff26d4b-cb0b-4f3d-af4e-53574a436687'} Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aff26d4b-cb0b-4f3d-af4e-53574a436687 could not be found. Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aff26d4b-cb0b-4f3d-af4e-53574a436687 could not be found. Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:45:27.458032 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:45:27.463339 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:45:27.463339 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:45:27.463339 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:45:27.463339 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:45:27.463339 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:45:27.463339 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aff26d4b-cb0b-4f3d-af4e-53574a436687 could not be found. Jun 20 12:45:27.463339 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:45:27.463339 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9ad2361f-3030-4d2a-88ce-cf7ae60d82a8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Returning 404 to user: Instance aff26d4b-cb0b-4f3d-af4e-53574a436687 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:45:27.463339 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9ad2361f-3030-4d2a-88ce-cf7ae60d82a8 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687" status: 404 len: 111 microversion: 2.1 time: 0.035605 Jun 20 12:45:27.463339 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3364/6629] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:45:27 2022] GET /compute/v2.1/servers/aff26d4b-cb0b-4f3d-af4e-53574a436687 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:45:33.834452 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-5b5ba976-3f7e-42a1-be34-2a56c137714e req-f847b2bb-e463-43bd-86ae-35175a9f314a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23d20f6e-3955-4967-8936-e092f3c942bc", "tag": "3c5e50e8-be21-4cf5-abad-d9a04881fd8d"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:45:33.842080 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b19ccf5f-dfe1-40f5-af0e-b8f8dcdc6182 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:45:33.843479 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b19ccf5f-dfe1-40f5-af0e-b8f8dcdc6182 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 23d20f6e-3955-4967-8936-e092f3c942bc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:45:33.843627 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-5b5ba976-3f7e-42a1-be34-2a56c137714e req-f847b2bb-e463-43bd-86ae-35175a9f314a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:33.844055 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-5b5ba976-3f7e-42a1-be34-2a56c137714e req-f847b2bb-e463-43bd-86ae-35175a9f314a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:33.852567 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b19ccf5f-dfe1-40f5-af0e-b8f8dcdc6182 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:33.853484 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b19ccf5f-dfe1-40f5-af0e-b8f8dcdc6182 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:33.854362 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b19ccf5f-dfe1-40f5-af0e-b8f8dcdc6182 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:33.854886 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b19ccf5f-dfe1-40f5-af0e-b8f8dcdc6182 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:33.858012 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-5b5ba976-3f7e-42a1-be34-2a56c137714e req-f847b2bb-e463-43bd-86ae-35175a9f314a service nova] Creating event network-changed:3c5e50e8-be21-4cf5-abad-d9a04881fd8d for instance 23d20f6e-3955-4967-8936-e092f3c942bc on n-h1-master-1 Jun 20 12:45:33.865080 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-5b5ba976-3f7e-42a1-be34-2a56c137714e req-f847b2bb-e463-43bd-86ae-35175a9f314a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034580 Jun 20 12:45:33.866645 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3365/6630] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:45:33.902267 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b19ccf5f-dfe1-40f5-af0e-b8f8dcdc6182 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 23d20f6e-3955-4967-8936-e092f3c942bc] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:45:34.053675 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b19ccf5f-dfe1-40f5-af0e-b8f8dcdc6182 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "DELETE /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc" status: 204 len: 0 microversion: 2.1 time: 0.225287 Jun 20 12:45:34.055151 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3266/6631] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:45:33 2022] DELETE /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:45:34.064691 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dfb6f507-2f03-472c-a5e6-59c533463443 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:45:34.066108 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dfb6f507-2f03-472c-a5e6-59c533463443 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 23d20f6e-3955-4967-8936-e092f3c942bc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:45:34.073779 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dfb6f507-2f03-472c-a5e6-59c533463443 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:34.074686 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dfb6f507-2f03-472c-a5e6-59c533463443 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:34.075944 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dfb6f507-2f03-472c-a5e6-59c533463443 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:34.076702 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dfb6f507-2f03-472c-a5e6-59c533463443 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:34.244559 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dfb6f507-2f03-472c-a5e6-59c533463443 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:45:34.252538 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dfb6f507-2f03-472c-a5e6-59c533463443 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc" status: 200 len: 1577 microversion: 2.1 time: 0.192606 Jun 20 12:45:34.262640 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3366/6632] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:45:34 2022] GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc => generated 1577 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:45:35.276181 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b00dd0b9-9cfe-4c5e-9c36-03fdc92ece66 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:45:35.278630 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b00dd0b9-9cfe-4c5e-9c36-03fdc92ece66 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 23d20f6e-3955-4967-8936-e092f3c942bc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:45:35.288887 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b00dd0b9-9cfe-4c5e-9c36-03fdc92ece66 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:35.289495 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b00dd0b9-9cfe-4c5e-9c36-03fdc92ece66 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:35.290367 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b00dd0b9-9cfe-4c5e-9c36-03fdc92ece66 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:35.290901 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b00dd0b9-9cfe-4c5e-9c36-03fdc92ece66 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:35.488472 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b00dd0b9-9cfe-4c5e-9c36-03fdc92ece66 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:45:35.498576 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b00dd0b9-9cfe-4c5e-9c36-03fdc92ece66 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc" status: 200 len: 1577 microversion: 2.1 time: 0.230396 Jun 20 12:45:35.499246 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3267/6633] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:45:35 2022] GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc => generated 1577 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:45:36.475412 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-0b0bb249-e226-4b74-88e8-0fc653002185 req-9fe5ada3-72f4-415d-aa0d-e7558c28f0d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23d20f6e-3955-4967-8936-e092f3c942bc", "name": "network-vif-deleted", "tag": "3c5e50e8-be21-4cf5-abad-d9a04881fd8d"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:45:36.492243 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-0b0bb249-e226-4b74-88e8-0fc653002185 req-9fe5ada3-72f4-415d-aa0d-e7558c28f0d9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:36.492688 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-0b0bb249-e226-4b74-88e8-0fc653002185 req-9fe5ada3-72f4-415d-aa0d-e7558c28f0d9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:36.506409 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-0b0bb249-e226-4b74-88e8-0fc653002185 req-9fe5ada3-72f4-415d-aa0d-e7558c28f0d9 service nova] Creating event network-vif-deleted:3c5e50e8-be21-4cf5-abad-d9a04881fd8d for instance 23d20f6e-3955-4967-8936-e092f3c942bc on n-h1-master-1 Jun 20 12:45:36.513661 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-0b0bb249-e226-4b74-88e8-0fc653002185 req-9fe5ada3-72f4-415d-aa0d-e7558c28f0d9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043271 Jun 20 12:45:36.515692 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3367/6634] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:45:36.518419 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-306f9795-5fc1-4de2-beac-d106fdd91d50 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:45:36.519375 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-306f9795-5fc1-4de2-beac-d106fdd91d50 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 23d20f6e-3955-4967-8936-e092f3c942bc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:45:36.537617 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-306f9795-5fc1-4de2-beac-d106fdd91d50 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:36.538432 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-306f9795-5fc1-4de2-beac-d106fdd91d50 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:36.539454 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-306f9795-5fc1-4de2-beac-d106fdd91d50 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:36.540061 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-306f9795-5fc1-4de2-beac-d106fdd91d50 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:36.635559 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-306f9795-5fc1-4de2-beac-d106fdd91d50 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:45:36.643506 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-306f9795-5fc1-4de2-beac-d106fdd91d50 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc" status: 200 len: 1225 microversion: 2.1 time: 0.131042 Jun 20 12:45:36.644148 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3268/6635] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:45:36 2022] GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc => generated 1225 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:45:37.663066 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-879813c3-6542-4d6d-a5bf-0b48e80d70b5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:45:37.663658 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-879813c3-6542-4d6d-a5bf-0b48e80d70b5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 23d20f6e-3955-4967-8936-e092f3c942bc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:45:37.672840 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-879813c3-6542-4d6d-a5bf-0b48e80d70b5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:37.673303 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-879813c3-6542-4d6d-a5bf-0b48e80d70b5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:37.674260 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-879813c3-6542-4d6d-a5bf-0b48e80d70b5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:37.674559 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-879813c3-6542-4d6d-a5bf-0b48e80d70b5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:37.746953 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-879813c3-6542-4d6d-a5bf-0b48e80d70b5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:45:37.757028 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-879813c3-6542-4d6d-a5bf-0b48e80d70b5 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc" status: 200 len: 1225 microversion: 2.1 time: 0.099987 Jun 20 12:45:37.757626 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3368/6636] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:45:37 2022] GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:45:38.779870 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7a28a398-337b-4ec5-aa28-040a30dff069 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:45:38.780517 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7a28a398-337b-4ec5-aa28-040a30dff069 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 23d20f6e-3955-4967-8936-e092f3c942bc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:45:38.787920 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7a28a398-337b-4ec5-aa28-040a30dff069 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:38.788522 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7a28a398-337b-4ec5-aa28-040a30dff069 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:38.789407 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7a28a398-337b-4ec5-aa28-040a30dff069 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:38.789841 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7a28a398-337b-4ec5-aa28-040a30dff069 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:38.864050 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7a28a398-337b-4ec5-aa28-040a30dff069 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:45:38.872905 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7a28a398-337b-4ec5-aa28-040a30dff069 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc" status: 200 len: 1225 microversion: 2.1 time: 0.096878 Jun 20 12:45:38.883148 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3269/6637] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:45:38 2022] GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:45:39.902936 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8e71f762-2d85-474b-9fff-dece53b6ec8d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:45:39.904116 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8e71f762-2d85-474b-9fff-dece53b6ec8d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 23d20f6e-3955-4967-8936-e092f3c942bc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:45:39.916024 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8e71f762-2d85-474b-9fff-dece53b6ec8d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:39.916327 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8e71f762-2d85-474b-9fff-dece53b6ec8d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:39.917141 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8e71f762-2d85-474b-9fff-dece53b6ec8d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:39.917828 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8e71f762-2d85-474b-9fff-dece53b6ec8d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:39.994915 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8e71f762-2d85-474b-9fff-dece53b6ec8d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:45:40.005389 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8e71f762-2d85-474b-9fff-dece53b6ec8d tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc" status: 200 len: 1225 microversion: 2.1 time: 0.117626 Jun 20 12:45:40.006384 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3369/6638] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:45:39 2022] GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc => generated 1225 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:45:41.026873 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b0d50447-fc5c-414e-94ed-72016eeed1cd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:45:41.029492 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b0d50447-fc5c-414e-94ed-72016eeed1cd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 23d20f6e-3955-4967-8936-e092f3c942bc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:45:41.043222 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b0d50447-fc5c-414e-94ed-72016eeed1cd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:41.044523 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b0d50447-fc5c-414e-94ed-72016eeed1cd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:41.046351 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b0d50447-fc5c-414e-94ed-72016eeed1cd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:41.047137 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b0d50447-fc5c-414e-94ed-72016eeed1cd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:41.109378 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b0d50447-fc5c-414e-94ed-72016eeed1cd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:41.110087 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b0d50447-fc5c-414e-94ed-72016eeed1cd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:41.110732 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-b0d50447-fc5c-414e-94ed-72016eeed1cd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lazy-loading 'fault' on Instance uuid 23d20f6e-3955-4967-8936-e092f3c942bc {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:45:41.170274 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b0d50447-fc5c-414e-94ed-72016eeed1cd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed0afc129364664aed8d8a96f499831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9c7bbcc9a149f5b77a89141a306c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:45:41.180465 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b0d50447-fc5c-414e-94ed-72016eeed1cd tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc" status: 200 len: 1230 microversion: 2.1 time: 0.160611 Jun 20 12:45:41.181174 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3270/6639] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:45:41 2022] GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc => generated 1230 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:45:42.199518 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f61e344f-af69-4518-bad1-dfa05ebe9959 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:45:42.200139 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f61e344f-af69-4518-bad1-dfa05ebe9959 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 23d20f6e-3955-4967-8936-e092f3c942bc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:45:42.208924 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f61e344f-af69-4518-bad1-dfa05ebe9959 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:42.209775 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f61e344f-af69-4518-bad1-dfa05ebe9959 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:42.210577 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f61e344f-af69-4518-bad1-dfa05ebe9959 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:42.211011 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f61e344f-af69-4518-bad1-dfa05ebe9959 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:42.226422 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-f61e344f-af69-4518-bad1-dfa05ebe9959 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] HTTP exception thrown: Instance 23d20f6e-3955-4967-8936-e092f3c942bc could not be found. Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f61e344f-af69-4518-bad1-dfa05ebe9959 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Request method failure captured: Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc HTTP/1.1 Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGlbodlapeisJn5a0HtwbwcZIYoBmT5AMrWgFKctZEM-c8IEHUY-HIxlKO2btmEhIp6rTchMUsTfBqlVWDOj1EarcMAz1U-zU3gC1LYOn6ihs7mNZ7VuUoyKyfaVYT5-C41dz-fiCbk7B4FysstqCDj9MrkXDGMTtiNF2ZH2AvXNm6I Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 5a9c7bbcc9a149f5b77a89141a306c3e Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-TestVolumeBootPattern-431625802 Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-TestVolumeBootPattern-431625802 Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 5a9c7bbcc9a149f5b77a89141a306c3e Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-TestVolumeBootPattern-431625802 Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-TestVolumeBootPattern-431625802-project Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: fed0afc129364664aed8d8a96f499831 Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-TestVolumeBootPattern-431625802-project Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 23d20f6e-3955-4967-8936-e092f3c942bc could not be found. Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '23d20f6e-3955-4967-8936-e092f3c942bc'} Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23d20f6e-3955-4967-8936-e092f3c942bc could not be found. Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23d20f6e-3955-4967-8936-e092f3c942bc could not be found. Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:45:42.228145 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:45:42.234129 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:45:42.234129 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:45:42.234129 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:45:42.234129 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:45:42.234129 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:45:42.234129 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23d20f6e-3955-4967-8936-e092f3c942bc could not be found. Jun 20 12:45:42.234129 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:45:42.234129 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f61e344f-af69-4518-bad1-dfa05ebe9959 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Returning 404 to user: Instance 23d20f6e-3955-4967-8936-e092f3c942bc could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:45:42.234129 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f61e344f-af69-4518-bad1-dfa05ebe9959 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc" status: 404 len: 111 microversion: 2.1 time: 0.034520 Jun 20 12:45:42.234129 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3370/6640] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:45:42 2022] GET /compute/v2.1/servers/23d20f6e-3955-4967-8936-e092f3c942bc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:45:42.750199 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-764e1910-68df-41d5-b21e-b6797a90d363 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:45:42.750878 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-764e1910-68df-41d5-b21e-b6797a90d363 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 47bf8feb-9acf-44f3-960f-a4eb84570735] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:45:42.758440 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-764e1910-68df-41d5-b21e-b6797a90d363 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:42.758946 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-764e1910-68df-41d5-b21e-b6797a90d363 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:42.759762 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-764e1910-68df-41d5-b21e-b6797a90d363 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:42.760242 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-764e1910-68df-41d5-b21e-b6797a90d363 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:42.775699 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-764e1910-68df-41d5-b21e-b6797a90d363 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] HTTP exception thrown: Instance 47bf8feb-9acf-44f3-960f-a4eb84570735 could not be found. Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-764e1910-68df-41d5-b21e-b6797a90d363 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Request method failure captured: Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735 HTTP/1.1 Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGlbodlapeisJn5a0HtwbwcZIYoBmT5AMrWgFKctZEM-c8IEHUY-HIxlKO2btmEhIp6rTchMUsTfBqlVWDOj1EarcMAz1U-zU3gC1LYOn6ihs7mNZ7VuUoyKyfaVYT5-C41dz-fiCbk7B4FysstqCDj9MrkXDGMTtiNF2ZH2AvXNm6I Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 5a9c7bbcc9a149f5b77a89141a306c3e Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-TestVolumeBootPattern-431625802 Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-TestVolumeBootPattern-431625802 Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 5a9c7bbcc9a149f5b77a89141a306c3e Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-TestVolumeBootPattern-431625802 Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-TestVolumeBootPattern-431625802-project Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: fed0afc129364664aed8d8a96f499831 Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-TestVolumeBootPattern-431625802-project Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 47bf8feb-9acf-44f3-960f-a4eb84570735 could not be found. Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '47bf8feb-9acf-44f3-960f-a4eb84570735'} Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47bf8feb-9acf-44f3-960f-a4eb84570735 could not be found. Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:45:42.777864 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:45:42.783053 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47bf8feb-9acf-44f3-960f-a4eb84570735 could not be found. Jun 20 12:45:42.783053 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:45:42.783053 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:45:42.783053 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:45:42.783053 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:45:42.783053 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:45:42.783053 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:45:42.783053 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:45:42.783053 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:45:42.783053 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47bf8feb-9acf-44f3-960f-a4eb84570735 could not be found. Jun 20 12:45:42.783053 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:45:42.783053 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-764e1910-68df-41d5-b21e-b6797a90d363 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Returning 404 to user: Instance 47bf8feb-9acf-44f3-960f-a4eb84570735 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:45:42.783053 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-764e1910-68df-41d5-b21e-b6797a90d363 tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "DELETE /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735" status: 404 len: 111 microversion: 2.1 time: 0.033567 Jun 20 12:45:42.784228 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3271/6641] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:45:42 2022] DELETE /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:45:42.790068 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7c5b0d00-b299-4eaa-a264-0913e48c82cc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:45:42.790898 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7c5b0d00-b299-4eaa-a264-0913e48c82cc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] [instance: 47bf8feb-9acf-44f3-960f-a4eb84570735] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:45:42.798230 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c5b0d00-b299-4eaa-a264-0913e48c82cc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:42.799059 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c5b0d00-b299-4eaa-a264-0913e48c82cc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:42.802015 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c5b0d00-b299-4eaa-a264-0913e48c82cc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:45:42.802755 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c5b0d00-b299-4eaa-a264-0913e48c82cc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:45:42.819198 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-7c5b0d00-b299-4eaa-a264-0913e48c82cc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] HTTP exception thrown: Instance 47bf8feb-9acf-44f3-960f-a4eb84570735 could not be found. Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7c5b0d00-b299-4eaa-a264-0913e48c82cc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Request method failure captured: Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735 HTTP/1.1 Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGlbodlapeisJn5a0HtwbwcZIYoBmT5AMrWgFKctZEM-c8IEHUY-HIxlKO2btmEhIp6rTchMUsTfBqlVWDOj1EarcMAz1U-zU3gC1LYOn6ihs7mNZ7VuUoyKyfaVYT5-C41dz-fiCbk7B4FysstqCDj9MrkXDGMTtiNF2ZH2AvXNm6I Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 5a9c7bbcc9a149f5b77a89141a306c3e Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-TestVolumeBootPattern-431625802 Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5a9c7bbcc9a149f5b77a89141a306c3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-TestVolumeBootPattern-431625802 Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 5a9c7bbcc9a149f5b77a89141a306c3e Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-TestVolumeBootPattern-431625802 Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-TestVolumeBootPattern-431625802-project Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: fed0afc129364664aed8d8a96f499831 Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-TestVolumeBootPattern-431625802-project Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 47bf8feb-9acf-44f3-960f-a4eb84570735 could not be found. Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '47bf8feb-9acf-44f3-960f-a4eb84570735'} Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47bf8feb-9acf-44f3-960f-a4eb84570735 could not be found. Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47bf8feb-9acf-44f3-960f-a4eb84570735 could not be found. Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:45:42.820944 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:45:42.830441 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:45:42.830441 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:45:42.830441 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:45:42.830441 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:45:42.830441 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:45:42.830441 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47bf8feb-9acf-44f3-960f-a4eb84570735 could not be found. Jun 20 12:45:42.830441 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:45:42.830441 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7c5b0d00-b299-4eaa-a264-0913e48c82cc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Returning 404 to user: Instance 47bf8feb-9acf-44f3-960f-a4eb84570735 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:45:42.830441 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7c5b0d00-b299-4eaa-a264-0913e48c82cc tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735" status: 404 len: 111 microversion: 2.1 time: 0.036846 Jun 20 12:45:42.830441 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3371/6642] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:45:42 2022] GET /compute/v2.1/servers/47bf8feb-9acf-44f3-960f-a4eb84570735 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:45:46.316741 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3ee78373-4f0d-4266-908d-2411bbdd6b5e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] Calling method '.version_select at 0x7f60724ed160>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:45:46.346157 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3ee78373-4f0d-4266-908d-2411bbdd6b5e tempest-TestVolumeBootPattern-431625802 tempest-TestVolumeBootPattern-431625802-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-997416587" status: 202 len: 0 microversion: 2.1 time: 0.033931 Jun 20 12:45:46.347218 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3272/6643] 10.222.0.27 () {58 vars in 1259 bytes} [Mon Jun 20 12:45:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-997416587 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:46:12.036952 n-d-master-1 devstack@n-api.service[119127]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 12:46:12.037621 n-d-master-1 devstack@n-api.service[119127]: Mon Jun 20 12:46:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 12:46:56.370362 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=26 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:46:56.371109 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=54 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:46:56.375375 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-21ab3d30-4415-4558-8085-12072d071ea4 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-842428190", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "3a368fd3-74fa-4970-a3a8-0288335ee63e"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:46:56.435050 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-21ab3d30-4415-4558-8085-12072d071ea4 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] validate_networks() for [('3a368fd3-74fa-4970-a3a8-0288335ee63e', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:46:56.893969 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-21ab3d30-4415-4558-8085-12072d071ea4 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:46:56.894404 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-21ab3d30-4415-4558-8085-12072d071ea4 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:46:56.894889 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-21ab3d30-4415-4558-8085-12072d071ea4 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:46:56.895309 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-21ab3d30-4415-4558-8085-12072d071ea4 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:46:56.895719 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-21ab3d30-4415-4558-8085-12072d071ea4 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:46:56.905836 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21ab3d30-4415-4558-8085-12072d071ea4 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:46:56.906289 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21ab3d30-4415-4558-8085-12072d071ea4 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:46:56.907069 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21ab3d30-4415-4558-8085-12072d071ea4 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:46:56.907509 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21ab3d30-4415-4558-8085-12072d071ea4 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:46:56.925510 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-21ab3d30-4415-4558-8085-12072d071ea4 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Getting quotas for project 60370353502340f69098617e40800da8. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:46:56.935563 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-21ab3d30-4415-4558-8085-12072d071ea4 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Getting quotas for user 938ec7c6175748c89c9ab87aac9a6978 and project 60370353502340f69098617e40800da8. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:46:56.952381 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-21ab3d30-4415-4558-8085-12072d071ea4 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:46:56.956224 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-21ab3d30-4415-4558-8085-12072d071ea4 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] [instance: 297cf406-0faf-4f32-b894-1fe4b6599dfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:46:57.012275 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-21ab3d30-4415-4558-8085-12072d071ea4 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.643983 Jun 20 12:46:57.012960 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3372/6644] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:46:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:46:57.021246 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:46:57.022197 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:46:57.026673 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fa649b4b-83b7-45cb-90a6-10798201ec6f tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:46:57.027297 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fa649b4b-83b7-45cb-90a6-10798201ec6f tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] [instance: 297cf406-0faf-4f32-b894-1fe4b6599dfb] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:46:57.217518 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fa649b4b-83b7-45cb-90a6-10798201ec6f tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938ec7c6175748c89c9ab87aac9a6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60370353502340f69098617e40800da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:46:57.224430 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fa649b4b-83b7-45cb-90a6-10798201ec6f tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] 10.222.0.27 "GET /compute/v2.1/servers/297cf406-0faf-4f32-b894-1fe4b6599dfb" status: 200 len: 1213 microversion: 2.1 time: 0.205281 Jun 20 12:46:57.225192 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3273/6645] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:46:57 2022] GET /compute/v2.1/servers/297cf406-0faf-4f32-b894-1fe4b6599dfb => generated 1213 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:46:58.243235 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1bf8e3e2-0700-4520-ab75-2e2a37a8ca80 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:46:58.244076 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1bf8e3e2-0700-4520-ab75-2e2a37a8ca80 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] [instance: 297cf406-0faf-4f32-b894-1fe4b6599dfb] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:46:58.251480 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1bf8e3e2-0700-4520-ab75-2e2a37a8ca80 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:46:58.251878 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1bf8e3e2-0700-4520-ab75-2e2a37a8ca80 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:46:58.252700 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1bf8e3e2-0700-4520-ab75-2e2a37a8ca80 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:46:58.253128 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1bf8e3e2-0700-4520-ab75-2e2a37a8ca80 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:46:58.321859 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1bf8e3e2-0700-4520-ab75-2e2a37a8ca80 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938ec7c6175748c89c9ab87aac9a6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60370353502340f69098617e40800da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:46:58.329713 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1bf8e3e2-0700-4520-ab75-2e2a37a8ca80 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] 10.222.0.27 "GET /compute/v2.1/servers/297cf406-0faf-4f32-b894-1fe4b6599dfb" status: 200 len: 1283 microversion: 2.1 time: 0.091564 Jun 20 12:46:58.330383 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3373/6646] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:46:58 2022] GET /compute/v2.1/servers/297cf406-0faf-4f32-b894-1fe4b6599dfb => generated 1283 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:46:59.348130 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-73c3e668-0eca-49c5-9440-2b6ea7ab1c93 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:46:59.349473 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-73c3e668-0eca-49c5-9440-2b6ea7ab1c93 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] [instance: 297cf406-0faf-4f32-b894-1fe4b6599dfb] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:46:59.357182 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-73c3e668-0eca-49c5-9440-2b6ea7ab1c93 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:46:59.357664 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-73c3e668-0eca-49c5-9440-2b6ea7ab1c93 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:46:59.358445 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-73c3e668-0eca-49c5-9440-2b6ea7ab1c93 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:46:59.358892 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-73c3e668-0eca-49c5-9440-2b6ea7ab1c93 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:46:59.546793 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-73c3e668-0eca-49c5-9440-2b6ea7ab1c93 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938ec7c6175748c89c9ab87aac9a6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60370353502340f69098617e40800da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:46:59.559130 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-73c3e668-0eca-49c5-9440-2b6ea7ab1c93 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] 10.222.0.27 "GET /compute/v2.1/servers/297cf406-0faf-4f32-b894-1fe4b6599dfb" status: 200 len: 1313 microversion: 2.1 time: 0.215659 Jun 20 12:46:59.560033 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3274/6647] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:46:59 2022] GET /compute/v2.1/servers/297cf406-0faf-4f32-b894-1fe4b6599dfb => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:46:59.678944 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-e28f25f2-f98d-4c2a-bc90-91cd129c655d req-f5de849e-afd2-428a-8e8a-50d232abaca0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "297cf406-0faf-4f32-b894-1fe4b6599dfb", "tag": "6be2a15b-c5a5-4fc8-bb82-828c60bfe042"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:46:59.689464 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-e28f25f2-f98d-4c2a-bc90-91cd129c655d req-f5de849e-afd2-428a-8e8a-50d232abaca0 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:46:59.689923 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-e28f25f2-f98d-4c2a-bc90-91cd129c655d req-f5de849e-afd2-428a-8e8a-50d232abaca0 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:46:59.703432 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-e28f25f2-f98d-4c2a-bc90-91cd129c655d req-f5de849e-afd2-428a-8e8a-50d232abaca0 service nova] Creating event network-changed:6be2a15b-c5a5-4fc8-bb82-828c60bfe042 for instance 297cf406-0faf-4f32-b894-1fe4b6599dfb on n-h1-master-1 Jun 20 12:46:59.708592 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-e28f25f2-f98d-4c2a-bc90-91cd129c655d req-f5de849e-afd2-428a-8e8a-50d232abaca0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036147 Jun 20 12:46:59.709230 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3374/6648] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:47:00.583623 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1d638467-1c3c-45f2-86ba-a33e2f996c07 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:47:00.584322 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1d638467-1c3c-45f2-86ba-a33e2f996c07 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] [instance: 297cf406-0faf-4f32-b894-1fe4b6599dfb] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:47:00.592068 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d638467-1c3c-45f2-86ba-a33e2f996c07 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:00.592678 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d638467-1c3c-45f2-86ba-a33e2f996c07 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:00.593835 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d638467-1c3c-45f2-86ba-a33e2f996c07 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:00.594545 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d638467-1c3c-45f2-86ba-a33e2f996c07 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:00.759326 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1d638467-1c3c-45f2-86ba-a33e2f996c07 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938ec7c6175748c89c9ab87aac9a6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60370353502340f69098617e40800da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:47:00.769442 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1d638467-1c3c-45f2-86ba-a33e2f996c07 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] 10.222.0.27 "GET /compute/v2.1/servers/297cf406-0faf-4f32-b894-1fe4b6599dfb" status: 200 len: 1313 microversion: 2.1 time: 0.190679 Jun 20 12:47:00.770217 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3275/6649] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:47:00 2022] GET /compute/v2.1/servers/297cf406-0faf-4f32-b894-1fe4b6599dfb => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:47:01.792241 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2298e731-c2ef-4429-a5f2-f4ef329895f3 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:47:01.792926 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2298e731-c2ef-4429-a5f2-f4ef329895f3 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] [instance: 297cf406-0faf-4f32-b894-1fe4b6599dfb] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:47:01.799878 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2298e731-c2ef-4429-a5f2-f4ef329895f3 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:01.800380 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2298e731-c2ef-4429-a5f2-f4ef329895f3 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:01.801157 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2298e731-c2ef-4429-a5f2-f4ef329895f3 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:01.801601 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2298e731-c2ef-4429-a5f2-f4ef329895f3 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:01.943802 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2298e731-c2ef-4429-a5f2-f4ef329895f3 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938ec7c6175748c89c9ab87aac9a6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60370353502340f69098617e40800da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:47:01.952462 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2298e731-c2ef-4429-a5f2-f4ef329895f3 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] 10.222.0.27 "GET /compute/v2.1/servers/297cf406-0faf-4f32-b894-1fe4b6599dfb" status: 200 len: 1313 microversion: 2.1 time: 0.167730 Jun 20 12:47:01.953223 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3375/6650] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:47:01 2022] GET /compute/v2.1/servers/297cf406-0faf-4f32-b894-1fe4b6599dfb => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:47:02.975007 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c58cda1a-63b4-4114-a1ef-a2a9cf1a3cd3 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:47:02.975841 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c58cda1a-63b4-4114-a1ef-a2a9cf1a3cd3 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] [instance: 297cf406-0faf-4f32-b894-1fe4b6599dfb] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:47:02.983566 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c58cda1a-63b4-4114-a1ef-a2a9cf1a3cd3 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:02.984109 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c58cda1a-63b4-4114-a1ef-a2a9cf1a3cd3 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:02.984928 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c58cda1a-63b4-4114-a1ef-a2a9cf1a3cd3 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:02.985373 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c58cda1a-63b4-4114-a1ef-a2a9cf1a3cd3 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:03.127017 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c58cda1a-63b4-4114-a1ef-a2a9cf1a3cd3 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938ec7c6175748c89c9ab87aac9a6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60370353502340f69098617e40800da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:47:03.135202 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c58cda1a-63b4-4114-a1ef-a2a9cf1a3cd3 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] 10.222.0.27 "GET /compute/v2.1/servers/297cf406-0faf-4f32-b894-1fe4b6599dfb" status: 200 len: 1313 microversion: 2.1 time: 0.164088 Jun 20 12:47:03.135794 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3276/6651] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:47:02 2022] GET /compute/v2.1/servers/297cf406-0faf-4f32-b894-1fe4b6599dfb => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:47:04.152514 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-775a4c5a-8518-47a7-b98d-d998ba4f03d1 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:47:04.153272 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-775a4c5a-8518-47a7-b98d-d998ba4f03d1 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] [instance: 297cf406-0faf-4f32-b894-1fe4b6599dfb] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:47:04.161024 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-775a4c5a-8518-47a7-b98d-d998ba4f03d1 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:04.162204 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-775a4c5a-8518-47a7-b98d-d998ba4f03d1 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:04.163503 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-775a4c5a-8518-47a7-b98d-d998ba4f03d1 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:04.163943 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-775a4c5a-8518-47a7-b98d-d998ba4f03d1 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:04.226548 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-a4f92ced-eab6-44d5-962e-64b50b72d026 req-8d1d0c0c-6c99-49ba-850d-b73427698ea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "297cf406-0faf-4f32-b894-1fe4b6599dfb", "name": "network-vif-plugged", "status": "completed", "tag": "6be2a15b-c5a5-4fc8-bb82-828c60bfe042"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:47:04.234928 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-a4f92ced-eab6-44d5-962e-64b50b72d026 req-8d1d0c0c-6c99-49ba-850d-b73427698ea4 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:04.235366 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-a4f92ced-eab6-44d5-962e-64b50b72d026 req-8d1d0c0c-6c99-49ba-850d-b73427698ea4 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:04.246886 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-a4f92ced-eab6-44d5-962e-64b50b72d026 req-8d1d0c0c-6c99-49ba-850d-b73427698ea4 service nova] Creating event network-vif-plugged:6be2a15b-c5a5-4fc8-bb82-828c60bfe042 for instance 297cf406-0faf-4f32-b894-1fe4b6599dfb on n-h1-master-1 Jun 20 12:47:04.252402 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-a4f92ced-eab6-44d5-962e-64b50b72d026 req-8d1d0c0c-6c99-49ba-850d-b73427698ea4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114201 Jun 20 12:47:04.253090 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3376/6652] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:47:04.307607 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-775a4c5a-8518-47a7-b98d-d998ba4f03d1 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938ec7c6175748c89c9ab87aac9a6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60370353502340f69098617e40800da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:47:04.315451 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-775a4c5a-8518-47a7-b98d-d998ba4f03d1 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] 10.222.0.27 "GET /compute/v2.1/servers/297cf406-0faf-4f32-b894-1fe4b6599dfb" status: 200 len: 1313 microversion: 2.1 time: 0.167621 Jun 20 12:47:04.316095 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3277/6653] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:47:04 2022] GET /compute/v2.1/servers/297cf406-0faf-4f32-b894-1fe4b6599dfb => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:47:05.338401 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9d49e652-e959-4456-88cf-f2c91b686e01 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:47:05.339101 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9d49e652-e959-4456-88cf-f2c91b686e01 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] [instance: 297cf406-0faf-4f32-b894-1fe4b6599dfb] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:47:05.346339 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9d49e652-e959-4456-88cf-f2c91b686e01 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:05.346856 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9d49e652-e959-4456-88cf-f2c91b686e01 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:05.347842 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9d49e652-e959-4456-88cf-f2c91b686e01 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:05.348290 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9d49e652-e959-4456-88cf-f2c91b686e01 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:05.493397 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9d49e652-e959-4456-88cf-f2c91b686e01 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938ec7c6175748c89c9ab87aac9a6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60370353502340f69098617e40800da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:47:05.501810 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9d49e652-e959-4456-88cf-f2c91b686e01 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] 10.222.0.27 "GET /compute/v2.1/servers/297cf406-0faf-4f32-b894-1fe4b6599dfb" status: 200 len: 1313 microversion: 2.1 time: 0.171615 Jun 20 12:47:05.502399 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3377/6654] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:47:05 2022] GET /compute/v2.1/servers/297cf406-0faf-4f32-b894-1fe4b6599dfb => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:47:06.523418 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f0cdb894-288b-4b4a-9969-3160c26f445c tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:47:06.524527 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f0cdb894-288b-4b4a-9969-3160c26f445c tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] [instance: 297cf406-0faf-4f32-b894-1fe4b6599dfb] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:47:06.536793 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f0cdb894-288b-4b4a-9969-3160c26f445c tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:06.537629 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f0cdb894-288b-4b4a-9969-3160c26f445c tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:06.538870 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f0cdb894-288b-4b4a-9969-3160c26f445c tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:06.539618 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f0cdb894-288b-4b4a-9969-3160c26f445c tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:06.674875 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f0cdb894-288b-4b4a-9969-3160c26f445c tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938ec7c6175748c89c9ab87aac9a6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60370353502340f69098617e40800da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:47:06.683572 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f0cdb894-288b-4b4a-9969-3160c26f445c tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] 10.222.0.27 "GET /compute/v2.1/servers/297cf406-0faf-4f32-b894-1fe4b6599dfb" status: 200 len: 1496 microversion: 2.1 time: 0.166878 Jun 20 12:47:06.684126 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3278/6655] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:47:06 2022] GET /compute/v2.1/servers/297cf406-0faf-4f32-b894-1fe4b6599dfb => generated 1496 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:47:07.075751 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d8170079-6b61-47fb-a11c-dfc1fa05bfd2 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:47:07.076334 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d8170079-6b61-47fb-a11c-dfc1fa05bfd2 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] [instance: 297cf406-0faf-4f32-b894-1fe4b6599dfb] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:47:07.079129 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:47:07.079810 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:47:07.085709 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d8170079-6b61-47fb-a11c-dfc1fa05bfd2 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:07.086162 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d8170079-6b61-47fb-a11c-dfc1fa05bfd2 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:07.086957 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d8170079-6b61-47fb-a11c-dfc1fa05bfd2 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:07.087555 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d8170079-6b61-47fb-a11c-dfc1fa05bfd2 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:07.113315 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d8170079-6b61-47fb-a11c-dfc1fa05bfd2 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] [instance: 297cf406-0faf-4f32-b894-1fe4b6599dfb] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:47:07.195084 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d8170079-6b61-47fb-a11c-dfc1fa05bfd2 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] 10.222.0.27 "DELETE /compute/v2.1/servers/297cf406-0faf-4f32-b894-1fe4b6599dfb" status: 204 len: 0 microversion: 2.1 time: 0.123503 Jun 20 12:47:07.195570 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3378/6656] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:47:07 2022] DELETE /compute/v2.1/servers/297cf406-0faf-4f32-b894-1fe4b6599dfb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:47:07.205403 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c7f83d33-afa5-4a0c-af93-f8f3bcc5b625 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:47:07.206040 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c7f83d33-afa5-4a0c-af93-f8f3bcc5b625 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] [instance: 297cf406-0faf-4f32-b894-1fe4b6599dfb] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:47:07.213015 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c7f83d33-afa5-4a0c-af93-f8f3bcc5b625 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:07.213443 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c7f83d33-afa5-4a0c-af93-f8f3bcc5b625 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:07.214284 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c7f83d33-afa5-4a0c-af93-f8f3bcc5b625 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:07.214744 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c7f83d33-afa5-4a0c-af93-f8f3bcc5b625 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:07.234184 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:47:07.373425 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c7f83d33-afa5-4a0c-af93-f8f3bcc5b625 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938ec7c6175748c89c9ab87aac9a6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60370353502340f69098617e40800da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:47:07.381408 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c7f83d33-afa5-4a0c-af93-f8f3bcc5b625 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] 10.222.0.27 "GET /compute/v2.1/servers/297cf406-0faf-4f32-b894-1fe4b6599dfb" status: 200 len: 1502 microversion: 2.1 time: 0.180401 Jun 20 12:47:07.381976 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3279/6657] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:47:07 2022] GET /compute/v2.1/servers/297cf406-0faf-4f32-b894-1fe4b6599dfb => generated 1502 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:47:08.402568 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ee560ee3-66a2-4892-b25f-91e3c22efe2f tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:47:08.403278 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ee560ee3-66a2-4892-b25f-91e3c22efe2f tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] [instance: 297cf406-0faf-4f32-b894-1fe4b6599dfb] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:47:08.410815 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee560ee3-66a2-4892-b25f-91e3c22efe2f tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:08.411277 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee560ee3-66a2-4892-b25f-91e3c22efe2f tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:08.412049 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee560ee3-66a2-4892-b25f-91e3c22efe2f tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:08.412524 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee560ee3-66a2-4892-b25f-91e3c22efe2f tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:08.555800 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ee560ee3-66a2-4892-b25f-91e3c22efe2f tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938ec7c6175748c89c9ab87aac9a6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60370353502340f69098617e40800da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:47:08.564385 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ee560ee3-66a2-4892-b25f-91e3c22efe2f tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] 10.222.0.27 "GET /compute/v2.1/servers/297cf406-0faf-4f32-b894-1fe4b6599dfb" status: 200 len: 1502 microversion: 2.1 time: 0.167412 Jun 20 12:47:08.564964 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3379/6658] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:47:08 2022] GET /compute/v2.1/servers/297cf406-0faf-4f32-b894-1fe4b6599dfb => generated 1502 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:47:08.923930 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-49f1732f-38d4-4f42-a4b5-72eddc5cdce8 req-a4999300-41c8-4ad0-87f7-80d7346fd124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "297cf406-0faf-4f32-b894-1fe4b6599dfb", "name": "network-vif-deleted", "tag": "6be2a15b-c5a5-4fc8-bb82-828c60bfe042"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:47:08.937172 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-49f1732f-38d4-4f42-a4b5-72eddc5cdce8 req-a4999300-41c8-4ad0-87f7-80d7346fd124 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:08.937625 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-49f1732f-38d4-4f42-a4b5-72eddc5cdce8 req-a4999300-41c8-4ad0-87f7-80d7346fd124 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:08.949642 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-49f1732f-38d4-4f42-a4b5-72eddc5cdce8 req-a4999300-41c8-4ad0-87f7-80d7346fd124 service nova] Creating event network-vif-deleted:6be2a15b-c5a5-4fc8-bb82-828c60bfe042 for instance 297cf406-0faf-4f32-b894-1fe4b6599dfb on n-h1-master-1 Jun 20 12:47:08.954815 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-49f1732f-38d4-4f42-a4b5-72eddc5cdce8 req-a4999300-41c8-4ad0-87f7-80d7346fd124 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035285 Jun 20 12:47:08.955449 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3280/6659] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:47:09.583081 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9357058c-7417-4c40-89f7-b1b0e0ad1fdd tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:47:09.583670 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9357058c-7417-4c40-89f7-b1b0e0ad1fdd tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] [instance: 297cf406-0faf-4f32-b894-1fe4b6599dfb] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:47:09.591141 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9357058c-7417-4c40-89f7-b1b0e0ad1fdd tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:09.591597 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9357058c-7417-4c40-89f7-b1b0e0ad1fdd tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:09.592405 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9357058c-7417-4c40-89f7-b1b0e0ad1fdd tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:09.592847 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9357058c-7417-4c40-89f7-b1b0e0ad1fdd tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:09.607704 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-9357058c-7417-4c40-89f7-b1b0e0ad1fdd tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] HTTP exception thrown: Instance 297cf406-0faf-4f32-b894-1fe4b6599dfb could not be found. Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9357058c-7417-4c40-89f7-b1b0e0ad1fdd tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Request method failure captured: Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/297cf406-0faf-4f32-b894-1fe4b6599dfb HTTP/1.1 Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGw-qj7kB4gyx6RItxHSG0sRoSOTJ7oOBg0fyLYyP1ypP3tswulijKoazCC9i9qE9bW2JsE3fGFc_yAFYaNya_HFPuv26hlDiWAaFwKgNtmdcnrvjko3b9xC5abFbJn0jxSTCjKqYSGZORo7SJ_EnHxfoVMlLwufIzfWaVm3Q8uHiOA Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 60370353502340f69098617e40800da8 Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-VolumesActionsTest-1345139101 Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/60370353502340f69098617e40800da8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/60370353502340f69098617e40800da8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/60370353502340f69098617e40800da8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_60370353502340f69098617e40800da8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-VolumesActionsTest-1345139101 Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 60370353502340f69098617e40800da8 Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-VolumesActionsTest-1345139101 Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-VolumesActionsTest-1345139101-project Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 938ec7c6175748c89c9ab87aac9a6978 Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-VolumesActionsTest-1345139101-project Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 297cf406-0faf-4f32-b894-1fe4b6599dfb could not be found. Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '297cf406-0faf-4f32-b894-1fe4b6599dfb'} Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 297cf406-0faf-4f32-b894-1fe4b6599dfb could not be found. Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 297cf406-0faf-4f32-b894-1fe4b6599dfb could not be found. Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:47:09.609424 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:47:09.614648 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:47:09.614648 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:47:09.614648 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:47:09.614648 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:47:09.614648 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:47:09.614648 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 297cf406-0faf-4f32-b894-1fe4b6599dfb could not be found. Jun 20 12:47:09.614648 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:47:09.614648 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9357058c-7417-4c40-89f7-b1b0e0ad1fdd tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Returning 404 to user: Instance 297cf406-0faf-4f32-b894-1fe4b6599dfb could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:47:09.614648 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9357058c-7417-4c40-89f7-b1b0e0ad1fdd tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] 10.222.0.27 "GET /compute/v2.1/servers/297cf406-0faf-4f32-b894-1fe4b6599dfb" status: 404 len: 111 microversion: 2.1 time: 0.031927 Jun 20 12:47:09.614648 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3380/6660] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:47:09 2022] GET /compute/v2.1/servers/297cf406-0faf-4f32-b894-1fe4b6599dfb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:47:09.667465 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-22ee1468-eaf8-40c8-8c11-f9e493ec4ec5 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2146331840", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "3a368fd3-74fa-4970-a3a8-0288335ee63e"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:47:09.724136 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-22ee1468-eaf8-40c8-8c11-f9e493ec4ec5 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] validate_networks() for [('3a368fd3-74fa-4970-a3a8-0288335ee63e', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:47:10.151748 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-22ee1468-eaf8-40c8-8c11-f9e493ec4ec5 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:47:10.152390 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-22ee1468-eaf8-40c8-8c11-f9e493ec4ec5 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:47:10.152693 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-22ee1468-eaf8-40c8-8c11-f9e493ec4ec5 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:47:10.153115 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-22ee1468-eaf8-40c8-8c11-f9e493ec4ec5 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:47:10.153538 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-22ee1468-eaf8-40c8-8c11-f9e493ec4ec5 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:47:10.163371 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22ee1468-eaf8-40c8-8c11-f9e493ec4ec5 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:10.163854 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22ee1468-eaf8-40c8-8c11-f9e493ec4ec5 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:10.164672 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22ee1468-eaf8-40c8-8c11-f9e493ec4ec5 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:10.165121 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22ee1468-eaf8-40c8-8c11-f9e493ec4ec5 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:10.183806 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-22ee1468-eaf8-40c8-8c11-f9e493ec4ec5 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Getting quotas for project 60370353502340f69098617e40800da8. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:47:10.189748 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-22ee1468-eaf8-40c8-8c11-f9e493ec4ec5 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Getting quotas for user 938ec7c6175748c89c9ab87aac9a6978 and project 60370353502340f69098617e40800da8. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:47:10.203600 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-22ee1468-eaf8-40c8-8c11-f9e493ec4ec5 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:47:10.206066 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-22ee1468-eaf8-40c8-8c11-f9e493ec4ec5 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] [instance: a2effc32-f14f-4fda-9b66-926ea9edc068] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:47:10.260181 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-22ee1468-eaf8-40c8-8c11-f9e493ec4ec5 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.599726 Jun 20 12:47:10.260867 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3281/6661] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:47:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:47:10.271153 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-46219f3c-7544-473b-9a2a-54ee1542e735 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:47:10.271785 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-46219f3c-7544-473b-9a2a-54ee1542e735 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] [instance: a2effc32-f14f-4fda-9b66-926ea9edc068] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:47:10.334203 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-46219f3c-7544-473b-9a2a-54ee1542e735 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938ec7c6175748c89c9ab87aac9a6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60370353502340f69098617e40800da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:47:10.342384 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-46219f3c-7544-473b-9a2a-54ee1542e735 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] 10.222.0.27 "GET /compute/v2.1/servers/a2effc32-f14f-4fda-9b66-926ea9edc068" status: 200 len: 1214 microversion: 2.1 time: 0.075074 Jun 20 12:47:10.342942 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3381/6662] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:47:10 2022] GET /compute/v2.1/servers/a2effc32-f14f-4fda-9b66-926ea9edc068 => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:47:11.360546 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-848da4a6-98be-4efe-91cd-9d5d0c124282 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:47:11.363969 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-848da4a6-98be-4efe-91cd-9d5d0c124282 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] [instance: a2effc32-f14f-4fda-9b66-926ea9edc068] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:47:11.368712 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-848da4a6-98be-4efe-91cd-9d5d0c124282 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:11.369488 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-848da4a6-98be-4efe-91cd-9d5d0c124282 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:11.370597 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-848da4a6-98be-4efe-91cd-9d5d0c124282 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:11.371047 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-848da4a6-98be-4efe-91cd-9d5d0c124282 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:11.464771 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-848da4a6-98be-4efe-91cd-9d5d0c124282 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938ec7c6175748c89c9ab87aac9a6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60370353502340f69098617e40800da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:47:11.472464 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-848da4a6-98be-4efe-91cd-9d5d0c124282 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] 10.222.0.27 "GET /compute/v2.1/servers/a2effc32-f14f-4fda-9b66-926ea9edc068" status: 200 len: 1284 microversion: 2.1 time: 0.117033 Jun 20 12:47:11.473249 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3282/6663] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:47:11 2022] GET /compute/v2.1/servers/a2effc32-f14f-4fda-9b66-926ea9edc068 => generated 1284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:47:12.490218 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a957ba01-dc92-4cbc-88b7-bdcc2768c1a0 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:47:12.490850 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a957ba01-dc92-4cbc-88b7-bdcc2768c1a0 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] [instance: a2effc32-f14f-4fda-9b66-926ea9edc068] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:47:12.500776 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a957ba01-dc92-4cbc-88b7-bdcc2768c1a0 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:12.501267 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a957ba01-dc92-4cbc-88b7-bdcc2768c1a0 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:12.502050 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a957ba01-dc92-4cbc-88b7-bdcc2768c1a0 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:12.502692 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a957ba01-dc92-4cbc-88b7-bdcc2768c1a0 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:12.664735 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a957ba01-dc92-4cbc-88b7-bdcc2768c1a0 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938ec7c6175748c89c9ab87aac9a6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60370353502340f69098617e40800da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:47:12.672991 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a957ba01-dc92-4cbc-88b7-bdcc2768c1a0 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] 10.222.0.27 "GET /compute/v2.1/servers/a2effc32-f14f-4fda-9b66-926ea9edc068" status: 200 len: 1314 microversion: 2.1 time: 0.186930 Jun 20 12:47:12.674281 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3382/6664] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:47:12 2022] GET /compute/v2.1/servers/a2effc32-f14f-4fda-9b66-926ea9edc068 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:47:12.761237 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-a628ed3a-f26f-4630-998f-675ca5377465 req-4a7ea6dd-c6d0-4c51-b288-d358fd149e11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2effc32-f14f-4fda-9b66-926ea9edc068", "tag": "1dead650-23ce-421b-aaea-b016a801d6a7"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:47:12.774914 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-a628ed3a-f26f-4630-998f-675ca5377465 req-4a7ea6dd-c6d0-4c51-b288-d358fd149e11 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:12.775652 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-a628ed3a-f26f-4630-998f-675ca5377465 req-4a7ea6dd-c6d0-4c51-b288-d358fd149e11 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:12.789176 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-a628ed3a-f26f-4630-998f-675ca5377465 req-4a7ea6dd-c6d0-4c51-b288-d358fd149e11 service nova] Creating event network-changed:1dead650-23ce-421b-aaea-b016a801d6a7 for instance a2effc32-f14f-4fda-9b66-926ea9edc068 on n-h1-master-1 Jun 20 12:47:12.795273 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-a628ed3a-f26f-4630-998f-675ca5377465 req-4a7ea6dd-c6d0-4c51-b288-d358fd149e11 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038913 Jun 20 12:47:12.796046 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3283/6665] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:47:13.692165 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-680f7410-c998-4469-8837-1e2bccae5e7e tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:47:13.692762 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-680f7410-c998-4469-8837-1e2bccae5e7e tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] [instance: a2effc32-f14f-4fda-9b66-926ea9edc068] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:47:13.700713 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-680f7410-c998-4469-8837-1e2bccae5e7e tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:13.701154 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-680f7410-c998-4469-8837-1e2bccae5e7e tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:13.701945 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-680f7410-c998-4469-8837-1e2bccae5e7e tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:13.702383 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-680f7410-c998-4469-8837-1e2bccae5e7e tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:13.840141 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-680f7410-c998-4469-8837-1e2bccae5e7e tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938ec7c6175748c89c9ab87aac9a6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60370353502340f69098617e40800da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:47:13.850293 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-680f7410-c998-4469-8837-1e2bccae5e7e tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] 10.222.0.27 "GET /compute/v2.1/servers/a2effc32-f14f-4fda-9b66-926ea9edc068" status: 200 len: 1314 microversion: 2.1 time: 0.161906 Jun 20 12:47:13.851102 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3383/6666] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:47:13 2022] GET /compute/v2.1/servers/a2effc32-f14f-4fda-9b66-926ea9edc068 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:47:14.868158 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-111820d3-0450-41d4-b208-726523fc1da1 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:47:14.868873 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-111820d3-0450-41d4-b208-726523fc1da1 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] [instance: a2effc32-f14f-4fda-9b66-926ea9edc068] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:47:14.877033 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-111820d3-0450-41d4-b208-726523fc1da1 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:14.877514 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-111820d3-0450-41d4-b208-726523fc1da1 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:14.878297 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-111820d3-0450-41d4-b208-726523fc1da1 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:14.878740 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-111820d3-0450-41d4-b208-726523fc1da1 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:15.028068 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-111820d3-0450-41d4-b208-726523fc1da1 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938ec7c6175748c89c9ab87aac9a6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60370353502340f69098617e40800da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:47:15.036298 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-111820d3-0450-41d4-b208-726523fc1da1 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] 10.222.0.27 "GET /compute/v2.1/servers/a2effc32-f14f-4fda-9b66-926ea9edc068" status: 200 len: 1314 microversion: 2.1 time: 0.172673 Jun 20 12:47:15.036882 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3284/6667] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:47:14 2022] GET /compute/v2.1/servers/a2effc32-f14f-4fda-9b66-926ea9edc068 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:47:16.053997 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7f044419-bb3f-4387-97d5-14c0c605fa07 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:47:16.054687 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7f044419-bb3f-4387-97d5-14c0c605fa07 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] [instance: a2effc32-f14f-4fda-9b66-926ea9edc068] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:47:16.062425 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7f044419-bb3f-4387-97d5-14c0c605fa07 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:16.062886 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7f044419-bb3f-4387-97d5-14c0c605fa07 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:16.063668 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7f044419-bb3f-4387-97d5-14c0c605fa07 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:16.064105 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7f044419-bb3f-4387-97d5-14c0c605fa07 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:16.202377 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7f044419-bb3f-4387-97d5-14c0c605fa07 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938ec7c6175748c89c9ab87aac9a6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60370353502340f69098617e40800da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:47:16.210115 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7f044419-bb3f-4387-97d5-14c0c605fa07 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] 10.222.0.27 "GET /compute/v2.1/servers/a2effc32-f14f-4fda-9b66-926ea9edc068" status: 200 len: 1314 microversion: 2.1 time: 0.160492 Jun 20 12:47:16.210706 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3384/6668] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:47:16 2022] GET /compute/v2.1/servers/a2effc32-f14f-4fda-9b66-926ea9edc068 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:47:17.229607 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-911575c8-80e2-428e-9078-b2209b41af6d tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:47:17.250113 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-911575c8-80e2-428e-9078-b2209b41af6d tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] [instance: a2effc32-f14f-4fda-9b66-926ea9edc068] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:47:17.250978 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-911575c8-80e2-428e-9078-b2209b41af6d tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:17.251427 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-911575c8-80e2-428e-9078-b2209b41af6d tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:17.252235 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-911575c8-80e2-428e-9078-b2209b41af6d tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:17.252750 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-911575c8-80e2-428e-9078-b2209b41af6d tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:17.400668 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-911575c8-80e2-428e-9078-b2209b41af6d tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938ec7c6175748c89c9ab87aac9a6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60370353502340f69098617e40800da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:47:17.409218 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-911575c8-80e2-428e-9078-b2209b41af6d tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] 10.222.0.27 "GET /compute/v2.1/servers/a2effc32-f14f-4fda-9b66-926ea9edc068" status: 200 len: 1314 microversion: 2.1 time: 0.185272 Jun 20 12:47:17.409797 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3285/6669] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:47:17 2022] GET /compute/v2.1/servers/a2effc32-f14f-4fda-9b66-926ea9edc068 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:47:18.184936 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-23322da2-c0cc-48c7-8dcb-66a95824fbc9 req-8448c6ff-de12-482e-9dc5-82e944978575 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2effc32-f14f-4fda-9b66-926ea9edc068", "name": "network-vif-plugged", "status": "completed", "tag": "1dead650-23ce-421b-aaea-b016a801d6a7"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:47:18.194974 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-23322da2-c0cc-48c7-8dcb-66a95824fbc9 req-8448c6ff-de12-482e-9dc5-82e944978575 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:18.195499 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-23322da2-c0cc-48c7-8dcb-66a95824fbc9 req-8448c6ff-de12-482e-9dc5-82e944978575 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:18.208694 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-23322da2-c0cc-48c7-8dcb-66a95824fbc9 req-8448c6ff-de12-482e-9dc5-82e944978575 service nova] Creating event network-vif-plugged:1dead650-23ce-421b-aaea-b016a801d6a7 for instance a2effc32-f14f-4fda-9b66-926ea9edc068 on n-h1-master-1 Jun 20 12:47:18.214028 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-23322da2-c0cc-48c7-8dcb-66a95824fbc9 req-8448c6ff-de12-482e-9dc5-82e944978575 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034159 Jun 20 12:47:18.216149 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3385/6670] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:47:18.426756 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4535c8e9-cd24-4863-adba-9d6e71206d19 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:47:18.427866 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4535c8e9-cd24-4863-adba-9d6e71206d19 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] [instance: a2effc32-f14f-4fda-9b66-926ea9edc068] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:47:18.435281 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4535c8e9-cd24-4863-adba-9d6e71206d19 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:18.435745 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4535c8e9-cd24-4863-adba-9d6e71206d19 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:18.436564 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4535c8e9-cd24-4863-adba-9d6e71206d19 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:18.437244 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4535c8e9-cd24-4863-adba-9d6e71206d19 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:18.577966 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4535c8e9-cd24-4863-adba-9d6e71206d19 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938ec7c6175748c89c9ab87aac9a6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60370353502340f69098617e40800da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:47:18.585843 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4535c8e9-cd24-4863-adba-9d6e71206d19 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] 10.222.0.27 "GET /compute/v2.1/servers/a2effc32-f14f-4fda-9b66-926ea9edc068" status: 200 len: 1314 microversion: 2.1 time: 0.163116 Jun 20 12:47:18.586421 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3286/6671] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:47:18 2022] GET /compute/v2.1/servers/a2effc32-f14f-4fda-9b66-926ea9edc068 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:47:19.609685 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-93577721-805f-4d2a-99e7-be0050037879 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:47:19.610597 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-93577721-805f-4d2a-99e7-be0050037879 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] [instance: a2effc32-f14f-4fda-9b66-926ea9edc068] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:47:19.622426 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93577721-805f-4d2a-99e7-be0050037879 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:19.623171 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93577721-805f-4d2a-99e7-be0050037879 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:19.624587 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93577721-805f-4d2a-99e7-be0050037879 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:19.625191 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93577721-805f-4d2a-99e7-be0050037879 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:19.793736 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-93577721-805f-4d2a-99e7-be0050037879 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938ec7c6175748c89c9ab87aac9a6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60370353502340f69098617e40800da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:47:19.801827 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-93577721-805f-4d2a-99e7-be0050037879 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] 10.222.0.27 "GET /compute/v2.1/servers/a2effc32-f14f-4fda-9b66-926ea9edc068" status: 200 len: 1497 microversion: 2.1 time: 0.200970 Jun 20 12:47:19.802955 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3386/6672] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:47:19 2022] GET /compute/v2.1/servers/a2effc32-f14f-4fda-9b66-926ea9edc068 => generated 1497 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:47:20.231222 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-641bdf8c-6583-4389-aee1-24901d3574a8 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:47:20.231807 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-641bdf8c-6583-4389-aee1-24901d3574a8 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] [instance: a2effc32-f14f-4fda-9b66-926ea9edc068] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:47:20.235830 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:47:20.237709 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:47:20.246051 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-641bdf8c-6583-4389-aee1-24901d3574a8 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:20.246716 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-641bdf8c-6583-4389-aee1-24901d3574a8 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:20.247940 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-641bdf8c-6583-4389-aee1-24901d3574a8 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:20.248688 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-641bdf8c-6583-4389-aee1-24901d3574a8 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:20.277473 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-641bdf8c-6583-4389-aee1-24901d3574a8 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] [instance: a2effc32-f14f-4fda-9b66-926ea9edc068] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:47:20.368279 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-641bdf8c-6583-4389-aee1-24901d3574a8 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a2effc32-f14f-4fda-9b66-926ea9edc068" status: 204 len: 0 microversion: 2.1 time: 0.142169 Jun 20 12:47:20.368928 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3287/6673] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:47:20 2022] DELETE /compute/v2.1/servers/a2effc32-f14f-4fda-9b66-926ea9edc068 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:47:20.377346 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0a34b1c6-b189-4adc-a085-fe388098b966 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:47:20.378202 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0a34b1c6-b189-4adc-a085-fe388098b966 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] [instance: a2effc32-f14f-4fda-9b66-926ea9edc068] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:47:20.380248 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:47:20.385985 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a34b1c6-b189-4adc-a085-fe388098b966 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:20.386447 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a34b1c6-b189-4adc-a085-fe388098b966 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:20.387228 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a34b1c6-b189-4adc-a085-fe388098b966 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:20.387667 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a34b1c6-b189-4adc-a085-fe388098b966 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:20.526435 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0a34b1c6-b189-4adc-a085-fe388098b966 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938ec7c6175748c89c9ab87aac9a6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60370353502340f69098617e40800da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:47:20.536846 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0a34b1c6-b189-4adc-a085-fe388098b966 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] 10.222.0.27 "GET /compute/v2.1/servers/a2effc32-f14f-4fda-9b66-926ea9edc068" status: 200 len: 1503 microversion: 2.1 time: 0.163223 Jun 20 12:47:20.537457 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3387/6674] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:47:20 2022] GET /compute/v2.1/servers/a2effc32-f14f-4fda-9b66-926ea9edc068 => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:47:21.559699 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-814c2e82-fc6a-4a8c-9aed-3017b120cba6 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:47:21.560775 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-814c2e82-fc6a-4a8c-9aed-3017b120cba6 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] [instance: a2effc32-f14f-4fda-9b66-926ea9edc068] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:47:21.571318 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-814c2e82-fc6a-4a8c-9aed-3017b120cba6 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:21.572153 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-814c2e82-fc6a-4a8c-9aed-3017b120cba6 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:21.573517 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-814c2e82-fc6a-4a8c-9aed-3017b120cba6 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:21.574305 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-814c2e82-fc6a-4a8c-9aed-3017b120cba6 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:21.775817 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-814c2e82-fc6a-4a8c-9aed-3017b120cba6 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938ec7c6175748c89c9ab87aac9a6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60370353502340f69098617e40800da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:47:21.784402 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-814c2e82-fc6a-4a8c-9aed-3017b120cba6 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] 10.222.0.27 "GET /compute/v2.1/servers/a2effc32-f14f-4fda-9b66-926ea9edc068" status: 200 len: 1503 microversion: 2.1 time: 0.231812 Jun 20 12:47:21.785340 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3288/6675] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:47:21 2022] GET /compute/v2.1/servers/a2effc32-f14f-4fda-9b66-926ea9edc068 => generated 1503 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:47:22.155957 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-7f184a93-c5ad-4bc8-a094-967a9662c79f req-ec17b726-b203-4553-9411-e289ba0f1a6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2effc32-f14f-4fda-9b66-926ea9edc068", "name": "network-vif-deleted", "tag": "1dead650-23ce-421b-aaea-b016a801d6a7"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:47:22.169362 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-7f184a93-c5ad-4bc8-a094-967a9662c79f req-ec17b726-b203-4553-9411-e289ba0f1a6e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:22.169815 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-7f184a93-c5ad-4bc8-a094-967a9662c79f req-ec17b726-b203-4553-9411-e289ba0f1a6e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:22.183711 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-7f184a93-c5ad-4bc8-a094-967a9662c79f req-ec17b726-b203-4553-9411-e289ba0f1a6e service nova] Creating event network-vif-deleted:1dead650-23ce-421b-aaea-b016a801d6a7 for instance a2effc32-f14f-4fda-9b66-926ea9edc068 on n-h1-master-1 Jun 20 12:47:22.189875 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-7f184a93-c5ad-4bc8-a094-967a9662c79f req-ec17b726-b203-4553-9411-e289ba0f1a6e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037710 Jun 20 12:47:22.190519 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3388/6676] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:47:22.805410 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fd2d67d3-c476-458e-bd5a-f18bd72de529 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:47:22.806048 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fd2d67d3-c476-458e-bd5a-f18bd72de529 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] [instance: a2effc32-f14f-4fda-9b66-926ea9edc068] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:47:22.812741 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fd2d67d3-c476-458e-bd5a-f18bd72de529 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:22.813294 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fd2d67d3-c476-458e-bd5a-f18bd72de529 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:22.814081 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fd2d67d3-c476-458e-bd5a-f18bd72de529 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:22.814526 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fd2d67d3-c476-458e-bd5a-f18bd72de529 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:22.828575 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-fd2d67d3-c476-458e-bd5a-f18bd72de529 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] HTTP exception thrown: Instance a2effc32-f14f-4fda-9b66-926ea9edc068 could not be found. Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fd2d67d3-c476-458e-bd5a-f18bd72de529 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Request method failure captured: Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/a2effc32-f14f-4fda-9b66-926ea9edc068 HTTP/1.1 Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGw-qj7kB4gyx6RItxHSG0sRoSOTJ7oOBg0fyLYyP1ypP3tswulijKoazCC9i9qE9bW2JsE3fGFc_yAFYaNya_HFPuv26hlDiWAaFwKgNtmdcnrvjko3b9xC5abFbJn0jxSTCjKqYSGZORo7SJ_EnHxfoVMlLwufIzfWaVm3Q8uHiOA Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 60370353502340f69098617e40800da8 Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-VolumesActionsTest-1345139101 Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/60370353502340f69098617e40800da8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/60370353502340f69098617e40800da8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/60370353502340f69098617e40800da8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_60370353502340f69098617e40800da8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-VolumesActionsTest-1345139101 Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 60370353502340f69098617e40800da8 Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-VolumesActionsTest-1345139101 Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-VolumesActionsTest-1345139101-project Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 938ec7c6175748c89c9ab87aac9a6978 Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-VolumesActionsTest-1345139101-project Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: exception: Instance a2effc32-f14f-4fda-9b66-926ea9edc068 could not be found. Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'a2effc32-f14f-4fda-9b66-926ea9edc068'} Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2effc32-f14f-4fda-9b66-926ea9edc068 could not be found. Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2effc32-f14f-4fda-9b66-926ea9edc068 could not be found. Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:47:22.830342 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:47:22.836981 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:47:22.836981 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:47:22.836981 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:47:22.836981 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:47:22.836981 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:47:22.836981 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2effc32-f14f-4fda-9b66-926ea9edc068 could not be found. Jun 20 12:47:22.836981 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:47:22.836981 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fd2d67d3-c476-458e-bd5a-f18bd72de529 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] Returning 404 to user: Instance a2effc32-f14f-4fda-9b66-926ea9edc068 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:47:22.836981 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fd2d67d3-c476-458e-bd5a-f18bd72de529 tempest-VolumesActionsTest-1345139101 tempest-VolumesActionsTest-1345139101-project] 10.222.0.27 "GET /compute/v2.1/servers/a2effc32-f14f-4fda-9b66-926ea9edc068" status: 404 len: 111 microversion: 2.1 time: 0.031598 Jun 20 12:47:22.837932 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3289/6677] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:47:22 2022] GET /compute/v2.1/servers/a2effc32-f14f-4fda-9b66-926ea9edc068 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:47:54.806560 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:47:54.807296 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:47:54.920937 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8573a41c-b211-46ec-a596-5678eaa5d999 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1974817629", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:47:54.973351 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-8573a41c-b211-46ec-a596-5678eaa5d999 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] validate_networks() for None {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:47:55.252144 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-8573a41c-b211-46ec-a596-5678eaa5d999 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:47:55.252600 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-8573a41c-b211-46ec-a596-5678eaa5d999 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:47:55.253077 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-8573a41c-b211-46ec-a596-5678eaa5d999 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:47:55.253525 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-8573a41c-b211-46ec-a596-5678eaa5d999 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:47:55.253943 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-8573a41c-b211-46ec-a596-5678eaa5d999 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:47:55.263623 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8573a41c-b211-46ec-a596-5678eaa5d999 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:55.264083 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8573a41c-b211-46ec-a596-5678eaa5d999 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:55.264979 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8573a41c-b211-46ec-a596-5678eaa5d999 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:55.265424 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8573a41c-b211-46ec-a596-5678eaa5d999 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:55.283634 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-8573a41c-b211-46ec-a596-5678eaa5d999 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Getting quotas for project 8ec610c3d9994ef0a9945eadacddcb28. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:47:55.289430 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-8573a41c-b211-46ec-a596-5678eaa5d999 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Getting quotas for user 9618947da33145e9be9e891d53d51d5d and project 8ec610c3d9994ef0a9945eadacddcb28. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:47:55.302636 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8573a41c-b211-46ec-a596-5678eaa5d999 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:47:55.305629 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8573a41c-b211-46ec-a596-5678eaa5d999 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] [instance: ef994e40-e8cb-40ec-adb3-84f60b8928fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:47:55.351287 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8573a41c-b211-46ec-a596-5678eaa5d999 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.550568 Jun 20 12:47:55.352142 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3389/6678] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:47:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:47:55.362640 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1b5ba7c8-01e6-44bd-b048-0c9a759f658f tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:47:55.363284 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1b5ba7c8-01e6-44bd-b048-0c9a759f658f tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] [instance: ef994e40-e8cb-40ec-adb3-84f60b8928fc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:47:55.365685 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:47:55.366336 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:47:55.422482 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1b5ba7c8-01e6-44bd-b048-0c9a759f658f tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9618947da33145e9be9e891d53d51d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec610c3d9994ef0a9945eadacddcb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:47:55.431362 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1b5ba7c8-01e6-44bd-b048-0c9a759f658f tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] 10.222.0.27 "GET /compute/v2.1/servers/ef994e40-e8cb-40ec-adb3-84f60b8928fc" status: 200 len: 1222 microversion: 2.1 time: 0.072909 Jun 20 12:47:55.432333 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3290/6679] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:47:55 2022] GET /compute/v2.1/servers/ef994e40-e8cb-40ec-adb3-84f60b8928fc => generated 1222 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:47:56.449902 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6dee698c-7bfd-48d2-9602-3890b1cbbb5f tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:47:56.451257 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6dee698c-7bfd-48d2-9602-3890b1cbbb5f tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] [instance: ef994e40-e8cb-40ec-adb3-84f60b8928fc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:47:56.459142 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6dee698c-7bfd-48d2-9602-3890b1cbbb5f tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:56.459581 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6dee698c-7bfd-48d2-9602-3890b1cbbb5f tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:56.460446 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6dee698c-7bfd-48d2-9602-3890b1cbbb5f tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:56.460904 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6dee698c-7bfd-48d2-9602-3890b1cbbb5f tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:56.530903 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6dee698c-7bfd-48d2-9602-3890b1cbbb5f tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9618947da33145e9be9e891d53d51d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec610c3d9994ef0a9945eadacddcb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:47:56.538655 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6dee698c-7bfd-48d2-9602-3890b1cbbb5f tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] 10.222.0.27 "GET /compute/v2.1/servers/ef994e40-e8cb-40ec-adb3-84f60b8928fc" status: 200 len: 1280 microversion: 2.1 time: 0.094064 Jun 20 12:47:56.539239 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3390/6680] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:47:56 2022] GET /compute/v2.1/servers/ef994e40-e8cb-40ec-adb3-84f60b8928fc => generated 1280 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:47:57.556957 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a3aa1592-5e7b-4add-8300-ac048fc597fb tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:47:57.557593 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a3aa1592-5e7b-4add-8300-ac048fc597fb tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] [instance: ef994e40-e8cb-40ec-adb3-84f60b8928fc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:47:57.566639 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3aa1592-5e7b-4add-8300-ac048fc597fb tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:57.567451 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3aa1592-5e7b-4add-8300-ac048fc597fb tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:57.568149 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3aa1592-5e7b-4add-8300-ac048fc597fb tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:57.568806 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3aa1592-5e7b-4add-8300-ac048fc597fb tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:57.789212 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a3aa1592-5e7b-4add-8300-ac048fc597fb tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9618947da33145e9be9e891d53d51d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec610c3d9994ef0a9945eadacddcb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:47:57.797083 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a3aa1592-5e7b-4add-8300-ac048fc597fb tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] 10.222.0.27 "GET /compute/v2.1/servers/ef994e40-e8cb-40ec-adb3-84f60b8928fc" status: 200 len: 1322 microversion: 2.1 time: 0.244424 Jun 20 12:47:57.797676 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3291/6681] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:47:57 2022] GET /compute/v2.1/servers/ef994e40-e8cb-40ec-adb3-84f60b8928fc => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:47:57.959034 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-f2d43582-eed7-40d2-a05a-352969dfcadb req-c9e195ab-5bf2-44e1-8aed-5df0328d8554 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef994e40-e8cb-40ec-adb3-84f60b8928fc", "tag": "7d7f93c9-6b0d-4257-aff9-c4bb795f76e3"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:47:57.972640 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-f2d43582-eed7-40d2-a05a-352969dfcadb req-c9e195ab-5bf2-44e1-8aed-5df0328d8554 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:57.973691 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-f2d43582-eed7-40d2-a05a-352969dfcadb req-c9e195ab-5bf2-44e1-8aed-5df0328d8554 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:57.988312 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-f2d43582-eed7-40d2-a05a-352969dfcadb req-c9e195ab-5bf2-44e1-8aed-5df0328d8554 service nova] Creating event network-changed:7d7f93c9-6b0d-4257-aff9-c4bb795f76e3 for instance ef994e40-e8cb-40ec-adb3-84f60b8928fc on n-h1-master-1 Jun 20 12:47:57.994701 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-f2d43582-eed7-40d2-a05a-352969dfcadb req-c9e195ab-5bf2-44e1-8aed-5df0328d8554 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044121 Jun 20 12:47:57.995342 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3391/6682] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:47:58.815117 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-671356a8-f3c1-420a-b95e-343a2db9a1e8 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:47:58.815786 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-671356a8-f3c1-420a-b95e-343a2db9a1e8 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] [instance: ef994e40-e8cb-40ec-adb3-84f60b8928fc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:47:58.823933 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-671356a8-f3c1-420a-b95e-343a2db9a1e8 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:58.824432 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-671356a8-f3c1-420a-b95e-343a2db9a1e8 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:58.825282 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-671356a8-f3c1-420a-b95e-343a2db9a1e8 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:47:58.825730 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-671356a8-f3c1-420a-b95e-343a2db9a1e8 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:47:58.963514 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-671356a8-f3c1-420a-b95e-343a2db9a1e8 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9618947da33145e9be9e891d53d51d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec610c3d9994ef0a9945eadacddcb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:47:58.972393 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-671356a8-f3c1-420a-b95e-343a2db9a1e8 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] 10.222.0.27 "GET /compute/v2.1/servers/ef994e40-e8cb-40ec-adb3-84f60b8928fc" status: 200 len: 1322 microversion: 2.1 time: 0.161240 Jun 20 12:47:58.972995 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3292/6683] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:47:58 2022] GET /compute/v2.1/servers/ef994e40-e8cb-40ec-adb3-84f60b8928fc => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:47:59.991433 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-459cb793-8234-4bc7-8ec4-966f55707c6f tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:47:59.992131 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-459cb793-8234-4bc7-8ec4-966f55707c6f tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] [instance: ef994e40-e8cb-40ec-adb3-84f60b8928fc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:00.002061 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-459cb793-8234-4bc7-8ec4-966f55707c6f tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:00.002514 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-459cb793-8234-4bc7-8ec4-966f55707c6f tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:00.003289 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-459cb793-8234-4bc7-8ec4-966f55707c6f tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:00.003724 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-459cb793-8234-4bc7-8ec4-966f55707c6f tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:00.148226 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-459cb793-8234-4bc7-8ec4-966f55707c6f tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9618947da33145e9be9e891d53d51d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec610c3d9994ef0a9945eadacddcb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:00.156375 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-459cb793-8234-4bc7-8ec4-966f55707c6f tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] 10.222.0.27 "GET /compute/v2.1/servers/ef994e40-e8cb-40ec-adb3-84f60b8928fc" status: 200 len: 1322 microversion: 2.1 time: 0.170516 Jun 20 12:48:00.156956 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3392/6684] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:47:59 2022] GET /compute/v2.1/servers/ef994e40-e8cb-40ec-adb3-84f60b8928fc => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:01.173990 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4992702e-b6f7-408b-9b86-5b6a8e5a9f93 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:01.174614 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4992702e-b6f7-408b-9b86-5b6a8e5a9f93 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] [instance: ef994e40-e8cb-40ec-adb3-84f60b8928fc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:01.184006 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4992702e-b6f7-408b-9b86-5b6a8e5a9f93 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:01.184635 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4992702e-b6f7-408b-9b86-5b6a8e5a9f93 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:01.185861 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4992702e-b6f7-408b-9b86-5b6a8e5a9f93 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:01.186533 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4992702e-b6f7-408b-9b86-5b6a8e5a9f93 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:01.357580 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4992702e-b6f7-408b-9b86-5b6a8e5a9f93 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9618947da33145e9be9e891d53d51d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec610c3d9994ef0a9945eadacddcb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:01.367502 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4992702e-b6f7-408b-9b86-5b6a8e5a9f93 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] 10.222.0.27 "GET /compute/v2.1/servers/ef994e40-e8cb-40ec-adb3-84f60b8928fc" status: 200 len: 1322 microversion: 2.1 time: 0.197130 Jun 20 12:48:01.368151 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3293/6685] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:01 2022] GET /compute/v2.1/servers/ef994e40-e8cb-40ec-adb3-84f60b8928fc => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:02.385469 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-014a68a4-b5f5-4dc4-bc14-2d8fc577a25b tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:02.386117 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-014a68a4-b5f5-4dc4-bc14-2d8fc577a25b tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] [instance: ef994e40-e8cb-40ec-adb3-84f60b8928fc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:02.393264 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-014a68a4-b5f5-4dc4-bc14-2d8fc577a25b tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:02.393716 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-014a68a4-b5f5-4dc4-bc14-2d8fc577a25b tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:02.394499 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-014a68a4-b5f5-4dc4-bc14-2d8fc577a25b tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:02.394947 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-014a68a4-b5f5-4dc4-bc14-2d8fc577a25b tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:02.426761 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-cbfccdbf-bceb-46e7-97c7-ff9b058ad817 req-7906abab-523a-4590-a2ae-56b139f30965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef994e40-e8cb-40ec-adb3-84f60b8928fc", "name": "network-vif-plugged", "status": "completed", "tag": "7d7f93c9-6b0d-4257-aff9-c4bb795f76e3"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:48:02.442163 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-cbfccdbf-bceb-46e7-97c7-ff9b058ad817 req-7906abab-523a-4590-a2ae-56b139f30965 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:02.443334 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-cbfccdbf-bceb-46e7-97c7-ff9b058ad817 req-7906abab-523a-4590-a2ae-56b139f30965 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:02.455881 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-cbfccdbf-bceb-46e7-97c7-ff9b058ad817 req-7906abab-523a-4590-a2ae-56b139f30965 service nova] Creating event network-vif-plugged:7d7f93c9-6b0d-4257-aff9-c4bb795f76e3 for instance ef994e40-e8cb-40ec-adb3-84f60b8928fc on n-h1-master-1 Jun 20 12:48:02.462383 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-cbfccdbf-bceb-46e7-97c7-ff9b058ad817 req-7906abab-523a-4590-a2ae-56b139f30965 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042034 Jun 20 12:48:02.464455 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3294/6686] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:48:02.558273 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-014a68a4-b5f5-4dc4-bc14-2d8fc577a25b tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9618947da33145e9be9e891d53d51d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec610c3d9994ef0a9945eadacddcb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:02.566072 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-014a68a4-b5f5-4dc4-bc14-2d8fc577a25b tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] 10.222.0.27 "GET /compute/v2.1/servers/ef994e40-e8cb-40ec-adb3-84f60b8928fc" status: 200 len: 1322 microversion: 2.1 time: 0.184643 Jun 20 12:48:02.566669 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3393/6687] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:02 2022] GET /compute/v2.1/servers/ef994e40-e8cb-40ec-adb3-84f60b8928fc => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:03.588975 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-080aa659-b5d1-44e9-aa4b-30d5c37945e1 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:03.590283 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-080aa659-b5d1-44e9-aa4b-30d5c37945e1 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] [instance: ef994e40-e8cb-40ec-adb3-84f60b8928fc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:03.602647 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-080aa659-b5d1-44e9-aa4b-30d5c37945e1 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:03.603116 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-080aa659-b5d1-44e9-aa4b-30d5c37945e1 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:03.603915 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-080aa659-b5d1-44e9-aa4b-30d5c37945e1 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:03.604404 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-080aa659-b5d1-44e9-aa4b-30d5c37945e1 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:03.753508 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-080aa659-b5d1-44e9-aa4b-30d5c37945e1 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9618947da33145e9be9e891d53d51d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec610c3d9994ef0a9945eadacddcb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:03.762201 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-080aa659-b5d1-44e9-aa4b-30d5c37945e1 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] 10.222.0.27 "GET /compute/v2.1/servers/ef994e40-e8cb-40ec-adb3-84f60b8928fc" status: 200 len: 1322 microversion: 2.1 time: 0.181417 Jun 20 12:48:03.762904 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3295/6688] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:03 2022] GET /compute/v2.1/servers/ef994e40-e8cb-40ec-adb3-84f60b8928fc => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:04.780644 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b324fc7b-1214-4403-817a-ba90382f4788 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:04.781435 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b324fc7b-1214-4403-817a-ba90382f4788 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] [instance: ef994e40-e8cb-40ec-adb3-84f60b8928fc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:04.789032 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b324fc7b-1214-4403-817a-ba90382f4788 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:04.789622 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b324fc7b-1214-4403-817a-ba90382f4788 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:04.790726 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b324fc7b-1214-4403-817a-ba90382f4788 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:04.791189 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b324fc7b-1214-4403-817a-ba90382f4788 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:04.936461 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b324fc7b-1214-4403-817a-ba90382f4788 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9618947da33145e9be9e891d53d51d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec610c3d9994ef0a9945eadacddcb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:04.945697 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b324fc7b-1214-4403-817a-ba90382f4788 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] 10.222.0.27 "GET /compute/v2.1/servers/ef994e40-e8cb-40ec-adb3-84f60b8928fc" status: 200 len: 1470 microversion: 2.1 time: 0.169041 Jun 20 12:48:04.946323 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3394/6689] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:04 2022] GET /compute/v2.1/servers/ef994e40-e8cb-40ec-adb3-84f60b8928fc => generated 1470 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:05.052939 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-845bf1a0-6e1b-45a3-b7ca-6724af17e446 tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] Calling method '.version_select at 0x7f60729a3f70>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:05.124794 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-845bf1a0-6e1b-45a3-b7ca-6724af17e446 tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/5b890b6d444841c1b2f66fedff6106b2" status: 200 len: 371 microversion: 2.1 time: 0.161568 Jun 20 12:48:05.125373 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3296/6690] 10.222.0.27 () {58 vars in 1241 bytes} [Mon Jun 20 12:48:04 2022] GET /compute/v2.1/os-quota-sets/5b890b6d444841c1b2f66fedff6106b2 => generated 371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:48:05.136985 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f81d9c96-b2ea-4326-9b1b-771b9eab160f tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1219389817", "id": 246617608, "os-flavor-access:is_public": "True"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:48:05.138600 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:48:05.138600 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 12:48:05.155711 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f81d9c96-b2ea-4326-9b1b-771b9eab160f tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.022508 Jun 20 12:48:05.156367 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3395/6691] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:48:05 2022] POST /compute/v2.1/flavors => generated 435 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:48:05.168948 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5337f1e9-bcd9-4417-8ff2-facf515ba8ac tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "246617608"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:48:05.169941 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5337f1e9-bcd9-4417-8ff2-facf515ba8ac tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] [instance: ef994e40-e8cb-40ec-adb3-84f60b8928fc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:05.176487 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5337f1e9-bcd9-4417-8ff2-facf515ba8ac tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:05.176961 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5337f1e9-bcd9-4417-8ff2-facf515ba8ac tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:05.177960 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5337f1e9-bcd9-4417-8ff2-facf515ba8ac tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:05.178796 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5337f1e9-bcd9-4417-8ff2-facf515ba8ac tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:05.265420 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5337f1e9-bcd9-4417-8ff2-facf515ba8ac tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '12229284d1954bacb9c0fb2d91744bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b890b6d444841c1b2f66fedff6106b2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:05.274645 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5337f1e9-bcd9-4417-8ff2-facf515ba8ac tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] [instance: ef994e40-e8cb-40ec-adb3-84f60b8928fc] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1219389817 {{(pid=119128) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 20 12:48:05.282867 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5337f1e9-bcd9-4417-8ff2-facf515ba8ac tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:05.283410 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5337f1e9-bcd9-4417-8ff2-facf515ba8ac tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:05.284379 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5337f1e9-bcd9-4417-8ff2-facf515ba8ac tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:05.284813 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5337f1e9-bcd9-4417-8ff2-facf515ba8ac tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:05.307752 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-5337f1e9-bcd9-4417-8ff2-facf515ba8ac tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] Getting quotas for project 8ec610c3d9994ef0a9945eadacddcb28. Resources: {'ram', 'cores'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:48:05.313267 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-5337f1e9-bcd9-4417-8ff2-facf515ba8ac tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] Getting quotas for user 9618947da33145e9be9e891d53d51d5d and project 8ec610c3d9994ef0a9945eadacddcb28. Resources: {'ram', 'cores'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:48:05.326349 n-d-master-1 devstack@n-api.service[119128]: INFO nova.compute.api [None req-5337f1e9-bcd9-4417-8ff2-facf515ba8ac tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] ram quota exceeded for 5b890b6d444841c1b2f66fedff6106b2, tried to resize instance. Jun 20 12:48:05.326876 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-5337f1e9-bcd9-4417-8ff2-facf515ba8ac tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5337f1e9-bcd9-4417-8ff2-facf515ba8ac tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] Request method failure captured: Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/servers/ef994e40-e8cb-40ec-adb3-84f60b8928fc/action HTTP/1.1 Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 38 Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGx6CeJVEI14vkEHKJkliWa4pimBpmk3sKI8tRxKAaMujJ_4JM0snceqkpkAsOS5hdtB_Au9hkurKOq-6Xfzki3ldTzdU4O7naEVVukdThqDSXO9avhwHpdmABd1NxrU4uWN_ln0hlKrSPPT9F9ehpLP7IMkAska3voTY1WjXIGe2bc Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 5b890b6d444841c1b2f66fedff6106b2 Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-193696376 Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member,admin Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member,admin Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5b890b6d444841c1b2f66fedff6106b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5b890b6d444841c1b2f66fedff6106b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5b890b6d444841c1b2f66fedff6106b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5b890b6d444841c1b2f66fedff6106b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersAdminNegativeTestJSON-193696376 Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 5b890b6d444841c1b2f66fedff6106b2 Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-193696376 Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersAdminNegativeTestJSON-193696376-project-admin Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 12229284d1954bacb9c0fb2d91744bae Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersAdminNegativeTestJSON-193696376-project-admin Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: {"resize": {"flavorRef": "246617608"}} Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'ef994e40-e8cb-40ec-adb3-84f60b8928fc', 'body': {'resize': {'flavorRef': '246617608'}}} Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 12:48:05.329094 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5337f1e9-bcd9-4417-8ff2-facf515ba8ac tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5337f1e9-bcd9-4417-8ff2-facf515ba8ac tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/ef994e40-e8cb-40ec-adb3-84f60b8928fc/action" status: 403 len: 118 microversion: 2.1 time: 0.165537 Jun 20 12:48:05.335116 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3297/6692] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:48:05 2022] POST /compute/v2.1/servers/ef994e40-e8cb-40ec-adb3-84f60b8928fc/action => generated 118 bytes in 167 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:48:05.347941 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-353f4510-188a-46e4-b880-c7d3c087c5c8 tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:05.348724 n-d-master-1 devstack@n-api.service[119127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:48:05.348724 n-d-master-1 devstack@n-api.service[119127]: warnings.warn(msg) Jun 20 12:48:05.351082 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:48:05.351869 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:48:05.369184 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-353f4510-188a-46e4-b880-c7d3c087c5c8 tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/246617608" status: 202 len: 0 microversion: 2.1 time: 0.025061 Jun 20 12:48:05.369777 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3396/6693] 10.222.0.27 () {58 vars in 1157 bytes} [Mon Jun 20 12:48:05 2022] DELETE /compute/v2.1/flavors/246617608 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:48:05.377999 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-aafd9a5e-4ae1-422a-a869-d0f4c1bd53f4 tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:05.403010 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-aafd9a5e-4ae1-422a-a869-d0f4c1bd53f4 tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028659 Jun 20 12:48:05.404045 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3298/6694] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 12:48:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:05.423155 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-282bc2a4-1162-45dd-aa60-253377192d9a tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] Calling method '.version_select at 0x7f60722ed9d0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:05.504177 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-282bc2a4-1162-45dd-aa60-253377192d9a tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/5b890b6d444841c1b2f66fedff6106b2" status: 200 len: 371 microversion: 2.1 time: 0.086605 Jun 20 12:48:05.504808 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3397/6695] 10.222.0.27 () {58 vars in 1241 bytes} [Mon Jun 20 12:48:05 2022] GET /compute/v2.1/os-quota-sets/5b890b6d444841c1b2f66fedff6106b2 => generated 371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:48:05.515472 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2adc49e5-58aa-448f-a4ef-f0d3322cf926 tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-574049235", "id": 1841398541, "os-flavor-access:is_public": "True"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:48:05.517094 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:48:05.517094 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 12:48:05.533124 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2adc49e5-58aa-448f-a4ef-f0d3322cf926 tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.021291 Jun 20 12:48:05.533710 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3299/6696] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:48:05 2022] POST /compute/v2.1/flavors => generated 436 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:48:05.544920 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8b6b3432-1462-4f0b-ab8f-ee2d5e28d06e tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1841398541"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:48:05.545811 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8b6b3432-1462-4f0b-ab8f-ee2d5e28d06e tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] [instance: ef994e40-e8cb-40ec-adb3-84f60b8928fc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:05.552114 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b6b3432-1462-4f0b-ab8f-ee2d5e28d06e tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:05.552627 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b6b3432-1462-4f0b-ab8f-ee2d5e28d06e tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:05.553988 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b6b3432-1462-4f0b-ab8f-ee2d5e28d06e tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:05.554458 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b6b3432-1462-4f0b-ab8f-ee2d5e28d06e tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:05.649610 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8b6b3432-1462-4f0b-ab8f-ee2d5e28d06e tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '12229284d1954bacb9c0fb2d91744bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b890b6d444841c1b2f66fedff6106b2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:05.656848 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8b6b3432-1462-4f0b-ab8f-ee2d5e28d06e tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] [instance: ef994e40-e8cb-40ec-adb3-84f60b8928fc] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-574049235 {{(pid=119127) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 20 12:48:05.664062 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b6b3432-1462-4f0b-ab8f-ee2d5e28d06e tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:05.664544 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b6b3432-1462-4f0b-ab8f-ee2d5e28d06e tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:05.665344 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b6b3432-1462-4f0b-ab8f-ee2d5e28d06e tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:05.665789 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b6b3432-1462-4f0b-ab8f-ee2d5e28d06e tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:05.689578 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-8b6b3432-1462-4f0b-ab8f-ee2d5e28d06e tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] Getting quotas for project 8ec610c3d9994ef0a9945eadacddcb28. Resources: {'ram', 'cores'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:48:05.695005 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-8b6b3432-1462-4f0b-ab8f-ee2d5e28d06e tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] Getting quotas for user 9618947da33145e9be9e891d53d51d5d and project 8ec610c3d9994ef0a9945eadacddcb28. Resources: {'ram', 'cores'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:48:05.709890 n-d-master-1 devstack@n-api.service[119127]: INFO nova.compute.api [None req-8b6b3432-1462-4f0b-ab8f-ee2d5e28d06e tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] cores quota exceeded for 5b890b6d444841c1b2f66fedff6106b2, tried to resize instance. Jun 20 12:48:05.710433 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-8b6b3432-1462-4f0b-ab8f-ee2d5e28d06e tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8b6b3432-1462-4f0b-ab8f-ee2d5e28d06e tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] Request method failure captured: Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers/ef994e40-e8cb-40ec-adb3-84f60b8928fc/action HTTP/1.1 Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 39 Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGx6CeJVEI14vkEHKJkliWa4pimBpmk3sKI8tRxKAaMujJ_4JM0snceqkpkAsOS5hdtB_Au9hkurKOq-6Xfzki3ldTzdU4O7naEVVukdThqDSXO9avhwHpdmABd1NxrU4uWN_ln0hlKrSPPT9F9ehpLP7IMkAska3voTY1WjXIGe2bc Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 5b890b6d444841c1b2f66fedff6106b2 Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-193696376 Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member,admin Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member,admin Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5b890b6d444841c1b2f66fedff6106b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5b890b6d444841c1b2f66fedff6106b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5b890b6d444841c1b2f66fedff6106b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5b890b6d444841c1b2f66fedff6106b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersAdminNegativeTestJSON-193696376 Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 5b890b6d444841c1b2f66fedff6106b2 Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-193696376 Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersAdminNegativeTestJSON-193696376-project-admin Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 12229284d1954bacb9c0fb2d91744bae Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersAdminNegativeTestJSON-193696376-project-admin Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: {"resize": {"flavorRef": "1841398541"}} Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'ef994e40-e8cb-40ec-adb3-84f60b8928fc', 'body': {'resize': {'flavorRef': '1841398541'}}} Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 12:48:05.712640 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8b6b3432-1462-4f0b-ab8f-ee2d5e28d06e tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8b6b3432-1462-4f0b-ab8f-ee2d5e28d06e tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/ef994e40-e8cb-40ec-adb3-84f60b8928fc/action" status: 403 len: 113 microversion: 2.1 time: 0.173404 Jun 20 12:48:05.718072 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3398/6697] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:48:05 2022] POST /compute/v2.1/servers/ef994e40-e8cb-40ec-adb3-84f60b8928fc/action => generated 113 bytes in 175 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:48:05.723620 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8261e3a8-81af-4115-96df-9e4ad4cf7299 tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:05.724404 n-d-master-1 devstack@n-api.service[119128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:48:05.724404 n-d-master-1 devstack@n-api.service[119128]: warnings.warn(msg) Jun 20 12:48:05.745362 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8261e3a8-81af-4115-96df-9e4ad4cf7299 tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1841398541" status: 202 len: 0 microversion: 2.1 time: 0.025930 Jun 20 12:48:05.746017 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3300/6698] 10.222.0.27 () {58 vars in 1160 bytes} [Mon Jun 20 12:48:05 2022] DELETE /compute/v2.1/flavors/1841398541 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:48:05.764965 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2f3ad22c-7c1c-4dab-a604-68654f3d187a tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:05.787607 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2f3ad22c-7c1c-4dab-a604-68654f3d187a tempest-ServersAdminNegativeTestJSON-193696376 tempest-ServersAdminNegativeTestJSON-193696376-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029509 Jun 20 12:48:05.788374 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3399/6699] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Jun 20 12:48:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:05.807600 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f6446d97-c1f6-462f-9677-40996d002d49 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:05.808077 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f6446d97-c1f6-462f-9677-40996d002d49 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] [instance: ef994e40-e8cb-40ec-adb3-84f60b8928fc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:05.814627 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6446d97-c1f6-462f-9677-40996d002d49 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:05.815086 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6446d97-c1f6-462f-9677-40996d002d49 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:05.815897 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6446d97-c1f6-462f-9677-40996d002d49 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:05.816376 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6446d97-c1f6-462f-9677-40996d002d49 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:05.845072 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f6446d97-c1f6-462f-9677-40996d002d49 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] [instance: ef994e40-e8cb-40ec-adb3-84f60b8928fc] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:48:05.939006 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f6446d97-c1f6-462f-9677-40996d002d49 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ef994e40-e8cb-40ec-adb3-84f60b8928fc" status: 204 len: 0 microversion: 2.1 time: 0.135837 Jun 20 12:48:05.939600 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3301/6700] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:48:05 2022] DELETE /compute/v2.1/servers/ef994e40-e8cb-40ec-adb3-84f60b8928fc => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:48:05.947990 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-480e1e27-5057-43b2-9ddd-6b36fd78cae7 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:05.949538 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-480e1e27-5057-43b2-9ddd-6b36fd78cae7 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] [instance: ef994e40-e8cb-40ec-adb3-84f60b8928fc] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:05.964464 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-480e1e27-5057-43b2-9ddd-6b36fd78cae7 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:05.965001 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-480e1e27-5057-43b2-9ddd-6b36fd78cae7 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:05.966191 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-480e1e27-5057-43b2-9ddd-6b36fd78cae7 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:05.966821 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-480e1e27-5057-43b2-9ddd-6b36fd78cae7 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:06.125199 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-480e1e27-5057-43b2-9ddd-6b36fd78cae7 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9618947da33145e9be9e891d53d51d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec610c3d9994ef0a9945eadacddcb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:06.134366 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-480e1e27-5057-43b2-9ddd-6b36fd78cae7 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] 10.222.0.27 "GET /compute/v2.1/servers/ef994e40-e8cb-40ec-adb3-84f60b8928fc" status: 200 len: 1476 microversion: 2.1 time: 0.190408 Jun 20 12:48:06.135157 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3400/6701] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:05 2022] GET /compute/v2.1/servers/ef994e40-e8cb-40ec-adb3-84f60b8928fc => generated 1476 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:07.153545 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-42c92b49-9139-4136-a178-633a776ad214 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:07.154269 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-42c92b49-9139-4136-a178-633a776ad214 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] [instance: ef994e40-e8cb-40ec-adb3-84f60b8928fc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:07.164419 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-42c92b49-9139-4136-a178-633a776ad214 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:07.164883 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-42c92b49-9139-4136-a178-633a776ad214 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:07.165676 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-42c92b49-9139-4136-a178-633a776ad214 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:07.166117 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-42c92b49-9139-4136-a178-633a776ad214 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:07.401206 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-42c92b49-9139-4136-a178-633a776ad214 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9618947da33145e9be9e891d53d51d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ec610c3d9994ef0a9945eadacddcb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:07.410087 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-42c92b49-9139-4136-a178-633a776ad214 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] 10.222.0.27 "GET /compute/v2.1/servers/ef994e40-e8cb-40ec-adb3-84f60b8928fc" status: 200 len: 1476 microversion: 2.1 time: 0.260807 Jun 20 12:48:07.410828 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3302/6702] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:07 2022] GET /compute/v2.1/servers/ef994e40-e8cb-40ec-adb3-84f60b8928fc => generated 1476 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:48:07.747244 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-c639c100-e6d3-4d0d-87aa-418b962de766 req-c2665c73-2bb8-45bc-b1ab-52eabb191c93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef994e40-e8cb-40ec-adb3-84f60b8928fc", "name": "network-vif-deleted", "tag": "7d7f93c9-6b0d-4257-aff9-c4bb795f76e3"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:48:07.759984 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-c639c100-e6d3-4d0d-87aa-418b962de766 req-c2665c73-2bb8-45bc-b1ab-52eabb191c93 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:07.760595 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-c639c100-e6d3-4d0d-87aa-418b962de766 req-c2665c73-2bb8-45bc-b1ab-52eabb191c93 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:07.773806 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-c639c100-e6d3-4d0d-87aa-418b962de766 req-c2665c73-2bb8-45bc-b1ab-52eabb191c93 service nova] Creating event network-vif-deleted:7d7f93c9-6b0d-4257-aff9-c4bb795f76e3 for instance ef994e40-e8cb-40ec-adb3-84f60b8928fc on n-h1-master-1 Jun 20 12:48:07.780915 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-c639c100-e6d3-4d0d-87aa-418b962de766 req-c2665c73-2bb8-45bc-b1ab-52eabb191c93 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037180 Jun 20 12:48:07.782010 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3401/6703] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:48:08.433880 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ced8ce77-c794-4974-95d8-7d250b97f410 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:08.434718 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ced8ce77-c794-4974-95d8-7d250b97f410 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] [instance: ef994e40-e8cb-40ec-adb3-84f60b8928fc] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:08.445815 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ced8ce77-c794-4974-95d8-7d250b97f410 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:08.446296 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ced8ce77-c794-4974-95d8-7d250b97f410 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:08.447108 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ced8ce77-c794-4974-95d8-7d250b97f410 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:08.447652 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ced8ce77-c794-4974-95d8-7d250b97f410 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:08.462881 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-ced8ce77-c794-4974-95d8-7d250b97f410 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] HTTP exception thrown: Instance ef994e40-e8cb-40ec-adb3-84f60b8928fc could not be found. Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ced8ce77-c794-4974-95d8-7d250b97f410 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Request method failure captured: Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/ef994e40-e8cb-40ec-adb3-84f60b8928fc HTTP/1.1 Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGx6nTUE1hw5VQQ6qkgDFrkrnwGdiriPafrWbQc7H7U50jVXuBKyGcpsLGFEJqZHIMQtnyaib3ERETMUdzT4qG4_1P98X5Og_AZVBnXDC3avOFfRz-D0t_tdIdfldREkvOHL1VcWsEwkg8MHSOzbo7jcdJR0xdjuOpuzWj_7q_f-0KI Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 8ec610c3d9994ef0a9945eadacddcb28 Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-482101176 Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8ec610c3d9994ef0a9945eadacddcb28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8ec610c3d9994ef0a9945eadacddcb28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8ec610c3d9994ef0a9945eadacddcb28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8ec610c3d9994ef0a9945eadacddcb28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersAdminNegativeTestJSON-482101176 Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 8ec610c3d9994ef0a9945eadacddcb28 Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-482101176 Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersAdminNegativeTestJSON-482101176-project Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 9618947da33145e9be9e891d53d51d5d Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersAdminNegativeTestJSON-482101176-project Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: exception: Instance ef994e40-e8cb-40ec-adb3-84f60b8928fc could not be found. Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'ef994e40-e8cb-40ec-adb3-84f60b8928fc'} Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef994e40-e8cb-40ec-adb3-84f60b8928fc could not be found. Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef994e40-e8cb-40ec-adb3-84f60b8928fc could not be found. Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:48:08.464626 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:48:08.470600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:48:08.470600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:48:08.470600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:48:08.470600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:48:08.470600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:48:08.470600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef994e40-e8cb-40ec-adb3-84f60b8928fc could not be found. Jun 20 12:48:08.470600 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:48:08.470600 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ced8ce77-c794-4974-95d8-7d250b97f410 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] Returning 404 to user: Instance ef994e40-e8cb-40ec-adb3-84f60b8928fc could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:48:08.470600 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ced8ce77-c794-4974-95d8-7d250b97f410 tempest-ServersAdminNegativeTestJSON-482101176 tempest-ServersAdminNegativeTestJSON-482101176-project] 10.222.0.27 "GET /compute/v2.1/servers/ef994e40-e8cb-40ec-adb3-84f60b8928fc" status: 404 len: 111 microversion: 2.1 time: 0.039218 Jun 20 12:48:08.470600 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3303/6704] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:08 2022] GET /compute/v2.1/servers/ef994e40-e8cb-40ec-adb3-84f60b8928fc => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:48:15.405463 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f6b751ef-75af-4b7c-a4e9-7527ff541129 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-398314659", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "22d5867a-6baf-4efd-87a7-6e1028fafd45"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:48:15.460986 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-f6b751ef-75af-4b7c-a4e9-7527ff541129 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] validate_networks() for [('22d5867a-6baf-4efd-87a7-6e1028fafd45', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:48:15.494463 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:48:15.676111 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:48:15.888951 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-f6b751ef-75af-4b7c-a4e9-7527ff541129 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:48:15.889537 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-f6b751ef-75af-4b7c-a4e9-7527ff541129 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:48:15.890090 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-f6b751ef-75af-4b7c-a4e9-7527ff541129 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:48:15.890607 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-f6b751ef-75af-4b7c-a4e9-7527ff541129 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:48:15.891153 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-f6b751ef-75af-4b7c-a4e9-7527ff541129 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:48:15.902839 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f6b751ef-75af-4b7c-a4e9-7527ff541129 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:15.903439 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f6b751ef-75af-4b7c-a4e9-7527ff541129 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:15.904488 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f6b751ef-75af-4b7c-a4e9-7527ff541129 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:15.905210 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f6b751ef-75af-4b7c-a4e9-7527ff541129 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:15.927800 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-f6b751ef-75af-4b7c-a4e9-7527ff541129 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Getting quotas for project 11635e4c3ead4b7fb19bb6139eda0cd8. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:48:15.934442 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-f6b751ef-75af-4b7c-a4e9-7527ff541129 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Getting quotas for user afab9d8d42a04462b162392ce5f01fb5 and project 11635e4c3ead4b7fb19bb6139eda0cd8. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:48:15.951802 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f6b751ef-75af-4b7c-a4e9-7527ff541129 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:48:15.955014 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f6b751ef-75af-4b7c-a4e9-7527ff541129 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:48:16.013503 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f6b751ef-75af-4b7c-a4e9-7527ff541129 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.740748 Jun 20 12:48:16.014317 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3402/6705] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:48:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:48:16.024751 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4b4e41d2-c3ae-4f4c-963f-4260fd242e83 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:16.026292 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4b4e41d2-c3ae-4f4c-963f-4260fd242e83 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:16.030351 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=4 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:48:16.031856 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:48:16.105439 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4b4e41d2-c3ae-4f4c-963f-4260fd242e83 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:16.115025 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4b4e41d2-c3ae-4f4c-963f-4260fd242e83 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1214 microversion: 2.1 time: 0.094191 Jun 20 12:48:16.116417 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3304/6706] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:16 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:17.133313 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b57c29d2-edc2-474c-86cc-59012ec3b7af tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:17.134088 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b57c29d2-edc2-474c-86cc-59012ec3b7af tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:17.156628 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b57c29d2-edc2-474c-86cc-59012ec3b7af tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:17.158237 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b57c29d2-edc2-474c-86cc-59012ec3b7af tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:17.160524 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b57c29d2-edc2-474c-86cc-59012ec3b7af tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:17.161437 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b57c29d2-edc2-474c-86cc-59012ec3b7af tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:17.246794 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b57c29d2-edc2-474c-86cc-59012ec3b7af tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:17.255299 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b57c29d2-edc2-474c-86cc-59012ec3b7af tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1272 microversion: 2.1 time: 0.126510 Jun 20 12:48:17.256620 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3403/6707] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:17 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1272 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:18.285821 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e93c1557-d6f6-4160-835f-82947c8e50f0 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:18.286429 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e93c1557-d6f6-4160-835f-82947c8e50f0 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:18.293758 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e93c1557-d6f6-4160-835f-82947c8e50f0 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:18.294254 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e93c1557-d6f6-4160-835f-82947c8e50f0 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:18.302202 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e93c1557-d6f6-4160-835f-82947c8e50f0 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:18.302680 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e93c1557-d6f6-4160-835f-82947c8e50f0 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:18.512560 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e93c1557-d6f6-4160-835f-82947c8e50f0 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:18.526583 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e93c1557-d6f6-4160-835f-82947c8e50f0 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1314 microversion: 2.1 time: 0.254523 Jun 20 12:48:18.527613 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3305/6708] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:18 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:18.644487 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-ab7c0799-076e-438f-87b9-a74c54ed5216 req-63689178-f253-46ab-83bf-03550ba99f2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5eae93a-501d-41b6-a67f-74744f372e73", "tag": "e65aadbf-5d96-477e-9a30-343a0a6e2237"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:48:18.670532 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ab7c0799-076e-438f-87b9-a74c54ed5216 req-63689178-f253-46ab-83bf-03550ba99f2a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:18.670989 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ab7c0799-076e-438f-87b9-a74c54ed5216 req-63689178-f253-46ab-83bf-03550ba99f2a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:18.687302 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-ab7c0799-076e-438f-87b9-a74c54ed5216 req-63689178-f253-46ab-83bf-03550ba99f2a service nova] Creating event network-changed:e65aadbf-5d96-477e-9a30-343a0a6e2237 for instance e5eae93a-501d-41b6-a67f-74744f372e73 on n-h1-master-1 Jun 20 12:48:18.693022 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-ab7c0799-076e-438f-87b9-a74c54ed5216 req-63689178-f253-46ab-83bf-03550ba99f2a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053957 Jun 20 12:48:18.694437 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3404/6709] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:48:19.543692 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e8c4cf6c-d6b3-4433-a7a0-c35809639aa6 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:19.544372 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e8c4cf6c-d6b3-4433-a7a0-c35809639aa6 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:19.551868 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e8c4cf6c-d6b3-4433-a7a0-c35809639aa6 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:19.552359 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e8c4cf6c-d6b3-4433-a7a0-c35809639aa6 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:19.553207 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e8c4cf6c-d6b3-4433-a7a0-c35809639aa6 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:19.554857 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e8c4cf6c-d6b3-4433-a7a0-c35809639aa6 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:19.699013 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e8c4cf6c-d6b3-4433-a7a0-c35809639aa6 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:19.706763 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e8c4cf6c-d6b3-4433-a7a0-c35809639aa6 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1314 microversion: 2.1 time: 0.166927 Jun 20 12:48:19.707661 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3306/6710] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:19 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:20.246914 n-d-master-1 devstack@n-api.service[119127]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 12:48:20.247526 n-d-master-1 devstack@n-api.service[119127]: Mon Jun 20 12:48:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 12:48:20.727376 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7215bd6b-ab47-4633-bc7f-3ee9ca235f24 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:20.728077 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7215bd6b-ab47-4633-bc7f-3ee9ca235f24 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:20.735947 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7215bd6b-ab47-4633-bc7f-3ee9ca235f24 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:20.736718 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7215bd6b-ab47-4633-bc7f-3ee9ca235f24 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:20.737209 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7215bd6b-ab47-4633-bc7f-3ee9ca235f24 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:20.737644 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7215bd6b-ab47-4633-bc7f-3ee9ca235f24 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:20.875477 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7215bd6b-ab47-4633-bc7f-3ee9ca235f24 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:20.883885 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7215bd6b-ab47-4633-bc7f-3ee9ca235f24 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1314 microversion: 2.1 time: 0.161277 Jun 20 12:48:20.884518 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3405/6711] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:20 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:21.902051 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d6cf4ae2-d387-4314-a756-3bbe82ca2adf tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:21.902865 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d6cf4ae2-d387-4314-a756-3bbe82ca2adf tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:21.913326 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6cf4ae2-d387-4314-a756-3bbe82ca2adf tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:21.913812 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6cf4ae2-d387-4314-a756-3bbe82ca2adf tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:21.914557 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6cf4ae2-d387-4314-a756-3bbe82ca2adf tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:21.914995 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6cf4ae2-d387-4314-a756-3bbe82ca2adf tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:22.069100 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d6cf4ae2-d387-4314-a756-3bbe82ca2adf tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:22.077203 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d6cf4ae2-d387-4314-a756-3bbe82ca2adf tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1314 microversion: 2.1 time: 0.179555 Jun 20 12:48:22.077765 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3307/6712] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:21 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:23.095594 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3eb0379e-4342-4b2d-8060-b66e47f6ebf9 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:23.096441 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3eb0379e-4342-4b2d-8060-b66e47f6ebf9 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:23.105063 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3eb0379e-4342-4b2d-8060-b66e47f6ebf9 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:23.105543 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3eb0379e-4342-4b2d-8060-b66e47f6ebf9 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:23.106377 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3eb0379e-4342-4b2d-8060-b66e47f6ebf9 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:23.106795 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3eb0379e-4342-4b2d-8060-b66e47f6ebf9 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:23.257992 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3eb0379e-4342-4b2d-8060-b66e47f6ebf9 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:23.266356 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3eb0379e-4342-4b2d-8060-b66e47f6ebf9 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1314 microversion: 2.1 time: 0.175073 Jun 20 12:48:23.266962 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3406/6713] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:23 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:24.284712 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-96dda0af-68a3-43a6-b298-f5197918a6b2 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:24.285346 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-96dda0af-68a3-43a6-b298-f5197918a6b2 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:24.297220 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-96dda0af-68a3-43a6-b298-f5197918a6b2 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:24.297775 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-96dda0af-68a3-43a6-b298-f5197918a6b2 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:24.298655 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-96dda0af-68a3-43a6-b298-f5197918a6b2 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:24.299149 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-96dda0af-68a3-43a6-b298-f5197918a6b2 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:24.442931 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-96dda0af-68a3-43a6-b298-f5197918a6b2 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:24.451707 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-96dda0af-68a3-43a6-b298-f5197918a6b2 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1314 microversion: 2.1 time: 0.171068 Jun 20 12:48:24.452274 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3308/6714] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:24 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:24.548864 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-2f45c7a7-55d7-43f2-ae63-6da3ccbf621a req-6391c401-bf7d-479d-811c-2ddd2bb258e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5eae93a-501d-41b6-a67f-74744f372e73", "name": "network-vif-plugged", "status": "completed", "tag": "e65aadbf-5d96-477e-9a30-343a0a6e2237"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:48:24.559168 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-2f45c7a7-55d7-43f2-ae63-6da3ccbf621a req-6391c401-bf7d-479d-811c-2ddd2bb258e7 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:24.559912 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-2f45c7a7-55d7-43f2-ae63-6da3ccbf621a req-6391c401-bf7d-479d-811c-2ddd2bb258e7 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:24.573287 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-2f45c7a7-55d7-43f2-ae63-6da3ccbf621a req-6391c401-bf7d-479d-811c-2ddd2bb258e7 service nova] Creating event network-vif-plugged:e65aadbf-5d96-477e-9a30-343a0a6e2237 for instance e5eae93a-501d-41b6-a67f-74744f372e73 on n-h1-master-1 Jun 20 12:48:24.578280 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-2f45c7a7-55d7-43f2-ae63-6da3ccbf621a req-6391c401-bf7d-479d-811c-2ddd2bb258e7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033545 Jun 20 12:48:24.578902 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3407/6715] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:48:25.469614 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-505c4af7-f8d5-4336-8133-76707a1c34c9 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:25.470210 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-505c4af7-f8d5-4336-8133-76707a1c34c9 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:25.473071 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:48:25.479112 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-505c4af7-f8d5-4336-8133-76707a1c34c9 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:25.479574 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-505c4af7-f8d5-4336-8133-76707a1c34c9 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:25.480390 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-505c4af7-f8d5-4336-8133-76707a1c34c9 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:25.480838 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-505c4af7-f8d5-4336-8133-76707a1c34c9 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:25.484673 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:48:25.623330 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-505c4af7-f8d5-4336-8133-76707a1c34c9 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:25.631803 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-505c4af7-f8d5-4336-8133-76707a1c34c9 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1314 microversion: 2.1 time: 0.165690 Jun 20 12:48:25.632410 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3309/6716] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:25 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:26.649568 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e8a0bbd3-0044-4f3a-9c54-f9a8074fae98 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:26.650222 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e8a0bbd3-0044-4f3a-9c54-f9a8074fae98 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:26.652937 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:48:26.653616 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:48:26.654317 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:48:26.664522 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e8a0bbd3-0044-4f3a-9c54-f9a8074fae98 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:26.664986 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e8a0bbd3-0044-4f3a-9c54-f9a8074fae98 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:26.665786 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e8a0bbd3-0044-4f3a-9c54-f9a8074fae98 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:26.666228 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e8a0bbd3-0044-4f3a-9c54-f9a8074fae98 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:26.670342 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=74 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:48:26.874709 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e8a0bbd3-0044-4f3a-9c54-f9a8074fae98 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:26.884128 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e8a0bbd3-0044-4f3a-9c54-f9a8074fae98 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1501 microversion: 2.1 time: 0.238946 Jun 20 12:48:26.884932 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3408/6717] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:26 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1501 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:26.901932 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b2d5ffc1-fe72-4e89-8b66-d61a423f779b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:48:26.902968 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b2d5ffc1-fe72-4e89-8b66-d61a423f779b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:26.905080 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:48:26.911417 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2d5ffc1-fe72-4e89-8b66-d61a423f779b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:26.911873 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2d5ffc1-fe72-4e89-8b66-d61a423f779b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:26.912927 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2d5ffc1-fe72-4e89-8b66-d61a423f779b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:26.913388 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2d5ffc1-fe72-4e89-8b66-d61a423f779b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:26.944269 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b2d5ffc1-fe72-4e89-8b66-d61a423f779b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:26.952579 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b2d5ffc1-fe72-4e89-8b66-d61a423f779b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Old instance type m1.heat2, new instance type m1.heat {{(pid=119128) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 20 12:48:26.963310 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-b2d5ffc1-fe72-4e89-8b66-d61a423f779b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:48:26.963761 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-b2d5ffc1-fe72-4e89-8b66-d61a423f779b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:48:26.964279 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-b2d5ffc1-fe72-4e89-8b66-d61a423f779b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:48:26.964712 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-b2d5ffc1-fe72-4e89-8b66-d61a423f779b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:48:26.965144 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-b2d5ffc1-fe72-4e89-8b66-d61a423f779b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:48:27.037222 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b2d5ffc1-fe72-4e89-8b66-d61a423f779b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "POST /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73/action" status: 202 len: 0 microversion: 2.1 time: 0.139138 Jun 20 12:48:27.041041 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3310/6718] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:48:26 2022] POST /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:48:27.046751 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-02281737-423c-49d3-b3b8-f7b91cd9e869 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:27.047607 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-02281737-423c-49d3-b3b8-f7b91cd9e869 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:27.055189 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02281737-423c-49d3-b3b8-f7b91cd9e869 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:27.055643 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02281737-423c-49d3-b3b8-f7b91cd9e869 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:27.056459 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02281737-423c-49d3-b3b8-f7b91cd9e869 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:27.056903 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02281737-423c-49d3-b3b8-f7b91cd9e869 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:27.211898 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-02281737-423c-49d3-b3b8-f7b91cd9e869 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:27.220079 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-02281737-423c-49d3-b3b8-f7b91cd9e869 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1510 microversion: 2.1 time: 0.177528 Jun 20 12:48:27.220947 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3409/6719] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:27 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1510 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:28.240123 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3dce3b08-1150-49cc-b188-1edfdd9c5b7b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:28.242415 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3dce3b08-1150-49cc-b188-1edfdd9c5b7b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:28.248837 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3dce3b08-1150-49cc-b188-1edfdd9c5b7b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:28.249307 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3dce3b08-1150-49cc-b188-1edfdd9c5b7b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:28.250285 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3dce3b08-1150-49cc-b188-1edfdd9c5b7b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:28.250723 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3dce3b08-1150-49cc-b188-1edfdd9c5b7b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:28.401232 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3dce3b08-1150-49cc-b188-1edfdd9c5b7b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:28.409490 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3dce3b08-1150-49cc-b188-1edfdd9c5b7b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1510 microversion: 2.1 time: 0.174263 Jun 20 12:48:28.410111 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3311/6720] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:28 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1510 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:29.429185 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ee7256e3-269a-43fa-8f26-d9cb85fc2778 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:29.429781 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ee7256e3-269a-43fa-8f26-d9cb85fc2778 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:29.437865 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee7256e3-269a-43fa-8f26-d9cb85fc2778 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:29.438346 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee7256e3-269a-43fa-8f26-d9cb85fc2778 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:29.439142 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee7256e3-269a-43fa-8f26-d9cb85fc2778 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:29.439586 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ee7256e3-269a-43fa-8f26-d9cb85fc2778 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:29.594389 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ee7256e3-269a-43fa-8f26-d9cb85fc2778 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:29.603365 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ee7256e3-269a-43fa-8f26-d9cb85fc2778 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1515 microversion: 2.1 time: 0.179353 Jun 20 12:48:29.603955 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3410/6721] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:29 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1515 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:30.630638 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-19bcf968-a769-4540-8496-3c1a9bf2263f tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:30.631771 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-19bcf968-a769-4540-8496-3c1a9bf2263f tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:30.650289 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-19bcf968-a769-4540-8496-3c1a9bf2263f tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:30.650763 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-19bcf968-a769-4540-8496-3c1a9bf2263f tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:30.651528 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-19bcf968-a769-4540-8496-3c1a9bf2263f tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:30.652003 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-19bcf968-a769-4540-8496-3c1a9bf2263f tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:30.810076 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-19bcf968-a769-4540-8496-3c1a9bf2263f tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:30.821592 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-19bcf968-a769-4540-8496-3c1a9bf2263f tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1515 microversion: 2.1 time: 0.197234 Jun 20 12:48:30.822331 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3312/6722] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:30 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1515 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:31.843292 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-801b2988-0579-4dd7-bf4d-1be0136d8c45 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:31.843894 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-801b2988-0579-4dd7-bf4d-1be0136d8c45 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:31.851503 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-801b2988-0579-4dd7-bf4d-1be0136d8c45 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:31.851989 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-801b2988-0579-4dd7-bf4d-1be0136d8c45 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:31.852787 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-801b2988-0579-4dd7-bf4d-1be0136d8c45 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:31.853225 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-801b2988-0579-4dd7-bf4d-1be0136d8c45 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:32.004135 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-801b2988-0579-4dd7-bf4d-1be0136d8c45 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:32.012783 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-801b2988-0579-4dd7-bf4d-1be0136d8c45 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1515 microversion: 2.1 time: 0.173742 Jun 20 12:48:32.013374 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3411/6723] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:31 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:33.032394 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1c7eda31-c38f-417e-9be4-09f0f63a9da3 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:33.032988 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1c7eda31-c38f-417e-9be4-09f0f63a9da3 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:33.044102 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1c7eda31-c38f-417e-9be4-09f0f63a9da3 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:33.044868 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1c7eda31-c38f-417e-9be4-09f0f63a9da3 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:33.046047 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1c7eda31-c38f-417e-9be4-09f0f63a9da3 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:33.046740 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1c7eda31-c38f-417e-9be4-09f0f63a9da3 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:33.199923 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1c7eda31-c38f-417e-9be4-09f0f63a9da3 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:33.213330 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1c7eda31-c38f-417e-9be4-09f0f63a9da3 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1515 microversion: 2.1 time: 0.186430 Jun 20 12:48:33.214125 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3313/6724] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:33 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1515 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:34.238961 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0d74fcb2-86e3-45d1-8303-f776d11ee115 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:34.239518 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0d74fcb2-86e3-45d1-8303-f776d11ee115 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:34.249591 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0d74fcb2-86e3-45d1-8303-f776d11ee115 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:34.250058 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0d74fcb2-86e3-45d1-8303-f776d11ee115 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:34.251216 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0d74fcb2-86e3-45d1-8303-f776d11ee115 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:34.251833 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0d74fcb2-86e3-45d1-8303-f776d11ee115 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:34.413659 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0d74fcb2-86e3-45d1-8303-f776d11ee115 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:34.424595 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0d74fcb2-86e3-45d1-8303-f776d11ee115 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1515 microversion: 2.1 time: 0.191805 Jun 20 12:48:34.425214 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3412/6725] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:34 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1515 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:35.446749 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a44bf7e8-e3a2-43ed-9e25-5cac1834a9b5 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:35.447385 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a44bf7e8-e3a2-43ed-9e25-5cac1834a9b5 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:35.455014 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a44bf7e8-e3a2-43ed-9e25-5cac1834a9b5 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:35.455479 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a44bf7e8-e3a2-43ed-9e25-5cac1834a9b5 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:35.456299 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a44bf7e8-e3a2-43ed-9e25-5cac1834a9b5 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:35.456752 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a44bf7e8-e3a2-43ed-9e25-5cac1834a9b5 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:35.598550 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a44bf7e8-e3a2-43ed-9e25-5cac1834a9b5 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:35.607429 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a44bf7e8-e3a2-43ed-9e25-5cac1834a9b5 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1515 microversion: 2.1 time: 0.166951 Jun 20 12:48:35.608352 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3314/6726] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:35 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:36.629016 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ac292ea4-674b-4c25-bcd7-56742f3ed1b4 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:36.629832 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ac292ea4-674b-4c25-bcd7-56742f3ed1b4 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:36.642380 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac292ea4-674b-4c25-bcd7-56742f3ed1b4 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:36.643145 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac292ea4-674b-4c25-bcd7-56742f3ed1b4 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:36.644485 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac292ea4-674b-4c25-bcd7-56742f3ed1b4 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:36.645218 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac292ea4-674b-4c25-bcd7-56742f3ed1b4 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:36.808805 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ac292ea4-674b-4c25-bcd7-56742f3ed1b4 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:36.818642 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ac292ea4-674b-4c25-bcd7-56742f3ed1b4 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1515 microversion: 2.1 time: 0.196117 Jun 20 12:48:36.819548 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3413/6727] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:36 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1515 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:37.837053 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-94eec55f-736a-4459-948f-90367aeeb7f6 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:37.837664 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-94eec55f-736a-4459-948f-90367aeeb7f6 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:37.845358 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94eec55f-736a-4459-948f-90367aeeb7f6 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:37.845830 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94eec55f-736a-4459-948f-90367aeeb7f6 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:37.846599 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94eec55f-736a-4459-948f-90367aeeb7f6 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:37.847044 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-94eec55f-736a-4459-948f-90367aeeb7f6 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:37.992769 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-94eec55f-736a-4459-948f-90367aeeb7f6 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:38.000639 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-94eec55f-736a-4459-948f-90367aeeb7f6 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1515 microversion: 2.1 time: 0.167673 Jun 20 12:48:38.001192 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3315/6728] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:37 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:39.018184 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e28fdafb-14ab-4ba7-bfb7-3e5a0b4e05ab tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:39.018905 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e28fdafb-14ab-4ba7-bfb7-3e5a0b4e05ab tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:39.026937 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e28fdafb-14ab-4ba7-bfb7-3e5a0b4e05ab tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:39.027391 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e28fdafb-14ab-4ba7-bfb7-3e5a0b4e05ab tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:39.028158 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e28fdafb-14ab-4ba7-bfb7-3e5a0b4e05ab tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:39.028630 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e28fdafb-14ab-4ba7-bfb7-3e5a0b4e05ab tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:39.168113 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e28fdafb-14ab-4ba7-bfb7-3e5a0b4e05ab tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:39.181649 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e28fdafb-14ab-4ba7-bfb7-3e5a0b4e05ab tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1515 microversion: 2.1 time: 0.166716 Jun 20 12:48:39.182629 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3414/6729] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:39 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:40.207326 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-467492ab-2913-4fb2-b37f-f1af0d96447f tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:40.208224 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-467492ab-2913-4fb2-b37f-f1af0d96447f tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:40.219166 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-467492ab-2913-4fb2-b37f-f1af0d96447f tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:40.219938 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-467492ab-2913-4fb2-b37f-f1af0d96447f tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:40.221268 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-467492ab-2913-4fb2-b37f-f1af0d96447f tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:40.221843 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-467492ab-2913-4fb2-b37f-f1af0d96447f tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:40.372232 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-467492ab-2913-4fb2-b37f-f1af0d96447f tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:40.382277 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-467492ab-2913-4fb2-b37f-f1af0d96447f tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1515 microversion: 2.1 time: 0.181625 Jun 20 12:48:40.383871 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3316/6730] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:40 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1515 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:41.401419 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-140e5ea6-1659-4a8d-aaa0-3cc5720302ae tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:41.402019 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-140e5ea6-1659-4a8d-aaa0-3cc5720302ae tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:41.410347 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-140e5ea6-1659-4a8d-aaa0-3cc5720302ae tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:41.410916 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-140e5ea6-1659-4a8d-aaa0-3cc5720302ae tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:41.411706 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-140e5ea6-1659-4a8d-aaa0-3cc5720302ae tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:41.412173 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-140e5ea6-1659-4a8d-aaa0-3cc5720302ae tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:41.557543 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-140e5ea6-1659-4a8d-aaa0-3cc5720302ae tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:41.565442 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-140e5ea6-1659-4a8d-aaa0-3cc5720302ae tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1515 microversion: 2.1 time: 0.168293 Jun 20 12:48:41.566162 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3415/6731] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:41 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:42.587158 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a58ab505-c9f6-433b-88d4-df6b20538852 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:42.587810 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a58ab505-c9f6-433b-88d4-df6b20538852 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:42.597761 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a58ab505-c9f6-433b-88d4-df6b20538852 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:42.598854 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a58ab505-c9f6-433b-88d4-df6b20538852 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:42.599841 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a58ab505-c9f6-433b-88d4-df6b20538852 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:42.600315 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a58ab505-c9f6-433b-88d4-df6b20538852 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:42.746516 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a58ab505-c9f6-433b-88d4-df6b20538852 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:42.754595 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a58ab505-c9f6-433b-88d4-df6b20538852 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1515 microversion: 2.1 time: 0.173602 Jun 20 12:48:42.755182 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3317/6732] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:42 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:43.774103 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e1d65f6c-d924-47ff-8e55-e3e5dc2fc98e tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:43.774852 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e1d65f6c-d924-47ff-8e55-e3e5dc2fc98e tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:43.784988 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1d65f6c-d924-47ff-8e55-e3e5dc2fc98e tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:43.785596 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1d65f6c-d924-47ff-8e55-e3e5dc2fc98e tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:43.786664 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1d65f6c-d924-47ff-8e55-e3e5dc2fc98e tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:43.787252 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1d65f6c-d924-47ff-8e55-e3e5dc2fc98e tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:43.934665 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e1d65f6c-d924-47ff-8e55-e3e5dc2fc98e tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:43.942806 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e1d65f6c-d924-47ff-8e55-e3e5dc2fc98e tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1515 microversion: 2.1 time: 0.174397 Jun 20 12:48:43.943385 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3416/6733] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:43 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:44.964105 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-89ec2a39-5792-4a4f-86b8-48c1211181f4 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:44.964784 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-89ec2a39-5792-4a4f-86b8-48c1211181f4 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:44.971955 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-89ec2a39-5792-4a4f-86b8-48c1211181f4 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:44.972455 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-89ec2a39-5792-4a4f-86b8-48c1211181f4 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:44.973230 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-89ec2a39-5792-4a4f-86b8-48c1211181f4 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:44.973680 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-89ec2a39-5792-4a4f-86b8-48c1211181f4 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:45.116603 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-89ec2a39-5792-4a4f-86b8-48c1211181f4 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:45.127489 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-89ec2a39-5792-4a4f-86b8-48c1211181f4 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1515 microversion: 2.1 time: 0.169526 Jun 20 12:48:45.128306 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3318/6734] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:44 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:46.151105 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-275d430c-208d-4bd7-90c9-cd4ae40b2760 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:46.152730 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-275d430c-208d-4bd7-90c9-cd4ae40b2760 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:46.162578 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-275d430c-208d-4bd7-90c9-cd4ae40b2760 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:46.163169 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-275d430c-208d-4bd7-90c9-cd4ae40b2760 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:46.164227 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-275d430c-208d-4bd7-90c9-cd4ae40b2760 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:46.164724 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-275d430c-208d-4bd7-90c9-cd4ae40b2760 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:46.322024 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-275d430c-208d-4bd7-90c9-cd4ae40b2760 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:46.334464 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-275d430c-208d-4bd7-90c9-cd4ae40b2760 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1515 microversion: 2.1 time: 0.189714 Jun 20 12:48:46.335151 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3417/6735] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:46 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1515 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:47.353604 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8bd9c4fb-9775-4c8f-8140-c5a75a1ef7ed tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:47.354277 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8bd9c4fb-9775-4c8f-8140-c5a75a1ef7ed tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:47.361883 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8bd9c4fb-9775-4c8f-8140-c5a75a1ef7ed tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:47.362345 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8bd9c4fb-9775-4c8f-8140-c5a75a1ef7ed tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:47.363105 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8bd9c4fb-9775-4c8f-8140-c5a75a1ef7ed tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:47.363546 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8bd9c4fb-9775-4c8f-8140-c5a75a1ef7ed tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:47.524191 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8bd9c4fb-9775-4c8f-8140-c5a75a1ef7ed tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:47.532729 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8bd9c4fb-9775-4c8f-8140-c5a75a1ef7ed tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1515 microversion: 2.1 time: 0.183454 Jun 20 12:48:47.533322 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3319/6736] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:47 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1515 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:48.552162 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-defce6d4-c8a1-4258-8277-c30dce60493d tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:48.552783 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-defce6d4-c8a1-4258-8277-c30dce60493d tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:48.561938 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-defce6d4-c8a1-4258-8277-c30dce60493d tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:48.562393 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-defce6d4-c8a1-4258-8277-c30dce60493d tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:48.563174 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-defce6d4-c8a1-4258-8277-c30dce60493d tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:48.563611 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-defce6d4-c8a1-4258-8277-c30dce60493d tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:48.704330 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-defce6d4-c8a1-4258-8277-c30dce60493d tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:48.715298 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-defce6d4-c8a1-4258-8277-c30dce60493d tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1515 microversion: 2.1 time: 0.168110 Jun 20 12:48:48.716052 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3418/6737] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:48 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:49.735177 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-031325d3-a1a6-4a86-8079-59b11ba06b92 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:49.735775 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-031325d3-a1a6-4a86-8079-59b11ba06b92 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:49.743281 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-031325d3-a1a6-4a86-8079-59b11ba06b92 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:49.743749 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-031325d3-a1a6-4a86-8079-59b11ba06b92 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:49.744556 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-031325d3-a1a6-4a86-8079-59b11ba06b92 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:49.745004 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-031325d3-a1a6-4a86-8079-59b11ba06b92 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:49.882327 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-031325d3-a1a6-4a86-8079-59b11ba06b92 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:49.891396 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-031325d3-a1a6-4a86-8079-59b11ba06b92 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1515 microversion: 2.1 time: 0.161053 Jun 20 12:48:49.891990 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3320/6738] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:49 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:50.912175 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f4b4600f-119f-4986-86a7-1700afc369c6 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:50.913221 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f4b4600f-119f-4986-86a7-1700afc369c6 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:50.930271 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f4b4600f-119f-4986-86a7-1700afc369c6 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:50.931043 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f4b4600f-119f-4986-86a7-1700afc369c6 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:50.932460 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f4b4600f-119f-4986-86a7-1700afc369c6 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:50.933214 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f4b4600f-119f-4986-86a7-1700afc369c6 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:51.073644 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f4b4600f-119f-4986-86a7-1700afc369c6 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:51.082135 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f4b4600f-119f-4986-86a7-1700afc369c6 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1515 microversion: 2.1 time: 0.176533 Jun 20 12:48:51.082751 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3419/6739] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:50 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:48:52.101094 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9411f0c4-6a2b-4278-8372-42294891f1d6 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:52.102097 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9411f0c4-6a2b-4278-8372-42294891f1d6 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:52.110817 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9411f0c4-6a2b-4278-8372-42294891f1d6 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:52.111272 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9411f0c4-6a2b-4278-8372-42294891f1d6 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:52.112056 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9411f0c4-6a2b-4278-8372-42294891f1d6 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:52.112536 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9411f0c4-6a2b-4278-8372-42294891f1d6 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:52.262088 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9411f0c4-6a2b-4278-8372-42294891f1d6 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:52.274136 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9411f0c4-6a2b-4278-8372-42294891f1d6 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1515 microversion: 2.1 time: 0.177976 Jun 20 12:48:52.274848 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3321/6740] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:52 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1515 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:53.294826 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4cb6303b-2603-4b2d-aa30-8a179fa074d0 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:53.295544 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4cb6303b-2603-4b2d-aa30-8a179fa074d0 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:53.303626 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4cb6303b-2603-4b2d-aa30-8a179fa074d0 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:53.304047 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4cb6303b-2603-4b2d-aa30-8a179fa074d0 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:53.305156 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4cb6303b-2603-4b2d-aa30-8a179fa074d0 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:53.305591 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4cb6303b-2603-4b2d-aa30-8a179fa074d0 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:53.452907 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4cb6303b-2603-4b2d-aa30-8a179fa074d0 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:53.464693 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4cb6303b-2603-4b2d-aa30-8a179fa074d0 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1515 microversion: 2.1 time: 0.174802 Jun 20 12:48:53.465520 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3420/6741] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:53 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:54.490001 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f13e11a3-0446-4a46-9834-4c2ea2141dc4 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:54.490931 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f13e11a3-0446-4a46-9834-4c2ea2141dc4 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:54.501537 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f13e11a3-0446-4a46-9834-4c2ea2141dc4 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:54.502314 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f13e11a3-0446-4a46-9834-4c2ea2141dc4 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:54.503602 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f13e11a3-0446-4a46-9834-4c2ea2141dc4 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:54.504391 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f13e11a3-0446-4a46-9834-4c2ea2141dc4 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:54.656010 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f13e11a3-0446-4a46-9834-4c2ea2141dc4 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:54.667729 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f13e11a3-0446-4a46-9834-4c2ea2141dc4 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1515 microversion: 2.1 time: 0.182779 Jun 20 12:48:54.668610 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3322/6742] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:54 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1515 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:55.693664 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-002cb82d-e6da-4431-8f8a-12990a781c9c tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:55.694391 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-002cb82d-e6da-4431-8f8a-12990a781c9c tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:55.704268 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-002cb82d-e6da-4431-8f8a-12990a781c9c tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:55.704742 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-002cb82d-e6da-4431-8f8a-12990a781c9c tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:55.705517 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-002cb82d-e6da-4431-8f8a-12990a781c9c tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:55.705952 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-002cb82d-e6da-4431-8f8a-12990a781c9c tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:55.851921 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-002cb82d-e6da-4431-8f8a-12990a781c9c tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:55.859962 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-002cb82d-e6da-4431-8f8a-12990a781c9c tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1515 microversion: 2.1 time: 0.172657 Jun 20 12:48:55.860578 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3421/6743] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:55 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:56.878879 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-57883744-f2c7-4b24-9280-ba6c826e997c tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:56.879539 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-57883744-f2c7-4b24-9280-ba6c826e997c tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:56.882335 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=32 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:48:56.887918 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-57883744-f2c7-4b24-9280-ba6c826e997c tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:56.888436 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-57883744-f2c7-4b24-9280-ba6c826e997c tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:56.889244 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-57883744-f2c7-4b24-9280-ba6c826e997c tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:56.889699 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-57883744-f2c7-4b24-9280-ba6c826e997c tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:56.892928 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:48:57.040965 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-57883744-f2c7-4b24-9280-ba6c826e997c tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:57.049081 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-57883744-f2c7-4b24-9280-ba6c826e997c tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1515 microversion: 2.1 time: 0.174605 Jun 20 12:48:57.049515 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3323/6744] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:56 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:58.076776 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6cda94a3-96f0-4fcc-b45d-8856de2997d9 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:58.077706 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6cda94a3-96f0-4fcc-b45d-8856de2997d9 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:58.082263 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=28 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:48:58.092086 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6cda94a3-96f0-4fcc-b45d-8856de2997d9 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:58.092875 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6cda94a3-96f0-4fcc-b45d-8856de2997d9 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:58.094088 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6cda94a3-96f0-4fcc-b45d-8856de2997d9 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:58.094834 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6cda94a3-96f0-4fcc-b45d-8856de2997d9 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:58.098041 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=84 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:48:58.239951 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6cda94a3-96f0-4fcc-b45d-8856de2997d9 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:58.251299 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6cda94a3-96f0-4fcc-b45d-8856de2997d9 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1515 microversion: 2.1 time: 0.181227 Jun 20 12:48:58.252221 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3422/6745] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:58 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1515 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:48:59.268508 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5f15a172-b5d4-4102-84a4-825e384cf7b7 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:48:59.269203 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5f15a172-b5d4-4102-84a4-825e384cf7b7 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:48:59.276696 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5f15a172-b5d4-4102-84a4-825e384cf7b7 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:59.277142 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5f15a172-b5d4-4102-84a4-825e384cf7b7 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:59.277925 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5f15a172-b5d4-4102-84a4-825e384cf7b7 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:48:59.278367 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5f15a172-b5d4-4102-84a4-825e384cf7b7 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:48:59.419976 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5f15a172-b5d4-4102-84a4-825e384cf7b7 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:48:59.430009 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5f15a172-b5d4-4102-84a4-825e384cf7b7 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1515 microversion: 2.1 time: 0.165257 Jun 20 12:48:59.430595 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3324/6746] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:48:59 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:00.449311 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0ac14b8b-0d45-4bdb-9b04-57b5e535e276 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:00.449960 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0ac14b8b-0d45-4bdb-9b04-57b5e535e276 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:00.456692 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0ac14b8b-0d45-4bdb-9b04-57b5e535e276 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:00.457158 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0ac14b8b-0d45-4bdb-9b04-57b5e535e276 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:00.457940 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0ac14b8b-0d45-4bdb-9b04-57b5e535e276 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:00.458383 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0ac14b8b-0d45-4bdb-9b04-57b5e535e276 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:00.604907 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0ac14b8b-0d45-4bdb-9b04-57b5e535e276 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:00.613040 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0ac14b8b-0d45-4bdb-9b04-57b5e535e276 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1515 microversion: 2.1 time: 0.169046 Jun 20 12:49:00.613654 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3423/6747] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:00 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:01.630669 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d2c60a1d-e9e7-465d-a89d-b60cf9b8b684 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:01.631292 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d2c60a1d-e9e7-465d-a89d-b60cf9b8b684 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:01.639802 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d2c60a1d-e9e7-465d-a89d-b60cf9b8b684 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:01.640300 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d2c60a1d-e9e7-465d-a89d-b60cf9b8b684 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:01.641095 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d2c60a1d-e9e7-465d-a89d-b60cf9b8b684 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:01.641559 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d2c60a1d-e9e7-465d-a89d-b60cf9b8b684 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:01.891730 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d2c60a1d-e9e7-465d-a89d-b60cf9b8b684 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:01.900384 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d2c60a1d-e9e7-465d-a89d-b60cf9b8b684 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1514 microversion: 2.1 time: 0.273542 Jun 20 12:49:01.900983 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3325/6748] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:01 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1514 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:02.139430 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-d2bd8321-65b2-4fae-baf2-3e30a32a4402 req-a8ee7a26-85e6-4983-94e3-ae4e18c0fd07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5eae93a-501d-41b6-a67f-74744f372e73", "name": "network-vif-unplugged", "status": "completed", "tag": "e65aadbf-5d96-477e-9a30-343a0a6e2237"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:49:02.148417 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-d2bd8321-65b2-4fae-baf2-3e30a32a4402 req-a8ee7a26-85e6-4983-94e3-ae4e18c0fd07 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:02.149199 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-d2bd8321-65b2-4fae-baf2-3e30a32a4402 req-a8ee7a26-85e6-4983-94e3-ae4e18c0fd07 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:02.163550 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-d2bd8321-65b2-4fae-baf2-3e30a32a4402 req-a8ee7a26-85e6-4983-94e3-ae4e18c0fd07 service nova] Creating event network-vif-unplugged:e65aadbf-5d96-477e-9a30-343a0a6e2237 for instance e5eae93a-501d-41b6-a67f-74744f372e73 on n-h2-master-1 Jun 20 12:49:02.170340 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [req-d2bd8321-65b2-4fae-baf2-3e30a32a4402 req-a8ee7a26-85e6-4983-94e3-ae4e18c0fd07 service nova] Instance e5eae93a-501d-41b6-a67f-74744f372e73 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119127) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:49:02.183056 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-d2bd8321-65b2-4fae-baf2-3e30a32a4402 req-a8ee7a26-85e6-4983-94e3-ae4e18c0fd07 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.120199 Jun 20 12:49:02.183969 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3424/6749] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:49:02.919069 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-52a74aa3-6fb4-4d14-8890-31f8e8273103 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:02.920543 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-52a74aa3-6fb4-4d14-8890-31f8e8273103 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:02.929153 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-52a74aa3-6fb4-4d14-8890-31f8e8273103 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:02.929939 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-52a74aa3-6fb4-4d14-8890-31f8e8273103 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:02.930949 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-52a74aa3-6fb4-4d14-8890-31f8e8273103 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:02.931398 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-52a74aa3-6fb4-4d14-8890-31f8e8273103 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:03.078805 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-52a74aa3-6fb4-4d14-8890-31f8e8273103 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:03.087298 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-52a74aa3-6fb4-4d14-8890-31f8e8273103 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1514 microversion: 2.1 time: 0.172488 Jun 20 12:49:03.087887 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3326/6750] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:02 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:04.111007 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6fbdd56a-9410-4ce4-bd91-452958dc091a tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:04.111874 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6fbdd56a-9410-4ce4-bd91-452958dc091a tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:04.121512 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6fbdd56a-9410-4ce4-bd91-452958dc091a tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:04.122143 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6fbdd56a-9410-4ce4-bd91-452958dc091a tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:04.123262 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6fbdd56a-9410-4ce4-bd91-452958dc091a tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:04.123894 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6fbdd56a-9410-4ce4-bd91-452958dc091a tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:04.205992 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-b349f0f6-5507-4035-8512-52b55ab9b46a req-b262bd2a-2bfd-495c-aec7-6bc91b3de2bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5eae93a-501d-41b6-a67f-74744f372e73", "tag": "e65aadbf-5d96-477e-9a30-343a0a6e2237"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:49:04.216515 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-b349f0f6-5507-4035-8512-52b55ab9b46a req-b262bd2a-2bfd-495c-aec7-6bc91b3de2bf service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:04.217229 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-b349f0f6-5507-4035-8512-52b55ab9b46a req-b262bd2a-2bfd-495c-aec7-6bc91b3de2bf service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:04.230653 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-b349f0f6-5507-4035-8512-52b55ab9b46a req-b262bd2a-2bfd-495c-aec7-6bc91b3de2bf service nova] Creating event network-changed:e65aadbf-5d96-477e-9a30-343a0a6e2237 for instance e5eae93a-501d-41b6-a67f-74744f372e73 on n-h2-master-1 Jun 20 12:49:04.236417 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [req-b349f0f6-5507-4035-8512-52b55ab9b46a req-b262bd2a-2bfd-495c-aec7-6bc91b3de2bf service nova] Instance e5eae93a-501d-41b6-a67f-74744f372e73 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:49:04.249159 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-b349f0f6-5507-4035-8512-52b55ab9b46a req-b262bd2a-2bfd-495c-aec7-6bc91b3de2bf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047590 Jun 20 12:49:04.249763 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3327/6751] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:49:04.267813 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6fbdd56a-9410-4ce4-bd91-452958dc091a tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:04.275799 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6fbdd56a-9410-4ce4-bd91-452958dc091a tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1512 microversion: 2.1 time: 0.173935 Jun 20 12:49:04.276419 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3425/6752] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:04 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1512 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:05.296001 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5ff9eb73-6d41-4c04-95e3-9a1627a90677 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:05.296783 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5ff9eb73-6d41-4c04-95e3-9a1627a90677 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:05.304271 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5ff9eb73-6d41-4c04-95e3-9a1627a90677 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:05.305052 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5ff9eb73-6d41-4c04-95e3-9a1627a90677 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:05.305997 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5ff9eb73-6d41-4c04-95e3-9a1627a90677 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:05.306469 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5ff9eb73-6d41-4c04-95e3-9a1627a90677 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:05.454333 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5ff9eb73-6d41-4c04-95e3-9a1627a90677 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:05.463093 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5ff9eb73-6d41-4c04-95e3-9a1627a90677 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1512 microversion: 2.1 time: 0.172504 Jun 20 12:49:05.463711 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3328/6753] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:05 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1512 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:06.481215 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fa4d25f5-3eea-46b9-a0bc-519db38589a3 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:06.481815 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fa4d25f5-3eea-46b9-a0bc-519db38589a3 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:06.489548 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fa4d25f5-3eea-46b9-a0bc-519db38589a3 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:06.490006 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fa4d25f5-3eea-46b9-a0bc-519db38589a3 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:06.490774 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fa4d25f5-3eea-46b9-a0bc-519db38589a3 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:06.491212 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fa4d25f5-3eea-46b9-a0bc-519db38589a3 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:06.631431 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fa4d25f5-3eea-46b9-a0bc-519db38589a3 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:06.639703 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fa4d25f5-3eea-46b9-a0bc-519db38589a3 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1509 microversion: 2.1 time: 0.162405 Jun 20 12:49:06.640361 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3426/6754] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:06 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:06.657061 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-622ea43a-eead-4412-a729-6a4764c11f99 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:06.657770 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-622ea43a-eead-4412-a729-6a4764c11f99 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:06.665247 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-622ea43a-eead-4412-a729-6a4764c11f99 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:06.665715 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-622ea43a-eead-4412-a729-6a4764c11f99 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:06.666502 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-622ea43a-eead-4412-a729-6a4764c11f99 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:06.666952 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-622ea43a-eead-4412-a729-6a4764c11f99 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:06.694460 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-622ea43a-eead-4412-a729-6a4764c11f99 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:49:06.748267 n-d-master-1 devstack@n-api.service[119128]: INFO nova.compute.api [None req-622ea43a-eead-4412-a729-6a4764c11f99 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Found an unconfirmed migration during delete, id: 16, status: finished Jun 20 12:49:08.248873 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-7c29e12e-825e-4220-9056-74ece1742e0a req-792a6044-1ce7-494f-9ed1-d839d2d502d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5eae93a-501d-41b6-a67f-74744f372e73", "name": "network-vif-plugged", "status": "completed", "tag": "e65aadbf-5d96-477e-9a30-343a0a6e2237"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:49:08.260540 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-7c29e12e-825e-4220-9056-74ece1742e0a req-792a6044-1ce7-494f-9ed1-d839d2d502d4 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:08.261234 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-7c29e12e-825e-4220-9056-74ece1742e0a req-792a6044-1ce7-494f-9ed1-d839d2d502d4 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:08.274701 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-7c29e12e-825e-4220-9056-74ece1742e0a req-792a6044-1ce7-494f-9ed1-d839d2d502d4 service nova] Creating event network-vif-plugged:e65aadbf-5d96-477e-9a30-343a0a6e2237 for instance e5eae93a-501d-41b6-a67f-74744f372e73 on n-h2-master-1 Jun 20 12:49:08.279838 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-7c29e12e-825e-4220-9056-74ece1742e0a req-792a6044-1ce7-494f-9ed1-d839d2d502d4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035360 Jun 20 12:49:08.281060 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3427/6755] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:49:08.288552 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-622ea43a-eead-4412-a729-6a4764c11f99 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 204 len: 0 microversion: 2.1 time: 1.635104 Jun 20 12:49:08.289357 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3329/6756] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:49:06 2022] DELETE /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 0 bytes in 1637 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:49:08.298597 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8e42f439-b42d-44ac-b8b3-39a4f0398ea0 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:08.299457 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8e42f439-b42d-44ac-b8b3-39a4f0398ea0 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:08.306748 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8e42f439-b42d-44ac-b8b3-39a4f0398ea0 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:08.307424 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8e42f439-b42d-44ac-b8b3-39a4f0398ea0 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:08.315425 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8e42f439-b42d-44ac-b8b3-39a4f0398ea0 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:08.315425 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8e42f439-b42d-44ac-b8b3-39a4f0398ea0 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:08.449937 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8e42f439-b42d-44ac-b8b3-39a4f0398ea0 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:08.462242 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8e42f439-b42d-44ac-b8b3-39a4f0398ea0 tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1501 microversion: 2.1 time: 0.167969 Jun 20 12:49:08.462925 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3428/6757] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:08 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1501 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:49:09.487417 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-57a4874a-7fef-48fc-b15d-8d1566ce1efe tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:09.488493 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-57a4874a-7fef-48fc-b15d-8d1566ce1efe tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:09.496227 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-57a4874a-7fef-48fc-b15d-8d1566ce1efe tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:09.496726 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-57a4874a-7fef-48fc-b15d-8d1566ce1efe tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:09.497519 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-57a4874a-7fef-48fc-b15d-8d1566ce1efe tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:09.497978 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-57a4874a-7fef-48fc-b15d-8d1566ce1efe tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:09.643906 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-57a4874a-7fef-48fc-b15d-8d1566ce1efe tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afab9d8d42a04462b162392ce5f01fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11635e4c3ead4b7fb19bb6139eda0cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:09.656122 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-57a4874a-7fef-48fc-b15d-8d1566ce1efe tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 200 len: 1501 microversion: 2.1 time: 0.175368 Jun 20 12:49:09.657049 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3330/6758] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:09 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 1501 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:10.339322 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-0d0b08d1-2af8-4f4f-9fe6-6f19d5f2870c req-74c631db-b52e-4c03-8c7f-fb13f7c83e44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5eae93a-501d-41b6-a67f-74744f372e73", "name": "network-vif-deleted", "tag": "e65aadbf-5d96-477e-9a30-343a0a6e2237"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:49:10.349449 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-0d0b08d1-2af8-4f4f-9fe6-6f19d5f2870c req-74c631db-b52e-4c03-8c7f-fb13f7c83e44 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:10.350103 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-0d0b08d1-2af8-4f4f-9fe6-6f19d5f2870c req-74c631db-b52e-4c03-8c7f-fb13f7c83e44 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:10.368419 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-0d0b08d1-2af8-4f4f-9fe6-6f19d5f2870c req-74c631db-b52e-4c03-8c7f-fb13f7c83e44 service nova] Creating event network-vif-deleted:e65aadbf-5d96-477e-9a30-343a0a6e2237 for instance e5eae93a-501d-41b6-a67f-74744f372e73 on n-h2-master-1 Jun 20 12:49:10.375060 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-0d0b08d1-2af8-4f4f-9fe6-6f19d5f2870c req-74c631db-b52e-4c03-8c7f-fb13f7c83e44 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039585 Jun 20 12:49:10.378892 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3429/6759] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:49:10.675118 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-eb213b3a-a434-4895-ae1a-8fddf496375a tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:10.675808 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-eb213b3a-a434-4895-ae1a-8fddf496375a tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:10.684150 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eb213b3a-a434-4895-ae1a-8fddf496375a tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:10.684650 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eb213b3a-a434-4895-ae1a-8fddf496375a tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:10.685433 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eb213b3a-a434-4895-ae1a-8fddf496375a tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:10.685890 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eb213b3a-a434-4895-ae1a-8fddf496375a tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:10.700154 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-eb213b3a-a434-4895-ae1a-8fddf496375a tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] HTTP exception thrown: Instance e5eae93a-501d-41b6-a67f-74744f372e73 could not be found. Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-eb213b3a-a434-4895-ae1a-8fddf496375a tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Request method failure captured: Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 HTTP/1.1 Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGyPo2wnHneVQ5DiNk2XAcf1mXVGIRLoILuYjoX73P9ItGNCbkc472KIJdQNCfAyz6WftcVNgdmrJlx9T2I1Gyh14pNcsY-QwmVXVECUMSqG32Jn8bbZ8S3EicqSKGKKXbKZy9F0--1lqi3hQ1kSI4LGkpH6pqxQRigB2L33CqTfyRA Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 11635e4c3ead4b7fb19bb6139eda0cd8 Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-DeleteServersTestJSON-1353094307 Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/11635e4c3ead4b7fb19bb6139eda0cd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/11635e4c3ead4b7fb19bb6139eda0cd8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/11635e4c3ead4b7fb19bb6139eda0cd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_11635e4c3ead4b7fb19bb6139eda0cd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-DeleteServersTestJSON-1353094307 Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 11635e4c3ead4b7fb19bb6139eda0cd8 Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-DeleteServersTestJSON-1353094307 Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-DeleteServersTestJSON-1353094307-project Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: afab9d8d42a04462b162392ce5f01fb5 Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-DeleteServersTestJSON-1353094307-project Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: exception: Instance e5eae93a-501d-41b6-a67f-74744f372e73 could not be found. Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'e5eae93a-501d-41b6-a67f-74744f372e73'} Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5eae93a-501d-41b6-a67f-74744f372e73 could not be found. Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5eae93a-501d-41b6-a67f-74744f372e73 could not be found. Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:49:10.701895 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:49:10.707608 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:49:10.707608 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:49:10.707608 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:49:10.707608 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:49:10.707608 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:49:10.707608 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5eae93a-501d-41b6-a67f-74744f372e73 could not be found. Jun 20 12:49:10.707608 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:49:10.707608 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-eb213b3a-a434-4895-ae1a-8fddf496375a tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Returning 404 to user: Instance e5eae93a-501d-41b6-a67f-74744f372e73 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:49:10.707608 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-eb213b3a-a434-4895-ae1a-8fddf496375a tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 404 len: 111 microversion: 2.1 time: 0.032174 Jun 20 12:49:10.707608 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3331/6760] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:10 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:49:10.721302 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7e399da0-04a4-43ba-816c-7a61bf9bbc0b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:10.721899 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7e399da0-04a4-43ba-816c-7a61bf9bbc0b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:10.729288 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7e399da0-04a4-43ba-816c-7a61bf9bbc0b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:10.729824 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7e399da0-04a4-43ba-816c-7a61bf9bbc0b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:10.730518 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7e399da0-04a4-43ba-816c-7a61bf9bbc0b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:10.730961 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7e399da0-04a4-43ba-816c-7a61bf9bbc0b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:10.748218 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-7e399da0-04a4-43ba-816c-7a61bf9bbc0b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] HTTP exception thrown: Instance e5eae93a-501d-41b6-a67f-74744f372e73 could not be found. Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7e399da0-04a4-43ba-816c-7a61bf9bbc0b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Request method failure captured: Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 HTTP/1.1 Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGyPo2wnHneVQ5DiNk2XAcf1mXVGIRLoILuYjoX73P9ItGNCbkc472KIJdQNCfAyz6WftcVNgdmrJlx9T2I1Gyh14pNcsY-QwmVXVECUMSqG32Jn8bbZ8S3EicqSKGKKXbKZy9F0--1lqi3hQ1kSI4LGkpH6pqxQRigB2L33CqTfyRA Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 11635e4c3ead4b7fb19bb6139eda0cd8 Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-DeleteServersTestJSON-1353094307 Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/11635e4c3ead4b7fb19bb6139eda0cd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/11635e4c3ead4b7fb19bb6139eda0cd8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/11635e4c3ead4b7fb19bb6139eda0cd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_11635e4c3ead4b7fb19bb6139eda0cd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-DeleteServersTestJSON-1353094307 Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 11635e4c3ead4b7fb19bb6139eda0cd8 Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-DeleteServersTestJSON-1353094307 Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-DeleteServersTestJSON-1353094307-project Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: afab9d8d42a04462b162392ce5f01fb5 Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-DeleteServersTestJSON-1353094307-project Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: exception: Instance e5eae93a-501d-41b6-a67f-74744f372e73 could not be found. Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'e5eae93a-501d-41b6-a67f-74744f372e73'} Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5eae93a-501d-41b6-a67f-74744f372e73 could not be found. Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:49:10.749917 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:49:10.755120 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5eae93a-501d-41b6-a67f-74744f372e73 could not be found. Jun 20 12:49:10.755120 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:49:10.755120 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:49:10.755120 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:49:10.755120 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:49:10.755120 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:49:10.755120 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:49:10.755120 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:49:10.755120 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:49:10.755120 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5eae93a-501d-41b6-a67f-74744f372e73 could not be found. Jun 20 12:49:10.755120 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:49:10.755120 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7e399da0-04a4-43ba-816c-7a61bf9bbc0b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Returning 404 to user: Instance e5eae93a-501d-41b6-a67f-74744f372e73 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:49:10.755120 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7e399da0-04a4-43ba-816c-7a61bf9bbc0b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 404 len: 111 microversion: 2.1 time: 0.034608 Jun 20 12:49:10.755120 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3430/6761] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:49:10 2022] DELETE /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:49:10.760479 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5846a30e-c838-4053-b90c-2cbb41e9824b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:10.761112 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5846a30e-c838-4053-b90c-2cbb41e9824b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] [instance: e5eae93a-501d-41b6-a67f-74744f372e73] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:10.767231 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5846a30e-c838-4053-b90c-2cbb41e9824b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:10.767695 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5846a30e-c838-4053-b90c-2cbb41e9824b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:10.768503 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5846a30e-c838-4053-b90c-2cbb41e9824b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:10.768954 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5846a30e-c838-4053-b90c-2cbb41e9824b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:10.783300 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-5846a30e-c838-4053-b90c-2cbb41e9824b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] HTTP exception thrown: Instance e5eae93a-501d-41b6-a67f-74744f372e73 could not be found. Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5846a30e-c838-4053-b90c-2cbb41e9824b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Request method failure captured: Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 HTTP/1.1 Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGyPo2wnHneVQ5DiNk2XAcf1mXVGIRLoILuYjoX73P9ItGNCbkc472KIJdQNCfAyz6WftcVNgdmrJlx9T2I1Gyh14pNcsY-QwmVXVECUMSqG32Jn8bbZ8S3EicqSKGKKXbKZy9F0--1lqi3hQ1kSI4LGkpH6pqxQRigB2L33CqTfyRA Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 11635e4c3ead4b7fb19bb6139eda0cd8 Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-DeleteServersTestJSON-1353094307 Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/11635e4c3ead4b7fb19bb6139eda0cd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/11635e4c3ead4b7fb19bb6139eda0cd8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/11635e4c3ead4b7fb19bb6139eda0cd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_11635e4c3ead4b7fb19bb6139eda0cd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-DeleteServersTestJSON-1353094307 Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 11635e4c3ead4b7fb19bb6139eda0cd8 Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-DeleteServersTestJSON-1353094307 Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-DeleteServersTestJSON-1353094307-project Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: afab9d8d42a04462b162392ce5f01fb5 Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-DeleteServersTestJSON-1353094307-project Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: exception: Instance e5eae93a-501d-41b6-a67f-74744f372e73 could not be found. Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'e5eae93a-501d-41b6-a67f-74744f372e73'} Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5eae93a-501d-41b6-a67f-74744f372e73 could not be found. Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5eae93a-501d-41b6-a67f-74744f372e73 could not be found. Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:49:10.784889 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:49:10.790514 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:49:10.790514 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:49:10.790514 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:49:10.790514 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:49:10.790514 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:49:10.790514 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5eae93a-501d-41b6-a67f-74744f372e73 could not be found. Jun 20 12:49:10.790514 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:49:10.790514 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5846a30e-c838-4053-b90c-2cbb41e9824b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] Returning 404 to user: Instance e5eae93a-501d-41b6-a67f-74744f372e73 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:49:10.790514 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5846a30e-c838-4053-b90c-2cbb41e9824b tempest-DeleteServersTestJSON-1353094307 tempest-DeleteServersTestJSON-1353094307-project] 10.222.0.27 "GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73" status: 404 len: 111 microversion: 2.1 time: 0.030246 Jun 20 12:49:10.791295 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3332/6762] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:10 2022] GET /compute/v2.1/servers/e5eae93a-501d-41b6-a67f-74744f372e73 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:49:19.438147 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c48fa1c0-12aa-4afb-b374-a311e15155f5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1945504138", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "a5f9d43a-e6ee-4369-b1fe-aa1398a39944"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:49:19.496065 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-c48fa1c0-12aa-4afb-b374-a311e15155f5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] validate_networks() for [('a5f9d43a-e6ee-4369-b1fe-aa1398a39944', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:49:19.926466 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-c48fa1c0-12aa-4afb-b374-a311e15155f5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:49:19.926907 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-c48fa1c0-12aa-4afb-b374-a311e15155f5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:49:19.927476 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-c48fa1c0-12aa-4afb-b374-a311e15155f5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:49:19.927978 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-c48fa1c0-12aa-4afb-b374-a311e15155f5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:49:19.928831 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-c48fa1c0-12aa-4afb-b374-a311e15155f5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:49:19.954189 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c48fa1c0-12aa-4afb-b374-a311e15155f5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:19.954706 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c48fa1c0-12aa-4afb-b374-a311e15155f5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:19.955625 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c48fa1c0-12aa-4afb-b374-a311e15155f5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:19.956088 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c48fa1c0-12aa-4afb-b374-a311e15155f5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:19.977131 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-c48fa1c0-12aa-4afb-b374-a311e15155f5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Getting quotas for project ec6dbb696cbc4887b7b79172d7d08ecb. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:49:19.983021 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-c48fa1c0-12aa-4afb-b374-a311e15155f5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Getting quotas for user 120cb878f5ce46999ccda36294b94a69 and project ec6dbb696cbc4887b7b79172d7d08ecb. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:49:19.997108 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c48fa1c0-12aa-4afb-b374-a311e15155f5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:49:19.999416 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c48fa1c0-12aa-4afb-b374-a311e15155f5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:49:20.047134 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c48fa1c0-12aa-4afb-b374-a311e15155f5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.733689 Jun 20 12:49:20.047710 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3431/6763] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:49:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:49:20.058522 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-43b6b9df-a048-4b04-aefb-4b669445f49e tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:20.059808 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-43b6b9df-a048-4b04-aefb-4b669445f49e tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:20.497805 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-43b6b9df-a048-4b04-aefb-4b669445f49e tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:20.505034 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-43b6b9df-a048-4b04-aefb-4b669445f49e tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1218 microversion: 2.1 time: 0.450910 Jun 20 12:49:20.505609 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3333/6764] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:20 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1218 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:21.525577 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1933b18a-11d6-4ffa-ab7c-01616a7747e8 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:21.526298 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1933b18a-11d6-4ffa-ab7c-01616a7747e8 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:21.540165 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1933b18a-11d6-4ffa-ab7c-01616a7747e8 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:21.542088 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1933b18a-11d6-4ffa-ab7c-01616a7747e8 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:21.544178 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1933b18a-11d6-4ffa-ab7c-01616a7747e8 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:21.545481 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1933b18a-11d6-4ffa-ab7c-01616a7747e8 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:21.635278 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1933b18a-11d6-4ffa-ab7c-01616a7747e8 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:21.649300 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1933b18a-11d6-4ffa-ab7c-01616a7747e8 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1276 microversion: 2.1 time: 0.130709 Jun 20 12:49:21.650416 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3432/6765] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:21 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1276 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:22.666760 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e3c88f7d-ffe9-4b47-b7b8-422fcf8ccb30 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:22.667476 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e3c88f7d-ffe9-4b47-b7b8-422fcf8ccb30 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:22.683262 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:49:22.689122 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e3c88f7d-ffe9-4b47-b7b8-422fcf8ccb30 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:22.689959 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e3c88f7d-ffe9-4b47-b7b8-422fcf8ccb30 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:22.692882 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e3c88f7d-ffe9-4b47-b7b8-422fcf8ccb30 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:22.700997 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e3c88f7d-ffe9-4b47-b7b8-422fcf8ccb30 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:22.717571 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-4850b72a-e3c4-4591-8235-eb77d763b112 req-47ce90c9-0da0-4c93-950c-1b478606bb9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea1bd972-38e3-40fb-96b9-12089853770b", "tag": "04d0258d-13b9-4935-9c90-233b99e2195f"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:49:22.731355 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-4850b72a-e3c4-4591-8235-eb77d763b112 req-47ce90c9-0da0-4c93-950c-1b478606bb9a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:22.732705 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-4850b72a-e3c4-4591-8235-eb77d763b112 req-47ce90c9-0da0-4c93-950c-1b478606bb9a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:22.749843 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-4850b72a-e3c4-4591-8235-eb77d763b112 req-47ce90c9-0da0-4c93-950c-1b478606bb9a service nova] Creating event network-changed:04d0258d-13b9-4935-9c90-233b99e2195f for instance ea1bd972-38e3-40fb-96b9-12089853770b on n-h2-master-1 Jun 20 12:49:22.756411 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-4850b72a-e3c4-4591-8235-eb77d763b112 req-47ce90c9-0da0-4c93-950c-1b478606bb9a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043715 Jun 20 12:49:22.758236 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3433/6766] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:49:23.044580 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e3c88f7d-ffe9-4b47-b7b8-422fcf8ccb30 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:23.055263 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e3c88f7d-ffe9-4b47-b7b8-422fcf8ccb30 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1318 microversion: 2.1 time: 0.392218 Jun 20 12:49:23.068389 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3334/6767] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:22 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1318 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:24.075459 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-345763c4-9fb3-4113-8f13-1095d8c79feb tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:24.076183 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-345763c4-9fb3-4113-8f13-1095d8c79feb tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:24.083014 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-345763c4-9fb3-4113-8f13-1095d8c79feb tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:24.083467 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-345763c4-9fb3-4113-8f13-1095d8c79feb tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:24.084625 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-345763c4-9fb3-4113-8f13-1095d8c79feb tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:24.085142 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-345763c4-9fb3-4113-8f13-1095d8c79feb tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:24.230463 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-345763c4-9fb3-4113-8f13-1095d8c79feb tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:24.238165 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-345763c4-9fb3-4113-8f13-1095d8c79feb tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1318 microversion: 2.1 time: 0.168438 Jun 20 12:49:24.238747 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3434/6768] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:24 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:25.255341 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e31747a6-e23d-4674-8ff4-40793797e561 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:25.255955 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e31747a6-e23d-4674-8ff4-40793797e561 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:25.263726 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e31747a6-e23d-4674-8ff4-40793797e561 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:25.264180 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e31747a6-e23d-4674-8ff4-40793797e561 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:25.265054 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e31747a6-e23d-4674-8ff4-40793797e561 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:25.265605 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e31747a6-e23d-4674-8ff4-40793797e561 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:25.497366 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e31747a6-e23d-4674-8ff4-40793797e561 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:25.505481 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e31747a6-e23d-4674-8ff4-40793797e561 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1318 microversion: 2.1 time: 0.254114 Jun 20 12:49:25.506284 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3335/6769] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:25 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:26.523627 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-57037219-4306-4af8-ba74-3d585d3ca5d2 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:26.524332 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-57037219-4306-4af8-ba74-3d585d3ca5d2 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:26.531722 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57037219-4306-4af8-ba74-3d585d3ca5d2 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:26.532176 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57037219-4306-4af8-ba74-3d585d3ca5d2 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:26.532988 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57037219-4306-4af8-ba74-3d585d3ca5d2 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:26.533430 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57037219-4306-4af8-ba74-3d585d3ca5d2 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:26.674104 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-57037219-4306-4af8-ba74-3d585d3ca5d2 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:26.682524 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-57037219-4306-4af8-ba74-3d585d3ca5d2 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1318 microversion: 2.1 time: 0.163164 Jun 20 12:49:26.683117 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3435/6770] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:26 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:27.699932 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f5dc4f47-a307-4cdb-880a-47d27ed56dda tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:27.700610 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f5dc4f47-a307-4cdb-880a-47d27ed56dda tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:27.703587 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:49:27.709293 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f5dc4f47-a307-4cdb-880a-47d27ed56dda tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:27.709977 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f5dc4f47-a307-4cdb-880a-47d27ed56dda tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:27.710715 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f5dc4f47-a307-4cdb-880a-47d27ed56dda tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:27.711160 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f5dc4f47-a307-4cdb-880a-47d27ed56dda tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:27.846579 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f5dc4f47-a307-4cdb-880a-47d27ed56dda tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:27.856965 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f5dc4f47-a307-4cdb-880a-47d27ed56dda tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1318 microversion: 2.1 time: 0.160947 Jun 20 12:49:27.857626 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3336/6771] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:27 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:28.336174 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-7e32302f-64a5-458e-b020-6d8cf36af062 req-d504a245-d11b-4380-9ee1-5bf477fbc3e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1bd972-38e3-40fb-96b9-12089853770b", "name": "network-vif-plugged", "status": "completed", "tag": "04d0258d-13b9-4935-9c90-233b99e2195f"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:49:28.341031 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:49:28.347092 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-7e32302f-64a5-458e-b020-6d8cf36af062 req-d504a245-d11b-4380-9ee1-5bf477fbc3e9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:28.347538 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-7e32302f-64a5-458e-b020-6d8cf36af062 req-d504a245-d11b-4380-9ee1-5bf477fbc3e9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:28.352331 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=62 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:49:28.360780 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-7e32302f-64a5-458e-b020-6d8cf36af062 req-d504a245-d11b-4380-9ee1-5bf477fbc3e9 service nova] Creating event network-vif-plugged:04d0258d-13b9-4935-9c90-233b99e2195f for instance ea1bd972-38e3-40fb-96b9-12089853770b on n-h2-master-1 Jun 20 12:49:28.365791 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-7e32302f-64a5-458e-b020-6d8cf36af062 req-d504a245-d11b-4380-9ee1-5bf477fbc3e9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033326 Jun 20 12:49:28.366789 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3436/6772] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:49:28.879087 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0789b814-3851-4ddf-a791-eddfd6a8645b tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:28.879665 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0789b814-3851-4ddf-a791-eddfd6a8645b tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:28.888586 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0789b814-3851-4ddf-a791-eddfd6a8645b tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:28.889287 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0789b814-3851-4ddf-a791-eddfd6a8645b tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:28.890525 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0789b814-3851-4ddf-a791-eddfd6a8645b tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:28.891263 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0789b814-3851-4ddf-a791-eddfd6a8645b tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:29.041964 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0789b814-3851-4ddf-a791-eddfd6a8645b tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:29.049788 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0789b814-3851-4ddf-a791-eddfd6a8645b tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1318 microversion: 2.1 time: 0.177695 Jun 20 12:49:29.050368 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3337/6773] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:28 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:30.065307 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:49:30.066099 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:49:30.070316 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4b97edb6-5e5b-4e90-944e-859609bc4096 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:30.071022 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4b97edb6-5e5b-4e90-944e-859609bc4096 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:30.078493 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4b97edb6-5e5b-4e90-944e-859609bc4096 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:30.078945 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4b97edb6-5e5b-4e90-944e-859609bc4096 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:30.079712 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4b97edb6-5e5b-4e90-944e-859609bc4096 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:30.080149 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4b97edb6-5e5b-4e90-944e-859609bc4096 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:30.228902 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4b97edb6-5e5b-4e90-944e-859609bc4096 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:30.239789 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4b97edb6-5e5b-4e90-944e-859609bc4096 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1508 microversion: 2.1 time: 0.176057 Jun 20 12:49:30.240577 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3437/6774] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:30 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1508 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:30.256608 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e48265da-d4a3-4404-adca-573fefe0d75c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:30.257561 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e48265da-d4a3-4404-adca-573fefe0d75c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:30.264948 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e48265da-d4a3-4404-adca-573fefe0d75c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:30.265410 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e48265da-d4a3-4404-adca-573fefe0d75c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:30.266223 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e48265da-d4a3-4404-adca-573fefe0d75c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:30.266615 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e48265da-d4a3-4404-adca-573fefe0d75c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:30.419936 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e48265da-d4a3-4404-adca-573fefe0d75c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:30.427785 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e48265da-d4a3-4404-adca-573fefe0d75c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1508 microversion: 2.1 time: 0.175170 Jun 20 12:49:30.428355 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3338/6775] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:30 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1508 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:30.444188 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-23726944-4dee-40ac-b46f-ab5bc89f289d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:49:30.445408 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-23726944-4dee-40ac-b46f-ab5bc89f289d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:30.451670 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-23726944-4dee-40ac-b46f-ab5bc89f289d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:30.452117 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-23726944-4dee-40ac-b46f-ab5bc89f289d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:30.452900 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-23726944-4dee-40ac-b46f-ab5bc89f289d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:30.453332 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-23726944-4dee-40ac-b46f-ab5bc89f289d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:30.538258 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-23726944-4dee-40ac-b46f-ab5bc89f289d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "PUT /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1080 microversion: 2.1 time: 0.097798 Jun 20 12:49:30.538869 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3438/6776] 10.222.0.27 () {60 vars in 1255 bytes} [Mon Jun 20 12:49:30 2022] PUT /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1080 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:30.552560 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b5390d9e-bb5d-4543-b3c1-14ea15659f60 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:30.553403 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b5390d9e-bb5d-4543-b3c1-14ea15659f60 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:30.556011 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:49:30.561890 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b5390d9e-bb5d-4543-b3c1-14ea15659f60 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:30.562357 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b5390d9e-bb5d-4543-b3c1-14ea15659f60 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:30.563135 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b5390d9e-bb5d-4543-b3c1-14ea15659f60 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:30.563703 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b5390d9e-bb5d-4543-b3c1-14ea15659f60 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:30.711873 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b5390d9e-bb5d-4543-b3c1-14ea15659f60 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:30.720075 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b5390d9e-bb5d-4543-b3c1-14ea15659f60 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1506 microversion: 2.1 time: 0.171422 Jun 20 12:49:30.720688 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3339/6777] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:30 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:30.735837 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2c0e7c73-80f0-463c-aaef-9a731786efd5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:30.736471 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2c0e7c73-80f0-463c-aaef-9a731786efd5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:30.743575 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2c0e7c73-80f0-463c-aaef-9a731786efd5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:30.744033 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2c0e7c73-80f0-463c-aaef-9a731786efd5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:30.744825 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2c0e7c73-80f0-463c-aaef-9a731786efd5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:30.745257 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2c0e7c73-80f0-463c-aaef-9a731786efd5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:30.890937 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2c0e7c73-80f0-463c-aaef-9a731786efd5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:30.898867 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2c0e7c73-80f0-463c-aaef-9a731786efd5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1506 microversion: 2.1 time: 0.166927 Jun 20 12:49:30.899459 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3439/6778] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:30 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:49:30.915966 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-02ff8d68-078c-4d97-ab39-0d57607c3e37 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:49:30.917168 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-02ff8d68-078c-4d97-ab39-0d57607c3e37 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:30.923948 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-02ff8d68-078c-4d97-ab39-0d57607c3e37 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:30.924441 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-02ff8d68-078c-4d97-ab39-0d57607c3e37 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:30.925259 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-02ff8d68-078c-4d97-ab39-0d57607c3e37 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:30.925705 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-02ff8d68-078c-4d97-ab39-0d57607c3e37 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:30.954801 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-02ff8d68-078c-4d97-ab39-0d57607c3e37 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:30.961516 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-02ff8d68-078c-4d97-ab39-0d57607c3e37 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Old instance type m1.heat2, new instance type m1.heat {{(pid=119128) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 20 12:49:30.968055 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-02ff8d68-078c-4d97-ab39-0d57607c3e37 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:49:30.968513 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-02ff8d68-078c-4d97-ab39-0d57607c3e37 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:49:30.968998 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-02ff8d68-078c-4d97-ab39-0d57607c3e37 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:49:30.969420 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-02ff8d68-078c-4d97-ab39-0d57607c3e37 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:49:30.969844 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-02ff8d68-078c-4d97-ab39-0d57607c3e37 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:49:31.037351 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-02ff8d68-078c-4d97-ab39-0d57607c3e37 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "POST /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b/action" status: 202 len: 0 microversion: 2.1 time: 0.125545 Jun 20 12:49:31.038057 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3340/6779] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:49:30 2022] POST /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:49:31.046313 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5b846d6b-dc02-4599-81f9-14e41d7d5d2d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:31.046919 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5b846d6b-dc02-4599-81f9-14e41d7d5d2d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:31.053155 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b846d6b-dc02-4599-81f9-14e41d7d5d2d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:31.053785 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b846d6b-dc02-4599-81f9-14e41d7d5d2d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:31.054680 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b846d6b-dc02-4599-81f9-14e41d7d5d2d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:31.055498 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b846d6b-dc02-4599-81f9-14e41d7d5d2d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:31.200328 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5b846d6b-dc02-4599-81f9-14e41d7d5d2d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:31.208628 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5b846d6b-dc02-4599-81f9-14e41d7d5d2d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1517 microversion: 2.1 time: 0.166112 Jun 20 12:49:31.209247 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3440/6780] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:31 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:32.226826 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2e73ce77-279f-4ed3-a126-2e5626e8619c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:32.227393 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2e73ce77-279f-4ed3-a126-2e5626e8619c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:32.234736 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2e73ce77-279f-4ed3-a126-2e5626e8619c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:32.235171 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2e73ce77-279f-4ed3-a126-2e5626e8619c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:32.236157 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2e73ce77-279f-4ed3-a126-2e5626e8619c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:32.236639 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2e73ce77-279f-4ed3-a126-2e5626e8619c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:32.392189 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2e73ce77-279f-4ed3-a126-2e5626e8619c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:32.402501 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2e73ce77-279f-4ed3-a126-2e5626e8619c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1517 microversion: 2.1 time: 0.178986 Jun 20 12:49:32.403880 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3341/6781] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:32 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1517 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:33.423548 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-25a587fc-a83f-487d-a139-059044cb4bcb tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:33.424337 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-25a587fc-a83f-487d-a139-059044cb4bcb tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:33.433345 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-25a587fc-a83f-487d-a139-059044cb4bcb tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:33.433802 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-25a587fc-a83f-487d-a139-059044cb4bcb tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:33.434569 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-25a587fc-a83f-487d-a139-059044cb4bcb tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:33.435007 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-25a587fc-a83f-487d-a139-059044cb4bcb tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:33.585440 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-25a587fc-a83f-487d-a139-059044cb4bcb tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:33.593449 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-25a587fc-a83f-487d-a139-059044cb4bcb tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1522 microversion: 2.1 time: 0.175299 Jun 20 12:49:33.594025 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3441/6782] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:33 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:34.611774 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4ff75036-43ae-4e12-acf5-7fcc8ce3eff5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:34.612448 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4ff75036-43ae-4e12-acf5-7fcc8ce3eff5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:34.620458 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ff75036-43ae-4e12-acf5-7fcc8ce3eff5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:34.620949 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ff75036-43ae-4e12-acf5-7fcc8ce3eff5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:34.621698 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ff75036-43ae-4e12-acf5-7fcc8ce3eff5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:34.622172 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ff75036-43ae-4e12-acf5-7fcc8ce3eff5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:34.767720 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4ff75036-43ae-4e12-acf5-7fcc8ce3eff5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:34.775882 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4ff75036-43ae-4e12-acf5-7fcc8ce3eff5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1522 microversion: 2.1 time: 0.168283 Jun 20 12:49:34.776495 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3342/6783] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:34 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:35.794990 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3f9b5d50-5dfb-44af-ad87-89e0e45e1701 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:35.795580 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3f9b5d50-5dfb-44af-ad87-89e0e45e1701 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:35.802114 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3f9b5d50-5dfb-44af-ad87-89e0e45e1701 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:35.802572 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3f9b5d50-5dfb-44af-ad87-89e0e45e1701 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:35.803346 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3f9b5d50-5dfb-44af-ad87-89e0e45e1701 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:35.803777 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3f9b5d50-5dfb-44af-ad87-89e0e45e1701 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:35.941006 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3f9b5d50-5dfb-44af-ad87-89e0e45e1701 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:35.949700 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3f9b5d50-5dfb-44af-ad87-89e0e45e1701 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1522 microversion: 2.1 time: 0.159828 Jun 20 12:49:35.950304 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3442/6784] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:35 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:36.967426 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5b0442ae-8f09-4c1c-99ec-9a7ff6641f2f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:36.968052 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5b0442ae-8f09-4c1c-99ec-9a7ff6641f2f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:36.975393 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5b0442ae-8f09-4c1c-99ec-9a7ff6641f2f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:36.975878 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5b0442ae-8f09-4c1c-99ec-9a7ff6641f2f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:36.976803 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5b0442ae-8f09-4c1c-99ec-9a7ff6641f2f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:36.977249 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5b0442ae-8f09-4c1c-99ec-9a7ff6641f2f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:37.117429 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5b0442ae-8f09-4c1c-99ec-9a7ff6641f2f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:37.127782 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5b0442ae-8f09-4c1c-99ec-9a7ff6641f2f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1522 microversion: 2.1 time: 0.164095 Jun 20 12:49:37.128704 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3343/6785] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:36 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:38.147147 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d71063de-1260-4218-916b-89c61ec3f714 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:38.147879 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d71063de-1260-4218-916b-89c61ec3f714 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:38.156690 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d71063de-1260-4218-916b-89c61ec3f714 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:38.157223 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d71063de-1260-4218-916b-89c61ec3f714 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:38.158116 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d71063de-1260-4218-916b-89c61ec3f714 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:38.158637 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d71063de-1260-4218-916b-89c61ec3f714 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:38.305316 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d71063de-1260-4218-916b-89c61ec3f714 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:38.313706 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d71063de-1260-4218-916b-89c61ec3f714 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1522 microversion: 2.1 time: 0.171348 Jun 20 12:49:38.314296 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3443/6786] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:38 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:39.334467 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d1c14b8d-5235-4091-830c-6bfd6db93f53 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:39.335208 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d1c14b8d-5235-4091-830c-6bfd6db93f53 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:39.342773 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d1c14b8d-5235-4091-830c-6bfd6db93f53 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:39.343239 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d1c14b8d-5235-4091-830c-6bfd6db93f53 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:39.344019 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d1c14b8d-5235-4091-830c-6bfd6db93f53 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:39.344651 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d1c14b8d-5235-4091-830c-6bfd6db93f53 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:39.494039 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d1c14b8d-5235-4091-830c-6bfd6db93f53 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:39.502337 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d1c14b8d-5235-4091-830c-6bfd6db93f53 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1522 microversion: 2.1 time: 0.174010 Jun 20 12:49:39.503129 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3344/6787] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:39 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:40.523908 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c890a207-0935-456f-b4fb-60e029088e83 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:40.524691 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c890a207-0935-456f-b4fb-60e029088e83 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:40.536729 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c890a207-0935-456f-b4fb-60e029088e83 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:40.537324 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c890a207-0935-456f-b4fb-60e029088e83 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:40.538581 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c890a207-0935-456f-b4fb-60e029088e83 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:40.539130 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c890a207-0935-456f-b4fb-60e029088e83 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:40.686220 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c890a207-0935-456f-b4fb-60e029088e83 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:40.694183 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c890a207-0935-456f-b4fb-60e029088e83 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1522 microversion: 2.1 time: 0.175656 Jun 20 12:49:40.694771 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3444/6788] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:40 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:41.711782 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f12d6f60-7864-486b-899e-146a13b43947 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:41.712421 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f12d6f60-7864-486b-899e-146a13b43947 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:41.719905 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f12d6f60-7864-486b-899e-146a13b43947 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:41.720415 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f12d6f60-7864-486b-899e-146a13b43947 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:41.721163 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f12d6f60-7864-486b-899e-146a13b43947 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:41.721608 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f12d6f60-7864-486b-899e-146a13b43947 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:41.869412 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f12d6f60-7864-486b-899e-146a13b43947 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:41.877382 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f12d6f60-7864-486b-899e-146a13b43947 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1522 microversion: 2.1 time: 0.169572 Jun 20 12:49:41.877918 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3345/6789] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:41 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:42.895314 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cb5be526-c3f0-4fd0-9475-4a7f11e8b599 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:42.895954 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cb5be526-c3f0-4fd0-9475-4a7f11e8b599 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:42.903553 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cb5be526-c3f0-4fd0-9475-4a7f11e8b599 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:42.904010 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cb5be526-c3f0-4fd0-9475-4a7f11e8b599 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:42.904807 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cb5be526-c3f0-4fd0-9475-4a7f11e8b599 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:42.905240 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cb5be526-c3f0-4fd0-9475-4a7f11e8b599 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:43.055459 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cb5be526-c3f0-4fd0-9475-4a7f11e8b599 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:43.063441 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cb5be526-c3f0-4fd0-9475-4a7f11e8b599 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1522 microversion: 2.1 time: 0.172115 Jun 20 12:49:43.064083 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3445/6790] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:42 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:44.081542 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-170667e3-406c-4b03-ae5b-cba3a54b5c1d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:44.082191 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-170667e3-406c-4b03-ae5b-cba3a54b5c1d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:44.089990 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-170667e3-406c-4b03-ae5b-cba3a54b5c1d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:44.090461 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-170667e3-406c-4b03-ae5b-cba3a54b5c1d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:44.091254 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-170667e3-406c-4b03-ae5b-cba3a54b5c1d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:44.091709 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-170667e3-406c-4b03-ae5b-cba3a54b5c1d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:44.231043 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-170667e3-406c-4b03-ae5b-cba3a54b5c1d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:44.239557 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-170667e3-406c-4b03-ae5b-cba3a54b5c1d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1522 microversion: 2.1 time: 0.162038 Jun 20 12:49:44.240132 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3346/6791] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:44 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:45.264950 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7b0b7acb-5217-4f6f-97b2-700faeccd4ab tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:45.266468 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7b0b7acb-5217-4f6f-97b2-700faeccd4ab tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:45.275858 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7b0b7acb-5217-4f6f-97b2-700faeccd4ab tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:45.276343 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7b0b7acb-5217-4f6f-97b2-700faeccd4ab tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:45.277115 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7b0b7acb-5217-4f6f-97b2-700faeccd4ab tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:45.277547 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7b0b7acb-5217-4f6f-97b2-700faeccd4ab tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:45.435315 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7b0b7acb-5217-4f6f-97b2-700faeccd4ab tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:45.443309 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7b0b7acb-5217-4f6f-97b2-700faeccd4ab tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1522 microversion: 2.1 time: 0.183101 Jun 20 12:49:45.443901 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3446/6792] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:45 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:46.460906 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a0eda237-d84a-4091-b54c-d5ad4e63e251 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:46.461753 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a0eda237-d84a-4091-b54c-d5ad4e63e251 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:46.469133 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a0eda237-d84a-4091-b54c-d5ad4e63e251 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:46.469611 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a0eda237-d84a-4091-b54c-d5ad4e63e251 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:46.470410 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a0eda237-d84a-4091-b54c-d5ad4e63e251 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:46.470854 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a0eda237-d84a-4091-b54c-d5ad4e63e251 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:46.620743 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a0eda237-d84a-4091-b54c-d5ad4e63e251 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:46.632943 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a0eda237-d84a-4091-b54c-d5ad4e63e251 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1522 microversion: 2.1 time: 0.176105 Jun 20 12:49:46.633598 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3347/6793] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:46 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:47.652159 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2445b8c9-5179-416b-84b2-62aab40d97bd tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:47.652787 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2445b8c9-5179-416b-84b2-62aab40d97bd tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:47.659840 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2445b8c9-5179-416b-84b2-62aab40d97bd tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:47.660324 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2445b8c9-5179-416b-84b2-62aab40d97bd tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:47.661093 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2445b8c9-5179-416b-84b2-62aab40d97bd tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:47.661529 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2445b8c9-5179-416b-84b2-62aab40d97bd tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:47.795453 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2445b8c9-5179-416b-84b2-62aab40d97bd tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:47.803283 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2445b8c9-5179-416b-84b2-62aab40d97bd tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1522 microversion: 2.1 time: 0.155537 Jun 20 12:49:47.804052 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3447/6794] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:47 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:48.821117 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-69de9e14-3f98-44b2-85e5-40b3e216beff tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:48.821774 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-69de9e14-3f98-44b2-85e5-40b3e216beff tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:48.829113 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-69de9e14-3f98-44b2-85e5-40b3e216beff tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:48.829576 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-69de9e14-3f98-44b2-85e5-40b3e216beff tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:48.830353 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-69de9e14-3f98-44b2-85e5-40b3e216beff tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:48.830799 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-69de9e14-3f98-44b2-85e5-40b3e216beff tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:48.969004 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-69de9e14-3f98-44b2-85e5-40b3e216beff tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:48.977424 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-69de9e14-3f98-44b2-85e5-40b3e216beff tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1522 microversion: 2.1 time: 0.160146 Jun 20 12:49:48.978469 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3348/6795] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:48 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:49.996878 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b227df47-b903-4d9e-b256-aa12fbbbef20 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:49.997647 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b227df47-b903-4d9e-b256-aa12fbbbef20 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:50.005433 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b227df47-b903-4d9e-b256-aa12fbbbef20 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:50.005865 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b227df47-b903-4d9e-b256-aa12fbbbef20 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:50.006632 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b227df47-b903-4d9e-b256-aa12fbbbef20 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:50.007071 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b227df47-b903-4d9e-b256-aa12fbbbef20 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:50.155545 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b227df47-b903-4d9e-b256-aa12fbbbef20 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:50.165376 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b227df47-b903-4d9e-b256-aa12fbbbef20 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1522 microversion: 2.1 time: 0.172776 Jun 20 12:49:50.166001 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3448/6796] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:49 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:51.183562 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-46d5e21d-c954-41ff-8be4-0b307acc8c0c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:51.184189 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-46d5e21d-c954-41ff-8be4-0b307acc8c0c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:51.191419 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-46d5e21d-c954-41ff-8be4-0b307acc8c0c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:51.191879 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-46d5e21d-c954-41ff-8be4-0b307acc8c0c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:51.192695 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-46d5e21d-c954-41ff-8be4-0b307acc8c0c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:51.193109 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-46d5e21d-c954-41ff-8be4-0b307acc8c0c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:51.197536 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:49:51.340391 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-46d5e21d-c954-41ff-8be4-0b307acc8c0c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:51.348118 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-46d5e21d-c954-41ff-8be4-0b307acc8c0c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1522 microversion: 2.1 time: 0.169086 Jun 20 12:49:51.348701 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3349/6797] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:51 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:52.366051 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9fe37b9d-436a-4f28-b4de-cab078710de9 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:52.366701 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9fe37b9d-436a-4f28-b4de-cab078710de9 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:52.374461 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9fe37b9d-436a-4f28-b4de-cab078710de9 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:52.374925 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9fe37b9d-436a-4f28-b4de-cab078710de9 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:52.375716 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9fe37b9d-436a-4f28-b4de-cab078710de9 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:52.376163 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9fe37b9d-436a-4f28-b4de-cab078710de9 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:52.517293 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9fe37b9d-436a-4f28-b4de-cab078710de9 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:52.525576 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9fe37b9d-436a-4f28-b4de-cab078710de9 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1522 microversion: 2.1 time: 0.163605 Jun 20 12:49:52.526153 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3449/6798] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:52 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:53.545447 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fdbda892-131b-476a-a4c5-6b9ff46dbcb1 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:53.546189 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fdbda892-131b-476a-a4c5-6b9ff46dbcb1 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:53.555481 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fdbda892-131b-476a-a4c5-6b9ff46dbcb1 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:53.555985 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fdbda892-131b-476a-a4c5-6b9ff46dbcb1 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:53.556817 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fdbda892-131b-476a-a4c5-6b9ff46dbcb1 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:53.557268 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fdbda892-131b-476a-a4c5-6b9ff46dbcb1 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:53.708658 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fdbda892-131b-476a-a4c5-6b9ff46dbcb1 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:53.716874 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fdbda892-131b-476a-a4c5-6b9ff46dbcb1 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1522 microversion: 2.1 time: 0.176994 Jun 20 12:49:53.717474 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3350/6799] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:53 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:54.735034 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-add1735a-642c-4820-9001-dc19dcdb98ae tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:54.736105 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-add1735a-642c-4820-9001-dc19dcdb98ae tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:54.745905 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-add1735a-642c-4820-9001-dc19dcdb98ae tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:54.746371 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-add1735a-642c-4820-9001-dc19dcdb98ae tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:54.747152 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-add1735a-642c-4820-9001-dc19dcdb98ae tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:54.747588 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-add1735a-642c-4820-9001-dc19dcdb98ae tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:54.898107 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-add1735a-642c-4820-9001-dc19dcdb98ae tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:54.906529 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-add1735a-642c-4820-9001-dc19dcdb98ae tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1522 microversion: 2.1 time: 0.175897 Jun 20 12:49:54.907134 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3450/6800] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:54 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:55.931569 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-873b64df-b382-4159-a98d-7cd3d6a6ee5c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:55.932606 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-873b64df-b382-4159-a98d-7cd3d6a6ee5c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:55.941128 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-873b64df-b382-4159-a98d-7cd3d6a6ee5c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:55.941596 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-873b64df-b382-4159-a98d-7cd3d6a6ee5c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:55.942408 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-873b64df-b382-4159-a98d-7cd3d6a6ee5c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:55.942865 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-873b64df-b382-4159-a98d-7cd3d6a6ee5c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:56.077925 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-873b64df-b382-4159-a98d-7cd3d6a6ee5c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:56.092330 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-873b64df-b382-4159-a98d-7cd3d6a6ee5c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1522 microversion: 2.1 time: 0.168990 Jun 20 12:49:56.093241 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3351/6801] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:55 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:57.117314 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e0cb7ed9-4e39-45fa-9387-96582afddd84 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:57.118219 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e0cb7ed9-4e39-45fa-9387-96582afddd84 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:57.125774 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e0cb7ed9-4e39-45fa-9387-96582afddd84 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:57.126233 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e0cb7ed9-4e39-45fa-9387-96582afddd84 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:57.127005 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e0cb7ed9-4e39-45fa-9387-96582afddd84 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:57.127448 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e0cb7ed9-4e39-45fa-9387-96582afddd84 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:57.545632 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e0cb7ed9-4e39-45fa-9387-96582afddd84 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:57.553970 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e0cb7ed9-4e39-45fa-9387-96582afddd84 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1522 microversion: 2.1 time: 0.442801 Jun 20 12:49:57.554609 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3451/6802] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:57 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1522 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:58.575383 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4650e35e-fdc8-41f4-ad5f-8cddbf964d7a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:58.576021 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4650e35e-fdc8-41f4-ad5f-8cddbf964d7a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:58.578833 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=36 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:49:58.584601 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4650e35e-fdc8-41f4-ad5f-8cddbf964d7a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:58.585066 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4650e35e-fdc8-41f4-ad5f-8cddbf964d7a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:58.585853 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4650e35e-fdc8-41f4-ad5f-8cddbf964d7a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:58.586298 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4650e35e-fdc8-41f4-ad5f-8cddbf964d7a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:58.736785 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4650e35e-fdc8-41f4-ad5f-8cddbf964d7a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:58.745164 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4650e35e-fdc8-41f4-ad5f-8cddbf964d7a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1522 microversion: 2.1 time: 0.173965 Jun 20 12:49:58.745758 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3352/6803] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:58 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:49:59.763082 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5dabafd6-2efe-4196-a36c-96135aef8b71 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:49:59.763703 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5dabafd6-2efe-4196-a36c-96135aef8b71 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:49:59.774882 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5dabafd6-2efe-4196-a36c-96135aef8b71 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:59.775723 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5dabafd6-2efe-4196-a36c-96135aef8b71 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:59.776107 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5dabafd6-2efe-4196-a36c-96135aef8b71 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:49:59.776591 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5dabafd6-2efe-4196-a36c-96135aef8b71 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:49:59.925827 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5dabafd6-2efe-4196-a36c-96135aef8b71 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:49:59.928232 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:49:59.936460 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5dabafd6-2efe-4196-a36c-96135aef8b71 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1522 microversion: 2.1 time: 0.177775 Jun 20 12:49:59.937073 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3452/6804] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:49:59 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:00.652504 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-5357accf-39dc-408e-bef6-47cd550152ad req-6e61c0d7-fefb-425d-b3f5-6aebc349e0f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1bd972-38e3-40fb-96b9-12089853770b", "name": "network-vif-unplugged", "status": "completed", "tag": "04d0258d-13b9-4935-9c90-233b99e2195f"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:50:00.664047 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-5357accf-39dc-408e-bef6-47cd550152ad req-6e61c0d7-fefb-425d-b3f5-6aebc349e0f7 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:00.664535 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-5357accf-39dc-408e-bef6-47cd550152ad req-6e61c0d7-fefb-425d-b3f5-6aebc349e0f7 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:00.677993 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-5357accf-39dc-408e-bef6-47cd550152ad req-6e61c0d7-fefb-425d-b3f5-6aebc349e0f7 service nova] Creating event network-vif-unplugged:04d0258d-13b9-4935-9c90-233b99e2195f for instance ea1bd972-38e3-40fb-96b9-12089853770b on n-h1-master-1 Jun 20 12:50:00.683962 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [req-5357accf-39dc-408e-bef6-47cd550152ad req-6e61c0d7-fefb-425d-b3f5-6aebc349e0f7 service nova] Instance ea1bd972-38e3-40fb-96b9-12089853770b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:50:00.696237 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-5357accf-39dc-408e-bef6-47cd550152ad req-6e61c0d7-fefb-425d-b3f5-6aebc349e0f7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047992 Jun 20 12:50:00.697383 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3353/6805] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:50:00.954953 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1a38d36f-51e2-4886-90fc-afa0417e8b7f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:00.955567 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1a38d36f-51e2-4886-90fc-afa0417e8b7f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:00.960010 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=34 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:50:00.968907 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a38d36f-51e2-4886-90fc-afa0417e8b7f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:00.969390 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a38d36f-51e2-4886-90fc-afa0417e8b7f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:00.970466 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a38d36f-51e2-4886-90fc-afa0417e8b7f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:00.970985 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a38d36f-51e2-4886-90fc-afa0417e8b7f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:01.132817 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1a38d36f-51e2-4886-90fc-afa0417e8b7f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:01.142022 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1a38d36f-51e2-4886-90fc-afa0417e8b7f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1521 microversion: 2.1 time: 0.190926 Jun 20 12:50:01.150754 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3453/6806] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:00 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:02.163716 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2801b617-078b-457b-8751-ae3066cdca53 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:02.164614 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2801b617-078b-457b-8751-ae3066cdca53 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:02.173003 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2801b617-078b-457b-8751-ae3066cdca53 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:02.173475 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2801b617-078b-457b-8751-ae3066cdca53 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:02.174305 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2801b617-078b-457b-8751-ae3066cdca53 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:02.174797 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2801b617-078b-457b-8751-ae3066cdca53 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:02.352157 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2801b617-078b-457b-8751-ae3066cdca53 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:02.364139 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2801b617-078b-457b-8751-ae3066cdca53 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1519 microversion: 2.1 time: 0.207303 Jun 20 12:50:02.364993 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3354/6807] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:02 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1519 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:02.711648 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-12d245b1-d9e2-4209-98d7-2db337be90c7 req-16acd479-4f5b-49ab-b94a-dec2ebbfa8e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea1bd972-38e3-40fb-96b9-12089853770b", "tag": "04d0258d-13b9-4935-9c90-233b99e2195f"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:50:02.721670 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-12d245b1-d9e2-4209-98d7-2db337be90c7 req-16acd479-4f5b-49ab-b94a-dec2ebbfa8e4 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:02.722112 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-12d245b1-d9e2-4209-98d7-2db337be90c7 req-16acd479-4f5b-49ab-b94a-dec2ebbfa8e4 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:02.735016 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-12d245b1-d9e2-4209-98d7-2db337be90c7 req-16acd479-4f5b-49ab-b94a-dec2ebbfa8e4 service nova] Creating event network-changed:04d0258d-13b9-4935-9c90-233b99e2195f for instance ea1bd972-38e3-40fb-96b9-12089853770b on n-h1-master-1 Jun 20 12:50:02.740616 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [req-12d245b1-d9e2-4209-98d7-2db337be90c7 req-16acd479-4f5b-49ab-b94a-dec2ebbfa8e4 service nova] Instance ea1bd972-38e3-40fb-96b9-12089853770b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119127) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:50:02.753458 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-12d245b1-d9e2-4209-98d7-2db337be90c7 req-16acd479-4f5b-49ab-b94a-dec2ebbfa8e4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045827 Jun 20 12:50:02.754226 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3454/6808] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:50:03.386326 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-79e3cb68-1eb0-48d8-9df2-660c60838af2 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:03.386969 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-79e3cb68-1eb0-48d8-9df2-660c60838af2 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:03.394648 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-79e3cb68-1eb0-48d8-9df2-660c60838af2 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:03.395117 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-79e3cb68-1eb0-48d8-9df2-660c60838af2 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:03.395914 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-79e3cb68-1eb0-48d8-9df2-660c60838af2 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:03.396398 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-79e3cb68-1eb0-48d8-9df2-660c60838af2 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:03.690230 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-79e3cb68-1eb0-48d8-9df2-660c60838af2 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:03.699181 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-79e3cb68-1eb0-48d8-9df2-660c60838af2 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1516 microversion: 2.1 time: 0.317432 Jun 20 12:50:03.699867 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3355/6809] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:03 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1516 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:03.715988 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2102d0c1-619e-44b8-aab2-f819fa3df847 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:50:03.716685 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2102d0c1-619e-44b8-aab2-f819fa3df847 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:03.724167 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2102d0c1-619e-44b8-aab2-f819fa3df847 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:03.724637 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2102d0c1-619e-44b8-aab2-f819fa3df847 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:03.725449 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2102d0c1-619e-44b8-aab2-f819fa3df847 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:03.725896 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2102d0c1-619e-44b8-aab2-f819fa3df847 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:03.794716 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2102d0c1-619e-44b8-aab2-f819fa3df847 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "POST /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b/action" status: 204 len: 0 microversion: 2.1 time: 0.082663 Jun 20 12:50:03.795158 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3455/6810] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:50:03 2022] POST /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b/action => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:50:03.803555 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f9d4d0df-bc34-4244-ab2c-fbeeb4017248 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:03.804178 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f9d4d0df-bc34-4244-ab2c-fbeeb4017248 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:03.811123 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f9d4d0df-bc34-4244-ab2c-fbeeb4017248 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:03.811584 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f9d4d0df-bc34-4244-ab2c-fbeeb4017248 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:03.812459 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f9d4d0df-bc34-4244-ab2c-fbeeb4017248 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:03.812862 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f9d4d0df-bc34-4244-ab2c-fbeeb4017248 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:04.024867 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f9d4d0df-bc34-4244-ab2c-fbeeb4017248 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:04.033204 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f9d4d0df-bc34-4244-ab2c-fbeeb4017248 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1516 microversion: 2.1 time: 0.233572 Jun 20 12:50:04.033818 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3356/6811] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:03 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1516 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:05.014604 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-8523b43b-aacf-409e-86f8-9b7ac62f00f7 req-1dbcfd98-1e80-448a-a30b-9bdfd5fab709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1bd972-38e3-40fb-96b9-12089853770b", "name": "network-vif-plugged", "status": "completed", "tag": "04d0258d-13b9-4935-9c90-233b99e2195f"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:50:05.026492 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-8523b43b-aacf-409e-86f8-9b7ac62f00f7 req-1dbcfd98-1e80-448a-a30b-9bdfd5fab709 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:05.027234 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-8523b43b-aacf-409e-86f8-9b7ac62f00f7 req-1dbcfd98-1e80-448a-a30b-9bdfd5fab709 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:05.041272 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-8523b43b-aacf-409e-86f8-9b7ac62f00f7 req-1dbcfd98-1e80-448a-a30b-9bdfd5fab709 service nova] Creating event network-vif-plugged:04d0258d-13b9-4935-9c90-233b99e2195f for instance ea1bd972-38e3-40fb-96b9-12089853770b on n-h1-master-1 Jun 20 12:50:05.048534 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [req-8523b43b-aacf-409e-86f8-9b7ac62f00f7 req-1dbcfd98-1e80-448a-a30b-9bdfd5fab709 service nova] Instance ea1bd972-38e3-40fb-96b9-12089853770b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119127) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:50:05.052912 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e758b503-33b5-45a2-a983-13829f709007 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:05.054851 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e758b503-33b5-45a2-a983-13829f709007 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:05.062445 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-8523b43b-aacf-409e-86f8-9b7ac62f00f7 req-1dbcfd98-1e80-448a-a30b-9bdfd5fab709 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054532 Jun 20 12:50:05.063702 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3456/6812] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:50:05.065833 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e758b503-33b5-45a2-a983-13829f709007 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:05.066643 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e758b503-33b5-45a2-a983-13829f709007 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:05.067487 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e758b503-33b5-45a2-a983-13829f709007 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:05.068045 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e758b503-33b5-45a2-a983-13829f709007 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:05.225038 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e758b503-33b5-45a2-a983-13829f709007 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:05.233530 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e758b503-33b5-45a2-a983-13829f709007 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1516 microversion: 2.1 time: 0.185617 Jun 20 12:50:05.234056 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3357/6813] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:05 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1516 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:06.254208 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-281a5df9-fc05-4d58-8e06-f13eccf722c5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:06.255132 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-281a5df9-fc05-4d58-8e06-f13eccf722c5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:06.263758 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-281a5df9-fc05-4d58-8e06-f13eccf722c5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:06.264233 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-281a5df9-fc05-4d58-8e06-f13eccf722c5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:06.265004 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-281a5df9-fc05-4d58-8e06-f13eccf722c5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:06.265441 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-281a5df9-fc05-4d58-8e06-f13eccf722c5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:06.402923 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-281a5df9-fc05-4d58-8e06-f13eccf722c5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:06.414771 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-281a5df9-fc05-4d58-8e06-f13eccf722c5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1508 microversion: 2.1 time: 0.167244 Jun 20 12:50:06.415560 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3457/6814] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:06 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:06.431724 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d96d6cfb-f3ae-489b-ad5a-f57b3037feee tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:06.432382 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d96d6cfb-f3ae-489b-ad5a-f57b3037feee tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:06.439895 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d96d6cfb-f3ae-489b-ad5a-f57b3037feee tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:06.440395 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d96d6cfb-f3ae-489b-ad5a-f57b3037feee tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:06.441210 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d96d6cfb-f3ae-489b-ad5a-f57b3037feee tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:06.441668 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d96d6cfb-f3ae-489b-ad5a-f57b3037feee tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:06.603986 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d96d6cfb-f3ae-489b-ad5a-f57b3037feee tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:06.615368 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d96d6cfb-f3ae-489b-ad5a-f57b3037feee tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1508 microversion: 2.1 time: 0.187528 Jun 20 12:50:06.616049 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3358/6815] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:06 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1508 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:06.640173 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-271d3ca7-fb76-4303-9a1d-b292b869f98a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Action: 'create', calling method: .version_select at 0x7f60736df310>, body: {"keypair": {"name": "tempest-keypair-970853829", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrSrE/ilUG9TAs6SW/6MX5BqRVkag9fqpQVqpWTxkMsw3OZA1WFxR6GOs8J0jpHc3e2HS+dPr6MIrzeyoBXsREmzvE5WVypaEMkrgo3BCr+SLJwmmUSSpjRtoTjhRFjwA=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:50:06.659123 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-271d3ca7-fb76-4303-9a1d-b292b869f98a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Getting quotas for project ec6dbb696cbc4887b7b79172d7d08ecb. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:50:06.664754 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-271d3ca7-fb76-4303-9a1d-b292b869f98a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Getting quotas for user 120cb878f5ce46999ccda36294b94a69 and project ec6dbb696cbc4887b7b79172d7d08ecb. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:50:06.698232 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-271d3ca7-fb76-4303-9a1d-b292b869f98a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.064213 Jun 20 12:50:06.698846 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3458/6816] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 12:50:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:50:07.967127 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b9fb57c6-b06b-4367-ba21-cecd53d2e2da tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:07.967755 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b9fb57c6-b06b-4367-ba21-cecd53d2e2da tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:07.975119 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b9fb57c6-b06b-4367-ba21-cecd53d2e2da tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:07.975580 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b9fb57c6-b06b-4367-ba21-cecd53d2e2da tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:07.976390 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b9fb57c6-b06b-4367-ba21-cecd53d2e2da tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:07.976843 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b9fb57c6-b06b-4367-ba21-cecd53d2e2da tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:08.107120 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b9fb57c6-b06b-4367-ba21-cecd53d2e2da tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:08.119075 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b9fb57c6-b06b-4367-ba21-cecd53d2e2da tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 200 len: 1508 microversion: 2.1 time: 0.155568 Jun 20 12:50:08.119779 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3359/6817] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:07 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:08.137737 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4386c063-cbcf-4f0d-9162-940ede56b876 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:08.138312 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4386c063-cbcf-4f0d-9162-940ede56b876 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:08.145370 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4386c063-cbcf-4f0d-9162-940ede56b876 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:08.145819 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4386c063-cbcf-4f0d-9162-940ede56b876 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:08.146590 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4386c063-cbcf-4f0d-9162-940ede56b876 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:08.147014 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4386c063-cbcf-4f0d-9162-940ede56b876 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:08.172379 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4386c063-cbcf-4f0d-9162-940ede56b876 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:50:08.257541 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4386c063-cbcf-4f0d-9162-940ede56b876 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 204 len: 0 microversion: 2.1 time: 0.124767 Jun 20 12:50:08.258173 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3459/6818] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:50:08 2022] DELETE /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 12:50:08.317001 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cb2091e5-55e5-4a4c-8ae4-8f07ac6f9595 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-24287071", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "a5f9d43a-e6ee-4369-b1fe-aa1398a39944"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:50:08.379140 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-cb2091e5-55e5-4a4c-8ae4-8f07ac6f9595 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] validate_networks() for [('a5f9d43a-e6ee-4369-b1fe-aa1398a39944', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:50:08.798412 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-cb2091e5-55e5-4a4c-8ae4-8f07ac6f9595 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:50:08.798846 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-cb2091e5-55e5-4a4c-8ae4-8f07ac6f9595 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:50:08.799328 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-cb2091e5-55e5-4a4c-8ae4-8f07ac6f9595 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:50:08.799744 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-cb2091e5-55e5-4a4c-8ae4-8f07ac6f9595 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:50:08.800181 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-cb2091e5-55e5-4a4c-8ae4-8f07ac6f9595 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:50:08.810455 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb2091e5-55e5-4a4c-8ae4-8f07ac6f9595 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:08.810913 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb2091e5-55e5-4a4c-8ae4-8f07ac6f9595 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:08.811710 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb2091e5-55e5-4a4c-8ae4-8f07ac6f9595 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:08.812151 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb2091e5-55e5-4a4c-8ae4-8f07ac6f9595 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:08.831283 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-cb2091e5-55e5-4a4c-8ae4-8f07ac6f9595 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Getting quotas for project ec6dbb696cbc4887b7b79172d7d08ecb. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:50:08.836808 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-cb2091e5-55e5-4a4c-8ae4-8f07ac6f9595 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Getting quotas for user 120cb878f5ce46999ccda36294b94a69 and project ec6dbb696cbc4887b7b79172d7d08ecb. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:50:08.856243 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cb2091e5-55e5-4a4c-8ae4-8f07ac6f9595 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:50:08.858682 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cb2091e5-55e5-4a4c-8ae4-8f07ac6f9595 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:50:08.907266 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cb2091e5-55e5-4a4c-8ae4-8f07ac6f9595 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.594351 Jun 20 12:50:08.908123 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3360/6819] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:50:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:50:08.918963 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3970502f-866b-4a92-bc5b-28ed27695727 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:08.920305 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3970502f-866b-4a92-bc5b-28ed27695727 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:08.978796 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3970502f-866b-4a92-bc5b-28ed27695727 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:08.985735 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3970502f-866b-4a92-bc5b-28ed27695727 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1216 microversion: 2.1 time: 0.071135 Jun 20 12:50:08.986303 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3460/6820] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:08 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1216 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:50:10.004814 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0e2594ec-654f-4d6f-8fb3-16843e4a84ae tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:10.006436 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0e2594ec-654f-4d6f-8fb3-16843e4a84ae tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:10.014687 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0e2594ec-654f-4d6f-8fb3-16843e4a84ae tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:10.015794 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0e2594ec-654f-4d6f-8fb3-16843e4a84ae tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:10.017022 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0e2594ec-654f-4d6f-8fb3-16843e4a84ae tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:10.017712 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0e2594ec-654f-4d6f-8fb3-16843e4a84ae tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:10.122774 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0e2594ec-654f-4d6f-8fb3-16843e4a84ae tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:10.130867 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0e2594ec-654f-4d6f-8fb3-16843e4a84ae tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1286 microversion: 2.1 time: 0.131408 Jun 20 12:50:10.131466 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3361/6821] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:09 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1286 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:10.160303 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-8f4e513c-ac96-4cd3-a5e9-3842e3adafe3 req-5935b2d8-d630-4733-8c60-6eda92e14c02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1bd972-38e3-40fb-96b9-12089853770b", "name": "network-vif-deleted", "tag": "04d0258d-13b9-4935-9c90-233b99e2195f"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:50:10.173844 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-8f4e513c-ac96-4cd3-a5e9-3842e3adafe3 req-5935b2d8-d630-4733-8c60-6eda92e14c02 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:10.174290 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-8f4e513c-ac96-4cd3-a5e9-3842e3adafe3 req-5935b2d8-d630-4733-8c60-6eda92e14c02 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:10.190833 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-8f4e513c-ac96-4cd3-a5e9-3842e3adafe3 req-5935b2d8-d630-4733-8c60-6eda92e14c02 service nova] Creating event network-vif-deleted:04d0258d-13b9-4935-9c90-233b99e2195f for instance ea1bd972-38e3-40fb-96b9-12089853770b on n-h1-master-1 Jun 20 12:50:10.199410 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-8f4e513c-ac96-4cd3-a5e9-3842e3adafe3 req-5935b2d8-d630-4733-8c60-6eda92e14c02 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042707 Jun 20 12:50:10.199963 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3461/6822] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:50:11.148953 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7372955c-a26d-452e-addf-6194bffe8c07 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:11.149709 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7372955c-a26d-452e-addf-6194bffe8c07 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:11.158009 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7372955c-a26d-452e-addf-6194bffe8c07 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:11.158476 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7372955c-a26d-452e-addf-6194bffe8c07 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:11.159267 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7372955c-a26d-452e-addf-6194bffe8c07 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:11.159920 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7372955c-a26d-452e-addf-6194bffe8c07 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:11.360834 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7372955c-a26d-452e-addf-6194bffe8c07 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:11.370739 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7372955c-a26d-452e-addf-6194bffe8c07 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1316 microversion: 2.1 time: 0.225971 Jun 20 12:50:11.372092 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3362/6823] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:11 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1316 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:12.218876 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-32963760-fd4b-450b-9d56-69bb07252720 req-3214f737-50bc-4130-a859-912a853366ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "638cbaff-03ff-4003-8155-41de3d27ba0f", "tag": "e0387b7c-0485-4a80-a4a3-26036092f435"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:50:12.229783 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-32963760-fd4b-450b-9d56-69bb07252720 req-3214f737-50bc-4130-a859-912a853366ff service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:12.230255 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-32963760-fd4b-450b-9d56-69bb07252720 req-3214f737-50bc-4130-a859-912a853366ff service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:12.242514 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-32963760-fd4b-450b-9d56-69bb07252720 req-3214f737-50bc-4130-a859-912a853366ff service nova] Creating event network-changed:e0387b7c-0485-4a80-a4a3-26036092f435 for instance 638cbaff-03ff-4003-8155-41de3d27ba0f on n-h1-master-1 Jun 20 12:50:12.247676 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-32963760-fd4b-450b-9d56-69bb07252720 req-3214f737-50bc-4130-a859-912a853366ff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033443 Jun 20 12:50:12.248280 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3462/6824] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:50:12.394244 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-37f8ff93-68b5-4ffb-aec7-c4886483f8a8 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:12.395290 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-37f8ff93-68b5-4ffb-aec7-c4886483f8a8 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:12.406281 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-37f8ff93-68b5-4ffb-aec7-c4886483f8a8 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:12.406740 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-37f8ff93-68b5-4ffb-aec7-c4886483f8a8 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:12.407512 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-37f8ff93-68b5-4ffb-aec7-c4886483f8a8 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:12.407955 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-37f8ff93-68b5-4ffb-aec7-c4886483f8a8 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:12.568536 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-37f8ff93-68b5-4ffb-aec7-c4886483f8a8 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:12.579242 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-37f8ff93-68b5-4ffb-aec7-c4886483f8a8 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1316 microversion: 2.1 time: 0.192571 Jun 20 12:50:12.579825 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3363/6825] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:12 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1316 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:13.597172 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c46e083c-7713-4f99-94db-f6901a2e7fc5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:13.597867 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c46e083c-7713-4f99-94db-f6901a2e7fc5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:13.604980 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c46e083c-7713-4f99-94db-f6901a2e7fc5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:13.605429 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c46e083c-7713-4f99-94db-f6901a2e7fc5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:13.606302 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c46e083c-7713-4f99-94db-f6901a2e7fc5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:13.606737 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c46e083c-7713-4f99-94db-f6901a2e7fc5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:13.763828 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c46e083c-7713-4f99-94db-f6901a2e7fc5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:13.771979 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c46e083c-7713-4f99-94db-f6901a2e7fc5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1316 microversion: 2.1 time: 0.180127 Jun 20 12:50:13.772593 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3463/6826] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:13 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1316 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:14.790241 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0ba0056d-f684-4b15-a597-eb5fd70410fd tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:14.790910 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0ba0056d-f684-4b15-a597-eb5fd70410fd tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:14.799510 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0ba0056d-f684-4b15-a597-eb5fd70410fd tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:14.800038 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0ba0056d-f684-4b15-a597-eb5fd70410fd tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:14.801088 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0ba0056d-f684-4b15-a597-eb5fd70410fd tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:14.801591 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0ba0056d-f684-4b15-a597-eb5fd70410fd tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:14.961285 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0ba0056d-f684-4b15-a597-eb5fd70410fd tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:14.969605 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0ba0056d-f684-4b15-a597-eb5fd70410fd tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1316 microversion: 2.1 time: 0.183403 Jun 20 12:50:14.970223 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3364/6827] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:14 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1316 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:15.989451 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4ed85229-35eb-4dad-bf77-404dcd18485d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:15.990124 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4ed85229-35eb-4dad-bf77-404dcd18485d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:16.000542 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4ed85229-35eb-4dad-bf77-404dcd18485d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:16.000994 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4ed85229-35eb-4dad-bf77-404dcd18485d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:16.001796 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4ed85229-35eb-4dad-bf77-404dcd18485d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:16.002230 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4ed85229-35eb-4dad-bf77-404dcd18485d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:16.154227 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4ed85229-35eb-4dad-bf77-404dcd18485d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:16.166748 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4ed85229-35eb-4dad-bf77-404dcd18485d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1316 microversion: 2.1 time: 0.183334 Jun 20 12:50:16.167472 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3464/6828] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:15 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1316 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:17.058047 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-dc95113c-ca9a-4e19-bb32-96048f3e9683 req-f149c8cf-c3e6-47b9-bed9-80c5dcb8de77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "638cbaff-03ff-4003-8155-41de3d27ba0f", "name": "network-vif-plugged", "status": "completed", "tag": "e0387b7c-0485-4a80-a4a3-26036092f435"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:50:17.067372 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-dc95113c-ca9a-4e19-bb32-96048f3e9683 req-f149c8cf-c3e6-47b9-bed9-80c5dcb8de77 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:17.067829 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-dc95113c-ca9a-4e19-bb32-96048f3e9683 req-f149c8cf-c3e6-47b9-bed9-80c5dcb8de77 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:17.079545 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-dc95113c-ca9a-4e19-bb32-96048f3e9683 req-f149c8cf-c3e6-47b9-bed9-80c5dcb8de77 service nova] Creating event network-vif-plugged:e0387b7c-0485-4a80-a4a3-26036092f435 for instance 638cbaff-03ff-4003-8155-41de3d27ba0f on n-h1-master-1 Jun 20 12:50:17.084690 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-dc95113c-ca9a-4e19-bb32-96048f3e9683 req-f149c8cf-c3e6-47b9-bed9-80c5dcb8de77 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030745 Jun 20 12:50:17.085308 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3365/6829] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:50:17.185952 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ac1a0021-c570-43b9-9e86-47a269ca2971 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:17.186584 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ac1a0021-c570-43b9-9e86-47a269ca2971 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:17.193874 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac1a0021-c570-43b9-9e86-47a269ca2971 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:17.194294 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac1a0021-c570-43b9-9e86-47a269ca2971 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:17.195097 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac1a0021-c570-43b9-9e86-47a269ca2971 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:17.195552 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac1a0021-c570-43b9-9e86-47a269ca2971 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:17.340564 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ac1a0021-c570-43b9-9e86-47a269ca2971 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:17.348742 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ac1a0021-c570-43b9-9e86-47a269ca2971 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1316 microversion: 2.1 time: 0.166862 Jun 20 12:50:17.349336 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3465/6830] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:17 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1316 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:18.366767 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-893bc361-b250-48f0-a9c6-7663b1d73600 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:18.367482 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-893bc361-b250-48f0-a9c6-7663b1d73600 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:18.374482 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-893bc361-b250-48f0-a9c6-7663b1d73600 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:18.374943 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-893bc361-b250-48f0-a9c6-7663b1d73600 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:18.375759 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-893bc361-b250-48f0-a9c6-7663b1d73600 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:18.376291 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-893bc361-b250-48f0-a9c6-7663b1d73600 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:18.518680 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-893bc361-b250-48f0-a9c6-7663b1d73600 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:18.528330 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-893bc361-b250-48f0-a9c6-7663b1d73600 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1506 microversion: 2.1 time: 0.166706 Jun 20 12:50:18.528924 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3366/6831] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:18 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:18.548153 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-be0fd70c-bb60-4445-88d6-653814cd34c5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:18.548814 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-be0fd70c-bb60-4445-88d6-653814cd34c5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:18.559730 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-be0fd70c-bb60-4445-88d6-653814cd34c5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:18.560498 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-be0fd70c-bb60-4445-88d6-653814cd34c5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:18.561930 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-be0fd70c-bb60-4445-88d6-653814cd34c5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:18.562490 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-be0fd70c-bb60-4445-88d6-653814cd34c5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:18.713018 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-be0fd70c-bb60-4445-88d6-653814cd34c5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:18.722180 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-be0fd70c-bb60-4445-88d6-653814cd34c5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1506 microversion: 2.1 time: 0.179833 Jun 20 12:50:18.722770 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3466/6832] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:18 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1506 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:18.739761 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-05ccf126-e538-4841-9486-f27e7367200a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:50:18.740801 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-05ccf126-e538-4841-9486-f27e7367200a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:18.747441 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05ccf126-e538-4841-9486-f27e7367200a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:18.747899 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05ccf126-e538-4841-9486-f27e7367200a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:18.748734 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05ccf126-e538-4841-9486-f27e7367200a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:18.749863 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05ccf126-e538-4841-9486-f27e7367200a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:18.775027 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:50:18.786568 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-05ccf126-e538-4841-9486-f27e7367200a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:18.795503 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-05ccf126-e538-4841-9486-f27e7367200a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Old instance type m1.heat2, new instance type m1.heat {{(pid=119128) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 20 12:50:18.802958 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-05ccf126-e538-4841-9486-f27e7367200a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:50:18.803335 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-05ccf126-e538-4841-9486-f27e7367200a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:50:18.803820 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-05ccf126-e538-4841-9486-f27e7367200a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:50:18.804266 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-05ccf126-e538-4841-9486-f27e7367200a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:50:18.804695 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-05ccf126-e538-4841-9486-f27e7367200a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:50:18.820906 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:50:18.844769 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:50:18.872372 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-05ccf126-e538-4841-9486-f27e7367200a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "POST /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f/action" status: 202 len: 0 microversion: 2.1 time: 0.137284 Jun 20 12:50:18.872983 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3367/6833] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:50:18 2022] POST /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:50:18.881232 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-760a247b-059e-4136-a5ec-ba981ddb3291 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:18.881767 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-760a247b-059e-4136-a5ec-ba981ddb3291 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:18.890987 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-760a247b-059e-4136-a5ec-ba981ddb3291 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:18.890987 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-760a247b-059e-4136-a5ec-ba981ddb3291 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:18.890987 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-760a247b-059e-4136-a5ec-ba981ddb3291 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:18.890987 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-760a247b-059e-4136-a5ec-ba981ddb3291 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:18.984083 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:50:19.041311 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-760a247b-059e-4136-a5ec-ba981ddb3291 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:19.049547 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-760a247b-059e-4136-a5ec-ba981ddb3291 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1513 microversion: 2.1 time: 0.172286 Jun 20 12:50:19.056289 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3467/6834] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:18 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1513 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:20.068753 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0f744727-2af4-4874-b636-f52c18757a46 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:20.069426 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0f744727-2af4-4874-b636-f52c18757a46 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:20.076076 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f744727-2af4-4874-b636-f52c18757a46 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:20.076558 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f744727-2af4-4874-b636-f52c18757a46 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:20.077328 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f744727-2af4-4874-b636-f52c18757a46 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:20.077829 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f744727-2af4-4874-b636-f52c18757a46 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:20.217527 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0f744727-2af4-4874-b636-f52c18757a46 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:20.226008 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0f744727-2af4-4874-b636-f52c18757a46 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1513 microversion: 2.1 time: 0.162025 Jun 20 12:50:20.226589 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3368/6835] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:20 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:21.245234 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-af363b91-b881-4d8f-80bf-4df2cb104d76 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:21.246269 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-af363b91-b881-4d8f-80bf-4df2cb104d76 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:21.257310 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-af363b91-b881-4d8f-80bf-4df2cb104d76 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:21.257951 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-af363b91-b881-4d8f-80bf-4df2cb104d76 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:21.259116 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-af363b91-b881-4d8f-80bf-4df2cb104d76 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:21.259718 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-af363b91-b881-4d8f-80bf-4df2cb104d76 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:21.406768 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-af363b91-b881-4d8f-80bf-4df2cb104d76 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:21.418666 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-af363b91-b881-4d8f-80bf-4df2cb104d76 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1518 microversion: 2.1 time: 0.178452 Jun 20 12:50:21.419268 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3468/6836] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:21 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1518 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:22.437199 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-81a29e20-826b-44d4-af7c-a89b5a5ecc12 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:22.437771 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-81a29e20-826b-44d4-af7c-a89b5a5ecc12 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:22.445627 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-81a29e20-826b-44d4-af7c-a89b5a5ecc12 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:22.446087 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-81a29e20-826b-44d4-af7c-a89b5a5ecc12 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:22.446854 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-81a29e20-826b-44d4-af7c-a89b5a5ecc12 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:22.447296 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-81a29e20-826b-44d4-af7c-a89b5a5ecc12 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:22.585983 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-81a29e20-826b-44d4-af7c-a89b5a5ecc12 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:22.593943 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-81a29e20-826b-44d4-af7c-a89b5a5ecc12 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1518 microversion: 2.1 time: 0.160784 Jun 20 12:50:22.594610 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3369/6837] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:22 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:23.611131 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-73745132-895c-4f7c-b5ea-840ee0ca6af1 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:23.611777 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-73745132-895c-4f7c-b5ea-840ee0ca6af1 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:23.619410 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-73745132-895c-4f7c-b5ea-840ee0ca6af1 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:23.619869 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-73745132-895c-4f7c-b5ea-840ee0ca6af1 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:23.620692 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-73745132-895c-4f7c-b5ea-840ee0ca6af1 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:23.621136 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-73745132-895c-4f7c-b5ea-840ee0ca6af1 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:23.753545 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-73745132-895c-4f7c-b5ea-840ee0ca6af1 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:23.761431 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-73745132-895c-4f7c-b5ea-840ee0ca6af1 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1518 microversion: 2.1 time: 0.154448 Jun 20 12:50:23.762017 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3469/6838] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:23 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:24.778189 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5e28a3de-3367-41d8-951c-56a1b967a0d8 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:24.778810 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5e28a3de-3367-41d8-951c-56a1b967a0d8 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:24.786173 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e28a3de-3367-41d8-951c-56a1b967a0d8 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:24.786634 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e28a3de-3367-41d8-951c-56a1b967a0d8 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:24.787413 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e28a3de-3367-41d8-951c-56a1b967a0d8 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:24.787860 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e28a3de-3367-41d8-951c-56a1b967a0d8 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:24.921690 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5e28a3de-3367-41d8-951c-56a1b967a0d8 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:24.929941 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5e28a3de-3367-41d8-951c-56a1b967a0d8 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1518 microversion: 2.1 time: 0.155617 Jun 20 12:50:24.930463 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3370/6839] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:24 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:25.947453 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a968d7c5-94e6-4560-a2d5-00f89eedde59 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:25.947979 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a968d7c5-94e6-4560-a2d5-00f89eedde59 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:25.955694 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a968d7c5-94e6-4560-a2d5-00f89eedde59 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:25.956156 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a968d7c5-94e6-4560-a2d5-00f89eedde59 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:25.956964 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a968d7c5-94e6-4560-a2d5-00f89eedde59 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:25.957407 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a968d7c5-94e6-4560-a2d5-00f89eedde59 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:25.975998 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:50:26.099158 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a968d7c5-94e6-4560-a2d5-00f89eedde59 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:26.107093 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a968d7c5-94e6-4560-a2d5-00f89eedde59 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1518 microversion: 2.1 time: 0.163787 Jun 20 12:50:26.107676 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3470/6840] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:25 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:27.125881 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1ddc8cd0-d9a2-43a1-8546-4726001ef45d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:27.126504 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1ddc8cd0-d9a2-43a1-8546-4726001ef45d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:27.133956 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1ddc8cd0-d9a2-43a1-8546-4726001ef45d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:27.134408 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1ddc8cd0-d9a2-43a1-8546-4726001ef45d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:27.135190 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1ddc8cd0-d9a2-43a1-8546-4726001ef45d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:27.135637 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1ddc8cd0-d9a2-43a1-8546-4726001ef45d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:27.276259 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1ddc8cd0-d9a2-43a1-8546-4726001ef45d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:27.284011 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1ddc8cd0-d9a2-43a1-8546-4726001ef45d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1518 microversion: 2.1 time: 0.162307 Jun 20 12:50:27.284619 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3371/6841] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:27 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:28.301571 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f03319ff-854e-41e6-887a-70d866d069a5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:28.302154 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f03319ff-854e-41e6-887a-70d866d069a5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:28.310337 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f03319ff-854e-41e6-887a-70d866d069a5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:28.310788 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f03319ff-854e-41e6-887a-70d866d069a5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:28.311552 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f03319ff-854e-41e6-887a-70d866d069a5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:28.311990 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f03319ff-854e-41e6-887a-70d866d069a5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:28.448247 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f03319ff-854e-41e6-887a-70d866d069a5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:28.458695 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f03319ff-854e-41e6-887a-70d866d069a5 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1518 microversion: 2.1 time: 0.160933 Jun 20 12:50:28.459367 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3471/6842] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:28 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:29.476262 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-eb89e7ec-29c6-4bde-9fe5-48789dae5e3e tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:29.476921 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-eb89e7ec-29c6-4bde-9fe5-48789dae5e3e tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:29.479906 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:50:29.486165 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eb89e7ec-29c6-4bde-9fe5-48789dae5e3e tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:29.486623 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eb89e7ec-29c6-4bde-9fe5-48789dae5e3e tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:29.487446 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eb89e7ec-29c6-4bde-9fe5-48789dae5e3e tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:29.487896 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eb89e7ec-29c6-4bde-9fe5-48789dae5e3e tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:29.623492 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-eb89e7ec-29c6-4bde-9fe5-48789dae5e3e tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:29.631721 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-eb89e7ec-29c6-4bde-9fe5-48789dae5e3e tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1518 microversion: 2.1 time: 0.159496 Jun 20 12:50:29.632415 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3372/6843] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:29 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:30.652047 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-573c718c-6a9b-4f3c-8989-392823769348 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:30.652691 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-573c718c-6a9b-4f3c-8989-392823769348 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:30.662041 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-573c718c-6a9b-4f3c-8989-392823769348 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:30.662499 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-573c718c-6a9b-4f3c-8989-392823769348 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:30.663298 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-573c718c-6a9b-4f3c-8989-392823769348 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:30.663711 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-573c718c-6a9b-4f3c-8989-392823769348 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:30.818372 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-573c718c-6a9b-4f3c-8989-392823769348 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:30.826001 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-573c718c-6a9b-4f3c-8989-392823769348 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1518 microversion: 2.1 time: 0.179741 Jun 20 12:50:30.826614 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3472/6844] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:30 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1518 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:31.846097 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-36e0b890-c5ce-446b-96c2-0c4cd895de8f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:31.846983 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-36e0b890-c5ce-446b-96c2-0c4cd895de8f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:31.856330 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-36e0b890-c5ce-446b-96c2-0c4cd895de8f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:31.856895 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-36e0b890-c5ce-446b-96c2-0c4cd895de8f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:31.858028 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-36e0b890-c5ce-446b-96c2-0c4cd895de8f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:31.858529 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-36e0b890-c5ce-446b-96c2-0c4cd895de8f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:32.009012 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-36e0b890-c5ce-446b-96c2-0c4cd895de8f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:32.017351 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-36e0b890-c5ce-446b-96c2-0c4cd895de8f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1518 microversion: 2.1 time: 0.177237 Jun 20 12:50:32.017921 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3373/6845] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:31 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1518 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:33.035176 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-235131a9-b093-467b-b4e6-0dc621651124 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:33.035862 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-235131a9-b093-467b-b4e6-0dc621651124 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:33.039360 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:50:33.045635 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-235131a9-b093-467b-b4e6-0dc621651124 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:33.046180 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-235131a9-b093-467b-b4e6-0dc621651124 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:33.046987 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-235131a9-b093-467b-b4e6-0dc621651124 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:33.047427 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-235131a9-b093-467b-b4e6-0dc621651124 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:33.197164 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-235131a9-b093-467b-b4e6-0dc621651124 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:33.205941 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-235131a9-b093-467b-b4e6-0dc621651124 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1518 microversion: 2.1 time: 0.175704 Jun 20 12:50:33.206462 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3473/6846] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:33 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1518 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:34.226983 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-957550a0-dfcb-43cc-a6a0-1180f589c26b tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:34.227506 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-957550a0-dfcb-43cc-a6a0-1180f589c26b tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:34.235172 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-957550a0-dfcb-43cc-a6a0-1180f589c26b tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:34.235696 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-957550a0-dfcb-43cc-a6a0-1180f589c26b tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:34.236834 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-957550a0-dfcb-43cc-a6a0-1180f589c26b tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:34.237673 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-957550a0-dfcb-43cc-a6a0-1180f589c26b tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:34.381529 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-957550a0-dfcb-43cc-a6a0-1180f589c26b tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:34.389366 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-957550a0-dfcb-43cc-a6a0-1180f589c26b tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1518 microversion: 2.1 time: 0.166422 Jun 20 12:50:34.389945 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3374/6847] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:34 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1518 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:35.406835 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-033319b3-400e-4bbd-9a5b-93572e8474fb tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:35.407439 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-033319b3-400e-4bbd-9a5b-93572e8474fb tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:35.416598 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-033319b3-400e-4bbd-9a5b-93572e8474fb tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:35.417066 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-033319b3-400e-4bbd-9a5b-93572e8474fb tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:35.418254 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-033319b3-400e-4bbd-9a5b-93572e8474fb tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:35.418922 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-033319b3-400e-4bbd-9a5b-93572e8474fb tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:35.562953 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-033319b3-400e-4bbd-9a5b-93572e8474fb tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:35.570849 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-033319b3-400e-4bbd-9a5b-93572e8474fb tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1518 microversion: 2.1 time: 0.167995 Jun 20 12:50:35.571424 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3474/6848] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:35 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:36.590143 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-192f2fcc-8804-4119-a4ab-a5eb68209e2d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:36.590763 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-192f2fcc-8804-4119-a4ab-a5eb68209e2d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:36.599008 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-192f2fcc-8804-4119-a4ab-a5eb68209e2d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:36.599508 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-192f2fcc-8804-4119-a4ab-a5eb68209e2d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:36.600799 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-192f2fcc-8804-4119-a4ab-a5eb68209e2d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:36.600937 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-192f2fcc-8804-4119-a4ab-a5eb68209e2d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:36.739038 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-192f2fcc-8804-4119-a4ab-a5eb68209e2d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:36.746737 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-192f2fcc-8804-4119-a4ab-a5eb68209e2d tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1518 microversion: 2.1 time: 0.162062 Jun 20 12:50:36.747294 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3375/6849] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:36 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:37.771901 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6ef4d427-c11d-4857-9186-6067afbc2d5a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:37.772555 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6ef4d427-c11d-4857-9186-6067afbc2d5a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:37.779060 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6ef4d427-c11d-4857-9186-6067afbc2d5a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:37.779521 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6ef4d427-c11d-4857-9186-6067afbc2d5a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:37.780314 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6ef4d427-c11d-4857-9186-6067afbc2d5a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:37.780768 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6ef4d427-c11d-4857-9186-6067afbc2d5a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:37.918980 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6ef4d427-c11d-4857-9186-6067afbc2d5a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:37.928020 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6ef4d427-c11d-4857-9186-6067afbc2d5a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1518 microversion: 2.1 time: 0.161717 Jun 20 12:50:37.928223 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3475/6850] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:37 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:38.945782 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f329bf13-c40f-4ea1-a1fd-4d2f9ff169f7 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:38.946470 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f329bf13-c40f-4ea1-a1fd-4d2f9ff169f7 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:38.954018 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f329bf13-c40f-4ea1-a1fd-4d2f9ff169f7 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:38.954514 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f329bf13-c40f-4ea1-a1fd-4d2f9ff169f7 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:38.955623 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f329bf13-c40f-4ea1-a1fd-4d2f9ff169f7 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:38.955869 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f329bf13-c40f-4ea1-a1fd-4d2f9ff169f7 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:39.092512 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f329bf13-c40f-4ea1-a1fd-4d2f9ff169f7 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:39.100555 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f329bf13-c40f-4ea1-a1fd-4d2f9ff169f7 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1518 microversion: 2.1 time: 0.158927 Jun 20 12:50:39.101137 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3376/6851] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:38 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:40.118078 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c2286dd8-ee26-48bf-aff6-db6801edffa6 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:40.118751 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c2286dd8-ee26-48bf-aff6-db6801edffa6 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:40.126088 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c2286dd8-ee26-48bf-aff6-db6801edffa6 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:40.126540 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c2286dd8-ee26-48bf-aff6-db6801edffa6 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:40.127378 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c2286dd8-ee26-48bf-aff6-db6801edffa6 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:40.127816 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c2286dd8-ee26-48bf-aff6-db6801edffa6 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:40.265689 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c2286dd8-ee26-48bf-aff6-db6801edffa6 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:40.273829 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c2286dd8-ee26-48bf-aff6-db6801edffa6 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1518 microversion: 2.1 time: 0.159738 Jun 20 12:50:40.274500 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3476/6852] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:40 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:41.294268 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1bdc9fc5-4046-4acc-b74c-dcf9e2802ea1 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:41.295628 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1bdc9fc5-4046-4acc-b74c-dcf9e2802ea1 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:41.304422 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1bdc9fc5-4046-4acc-b74c-dcf9e2802ea1 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:41.304885 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1bdc9fc5-4046-4acc-b74c-dcf9e2802ea1 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:41.305665 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1bdc9fc5-4046-4acc-b74c-dcf9e2802ea1 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:41.306462 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1bdc9fc5-4046-4acc-b74c-dcf9e2802ea1 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:41.449063 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1bdc9fc5-4046-4acc-b74c-dcf9e2802ea1 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:41.458578 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1bdc9fc5-4046-4acc-b74c-dcf9e2802ea1 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1518 microversion: 2.1 time: 0.170102 Jun 20 12:50:41.459156 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3377/6853] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:41 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1518 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:42.476081 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-49d369a7-e737-4653-9ec7-8b6cf8586b31 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:42.476700 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-49d369a7-e737-4653-9ec7-8b6cf8586b31 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:42.486928 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-49d369a7-e737-4653-9ec7-8b6cf8586b31 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:42.487464 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-49d369a7-e737-4653-9ec7-8b6cf8586b31 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:42.488330 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-49d369a7-e737-4653-9ec7-8b6cf8586b31 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:42.488769 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-49d369a7-e737-4653-9ec7-8b6cf8586b31 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:42.640001 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-49d369a7-e737-4653-9ec7-8b6cf8586b31 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:42.649803 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-49d369a7-e737-4653-9ec7-8b6cf8586b31 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1518 microversion: 2.1 time: 0.178287 Jun 20 12:50:42.650395 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3477/6854] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:42 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1518 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:43.666643 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-aa779b2c-916b-4f57-a148-4a1dc19373b2 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:43.667287 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-aa779b2c-916b-4f57-a148-4a1dc19373b2 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:43.674392 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aa779b2c-916b-4f57-a148-4a1dc19373b2 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:43.674854 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aa779b2c-916b-4f57-a148-4a1dc19373b2 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:43.675634 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aa779b2c-916b-4f57-a148-4a1dc19373b2 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:43.676079 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-aa779b2c-916b-4f57-a148-4a1dc19373b2 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:43.827684 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-aa779b2c-916b-4f57-a148-4a1dc19373b2 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:43.835855 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-aa779b2c-916b-4f57-a148-4a1dc19373b2 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1518 microversion: 2.1 time: 0.173116 Jun 20 12:50:43.836415 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3378/6855] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:43 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1518 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:44.853308 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1997f484-2208-4e13-856a-af46be99ce40 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:44.854085 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1997f484-2208-4e13-856a-af46be99ce40 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:44.861883 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1997f484-2208-4e13-856a-af46be99ce40 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:44.862946 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1997f484-2208-4e13-856a-af46be99ce40 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:44.863462 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1997f484-2208-4e13-856a-af46be99ce40 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:44.863973 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1997f484-2208-4e13-856a-af46be99ce40 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:45.020085 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1997f484-2208-4e13-856a-af46be99ce40 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:45.029862 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1997f484-2208-4e13-856a-af46be99ce40 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1518 microversion: 2.1 time: 0.181500 Jun 20 12:50:45.030474 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3478/6856] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:44 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1518 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:46.047242 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-21477335-4af1-404f-bbeb-90fa0947a022 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:46.047838 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-21477335-4af1-404f-bbeb-90fa0947a022 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:46.056711 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-21477335-4af1-404f-bbeb-90fa0947a022 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:46.057512 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-21477335-4af1-404f-bbeb-90fa0947a022 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:46.058643 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-21477335-4af1-404f-bbeb-90fa0947a022 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:46.059137 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-21477335-4af1-404f-bbeb-90fa0947a022 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:46.208053 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-21477335-4af1-404f-bbeb-90fa0947a022 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:46.217924 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-21477335-4af1-404f-bbeb-90fa0947a022 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1518 microversion: 2.1 time: 0.174617 Jun 20 12:50:46.218543 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3379/6857] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:46 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1518 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:47.238612 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b3d398d9-96df-4d83-95eb-122a5db72c7f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:47.239462 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b3d398d9-96df-4d83-95eb-122a5db72c7f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:47.248875 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3d398d9-96df-4d83-95eb-122a5db72c7f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:47.249385 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3d398d9-96df-4d83-95eb-122a5db72c7f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:47.250155 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3d398d9-96df-4d83-95eb-122a5db72c7f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:47.250590 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3d398d9-96df-4d83-95eb-122a5db72c7f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:47.400380 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b3d398d9-96df-4d83-95eb-122a5db72c7f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:47.409388 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b3d398d9-96df-4d83-95eb-122a5db72c7f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1518 microversion: 2.1 time: 0.174931 Jun 20 12:50:47.410173 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3479/6858] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:47 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1518 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:48.143415 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-3f5da5f8-6f21-4762-908e-18207e0ba446 req-b8e03815-e4b8-409d-af41-99ac20be164a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "638cbaff-03ff-4003-8155-41de3d27ba0f", "name": "network-vif-unplugged", "status": "completed", "tag": "e0387b7c-0485-4a80-a4a3-26036092f435"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:50:48.155015 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-3f5da5f8-6f21-4762-908e-18207e0ba446 req-b8e03815-e4b8-409d-af41-99ac20be164a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:48.155496 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-3f5da5f8-6f21-4762-908e-18207e0ba446 req-b8e03815-e4b8-409d-af41-99ac20be164a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:48.169489 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-3f5da5f8-6f21-4762-908e-18207e0ba446 req-b8e03815-e4b8-409d-af41-99ac20be164a service nova] Creating event network-vif-unplugged:e0387b7c-0485-4a80-a4a3-26036092f435 for instance 638cbaff-03ff-4003-8155-41de3d27ba0f on n-h2-master-1 Jun 20 12:50:48.175323 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [req-3f5da5f8-6f21-4762-908e-18207e0ba446 req-b8e03815-e4b8-409d-af41-99ac20be164a service nova] Instance 638cbaff-03ff-4003-8155-41de3d27ba0f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:50:48.187272 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-3f5da5f8-6f21-4762-908e-18207e0ba446 req-b8e03815-e4b8-409d-af41-99ac20be164a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047650 Jun 20 12:50:48.187892 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3380/6859] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:50:48.436435 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d706af57-8c19-4f02-b063-f2523cf3e234 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:48.437161 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d706af57-8c19-4f02-b063-f2523cf3e234 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:48.445382 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d706af57-8c19-4f02-b063-f2523cf3e234 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:48.445838 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d706af57-8c19-4f02-b063-f2523cf3e234 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:48.446707 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d706af57-8c19-4f02-b063-f2523cf3e234 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:48.447134 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d706af57-8c19-4f02-b063-f2523cf3e234 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:48.599059 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d706af57-8c19-4f02-b063-f2523cf3e234 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:48.607404 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d706af57-8c19-4f02-b063-f2523cf3e234 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1517 microversion: 2.1 time: 0.179372 Jun 20 12:50:48.608023 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3480/6860] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:48 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1517 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:49.626811 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-48ab36c8-ee18-40c4-8644-27e31766dc64 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:49.627563 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-48ab36c8-ee18-40c4-8644-27e31766dc64 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:49.634646 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-48ab36c8-ee18-40c4-8644-27e31766dc64 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:49.635579 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-48ab36c8-ee18-40c4-8644-27e31766dc64 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:49.636163 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-48ab36c8-ee18-40c4-8644-27e31766dc64 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:49.636750 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-48ab36c8-ee18-40c4-8644-27e31766dc64 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:49.639550 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:50:49.789456 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-48ab36c8-ee18-40c4-8644-27e31766dc64 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:49.798954 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-48ab36c8-ee18-40c4-8644-27e31766dc64 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1515 microversion: 2.1 time: 0.177134 Jun 20 12:50:49.799782 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3381/6861] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:49 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:50.206382 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-ddbbddb9-415a-4450-8987-2234a97a8190 req-69831201-c5c9-4c8c-9a1f-6870bf8e5717 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "638cbaff-03ff-4003-8155-41de3d27ba0f", "tag": "e0387b7c-0485-4a80-a4a3-26036092f435"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:50:50.217185 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ddbbddb9-415a-4450-8987-2234a97a8190 req-69831201-c5c9-4c8c-9a1f-6870bf8e5717 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:50.217635 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ddbbddb9-415a-4450-8987-2234a97a8190 req-69831201-c5c9-4c8c-9a1f-6870bf8e5717 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:50.230180 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-ddbbddb9-415a-4450-8987-2234a97a8190 req-69831201-c5c9-4c8c-9a1f-6870bf8e5717 service nova] Creating event network-changed:e0387b7c-0485-4a80-a4a3-26036092f435 for instance 638cbaff-03ff-4003-8155-41de3d27ba0f on n-h2-master-1 Jun 20 12:50:50.235921 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [req-ddbbddb9-415a-4450-8987-2234a97a8190 req-69831201-c5c9-4c8c-9a1f-6870bf8e5717 service nova] Instance 638cbaff-03ff-4003-8155-41de3d27ba0f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119127) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:50:50.249849 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-ddbbddb9-415a-4450-8987-2234a97a8190 req-69831201-c5c9-4c8c-9a1f-6870bf8e5717 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047748 Jun 20 12:50:50.250613 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3481/6862] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:50:50.822190 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0c8138ac-cdd4-43e0-b07b-20b6a1c4084a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:50.822861 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0c8138ac-cdd4-43e0-b07b-20b6a1c4084a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:50.830409 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c8138ac-cdd4-43e0-b07b-20b6a1c4084a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:50.830869 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c8138ac-cdd4-43e0-b07b-20b6a1c4084a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:50.831657 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c8138ac-cdd4-43e0-b07b-20b6a1c4084a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:50.832098 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c8138ac-cdd4-43e0-b07b-20b6a1c4084a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:50.996816 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0c8138ac-cdd4-43e0-b07b-20b6a1c4084a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:51.005754 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0c8138ac-cdd4-43e0-b07b-20b6a1c4084a tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1515 microversion: 2.1 time: 0.189529 Jun 20 12:50:51.006391 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3382/6863] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:50 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1515 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:52.027072 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3a72c873-0da0-48a4-9304-dcc40a9260fd tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:52.028516 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3a72c873-0da0-48a4-9304-dcc40a9260fd tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:52.035091 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a72c873-0da0-48a4-9304-dcc40a9260fd tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:52.035546 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a72c873-0da0-48a4-9304-dcc40a9260fd tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:52.036601 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a72c873-0da0-48a4-9304-dcc40a9260fd tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:52.037229 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a72c873-0da0-48a4-9304-dcc40a9260fd tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:52.178944 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3a72c873-0da0-48a4-9304-dcc40a9260fd tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:52.187686 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3a72c873-0da0-48a4-9304-dcc40a9260fd tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1515 microversion: 2.1 time: 0.165519 Jun 20 12:50:52.200522 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3482/6864] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:52 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:53.211468 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-eba1e1a3-1e89-4074-a9fb-d6f4fc7d75f3 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:53.212023 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-eba1e1a3-1e89-4074-a9fb-d6f4fc7d75f3 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:53.221409 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eba1e1a3-1e89-4074-a9fb-d6f4fc7d75f3 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:53.221869 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eba1e1a3-1e89-4074-a9fb-d6f4fc7d75f3 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:53.222662 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eba1e1a3-1e89-4074-a9fb-d6f4fc7d75f3 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:53.223108 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eba1e1a3-1e89-4074-a9fb-d6f4fc7d75f3 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:53.380992 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-eba1e1a3-1e89-4074-a9fb-d6f4fc7d75f3 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:53.388738 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-eba1e1a3-1e89-4074-a9fb-d6f4fc7d75f3 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1512 microversion: 2.1 time: 0.181572 Jun 20 12:50:53.389293 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3383/6865] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:53 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1512 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:53.405439 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3de88180-01d5-4ac8-a12c-2d8373efea0b tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:50:53.406022 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3de88180-01d5-4ac8-a12c-2d8373efea0b tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:53.413570 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3de88180-01d5-4ac8-a12c-2d8373efea0b tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:53.414056 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3de88180-01d5-4ac8-a12c-2d8373efea0b tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:53.414827 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3de88180-01d5-4ac8-a12c-2d8373efea0b tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:53.415263 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3de88180-01d5-4ac8-a12c-2d8373efea0b tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:53.480446 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3de88180-01d5-4ac8-a12c-2d8373efea0b tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "POST /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f/action" status: 204 len: 0 microversion: 2.1 time: 0.078601 Jun 20 12:50:53.481020 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3483/6866] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:50:53 2022] POST /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:50:53.490502 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-196abd91-a84b-4724-9120-f8f63697f20f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:53.491429 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-196abd91-a84b-4724-9120-f8f63697f20f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:53.498008 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-196abd91-a84b-4724-9120-f8f63697f20f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:53.498478 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-196abd91-a84b-4724-9120-f8f63697f20f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:53.499261 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-196abd91-a84b-4724-9120-f8f63697f20f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:53.499709 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-196abd91-a84b-4724-9120-f8f63697f20f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:53.714182 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-196abd91-a84b-4724-9120-f8f63697f20f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:53.724974 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-196abd91-a84b-4724-9120-f8f63697f20f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1512 microversion: 2.1 time: 0.238288 Jun 20 12:50:53.725883 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3384/6867] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:53 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1512 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:54.744786 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-302a7360-a680-4e45-9f49-b3feb9e526fa tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:54.746181 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-302a7360-a680-4e45-9f49-b3feb9e526fa tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:54.756233 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-302a7360-a680-4e45-9f49-b3feb9e526fa tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:54.756888 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-302a7360-a680-4e45-9f49-b3feb9e526fa tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:54.757646 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-302a7360-a680-4e45-9f49-b3feb9e526fa tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:54.758298 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-302a7360-a680-4e45-9f49-b3feb9e526fa tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:54.899302 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-121395e7-312a-456b-920c-09abdfc1c713 req-e2cad5af-73d6-48ca-91c7-24d00c149ab5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "638cbaff-03ff-4003-8155-41de3d27ba0f", "name": "network-vif-plugged", "status": "completed", "tag": "e0387b7c-0485-4a80-a4a3-26036092f435"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:50:54.913660 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-121395e7-312a-456b-920c-09abdfc1c713 req-e2cad5af-73d6-48ca-91c7-24d00c149ab5 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:54.915275 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-121395e7-312a-456b-920c-09abdfc1c713 req-e2cad5af-73d6-48ca-91c7-24d00c149ab5 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:54.935516 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-121395e7-312a-456b-920c-09abdfc1c713 req-e2cad5af-73d6-48ca-91c7-24d00c149ab5 service nova] Creating event network-vif-plugged:e0387b7c-0485-4a80-a4a3-26036092f435 for instance 638cbaff-03ff-4003-8155-41de3d27ba0f on n-h2-master-1 Jun 20 12:50:54.941687 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-121395e7-312a-456b-920c-09abdfc1c713 req-e2cad5af-73d6-48ca-91c7-24d00c149ab5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045868 Jun 20 12:50:54.943132 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3385/6868] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:50:54.948464 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-302a7360-a680-4e45-9f49-b3feb9e526fa tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:54.963387 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-302a7360-a680-4e45-9f49-b3feb9e526fa tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1512 microversion: 2.1 time: 0.224611 Jun 20 12:50:54.974333 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3484/6869] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:54 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1512 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:55.982208 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5c2484bd-236d-496d-ab79-775fd38d0807 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:55.982926 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5c2484bd-236d-496d-ab79-775fd38d0807 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:55.991092 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5c2484bd-236d-496d-ab79-775fd38d0807 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:55.991562 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5c2484bd-236d-496d-ab79-775fd38d0807 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:55.992397 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5c2484bd-236d-496d-ab79-775fd38d0807 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:55.992848 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5c2484bd-236d-496d-ab79-775fd38d0807 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:56.151282 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5c2484bd-236d-496d-ab79-775fd38d0807 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:56.160069 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5c2484bd-236d-496d-ab79-775fd38d0807 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1504 microversion: 2.1 time: 0.182144 Jun 20 12:50:56.160689 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3386/6870] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:55 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1504 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:56.177156 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5fa0e74b-539a-4601-9a84-132e904ebd3f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:56.177782 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5fa0e74b-539a-4601-9a84-132e904ebd3f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:56.185033 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5fa0e74b-539a-4601-9a84-132e904ebd3f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:56.185497 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5fa0e74b-539a-4601-9a84-132e904ebd3f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:56.186273 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5fa0e74b-539a-4601-9a84-132e904ebd3f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:56.186710 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5fa0e74b-539a-4601-9a84-132e904ebd3f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:56.190476 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:50:56.333528 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5fa0e74b-539a-4601-9a84-132e904ebd3f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:56.341472 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5fa0e74b-539a-4601-9a84-132e904ebd3f tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1504 microversion: 2.1 time: 0.168393 Jun 20 12:50:56.342094 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3485/6871] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:56 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:56.358297 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d1671b19-4cce-491e-8eea-58b5fc654d57 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:56.358915 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d1671b19-4cce-491e-8eea-58b5fc654d57 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:56.365717 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d1671b19-4cce-491e-8eea-58b5fc654d57 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:56.366235 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d1671b19-4cce-491e-8eea-58b5fc654d57 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:56.367134 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d1671b19-4cce-491e-8eea-58b5fc654d57 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:56.367638 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d1671b19-4cce-491e-8eea-58b5fc654d57 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:56.522843 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d1671b19-4cce-491e-8eea-58b5fc654d57 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:56.533528 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d1671b19-4cce-491e-8eea-58b5fc654d57 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1504 microversion: 2.1 time: 0.178933 Jun 20 12:50:56.534058 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3387/6872] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:56 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:56.554306 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f1d4cd2d-25d0-4529-8c2d-6aa945afe519 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:56.555022 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f1d4cd2d-25d0-4529-8c2d-6aa945afe519 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:56.565697 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f1d4cd2d-25d0-4529-8c2d-6aa945afe519 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:56.566521 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f1d4cd2d-25d0-4529-8c2d-6aa945afe519 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:56.567885 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f1d4cd2d-25d0-4529-8c2d-6aa945afe519 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:56.568771 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f1d4cd2d-25d0-4529-8c2d-6aa945afe519 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:56.600469 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f1d4cd2d-25d0-4529-8c2d-6aa945afe519 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:50:56.689740 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f1d4cd2d-25d0-4529-8c2d-6aa945afe519 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "DELETE /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 204 len: 0 microversion: 2.1 time: 0.142775 Jun 20 12:50:56.694217 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3486/6873] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:50:56 2022] DELETE /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:50:56.707943 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e8b6164e-5abd-4a50-9864-43903b93e1d9 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:56.708551 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e8b6164e-5abd-4a50-9864-43903b93e1d9 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:56.715204 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e8b6164e-5abd-4a50-9864-43903b93e1d9 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:56.715667 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e8b6164e-5abd-4a50-9864-43903b93e1d9 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:56.716509 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e8b6164e-5abd-4a50-9864-43903b93e1d9 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:56.716956 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e8b6164e-5abd-4a50-9864-43903b93e1d9 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:56.749042 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e8b6164e-5abd-4a50-9864-43903b93e1d9 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:50:56.803309 n-d-master-1 devstack@n-api.service[119128]: INFO nova.compute.api [None req-e8b6164e-5abd-4a50-9864-43903b93e1d9 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Instance is already in deleting state, ignoring this request Jun 20 12:50:56.804012 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e8b6164e-5abd-4a50-9864-43903b93e1d9 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "DELETE /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 204 len: 0 microversion: 2.1 time: 0.100474 Jun 20 12:50:56.804657 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3388/6874] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:50:56 2022] DELETE /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 12:50:56.814120 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bbc3f0d3-16fb-42da-8540-bf7060721196 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:56.814828 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bbc3f0d3-16fb-42da-8540-bf7060721196 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:56.821924 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bbc3f0d3-16fb-42da-8540-bf7060721196 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:56.822379 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bbc3f0d3-16fb-42da-8540-bf7060721196 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:56.823151 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bbc3f0d3-16fb-42da-8540-bf7060721196 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:56.823570 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bbc3f0d3-16fb-42da-8540-bf7060721196 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:56.979586 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bbc3f0d3-16fb-42da-8540-bf7060721196 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:56.991860 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bbc3f0d3-16fb-42da-8540-bf7060721196 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1510 microversion: 2.1 time: 0.182136 Jun 20 12:50:56.992688 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3487/6875] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:56 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1510 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:58.013244 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-30a3383f-fccd-4008-bce0-462c7fa43132 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:58.013955 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-30a3383f-fccd-4008-bce0-462c7fa43132 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:58.021887 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-30a3383f-fccd-4008-bce0-462c7fa43132 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:58.022367 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-30a3383f-fccd-4008-bce0-462c7fa43132 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:58.023191 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-30a3383f-fccd-4008-bce0-462c7fa43132 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:58.023659 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-30a3383f-fccd-4008-bce0-462c7fa43132 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:58.175036 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-30a3383f-fccd-4008-bce0-462c7fa43132 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '120cb878f5ce46999ccda36294b94a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6dbb696cbc4887b7b79172d7d08ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:50:58.190331 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-30a3383f-fccd-4008-bce0-462c7fa43132 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 200 len: 1510 microversion: 2.1 time: 0.182143 Jun 20 12:50:58.191034 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3389/6876] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:58 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 1510 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:50:58.789657 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-9a69131b-3f47-4d54-8be1-aa6094b8c30f req-f8550df7-490e-4cc5-a463-240c846fb051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "638cbaff-03ff-4003-8155-41de3d27ba0f", "name": "network-vif-deleted", "tag": "e0387b7c-0485-4a80-a4a3-26036092f435"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:50:58.799882 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-9a69131b-3f47-4d54-8be1-aa6094b8c30f req-f8550df7-490e-4cc5-a463-240c846fb051 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:58.800355 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-9a69131b-3f47-4d54-8be1-aa6094b8c30f req-f8550df7-490e-4cc5-a463-240c846fb051 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:58.813157 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-9a69131b-3f47-4d54-8be1-aa6094b8c30f req-f8550df7-490e-4cc5-a463-240c846fb051 service nova] Creating event network-vif-deleted:e0387b7c-0485-4a80-a4a3-26036092f435 for instance 638cbaff-03ff-4003-8155-41de3d27ba0f on n-h2-master-1 Jun 20 12:50:58.818235 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-9a69131b-3f47-4d54-8be1-aa6094b8c30f req-f8550df7-490e-4cc5-a463-240c846fb051 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032309 Jun 20 12:50:58.818872 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3488/6877] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:50:59.209398 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0c5653f7-b4bd-4c2d-882e-66c5c6a1f64c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:59.210030 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0c5653f7-b4bd-4c2d-882e-66c5c6a1f64c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: 638cbaff-03ff-4003-8155-41de3d27ba0f] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:59.217609 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c5653f7-b4bd-4c2d-882e-66c5c6a1f64c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:59.218057 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c5653f7-b4bd-4c2d-882e-66c5c6a1f64c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:59.219084 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c5653f7-b4bd-4c2d-882e-66c5c6a1f64c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:59.219533 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c5653f7-b4bd-4c2d-882e-66c5c6a1f64c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:59.234263 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-0c5653f7-b4bd-4c2d-882e-66c5c6a1f64c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] HTTP exception thrown: Instance 638cbaff-03ff-4003-8155-41de3d27ba0f could not be found. Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0c5653f7-b4bd-4c2d-882e-66c5c6a1f64c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Request method failure captured: Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f HTTP/1.1 Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGzPzSU3Mrv2NKXEdcnL-ZrxMHjUCXDEvaeEbUhBoqlhNALy-zhydOqdoG68ptOd-Pvbody3kebQjwdDaKkJbcwhZVFNB88gEBjw5UrYIoMVCE96LShuzY_BZ8wG5otrrQ03C1oFntLff6YBFzZX5FYJqB4m6dMgzilJUq9WNj5tghs Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: ec6dbb696cbc4887b7b79172d7d08ecb Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1283334999 Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec6dbb696cbc4887b7b79172d7d08ecb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec6dbb696cbc4887b7b79172d7d08ecb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ec6dbb696cbc4887b7b79172d7d08ecb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ec6dbb696cbc4887b7b79172d7d08ecb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServerDiskConfigTestJSON-1283334999 Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: ec6dbb696cbc4887b7b79172d7d08ecb Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1283334999 Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServerDiskConfigTestJSON-1283334999-project Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 120cb878f5ce46999ccda36294b94a69 Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServerDiskConfigTestJSON-1283334999-project Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 638cbaff-03ff-4003-8155-41de3d27ba0f could not be found. Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '638cbaff-03ff-4003-8155-41de3d27ba0f'} Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 638cbaff-03ff-4003-8155-41de3d27ba0f could not be found. Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 638cbaff-03ff-4003-8155-41de3d27ba0f could not be found. Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:50:59.236473 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:50:59.244373 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:50:59.244373 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:50:59.244373 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:50:59.244373 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:50:59.244373 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:50:59.244373 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 638cbaff-03ff-4003-8155-41de3d27ba0f could not be found. Jun 20 12:50:59.244373 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:50:59.244373 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0c5653f7-b4bd-4c2d-882e-66c5c6a1f64c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Returning 404 to user: Instance 638cbaff-03ff-4003-8155-41de3d27ba0f could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:50:59.244373 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0c5653f7-b4bd-4c2d-882e-66c5c6a1f64c tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f" status: 404 len: 111 microversion: 2.1 time: 0.033322 Jun 20 12:50:59.244373 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3390/6878] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:59 2022] GET /compute/v2.1/servers/638cbaff-03ff-4003-8155-41de3d27ba0f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:50:59.247446 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-32d647df-0b36-47fd-9297-3eee2b148780 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '.version_select at 0x7f6073a8e9d0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:59.272330 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-32d647df-0b36-47fd-9297-3eee2b148780 tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-970853829" status: 202 len: 0 microversion: 2.1 time: 0.028477 Jun 20 12:50:59.274209 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3489/6879] 10.222.0.27 () {58 vars in 1217 bytes} [Mon Jun 20 12:50:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-970853829 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 12:50:59.952711 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fe45f7e2-db41-4ef4-b475-87a37a99152e tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:59.953372 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fe45f7e2-db41-4ef4-b475-87a37a99152e tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:50:59.957053 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=38 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:50:59.962646 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe45f7e2-db41-4ef4-b475-87a37a99152e tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:59.963119 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe45f7e2-db41-4ef4-b475-87a37a99152e tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:59.963991 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe45f7e2-db41-4ef4-b475-87a37a99152e tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:50:59.964598 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe45f7e2-db41-4ef4-b475-87a37a99152e tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:50:59.980112 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-fe45f7e2-db41-4ef4-b475-87a37a99152e tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] HTTP exception thrown: Instance ea1bd972-38e3-40fb-96b9-12089853770b could not be found. Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fe45f7e2-db41-4ef4-b475-87a37a99152e tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Request method failure captured: Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b HTTP/1.1 Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisGzPzSU3Mrv2NKXEdcnL-ZrxMHjUCXDEvaeEbUhBoqlhNALy-zhydOqdoG68ptOd-Pvbody3kebQjwdDaKkJbcwhZVFNB88gEBjw5UrYIoMVCE96LShuzY_BZ8wG5otrrQ03C1oFntLff6YBFzZX5FYJqB4m6dMgzilJUq9WNj5tghs Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: ec6dbb696cbc4887b7b79172d7d08ecb Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1283334999 Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec6dbb696cbc4887b7b79172d7d08ecb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec6dbb696cbc4887b7b79172d7d08ecb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ec6dbb696cbc4887b7b79172d7d08ecb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ec6dbb696cbc4887b7b79172d7d08ecb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServerDiskConfigTestJSON-1283334999 Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: ec6dbb696cbc4887b7b79172d7d08ecb Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1283334999 Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServerDiskConfigTestJSON-1283334999-project Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 120cb878f5ce46999ccda36294b94a69 Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServerDiskConfigTestJSON-1283334999-project Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: exception: Instance ea1bd972-38e3-40fb-96b9-12089853770b could not be found. Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'ea1bd972-38e3-40fb-96b9-12089853770b'} Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea1bd972-38e3-40fb-96b9-12089853770b could not be found. Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:50:59.981779 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:50:59.988222 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea1bd972-38e3-40fb-96b9-12089853770b could not be found. Jun 20 12:50:59.988222 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:50:59.988222 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:50:59.988222 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:50:59.988222 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:50:59.988222 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:50:59.988222 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:50:59.988222 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:50:59.988222 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:50:59.988222 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea1bd972-38e3-40fb-96b9-12089853770b could not be found. Jun 20 12:50:59.988222 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:50:59.988222 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fe45f7e2-db41-4ef4-b475-87a37a99152e tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Returning 404 to user: Instance ea1bd972-38e3-40fb-96b9-12089853770b could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:50:59.988222 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fe45f7e2-db41-4ef4-b475-87a37a99152e tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 404 len: 111 microversion: 2.1 time: 0.041862 Jun 20 12:50:59.988222 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3391/6880] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:50:59 2022] DELETE /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:50:59.994049 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a5017d6f-8a96-48cd-8e99-5b44b02d91ee tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:50:59.994808 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a5017d6f-8a96-48cd-8e99-5b44b02d91ee tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] [instance: ea1bd972-38e3-40fb-96b9-12089853770b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:51:00.004307 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5017d6f-8a96-48cd-8e99-5b44b02d91ee tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:51:00.004761 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5017d6f-8a96-48cd-8e99-5b44b02d91ee tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:51:00.005663 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5017d6f-8a96-48cd-8e99-5b44b02d91ee tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:51:00.006098 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5017d6f-8a96-48cd-8e99-5b44b02d91ee tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:51:00.020912 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-a5017d6f-8a96-48cd-8e99-5b44b02d91ee tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] HTTP exception thrown: Instance ea1bd972-38e3-40fb-96b9-12089853770b could not be found. Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a5017d6f-8a96-48cd-8e99-5b44b02d91ee tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Request method failure captured: Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b HTTP/1.1 Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisGzPzSU3Mrv2NKXEdcnL-ZrxMHjUCXDEvaeEbUhBoqlhNALy-zhydOqdoG68ptOd-Pvbody3kebQjwdDaKkJbcwhZVFNB88gEBjw5UrYIoMVCE96LShuzY_BZ8wG5otrrQ03C1oFntLff6YBFzZX5FYJqB4m6dMgzilJUq9WNj5tghs Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: ec6dbb696cbc4887b7b79172d7d08ecb Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1283334999 Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec6dbb696cbc4887b7b79172d7d08ecb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec6dbb696cbc4887b7b79172d7d08ecb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ec6dbb696cbc4887b7b79172d7d08ecb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ec6dbb696cbc4887b7b79172d7d08ecb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServerDiskConfigTestJSON-1283334999 Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: ec6dbb696cbc4887b7b79172d7d08ecb Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1283334999 Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServerDiskConfigTestJSON-1283334999-project Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 120cb878f5ce46999ccda36294b94a69 Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServerDiskConfigTestJSON-1283334999-project Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: exception: Instance ea1bd972-38e3-40fb-96b9-12089853770b could not be found. Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'ea1bd972-38e3-40fb-96b9-12089853770b'} Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea1bd972-38e3-40fb-96b9-12089853770b could not be found. Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea1bd972-38e3-40fb-96b9-12089853770b could not be found. Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:51:00.022629 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:51:00.026580 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:51:00.026580 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:51:00.026580 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:51:00.026580 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:51:00.026580 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:51:00.026580 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea1bd972-38e3-40fb-96b9-12089853770b could not be found. Jun 20 12:51:00.026580 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:51:00.026580 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a5017d6f-8a96-48cd-8e99-5b44b02d91ee tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] Returning 404 to user: Instance ea1bd972-38e3-40fb-96b9-12089853770b could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:51:00.026580 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a5017d6f-8a96-48cd-8e99-5b44b02d91ee tempest-ServerDiskConfigTestJSON-1283334999 tempest-ServerDiskConfigTestJSON-1283334999-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b" status: 404 len: 111 microversion: 2.1 time: 0.034441 Jun 20 12:51:00.026580 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3490/6881] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:50:59 2022] GET /compute/v2.1/servers/ea1bd972-38e3-40fb-96b9-12089853770b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:51:09.072960 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8bd7b7d0-82c6-4a66-9a63-e71ffdcbf513 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Action: 'create', calling method: .version_select at 0x7f6072559790>, body: {"keypair": {"name": "tempest-keypair-888492200", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU9H7bggmRer3yh6Yx5gQ5FxBIxVucXawMAqqd0QHNz5EI6TKkXqZhfhzEgBsZUsXzf+4kaknOWDlLWkwQruIz2Mc2FvLHnzuYYbgXVdwHWApn8RLHhM7pVZaDWUF4cKQ=="}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:51:09.097657 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-8bd7b7d0-82c6-4a66-9a63-e71ffdcbf513 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Getting quotas for project 57445eadc2e94955963af6c23e797c07. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:51:09.106733 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-8bd7b7d0-82c6-4a66-9a63-e71ffdcbf513 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Getting quotas for user b18cd0c87eed404bb4321acc9762a172 and project 57445eadc2e94955963af6c23e797c07. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:51:09.127319 n-d-master-1 devstack@n-api.service[119128]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8bd7b7d0-82c6-4a66-9a63-e71ffdcbf513 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [35acb0c2-be15-4081-9a9d-0cbf9f7042fc] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 20 12:51:09.971161 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:51:10.136194 n-d-master-1 devstack@n-api.service[119128]: INFO oslo.messaging._drivers.impl_rabbit [None req-8bd7b7d0-82c6-4a66-9a63-e71ffdcbf513 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [35acb0c2-be15-4081-9a9d-0cbf9f7042fc] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 43334. Jun 20 12:51:10.155949 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8bd7b7d0-82c6-4a66-9a63-e71ffdcbf513 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.213443 Jun 20 12:51:10.156817 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3392/6882] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 12:51:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:51:11.513793 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2ac516c9-bcd8-4a0b-9a61-91f2b2804dc0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-222543469", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5b02c936-b353-4cca-83a5-eeaf008c79ad"}], "security_groups": [{"name": "tempest-securitygroup--996108121"}], "key_name": "tempest-keypair-888492200", "user_data": "}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:51:11.525369 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:51:11.526016 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:51:11.645875 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-2ac516c9-bcd8-4a0b-9a61-91f2b2804dc0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] validate_networks() for [('5b02c936-b353-4cca-83a5-eeaf008c79ad', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:51:12.082087 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-2ac516c9-bcd8-4a0b-9a61-91f2b2804dc0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:51:12.082513 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-2ac516c9-bcd8-4a0b-9a61-91f2b2804dc0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:51:12.082985 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-2ac516c9-bcd8-4a0b-9a61-91f2b2804dc0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:51:12.083394 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-2ac516c9-bcd8-4a0b-9a61-91f2b2804dc0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:51:12.083803 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-2ac516c9-bcd8-4a0b-9a61-91f2b2804dc0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:51:12.093230 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2ac516c9-bcd8-4a0b-9a61-91f2b2804dc0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:51:12.093676 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2ac516c9-bcd8-4a0b-9a61-91f2b2804dc0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:51:12.094473 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2ac516c9-bcd8-4a0b-9a61-91f2b2804dc0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:51:12.094992 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2ac516c9-bcd8-4a0b-9a61-91f2b2804dc0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:51:12.113559 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-2ac516c9-bcd8-4a0b-9a61-91f2b2804dc0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Getting quotas for project 57445eadc2e94955963af6c23e797c07. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:51:12.118994 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-2ac516c9-bcd8-4a0b-9a61-91f2b2804dc0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Getting quotas for user b18cd0c87eed404bb4321acc9762a172 and project 57445eadc2e94955963af6c23e797c07. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:51:12.132339 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2ac516c9-bcd8-4a0b-9a61-91f2b2804dc0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:51:12.134654 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2ac516c9-bcd8-4a0b-9a61-91f2b2804dc0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:51:12.185923 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2ac516c9-bcd8-4a0b-9a61-91f2b2804dc0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.676426 Jun 20 12:51:12.187040 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3491/6883] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:51:11 2022] POST /compute/v2.1/servers => generated 408 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:51:12.198155 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3de6c4d4-4ec5-4bbd-939f-b1ab2c1855cd tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:51:12.199491 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3de6c4d4-4ec5-4bbd-939f-b1ab2c1855cd tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:51:12.261273 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3de6c4d4-4ec5-4bbd-939f-b1ab2c1855cd tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:51:12.269766 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3de6c4d4-4ec5-4bbd-939f-b1ab2c1855cd tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 200 len: 1237 microversion: 2.1 time: 0.076421 Jun 20 12:51:12.270366 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3393/6884] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:51:12 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 1237 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:51:13.286376 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1b380eed-5d66-41aa-9aa9-9d86b937a233 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:51:13.286991 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1b380eed-5d66-41aa-9aa9-9d86b937a233 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:51:13.295389 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1b380eed-5d66-41aa-9aa9-9d86b937a233 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:51:13.295844 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1b380eed-5d66-41aa-9aa9-9d86b937a233 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:51:13.296892 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1b380eed-5d66-41aa-9aa9-9d86b937a233 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:51:13.297333 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1b380eed-5d66-41aa-9aa9-9d86b937a233 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:51:13.365855 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1b380eed-5d66-41aa-9aa9-9d86b937a233 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:51:13.375316 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1b380eed-5d66-41aa-9aa9-9d86b937a233 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 200 len: 1297 microversion: 2.1 time: 0.092879 Jun 20 12:51:13.376003 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3492/6885] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:51:13 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 1297 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:51:14.394588 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-20a40f1b-d964-449a-a92c-767fa478a318 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:51:14.395145 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-20a40f1b-d964-449a-a92c-767fa478a318 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:51:14.402684 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-20a40f1b-d964-449a-a92c-767fa478a318 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:51:14.403149 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-20a40f1b-d964-449a-a92c-767fa478a318 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:51:14.403967 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-20a40f1b-d964-449a-a92c-767fa478a318 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:51:14.404467 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-20a40f1b-d964-449a-a92c-767fa478a318 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:51:14.643472 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-20a40f1b-d964-449a-a92c-767fa478a318 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:51:14.653059 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-20a40f1b-d964-449a-a92c-767fa478a318 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 200 len: 1362 microversion: 2.1 time: 0.262395 Jun 20 12:51:14.653504 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3394/6886] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:51:14 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 1362 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:51:14.799134 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-8c8f684c-096e-4dff-8742-971b96faf3a4 req-ccb6598a-da57-4097-9878-d69b606cc382 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10058791-4c6b-4529-a768-09dbf6804441", "tag": "11e85eb6-723d-4d5e-a40c-a7b4e6f6bec1"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:51:14.816433 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-8c8f684c-096e-4dff-8742-971b96faf3a4 req-ccb6598a-da57-4097-9878-d69b606cc382 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:51:14.817287 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-8c8f684c-096e-4dff-8742-971b96faf3a4 req-ccb6598a-da57-4097-9878-d69b606cc382 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:51:14.831088 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-8c8f684c-096e-4dff-8742-971b96faf3a4 req-ccb6598a-da57-4097-9878-d69b606cc382 service nova] Creating event network-changed:11e85eb6-723d-4d5e-a40c-a7b4e6f6bec1 for instance 10058791-4c6b-4529-a768-09dbf6804441 on n-h2-master-1 Jun 20 12:51:14.837069 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-8c8f684c-096e-4dff-8742-971b96faf3a4 req-ccb6598a-da57-4097-9878-d69b606cc382 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041847 Jun 20 12:51:14.841535 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3493/6887] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:51:15.671237 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-25bd4eb9-f616-4a11-9bdb-2dcea369fc3d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:51:15.671862 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-25bd4eb9-f616-4a11-9bdb-2dcea369fc3d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:51:15.679518 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-25bd4eb9-f616-4a11-9bdb-2dcea369fc3d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:51:15.679981 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-25bd4eb9-f616-4a11-9bdb-2dcea369fc3d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:51:15.680793 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-25bd4eb9-f616-4a11-9bdb-2dcea369fc3d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:51:15.681586 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-25bd4eb9-f616-4a11-9bdb-2dcea369fc3d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:51:15.822437 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-25bd4eb9-f616-4a11-9bdb-2dcea369fc3d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:51:15.830270 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-25bd4eb9-f616-4a11-9bdb-2dcea369fc3d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 200 len: 1362 microversion: 2.1 time: 0.163013 Jun 20 12:51:15.830850 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3395/6888] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:51:15 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:51:16.849567 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-00441a05-9e57-44f6-8d68-99365b2e961e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:51:16.850250 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-00441a05-9e57-44f6-8d68-99365b2e961e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:51:16.857288 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-00441a05-9e57-44f6-8d68-99365b2e961e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:51:16.857748 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-00441a05-9e57-44f6-8d68-99365b2e961e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:51:16.858546 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-00441a05-9e57-44f6-8d68-99365b2e961e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:51:16.859012 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-00441a05-9e57-44f6-8d68-99365b2e961e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:51:17.006002 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-00441a05-9e57-44f6-8d68-99365b2e961e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:51:17.016477 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-00441a05-9e57-44f6-8d68-99365b2e961e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 200 len: 1362 microversion: 2.1 time: 0.172574 Jun 20 12:51:17.017010 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3494/6889] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:51:16 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:51:18.035296 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1ad5ea21-8ca8-4281-bec2-e4fb02a31df2 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:51:18.035919 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1ad5ea21-8ca8-4281-bec2-e4fb02a31df2 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:51:18.043537 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1ad5ea21-8ca8-4281-bec2-e4fb02a31df2 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:51:18.043997 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1ad5ea21-8ca8-4281-bec2-e4fb02a31df2 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:51:18.044803 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1ad5ea21-8ca8-4281-bec2-e4fb02a31df2 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:51:18.045247 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1ad5ea21-8ca8-4281-bec2-e4fb02a31df2 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:51:18.191650 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1ad5ea21-8ca8-4281-bec2-e4fb02a31df2 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:51:18.199759 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1ad5ea21-8ca8-4281-bec2-e4fb02a31df2 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 200 len: 1362 microversion: 2.1 time: 0.168822 Jun 20 12:51:18.200477 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3396/6890] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:51:18 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:51:19.217450 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6e4c4506-a2e1-40fe-96f2-a3542a454c62 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:51:19.218025 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6e4c4506-a2e1-40fe-96f2-a3542a454c62 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:51:19.226127 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6e4c4506-a2e1-40fe-96f2-a3542a454c62 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:51:19.226580 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6e4c4506-a2e1-40fe-96f2-a3542a454c62 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:51:19.227458 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6e4c4506-a2e1-40fe-96f2-a3542a454c62 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:51:19.228671 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6e4c4506-a2e1-40fe-96f2-a3542a454c62 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:51:19.362491 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6e4c4506-a2e1-40fe-96f2-a3542a454c62 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:51:19.370133 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6e4c4506-a2e1-40fe-96f2-a3542a454c62 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 200 len: 1362 microversion: 2.1 time: 0.156644 Jun 20 12:51:19.370772 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3495/6891] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:51:19 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:51:20.389766 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5ae20c03-d217-4e90-b3c2-85529035a82d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:51:20.390379 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5ae20c03-d217-4e90-b3c2-85529035a82d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:51:20.401757 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5ae20c03-d217-4e90-b3c2-85529035a82d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:51:20.402330 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5ae20c03-d217-4e90-b3c2-85529035a82d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:51:20.403485 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5ae20c03-d217-4e90-b3c2-85529035a82d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:51:20.404127 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5ae20c03-d217-4e90-b3c2-85529035a82d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:51:20.553555 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5ae20c03-d217-4e90-b3c2-85529035a82d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:51:20.561943 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5ae20c03-d217-4e90-b3c2-85529035a82d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 200 len: 1362 microversion: 2.1 time: 0.178308 Jun 20 12:51:20.562495 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3397/6892] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:51:20 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:51:20.854814 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-8ae144c3-0425-422f-9fde-42080ff05aa9 req-eedd3512-8844-4b44-bba3-76aabdcf8d06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10058791-4c6b-4529-a768-09dbf6804441", "name": "network-vif-plugged", "status": "completed", "tag": "11e85eb6-723d-4d5e-a40c-a7b4e6f6bec1"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:51:20.866407 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-8ae144c3-0425-422f-9fde-42080ff05aa9 req-eedd3512-8844-4b44-bba3-76aabdcf8d06 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:51:20.866837 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-8ae144c3-0425-422f-9fde-42080ff05aa9 req-eedd3512-8844-4b44-bba3-76aabdcf8d06 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:51:20.879327 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-8ae144c3-0425-422f-9fde-42080ff05aa9 req-eedd3512-8844-4b44-bba3-76aabdcf8d06 service nova] Creating event network-vif-plugged:11e85eb6-723d-4d5e-a40c-a7b4e6f6bec1 for instance 10058791-4c6b-4529-a768-09dbf6804441 on n-h2-master-1 Jun 20 12:51:20.885067 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-8ae144c3-0425-422f-9fde-42080ff05aa9 req-eedd3512-8844-4b44-bba3-76aabdcf8d06 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036073 Jun 20 12:51:20.885998 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3496/6893] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:51:21.582231 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b9348fbb-73cf-4013-9a63-8a1648ce9592 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:51:21.583203 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b9348fbb-73cf-4013-9a63-8a1648ce9592 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:51:21.591527 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b9348fbb-73cf-4013-9a63-8a1648ce9592 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:51:21.591992 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b9348fbb-73cf-4013-9a63-8a1648ce9592 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:51:21.592821 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b9348fbb-73cf-4013-9a63-8a1648ce9592 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:51:21.593262 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b9348fbb-73cf-4013-9a63-8a1648ce9592 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:51:21.747397 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b9348fbb-73cf-4013-9a63-8a1648ce9592 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:51:21.755193 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b9348fbb-73cf-4013-9a63-8a1648ce9592 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 200 len: 1362 microversion: 2.1 time: 0.178953 Jun 20 12:51:21.755764 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3398/6894] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:51:21 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:51:22.772893 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:51:22.773892 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:51:22.777977 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-083e34bd-2e91-4920-bece-f0a0f4dd1d47 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:51:22.778674 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-083e34bd-2e91-4920-bece-f0a0f4dd1d47 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:51:22.786059 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-083e34bd-2e91-4920-bece-f0a0f4dd1d47 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:51:22.786505 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-083e34bd-2e91-4920-bece-f0a0f4dd1d47 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:51:22.787271 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-083e34bd-2e91-4920-bece-f0a0f4dd1d47 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:51:22.787703 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-083e34bd-2e91-4920-bece-f0a0f4dd1d47 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:51:22.938255 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-083e34bd-2e91-4920-bece-f0a0f4dd1d47 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:51:22.947067 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-083e34bd-2e91-4920-bece-f0a0f4dd1d47 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 200 len: 1549 microversion: 2.1 time: 0.177160 Jun 20 12:51:22.947647 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3497/6895] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:51:22 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 1549 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:51:22.963953 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8c6c3c76-7ebc-4662-ad69-ce08c7ee8046 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:51:22.964526 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8c6c3c76-7ebc-4662-ad69-ce08c7ee8046 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:51:22.966408 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:51:22.972995 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8c6c3c76-7ebc-4662-ad69-ce08c7ee8046 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:51:22.973477 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8c6c3c76-7ebc-4662-ad69-ce08c7ee8046 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:51:22.974261 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8c6c3c76-7ebc-4662-ad69-ce08c7ee8046 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:51:22.974709 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8c6c3c76-7ebc-4662-ad69-ce08c7ee8046 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:51:23.056753 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8c6c3c76-7ebc-4662-ad69-ce08c7ee8046 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096595 Jun 20 12:51:23.057365 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3399/6896] 10.222.0.27 () {58 vars in 1274 bytes} [Mon Jun 20 12:51:22 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:51:24.053539 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-c9088ea3-69ba-492e-9724-2b1f33714bc7 req-affa7a47-11d9-48c2-9a52-f4a442c3789d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10058791-4c6b-4529-a768-09dbf6804441", "tag": "11e85eb6-723d-4d5e-a40c-a7b4e6f6bec1"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:51:24.063996 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-c9088ea3-69ba-492e-9724-2b1f33714bc7 req-affa7a47-11d9-48c2-9a52-f4a442c3789d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:51:24.064479 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-c9088ea3-69ba-492e-9724-2b1f33714bc7 req-affa7a47-11d9-48c2-9a52-f4a442c3789d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:51:24.076284 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-c9088ea3-69ba-492e-9724-2b1f33714bc7 req-affa7a47-11d9-48c2-9a52-f4a442c3789d service nova] Creating event network-changed:11e85eb6-723d-4d5e-a40c-a7b4e6f6bec1 for instance 10058791-4c6b-4529-a768-09dbf6804441 on n-h2-master-1 Jun 20 12:51:24.081671 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-c9088ea3-69ba-492e-9724-2b1f33714bc7 req-affa7a47-11d9-48c2-9a52-f4a442c3789d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031854 Jun 20 12:51:24.082346 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3498/6897] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:52:28.838081 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:52:28.838862 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=34 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:52:28.843635 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-332325c7-cdcf-4dee-94a5-ceceab9fdc46 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:52:28.844281 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-332325c7-cdcf-4dee-94a5-ceceab9fdc46 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:52:28.852004 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-332325c7-cdcf-4dee-94a5-ceceab9fdc46 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:28.852524 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-332325c7-cdcf-4dee-94a5-ceceab9fdc46 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:28.853311 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-332325c7-cdcf-4dee-94a5-ceceab9fdc46 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:28.853759 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-332325c7-cdcf-4dee-94a5-ceceab9fdc46 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:29.064476 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-332325c7-cdcf-4dee-94a5-ceceab9fdc46 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:52:29.072781 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-332325c7-cdcf-4dee-94a5-ceceab9fdc46 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 200 len: 1668 microversion: 2.1 time: 0.237542 Jun 20 12:52:29.073363 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3400/6898] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:52:28 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 1668 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:52:29.089622 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:52:29.090309 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=32 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:52:29.095272 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-75f4a96e-35df-4ea9-a900-5c7e80dbe904 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:52:29.096006 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-75f4a96e-35df-4ea9-a900-5c7e80dbe904 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:52:29.104533 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-75f4a96e-35df-4ea9-a900-5c7e80dbe904 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:29.104992 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-75f4a96e-35df-4ea9-a900-5c7e80dbe904 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:29.105802 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-75f4a96e-35df-4ea9-a900-5c7e80dbe904 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:29.106248 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-75f4a96e-35df-4ea9-a900-5c7e80dbe904 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:29.247255 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-75f4a96e-35df-4ea9-a900-5c7e80dbe904 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:52:29.260919 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-75f4a96e-35df-4ea9-a900-5c7e80dbe904 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 200 len: 1668 microversion: 2.1 time: 0.174320 Jun 20 12:52:29.261527 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3499/6899] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:52:29 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 1668 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:52:29.280054 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8234e149-afbb-46e0-990a-92433337e04c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:52:29.280697 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8234e149-afbb-46e0-990a-92433337e04c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:52:29.287302 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8234e149-afbb-46e0-990a-92433337e04c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:29.287769 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8234e149-afbb-46e0-990a-92433337e04c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:29.288557 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8234e149-afbb-46e0-990a-92433337e04c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:29.289001 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8234e149-afbb-46e0-990a-92433337e04c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:29.447189 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8234e149-afbb-46e0-990a-92433337e04c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:52:29.454885 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8234e149-afbb-46e0-990a-92433337e04c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 200 len: 1668 microversion: 2.1 time: 0.179260 Jun 20 12:52:29.455456 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3401/6900] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:52:29 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 1668 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:52:29.478025 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a9d4d874-d06f-4b02-8311-33d4486eee03 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:52:29.479026 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a9d4d874-d06f-4b02-8311-33d4486eee03 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:52:29.485784 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a9d4d874-d06f-4b02-8311-33d4486eee03 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:29.486233 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a9d4d874-d06f-4b02-8311-33d4486eee03 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:29.486996 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a9d4d874-d06f-4b02-8311-33d4486eee03 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:29.487432 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a9d4d874-d06f-4b02-8311-33d4486eee03 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:29.564912 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a9d4d874-d06f-4b02-8311-33d4486eee03 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:52:29.571157 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a9d4d874-d06f-4b02-8311-33d4486eee03 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Old instance type m1.heat2, new instance type m1.heat {{(pid=119127) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 20 12:52:29.577865 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-a9d4d874-d06f-4b02-8311-33d4486eee03 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:52:29.578281 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-a9d4d874-d06f-4b02-8311-33d4486eee03 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:52:29.578755 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-a9d4d874-d06f-4b02-8311-33d4486eee03 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:52:29.579160 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-a9d4d874-d06f-4b02-8311-33d4486eee03 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:52:29.579569 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-a9d4d874-d06f-4b02-8311-33d4486eee03 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:52:29.689223 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a9d4d874-d06f-4b02-8311-33d4486eee03 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "POST /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441/action" status: 202 len: 0 microversion: 2.1 time: 0.215113 Jun 20 12:52:29.689506 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3500/6901] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:52:29 2022] POST /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:52:29.699228 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2f504081-571e-411f-b80e-e09b768b936b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:52:29.699860 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2f504081-571e-411f-b80e-e09b768b936b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:52:29.707139 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2f504081-571e-411f-b80e-e09b768b936b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:29.707594 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2f504081-571e-411f-b80e-e09b768b936b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:29.708490 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2f504081-571e-411f-b80e-e09b768b936b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:29.709093 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2f504081-571e-411f-b80e-e09b768b936b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:29.898361 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2f504081-571e-411f-b80e-e09b768b936b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:52:29.908252 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2f504081-571e-411f-b80e-e09b768b936b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 200 len: 1677 microversion: 2.1 time: 0.213496 Jun 20 12:52:29.909205 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3402/6902] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:52:29 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 1677 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:52:30.933079 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5a3caef7-8518-4696-a8b9-ce62f4030012 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:52:30.934571 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5a3caef7-8518-4696-a8b9-ce62f4030012 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:52:30.941899 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5a3caef7-8518-4696-a8b9-ce62f4030012 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:30.942350 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5a3caef7-8518-4696-a8b9-ce62f4030012 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:30.943326 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5a3caef7-8518-4696-a8b9-ce62f4030012 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:30.943945 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5a3caef7-8518-4696-a8b9-ce62f4030012 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:31.080683 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5a3caef7-8518-4696-a8b9-ce62f4030012 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:52:31.088981 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5a3caef7-8518-4696-a8b9-ce62f4030012 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 200 len: 1677 microversion: 2.1 time: 0.163758 Jun 20 12:52:31.089603 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3501/6903] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:52:30 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:52:32.109839 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4fa1b8ed-39c0-49c3-addd-81ed857203a0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:52:32.110864 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4fa1b8ed-39c0-49c3-addd-81ed857203a0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:52:32.119498 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4fa1b8ed-39c0-49c3-addd-81ed857203a0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:32.119951 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4fa1b8ed-39c0-49c3-addd-81ed857203a0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:32.120745 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4fa1b8ed-39c0-49c3-addd-81ed857203a0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:32.121189 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4fa1b8ed-39c0-49c3-addd-81ed857203a0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:32.259041 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4fa1b8ed-39c0-49c3-addd-81ed857203a0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:52:32.266819 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4fa1b8ed-39c0-49c3-addd-81ed857203a0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 200 len: 1682 microversion: 2.1 time: 0.163756 Jun 20 12:52:32.267399 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3403/6904] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:52:32 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:52:33.288529 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1fbc9d2d-7c87-4e62-81ef-43ff9cce0570 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:52:33.289367 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1fbc9d2d-7c87-4e62-81ef-43ff9cce0570 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:52:33.297179 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1fbc9d2d-7c87-4e62-81ef-43ff9cce0570 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:33.297634 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1fbc9d2d-7c87-4e62-81ef-43ff9cce0570 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:33.298420 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1fbc9d2d-7c87-4e62-81ef-43ff9cce0570 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:33.298862 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1fbc9d2d-7c87-4e62-81ef-43ff9cce0570 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:33.436128 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1fbc9d2d-7c87-4e62-81ef-43ff9cce0570 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:52:33.444500 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1fbc9d2d-7c87-4e62-81ef-43ff9cce0570 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 200 len: 1682 microversion: 2.1 time: 0.161258 Jun 20 12:52:33.445072 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3502/6905] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:52:33 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:52:34.462215 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-893201a6-a2ae-4e49-bb1e-34f783195920 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:52:34.462827 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-893201a6-a2ae-4e49-bb1e-34f783195920 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:52:34.470336 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-893201a6-a2ae-4e49-bb1e-34f783195920 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:34.470806 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-893201a6-a2ae-4e49-bb1e-34f783195920 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:34.471618 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-893201a6-a2ae-4e49-bb1e-34f783195920 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:34.472098 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-893201a6-a2ae-4e49-bb1e-34f783195920 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:34.617772 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-893201a6-a2ae-4e49-bb1e-34f783195920 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:52:34.626142 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-893201a6-a2ae-4e49-bb1e-34f783195920 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 200 len: 1682 microversion: 2.1 time: 0.168056 Jun 20 12:52:34.626702 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3404/6906] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:52:34 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:52:35.646134 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c034ac6d-99a8-420a-a40d-7a415ec14a43 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:52:35.647032 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c034ac6d-99a8-420a-a40d-7a415ec14a43 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:52:35.654942 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c034ac6d-99a8-420a-a40d-7a415ec14a43 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:35.655385 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c034ac6d-99a8-420a-a40d-7a415ec14a43 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:35.656180 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c034ac6d-99a8-420a-a40d-7a415ec14a43 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:35.656650 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c034ac6d-99a8-420a-a40d-7a415ec14a43 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:35.803580 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c034ac6d-99a8-420a-a40d-7a415ec14a43 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:52:35.813037 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c034ac6d-99a8-420a-a40d-7a415ec14a43 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 200 len: 1682 microversion: 2.1 time: 0.172345 Jun 20 12:52:35.816375 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3503/6907] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:52:35 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:52:36.831414 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2a29951a-d2f6-41d3-8d69-4f4050fadeb5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:52:36.832109 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2a29951a-d2f6-41d3-8d69-4f4050fadeb5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:52:36.842056 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a29951a-d2f6-41d3-8d69-4f4050fadeb5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:36.842817 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a29951a-d2f6-41d3-8d69-4f4050fadeb5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:36.844095 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a29951a-d2f6-41d3-8d69-4f4050fadeb5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:36.844875 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a29951a-d2f6-41d3-8d69-4f4050fadeb5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:36.994724 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2a29951a-d2f6-41d3-8d69-4f4050fadeb5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:52:37.003364 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2a29951a-d2f6-41d3-8d69-4f4050fadeb5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 200 len: 1682 microversion: 2.1 time: 0.176411 Jun 20 12:52:37.003794 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3405/6908] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:52:36 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:52:38.022513 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-de07fbb2-4c03-465a-b318-7487c0f82239 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:52:38.023148 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-de07fbb2-4c03-465a-b318-7487c0f82239 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:52:38.030495 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-de07fbb2-4c03-465a-b318-7487c0f82239 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:38.030944 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-de07fbb2-4c03-465a-b318-7487c0f82239 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:38.031723 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-de07fbb2-4c03-465a-b318-7487c0f82239 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:38.032156 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-de07fbb2-4c03-465a-b318-7487c0f82239 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:38.171028 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-de07fbb2-4c03-465a-b318-7487c0f82239 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:52:38.183013 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-de07fbb2-4c03-465a-b318-7487c0f82239 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 200 len: 1682 microversion: 2.1 time: 0.165058 Jun 20 12:52:38.183941 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3504/6909] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:52:38 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:52:39.201369 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b3947463-74e6-4237-89d9-a1342a482830 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:52:39.201956 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b3947463-74e6-4237-89d9-a1342a482830 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:52:39.209444 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b3947463-74e6-4237-89d9-a1342a482830 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:39.209911 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b3947463-74e6-4237-89d9-a1342a482830 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:39.210701 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b3947463-74e6-4237-89d9-a1342a482830 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:39.211278 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b3947463-74e6-4237-89d9-a1342a482830 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:39.624735 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b3947463-74e6-4237-89d9-a1342a482830 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:52:39.633556 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b3947463-74e6-4237-89d9-a1342a482830 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 200 len: 1682 microversion: 2.1 time: 0.436018 Jun 20 12:52:39.634368 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3406/6910] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:52:39 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 1682 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:52:40.651465 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9758d497-0678-4a2b-bcc7-727fe887635b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:52:40.652099 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9758d497-0678-4a2b-bcc7-727fe887635b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:52:40.659673 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9758d497-0678-4a2b-bcc7-727fe887635b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:40.660129 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9758d497-0678-4a2b-bcc7-727fe887635b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:40.660981 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9758d497-0678-4a2b-bcc7-727fe887635b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:40.661392 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9758d497-0678-4a2b-bcc7-727fe887635b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:40.812691 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9758d497-0678-4a2b-bcc7-727fe887635b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:52:40.823914 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9758d497-0678-4a2b-bcc7-727fe887635b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 200 len: 1682 microversion: 2.1 time: 0.176273 Jun 20 12:52:40.824690 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3505/6911] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:52:40 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:52:41.845830 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2249f184-1f21-4df7-bf32-88ec4f552481 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:52:41.846483 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2249f184-1f21-4df7-bf32-88ec4f552481 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:52:41.856818 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2249f184-1f21-4df7-bf32-88ec4f552481 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:41.857280 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2249f184-1f21-4df7-bf32-88ec4f552481 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:41.858071 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2249f184-1f21-4df7-bf32-88ec4f552481 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:41.858515 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2249f184-1f21-4df7-bf32-88ec4f552481 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:42.017148 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2249f184-1f21-4df7-bf32-88ec4f552481 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:52:42.026847 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2249f184-1f21-4df7-bf32-88ec4f552481 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 200 len: 1682 microversion: 2.1 time: 0.185737 Jun 20 12:52:42.027525 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3407/6912] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:52:41 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 1682 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:52:43.044441 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b95a8918-a815-4fa0-b9f2-08d0010f4e11 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:52:43.045034 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b95a8918-a815-4fa0-b9f2-08d0010f4e11 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:52:43.052527 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b95a8918-a815-4fa0-b9f2-08d0010f4e11 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:43.052996 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b95a8918-a815-4fa0-b9f2-08d0010f4e11 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:43.054297 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b95a8918-a815-4fa0-b9f2-08d0010f4e11 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:43.054432 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b95a8918-a815-4fa0-b9f2-08d0010f4e11 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:43.193096 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b95a8918-a815-4fa0-b9f2-08d0010f4e11 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:52:43.201280 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b95a8918-a815-4fa0-b9f2-08d0010f4e11 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 200 len: 1682 microversion: 2.1 time: 0.160778 Jun 20 12:52:43.201885 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3506/6913] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:52:43 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:52:44.219949 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c6c645a9-f51f-4b6c-9769-6b86b89f5431 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:52:44.220541 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c6c645a9-f51f-4b6c-9769-6b86b89f5431 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:52:44.228014 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c6c645a9-f51f-4b6c-9769-6b86b89f5431 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:44.228916 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c6c645a9-f51f-4b6c-9769-6b86b89f5431 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:44.229310 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c6c645a9-f51f-4b6c-9769-6b86b89f5431 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:44.229765 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c6c645a9-f51f-4b6c-9769-6b86b89f5431 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:44.465493 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c6c645a9-f51f-4b6c-9769-6b86b89f5431 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:52:44.476833 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c6c645a9-f51f-4b6c-9769-6b86b89f5431 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 200 len: 1681 microversion: 2.1 time: 0.261207 Jun 20 12:52:44.477325 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3408/6914] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:52:44 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 1681 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:52:44.495898 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-c540faf3-766c-4b6c-a9f9-b9d575b5a4e4 req-49d96367-46cb-462d-8175-52147a5c4da5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10058791-4c6b-4529-a768-09dbf6804441", "name": "network-vif-unplugged", "status": "completed", "tag": "11e85eb6-723d-4d5e-a40c-a7b4e6f6bec1"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:52:44.511527 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-c540faf3-766c-4b6c-a9f9-b9d575b5a4e4 req-49d96367-46cb-462d-8175-52147a5c4da5 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:44.512125 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-c540faf3-766c-4b6c-a9f9-b9d575b5a4e4 req-49d96367-46cb-462d-8175-52147a5c4da5 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:44.530412 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-c540faf3-766c-4b6c-a9f9-b9d575b5a4e4 req-49d96367-46cb-462d-8175-52147a5c4da5 service nova] Creating event network-vif-unplugged:11e85eb6-723d-4d5e-a40c-a7b4e6f6bec1 for instance 10058791-4c6b-4529-a768-09dbf6804441 on n-h1-master-1 Jun 20 12:52:44.537213 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [req-c540faf3-766c-4b6c-a9f9-b9d575b5a4e4 req-49d96367-46cb-462d-8175-52147a5c4da5 service nova] Instance 10058791-4c6b-4529-a768-09dbf6804441 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119127) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:52:44.552415 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-c540faf3-766c-4b6c-a9f9-b9d575b5a4e4 req-49d96367-46cb-462d-8175-52147a5c4da5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063864 Jun 20 12:52:44.553259 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3507/6915] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:52:45.495786 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-df00669a-b22c-4083-b3fe-a1dd0295c5bf tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:52:45.496711 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-df00669a-b22c-4083-b3fe-a1dd0295c5bf tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:52:45.504028 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-df00669a-b22c-4083-b3fe-a1dd0295c5bf tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:45.504759 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-df00669a-b22c-4083-b3fe-a1dd0295c5bf tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:45.505711 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-df00669a-b22c-4083-b3fe-a1dd0295c5bf tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:45.506163 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-df00669a-b22c-4083-b3fe-a1dd0295c5bf tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:45.742547 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-df00669a-b22c-4083-b3fe-a1dd0295c5bf tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:52:45.751605 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-df00669a-b22c-4083-b3fe-a1dd0295c5bf tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 200 len: 1681 microversion: 2.1 time: 0.259637 Jun 20 12:52:45.752223 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3409/6916] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:52:45 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 1681 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:52:46.575547 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-e04d85ec-3907-4757-b1a7-9348386d19be req-2784f4a4-eddd-402e-9010-3633442d7b27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10058791-4c6b-4529-a768-09dbf6804441", "tag": "11e85eb6-723d-4d5e-a40c-a7b4e6f6bec1"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:52:46.585369 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-e04d85ec-3907-4757-b1a7-9348386d19be req-2784f4a4-eddd-402e-9010-3633442d7b27 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:46.585865 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-e04d85ec-3907-4757-b1a7-9348386d19be req-2784f4a4-eddd-402e-9010-3633442d7b27 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:46.598763 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-e04d85ec-3907-4757-b1a7-9348386d19be req-2784f4a4-eddd-402e-9010-3633442d7b27 service nova] Creating event network-changed:11e85eb6-723d-4d5e-a40c-a7b4e6f6bec1 for instance 10058791-4c6b-4529-a768-09dbf6804441 on n-h1-master-1 Jun 20 12:52:46.604667 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [req-e04d85ec-3907-4757-b1a7-9348386d19be req-2784f4a4-eddd-402e-9010-3633442d7b27 service nova] Instance 10058791-4c6b-4529-a768-09dbf6804441 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119127) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:52:46.615865 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-e04d85ec-3907-4757-b1a7-9348386d19be req-2784f4a4-eddd-402e-9010-3633442d7b27 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046165 Jun 20 12:52:46.616633 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3508/6917] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:52:46.769733 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a8ae393b-e648-42bb-831a-860f325902f9 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:52:46.771479 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a8ae393b-e648-42bb-831a-860f325902f9 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:52:46.777511 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a8ae393b-e648-42bb-831a-860f325902f9 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:46.777990 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a8ae393b-e648-42bb-831a-860f325902f9 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:46.778794 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a8ae393b-e648-42bb-831a-860f325902f9 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:46.779244 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a8ae393b-e648-42bb-831a-860f325902f9 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:47.049845 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a8ae393b-e648-42bb-831a-860f325902f9 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:52:47.060002 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a8ae393b-e648-42bb-831a-860f325902f9 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 200 len: 1679 microversion: 2.1 time: 0.294599 Jun 20 12:52:47.060606 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3410/6918] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:52:46 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 1679 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:52:48.083547 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cd66f6c1-aaeb-45a0-9222-1ee97112cab9 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:52:48.084327 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cd66f6c1-aaeb-45a0-9222-1ee97112cab9 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:52:48.091541 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cd66f6c1-aaeb-45a0-9222-1ee97112cab9 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:48.092341 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cd66f6c1-aaeb-45a0-9222-1ee97112cab9 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:48.093240 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cd66f6c1-aaeb-45a0-9222-1ee97112cab9 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:48.093778 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cd66f6c1-aaeb-45a0-9222-1ee97112cab9 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:48.238569 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cd66f6c1-aaeb-45a0-9222-1ee97112cab9 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:52:48.247226 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cd66f6c1-aaeb-45a0-9222-1ee97112cab9 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 200 len: 1676 microversion: 2.1 time: 0.168897 Jun 20 12:52:48.247861 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3509/6919] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:52:48 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:52:48.264338 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e2f7c1a1-5fd1-486f-8d49-fd0f1ac82b22 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:52:48.264903 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e2f7c1a1-5fd1-486f-8d49-fd0f1ac82b22 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:52:48.272017 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e2f7c1a1-5fd1-486f-8d49-fd0f1ac82b22 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:48.272527 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e2f7c1a1-5fd1-486f-8d49-fd0f1ac82b22 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:48.273324 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e2f7c1a1-5fd1-486f-8d49-fd0f1ac82b22 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:48.273781 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e2f7c1a1-5fd1-486f-8d49-fd0f1ac82b22 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:48.335943 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e2f7c1a1-5fd1-486f-8d49-fd0f1ac82b22 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "POST /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441/action" status: 204 len: 0 microversion: 2.1 time: 0.075368 Jun 20 12:52:48.336683 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3411/6920] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:52:48 2022] POST /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:52:48.346065 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-faf6bb38-78e5-4520-94b1-39788bf177a1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:52:48.347747 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-faf6bb38-78e5-4520-94b1-39788bf177a1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:52:48.357570 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-faf6bb38-78e5-4520-94b1-39788bf177a1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:48.358169 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-faf6bb38-78e5-4520-94b1-39788bf177a1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:48.359171 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-faf6bb38-78e5-4520-94b1-39788bf177a1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:48.359700 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-faf6bb38-78e5-4520-94b1-39788bf177a1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:48.510364 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-faf6bb38-78e5-4520-94b1-39788bf177a1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:52:48.518263 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-faf6bb38-78e5-4520-94b1-39788bf177a1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 200 len: 1676 microversion: 2.1 time: 0.177256 Jun 20 12:52:48.519045 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3510/6921] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:52:48 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 1676 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:52:49.216405 n-d-master-1 devstack@n-api.service[119128]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 12:52:49.216590 n-d-master-1 devstack@n-api.service[119128]: Mon Jun 20 12:52:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 12:52:49.541083 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d1890a6c-64af-4639-a693-f0a6c255d164 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:52:49.541836 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d1890a6c-64af-4639-a693-f0a6c255d164 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:52:49.549379 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d1890a6c-64af-4639-a693-f0a6c255d164 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:49.549841 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d1890a6c-64af-4639-a693-f0a6c255d164 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:49.550628 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d1890a6c-64af-4639-a693-f0a6c255d164 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:49.551077 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d1890a6c-64af-4639-a693-f0a6c255d164 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:49.712329 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d1890a6c-64af-4639-a693-f0a6c255d164 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:52:49.720305 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d1890a6c-64af-4639-a693-f0a6c255d164 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 200 len: 1676 microversion: 2.1 time: 0.186402 Jun 20 12:52:49.720886 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3412/6922] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:52:49 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 1676 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:52:50.050988 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-da8fd8c7-7d21-4dd2-8be2-9e1c5a709baf req-9d948517-d71c-4a96-a474-33b437ab3a69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10058791-4c6b-4529-a768-09dbf6804441", "name": "network-vif-plugged", "status": "completed", "tag": "11e85eb6-723d-4d5e-a40c-a7b4e6f6bec1"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:52:50.060532 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-da8fd8c7-7d21-4dd2-8be2-9e1c5a709baf req-9d948517-d71c-4a96-a474-33b437ab3a69 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:50.061211 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-da8fd8c7-7d21-4dd2-8be2-9e1c5a709baf req-9d948517-d71c-4a96-a474-33b437ab3a69 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:50.073990 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-da8fd8c7-7d21-4dd2-8be2-9e1c5a709baf req-9d948517-d71c-4a96-a474-33b437ab3a69 service nova] Creating event network-vif-plugged:11e85eb6-723d-4d5e-a40c-a7b4e6f6bec1 for instance 10058791-4c6b-4529-a768-09dbf6804441 on n-h1-master-1 Jun 20 12:52:50.079027 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-da8fd8c7-7d21-4dd2-8be2-9e1c5a709baf req-9d948517-d71c-4a96-a474-33b437ab3a69 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121756 Jun 20 12:52:50.079586 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3511/6923] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:52:50.737772 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7dc36aac-7efe-463d-8a4e-5af647de2667 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:52:50.738430 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7dc36aac-7efe-463d-8a4e-5af647de2667 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:52:50.746920 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7dc36aac-7efe-463d-8a4e-5af647de2667 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:50.747329 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7dc36aac-7efe-463d-8a4e-5af647de2667 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:50.748114 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7dc36aac-7efe-463d-8a4e-5af647de2667 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:50.748628 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7dc36aac-7efe-463d-8a4e-5af647de2667 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:50.887395 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7dc36aac-7efe-463d-8a4e-5af647de2667 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:52:50.895387 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7dc36aac-7efe-463d-8a4e-5af647de2667 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 200 len: 1668 microversion: 2.1 time: 0.161588 Jun 20 12:52:50.895954 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3413/6924] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:52:50 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 1668 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:52:50.912388 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e0a919cf-dd08-4ab2-b024-46297ea3eaa0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:52:50.913120 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e0a919cf-dd08-4ab2-b024-46297ea3eaa0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:52:50.920049 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e0a919cf-dd08-4ab2-b024-46297ea3eaa0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:50.920533 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e0a919cf-dd08-4ab2-b024-46297ea3eaa0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:50.921312 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e0a919cf-dd08-4ab2-b024-46297ea3eaa0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:50.921752 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e0a919cf-dd08-4ab2-b024-46297ea3eaa0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:51.065690 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e0a919cf-dd08-4ab2-b024-46297ea3eaa0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:52:51.075600 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e0a919cf-dd08-4ab2-b024-46297ea3eaa0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 200 len: 1668 microversion: 2.1 time: 0.167522 Jun 20 12:52:51.076196 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3512/6925] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:52:50 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 1668 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:52:51.095071 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-77a13db1-27b5-4edd-a3e4-2bd5dee9a9fe tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:52:51.095982 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-77a13db1-27b5-4edd-a3e4-2bd5dee9a9fe tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:52:51.103724 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-77a13db1-27b5-4edd-a3e4-2bd5dee9a9fe tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:51.104187 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-77a13db1-27b5-4edd-a3e4-2bd5dee9a9fe tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:51.105001 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-77a13db1-27b5-4edd-a3e4-2bd5dee9a9fe tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:51.105451 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-77a13db1-27b5-4edd-a3e4-2bd5dee9a9fe tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:51.249492 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-77a13db1-27b5-4edd-a3e4-2bd5dee9a9fe tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:52:51.257809 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-77a13db1-27b5-4edd-a3e4-2bd5dee9a9fe tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 200 len: 1668 microversion: 2.1 time: 0.168517 Jun 20 12:52:51.258376 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3414/6926] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:52:51 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 1668 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:52:51.276838 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c8fcfe4d-7ee3-4325-b17d-72fdaae9e825 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:52:51.277410 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c8fcfe4d-7ee3-4325-b17d-72fdaae9e825 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:52:51.284532 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c8fcfe4d-7ee3-4325-b17d-72fdaae9e825 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:51.284994 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c8fcfe4d-7ee3-4325-b17d-72fdaae9e825 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:51.285772 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c8fcfe4d-7ee3-4325-b17d-72fdaae9e825 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:51.286218 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c8fcfe4d-7ee3-4325-b17d-72fdaae9e825 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:51.314383 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c8fcfe4d-7ee3-4325-b17d-72fdaae9e825 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:52:51.370831 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:52:51.400289 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c8fcfe4d-7ee3-4325-b17d-72fdaae9e825 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "DELETE /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 204 len: 0 microversion: 2.1 time: 0.129400 Jun 20 12:52:51.400772 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3513/6927] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:52:51 2022] DELETE /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:52:51.409546 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fc4e038f-3a39-4261-91ba-3857a2269317 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:52:51.410155 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fc4e038f-3a39-4261-91ba-3857a2269317 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:52:51.417605 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fc4e038f-3a39-4261-91ba-3857a2269317 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:51.418110 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fc4e038f-3a39-4261-91ba-3857a2269317 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:51.419105 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fc4e038f-3a39-4261-91ba-3857a2269317 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:51.419343 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fc4e038f-3a39-4261-91ba-3857a2269317 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:51.435632 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:52:51.560503 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fc4e038f-3a39-4261-91ba-3857a2269317 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:52:51.570054 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fc4e038f-3a39-4261-91ba-3857a2269317 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 200 len: 1674 microversion: 2.1 time: 0.164194 Jun 20 12:52:51.570826 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3415/6928] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:52:51 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:52:52.593955 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b75d0ac4-a957-409a-a5c7-96874f8cb379 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:52:52.594659 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b75d0ac4-a957-409a-a5c7-96874f8cb379 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:52:52.603789 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b75d0ac4-a957-409a-a5c7-96874f8cb379 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:52.604246 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b75d0ac4-a957-409a-a5c7-96874f8cb379 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:52.605054 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b75d0ac4-a957-409a-a5c7-96874f8cb379 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:52.605501 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b75d0ac4-a957-409a-a5c7-96874f8cb379 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:52.748497 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b75d0ac4-a957-409a-a5c7-96874f8cb379 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:52:52.756347 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b75d0ac4-a957-409a-a5c7-96874f8cb379 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 200 len: 1674 microversion: 2.1 time: 0.166706 Jun 20 12:52:52.756945 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3514/6929] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:52:52 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:52:53.640247 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-70dc3e00-8bff-4e9f-9510-f557003d46c6 req-a04077b2-cfb2-4e44-9490-2d5b5fe6bb86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10058791-4c6b-4529-a768-09dbf6804441", "name": "network-vif-deleted", "tag": "11e85eb6-723d-4d5e-a40c-a7b4e6f6bec1"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:52:53.649641 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-70dc3e00-8bff-4e9f-9510-f557003d46c6 req-a04077b2-cfb2-4e44-9490-2d5b5fe6bb86 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:53.650241 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-70dc3e00-8bff-4e9f-9510-f557003d46c6 req-a04077b2-cfb2-4e44-9490-2d5b5fe6bb86 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:53.662750 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-70dc3e00-8bff-4e9f-9510-f557003d46c6 req-a04077b2-cfb2-4e44-9490-2d5b5fe6bb86 service nova] Creating event network-vif-deleted:11e85eb6-723d-4d5e-a40c-a7b4e6f6bec1 for instance 10058791-4c6b-4529-a768-09dbf6804441 on n-h1-master-1 Jun 20 12:52:53.670987 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-70dc3e00-8bff-4e9f-9510-f557003d46c6 req-a04077b2-cfb2-4e44-9490-2d5b5fe6bb86 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033659 Jun 20 12:52:53.671608 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3416/6930] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:52:53.776101 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e7371440-513c-4af9-8c3d-808613d8399e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:52:53.783692 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e7371440-513c-4af9-8c3d-808613d8399e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:52:53.793979 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e7371440-513c-4af9-8c3d-808613d8399e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:53.794442 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e7371440-513c-4af9-8c3d-808613d8399e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:53.795400 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e7371440-513c-4af9-8c3d-808613d8399e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:53.795992 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e7371440-513c-4af9-8c3d-808613d8399e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:53.841127 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e7371440-513c-4af9-8c3d-808613d8399e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:53.842202 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e7371440-513c-4af9-8c3d-808613d8399e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:53.842998 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-e7371440-513c-4af9-8c3d-808613d8399e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lazy-loading 'fault' on Instance uuid 10058791-4c6b-4529-a768-09dbf6804441 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:52:53.900098 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e7371440-513c-4af9-8c3d-808613d8399e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:52:53.907726 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e7371440-513c-4af9-8c3d-808613d8399e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 200 len: 1327 microversion: 2.1 time: 0.136208 Jun 20 12:52:53.908351 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3515/6931] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:52:53 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 1327 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:52:54.927636 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4376d39e-0115-41a5-ae68-1ea156cfaaa0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:52:54.928527 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4376d39e-0115-41a5-ae68-1ea156cfaaa0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:52:54.935947 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4376d39e-0115-41a5-ae68-1ea156cfaaa0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:54.936666 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4376d39e-0115-41a5-ae68-1ea156cfaaa0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:54.937866 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4376d39e-0115-41a5-ae68-1ea156cfaaa0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:54.938557 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4376d39e-0115-41a5-ae68-1ea156cfaaa0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:54.954168 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-4376d39e-0115-41a5-ae68-1ea156cfaaa0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] HTTP exception thrown: Instance 10058791-4c6b-4529-a768-09dbf6804441 could not be found. Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4376d39e-0115-41a5-ae68-1ea156cfaaa0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Request method failure captured: Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 HTTP/1.1 Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisG08rWo0X6U5MzMEcLnjL5zHWgwcE3Lcu6YwEwZnA9jzQ-u9KPkLaETww8Ci0auGDTDBPUXC4mM-tgcbZ6FJUcQfalWIqhOnqkp9A6seLBffT24h5gBbqqQy1eJfmNhvJDOrIpkg8bPzi2bdUNNLGMSOVbBNvpf_M-HQ0tO6PVx5RyU Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 57445eadc2e94955963af6c23e797c07 Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServerActionsTestJSON-433739157 Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57445eadc2e94955963af6c23e797c07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57445eadc2e94955963af6c23e797c07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/57445eadc2e94955963af6c23e797c07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_57445eadc2e94955963af6c23e797c07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServerActionsTestJSON-433739157 Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 57445eadc2e94955963af6c23e797c07 Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServerActionsTestJSON-433739157 Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServerActionsTestJSON-433739157-project Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: b18cd0c87eed404bb4321acc9762a172 Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServerActionsTestJSON-433739157-project Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 10058791-4c6b-4529-a768-09dbf6804441 could not be found. Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '10058791-4c6b-4529-a768-09dbf6804441'} Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10058791-4c6b-4529-a768-09dbf6804441 could not be found. Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10058791-4c6b-4529-a768-09dbf6804441 could not be found. Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:52:54.955909 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:52:54.961564 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:52:54.961564 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:52:54.961564 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:52:54.961564 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:52:54.961564 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:52:54.961564 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10058791-4c6b-4529-a768-09dbf6804441 could not be found. Jun 20 12:52:54.961564 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:52:54.961564 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4376d39e-0115-41a5-ae68-1ea156cfaaa0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Returning 404 to user: Instance 10058791-4c6b-4529-a768-09dbf6804441 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:52:54.961564 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4376d39e-0115-41a5-ae68-1ea156cfaaa0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 404 len: 111 microversion: 2.1 time: 0.035699 Jun 20 12:52:54.961564 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3417/6932] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:52:54 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:52:54.973251 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a5b4cf62-7d13-4611-aaf2-a917baf47fe1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:52:54.973888 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a5b4cf62-7d13-4611-aaf2-a917baf47fe1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:52:54.982151 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5b4cf62-7d13-4611-aaf2-a917baf47fe1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:54.982611 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5b4cf62-7d13-4611-aaf2-a917baf47fe1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:54.983446 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5b4cf62-7d13-4611-aaf2-a917baf47fe1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:54.983879 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5b4cf62-7d13-4611-aaf2-a917baf47fe1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:54.998834 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-a5b4cf62-7d13-4611-aaf2-a917baf47fe1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] HTTP exception thrown: Instance 10058791-4c6b-4529-a768-09dbf6804441 could not be found. Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a5b4cf62-7d13-4611-aaf2-a917baf47fe1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Request method failure captured: Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 HTTP/1.1 Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisG08rWo0X6U5MzMEcLnjL5zHWgwcE3Lcu6YwEwZnA9jzQ-u9KPkLaETww8Ci0auGDTDBPUXC4mM-tgcbZ6FJUcQfalWIqhOnqkp9A6seLBffT24h5gBbqqQy1eJfmNhvJDOrIpkg8bPzi2bdUNNLGMSOVbBNvpf_M-HQ0tO6PVx5RyU Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 57445eadc2e94955963af6c23e797c07 Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServerActionsTestJSON-433739157 Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57445eadc2e94955963af6c23e797c07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57445eadc2e94955963af6c23e797c07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/57445eadc2e94955963af6c23e797c07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_57445eadc2e94955963af6c23e797c07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServerActionsTestJSON-433739157 Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 57445eadc2e94955963af6c23e797c07 Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServerActionsTestJSON-433739157 Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServerActionsTestJSON-433739157-project Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: b18cd0c87eed404bb4321acc9762a172 Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServerActionsTestJSON-433739157-project Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 10058791-4c6b-4529-a768-09dbf6804441 could not be found. Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '10058791-4c6b-4529-a768-09dbf6804441'} Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10058791-4c6b-4529-a768-09dbf6804441 could not be found. Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10058791-4c6b-4529-a768-09dbf6804441 could not be found. Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:52:55.000581 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:52:55.004551 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:52:55.004551 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:52:55.004551 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:52:55.004551 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:52:55.004551 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:52:55.004551 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10058791-4c6b-4529-a768-09dbf6804441 could not be found. Jun 20 12:52:55.004551 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:52:55.004551 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a5b4cf62-7d13-4611-aaf2-a917baf47fe1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Returning 404 to user: Instance 10058791-4c6b-4529-a768-09dbf6804441 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:52:55.004551 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a5b4cf62-7d13-4611-aaf2-a917baf47fe1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 404 len: 111 microversion: 2.1 time: 0.033066 Jun 20 12:52:55.004551 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3516/6933] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:52:54 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:52:55.052516 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-58353311-785c-4cf1-aa6f-54f40dfab223 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-418427237", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "5b02c936-b353-4cca-83a5-eeaf008c79ad"}], "security_groups": [{"name": "tempest-securitygroup--996108121"}], "key_name": "tempest-keypair-888492200", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:52:55.171002 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-58353311-785c-4cf1-aa6f-54f40dfab223 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] validate_networks() for [('5b02c936-b353-4cca-83a5-eeaf008c79ad', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:52:55.634900 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-58353311-785c-4cf1-aa6f-54f40dfab223 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:52:55.635465 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-58353311-785c-4cf1-aa6f-54f40dfab223 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:52:55.636135 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-58353311-785c-4cf1-aa6f-54f40dfab223 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:52:55.636700 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-58353311-785c-4cf1-aa6f-54f40dfab223 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:52:55.637137 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-58353311-785c-4cf1-aa6f-54f40dfab223 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:52:55.646585 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-58353311-785c-4cf1-aa6f-54f40dfab223 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:55.647040 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-58353311-785c-4cf1-aa6f-54f40dfab223 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:55.647889 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-58353311-785c-4cf1-aa6f-54f40dfab223 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:55.648382 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-58353311-785c-4cf1-aa6f-54f40dfab223 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:55.666812 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-58353311-785c-4cf1-aa6f-54f40dfab223 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Getting quotas for project 57445eadc2e94955963af6c23e797c07. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:52:55.672499 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-58353311-785c-4cf1-aa6f-54f40dfab223 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Getting quotas for user b18cd0c87eed404bb4321acc9762a172 and project 57445eadc2e94955963af6c23e797c07. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:52:55.687964 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-58353311-785c-4cf1-aa6f-54f40dfab223 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:52:55.690804 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-58353311-785c-4cf1-aa6f-54f40dfab223 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:52:55.739991 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-58353311-785c-4cf1-aa6f-54f40dfab223 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.691472 Jun 20 12:52:55.740879 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3418/6934] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:52:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:52:55.751443 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d652493a-d24e-4a58-8968-c2c641caf294 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:52:55.752088 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d652493a-d24e-4a58-8968-c2c641caf294 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:52:55.810399 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d652493a-d24e-4a58-8968-c2c641caf294 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:52:55.818276 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d652493a-d24e-4a58-8968-c2c641caf294 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 200 len: 1237 microversion: 2.1 time: 0.070546 Jun 20 12:52:55.818914 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3517/6935] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:52:55 2022] GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:52:56.837486 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9c888ac0-b226-445a-a3ee-e7a2a4bf10f1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:52:56.839517 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9c888ac0-b226-445a-a3ee-e7a2a4bf10f1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:52:56.850198 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c888ac0-b226-445a-a3ee-e7a2a4bf10f1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:56.851123 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c888ac0-b226-445a-a3ee-e7a2a4bf10f1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:56.852534 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c888ac0-b226-445a-a3ee-e7a2a4bf10f1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:56.853306 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c888ac0-b226-445a-a3ee-e7a2a4bf10f1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:56.962954 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9c888ac0-b226-445a-a3ee-e7a2a4bf10f1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:52:56.971722 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9c888ac0-b226-445a-a3ee-e7a2a4bf10f1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 200 len: 1297 microversion: 2.1 time: 0.140132 Jun 20 12:52:56.980045 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3419/6936] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:52:56 2022] GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 1297 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:52:57.994323 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-550b5a56-2c23-4eee-bbac-bf2dcb05b4ce tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:52:57.995628 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-550b5a56-2c23-4eee-bbac-bf2dcb05b4ce tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:52:58.014035 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-550b5a56-2c23-4eee-bbac-bf2dcb05b4ce tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:58.014832 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-550b5a56-2c23-4eee-bbac-bf2dcb05b4ce tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:58.016175 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-550b5a56-2c23-4eee-bbac-bf2dcb05b4ce tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:58.016998 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-550b5a56-2c23-4eee-bbac-bf2dcb05b4ce tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:58.160648 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-550b5a56-2c23-4eee-bbac-bf2dcb05b4ce tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:52:58.171347 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-550b5a56-2c23-4eee-bbac-bf2dcb05b4ce tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 200 len: 1362 microversion: 2.1 time: 0.184308 Jun 20 12:52:58.173781 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3518/6937] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:52:57 2022] GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:52:58.391195 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-1384df6d-8021-4dc0-91d8-144b320d47e4 req-55bb5ac0-e1d6-430b-aeb0-0ea7020be212 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6", "tag": "ecc299a3-e7bc-4e41-95fa-4726dbb6f5d5"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:52:58.401638 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-1384df6d-8021-4dc0-91d8-144b320d47e4 req-55bb5ac0-e1d6-430b-aeb0-0ea7020be212 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:58.402191 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-1384df6d-8021-4dc0-91d8-144b320d47e4 req-55bb5ac0-e1d6-430b-aeb0-0ea7020be212 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:58.414797 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-1384df6d-8021-4dc0-91d8-144b320d47e4 req-55bb5ac0-e1d6-430b-aeb0-0ea7020be212 service nova] Creating event network-changed:ecc299a3-e7bc-4e41-95fa-4726dbb6f5d5 for instance b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 on n-h2-master-1 Jun 20 12:52:58.420245 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-1384df6d-8021-4dc0-91d8-144b320d47e4 req-55bb5ac0-e1d6-430b-aeb0-0ea7020be212 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033129 Jun 20 12:52:58.421420 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3420/6938] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:52:59.191911 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-103cb692-56d5-488a-ba7b-7b0545ecf8e8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:52:59.192497 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-103cb692-56d5-488a-ba7b-7b0545ecf8e8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:52:59.195453 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:52:59.201601 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-103cb692-56d5-488a-ba7b-7b0545ecf8e8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:59.202069 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-103cb692-56d5-488a-ba7b-7b0545ecf8e8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:59.202835 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-103cb692-56d5-488a-ba7b-7b0545ecf8e8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:52:59.203276 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-103cb692-56d5-488a-ba7b-7b0545ecf8e8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:52:59.355329 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-103cb692-56d5-488a-ba7b-7b0545ecf8e8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:52:59.362984 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-103cb692-56d5-488a-ba7b-7b0545ecf8e8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 200 len: 1362 microversion: 2.1 time: 0.175188 Jun 20 12:52:59.363556 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3519/6939] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:52:59 2022] GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:53:00.381969 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e138db6f-830a-4013-a761-d35050157b90 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:53:00.382781 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e138db6f-830a-4013-a761-d35050157b90 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:53:00.384764 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:53:00.390551 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e138db6f-830a-4013-a761-d35050157b90 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:53:00.391010 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e138db6f-830a-4013-a761-d35050157b90 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:53:00.391790 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e138db6f-830a-4013-a761-d35050157b90 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:53:00.392235 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e138db6f-830a-4013-a761-d35050157b90 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:53:00.532339 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e138db6f-830a-4013-a761-d35050157b90 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:53:00.540573 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e138db6f-830a-4013-a761-d35050157b90 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 200 len: 1362 microversion: 2.1 time: 0.163759 Jun 20 12:53:00.541119 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3421/6940] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:53:00 2022] GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:53:01.561047 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d36b8322-b36c-4229-96f4-7062cf9a5656 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:53:01.561785 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d36b8322-b36c-4229-96f4-7062cf9a5656 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:53:01.571529 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d36b8322-b36c-4229-96f4-7062cf9a5656 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:53:01.571987 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d36b8322-b36c-4229-96f4-7062cf9a5656 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:53:01.572789 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d36b8322-b36c-4229-96f4-7062cf9a5656 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:53:01.573221 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d36b8322-b36c-4229-96f4-7062cf9a5656 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:53:01.714313 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d36b8322-b36c-4229-96f4-7062cf9a5656 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:53:01.722586 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d36b8322-b36c-4229-96f4-7062cf9a5656 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 200 len: 1362 microversion: 2.1 time: 0.167632 Jun 20 12:53:01.723170 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3520/6941] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:53:01 2022] GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:53:02.740667 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5b1fea7f-6c34-4aaf-aec6-a2a0c1b02f33 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:53:02.741461 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5b1fea7f-6c34-4aaf-aec6-a2a0c1b02f33 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:53:02.751575 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5b1fea7f-6c34-4aaf-aec6-a2a0c1b02f33 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:53:02.752169 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5b1fea7f-6c34-4aaf-aec6-a2a0c1b02f33 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:53:02.753364 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5b1fea7f-6c34-4aaf-aec6-a2a0c1b02f33 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:53:02.754000 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5b1fea7f-6c34-4aaf-aec6-a2a0c1b02f33 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:53:02.911194 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5b1fea7f-6c34-4aaf-aec6-a2a0c1b02f33 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:53:02.922444 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5b1fea7f-6c34-4aaf-aec6-a2a0c1b02f33 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 200 len: 1362 microversion: 2.1 time: 0.185890 Jun 20 12:53:02.923035 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3422/6942] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:53:02 2022] GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:53:03.402801 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-92dd98a4-5435-4bb1-a2b3-0d7822342fc9 req-3eb0bd56-56f6-43f1-ac6e-fa5b80b8a3d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6", "name": "network-vif-plugged", "status": "completed", "tag": "ecc299a3-e7bc-4e41-95fa-4726dbb6f5d5"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:53:03.413204 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-92dd98a4-5435-4bb1-a2b3-0d7822342fc9 req-3eb0bd56-56f6-43f1-ac6e-fa5b80b8a3d6 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:53:03.413970 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-92dd98a4-5435-4bb1-a2b3-0d7822342fc9 req-3eb0bd56-56f6-43f1-ac6e-fa5b80b8a3d6 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:53:03.430902 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-92dd98a4-5435-4bb1-a2b3-0d7822342fc9 req-3eb0bd56-56f6-43f1-ac6e-fa5b80b8a3d6 service nova] Creating event network-vif-plugged:ecc299a3-e7bc-4e41-95fa-4726dbb6f5d5 for instance b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 on n-h2-master-1 Jun 20 12:53:03.436588 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-92dd98a4-5435-4bb1-a2b3-0d7822342fc9 req-3eb0bd56-56f6-43f1-ac6e-fa5b80b8a3d6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037541 Jun 20 12:53:03.437430 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3521/6943] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:53:03.942884 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e9aea54b-86d3-4e42-b726-ba3cd9ea52ab tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:53:03.944123 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e9aea54b-86d3-4e42-b726-ba3cd9ea52ab tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:53:03.951464 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e9aea54b-86d3-4e42-b726-ba3cd9ea52ab tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:53:03.951929 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e9aea54b-86d3-4e42-b726-ba3cd9ea52ab tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:53:03.952750 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e9aea54b-86d3-4e42-b726-ba3cd9ea52ab tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:53:03.953194 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e9aea54b-86d3-4e42-b726-ba3cd9ea52ab tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:53:04.100674 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e9aea54b-86d3-4e42-b726-ba3cd9ea52ab tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:53:04.108793 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e9aea54b-86d3-4e42-b726-ba3cd9ea52ab tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 200 len: 1362 microversion: 2.1 time: 0.171303 Jun 20 12:53:04.109340 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3423/6944] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:53:03 2022] GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:53:05.127854 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-15a91832-cc34-443b-b014-9b25ab29b1f8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:53:05.128511 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-15a91832-cc34-443b-b014-9b25ab29b1f8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:53:05.135493 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-15a91832-cc34-443b-b014-9b25ab29b1f8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:53:05.135940 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-15a91832-cc34-443b-b014-9b25ab29b1f8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:53:05.136746 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-15a91832-cc34-443b-b014-9b25ab29b1f8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:53:05.137176 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-15a91832-cc34-443b-b014-9b25ab29b1f8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:53:05.287666 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-15a91832-cc34-443b-b014-9b25ab29b1f8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:53:05.295834 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-15a91832-cc34-443b-b014-9b25ab29b1f8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 200 len: 1549 microversion: 2.1 time: 0.173287 Jun 20 12:53:05.296441 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3522/6945] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:53:05 2022] GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 1549 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:53:05.313474 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-72ba0ea8-a099-4afd-8cdf-f04666d257f6 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:53:05.313979 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-72ba0ea8-a099-4afd-8cdf-f04666d257f6 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:53:05.321895 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-72ba0ea8-a099-4afd-8cdf-f04666d257f6 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:53:05.322419 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-72ba0ea8-a099-4afd-8cdf-f04666d257f6 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:53:05.323203 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-72ba0ea8-a099-4afd-8cdf-f04666d257f6 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:53:05.323652 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-72ba0ea8-a099-4afd-8cdf-f04666d257f6 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:53:05.414470 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-72ba0ea8-a099-4afd-8cdf-f04666d257f6 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104550 Jun 20 12:53:05.415244 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3424/6946] 10.222.0.27 () {58 vars in 1274 bytes} [Mon Jun 20 12:53:05 2022] GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:53:06.616779 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-7bda7563-6180-4493-84a4-4c2c3164a614 req-527b2552-889e-4157-a58e-d81a1772a5c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6", "tag": "ecc299a3-e7bc-4e41-95fa-4726dbb6f5d5"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:53:06.620402 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:53:06.627122 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-7bda7563-6180-4493-84a4-4c2c3164a614 req-527b2552-889e-4157-a58e-d81a1772a5c0 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:53:06.627582 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-7bda7563-6180-4493-84a4-4c2c3164a614 req-527b2552-889e-4157-a58e-d81a1772a5c0 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:53:06.639148 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-7bda7563-6180-4493-84a4-4c2c3164a614 req-527b2552-889e-4157-a58e-d81a1772a5c0 service nova] Creating event network-changed:ecc299a3-e7bc-4e41-95fa-4726dbb6f5d5 for instance b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 on n-h2-master-1 Jun 20 12:53:06.644600 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-7bda7563-6180-4493-84a4-4c2c3164a614 req-527b2552-889e-4157-a58e-d81a1772a5c0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031626 Jun 20 12:53:06.645210 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3523/6947] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:53:20.258887 n-d-master-1 devstack@n-api.service[119127]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 12:53:20.260160 n-d-master-1 devstack@n-api.service[119127]: Mon Jun 20 12:53:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 12:54:18.813182 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:54:18.814181 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:54:18.817092 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=7 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:54:18.817755 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=39 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:54:18.823049 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4930dd47-da66-4d55-a0c8-934bbbbb5606 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:54:18.831570 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4930dd47-da66-4d55-a0c8-934bbbbb5606 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:18.832102 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4930dd47-da66-4d55-a0c8-934bbbbb5606 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:18.857398 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4930dd47-da66-4d55-a0c8-934bbbbb5606 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Going to try to stop instance {{(pid=119128) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 20 12:54:18.906255 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4930dd47-da66-4d55-a0c8-934bbbbb5606 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "POST /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6/action" status: 202 len: 0 microversion: 2.1 time: 0.093527 Jun 20 12:54:18.906818 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3425/6948] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:54:18 2022] POST /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:54:18.917225 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=9 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:54:18.918285 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=44 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:54:18.925228 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ea303c93-596d-4354-aa9d-ca9df3686c97 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:54:18.926182 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ea303c93-596d-4354-aa9d-ca9df3686c97 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:18.934255 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea303c93-596d-4354-aa9d-ca9df3686c97 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:18.934792 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea303c93-596d-4354-aa9d-ca9df3686c97 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:18.935675 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea303c93-596d-4354-aa9d-ca9df3686c97 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:18.936127 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea303c93-596d-4354-aa9d-ca9df3686c97 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:19.262888 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ea303c93-596d-4354-aa9d-ca9df3686c97 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:54:19.272659 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ea303c93-596d-4354-aa9d-ca9df3686c97 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 200 len: 1678 microversion: 2.1 time: 0.359675 Jun 20 12:54:19.273290 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3524/6949] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:54:18 2022] GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 1678 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:54:20.292924 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-83549061-8766-4038-abd8-24458f43efeb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:54:20.293520 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-83549061-8766-4038-abd8-24458f43efeb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:20.300640 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-83549061-8766-4038-abd8-24458f43efeb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:20.301109 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-83549061-8766-4038-abd8-24458f43efeb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:20.301921 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-83549061-8766-4038-abd8-24458f43efeb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:20.302623 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-83549061-8766-4038-abd8-24458f43efeb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:20.604172 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-83549061-8766-4038-abd8-24458f43efeb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:54:20.616550 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-83549061-8766-4038-abd8-24458f43efeb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 200 len: 1678 microversion: 2.1 time: 0.329024 Jun 20 12:54:20.617159 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3426/6950] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:54:20 2022] GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 1678 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:54:21.634905 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-274717a3-a4ab-448a-8b7b-85931b6974ba tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:54:21.635513 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-274717a3-a4ab-448a-8b7b-85931b6974ba tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:21.646203 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-274717a3-a4ab-448a-8b7b-85931b6974ba tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:21.646663 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-274717a3-a4ab-448a-8b7b-85931b6974ba tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:21.647451 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-274717a3-a4ab-448a-8b7b-85931b6974ba tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:21.647892 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-274717a3-a4ab-448a-8b7b-85931b6974ba tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:21.794900 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-274717a3-a4ab-448a-8b7b-85931b6974ba tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:54:21.803231 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-274717a3-a4ab-448a-8b7b-85931b6974ba tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 200 len: 1678 microversion: 2.1 time: 0.172682 Jun 20 12:54:21.803850 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3525/6951] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:54:21 2022] GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:54:22.821578 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bc97af1e-c14d-497e-9a86-4c96270ab493 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:54:22.822396 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bc97af1e-c14d-497e-9a86-4c96270ab493 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:22.829511 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bc97af1e-c14d-497e-9a86-4c96270ab493 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:22.829988 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bc97af1e-c14d-497e-9a86-4c96270ab493 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:22.830781 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bc97af1e-c14d-497e-9a86-4c96270ab493 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:22.831237 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bc97af1e-c14d-497e-9a86-4c96270ab493 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:22.975043 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-bc97af1e-c14d-497e-9a86-4c96270ab493 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:54:22.983197 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bc97af1e-c14d-497e-9a86-4c96270ab493 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 200 len: 1678 microversion: 2.1 time: 0.165990 Jun 20 12:54:22.983782 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3427/6952] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:54:22 2022] GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:54:24.004633 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-68ecb200-8891-4650-b494-37b58a23ca76 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:54:24.005481 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-68ecb200-8891-4650-b494-37b58a23ca76 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:24.014378 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-68ecb200-8891-4650-b494-37b58a23ca76 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:24.014839 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-68ecb200-8891-4650-b494-37b58a23ca76 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:24.015627 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-68ecb200-8891-4650-b494-37b58a23ca76 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:24.016074 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-68ecb200-8891-4650-b494-37b58a23ca76 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:24.157618 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-68ecb200-8891-4650-b494-37b58a23ca76 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:54:24.167214 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-68ecb200-8891-4650-b494-37b58a23ca76 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 200 len: 1678 microversion: 2.1 time: 0.169111 Jun 20 12:54:24.167968 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3526/6953] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:54:23 2022] GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:54:25.190550 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c5ddd617-2f4d-41aa-ab4a-d6be3511f6b1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:54:25.191105 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c5ddd617-2f4d-41aa-ab4a-d6be3511f6b1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:25.199637 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c5ddd617-2f4d-41aa-ab4a-d6be3511f6b1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:25.200160 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c5ddd617-2f4d-41aa-ab4a-d6be3511f6b1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:25.200990 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c5ddd617-2f4d-41aa-ab4a-d6be3511f6b1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:25.201441 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c5ddd617-2f4d-41aa-ab4a-d6be3511f6b1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:25.346099 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c5ddd617-2f4d-41aa-ab4a-d6be3511f6b1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:54:25.356912 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c5ddd617-2f4d-41aa-ab4a-d6be3511f6b1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 200 len: 1678 microversion: 2.1 time: 0.172026 Jun 20 12:54:25.357563 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3428/6954] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:54:25 2022] GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:54:26.377327 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-242f8051-6285-4842-9cdb-4c807892cfb8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:54:26.377979 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-242f8051-6285-4842-9cdb-4c807892cfb8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:26.385388 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-242f8051-6285-4842-9cdb-4c807892cfb8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:26.385844 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-242f8051-6285-4842-9cdb-4c807892cfb8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:26.386605 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-242f8051-6285-4842-9cdb-4c807892cfb8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:26.387038 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-242f8051-6285-4842-9cdb-4c807892cfb8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:26.549677 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-242f8051-6285-4842-9cdb-4c807892cfb8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:54:26.558197 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-242f8051-6285-4842-9cdb-4c807892cfb8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 200 len: 1678 microversion: 2.1 time: 0.184528 Jun 20 12:54:26.558802 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3527/6955] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:54:26 2022] GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 1678 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:54:27.580817 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4bf61a4d-6f9b-4df6-b280-687aa8357c40 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:54:27.581729 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4bf61a4d-6f9b-4df6-b280-687aa8357c40 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:27.592031 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4bf61a4d-6f9b-4df6-b280-687aa8357c40 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:27.592767 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4bf61a4d-6f9b-4df6-b280-687aa8357c40 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:27.594152 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4bf61a4d-6f9b-4df6-b280-687aa8357c40 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:27.594894 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4bf61a4d-6f9b-4df6-b280-687aa8357c40 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:27.741239 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4bf61a4d-6f9b-4df6-b280-687aa8357c40 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:54:27.749888 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4bf61a4d-6f9b-4df6-b280-687aa8357c40 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 200 len: 1678 microversion: 2.1 time: 0.173208 Jun 20 12:54:27.750460 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3429/6956] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:54:27 2022] GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:54:28.771026 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d524bfa1-8ed0-458e-bf9f-fe90f6bf71d0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:54:28.771662 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d524bfa1-8ed0-458e-bf9f-fe90f6bf71d0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:28.779250 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d524bfa1-8ed0-458e-bf9f-fe90f6bf71d0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:28.779707 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d524bfa1-8ed0-458e-bf9f-fe90f6bf71d0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:28.780515 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d524bfa1-8ed0-458e-bf9f-fe90f6bf71d0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:28.780975 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d524bfa1-8ed0-458e-bf9f-fe90f6bf71d0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:28.935527 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d524bfa1-8ed0-458e-bf9f-fe90f6bf71d0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:54:28.944404 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d524bfa1-8ed0-458e-bf9f-fe90f6bf71d0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 200 len: 1678 microversion: 2.1 time: 0.177328 Jun 20 12:54:28.944998 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3528/6957] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:54:28 2022] GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 1678 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:54:29.962242 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-24d1d369-b0b8-40f1-baef-6d742ccfce9b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:54:29.963574 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-24d1d369-b0b8-40f1-baef-6d742ccfce9b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:29.970565 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-24d1d369-b0b8-40f1-baef-6d742ccfce9b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:29.971023 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-24d1d369-b0b8-40f1-baef-6d742ccfce9b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:29.971841 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-24d1d369-b0b8-40f1-baef-6d742ccfce9b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:29.972359 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-24d1d369-b0b8-40f1-baef-6d742ccfce9b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:30.106720 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-24d1d369-b0b8-40f1-baef-6d742ccfce9b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:54:30.119217 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-24d1d369-b0b8-40f1-baef-6d742ccfce9b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 200 len: 1655 microversion: 2.1 time: 0.160662 Jun 20 12:54:30.119892 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3430/6958] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:54:29 2022] GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 1655 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:54:30.137191 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dfe50faf-0bbb-4a14-817e-46477461805a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:54:30.138255 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dfe50faf-0bbb-4a14-817e-46477461805a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:30.146054 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dfe50faf-0bbb-4a14-817e-46477461805a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:30.146505 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dfe50faf-0bbb-4a14-817e-46477461805a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:30.147108 n-d-master-1 devstack@n-api.service[119128]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 12:54:30.147257 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dfe50faf-0bbb-4a14-817e-46477461805a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:30.147349 n-d-master-1 devstack@n-api.service[119128]: Mon Jun 20 12:54:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 12:54:30.147689 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dfe50faf-0bbb-4a14-817e-46477461805a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:30.178910 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dfe50faf-0bbb-4a14-817e-46477461805a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:54:30.185645 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dfe50faf-0bbb-4a14-817e-46477461805a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Old instance type m1.heat2, new instance type m1.heat {{(pid=119127) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 20 12:54:30.192128 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-dfe50faf-0bbb-4a14-817e-46477461805a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:54:30.192576 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-dfe50faf-0bbb-4a14-817e-46477461805a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:54:30.193047 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-dfe50faf-0bbb-4a14-817e-46477461805a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:54:30.193452 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-dfe50faf-0bbb-4a14-817e-46477461805a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:54:30.193863 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-dfe50faf-0bbb-4a14-817e-46477461805a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:54:30.264263 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dfe50faf-0bbb-4a14-817e-46477461805a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "POST /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6/action" status: 202 len: 0 microversion: 2.1 time: 0.131375 Jun 20 12:54:30.264927 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3529/6959] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:54:30 2022] POST /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:54:30.273358 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-76f45e57-581b-44c6-9872-5e76ca60597a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:54:30.273981 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-76f45e57-581b-44c6-9872-5e76ca60597a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:30.281510 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-76f45e57-581b-44c6-9872-5e76ca60597a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:30.282070 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-76f45e57-581b-44c6-9872-5e76ca60597a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:30.282977 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-76f45e57-581b-44c6-9872-5e76ca60597a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:30.283493 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-76f45e57-581b-44c6-9872-5e76ca60597a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:30.466465 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-76f45e57-581b-44c6-9872-5e76ca60597a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:54:30.474961 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-76f45e57-581b-44c6-9872-5e76ca60597a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 200 len: 1678 microversion: 2.1 time: 0.205452 Jun 20 12:54:30.475537 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3431/6960] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:54:30 2022] GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 1678 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:54:31.495602 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-505a790a-18ec-4e39-8726-d4653fa6eae6 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:54:31.496267 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-505a790a-18ec-4e39-8726-d4653fa6eae6 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:31.503997 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-505a790a-18ec-4e39-8726-d4653fa6eae6 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:31.504487 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-505a790a-18ec-4e39-8726-d4653fa6eae6 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:31.505268 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-505a790a-18ec-4e39-8726-d4653fa6eae6 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:31.505708 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-505a790a-18ec-4e39-8726-d4653fa6eae6 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:31.663364 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-505a790a-18ec-4e39-8726-d4653fa6eae6 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:54:31.671889 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-505a790a-18ec-4e39-8726-d4653fa6eae6 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 200 len: 1678 microversion: 2.1 time: 0.181592 Jun 20 12:54:31.672528 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3530/6961] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:54:31 2022] GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 1678 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:54:32.694091 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-313a5c8a-f5a6-4f73-8896-43db49af1434 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:54:32.695019 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-313a5c8a-f5a6-4f73-8896-43db49af1434 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:32.703489 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-313a5c8a-f5a6-4f73-8896-43db49af1434 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:32.703970 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-313a5c8a-f5a6-4f73-8896-43db49af1434 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:32.704784 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-313a5c8a-f5a6-4f73-8896-43db49af1434 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:32.705238 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-313a5c8a-f5a6-4f73-8896-43db49af1434 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:32.846226 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-313a5c8a-f5a6-4f73-8896-43db49af1434 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:54:32.854201 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-313a5c8a-f5a6-4f73-8896-43db49af1434 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 200 len: 1683 microversion: 2.1 time: 0.167115 Jun 20 12:54:32.854771 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3432/6962] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:54:32 2022] GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:54:33.874420 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-743628a0-f0aa-45f6-af22-ec58b6fdf894 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:54:33.874980 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-743628a0-f0aa-45f6-af22-ec58b6fdf894 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:33.882599 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-743628a0-f0aa-45f6-af22-ec58b6fdf894 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:33.883078 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-743628a0-f0aa-45f6-af22-ec58b6fdf894 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:33.883842 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-743628a0-f0aa-45f6-af22-ec58b6fdf894 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:33.884301 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-743628a0-f0aa-45f6-af22-ec58b6fdf894 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:34.306402 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-743628a0-f0aa-45f6-af22-ec58b6fdf894 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:54:34.315022 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-743628a0-f0aa-45f6-af22-ec58b6fdf894 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 200 len: 1683 microversion: 2.1 time: 0.445902 Jun 20 12:54:34.315627 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3531/6963] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:54:33 2022] GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 1683 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:54:35.065644 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-7caae830-f828-4d27-a917-b5c9aad45615 req-2aa63520-c280-4ebb-91f2-e1ad2c2b18a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6", "name": "network-vif-unplugged", "status": "completed", "tag": "ecc299a3-e7bc-4e41-95fa-4726dbb6f5d5"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:54:35.082429 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-7caae830-f828-4d27-a917-b5c9aad45615 req-2aa63520-c280-4ebb-91f2-e1ad2c2b18a0 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:35.082887 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-7caae830-f828-4d27-a917-b5c9aad45615 req-2aa63520-c280-4ebb-91f2-e1ad2c2b18a0 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:35.096249 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-7caae830-f828-4d27-a917-b5c9aad45615 req-2aa63520-c280-4ebb-91f2-e1ad2c2b18a0 service nova] Creating event network-vif-unplugged:ecc299a3-e7bc-4e41-95fa-4726dbb6f5d5 for instance b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 on n-h1-master-1 Jun 20 12:54:35.102294 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [req-7caae830-f828-4d27-a917-b5c9aad45615 req-2aa63520-c280-4ebb-91f2-e1ad2c2b18a0 service nova] Instance b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:54:35.115760 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-7caae830-f828-4d27-a917-b5c9aad45615 req-2aa63520-c280-4ebb-91f2-e1ad2c2b18a0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125832 Jun 20 12:54:35.116473 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3433/6964] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:54:35.332117 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2c5facab-7079-468a-abef-176e144d2088 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:54:35.333405 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2c5facab-7079-468a-abef-176e144d2088 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:35.341668 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2c5facab-7079-468a-abef-176e144d2088 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:35.342128 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2c5facab-7079-468a-abef-176e144d2088 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:35.343149 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2c5facab-7079-468a-abef-176e144d2088 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:35.343624 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2c5facab-7079-468a-abef-176e144d2088 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:35.482263 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2c5facab-7079-468a-abef-176e144d2088 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:54:35.491737 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2c5facab-7079-468a-abef-176e144d2088 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 200 len: 1682 microversion: 2.1 time: 0.163521 Jun 20 12:54:35.492540 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3532/6965] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:54:35 2022] GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:54:36.514443 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1eb2025a-f8f1-4349-a19d-fb1cc764383b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:54:36.515194 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1eb2025a-f8f1-4349-a19d-fb1cc764383b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:36.525002 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1eb2025a-f8f1-4349-a19d-fb1cc764383b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:36.525498 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1eb2025a-f8f1-4349-a19d-fb1cc764383b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:36.526286 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1eb2025a-f8f1-4349-a19d-fb1cc764383b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:36.526737 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1eb2025a-f8f1-4349-a19d-fb1cc764383b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:36.677024 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1eb2025a-f8f1-4349-a19d-fb1cc764383b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:54:36.686846 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1eb2025a-f8f1-4349-a19d-fb1cc764383b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 200 len: 1680 microversion: 2.1 time: 0.179134 Jun 20 12:54:36.687426 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3434/6966] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:54:36 2022] GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:54:37.143595 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-b2aa7e1a-c080-40bd-91ba-6e306e118003 req-2d23917b-b22c-4ba2-94d4-a65c8c966aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6", "tag": "ecc299a3-e7bc-4e41-95fa-4726dbb6f5d5"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:54:37.154894 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b2aa7e1a-c080-40bd-91ba-6e306e118003 req-2d23917b-b22c-4ba2-94d4-a65c8c966aa3 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:37.155511 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b2aa7e1a-c080-40bd-91ba-6e306e118003 req-2d23917b-b22c-4ba2-94d4-a65c8c966aa3 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:37.170398 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-b2aa7e1a-c080-40bd-91ba-6e306e118003 req-2d23917b-b22c-4ba2-94d4-a65c8c966aa3 service nova] Creating event network-changed:ecc299a3-e7bc-4e41-95fa-4726dbb6f5d5 for instance b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 on n-h1-master-1 Jun 20 12:54:37.176980 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [req-b2aa7e1a-c080-40bd-91ba-6e306e118003 req-2d23917b-b22c-4ba2-94d4-a65c8c966aa3 service nova] Instance b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119127) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:54:37.190859 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-b2aa7e1a-c080-40bd-91ba-6e306e118003 req-2d23917b-b22c-4ba2-94d4-a65c8c966aa3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050898 Jun 20 12:54:37.191476 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3533/6967] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:54:37.706360 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-23c568f0-cd23-44a8-8476-aada2c184174 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:54:37.707061 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-23c568f0-cd23-44a8-8476-aada2c184174 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:37.717066 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23c568f0-cd23-44a8-8476-aada2c184174 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:37.717973 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23c568f0-cd23-44a8-8476-aada2c184174 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:37.718370 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23c568f0-cd23-44a8-8476-aada2c184174 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:37.719000 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23c568f0-cd23-44a8-8476-aada2c184174 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:38.034029 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-23c568f0-cd23-44a8-8476-aada2c184174 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:54:38.042301 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-23c568f0-cd23-44a8-8476-aada2c184174 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 200 len: 1676 microversion: 2.1 time: 0.340983 Jun 20 12:54:38.043145 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3435/6968] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:54:37 2022] GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 1676 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:54:38.060169 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-20b8fd1f-dd19-461e-aee4-5fdec6743c84 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:54:38.061083 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-20b8fd1f-dd19-461e-aee4-5fdec6743c84 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:38.067922 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-20b8fd1f-dd19-461e-aee4-5fdec6743c84 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:38.068422 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-20b8fd1f-dd19-461e-aee4-5fdec6743c84 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:38.069206 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-20b8fd1f-dd19-461e-aee4-5fdec6743c84 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:38.069644 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-20b8fd1f-dd19-461e-aee4-5fdec6743c84 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:38.133451 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-20b8fd1f-dd19-461e-aee4-5fdec6743c84 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "POST /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6/action" status: 204 len: 0 microversion: 2.1 time: 0.077687 Jun 20 12:54:38.134057 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3534/6969] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:54:38 2022] POST /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:54:38.143234 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c6f6c18e-0697-4ae8-9913-7fce5cbebf9a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:54:38.143878 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c6f6c18e-0697-4ae8-9913-7fce5cbebf9a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:38.150353 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c6f6c18e-0697-4ae8-9913-7fce5cbebf9a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:38.150813 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c6f6c18e-0697-4ae8-9913-7fce5cbebf9a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:38.151630 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c6f6c18e-0697-4ae8-9913-7fce5cbebf9a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:38.152256 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c6f6c18e-0697-4ae8-9913-7fce5cbebf9a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:38.424046 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c6f6c18e-0697-4ae8-9913-7fce5cbebf9a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:54:38.432523 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c6f6c18e-0697-4ae8-9913-7fce5cbebf9a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 200 len: 1676 microversion: 2.1 time: 0.293820 Jun 20 12:54:38.433601 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3436/6970] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:54:38 2022] GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 1676 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:54:39.452729 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b5c13684-1fe5-41c5-838a-9a717ea6065b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:54:39.453415 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b5c13684-1fe5-41c5-838a-9a717ea6065b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:39.460397 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5c13684-1fe5-41c5-838a-9a717ea6065b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:39.460843 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5c13684-1fe5-41c5-838a-9a717ea6065b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:39.461635 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5c13684-1fe5-41c5-838a-9a717ea6065b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:39.462118 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5c13684-1fe5-41c5-838a-9a717ea6065b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:39.609787 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b5c13684-1fe5-41c5-838a-9a717ea6065b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:54:39.618633 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b5c13684-1fe5-41c5-838a-9a717ea6065b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 200 len: 1676 microversion: 2.1 time: 0.171763 Jun 20 12:54:39.619250 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3535/6971] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:54:39 2022] GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:54:40.583598 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-48c1cf7b-8300-4bb0-bba0-4c655082f084 req-74ed76e6-8b96-4e97-9c1b-dd0e7fe7fa62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6", "name": "network-vif-plugged", "status": "completed", "tag": "ecc299a3-e7bc-4e41-95fa-4726dbb6f5d5"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:54:40.593124 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-48c1cf7b-8300-4bb0-bba0-4c655082f084 req-74ed76e6-8b96-4e97-9c1b-dd0e7fe7fa62 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:40.593596 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-48c1cf7b-8300-4bb0-bba0-4c655082f084 req-74ed76e6-8b96-4e97-9c1b-dd0e7fe7fa62 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:40.605481 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-48c1cf7b-8300-4bb0-bba0-4c655082f084 req-74ed76e6-8b96-4e97-9c1b-dd0e7fe7fa62 service nova] Creating event network-vif-plugged:ecc299a3-e7bc-4e41-95fa-4726dbb6f5d5 for instance b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 on n-h1-master-1 Jun 20 12:54:40.612443 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-48c1cf7b-8300-4bb0-bba0-4c655082f084 req-74ed76e6-8b96-4e97-9c1b-dd0e7fe7fa62 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087935 Jun 20 12:54:40.613167 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3437/6972] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:54:40.635804 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7d09d5fc-94b1-40af-8808-fe0cf05ca212 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:54:40.636451 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7d09d5fc-94b1-40af-8808-fe0cf05ca212 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:40.644193 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7d09d5fc-94b1-40af-8808-fe0cf05ca212 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:40.644690 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7d09d5fc-94b1-40af-8808-fe0cf05ca212 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:40.645481 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7d09d5fc-94b1-40af-8808-fe0cf05ca212 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:40.645924 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7d09d5fc-94b1-40af-8808-fe0cf05ca212 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:40.786606 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7d09d5fc-94b1-40af-8808-fe0cf05ca212 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:54:40.795983 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7d09d5fc-94b1-40af-8808-fe0cf05ca212 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 200 len: 1655 microversion: 2.1 time: 0.163874 Jun 20 12:54:40.796532 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3536/6973] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:54:40 2022] GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 1655 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:54:40.813248 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c8da4d41-543c-46fe-8d1d-bc0a4932ed68 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:54:40.813960 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c8da4d41-543c-46fe-8d1d-bc0a4932ed68 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:40.828936 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c8da4d41-543c-46fe-8d1d-bc0a4932ed68 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:40.829420 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c8da4d41-543c-46fe-8d1d-bc0a4932ed68 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:40.830260 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c8da4d41-543c-46fe-8d1d-bc0a4932ed68 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:40.830724 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c8da4d41-543c-46fe-8d1d-bc0a4932ed68 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:40.972797 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c8da4d41-543c-46fe-8d1d-bc0a4932ed68 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:54:40.983965 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c8da4d41-543c-46fe-8d1d-bc0a4932ed68 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 200 len: 1655 microversion: 2.1 time: 0.174583 Jun 20 12:54:40.985046 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3438/6974] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:54:40 2022] GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 1655 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:54:41.001194 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-877d78dd-fb3f-4729-96ed-8825c071ce3e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:54:41.008878 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-877d78dd-fb3f-4729-96ed-8825c071ce3e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:41.009327 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-877d78dd-fb3f-4729-96ed-8825c071ce3e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:41.035811 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-877d78dd-fb3f-4729-96ed-8825c071ce3e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Going to try to start instance {{(pid=119127) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 20 12:54:41.062005 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:54:41.082357 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-877d78dd-fb3f-4729-96ed-8825c071ce3e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "POST /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6/action" status: 202 len: 0 microversion: 2.1 time: 0.085105 Jun 20 12:54:41.082983 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3537/6975] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:54:40 2022] POST /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:54:41.091710 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a34fcade-5dac-432e-bdbe-1e1b0e219556 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:54:41.093217 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a34fcade-5dac-432e-bdbe-1e1b0e219556 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:41.099993 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a34fcade-5dac-432e-bdbe-1e1b0e219556 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:41.101140 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a34fcade-5dac-432e-bdbe-1e1b0e219556 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:41.102523 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a34fcade-5dac-432e-bdbe-1e1b0e219556 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:41.103347 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a34fcade-5dac-432e-bdbe-1e1b0e219556 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:41.363686 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a34fcade-5dac-432e-bdbe-1e1b0e219556 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:54:41.371844 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a34fcade-5dac-432e-bdbe-1e1b0e219556 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 200 len: 1664 microversion: 2.1 time: 0.284173 Jun 20 12:54:41.372853 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3439/6976] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:54:41 2022] GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 1664 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:54:42.391743 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dc10f447-a57f-4b73-827a-49335a49b6f4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:54:42.392660 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dc10f447-a57f-4b73-827a-49335a49b6f4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:42.400143 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc10f447-a57f-4b73-827a-49335a49b6f4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:42.400906 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc10f447-a57f-4b73-827a-49335a49b6f4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:42.401933 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc10f447-a57f-4b73-827a-49335a49b6f4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:42.402659 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc10f447-a57f-4b73-827a-49335a49b6f4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:42.554023 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dc10f447-a57f-4b73-827a-49335a49b6f4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:54:42.562776 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dc10f447-a57f-4b73-827a-49335a49b6f4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 200 len: 1664 microversion: 2.1 time: 0.176477 Jun 20 12:54:42.563421 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3538/6977] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:54:42 2022] GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 1664 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:54:43.580777 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5a2d7b96-4a6a-4470-8c73-dacc66404509 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:54:43.581366 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5a2d7b96-4a6a-4470-8c73-dacc66404509 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:43.588809 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a2d7b96-4a6a-4470-8c73-dacc66404509 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:43.589277 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a2d7b96-4a6a-4470-8c73-dacc66404509 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:43.590081 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a2d7b96-4a6a-4470-8c73-dacc66404509 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:43.590564 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a2d7b96-4a6a-4470-8c73-dacc66404509 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:43.731452 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5a2d7b96-4a6a-4470-8c73-dacc66404509 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:54:43.741356 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5a2d7b96-4a6a-4470-8c73-dacc66404509 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 200 len: 1668 microversion: 2.1 time: 0.164810 Jun 20 12:54:43.741915 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3440/6978] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:54:43 2022] GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 1668 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:54:43.758324 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2e50a67b-358e-463e-b053-dec777046b20 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:54:43.758842 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2e50a67b-358e-463e-b053-dec777046b20 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:43.773234 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2e50a67b-358e-463e-b053-dec777046b20 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:43.774037 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2e50a67b-358e-463e-b053-dec777046b20 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:43.774825 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2e50a67b-358e-463e-b053-dec777046b20 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:43.775260 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2e50a67b-358e-463e-b053-dec777046b20 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:43.802229 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2e50a67b-358e-463e-b053-dec777046b20 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:54:43.902825 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2e50a67b-358e-463e-b053-dec777046b20 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 204 len: 0 microversion: 2.1 time: 0.147997 Jun 20 12:54:43.903355 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3539/6979] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:54:43 2022] DELETE /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:54:43.911874 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f6886b89-6edc-441d-a073-9b25ea17aaf4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:54:43.912546 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f6886b89-6edc-441d-a073-9b25ea17aaf4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:43.918990 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6886b89-6edc-441d-a073-9b25ea17aaf4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:43.919445 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6886b89-6edc-441d-a073-9b25ea17aaf4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:43.920492 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6886b89-6edc-441d-a073-9b25ea17aaf4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:43.920981 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6886b89-6edc-441d-a073-9b25ea17aaf4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:43.940974 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:54:44.066584 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f6886b89-6edc-441d-a073-9b25ea17aaf4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:54:44.074570 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f6886b89-6edc-441d-a073-9b25ea17aaf4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 200 len: 1674 microversion: 2.1 time: 0.166681 Jun 20 12:54:44.075129 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3441/6980] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:54:43 2022] GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:54:45.093585 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c443ea40-f3c5-43a0-a50d-f00058484124 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:54:45.094226 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c443ea40-f3c5-43a0-a50d-f00058484124 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:45.101984 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c443ea40-f3c5-43a0-a50d-f00058484124 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:45.102438 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c443ea40-f3c5-43a0-a50d-f00058484124 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:45.103209 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c443ea40-f3c5-43a0-a50d-f00058484124 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:45.103643 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c443ea40-f3c5-43a0-a50d-f00058484124 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:45.247854 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c443ea40-f3c5-43a0-a50d-f00058484124 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:54:45.257015 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c443ea40-f3c5-43a0-a50d-f00058484124 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 200 len: 1674 microversion: 2.1 time: 0.168351 Jun 20 12:54:45.257862 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3540/6981] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:54:45 2022] GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 1674 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:54:46.275471 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-04a4f86a-8fe4-452a-9a1a-e809cbe81de4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:54:46.276095 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-04a4f86a-8fe4-452a-9a1a-e809cbe81de4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:46.289403 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-d4024404-97ae-46cd-84a2-0156ce59f465 req-d0481a1e-8ff9-4400-886c-c8184f9afca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6", "name": "network-vif-deleted", "tag": "ecc299a3-e7bc-4e41-95fa-4726dbb6f5d5"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:54:46.297641 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-04a4f86a-8fe4-452a-9a1a-e809cbe81de4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:46.298119 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-04a4f86a-8fe4-452a-9a1a-e809cbe81de4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:46.301013 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-04a4f86a-8fe4-452a-9a1a-e809cbe81de4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:46.303339 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-04a4f86a-8fe4-452a-9a1a-e809cbe81de4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:46.306657 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-d4024404-97ae-46cd-84a2-0156ce59f465 req-d0481a1e-8ff9-4400-886c-c8184f9afca6 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:46.309054 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-d4024404-97ae-46cd-84a2-0156ce59f465 req-d0481a1e-8ff9-4400-886c-c8184f9afca6 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:46.341174 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-d4024404-97ae-46cd-84a2-0156ce59f465 req-d0481a1e-8ff9-4400-886c-c8184f9afca6 service nova] Creating event network-vif-deleted:ecc299a3-e7bc-4e41-95fa-4726dbb6f5d5 for instance b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 on n-h1-master-1 Jun 20 12:54:46.352811 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-d4024404-97ae-46cd-84a2-0156ce59f465 req-d0481a1e-8ff9-4400-886c-c8184f9afca6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064503 Jun 20 12:54:46.354272 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3541/6982] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:54:46.405623 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-04a4f86a-8fe4-452a-9a1a-e809cbe81de4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:54:46.419743 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-04a4f86a-8fe4-452a-9a1a-e809cbe81de4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 200 len: 1607 microversion: 2.1 time: 0.147725 Jun 20 12:54:46.420860 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3442/6983] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:54:46 2022] GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 1607 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:54:47.439989 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-34d60eeb-5409-416b-a8c5-22bd3b20b9c8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:54:47.440710 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-34d60eeb-5409-416b-a8c5-22bd3b20b9c8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:47.448162 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-34d60eeb-5409-416b-a8c5-22bd3b20b9c8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:47.448642 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-34d60eeb-5409-416b-a8c5-22bd3b20b9c8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:47.449420 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-34d60eeb-5409-416b-a8c5-22bd3b20b9c8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:47.449875 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-34d60eeb-5409-416b-a8c5-22bd3b20b9c8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:47.465721 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-34d60eeb-5409-416b-a8c5-22bd3b20b9c8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] HTTP exception thrown: Instance b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 could not be found. Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-34d60eeb-5409-416b-a8c5-22bd3b20b9c8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Request method failure captured: Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 HTTP/1.1 Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisG08rWo0X6U5MzMEcLnjL5zHWgwcE3Lcu6YwEwZnA9jzQ-u9KPkLaETww8Ci0auGDTDBPUXC4mM-tgcbZ6FJUcQfalWIqhOnqkp9A6seLBffT24h5gBbqqQy1eJfmNhvJDOrIpkg8bPzi2bdUNNLGMSOVbBNvpf_M-HQ0tO6PVx5RyU Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 57445eadc2e94955963af6c23e797c07 Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServerActionsTestJSON-433739157 Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57445eadc2e94955963af6c23e797c07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57445eadc2e94955963af6c23e797c07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/57445eadc2e94955963af6c23e797c07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_57445eadc2e94955963af6c23e797c07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServerActionsTestJSON-433739157 Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 57445eadc2e94955963af6c23e797c07 Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServerActionsTestJSON-433739157 Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServerActionsTestJSON-433739157-project Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: b18cd0c87eed404bb4321acc9762a172 Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServerActionsTestJSON-433739157-project Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: exception: Instance b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 could not be found. Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6'} Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 could not be found. Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 could not be found. Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:54:47.467525 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:54:47.471375 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:54:47.471375 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:54:47.471375 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:54:47.471375 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:54:47.471375 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:54:47.471375 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 could not be found. Jun 20 12:54:47.471375 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:54:47.471375 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-34d60eeb-5409-416b-a8c5-22bd3b20b9c8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Returning 404 to user: Instance b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:54:47.471375 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-34d60eeb-5409-416b-a8c5-22bd3b20b9c8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 404 len: 111 microversion: 2.1 time: 0.033857 Jun 20 12:54:47.473339 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3542/6984] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:54:47 2022] GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:54:47.484927 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cfab61ef-97c7-41a3-82bc-f025a96d9a56 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:54:47.485527 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cfab61ef-97c7-41a3-82bc-f025a96d9a56 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:47.494579 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cfab61ef-97c7-41a3-82bc-f025a96d9a56 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:47.495048 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cfab61ef-97c7-41a3-82bc-f025a96d9a56 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:47.495869 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cfab61ef-97c7-41a3-82bc-f025a96d9a56 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:47.496406 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cfab61ef-97c7-41a3-82bc-f025a96d9a56 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:47.513042 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-cfab61ef-97c7-41a3-82bc-f025a96d9a56 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] HTTP exception thrown: Instance b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 could not be found. Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cfab61ef-97c7-41a3-82bc-f025a96d9a56 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Request method failure captured: Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 HTTP/1.1 Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisG08rWo0X6U5MzMEcLnjL5zHWgwcE3Lcu6YwEwZnA9jzQ-u9KPkLaETww8Ci0auGDTDBPUXC4mM-tgcbZ6FJUcQfalWIqhOnqkp9A6seLBffT24h5gBbqqQy1eJfmNhvJDOrIpkg8bPzi2bdUNNLGMSOVbBNvpf_M-HQ0tO6PVx5RyU Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 57445eadc2e94955963af6c23e797c07 Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServerActionsTestJSON-433739157 Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57445eadc2e94955963af6c23e797c07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57445eadc2e94955963af6c23e797c07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/57445eadc2e94955963af6c23e797c07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_57445eadc2e94955963af6c23e797c07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServerActionsTestJSON-433739157 Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 57445eadc2e94955963af6c23e797c07 Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServerActionsTestJSON-433739157 Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServerActionsTestJSON-433739157-project Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: b18cd0c87eed404bb4321acc9762a172 Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServerActionsTestJSON-433739157-project Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: exception: Instance b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 could not be found. Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6'} Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 could not be found. Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 could not be found. Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:54:47.514979 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:54:47.522968 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:54:47.522968 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:54:47.522968 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:54:47.522968 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:54:47.522968 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:54:47.522968 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 could not be found. Jun 20 12:54:47.522968 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:54:47.522968 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cfab61ef-97c7-41a3-82bc-f025a96d9a56 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Returning 404 to user: Instance b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:54:47.522968 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cfab61ef-97c7-41a3-82bc-f025a96d9a56 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 404 len: 111 microversion: 2.1 time: 0.036165 Jun 20 12:54:47.522968 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3443/6985] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:54:47 2022] GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:54:47.568239 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b8347394-edc5-4840-80ff-8afa3823dee8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1454407748", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "5b02c936-b353-4cca-83a5-eeaf008c79ad"}], "security_groups": [{"name": "tempest-securitygroup--996108121"}], "key_name": "tempest-keypair-888492200", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:54:47.677858 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-b8347394-edc5-4840-80ff-8afa3823dee8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] validate_networks() for [('5b02c936-b353-4cca-83a5-eeaf008c79ad', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:54:48.132551 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-b8347394-edc5-4840-80ff-8afa3823dee8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:54:48.132993 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-b8347394-edc5-4840-80ff-8afa3823dee8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:54:48.133567 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-b8347394-edc5-4840-80ff-8afa3823dee8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:54:48.134087 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-b8347394-edc5-4840-80ff-8afa3823dee8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:54:48.134943 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-b8347394-edc5-4840-80ff-8afa3823dee8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:54:48.144804 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b8347394-edc5-4840-80ff-8afa3823dee8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:48.145242 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b8347394-edc5-4840-80ff-8afa3823dee8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:48.146146 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b8347394-edc5-4840-80ff-8afa3823dee8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:48.146592 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b8347394-edc5-4840-80ff-8afa3823dee8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:48.165965 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-b8347394-edc5-4840-80ff-8afa3823dee8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Getting quotas for project 57445eadc2e94955963af6c23e797c07. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:54:48.172056 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-b8347394-edc5-4840-80ff-8afa3823dee8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Getting quotas for user b18cd0c87eed404bb4321acc9762a172 and project 57445eadc2e94955963af6c23e797c07. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:54:48.190157 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b8347394-edc5-4840-80ff-8afa3823dee8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:54:48.193338 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b8347394-edc5-4840-80ff-8afa3823dee8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:54:48.256968 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b8347394-edc5-4840-80ff-8afa3823dee8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.692734 Jun 20 12:54:48.262791 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3543/6986] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:54:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:54:48.268989 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6307ba0e-250b-416f-9efa-8f5a3b419df4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:54:48.269724 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6307ba0e-250b-416f-9efa-8f5a3b419df4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:48.332190 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6307ba0e-250b-416f-9efa-8f5a3b419df4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:54:48.341459 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6307ba0e-250b-416f-9efa-8f5a3b419df4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 200 len: 1238 microversion: 2.1 time: 0.076740 Jun 20 12:54:48.344443 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3444/6987] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:54:48 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 1238 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:54:49.362695 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-51bbe42f-f29a-4f37-85d4-bca07e302709 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:54:49.363451 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-51bbe42f-f29a-4f37-85d4-bca07e302709 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:49.369624 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:54:49.376693 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51bbe42f-f29a-4f37-85d4-bca07e302709 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:49.377237 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51bbe42f-f29a-4f37-85d4-bca07e302709 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:49.378043 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51bbe42f-f29a-4f37-85d4-bca07e302709 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:49.378539 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51bbe42f-f29a-4f37-85d4-bca07e302709 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:49.444640 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-51bbe42f-f29a-4f37-85d4-bca07e302709 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:54:49.452945 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-51bbe42f-f29a-4f37-85d4-bca07e302709 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 200 len: 1296 microversion: 2.1 time: 0.095410 Jun 20 12:54:49.453569 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3544/6988] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:54:49 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 1296 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:54:50.472068 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5715b1e4-8a57-429f-8612-3ed5a606b5fc tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:54:50.472927 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5715b1e4-8a57-429f-8612-3ed5a606b5fc tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:50.476531 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=43 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:54:50.485071 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5715b1e4-8a57-429f-8612-3ed5a606b5fc tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:50.485784 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5715b1e4-8a57-429f-8612-3ed5a606b5fc tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:50.486816 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5715b1e4-8a57-429f-8612-3ed5a606b5fc tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:50.487493 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5715b1e4-8a57-429f-8612-3ed5a606b5fc tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:50.699189 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5715b1e4-8a57-429f-8612-3ed5a606b5fc tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:54:50.708527 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5715b1e4-8a57-429f-8612-3ed5a606b5fc tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 200 len: 1363 microversion: 2.1 time: 0.241586 Jun 20 12:54:50.709310 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3445/6989] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:54:50 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:54:50.768116 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-4cc8397a-2683-45d7-8d9d-f885fc18c0f7 req-5ca6d1eb-724e-4045-aa08-6a560592e570 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "025efc55-77b8-4098-9170-a1ffa8aa9a35", "tag": "b280d248-896b-4751-890a-641cf56a05c6"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:54:50.777878 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-4cc8397a-2683-45d7-8d9d-f885fc18c0f7 req-5ca6d1eb-724e-4045-aa08-6a560592e570 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:50.778859 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-4cc8397a-2683-45d7-8d9d-f885fc18c0f7 req-5ca6d1eb-724e-4045-aa08-6a560592e570 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:50.794019 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-4cc8397a-2683-45d7-8d9d-f885fc18c0f7 req-5ca6d1eb-724e-4045-aa08-6a560592e570 service nova] Creating event network-changed:b280d248-896b-4751-890a-641cf56a05c6 for instance 025efc55-77b8-4098-9170-a1ffa8aa9a35 on n-h1-master-1 Jun 20 12:54:50.799246 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-4cc8397a-2683-45d7-8d9d-f885fc18c0f7 req-5ca6d1eb-724e-4045-aa08-6a560592e570 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035075 Jun 20 12:54:50.799912 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3545/6990] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:54:51.728911 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e5262401-fd2f-4f48-a348-ce60b891bebd tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:54:51.729578 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e5262401-fd2f-4f48-a348-ce60b891bebd tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:51.737165 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e5262401-fd2f-4f48-a348-ce60b891bebd tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:51.737638 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e5262401-fd2f-4f48-a348-ce60b891bebd tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:51.738454 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e5262401-fd2f-4f48-a348-ce60b891bebd tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:51.738885 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e5262401-fd2f-4f48-a348-ce60b891bebd tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:51.889883 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e5262401-fd2f-4f48-a348-ce60b891bebd tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:54:51.898623 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e5262401-fd2f-4f48-a348-ce60b891bebd tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 200 len: 1363 microversion: 2.1 time: 0.175051 Jun 20 12:54:51.899240 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3446/6991] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:54:51 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:54:52.922556 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-819d56ec-2cf8-4a22-96ee-28ff0f31a360 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:54:52.923257 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-819d56ec-2cf8-4a22-96ee-28ff0f31a360 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:52.930146 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-819d56ec-2cf8-4a22-96ee-28ff0f31a360 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:52.930601 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-819d56ec-2cf8-4a22-96ee-28ff0f31a360 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:52.931375 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-819d56ec-2cf8-4a22-96ee-28ff0f31a360 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:52.931821 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-819d56ec-2cf8-4a22-96ee-28ff0f31a360 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:53.076411 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-819d56ec-2cf8-4a22-96ee-28ff0f31a360 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:54:53.087183 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-819d56ec-2cf8-4a22-96ee-28ff0f31a360 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 200 len: 1363 microversion: 2.1 time: 0.172964 Jun 20 12:54:53.087787 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3546/6992] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:54:52 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:54:54.104949 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c0052393-cf4e-4b38-8011-3804dc0d8221 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:54:54.105559 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c0052393-cf4e-4b38-8011-3804dc0d8221 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:54.113707 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c0052393-cf4e-4b38-8011-3804dc0d8221 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:54.114229 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c0052393-cf4e-4b38-8011-3804dc0d8221 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:54.115008 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c0052393-cf4e-4b38-8011-3804dc0d8221 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:54.115460 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c0052393-cf4e-4b38-8011-3804dc0d8221 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:54.264702 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c0052393-cf4e-4b38-8011-3804dc0d8221 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:54:54.272871 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c0052393-cf4e-4b38-8011-3804dc0d8221 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 200 len: 1363 microversion: 2.1 time: 0.171919 Jun 20 12:54:54.273426 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3447/6993] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:54:54 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:54:54.527815 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-bc8f06bf-7e65-461c-a8f9-e4c9b63c8a0f req-5f3c72d4-03a9-4656-9969-fed365f20e36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "025efc55-77b8-4098-9170-a1ffa8aa9a35", "name": "network-vif-plugged", "status": "completed", "tag": "b280d248-896b-4751-890a-641cf56a05c6"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:54:54.540339 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-bc8f06bf-7e65-461c-a8f9-e4c9b63c8a0f req-5f3c72d4-03a9-4656-9969-fed365f20e36 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:54.540995 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-bc8f06bf-7e65-461c-a8f9-e4c9b63c8a0f req-5f3c72d4-03a9-4656-9969-fed365f20e36 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:54.554062 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-bc8f06bf-7e65-461c-a8f9-e4c9b63c8a0f req-5f3c72d4-03a9-4656-9969-fed365f20e36 service nova] Creating event network-vif-plugged:b280d248-896b-4751-890a-641cf56a05c6 for instance 025efc55-77b8-4098-9170-a1ffa8aa9a35 on n-h1-master-1 Jun 20 12:54:54.560179 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-bc8f06bf-7e65-461c-a8f9-e4c9b63c8a0f req-5f3c72d4-03a9-4656-9969-fed365f20e36 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036985 Jun 20 12:54:54.560830 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3547/6994] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:54:55.290480 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7848c3ea-3e2e-4db7-9603-548e15788bb3 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:54:55.291101 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7848c3ea-3e2e-4db7-9603-548e15788bb3 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:55.298482 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7848c3ea-3e2e-4db7-9603-548e15788bb3 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:55.298943 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7848c3ea-3e2e-4db7-9603-548e15788bb3 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:55.299727 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7848c3ea-3e2e-4db7-9603-548e15788bb3 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:55.300147 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7848c3ea-3e2e-4db7-9603-548e15788bb3 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:55.438233 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7848c3ea-3e2e-4db7-9603-548e15788bb3 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:54:55.446225 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7848c3ea-3e2e-4db7-9603-548e15788bb3 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 200 len: 1363 microversion: 2.1 time: 0.159765 Jun 20 12:54:55.446855 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3448/6995] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:54:55 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:54:56.465035 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f486c699-965a-4280-9a40-29ebe72699d1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:54:56.465777 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f486c699-965a-4280-9a40-29ebe72699d1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:56.473291 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f486c699-965a-4280-9a40-29ebe72699d1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:56.474020 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f486c699-965a-4280-9a40-29ebe72699d1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:56.474819 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f486c699-965a-4280-9a40-29ebe72699d1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:56.475253 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f486c699-965a-4280-9a40-29ebe72699d1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:56.608806 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f486c699-965a-4280-9a40-29ebe72699d1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:54:56.616832 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f486c699-965a-4280-9a40-29ebe72699d1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 200 len: 1551 microversion: 2.1 time: 0.157143 Jun 20 12:54:56.617423 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3548/6996] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:54:56 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 1551 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:54:56.633861 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-48f67e62-cf9f-4562-b4ca-50a2205d01b8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:54:56.634463 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-48f67e62-cf9f-4562-b4ca-50a2205d01b8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:54:56.642065 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-48f67e62-cf9f-4562-b4ca-50a2205d01b8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:56.642532 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-48f67e62-cf9f-4562-b4ca-50a2205d01b8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:56.643321 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-48f67e62-cf9f-4562-b4ca-50a2205d01b8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:56.643775 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-48f67e62-cf9f-4562-b4ca-50a2205d01b8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:56.725660 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-48f67e62-cf9f-4562-b4ca-50a2205d01b8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095705 Jun 20 12:54:56.726266 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3449/6997] 10.222.0.27 () {58 vars in 1274 bytes} [Mon Jun 20 12:54:56 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:54:57.918697 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-94018545-b644-4c0e-b5ac-bdbbc31b7380 req-34fae937-6296-4598-9fc1-5c82e3329d0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "025efc55-77b8-4098-9170-a1ffa8aa9a35", "tag": "b280d248-896b-4751-890a-641cf56a05c6"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:54:57.928189 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-94018545-b644-4c0e-b5ac-bdbbc31b7380 req-34fae937-6296-4598-9fc1-5c82e3329d0a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:54:57.929479 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-94018545-b644-4c0e-b5ac-bdbbc31b7380 req-34fae937-6296-4598-9fc1-5c82e3329d0a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:54:57.942107 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-94018545-b644-4c0e-b5ac-bdbbc31b7380 req-34fae937-6296-4598-9fc1-5c82e3329d0a service nova] Creating event network-changed:b280d248-896b-4751-890a-641cf56a05c6 for instance 025efc55-77b8-4098-9170-a1ffa8aa9a35 on n-h1-master-1 Jun 20 12:54:57.947241 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-94018545-b644-4c0e-b5ac-bdbbc31b7380 req-34fae937-6296-4598-9fc1-5c82e3329d0a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032068 Jun 20 12:54:57.948377 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3549/6998] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:55:30.840928 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:55:30.842931 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=9 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:55:30.843638 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=38 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:55:30.848865 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ff83da1d-c9be-4a1b-9b85-c6e998ac08f8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:55:30.850086 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ff83da1d-c9be-4a1b-9b85-c6e998ac08f8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:55:30.860797 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ff83da1d-c9be-4a1b-9b85-c6e998ac08f8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:30.861344 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ff83da1d-c9be-4a1b-9b85-c6e998ac08f8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:30.862161 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ff83da1d-c9be-4a1b-9b85-c6e998ac08f8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:30.862617 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ff83da1d-c9be-4a1b-9b85-c6e998ac08f8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:30.894443 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ff83da1d-c9be-4a1b-9b85-c6e998ac08f8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:55:30.900802 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ff83da1d-c9be-4a1b-9b85-c6e998ac08f8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Old instance type m1.heat2, new instance type m1.heat {{(pid=119128) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 20 12:55:30.907988 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-ff83da1d-c9be-4a1b-9b85-c6e998ac08f8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:55:30.908478 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-ff83da1d-c9be-4a1b-9b85-c6e998ac08f8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:55:30.908972 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-ff83da1d-c9be-4a1b-9b85-c6e998ac08f8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:55:30.909402 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-ff83da1d-c9be-4a1b-9b85-c6e998ac08f8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:55:30.909859 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-ff83da1d-c9be-4a1b-9b85-c6e998ac08f8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:55:30.979245 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ff83da1d-c9be-4a1b-9b85-c6e998ac08f8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "POST /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35/action" status: 202 len: 0 microversion: 2.1 time: 0.140101 Jun 20 12:55:30.979876 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3450/6999] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:55:30 2022] POST /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:55:30.986108 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:55:30.987329 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:55:30.990677 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=11 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:55:30.991372 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=58,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:55:30.997167 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9a17ac0f-0927-4779-996d-288a4cf7f877 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:55:30.997878 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9a17ac0f-0927-4779-996d-288a4cf7f877 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:55:31.007951 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a17ac0f-0927-4779-996d-288a4cf7f877 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:31.008723 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a17ac0f-0927-4779-996d-288a4cf7f877 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:31.009514 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a17ac0f-0927-4779-996d-288a4cf7f877 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:31.010004 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a17ac0f-0927-4779-996d-288a4cf7f877 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:31.160387 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9a17ac0f-0927-4779-996d-288a4cf7f877 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:55:31.168297 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9a17ac0f-0927-4779-996d-288a4cf7f877 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 200 len: 1679 microversion: 2.1 time: 0.183153 Jun 20 12:55:31.168936 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3550/7000] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:55:30 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 1679 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:55:32.190784 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-00d6fa08-9b0e-4f97-94fb-235a206f9e61 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:55:32.191430 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-00d6fa08-9b0e-4f97-94fb-235a206f9e61 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:55:32.200275 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-00d6fa08-9b0e-4f97-94fb-235a206f9e61 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:32.200748 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-00d6fa08-9b0e-4f97-94fb-235a206f9e61 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:32.201573 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-00d6fa08-9b0e-4f97-94fb-235a206f9e61 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:32.202027 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-00d6fa08-9b0e-4f97-94fb-235a206f9e61 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:32.350943 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-00d6fa08-9b0e-4f97-94fb-235a206f9e61 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:55:32.361118 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-00d6fa08-9b0e-4f97-94fb-235a206f9e61 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 200 len: 1679 microversion: 2.1 time: 0.175066 Jun 20 12:55:32.362045 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3451/7001] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:55:32 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:55:33.379335 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d4bb0967-a5ee-4763-9f31-aad80080fa74 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:55:33.379921 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d4bb0967-a5ee-4763-9f31-aad80080fa74 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:55:33.391467 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d4bb0967-a5ee-4763-9f31-aad80080fa74 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:33.392133 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d4bb0967-a5ee-4763-9f31-aad80080fa74 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:33.393583 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d4bb0967-a5ee-4763-9f31-aad80080fa74 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:33.394173 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d4bb0967-a5ee-4763-9f31-aad80080fa74 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:33.542502 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d4bb0967-a5ee-4763-9f31-aad80080fa74 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:55:33.551445 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d4bb0967-a5ee-4763-9f31-aad80080fa74 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 200 len: 1684 microversion: 2.1 time: 0.176169 Jun 20 12:55:33.552343 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3551/7002] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:55:33 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 1684 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:55:34.572026 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-73d7ef2f-d682-4e70-b162-28802fbc1216 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:55:34.572730 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-73d7ef2f-d682-4e70-b162-28802fbc1216 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:55:34.581041 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-73d7ef2f-d682-4e70-b162-28802fbc1216 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:34.581671 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-73d7ef2f-d682-4e70-b162-28802fbc1216 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:34.582515 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-73d7ef2f-d682-4e70-b162-28802fbc1216 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:34.583072 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-73d7ef2f-d682-4e70-b162-28802fbc1216 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:34.736237 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-73d7ef2f-d682-4e70-b162-28802fbc1216 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:55:34.744568 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-73d7ef2f-d682-4e70-b162-28802fbc1216 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 200 len: 1684 microversion: 2.1 time: 0.177384 Jun 20 12:55:34.745180 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3452/7003] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:55:34 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 1684 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:55:35.764337 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-42ad7d58-2188-4cdb-9c83-204fbba3e3e7 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:55:35.765134 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-42ad7d58-2188-4cdb-9c83-204fbba3e3e7 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:55:35.773850 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-42ad7d58-2188-4cdb-9c83-204fbba3e3e7 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:35.775041 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-42ad7d58-2188-4cdb-9c83-204fbba3e3e7 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:35.776006 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-42ad7d58-2188-4cdb-9c83-204fbba3e3e7 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:35.776484 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-42ad7d58-2188-4cdb-9c83-204fbba3e3e7 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:35.939593 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-42ad7d58-2188-4cdb-9c83-204fbba3e3e7 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:55:35.948715 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-42ad7d58-2188-4cdb-9c83-204fbba3e3e7 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 200 len: 1684 microversion: 2.1 time: 0.188874 Jun 20 12:55:35.949348 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3552/7004] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:55:35 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 1684 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:55:36.967768 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b30d5927-d4f7-4f34-9b6f-1e4acffcf455 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:55:36.968509 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b30d5927-d4f7-4f34-9b6f-1e4acffcf455 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:55:36.976116 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b30d5927-d4f7-4f34-9b6f-1e4acffcf455 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:36.976616 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b30d5927-d4f7-4f34-9b6f-1e4acffcf455 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:36.977409 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b30d5927-d4f7-4f34-9b6f-1e4acffcf455 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:36.977892 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b30d5927-d4f7-4f34-9b6f-1e4acffcf455 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:37.121162 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b30d5927-d4f7-4f34-9b6f-1e4acffcf455 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:55:37.129280 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b30d5927-d4f7-4f34-9b6f-1e4acffcf455 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 200 len: 1684 microversion: 2.1 time: 0.165587 Jun 20 12:55:37.129859 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3453/7005] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:55:36 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 1684 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:55:38.147570 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8c9d53c1-91b4-4e06-b7b2-b0c860446c74 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:55:38.153112 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8c9d53c1-91b4-4e06-b7b2-b0c860446c74 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:55:38.159118 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8c9d53c1-91b4-4e06-b7b2-b0c860446c74 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:38.159499 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8c9d53c1-91b4-4e06-b7b2-b0c860446c74 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:38.161191 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8c9d53c1-91b4-4e06-b7b2-b0c860446c74 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:38.161191 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8c9d53c1-91b4-4e06-b7b2-b0c860446c74 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:38.306536 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8c9d53c1-91b4-4e06-b7b2-b0c860446c74 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:55:38.315804 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8c9d53c1-91b4-4e06-b7b2-b0c860446c74 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 200 len: 1684 microversion: 2.1 time: 0.172544 Jun 20 12:55:38.317088 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3553/7006] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:55:38 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 1684 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:55:39.336419 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-537d1287-a1b7-42a9-b161-b9814d4e343f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:55:39.337075 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-537d1287-a1b7-42a9-b161-b9814d4e343f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:55:39.344172 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-537d1287-a1b7-42a9-b161-b9814d4e343f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:39.344685 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-537d1287-a1b7-42a9-b161-b9814d4e343f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:39.345509 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-537d1287-a1b7-42a9-b161-b9814d4e343f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:39.345976 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-537d1287-a1b7-42a9-b161-b9814d4e343f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:39.486089 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-537d1287-a1b7-42a9-b161-b9814d4e343f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:55:39.494273 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-537d1287-a1b7-42a9-b161-b9814d4e343f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 200 len: 1684 microversion: 2.1 time: 0.163546 Jun 20 12:55:39.494877 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3454/7007] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:55:39 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:55:40.512076 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-268f921a-d39e-4668-ba4a-48f9b14dff37 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:55:40.512729 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-268f921a-d39e-4668-ba4a-48f9b14dff37 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:55:40.520358 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-268f921a-d39e-4668-ba4a-48f9b14dff37 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:40.520801 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-268f921a-d39e-4668-ba4a-48f9b14dff37 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:40.521584 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-268f921a-d39e-4668-ba4a-48f9b14dff37 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:40.522018 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-268f921a-d39e-4668-ba4a-48f9b14dff37 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:40.661122 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-268f921a-d39e-4668-ba4a-48f9b14dff37 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:55:40.672824 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-268f921a-d39e-4668-ba4a-48f9b14dff37 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 200 len: 1684 microversion: 2.1 time: 0.164564 Jun 20 12:55:40.673679 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3554/7008] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:55:40 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:55:41.694393 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-15764180-a811-478e-b665-5b76d792888c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:55:41.695012 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-15764180-a811-478e-b665-5b76d792888c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:55:41.702581 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-15764180-a811-478e-b665-5b76d792888c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:41.703616 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-15764180-a811-478e-b665-5b76d792888c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:41.704456 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-15764180-a811-478e-b665-5b76d792888c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:41.704920 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-15764180-a811-478e-b665-5b76d792888c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:41.852193 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-15764180-a811-478e-b665-5b76d792888c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:55:41.860899 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-15764180-a811-478e-b665-5b76d792888c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 200 len: 1684 microversion: 2.1 time: 0.170588 Jun 20 12:55:41.861486 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3455/7009] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:55:41 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 1684 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:55:42.879047 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3ea66786-516c-4f2c-82ef-eb8b79f294c5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:55:42.879844 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3ea66786-516c-4f2c-82ef-eb8b79f294c5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:55:42.890596 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3ea66786-516c-4f2c-82ef-eb8b79f294c5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:42.891074 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3ea66786-516c-4f2c-82ef-eb8b79f294c5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:42.891851 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3ea66786-516c-4f2c-82ef-eb8b79f294c5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:42.892341 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3ea66786-516c-4f2c-82ef-eb8b79f294c5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:43.038646 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3ea66786-516c-4f2c-82ef-eb8b79f294c5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:55:43.047334 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3ea66786-516c-4f2c-82ef-eb8b79f294c5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 200 len: 1684 microversion: 2.1 time: 0.172634 Jun 20 12:55:43.047932 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3555/7010] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:55:42 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 1684 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:55:44.069292 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7065295d-067b-4590-a345-eb8749a09048 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:55:44.069935 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7065295d-067b-4590-a345-eb8749a09048 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:55:44.079001 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7065295d-067b-4590-a345-eb8749a09048 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:44.079600 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7065295d-067b-4590-a345-eb8749a09048 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:44.080564 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7065295d-067b-4590-a345-eb8749a09048 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:44.080990 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7065295d-067b-4590-a345-eb8749a09048 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:44.229768 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7065295d-067b-4590-a345-eb8749a09048 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:55:44.237986 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7065295d-067b-4590-a345-eb8749a09048 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 200 len: 1684 microversion: 2.1 time: 0.174209 Jun 20 12:55:44.238597 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3456/7011] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:55:44 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 1684 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:55:45.255437 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4c7fc90c-2c39-4f8b-8b51-e7ff645d6dcd tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:55:45.256155 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4c7fc90c-2c39-4f8b-8b51-e7ff645d6dcd tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:55:45.264514 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4c7fc90c-2c39-4f8b-8b51-e7ff645d6dcd tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:45.265276 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4c7fc90c-2c39-4f8b-8b51-e7ff645d6dcd tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:45.267355 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4c7fc90c-2c39-4f8b-8b51-e7ff645d6dcd tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:45.267804 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4c7fc90c-2c39-4f8b-8b51-e7ff645d6dcd tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:45.408033 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4c7fc90c-2c39-4f8b-8b51-e7ff645d6dcd tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:55:45.418243 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4c7fc90c-2c39-4f8b-8b51-e7ff645d6dcd tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 200 len: 1684 microversion: 2.1 time: 0.166654 Jun 20 12:55:45.419224 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3556/7012] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:55:45 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 1684 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:55:46.440832 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-09d1e69b-5f79-4d97-ba39-3f312330edaf tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:55:46.441606 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-09d1e69b-5f79-4d97-ba39-3f312330edaf tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:55:46.450468 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-09d1e69b-5f79-4d97-ba39-3f312330edaf tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:46.451045 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-09d1e69b-5f79-4d97-ba39-3f312330edaf tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:46.452098 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-09d1e69b-5f79-4d97-ba39-3f312330edaf tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:46.452939 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-09d1e69b-5f79-4d97-ba39-3f312330edaf tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:46.600330 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-09d1e69b-5f79-4d97-ba39-3f312330edaf tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:55:46.611511 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-09d1e69b-5f79-4d97-ba39-3f312330edaf tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 200 len: 1684 microversion: 2.1 time: 0.175567 Jun 20 12:55:46.612090 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3457/7013] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:55:46 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 1684 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:55:47.629700 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9969175e-27e5-45a8-bbc6-9776a4f4b383 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:55:47.630335 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9969175e-27e5-45a8-bbc6-9776a4f4b383 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:55:47.637450 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9969175e-27e5-45a8-bbc6-9776a4f4b383 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:47.637970 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9969175e-27e5-45a8-bbc6-9776a4f4b383 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:47.638782 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9969175e-27e5-45a8-bbc6-9776a4f4b383 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:47.639317 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9969175e-27e5-45a8-bbc6-9776a4f4b383 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:47.801318 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9969175e-27e5-45a8-bbc6-9776a4f4b383 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:55:47.812978 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9969175e-27e5-45a8-bbc6-9776a4f4b383 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 200 len: 1684 microversion: 2.1 time: 0.187783 Jun 20 12:55:47.813791 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3557/7014] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:55:47 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 1684 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:55:48.833038 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8061e9fc-94c9-40ce-8613-a7fa77ab34eb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:55:48.833626 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8061e9fc-94c9-40ce-8613-a7fa77ab34eb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:55:48.840953 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8061e9fc-94c9-40ce-8613-a7fa77ab34eb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:48.841423 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8061e9fc-94c9-40ce-8613-a7fa77ab34eb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:48.842209 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8061e9fc-94c9-40ce-8613-a7fa77ab34eb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:48.842666 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8061e9fc-94c9-40ce-8613-a7fa77ab34eb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:48.982670 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8061e9fc-94c9-40ce-8613-a7fa77ab34eb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:55:48.990852 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8061e9fc-94c9-40ce-8613-a7fa77ab34eb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 200 len: 1684 microversion: 2.1 time: 0.161979 Jun 20 12:55:48.991448 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3458/7015] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:55:48 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 1684 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:55:50.008045 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-813defa6-f8e6-482f-ae29-b881fe3251ae tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:55:50.008686 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-813defa6-f8e6-482f-ae29-b881fe3251ae tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:55:50.015934 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-813defa6-f8e6-482f-ae29-b881fe3251ae tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:50.016420 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-813defa6-f8e6-482f-ae29-b881fe3251ae tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:50.017193 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-813defa6-f8e6-482f-ae29-b881fe3251ae tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:50.017627 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-813defa6-f8e6-482f-ae29-b881fe3251ae tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:50.154288 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-813defa6-f8e6-482f-ae29-b881fe3251ae tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:55:50.162083 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-813defa6-f8e6-482f-ae29-b881fe3251ae tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 200 len: 1683 microversion: 2.1 time: 0.158113 Jun 20 12:55:50.162853 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3558/7016] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:55:50 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:55:50.628883 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-5b86b2e8-32f6-4a0e-8370-721c8cca9cd2 req-9db7503f-077d-4ecf-9d53-2274b516eef1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "025efc55-77b8-4098-9170-a1ffa8aa9a35", "name": "network-vif-unplugged", "status": "completed", "tag": "b280d248-896b-4751-890a-641cf56a05c6"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:55:50.637879 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-5b86b2e8-32f6-4a0e-8370-721c8cca9cd2 req-9db7503f-077d-4ecf-9d53-2274b516eef1 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:50.638409 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-5b86b2e8-32f6-4a0e-8370-721c8cca9cd2 req-9db7503f-077d-4ecf-9d53-2274b516eef1 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:50.654379 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-5b86b2e8-32f6-4a0e-8370-721c8cca9cd2 req-9db7503f-077d-4ecf-9d53-2274b516eef1 service nova] Creating event network-vif-unplugged:b280d248-896b-4751-890a-641cf56a05c6 for instance 025efc55-77b8-4098-9170-a1ffa8aa9a35 on n-h2-master-1 Jun 20 12:55:50.660587 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [req-5b86b2e8-32f6-4a0e-8370-721c8cca9cd2 req-9db7503f-077d-4ecf-9d53-2274b516eef1 service nova] Instance 025efc55-77b8-4098-9170-a1ffa8aa9a35 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:55:50.672229 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-5b86b2e8-32f6-4a0e-8370-721c8cca9cd2 req-9db7503f-077d-4ecf-9d53-2274b516eef1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047665 Jun 20 12:55:50.672721 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3459/7017] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:55:51.181960 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f6f3f0be-3104-40a9-9d91-a816abbdede7 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:55:51.182680 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f6f3f0be-3104-40a9-9d91-a816abbdede7 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:55:51.191972 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f6f3f0be-3104-40a9-9d91-a816abbdede7 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:51.192808 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f6f3f0be-3104-40a9-9d91-a816abbdede7 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:51.193693 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f6f3f0be-3104-40a9-9d91-a816abbdede7 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:51.194203 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f6f3f0be-3104-40a9-9d91-a816abbdede7 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:51.339339 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f6f3f0be-3104-40a9-9d91-a816abbdede7 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:55:51.347122 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f6f3f0be-3104-40a9-9d91-a816abbdede7 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 200 len: 1683 microversion: 2.1 time: 0.171272 Jun 20 12:55:51.347736 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3559/7018] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:55:51 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:55:52.365788 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2f668dbb-219f-4e20-a85d-819e5207a922 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:55:52.366508 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2f668dbb-219f-4e20-a85d-819e5207a922 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:55:52.373169 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2f668dbb-219f-4e20-a85d-819e5207a922 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:52.373634 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2f668dbb-219f-4e20-a85d-819e5207a922 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:52.374417 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2f668dbb-219f-4e20-a85d-819e5207a922 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:52.374867 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2f668dbb-219f-4e20-a85d-819e5207a922 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:52.523824 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2f668dbb-219f-4e20-a85d-819e5207a922 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:55:52.535847 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2f668dbb-219f-4e20-a85d-819e5207a922 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 200 len: 1681 microversion: 2.1 time: 0.175230 Jun 20 12:55:52.536602 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3460/7019] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:55:52 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:55:52.689276 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-a0f0625c-1e39-4eda-ae98-6d74ca35e41a req-5bd15674-b454-4d75-9f28-3272105d4cfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "025efc55-77b8-4098-9170-a1ffa8aa9a35", "tag": "b280d248-896b-4751-890a-641cf56a05c6"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:55:52.698292 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-a0f0625c-1e39-4eda-ae98-6d74ca35e41a req-5bd15674-b454-4d75-9f28-3272105d4cfe service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:52.698732 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-a0f0625c-1e39-4eda-ae98-6d74ca35e41a req-5bd15674-b454-4d75-9f28-3272105d4cfe service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:52.712037 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-a0f0625c-1e39-4eda-ae98-6d74ca35e41a req-5bd15674-b454-4d75-9f28-3272105d4cfe service nova] Creating event network-changed:b280d248-896b-4751-890a-641cf56a05c6 for instance 025efc55-77b8-4098-9170-a1ffa8aa9a35 on n-h2-master-1 Jun 20 12:55:52.718252 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [req-a0f0625c-1e39-4eda-ae98-6d74ca35e41a req-5bd15674-b454-4d75-9f28-3272105d4cfe service nova] Instance 025efc55-77b8-4098-9170-a1ffa8aa9a35 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119127) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:55:52.729493 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-a0f0625c-1e39-4eda-ae98-6d74ca35e41a req-5bd15674-b454-4d75-9f28-3272105d4cfe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044451 Jun 20 12:55:52.730111 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3560/7020] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:55:53.553929 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a15e49f7-6558-4a74-9cdf-9e8f656c872f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:55:53.554548 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a15e49f7-6558-4a74-9cdf-9e8f656c872f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:55:53.562259 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a15e49f7-6558-4a74-9cdf-9e8f656c872f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:53.562709 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a15e49f7-6558-4a74-9cdf-9e8f656c872f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:53.563531 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a15e49f7-6558-4a74-9cdf-9e8f656c872f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:53.563933 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a15e49f7-6558-4a74-9cdf-9e8f656c872f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:53.721064 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a15e49f7-6558-4a74-9cdf-9e8f656c872f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:55:53.729866 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a15e49f7-6558-4a74-9cdf-9e8f656c872f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 200 len: 1681 microversion: 2.1 time: 0.179899 Jun 20 12:55:53.730453 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3461/7021] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:55:53 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 1681 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:55:54.748854 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8d0135e9-bf33-4a34-af0b-833df8fa02dc tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:55:54.750223 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8d0135e9-bf33-4a34-af0b-833df8fa02dc tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:55:54.757014 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8d0135e9-bf33-4a34-af0b-833df8fa02dc tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:54.757719 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8d0135e9-bf33-4a34-af0b-833df8fa02dc tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:54.758516 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8d0135e9-bf33-4a34-af0b-833df8fa02dc tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:54.758914 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8d0135e9-bf33-4a34-af0b-833df8fa02dc tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:54.913142 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8d0135e9-bf33-4a34-af0b-833df8fa02dc tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:55:54.921282 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8d0135e9-bf33-4a34-af0b-833df8fa02dc tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 200 len: 1678 microversion: 2.1 time: 0.177766 Jun 20 12:55:54.921868 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3561/7022] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:55:54 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 1678 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:55:54.938791 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0f96ea9b-5ace-4d3a-bd16-30fcd713456e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:55:54.939349 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0f96ea9b-5ace-4d3a-bd16-30fcd713456e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:55:54.946667 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f96ea9b-5ace-4d3a-bd16-30fcd713456e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:54.947133 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f96ea9b-5ace-4d3a-bd16-30fcd713456e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:54.948095 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f96ea9b-5ace-4d3a-bd16-30fcd713456e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:54.948600 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f96ea9b-5ace-4d3a-bd16-30fcd713456e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:54.987544 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f96ea9b-5ace-4d3a-bd16-30fcd713456e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:54.987907 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f96ea9b-5ace-4d3a-bd16-30fcd713456e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:54.988759 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f96ea9b-5ace-4d3a-bd16-30fcd713456e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:54.989412 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f96ea9b-5ace-4d3a-bd16-30fcd713456e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:55.018071 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-0f96ea9b-5ace-4d3a-bd16-30fcd713456e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Getting quotas for project 57445eadc2e94955963af6c23e797c07. Resources: {'ram', 'cores'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:55:55.023612 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-0f96ea9b-5ace-4d3a-bd16-30fcd713456e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Getting quotas for user b18cd0c87eed404bb4321acc9762a172 and project 57445eadc2e94955963af6c23e797c07. Resources: {'ram', 'cores'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:55:55.119362 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:55:55.145969 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0f96ea9b-5ace-4d3a-bd16-30fcd713456e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "POST /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35/action" status: 202 len: 0 microversion: 2.1 time: 0.211168 Jun 20 12:55:55.146595 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3462/7023] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:55:54 2022] POST /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:55:55.156605 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1a15a827-1a86-46cd-a15e-61e8f26155d6 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:55:55.157236 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1a15a827-1a86-46cd-a15e-61e8f26155d6 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:55:55.165214 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a15a827-1a86-46cd-a15e-61e8f26155d6 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:55.165709 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a15a827-1a86-46cd-a15e-61e8f26155d6 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:55.166639 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a15a827-1a86-46cd-a15e-61e8f26155d6 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:55.167083 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a15a827-1a86-46cd-a15e-61e8f26155d6 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:55.308119 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1a15a827-1a86-46cd-a15e-61e8f26155d6 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:55:55.316032 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1a15a827-1a86-46cd-a15e-61e8f26155d6 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 200 len: 1677 microversion: 2.1 time: 0.164714 Jun 20 12:55:55.316657 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3562/7024] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:55:55 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:55:56.336183 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d5d3b2b6-b67b-4059-8692-045317fb4277 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:55:56.336917 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d5d3b2b6-b67b-4059-8692-045317fb4277 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:55:56.344491 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d5d3b2b6-b67b-4059-8692-045317fb4277 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:56.345024 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d5d3b2b6-b67b-4059-8692-045317fb4277 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:56.345840 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d5d3b2b6-b67b-4059-8692-045317fb4277 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:56.346391 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d5d3b2b6-b67b-4059-8692-045317fb4277 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:56.392236 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-0ba11888-83f6-42c4-9456-f820dcdd9b8c req-f2882c82-67da-4a11-9782-5452b736b03d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "025efc55-77b8-4098-9170-a1ffa8aa9a35", "name": "network-vif-plugged", "status": "completed", "tag": "b280d248-896b-4751-890a-641cf56a05c6"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:55:56.405479 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-0ba11888-83f6-42c4-9456-f820dcdd9b8c req-f2882c82-67da-4a11-9782-5452b736b03d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:56.406111 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-0ba11888-83f6-42c4-9456-f820dcdd9b8c req-f2882c82-67da-4a11-9782-5452b736b03d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:56.419287 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-0ba11888-83f6-42c4-9456-f820dcdd9b8c req-f2882c82-67da-4a11-9782-5452b736b03d service nova] Creating event network-vif-plugged:b280d248-896b-4751-890a-641cf56a05c6 for instance 025efc55-77b8-4098-9170-a1ffa8aa9a35 on n-h2-master-1 Jun 20 12:55:56.427274 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [req-0ba11888-83f6-42c4-9456-f820dcdd9b8c req-f2882c82-67da-4a11-9782-5452b736b03d service nova] Instance 025efc55-77b8-4098-9170-a1ffa8aa9a35 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119127) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:55:56.439367 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-0ba11888-83f6-42c4-9456-f820dcdd9b8c req-f2882c82-67da-4a11-9782-5452b736b03d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051301 Jun 20 12:55:56.440666 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3563/7025] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:55:56.489884 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d5d3b2b6-b67b-4059-8692-045317fb4277 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:55:56.497776 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d5d3b2b6-b67b-4059-8692-045317fb4277 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 200 len: 1677 microversion: 2.1 time: 0.167242 Jun 20 12:55:56.498344 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3463/7026] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:55:56 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:55:57.522490 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bec8323a-b72b-4455-b081-0ac448891c59 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:55:57.523179 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bec8323a-b72b-4455-b081-0ac448891c59 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:55:57.530873 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bec8323a-b72b-4455-b081-0ac448891c59 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:57.531329 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bec8323a-b72b-4455-b081-0ac448891c59 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:57.532095 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bec8323a-b72b-4455-b081-0ac448891c59 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:57.532562 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bec8323a-b72b-4455-b081-0ac448891c59 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:57.686191 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bec8323a-b72b-4455-b081-0ac448891c59 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:55:57.695309 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bec8323a-b72b-4455-b081-0ac448891c59 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 200 len: 1677 microversion: 2.1 time: 0.181803 Jun 20 12:55:57.696080 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3564/7027] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:55:57 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 1677 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:55:58.437620 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-596c1eef-cf38-4ab2-a05b-35b68f5d1734 req-6e6acf14-de19-44c4-bcce-f35c2b80c79c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "025efc55-77b8-4098-9170-a1ffa8aa9a35", "name": "network-vif-unplugged", "status": "completed", "tag": "b280d248-896b-4751-890a-641cf56a05c6"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:55:58.447259 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-596c1eef-cf38-4ab2-a05b-35b68f5d1734 req-6e6acf14-de19-44c4-bcce-f35c2b80c79c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:58.447719 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-596c1eef-cf38-4ab2-a05b-35b68f5d1734 req-6e6acf14-de19-44c4-bcce-f35c2b80c79c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:58.460658 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-596c1eef-cf38-4ab2-a05b-35b68f5d1734 req-6e6acf14-de19-44c4-bcce-f35c2b80c79c service nova] Creating event network-vif-unplugged:b280d248-896b-4751-890a-641cf56a05c6 for instance 025efc55-77b8-4098-9170-a1ffa8aa9a35 on n-h1-master-1 Jun 20 12:55:58.466302 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [req-596c1eef-cf38-4ab2-a05b-35b68f5d1734 req-6e6acf14-de19-44c4-bcce-f35c2b80c79c service nova] Instance 025efc55-77b8-4098-9170-a1ffa8aa9a35 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:55:58.477559 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-596c1eef-cf38-4ab2-a05b-35b68f5d1734 req-6e6acf14-de19-44c4-bcce-f35c2b80c79c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044065 Jun 20 12:55:58.478167 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3464/7028] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:55:58.714537 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-51290129-569f-4f8a-92bd-14e0f17b56f5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:55:58.715089 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-51290129-569f-4f8a-92bd-14e0f17b56f5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:55:58.722508 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51290129-569f-4f8a-92bd-14e0f17b56f5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:58.722962 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51290129-569f-4f8a-92bd-14e0f17b56f5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:58.723909 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51290129-569f-4f8a-92bd-14e0f17b56f5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:58.724322 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51290129-569f-4f8a-92bd-14e0f17b56f5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:58.858654 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-51290129-569f-4f8a-92bd-14e0f17b56f5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:55:58.887701 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-51290129-569f-4f8a-92bd-14e0f17b56f5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 200 len: 1677 microversion: 2.1 time: 0.176945 Jun 20 12:55:58.888676 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3565/7029] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:55:58 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:55:59.908075 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-68ec555a-d9f9-4fbd-aacb-ff22d150fc32 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:55:59.908846 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-68ec555a-d9f9-4fbd-aacb-ff22d150fc32 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:55:59.915910 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-68ec555a-d9f9-4fbd-aacb-ff22d150fc32 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:59.916415 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-68ec555a-d9f9-4fbd-aacb-ff22d150fc32 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:55:59.917205 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-68ec555a-d9f9-4fbd-aacb-ff22d150fc32 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:55:59.917661 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-68ec555a-d9f9-4fbd-aacb-ff22d150fc32 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:00.058898 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-68ec555a-d9f9-4fbd-aacb-ff22d150fc32 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:56:00.067024 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-68ec555a-d9f9-4fbd-aacb-ff22d150fc32 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 200 len: 1677 microversion: 2.1 time: 0.163934 Jun 20 12:56:00.067482 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3465/7030] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:55:59 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:56:00.497793 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-b6936717-1543-4e2c-afb8-5388d7142928 req-5ae4c818-f2fb-4ba9-816f-2d8b9323ab3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "025efc55-77b8-4098-9170-a1ffa8aa9a35", "tag": "b280d248-896b-4751-890a-641cf56a05c6"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:56:00.507460 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b6936717-1543-4e2c-afb8-5388d7142928 req-5ae4c818-f2fb-4ba9-816f-2d8b9323ab3b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:00.507918 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b6936717-1543-4e2c-afb8-5388d7142928 req-5ae4c818-f2fb-4ba9-816f-2d8b9323ab3b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:00.520223 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-b6936717-1543-4e2c-afb8-5388d7142928 req-5ae4c818-f2fb-4ba9-816f-2d8b9323ab3b service nova] Creating event network-changed:b280d248-896b-4751-890a-641cf56a05c6 for instance 025efc55-77b8-4098-9170-a1ffa8aa9a35 on n-h1-master-1 Jun 20 12:56:00.526149 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [req-b6936717-1543-4e2c-afb8-5388d7142928 req-5ae4c818-f2fb-4ba9-816f-2d8b9323ab3b service nova] Instance 025efc55-77b8-4098-9170-a1ffa8aa9a35 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119127) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:56:00.537724 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-b6936717-1543-4e2c-afb8-5388d7142928 req-5ae4c818-f2fb-4ba9-816f-2d8b9323ab3b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043770 Jun 20 12:56:00.538353 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3566/7031] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:56:01.084877 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-54c57609-d459-4f59-8d3c-71e7491a6fdb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:56:01.085470 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-54c57609-d459-4f59-8d3c-71e7491a6fdb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:56:01.088639 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:56:01.094802 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-54c57609-d459-4f59-8d3c-71e7491a6fdb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:01.095270 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-54c57609-d459-4f59-8d3c-71e7491a6fdb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:01.096079 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-54c57609-d459-4f59-8d3c-71e7491a6fdb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:01.096559 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-54c57609-d459-4f59-8d3c-71e7491a6fdb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:01.439558 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-54c57609-d459-4f59-8d3c-71e7491a6fdb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:56:01.447539 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-54c57609-d459-4f59-8d3c-71e7491a6fdb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 200 len: 1670 microversion: 2.1 time: 0.366918 Jun 20 12:56:01.448135 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3466/7032] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:56:01 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 1670 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:56:01.465035 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8a1db6d5-152b-4315-966c-1feacb6bd6d4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:56:01.465794 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8a1db6d5-152b-4315-966c-1feacb6bd6d4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:56:01.467919 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=35 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:56:01.474515 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a1db6d5-152b-4315-966c-1feacb6bd6d4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:01.474969 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a1db6d5-152b-4315-966c-1feacb6bd6d4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:01.475769 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a1db6d5-152b-4315-966c-1feacb6bd6d4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:01.476224 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a1db6d5-152b-4315-966c-1feacb6bd6d4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:01.479270 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=97 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:56:01.623255 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8a1db6d5-152b-4315-966c-1feacb6bd6d4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:56:01.631620 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8a1db6d5-152b-4315-966c-1feacb6bd6d4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 200 len: 1670 microversion: 2.1 time: 0.171019 Jun 20 12:56:01.632418 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3567/7033] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:56:01 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 1670 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:56:01.649091 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0dce0d5c-1319-4e7e-89d6-429134afba81 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:56:01.649721 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0dce0d5c-1319-4e7e-89d6-429134afba81 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:56:01.656297 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0dce0d5c-1319-4e7e-89d6-429134afba81 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:01.656606 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0dce0d5c-1319-4e7e-89d6-429134afba81 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:01.657519 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0dce0d5c-1319-4e7e-89d6-429134afba81 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:01.658031 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0dce0d5c-1319-4e7e-89d6-429134afba81 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:01.872461 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0dce0d5c-1319-4e7e-89d6-429134afba81 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:56:01.881134 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0dce0d5c-1319-4e7e-89d6-429134afba81 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 200 len: 1670 microversion: 2.1 time: 0.236599 Jun 20 12:56:01.881596 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3467/7034] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:56:01 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 1670 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:56:01.897836 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d8e5392f-4520-47af-bf3a-ce7a57ec364a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:56:01.898373 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d8e5392f-4520-47af-bf3a-ce7a57ec364a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:56:01.905481 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d8e5392f-4520-47af-bf3a-ce7a57ec364a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:01.905947 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d8e5392f-4520-47af-bf3a-ce7a57ec364a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:01.906718 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d8e5392f-4520-47af-bf3a-ce7a57ec364a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:01.907158 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d8e5392f-4520-47af-bf3a-ce7a57ec364a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:01.932606 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d8e5392f-4520-47af-bf3a-ce7a57ec364a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:56:02.017510 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d8e5392f-4520-47af-bf3a-ce7a57ec364a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "DELETE /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 204 len: 0 microversion: 2.1 time: 0.123568 Jun 20 12:56:02.018157 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3568/7035] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:56:01 2022] DELETE /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:56:02.026916 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cade0155-4a22-405d-9fbf-d16a60078b2f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:56:02.027578 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cade0155-4a22-405d-9fbf-d16a60078b2f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:56:02.033863 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cade0155-4a22-405d-9fbf-d16a60078b2f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:02.034331 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cade0155-4a22-405d-9fbf-d16a60078b2f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:02.035148 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cade0155-4a22-405d-9fbf-d16a60078b2f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:02.035602 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cade0155-4a22-405d-9fbf-d16a60078b2f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:02.169637 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-cade0155-4a22-405d-9fbf-d16a60078b2f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:56:02.178133 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cade0155-4a22-405d-9fbf-d16a60078b2f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 200 len: 1676 microversion: 2.1 time: 0.155216 Jun 20 12:56:02.178720 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3468/7036] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:56:02 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:56:02.889554 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-c23292df-4f58-4a97-8b09-ff1a6c3dfe67 req-d5e70b03-0ab9-4021-a0a3-e6953e64d925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "025efc55-77b8-4098-9170-a1ffa8aa9a35", "name": "network-vif-plugged", "status": "completed", "tag": "b280d248-896b-4751-890a-641cf56a05c6"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:56:02.901861 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-c23292df-4f58-4a97-8b09-ff1a6c3dfe67 req-d5e70b03-0ab9-4021-a0a3-e6953e64d925 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:02.902313 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-c23292df-4f58-4a97-8b09-ff1a6c3dfe67 req-d5e70b03-0ab9-4021-a0a3-e6953e64d925 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:02.915100 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-c23292df-4f58-4a97-8b09-ff1a6c3dfe67 req-d5e70b03-0ab9-4021-a0a3-e6953e64d925 service nova] Creating event network-vif-plugged:b280d248-896b-4751-890a-641cf56a05c6 for instance 025efc55-77b8-4098-9170-a1ffa8aa9a35 on n-h1-master-1 Jun 20 12:56:02.920623 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-c23292df-4f58-4a97-8b09-ff1a6c3dfe67 req-d5e70b03-0ab9-4021-a0a3-e6953e64d925 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035169 Jun 20 12:56:02.921424 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3569/7037] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:56:03.196748 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-96ce0b4a-5b54-4f8c-908b-2204562938cb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:56:03.197293 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-96ce0b4a-5b54-4f8c-908b-2204562938cb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:56:03.204648 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-96ce0b4a-5b54-4f8c-908b-2204562938cb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:03.205109 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-96ce0b4a-5b54-4f8c-908b-2204562938cb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:03.205892 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-96ce0b4a-5b54-4f8c-908b-2204562938cb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:03.206326 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-96ce0b4a-5b54-4f8c-908b-2204562938cb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:03.412660 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-96ce0b4a-5b54-4f8c-908b-2204562938cb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:56:03.420772 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-96ce0b4a-5b54-4f8c-908b-2204562938cb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 200 len: 1676 microversion: 2.1 time: 0.228018 Jun 20 12:56:03.421435 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3469/7038] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:56:03 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 1676 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:56:04.187392 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-be6a107d-f160-4be7-8778-cd28310d91ad req-9b292e71-e958-418d-a226-f9e62ada39ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "025efc55-77b8-4098-9170-a1ffa8aa9a35", "name": "network-vif-deleted", "tag": "b280d248-896b-4751-890a-641cf56a05c6"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:56:04.198754 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-be6a107d-f160-4be7-8778-cd28310d91ad req-9b292e71-e958-418d-a226-f9e62ada39ef service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:04.199199 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-be6a107d-f160-4be7-8778-cd28310d91ad req-9b292e71-e958-418d-a226-f9e62ada39ef service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:04.212375 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-be6a107d-f160-4be7-8778-cd28310d91ad req-9b292e71-e958-418d-a226-f9e62ada39ef service nova] Creating event network-vif-deleted:b280d248-896b-4751-890a-641cf56a05c6 for instance 025efc55-77b8-4098-9170-a1ffa8aa9a35 on n-h1-master-1 Jun 20 12:56:04.217433 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-be6a107d-f160-4be7-8778-cd28310d91ad req-9b292e71-e958-418d-a226-f9e62ada39ef service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034580 Jun 20 12:56:04.218054 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3570/7039] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:56:04.439472 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-392fa95c-d3c7-40b2-87e6-6c46e1182c10 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:56:04.440193 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-392fa95c-d3c7-40b2-87e6-6c46e1182c10 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:56:04.448516 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-392fa95c-d3c7-40b2-87e6-6c46e1182c10 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:04.448987 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-392fa95c-d3c7-40b2-87e6-6c46e1182c10 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:04.449816 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-392fa95c-d3c7-40b2-87e6-6c46e1182c10 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:04.450260 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-392fa95c-d3c7-40b2-87e6-6c46e1182c10 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:04.485608 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-392fa95c-d3c7-40b2-87e6-6c46e1182c10 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:04.486087 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-392fa95c-d3c7-40b2-87e6-6c46e1182c10 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:04.486552 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-392fa95c-d3c7-40b2-87e6-6c46e1182c10 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lazy-loading 'fault' on Instance uuid 025efc55-77b8-4098-9170-a1ffa8aa9a35 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:56:04.535275 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-392fa95c-d3c7-40b2-87e6-6c46e1182c10 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:56:04.546307 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-392fa95c-d3c7-40b2-87e6-6c46e1182c10 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 200 len: 1328 microversion: 2.1 time: 0.111240 Jun 20 12:56:04.547459 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3470/7040] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:56:04 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 1328 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:56:05.570649 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-42967771-42a7-4db6-a22f-7b10322a7d35 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:56:05.571379 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-42967771-42a7-4db6-a22f-7b10322a7d35 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:56:05.580403 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-42967771-42a7-4db6-a22f-7b10322a7d35 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:05.580855 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-42967771-42a7-4db6-a22f-7b10322a7d35 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:05.581641 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-42967771-42a7-4db6-a22f-7b10322a7d35 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:05.582078 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-42967771-42a7-4db6-a22f-7b10322a7d35 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:05.604827 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-42967771-42a7-4db6-a22f-7b10322a7d35 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] HTTP exception thrown: Instance 025efc55-77b8-4098-9170-a1ffa8aa9a35 could not be found. Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-42967771-42a7-4db6-a22f-7b10322a7d35 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Request method failure captured: Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 HTTP/1.1 Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisG08rWo0X6U5MzMEcLnjL5zHWgwcE3Lcu6YwEwZnA9jzQ-u9KPkLaETww8Ci0auGDTDBPUXC4mM-tgcbZ6FJUcQfalWIqhOnqkp9A6seLBffT24h5gBbqqQy1eJfmNhvJDOrIpkg8bPzi2bdUNNLGMSOVbBNvpf_M-HQ0tO6PVx5RyU Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 57445eadc2e94955963af6c23e797c07 Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServerActionsTestJSON-433739157 Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57445eadc2e94955963af6c23e797c07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57445eadc2e94955963af6c23e797c07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/57445eadc2e94955963af6c23e797c07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_57445eadc2e94955963af6c23e797c07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServerActionsTestJSON-433739157 Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 57445eadc2e94955963af6c23e797c07 Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServerActionsTestJSON-433739157 Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServerActionsTestJSON-433739157-project Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: b18cd0c87eed404bb4321acc9762a172 Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServerActionsTestJSON-433739157-project Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 025efc55-77b8-4098-9170-a1ffa8aa9a35 could not be found. Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '025efc55-77b8-4098-9170-a1ffa8aa9a35'} Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 025efc55-77b8-4098-9170-a1ffa8aa9a35 could not be found. Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 025efc55-77b8-4098-9170-a1ffa8aa9a35 could not be found. Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:56:05.606504 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:56:05.610924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:56:05.610924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:56:05.610924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:56:05.610924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:56:05.610924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:56:05.610924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 025efc55-77b8-4098-9170-a1ffa8aa9a35 could not be found. Jun 20 12:56:05.610924 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:56:05.610924 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-42967771-42a7-4db6-a22f-7b10322a7d35 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Returning 404 to user: Instance 025efc55-77b8-4098-9170-a1ffa8aa9a35 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:56:05.610924 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-42967771-42a7-4db6-a22f-7b10322a7d35 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 404 len: 111 microversion: 2.1 time: 0.044767 Jun 20 12:56:05.610924 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3571/7041] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:56:05 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:56:05.635262 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f08640e3-757b-4643-aebe-5dfc3f2fed77 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:56:05.636014 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f08640e3-757b-4643-aebe-5dfc3f2fed77 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:56:05.637993 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:56:05.647281 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f08640e3-757b-4643-aebe-5dfc3f2fed77 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:05.647760 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f08640e3-757b-4643-aebe-5dfc3f2fed77 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:05.648632 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f08640e3-757b-4643-aebe-5dfc3f2fed77 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:05.649089 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f08640e3-757b-4643-aebe-5dfc3f2fed77 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:05.667652 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-f08640e3-757b-4643-aebe-5dfc3f2fed77 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] HTTP exception thrown: Instance 025efc55-77b8-4098-9170-a1ffa8aa9a35 could not be found. Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f08640e3-757b-4643-aebe-5dfc3f2fed77 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Request method failure captured: Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 HTTP/1.1 Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisG08rWo0X6U5MzMEcLnjL5zHWgwcE3Lcu6YwEwZnA9jzQ-u9KPkLaETww8Ci0auGDTDBPUXC4mM-tgcbZ6FJUcQfalWIqhOnqkp9A6seLBffT24h5gBbqqQy1eJfmNhvJDOrIpkg8bPzi2bdUNNLGMSOVbBNvpf_M-HQ0tO6PVx5RyU Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 57445eadc2e94955963af6c23e797c07 Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServerActionsTestJSON-433739157 Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57445eadc2e94955963af6c23e797c07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57445eadc2e94955963af6c23e797c07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/57445eadc2e94955963af6c23e797c07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_57445eadc2e94955963af6c23e797c07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServerActionsTestJSON-433739157 Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 57445eadc2e94955963af6c23e797c07 Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServerActionsTestJSON-433739157 Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServerActionsTestJSON-433739157-project Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: b18cd0c87eed404bb4321acc9762a172 Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServerActionsTestJSON-433739157-project Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 025efc55-77b8-4098-9170-a1ffa8aa9a35 could not be found. Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '025efc55-77b8-4098-9170-a1ffa8aa9a35'} Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 025efc55-77b8-4098-9170-a1ffa8aa9a35 could not be found. Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 025efc55-77b8-4098-9170-a1ffa8aa9a35 could not be found. Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:56:05.669414 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:56:05.673337 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:56:05.673337 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:56:05.673337 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:56:05.673337 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:56:05.673337 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:56:05.673337 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 025efc55-77b8-4098-9170-a1ffa8aa9a35 could not be found. Jun 20 12:56:05.673337 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:56:05.673337 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f08640e3-757b-4643-aebe-5dfc3f2fed77 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Returning 404 to user: Instance 025efc55-77b8-4098-9170-a1ffa8aa9a35 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:56:05.673337 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f08640e3-757b-4643-aebe-5dfc3f2fed77 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 404 len: 111 microversion: 2.1 time: 0.040614 Jun 20 12:56:05.673337 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3471/7042] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:56:05 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:56:05.736625 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6eadc222-b860-4d63-aa40-2b3faa3c070b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-293364265", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "5b02c936-b353-4cca-83a5-eeaf008c79ad"}], "security_groups": [{"name": "tempest-securitygroup--996108121"}], "key_name": "tempest-keypair-888492200", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:56:05.865041 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-6eadc222-b860-4d63-aa40-2b3faa3c070b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] validate_networks() for [('5b02c936-b353-4cca-83a5-eeaf008c79ad', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:56:06.449591 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-6eadc222-b860-4d63-aa40-2b3faa3c070b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:56:06.450007 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-6eadc222-b860-4d63-aa40-2b3faa3c070b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:56:06.450473 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-6eadc222-b860-4d63-aa40-2b3faa3c070b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:56:06.450873 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-6eadc222-b860-4d63-aa40-2b3faa3c070b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:56:06.451276 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-6eadc222-b860-4d63-aa40-2b3faa3c070b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:56:06.463161 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6eadc222-b860-4d63-aa40-2b3faa3c070b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:06.463661 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6eadc222-b860-4d63-aa40-2b3faa3c070b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:06.464422 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6eadc222-b860-4d63-aa40-2b3faa3c070b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:06.464857 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6eadc222-b860-4d63-aa40-2b3faa3c070b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:06.485318 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-6eadc222-b860-4d63-aa40-2b3faa3c070b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Getting quotas for project 57445eadc2e94955963af6c23e797c07. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:56:06.491096 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-6eadc222-b860-4d63-aa40-2b3faa3c070b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Getting quotas for user b18cd0c87eed404bb4321acc9762a172 and project 57445eadc2e94955963af6c23e797c07. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:56:06.509277 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6eadc222-b860-4d63-aa40-2b3faa3c070b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:56:06.511615 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6eadc222-b860-4d63-aa40-2b3faa3c070b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:56:06.563268 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6eadc222-b860-4d63-aa40-2b3faa3c070b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.830924 Jun 20 12:56:06.563936 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3572/7043] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:56:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:56:06.574358 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e9111646-00d3-4730-980a-b269cf695dbe tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:56:06.574965 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e9111646-00d3-4730-980a-b269cf695dbe tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:56:06.646434 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e9111646-00d3-4730-980a-b269cf695dbe tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:56:06.658759 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e9111646-00d3-4730-980a-b269cf695dbe tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1237 microversion: 2.1 time: 0.088285 Jun 20 12:56:06.659404 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3472/7044] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:56:06 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1237 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:56:07.677999 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2cfba564-1c63-4b66-96a3-aa57ab815f6c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:56:07.678682 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2cfba564-1c63-4b66-96a3-aa57ab815f6c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:56:07.685942 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2cfba564-1c63-4b66-96a3-aa57ab815f6c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:07.686437 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2cfba564-1c63-4b66-96a3-aa57ab815f6c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:07.687200 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2cfba564-1c63-4b66-96a3-aa57ab815f6c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:07.687682 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2cfba564-1c63-4b66-96a3-aa57ab815f6c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:07.755868 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2cfba564-1c63-4b66-96a3-aa57ab815f6c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:56:07.767103 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2cfba564-1c63-4b66-96a3-aa57ab815f6c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1295 microversion: 2.1 time: 0.094047 Jun 20 12:56:07.767943 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3573/7045] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:56:07 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1295 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:56:08.787764 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ab31ec78-8a48-4f91-b1df-6b61e92922f3 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:56:08.788445 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ab31ec78-8a48-4f91-b1df-6b61e92922f3 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:56:08.802119 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ab31ec78-8a48-4f91-b1df-6b61e92922f3 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:08.803173 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ab31ec78-8a48-4f91-b1df-6b61e92922f3 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:08.805185 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ab31ec78-8a48-4f91-b1df-6b61e92922f3 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:08.806090 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ab31ec78-8a48-4f91-b1df-6b61e92922f3 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:09.283939 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ab31ec78-8a48-4f91-b1df-6b61e92922f3 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:56:09.293971 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ab31ec78-8a48-4f91-b1df-6b61e92922f3 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1362 microversion: 2.1 time: 0.510410 Jun 20 12:56:09.295007 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3473/7046] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:56:08 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1362 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:56:09.337798 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-8aa11e31-fcd8-49ad-80be-223007e0da69 req-4304d2d8-0907-416c-9cd9-4f15bb9d9df8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eefecb41-6dae-4175-9efe-db8b3dff9258", "tag": "63a45847-6266-402a-a049-73cd20b9f74e"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:56:09.348066 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-8aa11e31-fcd8-49ad-80be-223007e0da69 req-4304d2d8-0907-416c-9cd9-4f15bb9d9df8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:09.348621 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-8aa11e31-fcd8-49ad-80be-223007e0da69 req-4304d2d8-0907-416c-9cd9-4f15bb9d9df8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:09.360882 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-8aa11e31-fcd8-49ad-80be-223007e0da69 req-4304d2d8-0907-416c-9cd9-4f15bb9d9df8 service nova] Creating event network-changed:63a45847-6266-402a-a049-73cd20b9f74e for instance eefecb41-6dae-4175-9efe-db8b3dff9258 on n-h1-master-1 Jun 20 12:56:09.366165 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-8aa11e31-fcd8-49ad-80be-223007e0da69 req-4304d2d8-0907-416c-9cd9-4f15bb9d9df8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032088 Jun 20 12:56:09.366783 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3574/7047] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:56:10.311665 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-58a72986-ebbc-44d9-8e53-847876e0c32c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:56:10.312354 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-58a72986-ebbc-44d9-8e53-847876e0c32c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:56:10.322822 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-58a72986-ebbc-44d9-8e53-847876e0c32c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:10.323293 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-58a72986-ebbc-44d9-8e53-847876e0c32c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:10.324085 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-58a72986-ebbc-44d9-8e53-847876e0c32c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:10.324575 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-58a72986-ebbc-44d9-8e53-847876e0c32c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:10.477796 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-58a72986-ebbc-44d9-8e53-847876e0c32c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:56:10.486096 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-58a72986-ebbc-44d9-8e53-847876e0c32c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1362 microversion: 2.1 time: 0.178637 Jun 20 12:56:10.486668 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3474/7048] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:56:10 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:56:11.507532 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7951e55b-88fa-4ee3-b93a-9732432ae7db tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:56:11.508255 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7951e55b-88fa-4ee3-b93a-9732432ae7db tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:56:11.515329 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7951e55b-88fa-4ee3-b93a-9732432ae7db tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:11.515775 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7951e55b-88fa-4ee3-b93a-9732432ae7db tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:11.516593 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7951e55b-88fa-4ee3-b93a-9732432ae7db tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:11.517040 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7951e55b-88fa-4ee3-b93a-9732432ae7db tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:11.663585 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7951e55b-88fa-4ee3-b93a-9732432ae7db tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:56:11.671941 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7951e55b-88fa-4ee3-b93a-9732432ae7db tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1362 microversion: 2.1 time: 0.171369 Jun 20 12:56:11.672569 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3575/7049] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:56:11 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:56:12.696645 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-369af608-5faf-45a1-bd89-aea6af0909d4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:56:12.697249 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-369af608-5faf-45a1-bd89-aea6af0909d4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:56:12.704755 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-369af608-5faf-45a1-bd89-aea6af0909d4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:12.705221 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-369af608-5faf-45a1-bd89-aea6af0909d4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:12.705994 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-369af608-5faf-45a1-bd89-aea6af0909d4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:12.706442 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-369af608-5faf-45a1-bd89-aea6af0909d4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:12.848167 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-369af608-5faf-45a1-bd89-aea6af0909d4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:56:12.857369 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-369af608-5faf-45a1-bd89-aea6af0909d4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1362 microversion: 2.1 time: 0.164675 Jun 20 12:56:12.858029 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3475/7050] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:56:12 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:56:13.877391 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a8fedc52-eed0-4c47-964a-d76aed26912d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:56:13.878009 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a8fedc52-eed0-4c47-964a-d76aed26912d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:56:13.885766 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a8fedc52-eed0-4c47-964a-d76aed26912d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:13.886222 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a8fedc52-eed0-4c47-964a-d76aed26912d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:13.886983 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a8fedc52-eed0-4c47-964a-d76aed26912d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:13.887446 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a8fedc52-eed0-4c47-964a-d76aed26912d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:14.045510 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a8fedc52-eed0-4c47-964a-d76aed26912d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:56:14.053517 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a8fedc52-eed0-4c47-964a-d76aed26912d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1362 microversion: 2.1 time: 0.180400 Jun 20 12:56:14.054415 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3576/7051] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:56:13 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:56:14.932828 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-ce60774d-6ab5-482a-beca-230e1e99bbe6 req-a849f4fa-8dc7-45ab-90d3-368e8477f89d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eefecb41-6dae-4175-9efe-db8b3dff9258", "name": "network-vif-plugged", "status": "completed", "tag": "63a45847-6266-402a-a049-73cd20b9f74e"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:56:14.943104 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-ce60774d-6ab5-482a-beca-230e1e99bbe6 req-a849f4fa-8dc7-45ab-90d3-368e8477f89d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:14.943571 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-ce60774d-6ab5-482a-beca-230e1e99bbe6 req-a849f4fa-8dc7-45ab-90d3-368e8477f89d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:14.956194 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-ce60774d-6ab5-482a-beca-230e1e99bbe6 req-a849f4fa-8dc7-45ab-90d3-368e8477f89d service nova] Creating event network-vif-plugged:63a45847-6266-402a-a049-73cd20b9f74e for instance eefecb41-6dae-4175-9efe-db8b3dff9258 on n-h1-master-1 Jun 20 12:56:14.961453 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-ce60774d-6ab5-482a-beca-230e1e99bbe6 req-a849f4fa-8dc7-45ab-90d3-368e8477f89d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032770 Jun 20 12:56:14.962067 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3476/7052] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:56:15.077058 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2ed5ed0c-d24f-4809-ac49-4c0c06a0d615 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:56:15.077676 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2ed5ed0c-d24f-4809-ac49-4c0c06a0d615 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:56:15.085064 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2ed5ed0c-d24f-4809-ac49-4c0c06a0d615 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:15.085672 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2ed5ed0c-d24f-4809-ac49-4c0c06a0d615 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:15.086480 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2ed5ed0c-d24f-4809-ac49-4c0c06a0d615 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:15.087214 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2ed5ed0c-d24f-4809-ac49-4c0c06a0d615 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:15.223455 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2ed5ed0c-d24f-4809-ac49-4c0c06a0d615 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:56:15.231654 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2ed5ed0c-d24f-4809-ac49-4c0c06a0d615 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1362 microversion: 2.1 time: 0.158705 Jun 20 12:56:15.232237 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3577/7053] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:56:15 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:56:16.252674 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-91004876-25f6-4c49-b070-b3ef5d97eac8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:56:16.253487 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-91004876-25f6-4c49-b070-b3ef5d97eac8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:56:16.260804 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-91004876-25f6-4c49-b070-b3ef5d97eac8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:16.261375 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-91004876-25f6-4c49-b070-b3ef5d97eac8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:16.262236 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-91004876-25f6-4c49-b070-b3ef5d97eac8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:16.262675 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-91004876-25f6-4c49-b070-b3ef5d97eac8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:16.414102 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-91004876-25f6-4c49-b070-b3ef5d97eac8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:56:16.425195 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-91004876-25f6-4c49-b070-b3ef5d97eac8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1549 microversion: 2.1 time: 0.178328 Jun 20 12:56:16.425953 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3477/7054] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:56:16 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1549 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:56:16.443752 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-19bbdad9-6198-4552-ac28-10c74abee33d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:56:16.444418 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-19bbdad9-6198-4552-ac28-10c74abee33d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:56:16.451385 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-19bbdad9-6198-4552-ac28-10c74abee33d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:16.452067 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-19bbdad9-6198-4552-ac28-10c74abee33d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:16.454016 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-19bbdad9-6198-4552-ac28-10c74abee33d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:16.454749 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-19bbdad9-6198-4552-ac28-10c74abee33d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:16.475865 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:56:16.501585 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:56:16.541141 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-19bbdad9-6198-4552-ac28-10c74abee33d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101415 Jun 20 12:56:16.541783 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3578/7055] 10.222.0.27 () {58 vars in 1274 bytes} [Mon Jun 20 12:56:16 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:56:17.610781 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:56:17.672431 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-f6b1b932-1c46-4d6c-b40d-e0b7a7049712 req-d1d56b5f-d619-4cba-bfe2-39b54d65ef77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eefecb41-6dae-4175-9efe-db8b3dff9258", "tag": "63a45847-6266-402a-a049-73cd20b9f74e"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:56:17.681517 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-f6b1b932-1c46-4d6c-b40d-e0b7a7049712 req-d1d56b5f-d619-4cba-bfe2-39b54d65ef77 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:17.682097 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-f6b1b932-1c46-4d6c-b40d-e0b7a7049712 req-d1d56b5f-d619-4cba-bfe2-39b54d65ef77 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:17.694380 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-f6b1b932-1c46-4d6c-b40d-e0b7a7049712 req-d1d56b5f-d619-4cba-bfe2-39b54d65ef77 service nova] Creating event network-changed:63a45847-6266-402a-a049-73cd20b9f74e for instance eefecb41-6dae-4175-9efe-db8b3dff9258 on n-h1-master-1 Jun 20 12:56:17.699767 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-f6b1b932-1c46-4d6c-b40d-e0b7a7049712 req-d1d56b5f-d619-4cba-bfe2-39b54d65ef77 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093712 Jun 20 12:56:17.700416 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3478/7056] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:56:40.270175 n-d-master-1 devstack@n-api.service[119127]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 12:56:40.270832 n-d-master-1 devstack@n-api.service[119127]: Mon Jun 20 12:56:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 12:56:49.098830 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:56:49.099686 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:56:49.104821 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e021f9d6-a417-408f-b9fd-4755d1fb55c1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:56:49.105435 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e021f9d6-a417-408f-b9fd-4755d1fb55c1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:56:49.122811 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e021f9d6-a417-408f-b9fd-4755d1fb55c1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:49.123389 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e021f9d6-a417-408f-b9fd-4755d1fb55c1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:49.124218 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e021f9d6-a417-408f-b9fd-4755d1fb55c1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:49.124983 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e021f9d6-a417-408f-b9fd-4755d1fb55c1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:49.267196 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e021f9d6-a417-408f-b9fd-4755d1fb55c1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:56:49.275560 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e021f9d6-a417-408f-b9fd-4755d1fb55c1 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1668 microversion: 2.1 time: 0.178435 Jun 20 12:56:49.276159 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3579/7057] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:56:49 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1668 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:56:49.290225 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=29 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:56:49.291482 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:56:49.295608 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-851467d6-9a41-4c55-8991-b26adec5dda2 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b93a3660-e44d-445f-966a-5dbed750193e"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:56:49.297098 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-851467d6-9a41-4c55-8991-b26adec5dda2 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:56:49.304383 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-851467d6-9a41-4c55-8991-b26adec5dda2 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:49.304844 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-851467d6-9a41-4c55-8991-b26adec5dda2 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:49.305609 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-851467d6-9a41-4c55-8991-b26adec5dda2 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:56:49.306075 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-851467d6-9a41-4c55-8991-b26adec5dda2 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:56:49.563661 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-851467d6-9a41-4c55-8991-b26adec5dda2 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "POST /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275389 Jun 20 12:56:49.564424 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3479/7058] 10.222.0.27 () {60 vars in 1322 bytes} [Mon Jun 20 12:56:49 2022] POST /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:57:01.337870 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c860861d-b599-4edf-9fdf-dc55ca5b02a5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:57:01.338848 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c860861d-b599-4edf-9fdf-dc55ca5b02a5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:01.341337 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:57:01.342000 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:57:01.349313 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c860861d-b599-4edf-9fdf-dc55ca5b02a5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:01.349770 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c860861d-b599-4edf-9fdf-dc55ca5b02a5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:01.350543 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c860861d-b599-4edf-9fdf-dc55ca5b02a5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:01.350983 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c860861d-b599-4edf-9fdf-dc55ca5b02a5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:01.381778 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c860861d-b599-4edf-9fdf-dc55ca5b02a5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:01.388480 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c860861d-b599-4edf-9fdf-dc55ca5b02a5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Old instance type m1.heat2, new instance type m1.heat {{(pid=119127) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 20 12:57:01.395952 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-c860861d-b599-4edf-9fdf-dc55ca5b02a5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:57:01.396403 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-c860861d-b599-4edf-9fdf-dc55ca5b02a5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:57:01.396876 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-c860861d-b599-4edf-9fdf-dc55ca5b02a5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:57:01.397286 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-c860861d-b599-4edf-9fdf-dc55ca5b02a5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:57:01.397699 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-c860861d-b599-4edf-9fdf-dc55ca5b02a5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:57:01.471744 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c860861d-b599-4edf-9fdf-dc55ca5b02a5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "POST /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258/action" status: 202 len: 0 microversion: 2.1 time: 0.137853 Jun 20 12:57:01.472507 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3580/7059] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:57:01 2022] POST /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:57:01.478769 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:57:01.479977 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:57:01.484891 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dfbd7ea8-7166-4e21-8515-a903b53d2aa6 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:01.485610 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-dfbd7ea8-7166-4e21-8515-a903b53d2aa6 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:01.492975 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dfbd7ea8-7166-4e21-8515-a903b53d2aa6 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:01.493437 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dfbd7ea8-7166-4e21-8515-a903b53d2aa6 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:01.494217 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dfbd7ea8-7166-4e21-8515-a903b53d2aa6 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:01.494655 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dfbd7ea8-7166-4e21-8515-a903b53d2aa6 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:01.657464 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-dfbd7ea8-7166-4e21-8515-a903b53d2aa6 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:01.665891 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dfbd7ea8-7166-4e21-8515-a903b53d2aa6 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1723 microversion: 2.1 time: 0.188951 Jun 20 12:57:01.666445 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3480/7060] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:01 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:02.684507 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cae236ba-a886-43ef-94ef-2139db212338 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:02.685062 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cae236ba-a886-43ef-94ef-2139db212338 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:02.691867 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cae236ba-a886-43ef-94ef-2139db212338 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:02.692358 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cae236ba-a886-43ef-94ef-2139db212338 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:02.693148 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cae236ba-a886-43ef-94ef-2139db212338 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:02.693584 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cae236ba-a886-43ef-94ef-2139db212338 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:02.835972 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cae236ba-a886-43ef-94ef-2139db212338 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:02.844706 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cae236ba-a886-43ef-94ef-2139db212338 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1723 microversion: 2.1 time: 0.165424 Jun 20 12:57:02.845319 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3581/7061] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:02 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:03.865747 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f42b189c-bcb9-40f4-bc3c-de625b95afd5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:03.866403 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f42b189c-bcb9-40f4-bc3c-de625b95afd5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:03.877111 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f42b189c-bcb9-40f4-bc3c-de625b95afd5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:03.877573 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f42b189c-bcb9-40f4-bc3c-de625b95afd5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:03.878359 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f42b189c-bcb9-40f4-bc3c-de625b95afd5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:03.878799 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f42b189c-bcb9-40f4-bc3c-de625b95afd5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:04.028114 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f42b189c-bcb9-40f4-bc3c-de625b95afd5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:04.037296 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f42b189c-bcb9-40f4-bc3c-de625b95afd5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1728 microversion: 2.1 time: 0.178073 Jun 20 12:57:04.037893 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3481/7062] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:03 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:05.056494 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b834047b-c512-47fc-8f7b-d3ba8164679f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:05.057094 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b834047b-c512-47fc-8f7b-d3ba8164679f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:05.073388 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b834047b-c512-47fc-8f7b-d3ba8164679f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:05.073973 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b834047b-c512-47fc-8f7b-d3ba8164679f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:05.075171 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b834047b-c512-47fc-8f7b-d3ba8164679f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:05.075917 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b834047b-c512-47fc-8f7b-d3ba8164679f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:05.218135 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b834047b-c512-47fc-8f7b-d3ba8164679f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:05.226998 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b834047b-c512-47fc-8f7b-d3ba8164679f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1728 microversion: 2.1 time: 0.175768 Jun 20 12:57:05.227603 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3582/7063] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:05 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1728 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:06.246596 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-53cd17c6-cb9a-40df-9510-38b7481e795e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:06.247730 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-53cd17c6-cb9a-40df-9510-38b7481e795e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:06.256879 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-53cd17c6-cb9a-40df-9510-38b7481e795e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:06.257345 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-53cd17c6-cb9a-40df-9510-38b7481e795e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:06.258133 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-53cd17c6-cb9a-40df-9510-38b7481e795e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:06.258577 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-53cd17c6-cb9a-40df-9510-38b7481e795e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:06.424921 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-53cd17c6-cb9a-40df-9510-38b7481e795e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:06.436683 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-53cd17c6-cb9a-40df-9510-38b7481e795e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1728 microversion: 2.1 time: 0.195933 Jun 20 12:57:06.437266 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3482/7064] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:06 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1728 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:07.457961 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e2732247-0fa0-4677-96cc-349beea1dc6e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:07.458737 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e2732247-0fa0-4677-96cc-349beea1dc6e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:07.468459 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2732247-0fa0-4677-96cc-349beea1dc6e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:07.469060 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2732247-0fa0-4677-96cc-349beea1dc6e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:07.470138 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2732247-0fa0-4677-96cc-349beea1dc6e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:07.470581 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2732247-0fa0-4677-96cc-349beea1dc6e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:07.607752 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e2732247-0fa0-4677-96cc-349beea1dc6e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:07.621759 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e2732247-0fa0-4677-96cc-349beea1dc6e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1728 microversion: 2.1 time: 0.168918 Jun 20 12:57:07.622660 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3583/7065] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:07 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:08.646614 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0b59c9e1-d273-4f8e-ab12-28eb4398d679 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:08.647265 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0b59c9e1-d273-4f8e-ab12-28eb4398d679 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:08.655404 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0b59c9e1-d273-4f8e-ab12-28eb4398d679 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:08.655872 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0b59c9e1-d273-4f8e-ab12-28eb4398d679 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:08.656698 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0b59c9e1-d273-4f8e-ab12-28eb4398d679 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:08.657154 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0b59c9e1-d273-4f8e-ab12-28eb4398d679 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:08.798825 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0b59c9e1-d273-4f8e-ab12-28eb4398d679 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:08.807667 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0b59c9e1-d273-4f8e-ab12-28eb4398d679 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1728 microversion: 2.1 time: 0.168486 Jun 20 12:57:08.808832 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3483/7066] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:08 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:09.825627 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-42cdc954-e9c2-4605-acf5-7f4fa9d1449f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:09.826240 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-42cdc954-e9c2-4605-acf5-7f4fa9d1449f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:09.833948 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-42cdc954-e9c2-4605-acf5-7f4fa9d1449f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:09.834424 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-42cdc954-e9c2-4605-acf5-7f4fa9d1449f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:09.835167 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-42cdc954-e9c2-4605-acf5-7f4fa9d1449f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:09.835605 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-42cdc954-e9c2-4605-acf5-7f4fa9d1449f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:09.984814 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-42cdc954-e9c2-4605-acf5-7f4fa9d1449f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:09.993849 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-42cdc954-e9c2-4605-acf5-7f4fa9d1449f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1728 microversion: 2.1 time: 0.172160 Jun 20 12:57:09.994441 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3584/7067] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:09 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:11.014125 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f499f721-0594-4e3b-abf3-47c65aded2b8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:11.014747 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f499f721-0594-4e3b-abf3-47c65aded2b8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:11.033140 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f499f721-0594-4e3b-abf3-47c65aded2b8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:11.033869 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f499f721-0594-4e3b-abf3-47c65aded2b8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:11.035163 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f499f721-0594-4e3b-abf3-47c65aded2b8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:11.035864 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f499f721-0594-4e3b-abf3-47c65aded2b8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:11.181286 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f499f721-0594-4e3b-abf3-47c65aded2b8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:11.191638 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f499f721-0594-4e3b-abf3-47c65aded2b8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1728 microversion: 2.1 time: 0.181239 Jun 20 12:57:11.192552 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3484/7068] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:11 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1728 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:12.210113 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e3e18b03-6c0c-4b76-9cd6-ad1a8c1e7502 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:12.210701 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e3e18b03-6c0c-4b76-9cd6-ad1a8c1e7502 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:12.218302 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e3e18b03-6c0c-4b76-9cd6-ad1a8c1e7502 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:12.218755 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e3e18b03-6c0c-4b76-9cd6-ad1a8c1e7502 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:12.219642 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e3e18b03-6c0c-4b76-9cd6-ad1a8c1e7502 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:12.220251 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e3e18b03-6c0c-4b76-9cd6-ad1a8c1e7502 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:12.358027 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e3e18b03-6c0c-4b76-9cd6-ad1a8c1e7502 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:12.366818 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e3e18b03-6c0c-4b76-9cd6-ad1a8c1e7502 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1728 microversion: 2.1 time: 0.160783 Jun 20 12:57:12.367451 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3585/7069] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:12 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:13.384990 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-26e6e3c1-f33e-4e13-b7b4-9b1531f73c56 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:13.385941 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-26e6e3c1-f33e-4e13-b7b4-9b1531f73c56 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:13.397498 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-26e6e3c1-f33e-4e13-b7b4-9b1531f73c56 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:13.398231 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-26e6e3c1-f33e-4e13-b7b4-9b1531f73c56 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:13.399544 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-26e6e3c1-f33e-4e13-b7b4-9b1531f73c56 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:13.400299 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-26e6e3c1-f33e-4e13-b7b4-9b1531f73c56 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:13.551035 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-26e6e3c1-f33e-4e13-b7b4-9b1531f73c56 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:13.560079 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-26e6e3c1-f33e-4e13-b7b4-9b1531f73c56 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1728 microversion: 2.1 time: 0.179143 Jun 20 12:57:13.560717 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3485/7070] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:13 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:14.578204 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e225b0fc-b813-457a-b77a-cf0ba0635157 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:14.578798 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e225b0fc-b813-457a-b77a-cf0ba0635157 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:14.586524 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e225b0fc-b813-457a-b77a-cf0ba0635157 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:14.586987 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e225b0fc-b813-457a-b77a-cf0ba0635157 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:14.587774 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e225b0fc-b813-457a-b77a-cf0ba0635157 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:14.588243 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e225b0fc-b813-457a-b77a-cf0ba0635157 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:14.738625 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e225b0fc-b813-457a-b77a-cf0ba0635157 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:14.747377 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e225b0fc-b813-457a-b77a-cf0ba0635157 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1728 microversion: 2.1 time: 0.173184 Jun 20 12:57:14.748116 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3586/7071] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:14 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:15.768607 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3127b9a6-146f-4e63-9eaf-bc574d6e16ed tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:15.769253 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3127b9a6-146f-4e63-9eaf-bc574d6e16ed tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:15.776835 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3127b9a6-146f-4e63-9eaf-bc574d6e16ed tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:15.777311 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3127b9a6-146f-4e63-9eaf-bc574d6e16ed tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:15.778097 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3127b9a6-146f-4e63-9eaf-bc574d6e16ed tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:15.778551 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3127b9a6-146f-4e63-9eaf-bc574d6e16ed tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:15.928641 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3127b9a6-146f-4e63-9eaf-bc574d6e16ed tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:15.937566 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3127b9a6-146f-4e63-9eaf-bc574d6e16ed tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1728 microversion: 2.1 time: 0.172970 Jun 20 12:57:15.938172 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3486/7072] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:15 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:16.957353 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-44dd854c-b7e8-4921-9a05-37c20a6dfd4f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:16.957968 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-44dd854c-b7e8-4921-9a05-37c20a6dfd4f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:16.964821 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-44dd854c-b7e8-4921-9a05-37c20a6dfd4f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:16.965280 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-44dd854c-b7e8-4921-9a05-37c20a6dfd4f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:16.966053 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-44dd854c-b7e8-4921-9a05-37c20a6dfd4f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:16.966488 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-44dd854c-b7e8-4921-9a05-37c20a6dfd4f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:17.103231 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-44dd854c-b7e8-4921-9a05-37c20a6dfd4f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:17.113032 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-44dd854c-b7e8-4921-9a05-37c20a6dfd4f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1728 microversion: 2.1 time: 0.160432 Jun 20 12:57:17.113781 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3587/7073] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:16 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:18.133311 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7f293d2e-32d5-4d06-a948-3fafef8b4544 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:18.133914 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7f293d2e-32d5-4d06-a948-3fafef8b4544 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:18.141197 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f293d2e-32d5-4d06-a948-3fafef8b4544 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:18.141665 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f293d2e-32d5-4d06-a948-3fafef8b4544 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:18.142455 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f293d2e-32d5-4d06-a948-3fafef8b4544 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:18.142906 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f293d2e-32d5-4d06-a948-3fafef8b4544 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:18.305025 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7f293d2e-32d5-4d06-a948-3fafef8b4544 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:18.314149 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7f293d2e-32d5-4d06-a948-3fafef8b4544 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1728 microversion: 2.1 time: 0.185844 Jun 20 12:57:18.314737 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3487/7074] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:18 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1728 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:19.332474 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f6de3916-1c44-4cf3-b30b-2761057fac43 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:19.333179 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f6de3916-1c44-4cf3-b30b-2761057fac43 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:19.340593 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f6de3916-1c44-4cf3-b30b-2761057fac43 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:19.341047 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f6de3916-1c44-4cf3-b30b-2761057fac43 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:19.341811 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f6de3916-1c44-4cf3-b30b-2761057fac43 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:19.342248 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f6de3916-1c44-4cf3-b30b-2761057fac43 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:19.769299 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f6de3916-1c44-4cf3-b30b-2761057fac43 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:19.778171 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f6de3916-1c44-4cf3-b30b-2761057fac43 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1728 microversion: 2.1 time: 0.449611 Jun 20 12:57:19.778771 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3588/7075] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:19 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1728 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:20.796654 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1814a7c2-30a6-4666-a959-93bb43562b5f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:20.797201 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1814a7c2-30a6-4666-a959-93bb43562b5f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:20.805469 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1814a7c2-30a6-4666-a959-93bb43562b5f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:20.805936 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1814a7c2-30a6-4666-a959-93bb43562b5f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:20.806732 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1814a7c2-30a6-4666-a959-93bb43562b5f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:20.807183 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1814a7c2-30a6-4666-a959-93bb43562b5f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:20.963073 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1814a7c2-30a6-4666-a959-93bb43562b5f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:20.974777 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1814a7c2-30a6-4666-a959-93bb43562b5f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1728 microversion: 2.1 time: 0.181632 Jun 20 12:57:20.975599 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3488/7076] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:20 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1728 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:21.999257 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cb72223e-104e-407c-aac4-5edd89d01afc tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:22.000103 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cb72223e-104e-407c-aac4-5edd89d01afc tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:22.008916 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cb72223e-104e-407c-aac4-5edd89d01afc tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:22.009367 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cb72223e-104e-407c-aac4-5edd89d01afc tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:22.010309 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cb72223e-104e-407c-aac4-5edd89d01afc tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:22.010746 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cb72223e-104e-407c-aac4-5edd89d01afc tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:22.145414 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cb72223e-104e-407c-aac4-5edd89d01afc tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:22.153864 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cb72223e-104e-407c-aac4-5edd89d01afc tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1728 microversion: 2.1 time: 0.158592 Jun 20 12:57:22.154464 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3589/7077] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:21 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:23.116769 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-24b78c74-3617-4a08-81ca-01fb6479c36e req-da8f39fc-7697-436a-ac4d-5fa808e9cb4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eefecb41-6dae-4175-9efe-db8b3dff9258", "name": "network-vif-unplugged", "status": "completed", "tag": "63a45847-6266-402a-a049-73cd20b9f74e"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:57:23.126866 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-24b78c74-3617-4a08-81ca-01fb6479c36e req-da8f39fc-7697-436a-ac4d-5fa808e9cb4b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:23.127683 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-24b78c74-3617-4a08-81ca-01fb6479c36e req-da8f39fc-7697-436a-ac4d-5fa808e9cb4b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:23.141735 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-24b78c74-3617-4a08-81ca-01fb6479c36e req-da8f39fc-7697-436a-ac4d-5fa808e9cb4b service nova] Creating event network-vif-unplugged:63a45847-6266-402a-a049-73cd20b9f74e for instance eefecb41-6dae-4175-9efe-db8b3dff9258 on n-h2-master-1 Jun 20 12:57:23.148686 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [req-24b78c74-3617-4a08-81ca-01fb6479c36e req-da8f39fc-7697-436a-ac4d-5fa808e9cb4b service nova] Instance eefecb41-6dae-4175-9efe-db8b3dff9258 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:57:23.161693 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-24b78c74-3617-4a08-81ca-01fb6479c36e req-da8f39fc-7697-436a-ac4d-5fa808e9cb4b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049130 Jun 20 12:57:23.162327 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3489/7078] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:57:23.171076 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7ec28afd-f7e1-4dfe-b711-4dbc627436ec tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:23.171954 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7ec28afd-f7e1-4dfe-b711-4dbc627436ec tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:23.179497 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ec28afd-f7e1-4dfe-b711-4dbc627436ec tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:23.179949 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ec28afd-f7e1-4dfe-b711-4dbc627436ec tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:23.180788 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ec28afd-f7e1-4dfe-b711-4dbc627436ec tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:23.181760 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ec28afd-f7e1-4dfe-b711-4dbc627436ec tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:23.354238 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7ec28afd-f7e1-4dfe-b711-4dbc627436ec tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:23.363394 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7ec28afd-f7e1-4dfe-b711-4dbc627436ec tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1727 microversion: 2.1 time: 0.195873 Jun 20 12:57:23.364568 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3590/7079] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:23 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1727 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:24.384047 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5fb95004-6c5d-410b-a937-e421730f0339 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:24.385050 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5fb95004-6c5d-410b-a937-e421730f0339 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:24.391964 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5fb95004-6c5d-410b-a937-e421730f0339 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:24.392476 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5fb95004-6c5d-410b-a937-e421730f0339 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:24.393298 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5fb95004-6c5d-410b-a937-e421730f0339 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:24.393753 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5fb95004-6c5d-410b-a937-e421730f0339 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:24.534959 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5fb95004-6c5d-410b-a937-e421730f0339 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:24.544567 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5fb95004-6c5d-410b-a937-e421730f0339 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1725 microversion: 2.1 time: 0.165963 Jun 20 12:57:24.545176 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3490/7080] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:24 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:25.182165 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-27ae07f0-091e-4424-945a-62670210b140 req-580bf9da-1d13-4ec4-ac00-9043773f1757 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eefecb41-6dae-4175-9efe-db8b3dff9258", "tag": "63a45847-6266-402a-a049-73cd20b9f74e"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:57:25.192433 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-27ae07f0-091e-4424-945a-62670210b140 req-580bf9da-1d13-4ec4-ac00-9043773f1757 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:25.192963 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-27ae07f0-091e-4424-945a-62670210b140 req-580bf9da-1d13-4ec4-ac00-9043773f1757 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:25.207672 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-27ae07f0-091e-4424-945a-62670210b140 req-580bf9da-1d13-4ec4-ac00-9043773f1757 service nova] Creating event network-changed:63a45847-6266-402a-a049-73cd20b9f74e for instance eefecb41-6dae-4175-9efe-db8b3dff9258 on n-h2-master-1 Jun 20 12:57:25.214342 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [req-27ae07f0-091e-4424-945a-62670210b140 req-580bf9da-1d13-4ec4-ac00-9043773f1757 service nova] Instance eefecb41-6dae-4175-9efe-db8b3dff9258 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119127) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:57:25.226310 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-27ae07f0-091e-4424-945a-62670210b140 req-580bf9da-1d13-4ec4-ac00-9043773f1757 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047719 Jun 20 12:57:25.226929 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3591/7081] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:57:25.563797 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-790701d5-8a09-45f8-b9c3-06a9e3deb062 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:25.564447 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-790701d5-8a09-45f8-b9c3-06a9e3deb062 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:25.572583 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-790701d5-8a09-45f8-b9c3-06a9e3deb062 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:25.573044 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-790701d5-8a09-45f8-b9c3-06a9e3deb062 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:25.573801 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-790701d5-8a09-45f8-b9c3-06a9e3deb062 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:25.574492 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-790701d5-8a09-45f8-b9c3-06a9e3deb062 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:25.958139 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-790701d5-8a09-45f8-b9c3-06a9e3deb062 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:25.969526 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-790701d5-8a09-45f8-b9c3-06a9e3deb062 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1725 microversion: 2.1 time: 0.409937 Jun 20 12:57:25.970556 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3491/7082] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:25 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1725 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:26.990691 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-36377dcf-ce8f-4ff0-a095-8ce07829d340 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:26.991416 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-36377dcf-ce8f-4ff0-a095-8ce07829d340 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:26.998705 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36377dcf-ce8f-4ff0-a095-8ce07829d340 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:26.999161 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36377dcf-ce8f-4ff0-a095-8ce07829d340 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:26.999949 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36377dcf-ce8f-4ff0-a095-8ce07829d340 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:27.000429 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36377dcf-ce8f-4ff0-a095-8ce07829d340 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:27.149469 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-36377dcf-ce8f-4ff0-a095-8ce07829d340 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:27.159014 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-36377dcf-ce8f-4ff0-a095-8ce07829d340 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1725 microversion: 2.1 time: 0.174080 Jun 20 12:57:27.159608 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3592/7083] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:26 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:28.177848 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2bd60ecd-f61b-43ff-b299-625280dacd0c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:28.178831 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2bd60ecd-f61b-43ff-b299-625280dacd0c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:28.187072 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2bd60ecd-f61b-43ff-b299-625280dacd0c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:28.187540 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2bd60ecd-f61b-43ff-b299-625280dacd0c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:28.188368 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2bd60ecd-f61b-43ff-b299-625280dacd0c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:28.188808 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2bd60ecd-f61b-43ff-b299-625280dacd0c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:28.346817 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2bd60ecd-f61b-43ff-b299-625280dacd0c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:28.355752 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2bd60ecd-f61b-43ff-b299-625280dacd0c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1725 microversion: 2.1 time: 0.183084 Jun 20 12:57:28.356397 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3492/7084] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:28 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:29.374842 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d57c595f-e391-44e3-bbab-a55f0e8b4ad8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:29.375399 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d57c595f-e391-44e3-bbab-a55f0e8b4ad8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:29.384405 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d57c595f-e391-44e3-bbab-a55f0e8b4ad8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:29.384896 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d57c595f-e391-44e3-bbab-a55f0e8b4ad8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:29.386113 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d57c595f-e391-44e3-bbab-a55f0e8b4ad8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:29.386730 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d57c595f-e391-44e3-bbab-a55f0e8b4ad8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:29.538293 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d57c595f-e391-44e3-bbab-a55f0e8b4ad8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:29.552142 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d57c595f-e391-44e3-bbab-a55f0e8b4ad8 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1725 microversion: 2.1 time: 0.181639 Jun 20 12:57:29.552776 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3593/7085] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:29 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:30.571062 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0199365c-3885-4353-9fed-52c55aecc71a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:30.571674 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0199365c-3885-4353-9fed-52c55aecc71a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:30.579560 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0199365c-3885-4353-9fed-52c55aecc71a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:30.580008 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0199365c-3885-4353-9fed-52c55aecc71a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:30.580817 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0199365c-3885-4353-9fed-52c55aecc71a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:30.581254 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0199365c-3885-4353-9fed-52c55aecc71a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:30.744272 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0199365c-3885-4353-9fed-52c55aecc71a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:30.752857 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0199365c-3885-4353-9fed-52c55aecc71a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1725 microversion: 2.1 time: 0.185909 Jun 20 12:57:30.753560 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3493/7086] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:30 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:31.771650 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2ceb59ff-fed3-4317-b92b-132ce0422883 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:31.772467 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2ceb59ff-fed3-4317-b92b-132ce0422883 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:31.775808 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=33 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:57:31.782265 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2ceb59ff-fed3-4317-b92b-132ce0422883 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:31.782719 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2ceb59ff-fed3-4317-b92b-132ce0422883 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:31.783510 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2ceb59ff-fed3-4317-b92b-132ce0422883 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:31.783950 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2ceb59ff-fed3-4317-b92b-132ce0422883 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:31.787051 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:57:31.943410 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2ceb59ff-fed3-4317-b92b-132ce0422883 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:31.956225 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2ceb59ff-fed3-4317-b92b-132ce0422883 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1725 microversion: 2.1 time: 0.188767 Jun 20 12:57:31.956846 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3594/7087] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:31 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:32.974741 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-789e6153-3a1c-47c8-92c5-f28f22a1bc0a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:32.975337 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-789e6153-3a1c-47c8-92c5-f28f22a1bc0a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:32.978427 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=29 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:57:32.984036 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-789e6153-3a1c-47c8-92c5-f28f22a1bc0a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:32.984523 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-789e6153-3a1c-47c8-92c5-f28f22a1bc0a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:32.985307 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-789e6153-3a1c-47c8-92c5-f28f22a1bc0a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:32.985749 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-789e6153-3a1c-47c8-92c5-f28f22a1bc0a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:32.988670 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=83 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:57:33.144648 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-789e6153-3a1c-47c8-92c5-f28f22a1bc0a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:33.153418 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-789e6153-3a1c-47c8-92c5-f28f22a1bc0a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1725 microversion: 2.1 time: 0.182660 Jun 20 12:57:33.154009 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3494/7088] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:32 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:34.174723 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bafc8af3-5eaf-4432-8953-765d901476cc tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:34.175362 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bafc8af3-5eaf-4432-8953-765d901476cc tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:34.183036 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bafc8af3-5eaf-4432-8953-765d901476cc tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:34.184297 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bafc8af3-5eaf-4432-8953-765d901476cc tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:34.184974 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bafc8af3-5eaf-4432-8953-765d901476cc tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:34.185411 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bafc8af3-5eaf-4432-8953-765d901476cc tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:34.340755 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bafc8af3-5eaf-4432-8953-765d901476cc tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:34.349771 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bafc8af3-5eaf-4432-8953-765d901476cc tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1725 microversion: 2.1 time: 0.181259 Jun 20 12:57:34.350375 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3595/7089] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:34 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:35.368513 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-76204c23-d8b2-47b4-ba1d-ebfb85324666 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:35.369332 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-76204c23-d8b2-47b4-ba1d-ebfb85324666 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:35.377748 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-76204c23-d8b2-47b4-ba1d-ebfb85324666 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:35.378240 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-76204c23-d8b2-47b4-ba1d-ebfb85324666 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:35.379021 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-76204c23-d8b2-47b4-ba1d-ebfb85324666 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:35.379465 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-76204c23-d8b2-47b4-ba1d-ebfb85324666 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:35.525737 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-76204c23-d8b2-47b4-ba1d-ebfb85324666 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:35.534449 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-76204c23-d8b2-47b4-ba1d-ebfb85324666 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1725 microversion: 2.1 time: 0.170878 Jun 20 12:57:35.535018 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3495/7090] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:35 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:36.551301 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-059c6282-62bb-4f54-a28a-53c880b0076b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:36.551960 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-059c6282-62bb-4f54-a28a-53c880b0076b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:36.561867 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-059c6282-62bb-4f54-a28a-53c880b0076b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:36.562319 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-059c6282-62bb-4f54-a28a-53c880b0076b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:36.563234 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-059c6282-62bb-4f54-a28a-53c880b0076b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:36.563573 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-059c6282-62bb-4f54-a28a-53c880b0076b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:36.717828 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-059c6282-62bb-4f54-a28a-53c880b0076b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:36.726658 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-059c6282-62bb-4f54-a28a-53c880b0076b tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1725 microversion: 2.1 time: 0.179283 Jun 20 12:57:36.727366 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3596/7091] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:36 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:37.745088 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-28da7e2e-238a-4262-9174-efcf127b1555 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:37.746030 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-28da7e2e-238a-4262-9174-efcf127b1555 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:37.753770 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-28da7e2e-238a-4262-9174-efcf127b1555 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:37.754288 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-28da7e2e-238a-4262-9174-efcf127b1555 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:37.755089 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-28da7e2e-238a-4262-9174-efcf127b1555 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:37.755705 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-28da7e2e-238a-4262-9174-efcf127b1555 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:37.894483 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-28da7e2e-238a-4262-9174-efcf127b1555 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:37.902908 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-28da7e2e-238a-4262-9174-efcf127b1555 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1725 microversion: 2.1 time: 0.161903 Jun 20 12:57:37.903509 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3496/7092] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:37 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:38.924522 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9df73fd8-a9f8-4d04-9335-03fc792b7b28 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:38.925131 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9df73fd8-a9f8-4d04-9335-03fc792b7b28 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:38.932364 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9df73fd8-a9f8-4d04-9335-03fc792b7b28 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:38.932829 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9df73fd8-a9f8-4d04-9335-03fc792b7b28 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:38.933959 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9df73fd8-a9f8-4d04-9335-03fc792b7b28 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:38.934404 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9df73fd8-a9f8-4d04-9335-03fc792b7b28 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:39.072713 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9df73fd8-a9f8-4d04-9335-03fc792b7b28 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:39.081427 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9df73fd8-a9f8-4d04-9335-03fc792b7b28 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1722 microversion: 2.1 time: 0.161627 Jun 20 12:57:39.082041 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3597/7093] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:38 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:39.099024 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-44c2c5c7-3cac-45b8-b5b7-dd1fbbb01f0d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:57:39.099569 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-44c2c5c7-3cac-45b8-b5b7-dd1fbbb01f0d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:39.106480 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-44c2c5c7-3cac-45b8-b5b7-dd1fbbb01f0d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:39.106955 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-44c2c5c7-3cac-45b8-b5b7-dd1fbbb01f0d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:39.107735 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-44c2c5c7-3cac-45b8-b5b7-dd1fbbb01f0d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:39.108190 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-44c2c5c7-3cac-45b8-b5b7-dd1fbbb01f0d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:39.148270 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-44c2c5c7-3cac-45b8-b5b7-dd1fbbb01f0d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:39.148759 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-44c2c5c7-3cac-45b8-b5b7-dd1fbbb01f0d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:39.149576 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-44c2c5c7-3cac-45b8-b5b7-dd1fbbb01f0d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:39.150028 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-44c2c5c7-3cac-45b8-b5b7-dd1fbbb01f0d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:39.171679 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-44c2c5c7-3cac-45b8-b5b7-dd1fbbb01f0d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Getting quotas for project 57445eadc2e94955963af6c23e797c07. Resources: {'ram', 'cores'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:57:39.177804 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-44c2c5c7-3cac-45b8-b5b7-dd1fbbb01f0d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Getting quotas for user b18cd0c87eed404bb4321acc9762a172 and project 57445eadc2e94955963af6c23e797c07. Resources: {'ram', 'cores'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:57:39.295001 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-44c2c5c7-3cac-45b8-b5b7-dd1fbbb01f0d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "POST /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258/action" status: 202 len: 0 microversion: 2.1 time: 0.200064 Jun 20 12:57:39.295656 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3497/7094] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:57:39 2022] POST /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:57:39.304393 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-16bd479c-9f0b-424e-997b-e71eba687aa0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:39.305116 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-16bd479c-9f0b-424e-997b-e71eba687aa0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:39.311937 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-16bd479c-9f0b-424e-997b-e71eba687aa0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:39.312528 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-16bd479c-9f0b-424e-997b-e71eba687aa0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:39.313419 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-16bd479c-9f0b-424e-997b-e71eba687aa0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:39.314101 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-16bd479c-9f0b-424e-997b-e71eba687aa0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:39.465460 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-16bd479c-9f0b-424e-997b-e71eba687aa0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:39.485556 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-16bd479c-9f0b-424e-997b-e71eba687aa0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1721 microversion: 2.1 time: 0.184902 Jun 20 12:57:39.486347 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3598/7095] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:39 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:40.505300 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-457fc60a-cecb-405e-869e-18ca59d1e37e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:40.506062 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-457fc60a-cecb-405e-869e-18ca59d1e37e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:40.516569 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-457fc60a-cecb-405e-869e-18ca59d1e37e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:40.517036 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-457fc60a-cecb-405e-869e-18ca59d1e37e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:40.517850 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-457fc60a-cecb-405e-869e-18ca59d1e37e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:40.518302 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-457fc60a-cecb-405e-869e-18ca59d1e37e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:40.655571 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-457fc60a-cecb-405e-869e-18ca59d1e37e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:40.667911 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-457fc60a-cecb-405e-869e-18ca59d1e37e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1721 microversion: 2.1 time: 0.167927 Jun 20 12:57:40.668961 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3498/7096] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:40 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:40.888051 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-f549f635-6c82-44fd-9504-6a948e804024 req-4e05a5c8-982a-4613-8c2b-f4f836b581c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eefecb41-6dae-4175-9efe-db8b3dff9258", "name": "network-vif-plugged", "status": "completed", "tag": "63a45847-6266-402a-a049-73cd20b9f74e"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:57:40.897940 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-f549f635-6c82-44fd-9504-6a948e804024 req-4e05a5c8-982a-4613-8c2b-f4f836b581c7 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:40.898399 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-f549f635-6c82-44fd-9504-6a948e804024 req-4e05a5c8-982a-4613-8c2b-f4f836b581c7 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:40.910626 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-f549f635-6c82-44fd-9504-6a948e804024 req-4e05a5c8-982a-4613-8c2b-f4f836b581c7 service nova] Creating event network-vif-plugged:63a45847-6266-402a-a049-73cd20b9f74e for instance eefecb41-6dae-4175-9efe-db8b3dff9258 on n-h2-master-1 Jun 20 12:57:40.916108 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [req-f549f635-6c82-44fd-9504-6a948e804024 req-4e05a5c8-982a-4613-8c2b-f4f836b581c7 service nova] Instance eefecb41-6dae-4175-9efe-db8b3dff9258 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119127) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:57:40.927659 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-f549f635-6c82-44fd-9504-6a948e804024 req-4e05a5c8-982a-4613-8c2b-f4f836b581c7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043445 Jun 20 12:57:40.928323 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3599/7097] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:57:41.691330 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5c448dd2-b7b2-45d8-863b-546aef25858a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:41.691938 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5c448dd2-b7b2-45d8-863b-546aef25858a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:41.699323 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5c448dd2-b7b2-45d8-863b-546aef25858a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:41.699787 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5c448dd2-b7b2-45d8-863b-546aef25858a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:41.700671 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5c448dd2-b7b2-45d8-863b-546aef25858a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:41.701116 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5c448dd2-b7b2-45d8-863b-546aef25858a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:41.856760 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5c448dd2-b7b2-45d8-863b-546aef25858a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:41.866578 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5c448dd2-b7b2-45d8-863b-546aef25858a tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1721 microversion: 2.1 time: 0.179463 Jun 20 12:57:41.867154 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3499/7098] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:41 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:42.885778 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ab247564-d9db-48b8-94e8-812f2586efab tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:42.886595 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ab247564-d9db-48b8-94e8-812f2586efab tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:42.894373 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ab247564-d9db-48b8-94e8-812f2586efab tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:42.894836 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ab247564-d9db-48b8-94e8-812f2586efab tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:42.895603 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ab247564-d9db-48b8-94e8-812f2586efab tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:42.896046 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ab247564-d9db-48b8-94e8-812f2586efab tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:43.036296 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ab247564-d9db-48b8-94e8-812f2586efab tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:43.044594 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ab247564-d9db-48b8-94e8-812f2586efab tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1721 microversion: 2.1 time: 0.164146 Jun 20 12:57:43.045228 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3600/7099] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:42 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:44.063131 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c7aab801-e046-4162-b98e-1b8bcf4bc1e0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:44.063890 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c7aab801-e046-4162-b98e-1b8bcf4bc1e0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:44.071075 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c7aab801-e046-4162-b98e-1b8bcf4bc1e0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:44.071549 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c7aab801-e046-4162-b98e-1b8bcf4bc1e0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:44.072373 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c7aab801-e046-4162-b98e-1b8bcf4bc1e0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:44.072827 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c7aab801-e046-4162-b98e-1b8bcf4bc1e0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:44.220456 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c7aab801-e046-4162-b98e-1b8bcf4bc1e0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:44.228867 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c7aab801-e046-4162-b98e-1b8bcf4bc1e0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1721 microversion: 2.1 time: 0.170745 Jun 20 12:57:44.229457 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3500/7100] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:44 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:44.913751 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-92d6a8c0-a374-4d28-8b4d-f5bf6fff159f req-24176551-f49c-420b-8c66-069f9cd5c0da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eefecb41-6dae-4175-9efe-db8b3dff9258", "name": "network-vif-unplugged", "status": "completed", "tag": "63a45847-6266-402a-a049-73cd20b9f74e"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:57:44.923921 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-92d6a8c0-a374-4d28-8b4d-f5bf6fff159f req-24176551-f49c-420b-8c66-069f9cd5c0da service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:44.924389 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-92d6a8c0-a374-4d28-8b4d-f5bf6fff159f req-24176551-f49c-420b-8c66-069f9cd5c0da service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:44.940091 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-92d6a8c0-a374-4d28-8b4d-f5bf6fff159f req-24176551-f49c-420b-8c66-069f9cd5c0da service nova] Creating event network-vif-unplugged:63a45847-6266-402a-a049-73cd20b9f74e for instance eefecb41-6dae-4175-9efe-db8b3dff9258 on n-h1-master-1 Jun 20 12:57:44.957879 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [req-92d6a8c0-a374-4d28-8b4d-f5bf6fff159f req-24176551-f49c-420b-8c66-069f9cd5c0da service nova] Instance eefecb41-6dae-4175-9efe-db8b3dff9258 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119127) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:57:44.977141 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-92d6a8c0-a374-4d28-8b4d-f5bf6fff159f req-24176551-f49c-420b-8c66-069f9cd5c0da service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066633 Jun 20 12:57:44.978542 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3601/7101] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:57:45.245755 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-73001e3c-53d5-4890-ac2b-c9988ae84cbe tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:45.246310 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-73001e3c-53d5-4890-ac2b-c9988ae84cbe tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:45.254583 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-73001e3c-53d5-4890-ac2b-c9988ae84cbe tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:45.255294 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-73001e3c-53d5-4890-ac2b-c9988ae84cbe tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:45.256192 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-73001e3c-53d5-4890-ac2b-c9988ae84cbe tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:45.256733 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-73001e3c-53d5-4890-ac2b-c9988ae84cbe tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:45.771081 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-73001e3c-53d5-4890-ac2b-c9988ae84cbe tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:45.779681 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-73001e3c-53d5-4890-ac2b-c9988ae84cbe tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1721 microversion: 2.1 time: 0.537926 Jun 20 12:57:45.780215 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3501/7102] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:45 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1721 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:46.798124 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-25749e39-4eed-4ba7-9aff-b3e2d92ec2f2 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:46.798830 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-25749e39-4eed-4ba7-9aff-b3e2d92ec2f2 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:46.806894 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-25749e39-4eed-4ba7-9aff-b3e2d92ec2f2 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:46.807311 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-25749e39-4eed-4ba7-9aff-b3e2d92ec2f2 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:46.808325 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-25749e39-4eed-4ba7-9aff-b3e2d92ec2f2 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:46.809130 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-25749e39-4eed-4ba7-9aff-b3e2d92ec2f2 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:46.953851 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-25749e39-4eed-4ba7-9aff-b3e2d92ec2f2 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:46.962409 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-25749e39-4eed-4ba7-9aff-b3e2d92ec2f2 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1721 microversion: 2.1 time: 0.168676 Jun 20 12:57:46.963121 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3602/7103] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:46 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:46.993192 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-e94d0388-8867-4845-8f7d-b956c28eae7b req-de922b74-c96c-4098-8a08-f769ccdb13ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eefecb41-6dae-4175-9efe-db8b3dff9258", "tag": "63a45847-6266-402a-a049-73cd20b9f74e"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:57:47.002431 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e94d0388-8867-4845-8f7d-b956c28eae7b req-de922b74-c96c-4098-8a08-f769ccdb13ee service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:47.003130 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e94d0388-8867-4845-8f7d-b956c28eae7b req-de922b74-c96c-4098-8a08-f769ccdb13ee service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:47.015778 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-e94d0388-8867-4845-8f7d-b956c28eae7b req-de922b74-c96c-4098-8a08-f769ccdb13ee service nova] Creating event network-changed:63a45847-6266-402a-a049-73cd20b9f74e for instance eefecb41-6dae-4175-9efe-db8b3dff9258 on n-h1-master-1 Jun 20 12:57:47.021718 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [req-e94d0388-8867-4845-8f7d-b956c28eae7b req-de922b74-c96c-4098-8a08-f769ccdb13ee service nova] Instance eefecb41-6dae-4175-9efe-db8b3dff9258 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 12:57:47.033128 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-e94d0388-8867-4845-8f7d-b956c28eae7b req-de922b74-c96c-4098-8a08-f769ccdb13ee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043818 Jun 20 12:57:47.033753 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3502/7104] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:57:47.980717 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-36047a88-8437-4a82-9e6b-70369a1c8e0d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:47.981397 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-36047a88-8437-4a82-9e6b-70369a1c8e0d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:47.989336 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36047a88-8437-4a82-9e6b-70369a1c8e0d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:47.989664 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36047a88-8437-4a82-9e6b-70369a1c8e0d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:47.990442 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36047a88-8437-4a82-9e6b-70369a1c8e0d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:47.990882 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36047a88-8437-4a82-9e6b-70369a1c8e0d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:48.128067 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-36047a88-8437-4a82-9e6b-70369a1c8e0d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:48.136305 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-36047a88-8437-4a82-9e6b-70369a1c8e0d tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1721 microversion: 2.1 time: 0.159516 Jun 20 12:57:48.137098 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3603/7105] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:47 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:49.159662 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-41d43280-f2cd-402d-8f38-e39d4c736ebc tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:49.160621 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-41d43280-f2cd-402d-8f38-e39d4c736ebc tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:49.162682 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:57:49.168476 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-41d43280-f2cd-402d-8f38-e39d4c736ebc tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:49.168929 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-41d43280-f2cd-402d-8f38-e39d4c736ebc tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:49.169715 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-41d43280-f2cd-402d-8f38-e39d4c736ebc tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:49.170164 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-41d43280-f2cd-402d-8f38-e39d4c736ebc tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:49.228118 n-d-master-1 devstack@n-api.service[119128]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 12:57:49.228537 n-d-master-1 devstack@n-api.service[119128]: Mon Jun 20 12:57:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 (ip 10.222.0.27) !!! Jun 20 12:57:49.322917 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-41d43280-f2cd-402d-8f38-e39d4c736ebc tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:49.333301 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-41d43280-f2cd-402d-8f38-e39d4c736ebc tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1721 microversion: 2.1 time: 0.182952 Jun 20 12:57:49.334051 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3503/7106] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:49 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:50.157947 n-d-master-1 devstack@n-api.service[119128]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 12:57:50.158162 n-d-master-1 devstack@n-api.service[119128]: Mon Jun 20 12:57:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 12:57:50.351092 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c74a0a76-db2d-4ef5-8606-96887eb718b0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:50.351804 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c74a0a76-db2d-4ef5-8606-96887eb718b0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:50.359410 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c74a0a76-db2d-4ef5-8606-96887eb718b0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:50.359866 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c74a0a76-db2d-4ef5-8606-96887eb718b0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:50.360870 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c74a0a76-db2d-4ef5-8606-96887eb718b0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:50.361316 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c74a0a76-db2d-4ef5-8606-96887eb718b0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:50.499232 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c74a0a76-db2d-4ef5-8606-96887eb718b0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:50.508190 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c74a0a76-db2d-4ef5-8606-96887eb718b0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1721 microversion: 2.1 time: 0.161036 Jun 20 12:57:50.508803 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3604/7107] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:50 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:51.525589 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1374a37c-22fe-45c4-afe4-a3f0f324c522 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:51.526229 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1374a37c-22fe-45c4-afe4-a3f0f324c522 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:51.536615 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1374a37c-22fe-45c4-afe4-a3f0f324c522 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:51.537091 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1374a37c-22fe-45c4-afe4-a3f0f324c522 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:51.537916 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1374a37c-22fe-45c4-afe4-a3f0f324c522 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:51.538366 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1374a37c-22fe-45c4-afe4-a3f0f324c522 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:51.684923 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1374a37c-22fe-45c4-afe4-a3f0f324c522 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:51.695174 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1374a37c-22fe-45c4-afe4-a3f0f324c522 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1721 microversion: 2.1 time: 0.173532 Jun 20 12:57:51.695869 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3504/7108] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:51 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:52.713725 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f0984dc5-a472-4b6a-88b6-d3b387df5ffb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:52.714353 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f0984dc5-a472-4b6a-88b6-d3b387df5ffb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:52.722042 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f0984dc5-a472-4b6a-88b6-d3b387df5ffb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:52.722524 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f0984dc5-a472-4b6a-88b6-d3b387df5ffb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:52.723309 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f0984dc5-a472-4b6a-88b6-d3b387df5ffb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:52.723719 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f0984dc5-a472-4b6a-88b6-d3b387df5ffb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:52.874863 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f0984dc5-a472-4b6a-88b6-d3b387df5ffb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:52.884869 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f0984dc5-a472-4b6a-88b6-d3b387df5ffb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1721 microversion: 2.1 time: 0.174995 Jun 20 12:57:52.885518 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3605/7109] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:52 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:53.902925 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0cb2d374-aeeb-48b2-8af6-de50ab11e5ac tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:53.903591 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0cb2d374-aeeb-48b2-8af6-de50ab11e5ac tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:53.911640 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cb2d374-aeeb-48b2-8af6-de50ab11e5ac tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:53.912126 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cb2d374-aeeb-48b2-8af6-de50ab11e5ac tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:53.912948 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cb2d374-aeeb-48b2-8af6-de50ab11e5ac tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:53.913412 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cb2d374-aeeb-48b2-8af6-de50ab11e5ac tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:54.049704 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0cb2d374-aeeb-48b2-8af6-de50ab11e5ac tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:54.057868 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0cb2d374-aeeb-48b2-8af6-de50ab11e5ac tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1721 microversion: 2.1 time: 0.158975 Jun 20 12:57:54.058438 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3505/7110] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:53 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:55.079702 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2a606a72-30f2-4940-a924-c1e5a7bc7a82 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:55.080263 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2a606a72-30f2-4940-a924-c1e5a7bc7a82 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:55.087753 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2a606a72-30f2-4940-a924-c1e5a7bc7a82 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:55.088227 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2a606a72-30f2-4940-a924-c1e5a7bc7a82 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:55.089008 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2a606a72-30f2-4940-a924-c1e5a7bc7a82 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:55.089451 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2a606a72-30f2-4940-a924-c1e5a7bc7a82 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:55.223592 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2a606a72-30f2-4940-a924-c1e5a7bc7a82 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:55.232177 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2a606a72-30f2-4940-a924-c1e5a7bc7a82 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1721 microversion: 2.1 time: 0.158497 Jun 20 12:57:55.232808 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3606/7111] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:55 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:56.252335 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-22a53bb1-544d-47ca-860d-ea735ab937a6 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:56.253281 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-22a53bb1-544d-47ca-860d-ea735ab937a6 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:56.263713 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22a53bb1-544d-47ca-860d-ea735ab937a6 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:56.264446 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22a53bb1-544d-47ca-860d-ea735ab937a6 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:56.265664 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22a53bb1-544d-47ca-860d-ea735ab937a6 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:56.266334 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22a53bb1-544d-47ca-860d-ea735ab937a6 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:56.415905 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-22a53bb1-544d-47ca-860d-ea735ab937a6 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:56.424594 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-22a53bb1-544d-47ca-860d-ea735ab937a6 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1721 microversion: 2.1 time: 0.176982 Jun 20 12:57:56.425173 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3506/7112] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:56 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:57.442602 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d0e08a74-3754-43ea-b28e-b93a1e1ddd5c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:57.443212 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d0e08a74-3754-43ea-b28e-b93a1e1ddd5c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:57.450490 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d0e08a74-3754-43ea-b28e-b93a1e1ddd5c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:57.450948 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d0e08a74-3754-43ea-b28e-b93a1e1ddd5c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:57.451715 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d0e08a74-3754-43ea-b28e-b93a1e1ddd5c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:57.452156 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d0e08a74-3754-43ea-b28e-b93a1e1ddd5c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:57.585161 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d0e08a74-3754-43ea-b28e-b93a1e1ddd5c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:57.593644 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d0e08a74-3754-43ea-b28e-b93a1e1ddd5c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1721 microversion: 2.1 time: 0.154840 Jun 20 12:57:57.594479 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3607/7113] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:57 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:57:58.611769 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-53c1e818-42fc-4d86-af78-731219391478 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:58.612552 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-53c1e818-42fc-4d86-af78-731219391478 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:58.620065 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-53c1e818-42fc-4d86-af78-731219391478 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:58.620550 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-53c1e818-42fc-4d86-af78-731219391478 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:58.621329 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-53c1e818-42fc-4d86-af78-731219391478 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:58.621775 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-53c1e818-42fc-4d86-af78-731219391478 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:58.760383 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-53c1e818-42fc-4d86-af78-731219391478 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:58.768947 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-53c1e818-42fc-4d86-af78-731219391478 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1714 microversion: 2.1 time: 0.161440 Jun 20 12:57:58.769503 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3507/7114] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:58 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1714 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:58.785923 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-429e5501-d7d7-4ab9-bb25-a849b86d0117 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:58.786560 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-429e5501-d7d7-4ab9-bb25-a849b86d0117 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:58.794084 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-429e5501-d7d7-4ab9-bb25-a849b86d0117 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:58.794548 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-429e5501-d7d7-4ab9-bb25-a849b86d0117 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:58.795326 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-429e5501-d7d7-4ab9-bb25-a849b86d0117 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:58.795770 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-429e5501-d7d7-4ab9-bb25-a849b86d0117 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:58.936183 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-429e5501-d7d7-4ab9-bb25-a849b86d0117 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:58.944777 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-429e5501-d7d7-4ab9-bb25-a849b86d0117 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1714 microversion: 2.1 time: 0.162831 Jun 20 12:57:58.945343 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3608/7115] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:58 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1714 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:58.961253 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d73c2205-8fbd-4562-b3c8-ac9d2517e57c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:58.961873 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d73c2205-8fbd-4562-b3c8-ac9d2517e57c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:58.968580 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d73c2205-8fbd-4562-b3c8-ac9d2517e57c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:58.969033 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d73c2205-8fbd-4562-b3c8-ac9d2517e57c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:58.969805 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d73c2205-8fbd-4562-b3c8-ac9d2517e57c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:58.970250 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d73c2205-8fbd-4562-b3c8-ac9d2517e57c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:58.972865 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:57:59.107223 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d73c2205-8fbd-4562-b3c8-ac9d2517e57c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:59.115791 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d73c2205-8fbd-4562-b3c8-ac9d2517e57c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1714 microversion: 2.1 time: 0.158525 Jun 20 12:57:59.116406 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3508/7116] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:58 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1714 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:57:59.132174 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-12a173d3-907d-4c00-8db4-8a21b26e84a0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:59.132629 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-12a173d3-907d-4c00-8db4-8a21b26e84a0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:59.139112 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-12a173d3-907d-4c00-8db4-8a21b26e84a0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:59.139553 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-12a173d3-907d-4c00-8db4-8a21b26e84a0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:59.140480 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-12a173d3-907d-4c00-8db4-8a21b26e84a0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:59.140999 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-12a173d3-907d-4c00-8db4-8a21b26e84a0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:59.167478 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-12a173d3-907d-4c00-8db4-8a21b26e84a0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:57:59.225595 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:57:59.259472 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-12a173d3-907d-4c00-8db4-8a21b26e84a0 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "DELETE /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 204 len: 0 microversion: 2.1 time: 0.130992 Jun 20 12:57:59.260228 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3609/7117] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:57:59 2022] DELETE /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:57:59.270949 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f033815f-3e8a-4cb0-a5d9-4293d6a578eb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:57:59.271589 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f033815f-3e8a-4cb0-a5d9-4293d6a578eb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:57:59.278862 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f033815f-3e8a-4cb0-a5d9-4293d6a578eb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:59.279331 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f033815f-3e8a-4cb0-a5d9-4293d6a578eb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:59.280132 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f033815f-3e8a-4cb0-a5d9-4293d6a578eb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:57:59.281397 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f033815f-3e8a-4cb0-a5d9-4293d6a578eb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:57:59.426426 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f033815f-3e8a-4cb0-a5d9-4293d6a578eb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:57:59.435246 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f033815f-3e8a-4cb0-a5d9-4293d6a578eb tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1720 microversion: 2.1 time: 0.170251 Jun 20 12:57:59.436022 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3509/7118] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:57:59 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:58:00.454310 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-11fd38a4-d25f-4e18-9fc3-6d5ae1d4cbd4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:00.455042 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-11fd38a4-d25f-4e18-9fc3-6d5ae1d4cbd4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:00.462632 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11fd38a4-d25f-4e18-9fc3-6d5ae1d4cbd4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:00.463951 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11fd38a4-d25f-4e18-9fc3-6d5ae1d4cbd4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:00.465152 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11fd38a4-d25f-4e18-9fc3-6d5ae1d4cbd4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:00.465595 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11fd38a4-d25f-4e18-9fc3-6d5ae1d4cbd4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:00.600179 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-11fd38a4-d25f-4e18-9fc3-6d5ae1d4cbd4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:58:00.608838 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-11fd38a4-d25f-4e18-9fc3-6d5ae1d4cbd4 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1720 microversion: 2.1 time: 0.159208 Jun 20 12:58:00.609442 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3610/7119] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:00 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:58:01.626649 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2529ef74-542f-4143-bb3c-62199f28d294 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:01.627946 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2529ef74-542f-4143-bb3c-62199f28d294 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:01.634485 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-b08cdca7-aea0-4e10-9888-29d1c56da4a2 req-8e1bee7f-2c7e-4817-a123-962dfc6d5fcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eefecb41-6dae-4175-9efe-db8b3dff9258", "name": "network-vif-deleted", "tag": "63a45847-6266-402a-a049-73cd20b9f74e"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:58:01.658058 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2529ef74-542f-4143-bb3c-62199f28d294 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:01.659469 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2529ef74-542f-4143-bb3c-62199f28d294 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:01.660637 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2529ef74-542f-4143-bb3c-62199f28d294 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:01.661810 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2529ef74-542f-4143-bb3c-62199f28d294 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:01.665880 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b08cdca7-aea0-4e10-9888-29d1c56da4a2 req-8e1bee7f-2c7e-4817-a123-962dfc6d5fcd service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:01.666319 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b08cdca7-aea0-4e10-9888-29d1c56da4a2 req-8e1bee7f-2c7e-4817-a123-962dfc6d5fcd service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:01.690109 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-b08cdca7-aea0-4e10-9888-29d1c56da4a2 req-8e1bee7f-2c7e-4817-a123-962dfc6d5fcd service nova] Creating event network-vif-deleted:63a45847-6266-402a-a049-73cd20b9f74e for instance eefecb41-6dae-4175-9efe-db8b3dff9258 on n-h1-master-1 Jun 20 12:58:01.697927 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-b08cdca7-aea0-4e10-9888-29d1c56da4a2 req-8e1bee7f-2c7e-4817-a123-962dfc6d5fcd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067117 Jun 20 12:58:01.699193 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3611/7120] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:58:01.749914 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2529ef74-542f-4143-bb3c-62199f28d294 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:58:01.758121 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2529ef74-542f-4143-bb3c-62199f28d294 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1368 microversion: 2.1 time: 0.135627 Jun 20 12:58:01.759094 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3510/7121] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:01 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1368 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:58:02.776171 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-740d4d14-7973-46a6-bae3-8abf3e8ab006 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:02.776876 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-740d4d14-7973-46a6-bae3-8abf3e8ab006 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:02.781147 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:58:02.788046 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-740d4d14-7973-46a6-bae3-8abf3e8ab006 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:02.788606 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-740d4d14-7973-46a6-bae3-8abf3e8ab006 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:02.789407 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-740d4d14-7973-46a6-bae3-8abf3e8ab006 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:02.789824 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-740d4d14-7973-46a6-bae3-8abf3e8ab006 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:02.868706 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-740d4d14-7973-46a6-bae3-8abf3e8ab006 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:58:02.878653 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-740d4d14-7973-46a6-bae3-8abf3e8ab006 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1368 microversion: 2.1 time: 0.107260 Jun 20 12:58:02.879935 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3612/7122] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:02 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1368 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:58:03.896808 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6aa3b48c-2331-4e87-9b6a-473d889af093 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:03.897423 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6aa3b48c-2331-4e87-9b6a-473d889af093 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:03.900182 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:58:03.905972 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6aa3b48c-2331-4e87-9b6a-473d889af093 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:03.906568 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6aa3b48c-2331-4e87-9b6a-473d889af093 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:03.907363 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6aa3b48c-2331-4e87-9b6a-473d889af093 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:03.907811 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6aa3b48c-2331-4e87-9b6a-473d889af093 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:03.975587 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6aa3b48c-2331-4e87-9b6a-473d889af093 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:58:03.984846 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6aa3b48c-2331-4e87-9b6a-473d889af093 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1368 microversion: 2.1 time: 0.092024 Jun 20 12:58:03.985435 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3511/7123] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:03 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:58:05.002611 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b57ef61c-25c0-4b64-ac5b-b93c997fdf55 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:05.003195 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b57ef61c-25c0-4b64-ac5b-b93c997fdf55 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:05.011207 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b57ef61c-25c0-4b64-ac5b-b93c997fdf55 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:05.011729 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b57ef61c-25c0-4b64-ac5b-b93c997fdf55 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:05.012550 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b57ef61c-25c0-4b64-ac5b-b93c997fdf55 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:05.012994 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b57ef61c-25c0-4b64-ac5b-b93c997fdf55 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:05.076912 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b57ef61c-25c0-4b64-ac5b-b93c997fdf55 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:58:05.085458 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b57ef61c-25c0-4b64-ac5b-b93c997fdf55 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1368 microversion: 2.1 time: 0.086977 Jun 20 12:58:05.086047 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3613/7124] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:04 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:58:06.102096 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8d4db326-a8ec-4740-b0c7-da197112e739 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:06.102648 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8d4db326-a8ec-4740-b0c7-da197112e739 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:06.110033 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8d4db326-a8ec-4740-b0c7-da197112e739 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:06.110490 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8d4db326-a8ec-4740-b0c7-da197112e739 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:06.111276 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8d4db326-a8ec-4740-b0c7-da197112e739 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:06.111720 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8d4db326-a8ec-4740-b0c7-da197112e739 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:06.146956 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8d4db326-a8ec-4740-b0c7-da197112e739 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:06.147423 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8d4db326-a8ec-4740-b0c7-da197112e739 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:06.147885 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-8d4db326-a8ec-4740-b0c7-da197112e739 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lazy-loading 'fault' on Instance uuid eefecb41-6dae-4175-9efe-db8b3dff9258 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:58:06.190326 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8d4db326-a8ec-4740-b0c7-da197112e739 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18cd0c87eed404bb4321acc9762a172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57445eadc2e94955963af6c23e797c07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:58:06.198883 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8d4db326-a8ec-4740-b0c7-da197112e739 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 200 len: 1373 microversion: 2.1 time: 0.100943 Jun 20 12:58:06.199460 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3512/7125] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:06 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 1373 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:58:07.217992 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2e02cce6-da39-411a-91e3-3418f40dadd5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:07.218574 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2e02cce6-da39-411a-91e3-3418f40dadd5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:07.225933 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2e02cce6-da39-411a-91e3-3418f40dadd5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:07.226379 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2e02cce6-da39-411a-91e3-3418f40dadd5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:07.227176 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2e02cce6-da39-411a-91e3-3418f40dadd5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:07.227610 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2e02cce6-da39-411a-91e3-3418f40dadd5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:07.241488 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-2e02cce6-da39-411a-91e3-3418f40dadd5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] HTTP exception thrown: Instance eefecb41-6dae-4175-9efe-db8b3dff9258 could not be found. Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2e02cce6-da39-411a-91e3-3418f40dadd5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Request method failure captured: Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 HTTP/1.1 Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisG08rWo0X6U5MzMEcLnjL5zHWgwcE3Lcu6YwEwZnA9jzQ-u9KPkLaETww8Ci0auGDTDBPUXC4mM-tgcbZ6FJUcQfalWIqhOnqkp9A6seLBffT24h5gBbqqQy1eJfmNhvJDOrIpkg8bPzi2bdUNNLGMSOVbBNvpf_M-HQ0tO6PVx5RyU Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 57445eadc2e94955963af6c23e797c07 Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServerActionsTestJSON-433739157 Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57445eadc2e94955963af6c23e797c07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57445eadc2e94955963af6c23e797c07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/57445eadc2e94955963af6c23e797c07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_57445eadc2e94955963af6c23e797c07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServerActionsTestJSON-433739157 Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 57445eadc2e94955963af6c23e797c07 Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServerActionsTestJSON-433739157 Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServerActionsTestJSON-433739157-project Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: b18cd0c87eed404bb4321acc9762a172 Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServerActionsTestJSON-433739157-project Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: exception: Instance eefecb41-6dae-4175-9efe-db8b3dff9258 could not be found. Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'eefecb41-6dae-4175-9efe-db8b3dff9258'} Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eefecb41-6dae-4175-9efe-db8b3dff9258 could not be found. Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eefecb41-6dae-4175-9efe-db8b3dff9258 could not be found. Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:58:07.243254 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:07.247289 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:07.247289 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:58:07.247289 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:58:07.247289 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:58:07.247289 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:58:07.247289 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eefecb41-6dae-4175-9efe-db8b3dff9258 could not be found. Jun 20 12:58:07.247289 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:07.247289 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2e02cce6-da39-411a-91e3-3418f40dadd5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Returning 404 to user: Instance eefecb41-6dae-4175-9efe-db8b3dff9258 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:58:07.247289 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2e02cce6-da39-411a-91e3-3418f40dadd5 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 404 len: 111 microversion: 2.1 time: 0.031742 Jun 20 12:58:07.247289 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3614/7126] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:07 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:58:07.302451 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9c1cb47e-31b1-4133-aeab-02591b24546f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:07.303406 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9c1cb47e-31b1-4133-aeab-02591b24546f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:07.311284 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c1cb47e-31b1-4133-aeab-02591b24546f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:07.311731 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c1cb47e-31b1-4133-aeab-02591b24546f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:07.312589 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c1cb47e-31b1-4133-aeab-02591b24546f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:07.313048 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c1cb47e-31b1-4133-aeab-02591b24546f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:07.326297 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-9c1cb47e-31b1-4133-aeab-02591b24546f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] HTTP exception thrown: Instance eefecb41-6dae-4175-9efe-db8b3dff9258 could not be found. Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9c1cb47e-31b1-4133-aeab-02591b24546f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Request method failure captured: Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258/os-volume_attachments HTTP/1.1 Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisG08rWo0X6U5MzMEcLnjL5zHWgwcE3Lcu6YwEwZnA9jzQ-u9KPkLaETww8Ci0auGDTDBPUXC4mM-tgcbZ6FJUcQfalWIqhOnqkp9A6seLBffT24h5gBbqqQy1eJfmNhvJDOrIpkg8bPzi2bdUNNLGMSOVbBNvpf_M-HQ0tO6PVx5RyU Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 57445eadc2e94955963af6c23e797c07 Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServerActionsTestJSON-433739157 Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57445eadc2e94955963af6c23e797c07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57445eadc2e94955963af6c23e797c07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/57445eadc2e94955963af6c23e797c07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_57445eadc2e94955963af6c23e797c07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServerActionsTestJSON-433739157 Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 57445eadc2e94955963af6c23e797c07 Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServerActionsTestJSON-433739157 Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServerActionsTestJSON-433739157-project Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: b18cd0c87eed404bb4321acc9762a172 Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServerActionsTestJSON-433739157-project Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: exception: Instance eefecb41-6dae-4175-9efe-db8b3dff9258 could not be found. Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: action_args: {'server_id': 'eefecb41-6dae-4175-9efe-db8b3dff9258'} Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eefecb41-6dae-4175-9efe-db8b3dff9258 could not be found. Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:58:07.328088 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eefecb41-6dae-4175-9efe-db8b3dff9258 could not be found. Jun 20 12:58:07.332455 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:58:07.332455 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:58:07.332455 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:58:07.332455 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:07.332455 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:58:07.332455 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:58:07.332455 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:58:07.332455 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:58:07.332455 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eefecb41-6dae-4175-9efe-db8b3dff9258 could not be found. Jun 20 12:58:07.332455 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:58:07.332455 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9c1cb47e-31b1-4133-aeab-02591b24546f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Returning 404 to user: Instance eefecb41-6dae-4175-9efe-db8b3dff9258 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:58:07.332455 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9c1cb47e-31b1-4133-aeab-02591b24546f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031221 Jun 20 12:58:07.332455 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3513/7127] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:58:07 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:58:10.664370 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c8ea784e-a465-45aa-b8a1-1558041c6fa3 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:10.664900 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c8ea784e-a465-45aa-b8a1-1558041c6fa3 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:10.672622 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c8ea784e-a465-45aa-b8a1-1558041c6fa3 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:10.673075 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c8ea784e-a465-45aa-b8a1-1558041c6fa3 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:10.673871 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c8ea784e-a465-45aa-b8a1-1558041c6fa3 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:10.674313 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c8ea784e-a465-45aa-b8a1-1558041c6fa3 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:10.691115 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-c8ea784e-a465-45aa-b8a1-1558041c6fa3 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] HTTP exception thrown: Instance eefecb41-6dae-4175-9efe-db8b3dff9258 could not be found. Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c8ea784e-a465-45aa-b8a1-1558041c6fa3 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Request method failure captured: Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 HTTP/1.1 Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisG08rWo0X6U5MzMEcLnjL5zHWgwcE3Lcu6YwEwZnA9jzQ-u9KPkLaETww8Ci0auGDTDBPUXC4mM-tgcbZ6FJUcQfalWIqhOnqkp9A6seLBffT24h5gBbqqQy1eJfmNhvJDOrIpkg8bPzi2bdUNNLGMSOVbBNvpf_M-HQ0tO6PVx5RyU Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 57445eadc2e94955963af6c23e797c07 Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServerActionsTestJSON-433739157 Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57445eadc2e94955963af6c23e797c07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57445eadc2e94955963af6c23e797c07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/57445eadc2e94955963af6c23e797c07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_57445eadc2e94955963af6c23e797c07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServerActionsTestJSON-433739157 Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 57445eadc2e94955963af6c23e797c07 Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServerActionsTestJSON-433739157 Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServerActionsTestJSON-433739157-project Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: b18cd0c87eed404bb4321acc9762a172 Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServerActionsTestJSON-433739157-project Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: exception: Instance eefecb41-6dae-4175-9efe-db8b3dff9258 could not be found. Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'eefecb41-6dae-4175-9efe-db8b3dff9258'} Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eefecb41-6dae-4175-9efe-db8b3dff9258 could not be found. Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:58:10.692955 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:58:10.696307 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eefecb41-6dae-4175-9efe-db8b3dff9258 could not be found. Jun 20 12:58:10.696307 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:10.696307 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:58:10.696307 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:10.696307 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:10.696307 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:58:10.696307 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:58:10.696307 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:58:10.696307 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:58:10.696307 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eefecb41-6dae-4175-9efe-db8b3dff9258 could not be found. Jun 20 12:58:10.696307 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:10.696307 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c8ea784e-a465-45aa-b8a1-1558041c6fa3 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Returning 404 to user: Instance eefecb41-6dae-4175-9efe-db8b3dff9258 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:58:10.696307 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c8ea784e-a465-45aa-b8a1-1558041c6fa3 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "DELETE /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 404 len: 111 microversion: 2.1 time: 0.034176 Jun 20 12:58:10.696307 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3615/7128] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:58:10 2022] DELETE /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:58:10.703683 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-884459e2-e178-4c9e-af45-02b3d8a44b21 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:10.704449 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-884459e2-e178-4c9e-af45-02b3d8a44b21 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: eefecb41-6dae-4175-9efe-db8b3dff9258] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:10.711858 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-884459e2-e178-4c9e-af45-02b3d8a44b21 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:10.712456 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-884459e2-e178-4c9e-af45-02b3d8a44b21 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:10.713332 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-884459e2-e178-4c9e-af45-02b3d8a44b21 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:10.713854 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-884459e2-e178-4c9e-af45-02b3d8a44b21 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:10.728046 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-884459e2-e178-4c9e-af45-02b3d8a44b21 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] HTTP exception thrown: Instance eefecb41-6dae-4175-9efe-db8b3dff9258 could not be found. Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-884459e2-e178-4c9e-af45-02b3d8a44b21 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Request method failure captured: Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 HTTP/1.1 Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisG08rWo0X6U5MzMEcLnjL5zHWgwcE3Lcu6YwEwZnA9jzQ-u9KPkLaETww8Ci0auGDTDBPUXC4mM-tgcbZ6FJUcQfalWIqhOnqkp9A6seLBffT24h5gBbqqQy1eJfmNhvJDOrIpkg8bPzi2bdUNNLGMSOVbBNvpf_M-HQ0tO6PVx5RyU Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 57445eadc2e94955963af6c23e797c07 Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServerActionsTestJSON-433739157 Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57445eadc2e94955963af6c23e797c07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57445eadc2e94955963af6c23e797c07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/57445eadc2e94955963af6c23e797c07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_57445eadc2e94955963af6c23e797c07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServerActionsTestJSON-433739157 Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 57445eadc2e94955963af6c23e797c07 Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServerActionsTestJSON-433739157 Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServerActionsTestJSON-433739157-project Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: b18cd0c87eed404bb4321acc9762a172 Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServerActionsTestJSON-433739157-project Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: exception: Instance eefecb41-6dae-4175-9efe-db8b3dff9258 could not be found. Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'eefecb41-6dae-4175-9efe-db8b3dff9258'} Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eefecb41-6dae-4175-9efe-db8b3dff9258 could not be found. Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eefecb41-6dae-4175-9efe-db8b3dff9258 could not be found. Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:58:10.730086 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:58:10.734549 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:10.734549 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:58:10.734549 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:58:10.734549 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:58:10.734549 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:58:10.734549 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eefecb41-6dae-4175-9efe-db8b3dff9258 could not be found. Jun 20 12:58:10.734549 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:58:10.734549 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-884459e2-e178-4c9e-af45-02b3d8a44b21 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Returning 404 to user: Instance eefecb41-6dae-4175-9efe-db8b3dff9258 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:58:10.734549 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-884459e2-e178-4c9e-af45-02b3d8a44b21 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258" status: 404 len: 111 microversion: 2.1 time: 0.032105 Jun 20 12:58:10.735210 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3514/7129] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:10 2022] GET /compute/v2.1/servers/eefecb41-6dae-4175-9efe-db8b3dff9258 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:58:10.740801 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5cf31927-f489-4136-bcb2-cbd662da908e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:10.741300 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5cf31927-f489-4136-bcb2-cbd662da908e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:10.747710 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5cf31927-f489-4136-bcb2-cbd662da908e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:10.748162 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5cf31927-f489-4136-bcb2-cbd662da908e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:10.748981 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5cf31927-f489-4136-bcb2-cbd662da908e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:10.749465 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5cf31927-f489-4136-bcb2-cbd662da908e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:10.763597 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-5cf31927-f489-4136-bcb2-cbd662da908e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] HTTP exception thrown: Instance 025efc55-77b8-4098-9170-a1ffa8aa9a35 could not be found. Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5cf31927-f489-4136-bcb2-cbd662da908e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Request method failure captured: Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 HTTP/1.1 Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisG08rWo0X6U5MzMEcLnjL5zHWgwcE3Lcu6YwEwZnA9jzQ-u9KPkLaETww8Ci0auGDTDBPUXC4mM-tgcbZ6FJUcQfalWIqhOnqkp9A6seLBffT24h5gBbqqQy1eJfmNhvJDOrIpkg8bPzi2bdUNNLGMSOVbBNvpf_M-HQ0tO6PVx5RyU Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 57445eadc2e94955963af6c23e797c07 Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServerActionsTestJSON-433739157 Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57445eadc2e94955963af6c23e797c07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57445eadc2e94955963af6c23e797c07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/57445eadc2e94955963af6c23e797c07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_57445eadc2e94955963af6c23e797c07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServerActionsTestJSON-433739157 Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 57445eadc2e94955963af6c23e797c07 Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServerActionsTestJSON-433739157 Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServerActionsTestJSON-433739157-project Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: b18cd0c87eed404bb4321acc9762a172 Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServerActionsTestJSON-433739157-project Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 025efc55-77b8-4098-9170-a1ffa8aa9a35 could not be found. Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '025efc55-77b8-4098-9170-a1ffa8aa9a35'} Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 025efc55-77b8-4098-9170-a1ffa8aa9a35 could not be found. Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:58:10.765490 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:58:10.769382 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 025efc55-77b8-4098-9170-a1ffa8aa9a35 could not be found. Jun 20 12:58:10.769382 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:10.769382 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:58:10.769382 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:10.769382 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:10.769382 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:58:10.769382 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:58:10.769382 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:58:10.769382 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:58:10.769382 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 025efc55-77b8-4098-9170-a1ffa8aa9a35 could not be found. Jun 20 12:58:10.769382 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:10.769382 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5cf31927-f489-4136-bcb2-cbd662da908e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Returning 404 to user: Instance 025efc55-77b8-4098-9170-a1ffa8aa9a35 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:58:10.769382 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5cf31927-f489-4136-bcb2-cbd662da908e tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "DELETE /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 404 len: 111 microversion: 2.1 time: 0.030065 Jun 20 12:58:10.769382 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3616/7130] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:58:10 2022] DELETE /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:58:10.776361 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1a1b67f6-0c96-4629-a0f5-2a3aa1726c3c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:10.777027 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1a1b67f6-0c96-4629-a0f5-2a3aa1726c3c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 025efc55-77b8-4098-9170-a1ffa8aa9a35] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:10.784559 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a1b67f6-0c96-4629-a0f5-2a3aa1726c3c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:10.785025 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a1b67f6-0c96-4629-a0f5-2a3aa1726c3c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:10.785810 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a1b67f6-0c96-4629-a0f5-2a3aa1726c3c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:10.786275 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1a1b67f6-0c96-4629-a0f5-2a3aa1726c3c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:10.801239 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-1a1b67f6-0c96-4629-a0f5-2a3aa1726c3c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] HTTP exception thrown: Instance 025efc55-77b8-4098-9170-a1ffa8aa9a35 could not be found. Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1a1b67f6-0c96-4629-a0f5-2a3aa1726c3c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Request method failure captured: Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 HTTP/1.1 Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisG08rWo0X6U5MzMEcLnjL5zHWgwcE3Lcu6YwEwZnA9jzQ-u9KPkLaETww8Ci0auGDTDBPUXC4mM-tgcbZ6FJUcQfalWIqhOnqkp9A6seLBffT24h5gBbqqQy1eJfmNhvJDOrIpkg8bPzi2bdUNNLGMSOVbBNvpf_M-HQ0tO6PVx5RyU Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 57445eadc2e94955963af6c23e797c07 Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServerActionsTestJSON-433739157 Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57445eadc2e94955963af6c23e797c07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57445eadc2e94955963af6c23e797c07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/57445eadc2e94955963af6c23e797c07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_57445eadc2e94955963af6c23e797c07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServerActionsTestJSON-433739157 Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 57445eadc2e94955963af6c23e797c07 Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServerActionsTestJSON-433739157 Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServerActionsTestJSON-433739157-project Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: b18cd0c87eed404bb4321acc9762a172 Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServerActionsTestJSON-433739157-project Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 025efc55-77b8-4098-9170-a1ffa8aa9a35 could not be found. Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '025efc55-77b8-4098-9170-a1ffa8aa9a35'} Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 025efc55-77b8-4098-9170-a1ffa8aa9a35 could not be found. Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 025efc55-77b8-4098-9170-a1ffa8aa9a35 could not be found. Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:58:10.802845 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:58:10.806752 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:10.806752 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:58:10.806752 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:58:10.806752 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:58:10.806752 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:58:10.806752 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 025efc55-77b8-4098-9170-a1ffa8aa9a35 could not be found. Jun 20 12:58:10.806752 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:58:10.806752 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1a1b67f6-0c96-4629-a0f5-2a3aa1726c3c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Returning 404 to user: Instance 025efc55-77b8-4098-9170-a1ffa8aa9a35 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:58:10.806752 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1a1b67f6-0c96-4629-a0f5-2a3aa1726c3c tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35" status: 404 len: 111 microversion: 2.1 time: 0.032291 Jun 20 12:58:10.806752 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3515/7131] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:10 2022] GET /compute/v2.1/servers/025efc55-77b8-4098-9170-a1ffa8aa9a35 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:58:10.813796 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-139fd4df-4b27-4156-bf6a-fa11510258b9 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:10.814293 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-139fd4df-4b27-4156-bf6a-fa11510258b9 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:10.820757 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-139fd4df-4b27-4156-bf6a-fa11510258b9 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:10.821210 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-139fd4df-4b27-4156-bf6a-fa11510258b9 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:10.821974 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-139fd4df-4b27-4156-bf6a-fa11510258b9 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:10.822411 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-139fd4df-4b27-4156-bf6a-fa11510258b9 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:10.837098 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-139fd4df-4b27-4156-bf6a-fa11510258b9 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] HTTP exception thrown: Instance b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 could not be found. Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-139fd4df-4b27-4156-bf6a-fa11510258b9 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Request method failure captured: Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 HTTP/1.1 Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisG08rWo0X6U5MzMEcLnjL5zHWgwcE3Lcu6YwEwZnA9jzQ-u9KPkLaETww8Ci0auGDTDBPUXC4mM-tgcbZ6FJUcQfalWIqhOnqkp9A6seLBffT24h5gBbqqQy1eJfmNhvJDOrIpkg8bPzi2bdUNNLGMSOVbBNvpf_M-HQ0tO6PVx5RyU Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 57445eadc2e94955963af6c23e797c07 Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServerActionsTestJSON-433739157 Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57445eadc2e94955963af6c23e797c07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57445eadc2e94955963af6c23e797c07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/57445eadc2e94955963af6c23e797c07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_57445eadc2e94955963af6c23e797c07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServerActionsTestJSON-433739157 Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 57445eadc2e94955963af6c23e797c07 Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServerActionsTestJSON-433739157 Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServerActionsTestJSON-433739157-project Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: b18cd0c87eed404bb4321acc9762a172 Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServerActionsTestJSON-433739157-project Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: exception: Instance b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 could not be found. Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6'} Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 could not be found. Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:58:10.838661 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:58:10.842654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 could not be found. Jun 20 12:58:10.842654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:10.842654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:58:10.842654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:10.842654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:10.842654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:58:10.842654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:58:10.842654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:58:10.842654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:58:10.842654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 could not be found. Jun 20 12:58:10.842654 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:10.842654 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-139fd4df-4b27-4156-bf6a-fa11510258b9 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Returning 404 to user: Instance b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:58:10.842654 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-139fd4df-4b27-4156-bf6a-fa11510258b9 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 404 len: 111 microversion: 2.1 time: 0.030231 Jun 20 12:58:10.842654 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3617/7132] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:58:10 2022] DELETE /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:58:10.848990 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-580464c8-fdcb-42ae-8479-1a8b60c3e229 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:10.849613 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-580464c8-fdcb-42ae-8479-1a8b60c3e229 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:10.855976 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-580464c8-fdcb-42ae-8479-1a8b60c3e229 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:10.856491 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-580464c8-fdcb-42ae-8479-1a8b60c3e229 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:10.857281 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-580464c8-fdcb-42ae-8479-1a8b60c3e229 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:10.857740 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-580464c8-fdcb-42ae-8479-1a8b60c3e229 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:10.872473 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-580464c8-fdcb-42ae-8479-1a8b60c3e229 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] HTTP exception thrown: Instance b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 could not be found. Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-580464c8-fdcb-42ae-8479-1a8b60c3e229 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Request method failure captured: Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 HTTP/1.1 Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisG08rWo0X6U5MzMEcLnjL5zHWgwcE3Lcu6YwEwZnA9jzQ-u9KPkLaETww8Ci0auGDTDBPUXC4mM-tgcbZ6FJUcQfalWIqhOnqkp9A6seLBffT24h5gBbqqQy1eJfmNhvJDOrIpkg8bPzi2bdUNNLGMSOVbBNvpf_M-HQ0tO6PVx5RyU Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 57445eadc2e94955963af6c23e797c07 Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServerActionsTestJSON-433739157 Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57445eadc2e94955963af6c23e797c07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57445eadc2e94955963af6c23e797c07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/57445eadc2e94955963af6c23e797c07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_57445eadc2e94955963af6c23e797c07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServerActionsTestJSON-433739157 Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 57445eadc2e94955963af6c23e797c07 Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServerActionsTestJSON-433739157 Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServerActionsTestJSON-433739157-project Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: b18cd0c87eed404bb4321acc9762a172 Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServerActionsTestJSON-433739157-project Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: exception: Instance b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 could not be found. Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6'} Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 could not be found. Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 could not be found. Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:58:10.874104 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:58:10.881078 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:10.881078 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:58:10.881078 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:58:10.881078 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:58:10.881078 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:58:10.881078 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 could not be found. Jun 20 12:58:10.881078 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:58:10.881078 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-580464c8-fdcb-42ae-8479-1a8b60c3e229 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Returning 404 to user: Instance b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:58:10.881078 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-580464c8-fdcb-42ae-8479-1a8b60c3e229 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6" status: 404 len: 111 microversion: 2.1 time: 0.031021 Jun 20 12:58:10.881078 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3516/7133] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:10 2022] GET /compute/v2.1/servers/b5a25b1a-d3e3-45ce-86ef-f10d1d4954e6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:58:10.884913 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b92dd9ef-1273-47f6-b323-2a4c970a066f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:10.885408 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b92dd9ef-1273-47f6-b323-2a4c970a066f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:10.892493 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b92dd9ef-1273-47f6-b323-2a4c970a066f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:10.892873 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b92dd9ef-1273-47f6-b323-2a4c970a066f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:10.893637 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b92dd9ef-1273-47f6-b323-2a4c970a066f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:10.894068 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b92dd9ef-1273-47f6-b323-2a4c970a066f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:10.910722 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-b92dd9ef-1273-47f6-b323-2a4c970a066f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] HTTP exception thrown: Instance 10058791-4c6b-4529-a768-09dbf6804441 could not be found. Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b92dd9ef-1273-47f6-b323-2a4c970a066f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Request method failure captured: Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 HTTP/1.1 Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisG08rWo0X6U5MzMEcLnjL5zHWgwcE3Lcu6YwEwZnA9jzQ-u9KPkLaETww8Ci0auGDTDBPUXC4mM-tgcbZ6FJUcQfalWIqhOnqkp9A6seLBffT24h5gBbqqQy1eJfmNhvJDOrIpkg8bPzi2bdUNNLGMSOVbBNvpf_M-HQ0tO6PVx5RyU Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 57445eadc2e94955963af6c23e797c07 Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServerActionsTestJSON-433739157 Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57445eadc2e94955963af6c23e797c07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57445eadc2e94955963af6c23e797c07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/57445eadc2e94955963af6c23e797c07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_57445eadc2e94955963af6c23e797c07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServerActionsTestJSON-433739157 Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 57445eadc2e94955963af6c23e797c07 Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServerActionsTestJSON-433739157 Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServerActionsTestJSON-433739157-project Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: b18cd0c87eed404bb4321acc9762a172 Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServerActionsTestJSON-433739157-project Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 10058791-4c6b-4529-a768-09dbf6804441 could not be found. Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '10058791-4c6b-4529-a768-09dbf6804441'} Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10058791-4c6b-4529-a768-09dbf6804441 could not be found. Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:58:10.912336 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:58:10.915732 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10058791-4c6b-4529-a768-09dbf6804441 could not be found. Jun 20 12:58:10.915732 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:10.915732 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:58:10.915732 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:10.915732 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:10.915732 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:58:10.915732 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:58:10.915732 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:58:10.915732 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:58:10.915732 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10058791-4c6b-4529-a768-09dbf6804441 could not be found. Jun 20 12:58:10.915732 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:10.915732 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b92dd9ef-1273-47f6-b323-2a4c970a066f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Returning 404 to user: Instance 10058791-4c6b-4529-a768-09dbf6804441 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:58:10.915732 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b92dd9ef-1273-47f6-b323-2a4c970a066f tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "DELETE /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 404 len: 111 microversion: 2.1 time: 0.032699 Jun 20 12:58:10.915732 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3618/7134] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:58:10 2022] DELETE /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:58:10.923916 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-29864e04-1dac-4357-9c12-b693651aa2f9 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:10.924700 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-29864e04-1dac-4357-9c12-b693651aa2f9 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] [instance: 10058791-4c6b-4529-a768-09dbf6804441] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:10.931483 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-29864e04-1dac-4357-9c12-b693651aa2f9 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:10.932048 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-29864e04-1dac-4357-9c12-b693651aa2f9 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:10.932944 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-29864e04-1dac-4357-9c12-b693651aa2f9 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:10.933472 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-29864e04-1dac-4357-9c12-b693651aa2f9 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:10.950052 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-29864e04-1dac-4357-9c12-b693651aa2f9 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] HTTP exception thrown: Instance 10058791-4c6b-4529-a768-09dbf6804441 could not be found. Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-29864e04-1dac-4357-9c12-b693651aa2f9 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Request method failure captured: Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 HTTP/1.1 Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisG08rWo0X6U5MzMEcLnjL5zHWgwcE3Lcu6YwEwZnA9jzQ-u9KPkLaETww8Ci0auGDTDBPUXC4mM-tgcbZ6FJUcQfalWIqhOnqkp9A6seLBffT24h5gBbqqQy1eJfmNhvJDOrIpkg8bPzi2bdUNNLGMSOVbBNvpf_M-HQ0tO6PVx5RyU Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 57445eadc2e94955963af6c23e797c07 Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServerActionsTestJSON-433739157 Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57445eadc2e94955963af6c23e797c07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/57445eadc2e94955963af6c23e797c07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/57445eadc2e94955963af6c23e797c07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_57445eadc2e94955963af6c23e797c07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServerActionsTestJSON-433739157 Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 57445eadc2e94955963af6c23e797c07 Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServerActionsTestJSON-433739157 Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServerActionsTestJSON-433739157-project Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: b18cd0c87eed404bb4321acc9762a172 Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServerActionsTestJSON-433739157-project Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 10058791-4c6b-4529-a768-09dbf6804441 could not be found. Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '10058791-4c6b-4529-a768-09dbf6804441'} Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10058791-4c6b-4529-a768-09dbf6804441 could not be found. Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10058791-4c6b-4529-a768-09dbf6804441 could not be found. Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:58:10.952385 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:58:10.956660 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:10.956660 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:58:10.956660 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:58:10.956660 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:58:10.956660 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:58:10.956660 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10058791-4c6b-4529-a768-09dbf6804441 could not be found. Jun 20 12:58:10.956660 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:58:10.956660 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-29864e04-1dac-4357-9c12-b693651aa2f9 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Returning 404 to user: Instance 10058791-4c6b-4529-a768-09dbf6804441 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:58:10.956660 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-29864e04-1dac-4357-9c12-b693651aa2f9 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441" status: 404 len: 111 microversion: 2.1 time: 0.035717 Jun 20 12:58:10.956660 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3517/7135] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:10 2022] GET /compute/v2.1/servers/10058791-4c6b-4529-a768-09dbf6804441 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:58:10.963873 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3a630eca-3195-446a-8c19-a44e0b526321 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] Calling method '.version_select at 0x7f6072115af0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:10.990386 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3a630eca-3195-446a-8c19-a44e0b526321 tempest-ServerActionsTestJSON-433739157 tempest-ServerActionsTestJSON-433739157-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-888492200" status: 202 len: 0 microversion: 2.1 time: 0.030467 Jun 20 12:58:10.991180 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3619/7136] 10.222.0.27 () {58 vars in 1217 bytes} [Mon Jun 20 12:58:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-888492200 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:58:20.853785 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ce28d88a-75c3-448b-bfef-e8129eabc71e tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-348599492", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "b5cd42e8-8531-40ec-a7fe-91b3ceafe9a3"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:58:20.913126 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-ce28d88a-75c3-448b-bfef-e8129eabc71e tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] validate_networks() for [('b5cd42e8-8531-40ec-a7fe-91b3ceafe9a3', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:58:20.941408 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=41 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:58:21.391515 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-ce28d88a-75c3-448b-bfef-e8129eabc71e tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:58:21.391954 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-ce28d88a-75c3-448b-bfef-e8129eabc71e tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:58:21.392495 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-ce28d88a-75c3-448b-bfef-e8129eabc71e tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:58:21.392919 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-ce28d88a-75c3-448b-bfef-e8129eabc71e tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:58:21.393348 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-ce28d88a-75c3-448b-bfef-e8129eabc71e tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:58:21.402582 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce28d88a-75c3-448b-bfef-e8129eabc71e tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:21.403051 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce28d88a-75c3-448b-bfef-e8129eabc71e tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:21.403871 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce28d88a-75c3-448b-bfef-e8129eabc71e tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:21.404372 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce28d88a-75c3-448b-bfef-e8129eabc71e tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:21.421870 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-ce28d88a-75c3-448b-bfef-e8129eabc71e tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Getting quotas for project 40de2e7411d2431b99dd7907a7c2f684. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:58:21.427429 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-ce28d88a-75c3-448b-bfef-e8129eabc71e tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Getting quotas for user f01e5b767f8849e8b33147ae4eeba206 and project 40de2e7411d2431b99dd7907a7c2f684. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:58:21.442014 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ce28d88a-75c3-448b-bfef-e8129eabc71e tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:58:21.444593 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ce28d88a-75c3-448b-bfef-e8129eabc71e tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 33bba1db-e12f-4f09-9f75-3c4af2a3958c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:58:21.491778 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ce28d88a-75c3-448b-bfef-e8129eabc71e tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.820687 Jun 20 12:58:21.492874 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3518/7137] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:58:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:58:21.500938 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=30 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:58:21.501880 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:58:21.506194 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f5551f33-bc6f-4026-a782-9b135987acd0 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:21.506818 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f5551f33-bc6f-4026-a782-9b135987acd0 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 33bba1db-e12f-4f09-9f75-3c4af2a3958c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:21.570946 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f5551f33-bc6f-4026-a782-9b135987acd0 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01e5b767f8849e8b33147ae4eeba206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40de2e7411d2431b99dd7907a7c2f684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:58:21.579102 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f5551f33-bc6f-4026-a782-9b135987acd0 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "GET /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c" status: 200 len: 1216 microversion: 2.1 time: 0.079947 Jun 20 12:58:21.582611 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3620/7138] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:21 2022] GET /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c => generated 1216 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:58:22.597765 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6e6383db-f818-4a57-9e44-1b8b14499579 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:22.600172 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6e6383db-f818-4a57-9e44-1b8b14499579 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 33bba1db-e12f-4f09-9f75-3c4af2a3958c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:22.607968 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6e6383db-f818-4a57-9e44-1b8b14499579 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:22.608887 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6e6383db-f818-4a57-9e44-1b8b14499579 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:22.610682 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6e6383db-f818-4a57-9e44-1b8b14499579 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:22.611363 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6e6383db-f818-4a57-9e44-1b8b14499579 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:22.722163 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6e6383db-f818-4a57-9e44-1b8b14499579 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01e5b767f8849e8b33147ae4eeba206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40de2e7411d2431b99dd7907a7c2f684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:58:22.742374 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6e6383db-f818-4a57-9e44-1b8b14499579 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "GET /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c" status: 200 len: 1276 microversion: 2.1 time: 0.149698 Jun 20 12:58:22.743737 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3519/7139] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:22 2022] GET /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c => generated 1276 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:58:23.761480 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-51af0729-5fd6-43a1-8c4c-a193437539d6 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:23.762210 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-51af0729-5fd6-43a1-8c4c-a193437539d6 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 33bba1db-e12f-4f09-9f75-3c4af2a3958c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:23.772608 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51af0729-5fd6-43a1-8c4c-a193437539d6 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:23.773369 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51af0729-5fd6-43a1-8c4c-a193437539d6 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:23.774393 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51af0729-5fd6-43a1-8c4c-a193437539d6 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:23.774911 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51af0729-5fd6-43a1-8c4c-a193437539d6 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:24.002037 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-51af0729-5fd6-43a1-8c4c-a193437539d6 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01e5b767f8849e8b33147ae4eeba206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40de2e7411d2431b99dd7907a7c2f684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:58:24.032343 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-51af0729-5fd6-43a1-8c4c-a193437539d6 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "GET /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c" status: 200 len: 1316 microversion: 2.1 time: 0.276015 Jun 20 12:58:24.033578 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3621/7140] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:23 2022] GET /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c => generated 1316 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:58:24.296629 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-ccab751f-7afb-4dea-b2e6-3722aeed1af0 req-ae73f8a4-12c7-478c-bfca-e40c3be32b2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33bba1db-e12f-4f09-9f75-3c4af2a3958c", "tag": "3cea862c-4b9a-4331-9a91-27fb6fbe377d"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:58:24.319147 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-ccab751f-7afb-4dea-b2e6-3722aeed1af0 req-ae73f8a4-12c7-478c-bfca-e40c3be32b2d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:24.320009 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-ccab751f-7afb-4dea-b2e6-3722aeed1af0 req-ae73f8a4-12c7-478c-bfca-e40c3be32b2d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:24.350969 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-ccab751f-7afb-4dea-b2e6-3722aeed1af0 req-ae73f8a4-12c7-478c-bfca-e40c3be32b2d service nova] Creating event network-changed:3cea862c-4b9a-4331-9a91-27fb6fbe377d for instance 33bba1db-e12f-4f09-9f75-3c4af2a3958c on n-h1-master-1 Jun 20 12:58:24.369822 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-ccab751f-7afb-4dea-b2e6-3722aeed1af0 req-ae73f8a4-12c7-478c-bfca-e40c3be32b2d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082570 Jun 20 12:58:24.375579 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3520/7141] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:58:25.050545 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0418e92b-13c4-48f6-b12c-b1ead607a29d tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:25.051131 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0418e92b-13c4-48f6-b12c-b1ead607a29d tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 33bba1db-e12f-4f09-9f75-3c4af2a3958c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:25.058363 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0418e92b-13c4-48f6-b12c-b1ead607a29d tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:25.059146 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0418e92b-13c4-48f6-b12c-b1ead607a29d tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:25.059910 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0418e92b-13c4-48f6-b12c-b1ead607a29d tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:25.060375 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0418e92b-13c4-48f6-b12c-b1ead607a29d tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:25.201613 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0418e92b-13c4-48f6-b12c-b1ead607a29d tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01e5b767f8849e8b33147ae4eeba206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40de2e7411d2431b99dd7907a7c2f684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:58:25.210665 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0418e92b-13c4-48f6-b12c-b1ead607a29d tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "GET /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c" status: 200 len: 1316 microversion: 2.1 time: 0.164158 Jun 20 12:58:25.211470 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3622/7142] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:25 2022] GET /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:58:26.228003 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f251ae83-08c8-4fb2-878c-704accc072d4 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:26.228798 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f251ae83-08c8-4fb2-878c-704accc072d4 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 33bba1db-e12f-4f09-9f75-3c4af2a3958c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:26.236727 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f251ae83-08c8-4fb2-878c-704accc072d4 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:26.237192 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f251ae83-08c8-4fb2-878c-704accc072d4 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:26.237999 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f251ae83-08c8-4fb2-878c-704accc072d4 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:26.238446 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f251ae83-08c8-4fb2-878c-704accc072d4 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:26.385337 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f251ae83-08c8-4fb2-878c-704accc072d4 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01e5b767f8849e8b33147ae4eeba206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40de2e7411d2431b99dd7907a7c2f684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:58:26.393508 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f251ae83-08c8-4fb2-878c-704accc072d4 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "GET /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c" status: 200 len: 1316 microversion: 2.1 time: 0.169971 Jun 20 12:58:26.394083 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3521/7143] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:26 2022] GET /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c => generated 1316 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:58:27.411405 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9f3d8aa4-7453-4cd3-9a6d-c5f5bb170c69 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:27.411854 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9f3d8aa4-7453-4cd3-9a6d-c5f5bb170c69 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 33bba1db-e12f-4f09-9f75-3c4af2a3958c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:27.419583 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9f3d8aa4-7453-4cd3-9a6d-c5f5bb170c69 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:27.420009 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9f3d8aa4-7453-4cd3-9a6d-c5f5bb170c69 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:27.420982 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9f3d8aa4-7453-4cd3-9a6d-c5f5bb170c69 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:27.421540 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9f3d8aa4-7453-4cd3-9a6d-c5f5bb170c69 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:27.560250 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9f3d8aa4-7453-4cd3-9a6d-c5f5bb170c69 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01e5b767f8849e8b33147ae4eeba206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40de2e7411d2431b99dd7907a7c2f684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:58:27.569058 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9f3d8aa4-7453-4cd3-9a6d-c5f5bb170c69 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "GET /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c" status: 200 len: 1316 microversion: 2.1 time: 0.162094 Jun 20 12:58:27.569683 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3623/7144] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:27 2022] GET /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:58:28.586854 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-60eaf0cd-3a66-4260-99f7-baee8fe05d76 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:28.587560 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-60eaf0cd-3a66-4260-99f7-baee8fe05d76 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 33bba1db-e12f-4f09-9f75-3c4af2a3958c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:28.596103 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-60eaf0cd-3a66-4260-99f7-baee8fe05d76 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:28.596615 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-60eaf0cd-3a66-4260-99f7-baee8fe05d76 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:28.597445 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-60eaf0cd-3a66-4260-99f7-baee8fe05d76 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:28.597900 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-60eaf0cd-3a66-4260-99f7-baee8fe05d76 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:28.733791 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-60eaf0cd-3a66-4260-99f7-baee8fe05d76 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01e5b767f8849e8b33147ae4eeba206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40de2e7411d2431b99dd7907a7c2f684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:58:28.741701 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-60eaf0cd-3a66-4260-99f7-baee8fe05d76 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "GET /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c" status: 200 len: 1316 microversion: 2.1 time: 0.159150 Jun 20 12:58:28.742318 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3522/7145] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:28 2022] GET /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:58:29.427334 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-0cb03999-81a3-4f2f-9ee0-b1ef397ff564 req-e072234c-8f9c-4b3d-b167-3565f152e7b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33bba1db-e12f-4f09-9f75-3c4af2a3958c", "name": "network-vif-plugged", "status": "completed", "tag": "3cea862c-4b9a-4331-9a91-27fb6fbe377d"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:58:29.437837 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-0cb03999-81a3-4f2f-9ee0-b1ef397ff564 req-e072234c-8f9c-4b3d-b167-3565f152e7b6 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:29.438282 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-0cb03999-81a3-4f2f-9ee0-b1ef397ff564 req-e072234c-8f9c-4b3d-b167-3565f152e7b6 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:29.450540 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-0cb03999-81a3-4f2f-9ee0-b1ef397ff564 req-e072234c-8f9c-4b3d-b167-3565f152e7b6 service nova] Creating event network-vif-plugged:3cea862c-4b9a-4331-9a91-27fb6fbe377d for instance 33bba1db-e12f-4f09-9f75-3c4af2a3958c on n-h1-master-1 Jun 20 12:58:29.456823 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-0cb03999-81a3-4f2f-9ee0-b1ef397ff564 req-e072234c-8f9c-4b3d-b167-3565f152e7b6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033072 Jun 20 12:58:29.457529 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3624/7146] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:58:29.759417 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-92db46d3-0dc6-4f98-aab0-b93e3a067f67 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:29.759982 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-92db46d3-0dc6-4f98-aab0-b93e3a067f67 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 33bba1db-e12f-4f09-9f75-3c4af2a3958c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:29.767798 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-92db46d3-0dc6-4f98-aab0-b93e3a067f67 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:29.768318 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-92db46d3-0dc6-4f98-aab0-b93e3a067f67 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:29.769129 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-92db46d3-0dc6-4f98-aab0-b93e3a067f67 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:29.769581 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-92db46d3-0dc6-4f98-aab0-b93e3a067f67 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:29.913004 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-92db46d3-0dc6-4f98-aab0-b93e3a067f67 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01e5b767f8849e8b33147ae4eeba206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40de2e7411d2431b99dd7907a7c2f684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:58:29.921286 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-92db46d3-0dc6-4f98-aab0-b93e3a067f67 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "GET /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c" status: 200 len: 1316 microversion: 2.1 time: 0.165885 Jun 20 12:58:29.921862 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3523/7147] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:29 2022] GET /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:58:30.940722 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a5fc834b-5581-4314-b444-af48c06c325a tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:30.941407 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a5fc834b-5581-4314-b444-af48c06c325a tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 33bba1db-e12f-4f09-9f75-3c4af2a3958c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:30.948234 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5fc834b-5581-4314-b444-af48c06c325a tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:30.948730 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5fc834b-5581-4314-b444-af48c06c325a tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:30.950079 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5fc834b-5581-4314-b444-af48c06c325a tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:30.950079 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5fc834b-5581-4314-b444-af48c06c325a tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:31.098163 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a5fc834b-5581-4314-b444-af48c06c325a tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01e5b767f8849e8b33147ae4eeba206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40de2e7411d2431b99dd7907a7c2f684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:58:31.106576 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a5fc834b-5581-4314-b444-af48c06c325a tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "GET /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c" status: 200 len: 1504 microversion: 2.1 time: 0.171368 Jun 20 12:58:31.107212 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3625/7148] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:30 2022] GET /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:58:31.165246 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d22281be-2c06-438d-a353-defa63309914 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1234598426", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "b5cd42e8-8531-40ec-a7fe-91b3ceafe9a3"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:58:31.220333 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-d22281be-2c06-438d-a353-defa63309914 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] validate_networks() for [('b5cd42e8-8531-40ec-a7fe-91b3ceafe9a3', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:58:31.411116 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:58:31.435869 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:58:31.603340 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-d22281be-2c06-438d-a353-defa63309914 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:58:31.603823 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-d22281be-2c06-438d-a353-defa63309914 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:58:31.604324 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-d22281be-2c06-438d-a353-defa63309914 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:58:31.604797 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-d22281be-2c06-438d-a353-defa63309914 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:58:31.605220 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-d22281be-2c06-438d-a353-defa63309914 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:58:31.614933 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d22281be-2c06-438d-a353-defa63309914 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:31.615398 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d22281be-2c06-438d-a353-defa63309914 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:31.616230 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d22281be-2c06-438d-a353-defa63309914 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:31.616999 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d22281be-2c06-438d-a353-defa63309914 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:31.634611 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-d22281be-2c06-438d-a353-defa63309914 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Getting quotas for project 40de2e7411d2431b99dd7907a7c2f684. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:58:31.640984 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-d22281be-2c06-438d-a353-defa63309914 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Getting quotas for user f01e5b767f8849e8b33147ae4eeba206 and project 40de2e7411d2431b99dd7907a7c2f684. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:58:31.655096 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d22281be-2c06-438d-a353-defa63309914 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:58:31.657287 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d22281be-2c06-438d-a353-defa63309914 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 541908f0-5048-49df-b117-ccece0e891ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:58:31.702955 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d22281be-2c06-438d-a353-defa63309914 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.541651 Jun 20 12:58:31.703858 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3524/7149] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:58:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 12:58:31.714114 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e6d958b3-6cd8-4c03-93bb-a72798a98161 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:31.714759 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e6d958b3-6cd8-4c03-93bb-a72798a98161 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 541908f0-5048-49df-b117-ccece0e891ca] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:31.716908 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:58:31.772733 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e6d958b3-6cd8-4c03-93bb-a72798a98161 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01e5b767f8849e8b33147ae4eeba206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40de2e7411d2431b99dd7907a7c2f684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:58:31.780405 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e6d958b3-6cd8-4c03-93bb-a72798a98161 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "GET /compute/v2.1/servers/541908f0-5048-49df-b117-ccece0e891ca" status: 200 len: 1217 microversion: 2.1 time: 0.069499 Jun 20 12:58:31.781538 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3626/7150] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:31 2022] GET /compute/v2.1/servers/541908f0-5048-49df-b117-ccece0e891ca => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:58:32.800182 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5229fe5c-0566-4aef-ae9b-23641a6ac671 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:32.802389 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5229fe5c-0566-4aef-ae9b-23641a6ac671 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 541908f0-5048-49df-b117-ccece0e891ca] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:32.813678 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5229fe5c-0566-4aef-ae9b-23641a6ac671 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:32.814669 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5229fe5c-0566-4aef-ae9b-23641a6ac671 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:32.815901 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5229fe5c-0566-4aef-ae9b-23641a6ac671 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:32.816450 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5229fe5c-0566-4aef-ae9b-23641a6ac671 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:32.918624 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5229fe5c-0566-4aef-ae9b-23641a6ac671 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01e5b767f8849e8b33147ae4eeba206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40de2e7411d2431b99dd7907a7c2f684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:58:32.927212 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5229fe5c-0566-4aef-ae9b-23641a6ac671 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "GET /compute/v2.1/servers/541908f0-5048-49df-b117-ccece0e891ca" status: 200 len: 1277 microversion: 2.1 time: 0.132359 Jun 20 12:58:32.927803 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3525/7151] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:32 2022] GET /compute/v2.1/servers/541908f0-5048-49df-b117-ccece0e891ca => generated 1277 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:58:33.944762 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bbec0b45-8438-4874-9954-f3d201309c37 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:33.945604 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bbec0b45-8438-4874-9954-f3d201309c37 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 541908f0-5048-49df-b117-ccece0e891ca] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:33.954395 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bbec0b45-8438-4874-9954-f3d201309c37 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:33.954868 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bbec0b45-8438-4874-9954-f3d201309c37 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:33.955757 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bbec0b45-8438-4874-9954-f3d201309c37 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:33.956401 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bbec0b45-8438-4874-9954-f3d201309c37 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:34.113566 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bbec0b45-8438-4874-9954-f3d201309c37 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01e5b767f8849e8b33147ae4eeba206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40de2e7411d2431b99dd7907a7c2f684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:58:34.121808 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bbec0b45-8438-4874-9954-f3d201309c37 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "GET /compute/v2.1/servers/541908f0-5048-49df-b117-ccece0e891ca" status: 200 len: 1317 microversion: 2.1 time: 0.180878 Jun 20 12:58:34.122438 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3627/7152] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:33 2022] GET /compute/v2.1/servers/541908f0-5048-49df-b117-ccece0e891ca => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:58:34.542965 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-341b6b64-4986-40ab-a075-b5a32ec377f9 req-6987e6e9-bc3b-4879-b1c9-27d5b8530aca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "541908f0-5048-49df-b117-ccece0e891ca", "tag": "3f25a3c2-99c5-4d1a-adb8-30c306414b4f"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:58:34.554935 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:58:34.562117 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-341b6b64-4986-40ab-a075-b5a32ec377f9 req-6987e6e9-bc3b-4879-b1c9-27d5b8530aca service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:34.562496 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-341b6b64-4986-40ab-a075-b5a32ec377f9 req-6987e6e9-bc3b-4879-b1c9-27d5b8530aca service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:34.578483 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-341b6b64-4986-40ab-a075-b5a32ec377f9 req-6987e6e9-bc3b-4879-b1c9-27d5b8530aca service nova] Creating event network-changed:3f25a3c2-99c5-4d1a-adb8-30c306414b4f for instance 541908f0-5048-49df-b117-ccece0e891ca on n-h2-master-1 Jun 20 12:58:34.584750 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-341b6b64-4986-40ab-a075-b5a32ec377f9 req-6987e6e9-bc3b-4879-b1c9-27d5b8530aca service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057487 Jun 20 12:58:34.585344 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3526/7153] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:58:35.139259 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cce98d89-4ca9-451a-927c-7ce31f1950d6 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:35.140135 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cce98d89-4ca9-451a-927c-7ce31f1950d6 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 541908f0-5048-49df-b117-ccece0e891ca] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:35.147342 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cce98d89-4ca9-451a-927c-7ce31f1950d6 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:35.147798 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cce98d89-4ca9-451a-927c-7ce31f1950d6 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:35.148594 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cce98d89-4ca9-451a-927c-7ce31f1950d6 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:35.149036 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cce98d89-4ca9-451a-927c-7ce31f1950d6 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:35.289787 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cce98d89-4ca9-451a-927c-7ce31f1950d6 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01e5b767f8849e8b33147ae4eeba206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40de2e7411d2431b99dd7907a7c2f684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:58:35.299167 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cce98d89-4ca9-451a-927c-7ce31f1950d6 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "GET /compute/v2.1/servers/541908f0-5048-49df-b117-ccece0e891ca" status: 200 len: 1317 microversion: 2.1 time: 0.163900 Jun 20 12:58:35.299753 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3628/7154] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:35 2022] GET /compute/v2.1/servers/541908f0-5048-49df-b117-ccece0e891ca => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:58:36.318598 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f50dac38-13c8-4ed1-b97a-bad8ad7e3045 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:36.319324 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f50dac38-13c8-4ed1-b97a-bad8ad7e3045 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 541908f0-5048-49df-b117-ccece0e891ca] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:36.327550 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f50dac38-13c8-4ed1-b97a-bad8ad7e3045 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:36.328024 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f50dac38-13c8-4ed1-b97a-bad8ad7e3045 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:36.328922 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f50dac38-13c8-4ed1-b97a-bad8ad7e3045 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:36.329373 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f50dac38-13c8-4ed1-b97a-bad8ad7e3045 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:36.470311 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f50dac38-13c8-4ed1-b97a-bad8ad7e3045 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01e5b767f8849e8b33147ae4eeba206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40de2e7411d2431b99dd7907a7c2f684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:58:36.477977 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f50dac38-13c8-4ed1-b97a-bad8ad7e3045 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "GET /compute/v2.1/servers/541908f0-5048-49df-b117-ccece0e891ca" status: 200 len: 1317 microversion: 2.1 time: 0.164201 Jun 20 12:58:36.478539 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3527/7155] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:36 2022] GET /compute/v2.1/servers/541908f0-5048-49df-b117-ccece0e891ca => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:58:37.495658 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-97769cf6-aae6-4945-8417-6f929c452ef2 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:37.496370 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-97769cf6-aae6-4945-8417-6f929c452ef2 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 541908f0-5048-49df-b117-ccece0e891ca] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:37.503532 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-97769cf6-aae6-4945-8417-6f929c452ef2 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:37.503978 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-97769cf6-aae6-4945-8417-6f929c452ef2 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:37.504773 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-97769cf6-aae6-4945-8417-6f929c452ef2 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:37.505206 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-97769cf6-aae6-4945-8417-6f929c452ef2 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:37.648140 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-97769cf6-aae6-4945-8417-6f929c452ef2 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01e5b767f8849e8b33147ae4eeba206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40de2e7411d2431b99dd7907a7c2f684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:58:37.656243 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-97769cf6-aae6-4945-8417-6f929c452ef2 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "GET /compute/v2.1/servers/541908f0-5048-49df-b117-ccece0e891ca" status: 200 len: 1317 microversion: 2.1 time: 0.164577 Jun 20 12:58:37.656851 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3629/7156] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:37 2022] GET /compute/v2.1/servers/541908f0-5048-49df-b117-ccece0e891ca => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:58:38.673670 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-46905218-2882-4979-8309-bb95b455f4bc tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:38.674318 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-46905218-2882-4979-8309-bb95b455f4bc tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 541908f0-5048-49df-b117-ccece0e891ca] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:38.681727 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-46905218-2882-4979-8309-bb95b455f4bc tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:38.682193 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-46905218-2882-4979-8309-bb95b455f4bc tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:38.682983 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-46905218-2882-4979-8309-bb95b455f4bc tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:38.683428 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-46905218-2882-4979-8309-bb95b455f4bc tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:38.823119 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-46905218-2882-4979-8309-bb95b455f4bc tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01e5b767f8849e8b33147ae4eeba206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40de2e7411d2431b99dd7907a7c2f684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:58:38.831217 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-46905218-2882-4979-8309-bb95b455f4bc tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "GET /compute/v2.1/servers/541908f0-5048-49df-b117-ccece0e891ca" status: 200 len: 1317 microversion: 2.1 time: 0.161705 Jun 20 12:58:38.831799 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3528/7157] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:38 2022] GET /compute/v2.1/servers/541908f0-5048-49df-b117-ccece0e891ca => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:58:39.194981 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-9538b2fd-3e08-463c-8bfc-28e6dbcaa8a3 req-efd8e6b8-c128-4602-9755-3199020a2c84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "541908f0-5048-49df-b117-ccece0e891ca", "name": "network-vif-plugged", "status": "completed", "tag": "3f25a3c2-99c5-4d1a-adb8-30c306414b4f"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:58:39.204412 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-9538b2fd-3e08-463c-8bfc-28e6dbcaa8a3 req-efd8e6b8-c128-4602-9755-3199020a2c84 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:39.204862 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-9538b2fd-3e08-463c-8bfc-28e6dbcaa8a3 req-efd8e6b8-c128-4602-9755-3199020a2c84 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:39.216769 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-9538b2fd-3e08-463c-8bfc-28e6dbcaa8a3 req-efd8e6b8-c128-4602-9755-3199020a2c84 service nova] Creating event network-vif-plugged:3f25a3c2-99c5-4d1a-adb8-30c306414b4f for instance 541908f0-5048-49df-b117-ccece0e891ca on n-h2-master-1 Jun 20 12:58:39.222419 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-9538b2fd-3e08-463c-8bfc-28e6dbcaa8a3 req-efd8e6b8-c128-4602-9755-3199020a2c84 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031058 Jun 20 12:58:39.223099 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3630/7158] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:58:39.848713 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b1a44aa9-86a3-49fa-89cb-2db380ddeda3 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:39.849180 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b1a44aa9-86a3-49fa-89cb-2db380ddeda3 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 541908f0-5048-49df-b117-ccece0e891ca] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:39.856370 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b1a44aa9-86a3-49fa-89cb-2db380ddeda3 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:39.856840 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b1a44aa9-86a3-49fa-89cb-2db380ddeda3 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:39.857629 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b1a44aa9-86a3-49fa-89cb-2db380ddeda3 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:39.858190 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b1a44aa9-86a3-49fa-89cb-2db380ddeda3 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:40.001512 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b1a44aa9-86a3-49fa-89cb-2db380ddeda3 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01e5b767f8849e8b33147ae4eeba206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40de2e7411d2431b99dd7907a7c2f684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:58:40.009380 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b1a44aa9-86a3-49fa-89cb-2db380ddeda3 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "GET /compute/v2.1/servers/541908f0-5048-49df-b117-ccece0e891ca" status: 200 len: 1317 microversion: 2.1 time: 0.164736 Jun 20 12:58:40.010017 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3529/7159] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:39 2022] GET /compute/v2.1/servers/541908f0-5048-49df-b117-ccece0e891ca => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:58:41.028284 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1091db68-0489-4897-a701-6089f0824e20 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:41.029013 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1091db68-0489-4897-a701-6089f0824e20 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 541908f0-5048-49df-b117-ccece0e891ca] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:41.036241 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1091db68-0489-4897-a701-6089f0824e20 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:41.036699 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1091db68-0489-4897-a701-6089f0824e20 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:41.037465 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1091db68-0489-4897-a701-6089f0824e20 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:41.037900 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1091db68-0489-4897-a701-6089f0824e20 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:41.171663 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1091db68-0489-4897-a701-6089f0824e20 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01e5b767f8849e8b33147ae4eeba206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40de2e7411d2431b99dd7907a7c2f684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:58:41.179443 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1091db68-0489-4897-a701-6089f0824e20 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "GET /compute/v2.1/servers/541908f0-5048-49df-b117-ccece0e891ca" status: 200 len: 1505 microversion: 2.1 time: 0.156291 Jun 20 12:58:41.180008 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3631/7160] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:41 2022] GET /compute/v2.1/servers/541908f0-5048-49df-b117-ccece0e891ca => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:58:41.196420 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-873184f6-117b-42ee-b82c-d04e6021664c tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:41.196935 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-873184f6-117b-42ee-b82c-d04e6021664c tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 541908f0-5048-49df-b117-ccece0e891ca] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:41.204585 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-873184f6-117b-42ee-b82c-d04e6021664c tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:41.205050 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-873184f6-117b-42ee-b82c-d04e6021664c tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:41.205906 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-873184f6-117b-42ee-b82c-d04e6021664c tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:41.206356 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-873184f6-117b-42ee-b82c-d04e6021664c tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:41.232189 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-873184f6-117b-42ee-b82c-d04e6021664c tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 541908f0-5048-49df-b117-ccece0e891ca] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:58:41.315463 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-873184f6-117b-42ee-b82c-d04e6021664c tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "DELETE /compute/v2.1/servers/541908f0-5048-49df-b117-ccece0e891ca" status: 204 len: 0 microversion: 2.1 time: 0.122540 Jun 20 12:58:41.316152 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3530/7161] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:58:41 2022] DELETE /compute/v2.1/servers/541908f0-5048-49df-b117-ccece0e891ca => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:58:41.324356 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f1e81c40-d477-4f53-b17b-9ccb6d2d4f6f tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:41.324985 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f1e81c40-d477-4f53-b17b-9ccb6d2d4f6f tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 541908f0-5048-49df-b117-ccece0e891ca] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:41.331350 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f1e81c40-d477-4f53-b17b-9ccb6d2d4f6f tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:41.331810 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f1e81c40-d477-4f53-b17b-9ccb6d2d4f6f tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:41.332651 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f1e81c40-d477-4f53-b17b-9ccb6d2d4f6f tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:41.333095 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f1e81c40-d477-4f53-b17b-9ccb6d2d4f6f tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:41.468260 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f1e81c40-d477-4f53-b17b-9ccb6d2d4f6f tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01e5b767f8849e8b33147ae4eeba206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40de2e7411d2431b99dd7907a7c2f684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:58:41.476179 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f1e81c40-d477-4f53-b17b-9ccb6d2d4f6f tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "GET /compute/v2.1/servers/541908f0-5048-49df-b117-ccece0e891ca" status: 200 len: 1511 microversion: 2.1 time: 0.155778 Jun 20 12:58:41.476766 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3632/7162] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:41 2022] GET /compute/v2.1/servers/541908f0-5048-49df-b117-ccece0e891ca => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:58:42.494855 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6437df15-9cf5-451f-9fa6-6b26b42a8376 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:42.495599 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6437df15-9cf5-451f-9fa6-6b26b42a8376 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 541908f0-5048-49df-b117-ccece0e891ca] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:42.497592 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:58:42.498298 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:58:42.505249 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6437df15-9cf5-451f-9fa6-6b26b42a8376 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:42.505707 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6437df15-9cf5-451f-9fa6-6b26b42a8376 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:42.506544 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6437df15-9cf5-451f-9fa6-6b26b42a8376 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:42.506989 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6437df15-9cf5-451f-9fa6-6b26b42a8376 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:42.641965 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6437df15-9cf5-451f-9fa6-6b26b42a8376 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01e5b767f8849e8b33147ae4eeba206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40de2e7411d2431b99dd7907a7c2f684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:58:42.650073 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6437df15-9cf5-451f-9fa6-6b26b42a8376 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "GET /compute/v2.1/servers/541908f0-5048-49df-b117-ccece0e891ca" status: 200 len: 1511 microversion: 2.1 time: 0.159598 Jun 20 12:58:42.650657 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3531/7163] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:42 2022] GET /compute/v2.1/servers/541908f0-5048-49df-b117-ccece0e891ca => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:58:43.305494 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-2cb9ed32-4fa7-4a2b-9cbc-80e6b62fc1d6 req-f73a723b-6e00-42ef-a673-4d8e16130b8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "541908f0-5048-49df-b117-ccece0e891ca", "name": "network-vif-deleted", "tag": "3f25a3c2-99c5-4d1a-adb8-30c306414b4f"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:58:43.311784 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:58:43.321303 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-2cb9ed32-4fa7-4a2b-9cbc-80e6b62fc1d6 req-f73a723b-6e00-42ef-a673-4d8e16130b8a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:43.328223 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-2cb9ed32-4fa7-4a2b-9cbc-80e6b62fc1d6 req-f73a723b-6e00-42ef-a673-4d8e16130b8a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:43.348710 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-2cb9ed32-4fa7-4a2b-9cbc-80e6b62fc1d6 req-f73a723b-6e00-42ef-a673-4d8e16130b8a service nova] Creating event network-vif-deleted:3f25a3c2-99c5-4d1a-adb8-30c306414b4f for instance 541908f0-5048-49df-b117-ccece0e891ca on n-h2-master-1 Jun 20 12:58:43.353942 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-2cb9ed32-4fa7-4a2b-9cbc-80e6b62fc1d6 req-f73a723b-6e00-42ef-a673-4d8e16130b8a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054593 Jun 20 12:58:43.354612 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3633/7164] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:58:43.668308 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8258873f-f11d-4d18-9bcf-e4f1c1e2997c tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:43.668881 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8258873f-f11d-4d18-9bcf-e4f1c1e2997c tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 541908f0-5048-49df-b117-ccece0e891ca] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:43.676729 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8258873f-f11d-4d18-9bcf-e4f1c1e2997c tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:43.677195 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8258873f-f11d-4d18-9bcf-e4f1c1e2997c tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:43.677993 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8258873f-f11d-4d18-9bcf-e4f1c1e2997c tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:43.678441 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8258873f-f11d-4d18-9bcf-e4f1c1e2997c tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:43.719454 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8258873f-f11d-4d18-9bcf-e4f1c1e2997c tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:43.719894 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8258873f-f11d-4d18-9bcf-e4f1c1e2997c tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:43.720382 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-8258873f-f11d-4d18-9bcf-e4f1c1e2997c tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lazy-loading 'fault' on Instance uuid 541908f0-5048-49df-b117-ccece0e891ca {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:58:43.765344 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8258873f-f11d-4d18-9bcf-e4f1c1e2997c tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01e5b767f8849e8b33147ae4eeba206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40de2e7411d2431b99dd7907a7c2f684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:58:43.773317 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8258873f-f11d-4d18-9bcf-e4f1c1e2997c tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "GET /compute/v2.1/servers/541908f0-5048-49df-b117-ccece0e891ca" status: 200 len: 1307 microversion: 2.1 time: 0.109352 Jun 20 12:58:43.773907 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3532/7165] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:43 2022] GET /compute/v2.1/servers/541908f0-5048-49df-b117-ccece0e891ca => generated 1307 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:58:44.792837 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2c60b9cc-c4ae-4f6f-b7e9-87ae6d836b80 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:44.793542 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2c60b9cc-c4ae-4f6f-b7e9-87ae6d836b80 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 541908f0-5048-49df-b117-ccece0e891ca] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:44.800572 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2c60b9cc-c4ae-4f6f-b7e9-87ae6d836b80 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:44.801025 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2c60b9cc-c4ae-4f6f-b7e9-87ae6d836b80 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:44.801788 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2c60b9cc-c4ae-4f6f-b7e9-87ae6d836b80 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:44.802255 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2c60b9cc-c4ae-4f6f-b7e9-87ae6d836b80 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:44.816619 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-2c60b9cc-c4ae-4f6f-b7e9-87ae6d836b80 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] HTTP exception thrown: Instance 541908f0-5048-49df-b117-ccece0e891ca could not be found. Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2c60b9cc-c4ae-4f6f-b7e9-87ae6d836b80 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Request method failure captured: Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/541908f0-5048-49df-b117-ccece0e891ca HTTP/1.1 Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisG7sas0yRDxcjnkdL94VStRbYrGAl8pH_P6XEaFUkoKOEIdi_U2ErxlnVto03RQ7dd-pYf1T4RZCBJ4rBzPg1XMTNWyiMw5F68h4wX9suEsvdaJFKnhYKNziNnphmWbBi4x6-FVW18nM7zZ2aBl48rjb4us5nYgOf3ubEIInyGv75Y4 Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 40de2e7411d2431b99dd7907a7c2f684 Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersNegativeTestJSON-1297232810 Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/40de2e7411d2431b99dd7907a7c2f684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/40de2e7411d2431b99dd7907a7c2f684"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/40de2e7411d2431b99dd7907a7c2f684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_40de2e7411d2431b99dd7907a7c2f684"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersNegativeTestJSON-1297232810 Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 40de2e7411d2431b99dd7907a7c2f684 Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1297232810 Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersNegativeTestJSON-1297232810-project Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: f01e5b767f8849e8b33147ae4eeba206 Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersNegativeTestJSON-1297232810-project Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 541908f0-5048-49df-b117-ccece0e891ca could not be found. Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '541908f0-5048-49df-b117-ccece0e891ca'} Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 541908f0-5048-49df-b117-ccece0e891ca could not be found. Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 541908f0-5048-49df-b117-ccece0e891ca could not be found. Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:58:44.818275 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:44.822862 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:44.822862 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:58:44.822862 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:58:44.822862 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:58:44.822862 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:58:44.822862 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 541908f0-5048-49df-b117-ccece0e891ca could not be found. Jun 20 12:58:44.822862 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:44.822862 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2c60b9cc-c4ae-4f6f-b7e9-87ae6d836b80 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Returning 404 to user: Instance 541908f0-5048-49df-b117-ccece0e891ca could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:58:44.822862 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2c60b9cc-c4ae-4f6f-b7e9-87ae6d836b80 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "GET /compute/v2.1/servers/541908f0-5048-49df-b117-ccece0e891ca" status: 404 len: 111 microversion: 2.1 time: 0.032170 Jun 20 12:58:44.822862 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3634/7166] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:44 2022] GET /compute/v2.1/servers/541908f0-5048-49df-b117-ccece0e891ca => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:58:44.829068 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b52bae7e-e9aa-488c-bcb3-71bc09d4a79b tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:44.829694 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b52bae7e-e9aa-488c-bcb3-71bc09d4a79b tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 33bba1db-e12f-4f09-9f75-3c4af2a3958c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:44.836896 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b52bae7e-e9aa-488c-bcb3-71bc09d4a79b tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:44.837358 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b52bae7e-e9aa-488c-bcb3-71bc09d4a79b tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:44.838135 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b52bae7e-e9aa-488c-bcb3-71bc09d4a79b tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:44.838565 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b52bae7e-e9aa-488c-bcb3-71bc09d4a79b tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:44.973029 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b52bae7e-e9aa-488c-bcb3-71bc09d4a79b tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01e5b767f8849e8b33147ae4eeba206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40de2e7411d2431b99dd7907a7c2f684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:58:44.980886 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b52bae7e-e9aa-488c-bcb3-71bc09d4a79b tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "GET /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c" status: 200 len: 1504 microversion: 2.1 time: 0.155805 Jun 20 12:58:44.981474 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3533/7167] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:44 2022] GET /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:58:44.998517 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dd677f3c-084d-49e2-8b17-458fbdcd4a1a tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:58:44.999488 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dd677f3c-084d-49e2-8b17-458fbdcd4a1a tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 03484372-3b29-425e-8c24-680dff5004ae] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:45.005158 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-dd677f3c-084d-49e2-8b17-458fbdcd4a1a tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] HTTP exception thrown: Instance 03484372-3b29-425e-8c24-680dff5004ae could not be found. Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dd677f3c-084d-49e2-8b17-458fbdcd4a1a tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Request method failure captured: Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers/03484372-3b29-425e-8c24-680dff5004ae/action HTTP/1.1 Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 32 Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisG7sas0yRDxcjnkdL94VStRbYrGAl8pH_P6XEaFUkoKOEIdi_U2ErxlnVto03RQ7dd-pYf1T4RZCBJ4rBzPg1XMTNWyiMw5F68h4wX9suEsvdaJFKnhYKNziNnphmWbBi4x6-FVW18nM7zZ2aBl48rjb4us5nYgOf3ubEIInyGv75Y4 Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 40de2e7411d2431b99dd7907a7c2f684 Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersNegativeTestJSON-1297232810 Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/40de2e7411d2431b99dd7907a7c2f684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/40de2e7411d2431b99dd7907a7c2f684"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/40de2e7411d2431b99dd7907a7c2f684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_40de2e7411d2431b99dd7907a7c2f684"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersNegativeTestJSON-1297232810 Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 40de2e7411d2431b99dd7907a7c2f684 Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1297232810 Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersNegativeTestJSON-1297232810-project Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: f01e5b767f8849e8b33147ae4eeba206 Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersNegativeTestJSON-1297232810-project Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: {"resize": {"flavorRef": "452"}} Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 03484372-3b29-425e-8c24-680dff5004ae could not be found. Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '03484372-3b29-425e-8c24-680dff5004ae', 'body': {'resize': {'flavorRef': '452'}}} Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03484372-3b29-425e-8c24-680dff5004ae could not be found. Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:58:45.006726 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:58:45.011051 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03484372-3b29-425e-8c24-680dff5004ae could not be found. Jun 20 12:58:45.011051 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:45.011051 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:58:45.011051 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:45.011051 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:45.011051 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:58:45.011051 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:58:45.011051 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:58:45.011051 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:58:45.011051 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03484372-3b29-425e-8c24-680dff5004ae could not be found. Jun 20 12:58:45.011051 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:45.011051 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dd677f3c-084d-49e2-8b17-458fbdcd4a1a tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Returning 404 to user: Instance 03484372-3b29-425e-8c24-680dff5004ae could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:58:45.011051 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dd677f3c-084d-49e2-8b17-458fbdcd4a1a tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "POST /compute/v2.1/servers/03484372-3b29-425e-8c24-680dff5004ae/action" status: 404 len: 111 microversion: 2.1 time: 0.013849 Jun 20 12:58:45.011051 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3635/7168] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:58:44 2022] POST /compute/v2.1/servers/03484372-3b29-425e-8c24-680dff5004ae/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:58:45.017250 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4158c7e7-ac37-47c7-a2c2-6be5fc81e68d tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:45.017882 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4158c7e7-ac37-47c7-a2c2-6be5fc81e68d tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 33bba1db-e12f-4f09-9f75-3c4af2a3958c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:45.024133 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4158c7e7-ac37-47c7-a2c2-6be5fc81e68d tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:45.024665 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4158c7e7-ac37-47c7-a2c2-6be5fc81e68d tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:45.025451 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4158c7e7-ac37-47c7-a2c2-6be5fc81e68d tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:45.025907 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4158c7e7-ac37-47c7-a2c2-6be5fc81e68d tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:45.161416 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4158c7e7-ac37-47c7-a2c2-6be5fc81e68d tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01e5b767f8849e8b33147ae4eeba206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40de2e7411d2431b99dd7907a7c2f684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:58:45.169397 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4158c7e7-ac37-47c7-a2c2-6be5fc81e68d tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "GET /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c" status: 200 len: 1504 microversion: 2.1 time: 0.156208 Jun 20 12:58:45.169968 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3534/7169] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:45 2022] GET /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:58:45.187464 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-57e4770e-2b57-45f2-8660-fd1d793bd182 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:45.188103 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-57e4770e-2b57-45f2-8660-fd1d793bd182 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 33bba1db-e12f-4f09-9f75-3c4af2a3958c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:45.198244 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57e4770e-2b57-45f2-8660-fd1d793bd182 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:45.198699 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57e4770e-2b57-45f2-8660-fd1d793bd182 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:45.199461 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57e4770e-2b57-45f2-8660-fd1d793bd182 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:45.199878 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57e4770e-2b57-45f2-8660-fd1d793bd182 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:45.334438 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-57e4770e-2b57-45f2-8660-fd1d793bd182 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01e5b767f8849e8b33147ae4eeba206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40de2e7411d2431b99dd7907a7c2f684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:58:45.342551 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-57e4770e-2b57-45f2-8660-fd1d793bd182 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "GET /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c" status: 200 len: 1504 microversion: 2.1 time: 0.159611 Jun 20 12:58:45.343133 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3636/7170] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:45 2022] GET /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:58:45.359011 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-605d217a-fc00-4825-adc9-0fb8d0934c0c tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "74c1f7e3-ab89-4b5b-88de-376f3c833a91"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:58:45.359999 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-605d217a-fc00-4825-adc9-0fb8d0934c0c tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 33bba1db-e12f-4f09-9f75-3c4af2a3958c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:45.366379 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-605d217a-fc00-4825-adc9-0fb8d0934c0c tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:45.366838 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-605d217a-fc00-4825-adc9-0fb8d0934c0c tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:45.367607 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-605d217a-fc00-4825-adc9-0fb8d0934c0c tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:45.368048 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-605d217a-fc00-4825-adc9-0fb8d0934c0c tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:45.372144 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:58:45.412398 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-605d217a-fc00-4825-adc9-0fb8d0934c0c tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f01e5b767f8849e8b33147ae4eeba206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40de2e7411d2431b99dd7907a7c2f684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:58:45.418659 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-605d217a-fc00-4825-adc9-0fb8d0934c0c tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] HTTP exception thrown: Flavor 74c1f7e3-ab89-4b5b-88de-376f3c833a91 could not be found. Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-605d217a-fc00-4825-adc9-0fb8d0934c0c tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Request method failure captured: Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: request: POST /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c/action HTTP/1.1 Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 65 Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisG7sas0yRDxcjnkdL94VStRbYrGAl8pH_P6XEaFUkoKOEIdi_U2ErxlnVto03RQ7dd-pYf1T4RZCBJ4rBzPg1XMTNWyiMw5F68h4wX9suEsvdaJFKnhYKNziNnphmWbBi4x6-FVW18nM7zZ2aBl48rjb4us5nYgOf3ubEIInyGv75Y4 Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 40de2e7411d2431b99dd7907a7c2f684 Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersNegativeTestJSON-1297232810 Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/40de2e7411d2431b99dd7907a7c2f684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/40de2e7411d2431b99dd7907a7c2f684"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/40de2e7411d2431b99dd7907a7c2f684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_40de2e7411d2431b99dd7907a7c2f684"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersNegativeTestJSON-1297232810 Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 40de2e7411d2431b99dd7907a7c2f684 Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1297232810 Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersNegativeTestJSON-1297232810-project Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: f01e5b767f8849e8b33147ae4eeba206 Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersNegativeTestJSON-1297232810-project Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: {"resize": {"flavorRef": "74c1f7e3-ab89-4b5b-88de-376f3c833a91"}} Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: exception: Flavor 74c1f7e3-ab89-4b5b-88de-376f3c833a91 could not be found. Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '33bba1db-e12f-4f09-9f75-3c4af2a3958c', 'body': {'resize': {'flavorRef': '74c1f7e3-ab89-4b5b-88de-376f3c833a91'}}} Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4146, in resize Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 12:58:45.432417 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 12:58:45.437100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:58:45.437100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 12:58:45.437100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 12:58:45.437100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 74c1f7e3-ab89-4b5b-88de-376f3c833a91 could not be found. Jun 20 12:58:45.437100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:58:45.437100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:58:45.437100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:58:45.437100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:45.437100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:58:45.437100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:58:45.437100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:58:45.437100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:58:45.437100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:58:45.437100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:58:45.437100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:58:45.437100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:58:45.437100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jun 20 12:58:45.437100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jun 20 12:58:45.437100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Jun 20 12:58:45.437100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 20 12:58:45.437100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 74c1f7e3-ab89-4b5b-88de-376f3c833a91 could not be found. Jun 20 12:58:45.437100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:58:45.437100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:58:45.437100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:58:45.437100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:45.437100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:58:45.437100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:58:45.437100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:58:45.437100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:58:45.437100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 74c1f7e3-ab89-4b5b-88de-376f3c833a91 could not be found. Jun 20 12:58:45.437100 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:58:45.437100 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-605d217a-fc00-4825-adc9-0fb8d0934c0c tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Returning 400 to user: Flavor 74c1f7e3-ab89-4b5b-88de-376f3c833a91 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:58:45.437100 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-605d217a-fc00-4825-adc9-0fb8d0934c0c tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "POST /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c/action" status: 400 len: 107 microversion: 2.1 time: 0.079129 Jun 20 12:58:45.437100 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3535/7171] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:58:45 2022] POST /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c/action => generated 107 bytes in 81 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:58:45.443288 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-715d049b-97ae-4183-bcc5-839782e0072d tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:45.444027 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-715d049b-97ae-4183-bcc5-839782e0072d tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 33bba1db-e12f-4f09-9f75-3c4af2a3958c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:45.450369 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-715d049b-97ae-4183-bcc5-839782e0072d tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:45.450803 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-715d049b-97ae-4183-bcc5-839782e0072d tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:45.451676 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-715d049b-97ae-4183-bcc5-839782e0072d tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:45.452142 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-715d049b-97ae-4183-bcc5-839782e0072d tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:45.591834 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-715d049b-97ae-4183-bcc5-839782e0072d tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01e5b767f8849e8b33147ae4eeba206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40de2e7411d2431b99dd7907a7c2f684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:58:45.600126 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-715d049b-97ae-4183-bcc5-839782e0072d tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "GET /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c" status: 200 len: 1504 microversion: 2.1 time: 0.160715 Jun 20 12:58:45.600749 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3637/7172] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:45 2022] GET /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:58:45.617337 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-38219472-d26a-4b65-b16c-4939d27e9669 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:45.617961 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-38219472-d26a-4b65-b16c-4939d27e9669 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 33bba1db-e12f-4f09-9f75-3c4af2a3958c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:45.624529 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-38219472-d26a-4b65-b16c-4939d27e9669 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:45.624990 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-38219472-d26a-4b65-b16c-4939d27e9669 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:45.625783 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-38219472-d26a-4b65-b16c-4939d27e9669 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:45.626235 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-38219472-d26a-4b65-b16c-4939d27e9669 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:45.761366 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-38219472-d26a-4b65-b16c-4939d27e9669 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01e5b767f8849e8b33147ae4eeba206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40de2e7411d2431b99dd7907a7c2f684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:58:45.769638 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-38219472-d26a-4b65-b16c-4939d27e9669 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "GET /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c" status: 200 len: 1504 microversion: 2.1 time: 0.156210 Jun 20 12:58:45.770218 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3536/7173] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:45 2022] GET /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:58:45.786378 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2ce3df4b-f2fd-4372-a524-3ec3a46d522e tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2ce3df4b-f2fd-4372-a524-3ec3a46d522e tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Request method failure captured: Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: request: POST /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c/action HTTP/1.1 Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 29 Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisG7sas0yRDxcjnkdL94VStRbYrGAl8pH_P6XEaFUkoKOEIdi_U2ErxlnVto03RQ7dd-pYf1T4RZCBJ4rBzPg1XMTNWyiMw5F68h4wX9suEsvdaJFKnhYKNziNnphmWbBi4x6-FVW18nM7zZ2aBl48rjb4us5nYgOf3ubEIInyGv75Y4 Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 40de2e7411d2431b99dd7907a7c2f684 Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersNegativeTestJSON-1297232810 Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/40de2e7411d2431b99dd7907a7c2f684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/40de2e7411d2431b99dd7907a7c2f684"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/40de2e7411d2431b99dd7907a7c2f684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_40de2e7411d2431b99dd7907a7c2f684"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersNegativeTestJSON-1297232810 Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 40de2e7411d2431b99dd7907a7c2f684 Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1297232810 Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersNegativeTestJSON-1297232810-project Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: f01e5b767f8849e8b33147ae4eeba206 Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersNegativeTestJSON-1297232810-project Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: {"resize": {"flavorRef": ""}} Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '33bba1db-e12f-4f09-9f75-3c4af2a3958c', 'body': {'resize': {'flavorRef': ''}}} Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise error Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi On instance['resize']: Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi '' Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:45.788713 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:58:45.792675 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:45.792675 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:45.792675 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:58:45.792675 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:58:45.792675 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 12:58:45.792675 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 12:58:45.792675 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Jun 20 12:58:45.792675 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:45.792675 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2ce3df4b-f2fd-4372-a524-3ec3a46d522e tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:58:45.792675 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2ce3df4b-f2fd-4372-a524-3ec3a46d522e tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "POST /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c/action" status: 400 len: 113 microversion: 2.1 time: 0.007774 Jun 20 12:58:45.792675 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3638/7174] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 12:58:45 2022] POST /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c/action => generated 113 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:58:45.799017 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fa309970-c595-45b6-a7ed-f119f8d7195b tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:45.799643 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fa309970-c595-45b6-a7ed-f119f8d7195b tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 33bba1db-e12f-4f09-9f75-3c4af2a3958c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:45.806281 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fa309970-c595-45b6-a7ed-f119f8d7195b tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:45.806746 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fa309970-c595-45b6-a7ed-f119f8d7195b tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:45.807557 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fa309970-c595-45b6-a7ed-f119f8d7195b tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:45.808000 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fa309970-c595-45b6-a7ed-f119f8d7195b tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:45.940218 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fa309970-c595-45b6-a7ed-f119f8d7195b tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01e5b767f8849e8b33147ae4eeba206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40de2e7411d2431b99dd7907a7c2f684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:58:45.948534 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fa309970-c595-45b6-a7ed-f119f8d7195b tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "GET /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c" status: 200 len: 1504 microversion: 2.1 time: 0.153374 Jun 20 12:58:45.950652 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3537/7175] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:45 2022] GET /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:58:45.970169 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1bdeeb4b-87cd-4034-83dd-d917d3c068a9 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:45.970657 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1bdeeb4b-87cd-4034-83dd-d917d3c068a9 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 541908f0-5048-49df-b117-ccece0e891ca] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:45.977523 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1bdeeb4b-87cd-4034-83dd-d917d3c068a9 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:45.977967 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1bdeeb4b-87cd-4034-83dd-d917d3c068a9 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:45.978719 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1bdeeb4b-87cd-4034-83dd-d917d3c068a9 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:45.979149 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1bdeeb4b-87cd-4034-83dd-d917d3c068a9 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:45.993235 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-1bdeeb4b-87cd-4034-83dd-d917d3c068a9 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] HTTP exception thrown: Instance 541908f0-5048-49df-b117-ccece0e891ca could not be found. Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1bdeeb4b-87cd-4034-83dd-d917d3c068a9 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Request method failure captured: Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/541908f0-5048-49df-b117-ccece0e891ca HTTP/1.1 Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisG7sas0yRDxcjnkdL94VStRbYrGAl8pH_P6XEaFUkoKOEIdi_U2ErxlnVto03RQ7dd-pYf1T4RZCBJ4rBzPg1XMTNWyiMw5F68h4wX9suEsvdaJFKnhYKNziNnphmWbBi4x6-FVW18nM7zZ2aBl48rjb4us5nYgOf3ubEIInyGv75Y4 Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 40de2e7411d2431b99dd7907a7c2f684 Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-ServersNegativeTestJSON-1297232810 Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/40de2e7411d2431b99dd7907a7c2f684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/40de2e7411d2431b99dd7907a7c2f684"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/40de2e7411d2431b99dd7907a7c2f684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_40de2e7411d2431b99dd7907a7c2f684"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-ServersNegativeTestJSON-1297232810 Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 40de2e7411d2431b99dd7907a7c2f684 Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1297232810 Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-ServersNegativeTestJSON-1297232810-project Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: f01e5b767f8849e8b33147ae4eeba206 Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-ServersNegativeTestJSON-1297232810-project Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 541908f0-5048-49df-b117-ccece0e891ca could not be found. Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '541908f0-5048-49df-b117-ccece0e891ca'} Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 541908f0-5048-49df-b117-ccece0e891ca could not be found. Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:58:45.994838 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:58:45.998983 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 541908f0-5048-49df-b117-ccece0e891ca could not be found. Jun 20 12:58:45.998983 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:45.998983 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:58:45.998983 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:45.998983 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:45.998983 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:58:45.998983 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:58:45.998983 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:58:45.998983 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:58:45.998983 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 541908f0-5048-49df-b117-ccece0e891ca could not be found. Jun 20 12:58:45.998983 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 12:58:45.998983 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1bdeeb4b-87cd-4034-83dd-d917d3c068a9 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Returning 404 to user: Instance 541908f0-5048-49df-b117-ccece0e891ca could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:58:45.998983 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1bdeeb4b-87cd-4034-83dd-d917d3c068a9 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "DELETE /compute/v2.1/servers/541908f0-5048-49df-b117-ccece0e891ca" status: 404 len: 111 microversion: 2.1 time: 0.030938 Jun 20 12:58:45.998983 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3639/7176] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:58:45 2022] DELETE /compute/v2.1/servers/541908f0-5048-49df-b117-ccece0e891ca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:58:46.005610 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fa52d4ff-ec7c-41ad-a303-44d04cf908ac tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:46.006248 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fa52d4ff-ec7c-41ad-a303-44d04cf908ac tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 541908f0-5048-49df-b117-ccece0e891ca] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:46.012563 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fa52d4ff-ec7c-41ad-a303-44d04cf908ac tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:46.013058 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fa52d4ff-ec7c-41ad-a303-44d04cf908ac tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:46.014117 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fa52d4ff-ec7c-41ad-a303-44d04cf908ac tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:46.014376 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fa52d4ff-ec7c-41ad-a303-44d04cf908ac tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:46.028530 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-fa52d4ff-ec7c-41ad-a303-44d04cf908ac tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] HTTP exception thrown: Instance 541908f0-5048-49df-b117-ccece0e891ca could not be found. Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fa52d4ff-ec7c-41ad-a303-44d04cf908ac tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Request method failure captured: Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/541908f0-5048-49df-b117-ccece0e891ca HTTP/1.1 Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisG7sas0yRDxcjnkdL94VStRbYrGAl8pH_P6XEaFUkoKOEIdi_U2ErxlnVto03RQ7dd-pYf1T4RZCBJ4rBzPg1XMTNWyiMw5F68h4wX9suEsvdaJFKnhYKNziNnphmWbBi4x6-FVW18nM7zZ2aBl48rjb4us5nYgOf3ubEIInyGv75Y4 Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 40de2e7411d2431b99dd7907a7c2f684 Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersNegativeTestJSON-1297232810 Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/40de2e7411d2431b99dd7907a7c2f684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/40de2e7411d2431b99dd7907a7c2f684"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/40de2e7411d2431b99dd7907a7c2f684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_40de2e7411d2431b99dd7907a7c2f684"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersNegativeTestJSON-1297232810 Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 40de2e7411d2431b99dd7907a7c2f684 Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1297232810 Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersNegativeTestJSON-1297232810-project Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: f01e5b767f8849e8b33147ae4eeba206 Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersNegativeTestJSON-1297232810-project Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 541908f0-5048-49df-b117-ccece0e891ca could not be found. Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '541908f0-5048-49df-b117-ccece0e891ca'} Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 541908f0-5048-49df-b117-ccece0e891ca could not be found. Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 541908f0-5048-49df-b117-ccece0e891ca could not be found. Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:58:46.030148 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:58:46.033789 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:46.033789 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:58:46.033789 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:58:46.033789 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:58:46.033789 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:58:46.033789 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 541908f0-5048-49df-b117-ccece0e891ca could not be found. Jun 20 12:58:46.033789 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:58:46.033789 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fa52d4ff-ec7c-41ad-a303-44d04cf908ac tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Returning 404 to user: Instance 541908f0-5048-49df-b117-ccece0e891ca could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:58:46.033789 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fa52d4ff-ec7c-41ad-a303-44d04cf908ac tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "GET /compute/v2.1/servers/541908f0-5048-49df-b117-ccece0e891ca" status: 404 len: 111 microversion: 2.1 time: 0.030091 Jun 20 12:58:46.033789 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3538/7177] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:46 2022] GET /compute/v2.1/servers/541908f0-5048-49df-b117-ccece0e891ca => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:58:46.040449 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-117cc45b-4d2e-4664-b3d8-5e4a8ce8dfb6 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:46.041071 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-117cc45b-4d2e-4664-b3d8-5e4a8ce8dfb6 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 33bba1db-e12f-4f09-9f75-3c4af2a3958c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:46.048130 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-117cc45b-4d2e-4664-b3d8-5e4a8ce8dfb6 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:46.048625 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-117cc45b-4d2e-4664-b3d8-5e4a8ce8dfb6 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:46.049397 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-117cc45b-4d2e-4664-b3d8-5e4a8ce8dfb6 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:46.049841 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-117cc45b-4d2e-4664-b3d8-5e4a8ce8dfb6 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:46.086015 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-117cc45b-4d2e-4664-b3d8-5e4a8ce8dfb6 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 33bba1db-e12f-4f09-9f75-3c4af2a3958c] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:58:46.166413 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-117cc45b-4d2e-4664-b3d8-5e4a8ce8dfb6 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "DELETE /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c" status: 204 len: 0 microversion: 2.1 time: 0.129471 Jun 20 12:58:46.166910 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3640/7178] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:58:46 2022] DELETE /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:58:46.175483 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2ae0ad47-1fdf-4316-8807-ac4ad562a100 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:46.176108 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2ae0ad47-1fdf-4316-8807-ac4ad562a100 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 33bba1db-e12f-4f09-9f75-3c4af2a3958c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:46.182459 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2ae0ad47-1fdf-4316-8807-ac4ad562a100 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:46.182923 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2ae0ad47-1fdf-4316-8807-ac4ad562a100 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:46.184018 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2ae0ad47-1fdf-4316-8807-ac4ad562a100 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:46.184694 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2ae0ad47-1fdf-4316-8807-ac4ad562a100 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:46.321792 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2ae0ad47-1fdf-4316-8807-ac4ad562a100 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01e5b767f8849e8b33147ae4eeba206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40de2e7411d2431b99dd7907a7c2f684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:58:46.335777 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2ae0ad47-1fdf-4316-8807-ac4ad562a100 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "GET /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c" status: 200 len: 1510 microversion: 2.1 time: 0.164369 Jun 20 12:58:46.336368 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3539/7179] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:46 2022] GET /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:58:47.354024 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b4a8ed0e-36ec-431b-a5c6-ce38aae75a3c tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:47.354774 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b4a8ed0e-36ec-431b-a5c6-ce38aae75a3c tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 33bba1db-e12f-4f09-9f75-3c4af2a3958c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:47.362063 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b4a8ed0e-36ec-431b-a5c6-ce38aae75a3c tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:47.362519 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b4a8ed0e-36ec-431b-a5c6-ce38aae75a3c tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:47.363289 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b4a8ed0e-36ec-431b-a5c6-ce38aae75a3c tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:47.363725 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b4a8ed0e-36ec-431b-a5c6-ce38aae75a3c tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:47.515462 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b4a8ed0e-36ec-431b-a5c6-ce38aae75a3c tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01e5b767f8849e8b33147ae4eeba206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40de2e7411d2431b99dd7907a7c2f684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:58:47.524262 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b4a8ed0e-36ec-431b-a5c6-ce38aae75a3c tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "GET /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c" status: 200 len: 1510 microversion: 2.1 time: 0.174607 Jun 20 12:58:47.524872 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3641/7180] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:47 2022] GET /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c => generated 1510 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:58:48.121409 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-640f84e0-edc0-4044-ac71-3920c464ce6a req-8eea9bff-e22e-4549-86d4-d36d94661884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33bba1db-e12f-4f09-9f75-3c4af2a3958c", "name": "network-vif-deleted", "tag": "3cea862c-4b9a-4331-9a91-27fb6fbe377d"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:58:48.133708 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-640f84e0-edc0-4044-ac71-3920c464ce6a req-8eea9bff-e22e-4549-86d4-d36d94661884 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:48.134434 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-640f84e0-edc0-4044-ac71-3920c464ce6a req-8eea9bff-e22e-4549-86d4-d36d94661884 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:48.155284 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-640f84e0-edc0-4044-ac71-3920c464ce6a req-8eea9bff-e22e-4549-86d4-d36d94661884 service nova] Creating event network-vif-deleted:3cea862c-4b9a-4331-9a91-27fb6fbe377d for instance 33bba1db-e12f-4f09-9f75-3c4af2a3958c on n-h1-master-1 Jun 20 12:58:48.163484 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-640f84e0-edc0-4044-ac71-3920c464ce6a req-8eea9bff-e22e-4549-86d4-d36d94661884 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045953 Jun 20 12:58:48.165163 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3540/7181] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:58:48.541906 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-21c520f9-b464-43d1-be53-f908df36ec94 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:48.542652 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-21c520f9-b464-43d1-be53-f908df36ec94 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 33bba1db-e12f-4f09-9f75-3c4af2a3958c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:48.549873 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21c520f9-b464-43d1-be53-f908df36ec94 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:48.550332 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21c520f9-b464-43d1-be53-f908df36ec94 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:48.551089 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21c520f9-b464-43d1-be53-f908df36ec94 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:48.551520 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21c520f9-b464-43d1-be53-f908df36ec94 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:48.555819 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:58:48.590244 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21c520f9-b464-43d1-be53-f908df36ec94 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:48.590701 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21c520f9-b464-43d1-be53-f908df36ec94 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:48.591155 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-21c520f9-b464-43d1-be53-f908df36ec94 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lazy-loading 'fault' on Instance uuid 33bba1db-e12f-4f09-9f75-3c4af2a3958c {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:58:48.634395 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-21c520f9-b464-43d1-be53-f908df36ec94 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f01e5b767f8849e8b33147ae4eeba206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40de2e7411d2431b99dd7907a7c2f684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:58:48.641634 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-21c520f9-b464-43d1-be53-f908df36ec94 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "GET /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c" status: 200 len: 1306 microversion: 2.1 time: 0.103813 Jun 20 12:58:48.642201 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3642/7182] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:48 2022] GET /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c => generated 1306 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:58:49.660235 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6b02dd59-ed8e-4136-a7ed-1412a97e6d18 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:58:49.660949 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6b02dd59-ed8e-4136-a7ed-1412a97e6d18 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] [instance: 33bba1db-e12f-4f09-9f75-3c4af2a3958c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:58:49.667866 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6b02dd59-ed8e-4136-a7ed-1412a97e6d18 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:49.668362 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6b02dd59-ed8e-4136-a7ed-1412a97e6d18 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:49.669141 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6b02dd59-ed8e-4136-a7ed-1412a97e6d18 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:58:49.669579 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6b02dd59-ed8e-4136-a7ed-1412a97e6d18 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:58:49.692162 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-6b02dd59-ed8e-4136-a7ed-1412a97e6d18 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] HTTP exception thrown: Instance 33bba1db-e12f-4f09-9f75-3c4af2a3958c could not be found. Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6b02dd59-ed8e-4136-a7ed-1412a97e6d18 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Request method failure captured: Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c HTTP/1.1 Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisG7sas0yRDxcjnkdL94VStRbYrGAl8pH_P6XEaFUkoKOEIdi_U2ErxlnVto03RQ7dd-pYf1T4RZCBJ4rBzPg1XMTNWyiMw5F68h4wX9suEsvdaJFKnhYKNziNnphmWbBi4x6-FVW18nM7zZ2aBl48rjb4us5nYgOf3ubEIInyGv75Y4 Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 40de2e7411d2431b99dd7907a7c2f684 Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-ServersNegativeTestJSON-1297232810 Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/40de2e7411d2431b99dd7907a7c2f684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/40de2e7411d2431b99dd7907a7c2f684"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/40de2e7411d2431b99dd7907a7c2f684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_40de2e7411d2431b99dd7907a7c2f684"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-ServersNegativeTestJSON-1297232810 Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 40de2e7411d2431b99dd7907a7c2f684 Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1297232810 Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-ServersNegativeTestJSON-1297232810-project Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: f01e5b767f8849e8b33147ae4eeba206 Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-ServersNegativeTestJSON-1297232810-project Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 33bba1db-e12f-4f09-9f75-3c4af2a3958c could not be found. Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '33bba1db-e12f-4f09-9f75-3c4af2a3958c'} Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33bba1db-e12f-4f09-9f75-3c4af2a3958c could not be found. Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33bba1db-e12f-4f09-9f75-3c4af2a3958c could not be found. Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:58:49.693915 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:58:49.698017 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:58:49.698017 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:58:49.698017 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:58:49.698017 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:58:49.698017 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:58:49.698017 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33bba1db-e12f-4f09-9f75-3c4af2a3958c could not be found. Jun 20 12:58:49.698017 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:58:49.698017 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6b02dd59-ed8e-4136-a7ed-1412a97e6d18 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] Returning 404 to user: Instance 33bba1db-e12f-4f09-9f75-3c4af2a3958c could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:58:49.698017 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6b02dd59-ed8e-4136-a7ed-1412a97e6d18 tempest-ServersNegativeTestJSON-1297232810 tempest-ServersNegativeTestJSON-1297232810-project] 10.222.0.27 "GET /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c" status: 404 len: 111 microversion: 2.1 time: 0.040537 Jun 20 12:58:49.698017 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3541/7183] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:58:49 2022] GET /compute/v2.1/servers/33bba1db-e12f-4f09-9f75-3c4af2a3958c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:59:22.066145 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:59:22.066907 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:59:22.265509 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6f98d215-8031-4832-8dc9-8820b008aec4 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Action: 'create', calling method: .version_select at 0x7f60722a9940>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1642489770", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMB4qutRmd2Pe5bo62h7UHd8829sTbvPQU0zitIZGSsVQr+oE7T3KutK7j/ALGj5sJxBW41RXsjRRJT+8kSwi6YpZofajPlaz7CZIMwHWh1owpyU/vi0fFWwxYw5bUtMQ=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:59:22.280445 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-6f98d215-8031-4832-8dc9-8820b008aec4 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Getting quotas for project 08cbcc7c9d0a479193999072cd0d1a45. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:59:22.286101 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-6f98d215-8031-4832-8dc9-8820b008aec4 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Getting quotas for user 3e01b8e2cdf145c8b98b239c950b16ee and project 08cbcc7c9d0a479193999072cd0d1a45. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:59:22.315657 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6f98d215-8031-4832-8dc9-8820b008aec4 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.254654 Jun 20 12:59:22.320488 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3643/7184] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 12:59:22 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:59:22.370509 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a9d93f88-7108-4f18-9a72-c3a8fb14943b tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-145685555", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1642489770", "networks": [{"uuid": "298a84c7-86e8-49f5-8d85-5e0066984fc0"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:59:22.378193 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:59:22.379198 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=26 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:59:22.629471 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-a9d93f88-7108-4f18-9a72-c3a8fb14943b tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] validate_networks() for [('298a84c7-86e8-49f5-8d85-5e0066984fc0', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:59:23.014744 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-a9d93f88-7108-4f18-9a72-c3a8fb14943b tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:59:23.015186 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-a9d93f88-7108-4f18-9a72-c3a8fb14943b tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:59:23.015666 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-a9d93f88-7108-4f18-9a72-c3a8fb14943b tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:59:23.016088 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-a9d93f88-7108-4f18-9a72-c3a8fb14943b tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:59:23.016536 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-a9d93f88-7108-4f18-9a72-c3a8fb14943b tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:59:23.025815 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a9d93f88-7108-4f18-9a72-c3a8fb14943b tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:23.026279 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a9d93f88-7108-4f18-9a72-c3a8fb14943b tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:23.027084 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a9d93f88-7108-4f18-9a72-c3a8fb14943b tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:23.027974 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a9d93f88-7108-4f18-9a72-c3a8fb14943b tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:23.047242 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-a9d93f88-7108-4f18-9a72-c3a8fb14943b tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Getting quotas for project 08cbcc7c9d0a479193999072cd0d1a45. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:59:23.052647 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-a9d93f88-7108-4f18-9a72-c3a8fb14943b tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Getting quotas for user 3e01b8e2cdf145c8b98b239c950b16ee and project 08cbcc7c9d0a479193999072cd0d1a45. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:59:23.066485 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a9d93f88-7108-4f18-9a72-c3a8fb14943b tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:59:23.068876 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a9d93f88-7108-4f18-9a72-c3a8fb14943b tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: dddaf0e2-d63c-4c02-8cdd-8406759ee7f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:59:23.117399 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a9d93f88-7108-4f18-9a72-c3a8fb14943b tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.750985 Jun 20 12:59:23.118061 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3542/7185] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:59:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:59:23.128223 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2f6cf548-210b-40f0-bd94-5a3bf87a67db tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:59:23.128861 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2f6cf548-210b-40f0-bd94-5a3bf87a67db tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: dddaf0e2-d63c-4c02-8cdd-8406759ee7f6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:59:23.295638 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2f6cf548-210b-40f0-bd94-5a3bf87a67db tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e01b8e2cdf145c8b98b239c950b16ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cbcc7c9d0a479193999072cd0d1a45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:59:23.303881 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2f6cf548-210b-40f0-bd94-5a3bf87a67db tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "GET /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6" status: 200 len: 1262 microversion: 2.1 time: 0.179546 Jun 20 12:59:23.304709 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3644/7186] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:59:23 2022] GET /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6 => generated 1262 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:59:24.323767 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d15c94e9-4c3b-4c5f-8f52-348e3bc6ea49 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:59:24.326309 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d15c94e9-4c3b-4c5f-8f52-348e3bc6ea49 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: dddaf0e2-d63c-4c02-8cdd-8406759ee7f6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:59:24.334874 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d15c94e9-4c3b-4c5f-8f52-348e3bc6ea49 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:24.335884 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d15c94e9-4c3b-4c5f-8f52-348e3bc6ea49 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:24.337160 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d15c94e9-4c3b-4c5f-8f52-348e3bc6ea49 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:24.337879 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d15c94e9-4c3b-4c5f-8f52-348e3bc6ea49 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:24.428998 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d15c94e9-4c3b-4c5f-8f52-348e3bc6ea49 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e01b8e2cdf145c8b98b239c950b16ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cbcc7c9d0a479193999072cd0d1a45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:59:24.438361 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d15c94e9-4c3b-4c5f-8f52-348e3bc6ea49 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "GET /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6" status: 200 len: 1320 microversion: 2.1 time: 0.120311 Jun 20 12:59:24.439465 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3543/7187] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:59:24 2022] GET /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6 => generated 1320 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:59:25.456485 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-532de2d7-e420-4f98-bdd4-cf7c57e4ccb3 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:59:25.457098 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-532de2d7-e420-4f98-bdd4-cf7c57e4ccb3 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: dddaf0e2-d63c-4c02-8cdd-8406759ee7f6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:59:25.465077 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-532de2d7-e420-4f98-bdd4-cf7c57e4ccb3 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:25.465675 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-532de2d7-e420-4f98-bdd4-cf7c57e4ccb3 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:25.467036 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-532de2d7-e420-4f98-bdd4-cf7c57e4ccb3 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:25.467523 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-532de2d7-e420-4f98-bdd4-cf7c57e4ccb3 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:25.630203 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-532de2d7-e420-4f98-bdd4-cf7c57e4ccb3 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e01b8e2cdf145c8b98b239c950b16ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cbcc7c9d0a479193999072cd0d1a45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:59:25.643595 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-532de2d7-e420-4f98-bdd4-cf7c57e4ccb3 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "GET /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6" status: 200 len: 1362 microversion: 2.1 time: 0.191085 Jun 20 12:59:25.644953 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3645/7188] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:59:25 2022] GET /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:59:25.689869 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-613a26d1-6f38-4230-b38f-0cc7873faa0a req-ba9d7786-a459-414f-b63d-34579df95331 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dddaf0e2-d63c-4c02-8cdd-8406759ee7f6", "tag": "25a83a77-4b6e-424c-9168-4318a15682dd"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:59:25.700978 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-613a26d1-6f38-4230-b38f-0cc7873faa0a req-ba9d7786-a459-414f-b63d-34579df95331 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:25.701642 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-613a26d1-6f38-4230-b38f-0cc7873faa0a req-ba9d7786-a459-414f-b63d-34579df95331 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:25.714785 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-613a26d1-6f38-4230-b38f-0cc7873faa0a req-ba9d7786-a459-414f-b63d-34579df95331 service nova] Creating event network-changed:25a83a77-4b6e-424c-9168-4318a15682dd for instance dddaf0e2-d63c-4c02-8cdd-8406759ee7f6 on n-h1-master-1 Jun 20 12:59:25.743955 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-613a26d1-6f38-4230-b38f-0cc7873faa0a req-ba9d7786-a459-414f-b63d-34579df95331 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034311 Jun 20 12:59:25.746760 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3544/7189] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:59:26.662536 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7385b462-07a5-413d-9d78-76cba7ac8171 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:59:26.663111 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7385b462-07a5-413d-9d78-76cba7ac8171 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: dddaf0e2-d63c-4c02-8cdd-8406759ee7f6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:59:26.671041 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7385b462-07a5-413d-9d78-76cba7ac8171 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:26.671464 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7385b462-07a5-413d-9d78-76cba7ac8171 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:26.672266 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7385b462-07a5-413d-9d78-76cba7ac8171 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:26.672708 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7385b462-07a5-413d-9d78-76cba7ac8171 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:26.813186 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7385b462-07a5-413d-9d78-76cba7ac8171 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e01b8e2cdf145c8b98b239c950b16ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cbcc7c9d0a479193999072cd0d1a45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:59:26.821048 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7385b462-07a5-413d-9d78-76cba7ac8171 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "GET /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6" status: 200 len: 1362 microversion: 2.1 time: 0.162741 Jun 20 12:59:26.821630 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3646/7190] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:59:26 2022] GET /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:59:27.840368 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ba461c2d-72ad-4516-b45b-1a7b2e3c3a24 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:59:27.841090 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ba461c2d-72ad-4516-b45b-1a7b2e3c3a24 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: dddaf0e2-d63c-4c02-8cdd-8406759ee7f6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:59:27.848073 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba461c2d-72ad-4516-b45b-1a7b2e3c3a24 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:27.848574 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba461c2d-72ad-4516-b45b-1a7b2e3c3a24 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:27.849394 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba461c2d-72ad-4516-b45b-1a7b2e3c3a24 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:27.849844 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba461c2d-72ad-4516-b45b-1a7b2e3c3a24 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:27.987797 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ba461c2d-72ad-4516-b45b-1a7b2e3c3a24 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e01b8e2cdf145c8b98b239c950b16ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cbcc7c9d0a479193999072cd0d1a45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:59:27.995747 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ba461c2d-72ad-4516-b45b-1a7b2e3c3a24 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "GET /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6" status: 200 len: 1362 microversion: 2.1 time: 0.160625 Jun 20 12:59:27.996724 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3545/7191] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:59:27 2022] GET /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:59:29.017282 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-269f1a18-26a8-4ee1-a06c-df1fa1538bb2 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:59:29.017904 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-269f1a18-26a8-4ee1-a06c-df1fa1538bb2 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: dddaf0e2-d63c-4c02-8cdd-8406759ee7f6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:59:29.025356 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-269f1a18-26a8-4ee1-a06c-df1fa1538bb2 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:29.026011 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-269f1a18-26a8-4ee1-a06c-df1fa1538bb2 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:29.026848 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-269f1a18-26a8-4ee1-a06c-df1fa1538bb2 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:29.027294 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-269f1a18-26a8-4ee1-a06c-df1fa1538bb2 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:29.169741 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-269f1a18-26a8-4ee1-a06c-df1fa1538bb2 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e01b8e2cdf145c8b98b239c950b16ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cbcc7c9d0a479193999072cd0d1a45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:59:29.177612 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-269f1a18-26a8-4ee1-a06c-df1fa1538bb2 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "GET /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6" status: 200 len: 1362 microversion: 2.1 time: 0.164969 Jun 20 12:59:29.178185 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3647/7192] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:59:29 2022] GET /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:59:29.736084 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-d6f26514-4d86-4067-8ac6-f1cb15f093d8 req-8a2e0f64-654a-4f2c-85a4-fdd45349f182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dddaf0e2-d63c-4c02-8cdd-8406759ee7f6", "name": "network-vif-plugged", "status": "completed", "tag": "25a83a77-4b6e-424c-9168-4318a15682dd"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:59:29.745067 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-d6f26514-4d86-4067-8ac6-f1cb15f093d8 req-8a2e0f64-654a-4f2c-85a4-fdd45349f182 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:29.745543 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-d6f26514-4d86-4067-8ac6-f1cb15f093d8 req-8a2e0f64-654a-4f2c-85a4-fdd45349f182 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:29.757961 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-d6f26514-4d86-4067-8ac6-f1cb15f093d8 req-8a2e0f64-654a-4f2c-85a4-fdd45349f182 service nova] Creating event network-vif-plugged:25a83a77-4b6e-424c-9168-4318a15682dd for instance dddaf0e2-d63c-4c02-8cdd-8406759ee7f6 on n-h1-master-1 Jun 20 12:59:29.763037 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-d6f26514-4d86-4067-8ac6-f1cb15f093d8 req-8a2e0f64-654a-4f2c-85a4-fdd45349f182 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031251 Jun 20 12:59:29.763830 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3546/7193] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:59:30.195410 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-afd03aa4-f0c8-4f96-9220-5fe92335d847 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:59:30.196004 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-afd03aa4-f0c8-4f96-9220-5fe92335d847 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: dddaf0e2-d63c-4c02-8cdd-8406759ee7f6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:59:30.203754 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-afd03aa4-f0c8-4f96-9220-5fe92335d847 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:30.204236 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-afd03aa4-f0c8-4f96-9220-5fe92335d847 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:30.205009 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-afd03aa4-f0c8-4f96-9220-5fe92335d847 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:30.205509 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-afd03aa4-f0c8-4f96-9220-5fe92335d847 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:30.339436 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-afd03aa4-f0c8-4f96-9220-5fe92335d847 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e01b8e2cdf145c8b98b239c950b16ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cbcc7c9d0a479193999072cd0d1a45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:59:30.347612 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-afd03aa4-f0c8-4f96-9220-5fe92335d847 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "GET /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6" status: 200 len: 1362 microversion: 2.1 time: 0.156275 Jun 20 12:59:30.348246 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3648/7194] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:59:30 2022] GET /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:59:31.366882 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-42986a93-8057-41aa-8145-b16745ba1dca tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:59:31.367618 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-42986a93-8057-41aa-8145-b16745ba1dca tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: dddaf0e2-d63c-4c02-8cdd-8406759ee7f6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:59:31.374532 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-42986a93-8057-41aa-8145-b16745ba1dca tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:31.374992 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-42986a93-8057-41aa-8145-b16745ba1dca tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:31.375780 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-42986a93-8057-41aa-8145-b16745ba1dca tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:31.376236 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-42986a93-8057-41aa-8145-b16745ba1dca tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:31.517993 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-42986a93-8057-41aa-8145-b16745ba1dca tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e01b8e2cdf145c8b98b239c950b16ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cbcc7c9d0a479193999072cd0d1a45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:59:31.526154 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-42986a93-8057-41aa-8145-b16745ba1dca tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "GET /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6" status: 200 len: 1555 microversion: 2.1 time: 0.164640 Jun 20 12:59:31.526738 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3547/7195] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:59:31 2022] GET /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6 => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:59:31.542747 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5acf96fa-60ff-42aa-ba18-3a9863a67c31 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:59:31.543336 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5acf96fa-60ff-42aa-ba18-3a9863a67c31 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: dddaf0e2-d63c-4c02-8cdd-8406759ee7f6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:59:31.550922 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5acf96fa-60ff-42aa-ba18-3a9863a67c31 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:31.551306 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5acf96fa-60ff-42aa-ba18-3a9863a67c31 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:31.552077 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5acf96fa-60ff-42aa-ba18-3a9863a67c31 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:31.552551 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5acf96fa-60ff-42aa-ba18-3a9863a67c31 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:31.686558 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5acf96fa-60ff-42aa-ba18-3a9863a67c31 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e01b8e2cdf145c8b98b239c950b16ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cbcc7c9d0a479193999072cd0d1a45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:59:31.694627 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5acf96fa-60ff-42aa-ba18-3a9863a67c31 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "GET /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6" status: 200 len: 1555 microversion: 2.1 time: 0.155791 Jun 20 12:59:31.695216 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3649/7196] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:59:31 2022] GET /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:59:32.057191 n-d-master-1 devstack@n-api.service[119127]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 12:59:32.057407 n-d-master-1 devstack@n-api.service[119127]: Mon Jun 20 12:59:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 12:59:33.329307 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-89ee2762-0781-4e9b-892f-b7dcc5b49401 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14aae1de-6e7e-4482-b723-6e88cb5d99b2"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:59:33.330470 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-89ee2762-0781-4e9b-892f-b7dcc5b49401 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: dddaf0e2-d63c-4c02-8cdd-8406759ee7f6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:59:33.333431 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:59:33.334140 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:59:33.340126 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-89ee2762-0781-4e9b-892f-b7dcc5b49401 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:33.340614 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-89ee2762-0781-4e9b-892f-b7dcc5b49401 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:33.341433 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-89ee2762-0781-4e9b-892f-b7dcc5b49401 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:33.341886 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-89ee2762-0781-4e9b-892f-b7dcc5b49401 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:33.606224 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-89ee2762-0781-4e9b-892f-b7dcc5b49401 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "POST /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281467 Jun 20 12:59:33.606997 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3548/7197] 10.222.0.27 () {60 vars in 1322 bytes} [Mon Jun 20 12:59:33 2022] POST /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:59:44.277389 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-14353d1d-a1e9-47ec-af53-169055904240 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:59:44.277988 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-14353d1d-a1e9-47ec-af53-169055904240 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: dddaf0e2-d63c-4c02-8cdd-8406759ee7f6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:59:44.281009 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:59:44.281748 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:59:44.282427 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=30 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:59:44.292989 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-14353d1d-a1e9-47ec-af53-169055904240 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:44.293474 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-14353d1d-a1e9-47ec-af53-169055904240 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:44.294424 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-14353d1d-a1e9-47ec-af53-169055904240 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:44.294922 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-14353d1d-a1e9-47ec-af53-169055904240 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:44.379575 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-14353d1d-a1e9-47ec-af53-169055904240 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lazy-loading 'services' on Instance uuid dddaf0e2-d63c-4c02-8cdd-8406759ee7f6 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:59:44.465336 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-14353d1d-a1e9-47ec-af53-169055904240 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6/os-volume_attachments/14aae1de-6e7e-4482-b723-6e88cb5d99b2" status: 202 len: 0 microversion: 2.1 time: 0.191540 Jun 20 12:59:44.466736 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3650/7198] 10.222.0.27 () {58 vars in 1415 bytes} [Mon Jun 20 12:59:44 2022] DELETE /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6/os-volume_attachments/14aae1de-6e7e-4482-b723-6e88cb5d99b2 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:59:44.474593 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:59:44.476058 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:59:44.480475 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a3545c49-b1ed-4837-9796-69a3afcbe9e4 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:59:44.481546 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a3545c49-b1ed-4837-9796-69a3afcbe9e4 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: dddaf0e2-d63c-4c02-8cdd-8406759ee7f6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:59:44.491555 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3545c49-b1ed-4837-9796-69a3afcbe9e4 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:44.492023 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3545c49-b1ed-4837-9796-69a3afcbe9e4 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:44.492851 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3545c49-b1ed-4837-9796-69a3afcbe9e4 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:44.493307 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3545c49-b1ed-4837-9796-69a3afcbe9e4 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:44.532320 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a3545c49-b1ed-4837-9796-69a3afcbe9e4 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "GET /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059896 Jun 20 12:59:44.535092 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3549/7199] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:59:44 2022] GET /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:59:45.546590 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-df80f13e-8715-4702-88d5-527f373c85c8 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:59:45.547699 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-df80f13e-8715-4702-88d5-527f373c85c8 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: dddaf0e2-d63c-4c02-8cdd-8406759ee7f6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:59:45.554618 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df80f13e-8715-4702-88d5-527f373c85c8 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:45.555091 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df80f13e-8715-4702-88d5-527f373c85c8 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:45.555867 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df80f13e-8715-4702-88d5-527f373c85c8 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:45.556337 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df80f13e-8715-4702-88d5-527f373c85c8 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:45.587695 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-df80f13e-8715-4702-88d5-527f373c85c8 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "GET /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046481 Jun 20 12:59:45.588502 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3651/7200] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:59:45 2022] GET /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:59:46.599545 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-47561689-1de4-4ae7-b9ad-e96978159d04 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:59:46.600553 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-47561689-1de4-4ae7-b9ad-e96978159d04 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: dddaf0e2-d63c-4c02-8cdd-8406759ee7f6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:59:46.608052 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-47561689-1de4-4ae7-b9ad-e96978159d04 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:46.608549 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-47561689-1de4-4ae7-b9ad-e96978159d04 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:46.609333 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-47561689-1de4-4ae7-b9ad-e96978159d04 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:46.609781 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-47561689-1de4-4ae7-b9ad-e96978159d04 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:46.641139 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-47561689-1de4-4ae7-b9ad-e96978159d04 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "GET /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045716 Jun 20 12:59:46.641725 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3550/7201] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:59:46 2022] GET /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:59:47.652728 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3f171011-9431-4963-b6b3-9640d2dad62a tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:59:47.653604 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3f171011-9431-4963-b6b3-9640d2dad62a tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: dddaf0e2-d63c-4c02-8cdd-8406759ee7f6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:59:47.661080 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3f171011-9431-4963-b6b3-9640d2dad62a tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:47.661538 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3f171011-9431-4963-b6b3-9640d2dad62a tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:47.662333 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3f171011-9431-4963-b6b3-9640d2dad62a tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:47.662773 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3f171011-9431-4963-b6b3-9640d2dad62a tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:47.695299 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3f171011-9431-4963-b6b3-9640d2dad62a tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "GET /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046699 Jun 20 12:59:47.695891 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3652/7202] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:59:47 2022] GET /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:59:48.706761 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-340631e7-5f10-463c-866e-fe992ef64586 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:59:48.707714 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-340631e7-5f10-463c-866e-fe992ef64586 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: dddaf0e2-d63c-4c02-8cdd-8406759ee7f6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:59:48.715133 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-340631e7-5f10-463c-866e-fe992ef64586 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:48.715509 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-340631e7-5f10-463c-866e-fe992ef64586 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:48.716547 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-340631e7-5f10-463c-866e-fe992ef64586 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:48.716852 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-340631e7-5f10-463c-866e-fe992ef64586 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:48.747677 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-340631e7-5f10-463c-866e-fe992ef64586 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "GET /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044800 Jun 20 12:59:48.748622 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3551/7203] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:59:48 2022] GET /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:59:49.759344 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3c5431a5-e29b-417a-94b5-ff406f676f86 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:59:49.760317 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3c5431a5-e29b-417a-94b5-ff406f676f86 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: dddaf0e2-d63c-4c02-8cdd-8406759ee7f6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:59:49.767797 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c5431a5-e29b-417a-94b5-ff406f676f86 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:49.768236 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c5431a5-e29b-417a-94b5-ff406f676f86 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:49.769085 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c5431a5-e29b-417a-94b5-ff406f676f86 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:49.769519 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c5431a5-e29b-417a-94b5-ff406f676f86 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:49.800083 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3c5431a5-e29b-417a-94b5-ff406f676f86 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "GET /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044722 Jun 20 12:59:49.800711 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3653/7204] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 12:59:49 2022] GET /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:59:49.811299 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b27c7b7a-2b54-47f2-a29a-53c710a98308 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:59:49.811839 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b27c7b7a-2b54-47f2-a29a-53c710a98308 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: dddaf0e2-d63c-4c02-8cdd-8406759ee7f6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:59:49.819404 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b27c7b7a-2b54-47f2-a29a-53c710a98308 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:49.819876 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b27c7b7a-2b54-47f2-a29a-53c710a98308 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:49.820704 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b27c7b7a-2b54-47f2-a29a-53c710a98308 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:49.821155 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b27c7b7a-2b54-47f2-a29a-53c710a98308 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:49.900125 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-b27c7b7a-2b54-47f2-a29a-53c710a98308 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] HTTP exception thrown: Instance dddaf0e2-d63c-4c02-8cdd-8406759ee7f6 is not attached to volume 14aae1de-6e7e-4482-b723-6e88cb5d99b2 Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b27c7b7a-2b54-47f2-a29a-53c710a98308 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Request method failure captured: Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6/os-volume_attachments/14aae1de-6e7e-4482-b723-6e88cb5d99b2 HTTP/1.1 Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisG8kywg0z_9TUDNhNYu2mADSJW0sUPOhjtttciYMigcAdfpkeu_qNVEVGFzO9jt-F_T6QYwk7TCpkUQ72-GxSjyRv9ugkZHUh6-nPjRZIYNs5j-hpD4QEWk3GnTG3SUIiySn5E5eGXOgCeqwhOw42DkdgV7juSsw__RPv2UwzWNp0Cw Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 08cbcc7c9d0a479193999072cd0d1a45 Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-TestEncryptedCinderVolumes-133287339 Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/08cbcc7c9d0a479193999072cd0d1a45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/08cbcc7c9d0a479193999072cd0d1a45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/08cbcc7c9d0a479193999072cd0d1a45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_08cbcc7c9d0a479193999072cd0d1a45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-TestEncryptedCinderVolumes-133287339 Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 08cbcc7c9d0a479193999072cd0d1a45 Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-133287339 Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-TestEncryptedCinderVolumes-133287339-project Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 3e01b8e2cdf145c8b98b239c950b16ee Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-TestEncryptedCinderVolumes-133287339-project Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: exception: Instance dddaf0e2-d63c-4c02-8cdd-8406759ee7f6 is not attached to volume 14aae1de-6e7e-4482-b723-6e88cb5d99b2 Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: action_args: {'server_id': 'dddaf0e2-d63c-4c02-8cdd-8406759ee7f6', 'id': '14aae1de-6e7e-4482-b723-6e88cb5d99b2'} Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 14aae1de-6e7e-4482-b723-6e88cb5d99b2. Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dddaf0e2-d63c-4c02-8cdd-8406759ee7f6 is not attached to volume 14aae1de-6e7e-4482-b723-6e88cb5d99b2 Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:59:49.908301 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:59:49.912151 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:59:49.912151 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:59:49.912151 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dddaf0e2-d63c-4c02-8cdd-8406759ee7f6 is not attached to volume 14aae1de-6e7e-4482-b723-6e88cb5d99b2 Jun 20 12:59:49.912151 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:59:49.912151 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b27c7b7a-2b54-47f2-a29a-53c710a98308 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Returning 404 to user: Instance dddaf0e2-d63c-4c02-8cdd-8406759ee7f6 is not attached to volume 14aae1de-6e7e-4482-b723-6e88cb5d99b2 {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:59:49.912151 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b27c7b7a-2b54-47f2-a29a-53c710a98308 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6/os-volume_attachments/14aae1de-6e7e-4482-b723-6e88cb5d99b2" status: 404 len: 154 microversion: 2.1 time: 0.103022 Jun 20 12:59:49.912151 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3552/7205] 10.222.0.27 () {58 vars in 1415 bytes} [Mon Jun 20 12:59:49 2022] DELETE /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6/os-volume_attachments/14aae1de-6e7e-4482-b723-6e88cb5d99b2 => generated 154 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:59:53.259427 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6ae2bc3f-655f-4252-8acf-5cbb29b538c3 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:59:53.259998 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6ae2bc3f-655f-4252-8acf-5cbb29b538c3 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: dddaf0e2-d63c-4c02-8cdd-8406759ee7f6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:59:53.267330 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6ae2bc3f-655f-4252-8acf-5cbb29b538c3 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:53.267780 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6ae2bc3f-655f-4252-8acf-5cbb29b538c3 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:53.268582 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6ae2bc3f-655f-4252-8acf-5cbb29b538c3 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:53.269016 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6ae2bc3f-655f-4252-8acf-5cbb29b538c3 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:53.295827 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6ae2bc3f-655f-4252-8acf-5cbb29b538c3 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: dddaf0e2-d63c-4c02-8cdd-8406759ee7f6] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:59:53.385373 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6ae2bc3f-655f-4252-8acf-5cbb29b538c3 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6" status: 204 len: 0 microversion: 2.1 time: 0.129585 Jun 20 12:59:53.386060 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3654/7206] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 12:59:53 2022] DELETE /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:59:53.394949 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f2c4335d-1b1b-4fad-910d-1e420325fd63 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:59:53.395569 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f2c4335d-1b1b-4fad-910d-1e420325fd63 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: dddaf0e2-d63c-4c02-8cdd-8406759ee7f6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:59:53.403529 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f2c4335d-1b1b-4fad-910d-1e420325fd63 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:53.403996 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f2c4335d-1b1b-4fad-910d-1e420325fd63 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:53.404843 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f2c4335d-1b1b-4fad-910d-1e420325fd63 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:53.405285 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f2c4335d-1b1b-4fad-910d-1e420325fd63 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:53.546481 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f2c4335d-1b1b-4fad-910d-1e420325fd63 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e01b8e2cdf145c8b98b239c950b16ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cbcc7c9d0a479193999072cd0d1a45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:59:53.554922 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f2c4335d-1b1b-4fad-910d-1e420325fd63 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "GET /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6" status: 200 len: 1561 microversion: 2.1 time: 0.163877 Jun 20 12:59:53.555487 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3553/7207] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:59:53 2022] GET /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:59:54.573870 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2355e23b-de8a-47d7-bf22-5bbb1ab61960 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:59:54.574567 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2355e23b-de8a-47d7-bf22-5bbb1ab61960 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: dddaf0e2-d63c-4c02-8cdd-8406759ee7f6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:59:54.582083 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2355e23b-de8a-47d7-bf22-5bbb1ab61960 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:54.582545 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2355e23b-de8a-47d7-bf22-5bbb1ab61960 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:54.583359 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2355e23b-de8a-47d7-bf22-5bbb1ab61960 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:54.583785 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2355e23b-de8a-47d7-bf22-5bbb1ab61960 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:54.724871 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2355e23b-de8a-47d7-bf22-5bbb1ab61960 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e01b8e2cdf145c8b98b239c950b16ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cbcc7c9d0a479193999072cd0d1a45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:59:54.733769 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2355e23b-de8a-47d7-bf22-5bbb1ab61960 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "GET /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6" status: 200 len: 1561 microversion: 2.1 time: 0.164473 Jun 20 12:59:54.734345 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3655/7208] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:59:54 2022] GET /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:59:55.707829 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-fa588732-1a6f-4bf5-bb5d-be24e570ec76 req-838af422-e26e-43e7-90aa-18d442679288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dddaf0e2-d63c-4c02-8cdd-8406759ee7f6", "name": "network-vif-deleted", "tag": "25a83a77-4b6e-424c-9168-4318a15682dd"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:59:55.714930 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-fa588732-1a6f-4bf5-bb5d-be24e570ec76 req-838af422-e26e-43e7-90aa-18d442679288 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:55.715686 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-fa588732-1a6f-4bf5-bb5d-be24e570ec76 req-838af422-e26e-43e7-90aa-18d442679288 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:55.727457 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-fa588732-1a6f-4bf5-bb5d-be24e570ec76 req-838af422-e26e-43e7-90aa-18d442679288 service nova] Creating event network-vif-deleted:25a83a77-4b6e-424c-9168-4318a15682dd for instance dddaf0e2-d63c-4c02-8cdd-8406759ee7f6 on n-h1-master-1 Jun 20 12:59:55.733577 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-fa588732-1a6f-4bf5-bb5d-be24e570ec76 req-838af422-e26e-43e7-90aa-18d442679288 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104573 Jun 20 12:59:55.734224 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3554/7209] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 12:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:59:55.751253 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c3e0b73b-9d95-4e8a-863d-9392b6dd4471 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:59:55.752036 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c3e0b73b-9d95-4e8a-863d-9392b6dd4471 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: dddaf0e2-d63c-4c02-8cdd-8406759ee7f6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:59:55.759339 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c3e0b73b-9d95-4e8a-863d-9392b6dd4471 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:55.759797 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c3e0b73b-9d95-4e8a-863d-9392b6dd4471 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:55.761218 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c3e0b73b-9d95-4e8a-863d-9392b6dd4471 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:55.761884 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c3e0b73b-9d95-4e8a-863d-9392b6dd4471 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:55.795916 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c3e0b73b-9d95-4e8a-863d-9392b6dd4471 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:55.796398 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c3e0b73b-9d95-4e8a-863d-9392b6dd4471 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:55.796856 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-c3e0b73b-9d95-4e8a-863d-9392b6dd4471 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lazy-loading 'fault' on Instance uuid dddaf0e2-d63c-4c02-8cdd-8406759ee7f6 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:59:55.839607 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c3e0b73b-9d95-4e8a-863d-9392b6dd4471 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e01b8e2cdf145c8b98b239c950b16ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cbcc7c9d0a479193999072cd0d1a45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:59:55.848232 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c3e0b73b-9d95-4e8a-863d-9392b6dd4471 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "GET /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6" status: 200 len: 1352 microversion: 2.1 time: 0.101058 Jun 20 12:59:55.848760 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3656/7210] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:59:55 2022] GET /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6 => generated 1352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:59:56.867322 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9bfc9a2c-6dc9-404b-b391-d8c5f280238f tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:59:56.868068 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9bfc9a2c-6dc9-404b-b391-d8c5f280238f tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: dddaf0e2-d63c-4c02-8cdd-8406759ee7f6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:59:56.876555 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9bfc9a2c-6dc9-404b-b391-d8c5f280238f tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:56.877190 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9bfc9a2c-6dc9-404b-b391-d8c5f280238f tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:56.878315 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9bfc9a2c-6dc9-404b-b391-d8c5f280238f tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:56.878964 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9bfc9a2c-6dc9-404b-b391-d8c5f280238f tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:56.895742 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-9bfc9a2c-6dc9-404b-b391-d8c5f280238f tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] HTTP exception thrown: Instance dddaf0e2-d63c-4c02-8cdd-8406759ee7f6 could not be found. Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9bfc9a2c-6dc9-404b-b391-d8c5f280238f tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Request method failure captured: Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6 HTTP/1.1 Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisG8kywg0z_9TUDNhNYu2mADSJW0sUPOhjtttciYMigcAdfpkeu_qNVEVGFzO9jt-F_T6QYwk7TCpkUQ72-GxSjyRv9ugkZHUh6-nPjRZIYNs5j-hpD4QEWk3GnTG3SUIiySn5E5eGXOgCeqwhOw42DkdgV7juSsw__RPv2UwzWNp0Cw Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 08cbcc7c9d0a479193999072cd0d1a45 Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-TestEncryptedCinderVolumes-133287339 Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/08cbcc7c9d0a479193999072cd0d1a45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/08cbcc7c9d0a479193999072cd0d1a45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/08cbcc7c9d0a479193999072cd0d1a45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_08cbcc7c9d0a479193999072cd0d1a45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-TestEncryptedCinderVolumes-133287339 Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 08cbcc7c9d0a479193999072cd0d1a45 Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-133287339 Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-TestEncryptedCinderVolumes-133287339-project Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 3e01b8e2cdf145c8b98b239c950b16ee Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-TestEncryptedCinderVolumes-133287339-project Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: exception: Instance dddaf0e2-d63c-4c02-8cdd-8406759ee7f6 could not be found. Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'dddaf0e2-d63c-4c02-8cdd-8406759ee7f6'} Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dddaf0e2-d63c-4c02-8cdd-8406759ee7f6 could not be found. Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dddaf0e2-d63c-4c02-8cdd-8406759ee7f6 could not be found. Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:59:56.897460 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:59:56.904580 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:59:56.904580 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:59:56.904580 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:59:56.904580 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:59:56.904580 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:59:56.904580 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dddaf0e2-d63c-4c02-8cdd-8406759ee7f6 could not be found. Jun 20 12:59:56.904580 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 12:59:56.904580 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9bfc9a2c-6dc9-404b-b391-d8c5f280238f tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Returning 404 to user: Instance dddaf0e2-d63c-4c02-8cdd-8406759ee7f6 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:59:56.904580 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9bfc9a2c-6dc9-404b-b391-d8c5f280238f tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "GET /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6" status: 404 len: 111 microversion: 2.1 time: 0.036887 Jun 20 12:59:56.904580 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3555/7211] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:59:56 2022] GET /compute/v2.1/servers/dddaf0e2-d63c-4c02-8cdd-8406759ee7f6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:59:56.908230 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-182de956-e28d-4506-92a3-79cf5f067f6a tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '.version_select at 0x7f60721264c0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:59:56.930326 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-182de956-e28d-4506-92a3-79cf5f067f6a tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1642489770" status: 202 len: 0 microversion: 2.1 time: 0.026044 Jun 20 12:59:56.930923 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3657/7212] 10.222.0.27 () {58 vars in 1277 bytes} [Mon Jun 20 12:59:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1642489770 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 12:59:56.952193 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fddcced7-c15e-456a-8964-12abab0f3158 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Action: 'create', calling method: .version_select at 0x7f6073f588b0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-2117887546", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKsYd+JodwqNaUzuO57XHVVf0MTyP8eOMrgtahUmf1WzM5Nx17anU+JfUSVNP7/nQv6nW6+esEXGdbF/FhnM0l/LxqueBvYMj4El4HCbgEg6pvwMv4hgKp/mwklGwYsXg=="}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:59:56.967932 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-fddcced7-c15e-456a-8964-12abab0f3158 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Getting quotas for project 08cbcc7c9d0a479193999072cd0d1a45. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:59:56.978120 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-fddcced7-c15e-456a-8964-12abab0f3158 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Getting quotas for user 3e01b8e2cdf145c8b98b239c950b16ee and project 08cbcc7c9d0a479193999072cd0d1a45. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:59:57.009650 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fddcced7-c15e-456a-8964-12abab0f3158 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.061480 Jun 20 12:59:57.010300 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3556/7213] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 12:59:56 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:59:57.060371 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dc6d3bb9-9ef9-42f2-bb0d-2e7503d0ce89 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1611225761", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-2117887546", "networks": [{"uuid": "298a84c7-86e8-49f5-8d85-5e0066984fc0"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:59:57.113158 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-dc6d3bb9-9ef9-42f2-bb0d-2e7503d0ce89 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] validate_networks() for [('298a84c7-86e8-49f5-8d85-5e0066984fc0', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:59:57.506970 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-dc6d3bb9-9ef9-42f2-bb0d-2e7503d0ce89 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:59:57.507606 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-dc6d3bb9-9ef9-42f2-bb0d-2e7503d0ce89 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:59:57.508395 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-dc6d3bb9-9ef9-42f2-bb0d-2e7503d0ce89 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:59:57.509001 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-dc6d3bb9-9ef9-42f2-bb0d-2e7503d0ce89 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:59:57.509621 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-dc6d3bb9-9ef9-42f2-bb0d-2e7503d0ce89 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:59:57.520110 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc6d3bb9-9ef9-42f2-bb0d-2e7503d0ce89 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:57.520604 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc6d3bb9-9ef9-42f2-bb0d-2e7503d0ce89 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:57.521413 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc6d3bb9-9ef9-42f2-bb0d-2e7503d0ce89 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:57.521861 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc6d3bb9-9ef9-42f2-bb0d-2e7503d0ce89 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:57.539135 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-dc6d3bb9-9ef9-42f2-bb0d-2e7503d0ce89 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Getting quotas for project 08cbcc7c9d0a479193999072cd0d1a45. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:59:57.545199 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-dc6d3bb9-9ef9-42f2-bb0d-2e7503d0ce89 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Getting quotas for user 3e01b8e2cdf145c8b98b239c950b16ee and project 08cbcc7c9d0a479193999072cd0d1a45. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:59:57.558081 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dc6d3bb9-9ef9-42f2-bb0d-2e7503d0ce89 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:59:57.560928 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dc6d3bb9-9ef9-42f2-bb0d-2e7503d0ce89 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: 76963b52-ac6c-4d05-aebc-3fb38e1aeade] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:59:57.609314 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dc6d3bb9-9ef9-42f2-bb0d-2e7503d0ce89 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.553214 Jun 20 12:59:57.609954 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3658/7214] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 12:59:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:59:57.620221 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1da366da-fb78-439d-a815-27ed4ba3b241 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:59:57.620853 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1da366da-fb78-439d-a815-27ed4ba3b241 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: 76963b52-ac6c-4d05-aebc-3fb38e1aeade] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:59:57.680243 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1da366da-fb78-439d-a815-27ed4ba3b241 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e01b8e2cdf145c8b98b239c950b16ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cbcc7c9d0a479193999072cd0d1a45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:59:57.687948 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1da366da-fb78-439d-a815-27ed4ba3b241 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "GET /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade" status: 200 len: 1263 microversion: 2.1 time: 0.071661 Jun 20 12:59:57.688636 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3557/7215] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:59:57 2022] GET /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade => generated 1263 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:59:58.706033 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2b662f68-7720-44fc-b628-4fe8db495fbf tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:59:58.706655 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2b662f68-7720-44fc-b628-4fe8db495fbf tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: 76963b52-ac6c-4d05-aebc-3fb38e1aeade] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:59:58.714244 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2b662f68-7720-44fc-b628-4fe8db495fbf tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:58.714684 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2b662f68-7720-44fc-b628-4fe8db495fbf tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:58.715550 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2b662f68-7720-44fc-b628-4fe8db495fbf tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:58.715955 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2b662f68-7720-44fc-b628-4fe8db495fbf tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:58.780034 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2b662f68-7720-44fc-b628-4fe8db495fbf tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e01b8e2cdf145c8b98b239c950b16ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cbcc7c9d0a479193999072cd0d1a45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:59:58.788138 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2b662f68-7720-44fc-b628-4fe8db495fbf tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "GET /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade" status: 200 len: 1321 microversion: 2.1 time: 0.086985 Jun 20 12:59:58.788850 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3659/7216] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:59:58 2022] GET /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade => generated 1321 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:59:59.806263 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-70b9b29d-2365-4417-96f8-9afa676a1cc8 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:59:59.807469 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-70b9b29d-2365-4417-96f8-9afa676a1cc8 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: 76963b52-ac6c-4d05-aebc-3fb38e1aeade] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:59:59.816121 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-70b9b29d-2365-4417-96f8-9afa676a1cc8 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:59.816967 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-70b9b29d-2365-4417-96f8-9afa676a1cc8 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:59:59.818013 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-70b9b29d-2365-4417-96f8-9afa676a1cc8 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:59:59.818519 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-70b9b29d-2365-4417-96f8-9afa676a1cc8 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:00.021357 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-70b9b29d-2365-4417-96f8-9afa676a1cc8 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e01b8e2cdf145c8b98b239c950b16ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cbcc7c9d0a479193999072cd0d1a45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:00:00.029829 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-70b9b29d-2365-4417-96f8-9afa676a1cc8 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "GET /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade" status: 200 len: 1363 microversion: 2.1 time: 0.227620 Jun 20 13:00:00.030450 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3558/7217] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 12:59:59 2022] GET /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:00:00.070988 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-8bc5e193-80ea-4ed9-bb5d-7fb86e4b09f0 req-fe4c620e-6ecf-44e8-aea3-c3dd78f352ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76963b52-ac6c-4d05-aebc-3fb38e1aeade", "tag": "b9f50333-22f1-4beb-864d-2016e095dc07"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:00:00.105027 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-8bc5e193-80ea-4ed9-bb5d-7fb86e4b09f0 req-fe4c620e-6ecf-44e8-aea3-c3dd78f352ff service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:00.105538 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-8bc5e193-80ea-4ed9-bb5d-7fb86e4b09f0 req-fe4c620e-6ecf-44e8-aea3-c3dd78f352ff service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:00.123509 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-8bc5e193-80ea-4ed9-bb5d-7fb86e4b09f0 req-fe4c620e-6ecf-44e8-aea3-c3dd78f352ff service nova] Creating event network-changed:b9f50333-22f1-4beb-864d-2016e095dc07 for instance 76963b52-ac6c-4d05-aebc-3fb38e1aeade on n-h1-master-1 Jun 20 13:00:00.129192 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-8bc5e193-80ea-4ed9-bb5d-7fb86e4b09f0 req-fe4c620e-6ecf-44e8-aea3-c3dd78f352ff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061972 Jun 20 13:00:00.130404 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3660/7218] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:00:01.047915 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f08b6ca7-52cd-4273-aef9-329562c29a92 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:00:01.048575 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f08b6ca7-52cd-4273-aef9-329562c29a92 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: 76963b52-ac6c-4d05-aebc-3fb38e1aeade] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:00:01.056103 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f08b6ca7-52cd-4273-aef9-329562c29a92 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:01.056600 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f08b6ca7-52cd-4273-aef9-329562c29a92 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:01.057378 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f08b6ca7-52cd-4273-aef9-329562c29a92 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:01.057854 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f08b6ca7-52cd-4273-aef9-329562c29a92 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:01.193208 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f08b6ca7-52cd-4273-aef9-329562c29a92 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e01b8e2cdf145c8b98b239c950b16ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cbcc7c9d0a479193999072cd0d1a45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:00:01.201979 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f08b6ca7-52cd-4273-aef9-329562c29a92 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "GET /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade" status: 200 len: 1363 microversion: 2.1 time: 0.158623 Jun 20 13:00:01.202510 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3559/7219] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:00:01 2022] GET /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:00:02.219926 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f354b3f9-ff94-4965-b6df-093f633bda92 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:00:02.220681 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f354b3f9-ff94-4965-b6df-093f633bda92 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: 76963b52-ac6c-4d05-aebc-3fb38e1aeade] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:00:02.228758 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f354b3f9-ff94-4965-b6df-093f633bda92 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:02.229255 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f354b3f9-ff94-4965-b6df-093f633bda92 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:02.230030 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f354b3f9-ff94-4965-b6df-093f633bda92 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:02.230463 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f354b3f9-ff94-4965-b6df-093f633bda92 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:02.372577 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f354b3f9-ff94-4965-b6df-093f633bda92 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e01b8e2cdf145c8b98b239c950b16ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cbcc7c9d0a479193999072cd0d1a45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:00:02.380457 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f354b3f9-ff94-4965-b6df-093f633bda92 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "GET /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade" status: 200 len: 1363 microversion: 2.1 time: 0.164962 Jun 20 13:00:02.381048 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3661/7220] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:00:02 2022] GET /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:00:03.400518 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-17925f67-fe21-4ad1-8e01-d0fcdb08135c tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:00:03.402034 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-17925f67-fe21-4ad1-8e01-d0fcdb08135c tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: 76963b52-ac6c-4d05-aebc-3fb38e1aeade] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:00:03.410067 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-17925f67-fe21-4ad1-8e01-d0fcdb08135c tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:03.410894 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-17925f67-fe21-4ad1-8e01-d0fcdb08135c tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:03.412075 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-17925f67-fe21-4ad1-8e01-d0fcdb08135c tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:03.412802 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-17925f67-fe21-4ad1-8e01-d0fcdb08135c tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:03.562888 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-17925f67-fe21-4ad1-8e01-d0fcdb08135c tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e01b8e2cdf145c8b98b239c950b16ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cbcc7c9d0a479193999072cd0d1a45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:00:03.571351 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-17925f67-fe21-4ad1-8e01-d0fcdb08135c tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "GET /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade" status: 200 len: 1363 microversion: 2.1 time: 0.176064 Jun 20 13:00:03.571917 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3560/7221] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:00:03 2022] GET /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:00:03.977122 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-b1b5cdbe-291d-4904-a313-6fd0777fc431 req-97d7ec72-9752-4f5d-b0de-934bb5afc7ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76963b52-ac6c-4d05-aebc-3fb38e1aeade", "name": "network-vif-plugged", "status": "completed", "tag": "b9f50333-22f1-4beb-864d-2016e095dc07"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:00:03.985719 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b1b5cdbe-291d-4904-a313-6fd0777fc431 req-97d7ec72-9752-4f5d-b0de-934bb5afc7ee service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:03.986186 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b1b5cdbe-291d-4904-a313-6fd0777fc431 req-97d7ec72-9752-4f5d-b0de-934bb5afc7ee service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:03.997594 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-b1b5cdbe-291d-4904-a313-6fd0777fc431 req-97d7ec72-9752-4f5d-b0de-934bb5afc7ee service nova] Creating event network-vif-plugged:b9f50333-22f1-4beb-864d-2016e095dc07 for instance 76963b52-ac6c-4d05-aebc-3fb38e1aeade on n-h1-master-1 Jun 20 13:00:04.002395 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-b1b5cdbe-291d-4904-a313-6fd0777fc431 req-97d7ec72-9752-4f5d-b0de-934bb5afc7ee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088210 Jun 20 13:00:04.003033 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3662/7222] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:00:04.592523 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9e20c432-ff2c-4b9c-94e1-88a54a0d2c38 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:00:04.593163 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9e20c432-ff2c-4b9c-94e1-88a54a0d2c38 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: 76963b52-ac6c-4d05-aebc-3fb38e1aeade] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:00:04.600736 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9e20c432-ff2c-4b9c-94e1-88a54a0d2c38 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:04.601104 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9e20c432-ff2c-4b9c-94e1-88a54a0d2c38 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:04.601895 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9e20c432-ff2c-4b9c-94e1-88a54a0d2c38 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:04.602348 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9e20c432-ff2c-4b9c-94e1-88a54a0d2c38 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:04.737103 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9e20c432-ff2c-4b9c-94e1-88a54a0d2c38 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e01b8e2cdf145c8b98b239c950b16ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cbcc7c9d0a479193999072cd0d1a45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:00:04.744920 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9e20c432-ff2c-4b9c-94e1-88a54a0d2c38 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "GET /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade" status: 200 len: 1363 microversion: 2.1 time: 0.159297 Jun 20 13:00:04.745496 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3561/7223] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:00:04 2022] GET /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:00:05.765966 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cedfd04c-ee8e-4b3b-9563-e7270c5c1a0d tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:00:05.766661 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cedfd04c-ee8e-4b3b-9563-e7270c5c1a0d tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: 76963b52-ac6c-4d05-aebc-3fb38e1aeade] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:00:05.773674 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cedfd04c-ee8e-4b3b-9563-e7270c5c1a0d tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:05.774130 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cedfd04c-ee8e-4b3b-9563-e7270c5c1a0d tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:05.774899 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cedfd04c-ee8e-4b3b-9563-e7270c5c1a0d tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:05.775338 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cedfd04c-ee8e-4b3b-9563-e7270c5c1a0d tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:05.921310 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cedfd04c-ee8e-4b3b-9563-e7270c5c1a0d tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e01b8e2cdf145c8b98b239c950b16ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cbcc7c9d0a479193999072cd0d1a45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:00:05.929197 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cedfd04c-ee8e-4b3b-9563-e7270c5c1a0d tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "GET /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade" status: 200 len: 1556 microversion: 2.1 time: 0.169940 Jun 20 13:00:05.929787 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3663/7224] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:00:05 2022] GET /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade => generated 1556 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:00:05.946639 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-50176464-925d-4027-9084-9b276e23cdff tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:00:05.947294 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-50176464-925d-4027-9084-9b276e23cdff tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: 76963b52-ac6c-4d05-aebc-3fb38e1aeade] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:00:05.957767 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-50176464-925d-4027-9084-9b276e23cdff tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:05.958459 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-50176464-925d-4027-9084-9b276e23cdff tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:05.959626 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-50176464-925d-4027-9084-9b276e23cdff tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:05.960292 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-50176464-925d-4027-9084-9b276e23cdff tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:06.110299 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-50176464-925d-4027-9084-9b276e23cdff tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e01b8e2cdf145c8b98b239c950b16ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cbcc7c9d0a479193999072cd0d1a45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:00:06.125503 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-50176464-925d-4027-9084-9b276e23cdff tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "GET /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade" status: 200 len: 1556 microversion: 2.1 time: 0.175583 Jun 20 13:00:06.125503 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3562/7225] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:00:05 2022] GET /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade => generated 1556 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:00:07.616293 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f9ad0c2f-4768-4ea7-954c-d7562af8d2a0 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63643c1a-1069-4bdc-a4cb-4dbf98e08b97"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:00:07.617363 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f9ad0c2f-4768-4ea7-954c-d7562af8d2a0 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: 76963b52-ac6c-4d05-aebc-3fb38e1aeade] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:00:07.620313 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:00:07.620988 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:00:07.627373 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9ad0c2f-4768-4ea7-954c-d7562af8d2a0 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:07.627848 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9ad0c2f-4768-4ea7-954c-d7562af8d2a0 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:07.628667 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9ad0c2f-4768-4ea7-954c-d7562af8d2a0 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:07.629104 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9ad0c2f-4768-4ea7-954c-d7562af8d2a0 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:07.908976 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f9ad0c2f-4768-4ea7-954c-d7562af8d2a0 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "POST /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296363 Jun 20 13:00:07.909636 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3664/7226] 10.222.0.27 () {60 vars in 1322 bytes} [Mon Jun 20 13:00:07 2022] POST /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:00:18.639474 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-76186e9d-0c44-4812-9c71-bb480fa62a5a tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:00:18.640136 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-76186e9d-0c44-4812-9c71-bb480fa62a5a tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: 76963b52-ac6c-4d05-aebc-3fb38e1aeade] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:00:18.642265 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:00:18.643096 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:00:18.643792 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=64 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:00:18.650680 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-76186e9d-0c44-4812-9c71-bb480fa62a5a tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:18.651149 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-76186e9d-0c44-4812-9c71-bb480fa62a5a tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:18.651930 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-76186e9d-0c44-4812-9c71-bb480fa62a5a tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:18.652431 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-76186e9d-0c44-4812-9c71-bb480fa62a5a tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:18.737620 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-76186e9d-0c44-4812-9c71-bb480fa62a5a tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lazy-loading 'services' on Instance uuid 76963b52-ac6c-4d05-aebc-3fb38e1aeade {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 13:00:18.817591 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-76186e9d-0c44-4812-9c71-bb480fa62a5a tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "DELETE /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade/os-volume_attachments/63643c1a-1069-4bdc-a4cb-4dbf98e08b97" status: 202 len: 0 microversion: 2.1 time: 0.182262 Jun 20 13:00:18.818315 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3563/7227] 10.222.0.27 () {58 vars in 1415 bytes} [Mon Jun 20 13:00:18 2022] DELETE /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade/os-volume_attachments/63643c1a-1069-4bdc-a4cb-4dbf98e08b97 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 13:00:18.825118 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:00:18.826564 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:00:18.831479 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c7e4eb30-1230-4308-a36b-b4656ba1f5c9 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:00:18.832762 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c7e4eb30-1230-4308-a36b-b4656ba1f5c9 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: 76963b52-ac6c-4d05-aebc-3fb38e1aeade] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:00:18.840779 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c7e4eb30-1230-4308-a36b-b4656ba1f5c9 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:18.841188 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c7e4eb30-1230-4308-a36b-b4656ba1f5c9 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:18.841973 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c7e4eb30-1230-4308-a36b-b4656ba1f5c9 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:18.842415 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c7e4eb30-1230-4308-a36b-b4656ba1f5c9 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:18.882229 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c7e4eb30-1230-4308-a36b-b4656ba1f5c9 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "GET /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059162 Jun 20 13:00:18.886426 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3665/7228] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 13:00:18 2022] GET /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:00:19.896090 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e617d632-e033-4036-b6e7-a8a329ab1ef4 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:00:19.897302 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e617d632-e033-4036-b6e7-a8a329ab1ef4 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: 76963b52-ac6c-4d05-aebc-3fb38e1aeade] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:00:19.904478 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e617d632-e033-4036-b6e7-a8a329ab1ef4 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:19.904968 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e617d632-e033-4036-b6e7-a8a329ab1ef4 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:19.905998 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e617d632-e033-4036-b6e7-a8a329ab1ef4 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:19.906517 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e617d632-e033-4036-b6e7-a8a329ab1ef4 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:19.938327 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e617d632-e033-4036-b6e7-a8a329ab1ef4 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "GET /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047486 Jun 20 13:00:19.938901 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3564/7229] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 13:00:19 2022] GET /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:00:20.950666 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-580cc008-d3cc-41ec-9008-559f3578fee4 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:00:20.951624 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-580cc008-d3cc-41ec-9008-559f3578fee4 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: 76963b52-ac6c-4d05-aebc-3fb38e1aeade] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:00:20.959949 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-580cc008-d3cc-41ec-9008-559f3578fee4 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:20.960431 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-580cc008-d3cc-41ec-9008-559f3578fee4 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:20.961206 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-580cc008-d3cc-41ec-9008-559f3578fee4 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:20.961636 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-580cc008-d3cc-41ec-9008-559f3578fee4 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:20.993761 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-580cc008-d3cc-41ec-9008-559f3578fee4 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "GET /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047262 Jun 20 13:00:20.994377 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3666/7230] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 13:00:20 2022] GET /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:00:22.010847 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1c541692-3ac5-4d31-9de1-97af129be4de tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:00:22.011801 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1c541692-3ac5-4d31-9de1-97af129be4de tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: 76963b52-ac6c-4d05-aebc-3fb38e1aeade] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:00:22.019632 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1c541692-3ac5-4d31-9de1-97af129be4de tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:22.020097 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1c541692-3ac5-4d31-9de1-97af129be4de tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:22.020933 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1c541692-3ac5-4d31-9de1-97af129be4de tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:22.021381 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1c541692-3ac5-4d31-9de1-97af129be4de tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:22.054842 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1c541692-3ac5-4d31-9de1-97af129be4de tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "GET /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052991 Jun 20 13:00:22.055443 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3565/7231] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 13:00:22 2022] GET /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 13:00:23.066982 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9a1a4474-390e-4442-933d-a131165dc67b tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:00:23.067998 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9a1a4474-390e-4442-933d-a131165dc67b tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: 76963b52-ac6c-4d05-aebc-3fb38e1aeade] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:00:23.075714 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a1a4474-390e-4442-933d-a131165dc67b tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:23.076172 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a1a4474-390e-4442-933d-a131165dc67b tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:23.076969 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a1a4474-390e-4442-933d-a131165dc67b tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:23.077408 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a1a4474-390e-4442-933d-a131165dc67b tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:23.109055 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9a1a4474-390e-4442-933d-a131165dc67b tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "GET /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046251 Jun 20 13:00:23.109875 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3667/7232] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 13:00:23 2022] GET /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:00:24.121240 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0c01a0fb-733e-471f-8c31-79dfb1835ae7 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:00:24.122167 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0c01a0fb-733e-471f-8c31-79dfb1835ae7 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: 76963b52-ac6c-4d05-aebc-3fb38e1aeade] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:00:24.129605 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c01a0fb-733e-471f-8c31-79dfb1835ae7 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:24.130070 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c01a0fb-733e-471f-8c31-79dfb1835ae7 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:24.130860 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c01a0fb-733e-471f-8c31-79dfb1835ae7 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:24.131315 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c01a0fb-733e-471f-8c31-79dfb1835ae7 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:24.161416 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0c01a0fb-733e-471f-8c31-79dfb1835ae7 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "GET /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044182 Jun 20 13:00:24.161903 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3566/7233] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 13:00:24 2022] GET /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 13:00:24.172004 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9c30cb15-774c-4c37-b1dd-9ad3cf9bc666 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:00:24.172667 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9c30cb15-774c-4c37-b1dd-9ad3cf9bc666 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: 76963b52-ac6c-4d05-aebc-3fb38e1aeade] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:00:24.179725 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9c30cb15-774c-4c37-b1dd-9ad3cf9bc666 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:24.180183 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9c30cb15-774c-4c37-b1dd-9ad3cf9bc666 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:24.180990 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9c30cb15-774c-4c37-b1dd-9ad3cf9bc666 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:24.181436 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9c30cb15-774c-4c37-b1dd-9ad3cf9bc666 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:24.268823 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-9c30cb15-774c-4c37-b1dd-9ad3cf9bc666 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] HTTP exception thrown: Instance 76963b52-ac6c-4d05-aebc-3fb38e1aeade is not attached to volume 63643c1a-1069-4bdc-a4cb-4dbf98e08b97 Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9c30cb15-774c-4c37-b1dd-9ad3cf9bc666 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Request method failure captured: Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade/os-volume_attachments/63643c1a-1069-4bdc-a4cb-4dbf98e08b97 HTTP/1.1 Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisG8kywg0z_9TUDNhNYu2mADSJW0sUPOhjtttciYMigcAdfpkeu_qNVEVGFzO9jt-F_T6QYwk7TCpkUQ72-GxSjyRv9ugkZHUh6-nPjRZIYNs5j-hpD4QEWk3GnTG3SUIiySn5E5eGXOgCeqwhOw42DkdgV7juSsw__RPv2UwzWNp0Cw Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 08cbcc7c9d0a479193999072cd0d1a45 Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-TestEncryptedCinderVolumes-133287339 Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/08cbcc7c9d0a479193999072cd0d1a45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/08cbcc7c9d0a479193999072cd0d1a45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/08cbcc7c9d0a479193999072cd0d1a45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_08cbcc7c9d0a479193999072cd0d1a45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-TestEncryptedCinderVolumes-133287339 Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 08cbcc7c9d0a479193999072cd0d1a45 Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-133287339 Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-TestEncryptedCinderVolumes-133287339-project Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 3e01b8e2cdf145c8b98b239c950b16ee Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-TestEncryptedCinderVolumes-133287339-project Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 76963b52-ac6c-4d05-aebc-3fb38e1aeade is not attached to volume 63643c1a-1069-4bdc-a4cb-4dbf98e08b97 Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: action_args: {'server_id': '76963b52-ac6c-4d05-aebc-3fb38e1aeade', 'id': '63643c1a-1069-4bdc-a4cb-4dbf98e08b97'} Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 63643c1a-1069-4bdc-a4cb-4dbf98e08b97. Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76963b52-ac6c-4d05-aebc-3fb38e1aeade is not attached to volume 63643c1a-1069-4bdc-a4cb-4dbf98e08b97 Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 13:00:24.270753 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 13:00:24.275039 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 13:00:24.275039 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 13:00:24.275039 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76963b52-ac6c-4d05-aebc-3fb38e1aeade is not attached to volume 63643c1a-1069-4bdc-a4cb-4dbf98e08b97 Jun 20 13:00:24.275039 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 13:00:24.275039 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9c30cb15-774c-4c37-b1dd-9ad3cf9bc666 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Returning 404 to user: Instance 76963b52-ac6c-4d05-aebc-3fb38e1aeade is not attached to volume 63643c1a-1069-4bdc-a4cb-4dbf98e08b97 {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 13:00:24.275039 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9c30cb15-774c-4c37-b1dd-9ad3cf9bc666 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "DELETE /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade/os-volume_attachments/63643c1a-1069-4bdc-a4cb-4dbf98e08b97" status: 404 len: 154 microversion: 2.1 time: 0.104255 Jun 20 13:00:24.275039 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3668/7234] 10.222.0.27 () {58 vars in 1415 bytes} [Mon Jun 20 13:00:24 2022] DELETE /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade/os-volume_attachments/63643c1a-1069-4bdc-a4cb-4dbf98e08b97 => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 13:00:27.649941 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-200b4675-ddc1-4292-8731-2c33a8f23c70 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:00:27.650513 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-200b4675-ddc1-4292-8731-2c33a8f23c70 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: 76963b52-ac6c-4d05-aebc-3fb38e1aeade] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:00:27.658272 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-200b4675-ddc1-4292-8731-2c33a8f23c70 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:27.658736 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-200b4675-ddc1-4292-8731-2c33a8f23c70 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:27.659514 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-200b4675-ddc1-4292-8731-2c33a8f23c70 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:27.659955 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-200b4675-ddc1-4292-8731-2c33a8f23c70 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:27.688671 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-200b4675-ddc1-4292-8731-2c33a8f23c70 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: 76963b52-ac6c-4d05-aebc-3fb38e1aeade] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 13:00:27.778520 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-200b4675-ddc1-4292-8731-2c33a8f23c70 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "DELETE /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade" status: 204 len: 0 microversion: 2.1 time: 0.132203 Jun 20 13:00:27.779065 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3567/7235] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 13:00:27 2022] DELETE /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 13:00:27.788021 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-98a15b0f-8309-49a0-b6f9-ee266287ea9b tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:00:27.788763 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-98a15b0f-8309-49a0-b6f9-ee266287ea9b tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: 76963b52-ac6c-4d05-aebc-3fb38e1aeade] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:00:27.796974 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-98a15b0f-8309-49a0-b6f9-ee266287ea9b tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:27.797989 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-98a15b0f-8309-49a0-b6f9-ee266287ea9b tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:27.798625 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-98a15b0f-8309-49a0-b6f9-ee266287ea9b tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:27.799073 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-98a15b0f-8309-49a0-b6f9-ee266287ea9b tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:27.940239 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-98a15b0f-8309-49a0-b6f9-ee266287ea9b tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e01b8e2cdf145c8b98b239c950b16ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cbcc7c9d0a479193999072cd0d1a45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:00:27.948659 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-98a15b0f-8309-49a0-b6f9-ee266287ea9b tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "GET /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade" status: 200 len: 1562 microversion: 2.1 time: 0.164632 Jun 20 13:00:27.949357 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3669/7236] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:00:27 2022] GET /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade => generated 1562 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:00:28.967083 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ba639146-84fb-4ee6-9627-16d169769d83 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:00:28.967802 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ba639146-84fb-4ee6-9627-16d169769d83 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: 76963b52-ac6c-4d05-aebc-3fb38e1aeade] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:00:28.975370 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba639146-84fb-4ee6-9627-16d169769d83 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:28.975842 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba639146-84fb-4ee6-9627-16d169769d83 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:28.976665 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba639146-84fb-4ee6-9627-16d169769d83 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:28.977118 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba639146-84fb-4ee6-9627-16d169769d83 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:29.112186 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ba639146-84fb-4ee6-9627-16d169769d83 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e01b8e2cdf145c8b98b239c950b16ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cbcc7c9d0a479193999072cd0d1a45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:00:29.120317 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ba639146-84fb-4ee6-9627-16d169769d83 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "GET /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade" status: 200 len: 1562 microversion: 2.1 time: 0.157519 Jun 20 13:00:29.120886 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3568/7237] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:00:28 2022] GET /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:00:29.757056 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-1b5a52fd-f407-4bcc-a5e4-dbd1177cc414 req-7f7de70e-e218-4d95-a0a9-0cf843cab8d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76963b52-ac6c-4d05-aebc-3fb38e1aeade", "name": "network-vif-deleted", "tag": "b9f50333-22f1-4beb-864d-2016e095dc07"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:00:29.770276 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-1b5a52fd-f407-4bcc-a5e4-dbd1177cc414 req-7f7de70e-e218-4d95-a0a9-0cf843cab8d9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:29.770736 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-1b5a52fd-f407-4bcc-a5e4-dbd1177cc414 req-7f7de70e-e218-4d95-a0a9-0cf843cab8d9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:29.785369 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-1b5a52fd-f407-4bcc-a5e4-dbd1177cc414 req-7f7de70e-e218-4d95-a0a9-0cf843cab8d9 service nova] Creating event network-vif-deleted:b9f50333-22f1-4beb-864d-2016e095dc07 for instance 76963b52-ac6c-4d05-aebc-3fb38e1aeade on n-h1-master-1 Jun 20 13:00:29.791434 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-1b5a52fd-f407-4bcc-a5e4-dbd1177cc414 req-7f7de70e-e218-4d95-a0a9-0cf843cab8d9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038226 Jun 20 13:00:29.792709 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3670/7238] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:00:30.137818 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d2111541-8892-4ead-b243-c50e6722734a tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:00:30.138453 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d2111541-8892-4ead-b243-c50e6722734a tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: 76963b52-ac6c-4d05-aebc-3fb38e1aeade] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:00:30.146229 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d2111541-8892-4ead-b243-c50e6722734a tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:30.146689 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d2111541-8892-4ead-b243-c50e6722734a tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:30.147484 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d2111541-8892-4ead-b243-c50e6722734a tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:30.147904 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d2111541-8892-4ead-b243-c50e6722734a tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:30.185520 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d2111541-8892-4ead-b243-c50e6722734a tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:30.186065 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d2111541-8892-4ead-b243-c50e6722734a tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:30.186607 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-d2111541-8892-4ead-b243-c50e6722734a tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lazy-loading 'fault' on Instance uuid 76963b52-ac6c-4d05-aebc-3fb38e1aeade {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 13:00:30.231163 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d2111541-8892-4ead-b243-c50e6722734a tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e01b8e2cdf145c8b98b239c950b16ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cbcc7c9d0a479193999072cd0d1a45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:00:30.238932 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d2111541-8892-4ead-b243-c50e6722734a tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "GET /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade" status: 200 len: 1353 microversion: 2.1 time: 0.105010 Jun 20 13:00:30.239845 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3569/7239] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:00:30 2022] GET /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade => generated 1353 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:00:31.257372 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e95d7e22-6be9-450a-95f4-0e048f708f9f tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:00:31.258083 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e95d7e22-6be9-450a-95f4-0e048f708f9f tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] [instance: 76963b52-ac6c-4d05-aebc-3fb38e1aeade] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:00:31.265843 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e95d7e22-6be9-450a-95f4-0e048f708f9f tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:31.266365 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e95d7e22-6be9-450a-95f4-0e048f708f9f tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:31.267156 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e95d7e22-6be9-450a-95f4-0e048f708f9f tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:31.267592 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e95d7e22-6be9-450a-95f4-0e048f708f9f tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:31.285663 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-e95d7e22-6be9-450a-95f4-0e048f708f9f tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] HTTP exception thrown: Instance 76963b52-ac6c-4d05-aebc-3fb38e1aeade could not be found. Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e95d7e22-6be9-450a-95f4-0e048f708f9f tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Request method failure captured: Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade HTTP/1.1 Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisG8kywg0z_9TUDNhNYu2mADSJW0sUPOhjtttciYMigcAdfpkeu_qNVEVGFzO9jt-F_T6QYwk7TCpkUQ72-GxSjyRv9ugkZHUh6-nPjRZIYNs5j-hpD4QEWk3GnTG3SUIiySn5E5eGXOgCeqwhOw42DkdgV7juSsw__RPv2UwzWNp0Cw Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 08cbcc7c9d0a479193999072cd0d1a45 Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-TestEncryptedCinderVolumes-133287339 Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/08cbcc7c9d0a479193999072cd0d1a45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/08cbcc7c9d0a479193999072cd0d1a45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/08cbcc7c9d0a479193999072cd0d1a45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_08cbcc7c9d0a479193999072cd0d1a45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-TestEncryptedCinderVolumes-133287339 Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 08cbcc7c9d0a479193999072cd0d1a45 Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-133287339 Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-TestEncryptedCinderVolumes-133287339-project Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 3e01b8e2cdf145c8b98b239c950b16ee Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-TestEncryptedCinderVolumes-133287339-project Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 76963b52-ac6c-4d05-aebc-3fb38e1aeade could not be found. Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '76963b52-ac6c-4d05-aebc-3fb38e1aeade'} Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76963b52-ac6c-4d05-aebc-3fb38e1aeade could not be found. Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76963b52-ac6c-4d05-aebc-3fb38e1aeade could not be found. Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 13:00:31.285906 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 13:00:31.293137 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 13:00:31.293137 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 13:00:31.293137 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 13:00:31.293137 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 13:00:31.293137 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 13:00:31.293137 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76963b52-ac6c-4d05-aebc-3fb38e1aeade could not be found. Jun 20 13:00:31.293137 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 13:00:31.293137 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e95d7e22-6be9-450a-95f4-0e048f708f9f tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Returning 404 to user: Instance 76963b52-ac6c-4d05-aebc-3fb38e1aeade could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 13:00:31.293137 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e95d7e22-6be9-450a-95f4-0e048f708f9f tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "GET /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade" status: 404 len: 111 microversion: 2.1 time: 0.034090 Jun 20 13:00:31.293137 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3671/7240] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:00:31 2022] GET /compute/v2.1/servers/76963b52-ac6c-4d05-aebc-3fb38e1aeade => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 13:00:31.296490 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6ca12dee-3eab-4630-b298-620f08d3f481 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] Calling method '.version_select at 0x7f60847d9ee0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:00:31.319921 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6ca12dee-3eab-4630-b298-620f08d3f481 tempest-TestEncryptedCinderVolumes-133287339 tempest-TestEncryptedCinderVolumes-133287339-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2117887546" status: 202 len: 0 microversion: 2.1 time: 0.027418 Jun 20 13:00:31.320713 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3570/7241] 10.222.0.27 () {58 vars in 1277 bytes} [Mon Jun 20 13:00:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2117887546 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 13:00:59.315797 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-95aa4a39-08e9-4a0e-8360-1f816501e6dc tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Action: 'create', calling method: .version_select at 0x7f60722a9280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-821292428", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcFCz9s+uRJOYsLClJ9hgE4zkkWFMQ6IB1EhZL4/4fsJft8Cay1jCVK1Lysxm0zNT6JeZzhTvKBVw1tc1sKeFEr/5KOA42B1yEdKxTlp+RaoDJR6gJrb5xIJKAsjfvMJw=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:00:59.320366 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=14 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:00:59.321065 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=34 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:00:59.334518 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-95aa4a39-08e9-4a0e-8360-1f816501e6dc tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Getting quotas for project 12310919d6514a4f9269d02db9a4000a. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 13:00:59.339757 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-95aa4a39-08e9-4a0e-8360-1f816501e6dc tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Getting quotas for user c78e902922ae43a39eb636ff8484af22 and project 12310919d6514a4f9269d02db9a4000a. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 13:00:59.366383 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-95aa4a39-08e9-4a0e-8360-1f816501e6dc tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.055532 Jun 20 13:00:59.367037 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3672/7242] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 13:00:59 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:00:59.419381 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:00:59.420483 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:00:59.425227 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-deaddde2-ce06-4744-8eaf-9418a030a7a2 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1360029311", "imageRef": "449eb850-0efe-4462-96e1-6c48a9ef5b02", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-821292428", "networks": [{"uuid": "26715a5d-85e3-4473-9076-7abf05e6d267"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:00:59.490428 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-deaddde2-ce06-4744-8eaf-9418a030a7a2 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] validate_networks() for [('26715a5d-85e3-4473-9076-7abf05e6d267', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 13:00:59.878027 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-deaddde2-ce06-4744-8eaf-9418a030a7a2 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 13:00:59.878487 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-deaddde2-ce06-4744-8eaf-9418a030a7a2 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 13:00:59.878980 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-deaddde2-ce06-4744-8eaf-9418a030a7a2 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 13:00:59.879393 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-deaddde2-ce06-4744-8eaf-9418a030a7a2 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 13:00:59.879813 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-deaddde2-ce06-4744-8eaf-9418a030a7a2 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 13:00:59.889286 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-deaddde2-ce06-4744-8eaf-9418a030a7a2 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:59.889749 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-deaddde2-ce06-4744-8eaf-9418a030a7a2 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:59.890847 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-deaddde2-ce06-4744-8eaf-9418a030a7a2 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:00:59.891308 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-deaddde2-ce06-4744-8eaf-9418a030a7a2 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:00:59.909531 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-deaddde2-ce06-4744-8eaf-9418a030a7a2 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Getting quotas for project 12310919d6514a4f9269d02db9a4000a. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 13:00:59.915234 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-deaddde2-ce06-4744-8eaf-9418a030a7a2 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Getting quotas for user c78e902922ae43a39eb636ff8484af22 and project 12310919d6514a4f9269d02db9a4000a. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 13:00:59.928980 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-deaddde2-ce06-4744-8eaf-9418a030a7a2 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 13:00:59.931403 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-deaddde2-ce06-4744-8eaf-9418a030a7a2 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='449eb850-0efe-4462-96e1-6c48a9ef5b02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 13:00:59.981950 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-deaddde2-ce06-4744-8eaf-9418a030a7a2 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.565022 Jun 20 13:00:59.982793 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3571/7243] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 13:00:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 13:00:59.993241 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c129b5df-c646-45d3-b73b-11d2ae4ed8a8 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:00:59.993858 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c129b5df-c646-45d3-b73b-11d2ae4ed8a8 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:01:00.049730 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c129b5df-c646-45d3-b73b-11d2ae4ed8a8 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78e902922ae43a39eb636ff8484af22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12310919d6514a4f9269d02db9a4000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:01:00.056912 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c129b5df-c646-45d3-b73b-11d2ae4ed8a8 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6" status: 200 len: 1258 microversion: 2.1 time: 0.068014 Jun 20 13:01:00.057702 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3673/7244] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:00:59 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6 => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 13:01:01.074576 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f6d4c24b-0065-4fa0-91d8-c86de4f7f742 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:01:01.075210 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f6d4c24b-0065-4fa0-91d8-c86de4f7f742 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:01:01.084317 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6d4c24b-0065-4fa0-91d8-c86de4f7f742 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:01.084793 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6d4c24b-0065-4fa0-91d8-c86de4f7f742 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:01.085594 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6d4c24b-0065-4fa0-91d8-c86de4f7f742 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:01.086050 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6d4c24b-0065-4fa0-91d8-c86de4f7f742 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:01.517081 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f6d4c24b-0065-4fa0-91d8-c86de4f7f742 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78e902922ae43a39eb636ff8484af22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12310919d6514a4f9269d02db9a4000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:01:01.533656 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f6d4c24b-0065-4fa0-91d8-c86de4f7f742 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6" status: 200 len: 1316 microversion: 2.1 time: 0.462997 Jun 20 13:01:01.534354 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3572/7245] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:01:01 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6 => generated 1316 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:01:02.552450 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-79423a13-8cc5-4c72-ad1f-b63adbe3e808 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:01:02.553138 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-79423a13-8cc5-4c72-ad1f-b63adbe3e808 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:01:02.566013 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-79423a13-8cc5-4c72-ad1f-b63adbe3e808 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:02.566773 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-79423a13-8cc5-4c72-ad1f-b63adbe3e808 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:02.567593 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-79423a13-8cc5-4c72-ad1f-b63adbe3e808 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:02.568044 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-79423a13-8cc5-4c72-ad1f-b63adbe3e808 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:02.730160 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-79423a13-8cc5-4c72-ad1f-b63adbe3e808 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78e902922ae43a39eb636ff8484af22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12310919d6514a4f9269d02db9a4000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:01:02.742415 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-79423a13-8cc5-4c72-ad1f-b63adbe3e808 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6" status: 200 len: 1358 microversion: 2.1 time: 0.194733 Jun 20 13:01:02.743684 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3674/7246] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:01:02 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6 => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:01:03.773196 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d37ceefe-89bc-47d2-a84e-db79fdf2e486 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:01:03.774751 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d37ceefe-89bc-47d2-a84e-db79fdf2e486 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:01:03.784866 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d37ceefe-89bc-47d2-a84e-db79fdf2e486 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:03.785765 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d37ceefe-89bc-47d2-a84e-db79fdf2e486 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:03.794366 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d37ceefe-89bc-47d2-a84e-db79fdf2e486 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:03.806365 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d37ceefe-89bc-47d2-a84e-db79fdf2e486 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:03.998709 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d37ceefe-89bc-47d2-a84e-db79fdf2e486 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78e902922ae43a39eb636ff8484af22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12310919d6514a4f9269d02db9a4000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:01:04.008612 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d37ceefe-89bc-47d2-a84e-db79fdf2e486 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6" status: 200 len: 1358 microversion: 2.1 time: 0.246928 Jun 20 13:01:04.009205 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3573/7247] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:01:03 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6 => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:01:05.026092 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bf35ade6-0438-4802-a3f7-d8525aaec04e tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:01:05.027428 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bf35ade6-0438-4802-a3f7-d8525aaec04e tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:01:05.035994 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf35ade6-0438-4802-a3f7-d8525aaec04e tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:05.036482 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf35ade6-0438-4802-a3f7-d8525aaec04e tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:05.037276 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf35ade6-0438-4802-a3f7-d8525aaec04e tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:05.037720 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf35ade6-0438-4802-a3f7-d8525aaec04e tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:05.191948 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bf35ade6-0438-4802-a3f7-d8525aaec04e tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78e902922ae43a39eb636ff8484af22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12310919d6514a4f9269d02db9a4000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:01:05.204400 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bf35ade6-0438-4802-a3f7-d8525aaec04e tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6" status: 200 len: 1358 microversion: 2.1 time: 0.181571 Jun 20 13:01:05.205314 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3675/7248] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:01:05 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:01:06.221950 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b70e05e1-aa15-4eb9-b7d4-9b6f0ee1996d tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:01:06.222617 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b70e05e1-aa15-4eb9-b7d4-9b6f0ee1996d tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:01:06.231639 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b70e05e1-aa15-4eb9-b7d4-9b6f0ee1996d tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:06.232135 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b70e05e1-aa15-4eb9-b7d4-9b6f0ee1996d tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:06.233056 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b70e05e1-aa15-4eb9-b7d4-9b6f0ee1996d tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:06.233580 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b70e05e1-aa15-4eb9-b7d4-9b6f0ee1996d tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:06.388680 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b70e05e1-aa15-4eb9-b7d4-9b6f0ee1996d tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78e902922ae43a39eb636ff8484af22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12310919d6514a4f9269d02db9a4000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:01:06.399552 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b70e05e1-aa15-4eb9-b7d4-9b6f0ee1996d tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6" status: 200 len: 1358 microversion: 2.1 time: 0.182187 Jun 20 13:01:06.400144 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3574/7249] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:01:06 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:01:07.416588 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-40fce5ba-a4a5-41fa-871b-bd8ea5b6160e tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:01:07.417533 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-40fce5ba-a4a5-41fa-871b-bd8ea5b6160e tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:01:07.428592 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-40fce5ba-a4a5-41fa-871b-bd8ea5b6160e tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:07.429048 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-40fce5ba-a4a5-41fa-871b-bd8ea5b6160e tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:07.429879 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-40fce5ba-a4a5-41fa-871b-bd8ea5b6160e tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:07.430284 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-40fce5ba-a4a5-41fa-871b-bd8ea5b6160e tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:07.574165 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-40fce5ba-a4a5-41fa-871b-bd8ea5b6160e tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78e902922ae43a39eb636ff8484af22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12310919d6514a4f9269d02db9a4000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:01:07.583439 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-40fce5ba-a4a5-41fa-871b-bd8ea5b6160e tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6" status: 200 len: 1358 microversion: 2.1 time: 0.170830 Jun 20 13:01:07.584370 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3676/7250] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:01:07 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:01:08.601639 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-db147176-beb0-47a4-8f81-10925fd615c0 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:01:08.602277 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-db147176-beb0-47a4-8f81-10925fd615c0 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:01:08.610104 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-db147176-beb0-47a4-8f81-10925fd615c0 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:08.610581 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-db147176-beb0-47a4-8f81-10925fd615c0 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:08.611373 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-db147176-beb0-47a4-8f81-10925fd615c0 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:08.611821 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-db147176-beb0-47a4-8f81-10925fd615c0 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:08.842938 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-db147176-beb0-47a4-8f81-10925fd615c0 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78e902922ae43a39eb636ff8484af22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12310919d6514a4f9269d02db9a4000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:01:08.851224 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-db147176-beb0-47a4-8f81-10925fd615c0 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6" status: 200 len: 1358 microversion: 2.1 time: 0.253590 Jun 20 13:01:08.852069 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3575/7251] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:01:08 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6 => generated 1358 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:01:09.377824 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-f7d3651d-6726-4cc0-93e5-722e9685fff0 req-5af14f35-454c-4cc4-bbd6-54b5d6980b30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0bdf47c-ee58-4772-a01c-581419f62be6", "tag": "57cf1060-3a54-49cc-9e92-743fe6dec91f"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:01:09.395783 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-f7d3651d-6726-4cc0-93e5-722e9685fff0 req-5af14f35-454c-4cc4-bbd6-54b5d6980b30 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:09.396257 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-f7d3651d-6726-4cc0-93e5-722e9685fff0 req-5af14f35-454c-4cc4-bbd6-54b5d6980b30 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:09.412817 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-f7d3651d-6726-4cc0-93e5-722e9685fff0 req-5af14f35-454c-4cc4-bbd6-54b5d6980b30 service nova] Creating event network-changed:57cf1060-3a54-49cc-9e92-743fe6dec91f for instance d0bdf47c-ee58-4772-a01c-581419f62be6 on n-h1-master-1 Jun 20 13:01:09.421987 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-f7d3651d-6726-4cc0-93e5-722e9685fff0 req-5af14f35-454c-4cc4-bbd6-54b5d6980b30 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048621 Jun 20 13:01:09.423245 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3677/7252] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:01:09.867881 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-484871ac-acfd-4485-9c83-ab0bc122ce09 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:01:09.868547 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-484871ac-acfd-4485-9c83-ab0bc122ce09 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:01:09.876657 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-484871ac-acfd-4485-9c83-ab0bc122ce09 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:09.877135 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-484871ac-acfd-4485-9c83-ab0bc122ce09 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:09.877920 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-484871ac-acfd-4485-9c83-ab0bc122ce09 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:09.878375 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-484871ac-acfd-4485-9c83-ab0bc122ce09 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:09.898823 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:01:09.922570 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:01:10.023658 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-484871ac-acfd-4485-9c83-ab0bc122ce09 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78e902922ae43a39eb636ff8484af22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12310919d6514a4f9269d02db9a4000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:01:10.032069 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-484871ac-acfd-4485-9c83-ab0bc122ce09 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6" status: 200 len: 1358 microversion: 2.1 time: 0.167840 Jun 20 13:01:10.033059 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3576/7253] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:01:09 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:01:11.046884 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:01:11.053586 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-97882336-ec09-4053-a2fd-2902453b5abd tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:01:11.054309 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-97882336-ec09-4053-a2fd-2902453b5abd tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:01:11.061596 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-97882336-ec09-4053-a2fd-2902453b5abd tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:11.062496 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-97882336-ec09-4053-a2fd-2902453b5abd tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:11.063402 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-97882336-ec09-4053-a2fd-2902453b5abd tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:11.064035 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-97882336-ec09-4053-a2fd-2902453b5abd tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:11.219317 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-97882336-ec09-4053-a2fd-2902453b5abd tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78e902922ae43a39eb636ff8484af22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12310919d6514a4f9269d02db9a4000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:01:11.227796 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-97882336-ec09-4053-a2fd-2902453b5abd tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6" status: 200 len: 1358 microversion: 2.1 time: 0.182015 Jun 20 13:01:11.228434 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3678/7254] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:01:11 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:01:12.247528 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-20b4689f-68e8-46bc-8412-7ae19d77c718 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:01:12.248162 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-20b4689f-68e8-46bc-8412-7ae19d77c718 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:01:12.255856 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-20b4689f-68e8-46bc-8412-7ae19d77c718 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:12.256350 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-20b4689f-68e8-46bc-8412-7ae19d77c718 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:12.257149 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-20b4689f-68e8-46bc-8412-7ae19d77c718 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:12.257601 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-20b4689f-68e8-46bc-8412-7ae19d77c718 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:12.412016 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-20b4689f-68e8-46bc-8412-7ae19d77c718 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78e902922ae43a39eb636ff8484af22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12310919d6514a4f9269d02db9a4000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:01:12.420044 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-20b4689f-68e8-46bc-8412-7ae19d77c718 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6" status: 200 len: 1358 microversion: 2.1 time: 0.176458 Jun 20 13:01:12.421305 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3577/7255] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:01:12 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:01:13.440288 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3e34e3f5-e505-4a5c-81dd-982b17bfe85b tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:01:13.440968 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3e34e3f5-e505-4a5c-81dd-982b17bfe85b tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:01:13.448497 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e34e3f5-e505-4a5c-81dd-982b17bfe85b tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:13.449057 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e34e3f5-e505-4a5c-81dd-982b17bfe85b tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:13.449805 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e34e3f5-e505-4a5c-81dd-982b17bfe85b tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:13.450268 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3e34e3f5-e505-4a5c-81dd-982b17bfe85b tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:13.590740 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3e34e3f5-e505-4a5c-81dd-982b17bfe85b tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78e902922ae43a39eb636ff8484af22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12310919d6514a4f9269d02db9a4000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:01:13.599385 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3e34e3f5-e505-4a5c-81dd-982b17bfe85b tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6" status: 200 len: 1358 microversion: 2.1 time: 0.164501 Jun 20 13:01:13.599973 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3679/7256] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:01:13 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:01:14.616955 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1b634bf1-7edc-4adf-a84f-58342ed701bb tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:01:14.617572 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1b634bf1-7edc-4adf-a84f-58342ed701bb tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:01:14.624946 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1b634bf1-7edc-4adf-a84f-58342ed701bb tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:14.625463 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1b634bf1-7edc-4adf-a84f-58342ed701bb tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:14.626293 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1b634bf1-7edc-4adf-a84f-58342ed701bb tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:14.626787 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1b634bf1-7edc-4adf-a84f-58342ed701bb tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:14.757872 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1b634bf1-7edc-4adf-a84f-58342ed701bb tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78e902922ae43a39eb636ff8484af22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12310919d6514a4f9269d02db9a4000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:01:14.765995 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1b634bf1-7edc-4adf-a84f-58342ed701bb tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6" status: 200 len: 1358 microversion: 2.1 time: 0.152978 Jun 20 13:01:14.766554 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3578/7257] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:01:14 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:01:15.783569 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f9193d77-75b8-4fa6-858a-9f65e71f0fb3 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:01:15.784184 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f9193d77-75b8-4fa6-858a-9f65e71f0fb3 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:01:15.791722 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9193d77-75b8-4fa6-858a-9f65e71f0fb3 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:15.792235 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9193d77-75b8-4fa6-858a-9f65e71f0fb3 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:15.793090 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9193d77-75b8-4fa6-858a-9f65e71f0fb3 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:15.793529 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9193d77-75b8-4fa6-858a-9f65e71f0fb3 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:15.930478 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f9193d77-75b8-4fa6-858a-9f65e71f0fb3 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78e902922ae43a39eb636ff8484af22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12310919d6514a4f9269d02db9a4000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:01:15.939053 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f9193d77-75b8-4fa6-858a-9f65e71f0fb3 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6" status: 200 len: 1358 microversion: 2.1 time: 0.159899 Jun 20 13:01:15.939869 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3680/7258] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:01:15 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:01:16.340997 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-1a23e3c2-c059-4ebf-80e8-39d14a3b7266 req-e8f0937e-def9-4b5c-b163-8d4e8157cf25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0bdf47c-ee58-4772-a01c-581419f62be6", "name": "network-vif-plugged", "status": "completed", "tag": "57cf1060-3a54-49cc-9e92-743fe6dec91f"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:01:16.353573 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-1a23e3c2-c059-4ebf-80e8-39d14a3b7266 req-e8f0937e-def9-4b5c-b163-8d4e8157cf25 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:16.354049 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-1a23e3c2-c059-4ebf-80e8-39d14a3b7266 req-e8f0937e-def9-4b5c-b163-8d4e8157cf25 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:16.367595 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-1a23e3c2-c059-4ebf-80e8-39d14a3b7266 req-e8f0937e-def9-4b5c-b163-8d4e8157cf25 service nova] Creating event network-vif-plugged:57cf1060-3a54-49cc-9e92-743fe6dec91f for instance d0bdf47c-ee58-4772-a01c-581419f62be6 on n-h1-master-1 Jun 20 13:01:16.374127 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-1a23e3c2-c059-4ebf-80e8-39d14a3b7266 req-e8f0937e-def9-4b5c-b163-8d4e8157cf25 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036342 Jun 20 13:01:16.375661 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3579/7259] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:01:16.958811 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3cc1e621-2810-41bd-aa15-1a482c8c476b tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:01:16.959465 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3cc1e621-2810-41bd-aa15-1a482c8c476b tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:01:16.966661 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3cc1e621-2810-41bd-aa15-1a482c8c476b tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:16.967166 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3cc1e621-2810-41bd-aa15-1a482c8c476b tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:16.967940 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3cc1e621-2810-41bd-aa15-1a482c8c476b tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:16.968479 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3cc1e621-2810-41bd-aa15-1a482c8c476b tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:17.110025 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3cc1e621-2810-41bd-aa15-1a482c8c476b tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78e902922ae43a39eb636ff8484af22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12310919d6514a4f9269d02db9a4000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:01:17.118457 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3cc1e621-2810-41bd-aa15-1a482c8c476b tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6" status: 200 len: 1358 microversion: 2.1 time: 0.163434 Jun 20 13:01:17.119208 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3681/7260] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:01:16 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:01:18.136965 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1f84f2a8-a3cd-4cc5-98e5-644f03aef9cd tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:01:18.137682 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1f84f2a8-a3cd-4cc5-98e5-644f03aef9cd tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:01:18.145586 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f84f2a8-a3cd-4cc5-98e5-644f03aef9cd tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:18.146111 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f84f2a8-a3cd-4cc5-98e5-644f03aef9cd tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:18.146890 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f84f2a8-a3cd-4cc5-98e5-644f03aef9cd tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:18.147334 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f84f2a8-a3cd-4cc5-98e5-644f03aef9cd tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:18.284585 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1f84f2a8-a3cd-4cc5-98e5-644f03aef9cd tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78e902922ae43a39eb636ff8484af22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12310919d6514a4f9269d02db9a4000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:01:18.292531 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1f84f2a8-a3cd-4cc5-98e5-644f03aef9cd tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6" status: 200 len: 1548 microversion: 2.1 time: 0.159906 Jun 20 13:01:18.293114 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3580/7261] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:01:18 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6 => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:01:18.309006 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-99a20fd9-4978-4ffe-86ce-a07321a148c5 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:01:18.309687 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-99a20fd9-4978-4ffe-86ce-a07321a148c5 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:01:18.318717 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-99a20fd9-4978-4ffe-86ce-a07321a148c5 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:18.319193 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-99a20fd9-4978-4ffe-86ce-a07321a148c5 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:18.319987 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-99a20fd9-4978-4ffe-86ce-a07321a148c5 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:18.320463 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-99a20fd9-4978-4ffe-86ce-a07321a148c5 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:18.458095 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-99a20fd9-4978-4ffe-86ce-a07321a148c5 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78e902922ae43a39eb636ff8484af22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12310919d6514a4f9269d02db9a4000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:01:18.466292 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-99a20fd9-4978-4ffe-86ce-a07321a148c5 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6" status: 200 len: 1548 microversion: 2.1 time: 0.161592 Jun 20 13:01:18.466890 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3682/7262] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:01:18 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6 => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:01:18.483009 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7d17234b-f241-4f08-9479-d2354fca8f7a tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:01:18.486960 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7d17234b-f241-4f08-9479-d2354fca8f7a tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c78e902922ae43a39eb636ff8484af22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12310919d6514a4f9269d02db9a4000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:01:18.487830 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7d17234b-f241-4f08-9479-d2354fca8f7a tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Searching by: {'deleted': False, 'project_id': '12310919d6514a4f9269d02db9a4000a'} {{(pid=119128) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 13:01:18.494131 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7d17234b-f241-4f08-9479-d2354fca8f7a tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:18.494629 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7d17234b-f241-4f08-9479-d2354fca8f7a tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:18.495456 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7d17234b-f241-4f08-9479-d2354fca8f7a tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:18.495907 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7d17234b-f241-4f08-9479-d2354fca8f7a tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:18.521821 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.multi_cell_list [None req-7d17234b-f241-4f08-9479-d2354fca8f7a tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119128) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 13:01:18.551753 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7d17234b-f241-4f08-9479-d2354fca8f7a tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.072682 Jun 20 13:01:18.552384 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3581/7263] 10.222.0.27 () {58 vars in 1124 bytes} [Mon Jun 20 13:01:18 2022] GET /compute/v2.1/servers => generated 343 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:01:18.563594 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-af537bd0-efec-426a-881e-19ba835ee3d5 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:01:18.564307 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-af537bd0-efec-426a-881e-19ba835ee3d5 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:01:18.570763 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-af537bd0-efec-426a-881e-19ba835ee3d5 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:18.571214 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-af537bd0-efec-426a-881e-19ba835ee3d5 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:18.571967 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-af537bd0-efec-426a-881e-19ba835ee3d5 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:18.572446 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-af537bd0-efec-426a-881e-19ba835ee3d5 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:18.720190 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-af537bd0-efec-426a-881e-19ba835ee3d5 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78e902922ae43a39eb636ff8484af22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12310919d6514a4f9269d02db9a4000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:01:18.728542 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-af537bd0-efec-426a-881e-19ba835ee3d5 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6" status: 200 len: 1548 microversion: 2.1 time: 0.168930 Jun 20 13:01:18.729171 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3683/7264] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:01:18 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6 => generated 1548 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:01:21.352749 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-48b6d2a9-cc4e-4187-9c6a-2f229f770a49 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56803e24-b377-431c-a0ac-c79396e8bf13"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:01:21.354093 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-48b6d2a9-cc4e-4187-9c6a-2f229f770a49 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:01:21.362483 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-48b6d2a9-cc4e-4187-9c6a-2f229f770a49 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:21.362962 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-48b6d2a9-cc4e-4187-9c6a-2f229f770a49 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:21.363763 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-48b6d2a9-cc4e-4187-9c6a-2f229f770a49 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:21.364250 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-48b6d2a9-cc4e-4187-9c6a-2f229f770a49 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:21.614501 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-48b6d2a9-cc4e-4187-9c6a-2f229f770a49 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "POST /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265607 Jun 20 13:01:21.615540 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3582/7265] 10.222.0.27 () {60 vars in 1322 bytes} [Mon Jun 20 13:01:21 2022] POST /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:01:32.360384 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b90f777d-e2fc-446f-b651-e8b579696db2 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:01:32.360970 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b90f777d-e2fc-446f-b651-e8b579696db2 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:01:32.363702 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:01:32.364386 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=56 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:01:32.369776 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b90f777d-e2fc-446f-b651-e8b579696db2 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:32.370230 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b90f777d-e2fc-446f-b651-e8b579696db2 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:32.371001 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b90f777d-e2fc-446f-b651-e8b579696db2 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:32.371437 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b90f777d-e2fc-446f-b651-e8b579696db2 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:32.506190 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b90f777d-e2fc-446f-b651-e8b579696db2 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78e902922ae43a39eb636ff8484af22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12310919d6514a4f9269d02db9a4000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:01:32.514829 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b90f777d-e2fc-446f-b651-e8b579696db2 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6" status: 200 len: 1594 microversion: 2.1 time: 0.158708 Jun 20 13:01:32.515789 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3684/7266] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:01:32 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6 => generated 1594 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:01:34.287670 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:01:34.289418 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:01:34.290417 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:01:34.477316 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-2b4d4c7a-193b-4031-b2cd-af0836b3d33b req-3b9c3c40-95b5-42bd-81cc-8c34806dc2c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0bdf47c-ee58-4772-a01c-581419f62be6", "tag": "57cf1060-3a54-49cc-9e92-743fe6dec91f"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:01:34.495020 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-2b4d4c7a-193b-4031-b2cd-af0836b3d33b req-3b9c3c40-95b5-42bd-81cc-8c34806dc2c6 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:34.495525 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-2b4d4c7a-193b-4031-b2cd-af0836b3d33b req-3b9c3c40-95b5-42bd-81cc-8c34806dc2c6 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:34.507989 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-2b4d4c7a-193b-4031-b2cd-af0836b3d33b req-3b9c3c40-95b5-42bd-81cc-8c34806dc2c6 service nova] Creating event network-changed:57cf1060-3a54-49cc-9e92-743fe6dec91f for instance d0bdf47c-ee58-4772-a01c-581419f62be6 on n-h1-master-1 Jun 20 13:01:34.513949 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-2b4d4c7a-193b-4031-b2cd-af0836b3d33b req-3b9c3c40-95b5-42bd-81cc-8c34806dc2c6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.233279 Jun 20 13:01:34.515614 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3583/7267] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:01:35.598950 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5b1eff9e-f41e-42a9-b7a8-65c17473ab9e tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-398471105"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:01:35.599483 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5b1eff9e-f41e-42a9-b7a8-65c17473ab9e tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:01:35.606852 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b1eff9e-f41e-42a9-b7a8-65c17473ab9e tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:35.607309 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b1eff9e-f41e-42a9-b7a8-65c17473ab9e tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:35.608081 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b1eff9e-f41e-42a9-b7a8-65c17473ab9e tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:35.608798 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b1eff9e-f41e-42a9-b7a8-65c17473ab9e tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:35.743520 n-d-master-1 devstack@n-api.service[119127]: INFO nova.network.security_group_api [None req-5b1eff9e-f41e-42a9-b7a8-65c17473ab9e tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Adding security group ea45c6c0-3133-43c3-bf75-e49265827342 to port 57cf1060-3a54-49cc-9e92-743fe6dec91f Jun 20 13:01:36.373429 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5b1eff9e-f41e-42a9-b7a8-65c17473ab9e tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "POST /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6/action" status: 202 len: 0 microversion: 2.1 time: 0.777712 Jun 20 13:01:36.374731 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3685/7268] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 13:01:35 2022] POST /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6/action => generated 0 bytes in 780 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 13:01:36.384664 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2044edb3-e948-44e4-9f03-0cbe793480b1 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:01:36.385381 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2044edb3-e948-44e4-9f03-0cbe793480b1 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:01:36.398807 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2044edb3-e948-44e4-9f03-0cbe793480b1 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:36.399277 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2044edb3-e948-44e4-9f03-0cbe793480b1 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:36.400708 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2044edb3-e948-44e4-9f03-0cbe793480b1 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:36.401169 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2044edb3-e948-44e4-9f03-0cbe793480b1 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:36.541319 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-a1c895f7-7b86-4da2-80d4-f3278cbe3186 req-f26179b1-b2fc-438d-863a-547e6c0617e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0bdf47c-ee58-4772-a01c-581419f62be6", "tag": "57cf1060-3a54-49cc-9e92-743fe6dec91f"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:01:36.558332 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-a1c895f7-7b86-4da2-80d4-f3278cbe3186 req-f26179b1-b2fc-438d-863a-547e6c0617e6 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:36.559858 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-a1c895f7-7b86-4da2-80d4-f3278cbe3186 req-f26179b1-b2fc-438d-863a-547e6c0617e6 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:36.576619 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-a1c895f7-7b86-4da2-80d4-f3278cbe3186 req-f26179b1-b2fc-438d-863a-547e6c0617e6 service nova] Creating event network-changed:57cf1060-3a54-49cc-9e92-743fe6dec91f for instance d0bdf47c-ee58-4772-a01c-581419f62be6 on n-h1-master-1 Jun 20 13:01:36.582665 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-a1c895f7-7b86-4da2-80d4-f3278cbe3186 req-f26179b1-b2fc-438d-863a-547e6c0617e6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049019 Jun 20 13:01:36.587693 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3686/7269] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 13:01:36.595597 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2044edb3-e948-44e4-9f03-0cbe793480b1 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78e902922ae43a39eb636ff8484af22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12310919d6514a4f9269d02db9a4000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:01:36.605946 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2044edb3-e948-44e4-9f03-0cbe793480b1 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6" status: 200 len: 1759 microversion: 2.1 time: 0.226641 Jun 20 13:01:36.606792 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3584/7270] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:01:36 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6 => generated 1759 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:01:50.472676 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:01:50.473413 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=12 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:01:50.478228 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e804f11f-c981-47d1-8d57-576245e67032 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:01:50.479278 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e804f11f-c981-47d1-8d57-576245e67032 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:01:50.486897 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e804f11f-c981-47d1-8d57-576245e67032 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:50.487332 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e804f11f-c981-47d1-8d57-576245e67032 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:50.488100 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e804f11f-c981-47d1-8d57-576245e67032 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:50.488559 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e804f11f-c981-47d1-8d57-576245e67032 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:50.573560 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e804f11f-c981-47d1-8d57-576245e67032 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "POST /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6/action" status: 202 len: 0 microversion: 2.1 time: 0.102654 Jun 20 13:01:50.574213 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3687/7271] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 13:01:50 2022] POST /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 13:01:50.583005 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-179dae48-f17c-4d04-905c-b51132a4a556 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:01:50.583637 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-179dae48-f17c-4d04-905c-b51132a4a556 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:01:50.586305 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=4 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:01:50.587128 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=8 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:01:50.593074 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-179dae48-f17c-4d04-905c-b51132a4a556 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:50.593743 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-179dae48-f17c-4d04-905c-b51132a4a556 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:50.594557 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-179dae48-f17c-4d04-905c-b51132a4a556 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:50.595009 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-179dae48-f17c-4d04-905c-b51132a4a556 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:50.843208 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-179dae48-f17c-4d04-905c-b51132a4a556 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78e902922ae43a39eb636ff8484af22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12310919d6514a4f9269d02db9a4000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:01:50.851267 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-179dae48-f17c-4d04-905c-b51132a4a556 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6" status: 200 len: 1751 microversion: 2.1 time: 0.272320 Jun 20 13:01:50.851818 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3585/7272] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:01:50 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6 => generated 1751 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:01:51.872573 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b4251995-c555-4693-b4d4-1a8159cea80c tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:01:51.873302 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b4251995-c555-4693-b4d4-1a8159cea80c tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:01:51.880542 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b4251995-c555-4693-b4d4-1a8159cea80c tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:51.880994 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b4251995-c555-4693-b4d4-1a8159cea80c tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:51.881793 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b4251995-c555-4693-b4d4-1a8159cea80c tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:51.882261 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b4251995-c555-4693-b4d4-1a8159cea80c tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:52.035621 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b4251995-c555-4693-b4d4-1a8159cea80c tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78e902922ae43a39eb636ff8484af22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12310919d6514a4f9269d02db9a4000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:01:52.044144 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b4251995-c555-4693-b4d4-1a8159cea80c tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6" status: 200 len: 1756 microversion: 2.1 time: 0.176712 Jun 20 13:01:52.044784 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3688/7273] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:01:51 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:01:53.062538 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-288a7c02-15b3-400d-86e3-4c098ac16957 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:01:53.063113 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-288a7c02-15b3-400d-86e3-4c098ac16957 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:01:53.070561 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-288a7c02-15b3-400d-86e3-4c098ac16957 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:53.071021 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-288a7c02-15b3-400d-86e3-4c098ac16957 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:53.071813 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-288a7c02-15b3-400d-86e3-4c098ac16957 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:53.072237 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-288a7c02-15b3-400d-86e3-4c098ac16957 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:53.217744 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-288a7c02-15b3-400d-86e3-4c098ac16957 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78e902922ae43a39eb636ff8484af22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12310919d6514a4f9269d02db9a4000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:01:53.225964 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-288a7c02-15b3-400d-86e3-4c098ac16957 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6" status: 200 len: 1756 microversion: 2.1 time: 0.167921 Jun 20 13:01:53.226549 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3586/7274] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:01:53 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:01:54.243244 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-44ae5aa4-14db-4dc0-891c-acf1e4634271 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:01:54.243809 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-44ae5aa4-14db-4dc0-891c-acf1e4634271 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:01:54.251365 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-44ae5aa4-14db-4dc0-891c-acf1e4634271 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:54.251817 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-44ae5aa4-14db-4dc0-891c-acf1e4634271 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:54.252602 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-44ae5aa4-14db-4dc0-891c-acf1e4634271 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:54.253027 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-44ae5aa4-14db-4dc0-891c-acf1e4634271 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:54.411243 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-44ae5aa4-14db-4dc0-891c-acf1e4634271 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78e902922ae43a39eb636ff8484af22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12310919d6514a4f9269d02db9a4000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:01:54.420000 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-44ae5aa4-14db-4dc0-891c-acf1e4634271 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6" status: 200 len: 1756 microversion: 2.1 time: 0.180680 Jun 20 13:01:54.420623 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3689/7275] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:01:54 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6 => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:01:55.439672 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b503960d-a148-48a0-adab-cbe8eedf5162 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:01:55.440326 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b503960d-a148-48a0-adab-cbe8eedf5162 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:01:55.447745 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b503960d-a148-48a0-adab-cbe8eedf5162 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:55.448233 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b503960d-a148-48a0-adab-cbe8eedf5162 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:55.449014 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b503960d-a148-48a0-adab-cbe8eedf5162 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:55.449464 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b503960d-a148-48a0-adab-cbe8eedf5162 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:55.606581 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b503960d-a148-48a0-adab-cbe8eedf5162 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78e902922ae43a39eb636ff8484af22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12310919d6514a4f9269d02db9a4000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:01:55.615505 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b503960d-a148-48a0-adab-cbe8eedf5162 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6" status: 200 len: 1756 microversion: 2.1 time: 0.180455 Jun 20 13:01:55.616101 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3587/7276] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:01:55 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6 => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:01:56.637183 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d49ecac9-c085-4dd7-9a34-03d725f9a76f tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:01:56.638078 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d49ecac9-c085-4dd7-9a34-03d725f9a76f tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:01:56.649873 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d49ecac9-c085-4dd7-9a34-03d725f9a76f tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:56.650615 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d49ecac9-c085-4dd7-9a34-03d725f9a76f tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:56.651884 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d49ecac9-c085-4dd7-9a34-03d725f9a76f tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:56.652647 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d49ecac9-c085-4dd7-9a34-03d725f9a76f tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:56.821375 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d49ecac9-c085-4dd7-9a34-03d725f9a76f tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78e902922ae43a39eb636ff8484af22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12310919d6514a4f9269d02db9a4000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:01:56.832300 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d49ecac9-c085-4dd7-9a34-03d725f9a76f tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6" status: 200 len: 1756 microversion: 2.1 time: 0.201388 Jun 20 13:01:56.832948 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3690/7277] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:01:56 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6 => generated 1756 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:01:57.851350 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0f43825b-1819-468b-91a9-bda3693633da tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:01:57.851939 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0f43825b-1819-468b-91a9-bda3693633da tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:01:57.859654 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f43825b-1819-468b-91a9-bda3693633da tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:57.860117 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f43825b-1819-468b-91a9-bda3693633da tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:57.860947 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f43825b-1819-468b-91a9-bda3693633da tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:57.861424 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f43825b-1819-468b-91a9-bda3693633da tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:58.090660 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0f43825b-1819-468b-91a9-bda3693633da tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78e902922ae43a39eb636ff8484af22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12310919d6514a4f9269d02db9a4000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:01:58.099444 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0f43825b-1819-468b-91a9-bda3693633da tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6" status: 200 len: 1756 microversion: 2.1 time: 0.252107 Jun 20 13:01:58.100121 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3588/7278] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:01:57 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6 => generated 1756 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:01:59.118020 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0597835b-2d37-4d3e-9366-3abcce9bc62e tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:01:59.118630 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0597835b-2d37-4d3e-9366-3abcce9bc62e tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:01:59.127083 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0597835b-2d37-4d3e-9366-3abcce9bc62e tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:59.127534 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0597835b-2d37-4d3e-9366-3abcce9bc62e tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:59.128349 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0597835b-2d37-4d3e-9366-3abcce9bc62e tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:01:59.128778 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0597835b-2d37-4d3e-9366-3abcce9bc62e tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:01:59.281630 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0597835b-2d37-4d3e-9366-3abcce9bc62e tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78e902922ae43a39eb636ff8484af22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12310919d6514a4f9269d02db9a4000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:01:59.290377 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0597835b-2d37-4d3e-9366-3abcce9bc62e tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6" status: 200 len: 1756 microversion: 2.1 time: 0.176283 Jun 20 13:01:59.290977 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3691/7279] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:01:59 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:02:00.310351 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d0b4996e-0503-469a-8f53-d0f2b099b79c tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:02:00.310965 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d0b4996e-0503-469a-8f53-d0f2b099b79c tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:02:00.318925 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d0b4996e-0503-469a-8f53-d0f2b099b79c tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:02:00.319387 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d0b4996e-0503-469a-8f53-d0f2b099b79c tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:02:00.320176 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d0b4996e-0503-469a-8f53-d0f2b099b79c tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:02:00.320652 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d0b4996e-0503-469a-8f53-d0f2b099b79c tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:02:00.473841 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d0b4996e-0503-469a-8f53-d0f2b099b79c tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78e902922ae43a39eb636ff8484af22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12310919d6514a4f9269d02db9a4000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:02:00.482368 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d0b4996e-0503-469a-8f53-d0f2b099b79c tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6" status: 200 len: 1756 microversion: 2.1 time: 0.178486 Jun 20 13:02:00.483024 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3589/7280] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:02:00 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6 => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:02:01.501036 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0b4be7f9-aa59-4144-b09e-221fbd1a4989 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:02:01.501729 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0b4be7f9-aa59-4144-b09e-221fbd1a4989 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:02:01.509202 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0b4be7f9-aa59-4144-b09e-221fbd1a4989 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:02:01.510621 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0b4be7f9-aa59-4144-b09e-221fbd1a4989 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:02:01.510621 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0b4be7f9-aa59-4144-b09e-221fbd1a4989 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:02:01.511343 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0b4be7f9-aa59-4144-b09e-221fbd1a4989 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:02:01.675272 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0b4be7f9-aa59-4144-b09e-221fbd1a4989 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78e902922ae43a39eb636ff8484af22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12310919d6514a4f9269d02db9a4000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:02:01.686497 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0b4be7f9-aa59-4144-b09e-221fbd1a4989 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6" status: 200 len: 1756 microversion: 2.1 time: 0.189160 Jun 20 13:02:01.687118 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3692/7281] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:02:01 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6 => generated 1756 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:02:02.706450 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d27d64d2-efa6-4f4f-a2af-42d9eb1c9858 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:02:02.707178 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d27d64d2-efa6-4f4f-a2af-42d9eb1c9858 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:02:02.714806 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d27d64d2-efa6-4f4f-a2af-42d9eb1c9858 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:02:02.715277 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d27d64d2-efa6-4f4f-a2af-42d9eb1c9858 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:02:02.716094 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d27d64d2-efa6-4f4f-a2af-42d9eb1c9858 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:02:02.717031 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d27d64d2-efa6-4f4f-a2af-42d9eb1c9858 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:02:02.872603 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d27d64d2-efa6-4f4f-a2af-42d9eb1c9858 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78e902922ae43a39eb636ff8484af22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12310919d6514a4f9269d02db9a4000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:02:02.882593 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d27d64d2-efa6-4f4f-a2af-42d9eb1c9858 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6" status: 200 len: 1759 microversion: 2.1 time: 0.180727 Jun 20 13:02:02.883149 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3590/7282] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:02:02 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6 => generated 1759 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:02:35.217248 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-49f7c1f5-99d7-4c0e-8b90-e1302e1882cd tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-398471105"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:02:35.217877 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-49f7c1f5-99d7-4c0e-8b90-e1302e1882cd tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:02:35.220687 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=12 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:02:35.221384 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:02:35.229643 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-49f7c1f5-99d7-4c0e-8b90-e1302e1882cd tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:02:35.230279 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-49f7c1f5-99d7-4c0e-8b90-e1302e1882cd tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:02:35.231608 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-49f7c1f5-99d7-4c0e-8b90-e1302e1882cd tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:02:35.232238 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-49f7c1f5-99d7-4c0e-8b90-e1302e1882cd tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:02:35.378752 n-d-master-1 devstack@n-api.service[119127]: INFO nova.network.security_group_api [None req-49f7c1f5-99d7-4c0e-8b90-e1302e1882cd tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Removing security group ea45c6c0-3133-43c3-bf75-e49265827342 from port 57cf1060-3a54-49cc-9e92-743fe6dec91f Jun 20 13:02:35.739507 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-49f7c1f5-99d7-4c0e-8b90-e1302e1882cd tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "POST /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6/action" status: 202 len: 0 microversion: 2.1 time: 0.528878 Jun 20 13:02:35.740588 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3693/7283] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 13:02:35 2022] POST /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6/action => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 13:02:35.749579 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-e318086a-129c-40f3-bf3b-e5954daa9602 req-e4398ef6-c985-4d66-b4d2-15c575af739b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0bdf47c-ee58-4772-a01c-581419f62be6", "tag": "57cf1060-3a54-49cc-9e92-743fe6dec91f"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:02:35.761141 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=12 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:02:35.761810 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=36 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:02:35.773912 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e318086a-129c-40f3-bf3b-e5954daa9602 req-e4398ef6-c985-4d66-b4d2-15c575af739b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:02:35.774653 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e318086a-129c-40f3-bf3b-e5954daa9602 req-e4398ef6-c985-4d66-b4d2-15c575af739b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:02:35.789854 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-e318086a-129c-40f3-bf3b-e5954daa9602 req-e4398ef6-c985-4d66-b4d2-15c575af739b service nova] Creating event network-changed:57cf1060-3a54-49cc-9e92-743fe6dec91f for instance d0bdf47c-ee58-4772-a01c-581419f62be6 on n-h1-master-1 Jun 20 13:02:35.797074 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-e318086a-129c-40f3-bf3b-e5954daa9602 req-e4398ef6-c985-4d66-b4d2-15c575af739b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053582 Jun 20 13:02:35.798416 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3591/7284] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:02:37.161232 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c511230a-5325-4c5b-a645-78b8f51d0b0a tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:02:37.162294 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c511230a-5325-4c5b-a645-78b8f51d0b0a tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:02:37.164794 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-1625a88b-bea4-4280-a448-5cc2703fbb96 req-ec643e16-f484-48f1-a278-63433f7d0636 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0bdf47c-ee58-4772-a01c-581419f62be6", "tag": "57cf1060-3a54-49cc-9e92-743fe6dec91f"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:02:37.169033 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c511230a-5325-4c5b-a645-78b8f51d0b0a tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:02:37.169595 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c511230a-5325-4c5b-a645-78b8f51d0b0a tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:02:37.170370 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c511230a-5325-4c5b-a645-78b8f51d0b0a tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:02:37.170812 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c511230a-5325-4c5b-a645-78b8f51d0b0a tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:02:37.174118 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-1625a88b-bea4-4280-a448-5cc2703fbb96 req-ec643e16-f484-48f1-a278-63433f7d0636 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:02:37.174641 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-1625a88b-bea4-4280-a448-5cc2703fbb96 req-ec643e16-f484-48f1-a278-63433f7d0636 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:02:37.188564 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-1625a88b-bea4-4280-a448-5cc2703fbb96 req-ec643e16-f484-48f1-a278-63433f7d0636 service nova] Creating event network-changed:57cf1060-3a54-49cc-9e92-743fe6dec91f for instance d0bdf47c-ee58-4772-a01c-581419f62be6 on n-h1-master-1 Jun 20 13:02:37.194556 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-1625a88b-bea4-4280-a448-5cc2703fbb96 req-ec643e16-f484-48f1-a278-63433f7d0636 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036261 Jun 20 13:02:37.196020 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3592/7285] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:02:37.276932 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-c511230a-5325-4c5b-a645-78b8f51d0b0a tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lazy-loading 'services' on Instance uuid d0bdf47c-ee58-4772-a01c-581419f62be6 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 13:02:37.359203 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c511230a-5325-4c5b-a645-78b8f51d0b0a tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6/os-volume_attachments/56803e24-b377-431c-a0ac-c79396e8bf13" status: 202 len: 0 microversion: 2.1 time: 0.202952 Jun 20 13:02:37.359938 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3694/7286] 10.222.0.27 () {58 vars in 1415 bytes} [Mon Jun 20 13:02:37 2022] DELETE /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6/os-volume_attachments/56803e24-b377-431c-a0ac-c79396e8bf13 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 13:02:37.379772 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-98305160-bff8-4459-9acd-15c465a9cb6c tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:02:37.380885 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-98305160-bff8-4459-9acd-15c465a9cb6c tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:02:37.389944 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-98305160-bff8-4459-9acd-15c465a9cb6c tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:02:37.390637 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-98305160-bff8-4459-9acd-15c465a9cb6c tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:02:37.391712 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-98305160-bff8-4459-9acd-15c465a9cb6c tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:02:37.392090 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-98305160-bff8-4459-9acd-15c465a9cb6c tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:02:37.446739 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-98305160-bff8-4459-9acd-15c465a9cb6c tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080432 Jun 20 13:02:37.447736 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3593/7287] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 13:02:37 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:02:38.461233 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dce95aa4-f5df-4ea1-87b0-d7babc9cad64 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:02:38.462203 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dce95aa4-f5df-4ea1-87b0-d7babc9cad64 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:02:38.469274 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dce95aa4-f5df-4ea1-87b0-d7babc9cad64 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:02:38.469721 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dce95aa4-f5df-4ea1-87b0-d7babc9cad64 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:02:38.470454 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dce95aa4-f5df-4ea1-87b0-d7babc9cad64 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:02:38.470916 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dce95aa4-f5df-4ea1-87b0-d7babc9cad64 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:02:38.501232 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dce95aa4-f5df-4ea1-87b0-d7babc9cad64 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045466 Jun 20 13:02:38.501835 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3695/7288] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 13:02:38 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:02:39.513711 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f7616470-098a-4979-9d0c-1a5d6ad5bbb2 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:02:39.514697 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f7616470-098a-4979-9d0c-1a5d6ad5bbb2 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:02:39.521861 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7616470-098a-4979-9d0c-1a5d6ad5bbb2 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:02:39.522357 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7616470-098a-4979-9d0c-1a5d6ad5bbb2 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:02:39.523151 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7616470-098a-4979-9d0c-1a5d6ad5bbb2 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:02:39.523608 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f7616470-098a-4979-9d0c-1a5d6ad5bbb2 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:02:39.554575 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f7616470-098a-4979-9d0c-1a5d6ad5bbb2 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045156 Jun 20 13:02:39.556359 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3594/7289] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 13:02:39 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:02:40.566793 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b2d0cfe3-b063-4a79-9b30-e664d6fa0e96 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:02:40.568438 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b2d0cfe3-b063-4a79-9b30-e664d6fa0e96 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:02:40.576175 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b2d0cfe3-b063-4a79-9b30-e664d6fa0e96 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:02:40.576658 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b2d0cfe3-b063-4a79-9b30-e664d6fa0e96 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:02:40.577437 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b2d0cfe3-b063-4a79-9b30-e664d6fa0e96 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:02:40.577879 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b2d0cfe3-b063-4a79-9b30-e664d6fa0e96 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:02:40.608361 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b2d0cfe3-b063-4a79-9b30-e664d6fa0e96 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045668 Jun 20 13:02:40.608947 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3696/7290] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 13:02:40 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:02:41.624836 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-65a4f4cb-8929-466a-b112-38499d060e61 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:02:41.625844 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-65a4f4cb-8929-466a-b112-38499d060e61 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:02:41.633521 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65a4f4cb-8929-466a-b112-38499d060e61 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:02:41.633996 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65a4f4cb-8929-466a-b112-38499d060e61 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:02:41.634798 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65a4f4cb-8929-466a-b112-38499d060e61 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:02:41.635253 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65a4f4cb-8929-466a-b112-38499d060e61 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:02:41.665131 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-65a4f4cb-8929-466a-b112-38499d060e61 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047216 Jun 20 13:02:41.665701 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3595/7291] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 13:02:41 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:02:42.677872 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e7c7805e-81fb-459f-953a-441fa7757c88 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:02:42.678815 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e7c7805e-81fb-459f-953a-441fa7757c88 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:02:42.686651 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e7c7805e-81fb-459f-953a-441fa7757c88 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:02:42.687113 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e7c7805e-81fb-459f-953a-441fa7757c88 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:02:42.687888 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e7c7805e-81fb-459f-953a-441fa7757c88 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:02:42.688358 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e7c7805e-81fb-459f-953a-441fa7757c88 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:02:42.718739 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e7c7805e-81fb-459f-953a-441fa7757c88 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044882 Jun 20 13:02:42.719304 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3697/7292] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 20 13:02:42 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 13:02:42.729548 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4d8d28e0-2aba-44d2-971f-b636f3bc4470 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:02:42.730072 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4d8d28e0-2aba-44d2-971f-b636f3bc4470 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:02:42.738428 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4d8d28e0-2aba-44d2-971f-b636f3bc4470 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:02:42.738898 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4d8d28e0-2aba-44d2-971f-b636f3bc4470 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:02:42.739681 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4d8d28e0-2aba-44d2-971f-b636f3bc4470 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:02:42.740133 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4d8d28e0-2aba-44d2-971f-b636f3bc4470 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:02:42.819390 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-4d8d28e0-2aba-44d2-971f-b636f3bc4470 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] HTTP exception thrown: Instance d0bdf47c-ee58-4772-a01c-581419f62be6 is not attached to volume 56803e24-b377-431c-a0ac-c79396e8bf13 Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4d8d28e0-2aba-44d2-971f-b636f3bc4470 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Request method failure captured: Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: request: DELETE /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6/os-volume_attachments/56803e24-b377-431c-a0ac-c79396e8bf13 HTTP/1.1 Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisG97oA2YIQvisFUb1u8jQzkA73fx94a52bRcwCICwCXCLFKhqb8No2UebYg98MvJTfnsuX4VWDulCBpulOlV0YEv-bQzbgsBLA8UeKYMr4e1PyHzdxwO4SF3DkFJWNKoSYd-7uaUOHPg26na-t5SOjxZj-XPGwCSML8B5qBlxo25PzE Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 12310919d6514a4f9269d02db9a4000a Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-TestMinimumBasicScenario-1132141256 Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/12310919d6514a4f9269d02db9a4000a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/12310919d6514a4f9269d02db9a4000a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/12310919d6514a4f9269d02db9a4000a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_12310919d6514a4f9269d02db9a4000a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-TestMinimumBasicScenario-1132141256 Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 12310919d6514a4f9269d02db9a4000a Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1132141256 Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-TestMinimumBasicScenario-1132141256-project Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: c78e902922ae43a39eb636ff8484af22 Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-TestMinimumBasicScenario-1132141256-project Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: exception: Instance d0bdf47c-ee58-4772-a01c-581419f62be6 is not attached to volume 56803e24-b377-431c-a0ac-c79396e8bf13 Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: action_args: {'server_id': 'd0bdf47c-ee58-4772-a01c-581419f62be6', 'id': '56803e24-b377-431c-a0ac-c79396e8bf13'} Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 56803e24-b377-431c-a0ac-c79396e8bf13. Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0bdf47c-ee58-4772-a01c-581419f62be6 is not attached to volume 56803e24-b377-431c-a0ac-c79396e8bf13 Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 13:02:42.821670 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 13:02:42.825452 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 13:02:42.825452 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 13:02:42.825452 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0bdf47c-ee58-4772-a01c-581419f62be6 is not attached to volume 56803e24-b377-431c-a0ac-c79396e8bf13 Jun 20 13:02:42.825452 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 13:02:42.825452 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4d8d28e0-2aba-44d2-971f-b636f3bc4470 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Returning 404 to user: Instance d0bdf47c-ee58-4772-a01c-581419f62be6 is not attached to volume 56803e24-b377-431c-a0ac-c79396e8bf13 {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 13:02:42.825452 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4d8d28e0-2aba-44d2-971f-b636f3bc4470 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6/os-volume_attachments/56803e24-b377-431c-a0ac-c79396e8bf13" status: 404 len: 154 microversion: 2.1 time: 0.097761 Jun 20 13:02:42.825452 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3596/7293] 10.222.0.27 () {58 vars in 1415 bytes} [Mon Jun 20 13:02:42 2022] DELETE /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6/os-volume_attachments/56803e24-b377-431c-a0ac-c79396e8bf13 => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 13:02:46.074335 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9202f5a7-f1b6-45d9-84c2-a5056152548a tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:02:46.074934 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9202f5a7-f1b6-45d9-84c2-a5056152548a tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:02:46.082673 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9202f5a7-f1b6-45d9-84c2-a5056152548a tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:02:46.083206 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9202f5a7-f1b6-45d9-84c2-a5056152548a tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:02:46.084059 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9202f5a7-f1b6-45d9-84c2-a5056152548a tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:02:46.084595 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9202f5a7-f1b6-45d9-84c2-a5056152548a tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:02:46.110840 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9202f5a7-f1b6-45d9-84c2-a5056152548a tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 13:02:46.194125 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9202f5a7-f1b6-45d9-84c2-a5056152548a tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6" status: 204 len: 0 microversion: 2.1 time: 0.123636 Jun 20 13:02:46.194642 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3698/7294] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 13:02:46 2022] DELETE /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 13:02:46.206016 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8cbffaa7-1a13-40da-aaf4-08b987ec1e2f tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:02:46.206751 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8cbffaa7-1a13-40da-aaf4-08b987ec1e2f tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:02:46.213769 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8cbffaa7-1a13-40da-aaf4-08b987ec1e2f tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:02:46.214264 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8cbffaa7-1a13-40da-aaf4-08b987ec1e2f tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:02:46.215078 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8cbffaa7-1a13-40da-aaf4-08b987ec1e2f tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:02:46.215573 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8cbffaa7-1a13-40da-aaf4-08b987ec1e2f tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:02:46.357569 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8cbffaa7-1a13-40da-aaf4-08b987ec1e2f tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78e902922ae43a39eb636ff8484af22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12310919d6514a4f9269d02db9a4000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:02:46.365420 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8cbffaa7-1a13-40da-aaf4-08b987ec1e2f tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6" status: 200 len: 1554 microversion: 2.1 time: 0.165102 Jun 20 13:02:46.365954 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3597/7295] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:02:46 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6 => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:02:47.387277 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cbba144a-3ea3-4a0a-b74a-db502fe41d75 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:02:47.388382 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cbba144a-3ea3-4a0a-b74a-db502fe41d75 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:02:47.396405 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cbba144a-3ea3-4a0a-b74a-db502fe41d75 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:02:47.396865 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cbba144a-3ea3-4a0a-b74a-db502fe41d75 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:02:47.397650 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cbba144a-3ea3-4a0a-b74a-db502fe41d75 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:02:47.398094 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cbba144a-3ea3-4a0a-b74a-db502fe41d75 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:02:47.560103 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cbba144a-3ea3-4a0a-b74a-db502fe41d75 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78e902922ae43a39eb636ff8484af22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12310919d6514a4f9269d02db9a4000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:02:47.567723 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cbba144a-3ea3-4a0a-b74a-db502fe41d75 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6" status: 200 len: 1554 microversion: 2.1 time: 0.187190 Jun 20 13:02:47.568346 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3699/7296] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:02:47 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6 => generated 1554 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:02:48.291356 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-71d8b704-8343-46f6-9a57-729a69bf8c7e req-ccc0d543-deba-4efe-9889-4edb1ae630ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0bdf47c-ee58-4772-a01c-581419f62be6", "name": "network-vif-deleted", "tag": "57cf1060-3a54-49cc-9e92-743fe6dec91f"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:02:48.301822 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-71d8b704-8343-46f6-9a57-729a69bf8c7e req-ccc0d543-deba-4efe-9889-4edb1ae630ac service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:02:48.302341 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-71d8b704-8343-46f6-9a57-729a69bf8c7e req-ccc0d543-deba-4efe-9889-4edb1ae630ac service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:02:48.314849 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-71d8b704-8343-46f6-9a57-729a69bf8c7e req-ccc0d543-deba-4efe-9889-4edb1ae630ac service nova] Creating event network-vif-deleted:57cf1060-3a54-49cc-9e92-743fe6dec91f for instance d0bdf47c-ee58-4772-a01c-581419f62be6 on n-h1-master-1 Jun 20 13:02:48.320324 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-71d8b704-8343-46f6-9a57-729a69bf8c7e req-ccc0d543-deba-4efe-9889-4edb1ae630ac service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032746 Jun 20 13:02:48.320943 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3598/7297] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:02:48.585561 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-710e0930-9196-43ee-b0fe-4f8627d8f1a7 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:02:48.586154 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-710e0930-9196-43ee-b0fe-4f8627d8f1a7 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:02:48.594620 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-710e0930-9196-43ee-b0fe-4f8627d8f1a7 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:02:48.595082 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-710e0930-9196-43ee-b0fe-4f8627d8f1a7 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:02:48.595889 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-710e0930-9196-43ee-b0fe-4f8627d8f1a7 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:02:48.596357 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-710e0930-9196-43ee-b0fe-4f8627d8f1a7 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:02:48.630830 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-710e0930-9196-43ee-b0fe-4f8627d8f1a7 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:02:48.631502 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-710e0930-9196-43ee-b0fe-4f8627d8f1a7 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:02:48.631969 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-710e0930-9196-43ee-b0fe-4f8627d8f1a7 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lazy-loading 'fault' on Instance uuid d0bdf47c-ee58-4772-a01c-581419f62be6 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 13:02:48.676422 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-710e0930-9196-43ee-b0fe-4f8627d8f1a7 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78e902922ae43a39eb636ff8484af22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12310919d6514a4f9269d02db9a4000a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:02:48.691652 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-710e0930-9196-43ee-b0fe-4f8627d8f1a7 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6" status: 200 len: 1348 microversion: 2.1 time: 0.110054 Jun 20 13:02:48.692872 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3700/7298] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:02:48 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6 => generated 1348 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:02:49.711863 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fa62a70e-eb0c-4ac5-a1f5-fd0575dd96dc tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:02:49.712607 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fa62a70e-eb0c-4ac5-a1f5-fd0575dd96dc tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] [instance: d0bdf47c-ee58-4772-a01c-581419f62be6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:02:49.720136 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fa62a70e-eb0c-4ac5-a1f5-fd0575dd96dc tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:02:49.720638 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fa62a70e-eb0c-4ac5-a1f5-fd0575dd96dc tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:02:49.721429 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fa62a70e-eb0c-4ac5-a1f5-fd0575dd96dc tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:02:49.721884 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fa62a70e-eb0c-4ac5-a1f5-fd0575dd96dc tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:02:49.736440 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-fa62a70e-eb0c-4ac5-a1f5-fd0575dd96dc tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] HTTP exception thrown: Instance d0bdf47c-ee58-4772-a01c-581419f62be6 could not be found. Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fa62a70e-eb0c-4ac5-a1f5-fd0575dd96dc tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Request method failure captured: Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6 HTTP/1.1 Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisG97oA2YIQvisFUb1u8jQzkA73fx94a52bRcwCICwCXCLFKhqb8No2UebYg98MvJTfnsuX4VWDulCBpulOlV0YEv-bQzbgsBLA8UeKYMr4e1PyHzdxwO4SF3DkFJWNKoSYd-7uaUOHPg26na-t5SOjxZj-XPGwCSML8B5qBlxo25PzE Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 12310919d6514a4f9269d02db9a4000a Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-TestMinimumBasicScenario-1132141256 Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/12310919d6514a4f9269d02db9a4000a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/12310919d6514a4f9269d02db9a4000a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/12310919d6514a4f9269d02db9a4000a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_12310919d6514a4f9269d02db9a4000a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-TestMinimumBasicScenario-1132141256 Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 12310919d6514a4f9269d02db9a4000a Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1132141256 Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-TestMinimumBasicScenario-1132141256-project Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: c78e902922ae43a39eb636ff8484af22 Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-TestMinimumBasicScenario-1132141256-project Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: exception: Instance d0bdf47c-ee58-4772-a01c-581419f62be6 could not be found. Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': 'd0bdf47c-ee58-4772-a01c-581419f62be6'} Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0bdf47c-ee58-4772-a01c-581419f62be6 could not be found. Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0bdf47c-ee58-4772-a01c-581419f62be6 could not be found. Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 13:02:49.738118 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 13:02:49.742193 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 13:02:49.742193 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 13:02:49.742193 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 13:02:49.742193 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 13:02:49.742193 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 13:02:49.742193 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0bdf47c-ee58-4772-a01c-581419f62be6 could not be found. Jun 20 13:02:49.742193 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 13:02:49.742193 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fa62a70e-eb0c-4ac5-a1f5-fd0575dd96dc tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Returning 404 to user: Instance d0bdf47c-ee58-4772-a01c-581419f62be6 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 13:02:49.742193 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fa62a70e-eb0c-4ac5-a1f5-fd0575dd96dc tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6" status: 404 len: 111 microversion: 2.1 time: 0.032958 Jun 20 13:02:49.742193 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3599/7299] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:02:49 2022] GET /compute/v2.1/servers/d0bdf47c-ee58-4772-a01c-581419f62be6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 13:02:49.748757 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ed71d206-8550-4e0c-9d7b-833a8abc7b14 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] Calling method '.version_select at 0x7f60721bc3a0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:02:49.771071 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ed71d206-8550-4e0c-9d7b-833a8abc7b14 tempest-TestMinimumBasicScenario-1132141256 tempest-TestMinimumBasicScenario-1132141256-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-821292428" status: 202 len: 0 microversion: 2.1 time: 0.026192 Jun 20 13:02:49.771699 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3701/7300] 10.222.0.27 () {58 vars in 1268 bytes} [Mon Jun 20 13:02:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-821292428 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 13:02:50.168943 n-d-master-1 devstack@n-api.service[119128]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 13:02:50.169163 n-d-master-1 devstack@n-api.service[119128]: Mon Jun 20 13:02:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 13:02:52.066795 n-d-master-1 devstack@n-api.service[119127]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 13:02:52.067282 n-d-master-1 devstack@n-api.service[119127]: Mon Jun 20 13:02:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 13:02:59.388870 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d3c7c7ff-f448-4e7b-827d-a722b9138866 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Action: 'create', calling method: .version_select at 0x7f60733bb9d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1508269916", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMtu3m6AHVoHalhLVpl34WMbH2ODGm49FfCKTE9W7MpyvKS6gsROXFISR5aJvbrx3UVbQl+fgPboGnYdVof6EcKiSm+Fycucv+u6Gqsme86Szaf/kFFoYXpUiJP1PmnAbw=="}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:02:59.404816 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-d3c7c7ff-f448-4e7b-827d-a722b9138866 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Getting quotas for project acee41bacfa54fef8c5eb48cb67de032. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 13:02:59.410489 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-d3c7c7ff-f448-4e7b-827d-a722b9138866 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Getting quotas for user b0fb2c86bbd4403481e17934014fdfb7 and project acee41bacfa54fef8c5eb48cb67de032. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 13:02:59.445095 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d3c7c7ff-f448-4e7b-827d-a722b9138866 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.227205 Jun 20 13:02:59.445926 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3600/7301] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 13:02:59 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 13:03:05.833268 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6c4fad3b-e50d-4ee5-bb36-10fa7eaf2d26 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-611803833", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "ac0c908b-ddf5-46f3-9061-2184e4ef30db"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1508269916", "security_groups": [{"name": "tempest-secgroup-smoke-410777037"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:03:05.843223 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:03:05.844052 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:03:05.965102 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-6c4fad3b-e50d-4ee5-bb36-10fa7eaf2d26 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] validate_networks() for [('ac0c908b-ddf5-46f3-9061-2184e4ef30db', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 13:03:06.409678 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-6c4fad3b-e50d-4ee5-bb36-10fa7eaf2d26 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 13:03:06.410319 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-6c4fad3b-e50d-4ee5-bb36-10fa7eaf2d26 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 13:03:06.410792 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-6c4fad3b-e50d-4ee5-bb36-10fa7eaf2d26 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 13:03:06.411201 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-6c4fad3b-e50d-4ee5-bb36-10fa7eaf2d26 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 13:03:06.411638 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-6c4fad3b-e50d-4ee5-bb36-10fa7eaf2d26 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 13:03:06.421274 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c4fad3b-e50d-4ee5-bb36-10fa7eaf2d26 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:06.421721 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c4fad3b-e50d-4ee5-bb36-10fa7eaf2d26 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:06.422652 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c4fad3b-e50d-4ee5-bb36-10fa7eaf2d26 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:06.423096 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c4fad3b-e50d-4ee5-bb36-10fa7eaf2d26 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:06.445285 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-6c4fad3b-e50d-4ee5-bb36-10fa7eaf2d26 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Getting quotas for project acee41bacfa54fef8c5eb48cb67de032. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 13:03:06.450901 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-6c4fad3b-e50d-4ee5-bb36-10fa7eaf2d26 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Getting quotas for user b0fb2c86bbd4403481e17934014fdfb7 and project acee41bacfa54fef8c5eb48cb67de032. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 13:03:06.463717 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6c4fad3b-e50d-4ee5-bb36-10fa7eaf2d26 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 13:03:06.466097 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6c4fad3b-e50d-4ee5-bb36-10fa7eaf2d26 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 7e8bf566-3f68-4b61-b60b-34ecb6243c71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 13:03:06.515096 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6c4fad3b-e50d-4ee5-bb36-10fa7eaf2d26 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.685815 Jun 20 13:03:06.521532 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3702/7302] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 13:03:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 13:03:06.523697 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=38 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:03:06.529274 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-15a6a08c-eda5-453b-bf7e-b06579ee02b1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:03:06.529937 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-15a6a08c-eda5-453b-bf7e-b06579ee02b1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 7e8bf566-3f68-4b61-b60b-34ecb6243c71] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:03:06.533236 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:03:06.593990 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-15a6a08c-eda5-453b-bf7e-b06579ee02b1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:03:06.601933 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-15a6a08c-eda5-453b-bf7e-b06579ee02b1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71" status: 200 len: 1266 microversion: 2.1 time: 0.078905 Jun 20 13:03:06.603739 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3601/7303] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:03:06 2022] GET /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71 => generated 1266 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:03:07.621230 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0e95a6ce-12dc-4dcd-8ee6-7d8b84840781 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:03:07.622444 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0e95a6ce-12dc-4dcd-8ee6-7d8b84840781 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 7e8bf566-3f68-4b61-b60b-34ecb6243c71] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:03:07.631744 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0e95a6ce-12dc-4dcd-8ee6-7d8b84840781 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:07.632464 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0e95a6ce-12dc-4dcd-8ee6-7d8b84840781 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:07.633612 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0e95a6ce-12dc-4dcd-8ee6-7d8b84840781 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:07.634095 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0e95a6ce-12dc-4dcd-8ee6-7d8b84840781 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:07.713864 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0e95a6ce-12dc-4dcd-8ee6-7d8b84840781 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:03:07.722840 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0e95a6ce-12dc-4dcd-8ee6-7d8b84840781 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71" status: 200 len: 1326 microversion: 2.1 time: 0.107388 Jun 20 13:03:07.734531 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3703/7304] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:03:07 2022] GET /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71 => generated 1326 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:03:08.742404 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-47434e39-1cce-4064-9e24-f2527a4a5cc0 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:03:08.743046 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-47434e39-1cce-4064-9e24-f2527a4a5cc0 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 7e8bf566-3f68-4b61-b60b-34ecb6243c71] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:03:08.753730 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-47434e39-1cce-4064-9e24-f2527a4a5cc0 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:08.754275 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-47434e39-1cce-4064-9e24-f2527a4a5cc0 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:08.755080 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-47434e39-1cce-4064-9e24-f2527a4a5cc0 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:08.755534 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-47434e39-1cce-4064-9e24-f2527a4a5cc0 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:09.020032 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-47434e39-1cce-4064-9e24-f2527a4a5cc0 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:03:09.029294 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-47434e39-1cce-4064-9e24-f2527a4a5cc0 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71" status: 200 len: 1391 microversion: 2.1 time: 0.291531 Jun 20 13:03:09.029901 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3602/7305] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:03:08 2022] GET /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71 => generated 1391 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:03:09.215623 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-087edbbd-6409-4fe3-b34b-eeeb826ee3c7 req-c01515be-cb74-4991-bbd4-87a1529d0e5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e8bf566-3f68-4b61-b60b-34ecb6243c71", "tag": "3dc35d20-101c-42bc-bd2a-5c110f64ec22"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:03:09.227859 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-087edbbd-6409-4fe3-b34b-eeeb826ee3c7 req-c01515be-cb74-4991-bbd4-87a1529d0e5b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:09.228427 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-087edbbd-6409-4fe3-b34b-eeeb826ee3c7 req-c01515be-cb74-4991-bbd4-87a1529d0e5b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:09.242549 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-087edbbd-6409-4fe3-b34b-eeeb826ee3c7 req-c01515be-cb74-4991-bbd4-87a1529d0e5b service nova] Creating event network-changed:3dc35d20-101c-42bc-bd2a-5c110f64ec22 for instance 7e8bf566-3f68-4b61-b60b-34ecb6243c71 on n-h1-master-1 Jun 20 13:03:09.248380 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-087edbbd-6409-4fe3-b34b-eeeb826ee3c7 req-c01515be-cb74-4991-bbd4-87a1529d0e5b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036495 Jun 20 13:03:09.249271 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3704/7306] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:03:10.047482 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4ab18c90-db51-431e-bcad-8ec321d5a3dd tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:03:10.048154 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4ab18c90-db51-431e-bcad-8ec321d5a3dd tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 7e8bf566-3f68-4b61-b60b-34ecb6243c71] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:03:10.056033 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ab18c90-db51-431e-bcad-8ec321d5a3dd tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:10.056526 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ab18c90-db51-431e-bcad-8ec321d5a3dd tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:10.057344 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ab18c90-db51-431e-bcad-8ec321d5a3dd tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:10.057790 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ab18c90-db51-431e-bcad-8ec321d5a3dd tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:10.222774 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4ab18c90-db51-431e-bcad-8ec321d5a3dd tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:03:10.230693 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4ab18c90-db51-431e-bcad-8ec321d5a3dd tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71" status: 200 len: 1391 microversion: 2.1 time: 0.187279 Jun 20 13:03:10.231269 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3603/7307] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:03:10 2022] GET /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71 => generated 1391 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:03:11.251208 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9a90b2c7-3875-4f9d-8556-a96fe6fd881f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:03:11.252258 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9a90b2c7-3875-4f9d-8556-a96fe6fd881f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 7e8bf566-3f68-4b61-b60b-34ecb6243c71] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:03:11.261354 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a90b2c7-3875-4f9d-8556-a96fe6fd881f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:11.262026 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a90b2c7-3875-4f9d-8556-a96fe6fd881f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:11.263088 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a90b2c7-3875-4f9d-8556-a96fe6fd881f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:11.263717 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a90b2c7-3875-4f9d-8556-a96fe6fd881f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:11.412258 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9a90b2c7-3875-4f9d-8556-a96fe6fd881f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:03:11.420487 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9a90b2c7-3875-4f9d-8556-a96fe6fd881f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71" status: 200 len: 1391 microversion: 2.1 time: 0.176236 Jun 20 13:03:11.421070 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3705/7308] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:03:11 2022] GET /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71 => generated 1391 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:03:12.440121 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d85e6d8a-8e77-40d0-88d7-471ed298ca82 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:03:12.440843 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d85e6d8a-8e77-40d0-88d7-471ed298ca82 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 7e8bf566-3f68-4b61-b60b-34ecb6243c71] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:03:12.448231 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d85e6d8a-8e77-40d0-88d7-471ed298ca82 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:12.448803 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d85e6d8a-8e77-40d0-88d7-471ed298ca82 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:12.449589 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d85e6d8a-8e77-40d0-88d7-471ed298ca82 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:12.450031 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d85e6d8a-8e77-40d0-88d7-471ed298ca82 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:12.595033 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d85e6d8a-8e77-40d0-88d7-471ed298ca82 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:03:12.603491 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d85e6d8a-8e77-40d0-88d7-471ed298ca82 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71" status: 200 len: 1391 microversion: 2.1 time: 0.167244 Jun 20 13:03:12.614459 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3604/7309] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:03:12 2022] GET /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71 => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:03:13.625551 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-54dd5542-6d03-43a7-ab9d-aa9ee69d86b2 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:03:13.626424 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-54dd5542-6d03-43a7-ab9d-aa9ee69d86b2 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 7e8bf566-3f68-4b61-b60b-34ecb6243c71] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:03:13.634494 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-54dd5542-6d03-43a7-ab9d-aa9ee69d86b2 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:13.635075 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-54dd5542-6d03-43a7-ab9d-aa9ee69d86b2 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:13.635853 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-54dd5542-6d03-43a7-ab9d-aa9ee69d86b2 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:13.636334 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-54dd5542-6d03-43a7-ab9d-aa9ee69d86b2 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:13.780108 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-54dd5542-6d03-43a7-ab9d-aa9ee69d86b2 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:03:13.788544 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-54dd5542-6d03-43a7-ab9d-aa9ee69d86b2 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71" status: 200 len: 1391 microversion: 2.1 time: 0.168836 Jun 20 13:03:13.789138 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3706/7310] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:03:13 2022] GET /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71 => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:03:14.631124 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-87e9b0fa-2ba0-4f02-b4f6-ab2a3680bd54 req-af0b04ac-3fb7-46c7-b8a6-f4cc86ec68d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e8bf566-3f68-4b61-b60b-34ecb6243c71", "name": "network-vif-plugged", "status": "completed", "tag": "3dc35d20-101c-42bc-bd2a-5c110f64ec22"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:03:14.639894 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-87e9b0fa-2ba0-4f02-b4f6-ab2a3680bd54 req-af0b04ac-3fb7-46c7-b8a6-f4cc86ec68d1 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:14.640374 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-87e9b0fa-2ba0-4f02-b4f6-ab2a3680bd54 req-af0b04ac-3fb7-46c7-b8a6-f4cc86ec68d1 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:14.652643 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-87e9b0fa-2ba0-4f02-b4f6-ab2a3680bd54 req-af0b04ac-3fb7-46c7-b8a6-f4cc86ec68d1 service nova] Creating event network-vif-plugged:3dc35d20-101c-42bc-bd2a-5c110f64ec22 for instance 7e8bf566-3f68-4b61-b60b-34ecb6243c71 on n-h1-master-1 Jun 20 13:03:14.657867 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-87e9b0fa-2ba0-4f02-b4f6-ab2a3680bd54 req-af0b04ac-3fb7-46c7-b8a6-f4cc86ec68d1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031073 Jun 20 13:03:14.658495 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3605/7311] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 13:03:14.805992 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ac324844-9c41-4d2b-9112-aa9beabb6327 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:03:14.806594 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ac324844-9c41-4d2b-9112-aa9beabb6327 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 7e8bf566-3f68-4b61-b60b-34ecb6243c71] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:03:14.814119 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac324844-9c41-4d2b-9112-aa9beabb6327 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:14.814578 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac324844-9c41-4d2b-9112-aa9beabb6327 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:14.815345 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac324844-9c41-4d2b-9112-aa9beabb6327 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:14.815830 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac324844-9c41-4d2b-9112-aa9beabb6327 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:14.968764 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ac324844-9c41-4d2b-9112-aa9beabb6327 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:03:14.976507 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ac324844-9c41-4d2b-9112-aa9beabb6327 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71" status: 200 len: 1391 microversion: 2.1 time: 0.174450 Jun 20 13:03:14.977093 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3707/7312] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:03:14 2022] GET /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71 => generated 1391 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 13:03:15.998578 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-99be5b9f-a23b-48c2-b67e-15bdc5a72eb6 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:03:15.999703 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-99be5b9f-a23b-48c2-b67e-15bdc5a72eb6 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 7e8bf566-3f68-4b61-b60b-34ecb6243c71] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:03:16.007591 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-99be5b9f-a23b-48c2-b67e-15bdc5a72eb6 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:16.008042 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-99be5b9f-a23b-48c2-b67e-15bdc5a72eb6 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:16.009002 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-99be5b9f-a23b-48c2-b67e-15bdc5a72eb6 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:16.009455 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-99be5b9f-a23b-48c2-b67e-15bdc5a72eb6 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:16.154766 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-99be5b9f-a23b-48c2-b67e-15bdc5a72eb6 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:03:16.162981 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-99be5b9f-a23b-48c2-b67e-15bdc5a72eb6 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71" status: 200 len: 1563 microversion: 2.1 time: 0.171910 Jun 20 13:03:16.163545 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3606/7313] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:03:15 2022] GET /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71 => generated 1563 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:03:16.179487 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4b2f97ab-05f6-462d-a08b-9c7a9e249de8 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:03:16.180108 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4b2f97ab-05f6-462d-a08b-9c7a9e249de8 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 7e8bf566-3f68-4b61-b60b-34ecb6243c71] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:03:16.188049 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4b2f97ab-05f6-462d-a08b-9c7a9e249de8 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:16.188547 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4b2f97ab-05f6-462d-a08b-9c7a9e249de8 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:16.189321 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4b2f97ab-05f6-462d-a08b-9c7a9e249de8 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:16.189762 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4b2f97ab-05f6-462d-a08b-9c7a9e249de8 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:16.330168 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4b2f97ab-05f6-462d-a08b-9c7a9e249de8 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:03:16.338311 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4b2f97ab-05f6-462d-a08b-9c7a9e249de8 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71" status: 200 len: 1563 microversion: 2.1 time: 0.162934 Jun 20 13:03:16.338861 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3708/7314] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:03:16 2022] GET /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71 => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:03:18.026111 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ed0d68bd-512e-4d09-b986-b8637c3007ec tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:03:18.026742 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ed0d68bd-512e-4d09-b986-b8637c3007ec tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 7e8bf566-3f68-4b61-b60b-34ecb6243c71] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:03:18.030274 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:03:18.032048 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-b9198089-1f5d-4dcc-9f8a-33c9aa2271c7 req-38f32311-932d-4a15-802f-d1342a803d08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e8bf566-3f68-4b61-b60b-34ecb6243c71", "tag": "3dc35d20-101c-42bc-bd2a-5c110f64ec22"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:03:18.035676 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed0d68bd-512e-4d09-b986-b8637c3007ec tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:18.036143 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed0d68bd-512e-4d09-b986-b8637c3007ec tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:18.036961 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed0d68bd-512e-4d09-b986-b8637c3007ec tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:18.037587 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed0d68bd-512e-4d09-b986-b8637c3007ec tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:18.041492 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:03:18.042457 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:03:18.046107 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b9198089-1f5d-4dcc-9f8a-33c9aa2271c7 req-38f32311-932d-4a15-802f-d1342a803d08 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:18.046803 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b9198089-1f5d-4dcc-9f8a-33c9aa2271c7 req-38f32311-932d-4a15-802f-d1342a803d08 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:18.065698 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-b9198089-1f5d-4dcc-9f8a-33c9aa2271c7 req-38f32311-932d-4a15-802f-d1342a803d08 service nova] Creating event network-changed:3dc35d20-101c-42bc-bd2a-5c110f64ec22 for instance 7e8bf566-3f68-4b61-b60b-34ecb6243c71 on n-h1-master-1 Jun 20 13:03:18.071087 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-b9198089-1f5d-4dcc-9f8a-33c9aa2271c7 req-38f32311-932d-4a15-802f-d1342a803d08 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044129 Jun 20 13:03:18.072078 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3709/7315] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 13:03:18.271304 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-ed0d68bd-512e-4d09-b986-b8637c3007ec tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:03:18.279374 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ed0d68bd-512e-4d09-b986-b8637c3007ec tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71" status: 200 len: 1563 microversion: 2.1 time: 0.257590 Jun 20 13:03:18.280271 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3607/7316] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:03:18 2022] GET /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71 => generated 1563 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:03:39.561975 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:03:39.562731 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=36 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:03:39.567150 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0a4fb9ca-2d4e-4fbd-848d-aa2fac784df1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:03:39.568303 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0a4fb9ca-2d4e-4fbd-848d-aa2fac784df1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 7e8bf566-3f68-4b61-b60b-34ecb6243c71] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:03:39.576159 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a4fb9ca-2d4e-4fbd-848d-aa2fac784df1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:39.576655 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a4fb9ca-2d4e-4fbd-848d-aa2fac784df1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:39.577416 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a4fb9ca-2d4e-4fbd-848d-aa2fac784df1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:39.577857 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a4fb9ca-2d4e-4fbd-848d-aa2fac784df1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:39.628985 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0a4fb9ca-2d4e-4fbd-848d-aa2fac784df1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "POST /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71/action" status: 200 len: 24572 microversion: 2.1 time: 0.068848 Jun 20 13:03:39.629616 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3710/7317] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 13:03:39 2022] POST /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71/action => generated 24572 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 13:03:50.743034 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-00f60d68-3c4a-4887-86e4-31a8def35ebf tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:03:50.743697 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-00f60d68-3c4a-4887-86e4-31a8def35ebf tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 7e8bf566-3f68-4b61-b60b-34ecb6243c71] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:03:50.746278 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=15 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:03:50.747007 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=32 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:03:50.753358 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-00f60d68-3c4a-4887-86e4-31a8def35ebf tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:50.753820 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-00f60d68-3c4a-4887-86e4-31a8def35ebf tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:50.754610 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-00f60d68-3c4a-4887-86e4-31a8def35ebf tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:50.755061 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-00f60d68-3c4a-4887-86e4-31a8def35ebf tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:50.834043 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-00f60d68-3c4a-4887-86e4-31a8def35ebf tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "POST /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71/action" status: 202 len: 0 microversion: 2.1 time: 0.094790 Jun 20 13:03:50.834692 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3608/7318] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 13:03:50 2022] POST /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 13:03:50.843751 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-375c8e68-718b-4911-94ec-e87d55ef53b0 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:03:50.844500 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-375c8e68-718b-4911-94ec-e87d55ef53b0 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 7e8bf566-3f68-4b61-b60b-34ecb6243c71] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:03:50.847238 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:03:50.847923 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=4 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:03:50.853775 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-375c8e68-718b-4911-94ec-e87d55ef53b0 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:50.854353 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-375c8e68-718b-4911-94ec-e87d55ef53b0 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:50.855177 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-375c8e68-718b-4911-94ec-e87d55ef53b0 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:50.855618 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-375c8e68-718b-4911-94ec-e87d55ef53b0 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:51.000049 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-375c8e68-718b-4911-94ec-e87d55ef53b0 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:03:51.007990 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-375c8e68-718b-4911-94ec-e87d55ef53b0 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71" status: 200 len: 1687 microversion: 2.1 time: 0.168460 Jun 20 13:03:51.008967 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3711/7319] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:03:50 2022] GET /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71 => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 13:03:52.031947 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bffa3c92-6393-464a-92b2-a49f4ed4eb50 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:03:52.032713 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bffa3c92-6393-464a-92b2-a49f4ed4eb50 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 7e8bf566-3f68-4b61-b60b-34ecb6243c71] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:03:52.041102 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bffa3c92-6393-464a-92b2-a49f4ed4eb50 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:52.041727 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bffa3c92-6393-464a-92b2-a49f4ed4eb50 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:52.042560 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bffa3c92-6393-464a-92b2-a49f4ed4eb50 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:52.043004 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bffa3c92-6393-464a-92b2-a49f4ed4eb50 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:52.204289 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-bffa3c92-6393-464a-92b2-a49f4ed4eb50 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:03:52.212801 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bffa3c92-6393-464a-92b2-a49f4ed4eb50 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71" status: 200 len: 1667 microversion: 2.1 time: 0.188322 Jun 20 13:03:52.213552 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3609/7320] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:03:52 2022] GET /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71 => generated 1667 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:03:53.303470 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a0000c0f-d297-41d8-ba13-5710eb4dc3df tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:03:53.304542 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a0000c0f-d297-41d8-ba13-5710eb4dc3df tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 7e8bf566-3f68-4b61-b60b-34ecb6243c71] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:03:53.313756 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a0000c0f-d297-41d8-ba13-5710eb4dc3df tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:53.314278 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a0000c0f-d297-41d8-ba13-5710eb4dc3df tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:53.315117 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a0000c0f-d297-41d8-ba13-5710eb4dc3df tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:53.315600 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a0000c0f-d297-41d8-ba13-5710eb4dc3df tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:53.366602 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a0000c0f-d297-41d8-ba13-5710eb4dc3df tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "POST /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71/action" status: 200 len: 32642 microversion: 2.1 time: 0.066651 Jun 20 13:03:53.367338 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3712/7321] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 13:03:53 2022] POST /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71/action => generated 32642 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 13:03:53.381391 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-010fde4e-010e-48ab-b7fc-b0592cbd9190 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:03:53.381961 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-010fde4e-010e-48ab-b7fc-b0592cbd9190 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 7e8bf566-3f68-4b61-b60b-34ecb6243c71] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:03:53.391283 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-010fde4e-010e-48ab-b7fc-b0592cbd9190 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:53.391757 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-010fde4e-010e-48ab-b7fc-b0592cbd9190 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:53.392590 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-010fde4e-010e-48ab-b7fc-b0592cbd9190 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:53.393044 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-010fde4e-010e-48ab-b7fc-b0592cbd9190 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:53.473191 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-010fde4e-010e-48ab-b7fc-b0592cbd9190 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "POST /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71/action" status: 202 len: 0 microversion: 2.1 time: 0.097528 Jun 20 13:03:53.474174 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3610/7322] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 13:03:53 2022] POST /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 13:03:53.486238 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8b91572a-3159-488a-989b-1e9340e8ac26 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:03:53.486728 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8b91572a-3159-488a-989b-1e9340e8ac26 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 7e8bf566-3f68-4b61-b60b-34ecb6243c71] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:03:53.494148 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b91572a-3159-488a-989b-1e9340e8ac26 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:53.494605 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b91572a-3159-488a-989b-1e9340e8ac26 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:53.495390 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b91572a-3159-488a-989b-1e9340e8ac26 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:53.495966 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b91572a-3159-488a-989b-1e9340e8ac26 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:53.644993 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8b91572a-3159-488a-989b-1e9340e8ac26 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:03:53.653697 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8b91572a-3159-488a-989b-1e9340e8ac26 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71" status: 200 len: 1674 microversion: 2.1 time: 0.172630 Jun 20 13:03:53.654147 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3713/7323] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:03:53 2022] GET /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71 => generated 1674 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:03:54.673373 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a2136e3e-51f3-4a1a-b2ed-2bb0b633f61a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:03:54.674078 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a2136e3e-51f3-4a1a-b2ed-2bb0b633f61a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 7e8bf566-3f68-4b61-b60b-34ecb6243c71] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:03:54.680990 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a2136e3e-51f3-4a1a-b2ed-2bb0b633f61a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:54.681449 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a2136e3e-51f3-4a1a-b2ed-2bb0b633f61a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:54.682501 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a2136e3e-51f3-4a1a-b2ed-2bb0b633f61a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:54.682830 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a2136e3e-51f3-4a1a-b2ed-2bb0b633f61a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:54.823399 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a2136e3e-51f3-4a1a-b2ed-2bb0b633f61a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:03:54.831847 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a2136e3e-51f3-4a1a-b2ed-2bb0b633f61a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71" status: 200 len: 1682 microversion: 2.1 time: 0.163973 Jun 20 13:03:54.833696 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3611/7324] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:03:54 2022] GET /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:03:54.925523 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6abf5d24-0894-4eed-8772-3108d7526c96 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:03:54.926373 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6abf5d24-0894-4eed-8772-3108d7526c96 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 7e8bf566-3f68-4b61-b60b-34ecb6243c71] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:03:54.934918 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6abf5d24-0894-4eed-8772-3108d7526c96 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:54.935360 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6abf5d24-0894-4eed-8772-3108d7526c96 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:54.936121 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6abf5d24-0894-4eed-8772-3108d7526c96 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:54.936603 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6abf5d24-0894-4eed-8772-3108d7526c96 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:54.988088 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6abf5d24-0894-4eed-8772-3108d7526c96 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "POST /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71/action" status: 200 len: 38482 microversion: 2.1 time: 0.065965 Jun 20 13:03:54.989035 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3714/7325] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 13:03:54 2022] POST /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71/action => generated 38482 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 13:03:56.273142 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dae057bf-3deb-4f32-9602-edc8be5b4e26 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:03:56.273735 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-dae057bf-3deb-4f32-9602-edc8be5b4e26 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 7e8bf566-3f68-4b61-b60b-34ecb6243c71] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:03:56.275784 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-af7eb12d-8b4e-48d3-9d74-c5be54190985 req-085ae84a-2a4a-4063-9498-7fe5caac0c5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e8bf566-3f68-4b61-b60b-34ecb6243c71", "tag": "3dc35d20-101c-42bc-bd2a-5c110f64ec22"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:03:56.281791 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dae057bf-3deb-4f32-9602-edc8be5b4e26 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:56.282259 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dae057bf-3deb-4f32-9602-edc8be5b4e26 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:56.283040 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dae057bf-3deb-4f32-9602-edc8be5b4e26 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:56.283730 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dae057bf-3deb-4f32-9602-edc8be5b4e26 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:56.286494 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-af7eb12d-8b4e-48d3-9d74-c5be54190985 req-085ae84a-2a4a-4063-9498-7fe5caac0c5a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:56.286908 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-af7eb12d-8b4e-48d3-9d74-c5be54190985 req-085ae84a-2a4a-4063-9498-7fe5caac0c5a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:56.298602 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-af7eb12d-8b4e-48d3-9d74-c5be54190985 req-085ae84a-2a4a-4063-9498-7fe5caac0c5a service nova] Creating event network-changed:3dc35d20-101c-42bc-bd2a-5c110f64ec22 for instance 7e8bf566-3f68-4b61-b60b-34ecb6243c71 on n-h1-master-1 Jun 20 13:03:56.303916 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-af7eb12d-8b4e-48d3-9d74-c5be54190985 req-085ae84a-2a4a-4063-9498-7fe5caac0c5a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033092 Jun 20 13:03:56.304760 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3715/7326] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:03:56.316624 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-dae057bf-3deb-4f32-9602-edc8be5b4e26 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 7e8bf566-3f68-4b61-b60b-34ecb6243c71] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 13:03:56.410966 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dae057bf-3deb-4f32-9602-edc8be5b4e26 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71" status: 204 len: 0 microversion: 2.1 time: 0.141956 Jun 20 13:03:56.412244 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3612/7327] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 13:03:56 2022] DELETE /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 13:03:56.422591 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-20a5fa9a-af88-44e3-af74-0a92462aceaa tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:03:56.423666 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-20a5fa9a-af88-44e3-af74-0a92462aceaa tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 7e8bf566-3f68-4b61-b60b-34ecb6243c71] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:03:56.430622 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-20a5fa9a-af88-44e3-af74-0a92462aceaa tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:56.431331 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-20a5fa9a-af88-44e3-af74-0a92462aceaa tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:56.432346 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-20a5fa9a-af88-44e3-af74-0a92462aceaa tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:56.432997 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-20a5fa9a-af88-44e3-af74-0a92462aceaa tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:56.573022 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-20a5fa9a-af88-44e3-af74-0a92462aceaa tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:03:56.581734 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-20a5fa9a-af88-44e3-af74-0a92462aceaa tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71" status: 200 len: 1688 microversion: 2.1 time: 0.164680 Jun 20 13:03:56.582342 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3716/7328] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:03:56 2022] GET /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71 => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:03:57.599839 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5532aafe-3f8c-4396-a2e9-376673bff692 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:03:57.600535 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5532aafe-3f8c-4396-a2e9-376673bff692 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 7e8bf566-3f68-4b61-b60b-34ecb6243c71] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:03:57.608767 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5532aafe-3f8c-4396-a2e9-376673bff692 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:57.609238 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5532aafe-3f8c-4396-a2e9-376673bff692 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:57.610014 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5532aafe-3f8c-4396-a2e9-376673bff692 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:57.610477 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5532aafe-3f8c-4396-a2e9-376673bff692 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:57.764133 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5532aafe-3f8c-4396-a2e9-376673bff692 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:03:57.772322 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5532aafe-3f8c-4396-a2e9-376673bff692 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71" status: 200 len: 1688 microversion: 2.1 time: 0.176834 Jun 20 13:03:57.772904 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3613/7329] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:03:57 2022] GET /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71 => generated 1688 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:03:58.483936 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-b96a7306-a0b1-4166-8ecf-894bc0f39f01 req-32fe59c1-99b1-4e7c-9de6-8b5a0d09d7ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e8bf566-3f68-4b61-b60b-34ecb6243c71", "name": "network-vif-deleted", "tag": "3dc35d20-101c-42bc-bd2a-5c110f64ec22"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:03:58.496972 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b96a7306-a0b1-4166-8ecf-894bc0f39f01 req-32fe59c1-99b1-4e7c-9de6-8b5a0d09d7ad service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:58.497216 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b96a7306-a0b1-4166-8ecf-894bc0f39f01 req-32fe59c1-99b1-4e7c-9de6-8b5a0d09d7ad service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:58.508851 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-b96a7306-a0b1-4166-8ecf-894bc0f39f01 req-32fe59c1-99b1-4e7c-9de6-8b5a0d09d7ad service nova] Creating event network-vif-deleted:3dc35d20-101c-42bc-bd2a-5c110f64ec22 for instance 7e8bf566-3f68-4b61-b60b-34ecb6243c71 on n-h1-master-1 Jun 20 13:03:58.514508 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-b96a7306-a0b1-4166-8ecf-894bc0f39f01 req-32fe59c1-99b1-4e7c-9de6-8b5a0d09d7ad service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034542 Jun 20 13:03:58.515897 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3717/7330] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:03:58.793038 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3e5dc69f-df5d-4be9-a9b0-8cdeee01b8d9 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:03:58.793828 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3e5dc69f-df5d-4be9-a9b0-8cdeee01b8d9 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 7e8bf566-3f68-4b61-b60b-34ecb6243c71] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:03:58.801634 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3e5dc69f-df5d-4be9-a9b0-8cdeee01b8d9 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:58.802163 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3e5dc69f-df5d-4be9-a9b0-8cdeee01b8d9 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:58.803004 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3e5dc69f-df5d-4be9-a9b0-8cdeee01b8d9 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:58.803665 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3e5dc69f-df5d-4be9-a9b0-8cdeee01b8d9 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:58.849871 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3e5dc69f-df5d-4be9-a9b0-8cdeee01b8d9 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:58.850493 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3e5dc69f-df5d-4be9-a9b0-8cdeee01b8d9 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:58.851012 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-3e5dc69f-df5d-4be9-a9b0-8cdeee01b8d9 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lazy-loading 'fault' on Instance uuid 7e8bf566-3f68-4b61-b60b-34ecb6243c71 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 13:03:58.909906 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3e5dc69f-df5d-4be9-a9b0-8cdeee01b8d9 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:03:58.919361 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3e5dc69f-df5d-4be9-a9b0-8cdeee01b8d9 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71" status: 200 len: 1356 microversion: 2.1 time: 0.131989 Jun 20 13:03:58.920162 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3614/7331] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:03:58 2022] GET /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71 => generated 1356 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:03:59.940675 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e822d963-5be5-460e-812d-826ad0c772ff tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:03:59.941604 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e822d963-5be5-460e-812d-826ad0c772ff tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 7e8bf566-3f68-4b61-b60b-34ecb6243c71] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:03:59.951019 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e822d963-5be5-460e-812d-826ad0c772ff tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:59.951470 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e822d963-5be5-460e-812d-826ad0c772ff tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:59.952227 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e822d963-5be5-460e-812d-826ad0c772ff tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:03:59.952698 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e822d963-5be5-460e-812d-826ad0c772ff tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:03:59.966936 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-e822d963-5be5-460e-812d-826ad0c772ff tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] HTTP exception thrown: Instance 7e8bf566-3f68-4b61-b60b-34ecb6243c71 could not be found. Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e822d963-5be5-460e-812d-826ad0c772ff tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Request method failure captured: Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71 HTTP/1.1 Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisHACr1Z1Pf7gGI9V77m0nnUZzZ5nWX2yhLGjpUHG7LL0xqNYFkbL4_1IIwiiDwVBoZSpoLQS1AbGh1f5DF9yEuMUKi5BxlkuR9qjJWkNvnjSqcfiG8X5PQZ9jVFWFokLDrkM49GBwx_isFNyLwrdbAahsC54lqfNzVHfDIXyGD4YFxM Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: acee41bacfa54fef8c5eb48cb67de032 Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1657633917 Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/acee41bacfa54fef8c5eb48cb67de032"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/acee41bacfa54fef8c5eb48cb67de032"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/acee41bacfa54fef8c5eb48cb67de032"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_acee41bacfa54fef8c5eb48cb67de032"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1657633917 Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: acee41bacfa54fef8c5eb48cb67de032 Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1657633917 Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-TestNetworkAdvancedServerOps-1657633917-project Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: b0fb2c86bbd4403481e17934014fdfb7 Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1657633917-project Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 7e8bf566-3f68-4b61-b60b-34ecb6243c71 could not be found. Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '7e8bf566-3f68-4b61-b60b-34ecb6243c71'} Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e8bf566-3f68-4b61-b60b-34ecb6243c71 could not be found. Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e8bf566-3f68-4b61-b60b-34ecb6243c71 could not be found. Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 13:03:59.968631 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 13:03:59.973276 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 13:03:59.973276 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 13:03:59.973276 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 13:03:59.973276 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 13:03:59.973276 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 13:03:59.973276 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 13:03:59.973276 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e8bf566-3f68-4b61-b60b-34ecb6243c71 could not be found. Jun 20 13:03:59.973276 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 13:03:59.973276 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e822d963-5be5-460e-812d-826ad0c772ff tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Returning 404 to user: Instance 7e8bf566-3f68-4b61-b60b-34ecb6243c71 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 13:03:59.973276 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e822d963-5be5-460e-812d-826ad0c772ff tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71" status: 404 len: 111 microversion: 2.1 time: 0.036561 Jun 20 13:03:59.973276 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3718/7332] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:03:59 2022] GET /compute/v2.1/servers/7e8bf566-3f68-4b61-b60b-34ecb6243c71 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 13:04:03.508435 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ee3ae96e-f7ea-4b1b-895f-ec24dfb5bb04 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '.version_select at 0x7f6073a4cdc0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:04:03.535450 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ee3ae96e-f7ea-4b1b-895f-ec24dfb5bb04 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1508269916" status: 202 len: 0 microversion: 2.1 time: 0.031223 Jun 20 13:04:03.536615 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3615/7333] 10.222.0.27 () {58 vars in 1283 bytes} [Mon Jun 20 13:04:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1508269916 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 13:04:03.562775 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dfc47d1e-4e2b-4e78-bb77-8d11e7e179cb tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Action: 'create', calling method: .version_select at 0x7f60720a38b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2085036110", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIr3g4OOpAnWFTE3NyF5T953mV/5X8RRP0fnWUg6cb4457s+DbxLaGEXwu24RNs9EkCROdVGcnS6f4ZfrWjipNxyclVPkl5ePsg0h0esYwgYduMLccqzkeFNnnh3q1Zog=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:04:03.583309 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-dfc47d1e-4e2b-4e78-bb77-8d11e7e179cb tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Getting quotas for project acee41bacfa54fef8c5eb48cb67de032. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 13:04:03.589486 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-dfc47d1e-4e2b-4e78-bb77-8d11e7e179cb tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Getting quotas for user b0fb2c86bbd4403481e17934014fdfb7 and project acee41bacfa54fef8c5eb48cb67de032. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 13:04:03.614792 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dfc47d1e-4e2b-4e78-bb77-8d11e7e179cb tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.056895 Jun 20 13:04:03.615409 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3719/7334] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 13:04:03 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:04:09.463674 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:04:09.470659 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-24d3f1ff-5eb2-4655-9013-434552f29754 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1807687934", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "0907ec24-f868-4f6f-a9e1-79039c5dc7eb"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2085036110", "security_groups": [{"name": "tempest-secgroup-smoke-1946528711"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:04:09.613382 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-24d3f1ff-5eb2-4655-9013-434552f29754 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] validate_networks() for [('0907ec24-f868-4f6f-a9e1-79039c5dc7eb', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 13:04:10.148760 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-24d3f1ff-5eb2-4655-9013-434552f29754 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 13:04:10.149610 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-24d3f1ff-5eb2-4655-9013-434552f29754 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 13:04:10.150457 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-24d3f1ff-5eb2-4655-9013-434552f29754 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 13:04:10.151219 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-24d3f1ff-5eb2-4655-9013-434552f29754 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 13:04:10.151917 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-24d3f1ff-5eb2-4655-9013-434552f29754 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 13:04:10.164587 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-24d3f1ff-5eb2-4655-9013-434552f29754 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:10.165059 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-24d3f1ff-5eb2-4655-9013-434552f29754 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:10.166043 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-24d3f1ff-5eb2-4655-9013-434552f29754 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:10.166657 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-24d3f1ff-5eb2-4655-9013-434552f29754 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:10.189382 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-24d3f1ff-5eb2-4655-9013-434552f29754 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Getting quotas for project acee41bacfa54fef8c5eb48cb67de032. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 13:04:10.195389 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-24d3f1ff-5eb2-4655-9013-434552f29754 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Getting quotas for user b0fb2c86bbd4403481e17934014fdfb7 and project acee41bacfa54fef8c5eb48cb67de032. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 13:04:10.209658 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-24d3f1ff-5eb2-4655-9013-434552f29754 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 13:04:10.212216 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-24d3f1ff-5eb2-4655-9013-434552f29754 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 998c58e3-3cd1-4d27-8ef2-4bdd76c74543] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 13:04:10.276833 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-24d3f1ff-5eb2-4655-9013-434552f29754 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.814747 Jun 20 13:04:10.284357 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3616/7335] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 13:04:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 13:04:10.287786 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=32 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:04:10.292624 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-becd337b-857b-46ed-a081-de5235a80476 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:04:10.293276 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-becd337b-857b-46ed-a081-de5235a80476 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 998c58e3-3cd1-4d27-8ef2-4bdd76c74543] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:04:10.367806 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-becd337b-857b-46ed-a081-de5235a80476 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:04:10.375754 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-becd337b-857b-46ed-a081-de5235a80476 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543" status: 200 len: 1267 microversion: 2.1 time: 0.090130 Jun 20 13:04:10.376921 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3720/7336] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:04:10 2022] GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543 => generated 1267 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:04:11.398933 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f314e868-ec5f-44b0-a62f-055b7e8a8694 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:04:11.400356 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f314e868-ec5f-44b0-a62f-055b7e8a8694 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 998c58e3-3cd1-4d27-8ef2-4bdd76c74543] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:04:11.409836 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f314e868-ec5f-44b0-a62f-055b7e8a8694 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:11.410881 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f314e868-ec5f-44b0-a62f-055b7e8a8694 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:11.414979 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f314e868-ec5f-44b0-a62f-055b7e8a8694 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:11.414979 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f314e868-ec5f-44b0-a62f-055b7e8a8694 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:11.494387 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f314e868-ec5f-44b0-a62f-055b7e8a8694 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:04:11.502956 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f314e868-ec5f-44b0-a62f-055b7e8a8694 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543" status: 200 len: 1319 microversion: 2.1 time: 0.110676 Jun 20 13:04:11.503781 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3617/7337] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:04:11 2022] GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543 => generated 1319 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:04:12.521595 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1e8b8450-1589-4922-9dd3-faa0cd926afe tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:04:12.522462 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1e8b8450-1589-4922-9dd3-faa0cd926afe tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 998c58e3-3cd1-4d27-8ef2-4bdd76c74543] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:04:12.538223 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1e8b8450-1589-4922-9dd3-faa0cd926afe tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:12.538358 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1e8b8450-1589-4922-9dd3-faa0cd926afe tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:12.539386 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1e8b8450-1589-4922-9dd3-faa0cd926afe tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:12.539987 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1e8b8450-1589-4922-9dd3-faa0cd926afe tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:12.684942 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1e8b8450-1589-4922-9dd3-faa0cd926afe tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:04:12.692931 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1e8b8450-1589-4922-9dd3-faa0cd926afe tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543" status: 200 len: 1393 microversion: 2.1 time: 0.176943 Jun 20 13:04:12.693501 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3721/7338] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:04:12 2022] GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543 => generated 1393 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:04:13.057640 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-2023963c-bd00-430d-9574-53f6465d9461 req-6435e6f5-d30e-4f7d-a441-18fa502bf29e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "998c58e3-3cd1-4d27-8ef2-4bdd76c74543", "tag": "a3585798-b443-4eb1-a0a9-f1fc06cd3a95"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:04:13.079899 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-2023963c-bd00-430d-9574-53f6465d9461 req-6435e6f5-d30e-4f7d-a441-18fa502bf29e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:13.080471 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-2023963c-bd00-430d-9574-53f6465d9461 req-6435e6f5-d30e-4f7d-a441-18fa502bf29e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:13.096904 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-2023963c-bd00-430d-9574-53f6465d9461 req-6435e6f5-d30e-4f7d-a441-18fa502bf29e service nova] Creating event network-changed:a3585798-b443-4eb1-a0a9-f1fc06cd3a95 for instance 998c58e3-3cd1-4d27-8ef2-4bdd76c74543 on n-h1-master-1 Jun 20 13:04:13.102446 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-2023963c-bd00-430d-9574-53f6465d9461 req-6435e6f5-d30e-4f7d-a441-18fa502bf29e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049359 Jun 20 13:04:13.103364 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3618/7339] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:04:13.711259 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6ec2fd1c-5348-4d65-8772-16d6911e0f14 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:04:13.711862 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6ec2fd1c-5348-4d65-8772-16d6911e0f14 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 998c58e3-3cd1-4d27-8ef2-4bdd76c74543] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:04:13.721030 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6ec2fd1c-5348-4d65-8772-16d6911e0f14 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:13.721481 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6ec2fd1c-5348-4d65-8772-16d6911e0f14 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:13.722722 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6ec2fd1c-5348-4d65-8772-16d6911e0f14 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:13.723426 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6ec2fd1c-5348-4d65-8772-16d6911e0f14 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:13.877524 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6ec2fd1c-5348-4d65-8772-16d6911e0f14 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:04:13.887122 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6ec2fd1c-5348-4d65-8772-16d6911e0f14 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543" status: 200 len: 1393 microversion: 2.1 time: 0.179873 Jun 20 13:04:13.888292 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3722/7340] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:04:13 2022] GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543 => generated 1393 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:04:14.907591 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f0f646e6-2507-45e2-acfe-6d49d9df144e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:04:14.908448 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f0f646e6-2507-45e2-acfe-6d49d9df144e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 998c58e3-3cd1-4d27-8ef2-4bdd76c74543] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:04:14.916070 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f0f646e6-2507-45e2-acfe-6d49d9df144e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:14.916565 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f0f646e6-2507-45e2-acfe-6d49d9df144e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:14.917359 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f0f646e6-2507-45e2-acfe-6d49d9df144e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:14.917816 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f0f646e6-2507-45e2-acfe-6d49d9df144e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:15.058261 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f0f646e6-2507-45e2-acfe-6d49d9df144e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:04:15.066463 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f0f646e6-2507-45e2-acfe-6d49d9df144e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543" status: 200 len: 1393 microversion: 2.1 time: 0.163548 Jun 20 13:04:15.067086 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3619/7341] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:04:14 2022] GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543 => generated 1393 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:04:16.086833 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c24600db-5533-4544-a60d-ba1c1455e033 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:04:16.087771 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c24600db-5533-4544-a60d-ba1c1455e033 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 998c58e3-3cd1-4d27-8ef2-4bdd76c74543] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:04:16.096069 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c24600db-5533-4544-a60d-ba1c1455e033 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:16.096563 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c24600db-5533-4544-a60d-ba1c1455e033 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:16.097332 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c24600db-5533-4544-a60d-ba1c1455e033 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:16.097742 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c24600db-5533-4544-a60d-ba1c1455e033 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:16.243772 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c24600db-5533-4544-a60d-ba1c1455e033 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:04:16.252332 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c24600db-5533-4544-a60d-ba1c1455e033 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543" status: 200 len: 1393 microversion: 2.1 time: 0.171788 Jun 20 13:04:16.252919 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3723/7342] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:04:16 2022] GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543 => generated 1393 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:04:17.272698 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1c291fac-d2ed-49cd-aa1a-aa09dbae79c5 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:04:17.273303 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1c291fac-d2ed-49cd-aa1a-aa09dbae79c5 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 998c58e3-3cd1-4d27-8ef2-4bdd76c74543] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:04:17.281150 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1c291fac-d2ed-49cd-aa1a-aa09dbae79c5 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:17.281611 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1c291fac-d2ed-49cd-aa1a-aa09dbae79c5 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:17.282392 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1c291fac-d2ed-49cd-aa1a-aa09dbae79c5 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:17.282835 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1c291fac-d2ed-49cd-aa1a-aa09dbae79c5 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:17.423408 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1c291fac-d2ed-49cd-aa1a-aa09dbae79c5 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:04:17.431338 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1c291fac-d2ed-49cd-aa1a-aa09dbae79c5 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543" status: 200 len: 1393 microversion: 2.1 time: 0.162591 Jun 20 13:04:17.431922 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3620/7343] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:04:17 2022] GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543 => generated 1393 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:04:18.449568 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ca34b4d9-2bb9-42cc-805f-37b9ea5ee102 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:04:18.450225 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ca34b4d9-2bb9-42cc-805f-37b9ea5ee102 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 998c58e3-3cd1-4d27-8ef2-4bdd76c74543] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:04:18.458010 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ca34b4d9-2bb9-42cc-805f-37b9ea5ee102 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:18.458521 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ca34b4d9-2bb9-42cc-805f-37b9ea5ee102 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:18.459360 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ca34b4d9-2bb9-42cc-805f-37b9ea5ee102 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:18.459835 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ca34b4d9-2bb9-42cc-805f-37b9ea5ee102 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:18.869810 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ca34b4d9-2bb9-42cc-805f-37b9ea5ee102 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:04:18.878072 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ca34b4d9-2bb9-42cc-805f-37b9ea5ee102 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543" status: 200 len: 1393 microversion: 2.1 time: 0.432970 Jun 20 13:04:18.878655 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3724/7344] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:04:18 2022] GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543 => generated 1393 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:04:18.978468 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-44764bf7-e855-4a3c-8d77-18324956706d req-2663c2e8-ec93-43fc-a33b-9b134422dcd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "998c58e3-3cd1-4d27-8ef2-4bdd76c74543", "name": "network-vif-plugged", "status": "completed", "tag": "a3585798-b443-4eb1-a0a9-f1fc06cd3a95"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:04:18.987595 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-44764bf7-e855-4a3c-8d77-18324956706d req-2663c2e8-ec93-43fc-a33b-9b134422dcd9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:18.988051 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-44764bf7-e855-4a3c-8d77-18324956706d req-2663c2e8-ec93-43fc-a33b-9b134422dcd9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:19.000080 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-44764bf7-e855-4a3c-8d77-18324956706d req-2663c2e8-ec93-43fc-a33b-9b134422dcd9 service nova] Creating event network-vif-plugged:a3585798-b443-4eb1-a0a9-f1fc06cd3a95 for instance 998c58e3-3cd1-4d27-8ef2-4bdd76c74543 on n-h1-master-1 Jun 20 13:04:19.005359 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-44764bf7-e855-4a3c-8d77-18324956706d req-2663c2e8-ec93-43fc-a33b-9b134422dcd9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030582 Jun 20 13:04:19.005949 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3621/7345] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:04:19.899342 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a6c5a405-9d6e-4e29-8cc5-ae54f02d00a3 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:04:19.900312 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a6c5a405-9d6e-4e29-8cc5-ae54f02d00a3 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 998c58e3-3cd1-4d27-8ef2-4bdd76c74543] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:04:19.908740 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a6c5a405-9d6e-4e29-8cc5-ae54f02d00a3 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:19.909186 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a6c5a405-9d6e-4e29-8cc5-ae54f02d00a3 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:19.909942 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a6c5a405-9d6e-4e29-8cc5-ae54f02d00a3 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:19.910371 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a6c5a405-9d6e-4e29-8cc5-ae54f02d00a3 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:20.048674 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a6c5a405-9d6e-4e29-8cc5-ae54f02d00a3 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:04:20.057293 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a6c5a405-9d6e-4e29-8cc5-ae54f02d00a3 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543" status: 200 len: 1393 microversion: 2.1 time: 0.164486 Jun 20 13:04:20.058345 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3725/7346] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:04:19 2022] GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543 => generated 1393 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:04:21.073068 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:04:21.074009 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:04:21.078736 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6a6dfcab-6f94-4fb5-9b2b-d1fba3f7704a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:04:21.079454 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6a6dfcab-6f94-4fb5-9b2b-d1fba3f7704a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 998c58e3-3cd1-4d27-8ef2-4bdd76c74543] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:04:21.081338 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:04:21.089222 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a6dfcab-6f94-4fb5-9b2b-d1fba3f7704a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:21.089710 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a6dfcab-6f94-4fb5-9b2b-d1fba3f7704a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:21.090498 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a6dfcab-6f94-4fb5-9b2b-d1fba3f7704a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:21.090946 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a6dfcab-6f94-4fb5-9b2b-d1fba3f7704a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:21.298293 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6a6dfcab-6f94-4fb5-9b2b-d1fba3f7704a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:04:21.310132 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6a6dfcab-6f94-4fb5-9b2b-d1fba3f7704a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543" status: 200 len: 1564 microversion: 2.1 time: 0.238928 Jun 20 13:04:21.310726 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3622/7347] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:04:21 2022] GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543 => generated 1564 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:04:21.327449 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d413b11c-4732-425b-b9e6-2850a74a80fb tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:04:21.328117 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d413b11c-4732-425b-b9e6-2850a74a80fb tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 998c58e3-3cd1-4d27-8ef2-4bdd76c74543] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:04:21.330120 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:04:21.331789 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:04:21.338126 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d413b11c-4732-425b-b9e6-2850a74a80fb tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:21.338579 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d413b11c-4732-425b-b9e6-2850a74a80fb tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:21.339335 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d413b11c-4732-425b-b9e6-2850a74a80fb tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:21.339766 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d413b11c-4732-425b-b9e6-2850a74a80fb tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:21.488303 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d413b11c-4732-425b-b9e6-2850a74a80fb tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:04:21.496542 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d413b11c-4732-425b-b9e6-2850a74a80fb tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543" status: 200 len: 1564 microversion: 2.1 time: 0.173694 Jun 20 13:04:21.497393 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3726/7348] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:04:21 2022] GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543 => generated 1564 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:04:23.487547 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-64b3438c-3f1a-460d-8c03-6d161dbe8aa1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:04:23.488263 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-64b3438c-3f1a-460d-8c03-6d161dbe8aa1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 998c58e3-3cd1-4d27-8ef2-4bdd76c74543] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:04:23.492637 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-44e90613-94b3-4eec-9465-feb78b5ae3b5 req-402e05bb-42b5-431d-8fa1-9be1e3c82797 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "998c58e3-3cd1-4d27-8ef2-4bdd76c74543", "tag": "a3585798-b443-4eb1-a0a9-f1fc06cd3a95"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:04:23.497522 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64b3438c-3f1a-460d-8c03-6d161dbe8aa1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:23.497996 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64b3438c-3f1a-460d-8c03-6d161dbe8aa1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:23.498956 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64b3438c-3f1a-460d-8c03-6d161dbe8aa1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:23.499438 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64b3438c-3f1a-460d-8c03-6d161dbe8aa1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:23.502817 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-44e90613-94b3-4eec-9465-feb78b5ae3b5 req-402e05bb-42b5-431d-8fa1-9be1e3c82797 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:23.503286 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-44e90613-94b3-4eec-9465-feb78b5ae3b5 req-402e05bb-42b5-431d-8fa1-9be1e3c82797 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:23.515043 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-44e90613-94b3-4eec-9465-feb78b5ae3b5 req-402e05bb-42b5-431d-8fa1-9be1e3c82797 service nova] Creating event network-changed:a3585798-b443-4eb1-a0a9-f1fc06cd3a95 for instance 998c58e3-3cd1-4d27-8ef2-4bdd76c74543 on n-h1-master-1 Jun 20 13:04:23.521275 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-44e90613-94b3-4eec-9465-feb78b5ae3b5 req-402e05bb-42b5-431d-8fa1-9be1e3c82797 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031998 Jun 20 13:04:23.522178 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3727/7349] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:04:23.742951 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-64b3438c-3f1a-460d-8c03-6d161dbe8aa1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:04:23.751795 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-64b3438c-3f1a-460d-8c03-6d161dbe8aa1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543" status: 200 len: 1564 microversion: 2.1 time: 0.269274 Jun 20 13:04:23.752817 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3623/7350] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:04:23 2022] GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543 => generated 1564 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:04:45.050353 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a7ed0c79-49c9-4b41-adcc-f05c58cfd151 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:04:45.051697 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a7ed0c79-49c9-4b41-adcc-f05c58cfd151 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 998c58e3-3cd1-4d27-8ef2-4bdd76c74543] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:04:45.055521 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:04:45.056178 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=38 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:04:45.065359 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a7ed0c79-49c9-4b41-adcc-f05c58cfd151 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:45.065983 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a7ed0c79-49c9-4b41-adcc-f05c58cfd151 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:45.066955 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a7ed0c79-49c9-4b41-adcc-f05c58cfd151 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:45.067399 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a7ed0c79-49c9-4b41-adcc-f05c58cfd151 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:45.121720 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a7ed0c79-49c9-4b41-adcc-f05c58cfd151 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "POST /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543/action" status: 200 len: 24573 microversion: 2.1 time: 0.077745 Jun 20 13:04:45.122332 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3728/7351] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 13:04:45 2022] POST /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543/action => generated 24573 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 13:04:51.514992 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:04:51.515864 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=36 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:04:51.519884 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4ef962f2-c072-4c01-b961-9e258fb40738 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:04:51.520879 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4ef962f2-c072-4c01-b961-9e258fb40738 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 998c58e3-3cd1-4d27-8ef2-4bdd76c74543] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:04:51.527779 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ef962f2-c072-4c01-b961-9e258fb40738 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:51.528262 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ef962f2-c072-4c01-b961-9e258fb40738 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:51.529058 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ef962f2-c072-4c01-b961-9e258fb40738 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:51.529478 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ef962f2-c072-4c01-b961-9e258fb40738 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:51.609642 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4ef962f2-c072-4c01-b961-9e258fb40738 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "POST /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543/action" status: 202 len: 0 microversion: 2.1 time: 0.095652 Jun 20 13:04:51.610300 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3624/7352] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 13:04:51 2022] POST /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 13:04:51.619459 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5f532be7-6f23-4dcd-b93f-5ed39ef501ad tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:04:51.620234 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5f532be7-6f23-4dcd-b93f-5ed39ef501ad tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 998c58e3-3cd1-4d27-8ef2-4bdd76c74543] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:04:51.627622 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f532be7-6f23-4dcd-b93f-5ed39ef501ad tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:51.628069 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f532be7-6f23-4dcd-b93f-5ed39ef501ad tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:51.628854 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f532be7-6f23-4dcd-b93f-5ed39ef501ad tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:51.629332 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f532be7-6f23-4dcd-b93f-5ed39ef501ad tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:51.828640 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5f532be7-6f23-4dcd-b93f-5ed39ef501ad tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:04:51.840477 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5f532be7-6f23-4dcd-b93f-5ed39ef501ad tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543" status: 200 len: 1675 microversion: 2.1 time: 0.225099 Jun 20 13:04:51.841354 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3729/7353] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:04:51 2022] GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543 => generated 1675 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:04:52.860177 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9cd737ce-6f55-4a36-b794-6d537a76344f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:04:52.860916 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9cd737ce-6f55-4a36-b794-6d537a76344f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 998c58e3-3cd1-4d27-8ef2-4bdd76c74543] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:04:52.867626 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9cd737ce-6f55-4a36-b794-6d537a76344f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:52.868102 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9cd737ce-6f55-4a36-b794-6d537a76344f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:52.868915 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9cd737ce-6f55-4a36-b794-6d537a76344f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:52.869372 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9cd737ce-6f55-4a36-b794-6d537a76344f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:53.016445 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9cd737ce-6f55-4a36-b794-6d537a76344f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:04:53.024626 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9cd737ce-6f55-4a36-b794-6d537a76344f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543" status: 200 len: 1680 microversion: 2.1 time: 0.169762 Jun 20 13:04:53.025208 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3625/7354] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:04:52 2022] GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:04:54.045042 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0a8ccb10-00e4-49db-89dd-1e9f6cd44c2a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:04:54.045630 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0a8ccb10-00e4-49db-89dd-1e9f6cd44c2a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 998c58e3-3cd1-4d27-8ef2-4bdd76c74543] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:04:54.057456 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a8ccb10-00e4-49db-89dd-1e9f6cd44c2a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:54.057943 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a8ccb10-00e4-49db-89dd-1e9f6cd44c2a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:54.059421 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a8ccb10-00e4-49db-89dd-1e9f6cd44c2a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:54.060024 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a8ccb10-00e4-49db-89dd-1e9f6cd44c2a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:54.199427 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0a8ccb10-00e4-49db-89dd-1e9f6cd44c2a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:04:54.207935 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0a8ccb10-00e4-49db-89dd-1e9f6cd44c2a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543" status: 200 len: 1680 microversion: 2.1 time: 0.169359 Jun 20 13:04:54.208479 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3730/7355] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:04:54 2022] GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:04:55.230076 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9c9adabf-d80c-4a63-8942-6a141e9c9a64 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:04:55.231108 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9c9adabf-d80c-4a63-8942-6a141e9c9a64 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 998c58e3-3cd1-4d27-8ef2-4bdd76c74543] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:04:55.242090 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c9adabf-d80c-4a63-8942-6a141e9c9a64 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:55.242552 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c9adabf-d80c-4a63-8942-6a141e9c9a64 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:55.243332 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c9adabf-d80c-4a63-8942-6a141e9c9a64 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:55.243775 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c9adabf-d80c-4a63-8942-6a141e9c9a64 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:55.380517 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9c9adabf-d80c-4a63-8942-6a141e9c9a64 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:04:55.388692 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9c9adabf-d80c-4a63-8942-6a141e9c9a64 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543" status: 200 len: 1680 microversion: 2.1 time: 0.165460 Jun 20 13:04:55.389283 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3626/7356] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:04:55 2022] GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:04:56.409938 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cd240e54-04b8-483f-81e5-867060721e12 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:04:56.410950 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cd240e54-04b8-483f-81e5-867060721e12 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 998c58e3-3cd1-4d27-8ef2-4bdd76c74543] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:04:56.419521 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cd240e54-04b8-483f-81e5-867060721e12 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:56.419977 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cd240e54-04b8-483f-81e5-867060721e12 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:56.420787 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cd240e54-04b8-483f-81e5-867060721e12 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:56.421232 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cd240e54-04b8-483f-81e5-867060721e12 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:56.562620 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cd240e54-04b8-483f-81e5-867060721e12 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:04:56.570555 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cd240e54-04b8-483f-81e5-867060721e12 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543" status: 200 len: 1680 microversion: 2.1 time: 0.167213 Jun 20 13:04:56.571143 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3731/7357] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:04:56 2022] GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:04:57.591701 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cf592187-d34a-4e01-b09f-deb53af28a64 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:04:57.592991 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cf592187-d34a-4e01-b09f-deb53af28a64 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 998c58e3-3cd1-4d27-8ef2-4bdd76c74543] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:04:57.604815 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cf592187-d34a-4e01-b09f-deb53af28a64 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:57.605562 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cf592187-d34a-4e01-b09f-deb53af28a64 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:57.606892 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cf592187-d34a-4e01-b09f-deb53af28a64 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:57.607642 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cf592187-d34a-4e01-b09f-deb53af28a64 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:57.748893 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-cf592187-d34a-4e01-b09f-deb53af28a64 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:04:57.759270 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cf592187-d34a-4e01-b09f-deb53af28a64 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543" status: 200 len: 1680 microversion: 2.1 time: 0.174113 Jun 20 13:04:57.759952 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3627/7358] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:04:57 2022] GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543 => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:04:58.781074 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9ed2fc57-0a83-449e-a2c6-2560a8256e95 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:04:58.782105 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9ed2fc57-0a83-449e-a2c6-2560a8256e95 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 998c58e3-3cd1-4d27-8ef2-4bdd76c74543] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:04:58.791843 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ed2fc57-0a83-449e-a2c6-2560a8256e95 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:58.792358 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ed2fc57-0a83-449e-a2c6-2560a8256e95 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:58.793125 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ed2fc57-0a83-449e-a2c6-2560a8256e95 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:58.793566 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ed2fc57-0a83-449e-a2c6-2560a8256e95 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:58.931744 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9ed2fc57-0a83-449e-a2c6-2560a8256e95 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:04:58.939855 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9ed2fc57-0a83-449e-a2c6-2560a8256e95 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543" status: 200 len: 1680 microversion: 2.1 time: 0.165412 Jun 20 13:04:58.940466 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3732/7359] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:04:58 2022] GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:04:59.960673 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8071dda2-839c-4374-b300-975ad866e98c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:04:59.961298 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8071dda2-839c-4374-b300-975ad866e98c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 998c58e3-3cd1-4d27-8ef2-4bdd76c74543] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:04:59.974752 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8071dda2-839c-4374-b300-975ad866e98c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:59.975220 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8071dda2-839c-4374-b300-975ad866e98c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:04:59.976215 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8071dda2-839c-4374-b300-975ad866e98c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:04:59.976684 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8071dda2-839c-4374-b300-975ad866e98c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:00.115706 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8071dda2-839c-4374-b300-975ad866e98c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:05:00.127227 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8071dda2-839c-4374-b300-975ad866e98c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543" status: 200 len: 1680 microversion: 2.1 time: 0.172104 Jun 20 13:05:00.128017 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3628/7360] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:04:59 2022] GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543 => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:05:01.148182 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b46c2ff7-51e3-4806-8cac-c3a5bae56660 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:05:01.148898 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b46c2ff7-51e3-4806-8cac-c3a5bae56660 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 998c58e3-3cd1-4d27-8ef2-4bdd76c74543] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:05:01.157137 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b46c2ff7-51e3-4806-8cac-c3a5bae56660 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:01.157645 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b46c2ff7-51e3-4806-8cac-c3a5bae56660 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:01.158496 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b46c2ff7-51e3-4806-8cac-c3a5bae56660 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:01.158985 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b46c2ff7-51e3-4806-8cac-c3a5bae56660 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:01.304171 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b46c2ff7-51e3-4806-8cac-c3a5bae56660 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:05:01.312770 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b46c2ff7-51e3-4806-8cac-c3a5bae56660 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543" status: 200 len: 1680 microversion: 2.1 time: 0.170110 Jun 20 13:05:01.313344 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3733/7361] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:05:01 2022] GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:05:02.333093 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fd115692-f992-4cec-b50f-4df22f5261ac tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:05:02.334576 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fd115692-f992-4cec-b50f-4df22f5261ac tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 998c58e3-3cd1-4d27-8ef2-4bdd76c74543] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:05:02.345377 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fd115692-f992-4cec-b50f-4df22f5261ac tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:02.345892 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fd115692-f992-4cec-b50f-4df22f5261ac tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:02.347416 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fd115692-f992-4cec-b50f-4df22f5261ac tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:02.347878 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fd115692-f992-4cec-b50f-4df22f5261ac tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:02.488614 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fd115692-f992-4cec-b50f-4df22f5261ac tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:05:02.496556 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fd115692-f992-4cec-b50f-4df22f5261ac tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543" status: 200 len: 1680 microversion: 2.1 time: 0.169877 Jun 20 13:05:02.497164 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3629/7362] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:05:02 2022] GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:05:03.514887 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7f4851ba-9ada-4269-b985-d541af059e63 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:05:03.515486 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7f4851ba-9ada-4269-b985-d541af059e63 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 998c58e3-3cd1-4d27-8ef2-4bdd76c74543] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:05:03.523125 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7f4851ba-9ada-4269-b985-d541af059e63 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:03.523575 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7f4851ba-9ada-4269-b985-d541af059e63 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:03.524351 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7f4851ba-9ada-4269-b985-d541af059e63 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:03.524804 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7f4851ba-9ada-4269-b985-d541af059e63 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:03.664103 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7f4851ba-9ada-4269-b985-d541af059e63 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:05:03.675645 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7f4851ba-9ada-4269-b985-d541af059e63 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543" status: 200 len: 1683 microversion: 2.1 time: 0.164408 Jun 20 13:05:03.676362 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3734/7363] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:05:03 2022] GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:05:27.915750 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-55fc498c-b8d5-4cf2-bf6a-9e69db03da16 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:05:27.917323 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-55fc498c-b8d5-4cf2-bf6a-9e69db03da16 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 998c58e3-3cd1-4d27-8ef2-4bdd76c74543] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:05:27.920238 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=12 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:05:27.920943 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:05:27.928710 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-55fc498c-b8d5-4cf2-bf6a-9e69db03da16 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:27.929264 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-55fc498c-b8d5-4cf2-bf6a-9e69db03da16 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:27.930254 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-55fc498c-b8d5-4cf2-bf6a-9e69db03da16 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:27.930701 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-55fc498c-b8d5-4cf2-bf6a-9e69db03da16 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:27.986100 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-55fc498c-b8d5-4cf2-bf6a-9e69db03da16 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "POST /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543/action" status: 200 len: 69093 microversion: 2.1 time: 0.077217 Jun 20 13:05:27.986785 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3630/7364] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 13:05:27 2022] POST /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543/action => generated 69093 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 13:05:35.657322 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-69b3d690-cc94-499e-8df7-30e65594698c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:05:35.658415 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-69b3d690-cc94-499e-8df7-30e65594698c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 998c58e3-3cd1-4d27-8ef2-4bdd76c74543] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:05:35.661133 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=14 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:05:35.661755 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=40 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:05:35.669056 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-69b3d690-cc94-499e-8df7-30e65594698c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:35.670050 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-69b3d690-cc94-499e-8df7-30e65594698c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:35.670958 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-69b3d690-cc94-499e-8df7-30e65594698c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:35.671610 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-69b3d690-cc94-499e-8df7-30e65594698c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:35.697674 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-69b3d690-cc94-499e-8df7-30e65594698c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 998c58e3-3cd1-4d27-8ef2-4bdd76c74543] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 13:05:35.719958 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-a0ab1f58-e22b-4b07-8efb-5deb8327d914 req-cb116fff-575f-4cb4-bbfc-6870f63c1bae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "998c58e3-3cd1-4d27-8ef2-4bdd76c74543", "tag": "a3585798-b443-4eb1-a0a9-f1fc06cd3a95"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:05:35.729749 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-a0ab1f58-e22b-4b07-8efb-5deb8327d914 req-cb116fff-575f-4cb4-bbfc-6870f63c1bae service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:35.730202 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-a0ab1f58-e22b-4b07-8efb-5deb8327d914 req-cb116fff-575f-4cb4-bbfc-6870f63c1bae service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:35.742103 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-a0ab1f58-e22b-4b07-8efb-5deb8327d914 req-cb116fff-575f-4cb4-bbfc-6870f63c1bae service nova] Creating event network-changed:a3585798-b443-4eb1-a0a9-f1fc06cd3a95 for instance 998c58e3-3cd1-4d27-8ef2-4bdd76c74543 on n-h1-master-1 Jun 20 13:05:35.748182 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-a0ab1f58-e22b-4b07-8efb-5deb8327d914 req-cb116fff-575f-4cb4-bbfc-6870f63c1bae service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090825 Jun 20 13:05:35.749248 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3631/7365] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:05:35.785310 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-69b3d690-cc94-499e-8df7-30e65594698c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "DELETE /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543" status: 204 len: 0 microversion: 2.1 time: 0.132119 Jun 20 13:05:35.786229 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3735/7366] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 13:05:35 2022] DELETE /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 13:05:35.800720 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f36c7c95-6551-4ccb-a4d2-54a6c5e1526a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:05:35.801779 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f36c7c95-6551-4ccb-a4d2-54a6c5e1526a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 998c58e3-3cd1-4d27-8ef2-4bdd76c74543] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:05:35.813107 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f36c7c95-6551-4ccb-a4d2-54a6c5e1526a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:35.815438 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f36c7c95-6551-4ccb-a4d2-54a6c5e1526a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:35.817565 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f36c7c95-6551-4ccb-a4d2-54a6c5e1526a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:35.819021 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f36c7c95-6551-4ccb-a4d2-54a6c5e1526a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:35.957268 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f36c7c95-6551-4ccb-a4d2-54a6c5e1526a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:05:35.965175 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f36c7c95-6551-4ccb-a4d2-54a6c5e1526a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543" status: 200 len: 1689 microversion: 2.1 time: 0.170019 Jun 20 13:05:35.965752 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3632/7367] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:05:35 2022] GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543 => generated 1689 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:05:36.983659 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-526164de-5b25-455b-96d8-f58d43ce465f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:05:36.984396 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-526164de-5b25-455b-96d8-f58d43ce465f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 998c58e3-3cd1-4d27-8ef2-4bdd76c74543] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:05:36.991700 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-526164de-5b25-455b-96d8-f58d43ce465f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:36.992139 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-526164de-5b25-455b-96d8-f58d43ce465f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:36.992941 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-526164de-5b25-455b-96d8-f58d43ce465f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:36.993383 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-526164de-5b25-455b-96d8-f58d43ce465f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:37.128191 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-526164de-5b25-455b-96d8-f58d43ce465f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:05:37.136035 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-526164de-5b25-455b-96d8-f58d43ce465f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543" status: 200 len: 1689 microversion: 2.1 time: 0.156848 Jun 20 13:05:37.136608 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3736/7368] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:05:36 2022] GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:05:37.867703 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-8636d9de-19eb-4a73-a2e3-83faa3506fd6 req-8ad3831c-a9b5-42bc-ad31-3fcd305fd6d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "998c58e3-3cd1-4d27-8ef2-4bdd76c74543", "name": "network-vif-deleted", "tag": "a3585798-b443-4eb1-a0a9-f1fc06cd3a95"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:05:37.877183 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-8636d9de-19eb-4a73-a2e3-83faa3506fd6 req-8ad3831c-a9b5-42bc-ad31-3fcd305fd6d7 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:37.877605 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-8636d9de-19eb-4a73-a2e3-83faa3506fd6 req-8ad3831c-a9b5-42bc-ad31-3fcd305fd6d7 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:37.889226 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-8636d9de-19eb-4a73-a2e3-83faa3506fd6 req-8ad3831c-a9b5-42bc-ad31-3fcd305fd6d7 service nova] Creating event network-vif-deleted:a3585798-b443-4eb1-a0a9-f1fc06cd3a95 for instance 998c58e3-3cd1-4d27-8ef2-4bdd76c74543 on n-h1-master-1 Jun 20 13:05:37.894179 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-8636d9de-19eb-4a73-a2e3-83faa3506fd6 req-8ad3831c-a9b5-42bc-ad31-3fcd305fd6d7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030271 Jun 20 13:05:37.895072 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3633/7369] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:05:38.153749 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a0ad66af-84d6-4ed8-a8cc-6395374a2bd7 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:05:38.154495 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a0ad66af-84d6-4ed8-a8cc-6395374a2bd7 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 998c58e3-3cd1-4d27-8ef2-4bdd76c74543] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:05:38.162177 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a0ad66af-84d6-4ed8-a8cc-6395374a2bd7 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:38.162625 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a0ad66af-84d6-4ed8-a8cc-6395374a2bd7 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:38.163404 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a0ad66af-84d6-4ed8-a8cc-6395374a2bd7 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:38.163838 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a0ad66af-84d6-4ed8-a8cc-6395374a2bd7 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:38.200975 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a0ad66af-84d6-4ed8-a8cc-6395374a2bd7 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:38.201504 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a0ad66af-84d6-4ed8-a8cc-6395374a2bd7 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:38.201964 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-a0ad66af-84d6-4ed8-a8cc-6395374a2bd7 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lazy-loading 'fault' on Instance uuid 998c58e3-3cd1-4d27-8ef2-4bdd76c74543 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 13:05:38.254098 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a0ad66af-84d6-4ed8-a8cc-6395374a2bd7 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:05:38.262679 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a0ad66af-84d6-4ed8-a8cc-6395374a2bd7 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543" status: 200 len: 1357 microversion: 2.1 time: 0.112897 Jun 20 13:05:38.272798 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3737/7370] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:05:38 2022] GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543 => generated 1357 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:05:39.286925 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cbdd1726-da11-4c15-bb7f-edf7fe5cfe97 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:05:39.288092 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cbdd1726-da11-4c15-bb7f-edf7fe5cfe97 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 998c58e3-3cd1-4d27-8ef2-4bdd76c74543] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:05:39.298932 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cbdd1726-da11-4c15-bb7f-edf7fe5cfe97 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:39.299710 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cbdd1726-da11-4c15-bb7f-edf7fe5cfe97 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:39.301068 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cbdd1726-da11-4c15-bb7f-edf7fe5cfe97 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:39.301820 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cbdd1726-da11-4c15-bb7f-edf7fe5cfe97 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:39.319335 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-cbdd1726-da11-4c15-bb7f-edf7fe5cfe97 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] HTTP exception thrown: Instance 998c58e3-3cd1-4d27-8ef2-4bdd76c74543 could not be found. Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cbdd1726-da11-4c15-bb7f-edf7fe5cfe97 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Request method failure captured: Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543 HTTP/1.1 Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisHACr1Z1Pf7gGI9V77m0nnUZzZ5nWX2yhLGjpUHG7LL0xqNYFkbL4_1IIwiiDwVBoZSpoLQS1AbGh1f5DF9yEuMUKi5BxlkuR9qjJWkNvnjSqcfiG8X5PQZ9jVFWFokLDrkM49GBwx_isFNyLwrdbAahsC54lqfNzVHfDIXyGD4YFxM Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: acee41bacfa54fef8c5eb48cb67de032 Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1657633917 Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/acee41bacfa54fef8c5eb48cb67de032"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/acee41bacfa54fef8c5eb48cb67de032"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/acee41bacfa54fef8c5eb48cb67de032"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_acee41bacfa54fef8c5eb48cb67de032"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1657633917 Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: acee41bacfa54fef8c5eb48cb67de032 Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1657633917 Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-TestNetworkAdvancedServerOps-1657633917-project Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: b0fb2c86bbd4403481e17934014fdfb7 Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1657633917-project Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 998c58e3-3cd1-4d27-8ef2-4bdd76c74543 could not be found. Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '998c58e3-3cd1-4d27-8ef2-4bdd76c74543'} Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 998c58e3-3cd1-4d27-8ef2-4bdd76c74543 could not be found. Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 998c58e3-3cd1-4d27-8ef2-4bdd76c74543 could not be found. Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 13:05:39.321030 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 13:05:39.325673 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 13:05:39.325673 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 13:05:39.325673 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 13:05:39.325673 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 13:05:39.325673 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 13:05:39.325673 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 13:05:39.325673 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 998c58e3-3cd1-4d27-8ef2-4bdd76c74543 could not be found. Jun 20 13:05:39.325673 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 13:05:39.325673 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cbdd1726-da11-4c15-bb7f-edf7fe5cfe97 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Returning 404 to user: Instance 998c58e3-3cd1-4d27-8ef2-4bdd76c74543 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 13:05:39.325673 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cbdd1726-da11-4c15-bb7f-edf7fe5cfe97 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543" status: 404 len: 111 microversion: 2.1 time: 0.044484 Jun 20 13:05:39.325673 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3634/7371] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:05:39 2022] GET /compute/v2.1/servers/998c58e3-3cd1-4d27-8ef2-4bdd76c74543 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 13:05:42.395914 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6ef5b742-8b4b-43aa-a849-26e1f65f8cc1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '.version_select at 0x7f6072050670>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:05:42.418358 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6ef5b742-8b4b-43aa-a849-26e1f65f8cc1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2085036110" status: 202 len: 0 microversion: 2.1 time: 0.026525 Jun 20 13:05:42.419296 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3738/7372] 10.222.0.27 () {58 vars in 1283 bytes} [Mon Jun 20 13:05:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2085036110 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 13:05:42.441015 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-19099e93-5261-4100-bd59-3c36a485e562 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Action: 'create', calling method: .version_select at 0x7f6073189c10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1232796879", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqDjxCJBn92kUl85ISWitcYALV3595yn/l5CLtQIgCPQOp3fzbAm8BT+gXb4KJb3r6myJfGPMHhU3o9p+cjrgrHtc45WQUKFRExqbRPUYzoNGtTYk9xGNRxemP7UQrx3g=="}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:05:42.457879 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-19099e93-5261-4100-bd59-3c36a485e562 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Getting quotas for project acee41bacfa54fef8c5eb48cb67de032. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 13:05:42.463237 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-19099e93-5261-4100-bd59-3c36a485e562 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Getting quotas for user b0fb2c86bbd4403481e17934014fdfb7 and project acee41bacfa54fef8c5eb48cb67de032. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 13:05:42.489158 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-19099e93-5261-4100-bd59-3c36a485e562 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.052086 Jun 20 13:05:42.490103 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3635/7373] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 13:05:42 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:05:48.140173 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a2376d1b-29ff-47d8-9cc9-99c7cf65976c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-191760974", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "d03df0f3-9295-4301-a4b6-072ef6d0dd85"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1232796879", "security_groups": [{"name": "tempest-secgroup-smoke-770629439"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:05:48.259254 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:05:48.283266 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-a2376d1b-29ff-47d8-9cc9-99c7cf65976c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] validate_networks() for [('d03df0f3-9295-4301-a4b6-072ef6d0dd85', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 13:05:48.719667 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-a2376d1b-29ff-47d8-9cc9-99c7cf65976c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 13:05:48.720092 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-a2376d1b-29ff-47d8-9cc9-99c7cf65976c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 13:05:48.720586 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-a2376d1b-29ff-47d8-9cc9-99c7cf65976c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 13:05:48.721540 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-a2376d1b-29ff-47d8-9cc9-99c7cf65976c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 13:05:48.721962 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-a2376d1b-29ff-47d8-9cc9-99c7cf65976c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 13:05:48.732275 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a2376d1b-29ff-47d8-9cc9-99c7cf65976c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:48.732684 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a2376d1b-29ff-47d8-9cc9-99c7cf65976c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:48.733699 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a2376d1b-29ff-47d8-9cc9-99c7cf65976c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:48.734130 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a2376d1b-29ff-47d8-9cc9-99c7cf65976c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:48.753493 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-a2376d1b-29ff-47d8-9cc9-99c7cf65976c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Getting quotas for project acee41bacfa54fef8c5eb48cb67de032. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 13:05:48.759143 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-a2376d1b-29ff-47d8-9cc9-99c7cf65976c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Getting quotas for user b0fb2c86bbd4403481e17934014fdfb7 and project acee41bacfa54fef8c5eb48cb67de032. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 13:05:48.771376 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a2376d1b-29ff-47d8-9cc9-99c7cf65976c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 13:05:48.773780 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a2376d1b-29ff-47d8-9cc9-99c7cf65976c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 13:05:48.821617 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a2376d1b-29ff-47d8-9cc9-99c7cf65976c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.686901 Jun 20 13:05:48.822594 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3739/7374] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 13:05:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 13:05:48.833016 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6c5d1ff3-f5e5-4b58-9ce7-df62415b1d00 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:05:48.833742 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6c5d1ff3-f5e5-4b58-9ce7-df62415b1d00 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:05:48.914624 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6c5d1ff3-f5e5-4b58-9ce7-df62415b1d00 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:05:48.922293 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6c5d1ff3-f5e5-4b58-9ce7-df62415b1d00 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 200 len: 1266 microversion: 2.1 time: 0.093198 Jun 20 13:05:48.928339 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3636/7375] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:05:48 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:05:49.939556 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4ff48eaa-d3c3-4262-b1bb-7acc815f2861 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:05:49.940173 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4ff48eaa-d3c3-4262-b1bb-7acc815f2861 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:05:49.954703 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4ff48eaa-d3c3-4262-b1bb-7acc815f2861 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:49.955465 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4ff48eaa-d3c3-4262-b1bb-7acc815f2861 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:49.956526 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4ff48eaa-d3c3-4262-b1bb-7acc815f2861 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:49.957127 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4ff48eaa-d3c3-4262-b1bb-7acc815f2861 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:50.059219 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4ff48eaa-d3c3-4262-b1bb-7acc815f2861 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:05:50.068428 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4ff48eaa-d3c3-4262-b1bb-7acc815f2861 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 200 len: 1336 microversion: 2.1 time: 0.132926 Jun 20 13:05:50.069826 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3740/7376] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:05:49 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 1336 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:05:51.086108 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fae356c9-9fbe-43b8-86d0-6358fa9be494 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:05:51.086799 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fae356c9-9fbe-43b8-86d0-6358fa9be494 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:05:51.089330 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=16 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:05:51.097000 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fae356c9-9fbe-43b8-86d0-6358fa9be494 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:51.097559 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fae356c9-9fbe-43b8-86d0-6358fa9be494 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:51.098414 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fae356c9-9fbe-43b8-86d0-6358fa9be494 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:51.098859 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fae356c9-9fbe-43b8-86d0-6358fa9be494 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:51.316547 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fae356c9-9fbe-43b8-86d0-6358fa9be494 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:05:51.333035 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fae356c9-9fbe-43b8-86d0-6358fa9be494 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 200 len: 1391 microversion: 2.1 time: 0.250638 Jun 20 13:05:51.334128 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3637/7377] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:05:51 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 1391 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:05:51.491437 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-10eeac4e-d243-4a45-a252-9d8e60badd61 req-28057f87-e306-4367-9d74-34d1a0dfd61b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fe1aac6-35d4-43ca-a504-478b2ea8f12a", "tag": "865a34b4-97cc-41ae-a96c-2741a2acff36"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:05:51.516828 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-10eeac4e-d243-4a45-a252-9d8e60badd61 req-28057f87-e306-4367-9d74-34d1a0dfd61b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:51.517276 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-10eeac4e-d243-4a45-a252-9d8e60badd61 req-28057f87-e306-4367-9d74-34d1a0dfd61b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:51.537366 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-10eeac4e-d243-4a45-a252-9d8e60badd61 req-28057f87-e306-4367-9d74-34d1a0dfd61b service nova] Creating event network-changed:865a34b4-97cc-41ae-a96c-2741a2acff36 for instance 1fe1aac6-35d4-43ca-a504-478b2ea8f12a on n-h1-master-1 Jun 20 13:05:51.546447 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-10eeac4e-d243-4a45-a252-9d8e60badd61 req-28057f87-e306-4367-9d74-34d1a0dfd61b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060038 Jun 20 13:05:51.547074 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3741/7378] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:05:52.354393 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cd3dc5c1-dad6-4c38-a4e2-d6c82a17a54c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:05:52.355330 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cd3dc5c1-dad6-4c38-a4e2-d6c82a17a54c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:05:52.368785 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cd3dc5c1-dad6-4c38-a4e2-d6c82a17a54c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:52.369496 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cd3dc5c1-dad6-4c38-a4e2-d6c82a17a54c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:52.370695 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cd3dc5c1-dad6-4c38-a4e2-d6c82a17a54c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:52.371375 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cd3dc5c1-dad6-4c38-a4e2-d6c82a17a54c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:52.526752 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-cd3dc5c1-dad6-4c38-a4e2-d6c82a17a54c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:05:52.535820 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cd3dc5c1-dad6-4c38-a4e2-d6c82a17a54c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 200 len: 1391 microversion: 2.1 time: 0.187557 Jun 20 13:05:52.537025 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3638/7379] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:05:52 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 1391 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:05:53.553838 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f3d9d70d-6c40-44c7-bede-a1b665632d6c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:05:53.554399 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f3d9d70d-6c40-44c7-bede-a1b665632d6c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:05:53.562354 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f3d9d70d-6c40-44c7-bede-a1b665632d6c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:53.562828 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f3d9d70d-6c40-44c7-bede-a1b665632d6c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:53.563581 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f3d9d70d-6c40-44c7-bede-a1b665632d6c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:53.564019 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f3d9d70d-6c40-44c7-bede-a1b665632d6c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:53.718263 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f3d9d70d-6c40-44c7-bede-a1b665632d6c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:05:53.726144 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f3d9d70d-6c40-44c7-bede-a1b665632d6c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 200 len: 1391 microversion: 2.1 time: 0.176706 Jun 20 13:05:53.727064 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3742/7380] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:05:53 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 1391 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:05:54.747092 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-763ae230-3bc0-457c-bf34-d27e4d5ef789 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:05:54.748064 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-763ae230-3bc0-457c-bf34-d27e4d5ef789 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:05:54.755970 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-763ae230-3bc0-457c-bf34-d27e4d5ef789 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:54.756543 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-763ae230-3bc0-457c-bf34-d27e4d5ef789 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:54.757331 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-763ae230-3bc0-457c-bf34-d27e4d5ef789 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:54.757780 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-763ae230-3bc0-457c-bf34-d27e4d5ef789 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:54.903723 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-763ae230-3bc0-457c-bf34-d27e4d5ef789 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:05:54.911657 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-763ae230-3bc0-457c-bf34-d27e4d5ef789 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 200 len: 1391 microversion: 2.1 time: 0.171319 Jun 20 13:05:54.912266 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3639/7381] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:05:54 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:05:55.929713 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4fe264db-08a4-4293-ac3f-964a7aa78d7e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:05:55.930316 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4fe264db-08a4-4293-ac3f-964a7aa78d7e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:05:55.937720 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4fe264db-08a4-4293-ac3f-964a7aa78d7e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:55.938619 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4fe264db-08a4-4293-ac3f-964a7aa78d7e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:55.939098 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4fe264db-08a4-4293-ac3f-964a7aa78d7e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:55.939543 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4fe264db-08a4-4293-ac3f-964a7aa78d7e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:56.073773 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4fe264db-08a4-4293-ac3f-964a7aa78d7e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:05:56.082085 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4fe264db-08a4-4293-ac3f-964a7aa78d7e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 200 len: 1391 microversion: 2.1 time: 0.156590 Jun 20 13:05:56.082709 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3743/7382] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:05:55 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:05:57.103095 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5bbbd438-d7b6-402a-a167-99d1e61f830e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:05:57.104129 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5bbbd438-d7b6-402a-a167-99d1e61f830e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:05:57.113835 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5bbbd438-d7b6-402a-a167-99d1e61f830e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:57.114309 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5bbbd438-d7b6-402a-a167-99d1e61f830e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:57.115101 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5bbbd438-d7b6-402a-a167-99d1e61f830e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:57.115560 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5bbbd438-d7b6-402a-a167-99d1e61f830e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:57.251828 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5bbbd438-d7b6-402a-a167-99d1e61f830e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:05:57.259545 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5bbbd438-d7b6-402a-a167-99d1e61f830e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 200 len: 1391 microversion: 2.1 time: 0.163059 Jun 20 13:05:57.260251 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3640/7383] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:05:57 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:05:57.633514 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-65a3c443-34c2-44f4-b7ff-0326651fe56e req-c8c5cbbd-2c98-44b7-9988-cd1b91dd6bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fe1aac6-35d4-43ca-a504-478b2ea8f12a", "name": "network-vif-plugged", "status": "completed", "tag": "865a34b4-97cc-41ae-a96c-2741a2acff36"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:05:57.642435 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-65a3c443-34c2-44f4-b7ff-0326651fe56e req-c8c5cbbd-2c98-44b7-9988-cd1b91dd6bf6 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:57.643604 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-65a3c443-34c2-44f4-b7ff-0326651fe56e req-c8c5cbbd-2c98-44b7-9988-cd1b91dd6bf6 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:57.654917 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-65a3c443-34c2-44f4-b7ff-0326651fe56e req-c8c5cbbd-2c98-44b7-9988-cd1b91dd6bf6 service nova] Creating event network-vif-plugged:865a34b4-97cc-41ae-a96c-2741a2acff36 for instance 1fe1aac6-35d4-43ca-a504-478b2ea8f12a on n-h1-master-1 Jun 20 13:05:57.659844 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-65a3c443-34c2-44f4-b7ff-0326651fe56e req-c8c5cbbd-2c98-44b7-9988-cd1b91dd6bf6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092311 Jun 20 13:05:57.660481 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3744/7384] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:05:58.277184 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-54a5b1e2-76de-459b-a657-59cc9eaaff70 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:05:58.277793 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-54a5b1e2-76de-459b-a657-59cc9eaaff70 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:05:58.280712 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:05:58.286834 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-54a5b1e2-76de-459b-a657-59cc9eaaff70 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:58.287294 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-54a5b1e2-76de-459b-a657-59cc9eaaff70 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:58.288070 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-54a5b1e2-76de-459b-a657-59cc9eaaff70 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:58.288542 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-54a5b1e2-76de-459b-a657-59cc9eaaff70 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:58.432230 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-54a5b1e2-76de-459b-a657-59cc9eaaff70 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:05:58.440508 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-54a5b1e2-76de-459b-a657-59cc9eaaff70 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 200 len: 1391 microversion: 2.1 time: 0.167374 Jun 20 13:05:58.441100 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3641/7385] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:05:58 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:05:59.456721 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:05:59.457605 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:05:59.463120 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cbff105e-6a73-4cd3-9b51-9b9a56e11b78 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:05:59.463856 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cbff105e-6a73-4cd3-9b51-9b9a56e11b78 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:05:59.472383 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cbff105e-6a73-4cd3-9b51-9b9a56e11b78 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:59.472918 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cbff105e-6a73-4cd3-9b51-9b9a56e11b78 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:59.473798 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cbff105e-6a73-4cd3-9b51-9b9a56e11b78 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:59.474306 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cbff105e-6a73-4cd3-9b51-9b9a56e11b78 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:59.614696 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cbff105e-6a73-4cd3-9b51-9b9a56e11b78 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:05:59.622334 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cbff105e-6a73-4cd3-9b51-9b9a56e11b78 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 200 len: 1563 microversion: 2.1 time: 0.167774 Jun 20 13:05:59.622905 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3745/7386] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:05:59 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 1563 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:05:59.639031 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5b493c14-53e6-49fe-a831-5a617bc3c05b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:05:59.639672 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5b493c14-53e6-49fe-a831-5a617bc3c05b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:05:59.641959 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:05:59.648409 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5b493c14-53e6-49fe-a831-5a617bc3c05b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:59.648878 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5b493c14-53e6-49fe-a831-5a617bc3c05b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:59.649660 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5b493c14-53e6-49fe-a831-5a617bc3c05b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:05:59.650112 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5b493c14-53e6-49fe-a831-5a617bc3c05b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:05:59.788662 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5b493c14-53e6-49fe-a831-5a617bc3c05b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:05:59.796515 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5b493c14-53e6-49fe-a831-5a617bc3c05b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 200 len: 1563 microversion: 2.1 time: 0.161336 Jun 20 13:05:59.797084 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3642/7387] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:05:59 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:06:01.472924 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-af426e0d-6ff6-44b2-ae68-4d75f259477f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:06:01.473533 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-af426e0d-6ff6-44b2-ae68-4d75f259477f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:06:01.475422 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-7166e74d-f484-4d81-89bf-4d49d75caa10 req-6a7bde55-1d17-4542-bf52-4245f1c3f6db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fe1aac6-35d4-43ca-a504-478b2ea8f12a", "tag": "865a34b4-97cc-41ae-a96c-2741a2acff36"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:06:01.480796 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-af426e0d-6ff6-44b2-ae68-4d75f259477f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:01.481509 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-af426e0d-6ff6-44b2-ae68-4d75f259477f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:01.482505 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-af426e0d-6ff6-44b2-ae68-4d75f259477f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:01.482940 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-af426e0d-6ff6-44b2-ae68-4d75f259477f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:01.484780 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-7166e74d-f484-4d81-89bf-4d49d75caa10 req-6a7bde55-1d17-4542-bf52-4245f1c3f6db service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:01.485240 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-7166e74d-f484-4d81-89bf-4d49d75caa10 req-6a7bde55-1d17-4542-bf52-4245f1c3f6db service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:01.497965 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-7166e74d-f484-4d81-89bf-4d49d75caa10 req-6a7bde55-1d17-4542-bf52-4245f1c3f6db service nova] Creating event network-changed:865a34b4-97cc-41ae-a96c-2741a2acff36 for instance 1fe1aac6-35d4-43ca-a504-478b2ea8f12a on n-h1-master-1 Jun 20 13:06:01.503578 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-7166e74d-f484-4d81-89bf-4d49d75caa10 req-6a7bde55-1d17-4542-bf52-4245f1c3f6db service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031859 Jun 20 13:06:01.504473 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3643/7388] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 13:06:01.635678 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-af426e0d-6ff6-44b2-ae68-4d75f259477f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:06:01.644065 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-af426e0d-6ff6-44b2-ae68-4d75f259477f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 200 len: 1563 microversion: 2.1 time: 0.175193 Jun 20 13:06:01.644925 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3746/7389] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:06:01 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 1563 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:06:22.907443 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=5 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:06:22.908226 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=38 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:06:22.912871 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-88a41e51-40ea-41e0-8f1d-cf20a078d438 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:06:22.913889 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-88a41e51-40ea-41e0-8f1d-cf20a078d438 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:06:22.925162 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88a41e51-40ea-41e0-8f1d-cf20a078d438 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:22.925622 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88a41e51-40ea-41e0-8f1d-cf20a078d438 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:22.926510 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88a41e51-40ea-41e0-8f1d-cf20a078d438 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:22.926964 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88a41e51-40ea-41e0-8f1d-cf20a078d438 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:22.977794 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-88a41e51-40ea-41e0-8f1d-cf20a078d438 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "POST /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a/action" status: 200 len: 24573 microversion: 2.1 time: 0.072166 Jun 20 13:06:22.978419 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3644/7390] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 13:06:22 2022] POST /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a/action => generated 24573 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 13:06:34.018683 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a19f8bf1-94a3-4ce1-91cc-2f8345ed185d tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:06:34.019120 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a19f8bf1-94a3-4ce1-91cc-2f8345ed185d tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:06:34.021893 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:06:34.022559 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=36 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:06:34.030012 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a19f8bf1-94a3-4ce1-91cc-2f8345ed185d tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:34.030718 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a19f8bf1-94a3-4ce1-91cc-2f8345ed185d tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:34.031648 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a19f8bf1-94a3-4ce1-91cc-2f8345ed185d tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:34.032102 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a19f8bf1-94a3-4ce1-91cc-2f8345ed185d tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:34.076711 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a19f8bf1-94a3-4ce1-91cc-2f8345ed185d tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:06:34.085525 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a19f8bf1-94a3-4ce1-91cc-2f8345ed185d tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Old instance type m1.heat2, new instance type m1.heat {{(pid=119127) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 20 13:06:34.093316 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-a19f8bf1-94a3-4ce1-91cc-2f8345ed185d tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 13:06:34.093749 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-a19f8bf1-94a3-4ce1-91cc-2f8345ed185d tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 13:06:34.094227 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-a19f8bf1-94a3-4ce1-91cc-2f8345ed185d tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 13:06:34.095123 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-a19f8bf1-94a3-4ce1-91cc-2f8345ed185d tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 13:06:34.095930 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-a19f8bf1-94a3-4ce1-91cc-2f8345ed185d tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 13:06:34.165200 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a19f8bf1-94a3-4ce1-91cc-2f8345ed185d tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "POST /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a/action" status: 202 len: 0 microversion: 2.1 time: 0.151124 Jun 20 13:06:34.165855 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3747/7391] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 13:06:34 2022] POST /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 13:06:34.174727 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e6163cea-4a15-4bdf-afef-daa58c134834 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:06:34.175435 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e6163cea-4a15-4bdf-afef-daa58c134834 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:06:34.178334 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:06:34.179000 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=4 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:06:34.185926 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e6163cea-4a15-4bdf-afef-daa58c134834 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:34.186389 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e6163cea-4a15-4bdf-afef-daa58c134834 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:34.187158 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e6163cea-4a15-4bdf-afef-daa58c134834 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:34.187640 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e6163cea-4a15-4bdf-afef-daa58c134834 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:34.341783 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e6163cea-4a15-4bdf-afef-daa58c134834 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:06:34.353949 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e6163cea-4a15-4bdf-afef-daa58c134834 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 200 len: 1691 microversion: 2.1 time: 0.179389 Jun 20 13:06:34.354991 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3645/7392] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:06:34 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 1691 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:06:35.368241 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6d380edf-438d-405f-a77d-b912b191d1cf tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:06:35.368824 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6d380edf-438d-405f-a77d-b912b191d1cf tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:06:35.375617 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6d380edf-438d-405f-a77d-b912b191d1cf tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:35.376137 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6d380edf-438d-405f-a77d-b912b191d1cf tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:35.376946 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6d380edf-438d-405f-a77d-b912b191d1cf tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:35.377385 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6d380edf-438d-405f-a77d-b912b191d1cf tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:35.519836 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6d380edf-438d-405f-a77d-b912b191d1cf tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:06:35.531383 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6d380edf-438d-405f-a77d-b912b191d1cf tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 200 len: 1691 microversion: 2.1 time: 0.167903 Jun 20 13:06:35.532371 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3748/7393] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:06:35 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:06:36.553574 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fe4b1e8b-becb-4237-9130-71eff0cb9638 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:06:36.554662 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fe4b1e8b-becb-4237-9130-71eff0cb9638 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:06:36.567388 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe4b1e8b-becb-4237-9130-71eff0cb9638 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:36.568176 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe4b1e8b-becb-4237-9130-71eff0cb9638 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:36.569517 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe4b1e8b-becb-4237-9130-71eff0cb9638 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:36.570268 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe4b1e8b-becb-4237-9130-71eff0cb9638 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:36.717190 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fe4b1e8b-becb-4237-9130-71eff0cb9638 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:06:36.728885 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fe4b1e8b-becb-4237-9130-71eff0cb9638 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 200 len: 1696 microversion: 2.1 time: 0.181799 Jun 20 13:06:36.729778 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3646/7394] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:06:36 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 1696 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:06:37.752944 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b0d592ae-e02c-4e01-a62e-46cbf204910f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:06:37.753577 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b0d592ae-e02c-4e01-a62e-46cbf204910f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:06:37.760999 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b0d592ae-e02c-4e01-a62e-46cbf204910f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:37.761457 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b0d592ae-e02c-4e01-a62e-46cbf204910f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:37.762232 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b0d592ae-e02c-4e01-a62e-46cbf204910f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:37.762673 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b0d592ae-e02c-4e01-a62e-46cbf204910f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:37.899254 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b0d592ae-e02c-4e01-a62e-46cbf204910f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:06:37.907273 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b0d592ae-e02c-4e01-a62e-46cbf204910f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 200 len: 1696 microversion: 2.1 time: 0.160640 Jun 20 13:06:37.907863 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3749/7395] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:06:37 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:06:38.924813 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a739ca04-09b2-48be-83bb-11539b469a14 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:06:38.925576 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a739ca04-09b2-48be-83bb-11539b469a14 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:06:38.933415 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a739ca04-09b2-48be-83bb-11539b469a14 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:38.933888 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a739ca04-09b2-48be-83bb-11539b469a14 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:38.934667 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a739ca04-09b2-48be-83bb-11539b469a14 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:38.935142 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a739ca04-09b2-48be-83bb-11539b469a14 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:39.069174 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a739ca04-09b2-48be-83bb-11539b469a14 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:06:39.077335 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a739ca04-09b2-48be-83bb-11539b469a14 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 200 len: 1696 microversion: 2.1 time: 0.156554 Jun 20 13:06:39.077919 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3647/7396] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:06:38 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:06:40.097789 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1c2043e6-59a1-4818-b828-f87e70d5d30a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:06:40.098525 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1c2043e6-59a1-4818-b828-f87e70d5d30a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:06:40.107774 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c2043e6-59a1-4818-b828-f87e70d5d30a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:40.108345 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c2043e6-59a1-4818-b828-f87e70d5d30a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:40.109248 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c2043e6-59a1-4818-b828-f87e70d5d30a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:40.109762 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c2043e6-59a1-4818-b828-f87e70d5d30a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:40.270368 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1c2043e6-59a1-4818-b828-f87e70d5d30a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:06:40.277998 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1c2043e6-59a1-4818-b828-f87e70d5d30a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 200 len: 1696 microversion: 2.1 time: 0.186170 Jun 20 13:06:40.278563 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3750/7397] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:06:40 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 1696 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:06:41.298993 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5b363670-5d11-4a9c-ac69-e670f5e25233 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:06:41.299610 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5b363670-5d11-4a9c-ac69-e670f5e25233 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:06:41.307147 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5b363670-5d11-4a9c-ac69-e670f5e25233 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:41.307610 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5b363670-5d11-4a9c-ac69-e670f5e25233 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:41.308779 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5b363670-5d11-4a9c-ac69-e670f5e25233 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:41.309258 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5b363670-5d11-4a9c-ac69-e670f5e25233 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:41.458704 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5b363670-5d11-4a9c-ac69-e670f5e25233 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:06:41.466992 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5b363670-5d11-4a9c-ac69-e670f5e25233 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 200 len: 1696 microversion: 2.1 time: 0.174039 Jun 20 13:06:41.467581 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3648/7398] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:06:41 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 1696 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:06:42.488761 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bd4bc953-9b82-410c-bf9d-5bb34d13fbdf tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:06:42.489352 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bd4bc953-9b82-410c-bf9d-5bb34d13fbdf tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:06:42.496901 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bd4bc953-9b82-410c-bf9d-5bb34d13fbdf tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:42.497357 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bd4bc953-9b82-410c-bf9d-5bb34d13fbdf tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:42.498122 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bd4bc953-9b82-410c-bf9d-5bb34d13fbdf tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:42.498556 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bd4bc953-9b82-410c-bf9d-5bb34d13fbdf tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:42.636078 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bd4bc953-9b82-410c-bf9d-5bb34d13fbdf tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:06:42.644138 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bd4bc953-9b82-410c-bf9d-5bb34d13fbdf tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 200 len: 1696 microversion: 2.1 time: 0.162083 Jun 20 13:06:42.644732 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3751/7399] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:06:42 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:06:43.666037 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-349221ec-a821-4705-b65e-6e235030fc85 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:06:43.666998 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-349221ec-a821-4705-b65e-6e235030fc85 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:06:43.679738 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-349221ec-a821-4705-b65e-6e235030fc85 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:43.680580 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-349221ec-a821-4705-b65e-6e235030fc85 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:43.681879 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-349221ec-a821-4705-b65e-6e235030fc85 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:43.682637 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-349221ec-a821-4705-b65e-6e235030fc85 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:43.835632 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-349221ec-a821-4705-b65e-6e235030fc85 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:06:43.843539 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-349221ec-a821-4705-b65e-6e235030fc85 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 200 len: 1696 microversion: 2.1 time: 0.184437 Jun 20 13:06:43.844144 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3649/7400] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:06:43 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 1696 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 13:06:44.861753 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a0689dd4-357e-41fb-ad5c-db60ffba9fae tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:06:44.862560 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a0689dd4-357e-41fb-ad5c-db60ffba9fae tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:06:44.871275 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a0689dd4-357e-41fb-ad5c-db60ffba9fae tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:44.871808 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a0689dd4-357e-41fb-ad5c-db60ffba9fae tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:44.872829 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a0689dd4-357e-41fb-ad5c-db60ffba9fae tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:44.873271 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a0689dd4-357e-41fb-ad5c-db60ffba9fae tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:45.010831 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a0689dd4-357e-41fb-ad5c-db60ffba9fae tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:06:45.019056 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a0689dd4-357e-41fb-ad5c-db60ffba9fae tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 200 len: 1696 microversion: 2.1 time: 0.161641 Jun 20 13:06:45.020048 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3752/7401] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:06:44 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:06:46.038794 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b17d5990-38e4-40ee-9c03-7eb6993e2d39 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:06:46.039416 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b17d5990-38e4-40ee-9c03-7eb6993e2d39 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:06:46.047089 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b17d5990-38e4-40ee-9c03-7eb6993e2d39 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:46.047551 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b17d5990-38e4-40ee-9c03-7eb6993e2d39 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:46.048355 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b17d5990-38e4-40ee-9c03-7eb6993e2d39 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:46.048802 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b17d5990-38e4-40ee-9c03-7eb6993e2d39 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:46.189263 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b17d5990-38e4-40ee-9c03-7eb6993e2d39 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:06:46.197750 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b17d5990-38e4-40ee-9c03-7eb6993e2d39 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 200 len: 1696 microversion: 2.1 time: 0.163282 Jun 20 13:06:46.198339 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3650/7402] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:06:46 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 1696 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:06:47.217805 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5ee126ff-1d14-4ce7-ad7f-3830c000d687 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:06:47.218480 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5ee126ff-1d14-4ce7-ad7f-3830c000d687 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:06:47.227892 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5ee126ff-1d14-4ce7-ad7f-3830c000d687 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:47.228657 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5ee126ff-1d14-4ce7-ad7f-3830c000d687 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:47.229805 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5ee126ff-1d14-4ce7-ad7f-3830c000d687 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:47.230437 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5ee126ff-1d14-4ce7-ad7f-3830c000d687 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:47.375681 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5ee126ff-1d14-4ce7-ad7f-3830c000d687 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:06:47.385082 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5ee126ff-1d14-4ce7-ad7f-3830c000d687 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 200 len: 1696 microversion: 2.1 time: 0.172270 Jun 20 13:06:47.385701 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3753/7403] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:06:47 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 1696 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:06:48.405970 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-af86bfe9-70d7-4d6b-afa2-acae1813de71 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:06:48.406968 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-af86bfe9-70d7-4d6b-afa2-acae1813de71 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:06:48.419134 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-af86bfe9-70d7-4d6b-afa2-acae1813de71 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:48.419912 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-af86bfe9-70d7-4d6b-afa2-acae1813de71 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:48.421255 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-af86bfe9-70d7-4d6b-afa2-acae1813de71 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:48.422014 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-af86bfe9-70d7-4d6b-afa2-acae1813de71 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:48.565683 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-af86bfe9-70d7-4d6b-afa2-acae1813de71 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:06:48.576993 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-af86bfe9-70d7-4d6b-afa2-acae1813de71 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 200 len: 1696 microversion: 2.1 time: 0.177481 Jun 20 13:06:48.577656 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3651/7404] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:06:48 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 1696 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:06:49.597926 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-211e5ef5-e642-48da-94a8-b45c87fea17e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:06:49.598603 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-211e5ef5-e642-48da-94a8-b45c87fea17e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:06:49.606829 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-211e5ef5-e642-48da-94a8-b45c87fea17e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:49.607317 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-211e5ef5-e642-48da-94a8-b45c87fea17e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:49.608240 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-211e5ef5-e642-48da-94a8-b45c87fea17e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:49.608752 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-211e5ef5-e642-48da-94a8-b45c87fea17e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:49.761586 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-211e5ef5-e642-48da-94a8-b45c87fea17e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:06:49.769349 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-211e5ef5-e642-48da-94a8-b45c87fea17e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 200 len: 1696 microversion: 2.1 time: 0.178161 Jun 20 13:06:49.770019 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3754/7405] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:06:49 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 1696 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:06:50.791838 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-80f3c4a4-e376-492d-ac07-0ee23281ad9b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:06:50.792889 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-80f3c4a4-e376-492d-ac07-0ee23281ad9b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:06:50.803639 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80f3c4a4-e376-492d-ac07-0ee23281ad9b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:50.804107 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80f3c4a4-e376-492d-ac07-0ee23281ad9b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:50.804935 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80f3c4a4-e376-492d-ac07-0ee23281ad9b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:50.805397 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80f3c4a4-e376-492d-ac07-0ee23281ad9b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:50.949032 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-80f3c4a4-e376-492d-ac07-0ee23281ad9b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:06:50.957666 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-80f3c4a4-e376-492d-ac07-0ee23281ad9b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 200 len: 1696 microversion: 2.1 time: 0.173371 Jun 20 13:06:50.958253 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3652/7406] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:06:50 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 1696 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:06:51.976663 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a66e0140-44ca-4ebd-a109-128faab14a04 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:06:51.977466 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a66e0140-44ca-4ebd-a109-128faab14a04 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:06:51.985020 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a66e0140-44ca-4ebd-a109-128faab14a04 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:51.985503 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a66e0140-44ca-4ebd-a109-128faab14a04 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:51.986281 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a66e0140-44ca-4ebd-a109-128faab14a04 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:51.986710 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a66e0140-44ca-4ebd-a109-128faab14a04 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:52.138860 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a66e0140-44ca-4ebd-a109-128faab14a04 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:06:52.147276 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a66e0140-44ca-4ebd-a109-128faab14a04 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 200 len: 1696 microversion: 2.1 time: 0.174646 Jun 20 13:06:52.147883 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3755/7407] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:06:51 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 1696 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:06:53.164661 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1e7ee638-83fa-4aa2-a5c9-b27d2fae85d9 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:06:53.165286 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1e7ee638-83fa-4aa2-a5c9-b27d2fae85d9 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:06:53.172779 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e7ee638-83fa-4aa2-a5c9-b27d2fae85d9 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:53.173280 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e7ee638-83fa-4aa2-a5c9-b27d2fae85d9 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:53.174042 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e7ee638-83fa-4aa2-a5c9-b27d2fae85d9 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:53.174797 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e7ee638-83fa-4aa2-a5c9-b27d2fae85d9 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:53.358785 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-1e7ee638-83fa-4aa2-a5c9-b27d2fae85d9 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:06:53.366901 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1e7ee638-83fa-4aa2-a5c9-b27d2fae85d9 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 200 len: 1695 microversion: 2.1 time: 0.206199 Jun 20 13:06:53.367489 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3653/7408] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:06:53 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 1695 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:06:53.697396 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-18b290fb-5580-4672-baf7-623ecf1507d8 req-25c6ea69-2e6a-4d90-9a20-9602fa765426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fe1aac6-35d4-43ca-a504-478b2ea8f12a", "name": "network-vif-unplugged", "status": "completed", "tag": "865a34b4-97cc-41ae-a96c-2741a2acff36"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:06:53.707355 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-18b290fb-5580-4672-baf7-623ecf1507d8 req-25c6ea69-2e6a-4d90-9a20-9602fa765426 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:53.707808 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-18b290fb-5580-4672-baf7-623ecf1507d8 req-25c6ea69-2e6a-4d90-9a20-9602fa765426 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:53.720399 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-18b290fb-5580-4672-baf7-623ecf1507d8 req-25c6ea69-2e6a-4d90-9a20-9602fa765426 service nova] Creating event network-vif-unplugged:865a34b4-97cc-41ae-a96c-2741a2acff36 for instance 1fe1aac6-35d4-43ca-a504-478b2ea8f12a on n-h2-master-1 Jun 20 13:06:53.726281 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [req-18b290fb-5580-4672-baf7-623ecf1507d8 req-25c6ea69-2e6a-4d90-9a20-9602fa765426 service nova] Instance 1fe1aac6-35d4-43ca-a504-478b2ea8f12a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119127) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 13:06:53.737778 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-18b290fb-5580-4672-baf7-623ecf1507d8 req-25c6ea69-2e6a-4d90-9a20-9602fa765426 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043935 Jun 20 13:06:53.738698 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3756/7409] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:06:54.385300 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-59a61214-c406-4211-b5f7-92d397161db3 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:06:54.385868 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-59a61214-c406-4211-b5f7-92d397161db3 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:06:54.393015 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-59a61214-c406-4211-b5f7-92d397161db3 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:54.393485 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-59a61214-c406-4211-b5f7-92d397161db3 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:54.394478 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-59a61214-c406-4211-b5f7-92d397161db3 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:54.394935 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-59a61214-c406-4211-b5f7-92d397161db3 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:54.644412 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-59a61214-c406-4211-b5f7-92d397161db3 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:06:54.651986 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-59a61214-c406-4211-b5f7-92d397161db3 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 200 len: 1695 microversion: 2.1 time: 0.270921 Jun 20 13:06:54.652614 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3654/7410] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:06:54 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 1695 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:06:55.671521 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-240936cf-6e44-4686-b1ed-d6cf9c0b1085 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:06:55.672236 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-240936cf-6e44-4686-b1ed-d6cf9c0b1085 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:06:55.679358 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-240936cf-6e44-4686-b1ed-d6cf9c0b1085 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:55.679833 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-240936cf-6e44-4686-b1ed-d6cf9c0b1085 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:55.680635 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-240936cf-6e44-4686-b1ed-d6cf9c0b1085 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:55.681077 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-240936cf-6e44-4686-b1ed-d6cf9c0b1085 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:55.761075 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-a0ce4046-a98b-433c-b156-367e5985f513 req-c8334325-7ccb-4b1b-8c1d-61c8bd944c1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fe1aac6-35d4-43ca-a504-478b2ea8f12a", "tag": "865a34b4-97cc-41ae-a96c-2741a2acff36"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:06:55.770966 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-a0ce4046-a98b-433c-b156-367e5985f513 req-c8334325-7ccb-4b1b-8c1d-61c8bd944c1d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:55.771455 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-a0ce4046-a98b-433c-b156-367e5985f513 req-c8334325-7ccb-4b1b-8c1d-61c8bd944c1d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:55.783789 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-a0ce4046-a98b-433c-b156-367e5985f513 req-c8334325-7ccb-4b1b-8c1d-61c8bd944c1d service nova] Creating event network-changed:865a34b4-97cc-41ae-a96c-2741a2acff36 for instance 1fe1aac6-35d4-43ca-a504-478b2ea8f12a on n-h2-master-1 Jun 20 13:06:55.790097 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [req-a0ce4046-a98b-433c-b156-367e5985f513 req-c8334325-7ccb-4b1b-8c1d-61c8bd944c1d service nova] Instance 1fe1aac6-35d4-43ca-a504-478b2ea8f12a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 20 13:06:55.801755 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-a0ce4046-a98b-433c-b156-367e5985f513 req-c8334325-7ccb-4b1b-8c1d-61c8bd944c1d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044325 Jun 20 13:06:55.802385 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3655/7411] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:06:55.822340 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-240936cf-6e44-4686-b1ed-d6cf9c0b1085 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:06:55.830237 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-240936cf-6e44-4686-b1ed-d6cf9c0b1085 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 200 len: 1693 microversion: 2.1 time: 0.164310 Jun 20 13:06:55.830818 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3757/7412] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:06:55 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:06:56.854345 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7057c5be-dd07-47ae-9301-686a586f2977 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:06:56.855516 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7057c5be-dd07-47ae-9301-686a586f2977 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:06:56.865829 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7057c5be-dd07-47ae-9301-686a586f2977 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:56.866291 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7057c5be-dd07-47ae-9301-686a586f2977 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:56.867070 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7057c5be-dd07-47ae-9301-686a586f2977 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:56.867518 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7057c5be-dd07-47ae-9301-686a586f2977 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:57.021402 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7057c5be-dd07-47ae-9301-686a586f2977 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:06:57.032898 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7057c5be-dd07-47ae-9301-686a586f2977 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 200 len: 1693 microversion: 2.1 time: 0.187217 Jun 20 13:06:57.033619 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3656/7413] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:06:56 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 1693 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:06:58.050735 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-25156182-ea65-4fa9-88b1-44d829290ae3 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:06:58.051341 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-25156182-ea65-4fa9-88b1-44d829290ae3 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:06:58.059190 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-25156182-ea65-4fa9-88b1-44d829290ae3 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:58.059646 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-25156182-ea65-4fa9-88b1-44d829290ae3 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:58.060462 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-25156182-ea65-4fa9-88b1-44d829290ae3 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:58.060901 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-25156182-ea65-4fa9-88b1-44d829290ae3 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:58.215765 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-25156182-ea65-4fa9-88b1-44d829290ae3 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:06:58.224548 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-25156182-ea65-4fa9-88b1-44d829290ae3 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 200 len: 1693 microversion: 2.1 time: 0.177697 Jun 20 13:06:58.225310 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3758/7414] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:06:58 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 1693 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:06:59.246358 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5f21f9ff-7262-47f2-b0dd-a454e5cdfd7e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:06:59.247407 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5f21f9ff-7262-47f2-b0dd-a454e5cdfd7e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:06:59.257043 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5f21f9ff-7262-47f2-b0dd-a454e5cdfd7e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:59.257505 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5f21f9ff-7262-47f2-b0dd-a454e5cdfd7e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:59.258287 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5f21f9ff-7262-47f2-b0dd-a454e5cdfd7e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:59.258731 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5f21f9ff-7262-47f2-b0dd-a454e5cdfd7e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:59.402919 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5f21f9ff-7262-47f2-b0dd-a454e5cdfd7e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:06:59.410880 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5f21f9ff-7262-47f2-b0dd-a454e5cdfd7e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 200 len: 1690 microversion: 2.1 time: 0.171078 Jun 20 13:06:59.411436 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3657/7415] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:06:59 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 1690 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:06:59.427283 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c877c877-d641-4289-8752-abe27cd10443 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:06:59.427825 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c877c877-d641-4289-8752-abe27cd10443 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:06:59.435307 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c877c877-d641-4289-8752-abe27cd10443 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:59.435756 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c877c877-d641-4289-8752-abe27cd10443 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:59.436556 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c877c877-d641-4289-8752-abe27cd10443 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:59.436987 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c877c877-d641-4289-8752-abe27cd10443 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:59.498232 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c877c877-d641-4289-8752-abe27cd10443 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "POST /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a/action" status: 204 len: 0 microversion: 2.1 time: 0.074531 Jun 20 13:06:59.499147 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3759/7416] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 13:06:59 2022] POST /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 13:06:59.508764 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-40f07cc9-fce5-489a-a311-c8b4f1f50df5 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:06:59.509666 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-40f07cc9-fce5-489a-a311-c8b4f1f50df5 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:06:59.517567 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-40f07cc9-fce5-489a-a311-c8b4f1f50df5 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:59.518332 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-40f07cc9-fce5-489a-a311-c8b4f1f50df5 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:59.519695 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-40f07cc9-fce5-489a-a311-c8b4f1f50df5 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:59.520409 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-40f07cc9-fce5-489a-a311-c8b4f1f50df5 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:59.749823 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-40f07cc9-fce5-489a-a311-c8b4f1f50df5 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:06:59.758190 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-40f07cc9-fce5-489a-a311-c8b4f1f50df5 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 200 len: 1690 microversion: 2.1 time: 0.254585 Jun 20 13:06:59.758828 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3658/7417] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:06:59 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 1690 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:06:59.775693 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0ae4e66a-8770-4e63-8a13-755e7720013d tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:06:59.776435 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0ae4e66a-8770-4e63-8a13-755e7720013d tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:06:59.782938 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0ae4e66a-8770-4e63-8a13-755e7720013d tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:59.783396 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0ae4e66a-8770-4e63-8a13-755e7720013d tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:59.784155 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0ae4e66a-8770-4e63-8a13-755e7720013d tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:06:59.784920 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0ae4e66a-8770-4e63-8a13-755e7720013d tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:06:59.919336 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0ae4e66a-8770-4e63-8a13-755e7720013d tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:06:59.928585 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0ae4e66a-8770-4e63-8a13-755e7720013d tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 200 len: 1690 microversion: 2.1 time: 0.157140 Jun 20 13:06:59.929176 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3760/7418] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:06:59 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:07:00.946790 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-10bf0215-74c4-44f3-8cbc-dbc27b5e1b66 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:07:00.947393 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-10bf0215-74c4-44f3-8cbc-dbc27b5e1b66 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:07:00.955160 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-10bf0215-74c4-44f3-8cbc-dbc27b5e1b66 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:07:00.955584 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-10bf0215-74c4-44f3-8cbc-dbc27b5e1b66 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:07:00.956725 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-10bf0215-74c4-44f3-8cbc-dbc27b5e1b66 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:07:00.956873 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-10bf0215-74c4-44f3-8cbc-dbc27b5e1b66 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:07:01.097796 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-10bf0215-74c4-44f3-8cbc-dbc27b5e1b66 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:07:01.105594 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-10bf0215-74c4-44f3-8cbc-dbc27b5e1b66 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 200 len: 1682 microversion: 2.1 time: 0.162813 Jun 20 13:07:01.106164 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3659/7419] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:07:00 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:07:01.614235 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-52d80762-b6e1-41bd-b781-c005e14d6c19 req-78666e1f-3f9e-4050-9a79-0a0c2c8e4beb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fe1aac6-35d4-43ca-a504-478b2ea8f12a", "name": "network-vif-plugged", "status": "completed", "tag": "865a34b4-97cc-41ae-a96c-2741a2acff36"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:07:01.624122 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-52d80762-b6e1-41bd-b781-c005e14d6c19 req-78666e1f-3f9e-4050-9a79-0a0c2c8e4beb service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:07:01.624605 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-52d80762-b6e1-41bd-b781-c005e14d6c19 req-78666e1f-3f9e-4050-9a79-0a0c2c8e4beb service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:07:01.636450 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-52d80762-b6e1-41bd-b781-c005e14d6c19 req-78666e1f-3f9e-4050-9a79-0a0c2c8e4beb service nova] Creating event network-vif-plugged:865a34b4-97cc-41ae-a96c-2741a2acff36 for instance 1fe1aac6-35d4-43ca-a504-478b2ea8f12a on n-h2-master-1 Jun 20 13:07:01.641466 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-52d80762-b6e1-41bd-b781-c005e14d6c19 req-78666e1f-3f9e-4050-9a79-0a0c2c8e4beb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031065 Jun 20 13:07:01.642065 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3761/7420] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:07:31.363809 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bc565b58-bd32-44f5-bd78-00a18db28366 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:07:31.365517 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bc565b58-bd32-44f5-bd78-00a18db28366 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:07:31.369273 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=30 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:07:31.369945 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=88 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:07:31.376826 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bc565b58-bd32-44f5-bd78-00a18db28366 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:07:31.377314 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bc565b58-bd32-44f5-bd78-00a18db28366 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:07:31.378111 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bc565b58-bd32-44f5-bd78-00a18db28366 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:07:31.378561 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bc565b58-bd32-44f5-bd78-00a18db28366 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:07:31.445893 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bc565b58-bd32-44f5-bd78-00a18db28366 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "POST /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a/action" status: 200 len: 24577 microversion: 2.1 time: 0.089085 Jun 20 13:07:31.446809 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3660/7421] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 13:07:31 2022] POST /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a/action => generated 24577 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 13:07:50.180176 n-d-master-1 devstack@n-api.service[119128]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 13:07:50.181189 n-d-master-1 devstack@n-api.service[119128]: Mon Jun 20 13:07:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 13:07:55.043250 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=34 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:07:55.045069 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:07:55.049063 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-dc5ce046-b61c-4677-8376-f8436db8fe13 req-c50f666a-8439-4369-b9a0-a64ddeff0d64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fe1aac6-35d4-43ca-a504-478b2ea8f12a", "tag": "865a34b4-97cc-41ae-a96c-2741a2acff36"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:07:55.050389 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8803e179-afa3-41a7-b0fa-16ce0004ae5b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:07:55.051292 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8803e179-afa3-41a7-b0fa-16ce0004ae5b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:07:55.054632 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:07:55.055339 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=4 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:07:55.058620 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8803e179-afa3-41a7-b0fa-16ce0004ae5b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:07:55.059093 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8803e179-afa3-41a7-b0fa-16ce0004ae5b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:07:55.060109 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8803e179-afa3-41a7-b0fa-16ce0004ae5b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:07:55.060803 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8803e179-afa3-41a7-b0fa-16ce0004ae5b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:07:55.061889 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-dc5ce046-b61c-4677-8376-f8436db8fe13 req-c50f666a-8439-4369-b9a0-a64ddeff0d64 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:07:55.062350 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-dc5ce046-b61c-4677-8376-f8436db8fe13 req-c50f666a-8439-4369-b9a0-a64ddeff0d64 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:07:55.075512 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-dc5ce046-b61c-4677-8376-f8436db8fe13 req-c50f666a-8439-4369-b9a0-a64ddeff0d64 service nova] Creating event network-changed:865a34b4-97cc-41ae-a96c-2741a2acff36 for instance 1fe1aac6-35d4-43ca-a504-478b2ea8f12a on n-h2-master-1 Jun 20 13:07:55.081199 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-dc5ce046-b61c-4677-8376-f8436db8fe13 req-c50f666a-8439-4369-b9a0-a64ddeff0d64 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037179 Jun 20 13:07:55.081670 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3661/7422] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:07:55.089364 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8803e179-afa3-41a7-b0fa-16ce0004ae5b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 13:07:55.178414 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8803e179-afa3-41a7-b0fa-16ce0004ae5b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 204 len: 0 microversion: 2.1 time: 0.137118 Jun 20 13:07:55.179150 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3762/7423] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 13:07:55 2022] DELETE /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 13:07:55.190921 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2029d224-729a-4d1d-a469-8768a1626586 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:07:55.191688 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2029d224-729a-4d1d-a469-8768a1626586 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:07:55.198954 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2029d224-729a-4d1d-a469-8768a1626586 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:07:55.199460 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2029d224-729a-4d1d-a469-8768a1626586 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:07:55.200327 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2029d224-729a-4d1d-a469-8768a1626586 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:07:55.200783 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2029d224-729a-4d1d-a469-8768a1626586 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:07:55.345867 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2029d224-729a-4d1d-a469-8768a1626586 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:07:55.353836 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2029d224-729a-4d1d-a469-8768a1626586 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 200 len: 1688 microversion: 2.1 time: 0.168993 Jun 20 13:07:55.354408 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3662/7424] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:07:55 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:07:56.372041 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-09dd8ad7-f36e-465c-a3e2-43474c8e1242 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:07:56.373524 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-09dd8ad7-f36e-465c-a3e2-43474c8e1242 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:07:56.380678 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-09dd8ad7-f36e-465c-a3e2-43474c8e1242 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:07:56.381232 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-09dd8ad7-f36e-465c-a3e2-43474c8e1242 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:07:56.382092 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-09dd8ad7-f36e-465c-a3e2-43474c8e1242 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:07:56.382595 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-09dd8ad7-f36e-465c-a3e2-43474c8e1242 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:07:56.521856 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-09dd8ad7-f36e-465c-a3e2-43474c8e1242 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:07:56.533516 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-09dd8ad7-f36e-465c-a3e2-43474c8e1242 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 200 len: 1688 microversion: 2.1 time: 0.165889 Jun 20 13:07:56.534779 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3763/7425] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:07:56 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:07:57.340483 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-c4261fbe-32f3-40fe-b3a4-3d80094ca290 req-b5cb8ede-3159-4a6d-af6d-8803fd1931e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fe1aac6-35d4-43ca-a504-478b2ea8f12a", "name": "network-vif-deleted", "tag": "865a34b4-97cc-41ae-a96c-2741a2acff36"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:07:57.349334 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-c4261fbe-32f3-40fe-b3a4-3d80094ca290 req-b5cb8ede-3159-4a6d-af6d-8803fd1931e9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:07:57.349939 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-c4261fbe-32f3-40fe-b3a4-3d80094ca290 req-b5cb8ede-3159-4a6d-af6d-8803fd1931e9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:07:57.361593 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-c4261fbe-32f3-40fe-b3a4-3d80094ca290 req-b5cb8ede-3159-4a6d-af6d-8803fd1931e9 service nova] Creating event network-vif-deleted:865a34b4-97cc-41ae-a96c-2741a2acff36 for instance 1fe1aac6-35d4-43ca-a504-478b2ea8f12a on n-h2-master-1 Jun 20 13:07:57.366510 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-c4261fbe-32f3-40fe-b3a4-3d80094ca290 req-b5cb8ede-3159-4a6d-af6d-8803fd1931e9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158190 Jun 20 13:07:57.367174 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3663/7426] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:07:57.556066 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e6622d29-c5c1-4259-b578-d42adeca5d43 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:07:57.556913 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e6622d29-c5c1-4259-b578-d42adeca5d43 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:07:57.566018 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e6622d29-c5c1-4259-b578-d42adeca5d43 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:07:57.566480 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e6622d29-c5c1-4259-b578-d42adeca5d43 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:07:57.567291 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e6622d29-c5c1-4259-b578-d42adeca5d43 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:07:57.567725 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e6622d29-c5c1-4259-b578-d42adeca5d43 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:07:57.614093 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e6622d29-c5c1-4259-b578-d42adeca5d43 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:07:57.614765 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e6622d29-c5c1-4259-b578-d42adeca5d43 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:07:57.615661 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-e6622d29-c5c1-4259-b578-d42adeca5d43 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lazy-loading 'fault' on Instance uuid 1fe1aac6-35d4-43ca-a504-478b2ea8f12a {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 13:07:57.663075 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-e6622d29-c5c1-4259-b578-d42adeca5d43 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:07:57.671940 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e6622d29-c5c1-4259-b578-d42adeca5d43 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 200 len: 1356 microversion: 2.1 time: 0.118977 Jun 20 13:07:57.672873 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3764/7427] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:07:57 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 1356 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:07:58.749970 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-59d594b6-3505-4774-bc1d-fcb6e2af98f8 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:07:58.751108 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-59d594b6-3505-4774-bc1d-fcb6e2af98f8 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 1fe1aac6-35d4-43ca-a504-478b2ea8f12a] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:07:58.761323 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-59d594b6-3505-4774-bc1d-fcb6e2af98f8 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:07:58.762048 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-59d594b6-3505-4774-bc1d-fcb6e2af98f8 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:07:58.763064 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-59d594b6-3505-4774-bc1d-fcb6e2af98f8 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:07:58.763738 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-59d594b6-3505-4774-bc1d-fcb6e2af98f8 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:07:58.781252 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-59d594b6-3505-4774-bc1d-fcb6e2af98f8 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] HTTP exception thrown: Instance 1fe1aac6-35d4-43ca-a504-478b2ea8f12a could not be found. Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-59d594b6-3505-4774-bc1d-fcb6e2af98f8 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Request method failure captured: Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a HTTP/1.1 Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisHACr1Z1Pf7gGI9V77m0nnUZzZ5nWX2yhLGjpUHG7LL0xqNYFkbL4_1IIwiiDwVBoZSpoLQS1AbGh1f5DF9yEuMUKi5BxlkuR9qjJWkNvnjSqcfiG8X5PQZ9jVFWFokLDrkM49GBwx_isFNyLwrdbAahsC54lqfNzVHfDIXyGD4YFxM Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: acee41bacfa54fef8c5eb48cb67de032 Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1657633917 Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/acee41bacfa54fef8c5eb48cb67de032"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/acee41bacfa54fef8c5eb48cb67de032"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/acee41bacfa54fef8c5eb48cb67de032"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_acee41bacfa54fef8c5eb48cb67de032"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1657633917 Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: acee41bacfa54fef8c5eb48cb67de032 Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1657633917 Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-TestNetworkAdvancedServerOps-1657633917-project Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: b0fb2c86bbd4403481e17934014fdfb7 Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1657633917-project Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 1fe1aac6-35d4-43ca-a504-478b2ea8f12a could not be found. Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '1fe1aac6-35d4-43ca-a504-478b2ea8f12a'} Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fe1aac6-35d4-43ca-a504-478b2ea8f12a could not be found. Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fe1aac6-35d4-43ca-a504-478b2ea8f12a could not be found. Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 13:07:58.782941 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 13:07:58.787202 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 13:07:58.787202 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 13:07:58.787202 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 13:07:58.787202 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 13:07:58.787202 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 13:07:58.787202 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 13:07:58.787202 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fe1aac6-35d4-43ca-a504-478b2ea8f12a could not be found. Jun 20 13:07:58.787202 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 13:07:58.787202 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-59d594b6-3505-4774-bc1d-fcb6e2af98f8 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Returning 404 to user: Instance 1fe1aac6-35d4-43ca-a504-478b2ea8f12a could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 13:07:58.787202 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-59d594b6-3505-4774-bc1d-fcb6e2af98f8 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a" status: 404 len: 111 microversion: 2.1 time: 0.096975 Jun 20 13:07:58.787202 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3664/7428] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:07:58 2022] GET /compute/v2.1/servers/1fe1aac6-35d4-43ca-a504-478b2ea8f12a => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 13:08:02.397151 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6eb89457-e1b9-4f6a-8577-fb1925b5b16a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '.version_select at 0x7f60720f0280>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:08:02.422738 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6eb89457-e1b9-4f6a-8577-fb1925b5b16a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1232796879" status: 202 len: 0 microversion: 2.1 time: 0.033571 Jun 20 13:08:02.424245 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3765/7429] 10.222.0.27 () {58 vars in 1283 bytes} [Mon Jun 20 13:08:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1232796879 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 13:08:02.449651 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-255f7293-88c9-4a09-abde-c86c2c3891aa tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Action: 'create', calling method: .version_select at 0x7f6073599280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-822902398", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzwQI2w6EqgOXU+SOh5FJIAyQFzKg6/EhTsiLORtd3RwdQx03UCsPTFChVDxb99uWgMdOBDp5mMtefOqt7bT/p1fMEErb182ctX6RkIzhTTaErMh9kOz0PZEHJGEFh8hQ=="}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:08:02.468337 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-255f7293-88c9-4a09-abde-c86c2c3891aa tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Getting quotas for project acee41bacfa54fef8c5eb48cb67de032. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 13:08:02.476307 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-255f7293-88c9-4a09-abde-c86c2c3891aa tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Getting quotas for user b0fb2c86bbd4403481e17934014fdfb7 and project acee41bacfa54fef8c5eb48cb67de032. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 13:08:02.506274 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-255f7293-88c9-4a09-abde-c86c2c3891aa tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.060711 Jun 20 13:08:02.506984 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3665/7430] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 13:08:02 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:08:07.786145 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ab390709-a3dd-4159-a94e-131aedc361f5 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1962475992", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "4cadfb73-5130-4cf2-9772-66a9234bcb2d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-822902398", "security_groups": [{"name": "tempest-secgroup-smoke-1237562890"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:08:07.794985 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:08:07.914882 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-ab390709-a3dd-4159-a94e-131aedc361f5 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] validate_networks() for [('4cadfb73-5130-4cf2-9772-66a9234bcb2d', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 13:08:08.396263 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-ab390709-a3dd-4159-a94e-131aedc361f5 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 13:08:08.396971 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-ab390709-a3dd-4159-a94e-131aedc361f5 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 13:08:08.397449 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-ab390709-a3dd-4159-a94e-131aedc361f5 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 13:08:08.397860 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-ab390709-a3dd-4159-a94e-131aedc361f5 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 13:08:08.398272 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-ab390709-a3dd-4159-a94e-131aedc361f5 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 13:08:08.407895 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ab390709-a3dd-4159-a94e-131aedc361f5 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:08.408388 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ab390709-a3dd-4159-a94e-131aedc361f5 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:08.409703 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ab390709-a3dd-4159-a94e-131aedc361f5 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:08.410176 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ab390709-a3dd-4159-a94e-131aedc361f5 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:08.436321 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-ab390709-a3dd-4159-a94e-131aedc361f5 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Getting quotas for project acee41bacfa54fef8c5eb48cb67de032. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 13:08:08.443019 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-ab390709-a3dd-4159-a94e-131aedc361f5 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Getting quotas for user b0fb2c86bbd4403481e17934014fdfb7 and project acee41bacfa54fef8c5eb48cb67de032. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 13:08:08.458594 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ab390709-a3dd-4159-a94e-131aedc361f5 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 13:08:08.461106 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ab390709-a3dd-4159-a94e-131aedc361f5 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 6351bb7c-6f22-4ac0-8b55-04765b86410b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 13:08:08.518498 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ab390709-a3dd-4159-a94e-131aedc361f5 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.736354 Jun 20 13:08:08.519792 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3766/7431] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 13:08:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 13:08:08.530714 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-85386df4-3908-4f30-98a0-e08a53da6c1d tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:08:08.531908 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-85386df4-3908-4f30-98a0-e08a53da6c1d tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 6351bb7c-6f22-4ac0-8b55-04765b86410b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:08:08.658026 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-85386df4-3908-4f30-98a0-e08a53da6c1d tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:08:08.666881 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-85386df4-3908-4f30-98a0-e08a53da6c1d tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b" status: 200 len: 1266 microversion: 2.1 time: 0.141219 Jun 20 13:08:08.675495 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3666/7432] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:08:08 2022] GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:08:09.686253 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4df7a6f2-4f9c-491d-aa4e-d303d66be217 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:08:09.687561 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4df7a6f2-4f9c-491d-aa4e-d303d66be217 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 6351bb7c-6f22-4ac0-8b55-04765b86410b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:08:09.700830 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4df7a6f2-4f9c-491d-aa4e-d303d66be217 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:09.701576 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4df7a6f2-4f9c-491d-aa4e-d303d66be217 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:09.709081 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4df7a6f2-4f9c-491d-aa4e-d303d66be217 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:09.711152 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4df7a6f2-4f9c-491d-aa4e-d303d66be217 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:09.814144 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4df7a6f2-4f9c-491d-aa4e-d303d66be217 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:08:09.823687 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4df7a6f2-4f9c-491d-aa4e-d303d66be217 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b" status: 200 len: 1336 microversion: 2.1 time: 0.144390 Jun 20 13:08:09.824509 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3767/7433] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:08:09 2022] GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b => generated 1336 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:08:10.840283 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c55d7821-6e02-4ca5-b312-502df56d59f4 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:08:10.840917 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c55d7821-6e02-4ca5-b312-502df56d59f4 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 6351bb7c-6f22-4ac0-8b55-04765b86410b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:08:10.843304 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=12 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:08:10.853038 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c55d7821-6e02-4ca5-b312-502df56d59f4 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:10.853801 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c55d7821-6e02-4ca5-b312-502df56d59f4 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:10.854761 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c55d7821-6e02-4ca5-b312-502df56d59f4 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:10.855369 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c55d7821-6e02-4ca5-b312-502df56d59f4 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:11.079328 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c55d7821-6e02-4ca5-b312-502df56d59f4 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:08:11.088838 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c55d7821-6e02-4ca5-b312-502df56d59f4 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b" status: 200 len: 1392 microversion: 2.1 time: 0.252426 Jun 20 13:08:11.099116 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3667/7434] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:08:10 2022] GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b => generated 1392 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:08:11.348873 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-f0764729-8c8a-46bf-83ff-21e5dd571a47 req-6073e0a8-12ca-466b-9209-739de6d6e319 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6351bb7c-6f22-4ac0-8b55-04765b86410b", "tag": "b0d02864-3410-46f9-b97b-95d8505e7040"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:08:11.400751 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-f0764729-8c8a-46bf-83ff-21e5dd571a47 req-6073e0a8-12ca-466b-9209-739de6d6e319 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:11.401329 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-f0764729-8c8a-46bf-83ff-21e5dd571a47 req-6073e0a8-12ca-466b-9209-739de6d6e319 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:11.414884 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-f0764729-8c8a-46bf-83ff-21e5dd571a47 req-6073e0a8-12ca-466b-9209-739de6d6e319 service nova] Creating event network-changed:b0d02864-3410-46f9-b97b-95d8505e7040 for instance 6351bb7c-6f22-4ac0-8b55-04765b86410b on n-h1-master-1 Jun 20 13:08:11.424175 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-f0764729-8c8a-46bf-83ff-21e5dd571a47 req-6073e0a8-12ca-466b-9209-739de6d6e319 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080966 Jun 20 13:08:11.428879 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3768/7435] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:08:12.106750 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-434d68ba-6e18-446c-a2be-24e1f2161d05 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:08:12.107285 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-434d68ba-6e18-446c-a2be-24e1f2161d05 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 6351bb7c-6f22-4ac0-8b55-04765b86410b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:08:12.115756 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-434d68ba-6e18-446c-a2be-24e1f2161d05 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:12.116244 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-434d68ba-6e18-446c-a2be-24e1f2161d05 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:12.117064 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-434d68ba-6e18-446c-a2be-24e1f2161d05 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:12.117523 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-434d68ba-6e18-446c-a2be-24e1f2161d05 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:12.258252 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-434d68ba-6e18-446c-a2be-24e1f2161d05 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:08:12.267309 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-434d68ba-6e18-446c-a2be-24e1f2161d05 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b" status: 200 len: 1392 microversion: 2.1 time: 0.164649 Jun 20 13:08:12.267996 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3668/7436] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:08:12 2022] GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 13:08:13.284967 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6cc564e1-9ac0-4173-b5a0-3caa0e5ba44e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:08:13.285670 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6cc564e1-9ac0-4173-b5a0-3caa0e5ba44e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 6351bb7c-6f22-4ac0-8b55-04765b86410b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:08:13.293219 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6cc564e1-9ac0-4173-b5a0-3caa0e5ba44e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:13.293673 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6cc564e1-9ac0-4173-b5a0-3caa0e5ba44e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:13.294447 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6cc564e1-9ac0-4173-b5a0-3caa0e5ba44e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:13.294871 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6cc564e1-9ac0-4173-b5a0-3caa0e5ba44e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:13.430688 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6cc564e1-9ac0-4173-b5a0-3caa0e5ba44e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:08:13.441441 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6cc564e1-9ac0-4173-b5a0-3caa0e5ba44e tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b" status: 200 len: 1392 microversion: 2.1 time: 0.160821 Jun 20 13:08:13.442019 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3769/7437] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:08:13 2022] GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:08:14.459619 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6c69720b-77e1-45b3-bb4c-5b0d17971e30 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:08:14.460226 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6c69720b-77e1-45b3-bb4c-5b0d17971e30 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 6351bb7c-6f22-4ac0-8b55-04765b86410b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:08:14.467384 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6c69720b-77e1-45b3-bb4c-5b0d17971e30 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:14.467848 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6c69720b-77e1-45b3-bb4c-5b0d17971e30 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:14.468663 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6c69720b-77e1-45b3-bb4c-5b0d17971e30 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:14.469116 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6c69720b-77e1-45b3-bb4c-5b0d17971e30 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:14.614474 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6c69720b-77e1-45b3-bb4c-5b0d17971e30 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:08:14.625136 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6c69720b-77e1-45b3-bb4c-5b0d17971e30 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b" status: 200 len: 1392 microversion: 2.1 time: 0.169837 Jun 20 13:08:14.625961 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3669/7438] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:08:14 2022] GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:08:15.648082 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-540dbf84-adfe-4618-ab29-6066805659a7 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:08:15.649242 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-540dbf84-adfe-4618-ab29-6066805659a7 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 6351bb7c-6f22-4ac0-8b55-04765b86410b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:08:15.661011 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-540dbf84-adfe-4618-ab29-6066805659a7 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:15.661671 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-540dbf84-adfe-4618-ab29-6066805659a7 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:15.662444 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-540dbf84-adfe-4618-ab29-6066805659a7 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:15.662884 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-540dbf84-adfe-4618-ab29-6066805659a7 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:15.799646 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-540dbf84-adfe-4618-ab29-6066805659a7 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:08:15.808228 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-540dbf84-adfe-4618-ab29-6066805659a7 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b" status: 200 len: 1392 microversion: 2.1 time: 0.166205 Jun 20 13:08:15.808820 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3770/7439] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:08:15 2022] GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:08:16.830730 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f3aaa7b5-911b-4ef6-bfc5-bc61c884e103 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:08:16.831787 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f3aaa7b5-911b-4ef6-bfc5-bc61c884e103 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 6351bb7c-6f22-4ac0-8b55-04765b86410b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:08:16.839760 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f3aaa7b5-911b-4ef6-bfc5-bc61c884e103 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:16.840243 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f3aaa7b5-911b-4ef6-bfc5-bc61c884e103 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:16.841024 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f3aaa7b5-911b-4ef6-bfc5-bc61c884e103 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:16.841459 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f3aaa7b5-911b-4ef6-bfc5-bc61c884e103 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:16.985129 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f3aaa7b5-911b-4ef6-bfc5-bc61c884e103 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:08:16.993418 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f3aaa7b5-911b-4ef6-bfc5-bc61c884e103 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b" status: 200 len: 1392 microversion: 2.1 time: 0.170441 Jun 20 13:08:16.993998 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3670/7440] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:08:16 2022] GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:08:18.014291 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-615c8977-9bdf-42d3-8f11-9bdb075c2165 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:08:18.015330 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-615c8977-9bdf-42d3-8f11-9bdb075c2165 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 6351bb7c-6f22-4ac0-8b55-04765b86410b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:08:18.023985 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-615c8977-9bdf-42d3-8f11-9bdb075c2165 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:18.024485 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-615c8977-9bdf-42d3-8f11-9bdb075c2165 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:18.025262 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-615c8977-9bdf-42d3-8f11-9bdb075c2165 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:18.025758 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-615c8977-9bdf-42d3-8f11-9bdb075c2165 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:18.159302 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-615c8977-9bdf-42d3-8f11-9bdb075c2165 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:08:18.167782 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-615c8977-9bdf-42d3-8f11-9bdb075c2165 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b" status: 200 len: 1392 microversion: 2.1 time: 0.159731 Jun 20 13:08:18.168406 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3771/7441] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:08:18 2022] GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:08:18.178419 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-5c32a127-d1c5-414c-8260-3f8681df5dae req-e3fbb524-747f-4f75-98ac-4078e18cc527 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6351bb7c-6f22-4ac0-8b55-04765b86410b", "name": "network-vif-plugged", "status": "completed", "tag": "b0d02864-3410-46f9-b97b-95d8505e7040"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:08:18.188798 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-5c32a127-d1c5-414c-8260-3f8681df5dae req-e3fbb524-747f-4f75-98ac-4078e18cc527 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:18.189246 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-5c32a127-d1c5-414c-8260-3f8681df5dae req-e3fbb524-747f-4f75-98ac-4078e18cc527 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:18.203101 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-5c32a127-d1c5-414c-8260-3f8681df5dae req-e3fbb524-747f-4f75-98ac-4078e18cc527 service nova] Creating event network-vif-plugged:b0d02864-3410-46f9-b97b-95d8505e7040 for instance 6351bb7c-6f22-4ac0-8b55-04765b86410b on n-h1-master-1 Jun 20 13:08:18.209127 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-5c32a127-d1c5-414c-8260-3f8681df5dae req-e3fbb524-747f-4f75-98ac-4078e18cc527 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034784 Jun 20 13:08:18.209847 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3671/7442] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 13:08:19.189196 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d193b42c-ba69-4d47-9bbc-e7b383e3327f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:08:19.190234 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d193b42c-ba69-4d47-9bbc-e7b383e3327f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 6351bb7c-6f22-4ac0-8b55-04765b86410b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:08:19.193300 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:08:19.193979 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:08:19.200665 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d193b42c-ba69-4d47-9bbc-e7b383e3327f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:19.201117 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d193b42c-ba69-4d47-9bbc-e7b383e3327f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:19.201882 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d193b42c-ba69-4d47-9bbc-e7b383e3327f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:19.202318 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d193b42c-ba69-4d47-9bbc-e7b383e3327f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:19.343910 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d193b42c-ba69-4d47-9bbc-e7b383e3327f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:08:19.351910 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d193b42c-ba69-4d47-9bbc-e7b383e3327f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b" status: 200 len: 1392 microversion: 2.1 time: 0.169676 Jun 20 13:08:19.352546 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3772/7443] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:08:19 2022] GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:08:20.370234 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e9744a85-9a80-4c21-a5b9-feebd52bac84 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:08:20.371146 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e9744a85-9a80-4c21-a5b9-feebd52bac84 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 6351bb7c-6f22-4ac0-8b55-04765b86410b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:08:20.373186 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:08:20.380344 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e9744a85-9a80-4c21-a5b9-feebd52bac84 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:20.380788 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e9744a85-9a80-4c21-a5b9-feebd52bac84 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:20.381569 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e9744a85-9a80-4c21-a5b9-feebd52bac84 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:20.382022 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e9744a85-9a80-4c21-a5b9-feebd52bac84 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:20.540134 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e9744a85-9a80-4c21-a5b9-feebd52bac84 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:08:20.548506 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e9744a85-9a80-4c21-a5b9-feebd52bac84 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b" status: 200 len: 1565 microversion: 2.1 time: 0.182582 Jun 20 13:08:20.549109 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3672/7444] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:08:20 2022] GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b => generated 1565 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:08:20.565296 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b097ac8f-70bc-47d0-b86a-ee1afc1d7ff6 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:08:20.565860 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b097ac8f-70bc-47d0-b86a-ee1afc1d7ff6 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 6351bb7c-6f22-4ac0-8b55-04765b86410b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:08:20.573320 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b097ac8f-70bc-47d0-b86a-ee1afc1d7ff6 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:20.573760 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b097ac8f-70bc-47d0-b86a-ee1afc1d7ff6 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:20.574542 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b097ac8f-70bc-47d0-b86a-ee1afc1d7ff6 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:20.574972 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b097ac8f-70bc-47d0-b86a-ee1afc1d7ff6 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:20.730391 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b097ac8f-70bc-47d0-b86a-ee1afc1d7ff6 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:08:20.738708 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b097ac8f-70bc-47d0-b86a-ee1afc1d7ff6 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b" status: 200 len: 1565 microversion: 2.1 time: 0.177282 Jun 20 13:08:20.739217 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3773/7445] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:08:20 2022] GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b => generated 1565 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:08:22.652908 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fbd3c740-e874-4aee-9830-1063207d6d6c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:08:22.653532 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fbd3c740-e874-4aee-9830-1063207d6d6c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 6351bb7c-6f22-4ac0-8b55-04765b86410b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:08:22.655451 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-5f361021-76d1-49d8-bbe1-520f15565ed9 req-c92a8d28-5e70-4473-b583-bde676e87af5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6351bb7c-6f22-4ac0-8b55-04765b86410b", "tag": "b0d02864-3410-46f9-b97b-95d8505e7040"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:08:22.661040 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fbd3c740-e874-4aee-9830-1063207d6d6c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:22.661543 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fbd3c740-e874-4aee-9830-1063207d6d6c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:22.662355 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fbd3c740-e874-4aee-9830-1063207d6d6c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:22.662799 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fbd3c740-e874-4aee-9830-1063207d6d6c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:22.665479 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-5f361021-76d1-49d8-bbe1-520f15565ed9 req-c92a8d28-5e70-4473-b583-bde676e87af5 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:22.666150 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-5f361021-76d1-49d8-bbe1-520f15565ed9 req-c92a8d28-5e70-4473-b583-bde676e87af5 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:22.677975 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-5f361021-76d1-49d8-bbe1-520f15565ed9 req-c92a8d28-5e70-4473-b583-bde676e87af5 service nova] Creating event network-changed:b0d02864-3410-46f9-b97b-95d8505e7040 for instance 6351bb7c-6f22-4ac0-8b55-04765b86410b on n-h1-master-1 Jun 20 13:08:22.683430 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-5f361021-76d1-49d8-bbe1-520f15565ed9 req-c92a8d28-5e70-4473-b583-bde676e87af5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032294 Jun 20 13:08:22.684665 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3774/7446] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:08:22.903056 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fbd3c740-e874-4aee-9830-1063207d6d6c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:08:22.911223 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fbd3c740-e874-4aee-9830-1063207d6d6c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b" status: 200 len: 1565 microversion: 2.1 time: 0.262694 Jun 20 13:08:22.920626 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3673/7447] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:08:22 2022] GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b => generated 1565 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:08:44.197702 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:08:44.198755 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=42 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:08:44.205589 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-52eccaa6-e2a3-4432-ad28-ed54cbb6ffc1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:08:44.207114 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-52eccaa6-e2a3-4432-ad28-ed54cbb6ffc1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 6351bb7c-6f22-4ac0-8b55-04765b86410b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:08:44.215659 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52eccaa6-e2a3-4432-ad28-ed54cbb6ffc1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:44.216127 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52eccaa6-e2a3-4432-ad28-ed54cbb6ffc1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:44.216930 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52eccaa6-e2a3-4432-ad28-ed54cbb6ffc1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:44.217366 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52eccaa6-e2a3-4432-ad28-ed54cbb6ffc1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:44.270464 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-52eccaa6-e2a3-4432-ad28-ed54cbb6ffc1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "POST /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b/action" status: 200 len: 24570 microversion: 2.1 time: 0.076145 Jun 20 13:08:44.271130 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3775/7448] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 13:08:44 2022] POST /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b/action => generated 24570 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 13:08:50.657349 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-42798379-0149-4624-9d3b-70f819a63e34 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:08:50.661267 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:08:50.662635 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=38 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:08:50.671501 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-42798379-0149-4624-9d3b-70f819a63e34 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:50.671968 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-42798379-0149-4624-9d3b-70f819a63e34 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:50.696485 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-42798379-0149-4624-9d3b-70f819a63e34 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 6351bb7c-6f22-4ac0-8b55-04765b86410b] Going to try to stop instance {{(pid=119128) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 20 13:08:50.745052 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-42798379-0149-4624-9d3b-70f819a63e34 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "POST /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b/action" status: 202 len: 0 microversion: 2.1 time: 0.094747 Jun 20 13:08:50.745876 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3674/7449] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 13:08:50 2022] POST /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 13:08:50.754840 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a2cc60ee-ce66-4c30-85c4-08293b034c25 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:08:50.755567 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a2cc60ee-ce66-4c30-85c4-08293b034c25 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 6351bb7c-6f22-4ac0-8b55-04765b86410b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:08:50.764529 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a2cc60ee-ce66-4c30-85c4-08293b034c25 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:50.764987 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a2cc60ee-ce66-4c30-85c4-08293b034c25 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:50.765795 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a2cc60ee-ce66-4c30-85c4-08293b034c25 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:50.766242 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a2cc60ee-ce66-4c30-85c4-08293b034c25 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:50.910773 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a2cc60ee-ce66-4c30-85c4-08293b034c25 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:08:50.919445 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a2cc60ee-ce66-4c30-85c4-08293b034c25 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b" status: 200 len: 1693 microversion: 2.1 time: 0.169008 Jun 20 13:08:50.920011 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3776/7450] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:08:50 2022] GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b => generated 1693 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:08:51.940975 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5a146ed8-115d-4f7b-86b1-4aef94319f84 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:08:51.941676 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5a146ed8-115d-4f7b-86b1-4aef94319f84 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 6351bb7c-6f22-4ac0-8b55-04765b86410b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:08:51.951651 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a146ed8-115d-4f7b-86b1-4aef94319f84 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:51.951870 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a146ed8-115d-4f7b-86b1-4aef94319f84 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:51.952702 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a146ed8-115d-4f7b-86b1-4aef94319f84 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:51.953146 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a146ed8-115d-4f7b-86b1-4aef94319f84 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:52.103542 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5a146ed8-115d-4f7b-86b1-4aef94319f84 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:08:52.112558 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5a146ed8-115d-4f7b-86b1-4aef94319f84 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b" status: 200 len: 1693 microversion: 2.1 time: 0.177890 Jun 20 13:08:52.113174 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3675/7451] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:08:51 2022] GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b => generated 1693 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:08:53.134167 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-261800aa-49a5-4b0a-bdc8-a0c4d80fdd1a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:08:53.135208 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-261800aa-49a5-4b0a-bdc8-a0c4d80fdd1a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 6351bb7c-6f22-4ac0-8b55-04765b86410b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:08:53.147989 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-261800aa-49a5-4b0a-bdc8-a0c4d80fdd1a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:53.148807 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-261800aa-49a5-4b0a-bdc8-a0c4d80fdd1a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:53.150087 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-261800aa-49a5-4b0a-bdc8-a0c4d80fdd1a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:53.150824 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-261800aa-49a5-4b0a-bdc8-a0c4d80fdd1a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:53.293882 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-261800aa-49a5-4b0a-bdc8-a0c4d80fdd1a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:08:53.302323 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-261800aa-49a5-4b0a-bdc8-a0c4d80fdd1a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b" status: 200 len: 1693 microversion: 2.1 time: 0.174898 Jun 20 13:08:53.302901 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3777/7452] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:08:53 2022] GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b => generated 1693 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:08:54.324745 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a6b03201-b993-4441-954d-d226f1e93da1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:08:54.325857 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a6b03201-b993-4441-954d-d226f1e93da1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 6351bb7c-6f22-4ac0-8b55-04765b86410b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:08:54.334048 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6b03201-b993-4441-954d-d226f1e93da1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:54.334565 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6b03201-b993-4441-954d-d226f1e93da1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:54.335462 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6b03201-b993-4441-954d-d226f1e93da1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:54.335979 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6b03201-b993-4441-954d-d226f1e93da1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:54.483595 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a6b03201-b993-4441-954d-d226f1e93da1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:08:54.493634 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a6b03201-b993-4441-954d-d226f1e93da1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b" status: 200 len: 1693 microversion: 2.1 time: 0.175329 Jun 20 13:08:54.494582 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3676/7453] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:08:54 2022] GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b => generated 1693 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:08:55.519288 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-79897498-215d-41f7-934f-ea05ec82bd00 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:08:55.520302 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-79897498-215d-41f7-934f-ea05ec82bd00 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 6351bb7c-6f22-4ac0-8b55-04765b86410b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:08:55.531370 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-79897498-215d-41f7-934f-ea05ec82bd00 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:55.531826 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-79897498-215d-41f7-934f-ea05ec82bd00 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:55.532628 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-79897498-215d-41f7-934f-ea05ec82bd00 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:55.533066 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-79897498-215d-41f7-934f-ea05ec82bd00 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:55.682191 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-79897498-215d-41f7-934f-ea05ec82bd00 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:08:55.690677 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-79897498-215d-41f7-934f-ea05ec82bd00 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b" status: 200 len: 1693 microversion: 2.1 time: 0.178118 Jun 20 13:08:55.691261 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3778/7454] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:08:55 2022] GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b => generated 1693 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:08:56.711091 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-51706d40-7832-4e2a-be45-2892302f3abd tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:08:56.712063 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-51706d40-7832-4e2a-be45-2892302f3abd tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 6351bb7c-6f22-4ac0-8b55-04765b86410b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:08:56.724427 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-51706d40-7832-4e2a-be45-2892302f3abd tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:56.725194 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-51706d40-7832-4e2a-be45-2892302f3abd tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:56.726527 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-51706d40-7832-4e2a-be45-2892302f3abd tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:56.727269 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-51706d40-7832-4e2a-be45-2892302f3abd tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:56.866111 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-51706d40-7832-4e2a-be45-2892302f3abd tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:08:56.874051 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-51706d40-7832-4e2a-be45-2892302f3abd tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b" status: 200 len: 1693 microversion: 2.1 time: 0.169622 Jun 20 13:08:56.874630 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3677/7455] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:08:56 2022] GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b => generated 1693 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:08:57.891079 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8b2259cc-e135-4197-a5e1-51e371ce5dfd tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:08:57.891732 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8b2259cc-e135-4197-a5e1-51e371ce5dfd tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 6351bb7c-6f22-4ac0-8b55-04765b86410b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:08:57.899344 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b2259cc-e135-4197-a5e1-51e371ce5dfd tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:57.899794 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b2259cc-e135-4197-a5e1-51e371ce5dfd tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:57.900588 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b2259cc-e135-4197-a5e1-51e371ce5dfd tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:57.901020 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8b2259cc-e135-4197-a5e1-51e371ce5dfd tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:58.058505 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8b2259cc-e135-4197-a5e1-51e371ce5dfd tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:08:58.069923 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8b2259cc-e135-4197-a5e1-51e371ce5dfd tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b" status: 200 len: 1693 microversion: 2.1 time: 0.182511 Jun 20 13:08:58.070826 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3779/7456] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:08:57 2022] GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b => generated 1693 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:08:59.090658 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0d2a65d8-5dd0-40ea-9722-3c7ee1515efd tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:08:59.091278 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0d2a65d8-5dd0-40ea-9722-3c7ee1515efd tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 6351bb7c-6f22-4ac0-8b55-04765b86410b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:08:59.098986 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d2a65d8-5dd0-40ea-9722-3c7ee1515efd tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:59.099457 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d2a65d8-5dd0-40ea-9722-3c7ee1515efd tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:59.100232 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d2a65d8-5dd0-40ea-9722-3c7ee1515efd tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:08:59.100713 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d2a65d8-5dd0-40ea-9722-3c7ee1515efd tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:08:59.242363 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0d2a65d8-5dd0-40ea-9722-3c7ee1515efd tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:08:59.251353 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0d2a65d8-5dd0-40ea-9722-3c7ee1515efd tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b" status: 200 len: 1693 microversion: 2.1 time: 0.165754 Jun 20 13:08:59.251934 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3678/7457] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:08:59 2022] GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b => generated 1693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:09:00.268336 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c4fa453b-539d-4979-8ee8-153070045333 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:09:00.268914 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c4fa453b-539d-4979-8ee8-153070045333 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 6351bb7c-6f22-4ac0-8b55-04765b86410b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:09:00.276246 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c4fa453b-539d-4979-8ee8-153070045333 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:00.276697 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c4fa453b-539d-4979-8ee8-153070045333 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:00.277453 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c4fa453b-539d-4979-8ee8-153070045333 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:00.277887 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c4fa453b-539d-4979-8ee8-153070045333 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:00.413213 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c4fa453b-539d-4979-8ee8-153070045333 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:09:00.421117 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c4fa453b-539d-4979-8ee8-153070045333 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b" status: 200 len: 1693 microversion: 2.1 time: 0.156739 Jun 20 13:09:00.421695 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3780/7458] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:09:00 2022] GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:09:01.447497 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fada8268-376f-4cb5-b919-e583312bdb83 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:09:01.448687 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fada8268-376f-4cb5-b919-e583312bdb83 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 6351bb7c-6f22-4ac0-8b55-04765b86410b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:09:01.460794 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fada8268-376f-4cb5-b919-e583312bdb83 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:01.461559 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fada8268-376f-4cb5-b919-e583312bdb83 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:01.462836 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fada8268-376f-4cb5-b919-e583312bdb83 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:01.463608 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fada8268-376f-4cb5-b919-e583312bdb83 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:01.604631 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fada8268-376f-4cb5-b919-e583312bdb83 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:09:01.616671 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fada8268-376f-4cb5-b919-e583312bdb83 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b" status: 200 len: 1670 microversion: 2.1 time: 0.175766 Jun 20 13:09:01.617462 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3679/7459] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:09:01 2022] GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b => generated 1670 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:09:02.717176 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-839d57b6-b459-4dd9-af0a-a1425c93c189 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:09:02.718018 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-839d57b6-b459-4dd9-af0a-a1425c93c189 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 6351bb7c-6f22-4ac0-8b55-04765b86410b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:09:02.725715 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-839d57b6-b459-4dd9-af0a-a1425c93c189 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:02.726138 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-839d57b6-b459-4dd9-af0a-a1425c93c189 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:02.726905 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-839d57b6-b459-4dd9-af0a-a1425c93c189 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:02.727370 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-839d57b6-b459-4dd9-af0a-a1425c93c189 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:02.787065 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-839d57b6-b459-4dd9-af0a-a1425c93c189 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "POST /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b/action" status: 200 len: 35508 microversion: 2.1 time: 0.073645 Jun 20 13:09:02.788046 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3781/7460] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 13:09:02 2022] POST /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b/action => generated 35508 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 13:09:02.799684 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f2012a70-1540-4587-8149-f3c7d3abb498 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:09:02.807450 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f2012a70-1540-4587-8149-f3c7d3abb498 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:02.808237 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f2012a70-1540-4587-8149-f3c7d3abb498 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:02.831120 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f2012a70-1540-4587-8149-f3c7d3abb498 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 6351bb7c-6f22-4ac0-8b55-04765b86410b] Going to try to start instance {{(pid=119128) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 20 13:09:02.875394 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f2012a70-1540-4587-8149-f3c7d3abb498 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "POST /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b/action" status: 202 len: 0 microversion: 2.1 time: 0.079577 Jun 20 13:09:02.876160 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3680/7461] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 13:09:02 2022] POST /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 13:09:02.884891 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-66143d0a-11f2-4fa4-b5b9-bfb9f47690b4 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:09:02.885566 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-66143d0a-11f2-4fa4-b5b9-bfb9f47690b4 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 6351bb7c-6f22-4ac0-8b55-04765b86410b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:09:02.893262 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66143d0a-11f2-4fa4-b5b9-bfb9f47690b4 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:02.893717 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66143d0a-11f2-4fa4-b5b9-bfb9f47690b4 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:02.894494 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66143d0a-11f2-4fa4-b5b9-bfb9f47690b4 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:02.894933 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66143d0a-11f2-4fa4-b5b9-bfb9f47690b4 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:03.047024 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-66143d0a-11f2-4fa4-b5b9-bfb9f47690b4 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:09:03.055969 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-66143d0a-11f2-4fa4-b5b9-bfb9f47690b4 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b" status: 200 len: 1679 microversion: 2.1 time: 0.175222 Jun 20 13:09:03.056987 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3782/7462] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:09:02 2022] GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:09:04.077660 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-465e2559-4c35-4778-8e3e-548f217440c6 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:09:04.078371 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-465e2559-4c35-4778-8e3e-548f217440c6 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 6351bb7c-6f22-4ac0-8b55-04765b86410b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:09:04.085032 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-465e2559-4c35-4778-8e3e-548f217440c6 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:04.085506 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-465e2559-4c35-4778-8e3e-548f217440c6 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:04.086283 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-465e2559-4c35-4778-8e3e-548f217440c6 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:04.086730 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-465e2559-4c35-4778-8e3e-548f217440c6 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:04.224604 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-465e2559-4c35-4778-8e3e-548f217440c6 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:09:04.232638 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-465e2559-4c35-4778-8e3e-548f217440c6 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b" status: 200 len: 1683 microversion: 2.1 time: 0.161332 Jun 20 13:09:04.233230 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3681/7463] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:09:04 2022] GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:09:28.458922 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-306f7312-f334-4154-af9b-968522cd9b91 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:09:28.459846 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-306f7312-f334-4154-af9b-968522cd9b91 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 6351bb7c-6f22-4ac0-8b55-04765b86410b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:09:28.462528 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=16 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:09:28.463181 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=44 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:09:28.469627 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-306f7312-f334-4154-af9b-968522cd9b91 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:28.470076 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-306f7312-f334-4154-af9b-968522cd9b91 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:28.470843 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-306f7312-f334-4154-af9b-968522cd9b91 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:28.471279 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-306f7312-f334-4154-af9b-968522cd9b91 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:28.523157 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-306f7312-f334-4154-af9b-968522cd9b91 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "POST /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b/action" status: 200 len: 60067 microversion: 2.1 time: 0.070818 Jun 20 13:09:28.523776 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3783/7464] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 13:09:28 2022] POST /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b/action => generated 60067 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 13:09:29.247986 n-d-master-1 devstack@n-api.service[119128]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 13:09:29.248948 n-d-master-1 devstack@n-api.service[119128]: Mon Jun 20 13:09:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 13:09:35.576699 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cb3083c1-0a98-4479-a0ff-b4207b34115b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:09:35.577309 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cb3083c1-0a98-4479-a0ff-b4207b34115b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 6351bb7c-6f22-4ac0-8b55-04765b86410b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:09:35.578874 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-eadbdc86-9180-41e8-aa8c-dbe5b6eabfee req-2e4aea6a-eca9-479c-9c66-64cffc94811e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6351bb7c-6f22-4ac0-8b55-04765b86410b", "tag": "b0d02864-3410-46f9-b97b-95d8505e7040"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:09:35.579338 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=16 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:09:35.580329 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:09:35.586903 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb3083c1-0a98-4479-a0ff-b4207b34115b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:35.587368 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb3083c1-0a98-4479-a0ff-b4207b34115b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:35.588161 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb3083c1-0a98-4479-a0ff-b4207b34115b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:35.588618 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb3083c1-0a98-4479-a0ff-b4207b34115b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:35.590211 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-eadbdc86-9180-41e8-aa8c-dbe5b6eabfee req-2e4aea6a-eca9-479c-9c66-64cffc94811e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:35.590798 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-eadbdc86-9180-41e8-aa8c-dbe5b6eabfee req-2e4aea6a-eca9-479c-9c66-64cffc94811e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:35.604644 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-eadbdc86-9180-41e8-aa8c-dbe5b6eabfee req-2e4aea6a-eca9-479c-9c66-64cffc94811e service nova] Creating event network-changed:b0d02864-3410-46f9-b97b-95d8505e7040 for instance 6351bb7c-6f22-4ac0-8b55-04765b86410b on n-h1-master-1 Jun 20 13:09:35.610852 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-eadbdc86-9180-41e8-aa8c-dbe5b6eabfee req-2e4aea6a-eca9-479c-9c66-64cffc94811e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036213 Jun 20 13:09:35.612108 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3784/7465] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:09:35.617748 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cb3083c1-0a98-4479-a0ff-b4207b34115b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 6351bb7c-6f22-4ac0-8b55-04765b86410b] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 13:09:35.707794 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cb3083c1-0a98-4479-a0ff-b4207b34115b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b" status: 204 len: 0 microversion: 2.1 time: 0.135233 Jun 20 13:09:35.709335 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3682/7466] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 13:09:35 2022] DELETE /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 13:09:35.718376 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f521280c-7eb2-40e3-8c02-c8e1f59b91ed tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:09:35.719356 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f521280c-7eb2-40e3-8c02-c8e1f59b91ed tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 6351bb7c-6f22-4ac0-8b55-04765b86410b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:09:35.726059 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f521280c-7eb2-40e3-8c02-c8e1f59b91ed tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:35.726513 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f521280c-7eb2-40e3-8c02-c8e1f59b91ed tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:35.727513 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f521280c-7eb2-40e3-8c02-c8e1f59b91ed tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:35.727960 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f521280c-7eb2-40e3-8c02-c8e1f59b91ed tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:35.866913 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f521280c-7eb2-40e3-8c02-c8e1f59b91ed tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:09:35.875720 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f521280c-7eb2-40e3-8c02-c8e1f59b91ed tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b" status: 200 len: 1689 microversion: 2.1 time: 0.162001 Jun 20 13:09:35.876395 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3785/7467] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:09:35 2022] GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:09:36.894393 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-88c3849b-985d-45e7-b6aa-af6eeb5fc0b0 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:09:36.895075 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-88c3849b-985d-45e7-b6aa-af6eeb5fc0b0 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 6351bb7c-6f22-4ac0-8b55-04765b86410b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:09:36.903367 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88c3849b-985d-45e7-b6aa-af6eeb5fc0b0 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:36.903828 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88c3849b-985d-45e7-b6aa-af6eeb5fc0b0 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:36.905125 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88c3849b-985d-45e7-b6aa-af6eeb5fc0b0 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:36.905852 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88c3849b-985d-45e7-b6aa-af6eeb5fc0b0 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:37.132538 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-88c3849b-985d-45e7-b6aa-af6eeb5fc0b0 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:09:37.140482 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-88c3849b-985d-45e7-b6aa-af6eeb5fc0b0 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b" status: 200 len: 1689 microversion: 2.1 time: 0.250423 Jun 20 13:09:37.141062 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3683/7468] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:09:36 2022] GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b => generated 1689 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:09:37.803496 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-88c5bbaf-4e3d-4655-9fc0-f101bd7c8e6a req-263865c9-5043-4d73-a3be-c8fc926fe3b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6351bb7c-6f22-4ac0-8b55-04765b86410b", "name": "network-vif-deleted", "tag": "b0d02864-3410-46f9-b97b-95d8505e7040"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:09:37.815965 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-88c5bbaf-4e3d-4655-9fc0-f101bd7c8e6a req-263865c9-5043-4d73-a3be-c8fc926fe3b8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:37.816484 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-88c5bbaf-4e3d-4655-9fc0-f101bd7c8e6a req-263865c9-5043-4d73-a3be-c8fc926fe3b8 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:37.831005 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-88c5bbaf-4e3d-4655-9fc0-f101bd7c8e6a req-263865c9-5043-4d73-a3be-c8fc926fe3b8 service nova] Creating event network-vif-deleted:b0d02864-3410-46f9-b97b-95d8505e7040 for instance 6351bb7c-6f22-4ac0-8b55-04765b86410b on n-h1-master-1 Jun 20 13:09:37.836024 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-88c5bbaf-4e3d-4655-9fc0-f101bd7c8e6a req-263865c9-5043-4d73-a3be-c8fc926fe3b8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036881 Jun 20 13:09:37.836660 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3786/7469] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:09:38.158102 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-380d0cbe-5970-4e14-a1db-6f4e39d8219b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:09:38.158931 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-380d0cbe-5970-4e14-a1db-6f4e39d8219b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 6351bb7c-6f22-4ac0-8b55-04765b86410b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:09:38.168735 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-380d0cbe-5970-4e14-a1db-6f4e39d8219b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:38.169219 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-380d0cbe-5970-4e14-a1db-6f4e39d8219b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:38.170356 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-380d0cbe-5970-4e14-a1db-6f4e39d8219b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:38.171193 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-380d0cbe-5970-4e14-a1db-6f4e39d8219b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:38.214025 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-380d0cbe-5970-4e14-a1db-6f4e39d8219b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:38.214482 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-380d0cbe-5970-4e14-a1db-6f4e39d8219b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:38.214978 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-380d0cbe-5970-4e14-a1db-6f4e39d8219b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lazy-loading 'fault' on Instance uuid 6351bb7c-6f22-4ac0-8b55-04765b86410b {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 13:09:38.275413 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-380d0cbe-5970-4e14-a1db-6f4e39d8219b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:09:38.282697 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-380d0cbe-5970-4e14-a1db-6f4e39d8219b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b" status: 200 len: 1356 microversion: 2.1 time: 0.128790 Jun 20 13:09:38.283273 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3684/7470] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:09:38 2022] GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b => generated 1356 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:09:39.306484 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-22d297a7-562b-4f2a-9f0a-5a8b7db63cec tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:09:39.307939 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-22d297a7-562b-4f2a-9f0a-5a8b7db63cec tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: 6351bb7c-6f22-4ac0-8b55-04765b86410b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:09:39.318571 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-22d297a7-562b-4f2a-9f0a-5a8b7db63cec tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:39.319109 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-22d297a7-562b-4f2a-9f0a-5a8b7db63cec tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:39.319882 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-22d297a7-562b-4f2a-9f0a-5a8b7db63cec tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:39.320358 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-22d297a7-562b-4f2a-9f0a-5a8b7db63cec tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:39.334150 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-22d297a7-562b-4f2a-9f0a-5a8b7db63cec tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] HTTP exception thrown: Instance 6351bb7c-6f22-4ac0-8b55-04765b86410b could not be found. Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-22d297a7-562b-4f2a-9f0a-5a8b7db63cec tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Request method failure captured: Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b HTTP/1.1 Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisHACr1Z1Pf7gGI9V77m0nnUZzZ5nWX2yhLGjpUHG7LL0xqNYFkbL4_1IIwiiDwVBoZSpoLQS1AbGh1f5DF9yEuMUKi5BxlkuR9qjJWkNvnjSqcfiG8X5PQZ9jVFWFokLDrkM49GBwx_isFNyLwrdbAahsC54lqfNzVHfDIXyGD4YFxM Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: acee41bacfa54fef8c5eb48cb67de032 Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1657633917 Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/acee41bacfa54fef8c5eb48cb67de032"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/acee41bacfa54fef8c5eb48cb67de032"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/acee41bacfa54fef8c5eb48cb67de032"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_acee41bacfa54fef8c5eb48cb67de032"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1657633917 Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: acee41bacfa54fef8c5eb48cb67de032 Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1657633917 Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-TestNetworkAdvancedServerOps-1657633917-project Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: b0fb2c86bbd4403481e17934014fdfb7 Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1657633917-project Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: exception: Instance 6351bb7c-6f22-4ac0-8b55-04765b86410b could not be found. Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': '6351bb7c-6f22-4ac0-8b55-04765b86410b'} Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6351bb7c-6f22-4ac0-8b55-04765b86410b could not be found. Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6351bb7c-6f22-4ac0-8b55-04765b86410b could not be found. Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 13:09:39.335802 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 13:09:39.339926 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 13:09:39.339926 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 13:09:39.339926 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 13:09:39.339926 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 13:09:39.339926 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 13:09:39.339926 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 13:09:39.339926 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6351bb7c-6f22-4ac0-8b55-04765b86410b could not be found. Jun 20 13:09:39.339926 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 13:09:39.339926 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-22d297a7-562b-4f2a-9f0a-5a8b7db63cec tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Returning 404 to user: Instance 6351bb7c-6f22-4ac0-8b55-04765b86410b could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 13:09:39.339926 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-22d297a7-562b-4f2a-9f0a-5a8b7db63cec tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b" status: 404 len: 111 microversion: 2.1 time: 0.039468 Jun 20 13:09:39.339926 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3787/7471] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:09:39 2022] GET /compute/v2.1/servers/6351bb7c-6f22-4ac0-8b55-04765b86410b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 13:09:42.648526 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-47957095-f360-496a-8ce4-316d32a75626 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '.version_select at 0x7f6073405700>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:09:42.671276 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-47957095-f360-496a-8ce4-316d32a75626 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-822902398" status: 202 len: 0 microversion: 2.1 time: 0.027863 Jun 20 13:09:42.671882 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3685/7472] 10.222.0.27 () {58 vars in 1280 bytes} [Mon Jun 20 13:09:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-822902398 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 13:09:42.705976 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-780c1965-efdf-43fd-94ce-83d1924a5644 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Action: 'create', calling method: .version_select at 0x7f60721f0160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-641751744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxhf/QOz24I0AuMUPm8vPhKzUkV+unXRRG4oTXog0oYiyRW51pcgaJEVPy8zu1Gd573MakimG9yZpeVdBKLh5yGjDu+j+NE1ADypn/yxyB52p6MSdS0IZ9i9yPPeXcE3A=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:09:42.721294 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-780c1965-efdf-43fd-94ce-83d1924a5644 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Getting quotas for project acee41bacfa54fef8c5eb48cb67de032. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 13:09:42.727530 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-780c1965-efdf-43fd-94ce-83d1924a5644 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Getting quotas for user b0fb2c86bbd4403481e17934014fdfb7 and project acee41bacfa54fef8c5eb48cb67de032. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 13:09:42.754331 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-780c1965-efdf-43fd-94ce-83d1924a5644 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.052365 Jun 20 13:09:42.755033 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3788/7473] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 13:09:42 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:09:48.389936 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:09:48.395304 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-be625d14-4c69-4cd8-a8f9-21295cf6f808 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1555307313", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "networks": [{"uuid": "9ed736b5-15b1-4b59-8235-4eb9b30af428"}], "key_name": "tempest-TestNetworkAdvancedServerOps-641751744", "security_groups": [{"name": "tempest-secgroup-smoke-388763887"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:09:48.843607 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-be625d14-4c69-4cd8-a8f9-21295cf6f808 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] validate_networks() for [('9ed736b5-15b1-4b59-8235-4eb9b30af428', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 13:09:49.280379 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-be625d14-4c69-4cd8-a8f9-21295cf6f808 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 13:09:49.280813 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-be625d14-4c69-4cd8-a8f9-21295cf6f808 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 13:09:49.281302 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-be625d14-4c69-4cd8-a8f9-21295cf6f808 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 13:09:49.281719 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-be625d14-4c69-4cd8-a8f9-21295cf6f808 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 13:09:49.282129 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-be625d14-4c69-4cd8-a8f9-21295cf6f808 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 13:09:49.296764 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-be625d14-4c69-4cd8-a8f9-21295cf6f808 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:49.297244 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-be625d14-4c69-4cd8-a8f9-21295cf6f808 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:49.298050 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-be625d14-4c69-4cd8-a8f9-21295cf6f808 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:49.298487 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-be625d14-4c69-4cd8-a8f9-21295cf6f808 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:49.316081 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-be625d14-4c69-4cd8-a8f9-21295cf6f808 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Getting quotas for project acee41bacfa54fef8c5eb48cb67de032. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 13:09:49.321905 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-be625d14-4c69-4cd8-a8f9-21295cf6f808 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Getting quotas for user b0fb2c86bbd4403481e17934014fdfb7 and project acee41bacfa54fef8c5eb48cb67de032. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 13:09:49.334599 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-be625d14-4c69-4cd8-a8f9-21295cf6f808 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 13:09:49.336983 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-be625d14-4c69-4cd8-a8f9-21295cf6f808 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: f3fac525-692e-4ad4-b3ce-9008e7e1c3b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 13:09:49.385167 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-be625d14-4c69-4cd8-a8f9-21295cf6f808 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.996879 Jun 20 13:09:49.391052 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3686/7474] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 13:09:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 13:09:49.394098 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=16 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:09:49.398544 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-96aa5c0a-dde8-402b-a69e-5d43534a3440 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:09:49.399167 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-96aa5c0a-dde8-402b-a69e-5d43534a3440 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: f3fac525-692e-4ad4-b3ce-9008e7e1c3b0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:09:49.465599 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-96aa5c0a-dde8-402b-a69e-5d43534a3440 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:09:49.472931 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-96aa5c0a-dde8-402b-a69e-5d43534a3440 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0" status: 200 len: 1266 microversion: 2.1 time: 0.080709 Jun 20 13:09:49.474122 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3789/7475] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:09:49 2022] GET /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0 => generated 1266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:09:50.491925 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7abd3ff8-0a90-4efa-92ae-1fb059b9cb0b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:09:50.493262 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7abd3ff8-0a90-4efa-92ae-1fb059b9cb0b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: f3fac525-692e-4ad4-b3ce-9008e7e1c3b0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:09:50.517649 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7abd3ff8-0a90-4efa-92ae-1fb059b9cb0b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:50.518451 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7abd3ff8-0a90-4efa-92ae-1fb059b9cb0b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:50.519775 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7abd3ff8-0a90-4efa-92ae-1fb059b9cb0b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:50.520561 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7abd3ff8-0a90-4efa-92ae-1fb059b9cb0b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:50.622132 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7abd3ff8-0a90-4efa-92ae-1fb059b9cb0b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:09:50.632052 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7abd3ff8-0a90-4efa-92ae-1fb059b9cb0b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0" status: 200 len: 1336 microversion: 2.1 time: 0.145778 Jun 20 13:09:50.633260 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3687/7476] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:09:50 2022] GET /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0 => generated 1336 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:09:51.650758 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5cbce818-813c-46cd-bb10-6466ea520a48 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:09:51.651418 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5cbce818-813c-46cd-bb10-6466ea520a48 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: f3fac525-692e-4ad4-b3ce-9008e7e1c3b0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:09:51.658722 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5cbce818-813c-46cd-bb10-6466ea520a48 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:51.659165 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5cbce818-813c-46cd-bb10-6466ea520a48 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:51.659932 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5cbce818-813c-46cd-bb10-6466ea520a48 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:51.660392 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5cbce818-813c-46cd-bb10-6466ea520a48 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:51.874657 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5cbce818-813c-46cd-bb10-6466ea520a48 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:09:51.883980 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5cbce818-813c-46cd-bb10-6466ea520a48 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0" status: 200 len: 1391 microversion: 2.1 time: 0.238527 Jun 20 13:09:51.884863 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3790/7477] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:09:51 2022] GET /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0 => generated 1391 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:09:51.926441 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-31669df0-1442-4179-bb7a-c5be2d8e4785 req-dddb2752-7415-406b-a753-b0f0b4271eb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3fac525-692e-4ad4-b3ce-9008e7e1c3b0", "tag": "fe2baf4a-11fb-4235-a5cd-607ed969ddf6"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:09:51.938219 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-31669df0-1442-4179-bb7a-c5be2d8e4785 req-dddb2752-7415-406b-a753-b0f0b4271eb2 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:51.938718 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-31669df0-1442-4179-bb7a-c5be2d8e4785 req-dddb2752-7415-406b-a753-b0f0b4271eb2 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:51.963219 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-31669df0-1442-4179-bb7a-c5be2d8e4785 req-dddb2752-7415-406b-a753-b0f0b4271eb2 service nova] Creating event network-changed:fe2baf4a-11fb-4235-a5cd-607ed969ddf6 for instance f3fac525-692e-4ad4-b3ce-9008e7e1c3b0 on n-h1-master-1 Jun 20 13:09:51.969939 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-31669df0-1442-4179-bb7a-c5be2d8e4785 req-dddb2752-7415-406b-a753-b0f0b4271eb2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047357 Jun 20 13:09:51.970565 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3688/7478] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:09:52.902127 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5d9aa2bf-45aa-439c-becb-a7a18639bea5 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:09:52.902715 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5d9aa2bf-45aa-439c-becb-a7a18639bea5 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: f3fac525-692e-4ad4-b3ce-9008e7e1c3b0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:09:52.910103 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5d9aa2bf-45aa-439c-becb-a7a18639bea5 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:52.910574 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5d9aa2bf-45aa-439c-becb-a7a18639bea5 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:52.911369 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5d9aa2bf-45aa-439c-becb-a7a18639bea5 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:52.911783 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5d9aa2bf-45aa-439c-becb-a7a18639bea5 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:53.054001 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5d9aa2bf-45aa-439c-becb-a7a18639bea5 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:09:53.061946 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5d9aa2bf-45aa-439c-becb-a7a18639bea5 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0" status: 200 len: 1391 microversion: 2.1 time: 0.164183 Jun 20 13:09:53.062529 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3791/7479] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:09:52 2022] GET /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0 => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:09:54.081009 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0ec23625-148c-46d1-ac94-9b19bd05e750 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:09:54.081797 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0ec23625-148c-46d1-ac94-9b19bd05e750 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: f3fac525-692e-4ad4-b3ce-9008e7e1c3b0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:09:54.088919 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0ec23625-148c-46d1-ac94-9b19bd05e750 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:54.089389 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0ec23625-148c-46d1-ac94-9b19bd05e750 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:54.090167 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0ec23625-148c-46d1-ac94-9b19bd05e750 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:54.090618 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0ec23625-148c-46d1-ac94-9b19bd05e750 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:54.233990 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0ec23625-148c-46d1-ac94-9b19bd05e750 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:09:54.244068 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0ec23625-148c-46d1-ac94-9b19bd05e750 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0" status: 200 len: 1391 microversion: 2.1 time: 0.168055 Jun 20 13:09:54.245019 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3689/7480] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:09:54 2022] GET /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0 => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:09:55.265721 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0560711e-facd-4ea3-8d4b-553100288716 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:09:55.266788 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0560711e-facd-4ea3-8d4b-553100288716 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: f3fac525-692e-4ad4-b3ce-9008e7e1c3b0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:09:55.275812 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0560711e-facd-4ea3-8d4b-553100288716 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:55.276267 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0560711e-facd-4ea3-8d4b-553100288716 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:55.277058 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0560711e-facd-4ea3-8d4b-553100288716 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:55.277487 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0560711e-facd-4ea3-8d4b-553100288716 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:55.426032 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0560711e-facd-4ea3-8d4b-553100288716 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:09:55.434574 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0560711e-facd-4ea3-8d4b-553100288716 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0" status: 200 len: 1391 microversion: 2.1 time: 0.175329 Jun 20 13:09:55.435156 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3792/7481] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:09:55 2022] GET /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0 => generated 1391 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:09:56.454373 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0deb749a-e095-49e1-9b3a-d5190166da14 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:09:56.455006 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0deb749a-e095-49e1-9b3a-d5190166da14 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: f3fac525-692e-4ad4-b3ce-9008e7e1c3b0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:09:56.463049 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0deb749a-e095-49e1-9b3a-d5190166da14 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:56.463577 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0deb749a-e095-49e1-9b3a-d5190166da14 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:56.464634 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0deb749a-e095-49e1-9b3a-d5190166da14 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:56.465107 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0deb749a-e095-49e1-9b3a-d5190166da14 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:56.480111 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-39aa715b-ce57-4f21-825b-ad64a9b73019 req-36f14c22-ec9c-4321-9f75-e0a26b8b85ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3fac525-692e-4ad4-b3ce-9008e7e1c3b0", "name": "network-vif-plugged", "status": "completed", "tag": "fe2baf4a-11fb-4235-a5cd-607ed969ddf6"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:09:56.491896 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-39aa715b-ce57-4f21-825b-ad64a9b73019 req-36f14c22-ec9c-4321-9f75-e0a26b8b85ef service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:56.496412 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-39aa715b-ce57-4f21-825b-ad64a9b73019 req-36f14c22-ec9c-4321-9f75-e0a26b8b85ef service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:56.511651 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-39aa715b-ce57-4f21-825b-ad64a9b73019 req-36f14c22-ec9c-4321-9f75-e0a26b8b85ef service nova] Creating event network-vif-plugged:fe2baf4a-11fb-4235-a5cd-607ed969ddf6 for instance f3fac525-692e-4ad4-b3ce-9008e7e1c3b0 on n-h1-master-1 Jun 20 13:09:56.517216 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-39aa715b-ce57-4f21-825b-ad64a9b73019 req-36f14c22-ec9c-4321-9f75-e0a26b8b85ef service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042366 Jun 20 13:09:56.518136 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3793/7482] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:09:56.646585 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0deb749a-e095-49e1-9b3a-d5190166da14 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:09:56.655168 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0deb749a-e095-49e1-9b3a-d5190166da14 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0" status: 200 len: 1391 microversion: 2.1 time: 0.204847 Jun 20 13:09:56.655793 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3690/7483] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:09:56 2022] GET /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0 => generated 1391 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:09:57.675097 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-37278dcf-67a4-4744-aaf2-b39e15748969 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:09:57.675829 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-37278dcf-67a4-4744-aaf2-b39e15748969 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: f3fac525-692e-4ad4-b3ce-9008e7e1c3b0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:09:57.683229 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-37278dcf-67a4-4744-aaf2-b39e15748969 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:57.683677 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-37278dcf-67a4-4744-aaf2-b39e15748969 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:57.684506 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-37278dcf-67a4-4744-aaf2-b39e15748969 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:57.684949 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-37278dcf-67a4-4744-aaf2-b39e15748969 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:57.825369 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-37278dcf-67a4-4744-aaf2-b39e15748969 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:09:57.836611 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-37278dcf-67a4-4744-aaf2-b39e15748969 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0" status: 200 len: 1564 microversion: 2.1 time: 0.166805 Jun 20 13:09:57.837374 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3794/7484] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:09:57 2022] GET /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0 => generated 1564 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:09:57.856660 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5b2f62ed-826b-44a9-979a-993139e9e70a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:09:57.857291 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5b2f62ed-826b-44a9-979a-993139e9e70a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: f3fac525-692e-4ad4-b3ce-9008e7e1c3b0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:09:57.864837 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5b2f62ed-826b-44a9-979a-993139e9e70a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:57.865442 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5b2f62ed-826b-44a9-979a-993139e9e70a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:57.866203 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5b2f62ed-826b-44a9-979a-993139e9e70a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:57.866657 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5b2f62ed-826b-44a9-979a-993139e9e70a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:58.018198 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5b2f62ed-826b-44a9-979a-993139e9e70a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:09:58.026472 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5b2f62ed-826b-44a9-979a-993139e9e70a tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0" status: 200 len: 1564 microversion: 2.1 time: 0.173879 Jun 20 13:09:58.027197 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3691/7485] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:09:57 2022] GET /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0 => generated 1564 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:09:59.699080 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2d6316ae-e97c-4095-b6d5-f05f8205e9c9 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:09:59.700509 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2d6316ae-e97c-4095-b6d5-f05f8205e9c9 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: f3fac525-692e-4ad4-b3ce-9008e7e1c3b0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:09:59.702647 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:09:59.703435 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:09:59.704745 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:09:59.705723 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:09:59.710106 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-f63e5a2b-2b7f-4f89-a042-f77213e23ac3 req-ab90a9bf-293c-4fde-8ae9-2e1f95d78c91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3fac525-692e-4ad4-b3ce-9008e7e1c3b0", "tag": "fe2baf4a-11fb-4235-a5cd-607ed969ddf6"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:09:59.711543 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2d6316ae-e97c-4095-b6d5-f05f8205e9c9 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:59.712062 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2d6316ae-e97c-4095-b6d5-f05f8205e9c9 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:59.712950 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2d6316ae-e97c-4095-b6d5-f05f8205e9c9 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:59.713451 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2d6316ae-e97c-4095-b6d5-f05f8205e9c9 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:59.721128 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-f63e5a2b-2b7f-4f89-a042-f77213e23ac3 req-ab90a9bf-293c-4fde-8ae9-2e1f95d78c91 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:09:59.721840 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-f63e5a2b-2b7f-4f89-a042-f77213e23ac3 req-ab90a9bf-293c-4fde-8ae9-2e1f95d78c91 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:09:59.738443 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-f63e5a2b-2b7f-4f89-a042-f77213e23ac3 req-ab90a9bf-293c-4fde-8ae9-2e1f95d78c91 service nova] Creating event network-changed:fe2baf4a-11fb-4235-a5cd-607ed969ddf6 for instance f3fac525-692e-4ad4-b3ce-9008e7e1c3b0 on n-h1-master-1 Jun 20 13:09:59.743927 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-f63e5a2b-2b7f-4f89-a042-f77213e23ac3 req-ab90a9bf-293c-4fde-8ae9-2e1f95d78c91 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042757 Jun 20 13:09:59.745878 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3692/7486] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 13:10:00.164537 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2d6316ae-e97c-4095-b6d5-f05f8205e9c9 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:10:00.175426 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2d6316ae-e97c-4095-b6d5-f05f8205e9c9 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0" status: 200 len: 1564 microversion: 2.1 time: 0.480926 Jun 20 13:10:00.176856 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3795/7487] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:09:59 2022] GET /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0 => generated 1564 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:10:21.459311 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:10:21.460824 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=30 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:10:21.467383 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-16b57663-f2eb-46ee-8352-85ec9531e030 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:10:21.468705 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-16b57663-f2eb-46ee-8352-85ec9531e030 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: f3fac525-692e-4ad4-b3ce-9008e7e1c3b0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:10:21.478273 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-16b57663-f2eb-46ee-8352-85ec9531e030 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:10:21.478736 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-16b57663-f2eb-46ee-8352-85ec9531e030 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:10:21.479515 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-16b57663-f2eb-46ee-8352-85ec9531e030 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:10:21.479962 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-16b57663-f2eb-46ee-8352-85ec9531e030 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:10:21.531978 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-16b57663-f2eb-46ee-8352-85ec9531e030 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "POST /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0/action" status: 200 len: 24567 microversion: 2.1 time: 0.076206 Jun 20 13:10:21.532637 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3693/7488] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 13:10:21 2022] POST /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0/action => generated 24567 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 13:10:32.601908 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d72d1973-8ac1-481f-9951-ddca7c57c1e1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:10:32.602529 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d72d1973-8ac1-481f-9951-ddca7c57c1e1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: f3fac525-692e-4ad4-b3ce-9008e7e1c3b0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:10:32.604499 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:10:32.605209 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=32 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:10:32.611669 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d72d1973-8ac1-481f-9951-ddca7c57c1e1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:10:32.612121 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d72d1973-8ac1-481f-9951-ddca7c57c1e1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:10:32.612934 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d72d1973-8ac1-481f-9951-ddca7c57c1e1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:10:32.613378 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d72d1973-8ac1-481f-9951-ddca7c57c1e1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:10:32.641258 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-d72d1973-8ac1-481f-9951-ddca7c57c1e1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lazy-loading 'flavor' on Instance uuid f3fac525-692e-4ad4-b3ce-9008e7e1c3b0 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 13:10:32.723231 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d72d1973-8ac1-481f-9951-ddca7c57c1e1 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "POST /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0/action" status: 202 len: 0 microversion: 2.1 time: 0.125668 Jun 20 13:10:32.724151 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3796/7489] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 13:10:32 2022] POST /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 13:10:32.733507 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-57918d4d-b12f-4e21-9a41-e5de6a6cc1bf tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:10:32.734216 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-57918d4d-b12f-4e21-9a41-e5de6a6cc1bf tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: f3fac525-692e-4ad4-b3ce-9008e7e1c3b0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:10:32.737128 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:10:32.737763 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=4 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:10:32.743532 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-57918d4d-b12f-4e21-9a41-e5de6a6cc1bf tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:10:32.743989 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-57918d4d-b12f-4e21-9a41-e5de6a6cc1bf tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:10:32.744835 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-57918d4d-b12f-4e21-9a41-e5de6a6cc1bf tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:10:32.745331 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-57918d4d-b12f-4e21-9a41-e5de6a6cc1bf tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:10:32.890903 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-57918d4d-b12f-4e21-9a41-e5de6a6cc1bf tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:10:32.898826 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-57918d4d-b12f-4e21-9a41-e5de6a6cc1bf tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0" status: 200 len: 1690 microversion: 2.1 time: 0.169856 Jun 20 13:10:32.899385 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3694/7490] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:10:32 2022] GET /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0 => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:10:33.923174 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-30164dcf-31fc-4562-b88e-54ba5915f411 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:10:33.924321 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-30164dcf-31fc-4562-b88e-54ba5915f411 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: f3fac525-692e-4ad4-b3ce-9008e7e1c3b0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:10:33.932769 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-30164dcf-31fc-4562-b88e-54ba5915f411 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:10:33.933218 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-30164dcf-31fc-4562-b88e-54ba5915f411 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:10:33.933980 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-30164dcf-31fc-4562-b88e-54ba5915f411 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:10:33.934410 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-30164dcf-31fc-4562-b88e-54ba5915f411 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:10:34.071566 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-30164dcf-31fc-4562-b88e-54ba5915f411 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:10:34.080141 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-30164dcf-31fc-4562-b88e-54ba5915f411 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0" status: 200 len: 1673 microversion: 2.1 time: 0.165571 Jun 20 13:10:34.080754 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3797/7491] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:10:33 2022] GET /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0 => generated 1673 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:10:35.191038 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7dacca85-6a1c-4eac-bef9-d0a145d455be tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:10:35.192761 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7dacca85-6a1c-4eac-bef9-d0a145d455be tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: f3fac525-692e-4ad4-b3ce-9008e7e1c3b0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:10:35.201051 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7dacca85-6a1c-4eac-bef9-d0a145d455be tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:10:35.201443 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7dacca85-6a1c-4eac-bef9-d0a145d455be tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:10:35.202214 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7dacca85-6a1c-4eac-bef9-d0a145d455be tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:10:35.202657 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7dacca85-6a1c-4eac-bef9-d0a145d455be tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:10:35.250881 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7dacca85-6a1c-4eac-bef9-d0a145d455be tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "POST /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0/action" status: 200 len: 38417 microversion: 2.1 time: 0.066257 Jun 20 13:10:35.251532 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3695/7492] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 13:10:35 2022] POST /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0/action => generated 38417 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 13:10:35.268886 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4c1fe407-1968-4bcb-a126-49687d0ef3b4 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:10:35.269657 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4c1fe407-1968-4bcb-a126-49687d0ef3b4 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: f3fac525-692e-4ad4-b3ce-9008e7e1c3b0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:10:35.278383 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4c1fe407-1968-4bcb-a126-49687d0ef3b4 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:10:35.278830 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4c1fe407-1968-4bcb-a126-49687d0ef3b4 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:10:35.279584 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4c1fe407-1968-4bcb-a126-49687d0ef3b4 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:10:35.280025 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4c1fe407-1968-4bcb-a126-49687d0ef3b4 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:10:35.352113 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4c1fe407-1968-4bcb-a126-49687d0ef3b4 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "POST /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0/action" status: 202 len: 0 microversion: 2.1 time: 0.088961 Jun 20 13:10:35.352775 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3798/7493] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 13:10:35 2022] POST /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 13:10:35.362271 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c9ed7155-be3c-4ff8-b2c1-4b2337d260ee tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:10:35.363074 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c9ed7155-be3c-4ff8-b2c1-4b2337d260ee tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: f3fac525-692e-4ad4-b3ce-9008e7e1c3b0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:10:35.370646 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c9ed7155-be3c-4ff8-b2c1-4b2337d260ee tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:10:35.371101 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c9ed7155-be3c-4ff8-b2c1-4b2337d260ee tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:10:35.371877 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c9ed7155-be3c-4ff8-b2c1-4b2337d260ee tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:10:35.372877 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c9ed7155-be3c-4ff8-b2c1-4b2337d260ee tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:10:35.593808 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c9ed7155-be3c-4ff8-b2c1-4b2337d260ee tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:10:35.601777 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c9ed7155-be3c-4ff8-b2c1-4b2337d260ee tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0" status: 200 len: 1679 microversion: 2.1 time: 0.243941 Jun 20 13:10:35.602369 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3696/7494] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:10:35 2022] GET /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0 => generated 1679 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:10:36.626376 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-486e3bd3-6830-4e28-b805-701aaad72038 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:10:36.627345 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-486e3bd3-6830-4e28-b805-701aaad72038 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: f3fac525-692e-4ad4-b3ce-9008e7e1c3b0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:10:36.635306 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-486e3bd3-6830-4e28-b805-701aaad72038 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:10:36.635766 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-486e3bd3-6830-4e28-b805-701aaad72038 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:10:36.636625 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-486e3bd3-6830-4e28-b805-701aaad72038 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:10:36.637121 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-486e3bd3-6830-4e28-b805-701aaad72038 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:10:36.777101 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-486e3bd3-6830-4e28-b805-701aaad72038 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:10:36.785269 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-486e3bd3-6830-4e28-b805-701aaad72038 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0" status: 200 len: 1679 microversion: 2.1 time: 0.167561 Jun 20 13:10:36.786078 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3799/7495] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:10:36 2022] GET /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:10:37.806444 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4edce7ea-2edc-4935-8ab7-d0cace8e054c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:10:37.807699 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4edce7ea-2edc-4935-8ab7-d0cace8e054c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: f3fac525-692e-4ad4-b3ce-9008e7e1c3b0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:10:37.815863 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4edce7ea-2edc-4935-8ab7-d0cace8e054c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:10:37.816366 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4edce7ea-2edc-4935-8ab7-d0cace8e054c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:10:37.817137 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4edce7ea-2edc-4935-8ab7-d0cace8e054c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:10:37.817577 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4edce7ea-2edc-4935-8ab7-d0cace8e054c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:10:37.960505 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4edce7ea-2edc-4935-8ab7-d0cace8e054c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:10:37.972070 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4edce7ea-2edc-4935-8ab7-d0cace8e054c tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0" status: 200 len: 1682 microversion: 2.1 time: 0.171281 Jun 20 13:10:37.972878 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3697/7496] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:10:37 2022] GET /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0 => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:10:38.065838 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-35b777e3-a326-49e5-bbb3-934fdd3a13d6 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:10:38.066736 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-35b777e3-a326-49e5-bbb3-934fdd3a13d6 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: f3fac525-692e-4ad4-b3ce-9008e7e1c3b0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:10:38.077186 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-35b777e3-a326-49e5-bbb3-934fdd3a13d6 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:10:38.077881 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-35b777e3-a326-49e5-bbb3-934fdd3a13d6 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:10:38.079174 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-35b777e3-a326-49e5-bbb3-934fdd3a13d6 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:10:38.079911 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-35b777e3-a326-49e5-bbb3-934fdd3a13d6 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:10:38.127491 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-35b777e3-a326-49e5-bbb3-934fdd3a13d6 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "POST /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0/action" status: 200 len: 38417 microversion: 2.1 time: 0.065550 Jun 20 13:10:38.128289 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3800/7497] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 13:10:38 2022] POST /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0/action => generated 38417 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 13:10:39.427344 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a3388a1e-2b5b-43cf-8a1c-41f510e1f33b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:10:39.427902 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a3388a1e-2b5b-43cf-8a1c-41f510e1f33b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: f3fac525-692e-4ad4-b3ce-9008e7e1c3b0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:10:39.435830 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3388a1e-2b5b-43cf-8a1c-41f510e1f33b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:10:39.436339 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3388a1e-2b5b-43cf-8a1c-41f510e1f33b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:10:39.437277 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3388a1e-2b5b-43cf-8a1c-41f510e1f33b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:10:39.437905 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3388a1e-2b5b-43cf-8a1c-41f510e1f33b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:10:39.467194 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a3388a1e-2b5b-43cf-8a1c-41f510e1f33b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: f3fac525-692e-4ad4-b3ce-9008e7e1c3b0] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 13:10:39.485359 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-5385d8d9-5809-426e-9eda-602c76a012e0 req-8e00506d-d5cf-417b-9a46-736c480fc4b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3fac525-692e-4ad4-b3ce-9008e7e1c3b0", "tag": "fe2baf4a-11fb-4235-a5cd-607ed969ddf6"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:10:39.498616 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-5385d8d9-5809-426e-9eda-602c76a012e0 req-8e00506d-d5cf-417b-9a46-736c480fc4b9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:10:39.499250 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-5385d8d9-5809-426e-9eda-602c76a012e0 req-8e00506d-d5cf-417b-9a46-736c480fc4b9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:10:39.511863 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-5385d8d9-5809-426e-9eda-602c76a012e0 req-8e00506d-d5cf-417b-9a46-736c480fc4b9 service nova] Creating event network-changed:fe2baf4a-11fb-4235-a5cd-607ed969ddf6 for instance f3fac525-692e-4ad4-b3ce-9008e7e1c3b0 on n-h1-master-1 Jun 20 13:10:39.517257 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-5385d8d9-5809-426e-9eda-602c76a012e0 req-8e00506d-d5cf-417b-9a46-736c480fc4b9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091929 Jun 20 13:10:39.517887 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3801/7498] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:10:39.556761 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a3388a1e-2b5b-43cf-8a1c-41f510e1f33b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0" status: 204 len: 0 microversion: 2.1 time: 0.133440 Jun 20 13:10:39.560984 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3698/7499] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 13:10:39 2022] DELETE /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 13:10:39.567018 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dcbaca76-016f-4b29-b2bb-84af3cc1d643 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:10:39.567717 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dcbaca76-016f-4b29-b2bb-84af3cc1d643 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: f3fac525-692e-4ad4-b3ce-9008e7e1c3b0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:10:39.575654 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dcbaca76-016f-4b29-b2bb-84af3cc1d643 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:10:39.576111 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dcbaca76-016f-4b29-b2bb-84af3cc1d643 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:10:39.576961 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dcbaca76-016f-4b29-b2bb-84af3cc1d643 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:10:39.577434 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dcbaca76-016f-4b29-b2bb-84af3cc1d643 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:10:39.717541 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dcbaca76-016f-4b29-b2bb-84af3cc1d643 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:10:39.725635 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dcbaca76-016f-4b29-b2bb-84af3cc1d643 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0" status: 200 len: 1688 microversion: 2.1 time: 0.163108 Jun 20 13:10:39.726440 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3802/7500] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:10:39 2022] GET /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0 => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:10:40.744099 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-55ded6ab-24a8-415a-8fa0-4ebf23acc35b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:10:40.744848 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-55ded6ab-24a8-415a-8fa0-4ebf23acc35b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: f3fac525-692e-4ad4-b3ce-9008e7e1c3b0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:10:40.752068 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-55ded6ab-24a8-415a-8fa0-4ebf23acc35b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:10:40.752576 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-55ded6ab-24a8-415a-8fa0-4ebf23acc35b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:10:40.753361 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-55ded6ab-24a8-415a-8fa0-4ebf23acc35b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:10:40.753796 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-55ded6ab-24a8-415a-8fa0-4ebf23acc35b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:10:40.930521 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-55ded6ab-24a8-415a-8fa0-4ebf23acc35b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:10:40.939209 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-55ded6ab-24a8-415a-8fa0-4ebf23acc35b tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0" status: 200 len: 1688 microversion: 2.1 time: 0.199592 Jun 20 13:10:40.939804 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3699/7501] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:10:40 2022] GET /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0 => generated 1688 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:10:41.682550 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-4f3d5a62-d20b-4a55-abf7-72ca7f415fc5 req-79c00f0b-58e8-4b86-bc21-340c2390b097 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3fac525-692e-4ad4-b3ce-9008e7e1c3b0", "name": "network-vif-deleted", "tag": "fe2baf4a-11fb-4235-a5cd-607ed969ddf6"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:10:41.694611 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-4f3d5a62-d20b-4a55-abf7-72ca7f415fc5 req-79c00f0b-58e8-4b86-bc21-340c2390b097 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:10:41.695115 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-4f3d5a62-d20b-4a55-abf7-72ca7f415fc5 req-79c00f0b-58e8-4b86-bc21-340c2390b097 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:10:41.707247 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-4f3d5a62-d20b-4a55-abf7-72ca7f415fc5 req-79c00f0b-58e8-4b86-bc21-340c2390b097 service nova] Creating event network-vif-deleted:fe2baf4a-11fb-4235-a5cd-607ed969ddf6 for instance f3fac525-692e-4ad4-b3ce-9008e7e1c3b0 on n-h1-master-1 Jun 20 13:10:41.712823 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-4f3d5a62-d20b-4a55-abf7-72ca7f415fc5 req-79c00f0b-58e8-4b86-bc21-340c2390b097 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035160 Jun 20 13:10:41.713426 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3803/7502] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:10:41.956872 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9be57286-dbb9-4705-8c47-7b4d8b408e2f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:10:41.957529 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9be57286-dbb9-4705-8c47-7b4d8b408e2f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: f3fac525-692e-4ad4-b3ce-9008e7e1c3b0] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:10:41.965537 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9be57286-dbb9-4705-8c47-7b4d8b408e2f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:10:41.966004 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9be57286-dbb9-4705-8c47-7b4d8b408e2f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:10:41.966785 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9be57286-dbb9-4705-8c47-7b4d8b408e2f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:10:41.967234 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9be57286-dbb9-4705-8c47-7b4d8b408e2f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:10:42.000788 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9be57286-dbb9-4705-8c47-7b4d8b408e2f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:10:42.001250 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9be57286-dbb9-4705-8c47-7b4d8b408e2f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:10:42.002161 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-9be57286-dbb9-4705-8c47-7b4d8b408e2f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lazy-loading 'fault' on Instance uuid f3fac525-692e-4ad4-b3ce-9008e7e1c3b0 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 13:10:42.049892 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9be57286-dbb9-4705-8c47-7b4d8b408e2f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fb2c86bbd4403481e17934014fdfb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acee41bacfa54fef8c5eb48cb67de032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:10:42.059594 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9be57286-dbb9-4705-8c47-7b4d8b408e2f tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0" status: 200 len: 1356 microversion: 2.1 time: 0.106857 Jun 20 13:10:42.060405 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3700/7503] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:10:41 2022] GET /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0 => generated 1356 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:10:43.085159 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-82999057-2f82-4de5-8604-a89bc93d63ed tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:10:43.086456 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-82999057-2f82-4de5-8604-a89bc93d63ed tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] [instance: f3fac525-692e-4ad4-b3ce-9008e7e1c3b0] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:10:43.097656 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-82999057-2f82-4de5-8604-a89bc93d63ed tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:10:43.098311 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-82999057-2f82-4de5-8604-a89bc93d63ed tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:10:43.099582 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-82999057-2f82-4de5-8604-a89bc93d63ed tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:10:43.100360 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-82999057-2f82-4de5-8604-a89bc93d63ed tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:10:43.114662 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-82999057-2f82-4de5-8604-a89bc93d63ed tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] HTTP exception thrown: Instance f3fac525-692e-4ad4-b3ce-9008e7e1c3b0 could not be found. Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-82999057-2f82-4de5-8604-a89bc93d63ed tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Request method failure captured: Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0 HTTP/1.1 Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisHACr1Z1Pf7gGI9V77m0nnUZzZ5nWX2yhLGjpUHG7LL0xqNYFkbL4_1IIwiiDwVBoZSpoLQS1AbGh1f5DF9yEuMUKi5BxlkuR9qjJWkNvnjSqcfiG8X5PQZ9jVFWFokLDrkM49GBwx_isFNyLwrdbAahsC54lqfNzVHfDIXyGD4YFxM Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: acee41bacfa54fef8c5eb48cb67de032 Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1657633917 Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/acee41bacfa54fef8c5eb48cb67de032"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/acee41bacfa54fef8c5eb48cb67de032"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/acee41bacfa54fef8c5eb48cb67de032"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_acee41bacfa54fef8c5eb48cb67de032"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1657633917 Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: acee41bacfa54fef8c5eb48cb67de032 Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1657633917 Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-TestNetworkAdvancedServerOps-1657633917-project Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: b0fb2c86bbd4403481e17934014fdfb7 Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1657633917-project Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: exception: Instance f3fac525-692e-4ad4-b3ce-9008e7e1c3b0 could not be found. Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'f3fac525-692e-4ad4-b3ce-9008e7e1c3b0'} Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3fac525-692e-4ad4-b3ce-9008e7e1c3b0 could not be found. Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3fac525-692e-4ad4-b3ce-9008e7e1c3b0 could not be found. Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 13:10:43.116360 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 13:10:43.120496 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 13:10:43.120496 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 13:10:43.120496 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 13:10:43.120496 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 13:10:43.120496 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 13:10:43.120496 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 13:10:43.120496 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3fac525-692e-4ad4-b3ce-9008e7e1c3b0 could not be found. Jun 20 13:10:43.120496 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 13:10:43.120496 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-82999057-2f82-4de5-8604-a89bc93d63ed tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Returning 404 to user: Instance f3fac525-692e-4ad4-b3ce-9008e7e1c3b0 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 13:10:43.120496 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-82999057-2f82-4de5-8604-a89bc93d63ed tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "GET /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0" status: 404 len: 111 microversion: 2.1 time: 0.041540 Jun 20 13:10:43.120496 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3804/7504] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:10:43 2022] GET /compute/v2.1/servers/f3fac525-692e-4ad4-b3ce-9008e7e1c3b0 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 13:10:46.421336 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2954f55d-c056-49f5-b30c-ee86b53b4088 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] Calling method '.version_select at 0x7f60723fe820>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:10:46.454225 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2954f55d-c056-49f5-b30c-ee86b53b4088 tempest-TestNetworkAdvancedServerOps-1657633917 tempest-TestNetworkAdvancedServerOps-1657633917-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-641751744" status: 202 len: 0 microversion: 2.1 time: 0.037296 Jun 20 13:10:46.454822 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3701/7505] 10.222.0.27 () {58 vars in 1280 bytes} [Mon Jun 20 13:10:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-641751744 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 13:10:57.792570 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=18 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:10:57.793757 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:10:58.000369 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-61e1bf90-95ef-4408-a5aa-1d54a86a3965 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Action: 'create', calling method: .version_select at 0x7f60721a7ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-17931136", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLnZtU6qbfOndNHsvhjTXxXGrC9364dqhomaLEaQwl6GTtwJ+yjKBeNr67VoFOmlf6TL79oKBvYc4/1jTD8CxR/PFpXPbCSeAp7r0bnWqTegxL8h/7SHCb9CTb9STPDweA=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:10:58.026412 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-61e1bf90-95ef-4408-a5aa-1d54a86a3965 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Getting quotas for project 1873e58ef0bb4d8da79eb47fc611b12c. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 13:10:58.033560 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-61e1bf90-95ef-4408-a5aa-1d54a86a3965 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Getting quotas for user 2f302f2f7713487fb2140218e737e9ce and project 1873e58ef0bb4d8da79eb47fc611b12c. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 13:10:58.064343 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-61e1bf90-95ef-4408-a5aa-1d54a86a3965 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.277223 Jun 20 13:10:58.065545 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3805/7506] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 13:10:57 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:10:59.120168 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-31b6e258-93a1-427c-b670-61875569a04d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-495752232", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-17931136", "security_groups": [{"name": "tempest-secgroup-smoke-1476333918"}], "networks": [{"uuid": "1b6d3671-0a05-420c-9131-4afa82167c89"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:10:59.131442 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:10:59.132452 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:10:59.244002 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-31b6e258-93a1-427c-b670-61875569a04d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] validate_networks() for [('1b6d3671-0a05-420c-9131-4afa82167c89', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 13:10:59.632995 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-31b6e258-93a1-427c-b670-61875569a04d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 13:10:59.633686 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-31b6e258-93a1-427c-b670-61875569a04d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 13:10:59.634533 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-31b6e258-93a1-427c-b670-61875569a04d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 13:10:59.634964 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-31b6e258-93a1-427c-b670-61875569a04d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 13:10:59.635424 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-31b6e258-93a1-427c-b670-61875569a04d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 13:10:59.644920 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-31b6e258-93a1-427c-b670-61875569a04d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:10:59.645388 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-31b6e258-93a1-427c-b670-61875569a04d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:10:59.646207 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-31b6e258-93a1-427c-b670-61875569a04d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:10:59.646668 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-31b6e258-93a1-427c-b670-61875569a04d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:10:59.666757 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-31b6e258-93a1-427c-b670-61875569a04d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Getting quotas for project 1873e58ef0bb4d8da79eb47fc611b12c. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 13:10:59.672799 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-31b6e258-93a1-427c-b670-61875569a04d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Getting quotas for user 2f302f2f7713487fb2140218e737e9ce and project 1873e58ef0bb4d8da79eb47fc611b12c. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 13:10:59.686625 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-31b6e258-93a1-427c-b670-61875569a04d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 13:10:59.688968 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-31b6e258-93a1-427c-b670-61875569a04d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 13:10:59.736749 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-31b6e258-93a1-427c-b670-61875569a04d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.620800 Jun 20 13:10:59.737689 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3702/7507] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 13:10:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 13:10:59.749616 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-39defb4c-d36b-42f6-96bf-ddefce78673b tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:10:59.750316 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-39defb4c-d36b-42f6-96bf-ddefce78673b tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:10:59.806531 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-39defb4c-d36b-42f6-96bf-ddefce78673b tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:10:59.813745 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-39defb4c-d36b-42f6-96bf-ddefce78673b tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1244 microversion: 2.1 time: 0.069228 Jun 20 13:10:59.814359 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3806/7508] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:10:59 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1244 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:11:00.832330 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5b2d376b-4d6e-45e9-a46d-8529eb7139d7 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:11:00.833103 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5b2d376b-4d6e-45e9-a46d-8529eb7139d7 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:11:00.895274 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5b2d376b-4d6e-45e9-a46d-8529eb7139d7 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:11:00.903237 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5b2d376b-4d6e-45e9-a46d-8529eb7139d7 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1244 microversion: 2.1 time: 0.075935 Jun 20 13:11:00.903867 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3703/7509] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:11:00 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1244 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:11:01.920690 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-247ac761-7bd8-4b85-82ef-a3091cb22731 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:11:01.921319 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-247ac761-7bd8-4b85-82ef-a3091cb22731 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:11:01.977039 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-247ac761-7bd8-4b85-82ef-a3091cb22731 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:11:01.984791 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-247ac761-7bd8-4b85-82ef-a3091cb22731 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1244 microversion: 2.1 time: 0.067966 Jun 20 13:11:01.985388 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3807/7510] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:11:01 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1244 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 13:11:03.002386 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0afe3819-ba59-4f26-b6ed-a1df5cc7cb83 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:11:03.003158 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0afe3819-ba59-4f26-b6ed-a1df5cc7cb83 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:11:03.059144 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0afe3819-ba59-4f26-b6ed-a1df5cc7cb83 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:11:03.066009 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0afe3819-ba59-4f26-b6ed-a1df5cc7cb83 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1244 microversion: 2.1 time: 0.067710 Jun 20 13:11:03.066571 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3704/7511] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:11:02 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1244 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:11:04.083305 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0fdd2666-4ad7-4d66-beac-ba15d8ccfafa tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:11:04.083914 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0fdd2666-4ad7-4d66-beac-ba15d8ccfafa tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:11:04.091997 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0fdd2666-4ad7-4d66-beac-ba15d8ccfafa tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:11:04.092505 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0fdd2666-4ad7-4d66-beac-ba15d8ccfafa tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:11:04.093276 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0fdd2666-4ad7-4d66-beac-ba15d8ccfafa tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:11:04.093712 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0fdd2666-4ad7-4d66-beac-ba15d8ccfafa tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:11:04.154322 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0fdd2666-4ad7-4d66-beac-ba15d8ccfafa tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:11:04.162696 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0fdd2666-4ad7-4d66-beac-ba15d8ccfafa tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1248 microversion: 2.1 time: 0.083334 Jun 20 13:11:04.163268 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3808/7512] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:11:04 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1248 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:11:05.179409 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-804c4fc1-c58c-4517-af6f-8b9b22488960 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:11:05.180037 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-804c4fc1-c58c-4517-af6f-8b9b22488960 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:11:05.188348 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-804c4fc1-c58c-4517-af6f-8b9b22488960 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:11:05.188888 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-804c4fc1-c58c-4517-af6f-8b9b22488960 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:11:05.189751 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-804c4fc1-c58c-4517-af6f-8b9b22488960 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:11:05.190197 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-804c4fc1-c58c-4517-af6f-8b9b22488960 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:11:05.278468 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-804c4fc1-c58c-4517-af6f-8b9b22488960 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:11:05.286165 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-804c4fc1-c58c-4517-af6f-8b9b22488960 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1302 microversion: 2.1 time: 0.110812 Jun 20 13:11:05.286758 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3705/7513] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:11:05 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1302 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:11:06.303231 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-75d4e3bd-5e3c-4da6-8fcb-eacdc3bd05ce tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:11:06.304121 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-75d4e3bd-5e3c-4da6-8fcb-eacdc3bd05ce tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:11:06.312176 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-75d4e3bd-5e3c-4da6-8fcb-eacdc3bd05ce tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:11:06.312818 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-75d4e3bd-5e3c-4da6-8fcb-eacdc3bd05ce tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:11:06.313602 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-75d4e3bd-5e3c-4da6-8fcb-eacdc3bd05ce tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:11:06.314040 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-75d4e3bd-5e3c-4da6-8fcb-eacdc3bd05ce tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:11:06.471840 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-75d4e3bd-5e3c-4da6-8fcb-eacdc3bd05ce tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:11:06.480114 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-75d4e3bd-5e3c-4da6-8fcb-eacdc3bd05ce tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1370 microversion: 2.1 time: 0.180777 Jun 20 13:11:06.480754 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3809/7514] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:11:06 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:11:06.592089 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-2c783ec0-f7f5-4250-ab12-96164662aaf6 req-efed0836-04cf-4a64-8609-b0c126413af9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3ee985a-b97b-4abc-8351-71e43f9e0066", "tag": "c4306861-7846-4fce-aca1-7dd204408bc7"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:11:06.601828 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-2c783ec0-f7f5-4250-ab12-96164662aaf6 req-efed0836-04cf-4a64-8609-b0c126413af9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:11:06.602777 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-2c783ec0-f7f5-4250-ab12-96164662aaf6 req-efed0836-04cf-4a64-8609-b0c126413af9 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:11:06.614976 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-2c783ec0-f7f5-4250-ab12-96164662aaf6 req-efed0836-04cf-4a64-8609-b0c126413af9 service nova] Creating event network-changed:c4306861-7846-4fce-aca1-7dd204408bc7 for instance b3ee985a-b97b-4abc-8351-71e43f9e0066 on n-h1-master-1 Jun 20 13:11:06.620267 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-2c783ec0-f7f5-4250-ab12-96164662aaf6 req-efed0836-04cf-4a64-8609-b0c126413af9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034387 Jun 20 13:11:06.621016 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3706/7515] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:11:07.499562 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6d79c9ad-2835-41f2-887a-349fae074d2d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:11:07.500345 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6d79c9ad-2835-41f2-887a-349fae074d2d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:11:07.509292 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6d79c9ad-2835-41f2-887a-349fae074d2d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:11:07.509853 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6d79c9ad-2835-41f2-887a-349fae074d2d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:11:07.510799 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6d79c9ad-2835-41f2-887a-349fae074d2d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:11:07.511353 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6d79c9ad-2835-41f2-887a-349fae074d2d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:11:07.654672 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6d79c9ad-2835-41f2-887a-349fae074d2d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:11:07.666297 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6d79c9ad-2835-41f2-887a-349fae074d2d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1370 microversion: 2.1 time: 0.171309 Jun 20 13:11:07.667134 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3810/7516] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:11:07 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:11:08.694406 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-18fed996-653f-4cf5-a907-2e5f82e58bf0 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:11:08.695325 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-18fed996-653f-4cf5-a907-2e5f82e58bf0 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:11:08.702494 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-18fed996-653f-4cf5-a907-2e5f82e58bf0 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:11:08.702956 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-18fed996-653f-4cf5-a907-2e5f82e58bf0 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:11:08.703737 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-18fed996-653f-4cf5-a907-2e5f82e58bf0 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:11:08.704184 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-18fed996-653f-4cf5-a907-2e5f82e58bf0 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:11:08.847845 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-18fed996-653f-4cf5-a907-2e5f82e58bf0 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:11:08.856957 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-18fed996-653f-4cf5-a907-2e5f82e58bf0 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1370 microversion: 2.1 time: 0.170233 Jun 20 13:11:08.857514 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3707/7517] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:11:08 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:11:09.874464 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-80ff9f22-b5df-4601-93a7-b342ba127876 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:11:09.875071 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-80ff9f22-b5df-4601-93a7-b342ba127876 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:11:09.882853 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-80ff9f22-b5df-4601-93a7-b342ba127876 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:11:09.883311 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-80ff9f22-b5df-4601-93a7-b342ba127876 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:11:09.884071 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-80ff9f22-b5df-4601-93a7-b342ba127876 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:11:09.884908 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-80ff9f22-b5df-4601-93a7-b342ba127876 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:11:10.023958 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-80ff9f22-b5df-4601-93a7-b342ba127876 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:11:10.032301 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-80ff9f22-b5df-4601-93a7-b342ba127876 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1370 microversion: 2.1 time: 0.161752 Jun 20 13:11:10.032910 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3811/7518] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:11:09 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:11:11.050012 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5f1fbc41-603d-4e48-a86c-e4a537b8dce1 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:11:11.050604 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5f1fbc41-603d-4e48-a86c-e4a537b8dce1 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:11:11.052704 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:11:11.059544 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5f1fbc41-603d-4e48-a86c-e4a537b8dce1 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:11:11.060099 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5f1fbc41-603d-4e48-a86c-e4a537b8dce1 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:11:11.061700 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5f1fbc41-603d-4e48-a86c-e4a537b8dce1 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:11:11.062158 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5f1fbc41-603d-4e48-a86c-e4a537b8dce1 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:11:11.204404 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5f1fbc41-603d-4e48-a86c-e4a537b8dce1 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:11:11.212031 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5f1fbc41-603d-4e48-a86c-e4a537b8dce1 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1370 microversion: 2.1 time: 0.166282 Jun 20 13:11:11.212693 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3708/7519] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:11:11 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:11:12.082532 n-d-master-1 devstack@n-api.service[119127]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 13:11:12.083515 n-d-master-1 devstack@n-api.service[119127]: Mon Jun 20 13:11:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 13:11:12.233432 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d6bccc98-66de-4376-88da-999ba32b3e40 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:11:12.234469 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d6bccc98-66de-4376-88da-999ba32b3e40 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:11:12.237330 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=8 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:11:12.243452 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d6bccc98-66de-4376-88da-999ba32b3e40 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:11:12.243928 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d6bccc98-66de-4376-88da-999ba32b3e40 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:11:12.244771 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d6bccc98-66de-4376-88da-999ba32b3e40 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:11:12.245233 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d6bccc98-66de-4376-88da-999ba32b3e40 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:11:12.383826 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d6bccc98-66de-4376-88da-999ba32b3e40 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:11:12.392073 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d6bccc98-66de-4376-88da-999ba32b3e40 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1370 microversion: 2.1 time: 0.165371 Jun 20 13:11:12.392664 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3812/7520] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:11:12 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:11:12.832375 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-4bd6417d-fe3a-4730-995b-e08daa218f26 req-f7c4711f-4fd4-4af9-8f38-d423415619c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3ee985a-b97b-4abc-8351-71e43f9e0066", "name": "network-vif-plugged", "status": "completed", "tag": "c4306861-7846-4fce-aca1-7dd204408bc7"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:11:12.844504 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-4bd6417d-fe3a-4730-995b-e08daa218f26 req-f7c4711f-4fd4-4af9-8f38-d423415619c1 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:11:12.844891 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-4bd6417d-fe3a-4730-995b-e08daa218f26 req-f7c4711f-4fd4-4af9-8f38-d423415619c1 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:11:12.856121 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-4bd6417d-fe3a-4730-995b-e08daa218f26 req-f7c4711f-4fd4-4af9-8f38-d423415619c1 service nova] Creating event network-vif-plugged:c4306861-7846-4fce-aca1-7dd204408bc7 for instance b3ee985a-b97b-4abc-8351-71e43f9e0066 on n-h1-master-1 Jun 20 13:11:12.861699 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-4bd6417d-fe3a-4730-995b-e08daa218f26 req-f7c4711f-4fd4-4af9-8f38-d423415619c1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098711 Jun 20 13:11:12.862504 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3709/7521] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:11:13.410726 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-29298af1-7e18-4227-8ecb-e6e395d42135 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:11:13.411320 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-29298af1-7e18-4227-8ecb-e6e395d42135 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:11:13.420506 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-29298af1-7e18-4227-8ecb-e6e395d42135 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:11:13.420960 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-29298af1-7e18-4227-8ecb-e6e395d42135 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:11:13.422021 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-29298af1-7e18-4227-8ecb-e6e395d42135 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:11:13.422469 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-29298af1-7e18-4227-8ecb-e6e395d42135 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:11:13.559416 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-29298af1-7e18-4227-8ecb-e6e395d42135 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:11:13.567565 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-29298af1-7e18-4227-8ecb-e6e395d42135 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1370 microversion: 2.1 time: 0.162096 Jun 20 13:11:13.568140 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3813/7522] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:11:13 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:11:14.582439 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=10 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:11:14.587712 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e077df9a-0051-4166-a8af-a6ca479e5541 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:11:14.588457 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e077df9a-0051-4166-a8af-a6ca479e5541 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:11:14.595211 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e077df9a-0051-4166-a8af-a6ca479e5541 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:11:14.595678 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e077df9a-0051-4166-a8af-a6ca479e5541 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:11:14.596494 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e077df9a-0051-4166-a8af-a6ca479e5541 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:11:14.596946 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e077df9a-0051-4166-a8af-a6ca479e5541 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:11:14.748921 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e077df9a-0051-4166-a8af-a6ca479e5541 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:11:14.757144 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e077df9a-0051-4166-a8af-a6ca479e5541 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1553 microversion: 2.1 time: 0.175773 Jun 20 13:11:14.757725 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3710/7523] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:11:14 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1553 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:11:14.773969 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-aa3ef915-7e4c-414e-9c0b-2430ab77f008 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:11:14.774536 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-aa3ef915-7e4c-414e-9c0b-2430ab77f008 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:11:14.782142 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa3ef915-7e4c-414e-9c0b-2430ab77f008 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:11:14.782597 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa3ef915-7e4c-414e-9c0b-2430ab77f008 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:11:14.783365 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa3ef915-7e4c-414e-9c0b-2430ab77f008 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:11:14.783806 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa3ef915-7e4c-414e-9c0b-2430ab77f008 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:11:14.927396 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-aa3ef915-7e4c-414e-9c0b-2430ab77f008 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:11:14.935510 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-aa3ef915-7e4c-414e-9c0b-2430ab77f008 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1553 microversion: 2.1 time: 0.165557 Jun 20 13:11:14.936080 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3814/7524] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:11:14 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:11:16.699432 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-ca96e75f-d775-4a78-8a07-8a6f57eb0cb8 req-67feaa2b-ce43-407f-88d5-8737fbabf447 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3ee985a-b97b-4abc-8351-71e43f9e0066", "tag": "c4306861-7846-4fce-aca1-7dd204408bc7"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:11:16.708412 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-ca96e75f-d775-4a78-8a07-8a6f57eb0cb8 req-67feaa2b-ce43-407f-88d5-8737fbabf447 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:11:16.708889 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-ca96e75f-d775-4a78-8a07-8a6f57eb0cb8 req-67feaa2b-ce43-407f-88d5-8737fbabf447 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:11:16.720035 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-ca96e75f-d775-4a78-8a07-8a6f57eb0cb8 req-67feaa2b-ce43-407f-88d5-8737fbabf447 service nova] Creating event network-changed:c4306861-7846-4fce-aca1-7dd204408bc7 for instance b3ee985a-b97b-4abc-8351-71e43f9e0066 on n-h1-master-1 Jun 20 13:11:16.725285 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-ca96e75f-d775-4a78-8a07-8a6f57eb0cb8 req-67feaa2b-ce43-407f-88d5-8737fbabf447 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029419 Jun 20 13:11:16.726008 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3711/7525] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:12:50.192486 n-d-master-1 devstack@n-api.service[119128]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 13:12:50.193337 n-d-master-1 devstack@n-api.service[119128]: Mon Jun 20 13:12:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 13:13:11.496230 n-d-master-1 devstack@n-api.service[119127]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e724c47c-e194-481c-b307-79cd496ecce0] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 20 13:13:11.496844 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:13:11.497579 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=42 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:13:11.501647 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bd496424-e409-425a-b184-c6cbbaa6a594 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:13:11.502187 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bd496424-e409-425a-b184-c6cbbaa6a594 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:13:11.509577 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bd496424-e409-425a-b184-c6cbbaa6a594 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:11.510111 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bd496424-e409-425a-b184-c6cbbaa6a594 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:11.510894 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bd496424-e409-425a-b184-c6cbbaa6a594 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:11.511316 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bd496424-e409-425a-b184-c6cbbaa6a594 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:11.534745 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-bd496424-e409-425a-b184-c6cbbaa6a594 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lazy-loading 'flavor' on Instance uuid b3ee985a-b97b-4abc-8351-71e43f9e0066 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 13:13:11.804966 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bd496424-e409-425a-b184-c6cbbaa6a594 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "POST /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066/action" status: 202 len: 0 microversion: 2.1 time: 0.311139 Jun 20 13:13:11.805599 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3815/7526] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 13:13:11 2022] POST /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 13:13:11.812936 n-d-master-1 devstack@n-api.service[119128]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aec4b5a8-4fa3-4bbf-bcd3-4f7b001dec4c] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 20 13:13:11.813756 n-d-master-1 devstack@n-api.service[119128]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34606191-6ad4-4abb-b900-405f87896bf5] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 20 13:13:11.814392 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:13:11.815142 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=32 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:13:11.819696 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-645599d8-5fd5-4797-a113-b602f2533227 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:13:11.820640 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-645599d8-5fd5-4797-a113-b602f2533227 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:13:11.828248 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-645599d8-5fd5-4797-a113-b602f2533227 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:11.828700 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-645599d8-5fd5-4797-a113-b602f2533227 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:11.829602 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-645599d8-5fd5-4797-a113-b602f2533227 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:11.830071 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-645599d8-5fd5-4797-a113-b602f2533227 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:11.980964 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-645599d8-5fd5-4797-a113-b602f2533227 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:13:11.988502 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-645599d8-5fd5-4797-a113-b602f2533227 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1678 microversion: 2.1 time: 0.177460 Jun 20 13:13:11.989066 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3712/7527] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:13:11 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1678 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:13:13.012836 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-11262d8a-2f7c-41ed-8f57-1042e756c5cc tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:13:13.013883 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-11262d8a-2f7c-41ed-8f57-1042e756c5cc tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:13:13.024950 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11262d8a-2f7c-41ed-8f57-1042e756c5cc tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:13.025842 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11262d8a-2f7c-41ed-8f57-1042e756c5cc tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:13.026796 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11262d8a-2f7c-41ed-8f57-1042e756c5cc tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:13.027226 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11262d8a-2f7c-41ed-8f57-1042e756c5cc tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:13.032853 n-d-master-1 devstack@n-api.service[119127]: INFO oslo.messaging._drivers.impl_rabbit [-] [e724c47c-e194-481c-b307-79cd496ecce0] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 46864. Jun 20 13:13:13.194220 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-11262d8a-2f7c-41ed-8f57-1042e756c5cc tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:13:13.202666 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-11262d8a-2f7c-41ed-8f57-1042e756c5cc tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1678 microversion: 2.1 time: 0.198836 Jun 20 13:13:13.203200 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3816/7528] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:13:13 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1678 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:13:14.223285 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-79b45b1d-648a-42d9-afb3-facd91c43bc0 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:13:14.223918 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-79b45b1d-648a-42d9-afb3-facd91c43bc0 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:13:14.234456 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-79b45b1d-648a-42d9-afb3-facd91c43bc0 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:14.234922 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-79b45b1d-648a-42d9-afb3-facd91c43bc0 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:14.235717 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-79b45b1d-648a-42d9-afb3-facd91c43bc0 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:14.236161 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-79b45b1d-648a-42d9-afb3-facd91c43bc0 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:14.242886 n-d-master-1 devstack@n-api.service[119128]: INFO oslo.messaging._drivers.impl_rabbit [-] [aec4b5a8-4fa3-4bbf-bcd3-4f7b001dec4c] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 46870. Jun 20 13:13:14.253801 n-d-master-1 devstack@n-api.service[119128]: INFO oslo.messaging._drivers.impl_rabbit [-] [34606191-6ad4-4abb-b900-405f87896bf5] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 46872. Jun 20 13:13:14.376951 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-79b45b1d-648a-42d9-afb3-facd91c43bc0 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:13:14.386013 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-79b45b1d-648a-42d9-afb3-facd91c43bc0 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1678 microversion: 2.1 time: 0.169186 Jun 20 13:13:14.386598 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3713/7529] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:13:14 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:13:15.406085 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2ccefd36-2ac6-40cc-83d3-c35fdbbc1ff0 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:13:15.406835 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2ccefd36-2ac6-40cc-83d3-c35fdbbc1ff0 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:13:15.415404 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2ccefd36-2ac6-40cc-83d3-c35fdbbc1ff0 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:15.415902 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2ccefd36-2ac6-40cc-83d3-c35fdbbc1ff0 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:15.417320 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2ccefd36-2ac6-40cc-83d3-c35fdbbc1ff0 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:15.417845 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2ccefd36-2ac6-40cc-83d3-c35fdbbc1ff0 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:15.557239 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2ccefd36-2ac6-40cc-83d3-c35fdbbc1ff0 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:13:15.565438 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2ccefd36-2ac6-40cc-83d3-c35fdbbc1ff0 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1678 microversion: 2.1 time: 0.164234 Jun 20 13:13:15.566018 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3817/7530] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:13:15 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:13:16.585956 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bb98082b-e887-4eb9-83cd-1ee62c1846ae tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:13:16.586820 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bb98082b-e887-4eb9-83cd-1ee62c1846ae tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:13:16.596999 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bb98082b-e887-4eb9-83cd-1ee62c1846ae tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:16.597631 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bb98082b-e887-4eb9-83cd-1ee62c1846ae tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:16.598715 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bb98082b-e887-4eb9-83cd-1ee62c1846ae tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:16.599341 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bb98082b-e887-4eb9-83cd-1ee62c1846ae tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:16.741014 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-bb98082b-e887-4eb9-83cd-1ee62c1846ae tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:13:16.749718 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bb98082b-e887-4eb9-83cd-1ee62c1846ae tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1678 microversion: 2.1 time: 0.169739 Jun 20 13:13:16.750287 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3714/7531] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:13:16 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:13:17.771178 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1bc2244f-577b-4a90-b0cd-216fea67293c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:13:17.772152 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1bc2244f-577b-4a90-b0cd-216fea67293c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:13:17.781331 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1bc2244f-577b-4a90-b0cd-216fea67293c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:17.781779 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1bc2244f-577b-4a90-b0cd-216fea67293c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:17.782539 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1bc2244f-577b-4a90-b0cd-216fea67293c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:17.782971 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1bc2244f-577b-4a90-b0cd-216fea67293c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:17.935647 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1bc2244f-577b-4a90-b0cd-216fea67293c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:13:17.943875 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1bc2244f-577b-4a90-b0cd-216fea67293c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1678 microversion: 2.1 time: 0.179423 Jun 20 13:13:17.944488 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3818/7532] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:13:17 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:13:18.962401 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8b7453f0-22f9-4742-b7dd-1ca21ecbe5fc tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:13:18.963047 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8b7453f0-22f9-4742-b7dd-1ca21ecbe5fc tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:13:18.970450 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8b7453f0-22f9-4742-b7dd-1ca21ecbe5fc tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:18.970912 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8b7453f0-22f9-4742-b7dd-1ca21ecbe5fc tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:18.971761 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8b7453f0-22f9-4742-b7dd-1ca21ecbe5fc tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:18.972277 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8b7453f0-22f9-4742-b7dd-1ca21ecbe5fc tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:19.120371 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8b7453f0-22f9-4742-b7dd-1ca21ecbe5fc tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:13:19.128127 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8b7453f0-22f9-4742-b7dd-1ca21ecbe5fc tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1678 microversion: 2.1 time: 0.171125 Jun 20 13:13:19.128746 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3715/7533] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:13:18 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:13:20.148258 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-95bbe953-0e63-4c27-b181-c06078bb598f tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:13:20.149159 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-95bbe953-0e63-4c27-b181-c06078bb598f tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:13:20.159616 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-95bbe953-0e63-4c27-b181-c06078bb598f tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:20.160391 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-95bbe953-0e63-4c27-b181-c06078bb598f tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:20.161634 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-95bbe953-0e63-4c27-b181-c06078bb598f tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:20.162829 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-95bbe953-0e63-4c27-b181-c06078bb598f tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:20.322736 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-95bbe953-0e63-4c27-b181-c06078bb598f tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:13:20.330631 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-95bbe953-0e63-4c27-b181-c06078bb598f tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1678 microversion: 2.1 time: 0.188908 Jun 20 13:13:20.331222 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3819/7534] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:13:20 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1678 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:13:21.352128 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0969404d-d833-4c02-b406-03019d10ce70 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:13:21.353111 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0969404d-d833-4c02-b406-03019d10ce70 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:13:21.365158 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0969404d-d833-4c02-b406-03019d10ce70 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:21.365858 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0969404d-d833-4c02-b406-03019d10ce70 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:21.367056 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0969404d-d833-4c02-b406-03019d10ce70 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:21.367736 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0969404d-d833-4c02-b406-03019d10ce70 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:21.508892 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0969404d-d833-4c02-b406-03019d10ce70 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:13:21.520828 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0969404d-d833-4c02-b406-03019d10ce70 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1678 microversion: 2.1 time: 0.174665 Jun 20 13:13:21.521530 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3716/7535] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:13:21 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:13:22.544463 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-18442d36-a827-40c5-99ed-912a825de400 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:13:22.545088 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-18442d36-a827-40c5-99ed-912a825de400 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:13:22.552696 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-18442d36-a827-40c5-99ed-912a825de400 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:22.553147 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-18442d36-a827-40c5-99ed-912a825de400 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:22.553908 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-18442d36-a827-40c5-99ed-912a825de400 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:22.554345 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-18442d36-a827-40c5-99ed-912a825de400 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:22.701093 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-18442d36-a827-40c5-99ed-912a825de400 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:13:22.709253 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-18442d36-a827-40c5-99ed-912a825de400 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1699 microversion: 2.1 time: 0.171658 Jun 20 13:13:22.709837 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3820/7536] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:13:22 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1699 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:13:23.731580 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2c9652da-089c-45fd-a5dc-1077689ced30 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:13:23.732495 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2c9652da-089c-45fd-a5dc-1077689ced30 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:13:23.744637 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2c9652da-089c-45fd-a5dc-1077689ced30 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:23.745369 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2c9652da-089c-45fd-a5dc-1077689ced30 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:23.746699 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2c9652da-089c-45fd-a5dc-1077689ced30 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:23.747496 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2c9652da-089c-45fd-a5dc-1077689ced30 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:23.896274 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-2c9652da-089c-45fd-a5dc-1077689ced30 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:13:23.907175 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2c9652da-089c-45fd-a5dc-1077689ced30 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1699 microversion: 2.1 time: 0.182291 Jun 20 13:13:23.907931 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3717/7537] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:13:23 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1699 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:13:24.931255 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2613b89c-a80e-4ca8-822d-131260e399d7 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:13:24.932000 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2613b89c-a80e-4ca8-822d-131260e399d7 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:13:24.940741 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2613b89c-a80e-4ca8-822d-131260e399d7 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:24.941271 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2613b89c-a80e-4ca8-822d-131260e399d7 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:24.942120 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2613b89c-a80e-4ca8-822d-131260e399d7 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:24.942748 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2613b89c-a80e-4ca8-822d-131260e399d7 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:25.090780 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2613b89c-a80e-4ca8-822d-131260e399d7 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:13:25.099765 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2613b89c-a80e-4ca8-822d-131260e399d7 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1694 microversion: 2.1 time: 0.175339 Jun 20 13:13:25.100666 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3821/7538] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:13:24 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1694 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:13:25.376802 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-31b0041f-7c7e-48f3-a75d-5ec2fbed43fe req-687081f2-e7ae-4d11-933a-ee61e5741528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3ee985a-b97b-4abc-8351-71e43f9e0066", "name": "network-vif-plugged", "status": "completed", "tag": "c4306861-7846-4fce-aca1-7dd204408bc7"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:13:25.395357 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-31b0041f-7c7e-48f3-a75d-5ec2fbed43fe req-687081f2-e7ae-4d11-933a-ee61e5741528 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:25.395832 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-31b0041f-7c7e-48f3-a75d-5ec2fbed43fe req-687081f2-e7ae-4d11-933a-ee61e5741528 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:25.417884 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-31b0041f-7c7e-48f3-a75d-5ec2fbed43fe req-687081f2-e7ae-4d11-933a-ee61e5741528 service nova] Creating event network-vif-plugged:c4306861-7846-4fce-aca1-7dd204408bc7 for instance b3ee985a-b97b-4abc-8351-71e43f9e0066 on n-h1-master-1 Jun 20 13:13:25.427078 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-31b0041f-7c7e-48f3-a75d-5ec2fbed43fe req-687081f2-e7ae-4d11-933a-ee61e5741528 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054531 Jun 20 13:13:25.428485 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3718/7539] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 13:13:26.121577 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4cb41bb4-5b03-43ac-894c-d6ebd37ce8af tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:13:26.122687 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4cb41bb4-5b03-43ac-894c-d6ebd37ce8af tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:13:26.129672 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4cb41bb4-5b03-43ac-894c-d6ebd37ce8af tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:26.130105 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4cb41bb4-5b03-43ac-894c-d6ebd37ce8af tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:26.130900 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4cb41bb4-5b03-43ac-894c-d6ebd37ce8af tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:26.131331 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4cb41bb4-5b03-43ac-894c-d6ebd37ce8af tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:26.320076 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4cb41bb4-5b03-43ac-894c-d6ebd37ce8af tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:13:26.332530 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4cb41bb4-5b03-43ac-894c-d6ebd37ce8af tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1694 microversion: 2.1 time: 0.218163 Jun 20 13:13:26.344452 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3822/7540] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:13:26 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1694 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:13:27.352065 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8d0bce8f-b25a-48ef-9e9b-815d2bd8552a tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:13:27.352804 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8d0bce8f-b25a-48ef-9e9b-815d2bd8552a tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:13:27.361597 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8d0bce8f-b25a-48ef-9e9b-815d2bd8552a tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:27.362227 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8d0bce8f-b25a-48ef-9e9b-815d2bd8552a tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:27.363059 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8d0bce8f-b25a-48ef-9e9b-815d2bd8552a tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:27.363511 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8d0bce8f-b25a-48ef-9e9b-815d2bd8552a tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:27.507770 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-8d0bce8f-b25a-48ef-9e9b-815d2bd8552a tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:13:27.516939 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8d0bce8f-b25a-48ef-9e9b-815d2bd8552a tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1694 microversion: 2.1 time: 0.168400 Jun 20 13:13:27.516939 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3719/7541] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:13:27 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1694 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:13:28.533858 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3cd44095-00c8-4a82-9d8e-94ed8ba0961a tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:13:28.535173 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3cd44095-00c8-4a82-9d8e-94ed8ba0961a tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:13:28.543125 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3cd44095-00c8-4a82-9d8e-94ed8ba0961a tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:28.543571 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3cd44095-00c8-4a82-9d8e-94ed8ba0961a tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:28.544743 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3cd44095-00c8-4a82-9d8e-94ed8ba0961a tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:28.545479 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3cd44095-00c8-4a82-9d8e-94ed8ba0961a tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:28.701298 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3cd44095-00c8-4a82-9d8e-94ed8ba0961a tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:13:28.714805 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3cd44095-00c8-4a82-9d8e-94ed8ba0961a tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1694 microversion: 2.1 time: 0.184747 Jun 20 13:13:28.715982 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3823/7542] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:13:28 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1694 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:13:29.732696 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b1d0691f-edb5-458e-a064-ea09b78603a4 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:13:29.733981 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b1d0691f-edb5-458e-a064-ea09b78603a4 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:13:29.742431 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b1d0691f-edb5-458e-a064-ea09b78603a4 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:29.743172 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b1d0691f-edb5-458e-a064-ea09b78603a4 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:29.744178 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b1d0691f-edb5-458e-a064-ea09b78603a4 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:29.744875 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b1d0691f-edb5-458e-a064-ea09b78603a4 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:29.897912 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b1d0691f-edb5-458e-a064-ea09b78603a4 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:13:29.906756 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b1d0691f-edb5-458e-a064-ea09b78603a4 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1694 microversion: 2.1 time: 0.177883 Jun 20 13:13:29.907320 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3720/7543] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:13:29 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1694 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:13:30.924178 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-563f53cf-2838-4897-b59a-ae6bb750a517 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:13:30.925006 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-563f53cf-2838-4897-b59a-ae6bb750a517 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:13:30.932268 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-563f53cf-2838-4897-b59a-ae6bb750a517 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:30.932742 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-563f53cf-2838-4897-b59a-ae6bb750a517 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:30.933516 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-563f53cf-2838-4897-b59a-ae6bb750a517 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:30.934274 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-563f53cf-2838-4897-b59a-ae6bb750a517 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:31.076064 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-563f53cf-2838-4897-b59a-ae6bb750a517 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:13:31.086491 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-563f53cf-2838-4897-b59a-ae6bb750a517 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1694 microversion: 2.1 time: 0.166108 Jun 20 13:13:31.087109 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3824/7544] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:13:30 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1694 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:13:32.104230 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cefbcbd5-199d-46d7-8e58-f93e711793ae tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:13:32.104954 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cefbcbd5-199d-46d7-8e58-f93e711793ae tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:13:32.112237 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cefbcbd5-199d-46d7-8e58-f93e711793ae tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:32.112709 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cefbcbd5-199d-46d7-8e58-f93e711793ae tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:32.113484 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cefbcbd5-199d-46d7-8e58-f93e711793ae tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:32.113907 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cefbcbd5-199d-46d7-8e58-f93e711793ae tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:32.264087 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-cefbcbd5-199d-46d7-8e58-f93e711793ae tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:13:32.272472 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cefbcbd5-199d-46d7-8e58-f93e711793ae tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1694 microversion: 2.1 time: 0.172129 Jun 20 13:13:32.273256 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3721/7545] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:13:32 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1694 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:13:33.289601 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-63f8e1ef-40e6-4c14-b1db-7ac275272192 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:13:33.290423 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-63f8e1ef-40e6-4c14-b1db-7ac275272192 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:13:33.301691 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63f8e1ef-40e6-4c14-b1db-7ac275272192 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:33.302253 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63f8e1ef-40e6-4c14-b1db-7ac275272192 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:33.303203 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63f8e1ef-40e6-4c14-b1db-7ac275272192 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:33.303650 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63f8e1ef-40e6-4c14-b1db-7ac275272192 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:33.460516 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-63f8e1ef-40e6-4c14-b1db-7ac275272192 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:13:33.472475 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-63f8e1ef-40e6-4c14-b1db-7ac275272192 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1694 microversion: 2.1 time: 0.187076 Jun 20 13:13:33.473416 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3825/7546] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:13:33 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1694 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:13:34.490206 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cb1a4052-0774-4b14-9150-68823c9c4f05 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:13:34.490894 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cb1a4052-0774-4b14-9150-68823c9c4f05 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:13:34.498492 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb1a4052-0774-4b14-9150-68823c9c4f05 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:34.498959 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb1a4052-0774-4b14-9150-68823c9c4f05 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:34.499958 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb1a4052-0774-4b14-9150-68823c9c4f05 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:34.500450 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb1a4052-0774-4b14-9150-68823c9c4f05 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:34.710671 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-cb1a4052-0774-4b14-9150-68823c9c4f05 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:13:34.720966 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cb1a4052-0774-4b14-9150-68823c9c4f05 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1676 microversion: 2.1 time: 0.234696 Jun 20 13:13:34.722178 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3722/7547] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:13:34 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1676 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:13:35.743184 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-11cf3abc-8287-4081-baab-64accdf51ade tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:13:35.744158 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-11cf3abc-8287-4081-baab-64accdf51ade tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:13:35.753493 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11cf3abc-8287-4081-baab-64accdf51ade tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:35.753985 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11cf3abc-8287-4081-baab-64accdf51ade tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:35.754734 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11cf3abc-8287-4081-baab-64accdf51ade tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:35.755203 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11cf3abc-8287-4081-baab-64accdf51ade tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:35.901853 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-11cf3abc-8287-4081-baab-64accdf51ade tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:13:35.913644 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-11cf3abc-8287-4081-baab-64accdf51ade tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1676 microversion: 2.1 time: 0.176897 Jun 20 13:13:35.914411 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3826/7548] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:13:35 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1676 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:13:36.936183 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5e5a42da-2df0-4640-a977-b4c22a4e6214 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:13:36.936916 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5e5a42da-2df0-4640-a977-b4c22a4e6214 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:13:36.944611 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e5a42da-2df0-4640-a977-b4c22a4e6214 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:36.945074 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e5a42da-2df0-4640-a977-b4c22a4e6214 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:36.945865 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e5a42da-2df0-4640-a977-b4c22a4e6214 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:36.946311 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e5a42da-2df0-4640-a977-b4c22a4e6214 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:37.088021 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5e5a42da-2df0-4640-a977-b4c22a4e6214 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:13:37.097983 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5e5a42da-2df0-4640-a977-b4c22a4e6214 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1619 microversion: 2.1 time: 0.169114 Jun 20 13:13:37.098569 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3723/7549] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:13:36 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1619 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 13:13:37.114471 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8bc56dfe-449c-4175-9439-6350139ce968 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:13:37.115033 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8bc56dfe-449c-4175-9439-6350139ce968 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:13:37.122215 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bc56dfe-449c-4175-9439-6350139ce968 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:37.122670 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bc56dfe-449c-4175-9439-6350139ce968 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:37.123531 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bc56dfe-449c-4175-9439-6350139ce968 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:37.123982 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bc56dfe-449c-4175-9439-6350139ce968 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:37.268343 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8bc56dfe-449c-4175-9439-6350139ce968 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "POST /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066/action" status: 202 len: 0 microversion: 2.1 time: 0.157701 Jun 20 13:13:37.268976 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3827/7550] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 13:13:37 2022] POST /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 13:13:37.277496 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-24548a1d-bb59-4ff3-8aef-ccf9752361fb tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:13:37.278112 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-24548a1d-bb59-4ff3-8aef-ccf9752361fb tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:13:37.284530 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-24548a1d-bb59-4ff3-8aef-ccf9752361fb tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:37.284773 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-24548a1d-bb59-4ff3-8aef-ccf9752361fb tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:37.285587 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-24548a1d-bb59-4ff3-8aef-ccf9752361fb tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:37.286033 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-24548a1d-bb59-4ff3-8aef-ccf9752361fb tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:37.397162 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-07050585-4acb-4498-830d-6ae105964381 req-424259eb-d054-4675-b406-771aba6e9a70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3ee985a-b97b-4abc-8351-71e43f9e0066", "name": "network-vif-unplugged", "status": "completed", "tag": "c4306861-7846-4fce-aca1-7dd204408bc7"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:13:37.406788 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-07050585-4acb-4498-830d-6ae105964381 req-424259eb-d054-4675-b406-771aba6e9a70 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:37.407385 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-07050585-4acb-4498-830d-6ae105964381 req-424259eb-d054-4675-b406-771aba6e9a70 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:37.423071 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.compute.server_external_events [req-07050585-4acb-4498-830d-6ae105964381 req-424259eb-d054-4675-b406-771aba6e9a70 service nova] Unable to find a host for instance b3ee985a-b97b-4abc-8351-71e43f9e0066. Dropping event network-vif-unplugged {{(pid=119127) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 20 13:13:37.424409 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-07050585-4acb-4498-830d-6ae105964381 req-424259eb-d054-4675-b406-771aba6e9a70 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031113 Jun 20 13:13:37.425558 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3828/7551] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 20 13:13:37.444837 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-24548a1d-bb59-4ff3-8aef-ccf9752361fb tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:13:37.452883 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-24548a1d-bb59-4ff3-8aef-ccf9752361fb tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1627 microversion: 2.1 time: 0.179401 Jun 20 13:13:37.453733 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3724/7552] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:13:37 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1627 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 13:13:38.472315 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-69b4f401-abab-4bb1-b933-7fed53f80faa tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:13:38.472883 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-69b4f401-abab-4bb1-b933-7fed53f80faa tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:13:38.480615 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-69b4f401-abab-4bb1-b933-7fed53f80faa tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:38.481099 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-69b4f401-abab-4bb1-b933-7fed53f80faa tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:38.481907 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-69b4f401-abab-4bb1-b933-7fed53f80faa tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:38.482401 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-69b4f401-abab-4bb1-b933-7fed53f80faa tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:38.486932 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:13:38.618982 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-69b4f401-abab-4bb1-b933-7fed53f80faa tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:13:38.627189 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-69b4f401-abab-4bb1-b933-7fed53f80faa tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1685 microversion: 2.1 time: 0.159183 Jun 20 13:13:38.627820 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3829/7553] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:13:38 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:13:39.646357 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0cd7b220-3062-4018-857a-677159a03b29 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:13:39.648661 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0cd7b220-3062-4018-857a-677159a03b29 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:13:39.660759 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cd7b220-3062-4018-857a-677159a03b29 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:39.661318 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cd7b220-3062-4018-857a-677159a03b29 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:39.662235 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cd7b220-3062-4018-857a-677159a03b29 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:39.662881 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0cd7b220-3062-4018-857a-677159a03b29 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:39.815683 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0cd7b220-3062-4018-857a-677159a03b29 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:13:39.824934 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0cd7b220-3062-4018-857a-677159a03b29 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1685 microversion: 2.1 time: 0.183292 Jun 20 13:13:39.825915 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3725/7554] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:13:39 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1685 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:13:40.844173 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d8cd54fe-8e92-464f-860b-10e54b9bcdd8 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:13:40.844965 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d8cd54fe-8e92-464f-860b-10e54b9bcdd8 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:13:40.852160 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d8cd54fe-8e92-464f-860b-10e54b9bcdd8 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:40.852668 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d8cd54fe-8e92-464f-860b-10e54b9bcdd8 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:40.853448 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d8cd54fe-8e92-464f-860b-10e54b9bcdd8 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:40.853918 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d8cd54fe-8e92-464f-860b-10e54b9bcdd8 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:41.003726 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d8cd54fe-8e92-464f-860b-10e54b9bcdd8 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:13:41.012118 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d8cd54fe-8e92-464f-860b-10e54b9bcdd8 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1685 microversion: 2.1 time: 0.172600 Jun 20 13:13:41.013033 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3830/7555] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:13:40 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1685 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:13:42.029218 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e4bddcd1-294c-4b09-9046-2dab314310d4 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:13:42.029867 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e4bddcd1-294c-4b09-9046-2dab314310d4 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:13:42.032861 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=29 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:13:42.039203 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e4bddcd1-294c-4b09-9046-2dab314310d4 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:42.039667 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e4bddcd1-294c-4b09-9046-2dab314310d4 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:42.040479 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e4bddcd1-294c-4b09-9046-2dab314310d4 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:42.040929 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e4bddcd1-294c-4b09-9046-2dab314310d4 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:42.043913 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=81 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:13:42.489620 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e4bddcd1-294c-4b09-9046-2dab314310d4 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:13:42.497301 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e4bddcd1-294c-4b09-9046-2dab314310d4 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1685 microversion: 2.1 time: 0.472180 Jun 20 13:13:42.497883 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3726/7556] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:13:42 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1685 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:13:43.515141 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5b0fa16e-44bb-4ec0-aad0-b1c24fc8d110 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:13:43.516640 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5b0fa16e-44bb-4ec0-aad0-b1c24fc8d110 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:13:43.519543 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=35 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:13:43.525878 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b0fa16e-44bb-4ec0-aad0-b1c24fc8d110 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:43.526341 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b0fa16e-44bb-4ec0-aad0-b1c24fc8d110 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:43.527299 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b0fa16e-44bb-4ec0-aad0-b1c24fc8d110 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:43.527840 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b0fa16e-44bb-4ec0-aad0-b1c24fc8d110 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:43.678469 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5b0fa16e-44bb-4ec0-aad0-b1c24fc8d110 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:13:43.687493 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5b0fa16e-44bb-4ec0-aad0-b1c24fc8d110 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1685 microversion: 2.1 time: 0.176685 Jun 20 13:13:43.688332 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3831/7557] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:13:43 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1685 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:13:44.707055 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cee74f07-d91c-4136-acb8-a13bae696e8f tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:13:44.707659 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cee74f07-d91c-4136-acb8-a13bae696e8f tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:13:44.714239 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cee74f07-d91c-4136-acb8-a13bae696e8f tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:44.714701 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cee74f07-d91c-4136-acb8-a13bae696e8f tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:44.715481 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cee74f07-d91c-4136-acb8-a13bae696e8f tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:44.715950 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cee74f07-d91c-4136-acb8-a13bae696e8f tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:44.890230 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-cee74f07-d91c-4136-acb8-a13bae696e8f tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:13:44.898003 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cee74f07-d91c-4136-acb8-a13bae696e8f tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1685 microversion: 2.1 time: 0.195864 Jun 20 13:13:44.898879 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3727/7558] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:13:44 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1685 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 13:13:45.916603 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-76af9880-e7c7-4ef6-a440-1fb23002f74e tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:13:45.917487 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-76af9880-e7c7-4ef6-a440-1fb23002f74e tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:13:45.925082 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-76af9880-e7c7-4ef6-a440-1fb23002f74e tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:45.925582 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-76af9880-e7c7-4ef6-a440-1fb23002f74e tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:45.926379 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-76af9880-e7c7-4ef6-a440-1fb23002f74e tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:45.926817 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-76af9880-e7c7-4ef6-a440-1fb23002f74e tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:46.086465 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-76af9880-e7c7-4ef6-a440-1fb23002f74e tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:13:46.094905 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-76af9880-e7c7-4ef6-a440-1fb23002f74e tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1685 microversion: 2.1 time: 0.183375 Jun 20 13:13:46.095539 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3832/7559] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:13:45 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1685 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:13:47.119100 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cb58cb33-13c6-44e6-8a33-3b7eea20e6b9 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:13:47.119768 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cb58cb33-13c6-44e6-8a33-3b7eea20e6b9 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:13:47.128518 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb58cb33-13c6-44e6-8a33-3b7eea20e6b9 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:47.129246 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb58cb33-13c6-44e6-8a33-3b7eea20e6b9 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:47.130134 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb58cb33-13c6-44e6-8a33-3b7eea20e6b9 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:47.130910 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb58cb33-13c6-44e6-8a33-3b7eea20e6b9 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:47.301443 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-cb58cb33-13c6-44e6-8a33-3b7eea20e6b9 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:13:47.313560 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cb58cb33-13c6-44e6-8a33-3b7eea20e6b9 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1685 microversion: 2.1 time: 0.199279 Jun 20 13:13:47.314352 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3728/7560] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:13:47 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1685 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:13:48.337223 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-705cbf51-4e99-4cd1-889d-7233c28a60e3 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:13:48.338075 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-705cbf51-4e99-4cd1-889d-7233c28a60e3 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:13:48.346873 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-705cbf51-4e99-4cd1-889d-7233c28a60e3 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:48.347328 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-705cbf51-4e99-4cd1-889d-7233c28a60e3 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:48.348099 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-705cbf51-4e99-4cd1-889d-7233c28a60e3 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:48.348575 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-705cbf51-4e99-4cd1-889d-7233c28a60e3 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:48.484862 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-705cbf51-4e99-4cd1-889d-7233c28a60e3 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:13:48.492534 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-705cbf51-4e99-4cd1-889d-7233c28a60e3 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1685 microversion: 2.1 time: 0.160618 Jun 20 13:13:48.493119 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3833/7561] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:13:48 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:13:49.511826 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4a4668f6-682f-4d46-90c3-82df06c90679 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:13:49.512546 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4a4668f6-682f-4d46-90c3-82df06c90679 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:13:49.520848 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4a4668f6-682f-4d46-90c3-82df06c90679 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:49.521307 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4a4668f6-682f-4d46-90c3-82df06c90679 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:49.522072 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4a4668f6-682f-4d46-90c3-82df06c90679 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:49.522514 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4a4668f6-682f-4d46-90c3-82df06c90679 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:49.660687 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4a4668f6-682f-4d46-90c3-82df06c90679 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:13:49.669363 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4a4668f6-682f-4d46-90c3-82df06c90679 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1685 microversion: 2.1 time: 0.162604 Jun 20 13:13:49.669991 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3729/7562] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:13:49 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1685 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:13:50.689617 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7f1fc2fe-ca44-4be8-a408-41895b981710 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:13:50.690245 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7f1fc2fe-ca44-4be8-a408-41895b981710 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:13:50.697730 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7f1fc2fe-ca44-4be8-a408-41895b981710 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:50.698196 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7f1fc2fe-ca44-4be8-a408-41895b981710 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:50.698967 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7f1fc2fe-ca44-4be8-a408-41895b981710 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:50.699407 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7f1fc2fe-ca44-4be8-a408-41895b981710 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:50.841717 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-7f1fc2fe-ca44-4be8-a408-41895b981710 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:13:50.849392 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7f1fc2fe-ca44-4be8-a408-41895b981710 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1685 microversion: 2.1 time: 0.165575 Jun 20 13:13:50.849950 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3834/7563] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:13:50 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1685 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:13:51.867069 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f4bd8619-95d0-44f0-9524-6493bff305a8 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:13:51.867701 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f4bd8619-95d0-44f0-9524-6493bff305a8 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:13:51.875527 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f4bd8619-95d0-44f0-9524-6493bff305a8 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:51.876158 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f4bd8619-95d0-44f0-9524-6493bff305a8 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:51.877326 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f4bd8619-95d0-44f0-9524-6493bff305a8 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:51.877811 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f4bd8619-95d0-44f0-9524-6493bff305a8 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:52.012564 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f4bd8619-95d0-44f0-9524-6493bff305a8 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:13:52.020171 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f4bd8619-95d0-44f0-9524-6493bff305a8 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1685 microversion: 2.1 time: 0.157236 Jun 20 13:13:52.020826 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3730/7564] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:13:51 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:13:53.037647 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3a550df4-d646-407b-9c90-d23b6f130903 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:13:53.038262 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3a550df4-d646-407b-9c90-d23b6f130903 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:13:53.045897 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a550df4-d646-407b-9c90-d23b6f130903 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:53.046356 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a550df4-d646-407b-9c90-d23b6f130903 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:53.047124 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a550df4-d646-407b-9c90-d23b6f130903 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:53.047562 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a550df4-d646-407b-9c90-d23b6f130903 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:53.189197 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-3a550df4-d646-407b-9c90-d23b6f130903 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:13:53.200663 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3a550df4-d646-407b-9c90-d23b6f130903 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1685 microversion: 2.1 time: 0.166929 Jun 20 13:13:53.201288 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3835/7565] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:13:53 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1685 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:13:53.528670 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-9a17da04-80ec-450d-88ad-06504b6f64ad req-26e41964-6a98-4b1e-b65b-e443b2e0d5e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3ee985a-b97b-4abc-8351-71e43f9e0066", "name": "network-vif-plugged", "status": "completed", "tag": "c4306861-7846-4fce-aca1-7dd204408bc7"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:13:53.537659 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9a17da04-80ec-450d-88ad-06504b6f64ad req-26e41964-6a98-4b1e-b65b-e443b2e0d5e1 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:53.538112 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9a17da04-80ec-450d-88ad-06504b6f64ad req-26e41964-6a98-4b1e-b65b-e443b2e0d5e1 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:53.549716 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-9a17da04-80ec-450d-88ad-06504b6f64ad req-26e41964-6a98-4b1e-b65b-e443b2e0d5e1 service nova] Creating event network-vif-plugged:c4306861-7846-4fce-aca1-7dd204408bc7 for instance b3ee985a-b97b-4abc-8351-71e43f9e0066 on n-h1-master-1 Jun 20 13:13:53.554965 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-9a17da04-80ec-450d-88ad-06504b6f64ad req-26e41964-6a98-4b1e-b65b-e443b2e0d5e1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030271 Jun 20 13:13:53.555837 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3731/7566] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:13:54.222056 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2f105360-900b-45bb-9c0a-e03d85e70f8d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:13:54.222694 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2f105360-900b-45bb-9c0a-e03d85e70f8d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:13:54.231493 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2f105360-900b-45bb-9c0a-e03d85e70f8d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:54.232071 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2f105360-900b-45bb-9c0a-e03d85e70f8d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:54.233052 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2f105360-900b-45bb-9c0a-e03d85e70f8d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:54.233578 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2f105360-900b-45bb-9c0a-e03d85e70f8d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:54.382031 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2f105360-900b-45bb-9c0a-e03d85e70f8d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:13:54.394340 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2f105360-900b-45bb-9c0a-e03d85e70f8d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1685 microversion: 2.1 time: 0.178369 Jun 20 13:13:54.395502 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3836/7567] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:13:54 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1685 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:13:55.413611 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-571faa46-6766-491e-9bce-9c488c57aef2 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:13:55.414316 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-571faa46-6766-491e-9bce-9c488c57aef2 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:13:55.421313 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-571faa46-6766-491e-9bce-9c488c57aef2 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:55.421760 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-571faa46-6766-491e-9bce-9c488c57aef2 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:55.422528 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-571faa46-6766-491e-9bce-9c488c57aef2 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:13:55.423022 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-571faa46-6766-491e-9bce-9c488c57aef2 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:13:55.564975 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-571faa46-6766-491e-9bce-9c488c57aef2 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:13:55.576764 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-571faa46-6766-491e-9bce-9c488c57aef2 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1672 microversion: 2.1 time: 0.168289 Jun 20 13:13:55.577540 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3732/7568] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:13:55 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1672 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:15:06.254004 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7c739692-4393-4f83-9046-5af628dab6c5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:15:06.254597 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=13 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:15:06.254986 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7c739692-4393-4f83-9046-5af628dab6c5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:15:06.255075 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=37 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:15:06.258190 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=11 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:15:06.258980 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=46 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:15:06.263662 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c739692-4393-4f83-9046-5af628dab6c5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:06.263931 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c739692-4393-4f83-9046-5af628dab6c5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:06.264798 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c739692-4393-4f83-9046-5af628dab6c5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:06.265175 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c739692-4393-4f83-9046-5af628dab6c5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:06.293981 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7c739692-4393-4f83-9046-5af628dab6c5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 13:15:06.325058 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-97d731e4-57b1-491e-b84e-003df4e3c4d1 req-5279d9ba-825e-400e-8df7-234792ce2288 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3ee985a-b97b-4abc-8351-71e43f9e0066", "tag": "c4306861-7846-4fce-aca1-7dd204408bc7"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:15:06.335052 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-97d731e4-57b1-491e-b84e-003df4e3c4d1 req-5279d9ba-825e-400e-8df7-234792ce2288 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:06.335638 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-97d731e4-57b1-491e-b84e-003df4e3c4d1 req-5279d9ba-825e-400e-8df7-234792ce2288 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:06.349112 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-97d731e4-57b1-491e-b84e-003df4e3c4d1 req-5279d9ba-825e-400e-8df7-234792ce2288 service nova] Creating event network-changed:c4306861-7846-4fce-aca1-7dd204408bc7 for instance b3ee985a-b97b-4abc-8351-71e43f9e0066 on n-h1-master-1 Jun 20 13:15:06.355624 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-97d731e4-57b1-491e-b84e-003df4e3c4d1 req-5279d9ba-825e-400e-8df7-234792ce2288 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103906 Jun 20 13:15:06.356583 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3733/7569] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:15:06.386181 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7c739692-4393-4f83-9046-5af628dab6c5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 204 len: 0 microversion: 2.1 time: 0.137240 Jun 20 13:15:06.386969 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3837/7570] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 13:15:06 2022] DELETE /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 13:15:06.396520 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-46a399c3-1798-46e4-9124-42bafaa1d7a6 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:15:06.397365 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-46a399c3-1798-46e4-9124-42bafaa1d7a6 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:15:06.408343 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-46a399c3-1798-46e4-9124-42bafaa1d7a6 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:06.408824 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-46a399c3-1798-46e4-9124-42bafaa1d7a6 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:06.409623 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-46a399c3-1798-46e4-9124-42bafaa1d7a6 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:06.410682 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-46a399c3-1798-46e4-9124-42bafaa1d7a6 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:06.614634 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-46a399c3-1798-46e4-9124-42bafaa1d7a6 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:15:06.622763 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-46a399c3-1798-46e4-9124-42bafaa1d7a6 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1678 microversion: 2.1 time: 0.230842 Jun 20 13:15:06.623327 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3734/7571] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:15:06 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1678 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 13:15:07.643237 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6c0b7c5b-8420-4fc0-b217-d9774c3c471d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:15:07.643945 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6c0b7c5b-8420-4fc0-b217-d9774c3c471d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:15:07.652662 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c0b7c5b-8420-4fc0-b217-d9774c3c471d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:07.653112 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c0b7c5b-8420-4fc0-b217-d9774c3c471d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:07.653889 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c0b7c5b-8420-4fc0-b217-d9774c3c471d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:07.654383 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c0b7c5b-8420-4fc0-b217-d9774c3c471d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:07.853427 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6c0b7c5b-8420-4fc0-b217-d9774c3c471d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:15:07.861807 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6c0b7c5b-8420-4fc0-b217-d9774c3c471d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 200 len: 1678 microversion: 2.1 time: 0.224650 Jun 20 13:15:07.862405 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3838/7572] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:15:07 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 1678 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:15:08.289800 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-d6e734c0-a5f7-4705-bb4b-e917e041f4a8 req-6bcaa60e-5dc1-4465-9ee1-89e01e55927d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3ee985a-b97b-4abc-8351-71e43f9e0066", "name": "network-vif-deleted", "tag": "c4306861-7846-4fce-aca1-7dd204408bc7"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:15:08.301339 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-d6e734c0-a5f7-4705-bb4b-e917e041f4a8 req-6bcaa60e-5dc1-4465-9ee1-89e01e55927d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:08.301807 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-d6e734c0-a5f7-4705-bb4b-e917e041f4a8 req-6bcaa60e-5dc1-4465-9ee1-89e01e55927d service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:08.313739 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-d6e734c0-a5f7-4705-bb4b-e917e041f4a8 req-6bcaa60e-5dc1-4465-9ee1-89e01e55927d service nova] Creating event network-vif-deleted:c4306861-7846-4fce-aca1-7dd204408bc7 for instance b3ee985a-b97b-4abc-8351-71e43f9e0066 on n-h1-master-1 Jun 20 13:15:08.319899 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-d6e734c0-a5f7-4705-bb4b-e917e041f4a8 req-6bcaa60e-5dc1-4465-9ee1-89e01e55927d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033922 Jun 20 13:15:08.320528 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3735/7573] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:15:08.881826 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4e55379c-11a3-41f0-b8d2-5c4e0577868c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:15:08.882402 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4e55379c-11a3-41f0-b8d2-5c4e0577868c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: b3ee985a-b97b-4abc-8351-71e43f9e0066] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:15:08.889971 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4e55379c-11a3-41f0-b8d2-5c4e0577868c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:08.890427 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4e55379c-11a3-41f0-b8d2-5c4e0577868c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:08.891219 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4e55379c-11a3-41f0-b8d2-5c4e0577868c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:08.891656 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4e55379c-11a3-41f0-b8d2-5c4e0577868c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:08.906354 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-4e55379c-11a3-41f0-b8d2-5c4e0577868c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] HTTP exception thrown: Instance b3ee985a-b97b-4abc-8351-71e43f9e0066 could not be found. Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4e55379c-11a3-41f0-b8d2-5c4e0577868c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Request method failure captured: Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 HTTP/1.1 Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisHHcOK1_OtXKlmCPE2OZYG9IwXN-4KlJQGXtRzez5Gx0pMow7DSrMrTPq4W99bpdjbQy_FZdlVLjYduvMnLmxh4IY0O2NMxLnXj9jVN5k3YoEOqi9MvCzx3TgzTloZwInNV_6EUkDSn3EqSXOBGsFJDRedLk8atg34nLTFwqNmkk3ZY Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 1873e58ef0bb4d8da79eb47fc611b12c Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-TestShelveInstance-137684792 Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1873e58ef0bb4d8da79eb47fc611b12c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1873e58ef0bb4d8da79eb47fc611b12c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1873e58ef0bb4d8da79eb47fc611b12c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1873e58ef0bb4d8da79eb47fc611b12c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-TestShelveInstance-137684792 Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 1873e58ef0bb4d8da79eb47fc611b12c Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-TestShelveInstance-137684792 Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-TestShelveInstance-137684792-project Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 2f302f2f7713487fb2140218e737e9ce Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-TestShelveInstance-137684792-project Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: exception: Instance b3ee985a-b97b-4abc-8351-71e43f9e0066 could not be found. Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'b3ee985a-b97b-4abc-8351-71e43f9e0066'} Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3ee985a-b97b-4abc-8351-71e43f9e0066 could not be found. Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3ee985a-b97b-4abc-8351-71e43f9e0066 could not be found. Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 13:15:08.908061 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 13:15:08.912953 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 13:15:08.912953 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 13:15:08.912953 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 13:15:08.912953 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 13:15:08.912953 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 13:15:08.912953 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3ee985a-b97b-4abc-8351-71e43f9e0066 could not be found. Jun 20 13:15:08.912953 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 13:15:08.912953 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4e55379c-11a3-41f0-b8d2-5c4e0577868c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Returning 404 to user: Instance b3ee985a-b97b-4abc-8351-71e43f9e0066 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 13:15:08.912953 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4e55379c-11a3-41f0-b8d2-5c4e0577868c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066" status: 404 len: 111 microversion: 2.1 time: 0.032682 Jun 20 13:15:08.912953 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3839/7574] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:15:08 2022] GET /compute/v2.1/servers/b3ee985a-b97b-4abc-8351-71e43f9e0066 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 13:15:09.085537 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3a949cad-f9c2-43e2-bf57-9353370ff9e8 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '.version_select at 0x7f607232e790>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:15:09.109005 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3a949cad-f9c2-43e2-bf57-9353370ff9e8 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-17931136" status: 202 len: 0 microversion: 2.1 time: 0.027865 Jun 20 13:15:09.109611 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3736/7575] 10.222.0.27 () {58 vars in 1247 bytes} [Mon Jun 20 13:15:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-17931136 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 13:15:09.133084 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c567a162-a634-4167-a4e8-4239bfeb9bbe tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Action: 'create', calling method: .version_select at 0x7f60729f1d30>, body: {"keypair": {"name": "tempest-TestShelveInstance-762052326", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOsYFQr6FzVBFNBXSTjWEVI17Dro9hswtE3+KWTG1FR4haVT1G4A41SvOgsukWCMUszHRgff4H1u+slWvkRCHMd4NKpKhJwTndttHdP3VQzPu1/UGLVXgkAyKup6Aq7jw=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:15:09.152932 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-c567a162-a634-4167-a4e8-4239bfeb9bbe tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Getting quotas for project 1873e58ef0bb4d8da79eb47fc611b12c. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 13:15:09.158119 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-c567a162-a634-4167-a4e8-4239bfeb9bbe tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Getting quotas for user 2f302f2f7713487fb2140218e737e9ce and project 1873e58ef0bb4d8da79eb47fc611b12c. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 13:15:09.184265 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c567a162-a634-4167-a4e8-4239bfeb9bbe tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.056457 Jun 20 13:15:09.184875 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3840/7576] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 13:15:09 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:15:26.418054 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=10 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:15:26.419545 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:15:26.423878 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-022ead9b-1d47-48f0-8f47-9839785c4783 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1901788642", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-762052326", "security_groups": [{"name": "tempest-secgroup-smoke-193880433"}], "networks": [{"uuid": "1b6d3671-0a05-420c-9131-4afa82167c89"}], "block_device_mapping_v2": [{"uuid": "22c4c5e1-dff6-4c59-a64d-0ffd1bfdf47c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:15:26.542139 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-022ead9b-1d47-48f0-8f47-9839785c4783 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] validate_networks() for [('1b6d3671-0a05-420c-9131-4afa82167c89', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 13:15:26.999277 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-022ead9b-1d47-48f0-8f47-9839785c4783 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 13:15:26.999761 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-022ead9b-1d47-48f0-8f47-9839785c4783 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 13:15:27.000502 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-022ead9b-1d47-48f0-8f47-9839785c4783 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 13:15:27.001015 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-022ead9b-1d47-48f0-8f47-9839785c4783 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 13:15:27.001445 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-022ead9b-1d47-48f0-8f47-9839785c4783 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 13:15:27.010851 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-022ead9b-1d47-48f0-8f47-9839785c4783 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:27.011309 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-022ead9b-1d47-48f0-8f47-9839785c4783 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:27.012116 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-022ead9b-1d47-48f0-8f47-9839785c4783 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:27.012596 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-022ead9b-1d47-48f0-8f47-9839785c4783 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:27.029775 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-022ead9b-1d47-48f0-8f47-9839785c4783 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Getting quotas for project 1873e58ef0bb4d8da79eb47fc611b12c. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 13:15:27.035138 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-022ead9b-1d47-48f0-8f47-9839785c4783 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Getting quotas for user 2f302f2f7713487fb2140218e737e9ce and project 1873e58ef0bb4d8da79eb47fc611b12c. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 13:15:27.094087 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-022ead9b-1d47-48f0-8f47-9839785c4783 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 13:15:27.096369 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-022ead9b-1d47-48f0-8f47-9839785c4783 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='22c4c5e1-dff6-4c59-a64d-0ffd1bfdf47c',volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 13:15:27.249155 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-022ead9b-1d47-48f0-8f47-9839785c4783 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.833020 Jun 20 13:15:27.250094 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3737/7577] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 13:15:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 13:15:27.258736 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:15:27.259630 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=4 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:15:27.260427 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:15:27.265033 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6332cd27-4e4d-40cc-b25b-a554c8955af5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:15:27.266109 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6332cd27-4e4d-40cc-b25b-a554c8955af5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:15:27.326873 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6332cd27-4e4d-40cc-b25b-a554c8955af5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:15:27.333784 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6332cd27-4e4d-40cc-b25b-a554c8955af5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1088 microversion: 2.1 time: 0.077248 Jun 20 13:15:27.334370 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3841/7578] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:15:27 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1088 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:15:28.351054 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3feff673-3b75-4bdf-b10b-62343f52a181 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:15:28.351683 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3feff673-3b75-4bdf-b10b-62343f52a181 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:15:28.406277 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3feff673-3b75-4bdf-b10b-62343f52a181 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:15:28.413499 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3feff673-3b75-4bdf-b10b-62343f52a181 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1088 microversion: 2.1 time: 0.067207 Jun 20 13:15:28.414067 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3738/7579] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:15:28 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1088 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:15:29.432435 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-935cd4c9-c747-4a53-a210-48d68f107a82 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:15:29.432435 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-935cd4c9-c747-4a53-a210-48d68f107a82 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:15:29.768839 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-935cd4c9-c747-4a53-a210-48d68f107a82 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:15:29.777963 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-935cd4c9-c747-4a53-a210-48d68f107a82 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1088 microversion: 2.1 time: 0.351417 Jun 20 13:15:29.778570 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3842/7580] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:15:29 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1088 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:15:30.799505 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3260a170-e0e9-4b4f-a267-5cbb711caef2 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:15:30.800116 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3260a170-e0e9-4b4f-a267-5cbb711caef2 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:15:30.808351 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3260a170-e0e9-4b4f-a267-5cbb711caef2 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:30.808812 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3260a170-e0e9-4b4f-a267-5cbb711caef2 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:30.809585 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3260a170-e0e9-4b4f-a267-5cbb711caef2 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:30.810027 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3260a170-e0e9-4b4f-a267-5cbb711caef2 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:30.871135 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3260a170-e0e9-4b4f-a267-5cbb711caef2 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:15:30.881716 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3260a170-e0e9-4b4f-a267-5cbb711caef2 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1138 microversion: 2.1 time: 0.085845 Jun 20 13:15:30.882479 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3739/7581] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:15:30 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1138 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:15:31.899538 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-56dcd392-895c-4bb3-bf31-a89318aa0ecb tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:15:31.900329 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-56dcd392-895c-4bb3-bf31-a89318aa0ecb tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:15:31.908648 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-56dcd392-895c-4bb3-bf31-a89318aa0ecb tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:31.909099 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-56dcd392-895c-4bb3-bf31-a89318aa0ecb tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:31.910001 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-56dcd392-895c-4bb3-bf31-a89318aa0ecb tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:31.910776 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-56dcd392-895c-4bb3-bf31-a89318aa0ecb tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:31.977878 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-56dcd392-895c-4bb3-bf31-a89318aa0ecb tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:15:31.985881 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-56dcd392-895c-4bb3-bf31-a89318aa0ecb tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1130 microversion: 2.1 time: 0.090543 Jun 20 13:15:31.986561 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3843/7582] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:15:31 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1130 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:15:33.004935 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-33e3d97e-83d0-46f4-b90c-805d8e5d67bd tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:15:33.005571 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-33e3d97e-83d0-46f4-b90c-805d8e5d67bd tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:15:33.014018 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-33e3d97e-83d0-46f4-b90c-805d8e5d67bd tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:33.014661 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-33e3d97e-83d0-46f4-b90c-805d8e5d67bd tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:33.015452 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-33e3d97e-83d0-46f4-b90c-805d8e5d67bd tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:33.015895 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-33e3d97e-83d0-46f4-b90c-805d8e5d67bd tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:33.280445 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-33e3d97e-83d0-46f4-b90c-805d8e5d67bd tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:15:33.291848 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-33e3d97e-83d0-46f4-b90c-805d8e5d67bd tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1271 microversion: 2.1 time: 0.292337 Jun 20 13:15:33.292640 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3740/7583] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:15:32 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1271 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:15:33.740909 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-8dfc36bc-2678-43a9-89ca-4125084ba5a8 req-cf18824b-7c30-4ce5-95c3-4df56233705c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b181724-b2bb-42af-b0c4-deed2fcb1cb9", "tag": "7c5a28a0-5944-4f8e-89a2-ec6f0285a68c"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:15:33.771923 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-8dfc36bc-2678-43a9-89ca-4125084ba5a8 req-cf18824b-7c30-4ce5-95c3-4df56233705c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:33.772552 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-8dfc36bc-2678-43a9-89ca-4125084ba5a8 req-cf18824b-7c30-4ce5-95c3-4df56233705c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:33.792177 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-8dfc36bc-2678-43a9-89ca-4125084ba5a8 req-cf18824b-7c30-4ce5-95c3-4df56233705c service nova] Creating event network-changed:7c5a28a0-5944-4f8e-89a2-ec6f0285a68c for instance 0b181724-b2bb-42af-b0c4-deed2fcb1cb9 on n-h1-master-1 Jun 20 13:15:33.797542 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-8dfc36bc-2678-43a9-89ca-4125084ba5a8 req-cf18824b-7c30-4ce5-95c3-4df56233705c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062668 Jun 20 13:15:33.798747 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3844/7584] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:15:34.310544 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e98812e1-7a79-4c63-bf7a-5ea8187f469d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:15:34.311157 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e98812e1-7a79-4c63-bf7a-5ea8187f469d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:15:34.319120 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e98812e1-7a79-4c63-bf7a-5ea8187f469d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:34.319825 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e98812e1-7a79-4c63-bf7a-5ea8187f469d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:34.322126 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e98812e1-7a79-4c63-bf7a-5ea8187f469d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:34.322604 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e98812e1-7a79-4c63-bf7a-5ea8187f469d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:34.568728 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e98812e1-7a79-4c63-bf7a-5ea8187f469d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:15:34.577121 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e98812e1-7a79-4c63-bf7a-5ea8187f469d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1271 microversion: 2.1 time: 0.271461 Jun 20 13:15:34.577679 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3741/7585] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:15:34 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1271 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:15:35.595873 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-03dd88e9-cd5f-4af4-bfa7-fb85e1406530 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:15:35.596741 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-03dd88e9-cd5f-4af4-bfa7-fb85e1406530 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:15:35.603399 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-03dd88e9-cd5f-4af4-bfa7-fb85e1406530 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:35.603847 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-03dd88e9-cd5f-4af4-bfa7-fb85e1406530 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:35.604640 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-03dd88e9-cd5f-4af4-bfa7-fb85e1406530 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:35.605071 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-03dd88e9-cd5f-4af4-bfa7-fb85e1406530 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:35.741099 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-03dd88e9-cd5f-4af4-bfa7-fb85e1406530 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:15:35.749060 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-03dd88e9-cd5f-4af4-bfa7-fb85e1406530 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1271 microversion: 2.1 time: 0.158427 Jun 20 13:15:35.749639 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3845/7586] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:15:35 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1271 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:15:36.770061 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a56fb956-8bc7-47e1-aa92-60951b03e46e tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:15:36.770761 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a56fb956-8bc7-47e1-aa92-60951b03e46e tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:15:36.782679 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a56fb956-8bc7-47e1-aa92-60951b03e46e tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:36.783364 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a56fb956-8bc7-47e1-aa92-60951b03e46e tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:36.784419 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a56fb956-8bc7-47e1-aa92-60951b03e46e tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:36.785082 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a56fb956-8bc7-47e1-aa92-60951b03e46e tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:36.921393 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a56fb956-8bc7-47e1-aa92-60951b03e46e tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:15:36.929222 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a56fb956-8bc7-47e1-aa92-60951b03e46e tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1271 microversion: 2.1 time: 0.166044 Jun 20 13:15:36.929800 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3742/7587] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:15:36 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1271 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:15:37.950879 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2ed5edef-0374-407c-a240-358d57d8783c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:15:37.951861 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2ed5edef-0374-407c-a240-358d57d8783c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:15:37.963170 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2ed5edef-0374-407c-a240-358d57d8783c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:37.963618 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2ed5edef-0374-407c-a240-358d57d8783c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:37.964424 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2ed5edef-0374-407c-a240-358d57d8783c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:37.964859 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2ed5edef-0374-407c-a240-358d57d8783c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:38.110988 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2ed5edef-0374-407c-a240-358d57d8783c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:15:38.119122 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2ed5edef-0374-407c-a240-358d57d8783c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1259 microversion: 2.1 time: 0.174739 Jun 20 13:15:38.119701 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3846/7588] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:15:37 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:15:39.137377 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d1704947-73bc-4613-95e1-cbc10efd1a0c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:15:39.138030 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d1704947-73bc-4613-95e1-cbc10efd1a0c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:15:39.139935 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:15:39.141554 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=8 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:15:39.147564 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d1704947-73bc-4613-95e1-cbc10efd1a0c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:39.148025 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d1704947-73bc-4613-95e1-cbc10efd1a0c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:39.148847 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d1704947-73bc-4613-95e1-cbc10efd1a0c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:39.149322 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d1704947-73bc-4613-95e1-cbc10efd1a0c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:39.303663 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d1704947-73bc-4613-95e1-cbc10efd1a0c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:15:39.315388 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d1704947-73bc-4613-95e1-cbc10efd1a0c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1259 microversion: 2.1 time: 0.181942 Jun 20 13:15:39.316076 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3743/7589] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:15:39 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:15:40.334819 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6a24cd5d-5dd9-45d4-b8ba-bf63e2811d60 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:15:40.335598 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6a24cd5d-5dd9-45d4-b8ba-bf63e2811d60 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:15:40.338857 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=4 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:15:40.344657 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6a24cd5d-5dd9-45d4-b8ba-bf63e2811d60 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:40.345113 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6a24cd5d-5dd9-45d4-b8ba-bf63e2811d60 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:40.345885 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6a24cd5d-5dd9-45d4-b8ba-bf63e2811d60 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:40.346325 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6a24cd5d-5dd9-45d4-b8ba-bf63e2811d60 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:40.476630 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6a24cd5d-5dd9-45d4-b8ba-bf63e2811d60 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:15:40.484828 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6a24cd5d-5dd9-45d4-b8ba-bf63e2811d60 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1259 microversion: 2.1 time: 0.155288 Jun 20 13:15:40.485419 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3847/7590] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:15:40 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:15:41.505517 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a69b5c05-d3a3-44d2-b84b-30ce44ea1172 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:15:41.506557 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a69b5c05-d3a3-44d2-b84b-30ce44ea1172 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:15:41.515024 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a69b5c05-d3a3-44d2-b84b-30ce44ea1172 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:41.515486 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a69b5c05-d3a3-44d2-b84b-30ce44ea1172 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:41.516258 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a69b5c05-d3a3-44d2-b84b-30ce44ea1172 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:41.516725 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a69b5c05-d3a3-44d2-b84b-30ce44ea1172 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:41.667213 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-a69b5c05-d3a3-44d2-b84b-30ce44ea1172 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:15:41.675306 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a69b5c05-d3a3-44d2-b84b-30ce44ea1172 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1259 microversion: 2.1 time: 0.176164 Jun 20 13:15:41.675858 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3744/7591] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:15:41 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:15:42.697831 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2079b88a-c29d-4e7c-8ded-4ec7cc5304d2 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:15:42.698384 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2079b88a-c29d-4e7c-8ded-4ec7cc5304d2 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:15:42.705857 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2079b88a-c29d-4e7c-8ded-4ec7cc5304d2 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:42.706306 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2079b88a-c29d-4e7c-8ded-4ec7cc5304d2 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:42.707069 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2079b88a-c29d-4e7c-8ded-4ec7cc5304d2 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:42.707504 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2079b88a-c29d-4e7c-8ded-4ec7cc5304d2 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:42.850097 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-2079b88a-c29d-4e7c-8ded-4ec7cc5304d2 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:15:42.857926 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2079b88a-c29d-4e7c-8ded-4ec7cc5304d2 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1259 microversion: 2.1 time: 0.165944 Jun 20 13:15:42.858525 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3848/7592] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:15:42 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:15:43.879269 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-363b3348-3697-4ba9-b32d-3d86ce08c768 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:15:43.880257 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-363b3348-3697-4ba9-b32d-3d86ce08c768 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:15:43.892793 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-363b3348-3697-4ba9-b32d-3d86ce08c768 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:43.893576 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-363b3348-3697-4ba9-b32d-3d86ce08c768 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:43.894900 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-363b3348-3697-4ba9-b32d-3d86ce08c768 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:43.895652 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-363b3348-3697-4ba9-b32d-3d86ce08c768 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:44.335461 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-363b3348-3697-4ba9-b32d-3d86ce08c768 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:15:44.343279 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-363b3348-3697-4ba9-b32d-3d86ce08c768 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1259 microversion: 2.1 time: 0.470771 Jun 20 13:15:44.343858 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3745/7593] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:15:43 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1259 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:15:45.364932 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fe3ec917-1737-4cbf-8e9b-723f1f1f1eca tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:15:45.365912 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fe3ec917-1737-4cbf-8e9b-723f1f1f1eca tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:15:45.374236 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fe3ec917-1737-4cbf-8e9b-723f1f1f1eca tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:45.374691 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fe3ec917-1737-4cbf-8e9b-723f1f1f1eca tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:45.375467 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fe3ec917-1737-4cbf-8e9b-723f1f1f1eca tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:45.375910 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fe3ec917-1737-4cbf-8e9b-723f1f1f1eca tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:45.516972 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fe3ec917-1737-4cbf-8e9b-723f1f1f1eca tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:15:45.525168 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fe3ec917-1737-4cbf-8e9b-723f1f1f1eca tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1259 microversion: 2.1 time: 0.167078 Jun 20 13:15:45.525792 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3849/7594] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:15:45 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:15:46.132540 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-633bc659-98c2-4b18-b1b7-b20ac9685bcb req-778d6a49-1354-4e62-93cf-c45cb357308b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b181724-b2bb-42af-b0c4-deed2fcb1cb9", "name": "network-vif-plugged", "status": "completed", "tag": "7c5a28a0-5944-4f8e-89a2-ec6f0285a68c"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:15:46.143139 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-633bc659-98c2-4b18-b1b7-b20ac9685bcb req-778d6a49-1354-4e62-93cf-c45cb357308b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:46.143590 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-633bc659-98c2-4b18-b1b7-b20ac9685bcb req-778d6a49-1354-4e62-93cf-c45cb357308b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:46.155232 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-633bc659-98c2-4b18-b1b7-b20ac9685bcb req-778d6a49-1354-4e62-93cf-c45cb357308b service nova] Creating event network-vif-plugged:7c5a28a0-5944-4f8e-89a2-ec6f0285a68c for instance 0b181724-b2bb-42af-b0c4-deed2fcb1cb9 on n-h1-master-1 Jun 20 13:15:46.160172 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-633bc659-98c2-4b18-b1b7-b20ac9685bcb req-778d6a49-1354-4e62-93cf-c45cb357308b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031566 Jun 20 13:15:46.160791 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3746/7595] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:15:46.542718 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1466a891-7bab-4fae-8638-b34748c14772 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:15:46.543343 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1466a891-7bab-4fae-8638-b34748c14772 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:15:46.550819 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1466a891-7bab-4fae-8638-b34748c14772 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:46.551274 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1466a891-7bab-4fae-8638-b34748c14772 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:46.552048 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1466a891-7bab-4fae-8638-b34748c14772 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:46.552519 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1466a891-7bab-4fae-8638-b34748c14772 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:46.702798 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-1466a891-7bab-4fae-8638-b34748c14772 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:15:46.715020 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1466a891-7bab-4fae-8638-b34748c14772 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1259 microversion: 2.1 time: 0.176175 Jun 20 13:15:46.715890 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3850/7596] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:15:46 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:15:47.743422 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4191490e-d55f-4fea-a8f4-b19a54b52041 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:15:47.744464 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4191490e-d55f-4fea-a8f4-b19a54b52041 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:15:47.753619 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4191490e-d55f-4fea-a8f4-b19a54b52041 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:47.754079 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4191490e-d55f-4fea-a8f4-b19a54b52041 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:47.754848 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4191490e-d55f-4fea-a8f4-b19a54b52041 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:47.755270 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4191490e-d55f-4fea-a8f4-b19a54b52041 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:47.895655 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4191490e-d55f-4fea-a8f4-b19a54b52041 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:15:47.903917 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4191490e-d55f-4fea-a8f4-b19a54b52041 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1442 microversion: 2.1 time: 0.167951 Jun 20 13:15:47.904528 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3747/7597] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:15:47 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1442 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:15:47.920738 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dfb0c582-62a3-4fda-a68e-b6c839e0c49b tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:15:47.921377 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dfb0c582-62a3-4fda-a68e-b6c839e0c49b tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:15:47.929415 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dfb0c582-62a3-4fda-a68e-b6c839e0c49b tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:47.929873 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dfb0c582-62a3-4fda-a68e-b6c839e0c49b tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:47.930666 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dfb0c582-62a3-4fda-a68e-b6c839e0c49b tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:47.931117 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dfb0c582-62a3-4fda-a68e-b6c839e0c49b tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:48.081862 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dfb0c582-62a3-4fda-a68e-b6c839e0c49b tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:15:48.091720 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dfb0c582-62a3-4fda-a68e-b6c839e0c49b tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1442 microversion: 2.1 time: 0.175479 Jun 20 13:15:48.092329 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3851/7598] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:15:47 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1442 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:15:49.766341 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-ffe49358-bae5-40d0-ac56-c967f1e9b77e req-45b9cd5c-8570-4f01-98a4-f41d7880501e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b181724-b2bb-42af-b0c4-deed2fcb1cb9", "tag": "7c5a28a0-5944-4f8e-89a2-ec6f0285a68c"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:15:49.775452 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-ffe49358-bae5-40d0-ac56-c967f1e9b77e req-45b9cd5c-8570-4f01-98a4-f41d7880501e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:15:49.775915 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-ffe49358-bae5-40d0-ac56-c967f1e9b77e req-45b9cd5c-8570-4f01-98a4-f41d7880501e service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:15:49.787096 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-ffe49358-bae5-40d0-ac56-c967f1e9b77e req-45b9cd5c-8570-4f01-98a4-f41d7880501e service nova] Creating event network-changed:7c5a28a0-5944-4f8e-89a2-ec6f0285a68c for instance 0b181724-b2bb-42af-b0c4-deed2fcb1cb9 on n-h1-master-1 Jun 20 13:15:49.792534 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-ffe49358-bae5-40d0-ac56-c967f1e9b77e req-45b9cd5c-8570-4f01-98a4-f41d7880501e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029878 Jun 20 13:15:49.793330 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3748/7599] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:16:12.097358 n-d-master-1 devstack@n-api.service[119127]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 13:16:12.097968 n-d-master-1 devstack@n-api.service[119127]: Mon Jun 20 13:16:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 13:17:45.969011 n-d-master-1 devstack@n-api.service[119127]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c8b4e032-3e27-4327-b51f-f4e5667969ed] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 20 13:17:45.970048 n-d-master-1 devstack@n-api.service[119127]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e724c47c-e194-481c-b307-79cd496ecce0] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 20 13:17:45.970982 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=26 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:17:45.971823 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=50 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:17:46.024989 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-15fb72c0-bc19-4334-9295-71f4388da0d0 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:17:46.025535 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-15fb72c0-bc19-4334-9295-71f4388da0d0 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:17:46.031741 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-15fb72c0-bc19-4334-9295-71f4388da0d0 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:17:46.032212 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-15fb72c0-bc19-4334-9295-71f4388da0d0 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:17:46.033090 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-15fb72c0-bc19-4334-9295-71f4388da0d0 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:17:46.033538 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-15fb72c0-bc19-4334-9295-71f4388da0d0 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:17:46.056565 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-15fb72c0-bc19-4334-9295-71f4388da0d0 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lazy-loading 'flavor' on Instance uuid 0b181724-b2bb-42af-b0c4-deed2fcb1cb9 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 13:17:46.150801 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-15fb72c0-bc19-4334-9295-71f4388da0d0 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "POST /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9/action" status: 202 len: 0 microversion: 2.1 time: 0.183416 Jun 20 13:17:46.151407 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3852/7600] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 13:17:45 2022] POST /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 13:17:46.157837 n-d-master-1 devstack@n-api.service[119128]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aec4b5a8-4fa3-4bbf-bcd3-4f7b001dec4c] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 20 13:17:46.158652 n-d-master-1 devstack@n-api.service[119128]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34606191-6ad4-4abb-b900-405f87896bf5] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 20 13:17:46.159265 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:17:46.160012 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=54 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:17:46.164644 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-47d52972-99fd-4635-9cc8-465ce935667c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:17:46.165384 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-47d52972-99fd-4635-9cc8-465ce935667c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:17:46.173360 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-47d52972-99fd-4635-9cc8-465ce935667c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:17:46.173825 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-47d52972-99fd-4635-9cc8-465ce935667c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:17:46.174614 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-47d52972-99fd-4635-9cc8-465ce935667c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:17:46.175145 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-47d52972-99fd-4635-9cc8-465ce935667c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:17:46.314874 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-47d52972-99fd-4635-9cc8-465ce935667c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:17:46.323117 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-47d52972-99fd-4635-9cc8-465ce935667c tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1566 microversion: 2.1 time: 0.167076 Jun 20 13:17:46.323691 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3749/7601] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:17:46 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:17:47.347410 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-028267c3-38ca-482b-8954-a22eb9d99132 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:17:47.348115 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-028267c3-38ca-482b-8954-a22eb9d99132 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:17:47.356831 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-028267c3-38ca-482b-8954-a22eb9d99132 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:17:47.357284 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-028267c3-38ca-482b-8954-a22eb9d99132 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:17:47.358052 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-028267c3-38ca-482b-8954-a22eb9d99132 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:17:47.358492 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-028267c3-38ca-482b-8954-a22eb9d99132 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:17:47.363630 n-d-master-1 devstack@n-api.service[119127]: INFO oslo.messaging._drivers.impl_rabbit [-] [e724c47c-e194-481c-b307-79cd496ecce0] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 47404. Jun 20 13:17:47.364361 n-d-master-1 devstack@n-api.service[119127]: INFO oslo.messaging._drivers.impl_rabbit [-] [c8b4e032-3e27-4327-b51f-f4e5667969ed] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 47402. Jun 20 13:17:47.504126 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-028267c3-38ca-482b-8954-a22eb9d99132 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:17:47.512568 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-028267c3-38ca-482b-8954-a22eb9d99132 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1566 microversion: 2.1 time: 0.173309 Jun 20 13:17:47.513166 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3853/7602] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:17:47 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:17:48.531254 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dc9e0a46-421d-4739-a25b-78fad2f35605 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:17:48.531988 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-dc9e0a46-421d-4739-a25b-78fad2f35605 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:17:48.543443 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc9e0a46-421d-4739-a25b-78fad2f35605 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:17:48.543897 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc9e0a46-421d-4739-a25b-78fad2f35605 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:17:48.544702 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc9e0a46-421d-4739-a25b-78fad2f35605 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:17:48.545147 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc9e0a46-421d-4739-a25b-78fad2f35605 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:17:48.550686 n-d-master-1 devstack@n-api.service[119128]: INFO oslo.messaging._drivers.impl_rabbit [-] [34606191-6ad4-4abb-b900-405f87896bf5] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 47412. Jun 20 13:17:48.553135 n-d-master-1 devstack@n-api.service[119128]: INFO oslo.messaging._drivers.impl_rabbit [-] [aec4b5a8-4fa3-4bbf-bcd3-4f7b001dec4c] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 47410. Jun 20 13:17:48.683564 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-dc9e0a46-421d-4739-a25b-78fad2f35605 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:17:48.691917 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dc9e0a46-421d-4739-a25b-78fad2f35605 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1566 microversion: 2.1 time: 0.165397 Jun 20 13:17:48.692527 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3750/7603] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:17:48 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:17:49.266176 n-d-master-1 devstack@n-api.service[119128]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 13:17:49.266488 n-d-master-1 devstack@n-api.service[119128]: Mon Jun 20 13:17:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 13:17:49.718044 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0e30acb1-5252-45a0-bb48-36fdd44508f5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:17:49.718911 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0e30acb1-5252-45a0-bb48-36fdd44508f5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:17:49.730972 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0e30acb1-5252-45a0-bb48-36fdd44508f5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:17:49.731726 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0e30acb1-5252-45a0-bb48-36fdd44508f5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:17:49.732997 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0e30acb1-5252-45a0-bb48-36fdd44508f5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:17:49.733765 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0e30acb1-5252-45a0-bb48-36fdd44508f5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:17:49.873746 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0e30acb1-5252-45a0-bb48-36fdd44508f5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:17:49.885824 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0e30acb1-5252-45a0-bb48-36fdd44508f5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1566 microversion: 2.1 time: 0.174208 Jun 20 13:17:49.887576 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3854/7604] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:17:49 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1566 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:17:50.204971 n-d-master-1 devstack@n-api.service[119128]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 13:17:50.205523 n-d-master-1 devstack@n-api.service[119128]: Mon Jun 20 13:17:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 13:17:50.907425 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-57afc383-dfc4-44e7-b1af-d0e9925f068d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:17:50.907961 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-57afc383-dfc4-44e7-b1af-d0e9925f068d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:17:50.916271 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-57afc383-dfc4-44e7-b1af-d0e9925f068d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:17:50.916643 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-57afc383-dfc4-44e7-b1af-d0e9925f068d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:17:50.917435 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-57afc383-dfc4-44e7-b1af-d0e9925f068d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:17:50.917875 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-57afc383-dfc4-44e7-b1af-d0e9925f068d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:17:51.061682 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-57afc383-dfc4-44e7-b1af-d0e9925f068d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:17:51.070896 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-57afc383-dfc4-44e7-b1af-d0e9925f068d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1566 microversion: 2.1 time: 0.167625 Jun 20 13:17:51.071471 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3751/7605] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:17:50 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:17:52.095796 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6f8f9fe2-75fa-417c-82a1-fe28f06550fd tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:17:52.096546 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6f8f9fe2-75fa-417c-82a1-fe28f06550fd tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:17:52.106572 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6f8f9fe2-75fa-417c-82a1-fe28f06550fd tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:17:52.107163 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6f8f9fe2-75fa-417c-82a1-fe28f06550fd tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:17:52.108127 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6f8f9fe2-75fa-417c-82a1-fe28f06550fd tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:17:52.108727 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6f8f9fe2-75fa-417c-82a1-fe28f06550fd tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:17:52.249246 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6f8f9fe2-75fa-417c-82a1-fe28f06550fd tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:17:52.258393 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6f8f9fe2-75fa-417c-82a1-fe28f06550fd tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1566 microversion: 2.1 time: 0.167702 Jun 20 13:17:52.258974 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3855/7606] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:17:52 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:17:53.276364 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-82d48365-fce0-4c2e-a2ba-dc201a631d56 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:17:53.277224 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-82d48365-fce0-4c2e-a2ba-dc201a631d56 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:17:53.284844 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-82d48365-fce0-4c2e-a2ba-dc201a631d56 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:17:53.285309 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-82d48365-fce0-4c2e-a2ba-dc201a631d56 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:17:53.286091 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-82d48365-fce0-4c2e-a2ba-dc201a631d56 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:17:53.286537 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-82d48365-fce0-4c2e-a2ba-dc201a631d56 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:17:53.424947 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-82d48365-fce0-4c2e-a2ba-dc201a631d56 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:17:53.433278 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-82d48365-fce0-4c2e-a2ba-dc201a631d56 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1566 microversion: 2.1 time: 0.161295 Jun 20 13:17:53.433849 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3752/7607] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:17:53 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:17:54.450686 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6f47c619-c8fd-4637-be70-bc5c0f6fdbf2 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:17:54.451296 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6f47c619-c8fd-4637-be70-bc5c0f6fdbf2 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:17:54.458993 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6f47c619-c8fd-4637-be70-bc5c0f6fdbf2 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:17:54.459574 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6f47c619-c8fd-4637-be70-bc5c0f6fdbf2 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:17:54.460379 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6f47c619-c8fd-4637-be70-bc5c0f6fdbf2 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:17:54.460820 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6f47c619-c8fd-4637-be70-bc5c0f6fdbf2 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:17:54.596965 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6f47c619-c8fd-4637-be70-bc5c0f6fdbf2 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:17:54.605465 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6f47c619-c8fd-4637-be70-bc5c0f6fdbf2 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1566 microversion: 2.1 time: 0.158784 Jun 20 13:17:54.606030 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3856/7608] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:17:54 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:17:55.626758 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4ebc5238-f73a-4f7a-a1e5-24c1de83e8dd tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:17:55.627722 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4ebc5238-f73a-4f7a-a1e5-24c1de83e8dd tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:17:55.639875 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ebc5238-f73a-4f7a-a1e5-24c1de83e8dd tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:17:55.640687 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ebc5238-f73a-4f7a-a1e5-24c1de83e8dd tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:17:55.641959 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ebc5238-f73a-4f7a-a1e5-24c1de83e8dd tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:17:55.642698 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ebc5238-f73a-4f7a-a1e5-24c1de83e8dd tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:17:55.792287 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4ebc5238-f73a-4f7a-a1e5-24c1de83e8dd tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:17:55.801762 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4ebc5238-f73a-4f7a-a1e5-24c1de83e8dd tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1566 microversion: 2.1 time: 0.181605 Jun 20 13:17:55.802345 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3753/7609] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:17:55 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1566 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:17:56.819387 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9b11ebb4-51a2-45a0-9bd9-6fac0b14c134 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:17:56.820002 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9b11ebb4-51a2-45a0-9bd9-6fac0b14c134 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:17:56.827465 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b11ebb4-51a2-45a0-9bd9-6fac0b14c134 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:17:56.827919 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b11ebb4-51a2-45a0-9bd9-6fac0b14c134 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:17:56.828719 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b11ebb4-51a2-45a0-9bd9-6fac0b14c134 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:17:56.829154 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b11ebb4-51a2-45a0-9bd9-6fac0b14c134 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:17:56.967203 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-9b11ebb4-51a2-45a0-9bd9-6fac0b14c134 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:17:56.975082 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9b11ebb4-51a2-45a0-9bd9-6fac0b14c134 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1566 microversion: 2.1 time: 0.160054 Jun 20 13:17:56.975659 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3857/7610] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:17:56 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:17:57.993408 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fa1e85c2-eb28-4e14-a027-a931e6c84df5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:17:57.994257 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fa1e85c2-eb28-4e14-a027-a931e6c84df5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:17:58.004225 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fa1e85c2-eb28-4e14-a027-a931e6c84df5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:17:58.004865 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fa1e85c2-eb28-4e14-a027-a931e6c84df5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:17:58.005885 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fa1e85c2-eb28-4e14-a027-a931e6c84df5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:17:58.006473 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fa1e85c2-eb28-4e14-a027-a931e6c84df5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:17:58.157990 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fa1e85c2-eb28-4e14-a027-a931e6c84df5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:17:58.167447 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fa1e85c2-eb28-4e14-a027-a931e6c84df5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1566 microversion: 2.1 time: 0.178903 Jun 20 13:17:58.167999 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3754/7611] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:17:57 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1566 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:17:59.185656 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cad6439a-0a34-41c9-9b9e-65b6ab89009e tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:17:59.186561 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cad6439a-0a34-41c9-9b9e-65b6ab89009e tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:17:59.195213 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cad6439a-0a34-41c9-9b9e-65b6ab89009e tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:17:59.195801 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cad6439a-0a34-41c9-9b9e-65b6ab89009e tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:17:59.196668 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cad6439a-0a34-41c9-9b9e-65b6ab89009e tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:17:59.197115 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cad6439a-0a34-41c9-9b9e-65b6ab89009e tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:17:59.337251 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-cad6439a-0a34-41c9-9b9e-65b6ab89009e tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:17:59.345136 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cad6439a-0a34-41c9-9b9e-65b6ab89009e tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1566 microversion: 2.1 time: 0.164275 Jun 20 13:17:59.345724 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3858/7612] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:17:59 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:18:00.363559 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5215c9cc-d6db-4dc9-9dd8-a98cefad7ddb tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:18:00.364234 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5215c9cc-d6db-4dc9-9dd8-a98cefad7ddb tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:18:00.373439 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5215c9cc-d6db-4dc9-9dd8-a98cefad7ddb tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:00.374023 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5215c9cc-d6db-4dc9-9dd8-a98cefad7ddb tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:00.375007 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5215c9cc-d6db-4dc9-9dd8-a98cefad7ddb tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:00.375544 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5215c9cc-d6db-4dc9-9dd8-a98cefad7ddb tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:00.522914 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5215c9cc-d6db-4dc9-9dd8-a98cefad7ddb tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:18:00.531813 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5215c9cc-d6db-4dc9-9dd8-a98cefad7ddb tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1567 microversion: 2.1 time: 0.172636 Jun 20 13:18:00.532914 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3755/7613] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:18:00 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:18:00.548565 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-25891ed5-c82a-4500-8d7a-5da330933472 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:18:00.549202 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-25891ed5-c82a-4500-8d7a-5da330933472 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:18:00.556399 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-25891ed5-c82a-4500-8d7a-5da330933472 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:00.556857 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-25891ed5-c82a-4500-8d7a-5da330933472 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:00.557638 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-25891ed5-c82a-4500-8d7a-5da330933472 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:00.558077 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-25891ed5-c82a-4500-8d7a-5da330933472 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:00.639995 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-25891ed5-c82a-4500-8d7a-5da330933472 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "POST /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9/action" status: 202 len: 0 microversion: 2.1 time: 0.095382 Jun 20 13:18:00.640650 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3859/7614] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 13:18:00 2022] POST /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 13:18:00.649621 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0486046a-34c4-4df8-ada5-19a2efc931a1 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:18:00.650223 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0486046a-34c4-4df8-ada5-19a2efc931a1 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:18:00.656745 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0486046a-34c4-4df8-ada5-19a2efc931a1 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:00.657420 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0486046a-34c4-4df8-ada5-19a2efc931a1 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:00.658239 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0486046a-34c4-4df8-ada5-19a2efc931a1 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:00.658763 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0486046a-34c4-4df8-ada5-19a2efc931a1 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:00.849703 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0486046a-34c4-4df8-ada5-19a2efc931a1 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:18:00.858812 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0486046a-34c4-4df8-ada5-19a2efc931a1 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1515 microversion: 2.1 time: 0.213538 Jun 20 13:18:00.859711 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3756/7615] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:18:00 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1515 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 13:18:00.922051 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-c7331c67-17ef-426b-a1d5-2028246c4d5c req-9b66f17b-8bc4-4847-a66b-1ae397f6b096 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b181724-b2bb-42af-b0c4-deed2fcb1cb9", "name": "network-vif-unplugged", "status": "completed", "tag": "7c5a28a0-5944-4f8e-89a2-ec6f0285a68c"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:18:00.932305 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-c7331c67-17ef-426b-a1d5-2028246c4d5c req-9b66f17b-8bc4-4847-a66b-1ae397f6b096 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:00.932782 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-c7331c67-17ef-426b-a1d5-2028246c4d5c req-9b66f17b-8bc4-4847-a66b-1ae397f6b096 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:00.945421 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.compute.server_external_events [req-c7331c67-17ef-426b-a1d5-2028246c4d5c req-9b66f17b-8bc4-4847-a66b-1ae397f6b096 service nova] Unable to find a host for instance 0b181724-b2bb-42af-b0c4-deed2fcb1cb9. Dropping event network-vif-unplugged {{(pid=119127) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 20 13:18:00.946529 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-c7331c67-17ef-426b-a1d5-2028246c4d5c req-9b66f17b-8bc4-4847-a66b-1ae397f6b096 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.123882 Jun 20 13:18:00.947342 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3860/7616] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 125 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 20 13:18:01.875901 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7e1fb013-f4f9-4c36-9453-9c94ca812782 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:18:01.876531 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7e1fb013-f4f9-4c36-9453-9c94ca812782 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:18:01.884093 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7e1fb013-f4f9-4c36-9453-9c94ca812782 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:01.884578 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7e1fb013-f4f9-4c36-9453-9c94ca812782 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:01.885361 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7e1fb013-f4f9-4c36-9453-9c94ca812782 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:01.885809 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7e1fb013-f4f9-4c36-9453-9c94ca812782 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:02.026527 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-7e1fb013-f4f9-4c36-9453-9c94ca812782 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:18:02.034515 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7e1fb013-f4f9-4c36-9453-9c94ca812782 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1517 microversion: 2.1 time: 0.162602 Jun 20 13:18:02.035083 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3757/7617] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:18:01 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:18:03.057474 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-65ccd1b5-0572-47fb-b064-02a7a21fba43 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:18:03.058759 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-65ccd1b5-0572-47fb-b064-02a7a21fba43 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:18:03.066976 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-65ccd1b5-0572-47fb-b064-02a7a21fba43 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:03.067453 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-65ccd1b5-0572-47fb-b064-02a7a21fba43 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:03.068353 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-65ccd1b5-0572-47fb-b064-02a7a21fba43 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:03.068803 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-65ccd1b5-0572-47fb-b064-02a7a21fba43 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:03.211299 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-65ccd1b5-0572-47fb-b064-02a7a21fba43 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:18:03.221414 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-65ccd1b5-0572-47fb-b064-02a7a21fba43 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1517 microversion: 2.1 time: 0.167709 Jun 20 13:18:03.222832 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3861/7618] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:18:03 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1517 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:18:04.239677 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3dd891ea-d153-4eef-bdd5-1aca95d71e32 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:18:04.240575 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3dd891ea-d153-4eef-bdd5-1aca95d71e32 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:18:04.248168 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3dd891ea-d153-4eef-bdd5-1aca95d71e32 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:04.248718 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3dd891ea-d153-4eef-bdd5-1aca95d71e32 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:04.249591 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3dd891ea-d153-4eef-bdd5-1aca95d71e32 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:04.250041 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3dd891ea-d153-4eef-bdd5-1aca95d71e32 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:04.386598 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-3dd891ea-d153-4eef-bdd5-1aca95d71e32 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:18:04.395620 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3dd891ea-d153-4eef-bdd5-1aca95d71e32 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1517 microversion: 2.1 time: 0.159806 Jun 20 13:18:04.396271 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3758/7619] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:18:04 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:18:05.414497 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-64ba5179-5350-4026-a927-b001c3393a6a tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:18:05.415085 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-64ba5179-5350-4026-a927-b001c3393a6a tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:18:05.422678 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-64ba5179-5350-4026-a927-b001c3393a6a tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:05.423131 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-64ba5179-5350-4026-a927-b001c3393a6a tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:05.423906 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-64ba5179-5350-4026-a927-b001c3393a6a tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:05.424374 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-64ba5179-5350-4026-a927-b001c3393a6a tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:05.562325 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-64ba5179-5350-4026-a927-b001c3393a6a tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:18:05.571220 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-64ba5179-5350-4026-a927-b001c3393a6a tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1517 microversion: 2.1 time: 0.161155 Jun 20 13:18:05.571784 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3862/7620] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:18:05 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:18:06.588937 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9735cbde-5077-4943-9d14-7f977a3e4da5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:18:06.589559 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9735cbde-5077-4943-9d14-7f977a3e4da5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:18:06.597115 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9735cbde-5077-4943-9d14-7f977a3e4da5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:06.597571 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9735cbde-5077-4943-9d14-7f977a3e4da5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:06.598378 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9735cbde-5077-4943-9d14-7f977a3e4da5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:06.598814 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9735cbde-5077-4943-9d14-7f977a3e4da5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:06.737260 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9735cbde-5077-4943-9d14-7f977a3e4da5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:18:06.745561 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9735cbde-5077-4943-9d14-7f977a3e4da5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1517 microversion: 2.1 time: 0.160680 Jun 20 13:18:06.746086 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3759/7621] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:18:06 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:18:07.763922 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-459adf20-3cfb-4b73-88d5-de2b2ab996ed tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:18:07.764573 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-459adf20-3cfb-4b73-88d5-de2b2ab996ed tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:18:07.772529 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-459adf20-3cfb-4b73-88d5-de2b2ab996ed tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:07.773017 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-459adf20-3cfb-4b73-88d5-de2b2ab996ed tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:07.773803 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-459adf20-3cfb-4b73-88d5-de2b2ab996ed tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:07.774245 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-459adf20-3cfb-4b73-88d5-de2b2ab996ed tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:08.248126 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-459adf20-3cfb-4b73-88d5-de2b2ab996ed tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:18:08.256364 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-459adf20-3cfb-4b73-88d5-de2b2ab996ed tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1573 microversion: 2.1 time: 0.497344 Jun 20 13:18:08.256982 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3863/7622] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:18:07 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1573 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:18:08.375688 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-c622d0df-b31f-4d1d-96db-f502a3e797e5 req-5aba29e1-3696-4cee-ad12-21dcd41a0353 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b181724-b2bb-42af-b0c4-deed2fcb1cb9", "tag": "7c5a28a0-5944-4f8e-89a2-ec6f0285a68c"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:18:08.389955 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-c622d0df-b31f-4d1d-96db-f502a3e797e5 req-5aba29e1-3696-4cee-ad12-21dcd41a0353 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:08.390404 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-c622d0df-b31f-4d1d-96db-f502a3e797e5 req-5aba29e1-3696-4cee-ad12-21dcd41a0353 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:08.411004 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-c622d0df-b31f-4d1d-96db-f502a3e797e5 req-5aba29e1-3696-4cee-ad12-21dcd41a0353 service nova] Creating event network-changed:7c5a28a0-5944-4f8e-89a2-ec6f0285a68c for instance 0b181724-b2bb-42af-b0c4-deed2fcb1cb9 on n-h2-master-1 Jun 20 13:18:08.417543 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-c622d0df-b31f-4d1d-96db-f502a3e797e5 req-5aba29e1-3696-4cee-ad12-21dcd41a0353 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047981 Jun 20 13:18:08.418531 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3760/7623] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:18:09.272862 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fdae0537-d26b-4f75-822c-862fecd5a3e5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:18:09.273562 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fdae0537-d26b-4f75-822c-862fecd5a3e5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:18:09.280865 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fdae0537-d26b-4f75-822c-862fecd5a3e5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:09.281316 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fdae0537-d26b-4f75-822c-862fecd5a3e5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:09.282121 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fdae0537-d26b-4f75-822c-862fecd5a3e5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:09.282566 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fdae0537-d26b-4f75-822c-862fecd5a3e5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:09.418473 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-fdae0537-d26b-4f75-822c-862fecd5a3e5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:18:09.427842 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fdae0537-d26b-4f75-822c-862fecd5a3e5 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1573 microversion: 2.1 time: 0.159062 Jun 20 13:18:09.428546 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3864/7624] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:18:09 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:18:10.452521 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b41da578-13fd-4ab7-b931-bdaa267714f1 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:18:10.453696 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b41da578-13fd-4ab7-b931-bdaa267714f1 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:18:10.462933 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b41da578-13fd-4ab7-b931-bdaa267714f1 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:10.463396 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b41da578-13fd-4ab7-b931-bdaa267714f1 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:10.464176 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b41da578-13fd-4ab7-b931-bdaa267714f1 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:10.464654 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b41da578-13fd-4ab7-b931-bdaa267714f1 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:10.610478 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b41da578-13fd-4ab7-b931-bdaa267714f1 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:18:10.618481 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b41da578-13fd-4ab7-b931-bdaa267714f1 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1573 microversion: 2.1 time: 0.174530 Jun 20 13:18:10.619125 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3761/7625] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:18:10 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1573 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:18:11.641464 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-02c98d96-9e7d-4c9c-80c5-a781b69098c6 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:18:11.642472 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-02c98d96-9e7d-4c9c-80c5-a781b69098c6 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:18:11.654937 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02c98d96-9e7d-4c9c-80c5-a781b69098c6 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:11.655722 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02c98d96-9e7d-4c9c-80c5-a781b69098c6 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:11.657127 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02c98d96-9e7d-4c9c-80c5-a781b69098c6 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:11.657969 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02c98d96-9e7d-4c9c-80c5-a781b69098c6 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:11.805174 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-02c98d96-9e7d-4c9c-80c5-a781b69098c6 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:18:11.813570 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-02c98d96-9e7d-4c9c-80c5-a781b69098c6 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1573 microversion: 2.1 time: 0.179263 Jun 20 13:18:11.814164 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3865/7626] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:18:11 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1573 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:18:12.831210 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-146d0963-f00a-4e7d-ac44-58ee7db8b538 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:18:12.831757 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-146d0963-f00a-4e7d-ac44-58ee7db8b538 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:18:12.839321 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-146d0963-f00a-4e7d-ac44-58ee7db8b538 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:12.839786 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-146d0963-f00a-4e7d-ac44-58ee7db8b538 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:12.840617 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-146d0963-f00a-4e7d-ac44-58ee7db8b538 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:12.841066 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-146d0963-f00a-4e7d-ac44-58ee7db8b538 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:12.979867 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-146d0963-f00a-4e7d-ac44-58ee7db8b538 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:18:12.987651 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-146d0963-f00a-4e7d-ac44-58ee7db8b538 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1573 microversion: 2.1 time: 0.160433 Jun 20 13:18:12.988235 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3762/7627] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:18:12 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1573 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:18:14.009393 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0f4bead2-498f-4768-bb52-784acb0c2034 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:18:14.010625 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0f4bead2-498f-4768-bb52-784acb0c2034 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:18:14.022332 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f4bead2-498f-4768-bb52-784acb0c2034 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:14.022782 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f4bead2-498f-4768-bb52-784acb0c2034 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:14.023544 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f4bead2-498f-4768-bb52-784acb0c2034 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:14.024002 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f4bead2-498f-4768-bb52-784acb0c2034 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:14.028113 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:18:14.159363 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-0f4bead2-498f-4768-bb52-784acb0c2034 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:18:14.167624 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0f4bead2-498f-4768-bb52-784acb0c2034 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1573 microversion: 2.1 time: 0.164713 Jun 20 13:18:14.168227 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3866/7628] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:18:14 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1573 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:18:15.189803 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c4d79567-8258-4482-9ce2-f8214c9e8a60 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:18:15.191143 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c4d79567-8258-4482-9ce2-f8214c9e8a60 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:18:15.200388 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4d79567-8258-4482-9ce2-f8214c9e8a60 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:15.200779 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4d79567-8258-4482-9ce2-f8214c9e8a60 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:15.201548 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4d79567-8258-4482-9ce2-f8214c9e8a60 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:15.201989 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4d79567-8258-4482-9ce2-f8214c9e8a60 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:15.349784 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c4d79567-8258-4482-9ce2-f8214c9e8a60 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:18:15.357929 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c4d79567-8258-4482-9ce2-f8214c9e8a60 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1573 microversion: 2.1 time: 0.174957 Jun 20 13:18:15.358497 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3763/7629] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:18:15 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1573 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:18:16.378565 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bcb557c2-b6fd-47c9-ad25-1daad005898d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:18:16.379576 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bcb557c2-b6fd-47c9-ad25-1daad005898d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:18:16.384627 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=33 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:18:16.393729 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bcb557c2-b6fd-47c9-ad25-1daad005898d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:16.394488 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bcb557c2-b6fd-47c9-ad25-1daad005898d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:16.395753 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bcb557c2-b6fd-47c9-ad25-1daad005898d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:16.396554 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bcb557c2-b6fd-47c9-ad25-1daad005898d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:16.534846 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-bcb557c2-b6fd-47c9-ad25-1daad005898d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:18:16.545498 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bcb557c2-b6fd-47c9-ad25-1daad005898d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1573 microversion: 2.1 time: 0.173363 Jun 20 13:18:16.546309 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3867/7630] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:18:16 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1573 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:18:17.566623 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9c94bee0-3642-4d0c-8db1-231f8dc151da tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:18:17.567215 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9c94bee0-3642-4d0c-8db1-231f8dc151da tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:18:17.570412 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=31 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:18:17.576398 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c94bee0-3642-4d0c-8db1-231f8dc151da tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:17.576861 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c94bee0-3642-4d0c-8db1-231f8dc151da tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:17.577652 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c94bee0-3642-4d0c-8db1-231f8dc151da tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:17.578092 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c94bee0-3642-4d0c-8db1-231f8dc151da tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:17.580849 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=87 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:18:17.726019 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-9c94bee0-3642-4d0c-8db1-231f8dc151da tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:18:17.739743 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9c94bee0-3642-4d0c-8db1-231f8dc151da tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1573 microversion: 2.1 time: 0.177170 Jun 20 13:18:17.741537 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3764/7631] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:18:17 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1573 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:18:18.763362 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a34b57fa-f106-4842-b70b-9964161d428a tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:18:18.763995 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a34b57fa-f106-4842-b70b-9964161d428a tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:18:18.771070 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a34b57fa-f106-4842-b70b-9964161d428a tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:18.771529 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a34b57fa-f106-4842-b70b-9964161d428a tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:18.772438 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a34b57fa-f106-4842-b70b-9964161d428a tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:18.772881 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a34b57fa-f106-4842-b70b-9964161d428a tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:18.914754 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a34b57fa-f106-4842-b70b-9964161d428a tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:18:18.923174 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a34b57fa-f106-4842-b70b-9964161d428a tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1573 microversion: 2.1 time: 0.163963 Jun 20 13:18:18.923731 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3868/7632] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:18:18 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1573 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:18:19.945001 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6f8a90d4-41fb-49b0-9afd-9d9c23c4a7e9 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:18:19.945976 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6f8a90d4-41fb-49b0-9afd-9d9c23c4a7e9 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:18:19.957456 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6f8a90d4-41fb-49b0-9afd-9d9c23c4a7e9 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:19.958263 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6f8a90d4-41fb-49b0-9afd-9d9c23c4a7e9 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:19.959553 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6f8a90d4-41fb-49b0-9afd-9d9c23c4a7e9 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:19.960410 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6f8a90d4-41fb-49b0-9afd-9d9c23c4a7e9 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:20.098979 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-6f8a90d4-41fb-49b0-9afd-9d9c23c4a7e9 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:18:20.106875 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6f8a90d4-41fb-49b0-9afd-9d9c23c4a7e9 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1573 microversion: 2.1 time: 0.168810 Jun 20 13:18:20.107455 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3765/7633] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:18:19 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1573 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:18:20.299253 n-d-master-1 devstack@n-api.service[119127]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 13:18:20.299830 n-d-master-1 devstack@n-api.service[119127]: Mon Jun 20 13:18:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 13:18:20.816493 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-63fd89d5-008f-4f64-950d-0df7cb8cd448 req-8094e606-f81f-4332-8aac-079f5b086428 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b181724-b2bb-42af-b0c4-deed2fcb1cb9", "name": "network-vif-plugged", "status": "completed", "tag": "7c5a28a0-5944-4f8e-89a2-ec6f0285a68c"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:18:20.825710 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-63fd89d5-008f-4f64-950d-0df7cb8cd448 req-8094e606-f81f-4332-8aac-079f5b086428 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:20.826186 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-63fd89d5-008f-4f64-950d-0df7cb8cd448 req-8094e606-f81f-4332-8aac-079f5b086428 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:20.839931 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-63fd89d5-008f-4f64-950d-0df7cb8cd448 req-8094e606-f81f-4332-8aac-079f5b086428 service nova] Creating event network-vif-plugged:7c5a28a0-5944-4f8e-89a2-ec6f0285a68c for instance 0b181724-b2bb-42af-b0c4-deed2fcb1cb9 on n-h2-master-1 Jun 20 13:18:20.845181 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-63fd89d5-008f-4f64-950d-0df7cb8cd448 req-8094e606-f81f-4332-8aac-079f5b086428 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032964 Jun 20 13:18:20.845798 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3869/7634] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:18:21.126619 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-eb28d7b6-cb80-46d2-888b-f3e8a591c712 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:18:21.127837 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-eb28d7b6-cb80-46d2-888b-f3e8a591c712 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:18:21.137276 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eb28d7b6-cb80-46d2-888b-f3e8a591c712 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:21.137772 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eb28d7b6-cb80-46d2-888b-f3e8a591c712 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:21.138627 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eb28d7b6-cb80-46d2-888b-f3e8a591c712 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:21.139075 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eb28d7b6-cb80-46d2-888b-f3e8a591c712 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:21.277666 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-eb28d7b6-cb80-46d2-888b-f3e8a591c712 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:18:21.285597 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-eb28d7b6-cb80-46d2-888b-f3e8a591c712 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1573 microversion: 2.1 time: 0.165283 Jun 20 13:18:21.286183 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3766/7635] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:18:21 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:18:22.305999 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6ac18800-36df-4ee3-9a4d-8008c920fd39 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:18:22.306842 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6ac18800-36df-4ee3-9a4d-8008c920fd39 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:18:22.315437 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6ac18800-36df-4ee3-9a4d-8008c920fd39 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:22.316358 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6ac18800-36df-4ee3-9a4d-8008c920fd39 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:22.317265 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6ac18800-36df-4ee3-9a4d-8008c920fd39 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:22.317808 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6ac18800-36df-4ee3-9a4d-8008c920fd39 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:22.481652 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6ac18800-36df-4ee3-9a4d-8008c920fd39 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:18:22.489689 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6ac18800-36df-4ee3-9a4d-8008c920fd39 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1573 microversion: 2.1 time: 0.189878 Jun 20 13:18:22.490317 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3870/7636] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:18:22 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1573 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:18:23.511981 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-29fd6c1a-ea2a-4b5c-b288-00316ed9c495 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:18:23.513356 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-29fd6c1a-ea2a-4b5c-b288-00316ed9c495 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:18:23.525397 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-29fd6c1a-ea2a-4b5c-b288-00316ed9c495 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:23.526513 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-29fd6c1a-ea2a-4b5c-b288-00316ed9c495 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:23.527412 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-29fd6c1a-ea2a-4b5c-b288-00316ed9c495 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:18:23.527862 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-29fd6c1a-ea2a-4b5c-b288-00316ed9c495 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:18:23.676905 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-29fd6c1a-ea2a-4b5c-b288-00316ed9c495 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:18:23.688582 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-29fd6c1a-ea2a-4b5c-b288-00316ed9c495 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1560 microversion: 2.1 time: 0.183302 Jun 20 13:18:23.689409 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3767/7637] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:18:23 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1560 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:19:40.137899 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=7 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:19:40.139284 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=24 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:19:40.139980 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=7 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:19:40.140890 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=23 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:19:40.144147 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5d7dd7c5-08ca-48df-a8a4-dc3df5419a48 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:19:40.144571 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5d7dd7c5-08ca-48df-a8a4-dc3df5419a48 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:19:40.159736 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5d7dd7c5-08ca-48df-a8a4-dc3df5419a48 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:19:40.160255 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5d7dd7c5-08ca-48df-a8a4-dc3df5419a48 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:19:40.161048 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5d7dd7c5-08ca-48df-a8a4-dc3df5419a48 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:19:40.161668 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5d7dd7c5-08ca-48df-a8a4-dc3df5419a48 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:19:40.187913 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5d7dd7c5-08ca-48df-a8a4-dc3df5419a48 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 13:19:40.228911 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-3550ec89-372b-4050-946b-b9de3b06fd81 req-d78bc99b-2281-47df-96c6-6ae7979f5264 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b181724-b2bb-42af-b0c4-deed2fcb1cb9", "tag": "7c5a28a0-5944-4f8e-89a2-ec6f0285a68c"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:19:40.245168 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-3550ec89-372b-4050-946b-b9de3b06fd81 req-d78bc99b-2281-47df-96c6-6ae7979f5264 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:19:40.246292 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-3550ec89-372b-4050-946b-b9de3b06fd81 req-d78bc99b-2281-47df-96c6-6ae7979f5264 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:19:40.258589 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-3550ec89-372b-4050-946b-b9de3b06fd81 req-d78bc99b-2281-47df-96c6-6ae7979f5264 service nova] Creating event network-changed:7c5a28a0-5944-4f8e-89a2-ec6f0285a68c for instance 0b181724-b2bb-42af-b0c4-deed2fcb1cb9 on n-h2-master-1 Jun 20 13:19:40.263782 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-3550ec89-372b-4050-946b-b9de3b06fd81 req-d78bc99b-2281-47df-96c6-6ae7979f5264 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125862 Jun 20 13:19:40.264630 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3768/7638] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:19:40.283451 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5d7dd7c5-08ca-48df-a8a4-dc3df5419a48 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 204 len: 0 microversion: 2.1 time: 0.147465 Jun 20 13:19:40.285240 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3871/7639] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 13:19:40 2022] DELETE /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 13:19:40.294000 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f15323c4-3663-4290-9a6a-c967c4851f4e tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:19:40.294816 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f15323c4-3663-4290-9a6a-c967c4851f4e tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:19:40.301787 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f15323c4-3663-4290-9a6a-c967c4851f4e tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:19:40.302340 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f15323c4-3663-4290-9a6a-c967c4851f4e tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:19:40.303353 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f15323c4-3663-4290-9a6a-c967c4851f4e tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:19:40.303787 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f15323c4-3663-4290-9a6a-c967c4851f4e tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:19:40.444892 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f15323c4-3663-4290-9a6a-c967c4851f4e tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:19:40.452766 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f15323c4-3663-4290-9a6a-c967c4851f4e tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1566 microversion: 2.1 time: 0.163109 Jun 20 13:19:40.453331 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3769/7640] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:19:40 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:19:41.473691 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8704e56a-1cc1-4a65-9d5c-a9b8b669f51d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:19:41.474471 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8704e56a-1cc1-4a65-9d5c-a9b8b669f51d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:19:41.482155 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8704e56a-1cc1-4a65-9d5c-a9b8b669f51d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:19:41.482613 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8704e56a-1cc1-4a65-9d5c-a9b8b669f51d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:19:41.483389 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8704e56a-1cc1-4a65-9d5c-a9b8b669f51d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:19:41.483830 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8704e56a-1cc1-4a65-9d5c-a9b8b669f51d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:19:41.662765 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-8704e56a-1cc1-4a65-9d5c-a9b8b669f51d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:19:41.674501 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8704e56a-1cc1-4a65-9d5c-a9b8b669f51d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1566 microversion: 2.1 time: 0.207292 Jun 20 13:19:41.675285 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3872/7641] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:19:41 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1566 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:19:42.591171 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-d4ac92f7-9a90-4505-b2b5-f0179f744354 req-07a20123-6053-40f6-b662-faf56979858f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b181724-b2bb-42af-b0c4-deed2fcb1cb9", "name": "network-vif-deleted", "tag": "7c5a28a0-5944-4f8e-89a2-ec6f0285a68c"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:19:42.603995 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-d4ac92f7-9a90-4505-b2b5-f0179f744354 req-07a20123-6053-40f6-b662-faf56979858f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:19:42.604491 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-d4ac92f7-9a90-4505-b2b5-f0179f744354 req-07a20123-6053-40f6-b662-faf56979858f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:19:42.620764 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-d4ac92f7-9a90-4505-b2b5-f0179f744354 req-07a20123-6053-40f6-b662-faf56979858f service nova] Creating event network-vif-deleted:7c5a28a0-5944-4f8e-89a2-ec6f0285a68c for instance 0b181724-b2bb-42af-b0c4-deed2fcb1cb9 on n-h2-master-1 Jun 20 13:19:42.627791 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-d4ac92f7-9a90-4505-b2b5-f0179f744354 req-07a20123-6053-40f6-b662-faf56979858f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040709 Jun 20 13:19:42.628493 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3770/7642] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:19:42.698881 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-986ba276-73ca-4d33-a833-111cd61812e0 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:19:42.699527 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-986ba276-73ca-4d33-a833-111cd61812e0 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:19:42.707530 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-986ba276-73ca-4d33-a833-111cd61812e0 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:19:42.708015 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-986ba276-73ca-4d33-a833-111cd61812e0 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:19:42.708841 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-986ba276-73ca-4d33-a833-111cd61812e0 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:19:42.709309 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-986ba276-73ca-4d33-a833-111cd61812e0 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:19:42.773403 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-986ba276-73ca-4d33-a833-111cd61812e0 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:19:42.781375 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-986ba276-73ca-4d33-a833-111cd61812e0 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1219 microversion: 2.1 time: 0.086672 Jun 20 13:19:42.781931 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3873/7643] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:19:42 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:19:43.799425 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d3a8c9af-e946-4c13-b0ea-072921d37520 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:19:43.800049 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d3a8c9af-e946-4c13-b0ea-072921d37520 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:19:43.807875 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3a8c9af-e946-4c13-b0ea-072921d37520 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:19:43.808371 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3a8c9af-e946-4c13-b0ea-072921d37520 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:19:43.809153 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3a8c9af-e946-4c13-b0ea-072921d37520 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:19:43.809596 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3a8c9af-e946-4c13-b0ea-072921d37520 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:19:43.879097 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-d3a8c9af-e946-4c13-b0ea-072921d37520 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:19:43.886997 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d3a8c9af-e946-4c13-b0ea-072921d37520 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1219 microversion: 2.1 time: 0.091996 Jun 20 13:19:43.887567 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3771/7644] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:19:43 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:19:44.904347 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-db4627e4-1247-4632-81de-34791fad7d03 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:19:44.904962 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-db4627e4-1247-4632-81de-34791fad7d03 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:19:44.912686 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-db4627e4-1247-4632-81de-34791fad7d03 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:19:44.913138 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-db4627e4-1247-4632-81de-34791fad7d03 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:19:44.913909 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-db4627e4-1247-4632-81de-34791fad7d03 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:19:44.914353 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-db4627e4-1247-4632-81de-34791fad7d03 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:19:44.981686 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-db4627e4-1247-4632-81de-34791fad7d03 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:19:44.989715 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-db4627e4-1247-4632-81de-34791fad7d03 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1219 microversion: 2.1 time: 0.089426 Jun 20 13:19:44.990278 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3874/7645] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:19:44 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:19:46.007067 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c1e1038e-396c-4ac9-8b04-c4399967172e tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:19:46.007927 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c1e1038e-396c-4ac9-8b04-c4399967172e tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:19:46.015603 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c1e1038e-396c-4ac9-8b04-c4399967172e tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:19:46.016070 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c1e1038e-396c-4ac9-8b04-c4399967172e tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:19:46.016892 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c1e1038e-396c-4ac9-8b04-c4399967172e tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:19:46.017362 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c1e1038e-396c-4ac9-8b04-c4399967172e tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:19:46.080313 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-c1e1038e-396c-4ac9-8b04-c4399967172e tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:19:46.088984 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c1e1038e-396c-4ac9-8b04-c4399967172e tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1219 microversion: 2.1 time: 0.085936 Jun 20 13:19:46.089573 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3772/7646] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:19:46 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:19:47.106092 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a3133e0c-e2cf-4801-8265-4a776803134f tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:19:47.106725 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a3133e0c-e2cf-4801-8265-4a776803134f tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:19:47.114248 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a3133e0c-e2cf-4801-8265-4a776803134f tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:19:47.114734 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a3133e0c-e2cf-4801-8265-4a776803134f tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:19:47.115509 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a3133e0c-e2cf-4801-8265-4a776803134f tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:19:47.116079 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a3133e0c-e2cf-4801-8265-4a776803134f tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:19:47.156746 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a3133e0c-e2cf-4801-8265-4a776803134f tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:19:47.157265 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a3133e0c-e2cf-4801-8265-4a776803134f tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:19:47.157784 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-a3133e0c-e2cf-4801-8265-4a776803134f tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lazy-loading 'fault' on Instance uuid 0b181724-b2bb-42af-b0c4-deed2fcb1cb9 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 13:19:47.202584 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a3133e0c-e2cf-4801-8265-4a776803134f tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f302f2f7713487fb2140218e737e9ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1873e58ef0bb4d8da79eb47fc611b12c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:19:47.212816 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a3133e0c-e2cf-4801-8265-4a776803134f tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 200 len: 1224 microversion: 2.1 time: 0.110449 Jun 20 13:19:47.214280 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3875/7647] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:19:47 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 1224 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:19:48.231423 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e4ee7e10-4be6-49f4-b43a-a565f7c3374d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:19:48.232154 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e4ee7e10-4be6-49f4-b43a-a565f7c3374d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] [instance: 0b181724-b2bb-42af-b0c4-deed2fcb1cb9] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:19:48.239882 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e4ee7e10-4be6-49f4-b43a-a565f7c3374d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:19:48.240410 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e4ee7e10-4be6-49f4-b43a-a565f7c3374d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:19:48.241208 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e4ee7e10-4be6-49f4-b43a-a565f7c3374d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:19:48.241651 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e4ee7e10-4be6-49f4-b43a-a565f7c3374d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:19:48.256274 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-e4ee7e10-4be6-49f4-b43a-a565f7c3374d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] HTTP exception thrown: Instance 0b181724-b2bb-42af-b0c4-deed2fcb1cb9 could not be found. Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e4ee7e10-4be6-49f4-b43a-a565f7c3374d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Request method failure captured: Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 HTTP/1.1 Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: Accept: application/json Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: Accept-Encoding: identity Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: Connection: close Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: Content-Length: 0 Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: Content-Type: application/json Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: Host: 10.222.0.27 Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: Openstack-System-Scope: None Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.9 Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: X-Auth-Token: gAAAAABisHHcOK1_OtXKlmCPE2OZYG9IwXN-4KlJQGXtRzez5Gx0pMow7DSrMrTPq4W99bpdjbQy_FZdlVLjYduvMnLmxh4IY0O2NMxLnXj9jVN5k3YoEOqi9MvCzx3TgzTloZwInNV_6EUkDSn3EqSXOBGsFJDRedLk8atg34nLTFwqNmkk3ZY Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Id: None Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: X-Domain-Name: None Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: X-Identity-Status: Confirmed Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: X-Is-Admin-Project: True Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Id: default Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: X-Project-Domain-Name: Default Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: X-Project-Id: 1873e58ef0bb4d8da79eb47fc611b12c Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: X-Project-Name: tempest-TestShelveInstance-137684792 Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: X-Role: reader,member Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: X-Roles: reader,member Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1873e58ef0bb4d8da79eb47fc611b12c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1873e58ef0bb4d8da79eb47fc611b12c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1873e58ef0bb4d8da79eb47fc611b12c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1873e58ef0bb4d8da79eb47fc611b12c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: X-Tenant: tempest-TestShelveInstance-137684792 Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Id: 1873e58ef0bb4d8da79eb47fc611b12c Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: X-Tenant-Name: tempest-TestShelveInstance-137684792 Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: X-User: tempest-TestShelveInstance-137684792-project Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Id: default Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: X-User-Domain-Name: Default Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: X-User-Id: 2f302f2f7713487fb2140218e737e9ce Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: X-User-Name: tempest-TestShelveInstance-137684792-project Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: method: > Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: exception: Instance 0b181724-b2bb-42af-b0c4-deed2fcb1cb9 could not be found. Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: action_args: {'id': '0b181724-b2bb-42af-b0c4-deed2fcb1cb9'} Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b181724-b2bb-42af-b0c4-deed2fcb1cb9 could not be found. Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b181724-b2bb-42af-b0c4-deed2fcb1cb9 could not be found. Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 13:19:48.258014 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 13:19:48.263025 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 13:19:48.263025 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 13:19:48.263025 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 13:19:48.263025 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 13:19:48.263025 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 13:19:48.263025 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b181724-b2bb-42af-b0c4-deed2fcb1cb9 could not be found. Jun 20 13:19:48.263025 n-d-master-1 devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Jun 20 13:19:48.263025 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e4ee7e10-4be6-49f4-b43a-a565f7c3374d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Returning 404 to user: Instance 0b181724-b2bb-42af-b0c4-deed2fcb1cb9 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 13:19:48.263025 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e4ee7e10-4be6-49f4-b43a-a565f7c3374d tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9" status: 404 len: 111 microversion: 2.1 time: 0.032145 Jun 20 13:19:48.263025 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3773/7648] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:19:48 2022] GET /compute/v2.1/servers/0b181724-b2bb-42af-b0c4-deed2fcb1cb9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 13:19:48.440035 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e0443090-b017-471d-b0b9-dd869d3ac070 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] Calling method '.version_select at 0x7f6072d0e550>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:19:48.466381 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e0443090-b017-471d-b0b9-dd869d3ac070 tempest-TestShelveInstance-137684792 tempest-TestShelveInstance-137684792-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-762052326" status: 202 len: 0 microversion: 2.1 time: 0.030363 Jun 20 13:19:48.467520 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3876/7649] 10.222.0.27 () {58 vars in 1250 bytes} [Mon Jun 20 13:19:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-762052326 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 13:20:06.501308 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=12 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:20:06.502381 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=24 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:20:06.686057 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2a15a2a5-5f8e-4f23-89b4-9d4df920d682 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Action: 'create', calling method: .version_select at 0x7f607250c820>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1032210652", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXfNeeCpAjhTxZr1tDzjFo9A5W/EFt8rv+NcS82WUMGOCofO+Ki+cxUhu0OAtmmDvr81rID/Nq6IEBiskBSosmbdlgUBjjQb0IVFlsNBR1GdBYV6dCIealaHyLy4+Cu9Q=="}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:20:06.701945 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-2a15a2a5-5f8e-4f23-89b4-9d4df920d682 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Getting quotas for project 80031ef91658449d8266e46fa1c353df. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 13:20:06.709492 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-2a15a2a5-5f8e-4f23-89b4-9d4df920d682 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Getting quotas for user 9ba34f15a3e24d0fa9fdbfbf681eb241 and project 80031ef91658449d8266e46fa1c353df. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 13:20:06.746697 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2a15a2a5-5f8e-4f23-89b4-9d4df920d682 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.250415 Jun 20 13:20:06.747315 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3774/7650] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 20 13:20:06 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:20:07.789920 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:20:07.790696 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:20:07.795457 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8de70008-ddb0-477e-a594-de2563e4b2f8 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1996083508", "imageRef": "f16836cc-4e18-4bd0-b261-3865adf8cb83", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1032210652", "security_groups": [{"name": "tempest-secgroup-smoke-421377117"}], "networks": [{"uuid": "36ea1178-0dd8-4b3e-b218-efca039b7524"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:20:08.019274 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-8de70008-ddb0-477e-a594-de2563e4b2f8 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] validate_networks() for [('36ea1178-0dd8-4b3e-b218-efca039b7524', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 13:20:08.519950 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-8de70008-ddb0-477e-a594-de2563e4b2f8 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 13:20:08.520483 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-8de70008-ddb0-477e-a594-de2563e4b2f8 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 13:20:08.520958 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-8de70008-ddb0-477e-a594-de2563e4b2f8 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 13:20:08.521370 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-8de70008-ddb0-477e-a594-de2563e4b2f8 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 13:20:08.521786 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-8de70008-ddb0-477e-a594-de2563e4b2f8 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 13:20:08.531140 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8de70008-ddb0-477e-a594-de2563e4b2f8 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:20:08.531590 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8de70008-ddb0-477e-a594-de2563e4b2f8 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:20:08.532429 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8de70008-ddb0-477e-a594-de2563e4b2f8 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:20:08.533066 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8de70008-ddb0-477e-a594-de2563e4b2f8 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:20:08.550781 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-8de70008-ddb0-477e-a594-de2563e4b2f8 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Getting quotas for project 80031ef91658449d8266e46fa1c353df. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 13:20:08.556233 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.quota [None req-8de70008-ddb0-477e-a594-de2563e4b2f8 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Getting quotas for user 9ba34f15a3e24d0fa9fdbfbf681eb241 and project 80031ef91658449d8266e46fa1c353df. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 13:20:08.569437 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8de70008-ddb0-477e-a594-de2563e4b2f8 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 13:20:08.571747 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8de70008-ddb0-477e-a594-de2563e4b2f8 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b39ad0dc-8fbc-420d-885c-d85860605652] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f16836cc-4e18-4bd0-b261-3865adf8cb83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 13:20:08.619932 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8de70008-ddb0-477e-a594-de2563e4b2f8 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.831542 Jun 20 13:20:08.620983 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3877/7651] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 13:20:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 13:20:08.631962 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-63327802-d183-4c4c-8f30-cba9525f7608 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:20:08.633327 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-63327802-d183-4c4c-8f30-cba9525f7608 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b39ad0dc-8fbc-420d-885c-d85860605652] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:20:08.793722 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-63327802-d183-4c4c-8f30-cba9525f7608 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba34f15a3e24d0fa9fdbfbf681eb241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80031ef91658449d8266e46fa1c353df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:20:08.800850 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-63327802-d183-4c4c-8f30-cba9525f7608 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "GET /compute/v2.1/servers/b39ad0dc-8fbc-420d-885c-d85860605652" status: 200 len: 1249 microversion: 2.1 time: 0.174097 Jun 20 13:20:08.801329 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3775/7652] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:20:08 2022] GET /compute/v2.1/servers/b39ad0dc-8fbc-420d-885c-d85860605652 => generated 1249 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:20:09.822900 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b01e2820-a5c1-46c9-97a8-00894f992330 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:20:09.835390 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b01e2820-a5c1-46c9-97a8-00894f992330 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b39ad0dc-8fbc-420d-885c-d85860605652] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:20:09.857539 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b01e2820-a5c1-46c9-97a8-00894f992330 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:20:09.858359 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b01e2820-a5c1-46c9-97a8-00894f992330 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:20:09.859626 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b01e2820-a5c1-46c9-97a8-00894f992330 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:20:09.860369 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b01e2820-a5c1-46c9-97a8-00894f992330 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:20:09.984936 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-b01e2820-a5c1-46c9-97a8-00894f992330 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba34f15a3e24d0fa9fdbfbf681eb241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80031ef91658449d8266e46fa1c353df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:20:09.996091 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b01e2820-a5c1-46c9-97a8-00894f992330 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "GET /compute/v2.1/servers/b39ad0dc-8fbc-420d-885c-d85860605652" status: 200 len: 1309 microversion: 2.1 time: 0.181187 Jun 20 13:20:10.006255 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3878/7653] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:20:09 2022] GET /compute/v2.1/servers/b39ad0dc-8fbc-420d-885c-d85860605652 => generated 1309 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:20:11.014288 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4542595c-bd5e-44f0-99c1-876037433798 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:20:11.014904 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4542595c-bd5e-44f0-99c1-876037433798 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b39ad0dc-8fbc-420d-885c-d85860605652] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:20:11.022359 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4542595c-bd5e-44f0-99c1-876037433798 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:20:11.022830 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4542595c-bd5e-44f0-99c1-876037433798 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:20:11.023606 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4542595c-bd5e-44f0-99c1-876037433798 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:20:11.024058 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4542595c-bd5e-44f0-99c1-876037433798 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:20:11.246494 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-4542595c-bd5e-44f0-99c1-876037433798 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba34f15a3e24d0fa9fdbfbf681eb241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80031ef91658449d8266e46fa1c353df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:20:11.254524 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4542595c-bd5e-44f0-99c1-876037433798 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "GET /compute/v2.1/servers/b39ad0dc-8fbc-420d-885c-d85860605652" status: 200 len: 1374 microversion: 2.1 time: 0.244239 Jun 20 13:20:11.255100 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3776/7654] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:20:11 2022] GET /compute/v2.1/servers/b39ad0dc-8fbc-420d-885c-d85860605652 => generated 1374 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:20:11.521483 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-41f39112-40b1-47ca-aed6-058eaff08aa3 req-954d45e4-a2a6-4fb8-82b5-3f0743d3ce0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b39ad0dc-8fbc-420d-885c-d85860605652", "tag": "3eba53cb-0f43-4471-9eb7-05dde04019ba"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:20:11.535618 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-41f39112-40b1-47ca-aed6-058eaff08aa3 req-954d45e4-a2a6-4fb8-82b5-3f0743d3ce0a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:20:11.536552 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-41f39112-40b1-47ca-aed6-058eaff08aa3 req-954d45e4-a2a6-4fb8-82b5-3f0743d3ce0a service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:20:11.550391 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-41f39112-40b1-47ca-aed6-058eaff08aa3 req-954d45e4-a2a6-4fb8-82b5-3f0743d3ce0a service nova] Creating event network-changed:3eba53cb-0f43-4471-9eb7-05dde04019ba for instance b39ad0dc-8fbc-420d-885c-d85860605652 on n-h1-master-1 Jun 20 13:20:11.556260 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-41f39112-40b1-47ca-aed6-058eaff08aa3 req-954d45e4-a2a6-4fb8-82b5-3f0743d3ce0a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041015 Jun 20 13:20:11.558283 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3879/7655] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:20:12.276503 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e78900b5-e979-4406-963b-f000f471ac70 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:20:12.277514 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e78900b5-e979-4406-963b-f000f471ac70 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b39ad0dc-8fbc-420d-885c-d85860605652] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:20:12.288533 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e78900b5-e979-4406-963b-f000f471ac70 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:20:12.289011 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e78900b5-e979-4406-963b-f000f471ac70 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:20:12.289795 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e78900b5-e979-4406-963b-f000f471ac70 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:20:12.290244 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e78900b5-e979-4406-963b-f000f471ac70 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:20:12.425624 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-e78900b5-e979-4406-963b-f000f471ac70 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba34f15a3e24d0fa9fdbfbf681eb241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80031ef91658449d8266e46fa1c353df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:20:12.433689 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e78900b5-e979-4406-963b-f000f471ac70 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "GET /compute/v2.1/servers/b39ad0dc-8fbc-420d-885c-d85860605652" status: 200 len: 1374 microversion: 2.1 time: 0.164069 Jun 20 13:20:12.434284 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3777/7656] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:20:12 2022] GET /compute/v2.1/servers/b39ad0dc-8fbc-420d-885c-d85860605652 => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:20:13.452813 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f640c7c6-9e61-4a2d-b3c3-32b85000138a tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:20:13.453547 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f640c7c6-9e61-4a2d-b3c3-32b85000138a tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b39ad0dc-8fbc-420d-885c-d85860605652] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:20:13.460828 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f640c7c6-9e61-4a2d-b3c3-32b85000138a tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:20:13.461284 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f640c7c6-9e61-4a2d-b3c3-32b85000138a tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:20:13.462060 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f640c7c6-9e61-4a2d-b3c3-32b85000138a tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:20:13.462502 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f640c7c6-9e61-4a2d-b3c3-32b85000138a tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:20:13.605047 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-f640c7c6-9e61-4a2d-b3c3-32b85000138a tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba34f15a3e24d0fa9fdbfbf681eb241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80031ef91658449d8266e46fa1c353df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:20:13.614389 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f640c7c6-9e61-4a2d-b3c3-32b85000138a tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "GET /compute/v2.1/servers/b39ad0dc-8fbc-420d-885c-d85860605652" status: 200 len: 1374 microversion: 2.1 time: 0.166858 Jun 20 13:20:13.614997 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3880/7657] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:20:13 2022] GET /compute/v2.1/servers/b39ad0dc-8fbc-420d-885c-d85860605652 => generated 1374 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:20:14.633416 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0c0aecf2-4dd0-4644-9ad7-3f508355e461 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:20:14.634056 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0c0aecf2-4dd0-4644-9ad7-3f508355e461 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b39ad0dc-8fbc-420d-885c-d85860605652] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:20:14.641825 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c0aecf2-4dd0-4644-9ad7-3f508355e461 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:20:14.642283 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c0aecf2-4dd0-4644-9ad7-3f508355e461 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:20:14.643056 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c0aecf2-4dd0-4644-9ad7-3f508355e461 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:20:14.643496 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c0aecf2-4dd0-4644-9ad7-3f508355e461 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:20:14.801634 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0c0aecf2-4dd0-4644-9ad7-3f508355e461 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba34f15a3e24d0fa9fdbfbf681eb241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80031ef91658449d8266e46fa1c353df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:20:14.809465 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0c0aecf2-4dd0-4644-9ad7-3f508355e461 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "GET /compute/v2.1/servers/b39ad0dc-8fbc-420d-885c-d85860605652" status: 200 len: 1374 microversion: 2.1 time: 0.180911 Jun 20 13:20:14.810046 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3778/7658] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:20:14 2022] GET /compute/v2.1/servers/b39ad0dc-8fbc-420d-885c-d85860605652 => generated 1374 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:20:15.308184 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-3e0a2279-7c30-4302-8ded-af8a37187ae1 req-6f9b02cd-0659-42d8-ae06-f60826511804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b39ad0dc-8fbc-420d-885c-d85860605652", "name": "network-vif-plugged", "status": "completed", "tag": "3eba53cb-0f43-4471-9eb7-05dde04019ba"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:20:15.317957 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-3e0a2279-7c30-4302-8ded-af8a37187ae1 req-6f9b02cd-0659-42d8-ae06-f60826511804 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:20:15.318413 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-3e0a2279-7c30-4302-8ded-af8a37187ae1 req-6f9b02cd-0659-42d8-ae06-f60826511804 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:20:15.330140 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-3e0a2279-7c30-4302-8ded-af8a37187ae1 req-6f9b02cd-0659-42d8-ae06-f60826511804 service nova] Creating event network-vif-plugged:3eba53cb-0f43-4471-9eb7-05dde04019ba for instance b39ad0dc-8fbc-420d-885c-d85860605652 on n-h1-master-1 Jun 20 13:20:15.335235 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-3e0a2279-7c30-4302-8ded-af8a37187ae1 req-6f9b02cd-0659-42d8-ae06-f60826511804 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030794 Jun 20 13:20:15.335880 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3881/7659] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:20:15.830143 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0ca27173-785a-40a7-bf2a-3f132fc3f1f6 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:20:15.831089 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0ca27173-785a-40a7-bf2a-3f132fc3f1f6 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b39ad0dc-8fbc-420d-885c-d85860605652] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:20:15.839059 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0ca27173-785a-40a7-bf2a-3f132fc3f1f6 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:20:15.839529 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0ca27173-785a-40a7-bf2a-3f132fc3f1f6 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:20:15.840353 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0ca27173-785a-40a7-bf2a-3f132fc3f1f6 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:20:15.840803 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0ca27173-785a-40a7-bf2a-3f132fc3f1f6 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:20:15.997956 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-0ca27173-785a-40a7-bf2a-3f132fc3f1f6 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba34f15a3e24d0fa9fdbfbf681eb241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80031ef91658449d8266e46fa1c353df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:20:16.006286 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0ca27173-785a-40a7-bf2a-3f132fc3f1f6 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "GET /compute/v2.1/servers/b39ad0dc-8fbc-420d-885c-d85860605652" status: 200 len: 1374 microversion: 2.1 time: 0.182195 Jun 20 13:20:16.006867 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3779/7660] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:20:15 2022] GET /compute/v2.1/servers/b39ad0dc-8fbc-420d-885c-d85860605652 => generated 1374 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:20:17.024891 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6c2d23a0-5f38-49a4-9de6-0297ae541dbb tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:20:17.025629 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6c2d23a0-5f38-49a4-9de6-0297ae541dbb tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b39ad0dc-8fbc-420d-885c-d85860605652] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:20:17.032688 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c2d23a0-5f38-49a4-9de6-0297ae541dbb tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:20:17.033152 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c2d23a0-5f38-49a4-9de6-0297ae541dbb tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:20:17.033923 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c2d23a0-5f38-49a4-9de6-0297ae541dbb tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:20:17.034363 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c2d23a0-5f38-49a4-9de6-0297ae541dbb tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:20:17.169693 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-6c2d23a0-5f38-49a4-9de6-0297ae541dbb tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba34f15a3e24d0fa9fdbfbf681eb241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80031ef91658449d8266e46fa1c353df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:20:17.177628 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6c2d23a0-5f38-49a4-9de6-0297ae541dbb tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "GET /compute/v2.1/servers/b39ad0dc-8fbc-420d-885c-d85860605652" status: 200 len: 1559 microversion: 2.1 time: 0.158084 Jun 20 13:20:17.178261 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3882/7661] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:20:17 2022] GET /compute/v2.1/servers/b39ad0dc-8fbc-420d-885c-d85860605652 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:20:17.194425 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-15d391e1-659a-4d0d-b87d-988813071f1a tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:20:17.195122 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-15d391e1-659a-4d0d-b87d-988813071f1a tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b39ad0dc-8fbc-420d-885c-d85860605652] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:20:17.202644 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-15d391e1-659a-4d0d-b87d-988813071f1a tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:20:17.203100 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-15d391e1-659a-4d0d-b87d-988813071f1a tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:20:17.203867 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-15d391e1-659a-4d0d-b87d-988813071f1a tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:20:17.204335 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-15d391e1-659a-4d0d-b87d-988813071f1a tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:20:17.340758 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-15d391e1-659a-4d0d-b87d-988813071f1a tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba34f15a3e24d0fa9fdbfbf681eb241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80031ef91658449d8266e46fa1c353df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:20:17.349150 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-15d391e1-659a-4d0d-b87d-988813071f1a tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "GET /compute/v2.1/servers/b39ad0dc-8fbc-420d-885c-d85860605652" status: 200 len: 1559 microversion: 2.1 time: 0.159142 Jun 20 13:20:17.349992 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3780/7662] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:20:17 2022] GET /compute/v2.1/servers/b39ad0dc-8fbc-420d-885c-d85860605652 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:20:19.323917 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-44a64805-672e-4acb-9ffc-aa7b510b55c3 req-f17df522-ef02-470b-aa1e-79fac420e02c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b39ad0dc-8fbc-420d-885c-d85860605652", "tag": "3eba53cb-0f43-4471-9eb7-05dde04019ba"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:20:19.327855 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:20:19.328721 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:20:19.335863 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-44a64805-672e-4acb-9ffc-aa7b510b55c3 req-f17df522-ef02-470b-aa1e-79fac420e02c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:20:19.336357 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-44a64805-672e-4acb-9ffc-aa7b510b55c3 req-f17df522-ef02-470b-aa1e-79fac420e02c service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:20:19.348234 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-44a64805-672e-4acb-9ffc-aa7b510b55c3 req-f17df522-ef02-470b-aa1e-79fac420e02c service nova] Creating event network-changed:3eba53cb-0f43-4471-9eb7-05dde04019ba for instance b39ad0dc-8fbc-420d-885c-d85860605652 on n-h1-master-1 Jun 20 13:20:19.353702 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-44a64805-672e-4acb-9ffc-aa7b510b55c3 req-f17df522-ef02-470b-aa1e-79fac420e02c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033511 Jun 20 13:20:19.354472 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3883/7663] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:21:09.276618 n-d-master-1 devstack@n-api.service[119128]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 13:21:09.277275 n-d-master-1 devstack@n-api.service[119128]: Mon Jun 20 13:21:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 13:22:13.768268 n-d-master-1 devstack@n-api.service[119128]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34606191-6ad4-4abb-b900-405f87896bf5] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 20 13:22:13.769873 n-d-master-1 devstack@n-api.service[119128]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aec4b5a8-4fa3-4bbf-bcd3-4f7b001dec4c] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 20 13:22:13.770963 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:22:13.772531 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:22:13.773782 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=30 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:22:13.778176 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ab41eaea-e702-4508-9b32-c6d0d4ad177c tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1972849535"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:22:13.779274 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ab41eaea-e702-4508-9b32-c6d0d4ad177c tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b39ad0dc-8fbc-420d-885c-d85860605652] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:22:13.787430 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ab41eaea-e702-4508-9b32-c6d0d4ad177c tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:13.787887 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ab41eaea-e702-4508-9b32-c6d0d4ad177c tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:13.788706 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ab41eaea-e702-4508-9b32-c6d0d4ad177c tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:13.789170 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ab41eaea-e702-4508-9b32-c6d0d4ad177c tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:14.081430 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ab41eaea-e702-4508-9b32-c6d0d4ad177c tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "POST /compute/v2.1/servers/b39ad0dc-8fbc-420d-885c-d85860605652/action" status: 202 len: 0 microversion: 2.1 time: 0.315705 Jun 20 13:22:14.082234 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3781/7664] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 20 13:22:13 2022] POST /compute/v2.1/servers/b39ad0dc-8fbc-420d-885c-d85860605652/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 20 13:22:17.979897 n-d-master-1 devstack@n-api.service[119127]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e724c47c-e194-481c-b307-79cd496ecce0] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 20 13:22:17.980740 n-d-master-1 devstack@n-api.service[119127]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c8b4e032-3e27-4327-b51f-f4e5667969ed] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 20 13:22:17.981547 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:22:17.982924 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=26 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:22:17.988983 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-71162cb1-e2ef-4cba-98da-ca034e9b94a1 req-c8b7ffd7-d2b7-4599-8dac-a3fd8dd9f0ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b39ad0dc-8fbc-420d-885c-d85860605652", "name": "network-vif-plugged", "status": "completed", "tag": "3eba53cb-0f43-4471-9eb7-05dde04019ba"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:22:18.003297 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-71162cb1-e2ef-4cba-98da-ca034e9b94a1 req-c8b7ffd7-d2b7-4599-8dac-a3fd8dd9f0ab service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:18.003793 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-71162cb1-e2ef-4cba-98da-ca034e9b94a1 req-c8b7ffd7-d2b7-4599-8dac-a3fd8dd9f0ab service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:18.016483 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-71162cb1-e2ef-4cba-98da-ca034e9b94a1 req-c8b7ffd7-d2b7-4599-8dac-a3fd8dd9f0ab service nova] Creating event network-vif-plugged:3eba53cb-0f43-4471-9eb7-05dde04019ba for instance b39ad0dc-8fbc-420d-885c-d85860605652 on n-h1-master-1 Jun 20 13:22:18.033193 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-71162cb1-e2ef-4cba-98da-ca034e9b94a1 req-c8b7ffd7-d2b7-4599-8dac-a3fd8dd9f0ab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055009 Jun 20 13:22:18.035223 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3884/7665] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 13:22:26.619318 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:22:26.620109 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:22:26.625638 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f2ee09c0-815a-4b0a-8991-61caa3f22063 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-706833869", "imageRef": "a1b917ea-5c5a-459f-8db0-b6a60a3b6aed", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1032210652", "security_groups": [{"name": "tempest-secgroup-smoke-421377117"}], "networks": [{"uuid": "36ea1178-0dd8-4b3e-b218-efca039b7524"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:22:26.648378 n-d-master-1 devstack@n-api.service[119128]: INFO oslo.messaging._drivers.impl_rabbit [-] [34606191-6ad4-4abb-b900-405f87896bf5] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 47910. Jun 20 13:22:26.651271 n-d-master-1 devstack@n-api.service[119128]: INFO oslo.messaging._drivers.impl_rabbit [-] [aec4b5a8-4fa3-4bbf-bcd3-4f7b001dec4c] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 47912. Jun 20 13:22:26.745678 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-f2ee09c0-815a-4b0a-8991-61caa3f22063 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] validate_networks() for [('36ea1178-0dd8-4b3e-b218-efca039b7524', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 13:22:27.191145 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-f2ee09c0-815a-4b0a-8991-61caa3f22063 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 13:22:27.191727 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-f2ee09c0-815a-4b0a-8991-61caa3f22063 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 13:22:27.192263 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-f2ee09c0-815a-4b0a-8991-61caa3f22063 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 13:22:27.192710 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-f2ee09c0-815a-4b0a-8991-61caa3f22063 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 13:22:27.193136 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-f2ee09c0-815a-4b0a-8991-61caa3f22063 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 13:22:27.203691 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f2ee09c0-815a-4b0a-8991-61caa3f22063 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:27.204176 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f2ee09c0-815a-4b0a-8991-61caa3f22063 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:27.204998 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f2ee09c0-815a-4b0a-8991-61caa3f22063 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:27.205453 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f2ee09c0-815a-4b0a-8991-61caa3f22063 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:27.223954 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-f2ee09c0-815a-4b0a-8991-61caa3f22063 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Getting quotas for project 80031ef91658449d8266e46fa1c353df. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 13:22:27.230023 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.quota [None req-f2ee09c0-815a-4b0a-8991-61caa3f22063 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Getting quotas for user 9ba34f15a3e24d0fa9fdbfbf681eb241 and project 80031ef91658449d8266e46fa1c353df. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 13:22:27.244110 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f2ee09c0-815a-4b0a-8991-61caa3f22063 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 13:22:27.246759 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f2ee09c0-815a-4b0a-8991-61caa3f22063 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a1b917ea-5c5a-459f-8db0-b6a60a3b6aed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 13:22:27.294473 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f2ee09c0-815a-4b0a-8991-61caa3f22063 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.677390 Jun 20 13:22:27.295121 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3782/7666] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 20 13:22:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 13:22:27.307722 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-193f313d-3cec-42ed-bdc6-e47d812275c1 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:22:27.308464 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-193f313d-3cec-42ed-bdc6-e47d812275c1 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:22:27.320041 n-d-master-1 devstack@n-api.service[119127]: INFO oslo.messaging._drivers.impl_rabbit [-] [e724c47c-e194-481c-b307-79cd496ecce0] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 47926. Jun 20 13:22:27.322617 n-d-master-1 devstack@n-api.service[119127]: INFO oslo.messaging._drivers.impl_rabbit [-] [c8b4e032-3e27-4327-b51f-f4e5667969ed] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 47928. Jun 20 13:22:27.372467 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-193f313d-3cec-42ed-bdc6-e47d812275c1 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba34f15a3e24d0fa9fdbfbf681eb241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80031ef91658449d8266e46fa1c353df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:22:27.379468 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-193f313d-3cec-42ed-bdc6-e47d812275c1 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1" status: 200 len: 1248 microversion: 2.1 time: 0.077920 Jun 20 13:22:27.380058 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3885/7667] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:22:27 2022] GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1 => generated 1248 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:22:28.398058 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-19654348-b248-4461-a022-bb00e85e028f tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:22:28.399557 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-19654348-b248-4461-a022-bb00e85e028f tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:22:28.406348 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-19654348-b248-4461-a022-bb00e85e028f tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:28.406862 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-19654348-b248-4461-a022-bb00e85e028f tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:28.407886 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-19654348-b248-4461-a022-bb00e85e028f tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:28.408646 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-19654348-b248-4461-a022-bb00e85e028f tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:28.478523 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-19654348-b248-4461-a022-bb00e85e028f tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba34f15a3e24d0fa9fdbfbf681eb241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80031ef91658449d8266e46fa1c353df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:22:28.486495 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-19654348-b248-4461-a022-bb00e85e028f tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1" status: 200 len: 1318 microversion: 2.1 time: 0.093099 Jun 20 13:22:28.487254 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3783/7668] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:22:28 2022] GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1 => generated 1318 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:22:29.502955 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ac26773f-ae01-4a2e-a6ca-4a4fbea01adb tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:22:29.506536 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ac26773f-ae01-4a2e-a6ca-4a4fbea01adb tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:22:29.508932 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:22:29.527474 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac26773f-ae01-4a2e-a6ca-4a4fbea01adb tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:29.528429 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac26773f-ae01-4a2e-a6ca-4a4fbea01adb tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:29.529788 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac26773f-ae01-4a2e-a6ca-4a4fbea01adb tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:29.530287 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac26773f-ae01-4a2e-a6ca-4a4fbea01adb tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:29.715914 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ac26773f-ae01-4a2e-a6ca-4a4fbea01adb tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba34f15a3e24d0fa9fdbfbf681eb241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80031ef91658449d8266e46fa1c353df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:22:29.735018 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ac26773f-ae01-4a2e-a6ca-4a4fbea01adb tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1" status: 200 len: 1373 microversion: 2.1 time: 0.235762 Jun 20 13:22:29.745731 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3886/7669] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:22:29 2022] GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1 => generated 1373 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:22:29.984520 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-5d95ce29-9f6f-4994-8e9f-98b4ec643db3 req-e84fe55d-3802-42d5-ae54-ac50ed54f4de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b39ad0dc-8fbc-420d-885c-d85860605652", "name": "network-vif-unplugged", "status": "completed", "tag": "3eba53cb-0f43-4471-9eb7-05dde04019ba"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:22:29.997520 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-5d95ce29-9f6f-4994-8e9f-98b4ec643db3 req-e84fe55d-3802-42d5-ae54-ac50ed54f4de service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:29.998254 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-5d95ce29-9f6f-4994-8e9f-98b4ec643db3 req-e84fe55d-3802-42d5-ae54-ac50ed54f4de service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:30.014247 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-5d95ce29-9f6f-4994-8e9f-98b4ec643db3 req-e84fe55d-3802-42d5-ae54-ac50ed54f4de service nova] Creating event network-vif-unplugged:3eba53cb-0f43-4471-9eb7-05dde04019ba for instance b39ad0dc-8fbc-420d-885c-d85860605652 on n-h1-master-1 Jun 20 13:22:30.028485 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-5d95ce29-9f6f-4994-8e9f-98b4ec643db3 req-e84fe55d-3802-42d5-ae54-ac50ed54f4de service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049260 Jun 20 13:22:30.029508 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3784/7670] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:22:30.763288 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5ea77426-3794-4612-938e-de6b7134c120 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:22:30.764123 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5ea77426-3794-4612-938e-de6b7134c120 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:22:30.773223 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5ea77426-3794-4612-938e-de6b7134c120 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:30.774211 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5ea77426-3794-4612-938e-de6b7134c120 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:30.775119 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5ea77426-3794-4612-938e-de6b7134c120 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:30.775797 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5ea77426-3794-4612-938e-de6b7134c120 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:30.917807 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-5ea77426-3794-4612-938e-de6b7134c120 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba34f15a3e24d0fa9fdbfbf681eb241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80031ef91658449d8266e46fa1c353df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:22:30.925792 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5ea77426-3794-4612-938e-de6b7134c120 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1" status: 200 len: 1373 microversion: 2.1 time: 0.166666 Jun 20 13:22:30.936065 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3887/7671] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:22:30 2022] GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1 => generated 1373 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:22:31.945006 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f2872fe3-46ac-470c-a8c6-ddb7f566fd20 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:22:31.945731 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f2872fe3-46ac-470c-a8c6-ddb7f566fd20 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:22:31.952575 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f2872fe3-46ac-470c-a8c6-ddb7f566fd20 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:31.953056 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f2872fe3-46ac-470c-a8c6-ddb7f566fd20 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:31.953845 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f2872fe3-46ac-470c-a8c6-ddb7f566fd20 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:31.957606 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f2872fe3-46ac-470c-a8c6-ddb7f566fd20 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:32.099739 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f2872fe3-46ac-470c-a8c6-ddb7f566fd20 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba34f15a3e24d0fa9fdbfbf681eb241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80031ef91658449d8266e46fa1c353df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:22:32.108438 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f2872fe3-46ac-470c-a8c6-ddb7f566fd20 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1" status: 200 len: 1373 microversion: 2.1 time: 0.168817 Jun 20 13:22:32.111765 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3785/7672] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:22:31 2022] GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1 => generated 1373 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:22:33.126154 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4b74ff4a-0eac-4a75-bc1e-719697bbac95 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:22:33.126766 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4b74ff4a-0eac-4a75-bc1e-719697bbac95 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:22:33.134668 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4b74ff4a-0eac-4a75-bc1e-719697bbac95 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:33.135119 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4b74ff4a-0eac-4a75-bc1e-719697bbac95 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:33.135893 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4b74ff4a-0eac-4a75-bc1e-719697bbac95 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:33.136375 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4b74ff4a-0eac-4a75-bc1e-719697bbac95 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:33.297258 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-4b74ff4a-0eac-4a75-bc1e-719697bbac95 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba34f15a3e24d0fa9fdbfbf681eb241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80031ef91658449d8266e46fa1c353df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:22:33.307685 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4b74ff4a-0eac-4a75-bc1e-719697bbac95 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1" status: 200 len: 1373 microversion: 2.1 time: 0.185333 Jun 20 13:22:33.309798 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3888/7673] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:22:33 2022] GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1 => generated 1373 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:22:34.326692 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-95c4006b-9b20-4f91-9d3f-7d27499f971b tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:22:34.327796 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-95c4006b-9b20-4f91-9d3f-7d27499f971b tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:22:34.336954 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95c4006b-9b20-4f91-9d3f-7d27499f971b tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:34.337411 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95c4006b-9b20-4f91-9d3f-7d27499f971b tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:34.338257 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95c4006b-9b20-4f91-9d3f-7d27499f971b tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:34.338711 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95c4006b-9b20-4f91-9d3f-7d27499f971b tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:34.501220 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-95c4006b-9b20-4f91-9d3f-7d27499f971b tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba34f15a3e24d0fa9fdbfbf681eb241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80031ef91658449d8266e46fa1c353df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:22:34.509972 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-95c4006b-9b20-4f91-9d3f-7d27499f971b tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1" status: 200 len: 1373 microversion: 2.1 time: 0.187809 Jun 20 13:22:34.510589 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3786/7674] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:22:34 2022] GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1 => generated 1373 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:22:35.527566 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-59480fb7-c791-449f-b6c7-5744769f5f7e tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:22:35.529327 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-59480fb7-c791-449f-b6c7-5744769f5f7e tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:22:35.537530 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-59480fb7-c791-449f-b6c7-5744769f5f7e tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:35.538091 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-59480fb7-c791-449f-b6c7-5744769f5f7e tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:35.539012 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-59480fb7-c791-449f-b6c7-5744769f5f7e tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:35.539518 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-59480fb7-c791-449f-b6c7-5744769f5f7e tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:35.684755 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-59480fb7-c791-449f-b6c7-5744769f5f7e tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba34f15a3e24d0fa9fdbfbf681eb241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80031ef91658449d8266e46fa1c353df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:22:35.692918 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-59480fb7-c791-449f-b6c7-5744769f5f7e tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1" status: 200 len: 1373 microversion: 2.1 time: 0.169681 Jun 20 13:22:35.693734 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3889/7675] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:22:35 2022] GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1 => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:22:36.715508 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cf570cb4-944e-4aa7-8408-0f9de8bed697 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:22:36.716573 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cf570cb4-944e-4aa7-8408-0f9de8bed697 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:22:36.728166 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cf570cb4-944e-4aa7-8408-0f9de8bed697 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:36.728922 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cf570cb4-944e-4aa7-8408-0f9de8bed697 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:36.729705 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cf570cb4-944e-4aa7-8408-0f9de8bed697 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:36.730156 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cf570cb4-944e-4aa7-8408-0f9de8bed697 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:36.864893 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-cf570cb4-944e-4aa7-8408-0f9de8bed697 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba34f15a3e24d0fa9fdbfbf681eb241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80031ef91658449d8266e46fa1c353df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:22:36.873102 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cf570cb4-944e-4aa7-8408-0f9de8bed697 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1" status: 200 len: 1373 microversion: 2.1 time: 0.164439 Jun 20 13:22:36.873672 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3787/7676] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:22:36 2022] GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1 => generated 1373 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:22:37.895658 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a36fdc28-2e3d-43d6-83c2-8a07cd20aca2 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:22:37.896636 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a36fdc28-2e3d-43d6-83c2-8a07cd20aca2 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:22:37.900047 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:22:37.906607 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a36fdc28-2e3d-43d6-83c2-8a07cd20aca2 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:37.907062 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a36fdc28-2e3d-43d6-83c2-8a07cd20aca2 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:37.907858 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a36fdc28-2e3d-43d6-83c2-8a07cd20aca2 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:37.908367 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a36fdc28-2e3d-43d6-83c2-8a07cd20aca2 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:38.064854 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-a36fdc28-2e3d-43d6-83c2-8a07cd20aca2 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba34f15a3e24d0fa9fdbfbf681eb241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80031ef91658449d8266e46fa1c353df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:22:38.074248 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a36fdc28-2e3d-43d6-83c2-8a07cd20aca2 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1" status: 200 len: 1373 microversion: 2.1 time: 0.182662 Jun 20 13:22:38.074857 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3890/7677] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:22:37 2022] GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1 => generated 1373 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:22:39.102458 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f394e445-94d0-495b-8563-d446238d3dd0 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:22:39.103453 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f394e445-94d0-495b-8563-d446238d3dd0 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:22:39.105496 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:22:39.106184 n-d-master-1 devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:22:39.113622 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f394e445-94d0-495b-8563-d446238d3dd0 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:39.114086 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f394e445-94d0-495b-8563-d446238d3dd0 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:39.114871 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f394e445-94d0-495b-8563-d446238d3dd0 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:39.115320 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f394e445-94d0-495b-8563-d446238d3dd0 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:39.257770 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f394e445-94d0-495b-8563-d446238d3dd0 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba34f15a3e24d0fa9fdbfbf681eb241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80031ef91658449d8266e46fa1c353df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:22:39.269829 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f394e445-94d0-495b-8563-d446238d3dd0 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1" status: 200 len: 1373 microversion: 2.1 time: 0.172514 Jun 20 13:22:39.270881 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3788/7678] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:22:39 2022] GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1 => generated 1373 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:22:40.290091 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-33b4a65e-bbcb-4663-94af-c09053b38eb3 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:22:40.290831 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-33b4a65e-bbcb-4663-94af-c09053b38eb3 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:22:40.298558 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-33b4a65e-bbcb-4663-94af-c09053b38eb3 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:40.299016 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-33b4a65e-bbcb-4663-94af-c09053b38eb3 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:40.299787 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-33b4a65e-bbcb-4663-94af-c09053b38eb3 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:40.300252 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-33b4a65e-bbcb-4663-94af-c09053b38eb3 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:40.520182 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-33b4a65e-bbcb-4663-94af-c09053b38eb3 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba34f15a3e24d0fa9fdbfbf681eb241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80031ef91658449d8266e46fa1c353df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:22:40.528330 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-33b4a65e-bbcb-4663-94af-c09053b38eb3 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1" status: 200 len: 1373 microversion: 2.1 time: 0.242613 Jun 20 13:22:40.528931 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3891/7679] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:22:40 2022] GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1 => generated 1373 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:22:40.913649 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-6fa06d30-6c25-4a82-aab3-c2ff7dcafa97 req-f99db01a-c518-481e-b826-daaf023d6be3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1", "tag": "c0e14152-4736-4075-9f95-42854ae16779"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:22:40.922740 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-6fa06d30-6c25-4a82-aab3-c2ff7dcafa97 req-f99db01a-c518-481e-b826-daaf023d6be3 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:40.923561 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-6fa06d30-6c25-4a82-aab3-c2ff7dcafa97 req-f99db01a-c518-481e-b826-daaf023d6be3 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:40.936856 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-6fa06d30-6c25-4a82-aab3-c2ff7dcafa97 req-f99db01a-c518-481e-b826-daaf023d6be3 service nova] Creating event network-changed:c0e14152-4736-4075-9f95-42854ae16779 for instance b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1 on n-h2-master-1 Jun 20 13:22:40.942655 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-6fa06d30-6c25-4a82-aab3-c2ff7dcafa97 req-f99db01a-c518-481e-b826-daaf023d6be3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130167 Jun 20 13:22:40.943438 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3789/7680] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:22:41.549825 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dd01ee79-bb2d-4e56-8a40-f4658766e4d8 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:22:41.550896 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dd01ee79-bb2d-4e56-8a40-f4658766e4d8 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:22:41.560147 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd01ee79-bb2d-4e56-8a40-f4658766e4d8 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:41.560638 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd01ee79-bb2d-4e56-8a40-f4658766e4d8 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:41.561406 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd01ee79-bb2d-4e56-8a40-f4658766e4d8 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:41.561845 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dd01ee79-bb2d-4e56-8a40-f4658766e4d8 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:41.708347 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-dd01ee79-bb2d-4e56-8a40-f4658766e4d8 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba34f15a3e24d0fa9fdbfbf681eb241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80031ef91658449d8266e46fa1c353df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:22:41.716590 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dd01ee79-bb2d-4e56-8a40-f4658766e4d8 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1" status: 200 len: 1373 microversion: 2.1 time: 0.173317 Jun 20 13:22:41.717186 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3892/7681] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:22:41 2022] GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1 => generated 1373 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:22:42.736684 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-47d6b15e-7696-4751-ae22-bfd7f513ec44 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:22:42.737427 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-47d6b15e-7696-4751-ae22-bfd7f513ec44 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:22:42.744412 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-47d6b15e-7696-4751-ae22-bfd7f513ec44 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:42.744916 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-47d6b15e-7696-4751-ae22-bfd7f513ec44 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:42.745696 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-47d6b15e-7696-4751-ae22-bfd7f513ec44 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:42.746144 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-47d6b15e-7696-4751-ae22-bfd7f513ec44 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:42.889014 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-47d6b15e-7696-4751-ae22-bfd7f513ec44 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba34f15a3e24d0fa9fdbfbf681eb241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80031ef91658449d8266e46fa1c353df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:22:42.896782 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-47d6b15e-7696-4751-ae22-bfd7f513ec44 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1" status: 200 len: 1373 microversion: 2.1 time: 0.165411 Jun 20 13:22:42.897385 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3790/7682] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:22:42 2022] GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1 => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:22:43.916648 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-53b37728-9b4e-4daf-a222-6fff0619cf37 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:22:43.917223 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-53b37728-9b4e-4daf-a222-6fff0619cf37 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:22:43.927901 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-53b37728-9b4e-4daf-a222-6fff0619cf37 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:43.928599 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-53b37728-9b4e-4daf-a222-6fff0619cf37 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:43.929796 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-53b37728-9b4e-4daf-a222-6fff0619cf37 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:43.930397 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-53b37728-9b4e-4daf-a222-6fff0619cf37 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:44.068435 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-53b37728-9b4e-4daf-a222-6fff0619cf37 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba34f15a3e24d0fa9fdbfbf681eb241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80031ef91658449d8266e46fa1c353df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:22:44.076950 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-53b37728-9b4e-4daf-a222-6fff0619cf37 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1" status: 200 len: 1373 microversion: 2.1 time: 0.166484 Jun 20 13:22:44.079605 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3893/7683] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:22:43 2022] GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1 => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:22:45.103048 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f8baf83d-3080-4e8e-bead-850f8bc186f6 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:22:45.104002 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f8baf83d-3080-4e8e-bead-850f8bc186f6 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:22:45.115919 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8baf83d-3080-4e8e-bead-850f8bc186f6 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:45.116742 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8baf83d-3080-4e8e-bead-850f8bc186f6 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:45.118005 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8baf83d-3080-4e8e-bead-850f8bc186f6 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:45.118741 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8baf83d-3080-4e8e-bead-850f8bc186f6 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:45.263597 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-f8baf83d-3080-4e8e-bead-850f8bc186f6 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba34f15a3e24d0fa9fdbfbf681eb241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80031ef91658449d8266e46fa1c353df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:22:45.271866 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f8baf83d-3080-4e8e-bead-850f8bc186f6 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1" status: 200 len: 1373 microversion: 2.1 time: 0.175342 Jun 20 13:22:45.272448 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3791/7684] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:22:45 2022] GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1 => generated 1373 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:22:46.295409 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d36d29d5-5173-4446-8b80-1b72da80f8ff tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:22:46.296045 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d36d29d5-5173-4446-8b80-1b72da80f8ff tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:22:46.304228 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d36d29d5-5173-4446-8b80-1b72da80f8ff tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:46.304736 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d36d29d5-5173-4446-8b80-1b72da80f8ff tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:46.305595 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d36d29d5-5173-4446-8b80-1b72da80f8ff tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:46.306081 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d36d29d5-5173-4446-8b80-1b72da80f8ff tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:46.451909 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-d36d29d5-5173-4446-8b80-1b72da80f8ff tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba34f15a3e24d0fa9fdbfbf681eb241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80031ef91658449d8266e46fa1c353df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:22:46.461106 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d36d29d5-5173-4446-8b80-1b72da80f8ff tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1" status: 200 len: 1373 microversion: 2.1 time: 0.171108 Jun 20 13:22:46.461711 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3894/7685] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:22:46 2022] GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1 => generated 1373 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:22:47.482634 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b2be4347-4206-471c-a09a-0c371675601b tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:22:47.483565 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b2be4347-4206-471c-a09a-0c371675601b tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:22:47.494978 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2be4347-4206-471c-a09a-0c371675601b tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:47.495767 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2be4347-4206-471c-a09a-0c371675601b tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:47.496750 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2be4347-4206-471c-a09a-0c371675601b tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:47.497188 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b2be4347-4206-471c-a09a-0c371675601b tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:47.649762 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-b2be4347-4206-471c-a09a-0c371675601b tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba34f15a3e24d0fa9fdbfbf681eb241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80031ef91658449d8266e46fa1c353df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:22:47.657401 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b2be4347-4206-471c-a09a-0c371675601b tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1" status: 200 len: 1373 microversion: 2.1 time: 0.181555 Jun 20 13:22:47.657979 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3792/7686] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:22:47 2022] GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1 => generated 1373 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:22:47.969056 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-b2ed7d8d-60d9-4f76-9fc0-69fb26edd232 req-e8237b8b-d1f8-4f90-b640-6085eb95fc0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1", "name": "network-vif-plugged", "status": "completed", "tag": "c0e14152-4736-4075-9f95-42854ae16779"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:22:47.979239 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b2ed7d8d-60d9-4f76-9fc0-69fb26edd232 req-e8237b8b-d1f8-4f90-b640-6085eb95fc0f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:47.980056 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b2ed7d8d-60d9-4f76-9fc0-69fb26edd232 req-e8237b8b-d1f8-4f90-b640-6085eb95fc0f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:47.993656 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-b2ed7d8d-60d9-4f76-9fc0-69fb26edd232 req-e8237b8b-d1f8-4f90-b640-6085eb95fc0f service nova] Creating event network-vif-plugged:c0e14152-4736-4075-9f95-42854ae16779 for instance b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1 on n-h2-master-1 Jun 20 13:22:47.999034 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-b2ed7d8d-60d9-4f76-9fc0-69fb26edd232 req-e8237b8b-d1f8-4f90-b640-6085eb95fc0f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033879 Jun 20 13:22:47.999699 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3895/7687] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:22:48.679039 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fb41e589-630d-4775-9b78-24fdf62d004b tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:22:48.680038 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fb41e589-630d-4775-9b78-24fdf62d004b tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:22:48.692272 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fb41e589-630d-4775-9b78-24fdf62d004b tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:48.693041 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fb41e589-630d-4775-9b78-24fdf62d004b tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:48.694699 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fb41e589-630d-4775-9b78-24fdf62d004b tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:48.695447 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fb41e589-630d-4775-9b78-24fdf62d004b tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:48.830572 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-fb41e589-630d-4775-9b78-24fdf62d004b tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba34f15a3e24d0fa9fdbfbf681eb241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80031ef91658449d8266e46fa1c353df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:22:48.838569 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fb41e589-630d-4775-9b78-24fdf62d004b tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1" status: 200 len: 1373 microversion: 2.1 time: 0.166177 Jun 20 13:22:48.839146 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3793/7688] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:22:48 2022] GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1 => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:22:49.858808 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-da92c8f2-5172-4f2f-a59a-8b7f95f350ef tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:22:49.859735 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-da92c8f2-5172-4f2f-a59a-8b7f95f350ef tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:22:49.863268 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=27 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:22:49.870483 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da92c8f2-5172-4f2f-a59a-8b7f95f350ef tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:49.871060 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da92c8f2-5172-4f2f-a59a-8b7f95f350ef tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:49.872019 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da92c8f2-5172-4f2f-a59a-8b7f95f350ef tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:49.872654 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-da92c8f2-5172-4f2f-a59a-8b7f95f350ef tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:50.019358 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-da92c8f2-5172-4f2f-a59a-8b7f95f350ef tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba34f15a3e24d0fa9fdbfbf681eb241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80031ef91658449d8266e46fa1c353df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:22:50.032279 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-da92c8f2-5172-4f2f-a59a-8b7f95f350ef tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1" status: 200 len: 1557 microversion: 2.1 time: 0.178572 Jun 20 13:22:50.033125 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3896/7689] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:22:49 2022] GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1 => generated 1557 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:22:50.050145 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5ac887ef-b0b4-4ef2-86a2-a05fc1c1b7a6 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:22:50.050770 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5ac887ef-b0b4-4ef2-86a2-a05fc1c1b7a6 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:22:50.057355 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5ac887ef-b0b4-4ef2-86a2-a05fc1c1b7a6 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:50.057816 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5ac887ef-b0b4-4ef2-86a2-a05fc1c1b7a6 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:50.058591 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5ac887ef-b0b4-4ef2-86a2-a05fc1c1b7a6 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:50.059040 n-d-master-1 devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5ac887ef-b0b4-4ef2-86a2-a05fc1c1b7a6 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:50.206848 n-d-master-1 devstack@n-api.service[119128]: DEBUG nova.policy [None req-5ac887ef-b0b4-4ef2-86a2-a05fc1c1b7a6 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba34f15a3e24d0fa9fdbfbf681eb241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80031ef91658449d8266e46fa1c353df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:22:50.217905 n-d-master-1 devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5ac887ef-b0b4-4ef2-86a2-a05fc1c1b7a6 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1" status: 200 len: 1557 microversion: 2.1 time: 0.172136 Jun 20 13:22:50.218787 n-d-master-1 devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3794/7690] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:22:50 2022] GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1 => generated 1557 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:22:51.876899 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-904968f4-dc65-4612-8668-753d64eef841 req-6cc5588a-f2ad-435d-beda-d24ce8dee296 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1", "tag": "c0e14152-4736-4075-9f95-42854ae16779"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:22:51.886783 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-904968f4-dc65-4612-8668-753d64eef841 req-6cc5588a-f2ad-435d-beda-d24ce8dee296 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:22:51.887290 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-904968f4-dc65-4612-8668-753d64eef841 req-6cc5588a-f2ad-435d-beda-d24ce8dee296 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:22:51.899413 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-904968f4-dc65-4612-8668-753d64eef841 req-6cc5588a-f2ad-435d-beda-d24ce8dee296 service nova] Creating event network-changed:c0e14152-4736-4075-9f95-42854ae16779 for instance b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1 on n-h2-master-1 Jun 20 13:22:51.905743 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-904968f4-dc65-4612-8668-753d64eef841 req-6cc5588a-f2ad-435d-beda-d24ce8dee296 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032208 Jun 20 13:22:51.906360 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3897/7691] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:22:52.118337 n-d-master-1 devstack@n-api.service[119127]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 13:22:52.118578 n-d-master-1 devstack@n-api.service[119127]: Mon Jun 20 13:22:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 13:24:58.073272 n-d-master-1 devstack@n-api.service[119128]: Traceback (most recent call last): Jun 20 13:24:58.073272 n-d-master-1 devstack@n-api.service[119128]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jun 20 13:24:58.073272 n-d-master-1 devstack@n-api.service[119128]: timer() Jun 20 13:24:58.073272 n-d-master-1 devstack@n-api.service[119128]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jun 20 13:24:58.073272 n-d-master-1 devstack@n-api.service[119128]: cb(*args, **kw) Jun 20 13:24:58.073272 n-d-master-1 devstack@n-api.service[119128]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire Jun 20 13:24:58.073272 n-d-master-1 devstack@n-api.service[119128]: waiter.switch() Jun 20 13:24:58.074362 n-d-master-1 devstack@n-api.service[119128]: greenlet.error: cannot switch to a different thread Jun 20 13:25:00.312593 n-d-master-1 devstack@n-api.service[119127]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 13:25:00.313130 n-d-master-1 devstack@n-api.service[119127]: Mon Jun 20 13:25:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 13:25:59.119158 n-d-master-1 devstack@n-api.service[119127]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e724c47c-e194-481c-b307-79cd496ecce0] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 20 13:25:59.120106 n-d-master-1 devstack@n-api.service[119127]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c8b4e032-3e27-4327-b51f-f4e5667969ed] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 20 13:25:59.121049 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:25:59.121805 n-d-master-1 devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=64 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 13:25:59.126638 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-130088cb-7fe5-4ad3-a933-5b4ebc5d327b tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:25:59.127227 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-130088cb-7fe5-4ad3-a933-5b4ebc5d327b tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:25:59.135117 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-130088cb-7fe5-4ad3-a933-5b4ebc5d327b tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:25:59.135580 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-130088cb-7fe5-4ad3-a933-5b4ebc5d327b tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:25:59.136384 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-130088cb-7fe5-4ad3-a933-5b4ebc5d327b tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:25:59.136822 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-130088cb-7fe5-4ad3-a933-5b4ebc5d327b tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:25:59.165954 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-130088cb-7fe5-4ad3-a933-5b4ebc5d327b tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 13:25:59.258090 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-130088cb-7fe5-4ad3-a933-5b4ebc5d327b tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1" status: 204 len: 0 microversion: 2.1 time: 0.140870 Jun 20 13:25:59.258731 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3898/7692] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 13:25:59 2022] DELETE /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 13:25:59.324736 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-a47ed9d1-fd0f-4c02-82dd-fcd6317a35fd req-217acf78-3852-4787-a6fc-38a32b084ac2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1", "tag": "c0e14152-4736-4075-9f95-42854ae16779"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:25:59.333298 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-a47ed9d1-fd0f-4c02-82dd-fcd6317a35fd req-217acf78-3852-4787-a6fc-38a32b084ac2 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:25:59.333669 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-a47ed9d1-fd0f-4c02-82dd-fcd6317a35fd req-217acf78-3852-4787-a6fc-38a32b084ac2 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:25:59.344806 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-a47ed9d1-fd0f-4c02-82dd-fcd6317a35fd req-217acf78-3852-4787-a6fc-38a32b084ac2 service nova] Creating event network-changed:c0e14152-4736-4075-9f95-42854ae16779 for instance b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1 on n-h2-master-1 Jun 20 13:25:59.350041 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-a47ed9d1-fd0f-4c02-82dd-fcd6317a35fd req-217acf78-3852-4787-a6fc-38a32b084ac2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089931 Jun 20 13:25:59.350652 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3899/7693] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:25:59.356239 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-592fec9e-2788-4c81-a253-a8ac51dfc924 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:25:59.357083 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-592fec9e-2788-4c81-a253-a8ac51dfc924 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:25:59.364388 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-592fec9e-2788-4c81-a253-a8ac51dfc924 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:25:59.364924 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-592fec9e-2788-4c81-a253-a8ac51dfc924 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:25:59.366313 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-592fec9e-2788-4c81-a253-a8ac51dfc924 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:25:59.366431 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-592fec9e-2788-4c81-a253-a8ac51dfc924 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:25:59.550513 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-592fec9e-2788-4c81-a253-a8ac51dfc924 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba34f15a3e24d0fa9fdbfbf681eb241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80031ef91658449d8266e46fa1c353df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:25:59.558376 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-592fec9e-2788-4c81-a253-a8ac51dfc924 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1" status: 200 len: 1682 microversion: 2.1 time: 0.206583 Jun 20 13:25:59.559007 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3900/7694] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:25:59 2022] GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1 => generated 1682 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:26:00.577521 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c49eee2c-80d4-4b6d-8c29-c8ffde44b0ca tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:26:00.578205 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c49eee2c-80d4-4b6d-8c29-c8ffde44b0ca tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:26:00.587677 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c49eee2c-80d4-4b6d-8c29-c8ffde44b0ca tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:26:00.588128 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c49eee2c-80d4-4b6d-8c29-c8ffde44b0ca tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:26:00.588923 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c49eee2c-80d4-4b6d-8c29-c8ffde44b0ca tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:26:00.589356 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c49eee2c-80d4-4b6d-8c29-c8ffde44b0ca tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:26:00.595748 n-d-master-1 devstack@n-api.service[119127]: INFO oslo.messaging._drivers.impl_rabbit [-] [e724c47c-e194-481c-b307-79cd496ecce0] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 48108. Jun 20 13:26:00.596562 n-d-master-1 devstack@n-api.service[119127]: INFO oslo.messaging._drivers.impl_rabbit [-] [c8b4e032-3e27-4327-b51f-f4e5667969ed] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 48110. Jun 20 13:26:00.787752 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-c49eee2c-80d4-4b6d-8c29-c8ffde44b0ca tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba34f15a3e24d0fa9fdbfbf681eb241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80031ef91658449d8266e46fa1c353df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:26:00.797125 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c49eee2c-80d4-4b6d-8c29-c8ffde44b0ca tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1" status: 200 len: 1682 microversion: 2.1 time: 0.223478 Jun 20 13:26:00.797979 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3901/7695] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:26:00 2022] GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1 => generated 1682 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:26:01.364727 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-ac28fddb-4329-4116-a7c7-2fa03f6cab31 req-b269abee-1b04-47a7-b184-81abdcea6f4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1", "name": "network-vif-deleted", "tag": "c0e14152-4736-4075-9f95-42854ae16779"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:26:01.373168 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ac28fddb-4329-4116-a7c7-2fa03f6cab31 req-b269abee-1b04-47a7-b184-81abdcea6f4f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:26:01.373612 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ac28fddb-4329-4116-a7c7-2fa03f6cab31 req-b269abee-1b04-47a7-b184-81abdcea6f4f service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:26:01.385057 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-ac28fddb-4329-4116-a7c7-2fa03f6cab31 req-b269abee-1b04-47a7-b184-81abdcea6f4f service nova] Creating event network-vif-deleted:c0e14152-4736-4075-9f95-42854ae16779 for instance b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1 on n-h2-master-1 Jun 20 13:26:01.390171 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-ac28fddb-4329-4116-a7c7-2fa03f6cab31 req-b269abee-1b04-47a7-b184-81abdcea6f4f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029253 Jun 20 13:26:01.390805 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3902/7696] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 13:26:01.816353 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-17f15451-4166-4163-929c-630b33a71f8f tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:26:01.817039 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-17f15451-4166-4163-929c-630b33a71f8f tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:26:01.823785 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17f15451-4166-4163-929c-630b33a71f8f tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:26:01.824285 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17f15451-4166-4163-929c-630b33a71f8f tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:26:01.825194 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17f15451-4166-4163-929c-630b33a71f8f tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:26:01.825611 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17f15451-4166-4163-929c-630b33a71f8f tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:26:01.841354 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-17f15451-4166-4163-929c-630b33a71f8f tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] HTTP exception thrown: Instance b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1 could not be found. Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-17f15451-4166-4163-929c-630b33a71f8f tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Request method failure captured: Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1 HTTP/1.1 Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisHQAT8GIlHX8o_WKoDHt17qLEfyh0BC5Wv1OROVxMXaed0UFjTdIs2BmQ7i4aPgeBETXj2N3T1lUmxL1NoKYZ_mIuNE8p0stp1yO8aHPZcHBv3UdvCC4NiRAXnfQwtSjgXFUaYO53AvRhfghnbTYa3Px7EVRj0Hh2_CIrbau9RqNx_s Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 80031ef91658449d8266e46fa1c353df Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-TestSnapshotPattern-481899659 Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/80031ef91658449d8266e46fa1c353df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/80031ef91658449d8266e46fa1c353df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/80031ef91658449d8266e46fa1c353df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_80031ef91658449d8266e46fa1c353df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-TestSnapshotPattern-481899659 Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 80031ef91658449d8266e46fa1c353df Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-TestSnapshotPattern-481899659 Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-TestSnapshotPattern-481899659-project Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 9ba34f15a3e24d0fa9fdbfbf681eb241 Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-TestSnapshotPattern-481899659-project Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: exception: Instance b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1 could not be found. Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1'} Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1 could not be found. Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1 could not be found. Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 13:26:01.842733 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 13:26:01.847679 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 13:26:01.847679 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 13:26:01.847679 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 13:26:01.847679 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 13:26:01.847679 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 13:26:01.847679 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1 could not be found. Jun 20 13:26:01.847679 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 13:26:01.847679 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-17f15451-4166-4163-929c-630b33a71f8f tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Returning 404 to user: Instance b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 13:26:01.847679 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-17f15451-4166-4163-929c-630b33a71f8f tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1" status: 404 len: 111 microversion: 2.1 time: 0.033165 Jun 20 13:26:01.847679 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3903/7697] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:26:01 2022] GET /compute/v2.1/servers/b24ea0c6-1ec4-4c45-b1ca-bc6369d37cc1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 13:26:03.704686 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0957f316-b9db-467c-b7f3-1577bccddb1e tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:26:03.705308 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0957f316-b9db-467c-b7f3-1577bccddb1e tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b39ad0dc-8fbc-420d-885c-d85860605652] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:26:03.712831 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0957f316-b9db-467c-b7f3-1577bccddb1e tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:26:03.713368 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0957f316-b9db-467c-b7f3-1577bccddb1e tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:26:03.714178 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0957f316-b9db-467c-b7f3-1577bccddb1e tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:26:03.715149 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0957f316-b9db-467c-b7f3-1577bccddb1e tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:26:03.741133 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0957f316-b9db-467c-b7f3-1577bccddb1e tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b39ad0dc-8fbc-420d-885c-d85860605652] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 13:26:03.821717 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0957f316-b9db-467c-b7f3-1577bccddb1e tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b39ad0dc-8fbc-420d-885c-d85860605652" status: 204 len: 0 microversion: 2.1 time: 0.121176 Jun 20 13:26:03.822510 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3904/7698] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 20 13:26:03 2022] DELETE /compute/v2.1/servers/b39ad0dc-8fbc-420d-885c-d85860605652 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 13:26:03.828099 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-fb0a1c58-7589-4568-9d62-19e24006f11d req-3f3f8371-065c-43fa-b9d1-ce6dadda3d5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b39ad0dc-8fbc-420d-885c-d85860605652", "tag": "3eba53cb-0f43-4471-9eb7-05dde04019ba"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:26:03.839565 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-fb0a1c58-7589-4568-9d62-19e24006f11d req-3f3f8371-065c-43fa-b9d1-ce6dadda3d5b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:26:03.840007 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-fb0a1c58-7589-4568-9d62-19e24006f11d req-3f3f8371-065c-43fa-b9d1-ce6dadda3d5b service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:26:03.854696 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-fb0a1c58-7589-4568-9d62-19e24006f11d req-3f3f8371-065c-43fa-b9d1-ce6dadda3d5b service nova] Creating event network-changed:3eba53cb-0f43-4471-9eb7-05dde04019ba for instance b39ad0dc-8fbc-420d-885c-d85860605652 on n-h1-master-1 Jun 20 13:26:03.860103 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-fb0a1c58-7589-4568-9d62-19e24006f11d req-3f3f8371-065c-43fa-b9d1-ce6dadda3d5b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036175 Jun 20 13:26:03.860760 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3905/7699] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:26:03.866161 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ab54bbc4-670f-4ac5-bd10-6f083c493788 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:26:03.867138 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ab54bbc4-670f-4ac5-bd10-6f083c493788 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b39ad0dc-8fbc-420d-885c-d85860605652] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:26:03.873393 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ab54bbc4-670f-4ac5-bd10-6f083c493788 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:26:03.873839 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ab54bbc4-670f-4ac5-bd10-6f083c493788 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:26:03.874596 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ab54bbc4-670f-4ac5-bd10-6f083c493788 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:26:03.875028 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ab54bbc4-670f-4ac5-bd10-6f083c493788 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:26:04.012547 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ab54bbc4-670f-4ac5-bd10-6f083c493788 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba34f15a3e24d0fa9fdbfbf681eb241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80031ef91658449d8266e46fa1c353df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:26:04.020988 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ab54bbc4-670f-4ac5-bd10-6f083c493788 tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "GET /compute/v2.1/servers/b39ad0dc-8fbc-420d-885c-d85860605652" status: 200 len: 1684 microversion: 2.1 time: 0.158969 Jun 20 13:26:04.021578 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3906/7700] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:26:03 2022] GET /compute/v2.1/servers/b39ad0dc-8fbc-420d-885c-d85860605652 => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:26:05.039499 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ade8a66e-39cf-4abe-9c1c-09af938aa49b tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:26:05.040223 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ade8a66e-39cf-4abe-9c1c-09af938aa49b tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b39ad0dc-8fbc-420d-885c-d85860605652] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:26:05.048037 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ade8a66e-39cf-4abe-9c1c-09af938aa49b tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:26:05.048538 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ade8a66e-39cf-4abe-9c1c-09af938aa49b tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:26:05.049320 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ade8a66e-39cf-4abe-9c1c-09af938aa49b tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:26:05.049758 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ade8a66e-39cf-4abe-9c1c-09af938aa49b tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:26:05.196452 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.policy [None req-ade8a66e-39cf-4abe-9c1c-09af938aa49b tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba34f15a3e24d0fa9fdbfbf681eb241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80031ef91658449d8266e46fa1c353df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 13:26:05.204720 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ade8a66e-39cf-4abe-9c1c-09af938aa49b tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "GET /compute/v2.1/servers/b39ad0dc-8fbc-420d-885c-d85860605652" status: 200 len: 1684 microversion: 2.1 time: 0.169312 Jun 20 13:26:05.205309 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3907/7701] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:26:05 2022] GET /compute/v2.1/servers/b39ad0dc-8fbc-420d-885c-d85860605652 => generated 1684 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 13:26:05.209906 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-3d336a69-eb57-4f3e-8909-556369d79ecc req-f4f350f1-1b03-471e-b124-209adeb7d015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b39ad0dc-8fbc-420d-885c-d85860605652", "name": "network-vif-deleted", "tag": "3eba53cb-0f43-4471-9eb7-05dde04019ba"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 13:26:05.218932 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-3d336a69-eb57-4f3e-8909-556369d79ecc req-f4f350f1-1b03-471e-b124-209adeb7d015 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:26:05.219638 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-3d336a69-eb57-4f3e-8909-556369d79ecc req-f4f350f1-1b03-471e-b124-209adeb7d015 service nova] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:26:05.230987 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-3d336a69-eb57-4f3e-8909-556369d79ecc req-f4f350f1-1b03-471e-b124-209adeb7d015 service nova] Creating event network-vif-deleted:3eba53cb-0f43-4471-9eb7-05dde04019ba for instance b39ad0dc-8fbc-420d-885c-d85860605652 on n-h1-master-1 Jun 20 13:26:05.237136 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-3d336a69-eb57-4f3e-8909-556369d79ecc req-f4f350f1-1b03-471e-b124-209adeb7d015 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030496 Jun 20 13:26:05.237922 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3908/7702] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 20 13:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 13:26:06.228918 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ebb4efe6-efab-4231-9626-2935461ccb2d tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:26:06.230007 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ebb4efe6-efab-4231-9626-2935461ccb2d tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] [instance: b39ad0dc-8fbc-420d-885c-d85860605652] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 13:26:06.238223 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebb4efe6-efab-4231-9626-2935461ccb2d tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:26:06.238676 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebb4efe6-efab-4231-9626-2935461ccb2d tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:26:06.239448 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebb4efe6-efab-4231-9626-2935461ccb2d tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 13:26:06.239887 n-d-master-1 devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebb4efe6-efab-4231-9626-2935461ccb2d tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Lock "d5df985c-a080-4240-bcef-1787de3aeb9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 13:26:06.253700 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-ebb4efe6-efab-4231-9626-2935461ccb2d tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] HTTP exception thrown: Instance b39ad0dc-8fbc-420d-885c-d85860605652 could not be found. Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ebb4efe6-efab-4231-9626-2935461ccb2d tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Request method failure captured: Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/b39ad0dc-8fbc-420d-885c-d85860605652 HTTP/1.1 Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: Accept: application/json Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: Accept-Encoding: identity Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: Connection: close Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: Content-Length: 0 Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: Content-Type: application/json Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: Host: 10.222.0.27 Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: Openstack-System-Scope: None Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.9 Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: X-Auth-Token: gAAAAABisHQAT8GIlHX8o_WKoDHt17qLEfyh0BC5Wv1OROVxMXaed0UFjTdIs2BmQ7i4aPgeBETXj2N3T1lUmxL1NoKYZ_mIuNE8p0stp1yO8aHPZcHBv3UdvCC4NiRAXnfQwtSjgXFUaYO53AvRhfghnbTYa3Px7EVRj0Hh2_CIrbau9RqNx_s Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Id: None Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: X-Domain-Name: None Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: X-Identity-Status: Confirmed Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: X-Is-Admin-Project: True Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Id: default Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: X-Project-Domain-Name: Default Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: X-Project-Id: 80031ef91658449d8266e46fa1c353df Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: X-Project-Name: tempest-TestSnapshotPattern-481899659 Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: X-Role: reader,member Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: X-Roles: reader,member Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/80031ef91658449d8266e46fa1c353df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/80031ef91658449d8266e46fa1c353df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/80031ef91658449d8266e46fa1c353df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_80031ef91658449d8266e46fa1c353df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}] Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: X-Tenant: tempest-TestSnapshotPattern-481899659 Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Id: 80031ef91658449d8266e46fa1c353df Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: X-Tenant-Name: tempest-TestSnapshotPattern-481899659 Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: X-User: tempest-TestSnapshotPattern-481899659-project Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Id: default Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: X-User-Domain-Name: Default Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: X-User-Id: 9ba34f15a3e24d0fa9fdbfbf681eb241 Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: X-User-Name: tempest-TestSnapshotPattern-481899659-project Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: method: > Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: exception: Instance b39ad0dc-8fbc-420d-885c-d85860605652 could not be found. Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: action_args: {'id': 'b39ad0dc-8fbc-420d-885c-d85860605652'} Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b39ad0dc-8fbc-420d-885c-d85860605652 could not be found. Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b39ad0dc-8fbc-420d-885c-d85860605652 could not be found. Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 13:26:06.255386 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 13:26:06.260491 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 13:26:06.260491 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 13:26:06.260491 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 13:26:06.260491 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 13:26:06.260491 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 13:26:06.260491 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b39ad0dc-8fbc-420d-885c-d85860605652 could not be found. Jun 20 13:26:06.260491 n-d-master-1 devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Jun 20 13:26:06.260491 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ebb4efe6-efab-4231-9626-2935461ccb2d tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Returning 404 to user: Instance b39ad0dc-8fbc-420d-885c-d85860605652 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 13:26:06.260491 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ebb4efe6-efab-4231-9626-2935461ccb2d tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "GET /compute/v2.1/servers/b39ad0dc-8fbc-420d-885c-d85860605652" status: 404 len: 111 microversion: 2.1 time: 0.036810 Jun 20 13:26:06.260491 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3909/7703] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 20 13:26:06 2022] GET /compute/v2.1/servers/b39ad0dc-8fbc-420d-885c-d85860605652 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 13:26:06.436032 n-d-master-1 devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a984cc3a-bef3-4b70-9be3-25083b90f01c tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] Calling method '.version_select at 0x7f6073d97ca0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 13:26:06.471520 n-d-master-1 devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a984cc3a-bef3-4b70-9be3-25083b90f01c tempest-TestSnapshotPattern-481899659 tempest-TestSnapshotPattern-481899659-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1032210652" status: 202 len: 0 microversion: 2.1 time: 0.039415 Jun 20 13:26:06.472593 n-d-master-1 devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3910/7704] 10.222.0.27 () {58 vars in 1256 bytes} [Mon Jun 20 13:26:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1032210652 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 13:26:12.129750 n-d-master-1 devstack@n-api.service[119127]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 13:26:12.130533 n-d-master-1 devstack@n-api.service[119127]: Mon Jun 20 13:26:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 13:29:32.142265 n-d-master-1 devstack@n-api.service[119127]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 13:29:32.143115 n-d-master-1 devstack@n-api.service[119127]: Mon Jun 20 13:29:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 13:31:20.617017 n-d-master-1 devstack@n-api.service[119127]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 13:31:20.617764 n-d-master-1 devstack@n-api.service[119127]: Mon Jun 20 13:31:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 13:31:40.327379 n-d-master-1 devstack@n-api.service[119127]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 13:31:40.328717 n-d-master-1 devstack@n-api.service[119127]: Mon Jun 20 13:31:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 13:32:52.153527 n-d-master-1 devstack@n-api.service[119127]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 13:32:52.154347 n-d-master-1 devstack@n-api.service[119127]: Mon Jun 20 13:32:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 13:34:40.631085 n-d-master-1 devstack@n-api.service[119127]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 13:34:40.631874 n-d-master-1 devstack@n-api.service[119127]: Mon Jun 20 13:34:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!